title: The Algebras for Automatic Relations

abstract: We introduce "synchronous algebras", an algebraic structure tailored to recognize automatic relations (a.k.a. synchronous relations, or regular relations). They are the equivalent of monoids for regular languages, however they conceptually differ in two points: first, they are typed and second, they are equipped with a dependency relation expressing constraints between elements of different types. We first show that the three pillars of algebraic language theory hold for synchronous algebras: (a) any relation admits a syntactic synchronous algebra recognizing it, and moreover, the relation is synchronous if, and only if, its minimal algebra is finite; (b) classes of synchronous relations with desirable closure properties (called "pseudovarieties") correspond to pseudovarieties of synchronous algebras; and (c) pseudovarieties of synchronous algebras are exactly the classes of synchronous algebras defined by a generalization of profinite equations called "profinite dependencies". Building on these results, we show how algebraic characterizations of pseudovarieties of regular languages can be lifted to the pseudovarieties of synchronous relations that they induce. A typical (and running) example of such a pseudovariety is the class of "group relations", defined as the relations recognized by finite-state synchronous permutation automata.


title: Deep-learning Optical Flow Outperforms PIV in Obtaining Velocity Fields from Active Nematics

abstract: Deep learning-based optical flow (DLOF) extracts features in adjacent video frames with deep convolutional neural networks. It uses those features to estimate the inter-frame motions of objects at the pixel level. In this article, we evaluate the ability of optical flow to quantify the spontaneous flows of MT-based active nematics under different labeling conditions. We compare DLOF against the commonly used technique, particle imaging velocimetry (PIV). We obtain flow velocity ground truths either by performing semi-automated particle tracking on samples with sparsely labeled filaments, or from passive tracer beads. We find that DLOF produces significantly more accurate velocity fields than PIV for densely labeled samples. We show that the breakdown of PIV arises because the algorithm cannot reliably distinguish contrast variations at high densities, particularly in directions parallel to the nematic director. DLOF overcomes this limitation. For sparsely labeled samples, DLOF and PIV produce results with similar accuracy, but DLOF gives higher-resolution fields. Our work establishes DLOF as a versatile tool for measuring fluid flows in a broad class of active, soft, and biophysical systems.


title: Drop-Connect as a Fault-Tolerance Approach for RRAM-based Deep Neural Network Accelerators

abstract: Resistive random-access memory (RRAM) is widely recognized as a promising emerging hardware platform for deep neural networks (DNNs). Yet, due to manufacturing limitations, current RRAM devices are highly susceptible to hardware defects, which poses a significant challenge to their practical applicability. In this paper, we present a machine learning technique that enables the deployment of defect-prone RRAM accelerators for DNN applications, without necessitating modifying the hardware, retraining of the neural network, or implementing additional detection circuitry/logic. The key idea involves incorporating a drop-connect inspired approach during the training phase of a DNN, where random subsets of weights are selected to emulate fault effects (e.g., set to zero to mimic stuck-at-1 faults), thereby equipping the DNN with the ability to learn and adapt to RRAM defects with the corresponding fault rates. Our results demonstrate the viability of the drop-connect approach, coupled with various algorithm and system-level design and trade-off considerations. We show that, even in the presence of high defect rates (e.g., up to 30%), the degradation of DNN accuracy can be as low as less than 1% compared to that of the fault-free version, while incurring minimal system-level runtime/energy costs.


title: Timing resolution performance of Timepix4 bump-bonded assemblies

abstract: The timing performance of the Timepix4 application-specific integrated circuit (ASIC) bump-bonded to a $100\;\mu\textrm{m}$ thick n-on-p silicon sensor is presented. A picosecond pulsed infrared laser was used to generate electron-hole pairs in the silicon bulk in a repeatable fashion, controlling the amount, position and time of the stimulated charge signal. The timing resolution for a single pixel has been measured to $107\;\textrm{ps}$ r.m.s. for laser-stimulated signals in the silicon sensor bulk. Considering multi-pixel clusters, the measured timing resolution reached $33\;\textrm{ps}$ r.m.s. exploiting oversampling of the timing information over several pixels.


title: GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilots

abstract: Geospatial Copilots unlock unprecedented potential for performing Earth Observation (EO) applications through natural language instructions. However, existing agents rely on overly simplified single tasks and template-based prompts, creating a disconnect with real-world scenarios. In this work, we present GeoLLM-Engine, an environment for tool-augmented agents with intricate tasks routinely executed by analysts on remote sensing platforms. We enrich our environment with geospatial API tools, dynamic maps/UIs, and external multimodal knowledge bases to properly gauge an agent's proficiency in interpreting realistic high-level natural language commands and its functional correctness in task completions. By alleviating overheads typically associated with human-in-the-loop benchmark curation, we harness our massively parallel engine across 100 GPT-4-Turbo nodes, scaling to over half a million diverse multi-tool tasks and across 1.1 million satellite images. By moving beyond traditional single-task image-caption paradigms, we investigate state-of-the-art agents and prompting techniques against long-horizon prompts.


title: Killkan: The Automatic Speech Recognition Dataset for Kichwa with Morphosyntactic Information

abstract: This paper presents Killkan, the first dataset for automatic speech recognition (ASR) in the Kichwa language, an indigenous language of Ecuador. Kichwa is an extremely low-resource endangered language, and there have been no resources before Killkan for Kichwa to be incorporated in applications of natural language processing. The dataset contains approximately 4 hours of audio with transcription, translation into Spanish, and morphosyntactic annotation in the format of Universal Dependencies. The audio data was retrieved from a publicly available radio program in Kichwa. This paper also provides corpus-linguistic analyses of the dataset with a special focus on the agglutinative morphology of Kichwa and frequent code-switching with Spanish. The experiments show that the dataset makes it possible to develop the first ASR system for Kichwa with reliable quality despite its small dataset size. This dataset, the ASR model, and the code used to develop them will be publicly available. Thus, our study positively showcases resource building and its applications for low-resource languages and their community.


title: A New Parameterization for Finding Solutions for Microlensing Exoplanet Light Curves

abstract: The gravitational microlensing method of discovering exoplanets and multi-star systems can produce degenerate solutions, some of which require in-depth analysis to uncover. We propose a new parameter space that can be used to sample potential solutions more efficiently and is more robust at finding all degenerate solutions. We identified two new parameters, k and h, that can be sampled in place of the mass ratios and separations of the systems under analysis to identify degenerate solutions. The parameter k is related to the size of the central caustic, $\Delta\xi_c$, while h is related to the distance of a point along the k contour from log(s)=0, where s is the projected planet-host separation. In this work, we present the characteristics of these parameters and the tests we conducted to prove their efficacy.

categories: astro-ph.EP astro-ph.GA astro-ph.IM astro-ph.SR


title: FedGreen: Carbon-aware Federated Learning with Model Size Adaptation

abstract: Federated learning (FL) provides a promising collaborative framework to build a model from distributed clients, and this work investigates the carbon emission of the FL process. Cloud and edge servers hosting FL clients may exhibit diverse carbon footprints influenced by their geographical locations with varying power sources, offering opportunities to reduce carbon emissions by training local models with adaptive computations and communications. In this paper, we propose FedGreen, a carbon-aware FL approach to efficiently train models by adopting adaptive model sizes shared with clients based on their carbon profiles and locations using ordered dropout as a model compression technique. We theoretically analyze the trade-offs between the produced carbon emissions and the convergence accuracy, considering the carbon intensity discrepancy across countries to choose the parameters optimally. Empirical studies show that FedGreen can substantially reduce the carbon footprints of FL compared to the state-of-the-art while maintaining competitive model accuracy.


title: Simultaneous Chandra and HST observations of the quiescent neutron-star low-mass X-ray binaries in 47 Tucanae

abstract: We present simultaneous Chandra X-ray Observatory and Hubble Space Telescope observations of three certain (X5, X7, W37) and two likely (X4, W17) quiescent neutron-star low-mass X-ray binaries (qLMXBs) in the globular cluster 47 Tuc. We study these systems in the X-ray, optical and near-ultraviolet (NUV) using the simultaneous data and additional non-contemporaneous HST data. We have discovered a blue and variable NUV counterpart to W17. We have not securely identified the eclipsing qLMXB W37 in the optical or NUV. Deeper high-resolution imaging is needed to further investigate the faint NUV excess near the centre of the W37 error circle. We suggest that a previously identified optical astrometric match to X7 is likely the true counterpart. The Halpha emission and the location of the counterpart in the colour-magnitude diagram, indicate that the secondary is probably a non-degenerate, H-rich star. This is consistent with previous results from fitting X7's X-ray spectrum. In X4, the simultaneous X-ray and optical behaviour supports the earlier suggestion that the X-ray variability is driven by changes in accretion rate. The X-ray eclipses in X5 coincide with minima in the optical/NUV light curves. Comparison of the 47 Tuc qLMXBs with the cataclysmic variables (CVs) in the cluster confirms that overall the qLMXBs have larger X-ray-to-optical flux ratios. Based on their optical/NUV colors, we conclude that the accretion disks in the qLMXBs are less prominent than in CVs. This makes the ratio of X-ray flux to excess blue optical flux a powerful discriminator between CVs and qLMXBs.


title: A Population Analysis of 20 Exoplanets Observed from the Optical to the Near-infrared Wavelengths with HST: Evidence for Widespread Stellar Contamination

abstract: We present a population study of 20 exoplanets, ranging from Neptune-like to inflated hot-Jupiter planets, observed during transit with the STIS and WFC3 instruments aboard the Hubble Space Telescope. To obtain spectral information from the near-UV to the near-infrared, we reanalysed sixteen WFC3 and over fifty STIS archival data sets with our dedicated HST pipeline. We also include twenty-four WFC3 data sets previously reduced with the same software. Across our target sample we observe significant divergence among multiple observations conducted with the same STIS grating at various epochs, whilst we do not detect variations in the WFC3 data sets. These results are suggestive of stellar contamination, which we have investigated further using known Bayesian tools and other tailored metrics, facilitating a more objective assessment of stellar activity intensity within each system. Our findings reveal that stellar activity contaminates up to half of the studied exoplanet atmospheres, albeit at varying extents. Accounting for stellar activity can significantly alter planetary atmospheric parameters like molecular abundances (up to 6 orders of magnitude) and temperature (up to 145 %), contrasting with the results of analyses that neglect activity. Our results emphasise the importance of considering the effects of stellar contamination in exoplanet transit studies; this issue is particularly true for data sets obtained with facilities that do not cover the optical and/or UV spectral range where the activity is expected to be more impactful but also more easily detectable. Our results also provide a catalogue of potentially active stars for further investigation and monitoring.


title: Metric3D v2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation

abstract: We introduce Metric3D v2, a geometric foundation model for zero-shot metric depth and surface normal estimation from a single image, which is crucial for metric 3D recovery. While depth and normal are geometrically related and highly complimentary, they present distinct challenges. SoTA monocular depth methods achieve zero-shot generalization by learning affine-invariant depths, which cannot recover real-world metrics. Meanwhile, SoTA normal estimation methods have limited zero-shot performance due to the lack of large-scale labeled data. To tackle these issues, we propose solutions for both metric depth estimation and surface normal estimation. For metric depth estimation, we show that the key to a zero-shot single-view model lies in resolving the metric ambiguity from various camera models and large-scale data training. We propose a canonical camera space transformation module, which explicitly addresses the ambiguity problem and can be effortlessly plugged into existing monocular models. For surface normal estimation, we propose a joint depth-normal optimization module to distill diverse data knowledge from metric depth, enabling normal estimators to learn beyond normal labels. Equipped with these modules, our depth-normal models can be stably trained with over 16 million of images from thousands of camera models with different-type annotations, resulting in zero-shot generalization to in-the-wild images with unseen camera settings. Our method enables the accurate recovery of metric 3D structures on randomly collected internet images, paving the way for plausible single-image metrology. Our project page is at https://JUGGHM.github.io/Metric3Dv2.


title: Light tailored by multimode fiber for multiphoton fluorescence microscopy

abstract: We study the diffraction of a particular class of beams, composed only by a combination of azimuthally invariant guided modes of an optical fiber. We demonstrate that such beams can be obtained by injecting a Gaussian beam in a small piece of silica graded-index multimode fiber. This minimalistic low-cost method is applied for improving the axial resolution of a two-photon microscope.


title: Joint Soil and Above-Ground Biomass Characterization Using Radars

abstract: Soil moisture sensing through biomass or vegetation canopy has challenged researchers, even those who use SAR sensors with penetration capabilities. This is mainly due to the imposed extra time and phase offsets on Radio Frequency (RF) signals as they travel through the canopy. These offsets depend on the vegetation canopy moisture and height, both of which are typically unknown in agricultural and forest fields. In this paper, we leverage the mobility of an unmanned aerial system (UAS) to collect spatially-diverse radar measurements, enabling the joint estimation of soil moisture, above-ground biomass moisture, and biomass height, all without assuming any calibration steps. We leverage the changes in time-of-flight (ToF) and angle-of-arrival (AoA) measurements of reflected radar signals as the UAS flies above a reflector buried under the soil. We demonstrate the effectiveness of our algorithm by simulating its performance under realistic measurement noises as well as conducting lab experiments with different types of above-ground biomass. Our simulation results conclude that our algorithm is capable of estimating volumetric soil moisture to less than 1% median absolute error (MAE), vegetation height to 11.1cm MAE, and vegetation relative permittivity to 0.32 MAE. Our experimental results demonstrate the effectiveness of the proposed method in practical scenarios for varying biomass moistures and heights.


title: SMI-5: Five Dimensions of Social Media Interaction for Platform (De)Centralization

abstract: Web 3.0 focuses on the decentralization of the internet and creating a system of interconnected and independent computers for improved privacy and security. We extend the idea of the decentralization of the web to the social media space: whereby we ask: in the context of the social media space, what does "decentralization" mean? Does decentralization of social media affect user interactions? We put forth the notion that decentralization in the social media does not solely take place on the physical network level, but can be compartmentalized across the entire social media stack. This paper puts forth SMI-5: the five dimensions of social media interaction for describing the (de)centralization of social platforms. We then illustrate a case study that the user interactions differ based on the slices of the SMI layer analyzed, highlighting the importance of understanding the (de)centralization of social media platforms from an a more encompassing perspective rather than only the physical network.


title: NeuraChip: Accelerating GNN Computations with a Hash-based Decoupled Spatial Accelerator

abstract: Graph Neural Networks (GNNs) are emerging as a formidable tool for processing non-euclidean data across various domains, ranging from social network analysis to bioinformatics. Despite their effectiveness, their adoption has not been pervasive because of scalability challenges associated with large-scale graph datasets, particularly when leveraging message passing. To tackle these challenges, we introduce NeuraChip, a novel GNN spatial accelerator based on Gustavson's algorithm. NeuraChip decouples the multiplication and addition computations in sparse matrix multiplication. This separation allows for independent exploitation of their unique data dependencies, facilitating efficient resource allocation. We introduce a rolling eviction strategy to mitigate data idling in on-chip memory as well as address the prevalent issue of memory bloat in sparse graph computations. Furthermore, the compute resource load balancing is achieved through a dynamic reseeding hash-based mapping, ensuring uniform utilization of computing resources agnostic of sparsity patterns. Finally, we present NeuraSim, an open-source, cycle-accurate, multi-threaded, modular simulator for comprehensive performance analysis. Overall, NeuraChip presents a significant improvement, yielding an average speedup of 22.1x over Intel's MKL, 17.1x over NVIDIA's cuSPARSE, 16.7x over AMD's hipSPARSE, and 1.5x over prior state-of-the-art SpGEMM accelerator and 1.3x over GNN accelerator. The source code for our open-sourced simulator and performance visualizer is publicly accessible on GitHub https://neurachip.us


title: The AMC -- What It Is and Why It Matters

abstract: A brief overview and history of the American Mathematics Competitions.


title: Deep Hankel matrices with random elements

abstract: Willems' fundamental lemma enables a trajectory-based characterization of linear systems through data-based Hankel matrices. However, in the presence of measurement noise, we ask: Is this noisy Hankel-based model expressive enough to re-identify itself? In other words, we study the output prediction accuracy from recursively applying the same persistently exciting input sequence to the model. We find an asymptotic connection to this self-consistency question in terms of the amount of data. More importantly, we also connect this question to the depth (number of rows) of the Hankel model, showing the simple act of reconfiguring a finite dataset significantly improves accuracy. We apply these insights to find a parsimonious depth for LQR problems over the trajectory space.


title: Grain boundary segregation prediction with a dual-solute model

abstract: Solute segregation along grain boundaries (GBs) profoundly affects their thermodynamic and kinetic behavior in polycrystalline materials. Recently, it has become a promising strategy for alloy design, mitigating grain growth by reducing excess GB energy and strengthening the GB network in nanocrystalline metals. In this context, the spectrum approach has emerged as a powerful tool to predict GB segregation. However, previous GB segregation predictions using this method relied heavily on single-solute segregation spectra, neglecting the crucial role of solute-solute interactions, which are often incorporated through a fitting parameter. In this work, we developed a dual-solute model whose segregation energy spectrum intrinsically considers the solute-solute interactions. Further improvement was made by describing the volume fraction of GBs as a varying parameter that scales with the total solute concentration and temperature. The refined dual-solute model was attempted to predict the GB segregation at finite temperatures in several binary systems. It shows significant improvement over the single-solute model and can accurately predict the hybrid Molecular Dynamics/Monte Carlo data within a broad temperature range with varying solute concentrations before forming secondary phases. This dual-solute model provides an effective way to statistically predict GB segregation with considerable accuracy in nanocrystalline metals.


title: Numerical study of transitions in lid-driven flows in semicircular cavities

abstract: In this article, three-dimensional (3D) lid-driven flows in semicircular cavities are studied. The numerical solution of the Navier-Stokes equations modeling incompressible viscous fluid flow in cavities is obtained via a methodology combining a first-order accurate operator-splitting scheme, a fictitious domain formulation, and finite element space approximations. The critical Reynolds numbers (Re_{cr}) for having oscillatory flow (a Hopf bifurcation) are obtained. The associated oscillating motion in a semicircular cavity with length equal to width has been studied in detail. Based on the averaged velocity field in one period of oscillating motion, the flow difference (called oscillation mode) between the velocity field and averaged one at several time instances in such period shows almost the same flow pattern for the Reynolds numbers close to Re_{cr}. This oscillation mode in a semicircular cavity shows a close similarity to the one obtained in a shallow cavity, but with some difference in a shallow cavity which is triggered by the presence of two vertical side walls and downstream wall.


title: ToM-LM: Delegating Theory of Mind Reasoning to External Symbolic Executors in Large Language Models

abstract: Theory of Mind (ToM) refers to the ability of individuals to attribute mental states to others. While Large Language Models (LLMs) have shown some promise with ToM ability, they still struggle with complex ToM reasoning. Our approach leverages an external symbolic executor, specifically the SMCDEL model checker, and fine-tuning to improve the ToM reasoning ability of LLMs. In our approach, an LLM is first fine-tuned through pairs of natural language and symbolic formulation representation of ToM problems and is then instructed to generate the symbolic formulation with a one-shot in-context example. The generated symbolic formulation is then executed by the SMCDEL model checker to perform transparent and verifiable ToM reasoning and give the final result. We demonstrate that our approach, ToM-LM, shows a significant improvement over all the constructed baselines. Our study proposes a novel view about externalizing a particular component of ToM reasoning, mainly reasoning about beliefs, and suggests generalizing it to other aspects of ToM reasoning.


title: Visual Delta Generator with Large Multi-modal Models for Semi-supervised Composed Image Retrieval

abstract: Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text, target image. These specific triplets are not as commonly available as simple image-text pairs, limiting the widespread use of CIR and its scalability. On the other hand, zero-shot CIR can be relatively easily trained with image-caption pairs without considering the image-to-image relation, but this approach tends to yield lower accuracy. We propose a new semi-supervised CIR approach where we search for a reference and its related target images in auxiliary data and learn our large language model-based Visual Delta Generator (VDG) to generate text describing the visual difference (i.e., visual delta) between the two. VDG, equipped with fluent language knowledge and being model agnostic, can generate pseudo triplets to boost the performance of CIR models. Our approach significantly improves the existing supervised learning approaches and achieves state-of-the-art results on the CIR benchmarks.


title: A Rotational/Roto-translational Constraint Method for Condensed Matter

abstract: In condensed matter physics, particularly in perovskite materials, the rotational motion of molecules and ions is associated with important issues such as ion conduction mechanism. Constrained Molecular Dynamics (MD) simulations offer a means to separate translational, vibrational, and rotational motions, enabling the independent study of their effects. In this study, we introduce a rotational and roto-translational constraint algorithm based on the Velocity Verlet integrator, which has been implemented into a homebrew version of the CP2K package. The MD results show that our program can selectively constrain the molecules and ions in the system and support long-time MD runs. The algorithm can help the future study of important rotation related dynamic problems in condensed matter systems.


title: An MRP Formulation for Supervised Learning: Generalized Temporal Difference Learning Models

abstract: In traditional statistical learning, data points are usually assumed to be independently and identically distributed (i.i.d.) following an unknown probability distribution. This paper presents a contrasting viewpoint, perceiving data points as interconnected and employing a Markov reward process (MRP) for data modeling. We reformulate the typical supervised learning as an on-policy policy evaluation problem within reinforcement learning (RL), introducing a generalized temporal difference (TD) learning algorithm as a resolution. Theoretically, our analysis draws connections between the solutions of linear TD learning and ordinary least squares (OLS). We also show that under specific conditions, particularly when noises are correlated, the TD's solution proves to be a more effective estimator than OLS. Furthermore, we establish the convergence of our generalized TD algorithms under linear function approximation. Empirical studies verify our theoretical results, examine the vital design of our TD algorithm and show practical utility across various datasets, encompassing tasks such as regression and image classification with deep learning.


title: Are early-type galaxies quenched by present-day environment? A study of dwarfs in the Fornax Cluster

abstract: Galaxies undergo processes throughout their lifetimes that ultimately lead to the expulsion of the gas and the cessation of the star-forming activity. This phenomenon commonly known as quenching, can be caused by environmental processes. For this we use the results of Romero-G\'omez et al. (2024), who analyzed galaxies from the SAMI-Fornax and ATLAS$^{3D}$ survey. Using t$_{90}$ as an approximation for the quenching time and comparing it with the infall time derived from phase-space models, we determine the probability of the quenching being produced by the local environment of galaxies. Our results reveal a relation between galaxy mass and quenching probability. Down to M$_{\star}$ $\sim$10$^{10}$ M$_{\odot}$, galaxies exhibit almost zero probability of quenching, suggesting their independence from environmental effects. As we move into the mass regime of dwarf galaxies, the probability increases with decreasing mass, highlighting their sensitivity to environmental quenching. For the dwarfs, 10$^{7}$ - 10$^{9}$ M$_{\odot}$, 36$\pm$9% of our observational data are consistent with this hypothesis, challenging the idea that the present-day cluster, Fornax, is the primary driver of quenching in the low mass galaxies. We compare these results with cosmological simulations, selecting galaxies under similar conditions to our observational sample. The simulated sample shows lower quenching probabilities as we move down in mass, only 5$\pm$1% of galaxies meet the quenching criteria. This discrepancy between observations and simulations underlines that modelling quenching is still in its infancy. In general, the number of observed galaxies quenched by their environment is lower than expected, which suggests that pre-processing plays a larger role in galaxy evolution. Ultimately, our results highlight the need for higher-quality simulations and refinement of galaxy formation and evolution models.


title: Sur la somme de M\"obius $\sum_{n \leqslant x} \mu(n)n^{-s}$ autour de $s=1$ et des sommes d\'eriv\'ees, premi\`ere \'etude

abstract: We study in an explicit manner the partial sums of the multiplicative inverse of the Riemann zeta function and its derivative.


title: A Ramsey Neutron-Beam Experiment to Search for Ultralight Axion Dark Matter at the ESS

abstract: High-intensity neutron beams, such as those available at the European Spallation Source (ESS), provide new opportunities for fundamental discoveries. Here we discuss a novel Ramsey neutron-beam experiment to search for ultralight axion dark matter through its coupling to neutron spins, which would cause the neutron spins to rotate about the velocity of the neutrons relative to the dark matter halo. We estimate that experiments at the HIBEAM beamline at the ESS can improve the sensitivity to the axion-neutron coupling compared to the current best laboratory limits by up to $2-3$ orders of magnitude over the axion mass range $10^{-22} \, \textrm{eV} - 10^{-16}$ eV.

categories: hep-ph astro-ph.CO nucl-ex physics.ins-det


title: LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models

abstract: Recently developed large language models (LLMs) have been shown to perform remarkably well on a wide range of language understanding tasks. But, can they really "reason" over the natural language? This question has been receiving significant research attention and many reasoning skills such as commonsense, numerical, and qualitative have been studied. However, the crucial skill pertaining to 'logical reasoning' has remained underexplored. Existing work investigating this reasoning ability of LLMs has focused only on a couple of inference rules (such as modus ponens and modus tollens) of propositional and first-order logic. Addressing the above limitation, we comprehensively evaluate the logical reasoning ability of LLMs on 25 different reasoning patterns spanning over propositional, first-order, and non-monotonic logics. To enable systematic evaluation, we introduce LogicBench, a natural language question-answering dataset focusing on the use of a single inference rule. We conduct detailed analysis with a range of LLMs such as GPT-4, ChatGPT, Gemini, Llama-2, and Mistral using chain-of-thought prompting. Experimental results show that existing LLMs do not fare well on LogicBench; especially, they struggle with instances involving complex reasoning and negations. Furthermore, they sometimes overlook contextual information necessary for reasoning to arrive at the correct conclusion. We believe that our work and findings facilitate future research for evaluating and enhancing the logical reasoning ability of LLMs. Data and code are available at https://github.com/Mihir3009/LogicBench.


title: Understanding Hyperbolic Metric Learning through Hard Negative Sampling

abstract: In recent years, there has been a growing trend of incorporating hyperbolic geometry methods into computer vision. While these methods have achieved state-of-the-art performance on various metric learning tasks using hyperbolic distance measurements, the underlying theoretical analysis supporting this superior performance remains under-exploited. In this study, we investigate the effects of integrating hyperbolic space into metric learning, particularly when training with contrastive loss. We identify a need for a comprehensive comparison between Euclidean and hyperbolic spaces regarding the temperature effect in the contrastive loss within the existing literature. To address this gap, we conduct an extensive investigation to benchmark the results of Vision Transformers (ViTs) using a hybrid objective function that combines loss from Euclidean and hyperbolic spaces. Additionally, we provide a theoretical analysis of the observed performance improvement. We also reveal that hyperbolic metric learning is highly related to hard negative sampling, providing insights for future work. This work will provide valuable data points and experience in understanding hyperbolic image embeddings. To shed more light on problem-solving and encourage further investigation into our approach, our code is available online (https://github.com/YunYunY/HypMix).


title: A Rapid Adapting and Continual Learning Spiking Neural Network Path Planning Algorithm for Mobile Robots

abstract: Mapping traversal costs in an environment and planning paths based on this map are important for autonomous navigation. We present a neurobotic navigation system that utilizes a Spiking Neural Network Wavefront Planner and E-prop learning to concurrently map and plan paths in a large and complex environment. We incorporate a novel method for mapping which, when combined with the Spiking Wavefront Planner, allows for adaptive planning by selectively considering any combination of costs. The system is tested on a mobile robot platform in an outdoor environment with obstacles and varying terrain. Results indicate that the system is capable of discerning features in the environment using three measures of cost, (1) energy expenditure by the wheels, (2) time spent in the presence of obstacles, and (3) terrain slope. In just twelve hours of online training, E-prop learns and incorporates traversal costs into the path planning maps by updating the delays in the Spiking Wavefront Planner. On simulated paths, the Spiking Wavefront Planner plans significantly shorter and lower cost paths than A* and RRT*. The spiking wavefront planner is compatible with neuromorphic hardware and could be used for applications requiring low size, weight, and power.


title: Magnetic anisotropy in single-crystalline antiferromagnetic Mn$_2$Au

abstract: Multiple recent studies have identified the metallic antiferromagnet Mn$_2$Au to be a candidate for spintronic applications due to apparent in-plane anisotropy, preserved magnetic properties above room temperature, and current-induced N\'eel vector switching. Crystal growth is complicated by the fact that Mn$_2$Au melts incongruently. We present a bismuth flux method to grow millimeter-scale bulk single crystals of Mn$_2$Au in order to examine the intrinsic anisotropic electrical and magnetic properties. Flux quenching experiments reveal that the Mn$_2$Au crystals precipitate below 550{\deg}C, about 100{\deg}C below the decomposition temperature of Mn$_2$Au. Bulk Mn$_2$Au crystals have a room-temperature resistivity of 16-19 $\mu\Omega$-cm and a residual resistivity ratio of 41. Mn$_2$Au crystals have a dimensionless susceptibility on the order of 10$^{-4}$, comparable to calculated and experimental reports on powder samples. Single-crystal neutron diffraction confirms the in-plane magnetic structure. The tetragonal symmetry of Mn$_2$Au constrains the $ab$-plane magnetic susceptibility to be constant, meaning that $\chi_{100}=\chi_{110}$ in the low-field limit, below any spin-flop transition. We find that three measured magnetic susceptibilities $\chi_{100}$, $\chi_{110}$, and $\chi_{001}$ are the same order of magnitude and agree with the calculated prediction, meaning the low-field susceptibility of Mn$_2$Au is quite isotropic, despite clear differences in $ab$-plane and $ac$-plane magnetocrystalline anisotropy. Mn$_2$Au is calculated to have an extremely high in-plane spin-flop field above 30 T, which is much larger than that of another in-plane antiferromagnet Fe$_2$As (less than 1 T). The subtle anisotropy of intrinsic susceptibilities may lead to dominating effects from shape, crystalline texture, strain, and defects in devices that attempt spin readout in Mn$_2$Au.


title: 3+1 non-linear evolution of Ricci-coupled scalar-Gauss-Bonnet gravity

abstract: Scalar-Gauss-Bonnet (sGB) gravity with an additional coupling between the scalar field and the Ricci scalar exhibits very interesting properties related to black hole stability, evasion of binary pulsar constraints, and general relativity as a late-time cosmology attractor. Furthermore, it was demonstrated that a spherically symmetric collapse is well-posed for a wide range of parameters. In the present paper we examine further the well-posedness through $3+1$ evolution of static and rotating black holes. We show that the evolution is indeed hyperbolic if the weak coupling condition is not severely violated. The loss of hyperbolicity is caused by the gravitational sector of the physical modes, thus it is not an artifact of the gauge choice. We further seek to compare the Ricci-coupled sGB theory against the standard sGB gravity with additional terms in the Gauss-Bonnet coupling. We find strong similarities in terms of well-posedness, but we also point out important differences in the stationary solutions. As a byproduct, we show strong indications that stationary near-extremal scalarized black holes exist within the Ricci-coupled sGB theory, where the scalar field is sourced by the spacetime curvature rather than the black hole spin.


title: NGC1856: Using machine learning techniques to uncover detailed stellar abundances from MUSE data

abstract: We present the first application of the novel approach based on data-driven machine learning methods applied to Multi-Unit Spectroscopic Explorer (MUSE) field data to derive stellar abundances of star clusters. MUSE has been used to target more than 10,000 fields, and it is unique in its ability to study dense stellar fields such as stellar clusters providing spectra for each individual star. We use MUSE data of the extragalactic young stellar cluster NGC 1856, located in the Large Magellanic Cloud (LMC). We present the individual stellar [Fe/H] abundance of 327 cluster members in addition to [Mg/Fe], [Si/Fe], [Ti/Fe], [C/Fe], [Ni/Fe], and [Cr/Fe] abundances of subsample sets. Our results match the LMC abundances obtained in the literature for [Mg/Fe], [Ti/Fe], [Ni/Fe], and [Cr/Fe]. This study is the first to derive [Si/Fe] and [C/Fe] abundances for this cluster. The revolutionary combination of integral-field spectroscopy and data-driven modeling will allow us to understand the chemical enrichment of star clusters and their host galaxies in greater detail expanding our understanding of galaxy evolution.


title: High Contrast, High Angular Resolution Optical Speckle Imaging: Uncovering Hidden Stellar Companions

abstract: We explore the possibility of detecting very faint, very close-in stellar companions using large aperture ground-based telescopes and the technique of optical speckle imaging. We examine the state of high angular resolution speckle imaging and contrast levels being achieved using current speckle cameras on the Gemini 8-m telescope. We then explore the use of the modern image reconstruction technique - Multi-Frame Blind Deconvolution (MFBD) - applied to speckle imaging from the Gemini 8-m telescope. We show that MFBD allows us to measure the flux ratio of the imaged stars to high accuracy and the reconstructed images yield higher precision astrometry. Both of these advances provide a large refinement in the derived astrophysical parameters compared with current Fourier techniques. MFBD image reconstructions reach contrast levels of $\sim$5$\times$10$^{-3}$, near the diffraction limit, to $\sim$10$^{-4}$ about 1.0 arcsec away. At these deep contrast levels with angular limits starting near the 8-m diffraction limit ($\sim$20 mas), most stellar companions to a solar-like stars can be imaged in the optical to near-IR bandpass (320-1000 nm).


title: Path integral approach to bosonisation and nonlinearities in exciton-polariton systems

abstract: Large exciton-polariton optical nonlinearities present a key mechanism for photonics-based communication, ultimately in the quantum regime. Enhanced nonlinear response from various materials hosting excitons and allowing for their strong coupling with light is therefore the topic of intense studies, both in theoretical and experimental domains. Reports on the scattering rates arising due to various system's nonlinearities, such as the exciton-exciton Coulomb interaction and the Pauli blocking that leads to the saturation of the exciton oscillator strength, however, are contradictory. In this work, we develop a formalism allowing to track the exciton nonlinearities appearing in the regime of strong coupling with photons, that includes finite temperatures, mixing of the exciton excited states, and the dark exciton contributions to saturation self-consistently. The equilibrium path integration approach employed here to address the polariton composite nature, leads to a transparent hierarchy of various contributions to nonlinearity. At the same time, by taking the simplest limit of zero temperature and so-called "rigid" excitons, through our framework we retrieve the expressions derived in conventional approaches for exciton interaction constants. In particular, our theory allows to clearly show that such interaction constants cannot be used as fitting parameters tunable in a wide range of values, as they are strictly defined by the material properties, and that other explanations are due for large optical nonlinearities recently reported.


title: Co-existing/Cooperating Multicell Massive MIMO and Cell-Free Massive MIMO Deployments: Heuristic Designs and Performance Analysis

abstract: Cell-free massive MIMO (CF-mMIMO) represent a deeply investigated evolution from the conventional multicell co-located massive MIMO (MC-mMIMO) network deployments. Anticipating a gradual integration of CF-mMIMO systems alongside pre-existing MC-mMIMO network elements, this paper considers a scenario where both deployments coexist, in order to serve a large number of users using a shared set of frequencies. The investigation explores the impact of this coexistence on the network's downlink performance, considering various degrees of mutual cooperation, precoder selection, and power control strategies. Moreover, to take into account the effect of the proposed cooperation scenarios on the fronthaul links, this paper also provides a fronthaul-aware heuristic association algorithm between users and network elements, which permits fulfilling the fronthaul requirement on each link. The research is finally completed by extensive simulations, shedding light on the performance outcomes associated with the diverse cooperation levels and several solutions delineated in the paper.


title: Maximal Procurement under a Budget

abstract: We study the problem of a principal who wants to influence an agent's observable action, subject to an ex-post budget. The agent has a private type determining their cost function. This paper endogenizes the value of the resource driving incentives, which holds no inherent value but is restricted by finite availability. We characterize the optimal mechanism, showing the emergence of a pooling region where the budget constraint binds for low-cost types. We then introduce a linear value for the transferable resource; as the principal's value increases, the mechanism demands more from agents with binding budget constraint but less from others.


title: BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysis

abstract: This paper presents BattleAgent, an emulation system that combines the Large Vision-Language Model and Multi-agent System. This novel system aims to simulate complex dynamic interactions among multiple agents, as well as between agents and their environments, over a period of time. It emulates both the decision-making processes of leaders and the viewpoints of ordinary participants, such as soldiers. The emulation showcases the current capabilities of agents, featuring fine-grained multi-modal interactions between agents and landscapes. It develops customizable agent structures to meet specific situational requirements, for example, a variety of battle-related activities like scouting and trench digging. These components collaborate to recreate historical events in a lively and comprehensive manner while offering insights into the thoughts and feelings of individuals from diverse viewpoints. The technological foundations of BattleAgent establish detailed and immersive settings for historical battles, enabling individual agents to partake in, observe, and dynamically respond to evolving battle scenarios. This methodology holds the potential to substantially deepen our understanding of historical events, particularly through individual accounts. Such initiatives can also aid historical research, as conventional historical narratives often lack documentation and prioritize the perspectives of decision-makers, thereby overlooking the experiences of ordinary individuals. BattelAgent illustrates AI's potential to revitalize the human aspect in crucial social events, thereby fostering a more nuanced collective understanding and driving the progressive development of human society.


title: Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date

abstract: Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.


title: The Ability of Virtual Reality Technologies to Improve Comprehension of Speech Therapy Device Training

abstract: This study evaluates the usage of virtual reality (VR) technologies as a teaching tool in oral placement therapy, a subset of speech therapy. The researcher distributed instructional videos using traditional lecture and modified three-dimensional video to prompt responses. Data was gathered with a two-part Google Form: In "Section 1: Knowledge Test" participants were asked to determine how well they received the information displayed to them. In "Section 2: Opinion Test" participants were asked diagnostic and subjective questions via Likert scale ranging from 1 ("Strongly Disagree") to 5 ("Strongly Agree") to determine how well they enjoyed viewing the information displayed to them. Averages for Section 1 were 92.00% for the control group (viewing 2D, unmodified video) and 77.88% for the experimental group (viewing 3D, VR video). Almost all participants answered at least 60% of the questions correctly. Averages for 2D and 3D participants were 4.53/5 and 3.82/5, respectively for "positive" prompts. Exactly 50% of participants experiencing VR video preferred the method to a traditional lecture. This study determines that virtual reality is viable as a learning tool, but knowledge obtained is not necessarily as high as using traditional lecture. Further experimentation is required to determine how well oral placement therapists respond to physically interacting with a model instead of only viewing it. Copies of the Google Form used to collect responses, all raw data, and a flowchart outlining each step used to construct the 3D video can be found in the Appendix.


title: Constraints on the reheating phase after Higgs inflation in the hybrid metric-Palatini approach

abstract: In this paper, we study the post-inflationary era called reheating stage. For this purpose, we consider a model in which the inflaton is non-minimally coupled to the curvature within the hybrid metric-Palatini approach. Furthermore, to investigate the consistency of our results with the observational data, we relate reheating parameters to those of inflation model. By taking into consideration the Higgs potential $V(\phi)=\lambda/4 \phi^4$; we derive the necessary quantities needed to obtain the reheating duration and the reheating temperature. Moreover, we plot reheating e-folds and temperature as a function of the spectral index, respectively. We consider three cases depending on the coupling constant $\xi$. In addition, we use some specific values of the effective equation of state $\omega$, which is presumed to remain relatively constant within the range of $-\frac{1}{3} \leq \omega < \frac{1}{3}$. We find that for $\xi=10^{-4.1}$ our results are in agreement with the recent Planck data as the reheating instant is corresponding to the central value of the spectral index and to a maximum temperature required by the scale of baryogenesis models.


title: Optimal sizing of 1D vibrating columns accounting for axial compression and self-weight

abstract: We investigate the effect of axial compression on the optimal design of columns, for the maximization of the fundamental vibration frequency. The compression may be due to a force at the columns' tip or to a load distributed along its axis, which may act either independently or simultaneously. We discuss the influence of these contributions on the optimality conditions, and show how the optimal beam design, and the corresponding frequency gain drastically change with the level of compression. We also discuss the indirect effect of frequency optimization on the critical load factors for the tip ($\lambda_{P}$) and distributed ($\lambda_{Q}$) loads. Finally, we provide some quantitative results for the optimal design problem parametrized by the triple ($\lambda_{P}$, $\lambda_{Q}$, $\Omega^{2}$) of buckling and dynamic eigenvalues.


title: Constraining dark energy equations of state in $F(R,T)$ gravity

abstract: In this paper, we examine the acceleration of the Universe's expansion in $F(R,T)$ gravity, where $R$ denotes the Ricci scalar and $T$ the trace of energy-momentum tensor. Indeed, the unknown nature of the source controlling this acceleration in general relativity leads scientists to investigate its properties by means of some alternative theories to general relativity. Our study is restricted to the particular case where $F(R,T)=R+2\kappa^2 \lambda T$ , with $\lambda$ being a constant. We use a Bayesian analysis of current observational datasets, including the type Ia supernovae constitution compilation and $H(z)$ measurements, to constrain free parameters of the model. To parametrize dark energy, we consider two well known equations of state. We find the best fit values for each model by running a Markov chain Monte Carlo technic. The best fit parameters are used to compare both models to $\Lambda$CDM by means of the Akaike information criterion and the Bayesian information criterion. We show that the Universe underwent recently a transition from a deceleration to an acceleration for both models. Furthermore, the data shows a phantom nature of the equation of state for both models.


title: DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraft

abstract: Procedural Content Generation (PCG) algorithms enable the automatic generation of complex and diverse artifacts. However, they don't provide high-level control over the generated content and typically require domain expertise. In contrast, text-to-3D methods allow users to specify desired characteristics in natural language, offering a high amount of flexibility and expressivity. But unlike PCG, such approaches cannot guarantee functionality, which is crucial for certain applications like game design. In this paper, we present a method for generating functional 3D artifacts from free-form text prompts in the open-world game Minecraft. Our method, DreamCraft, trains quantized Neural Radiance Fields (NeRFs) to represent artifacts that, when viewed in-game, match given text descriptions. We find that DreamCraft produces more aligned in-game artifacts than a baseline that post-processes the output of an unconstrained NeRF. Thanks to the quantized representation of the environment, functional constraints can be integrated using specialized loss terms. We show how this can be leveraged to generate 3D structures that match a target distribution or obey certain adjacency rules over the block types. DreamCraft inherits a high degree of expressivity and controllability from the NeRF, while still being able to incorporate functional constraints through domain-specific objectives.


title: Distinguishing noisy crystal symmetries in coarse-grained computer simulations: New procedures for noise reduction and lattice reconstruction

abstract: We suggest new modification (we call it a noise reduction procedure) for Steinhardt parameters which are often used for detecting crystalline structures in computer simulation of solids and soft matter systems. We have also developed a new methodology how to reconstruct "ideal" lattice structure in the whole simulation box that would be most close to a real noisy crystalline symmetry, when it is defined locally and then averaged over the whole box. For this second procedure, which we call lattice reconstruction procedure, we have developed an algorithm for finding the lattice vectors from the values of Steinhardt parameters obtained after the noise reduction procedure. We apply noise to the classical crystalline structures (sc, bcc, fcc, hcp), and use both procedures to detect the crystalline structures in these classical but noisy systems. We demonstrate advantages of our procedures in comparison with existing methods and discuss their applicability limits.


title: A Unified Framework for Total Variation Regularized Optimization in Fluid Dynamics and Related Physical Systems

abstract: An optimization framework is presented for minimizing the energy functional developed around a generalized equation governing physical systems such as fluid dynamics, particle transport, phase transition, and other related systems. The convexity of the energy functional is investigated to derive the necessary conditions for a smooth and global optimum solution. Furthermore, the Total Variation (TV) regularization term is introduced to gain insights into the solution space and convergence analysis of convection-dominated problems. We demonstrate the practical application of our method by applying it to some selected examples such as the Boltzmann, Navier-Stokes, and Maxwell equations.


title: Boundary determination and local rigidity of analytic metrics in the Lorentzian scattering rigidity problem

abstract: We study the scattering rigidity problem in Lorentzian geometry: recovery of a Lorentzian metric from the scattering relation known on a lateral timelike boundary. We show that one can recover the jet of the metric up to a gauge transformation near a lightlike strictly convex point. Assuming that the metric is real analytic, we show that one can recover the metric up to a gauge transformation as well near such a point.


title: Twisted MoSe2 Homobilayer Behaving as a Heterobilayer

abstract: Heterostructures (HSs) formed by the transition-metal dichalcogenides (TMDCs) materials have shown great promise in next-generation optoelectronic and photonic applications. An artificially twisted HS, allows us to manipulate the optical, and electronic properties. With this work, we introduce the understanding of the complex energy transfer (ET) process governed by the dipolar interaction in a twisted molybdenum diselenide (MoSe2) homobilayer without any charge-blocking interlayer. We fabricated an unconventional homobilayer (i.e., HS) with a large twist angle by combining the chemical vapor deposition (CVD) and mechanical exfoliation (Exf.) techniques to fully exploit the lattice parameters mismatch and indirect/direct (CVD/Exf.) bandgap nature. This effectively weaken the charge transfer (CT) process and allows the ET process to take over the carrier recombination channels. We utilize a series of optical and electron spectroscopy techniques complementing by the density functional theory calculations, to describe a massive photoluminescence enhancement from the HS area due to an efficient ET process. Our results show that the electronically decoupled MoSe2 homobilayer is coupled by the ET process, mimicking a 'true' heterobilayer nature.


title: Magnetic ordering and dynamics in monolayers and bilayers of chromium trihalides: atomistic simulations approach

abstract: We analyze magnetic properties of monolayers and bilayers of chromium trihalides, CrI$_3$, in two different stacking configurations: AA and rhombohedral ones. Our main focus is on the corresponding Curie temperatures, hysteresis curves, equilibrium spin structures, and spin wave excitations. To obtain all these magnetic characteristic, we employ the atomistic spin dynamics and Monte Carlo simulation techniques. The model Hamiltonian includes isotropic exchange coupling, magnetic anisotropy, and Dzyaloshinskii-Moriya interaction. Though the latter is relatively weak in CrI$_3$, we consider a more general case assuming also an enhancement of Dzyaloshinskii-Moriya interaction in the corresponding Janus structures and by external electric fields. An important issue of the analysis is the correlation between hysteresis curves and spin configurations in the system, as well as formation of the skyrmion textures.


title: Constructions of Spherical 3-Designs

abstract: Spherical t-designs are Chebyshev-type averaging sets on the d-sphere S^d which are exact for polynomials of degree at most t. This concept was introduced in 1977 by Delsarte, Goethals, and Seidel, who also found the minimum possible size of such designs, in particular, that the number of points in a 3-design on S^d must be at least n>=2d+2. In this paper we give explicit constructions for spherical 3-designs on S^d consisting of n points for d=1 and n>=4; d=2 and n=6; 8; >= 10; d=3 and n=8; >=10; d = 4 and n = 10; 12; >= 14; d>=5 and n>=5(d+1)/2 odd or n>=2d+2 even. We also provide some evidence that 3-designs of other sizes do not exist.


title: Oscillatrons: neural units with time-dependent multifunctionality

abstract: Several branches of computing use a system's physical dynamics to do computation. We show that the dynamics of an underdamped harmonic oscillator can perform multifunctional computation, solving distinct problems at distinct times within a dynamical trajectory. Oscillator computing usually focuses on the oscillator's phase as the information-carrying component. Here we focus on the time-resolved amplitude of an oscillator whose inputs influence its frequency, which has a natural parallel as the activity of a time-dependent neural unit. We call this unit an oscillatron. The activity of an oscillatron at fixed time is a nonmonotonic function of the input, and so it can solve nonlinearly-separable problems such as XOR. The activity of the oscillatron at fixed input is a nonmonotonic function of time, and so it is multifunctional in a temporal sense, able to carry out distinct nonlinear computations at distinct times within the same dynamical trajectory. Time-resolved computing of this nature can be done in or out of equilibrium, with the natural time evolution of the system giving us multiple computations for the price of one.


title: Modular Forms in Combinatorial Optimization

abstract: Combinatorial optimization problems, such as the Asymmetric Traveling Salesman Problem (ATSP), find applications across various domains including logistics, genome sequencing, and robotics. Despite their extensive applications, there have not been significant advancements in deriving optimal solutions for these problems. The lack of theoretical understanding owing to the complex structure of these problems has hindered the development of sophisticated algorithms. This paper proposes an unconventional approach by translating the ATSP into the complex domain, revealing an intrinsic modular nature of the problem. Furthermore, we have exploited modularity conditions to gain deeper insights into both unconstrained and constrained optimal solutions. The theoretical framework laid out in this paper can lead to important results at the intersection of combinatorial optimization and number theory.


title: Fractional quantum Hall effect of partons and the nature of the 8/17 state in the zeroth Landau level of bilayer graphene

abstract: We consider the fractional quantum Hall effect (FQHE) at the filling factor $8/17$, where signatures of incompressibility have been observed in the zeroth Landau level of bilayer graphene. We propose an Abelian state described by the "$\overline{(8/3)}\bar{2}1^{3}$" parton wave function, where a parton itself forms an FQHE state. This state is topologically distinct from the $8/17$ Levin-Halperin state, a daughter state of the Moore-Read state. We carry out extensive numerical exact diagonalization of the Coulomb interaction at 8/17 in the zeroth Landau level of bilayer graphene but find that our results cannot conclusively determine the topological order of the underlying ground state. We work out the low-energy effective theory of the $\overline{(8/3)}\bar{2}1^{3}$ edge and make predictions for experimentally measurable properties of the state which can tell it apart from the 8/17 Levin-Halperin state.


title: Quantum metrology of rotations with mixed spin states

abstract: The efficiency of a quantum metrology protocol can be considerably reduced by the interaction of a quantum system with its environment, resulting in a loss of purity and, consequently, a mixed state for the probing system. In this paper we examine the potential of mixed spin-$j$ states to achieve sensitivity comparable, and even equal, to that of pure states in the measurement of infinitesimal rotations about arbitrary axes. We introduce the concept of mixed optimal quantum rotosensors based on a maximization of the Fisher quantum information and show that it is related to the notion of anticoherence of spin states and its generalization to subspaces. We present several examples of anticoherent subspaces and their associated mixed optimal quantum rotosensors. We also show that the latter maximize negativity for specific bipartitions, reaching the same maximum value as pure states. These results elucidate the interplay between quantum metrology of rotations, anticoherence and entanglement in the framework of mixed spin states.


title: PRISM: Patient Records Interpretation for Semantic Clinical Trial Matching using Large Language Models

abstract: Clinical trial matching is the task of identifying trials for which patients may be potentially eligible. Typically, this task is labor-intensive and requires detailed verification of patient electronic health records (EHRs) against the stringent inclusion and exclusion criteria of clinical trials. This process is manual, time-intensive, and challenging to scale up, resulting in many patients missing out on potential therapeutic options. Recent advancements in Large Language Models (LLMs) have made automating patient-trial matching possible, as shown in multiple concurrent research studies. However, the current approaches are confined to constrained, often synthetic datasets that do not adequately mirror the complexities encountered in real-world medical data. In this study, we present the first, end-to-end large-scale empirical evaluation of clinical trial matching using real-world EHRs. Our study showcases the capability of LLMs to accurately match patients with appropriate clinical trials. We perform experiments with proprietary LLMs, including GPT-4 and GPT-3.5, as well as our custom fine-tuned model called OncoLLM and show that OncoLLM, despite its significantly smaller size, not only outperforms GPT-3.5 but also matches the performance of qualified medical doctors. All experiments were carried out on real-world EHRs that include clinical notes and available clinical trials from a single cancer center in the United States.


title: Fractional maximal operators on weighted variable Lebesgue spaces over the spaces of homogeneous type

abstract: Let $(X,d,\mu)$ is a space of homogeneous type, we establish a new class of fractional-type variable weights $A_{p(\cdot), q(\cdot)}(X)$. Then, we get the new weighted strong-type and weak-type characterizations for fractional maximal operators $M_\eta$ on weighted variable Lebesgue spaces over $(X,d,\mu)$. This study generalizes the results by Cruz-Uribe-Fiorenza-Neugebauer (2012), Bernardis-Dalmasso-Pradolini (2014), Cruz-Uribe-Shukla (2018), and Cruz-Uribe-Cummings (2022).


title: $\gamma_5$ subtleties in distinct regularizations: the Bumblebee model example

abstract: We examine the subtleties of regularization schemes in four-dimensional space ($4S$), related in particular to the introduction of the $\gamma_5$ matrix. To illustrate we use a "Bumblebee" model featuring dynamically induced Lorentz symmetry violation. The analysis centers on how different regularization methods affect the solutions to the gap equation in this model. We highlight the resolution of ambiguities associated with the $\gamma_5$ matrix in ultraviolet divergent integrals by employing an enhanced Implicit Regularization (IREG) method. This method extends IREG to a quasi-four-dimensional space, $Q4S = 4S \oplus X$, drawing parallels with the consistent approach of Dimensional Reduction (DRED). Comparative analysis is conducted against results from the 't Hooft-Veltman regularization scheme, conventional IREG in strict $4S$, and sharp momentum cutoff techniques. Our results illustrate a scheme to compute $\gamma_5$ interactions in physical dimension of divergent amplitudes, confirming the approach in [1].


title: Cross-Temporal Spectrogram Autoencoder (CTSAE): Unsupervised Dimensionality Reduction for Clustering Gravitational Wave Glitches

abstract: The advancement of The Laser Interferometer Gravitational-Wave Observatory (LIGO) has significantly enhanced the feasibility and reliability of gravitational wave detection. However, LIGO's high sensitivity makes it susceptible to transient noises known as glitches, which necessitate effective differentiation from real gravitational wave signals. Traditional approaches predominantly employ fully supervised or semi-supervised algorithms for the task of glitch classification and clustering. In the future task of identifying and classifying glitches across main and auxiliary channels, it is impractical to build a dataset with manually labeled ground-truth. In addition, the patterns of glitches can vary with time, generating new glitches without manual labels. In response to this challenge, we introduce the Cross-Temporal Spectrogram Autoencoder (CTSAE), a pioneering unsupervised method for the dimensionality reduction and clustering of gravitational wave glitches. CTSAE integrates a novel four-branch autoencoder with a hybrid of Convolutional Neural Networks (CNN) and Vision Transformers (ViT). To further extract features across multi-branches, we introduce a novel multi-branch fusion method using the CLS (Class) token. Our model, trained and evaluated on the GravitySpy O3 dataset on the main channel, demonstrates superior performance in clustering tasks when compared to state-of-the-art semi-supervised learning methods. To the best of our knowledge, CTSAE represents the first unsupervised approach tailored specifically for clustering LIGO data, marking a significant step forward in the field of gravitational wave research. The code of this paper is available at https://github.com/Zod-L/CTSAE


title: Superconducting magnetoelectric effects in mesoscopic hybrid structures

abstract: In superconductors that lack inversion symmetry, a supercurrent flow can lead to nondissipative magnetoelectric effects. We offer a straightforward formalism to obtain a supercurrent-induced magnetization in superconductors with broken inversion symmetry, which may have orbital, layer, sublattice, or valley degrees of freedom, multiband noncentrosymmetric superconductors. The nondissipative magnetoelectric effect may find applications in fabricating quantum computation platforms or efficient superconducting spintronic devices. We explore how the current-induced magnetization can be employed to create and manipulate Majorana zero modes in a simple hybrid structure.


title: Online Disjoint Set Covers: Randomization is not Necessary

abstract: In the online disjoint set covers problem, the edges of a hypergraph are revealed online, and the goal is to partition them into a maximum number of disjoint set covers. That is, n nodes of a hypergraph are given at the beginning, and then a sequence of hyperedges (subsets of [n]) is presented to an algorithm. For each hyperedge, an online algorithm must assign a color (an integer). Once an input terminates, the gain of the algorithm is the number of colors that correspond to valid set covers (i.e., the union of hyperedges that have that color contains all n nodes). We present a deterministic online algorithm that is O(log^2 n)-competitive, exponentially improving on the previous bound of O(n) and matching the performance of the best randomized algorithm by Emek et al. [ESA 2019]. For color selection, our algorithm uses a novel potential function, which can be seen as an online counterpart of the derandomization method of conditional probabilities and pessimistic estimators. There are only a few cases where derandomization has been successfully used in the field of online algorithms. In contrast to previous approaches, our result extends this tool to tackle the following new challenges: (i) the potential function derandomizes not only the Chernoff bound, but also the coupon collector's problem, (ii) the value of OPT of the maximization problem is not bounded a priori, and (iii) we do not produce a fractional solution first, but work directly on the input.


title: Planet formation -- observational constraints, physical processes, and compositional patterns

abstract: The goal of planet formation as a field of study is not only to provide the understanding of how planets come into existence. It is also an interdisciplinary bridge which links astronomy to geology and mineralogy. Recent observations of young stars accompanied by their protoplanetary disks (Manara et al. 2022) provide direct insights into the conditions at which planets are forming. These astronomical observations can be taken as initial conditions for the models of planet formation. In this chapter, we first give an brief overview of key observational constraints for planet formation theory derived from both the solar system and from the exoplanet population. We then review physical mechanisms governing planetary system formation and discuss how they can be put together to form global planet formation models. Finally, we discuss how the compositional links from protoplanetary disks to planetary atmospheres put novel constraints on planet formation theory. In particular, we are currently gaining insights into the composition of the inner, planet-forming region within the disks thanks to observations from the James Webb Space Telescope (Grant et al. 2023; Perotti et al. 2023). The task for planet formation modelling is then to link these observational properties and compositional content to the physical properties, and also the elementary inventory of meteorites, the Moon, Earth, and the other planets. If successful, this global approach can provide useful constraints for geological studies.


title: Heavy subsets from microsupports

abstract: We construct partial symplectic quasi-states on a cotangent bundle with the use of microlocal sheaf theory. We also give criteria and characterization for heaviness/superheaviness with respect to the partial symplectic quasi-state.


title: Safe POMDP Online Planning among Dynamic Agents via Adaptive Conformal Prediction

abstract: Online planning for partially observable Markov decision processes (POMDPs) provides efficient techniques for robot decision-making under uncertainty. However, existing methods fall short of preventing safety violations in dynamic environments. This work presents a novel safe POMDP online planning approach that offers probabilistic safety guarantees amidst environments populated by multiple dynamic agents. Our approach utilizes data-driven trajectory prediction models of dynamic agents and applies Adaptive Conformal Prediction (ACP) for assessing the uncertainties in these predictions. Leveraging the obtained ACP-based trajectory predictions, our approach constructs safety shields on-the-fly to prevent unsafe actions within POMDP online planning. Through experimental evaluation in various dynamic environments using real-world pedestrian trajectory data, the proposed approach has been shown to effectively maintain probabilistic safety guarantees while accommodating up to hundreds of dynamic agents.


title: The extended Lipkin model: proposal for implementation in a quantum platform and machine learning analysis of its phase diagram

abstract: We investigate the Extended Lipkin Model (ELM), whose phase diagram mirrors that of the Interacting Boson Approximation model (IBA). Unlike the standard Lipkin model, the ELM (as the IBA) features both first- and second-order quantum shape phase transitions depending on the model parameters. Our goal is to implement the ELM on a quantum platform, leveraging Machine Learning techniques to identify its quantum phase transitions and critical lines. To achieve this, we offer: i) ground state energy calculations using a variational quantum eigensolver; ii) a detailed formulation for ELM dynamics within quantum computing, facilitating experimental exploration of the IBA phase diagram; and iii) a phase diagram determination using various Machine Learning methods. We successfully replicate the ELM ground-state energy using the Adaptive Derivative-Assembled Pseudo-Trotter ansatz Variational Quantum Eigensolver (ADAPT-VQE) algorithm across the entire phase space. Our framework ensures ELM implementation on quantum platforms with controlled errors. Lastly, our ML predictions yield a meaningful phase diagram for the model. Keywords: Quantum Platforms Nuclear Models ADAPT-VQE Quantum Shape Phase Transitions Interacting Boson Approximation Extended Lipkin Model Machine Learning


title: Low-Bandwidth Matrix Multiplication: Faster Algorithms and More General Forms of Sparsity

abstract: In prior work, Gupta et al. (SPAA 2022) presented a distributed algorithm for multiplying sparse $n \times n$ matrices, using $n$ computers. They assumed that the input matrices are uniformly sparse--there are at most $d$ non-zeros in each row and column--and the task is to compute a uniformly sparse part of the product matrix. The sparsity structure is globally known in advance (this is the supported setting). As input, each computer receives one row of each input matrix, and each computer needs to output one row of the product matrix. In each communication round each computer can send and receive one $O(\log n)$-bit message. Their algorithm solves this task in $O(d^{1.907})$ rounds, while the trivial bound is $O(d^2)$. We improve on the prior work in two dimensions: First, we show that we can solve the same task faster, in only $O(d^{1.832})$ rounds. Second, we explore what happens when matrices are not uniformly sparse. We consider the following alternative notions of sparsity: row-sparse matrices (at most $d$ non-zeros per row), column-sparse matrices, matrices with bounded degeneracy (we can recursively delete a row or column with at most $d$ non-zeros), average-sparse matrices (at most $dn$ non-zeros in total), and general matrices.


title: Measuring topological constraint relaxation in ring-linear polymer blends

abstract: Polymers are an effective test-bed for studying topological constraints in condensed matter due to a wide array of synthetically-available chain topologies. When linear and ring polymers are blended together, emergent rheological properties are observed as the blend can be more viscous than either of the individual components. This emergent behavior arises since ring-linear blends can form long-lived topological constraints as the linear polymers thread the ring polymers. Here, we demonstrate how the Gauss linking integral can be used to efficiently evaluate the relaxation of topological constraints in ring-linear polymer blends. For majority-linear blends, the relaxation rate of topological constraints depends primarily on reptation of the linear polymers, resulting in the diffusive time $\tau_{d,R}$ for rings of length $N_R$ blended with linear chains of length $N_l$ to scale as $\tau_{d,R}\sim N_R^2N_L^{3.4}$.


title: Casimir energy on the sphere and 6D CFT trace anomaly

abstract: We elucidate the dependence of the Casimir energy on the trace anomaly coefficients for a six-dimensional CFT on $R\times S^5$. This extends the universal dependence on the central charge in 2D and the relation by Cappelli and Coste in 4D, unveiling the role of the trivial total derivatives in the anomaly that renders the Casimir energy scheme dependent. We obtain $$E_o=-\frac{15}{8}\,a_6 -\frac{5}{12}\,\left(g_5+\frac{1}{4}\,g_7+\frac{1}{2}\,g_8-10\, g_9+g_{10}\right),$$ with $a_6$ being the type A central charge and the $g$'s, the coefficients of five out of six terms that form a basis for trivial total derivatives. The derivation is based on the Polyakov formulas (conformal primitive) resulting from the integration of the trace anomaly. Alternatively, on a 6D conformally flat background the above basis is redundant and one can simplify further to get, in terms of the Schouten scalar $J$ and the Schouten tensor $V$, Branson's basis for trivial total derivatives $\nabla^2\nabla^2 J$, $\nabla^2J^2$ and $\nabla^2|V|^2+2\nabla\cdot(V\cdot\nabla\,J)$ with coefficients $\gamma_1, \gamma_2$ and $\gamma_3$, respectively, \begin{equation} \nonumber E_o=-\frac{15}{8}a_6-\frac{1}{24}\left(\gamma_1-\gamma_2 -\frac{1}{8}\gamma_3\right)~. \end{equation}


title: Polyconvex neural network models of thermoelasticity

abstract: Machine-learning function representations such as neural networks have proven to be excellent constructs for constitutive modeling due to their flexibility to represent highly nonlinear data and their ability to incorporate constitutive constraints, which also allows them to generalize well to unseen data. In this work, we extend a polyconvex hyperelastic neural network framework to thermo-hyperelasticity by specifying the thermodynamic and material theoretic requirements for an expansion of the Helmholtz free energy expressed in terms of deformation invariants and temperature. Different formulations which a priori ensure polyconvexity with respect to deformation and concavity with respect to temperature are proposed and discussed. The physics-augmented neural networks are furthermore calibrated with a recently proposed sparsification algorithm that not only aims to fit the training data but also penalizes the number of active parameters, which prevents overfitting in the low data regime and promotes generalization. The performance of the proposed framework is demonstrated on synthetic data, which illustrate the expected thermomechanical phenomena, and existing temperature-dependent uniaxial tension and tension-torsion experimental datasets.


title: Highly Squeezed States in Ring Resonators: Beyond the Undepleted Pump Approximation

abstract: We present a multimode theory of squeezed state generation in resonant systems valid for arbitrary pump power and including pump depletion. The Hamiltonian is written in terms of asymptotic-in and -out fields from scattering theory, capable of describing a general interaction. As an example we consider the lossy generation of a highly squeezed state by an effective second-order interaction in a silicon nitride ring resonator point-coupled to a waveguide. We calculate the photon number, Schmidt number, and the second-order correlation function of the generated state in the waveguide. The treatment we present provides a path forward to study the deterministic generation of non-Gaussian states in resonant systems.


title: Guided AbsoluteGrad: Magnitude of Gradients Matters to Explanation's Localization and Saliency

abstract: This paper proposes a new gradient-based XAI method called Guided AbsoluteGrad for saliency map explanations. We utilize both positive and negative gradient magnitudes and employ gradient variance to distinguish the important areas for noise deduction. We also introduce a novel evaluation metric named ReCover And Predict (RCAP), which considers the Localization and Visual Noise Level objectives of the explanations. We propose two propositions for these two objectives and prove the necessity of evaluating them. We evaluate Guided AbsoluteGrad with seven gradient-based XAI methods using the RCAP metric and other SOTA metrics in three case studies: (1) ImageNet dataset with ResNet50 model; (2) International Skin Imaging Collaboration (ISIC) dataset with EfficientNet model; (3) the Places365 dataset with DenseNet161 model. Our method surpasses other gradient-based approaches, showcasing the quality of enhanced saliency map explanations through gradient magnitude.


title: CASPR: Automated Evaluation Metric for Contrastive Summarization

abstract: Summarizing comparative opinions about entities (e.g., hotels, phones) from a set of source reviews, often referred to as contrastive summarization, can considerably aid users in decision making. However, reliably measuring the contrastiveness of the output summaries without relying on human evaluations remains an open problem. Prior work has proposed token-overlap based metrics, Distinctiveness Score, to measure contrast which does not take into account the sensitivity to meaning-preserving lexical variations. In this work, we propose an automated evaluation metric CASPR to better measure contrast between a pair of summaries. Our metric is based on a simple and light-weight method that leverages natural language inference (NLI) task to measure contrast by segmenting reviews into single-claim sentences and carefully aggregating NLI scores between them to come up with a summary-level score. We compare CASPR with Distinctiveness Score and a simple yet powerful baseline based on BERTScore. Our results on a prior dataset CoCoTRIP demonstrate that CASPR can more reliably capture the contrastiveness of the summary pairs compared to the baselines.


title: On the existence of thermodynamically stable asymptotically flat black holes

abstract: We use the quasilocal formalism of Brown and York, supplemented with counterterms, to investigate the thermodynamics of asymptotically flat black holes. We consider two families of exact regular black hole solutions, which are thermodynamically stable. The first one consists of four-dimensional static charged hairy black holes in extended supergravity. The second family consists of five-dimensional static charged black holes in Gauss-Bonnet (GB) gravity. Despite the fact that their characteristics are completely different, we found a striking similarity between their thermodynamic behaviour.


title: Cohomology of BiHom-Associative Trialgebras

abstract: The paper concerns the cohomology of (multiplicative) BiHom-associative trialgebras. We first detail the correspondence between central extensions and second cohomology. This is followed by a general cohomology theory that unifies those of BiHom-associative algebras and associative trialgebras. Finally, we introduce one-parameter formal deformations and classify generalized $\alpha\beta$-derivations of 3-dimensional BiHom-associative trialgebras.


title: Dynamics of a small quantum system open to a bath with thermostat

abstract: We investigate dynamics of a small quantum system open to a bath with thermostat. We introduce another bath, called super bath, weakly coupled with the bath to provide it with thermostat, which has either the Lindblad or Redfield type. We treat the interaction between the system and bath via a rigorous perturbation theory. Due to the thermostat, the bath behaves dissipative and stochastic, for which the usual Born-Markov assumption is not needed. We consider a specific example of a harmonic oscillator system, and a photonic bath in a large container, and a super bath of the Caldeira-Legget oscillators distributed on the inner surface of the container. We use the $P$-representation for the total harmonic system. We derive the reduced time-evolution equation for the system by explicitly finding the correlation between the system and bath beyond the product state, that was not obtainable in the previous theory for the system and bath isolated from environment, and marginalizing bath degrees of freedom. Remarkably, the associated dynamic equation for the system density matrix is of the same form as the Redfield master equation with different coefficients depending on thermostat used. We find steady state does not depend on thermostat, but time-dependent state does, that agrees with common expectation. We expect to apply our theory to general systems. Unlike the usual quantum master equations, our reduced dynamics allows investigation for time-dependent protocols and non-equilibrium quantum stochastic dynamics will be investigated in future.


title: Self-gravitating solutions in Yang-Mills-Chern-Simons theory coupled to 3D massive gravity

abstract: We study self-gravitating solutions of 3-dimensional massive gravity coupled to Yang-Mills-Chern-Simons gauge theory. Among these, there is a family of asymptotically Warped-Anti de Sitter black holes that come to generalize previous solutions found in the literature and studied in the context of WAdS$_3$/CFT$_2$. We also present self-gravitating solutions to the 3-dimensional Einstein-Yang-Mills theory, as well as other self-gravitating solutions in the presence of higher-curvature terms.


title: Air-taxi trajectory optimization with aerodynamic and motor models

abstract: Many air-taxi concepts are capable of vertical takeoff and landing, enabling them to fly to and from urban locations. An important capability for these air taxis is the transition between hover and forward flight. We propose a robust methodology for computing optimal takeoff and transition trajectories using surrogate models trained on data from physics-based models. The use of surrogate models reduces the computational complexity and improves the robustness of the trajectory optimization algorithm. We demonstrate the versatility and robustness of the proposed methodology by applying it to 12 trajectory optimization problems that involve air-taxi takeoff and outbound transition. These trajectories are representative of real air-taxi operations, with a variety of constraints derived, in part, from proposed mission requirements.


title: A note on the generalised Hessian of the least squares associated with systems of linear inequalities

abstract: The goal of this note is to point out an erroneous formula for the generalised Hessian of the least squares associated with a system of linear inequalities, that was given in the paper "A finite Newton method for classification" by O.L. Mangasarian (Optim. Methods Softw. 17: 913--929, 2002) and reproduced multiple times in other publications. We also provide sufficient contiditions for the validity of Mangasarian's formula and show that Slater's condition guarantees that some particular elements from the set defined by Mangasarian belong to the generalised Hessian of the corresponding function.


title: Mapping Incidence and Prevalence Peak Data for SIR Forecasting Applications

abstract: Infectious disease modeling and forecasting have played a key role in helping assess and respond to epidemics and pandemics. Recent work has leveraged data on disease peak infection and peak hospital incidence to fit compartmental models for the purpose of forecasting and describing the dynamics of a disease outbreak. Incorporating these data can greatly stabilize a compartmental model fit on early observations, where slight perturbations in the data may lead to model fits that project wildly unrealistic peak infection. We introduce a new method for incorporating historic data on the value and time of peak incidence of hospitalization into the fit for a Susceptible-Infectious-Recovered (SIR) model by formulating the relationship between an SIR model's starting parameters and peak incidence as a system of two equations that can be solved computationally. This approach is assessed for practicality in terms of accuracy and speed of computation via simulation. To exhibit the modeling potential, we update the Dirichlet-Beta State Space modeling framework to use hospital incidence data, as this framework was previously formulated to incorporate only data on total infections.


title: Matrix analogues of some asymptotic methods for Laplace integrals

abstract: The matrix analogues of Laplace's method and Watson's lemma are derived via the approach described by Williams and Wong [J. Approx. Theory 24 (4) (1974), 378-384]. Some examples are also given.


title: Retrieval Head Mechanistically Explains Long-Context Factuality

abstract: Despite the recent progress in long-context language models, it remains elusive how transformer-based models exhibit the capability to retrieve relevant information from arbitrary locations within the long context. This paper aims to address this question. Our systematic investigation across a wide spectrum of models reveals that a special type of attention heads are largely responsible for retrieving information, which we dub retrieval heads. We identify intriguing properties of retrieval heads:(1) universal: all the explored models with long-context capability have a set of retrieval heads; (2) sparse: only a small portion (less than 5\%) of the attention heads are retrieval. (3) intrinsic: retrieval heads already exist in models pretrained with short context. When extending the context length by continual pretraining, it is still the same set of heads that perform information retrieval. (4) dynamically activated: take Llama-2 7B for example, 12 retrieval heads always attend to the required information no matter how the context is changed. The rest of the retrieval heads are activated in different contexts. (5) causal: completely pruning retrieval heads leads to failure in retrieving relevant information and results in hallucination, while pruning random non-retrieval heads does not affect the model's retrieval ability. We further show that retrieval heads strongly influence chain-of-thought (CoT) reasoning, where the model needs to frequently refer back the question and previously-generated context. Conversely, tasks where the model directly generates the answer using its intrinsic knowledge are less impacted by masking out retrieval heads. These observations collectively explain which internal part of the model seeks information from the input tokens. We believe our insights will foster future research on reducing hallucination, improving reasoning, and compressing the KV cache.


title: Jitter Characterization of the HyTI Satellite

abstract: The Hyperspectral Thermal Imager (HyTI) is a technology demonstration mission that will obtain high spatial, spectral, and temporal resolution long-wave infrared images of Earth's surface from a 6U cubesat. HyTI science requires that the pointing accuracy of the optical axis shall not exceed 2.89 arcsec over the 0.5 ms integration time due to microvibration effects (known as jitter). Two sources of vibration are a cryocooler that is added to maintain the detector at 68 K and three orthogonally placed reaction wheels that are a part of the attitude control system. Both of these parts will introduce vibrations that are propagated through to the satellite structure while imaging. Typical methods of characterizing and measuring jitter involve complex finite element methods and specialized equipment and setups. In this paper, we describe a novel method of characterizing jitter for small satellite systems that is low-cost and minimally modifies the subject's mass distribution. The metrology instrument is comprised of a laser source, a small mirror mounted via a 3D printed clamp to a jig, and a lateral effect position-sensing detector. The position-sensing detector samples 1000 Hz and can measure displacements as little as 0.15 arcsec at distances of one meter. This paper provides an experimental procedure that incrementally analyzes vibratory sources to establish causal relationships between sources and the vibratory modes they create. We demonstrate the capabilities of this metrology system and testing procedure on HyTI in the Hawaii Space Flight Lab's clean room. Results include power spectral density plots that show fundamental and higher-order vibratory modal frequencies. Results from metrology show that jitter from reaction wheels meets HyTI system requirements within 3$\sigma$.


title: Designing AI-Enabled Games to Support Social-Emotional Learning for Children with Autism Spectrum Disorders

abstract: Children with autism spectrum disorder (ASD) experience challenges in grasping social-emotional cues, which can result in difficulties in recognizing emotions and understanding and responding to social interactions. Social-emotional intervention is an effective method to improve emotional understanding and facial expression recognition among individuals with ASD. Existing work emphasizes the importance of personalizing interventions to meet individual needs and motivate engagement for optimal outcomes in daily settings. We design a social-emotional game for ASD children, which generates personalized stories by leveraging the current advancement of artificial intelligence. Via a co-design process with five domain experts, this work offers several design insights into developing future AI-enabled gamified systems for families with autistic children. We also propose a fine-tuned AI model and a dataset of social stories for different basic emotions.


title: Granular jamming gripper with integrated suction

abstract: Granular grippers can manipulate a wide variety of objects, but need to be pressed on the object to conform to it. If the object is placed on unstable ground, e.g., on sand or water, this step might cause the object to sink or move away from the gripper, hindering proper operation. We introduce a granular gripper with an integrated suction cup, where suction and jamming are controlled independently. We demonstrate the system's robust and enhanced gripping capabilities by comparing its grasping performance with a typical granular gripper design. We show that the proposed device can grip objects that are challenging for typical granular grippers, including those placed on unstable ground, as the suction cup stabilizes the object, allowing the gripper to conform.