title: Self-organized dynamics of a viscous drop with interfacial nematic activity

abstract: We study emergent dynamics in a viscous drop subject to interfacial nematic activity. Using hydrodynamic simulations, we show how the interplay of nematodynamics, activity-driven flows and surface deformations gives rise to a sequence of self-organized behaviors of increasing complexity, from periodic braiding motions of topological defects to chaotic defect dynamics and active turbulence, along with spontaneous shape changes and translation. Our findings recapitulate qualitative features of experiments and shed light on the mechanisms underpinning morphological dynamics in active interfaces.


title: Missed Connections: Lateral Thinking Puzzles for Large Language Models

abstract: The Connections puzzle published each day by the New York Times tasks players with dividing a bank of sixteen words into four groups of four words that each relate to a common theme. Solving the puzzle requires both common linguistic knowledge (i.e. definitions and typical usage) as well as, in many cases, lateral or abstract thinking. This is because the four categories ascend in complexity, with the most challenging category often requiring thinking about words in uncommon ways or as parts of larger phrases. We investigate the capacity for automated AI systems to play Connections and explore the game's potential as an automated benchmark for abstract reasoning and a way to measure the semantic information encoded by data-driven linguistic systems. In particular, we study both a sentence-embedding baseline and modern large language models (LLMs). We report their accuracy on the task, measure the impacts of chain-of-thought prompting, and discuss their failure modes. Overall, we find that the Connections task is challenging yet feasible, and a strong test-bed for future work.


title: A Learning-to-Rank Formulation of Clustering-Based Approximate Nearest Neighbor Search

abstract: A critical piece of the modern information retrieval puzzle is approximate nearest neighbor search. Its objective is to return a set of $k$ data points that are closest to a query point, with its accuracy measured by the proportion of exact nearest neighbors captured in the returned set. One popular approach to this question is clustering: The indexing algorithm partitions data points into non-overlapping subsets and represents each partition by a point such as its centroid. The query processing algorithm first identifies the nearest clusters -- a process known as routing -- then performs a nearest neighbor search over those clusters only. In this work, we make a simple observation: The routing function solves a ranking problem. Its quality can therefore be assessed with a ranking metric, making the function amenable to learning-to-rank. Interestingly, ground-truth is often freely available: Given a query distribution in a top-$k$ configuration, the ground-truth is the set of clusters that contain the exact top-$k$ vectors. We develop this insight and apply it to Maximum Inner Product Search (MIPS). As we demonstrate empirically on various datasets, learning a simple linear function consistently improves the accuracy of clustering-based MIPS.


title: Visual Prompting for Generalized Few-shot Segmentation: A Multi-scale Approach

abstract: The emergence of attention-based transformer models has led to their extensive use in various tasks, due to their superior generalization and transfer properties. Recent research has demonstrated that such models, when prompted appropriately, are excellent for few-shot inference. However, such techniques are under-explored for dense prediction tasks like semantic segmentation. In this work, we examine the effectiveness of prompting a transformer-decoder with learned visual prompts for the generalized few-shot segmentation (GFSS) task. Our goal is to achieve strong performance not only on novel categories with limited examples, but also to retain performance on base categories. We propose an approach to learn visual prompts with limited examples. These learned visual prompts are used to prompt a multiscale transformer decoder to facilitate accurate dense predictions. Additionally, we introduce a unidirectional causal attention mechanism between the novel prompts, learned with limited examples, and the base prompts, learned with abundant data. This mechanism enriches the novel prompts without deteriorating the base class performance. Overall, this form of prompting helps us achieve state-of-the-art performance for GFSS on two different benchmark datasets: COCO-$20^i$ and Pascal-$5^i$, without the need for test-time optimization (or transduction). Furthermore, test-time optimization leveraging unlabelled test data can be used to improve the prompts, which we refer to as transductive prompt tuning.


title: The bandgap-detuned excitation regime in photonic-crystal resonators

abstract: Control of nonlinear interactions in microresonators enhances access to classical and quantum field states across nearly limitless bandwidth. A recent innovation has been to leverage coherent scattering of the intraresonator pump as a control of group-velocity dispersion and nonlinear frequency shifts, which are precursors for the dynamical evolution of new field states. A uniform periodicity nanostructure addresses backscattering with one resonator mode, and pumping that mode enables universal phase-matching for four-wave mixing with control by the bandgap. Yet, since nonlinear-resonator phenomena are intrinsically multimode and exhibit complex modelocking, here we demonstrate a new approach to controlling nonlinear interactions by creating bandgap modes completely separate from the pump laser. We explore this bandgap-detuned excitation regime through generation of benchmark optical parametric oscillators (OPOs) and soliton microcombs. Indeed, we show that mode-locked states are phase matched more effectively in the bandgap-detuned regime in which we directly control the modal Kerr shift with the bandgaps without perturbing the pump field. In particular, bandgap-detuned excitation enables an arbitrary control of backscattering as a versatile tool for mode-locked state engineering. Our experiments leverage nanophotonic resonators for phase matching of OPOs and solitons, leading to control over threshold power, conversion efficiency, and emission direction that enable application advances in high-capacity signaling and computing, signal generation, and quantum sensing.


title: Let's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions

abstract: Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension questions from these paths and the broader code structure. Responding to the questions requires reading and tracing the code, which is known to support students' learning. At the same time, computing education researchers have witnessed the emergence of Large Language Models (LLMs) that have taken the community by storm. Researchers have demonstrated the applicability of these models especially in the introductory programming context, outlining their performance in solving introductory programming problems and their utility in creating new learning resources. In this work, we explore the capability of the state-of-the-art LLMs (GPT-3.5 and GPT-4) in answering QLCs that are generated from code that the LLMs have created. Our results show that although the state-of-the-art LLMs can create programs and trace program execution when prompted, they easily succumb to similar errors that have previously been recorded for novice programmers. These results demonstrate the fallibility of these models and perhaps dampen the expectations fueled by the recent LLM hype. At the same time, we also highlight future research possibilities such as using LLMs to mimic students as their behavior can indeed be similar for some specific tasks.


title: Learning with 3D rotations, a hitchhiker's guide to SO(3)

abstract: Many settings in machine learning require the selection of a rotation representation. However, choosing a suitable representation from the many available options is challenging. This paper acts as a survey and guide through rotation representations. We walk through their properties that harm or benefit deep learning with gradient-based optimization. By consolidating insights from rotation-based learning, we provide a comprehensive overview of learning functions with rotation representations. We provide guidance on selecting representations based on whether rotations are in the model's input or output and whether the data primarily comprises small angles.


title: Measuring the refractive index and thickness of multilayer samples by Fourier domain optical coherence tomography

abstract: Non-contact measurement of the refractive index and thickness of multilayer biological tissues is of great significance for biomedical applications and can greatly improve medical diagnosis and treatment. In this work, we introduce a theoretical method to simultaneously extract the above information using a Fourier domain optical coherence tomography (FD-OCT) system, in which no additional arrangement and prior information about the object is required other than the OCT interference spectrum. The single reflection components can be extracted from the observed spectrum by isolating the primary spikes in the sample reflectance profile, and then the refractive index and thickness can be obtained by fitting the actual and modeled values of the single reflection spectrum. In a two-layer sample example, the simulation results show that our method can reconstruct the results with high accuracy. The relative error is within 0.01%. The complexity of our approach grows linearly with the number of sample layers, making it well-adapted to multilayer situations. Our method takes into account both single and multiple reflections in multilayer samples and is therefore equally applicable to samples with high refractive index contrast.


title: Equivariant Spatio-Temporal Self-Supervision for LiDAR Object Detection

abstract: Popular representation learning methods encourage feature invariance under transformations applied at the input. However, in 3D perception tasks like object localization and segmentation, outputs are naturally equivariant to some transformations, such as rotation. Using pre-training loss functions that encourage equivariance of features under certain transformations provides a strong self-supervision signal while also retaining information of geometric relationships between transformed feature representations. This can enable improved performance in downstream tasks that are equivariant to such transformations. In this paper, we propose a spatio-temporal equivariant learning framework by considering both spatial and temporal augmentations jointly. Our experiments show that the best performance arises with a pre-training approach that encourages equivariance to translation, scaling, and flip, rotation and scene flow. For spatial augmentations, we find that depending on the transformation, either a contrastive objective or an equivariance-by-classification objective yields best results. To leverage real-world object deformations and motion, we consider sequential LiDAR scene pairs and develop a novel 3D scene flow-based equivariance objective that leads to improved performance overall. We show our pre-training method for 3D object detection which outperforms existing equivariant and invariant approaches in many settings.


title: Data-driven computation of adjoint sensitivities without adjoint solvers: An application to thermoacoustics

abstract: Adjoint methods have been the pillar of gradient-based optimization for decades. They enable the accurate computation of a gradient (sensitivity) of a quantity of interest with respect to all system's parameters in one calculation. When the gradient is embedded in an optimization routine, the quantity of interest can be optimized for the system to have the desired behaviour. Adjoint methods require the system's Jacobian, whose computation can be cumbersome, and is problem dependent. We propose a computational strategy to infer the adjoint sensitivities from data (observables), which bypasses the need of the Jacobian of the physical system. The key component of this strategy is an echo state network, which learns the dynamics of nonlinear regimes with varying parameters, and evolves dynamically via a hidden state. Although the framework is general, we focus on thermoacoustics governed by nonlinear and time-delayed systems. First, we show that a parameter-aware Echo State Network (ESN) infers the parameterized dynamics. Second, we derive the adjoint of the ESN to compute the sensitivity of time-averaged cost functionals. Third, we propose the Thermoacoustic Echo State Network (T-ESN), which hard constrains the physical knowledge in the network architecture. Fourth, we apply the framework to a variety of nonlinear thermoacoustic regimes of a prototypical system. We show that the T-ESN accurately infers the correct adjoint sensitivities of the time-averaged acoustic energy with respect to the flame parameters. The results are robust to noisy data, from periodic, through quasiperiodic, to chaotic regimes. A single network predicts the nonlinear bifurcations on unseen scenarios, and so the inferred adjoint sensitivities are employed to suppress an instability via steepest descent. This work opens new possibilities for gradient-based data-driven design optimization.


title: Testing Mechanisms

abstract: Economists are often interested in the mechanisms by which a particular treatment affects an outcome. This paper develops tests for the ``sharp null of full mediation'' that the treatment $D$ operates on the outcome $Y$ only through a particular conjectured mechanism (or set of mechanisms) $M$. A key observation is that if $D$ is randomly assigned and has a monotone effect on $M$, then $D$ is a valid instrumental variable for the local average treatment effect (LATE) of $M$ on $Y$. Existing tools for testing the validity of the LATE assumptions can thus be used to test the sharp null of full mediation when $M$ and $D$ are binary. We develop a more general framework that allows one to test whether the effect of $D$ on $Y$ is fully explained by a potentially multi-valued and multi-dimensional set of mechanisms $M$, allowing for relaxations of the monotonicity assumption. We further provide methods for lower-bounding the size of the alternative mechanisms when the sharp null is rejected. An advantage of our approach relative to existing tools for mediation analysis is that it does not require stringent assumptions about how $M$ is assigned; on the other hand, our approach helps to answer different questions than traditional mediation analysis by focusing on the sharp null rather than estimating average direct and indirect effects. We illustrate the usefulness of the testable implications in two empirical applications.


title: Simulating Cloud Environments of Connected Vehicles for Anomaly Detection

abstract: The emergence of connected vehicles is driven by increasing customer and regulatory demands. To meet these, more complex software applications, some of which require service-based cloud and edge backends, are developed. When new software is deployed however, the high complexity and interdependencies between components can lead to unforeseen side effects in other system parts. As such, it becomes more challenging to recognize whether deviations to the intended system behavior are occurring, ultimately resulting in higher monitoring efforts and slower responses to errors. To overcome this problem, a simulation of the cloud environment running in parallel to the system is proposed. This approach enables the live comparison between simulated and real cloud behavior. Therefore, a concept is developed mirroring the existing cloud system into a simulation. To collect the necessary data, an observability platform is presented, capturing telemetry and architecture information. Subsequently, a simulation environment is designed that converts the architecture into a simulation model and simulates its dynamic workload by utilizing captured communication data. The proposed concept is evaluated in a real-world application scenario for electric vehicle charging: Vehicles can apply for an unoccupied charging station at a cloud service backend, the latter which manages all incoming requests and performs the assignment. Benchmarks are conducted by comparing the collected telemetry data with the simulated results under different loads and injected faults. The results show that regular cloud behavior is mirrored well by the simulation and that misbehavior due to fault injection is well visible, indicating that simulations are a promising data source for anomaly detection in connected vehicle cloud environments during operation.


title: Diffusion Schr\"odinger Bridge Models for High-Quality MR-to-CT Synthesis for Head and Neck Proton Treatment Planning

abstract: In recent advancements in proton therapy, MR-based treatment planning is gaining momentum to minimize additional radiation exposure compared to traditional CT-based methods. This transition highlights the critical need for accurate MR-to-CT image synthesis, which is essential for precise proton dose calculations. Our research introduces the Diffusion Schr\"odinger Bridge Models (DSBM), an innovative approach for high-quality MR-to-CT synthesis. DSBM learns the nonlinear diffusion processes between MR and CT data distributions. This method improves upon traditional diffusion models by initiating synthesis from the prior distribution rather than the Gaussian distribution, enhancing both generation quality and efficiency. We validated the effectiveness of DSBM on a head and neck cancer dataset, demonstrating its superiority over traditional image synthesis methods through both image-level and dosimetric-level evaluations. The effectiveness of DSBM in MR-based proton treatment planning highlights its potential as a valuable tool in various clinical scenarios.


title: Meta-Decomposition: Dynamic Segmentation Approach Selection in IoT-based Activity Recognition

abstract: Internet of Things (IoT) devices generate heterogeneous data over time; and relying solely on individual data points is inadequate for accurate analysis. Segmentation is a common preprocessing step in many IoT applications, including IoT-based activity recognition, aiming to address the limitations of individual events and streamline the process. However, this step introduces at least two families of uncontrollable biases. The first is caused by the changes made by the segmentation process on the initial problem space, such as dividing the input data into 60 seconds windows. The second category of biases results from the segmentation process itself, including the fixation of the segmentation method and its parameters. To address these biases, we propose to redefine the segmentation problem as a special case of a decomposition problem, including three key components: a decomposer, resolutions, and a composer. The inclusion of the composer task in the segmentation process facilitates an assessment of the relationship between the original problem and the problem after the segmentation. Therefore, It leads to an improvement in the evaluation process and, consequently, in the selection of the appropriate segmentation method. Then, we formally introduce our novel meta-decomposition or learning-to-decompose approach. It reduces the segmentation biases by considering the segmentation as a hyperparameter to be optimized by the outer learning problem. Therefore, meta-decomposition improves the overall system performance by dynamically selecting the appropriate segmentation method without including the mentioned biases. Extensive experiments on four real-world datasets demonstrate the effectiveness of our proposal.


title: Soft Photon Heating: A Semi-Analytic Framework and Applications to $21$cm Cosmology

abstract: The presence of an abundant population of low frequency photons at high redshifts (such as a radio background) can source leading order effects on the evolution of the matter and spin temperatures through rapid free-free absorptions. This effect, known as soft photon heating, can have a dramatic impact on the differential brightness temperature, $\Delta T_{\rm b}$, a central observable in $21$cm cosmology. Here, we introduce a semi-analytic framework to describe the dynamics of soft photon heating, providing a simplified set of evolution equations and a useful numerical scheme which can be used to study this generic effect. We also perform quasi-instantaneous and continuous soft photon injections to elucidate the different regimes in which soft photon heating is expected to impart a significant contribution to the global $21$cm signal and its fluctuations. We find that soft photon backgrounds produced after recombination with spectral index $\gamma > 3.0$ undergo significant free-free absorption, and therefore this heating effect cannot be neglected. The effect becomes stronger with steeper spectral index, and in some cases the injection of a synchrotron-like spectrum ($\gamma = 3.6$) can suppress the amplitude of $\Delta T_{\rm b}$ relative to the standard model prediction, making the global $21$cm signal even more difficult to detect in these scenarios.


title: Incremental Bootstrapping and Classification of Structured Scenes in a Fuzzy Ontology

abstract: We foresee robots that bootstrap knowledge representations and use them for classifying relevant situations and making decisions based on future observations. Particularly for assistive robots, the bootstrapping mechanism might be supervised by humans who should not repeat a training phase several times and should be able to refine the taught representation. We consider robots that bootstrap structured representations to classify some intelligible categories. Such a structure should be incrementally bootstrapped, i.e., without invalidating the identified category models when a new additional category is considered. To tackle this scenario, we presented the Scene Identification and Tagging (SIT) algorithm, which bootstraps structured knowledge representation in a crisp OWL-DL ontology. Over time, SIT bootstraps a graph representing scenes, sub-scenes and similar scenes. Then, SIT can classify new scenes within the bootstrapped graph through logic-based reasoning. However, SIT has issues with sensory data because its crisp implementation is not robust to perception noises. This paper presents a reformulation of SIT within the fuzzy domain, which exploits a fuzzy DL ontology to overcome the robustness issues. By comparing the performances of fuzzy and crisp implementations of SIT, we show that fuzzy SIT is robust, preserves the properties of its crisp formulation, and enhances the bootstrapped representations. On the contrary, the fuzzy implementation of SIT leads to less intelligible knowledge representations than the one bootstrapped in the crisp domain.


title: Piercing the Veil of TVL: DeFi Reappraised

abstract: Total value locked (TVL) is widely used to measure the size and popularity of decentralized finance (DeFi). However, the prevalent TVL calculation framework suffers from a "double counting" issue that results in an inflated metric. We find existing methodologies addressing double counting either inconsistent or flawed. To solve this, we formalize the TVL framework and propose a new framework, total value redeemable (TVR), to accurately assess the true value within DeFi. TVL formalization reveals how DeFi's complex network spreads financial contagion via derivative tokens, amplifying liquidations and stablecoin depegging in market downturns. We construct the DeFi multiplier to quantify the double counting, which mirrors the money multiplier in traditional finance (TradFi). Our measurement finds substantial double counting in DeFi. During the peak of DeFi activity on December 2, 2021, the difference between TVL and TVR was \$139.87 billion, with a TVL-to-TVR ratio of about 2. We further show that TVR is a more stable metric than TVL, especially during market downturns. A 25% decline in the price of Ether (ETH) leads to a \$1 billion greater non-linear decrease in TVL compared to TVR. We also observe a substitution effect between TradFi and DeFi.


title: On the Representation of Block Languages

abstract: In this paper we consider block languages, namely sets of words having the same length, and we propose a new representation for these languages. In particular, given an alphabet of size $k$ and a length $\ell$, these languages can be represented by bitmaps of size $k^\ell$, in which each bit indicates whether the correspondent word, according to the lexicographical order, belongs to the language (bit equal to 1) or not (bit equal to 0). This representation turns out to be a good tool for the investigation of several properties of block languages, making proofs simpler and reasoning clearer. After showing how to convert bitmaps into minimal deterministic and nondeterministic finite automata, we use this representation as a tool to study the deterministic and nondeterministic state complexity of block languages, as well as the costs of basic operations on block languages, in terms of the sizes of the equivalent finite automata.


title: Spatio-temporal patterns of diurnal temperature: a random matrix approach I-case of India

abstract: We consider the spatio-temporal gridded daily diurnal temperature range (DTR) data across India during the 72-year period 1951--2022. We augment this data with information on the El Nino-Southern Oscillation (ENSO) and on the climatic regions (Stamp's and Koeppen's classification) and four seasons of India. We use various matrix theory approaches to trim out strong but routine signals, random matrix theory to remove noise, and novel empirical generalised singular-value distributions to establish retention of essential signals in the trimmed data. We make use of the spatial Bergsma statistics to measure spatial association and identify temporal change points in the spatial-association. In particular, our investigation captures a yet unknown change-point over the 72 years under study with drastic changes in spatial-association of DTR in India. It also brings out changes in spatial association with regard to ENSO. We conclude that while studying/modelling Indian DTR data, due consideration should be granted to the strong spatial association that is being persistently exhibited over decades, and provision should be kept for potential change points in the temporal behaviour, which in turn can bring moderate to dramatic changes in the spatial association pattern. Some of our analysis also reaffirms the conclusions made by other authors, regarding spatial and temporal behavior of DTR, adding our own insights. We consider the data from the yearly, seasonal and climatic zones points of view, and discover several new and interesting statistical structures which should be of interest, especially to climatologists and statisticians. Our methods are not country specific and could be used profitably for DTR data from other geographical areas.


title: How to study the evolution of parametrized games?

abstract: I consider a family of games with corresponding payoff matrices, parametrized by the parameter The informal question of interest is: what game is the best? Instead of attempting to suggest a more or less arbitrary definition of the best game, I allow natural selection to find it through honest competition between games. Specifically, I consider a model of a community composed of populations with different payoff matrices and study the natural selection between the populations. The outcome of the community evolution determines the best game. I develop here a mathematical toolbox, that allows the study of evolution of parametrized games. The developed approach is applied to three examples of parametrized games from the literature: local replicator dynamics, pairwise competition and the game of alleles in diploid genomes.


title: Weyl group twists and representations of quantum affine Borel algebras

abstract: We define categories $\mathcal{O}^w$ of representations of Borel subalgebras $\mathcal{U}_q\mathfrak{b}$ of quantum affine algebras $\mathcal{U}_q\hat{\mathfrak{g}}$, which come from the category $\mathcal{O}$ twisted by Weyl group elements $w$. We construct inductive systems of finite-dimensional $\mathcal{U}_q\mathfrak{b}$-modules twisted by $w$, which provide representations in the category $\mathcal{O}^w$. We also establish a classification of simple modules in these categories $\mathcal{O}^w$. We explore convergent phenomenon of $q$-characters of representations of quantum affine algebras, which conjecturally give the $q$-characters of representations in $\mathcal{O}^w$. Furthermore, we propose a conjecture concerning the relationship between the category $\mathcal{O}$ and the twisted category $\mathcal{O}^w$, and we propose a possible connection with shifted quantum affine algebras.


title: Robust Quasi-Bound States in the continuum: Accidental and Symmetry-Protected Variants in Dielectric Metasurfaces

abstract: Recently, man-made dielectric materials composed of finite-sized dielectric constituents have emerged as a promising platform for quasi-bound states in the continuum (QBICs). These states allow for an extraordinary confinement of light within regions smaller than the wavelength scale. Known for their exceptional quality factors, they have become crucial assets across a diverse array of applications. Given the circumstances, there is a compelling drive to find meta-designs that can possess multiple QBICs. Here, we demonstrate the existence of two different types of QBICs in silicon-based metasurfaces: accidental QBIC and symmetry-protected QBIC. The accidental QBIC evinces notable resilience to variations in geometrical parameters and symmetry, underscoring its capacity to adeptly navigate manufacturing tolerances while consistently upholding a distinguished quality factor of $10^5$. Conversely, the symmetry-protected QBIC inherently correlates with the disruption of unit cell symmetry. As a result, a phase delay yields an efficient channel for substantial energy transference to the continuum, endowing this variant with an exceedingly high quality factor, approaching $10^8$. Moreover, the manifestation of these QBICs stems from the intricate interplay among out-of-plane electric and magnetic dipoles, alongside in-plane quadrupoles exhibiting odd parities.


title: Magnetic structure and component-separated transitions of HoNiSi$_{3}$

abstract: HoNiSi$_{3}$ is an intermetallic compound characterized by two successive antiferromagnetic transitions at $T_{N1} = 6.3$ K and $T_{N2} = 10.4$ K. Here, its zero-field microscopic magnetic structure is inferred from resonant x-ray magnetic diffraction experiments on a single crystalline sample that complement previous bulk magnetic susceptibility data. For $T < T_{N2}$, the primitive magnetic unit cell matches the chemical cell. The magnetic structure features ferromagnetic {\it ac} planes stacked in an antiferromagnetic $\uparrow \downarrow \uparrow \downarrow$ pattern. For $T_{N1} < T < T_{N2}$, the ordered magnetic moment points along $\vec{a}$, and for $T < T_{N1}$ a component along $\vec{c}$ also orders. A symmetry analysis indicates that the magnetic structure for $T<T_{N1}$ is not compatible with the presumed orthorhombic $Cmmm$ space group of the chemical structure, and therefore a slight lattice distortion is implied. Mean-field calculations using a simplified magnetic Hamiltonian, including a reduced set of three independent exchange coupling parameters determined by density functional theory calculations and two crystal electric field terms taken as free-fitting parameters, are able to reproduce the main experimental observations. An alternative approach using a more complete model including seven exchange coupling and nine crystal electric field terms is also explored, where the search of the ground state magnetic structure compatible with the available anisotropic magnetic susceptibility and magnetization data is carried out with the help of an unsupervised machine learning algorithm. The possible magnetic configurations are grouped into five clusters, and the cluster that yields the best comparison with the experimental macroscopic data contains the parameters previously found with the simplified model and also predicts the correct ground-state magnetic structure.


title: Mapping Violence: Developing an Extensive Framework to Build a Bangla Sectarian Expression Dataset from Social Media Interactions

abstract: Communal violence in online forums has become extremely prevalent in South Asia, where many communities of different cultures coexist and share resources. These societies exhibit a phenomenon characterized by strong bonds within their own groups and animosity towards others, leading to conflicts that frequently escalate into violent confrontations. To address this issue, we have developed the first comprehensive framework for the automatic detection of communal violence markers in online Bangla content accompanying the largest collection (13K raw sentences) of social media interactions that fall under the definition of four major violence class and their 16 coarse expressions. Our workflow introduces a 7-step expert annotation process incorporating insights from social scientists, linguists, and psychologists. By presenting data statistics and benchmarking performance using this dataset, we have determined that, aside from the category of Non-communal violence, Religio-communal violence is particularly pervasive in Bangla text. Moreover, we have substantiated the effectiveness of fine-tuning language models in identifying violent comments by conducting preliminary benchmarking on the state-of-the-art Bangla deep learning model.


title: Virtual Foundry Graphnet for Metal Sintering Deformation Prediction

abstract: Metal Sintering is a necessary step for Metal Injection Molded parts and binder jet such as HP's metal 3D printer. The metal sintering process introduces large deformation varying from 25 to 50% depending on the green part porosity. In this paper, we use a graph-based deep learning approach to predict the part deformation, which can speed up the deformation simulation substantially at the voxel level. Running a well-trained Metal Sintering inferencing engine only takes a range of seconds to obtain the final sintering deformation value. The tested accuracy on example complex geometry achieves 0.7um mean deviation for a 63mm testing part.


title: Improved Generalization Bounds for Communication Efficient Federated Learning

abstract: This paper focuses on reducing the communication cost of federated learning by exploring generalization bounds and representation learning. We first characterize a tighter generalization bound for one-round federated learning based on local clients' generalizations and heterogeneity of data distribution (non-iid scenario). We also characterize a generalization bound in R-round federated learning and its relation to the number of local updates (local stochastic gradient descents (SGDs)). Then, based on our generalization bound analysis and our representation learning interpretation of this analysis, we show for the first time that less frequent aggregations, hence more local updates, for the representation extractor (usually corresponds to initial layers) leads to the creation of more generalizable models, particularly for non-iid scenarios. We design a novel Federated Learning with Adaptive Local Steps (FedALS) algorithm based on our generalization bound and representation learning analysis. FedALS employs varying aggregation frequencies for different parts of the model, so reduces the communication cost. The paper is followed with experimental results showing the effectiveness of FedALS.


title: The Ramshaw-Mesina Hybrid Algorithm applied to the Navier Stokes Equations

abstract: In 1991, Ramshaw and Mesina proposed a novel synthesis of penalty methods and artificial compression methods. When the two were balanced they found the combination was 3-4 orders more accurate than either alone. This report begins the study of their interesting method applied to the Navier-Stokes equations. We perform stability analysis, semi-discrete error analysis, and tests of the algorithm. Although most of the results for implicit time discretizations of our numerical tests comply with theirs for explicit time discretizations, the behavior in damping pressure oscillations and violations of incompressibility are different from their findings and our heuristic analysis.


title: Microwave dependent quantum transport characteristics in GaN/AlGaN FETs

abstract: Defects in semiconductors, traditionally seen as detrimental to electronic device performance, have emerged as potential assets in quantum technologies due to their unique quantum properties. This study investigates the interaction between defects and quantum electron transport in GaN/AlGaN field-effect transistors, highlighting the observation of Fano resonances at low temperatures. We observe the resonance spectra and their dependence on gate voltage and magnetic fields. To explain the observed behavior, we construct the possible scenario as a Fano interferometer with finite width. Our findings reveal the potential of semiconductor defects to contribute to the development of quantum information processing, providing their role to key components in next-generation quantum devices.


title: Language Models Still Struggle to Zero-shot Reason about Time Series

abstract: Time series are critical for decision-making in fields like finance and healthcare. Their importance has driven a recent influx of works passing time series into language models, leading to non-trivial forecasting on some datasets. But it remains unknown whether non-trivial forecasting implies that language models can reason about time series. To address this gap, we generate a first-of-its-kind evaluation framework for time series reasoning, including formal tasks and a corresponding dataset of multi-scale time series paired with text captions across ten domains. Using these data, we probe whether language models achieve three forms of reasoning: (1) Etiological Reasoning - given an input time series, can the language model identify the scenario that most likely created it? (2) Question Answering - can a language model answer factual questions about time series? (3) Context-Aided Forecasting - does highly relevant textual context improve a language model's time series forecasts? We find that otherwise highly-capable language models demonstrate surprisingly limited time series reasoning: they score marginally above random on etiological and question answering tasks (up to 30 percentage points worse than humans) and show modest success in using context to improve forecasting. These weakness showcase that time series reasoning is an impactful, yet deeply underdeveloped direction for language model research. We also make our datasets and code public at to support further research in this direction at https://github.com/behavioral-data/TSandLanguage


title: Coherent optical control of quantum Hall edge states

abstract: Current carrying chiral edge states in quantum Hall systems have fascinating properties that are usually studied by electron spectroscopy and interferometry. Here we demonstrate that electron occupation, current, and electron coherence in chiral edge states can be selectively probed and controlled by low-energy electromagnetic radiation in the microwave to infrared range without affecting electron states in the bulk or destroying quantum Hall effect conditions in the bulk of the sample. Both linear and nonlinear optical control is possible due to inevitable violation of adiabaticity and inversion symmetry breaking for electron states near the edge. This opens up new pathways for frequency- and polarization-selective spectroscopy and control of individual edge states.


title: Modelling infectious disease transmission dynamics in conference environments: An individual-based approach

abstract: The global public health landscape is perpetually challenged by the looming threat of infectious diseases. Central to addressing this concern is the imperative to prevent and manage disease transmission during pandemics, particularly in unique settings. This study addresses the transmission dynamics of infectious diseases within conference venues, presenting a computational model designed to simulate transmission processes within a condensed timeframe (one day), beginning with sporadic cases. Our model intricately captures the activities of individual attendees within the conference venue, encompassing meetings, rest intervals, and meal breaks. While meetings entail proximity seating, rest and lunch periods allow attendees to interact with diverse individuals. Moreover, the restroom environment poses an additional avenue for potential infection transmission. Employing an individual-based model, we meticulously replicated the transmission dynamics of infectious diseases, with a specific emphasis on close-contact interactions between infected and susceptible individuals. Through comprehensive analysis of model simulations, we elucidated the intricacies of disease transmission dynamics within conference settings and assessed the efficacy of control strategies to curb disease dissemination. Ultimately, our study proffers a numerical framework for assessing the risk of infectious disease transmission during short-duration conferences, furnishing conference organizers with valuable insights to inform the implementation of targeted prevention and control measures.


title: Predictive Model Development to Identify Failed Healing in Patients after Non-Union Fracture Surgery

abstract: Bone non-union is among the most severe complications associated with trauma surgery, occurring in 10-30% of cases after long bone fractures. Treating non-unions requires a high level of surgical expertise and often involves multiple revision surgeries, sometimes even leading to amputation. Thus, more accurate prognosis is crucial for patient well-being. Recent advances in machine learning (ML) hold promise for developing models to predict non-union healing, even when working with smaller datasets, a commonly encountered challenge in clinical domains. To demonstrate the effectiveness of ML in identifying candidates at risk of failed non-union healing, we applied three ML models (logistic regression, support vector machine, and XGBoost) to the clinical dataset TRUFFLE, which includes 797 patients with long bone non-union. The models provided prediction results with 70% sensitivity, and the specificities of 66% (XGBoost), 49% (support vector machine), and 43% (logistic regression). These findings offer valuable clinical insights because they enable early identification of patients at risk of failed non-union healing after the initial surgical revision treatment protocol.


title: A computational scheme connecting gene regulatory network dynamics with heterogeneous stem cell regeneration

abstract: Stem cell regeneration is a vital biological process in self-renewing tissues, governing development and tissue homeostasis. Gene regulatory network dynamics are pivotal in controlling stem cell regeneration and cell type transitions. However, integrating the quantitative dynamics of gene regulatory networks at the single-cell level with stem cell regeneration at the population level poses significant challenges. This study presents a computational framework connecting gene regulatory network dynamics with stem cell regeneration through a data-driven formulation of the inheritance function. The inheritance function captures epigenetic state transitions during cell division in heterogeneous stem cell populations. Our scheme allows the derivation of the inheritance function based on a hybrid model of cross-cell-cycle gene regulation network dynamics. The proposed scheme enables us to derive the inheritance function based on the hybrid model of cross-cell-cycle gene regulation network dynamics. By explicitly incorporating gene regulatory network structure, it replicates cross-cell-cycling gene regulation dynamics through individual-cell-based modeling. The numerical scheme holds the potential for extension to diverse gene regulatory networks, facilitating a deeper understanding of the connection between gene regulation dynamics and stem cell regeneration.


title: IrrNet: Advancing Irrigation Mapping with Incremental Patch Size Training on Remote Sensing Imagery

abstract: Irrigation mapping plays a crucial role in effective water management, essential for preserving both water quality and quantity, and is key to mitigating the global issue of water scarcity. The complexity of agricultural fields, adorned with diverse irrigation practices, especially when multiple systems coexist in close quarters, poses a unique challenge. This complexity is further compounded by the nature of Landsat's remote sensing data, where each pixel is rich with densely packed information, complicating the task of accurate irrigation mapping. In this study, we introduce an innovative approach that employs a progressive training method, which strategically increases patch sizes throughout the training process, utilizing datasets from Landsat 5 and 7, labeled with the WRLU dataset for precise labeling. This initial focus allows the model to capture detailed features, progressively shifting to broader, more general features as the patch size enlarges. Remarkably, our method enhances the performance of existing state-of-the-art models by approximately 20%. Furthermore, our analysis delves into the significance of incorporating various spectral bands into the model, assessing their impact on performance. The findings reveal that additional bands are instrumental in enabling the model to discern finer details more effectively. This work sets a new standard for leveraging remote sensing imagery in irrigation mapping.


title: The Code the World Depends On: A First Look at Technology Makers' Open Source Software Dependencies

abstract: Open-source software (OSS) supply chain security has become a topic of concern for organizations. Patching an OSS vulnerability can require updating other dependent software products in addition to the original package. However, the landscape of OSS dependencies is not well explored: we do not know what packages are most critical to patch, hindering efforts to improve OSS security where it is most needed. There is thus a need to understand OSS usage in major software and device makers' products. Our work takes a first step toward closing this knowledge gap. We investigate published OSS dependency information for 108 major software and device makers, cataloging how available and how detailed this information is and identifying the OSS packages that appear the most frequently in our data.


title: Multimodal 3D Object Detection on Unseen Domains

abstract: LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience performance degradation. Domain adaptation approaches assume access to unannotated samples from the test distribution to address this problem. However, in the real world, the exact conditions of deployment and access to samples representative of the test dataset may be unavailable while training. We argue that the more realistic and challenging formulation is to require robustness in performance to unseen target domains. We propose to address this problem in a two-pronged manner. First, we leverage paired LiDAR-image data present in most autonomous driving datasets to perform multimodal object detection. We suggest that working with multimodal features by leveraging both images and LiDAR point clouds for scene understanding tasks results in object detectors more robust to unseen domain shifts. Second, we train a 3D object detector to learn multimodal object features across different distributions and promote feature invariance across these source domains to improve generalizability to unseen target domains. To this end, we propose CLIX$^\text{3D}$, a multimodal fusion and supervised contrastive learning framework for 3D object detection that performs alignment of object features from same-class samples of different domains while pushing the features from different classes apart. We show that CLIX$^\text{3D}$ yields state-of-the-art domain generalization performance under multiple dataset shifts.


title: 2D capsid formation within an oscillatory energy landscape: orderly self-assembly depends on the interplay between a dynamic potential and intrinsic relaxation times

abstract: Multiple dissipative self-assembly protocols designed to create novel structures or to reduce kinetic traps have recently emerged. Specifically, temporal oscillations of particle interactions have been shown effective at both aims, but investigations thus far have focused on systems of simple colloids or their binary mixtures. In this work, we expand our understanding of the effect of temporally oscillating interactions to a two-dimensional coarse-grained viral capsid-like model that undergoes a self-limited assembly. This model includes multiple intrinsic relaxation times due to the internal structure of the capsid subunits and, under certain interaction regimes, proceeds via a two-step nucleation mechanism. We find that oscillations much faster than the local intrinsic relaxation times can be described via a time averaged inter-particle potential across a wide range of interaction strengths, while oscillations much slower than these relaxation times result in structures that adapt to the attraction strength of the current half-cycle. Interestingly, oscillations periods similar to these relaxation times shift the interaction window over which orderly assembly occurs by enabling error correction during the half-cycles with weaker attractions. Our results provide fundamental insights to non-equilibrium self-assembly on temporally variant energy landscapes.


title: End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver

abstract: Deep learning has been widely applied to solve partial differential equations (PDEs) in computational fluid dynamics. Recent research proposed a PDE correction framework that leverages deep learning to correct the solution obtained by a PDE solver on a coarse mesh. However, end-to-end training of such a PDE correction model over both solver-dependent parameters such as mesh parameters and neural network parameters requires the PDE solver to support automatic differentiation through the iterative numerical process. Such a feature is not readily available in many existing solvers. In this study, we explore the feasibility of end-to-end training of a hybrid model with a black-box PDE solver and a deep learning model for fluid flow prediction. Specifically, we investigate a hybrid model that integrates a black-box PDE solver into a differentiable deep graph neural network. To train this model, we use a zeroth-order gradient estimator to differentiate the PDE solver via forward propagation. Although experiments show that the proposed approach based on zeroth-order gradient estimation underperforms the baseline that computes exact derivatives using automatic differentiation, our proposed method outperforms the baseline trained with a frozen input mesh to the solver. Moreover, with a simple warm-start on the neural network parameters, we show that models trained by these zeroth-order algorithms achieve an accelerated convergence and improved generalization performance.


title: Regret Analysis in Threshold Policy Design

abstract: Threshold policies are targeting mechanisms that assign treatments based on whether an observable characteristic exceeds a certain threshold. They are widespread across multiple domains, such as welfare programs, taxation, and clinical medicine. This paper addresses the problem of designing threshold policies using experimental data, when the goal is to maximize the population welfare. First, I characterize the regret (a measure of policy optimality) of the Empirical Welfare Maximizer (EWM) policy, popular in the literature. Next, I introduce the Smoothed Welfare Maximizer (SWM) policy, which improves the EWM's regret convergence rate under an additional smoothness condition. The two policies are compared studying how differently their regrets depend on the population distribution, and investigating their finite sample performances through Monte Carlo simulations. In many contexts, the welfare guaranteed by the novel SWM policy is larger than with the EWM. An empirical illustration demonstrates how the treatment recommendation of the two policies may in practice notably differ.


title: Tensor-Networks-based Learning of Probabilistic Cellular Automata Dynamics

abstract: Algorithms developed to solve many-body quantum problems, like tensor networks, can turn into powerful quantum-inspired tools to tackle problems in the classical domain. In this work, we focus on matrix product operators, a prominent numerical technique to study many-body quantum systems, especially in one dimension. It has been previously shown that such a tool can be used for classification, learning of deterministic sequence-to-sequence processes and of generic quantum processes. We further develop a matrix product operator algorithm to learn probabilistic sequence-to-sequence processes and apply this algorithm to probabilistic cellular automata. This new approach can accurately learn probabilistic cellular automata processes in different conditions, even when the process is a probabilistic mixture of different chaotic rules. In addition, we find that the ability to learn these dynamics is a function of the bit-wise difference between the rules and whether one is much more likely than the other.


title: QGen: On the Ability to Generalize in Quantization Aware Training

abstract: Quantization lowers memory usage, computational requirements, and latency by utilizing fewer bits to represent model weights and activations. In this work, we investigate the generalization properties of quantized neural networks, a characteristic that has received little attention despite its implications on model performance. In particular, first, we develop a theoretical model for quantization in neural networks and demonstrate how quantization functions as a form of regularization. Second, motivated by recent work connecting the sharpness of the loss landscape and generalization, we derive an approximate bound for the generalization of quantized models conditioned on the amount of quantization noise. We then validate our hypothesis by experimenting with over 2000 models trained on CIFAR-10, CIFAR-100, and ImageNet datasets on convolutional and transformer-based models.


title: Event-Based Eye Tracking. AIS 2024 Challenge Survey

abstract: This survey reviews the AIS 2024 Event-Based Eye Tracking (EET) Challenge. The task of the challenge focuses on processing eye movement recorded with event cameras and predicting the pupil center of the eye. The challenge emphasizes efficient eye tracking with event cameras to achieve good task accuracy and efficiency trade-off. During the challenge period, 38 participants registered for the Kaggle competition, and 8 teams submitted a challenge factsheet. The novel and diverse methods from the submitted factsheets are reviewed and analyzed in this survey to advance future event-based eye tracking research.


title: IoT-Driven Cloud-based Energy and Environment Monitoring System for Manufacturing Industry

abstract: This research focused on the development of a cost-effective IoT solution for energy and environment monitoring geared towards manufacturing industries. The proposed system is developed using open-source software that can be easily deployed in any manufacturing environment. The system collects real-time temperature, humidity, and energy data from different devices running on different communication such as TCP/IP, Modbus, etc., and the data is transferred wirelessly using an MQTT client to a database working as a cloud storage solution. The collected data is then visualized and analyzed using a website running on a host machine working as a web client.


title: Periodic traveling waves for nonlinear Schr\"odinger equations with non-zero conditions at infinity in $ \R ^2 $

abstract: We consider the nonlinear Schr\"odinger equation with nonzero conditions at infinity in $\R^2$. We investigate the existence of traveling waves that are periodic in the direction transverse to the direction of propagation and minimize the energy when the momentum is kept fixed. We show that for any given value of the momentum, there is a critical value of the period such that traveling waves with period smaller than the critical value are one-dimensional, and those with larger periods depend on two variables.


title: Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommendation Systems

abstract: Large Language Models (LLMs) have demonstrated great potential in Conversational Recommender Systems (CRS). However, the application of LLMs to CRS has exposed a notable discrepancy in behavior between LLM-based CRS and human recommenders: LLMs often appear inflexible and passive, frequently rushing to complete the recommendation task without sufficient inquiry.This behavior discrepancy can lead to decreased accuracy in recommendations and lower user satisfaction. Despite its importance, existing studies in CRS lack a study about how to measure such behavior discrepancy. To fill this gap, we propose Behavior Alignment, a new evaluation metric to measure how well the recommendation strategies made by a LLM-based CRS are consistent with human recommenders'. Our experiment results show that the new metric is better aligned with human preferences and can better differentiate how systems perform than existing evaluation metrics. As Behavior Alignment requires explicit and costly human annotations on the recommendation strategies, we also propose a classification-based method to implicitly measure the Behavior Alignment based on the responses. The evaluation results confirm the robustness of the method.


title: Analysis of blurring due to short T2 decay at different resolutions in 23Na MRI

abstract: The nuclear magnetic resonance signal from sodium (23Na) nuclei demonstrates a fast bi-exponential T2 decay in biological tissues (T2,short = 0.5-5 ms and T2,long = 10-30 ms). Hence, blurring observed in sodium images acquired with center-out sequences is generally assumed to be dominated by signal attenuation at higher k-space frequencies. Most of the studies in the field primarily focus on the impact of readout duration on blurring but neglect the impact of resolution. In this paper, we examine the blurring effect of short T2 on images at different resolutions. A series of simulations, as well as phantom and in vivo scans were performed at varying resolutions and readout durations in order to evaluate progressive changes in image quality. We demonstrate that, given a fixed readout duration, T2 decay produces distinct blurring effects at different resolutions. Therefore, in addition to voxel size-dependent partial volume effects, the choice of resolution adds additional T2-dependent blurring.


title: A Nonlinear, Conservative, Entropic Fokker-Planck Model for Multi-Species Collisions

abstract: A multi-species Fokker-Planck model for simulating particle collisions in a plasma is presented. The model includes various parameters that must be tuned. Under reasonable assumptions on these parameters, the model satisfies appropriate conservation laws, dissipates an entropy, and satisfies an $\mathcal{H}$-Theorem. In addition, the model parameters provide the additional flexibility that is used to match simultaneously momentum and temperature relaxation formulas derived from the Boltzmann collision operator for a binary mixture with Coulomb potentials. A numerical method for solving the resulting space-homogeneous kinetic equation is presented and two examples are provided to demonstrate the relaxation of species bulk velocities and temperatures to their equilibrium values.


title: 3D object quality prediction for Metal Jet Printer with Multimodal thermal encoder

abstract: With the advancements in 3D printing technologies, it is extremely important that the quality of 3D printed objects, and dimensional accuracies should meet the customer's specifications. Various factors during metal printing affect the printed parts' quality, including the power quality, the printing stage parameters, the print part's location inside the print bed, the curing stage parameters, and the metal sintering process. With the large data gathered from HP's MetJet printing process, AI techniques can be used to analyze, learn, and effectively infer the printed part quality metrics, as well as assist in improving the print yield. In-situ thermal sensing data captured by printer-installed thermal sensors contains the part thermal signature of fusing layers. Such part thermal signature contains a convoluted impact from various factors. In this paper, we use a multimodal thermal encoder network to fuse data of a different nature including the video data vectorized printer control data, and exact part thermal signatures with a trained encoder-decoder module. We explored the data fusing techniques and stages for data fusing, the optimized end-to-end model architecture indicates an improved part quality prediction accuracy.


title: Direct measurement of energy transfer in strongly driven rotating turbulence

abstract: A short, abrupt increase in energy injection rate into steady strongly-driven rotating turbulent flow is used as a probe for energy transfer in the system. The injected excessive energy is localized in time and space and its spectra differ from those of the steady turbulent flow. This allows measuring energy transfer rates, in three different domains: In real space, the injected energy propagates within the turbulent field, as a wave packet of inertial waves. In the frequency domain, energy is transferred non-locally to the low, quasi-geostrophic modes. In wavenumber space, energy locally cascades toward small wavenumbers, in a rate that is consistent with two-dimensionsal (2D) turbulence models. Surprisingly however, the inverse cascade of energy is mediated by inertial waves that propagate within the flow with small, but non-vanishing frequency. Our observations differ from measurements and theoretical predictions of weakly driven turbulence. Yet, they show that in strongly-driven rotating turbulence, inertial waves play an important role in energy transfer, even at the vicinity of the 2D manifold.


title: CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration

abstract: Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high computational costs. To overcome these issues, we introduce the Channel-Aware U-Shaped Mamba (CU-Mamba) model, which incorporates a dual State Space Model (SSM) framework into the U-Net architecture. CU-Mamba employs a Spatial SSM module for global context encoding and a Channel SSM component to preserve channel correlation features, both in linear computational complexity relative to the feature map size. Extensive experimental results validate CU-Mamba's superiority over existing state-of-the-art methods, underscoring the importance of integrating both spatial and channel contexts in image restoration.


title: Hydrogen plasma inhibits ion beam restructuring of materials

abstract: Focused ion beam (FIB) techniques are employed widely for nanofabrication, and processing of materials and devices. However, ion irradiation often gives rise to severe damage due to atomic displacements that cause defect formation, migration and clustering within the ion-solid interaction volume. The resulting restructuring degrades the functionality of materials, and limits the utility FIB ablation and nanofabrication techniques. Here we show that such restructuring can be inhibited by performing FIB irradiation in a hydrogen plasma environment via chemical pathways that modify defect binding energies and transport kinetics, as well as material ablation rates. The method is minimally-invasive and has the potential to greatly expand the utility of FIB nanofabrication techniques in processing of functional materials and devices.


title: Dyakonov-Perel-like Orbital and Spin Relaxations in Centrosymmetric Systems

abstract: The Dyakonov-Perel (DP) mechanism of spin relaxation has long been considered irrelevant in centrosymmetric systems since it was developed originally for non-centrosymmetric ones. We investigate whether this conventional understanding extends to the realm of orbital relaxation, which has recently attracted significant attention. Surprisingly, we find that orbital relaxation in centrosymmetric systems exhibits the DP-like behavior in the weak scattering regime. Moreover, the DP-like orbital relaxation can make the spin relaxation in centrosymmetric systems DP-like through the spin-orbit coupling. We also find that the DP-like orbital and spin relaxations are anisotropic even in materials with high crystal symmetry (such as face-centered cubic structure) and may depend on the orbital and spin nature of electron wavefunctions.


title: Asymmetric canonical correlation analysis of Riemannian and high-dimensional data

abstract: In this paper, we introduce a novel statistical model for the integrative analysis of Riemannian-valued functional data and high-dimensional data. We apply this model to explore the dependence structure between each subject's dynamic functional connectivity -- represented by a temporally indexed collection of positive definite covariance matrices -- and high-dimensional data representing lifestyle, demographic, and psychometric measures. Specifically, we employ a reformulation of canonical correlation analysis that enables efficient control of the complexity of the functional canonical directions using tangent space sieve approximations. Additionally, we enforce an interpretable group structure on the high-dimensional canonical directions via a sparsity-promoting penalty. The proposed method shows improved empirical performance over alternative approaches and comes with theoretical guarantees. Its application to data from the Human Connectome Project reveals a dominant mode of covariation between dynamic functional connectivity and lifestyle, demographic, and psychometric measures. This mode aligns with results from static connectivity studies but reveals a unique temporal non-stationary pattern that such studies fail to capture.


title: REQUAL-LM: Reliability and Equity through Aggregation in Large Language Models

abstract: The extensive scope of large language models (LLMs) across various domains underscores the critical importance of responsibility in their application, beyond natural language processing. In particular, the randomized nature of LLMs, coupled with inherent biases and historical stereotypes in data, raises critical concerns regarding reliability and equity. Addressing these challenges are necessary before using LLMs for applications with societal impact. Towards addressing this gap, we introduce REQUAL-LM, a novel method for finding reliable and equitable LLM outputs through aggregation. Specifically, we develop a Monte Carlo method based on repeated sampling to find a reliable output close to the mean of the underlying distribution of possible outputs. We formally define the terms such as reliability and bias, and design an equity-aware aggregation to minimize harmful bias while finding a highly reliable output. REQUAL-LM does not require specialized hardware, does not impose a significant computing load, and uses LLMs as a blackbox. This design choice enables seamless scalability alongside the rapid advancement of LLM technologies. Our system does not require retraining the LLMs, which makes it deployment ready and easy to adapt. Our comprehensive experiments using various tasks and datasets demonstrate that REQUAL- LM effectively mitigates bias and selects a more equitable response, specifically the outputs that properly represents minority groups.


title: Casimir Effect and Holographic Dual of Wedges

abstract: This paper investigates the Casimir effect of a wedge and its holographic dual. We prove that the displacement operator universally determines the wedge Casimir effect in the smooth limit. Besides, we argue that the wedge Casimir energy increases with the opening angle and test it with several examples. Furthermore, we construct the holographic dual of wedges in AdS/BCFT in general dimensions. We verify that our proposal can produce the expected Casimir effect within smooth and singular limits. We observe that the Casimir energy density of a wedge increases with the brane tension. Next, we discuss the wedge contribution to holographic entanglement entropy and find it increases with the opening angle, similar to the wedge Casimir energy. Finally, we briefly discuss the holographic polygon in AdS$_3$/BCFT$_2$ and its generalization to higher dimensions.


title: Analysis of Evolutionary Diversity Optimisation for the Maximum Matching Problem

abstract: This paper explores the enhancement of solution diversity in evolutionary algorithms (EAs) for the maximum matching problem, concentrating on complete bipartite graphs and paths. We adopt binary string encoding for matchings and use Hamming distance to measure diversity, aiming for its maximization. Our study centers on the $(\mu+1)$-EA and $2P-EA_D$, which are applied to optimize diversity. We provide a rigorous theoretical and empirical analysis of these algorithms. For complete bipartite graphs, our runtime analysis shows that, with a reasonably small $\mu$, the $(\mu+1)$-EA achieves maximal diversity with an expected runtime of $O(\mu^2 m^4 \log(m))$ for the small gap case (where the population size $\mu$ is less than the difference in the sizes of the bipartite partitions) and $O(\mu^2 m^2 \log(m))$ otherwise. For paths, we establish an upper runtime bound of $O(\mu^3 m^3)$. The $2P-EA_D$ displays stronger performance, with bounds of $O(\mu^2 m^2 \log(m))$ for the small gap case, $O(\mu^2 n^2 \log(n))$ otherwise, and $O(\mu^3 m^2)$ for paths. Here, $n$ represents the total number of vertices and $m$ the number of edges. Our empirical studies, which examine the scaling behavior with respect to $m$ and $\mu$, complement these theoretical insights and suggest potential for further refinement of the runtime bounds.


title: Intelligent mechanical metamaterials towards learning static and dynamic behaviors

abstract: The exploration of intelligent machines has recently spurred the development of physical neural networks, a class of intelligent metamaterials capable of learning, whether in silico or in situ, from observed data. In this study, we introduce a back-propagation framework for lattice-based mechanical neural networks (MNNs) to achieve prescribed static and dynamic performance. This approach leverages the steady states of nodes for back-propagation, efficiently updating the learning degrees of freedom without prior knowledge of input loading. One-dimensional MNNs, trained with back-propagation in silico, can exhibit the desired behaviors on demand function as intelligent mechanical machines. The framework is then employed for the precise morphing control of the two-dimensional MNNs subjected to different static loads. Moreover, the intelligent MNNs are trained to execute classical machine learning tasks such as regression to tackle various deformation control tasks. Finally, the disordered MNNs are constructed and trained to demonstrate pre-programmed wave bandgap control ability, illustrating the versatility of the proposed approach as a platform for physical learning. Our approach presents an efficient pathway for the design of intelligent mechanical metamaterials for a wide range of static and dynamic target functionalities, positioning them as powerful engines for physical learning.


title: A Sequential Benders-based Mixed-Integer Quadratic Programming Algorithm

abstract: For continuous decision spaces, nonlinear programs (NLPs) can be efficiently solved via sequential quadratic programming (SQP) and, more generally, sequential convex programming (SCP). These algorithms linearize only the nonlinear equality constraints and keep the outer convex structure of the problem intact. The aim of the presented sequential mixed-integer quadratic programming (MIQP) algorithm for mixed-integer nonlinear problems (MINLPs) is to extend the SQP/SCP methodology to MINLPs and leverage the availability of efficient MIQP solvers. The algorithm employs a three-step method in each iterate: First, the MINLP is linearized at a given iterate. Second, an MIQP with its feasible set restricted to a specific region around the current linearization point is formulated and solved. Third, the integer variables obtained from the MIQP solution are fixed, and only an NLP in the continuous variables is solved. The outcome of the third step is compared to previous iterates, and the best iterate so far is used as a linearization point in the next iterate. Crucially, the objective values and derivatives from all previous iterates are used to formulate the polyhedral region in the second step. The linear inequalities that define the region build on concepts from generalized Benders' decomposition for MINLPs. Although the presented MINLP algorithm is a heuristic method without any global optimality guarantee, it converges to the exact integer solution when applied to convex MINLP with a linear outer structure. The conducted numerical experiments demonstrate that the proposed algorithm is competitive with other open-source solvers for MINLP. Finally, we solve two mixed-integer optimal control problems (MIOCPs) transcribed into MINLPs via direct methods, showing that the presented algorithm can effectively deal with nonlinear equality constraints, a major hurdle for generic MINLP solvers.


title: Inducing mechanical self-healing in glassy polymer melts

abstract: Glassy polymer melts such as the plastics used in pipes, structural materials, and medical devices are ubiquitous in daily life. They accumulate damage over time due to their use, which limits their functionalities and demands periodic replacement. The resulting economic and social burden could be mitigated by the design of self-healing mechanisms that expand the lifespan of materials. However, the characteristic low molecular mobility in glassy polymer melts intrinsically limits the design of self-healing behavior. We demonstrate through numerical simulations that controlled oscillatory deformations enhance the local molecular mobility of glassy polymers without compromising their structural or mechanical stability. We apply this principle to increase the molecular mobility around the surface of a crack, inducing fracture repair and recovering the mechanical properties of the pristine material. Our findings establish a general physical mechanism of self-healing in glasses that may inspire the design and processing of new glassy materials.


title: NonGEMM Bench: Understanding the Performance Horizon of the Latest ML Workloads with NonGEMM Workloads

abstract: Machine Learning (ML) operators are the building blocks to design ML models with various target applications. GEneral Matrix Multiplication (GEMM) operators are the backbone of ML models. They are notorious for being computationally expensive requiring billions of multiply-and-accumulate. Therefore, significant effort has been put to study and optimize the GEMM operators in order to speed up the execution of ML models. GPUs and accelerators are widely deployed to accelerate ML workloads by optimizing the execution of GEMM operators. Nonetheless, the performance of NonGEMM operators have not been studied as thoroughly as GEMMs. Therefore, this paper describes \bench, a benchmark to study NonGEMM operators. We first construct \bench using popular ML workloads from different domains, then perform case studies on various grade GPU platforms to analyze the behavior of NonGEMM operators in GPU accelerated systems. Finally, we present some key takeaways to bridge the gap between GEMM and NonGEMM operators and to offer the community with potential new optimization directions.


title: An Invitation to Resolvent Analysis

abstract: Resolvent analysis is a powerful tool that can reveal the linear amplification mechanisms between the forcing inputs and the response outputs about a base flow. These mechanisms can be revealed in terms of a pair of forcing and response modes and the associated gains (amplification magnitude) in the order of energy contents at a given frequency. The linear relationship that ties the forcing and the response is represented through the resolvent operator (transfer function), which is constructed through spatially discretizing the linearized Navier-Stokes operator. One of the unique strengths of resolvent analysis is its ability to analyze statistically stationary turbulent flows. In light of the increasing interest in using resolvent analysis to study a variety of flows, we offer this guide in hopes of removing the hurdle for students and researchers to initiate the development of a resolvent analysis code and its applications to their problems of interest. To achieve this goal, we discuss various aspects of resolvent analysis and its role in identifying dominant flow structures about the base flow. The discussion in this paper revolves around the compressible Navier-Stokes equations in the most general manner. We cover essential considerations ranging from selecting the base flow and appropriate energy norms to the intricacies of constructing the linear operator and performing eigenvalue and singular value decompositions. Throughout the paper, we offer details and know-how that may not be available to readers in a collective manner elsewhere. Towards the end of this paper, examples are offered to demonstrate the practical applicability of resolvent analysis, aiming to guide readers through its implementation and inspire further extensions. We invite readers to consider resolvent analysis as a companion for their research endeavors.


title: Constrained Stochastic Recursive Momentum Successive Convex Approximation

abstract: We consider stochastic optimization problems with functional constraints. If the objective and constraint functions are not convex, the classical stochastic approximation algorithms such as the proximal stochastic gradient descent do not lead to efficient algorithms. In this work, we put forth an accelerated SCA algorithm that utilizes the recursive momentum-based acceleration which is widely used in the unconstrained setting. Remarkably, the proposed algorithm also achieves the optimal SFO complexity, at par with that achieved by state-of-the-art (unconstrained) stochastic optimization algorithms and match the SFO-complexity lower bound for minimization of general smooth functions. At each iteration, the proposed algorithm entails constructing convex surrogates of the objective and the constraint functions, and solving the resulting convex optimization problem. A recursive update rule is employed to track the gradient of the objective function, and contributes to achieving faster convergence and improved SFO complexity. A key ingredient of the proof is a new parameterized version of the standard Mangasarian-Fromowitz Constraints Qualification, that allows us to bound the dual variables and hence establish that the iterates approach an $\epsilon$-stationary point. We also detail a obstacle-avoiding trajectory optimization problem that can be solved using the proposed algorithm, and show that its performance is superior to that of the existing algorithms. The performance of the proposed algorithm is also compared against that of a specialized sparse classification algorithm on a binary classification problem.


title: Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

abstract: The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevant is document A to query Q?", results in sub-optimal ranking. Instead, the pairwise ranking prompting (PRP) approach produces promising ranking performance through asking about pairwise comparisons, e.g., ``Is document A more relevant than document B to query Q?". Thus, while LLMs are effective at their ranking ability, this is not reflected in their relevance label generation. In this work, we propose a post-processing method to consolidate the relevance labels generated by an LLM with its powerful ranking abilities. Our method takes both LLM generated relevance labels and pairwise preferences. The labels are then altered to satisfy the pairwise preferences of the LLM, while staying as close to the original values as possible. Our experimental results indicate that our approach effectively balances label accuracy and ranking performance. Thereby, our work shows it is possible to combine both the ranking and labeling abilities of LLMs through post-processing.


title: Enhancing Q&A with Domain-Specific Fine-Tuning and Iterative Reasoning: A Comparative Study

abstract: This paper investigates the impact of domain-specific model fine-tuning and of reasoning mechanisms on the performance of question-answering (Q&A) systems powered by large language models (LLMs) and Retrieval-Augmented Generation (RAG). Using the FinanceBench SEC financial filings dataset, we observe that, for RAG, combining a fine-tuned embedding model with a fine-tuned LLM achieves better accuracy than generic models, with relatively greater gains attributable to fine-tuned embedding models. Additionally, employing reasoning iterations on top of RAG delivers an even bigger jump in performance, enabling the Q&A systems to get closer to human-expert quality. We discuss the implications of such findings, propose a structured technical design space capturing major technical components of Q&A AI, and provide recommendations for making high-impact technical choices for such components. We plan to follow up on this work with actionable guides for AI teams and further investigations into the impact of domain-specific augmentation in RAG and into agentic AI capabilities such as advanced planning and reasoning.


title: Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metric

abstract: The proliferation of social media platforms has given rise to the amount of online debates and arguments. Consequently, the need for automatic summarization methods for such debates is imperative, however this area of summarization is rather understudied. The Key Point Analysis (KPA) task formulates argument summarization as representing the summary of a large collection of arguments in the form of concise sentences in bullet-style format, called key points. A sub-task of KPA, called Key Point Generation (KPG), focuses on generating these key points given the arguments. This paper introduces a novel extractive approach for key point generation, that outperforms previous state-of-the-art methods for the task. Our method utilizes an extractive clustering based approach that offers concise, high quality generated key points with higher coverage of reference summaries, and less redundant outputs. In addition, we show that the existing evaluation metrics for summarization such as ROUGE are incapable of differentiating between generated key points of different qualities. To this end, we propose a new evaluation metric for assessing the generated key points by their coverage. Our code can be accessed online.


title: Automated Social Science: Language Models as Scientist and Subjects

abstract: We present an approach for automatically generating and testing, in silico, social scientific hypotheses. This automation is made possible by recent advances in large language models (LLM), but the key feature of the approach is the use of structural causal models. Structural causal models provide a language to state hypotheses, a blueprint for constructing LLM-based agents, an experimental design, and a plan for data analysis. The fitted structural causal model becomes an object available for prediction or the planning of follow-on experiments. We demonstrate the approach with several scenarios: a negotiation, a bail hearing, a job interview, and an auction. In each case, causal relationships are both proposed and tested by the system, finding evidence for some and not others. We provide evidence that the insights from these simulations of social interactions are not available to the LLM purely through direct elicitation. When given its proposed structural causal model for each scenario, the LLM is good at predicting the signs of estimated effects, but it cannot reliably predict the magnitudes of those estimates. In the auction experiment, the in silico simulation results closely match the predictions of auction theory, but elicited predictions of the clearing prices from the LLM are inaccurate. However, the LLM's predictions are dramatically improved if the model can condition on the fitted structural causal model. In short, the LLM knows more than it can (immediately) tell.


title: Prompt-Driven Feature Diffusion for Open-World Semi-Supervised Learning

abstract: In this paper, we present a novel approach termed Prompt-Driven Feature Diffusion (PDFD) within a semi-supervised learning framework for Open World Semi-Supervised Learning (OW-SSL). At its core, PDFD deploys an efficient feature-level diffusion model with the guidance of class-specific prompts to support discriminative feature representation learning and feature generation, tackling the challenge of the non-availability of labeled data for unseen classes in OW-SSL. In particular, PDFD utilizes class prototypes as prompts in the diffusion model, leveraging their class-discriminative and semantic generalization ability to condition and guide the diffusion process across all the seen and unseen classes. Furthermore, PDFD incorporates a class-conditional adversarial loss for diffusion model training, ensuring that the features generated via the diffusion process can be discriminatively aligned with the class-conditional features of the real data. Additionally, the class prototypes of the unseen classes are computed using only unlabeled instances with confident predictions within a semi-supervised learning framework. We conduct extensive experiments to evaluate the proposed PDFD. The empirical results show PDFD exhibits remarkable performance enhancements over many state-of-the-art existing methods.


title: Symplectic Weiss calculi

abstract: We provide two candidates for symplectic Weiss calculus based on two different, but closely related, collections of groups. In the case of the non-compact symplectic groups, i.e., automorphism groups of vector spaces with symplectic forms, we show that the calculus deformation retracts onto unitary calculus as a corollary of the fact that Weiss calculus only depends on the homotopy type of the groupoid core of the diagram category. In the case of the compact symplectic groups, i.e., automorphism groups of quaternion vector spaces, we provide a comparison with the other known versions of Weiss calculus analogous to the comparisons of calculi of the second named author, and classify certain stably trivial quaternion vector bundles over finite cell complexes in a range, using elementary results on convergence of Weiss calculi.


title: When are Foundation Models Effective? Understanding the Suitability for Pixel-Level Classification Using Multispectral Imagery

abstract: Foundation models, i.e., very large deep learning models, have demonstrated impressive performances in various language and vision tasks that are otherwise difficult to reach using smaller-size models. The major success of GPT-type of language models is particularly exciting and raises expectations on the potential of foundation models in other domains including satellite remote sensing. In this context, great efforts have been made to build foundation models to test their capabilities in broader applications, and examples include Prithvi by NASA-IBM, Segment-Anything-Model, ViT, etc. This leads to an important question: Are foundation models always a suitable choice for different remote sensing tasks, and when or when not? This work aims to enhance the understanding of the status and suitability of foundation models for pixel-level classification using multispectral imagery at moderate resolution, through comparisons with traditional machine learning (ML) and regular-size deep learning models. Interestingly, the results reveal that in many scenarios traditional ML models still have similar or better performance compared to foundation models, especially for tasks where texture is less useful for classification. On the other hand, deep learning models did show more promising results for tasks where labels partially depend on texture (e.g., burn scar), while the difference in performance between foundation models and deep learning models is not obvious. The results conform with our analysis: The suitability of foundation models depend on the alignment between the self-supervised learning tasks and the real downstream tasks, and the typical masked autoencoder paradigm is not necessarily suitable for many remote sensing problems.


title: Establishing a Baseline for Gaze-driven Authentication Performance in VR: A Breadth-First Investigation on a Very Large Dataset

abstract: This paper performs the crucial work of establishing a baseline for gaze-driven authentication performance to begin answering fundamental research questions using a very large dataset of gaze recordings from 9202 people with a level of eye tracking (ET) signal quality equivalent to modern consumer-facing virtual reality (VR) platforms. The size of the employed dataset is at least an order-of-magnitude larger than any other dataset from previous related work. Binocular estimates of the optical and visual axes of the eyes and a minimum duration for enrollment and verification are required for our model to achieve a false rejection rate (FRR) of below 3% at a false acceptance rate (FAR) of 1 in 50,000. In terms of identification accuracy which decreases with gallery size, we estimate that our model would fall below chance-level accuracy for gallery sizes of 148,000 or more. Our major findings indicate that gaze authentication can be as accurate as required by the FIDO standard when driven by a state-of-the-art machine learning architecture and a sufficiently large training dataset.


title: Persistent interaction topology in data analysis

abstract: Topological data analysis, as a tool for extracting topological features and characterizing geometric shapes, has experienced significant development across diverse fields. Its key mathematical techniques include persistent homology and the recently developed persistent Laplacians. However, classic mathematical models like simplicial complexes often struggle to provide a localized topological description for interactions or individual elements within a complex system involving a specific set of elements. In this work, we introduce persistent interaction homology and persistent interaction Laplacian that emphasize individual interacting elements in the system. We demonstrate the stability of persistent interaction homology as a persistent module. Furthermore, for a finite discrete set of points in the Euclidean space, we provide the construction of persistent interaction Vietoris-Rips complexes and compute their interaction homology and interaction Laplacians. The proposed methods hold significant promise for analyzing heterogeneously interactive data and emphasizing specific elements in data. Their utility for data science is demonstrated with applications to molecules.


title: Developing Situational Awareness for Joint Action with Autonomous Vehicles

abstract: Unanswered questions about how human-AV interaction designers can support rider's informational needs hinders Autonomous Vehicles (AV) adoption. To achieve joint human-AV action goals - such as safe transportation, trust, or learning from an AV - sufficient situational awareness must be held by the human, AV, and human-AV system collectively. We present a systems-level framework that integrates cognitive theories of joint action and situational awareness as a means to tailor communications that meet the criteria necessary for goal success. This framework is based on four components of the shared situation: AV traits, action goals, subject-specific traits and states, and the situated driving context. AV communications should be tailored to these factors and be sensitive when they change. This framework can be useful for understanding individual, shared, and distributed human-AV situational awareness and designing for future AV communications that meet the informational needs and goals of diverse groups and in diverse driving contexts.


title: Semiclassical bremsstrahlung from a charge radially falling into a Schwarzschild black hole

abstract: A semiclassical investigation of the electromagnetic radiation emitted by a charged particle in a radially freely falling motion in Schwarzschild spacetime is carried out. We use quantum field theory at tree level to obtain the one-particle-emission amplitudes. We analyze and compare the energy spectrum and total energy released, which are calculated from these amplitudes, for particles with varying initial positions and for particles originating from infinity with varying kinetic energy. We also compare the results with those due to a falling charged "string" extended in the radial direction.


title: Associations between pain-management treatments and opioid use disorder risk among Medicaid patients

abstract: Introduction: Chronic pain patients are at increased risk of opioid-misuse. Less is known about the unique risk conferred by each pain-management treatment, as treatments are typically implemented together, confounding their independent effects. We estimated the extent to which pain-management strategies were associated with risk of incident opioid use disorder (OUD) for those with chronic pain, controlling for baseline demographic and clinical confounding variables and holding other pain-management treatments at their observed levels. Methods: We used data from two chronic pain subgroups within a cohort of non-pregnant Medicaid patients aged 35-64 years, 2016-2019, from 25 states: 1) those with a chronic pain condition co-morbid with physical disability (N=6,133) or 2) those with chronic pain without disability (N=67,438). We considered 9 pain-management treatments: prescription opioid i) dose and ii) duration; iii) number of opioid prescribers; opioid co-prescription with iv) benzodiazepines, v) muscle relaxants, and vi) gabapentinoids; vii) non-opioid pain prescription, viii) physical therapy, and ix) other pain treatment modality. Our outcome was incident OUD. Results: Having an opioid and gabapentin co-prescription or an opioid and benzodiazepine co-prescription was statistically significantly associated with a 16-46% increased risk of OUD. Opioid dose and duration also were significantly associated with increased risk of OUD. Physical therapy was significantly associated with an 11% decreased risk of OUD in the subgroup with chronic pain but no disability. Conclusions: Co-prescription of opioids with either gabapentin or benzodiazepines may substantially increase risk of OUD. More positively, physical therapy may be a relatively accessible and safe pain-management strategy.


title: TempBEV: Improving Learned BEV Encoders with Combined Image and BEV Space Temporal Aggregation

abstract: Autonomous driving requires an accurate representation of the environment. A strategy toward high accuracy is to fuse data from several sensors. Learned Bird's-Eye View (BEV) encoders can achieve this by mapping data from individual sensors into one joint latent space. For cost-efficient camera-only systems, this provides an effective mechanism to fuse data from multiple cameras with different views. Accuracy can further be improved by aggregating sensor information over time. This is especially important in monocular camera systems to account for the lack of explicit depth and velocity measurements. Thereby, the effectiveness of developed BEV encoders crucially depends on the operators used to aggregate temporal information and on the used latent representation spaces. We analyze BEV encoders proposed in the literature and compare their effectiveness, quantifying the effects of aggregation operators and latent representations. While most existing approaches aggregate temporal information either in image or in BEV latent space, our analyses and performance comparisons suggest that these latent representations exhibit complementary strengths. Therefore, we develop a novel temporal BEV encoder, TempBEV, which integrates aggregated temporal information from both latent spaces. We consider subsequent image frames as stereo through time and leverage methods from optical flow estimation for temporal stereo encoding. Empirical evaluation on the NuScenes dataset shows a significant improvement by TempBEV over the baseline for 3D object detection and BEV segmentation. The ablation uncovers a strong synergy of joint temporal aggregation in the image and BEV latent space. These results indicate the overall effectiveness of our approach and make a strong case for aggregating temporal information in both image and BEV latent spaces.