title: Disentanglement of Correlated Factors via Hausdorff Factorized Support

abstract: A grand goal in deep learning research is to learn representations capable of generalizing across distribution shifts. Disentanglement is one promising direction aimed at aligning a model's representation with the underlying factors generating the data (e.g. color or background). Existing disentanglement methods, however, rely on an often unrealistic assumption: that factors are statistically independent. In reality, factors (like object color and shape) are correlated. To address this limitation, we consider the use of a relaxed disentanglement criterion -- the Hausdorff Factorized Support (HFS) criterion -- that encourages only pairwise factorized \emph{support}, rather than a factorial distribution, by minimizing a Hausdorff distance. This allows for arbitrary distributions of the factors over their support, including correlations between them. We show that the use of HFS consistently facilitates disentanglement and recovery of ground-truth factors across a variety of correlation settings and benchmarks, even under severe training correlations and correlation shifts, with in parts over $+60\%$ in relative improvement over existing disentanglement methods. In addition, we find that leveraging HFS for representation learning can even facilitate transfer to downstream tasks such as classification under distribution shifts. We hope our original approach and positive empirical results inspire further progress on the open problem of robust generalization. Code available at https://github.com/facebookresearch/disentangling-correlated-factors.


title: Categorical properties of reduction functors over non-positive DG-rings

abstract: Given a non-positive DG-ring $A$, associated to it are the reduction and coreduction functors $F(-) = \mathrm{H}^0(A)\otimes^{\mathrm{L}}_A -$ and $G(-) = \mathrm{R}\operatorname{Hom}_A(\mathrm{H}^0(A),-)$, considered as functors $\operatorname{\mathsf{D}}(A) \to \operatorname{\mathsf{D}}(\mathrm{H}^0(A))$, as well as the forgetful functor $S:\operatorname{\mathsf{D}}(\mathrm{H}^0(A)) \to \operatorname{\mathsf{D}}(A)$. In this paper we carry a systematic study of the categorical properties of these functors. As an application, a new descent result for vanishing of $\operatorname{Ext}$ and $\operatorname{Tor}$ over ordinary commutative noetherian rings is deduced.


title: Quantifying and analyzing rock trait distributions of rocky fault scarps using deep learning approach

abstract: We apply a deep learning model to segment and identify rock characteristics based on a Structure-from-Motion orthomap and digital elevation model of a rocky fault scarp in the Volcanic Tablelands, eastern California. By post-processing the deep learning results, we build a semantic rock map and analyze rock trait distributions. The resulting semantic map contains nearly 230,000 rocks with effective diameters ranging from 2 cm to 250 cm. Rock trait distributions provide a new perspective on rocky fault scarp development and extend past research on scarp geometry including slope, height, and length. Heatmaps indicate rock size spatial distributions on the fault scarp and surrounding topographic flats. Median grain size changes perpendicular to the fault scarp trace with the largest rocks exposed on and downslope from the scarp footwall. Correlation analyses of the segmented fault scarp illustrate the relationship between rock trait statistics and fault scarp geomorphology. Local fault scarp height correlates with median grain size (R2 of 0.6), the mean grain size of the largest rocks (R2 of 0.76), and the ratio of the number of small to large rocks (R2 of 0.40). The positive correlation (R2 of 0.81) between local fault scarp height and standard deviation of grain size suggests that rocks on a higher fault scarp are less well sorted. The correlation analysis between fault scarp height and rock orientation statistics supports a particle transportation model in which locally higher fault scarps have relatively more rocks with long axes parallel to fault scarp trace because rocks have a larger distance to roll and orient the long axes. Our work demonstrates a data-driven approach to geomorphology based on rock trait distributions, promising a greater understanding of fault scarp formation, as well as many other applications for which granulometry is an indicator of process.


title: Dynamics of van der Waals Charge Qubit in 2D Bilayers: Ab initio Quantum Transport and Qubit Measurement

abstract: A van der Waals (vdW) charge qubit, electrostatically confined within two-dimensional (2D) vdW materials, is proposed as building block of future quantum computers. Its characteristics are systematically evaluated with respect to its two-level anti-crossing energy difference ($\Delta$). Bilayer graphene ($\Delta$ $\approx$ 0) and a vdW heterostructure ($\Delta$ $\gg$ 0) are used as representative examples. Their tunable electronic properties with an external electric field define the state of the charge qubit. By combining density functional theory and quantum transport calculations, we highlight the optimal qubit operation conditions based on charge stability and energy-level diagrams. Moreover, a single-electron transistor (SET) design based on trilayer vdW heterostructures capacitively coupled to the charge qubit is introduced as measurement setup with low decoherence and improved measurement properties. It is found that a $\Delta$ greater than 20 meV results in a rapid mixing of the qubit states, which leads to a lower measurement quantity, i.e. contrast and conductance. With properly optimized designs, qubit architectures relying on 2D vdW structures could be integrated into an all-electronic quantum computing platform.


title: Partial Tail-Correlation Coefficient Applied to Extremal-Network Learning

abstract: We propose a novel extremal dependence measure called the partial tail-correlation coefficient (PTCC), in analogy to the partial correlation coefficient in classical multivariate analysis. The construction of our new coefficient is based on the framework of multivariate regular variation and transformed-linear algebra operations. We show how this coefficient allows identifying pairs of variables that have partially uncorrelated tails given the other variables in a random vector. Unlike other recently introduced conditional independence frameworks for extremes, our approach requires minimal modeling assumptions and can thus be used in exploratory analyses to learn the structure of extremal graphical models. Similarly to traditional Gaussian graphical models where edges correspond to the non-zero entries of the precision matrix, we can exploit classical inference methods for high-dimensional data, such as the graphical LASSO with Laplacian spectral constraints, to efficiently learn the extremal network structure via the PTCC. We apply our new method to study extreme risk networks in two different datasets (extreme river discharges and historical global currency exchange data) and show that we can extract meaningful extremal structures with meaningful domain-specific interpretations.


title: Predicting Fine-Tuning Performance with Probing

abstract: Large NLP models have recently shown impressive performance in language understanding tasks, typically evaluated by their fine-tuned performance. Alternatively, probing has received increasing attention as being a lightweight method for interpreting the intrinsic mechanisms of large NLP models. In probing, post-hoc classifiers are trained on "out-of-domain" datasets that diagnose specific abilities. While probing the language models has led to insightful findings, they appear disjointed from the development of models. This paper explores the utility of probing deep NLP models to extract a proxy signal widely used in model development -- the fine-tuning performance. We find that it is possible to use the accuracies of only three probing tests to predict the fine-tuning performance with errors $40\%$ - $80\%$ smaller than baselines. We further discuss possible avenues where probing can empower the development of deep NLP models.


title: JOIST: A Joint Speech and Text Streaming Model For ASR

abstract: We present JOIST, an algorithm to train a streaming, cascaded, encoder end-to-end (E2E) model with both speech-text paired inputs, and text-only unpaired inputs. Unlike previous works, we explore joint training with both modalities, rather than pre-training and fine-tuning. In addition, we explore JOIST using a streaming E2E model with an order of magnitude more data, which are also novelties compared to previous works. Through a series of ablation studies, we explore different types of text modeling, including how to model the length of the text sequence and the appropriate text sub-word unit representation. We find that best text representation for JOIST improves WER across a variety of search and rare-word test sets by 4-14% relative, compared to a model not trained with text. In addition, we quantitatively show that JOIST maintains streaming capabilities, which is important for good user-level experience.


title: Finding Islands of Predictability in Action Forecasting

abstract: We address dense action forecasting: the problem of predicting future action sequence over long durations based on partial observation. Our key insight is that future action sequences are more accurately modeled with variable, rather than one, levels of abstraction, and that the optimal level of abstraction can be dynamically selected during the prediction process. Our experiments show that most parts of future action sequences can be predicted confidently in fine detail only in small segments of future frames, which are effectively ``islands'' of high model prediction confidence in a ``sea'' of uncertainty. We propose a combination Bayesian neural network and hierarchical convolutional segmentation model to both accurately predict future actions and optimally select abstraction levels. We evaluate this approach on standard datasets against existing state-of-the-art systems and demonstrate that our ``islands of predictability'' approach maintains fine-grained action predictions while also making accurate abstract predictions where systems were previously unable to do so, and thus results in substantial, monotonic increases in accuracy.


title: Enhancing the robustness of coupling between a single emitter and a photonic crystal waveguide

abstract: We present a heuristic mathematical model of the relation between the geometry of a photonic crystal waveguide and the Purcell enhancement factor at a particular wavelength of interest. We use this model to propose approaches to the design of a photonic crystal waveguide maximizing the Purcell enhancement at a target wavelength. Numerical simulations indicate that the proposed structures exhibit robustness to fabrication defects introduced into photonic crystal geometry.


title: Consistency and Accuracy of CelebA Attribute Values

abstract: We report the first systematic analysis of the experimental foundations of facial attribute classification. Two annotators independently assigning attribute values shows that only 12 of 40 common attributes are assigned values with >= 95% consistency, and three (high cheekbones, pointed nose, oval face) have essentially random consistency. Of 5,068 duplicate face appearances in CelebA, attributes have contradicting values on from 10 to 860 of the 5,068 duplicates. Manual audit of a subset of CelebA estimates error rates as high as 40% for (no beard=false), even though the labeling consistency experiment indicates that no beard could be assigned with >= 95% consistency. Selecting the mouth slightly open (MSO) for deeper analysis, we estimate the error rate for (MSO=true) at about 20% and (MSO=false) at about 2%. A corrected version of the MSO attribute values enables learning a model that achieves higher accuracy than previously reported for MSO. Corrected values for CelebA MSO are available at https://github.com/HaiyuWu/CelebAMSO.


title: Influence of Ferromagnetic Interlayer Exchange Coupling on Current-induced Magnetization Switching and Dzyaloshinskii-Moriya Interaction in Co/Pt/Co Multilayer System

abstract: This paper investigates the relationship among interlayer exchange coupling (IEC), Dzyaloshinskii-Moriya interaction (DMI), and multilevel magnetization switching within a Co/Pt/Co heterostructure, where varying Pt thicknesses enable control over the coupling strength. Employing Brillouin Light Scattering to quantify the effective DMI, we explore its potential role in magnetization dynamics and multilevel magnetization switching. Experimental findings show four distinct resistance states under an external magnetic field and spin Hall effect related spin current. We explain this phenomenon based on the asymmetry between Pt/Co and Co/Pt interfaces and the interlayer coupling, which, in turn, influences DMI and subsequently impacts the magnetization dynamics. Numerical simulations, including macrospin, 1D domain wall, and simple spin wave models, further support the experimental observations of multilevel switching and help uncover the underlying mechanisms. Our proposed explanation, supported by magnetic domain observation using polar-magnetooptical Kerr microscopy, offers insights into both the spatial distribution of magnetization and its dynamics for different IECs, thereby shedding light on its interplay with DMI, which may lead to potential applications in storage devices.


title: Bayesian inference to study a signal with two or more decaying particles in a non-resonant background

abstract: We study the application of a Bayesian method to extract relevant information from data for the case of a signal consisting of two or more decaying particles and its background. The method takes advantage of the dependence that exists in the distributions of the decaying products at the event-by-event level and processes the information for the whole sample to infer the mixture fraction and the relevant parameters for signal and background distributions. The algorithm usually needs a numerical computation of the posterior, which we work out explicitly in a benchmark scenario of a simplified $pp\to hh \to b\bar b \gamma \gamma$ search. We perform a posterior predictive check on the results and we show how the signal fraction is correctly extracted from the sample, as well as many parameters in the signal and background distributions. The presented framework could be used for other searches such as $pp\to ZZ,\ WW,\ ZW$ and pair of Leptoquarks, among many others.


title: Lambert W Lines and Finite Square Well Sensors

abstract: The bound state energies of a 1-dimensional finite quantum square well (FSW) can be determined using a geometric method, involving a smooth mapping between two copies of the complex plane. The method allows one to identify particular strengths of the FSW at which the system can become unusually sensitive to changes in the well depth or geometry. In the present paper we explore that sensitivity, and exhibit a 3-D visualization of the solutions.


title: Reducing Action Space: Reference-Model-Assisted Deep Reinforcement Learning for Inverter-based Volt-Var Control

abstract: Reference-model-assisted deep reinforcement learning (DRL) for inverter-based Volt-Var Control (IB-VVC) in active distribution networks is proposed. We investigate that a large action space increases the learning difficulties of DRL and degrades the optimization performance in the process of generating data and training neural networks. To reduce the action space of DRL, we design a reference-model-assisted DRL approach. We introduce definitions of the reference model, reference-model-based optimization, and reference actions. The reference-model-assisted DRL learns the residual actions between the reference actions and optimal actions, rather than learning the optimal actions directly. Since the residual actions are considerably smaller than the optimal actions for a reference model, we can design a smaller action space for the reference-model-assisted DRL. It reduces the learning difficulties of DRL and optimises the performance of the reference-model-assisted DRL approach. It is noteworthy that the reference-model-assisted DRL approach is compatible with any policy gradient DRL algorithms for continuous action problems. This work takes the soft actor-critic algorithm as an example and designs a reference-model-assisted soft actor-critic algorithm. Simulations show that 1) large action space degrades the performance of DRL in the whole training stage, and 2) reference-model-assisted DRL requires fewer iteration times and returns a better optimization performance.


title: On the ergodicity assumption in Performance-Based Engineering

abstract: In the Performance-Based Engineering (PBE) framework, uncertainties in system parameters, or modelling uncertainties, have been shown to have significant effects on capacity fragilities and annual collapse rates of buildings. Yet, since modelling uncertainties are non-ergodic variables, their consideration in failure rate calculations offends the Poisson assumption of independent crossings. This problem has been addressed in the literature, and errors found negligible for small annual collapse failure rates. However, the errors could be significant for serviceability limit states, and when failure rates are integrated in time, to provide lifetime failure probabilities. Herein, we present a novel formulation to fully avoid the error in integration of non-ergodic variables. The proposed product-of-lognormals formulation is fully compatible with popular fragility modelling approaches in PBE context. Moreover, we address collapse limit states of realistic reinforced concrete buildings, and find errors of the order of 5 to 8% for 50-year lifetimes, up to 14% for 100 years. Computation of accurate lifetime failure probabilities in a PBE context is clearly important, as it allows comparison with lifetime target reliability values for other structural analysis formulations.


title: Can Demographic Factors Improve Text Classification? Revisiting Demographic Adaptation in the Age of Transformers

abstract: Demographic factors (e.g., gender or age) shape our language. Previous work showed that incorporating demographic factors can consistently improve performance for various NLP tasks with traditional NLP models. In this work, we investigate whether these previous findings still hold with state-of-the-art pretrained Transformer-based language models (PLMs). We use three common specialization methods proven effective for incorporating external knowledge into pretrained Transformers (e.g., domain-specific or geographic knowledge). We adapt the language representations for the demographic dimensions of gender and age, using continuous language modeling and dynamic multi-task learning for adaptation, where we couple language modeling objectives with the prediction of demographic classes. Our results, when employing a multilingual PLM, show substantial gains in task performance across four languages (English, German, French, and Danish), which is consistent with the results of previous work. However, controlling for confounding factors - primarily domain and language proficiency of Transformer-based PLMs - shows that downstream performance gains from our demographic adaptation do not actually stem from demographic knowledge. Our results indicate that demographic specialization of PLMs, while holding promise for positive societal impact, still represents an unsolved problem for (modern) NLP.


title: The Power of Multi-Step Vizing Chains

abstract: Recent papers [Ber'2022], [GP'2020], [DHZ'2019] have addressed different variants of the (\Delta + 1)-edge colouring problem by concatenating or gluing together many Vizing chains to form what Bernshteyn [Ber'2022] coined \emph{multi-step Vizing chains}. In this paper, we propose a slightly more general definition of this term. We then apply multi-step Vizing chain constructions to prove combinatorial properties of edge colourings that lead to (improved) algorithms for computing edge colouring across different models of computation. This approach seems especially powerful for constructing augmenting subgraphs which respect some notion of locality. First, we construct strictly local multi-step Vizing chains and use them to show a local version of Vizings Theorem thus confirming a recent conjecture of Bonamy, Delcourt, Lang and Postle [BDLP'2020]. Our proof is constructive and also implies an algorithm for computing such a colouring. Then, we show that for any uncoloured edge there exists an augmenting subgraph of size O(\Delta^{7}\log n), answering an open problem of Bernshteyn [Ber'2022]. Chang, He, Li, Pettie and Uitto [CHLPU'2018] show a lower bound of \Omega(\Delta \log \frac{n}{\Delta}) for the size of such augmenting subgraphs, so the upper bound is tight up to \Delta and constant factors. These ideas also extend to give a faster deterministic LOCAL algorithm for (\Delta + 1)-edge colouring running in \tilde{O}(\poly(\Delta)\log^6 n) rounds. These results improve the recent breakthrough result of Bernshteyn [Ber'2022], who showed the existence of augmenting subgraphs of size O(\Delta^6\log^2 n), and used these to give the first (\Delta + 1)-edge colouring algorithm in the LOCAL model running in O(\poly(\Delta, \log n)) rounds. ... (see paper for the remaining part of the abstract)


title: Dynamic load balance of chemical source term evaluation in high-fidelity combustion simulations

abstract: This paper presents a load balancing strategy for reaction rate evaluation and chemistry integration in reacting flow simulations. The large disparity in scales during combustion introduces stiffness in the numerical integration of the PDEs and generates load imbalance during the parallel execution. The strategy is based on the use of the DLB library to redistribute the computing resources at node level, lending additional CPU-cores to higher loaded MPI processes. This approach does not require explicit data transfer and is activated automatically at runtime. Two chemistry descriptions, detailed and reduced, are evaluated on two different configurations: laminar counterflow flame and a turbulent swirl-stabilized flame. For single-node calculations, speedups of 2.3x and 7x are obtained for the detailed and reduced chemistry, respectively. Results on multi-node runs also show that DLB improves the performance of the pure-MPI code similar to single node runs. It is shown DLB can get performance improvements in both detailed and reduced chemistry calculations.


title: Is It Worth the (Environmental) Cost? Limited Evidence for Temporal Adaptation via Continuous Training

abstract: Language is constantly changing and evolving, leaving language models to become quickly outdated. Consequently, we should continuously update our models with new data to expose them to new events and facts. However, that requires additional computing, which means new carbon emissions. Do any measurable benefits justify this cost? This paper looks for empirical evidence to support continuous training. We reproduce existing benchmarks and extend them to include additional time periods, models, and tasks. Our results show that the downstream task performance of temporally adapted English models for social media data do not improve over time. Pretrained models without temporal adaptation are actually significantly more effective and efficient. However, we also note a lack of suitable temporal benchmarks. Our findings invite a critical reflection on when and how to temporally adapt language models, accounting for sustainability.


title: A Generalization of Markov Numbers

abstract: We explore a generalization of the Markov numbers that is motivated by a specific generalized cluster algebra arising from an orbifold, in the sense of Chekhov and Shapiro. We give an explicit algorithm for computing these generalized Markov numbers and exhibit several patterns analogous to those that appear within the ordinary Markov numbers. Along the way, we present formulas related to continued fractions and snake graphs.


title: Gravitational focusing effects on streaming dark matter as a new detection concept

abstract: Cosmological simulations for cold dark matter (DM) indicate that a large number of streams might exist in our Galaxy. The present work incorporates gravitational focusing (GF) effects on streaming DM constituents by the Sun and the Earth preceding their encounter with Earth bound detectors. For streaming DM, the GF gives rise to spatiotemporal flux enhancements of orders of magnitude above the nominal DM density. Remarkably, due to Earth's rotation the derived flux enhancements appear as transient signals lasting about 10 seconds repeating daily for days or weeks. This work presents a novel opportunity for DM signal detection and identification, and the present simulation can be applied to any kind of invisible matter entering the solar system.

categories: astro-ph.IM astro-ph.CO astro-ph.EP gr-qc hep-ph


title: Note on purity of crystalline local systems

abstract: In this short note, we prove a purity result for crystalline local systems on a smooth $p$-adic affine formal scheme. This was previously known by combining the results of Tsuji and Liu-Zhu. We give a totally different argument using the prismatic description of crystalline local systems, which does not use the corresponding result of Liu-Zhu. In particular, our method also proves the local purity statement when the base is a formal power series ring over a complete discrete valuation ring.


title: Threshold solutions for cubic Schr\"odinger systems

abstract: We consider the following Scr\"odinger system $$\begin{cases}\displaystyle i\partial_t u + \Delta u +(|u|^2+\beta |v|^2) u= 0, \\ \displaystyle i\partial_t v + \Delta v +(|v|^2+\beta |u|^2) v = 0,\end{cases}$$ with initial data $(u_0,v_0) \in H^1(\mathbb{R} ^3)\times H^1(\mathbb{R}^3)$ at the so-called \textit{mass-energy threshold}, i.e., such that %$\mathcal{ME}(u_0,v_0) = 1$. $M(u_0,v_0)E(u_0,v_0) = M(\phi,\psi)E(\phi,\psi)$, where $(\phi,\psi)$ is a ground state. For a suitable range of values of $\beta>0$, we show the existence of special solutions to this system, which converge to a standing wave solution in one time direction, and either blows up or scatters in the opposite direction. Moreover, we classify general solutions at the ground state, showing a rigidity result regarding the possible long-time behaviors that might occur. Our results do not rely on the uniqueness of the corresponding ground state: indeed, the main results hold even in the case where the Weinstein functional is known to have more than one optimizer.


title: M2D2: A Massively Multi-domain Language Modeling Dataset

abstract: We present M2D2, a fine-grained, massively multi-domain corpus for studying domain adaptation in language models (LMs). M2D2 consists of 8.5B tokens and spans 145 domains extracted from Wikipedia and Semantic Scholar. Using ontologies derived from Wikipedia and ArXiv categories, we organize the domains in each data source into 22 groups. This two-level hierarchy enables the study of relationships between domains and their effects on in- and out-of-domain performance after adaptation. We also present a number of insights into the nature of effective domain adaptation in LMs, as examples of the new types of studies M2D2 enables. To improve in-domain performance, we show the benefits of adapting the LM along a domain hierarchy; adapting to smaller amounts of fine-grained domain-specific data can lead to larger in-domain performance gains than larger amounts of weakly relevant data. We further demonstrate a trade-off between in-domain specialization and out-of-domain generalization within and across ontologies, as well as a strong correlation between out-of-domain performance and lexical overlap between domains.


title: Pair distribution function analysis for oxide defect identification through feature extraction and supervised learning

abstract: Feature extraction and a neural network model are applied to predict the defect types and concentrations in experimental TiO$_2$ samples. A dataset of TiO$_2$ structures with vacancies and interstitials of oxygen and titanium is built and the structures are relaxed using energy minimization. The features of the calculated pair distribution functions (PDFs) of these defected structures are extracted using linear methods (principal component analysis, non-negative matrix factorization) and non-linear methods (autoencoder, convolutional neural network). The extracted features are used as the inputs to a neural network that maps the feature weights to the concentration of each defect type. The performance of this machine learning pipeline is validated by predicting the defect concentrations based on experimentally-measured TiO$_2$ PDFs and comparing the results to brute-force predictions. A physics-based initialization of the autoencoder has the highest accuracy in predicting the defect concentrations. This model incorporates physical interpretability and predictability of material properties, enabling a more efficient material characterization process with scattering data.


title: SWFormer: Sparse Window Transformer for 3D Object Detection in Point Clouds

abstract: 3D object detection in point clouds is a core component for modern robotics and autonomous driving systems. A key challenge in 3D object detection comes from the inherent sparse nature of point occupancy within the 3D scene. In this paper, we propose Sparse Window Transformer (SWFormer ), a scalable and accurate model for 3D object detection, which can take full advantage of the sparsity of point clouds. Built upon the idea of window-based Transformers, SWFormer converts 3D points into sparse voxels and windows, and then processes these variable-length sparse windows efficiently using a bucketing scheme. In addition to self-attention within each spatial window, our SWFormer also captures cross-window correlation with multi-scale feature fusion and window shifting operations. To further address the unique challenge of detecting 3D objects accurately from sparse features, we propose a new voxel diffusion technique. Experimental results on the Waymo Open Dataset show our SWFormer achieves state-of-the-art 73.36 L2 mAPH on vehicle and pedestrian for 3D object detection on the official test set, outperforming all previous single-stage and two-stage models, while being much more efficient.


title: Mind the Labels: Describing Relations in Knowledge Graphs With Pretrained Models

abstract: Pretrained language models (PLMs) for data-to-text (D2T) generation can use human-readable data labels such as column headings, keys, or relation names to generalize to out-of-domain examples. However, the models are well-known in producing semantically inaccurate outputs if these labels are ambiguous or incomplete, which is often the case in D2T datasets. In this paper, we expose this issue on the task of descibing a relation between two entities. For our experiments, we collect a novel dataset for verbalizing a diverse set of 1,522 unique relations from three large-scale knowledge graphs (Wikidata, DBPedia, YAGO). We find that although PLMs for D2T generation expectedly fail on unclear cases, models trained with a large variety of relation labels are surprisingly robust in verbalizing novel, unseen relations. We argue that using data with a diverse set of clear and meaningful labels is key to training D2T generation systems capable of generalizing to novel domains.


title: A Relational Macrostate Theory Guides Artificial Intelligence to Learn Macro and Design Micro

abstract: The high-dimesionality, non-linearity and emergent properties of complex systems pose a challenge to identifying general laws in the same manner that has been so successful in simpler physical systems. In Anderson's seminal work on why "more is different" he pointed to how emergent, macroscale patterns break symmetries of the underlying microscale laws. Yet, less recognized is that these large-scale, emergent patterns must also retain some symmetries of the microscale rules. Here we introduce a new, relational macrostate theory (RMT) that defines macrostates in terms of symmetries between two mutually predictive observations, and develop a machine learning architecture, MacroNet, that identifies macrostates. Using this framework, we show how macrostates can be identifed across systems ranging in complexity from the simplicity of the simple harmonic oscillator to the much more complex spatial patterning characteristic of Turing instabilities. Furthermore, we show how our framework can be used for the inverse design of microstates consistent with a given macroscopic property -- in Turing patterns this allows us to design underlying rule with a given specification of spatial patterning, and to identify which rule parameters most control these patterns. By demonstrating a general theory for how macroscopic properties emerge from conservation of symmetries in the mapping between observations, we provide a machine learning framework that allows a unified approach to identifying macrostates in systems from the simple to complex, and allows the design of new examples consistent with a given macroscopic property.


title: Rational points in the Noether-Lefschetz locus of moduli spaces of K3 surfaces

abstract: In this paper, we study maps between moduli spaces of lattice-polarized K3 surfaces induced by sublattices of prime index. We show that these maps can be used to determine if a rational point of the moduli space belongs to the Noether-Lefschetz locus. As an application, we prove that the Bombieri-Lang conjecture implies non-density statements for the rational points in the Noether-Lefschetz locus, as predicted by a conjecture of Shafarevich.


title: ScionFL: Efficient and Robust Secure Quantized Aggregation

abstract: Secure aggregation is commonly used in federated learning (FL) to alleviate privacy concerns related to the central aggregator seeing all parameter updates in the clear. Unfortunately, most existing secure aggregation schemes ignore two critical orthogonal research directions that aim to (i) significantly reduce client-server communication and (ii) mitigate the impact of malicious clients. However, both of these additional properties are essential to facilitate cross-device FL with thousands or even millions of (mobile) participants. In this paper, we unite both research directions by introducing ScionFL, the first secure aggregation framework for FL that operates efficiently on quantized inputs and simultaneously provides robustness against malicious clients. Our framework leverages (novel) multi-party computation (MPC) techniques and supports multiple linear (1-bit) quantization schemes, including ones that utilize the randomized Hadamard transform and Kashin's representation. Our theoretical results are supported by extensive evaluations. We show that with no overhead for clients and moderate overhead for the server compared to transferring and processing quantized updates in plaintext, we obtain comparable accuracy for standard FL benchmarks. Moreover, we demonstrate the robustness of our framework against state-of-the-art poisoning attacks.


title: Scalable lipid droplet microarray fabrication, validation, and screening

abstract: High throughput screening of small molecules and natural products is costly, requiring significant amounts of time, reagents, and operating space. Although microarrays have proven effective in the miniaturization of screening for certain biochemical assays, such as nucleic acid hybridization or antibody binding, they are not widely used for drug discovery in cell culture due to the need for cells to internalize lipophilic drug candidates. Lipid droplet microarrays are a promising solution to this problem as they are capable of delivering lipophilic drugs to cells at dosages comparable to solution delivery. However, the scalablility of the array fabrication, assay validation, and screening steps has limited the utility of this approach. Here we demonstrate a scalable process for lipid droplet array fabrication, assay validation in cell culture, and drug screening. A nanointaglio printing process has been adapted for use with a printing press. The arrays are stabilized for immersion into aqueous solution using a vapor coating process. In addition to delivery of lipophilic compounds, we found that we are also able to encapsulate and deliver a water-soluble compound in this way. The arrays can be functionalized by extracellular matrix proteins such as collagen prior to cell culture as the mechanism for uptake is based on direct contact with the lipid delivery vehicles rather than diffusion of the drug out of the microarray spots. We demonstrate this method for delivery to 3 different cell types and the screening of 90 natural product extracts on a microarray covering an area of less than 0.1 cm2. The arrays are suitable for miniaturized screening, for instance in BSL-3 conditions where space is limited and for applications where cell numbers are limited, such as in functional precision medicine.


title: Fermions coupled to the Palatini action in $n$ dimensions

abstract: We study minimal and nonminimal couplings of fermions to the Palatini action in $n$ dimensions ($n\geq 3$) from the Lagrangian and Hamiltonian viewpoints. The Lagrangian action considered is not, in general, equivalent to the Einstein-Dirac action principle. However, by choosing properly the coupling parameters, it is possible to give a first-order action fully equivalent to the Einstein-Dirac theory in a spacetime of dimension four. By using a suitable parametrization of the vielbein and the connection, the Hamiltonian analysis of the general Lagrangian is given, which involves manifestly Lorentz-covariant phase-space variables, a real noncanonical symplectic structure, and only first-class constraints. Additional Hamiltonian formulations are obtained via symplectomorphisms, one of them involving half-densitized fermions. To confront our results with previous approaches, the time gauge is imposed.


title: Marginalized particle Gibbs for multiple state-space models coupled through shared parameters

abstract: We consider Bayesian inference from multiple time series described by a common state-space model (SSM) structure, but where different subsets of parameters are shared between different submodels. An important example is disease-dynamics, where parameters can be either disease or location specific. Parameter inference in these models can be improved by systematically aggregating information from the different time series, most notably for short series. Particle Gibbs (PG) samplers are an efficient class of algorithms for inference in SSMs, in particular when conjugacy can be exploited to marginalize out model parameters from the state update. We present two different PG samplers that marginalize static model parameters on-the-fly: one that updates one model at a time conditioned on the datasets for the other models, and one that concurrently updates all models by stacking them into a high-dimensional SSM. The distinctive features of each sampler make them suitable for different modelling contexts. We provide insights on when each sampler should be used and show that they can be combined to form an efficient PG sampler for a model with strong dependencies between states and parameters. The performance is illustrated on two linear-Gaussian examples and on a real-world example on the spread of mosquito-borne diseases.


title: Positive Hennessy-Milner Logic for Branching Bisimulation

abstract: Labelled transitions systems can be studied in terms of modal logic and in terms of bisimulation. These two notions are connected by Hennessy-Milner theorems, that show that two states are bisimilar precisely when they satisfy the same modal logic formulas. Recently, apartness has been studied as a dual to bisimulation, which also gives rise to a dual version of the Hennessy-Milner theorem: two states are apart precisely when there is a modal formula that distinguishes them. In this paper, we introduce ``directed'' versions of Hennessy-Milner theorems that characterize when the theory of one state is included in the other. For this we introduce ``positive modal logics'' that only allow a limited use of negation. Furthermore, we introduce directed notions of bisimulation and apartness, and then show that, for this positive modal logic, the theory of $s$ is included in the theory of $t$ precisely when $s$ is directed bisimilar to $t$. Or, in terms of apartness, we show that $s$ is directed apart from $t$ precisely when the theory of $s$ is not included in the theory of $t$. From the directed version of the Hennessy-Milner theorem, the original result follows. In particular, we study the case of branching bisimulation and Hennessy-Milner Logic with Until (HMLU) as a modal logic. We introduce ``directed branching bisimulation'' (and directed branching apartness) and ``Positive Hennessy-Milner Logic with Until'' (PHMLU) and we show the directed version of the Hennessy-Milner theorems. In the process, we show that every HMLU formula is equivalent to a Boolean combination of Positive HMLU formulas, which is a very non-trivial result. This gives rise to a sublogic of HMLU that is equally expressive but easier to reason about.


title: Frustratingly Easy Sentiment Analysis of Text Streams: Generating High-Quality Emotion Arcs Using Emotion Lexicons

abstract: Automatically generated emotion arcs -- that capture how an individual or a population feels over time -- are widely used in industry and research. However, there is little work on evaluating the generated arcs. This is in part due to the difficulty of establishing the true (gold) emotion arc. Our work, for the first time, systematically and quantitatively evaluates automatically generated emotion arcs. We also compare two common ways of generating emotion arcs: Machine-Learning (ML) models and Lexicon-Only (LexO) methods. Using a number of diverse datasets, we systematically study the relationship between the quality of an emotion lexicon and the quality of the emotion arc that can be generated with it. We also study the relationship between the quality of an instance-level emotion detection system (say from an ML model) and the quality of emotion arcs that can be generated with it. We show that despite being markedly poor at instance level, LexO methods are highly accurate at generating emotion arcs by aggregating information from hundreds of instances. This has wide-spread implications for commercial development, as well as research in psychology, public health, digital humanities, etc. that values simple interpretable methods and disprefers the need for domain-specific training data, programming expertise, and high-carbon-footprint models.


title: Behavior Cloned Transformers are Neurosymbolic Reasoners

abstract: In this work, we explore techniques for augmenting interactive agents with information from symbolic modules, much like humans use tools like calculators and GPS systems to assist with arithmetic and navigation. We test our agent's abilities in text games -- challenging benchmarks for evaluating the multi-step reasoning abilities of game agents in grounded, language-based environments. Our experimental study indicates that injecting the actions from these symbolic modules into the action space of a behavior cloned transformer agent increases performance on four text game benchmarks that test arithmetic, navigation, sorting, and common sense reasoning by an average of 22%, allowing an agent to reach the highest possible performance on unseen games. This action injection technique is easily extended to new agents, environments, and symbolic modules.


title: Notes on CSPs and Polymorphisms

abstract: These are notes from a multi-year learning seminar on the algebraic approach to Constraint Satisfaction Problems (CSPs). The main topics covered are the theory of algebraic structures with few subpowers, the theory of absorbing subalgebras and its applications to studying CSP templates which can be solved by local consistency methods, and the dichotomy theorem for conservative CSP templates. Subsections and appendices cover supplementary material.


title: Effect of Standing Wave on Terahertz Channel Model

abstract: There is a growing interest in exploiting the terahertz frequency band for future communication systems that demand high data rates. Given the complex propagation behavior of this frequency band, various researchers have developed channel models that can be utilized in the development of communication systems. These models however do not include a crucial aspect of terahertz propagation at short distances: the presence of standing waves. Our measurements show that at specific distances, the effect of standing waves is significant. In this paper, we extend previous terahertz channel models to include the effect of standing waves and show a good fit with our measurements. Our measurements and modeling cover the five most promising terahertz frequency bands: 140, 220, 340, 410, 460 GHz.


title: Synthesis of Proactive Sensor Placement In Probabilistic Attack Graphs

abstract: This paper studies the deployment of joint moving target defense (MTD) and deception against multi-stage cyberattacks. Given the system equipped with MTD that randomizes between different configurations, we investigate how to allocate a bounded number of sensors in each configuration to optimize the attack detection rate before the attacker achieves its objective. Specifically, two types of sensors are considered: intrusion detectors that are observable by the attacker and stealthy sensors that are not observable to the attacker. We propose a two-step optimization-based approach for allocating intrusion detectors and stealthy sensors: Firstly, the defender allocates intrusion detectors assuming the attacker will best respond to evade detection by intrusion detectors. Secondly, the defender will allocate stealthy sensors, given the best response attack strategy computed in the first step, to further reduce the attacker's chance of success. We illustrate the effectiveness of the proposed methods using a cyber defense example.


title: Four-channel radio-frequency signal generator programmed by an open-source Arduino-based control system via single or quad Serial Peripheral Interface

abstract: Radio-frequency (RF) signal generators are standard laboratory equipment and a wide-range of open-source and commercial devices exists to address their many applications. Nonetheless, only few expensive and proprietary solutions can be re-configured within a wide frequency band and triggered on a micro-second timescale. Such specifications are required for applications that use variable radio-frequencies to generate programmed mixed signals, to control processes or states and to precisely steer laser beams using acousto-optical devices, tasks often needed in industrial manufacturing, atomic and molecular physics or microscopy. Here we present an open-source low-cost Arduino-based control system that can store up to millions of commands received from a computer and then perform reliable high-speed programming of an arbitrary device under its control (DUC) via a single- or quad-wire Serial Peripheral Interface. The software architecture operates as a real-time state machine, making it easily extensible and adaptable to any DUC. Each configuration change can be triggered either externally or internally, reaching ~1 MHz rates when using a Teensy 4.1 Arduino-compatible board. Leveraging this flexible system, we developed a programmable four-channel RF signal generator, based on an Analog Devices 9959 Evaluation board, and we demonstrated its capability and validated its performance.


title: Amortized Inference for Heterogeneous Reconstruction in Cryo-EM

abstract: Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved. Our method, cryoFIRE, performs ab initio heterogeneous reconstruction with unknown poses in an amortized framework, thereby avoiding the computationally expensive step of pose search while enabling the analysis of conformational heterogeneity. Poses and conformation are jointly estimated by an encoder while a physics-based decoder aggregates the images into an implicit neural representation of the conformational space. We show that our method can provide one order of magnitude speedup on datasets containing millions of images without any loss of accuracy. We validate that the joint estimation of poses and conformations can be amortized over the size of the dataset. For the first time, we prove that an amortized method can extract interpretable dynamic information from experimental datasets.


title: A Herglotz-based integrator for nonholonomic mechanical systems

abstract: We propose a numerical scheme for the time-integration of nonholonomic mechanical systems, both conservative and nonconservative. The scheme is obtained by simultaneously discretizing the constraint equations and the Herglotz variational principle. We validate the method using numerical simulations and contrast them against the results of standard methods from the literature.


title: On the topological entropy of (a,b)-continued fraction transformations

abstract: We study the topological entropy of a two-parameter family of maps related to (a,b)-continued fraction algorithms and prove that it is constant on a square within the parameter space (two vertices of this square correspond to well-studied continued fraction algorithms). The proof uses conjugation to maps of constant slope. We also present experimental evidence that the topological entropy is flexible (i.e., takes any value in a range) on the whole parameter space.


title: Constraint Inequalities from Hilbert Space Geometry & Efficient Quantum Computation

abstract: Useful relations describing arbitrary parameters of given quantum systems can be derived from simple physical constraints imposed on the vectors in the corresponding Hilbert space. This is well known and it usually proceeds by partitioning the large dimensional Hilbert space into relevant sub spaces and relating points in the Hilbert space to the expectation values of physical observables. The aim of this note is quite modest. We describe the procedure and point out that this parallels the necessary considerations that make Quantum Simulation of quantum fields and interacting many body quantum systems on Noisy Intermediate Scale Quantum (NISQ) devices possible. We conclude by pointing out relevant parts of Quantum Computing where these ideas could be useful. This work proceeds in density matrix formalism and is a review of materials found in references. We enrich the literature by suggesting how to use these ideas to guide and improve parameterized quantum circuits.


title: CMB Delensing with Neural Network Based Lensing Reconstruction in the Presence of Primordial Tensor Perturbations

abstract: The next-generation CMB experiments are expected to constrain the tensor-to-scalar ratio $r$ with high precision. Delensing is an important process as the observed CMB $B$-mode polarization that contains the primordial tensor perturbation signal is dominated by a much larger contribution due to gravitational lensing. To do so successfully, it is useful to explore methods for lensing reconstruction beyond the traditional quadratic estimator (QE) (which will become suboptimal for the next-generation experiments), and the maximum a posterior estimator (which is still currently under development). In Caldeira et al. 2020, the authors showed that a neural network (NN) method using the ResUNet architectrue performs better than the QE and slightly suboptimally compared to the iterative estimator in terms of the lensing reconstruction performance. In this work, we take one step further to evaluate the delensing performance of these estimators on maps with primordial tensor perturbations using a standard delensing pipeline, and show that the \emph{delensing} performance of the NN estimator is optimal, agreeing with that of a converged iterative estimator, when tested on a suite of simulations with $r=0.01$ and $r=0.001$ for $12.7^{\circ} \times 12.7^{\circ}$ maps at a CMB-Stage~4 like polarization noise level $1\,\mu \rm{K\,arcmin}$ and 1' beam. We found that for the purpose of delensing, it is necessary to train and evaluate the NN on a set of CMB maps with $l<l_{\rm{cut}}$ removed, in order to avoid spurious correlations on the scales of interest for the final delensed $B$-mode power spectrum $l<l_{\rm{cut}}$, similar to what was known previously for the QE and the iterative estimator. We also present various NN training techniques that can be extended for a simultaneous treatment of foregrounds and more complex instrumental effects where the modeling is more uncertain.


title: A Neural Model of Number Comparison with Surprisingly Robust Generalization

abstract: We propose a relatively simple computational neural-network model of number comparison. Training on comparisons of the integers 1-9 enable the model to efficiently and accurately simulate a wide range of phenomena, including distance and ratio effects and robust generalization to multidigit integers, negative numbers, and decimal numbers. An accompanying logical model of number comparison provides further insights into the workings of number comparison and its relation to the Arabic number system. These models provide a rational basis for the psychology of number comparison and the ability of neural networks to efficiently learn a powerful system with robust generalization.


title: Non-fungible token transactions: data and challenges

abstract: Non-fungible tokens (NFT) have recently emerged as a novel blockchain hosted financial asset class that has attracted major transaction volumes. Investment decisions rely on data and adequate preprocessing and application of analytics to them. Both owing to the non-fungible nature of the tokens and to a blockchain being the primary data source, NFT transaction data pose several challenges not commonly encountered in traditional financial data. Using data that consist of the transaction history of eight highly valued NFT collections, a selection of such challenges is illustrated. These are: price differentiation by token traits, the possible existence of lateral swaps and wash trades in the transaction history and finally, severe volatility. While this paper merely scratches the surface of how data analytics can be applied in this context, the data and challenges laid out here may present opportunities for future research on the topic.


title: Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagation

abstract: Lipschitz constants are connected to many properties of neural networks, such as robustness, fairness, and generalization. Existing methods for computing Lipschitz constants either produce relatively loose upper bounds or are limited to small networks. In this paper, we develop an efficient framework for computing the $\ell_\infty$ local Lipschitz constant of a neural network by tightly upper bounding the norm of Clarke Jacobian via linear bound propagation. We formulate the computation of local Lipschitz constants with a linear bound propagation process on a high-order backward graph induced by the chain rule of Clarke Jacobian. To enable linear bound propagation, we derive tight linear relaxations for specific nonlinearities in Clarke Jacobian. This formulate unifies existing ad-hoc approaches such as RecurJac, which can be seen as a special case of ours with weaker relaxations. The bound propagation framework also allows us to easily borrow the popular Branch-and-Bound (BaB) approach from neural network verification to further tighten Lipschitz constants. Experiments show that on tiny models, our method produces comparable bounds compared to exact methods that cannot scale to slightly larger models; on larger models, our method efficiently produces tighter results than existing relaxed or naive methods, and our method scales to much larger practical models that previous works could not handle. We also demonstrate an application on provable monotonicity analysis. Code is available at https://github.com/shizhouxing/Local-Lipschitz-Constants.


title: The case of HD 106906 debris disc: A binary's revenge

abstract: Debris disc architecture presents [exo-]planetary scientists with precious clues for processes of planet formation and evolution, including constraints on planetary mass perturbers. This is particularly true of the disc in HD 106906, which in early HST, then follow up polarimetric observations, presented asymmetries and needle-like features that have been attributed to perturbations by a massive, and unusually distant external planetary companion. Here, we revisit the long-term secular dynamical evolution of the HD 106906 disc allowing for the combined gravitational action of the planetary companion and the inner stellar binary which holds the system together. We argue that the binary is strong enough to impose a dynamical break at the disc's location, resulting in distinctive observational signatures which we render via simulated surface density maps and vertical structure profiles. Within uncertainties on the planet's orbit, we show that the disc can go from being fully dominated by the inner binary to significantly so, and is hardly ever outside its reach. The extent of binary dominance impacts the disc's mean eccentricity, a metric which we map as a function of the planet's semi-major axis and orbital eccentricity, with and without radiation pressure. We can thus constrain the planet's orbit to ease the tension between evident axisymmetry in the millimeter, and apparent asymmetry in scattered light. We discuss phase space structure, then inclination distribution, arguing for the relevance of our results to a variety of hierarchical systems, as we set the stage for generalizations that allow for disc self-gravity and collisional evolution.


title: Caption supervision enables robust learners

abstract: Vision language (VL) models like CLIP are robust to natural distribution shifts, in part because CLIP learns on unstructured data using a technique called caption supervision; the model inteprets image-linked texts as ground-truth labels. In a carefully controlled comparison study, we show that caption-supervised CNNs trained on a standard cross-entropy loss (with image labels assigned by scanning captions for class names) can exhibit greater distributional robustness than VL models trained on the same data. To facilitate future experiments with high-accuracy caption-supervised models, we introduce CaptionNet (https://github.com/penfever/CaptionNet/), which includes a class-balanced, fully supervised dataset with over 50,000 new human-labeled ImageNet-compliant samples which includes web-scraped captions. In a series of experiments on CaptionNet, we show how the choice of loss function, data filtration and supervision strategy enable robust computer vision. We also provide the codebase necessary to reproduce our experiments at VL Hub (https://github.com/penfever/vlhub/).


title: A Concise Introduction to Reinforcement Learning in Robotics

abstract: One of the biggest hurdles robotics faces is the facet of sophisticated and hard-to-engineer behaviors. Reinforcement learning offers a set of tools, and a framework to address this problem. In parallel, the misgivings of robotics offer a solid testing ground and evaluation metric for advancements in reinforcement learning. The two disciplines go hand-in-hand, much like the fields of Mathematics and Physics. By means of this survey paper, we aim to invigorate links between the research communities of the two disciplines by focusing on the work done in reinforcement learning for locomotive and control aspects of robotics. Additionally, we aim to highlight not only the notable successes but also the key challenges of the application of Reinforcement Learning in Robotics. This paper aims to serve as a reference guide for researchers in reinforcement learning applied to the field of robotics. The literature survey is at a fairly introductory level, aimed at aspiring researchers. Appropriately, we have covered the most essential concepts required for research in the field of reinforcement learning, with robotics in mind. Through a thorough analysis of this problem, we are able to manifest how reinforcement learning could be applied profitably, and also focus on open-ended questions, as well as the potential for future research.


title: On the existence of closed trajectories and pseudo-trajectories for a family of third order differential equations

abstract: The goal of this article is to study the existence of closed trajectories for the differential equation $\dddot{z}+a\ddot{z}+b\dot{z}+abz=\varepsilon F(z,\dot{z},\ddot{z})$ in two situations. In the first situation, we consider $F(z,\dot{z},\ddot{z})=1$ and $b={\rm sgn}(h(z,\dot{z},\ddot{z}))$, where $h(z,\dot{z},\ddot{z})=z^2+(\dot{z})^2+(\ddot{z})^2-1$. We show that the differential equation is equivalent to a piecewise smooth differential system that admits the unit sphere as the discontinuity manifold. We obtain conditions for the existence of a closed pseudo-trajectory in this case. In the second situation, we consider $\varepsilon \neq 0$ sufficiently small, $b>0$, and $F(z,\dot{z},\ddot{z})$ a $n$-degree polynomial. We show that the unperturbed differential equation has a family of isochronous periodic solutions filling an invariant plane. Then, we study the maximum number of limit cycles which bifurcate from this 2-dimensional isochronous using the averaging theory. Thus, within the same family, we have periodic solutions (in the case where the parameters create a smooth equation) and also pseudo-periodic solutions (in the case of Filippov systems).


title: GridPyM: a Python module to handle grid diagrams

abstract: Grid diagrams are a combinatorial version of classical link diagrams, widely used in theoretical, computational and applied knot theory. Motivated by questions from (bio)-physical knot theory, we introduce GridPyM, a Sage compatible Python module that handles grid diagrams. GridPyM focuses on generating and simplifying grids, and on modelling local transformations between them.


title: Real-time Action Recognition for Fine-Grained Actions and The Hand Wash Dataset

abstract: In this paper we present a three-stream algorithm for real-time action recognition and a new dataset of handwash videos, with the intent of aligning action recognition with real-world constraints to yield effective conclusions. A three-stream fusion algorithm is proposed, which runs both accurately and efficiently, in real-time even on low-powered systems such as a Raspberry Pi. The cornerstone of the proposed algorithm is the incorporation of both spatial and temporal information, as well as the information of the objects in a video while using an efficient architecture, and Optical Flow computation to achieve commendable results in real-time. The results achieved by this algorithm are benchmarked on the UCF-101 as well as the HMDB-51 datasets, achieving an accuracy of 92.7% and 64.9% respectively. An important point to note is that the algorithm is novel in the aspect that it is also able to learn the intricate differences between extremely similar actions, which would be difficult even for the human eye. Additionally, noticing a dearth in the number of datasets for the recognition of very similar or fine-grained actions, this paper also introduces a new dataset that is made publicly available, the Hand Wash Dataset with the intent of introducing a new benchmark for fine-grained action recognition tasks in the future.


title: Estimation of the Sample Frechet Mean: A Convolutional Neural Network Approach

abstract: This work addresses the rising demand for novel tools in statistical and machine learning for "graph-valued random variables" by proposing a fast algorithm to compute the sample Frechet mean, which replaces the concept of sample mean for graphs (or networks). We use convolutional neural networks to learn the morphology of the graphs in a set of graphs. Our experiments on several ensembles of random graphs demonstrate that our method can reliably recover the sample Frechet mean.


title: The two-sided Galois duals of multi-twisted codes

abstract: Characterizing the duals of linear codes with rich algebraic structures received great interest in recent decades. The beginning was by representing cyclic codes over finite fields as ideals in the polynomial ring. Subsequently, studying the duals of constacyclic, quasi-cyclic, quasi-twisted, generalized quasi-cyclic, and multi-twisted codes appeared extensively in literature. We consider the class of multi-twisted (MT) codes because it extends to all of these codes. We describe a MT code $\mathcal{C}$ as a module over a principal ideal domain. Hence, $\mathcal{C}$ has a generator polynomial matrix (GPM) that satisfies an identical equation. The reduced GPM of $\mathcal{C}$ is the Hermite normal form of its GPM. We show that the Euclidean dual $\mathcal{C}^\perp$ of $\mathcal{C}$ is MT as well. We prove a formula for a GPM of $\mathcal{C}^\perp$ using the identical equation of the reduced GPM of $\mathcal{C}$. Then we aim to replace the Euclidean dual with the Galois dual. The Galois inner product is an asymmetric form, so we distinguish between the right and left Galois duals. We show that the right and left Galois duals of a MT code are MT as well but with possibly different shift constants. Our study is the first to contain the right and left Galois duals of a linear code simultaneously. This gives two advantages: establishing their interconnected identities and introducing the two-sided Galois dual that has not previously appeared in the literature. We use a condition for the two-sided Galois dual of a MT code to be MT, hence its GPM is characterized. Two special cases are also studied, one when the right and left Galois duals trivially intersect and the other when they coincide. The latter case is considered for any linear code, where a necessary and sufficient condition is established for the equality of the right and left Galois duals.


title: The Immersed Boundary Double Layer (IBDL) Method

abstract: The Immersed Boundary (IB) method of Peskin (J. Comput. Phys., 1977) is useful for problems involving fluid-structure interactions or complex geometries. By making use of a regular grid that is independent of the geometry, the IB framework yields a robust numerical scheme that can efficiently handle immersed deformable structures. The IB method has also been adapted to problems with prescribed motion and other PDEs with given boundary data. IB methods for these problems traditionally involve penalty forces that only approximately satisfy boundary conditions, or they are formulated as constraint problems. In the latter approach, one must find the unknown forces by solving an equation that corresponds to a poorly conditioned first-kind integral equation. This operation can therefore require a large number of iterations of a Krylov method, and since a time-dependent problem requires this solve at each time step, this method can be prohibitively inefficient without preconditioning. This dissertation introduces a new, well-conditioned IB formulation for boundary value problems, called the Immersed Boundary Double Layer (IBDL) method. We formulate it for Poisson, Helmholtz, Brinkman, Stokes, and Navier-Stokes equations and demonstrate its efficiency over the other constraint method. In this new formulation, the equation for the unknown boundary distribution corresponds to a well-conditioned second-kind integral equation that can be solved efficiently with a small number of iterations of a Krylov method. Furthermore, the iteration count is independent of both the mesh size and the boundary point spacing. The method converges away from the boundary, and when combined with a local interpolation, it converges in the entire PDE domain. Additionally, while the original constraint method applies only to Dirichlet problems, the IBDL formulation can also be used for Neumann boundary conditions.


title: Early Discovery of Disappearing Entities in Microblogs

abstract: We make decisions by reacting to changes in the real world, in particular, the emergence and disappearance of impermanent entities such as events, restaurants, and services. Because we want to avoid missing out on opportunities or making fruitless actions after they have disappeared, it is important to know when entities disappear as early as possible. We thus tackle the task of detecting disappearing entities from microblogs, whose posts mention various entities, in a timely manner. The major challenge is detecting uncertain contexts of disappearing entities from noisy microblog posts. To collect these disappearing contexts, we design time-sensitive distant supervision, which utilizes entities from the knowledge base and time-series posts, for this task to build large-scale Twitter datasets\footnote{We will release the datasets (tweet IDs) used in the experiments to promote reproducibility.} for English and Japanese. To ensure robust detection in noisy environments, we refine pretrained word embeddings of the detection model on microblog streams of the target day. Experimental results on the Twitter datasets confirmed the effectiveness of the collected labeled data and refined word embeddings; more than 70\% of the detected disappearing entities in Wikipedia are discovered earlier than the update on Wikipedia, and the average lead-time is over one month.


title: On the intrinsic and extrinsic boundary for metric measure spaces with lower curvature bounds

abstract: We show that if an Alexandrov space $X$ has an Alexandrov subspace $\bar \Omega$ of the same dimension disjoint from the boundary of $X$, then the topological boundary of $\bar \Omega$ coincides with its Alexandrov boundary. Similarly, if a noncollapsed RCD(K,N) space $X$ has a noncollapsed RCD(K,N) subspace $\bar \Omega$ disjoint from boundary of $X$ and with mild boundary condition, then the topological boundary of $\bar \Omega$ coincides with its De Philippis-Gigli boundary. We then discuss some consequences about convexity of such type of equivalence.


title: Symmetry-Resolved Entanglement of $C_2$-symmetric Topological Insulators

abstract: For a many-body system of arbitrary dimension, we consider fermionic ground states of non-interacting Hamiltonians invariant under a $C_2$ cyclic group. The absolute difference $\Delta$ between the number of occupied symmetric and anti-symmetric single-particle states is an adiabatic invariant. We prove lower bounds on the configurational and the number entropy based on this invariant. In band insulators, the topological invariant $\Delta$ and the entropy bounds can be directly determined from high symmetry points in the Brillouin zone.


title: Anomaly detection in dynamic networks

abstract: Detecting anomalies from a series of temporal networks has many applications, including road accidents in transport networks and suspicious events in social networks. While there are many methods for network anomaly detection, statistical methods are under utilised in this space even though they have a long history and proven capability in handling temporal dependencies. In this paper, we introduce \textit{oddnet}, a feature-based network anomaly detection method that uses time series methods to model temporal dependencies. We demonstrate the effectiveness of oddnet on synthetic and real-world datasets. The R package oddnet implements this algorithm.


title: High-strain-induced local modification of the electronic properties of VO$_2$ thin films

abstract: Vanadium dioxide (VO2) is a popular candidate for electronic and optical switching applications due to its well-known semiconductor-metal transition. Its study is notoriously challenging due to the interplay of long and short range elastic distortions, as well as the symmetry change, and the electronic structure changes. The inherent coupling of lattice and electronic degrees of freedom opens the avenue towards mechanical actuation of single domains. In this work, we show that we can manipulate and monitor the reversible semiconductor-to-metal transition of VO2 while applying a controlled amount of mechanical pressure by a nanosized metallic probe using an atomic force microscope. At a critical pressure, we can reversibly actuate the phase transition with a large modulation of the conductivity. Direct tunneling through the VO2-metal contact is observed as the main charge carrier injection mechanism before and after the phase transition of VO2. The tunneling barrier is formed by a very thin but persistently insulating surfacelayer of the VO2. The necessary pressure to induce the transition decreases with temperature. In addition, we measured the phase coexistence line in a hitherto unexplored regime. Our study provides valuable information on pressure-induced electronic modifications of the VO2 properties, as well as on nanoscale metal-oxide contacts, which can help in the future design of oxide electronics.


title: The REACH radiometer for detecting the 21-cm hydrogen signal from redshift 7.5 to 28

abstract: Observations of the 21-cm line from primordial hydrogen promise to be one of the best tools to study the early epochs of the Universe: the Dark Ages, the Cosmic Dawn, and the subsequent Epoch of Reionization. In 2018, the EDGES experiment caught the attention of the cosmology community with a potential detection of an absorption feature in the sky-averaged radio spectrum centred at 78 MHz. The feature is deeper than expected, and, if confirmed, would call for new physics. However, different groups have re-analyzed the EDGES data and questioned the reliability of the signal. The Radio Experiment for the Analysis of Cosmic Hydrogen (REACH) is a sky-averaged 21-cm experiment aiming at improving the current observations by tackling the issues faced by current instruments related to residual systematic signals in the data. The novel experimental approach focuses on detecting and jointly explaining these systematics together with the foregrounds and the cosmological signal using Bayesian statistics. To achieve this, REACH features simultaneous observations with two different antennas, an ultra wideband system (redshift range 7.5 to 28), and a receiver calibrator based on in-field measurements. Simulated observations forecast percent-level constraints on astrophysical parameters, potentially opening up a new window to the infant Universe.


title: Identification of quantum entanglement with Siamese convolutional neural networks and semi-supervised learning

abstract: Quantum entanglement is a fundamental property commonly used in various quantum information protocols and algorithms. Nonetheless, the problem of identifying entanglement has still not reached a general solution for systems larger than $2\times3$. In this study, we use deep convolutional NNs, a type of supervised machine learning, to identify quantum entanglement for any bipartition in a 3-qubit system. We demonstrate that training the model on synthetically generated datasets of random density matrices excluding challenging positive-under-partial-transposition entangled states (PPTES), which cannot be identified (and correctly labeled) in general, leads to good model accuracy even for PPTES states, that were outside the training data. Our aim is to enhance the model's generalization on PPTES. By applying entanglement-preserving symmetry operations through a triple Siamese network trained in a semi-supervised manner, we improve the model's accuracy and ability to recognize PPTES. Moreover, by constructing an ensemble of Siamese models, even better generalization is observed, in analogy with the idea of finding separate types of entanglement witnesses for different classes of states.


title: TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography

abstract: Neuroimaging-based prediction of neurocognitive measures is valuable for studying how the brain's structure relates to cognitive function. However, the accuracy of prediction using popular linear regression models is relatively low. We propose a novel deep regression method, namely TractoSCR, that allows full supervision for contrastive learning in regression tasks using diffusion MRI tractography. TractoSCR performs supervised contrastive learning by using the absolute difference between continuous regression labels (i.e. neurocognitive scores) to determine positive and negative pairs. We apply TractoSCR to analyze a large-scale dataset including multi-site harmonized diffusion MRI and neurocognitive data from 8735 participants in the Adolescent Brain Cognitive Development (ABCD) Study. We extract white matter microstructural measures using a fine parcellation of white matter tractography into fiber clusters. Using these measures, we predict three scores related to domains of higher-order cognition (general cognitive ability, executive function, and learning/memory). To identify important fiber clusters for prediction of these neurocognitive scores, we propose a permutation feature importance method for high-dimensional data. We find that TractoSCR improves the accuracy of neurocognitive score prediction compared to other state-of-the-art methods. We find that the most predictive fiber clusters are predominantly located within the superficial white matter and projection tracts, particularly the superficial frontal white matter and striato-frontal connections. Overall, our results demonstrate the utility of contrastive representation learning methods for regression, and in particular for improving neuroimaging-based prediction of higher-order cognitive abilities.


title: A Unified Cryptoprocessor for Lattice-based Signature and Key-exchange

abstract: We propose design methodologies for building a compact, unified and programmable cryptoprocessor architecture that computes post-quantum key agreement and digital signature. Synergies in the two types of cryptographic primitives are used to make the cryptoprocessor compact. As a case study, the cryptoprocessor architecture has been optimized targeting the signature scheme 'CRYSTALS-Dilithium' and the key encapsulation mechanism (KEM) 'Saber', both finalists in the NIST's post-quantum cryptography standardization project. The programmable cryptoprocessor executes key generations, encapsulations, decapsulations, signature generations, and signature verifications for all the security levels of Dilithium and Saber. On a Xilinx Ultrascale+ FPGA, the proposed cryptoprocessor consumes 18,406 LUTs, 9,323 FFs, 4 DSPs, and 24 BRAMs. It achieves 200 MHz clock frequency and finishes CCA-secure key-generation/encapsulation/decapsulation operations for LightSaber in 29.6/40.4/58.3$\mu$s; for Saber in 54.9/69.7/94.9$\mu$s; and for FireSaber in 87.6/108.0/139.4$\mu$s, respectively. It finishes key-generation/sign/verify operations for Dilithium-2 in 70.9/151.6/75.2$\mu$s; for Dilithium-3 in 114.7/237/127.6$\mu$s; and for Dilithium-5 in 194.2/342.1/228.9$\mu$s, respectively, for the best-case scenario. On UMC 65nm library for ASIC the latency is improved by a factor of two due to a 2x increase in clock frequency.


title: Invariance-adapted decomposition and Lasso-type contrastive learning

abstract: Recent years have witnessed the effectiveness of contrastive learning in obtaining the representation of dataset that is useful in interpretation and downstream tasks. However, the mechanism that describes this effectiveness have not been thoroughly analyzed, and many studies have been conducted to investigate the data structures captured by contrastive learning. In particular, the recent study of \citet{content_isolate} has shown that contrastive learning is capable of decomposing the data space into the space that is invariant to all augmentations and its complement. In this paper, we introduce the notion of invariance-adapted latent space that decomposes the data space into the intersections of the invariant spaces of each augmentation and their complements. This decomposition generalizes the one introduced in \citet{content_isolate}, and describes a structure that is analogous to the frequencies in the harmonic analysis of a group. We experimentally show that contrastive learning with lasso-type metric can be used to find an invariance-adapted latent space, thereby suggesting a new potential for the contrastive learning. We also investigate when such a latent space can be identified up to mixings within each component.


title: Human mobility networks reveal increased segregation in large cities

abstract: A long-standing expectation is that large, dense, and cosmopolitan areas support socioeconomic mixing and exposure between diverse individuals. It has been difficult to assess this hypothesis because past approaches to measuring socioeconomic mixing have relied on static residential housing data rather than real-life exposures between people at work, in places of leisure, and in home neighborhoods. Here we develop a new measure of exposure segregation (ES) that captures the socioeconomic diversity of everyday encounters. Leveraging cell phone mobility data to represent 1.6 billion exposures among 9.6 million people in the United States, we measure exposure segregation across 382 Metropolitan Statistical Areas (MSAs) and 2829 counties. We discover that exposure segregation is 67% higher in the 10 largest Metropolitan Statistical Areas (MSAs) than in small MSAs with fewer than 100,000 residents. This means that, contrary to expectation, residents of large cosmopolitan areas have significantly less exposure to diverse individuals. Second, we find evidence that large cities offer a greater choice of differentiated spaces targeted to specific socioeconomic groups, a dynamic that accounts for this increase in everyday socioeconomic segregation. Third, we discover that this segregation-increasing effect is countered when a city's hubs (e.g. shopping malls) are positioned to bridge diverse neighborhoods and thus attract people of all socioeconomic statuses. Overall, our findings challenge a long-standing conjecture in human geography and urban design, and highlight how built environment can both prevent and facilitate exposure between diverse individuals.


title: Noise Audits Improve Moral Foundation Classification

abstract: Morality plays an important role in culture, identity, and emotion. Recent advances in natural language processing have shown that it is possible to classify moral values expressed in text at scale. Morality classification relies on human annotators to label the moral expressions in text, which provides training data to achieve state-of-the-art performance. However, these annotations are inherently subjective and some of the instances are hard to classify, resulting in noisy annotations due to error or lack of agreement. The presence of noise in training data harms the classifier's ability to accurately recognize moral foundations from text. We propose two metrics to audit the noise of annotations. The first metric is entropy of instance labels, which is a proxy measure of annotator disagreement about how the instance should be labeled. The second metric is the silhouette coefficient of a label assigned by an annotator to an instance. This metric leverages the idea that instances with the same label should have similar latent representations, and deviations from collective judgments are indicative of errors. Our experiments on three widely used moral foundations datasets show that removing noisy annotations based on the proposed metrics improves classification performance.


title: GLACIAL: Granger and Learning-based Causality Analysis for Longitudinal Studies

abstract: The Granger framework is widely used for discovering causal relationships based on time-varying signals. Implementations of Granger causality (GC) are mostly developed for densely sampled timeseries data. A substantially different setting, particularly common in population health applications, is the longitudinal study design, where multiple individuals are followed and sparsely observed for a limited number of times. Longitudinal studies commonly track many variables, which are likely governed by nonlinear dynamics that might have individual-specific idiosyncrasies and exhibit both direct and indirect causes. Furthermore, real-world longitudinal data often suffer from widespread missingness. GC methods are not well-suited to handle these issues. In this paper, we intend to fill this methodological gap. We propose to marry the GC framework with a machine learning based prediction model. We call our approach GLACIAL, which stands for "Granger and LeArning-based CausalIty Analysis for Longitudinal studies." GLACIAL treats individuals as independent samples and uses average prediction accuracy on hold-out individuals to test for effects of causal relationships. GLACIAL employs a multi-task neural network trained with input feature dropout to efficiently learn nonlinear dynamic relationships between a large number of variables, handle missing values, and probe causal links. Extensive experiments on synthetic and real data demonstrate the utility of GLACIAL and how it can outperform competitive baselines.


title: Ultra-Wide Bandgap Ga$_2$O$_3$-on-SiC MOSFETs

abstract: Ulta-wide bandgap semiconductors based on $\beta$-Ga$_2$O$_3$ offer the potential to achieve higher power switching performance, efficiency, and lower manufacturing cost than today's wide bandgap power semiconductors. However, the most critical challenge to the commercialization of Ga$_2$O$_3$ electronics is overheating, which impacts the device's performance and reliability. We fabricated a Ga$_2$O$_3$/4H-SiC composite wafer using a fusion-bonding method. A low temperature ($\le$ 600 $^{\circ}$C) epitaxy and device processing approach based on low-temperature (LT) metalorganic vapor phase epitaxy is developed to grow a Ga$_2$O$_3$ epitaxial channel layer on the composite wafer and subsequently fabricate into Ga$_2$O$_3$ power MOSFETs. This LT approach is essential to preserve the structural integrity of the composite wafer. These LT-grown epitaxial Ga$_2$O$_3$ MOSFETs deliver high thermal performance (56% reduction in channel temperature), high voltage blocking capabilities up to 2.45 kV, and power figures of merit of $\sim$ 300 MW/cm$^2$, which is a record high for any heterogeneously integrated Ga$_2$O$_3$ devices reported to date. This work is the first realization of multi-kilovolt homoepitaxial Ga$_2$O$_3$ power MOSFETs fabricated on a composite substrate with high heat transfer performance which delivers state-of-the-art power density values while running much cooler than those on native substrates. Thermal characterization and modeling results reveal that a Ga$_2$O$_3$/diamond composite wafer with a reduced Ga$_2$O$_3$ thickness ($\sim$ 1 $\mu$m) and thinner bonding interlayer ($<$ 10 nm) can reduce the device thermal impedance to a level lower than today's GaN-on-SiC power switches.


title: Information consumption and size in firms

abstract: Social and biological collectives need to exchange information to persist and to function. This happens across internal networks, whose structure represents static channels through which information flows. Less studied is the quantity and variety of information transmitted. We characterize a part of the information flow, the information going into organizations, primarily business firms. We measure what firms read using a data set of hundreds of millions of records of news articles accessed by employees across millions of firms. We measure and relate quantitatively three essential aspects: reading volume, reading variety, and firm size. First we compare volume with firm size, showing that firms grow sublinearly with the volume of their reading. The scaling means that inequality in information volume exaggerates the classic Zipf's law inequality in firm size, pointing to an economy of scale in information consumption. Then, by connecting variety and volume, we show that the firms vary in their reading habits to a limited degree. Firms above a certain size become repetitive readers, consistent with the sudden onset of a coordination cost between teams, not individual employees. Finally, we relate information variety to size to show that large firms tend to increase investments in existing areas of interest instead of divesting from them to move to new areas. We argue that this reflects structural constraints in growth. The results indicate how information consumption reflects the role of internal structure, beyond individual employees, analogous to information processing in other social and biological systems.


title: Continued fraction representations of the generalized operator entropy

abstract: The direct calculation of the Generalized operator entropy proves difficult by the appearance of rational exponents of matrices. The main motivation of this work is to overcome these difficulties and to present a practical and efficient method for this calculation using its representation by the matrix continued fraction. At the end of our paper, we deduce a continued fraction expansion of the Bregman operator divergence. Some numerical examples illutrating the theoretical result are discussed.


title: Learning to Efficiently Plan Robust Frictional Multi-Object Grasps

abstract: We consider a decluttering problem where multiple rigid convex polygonal objects rest in randomly placed positions and orientations on a planar surface and must be efficiently transported to a packing box using both single and multi-object grasps. Prior work considered frictionless multi-object grasping. In this paper, we introduce friction to increase the number of potential grasps for a given group of objects, and thus increase picks per hour. We train a neural network using real examples to plan robust multi-object grasps. In physical experiments, we find a 13.7% increase in success rate, a 1.6x increase in picks per hour, and a 6.3x decrease in grasp planning time compared to prior work on multi-object grasping. Compared to single-object grasping, we find a 3.1x increase in picks per hour.


title: Video-rate broadband longwave IR dual-comb spectroscopy with 240,000 comb-mode resolved data points

abstract: We report molecular detection using dual frequency-comb spectroscopy with highly coherent broadband (6.6-11.4 {\m}m) long-wavelength infrared (LWIR) combs. The combs were produced via intra-pulse difference frequency generation (IDFG) in ZGP crystals using sub-three-cycle (20 fs) driving pulses from mode-locked Cr:ZnS lasers at the central wavelength of 2.4 {\m}m). Real-time and up to video rate (0.1-12 s per spectrum) acquisition of molecular spectra with some 240,000 comb-mode-resolved data points spaced by 80 MHz and referenced to a Rb clock with a signal-to-noise ratio (SNR) >300 has been demonstrated. The key to achieving such a high rate of massive spectral data acquisition is a low phase and intensity noise of the LWIR combs and excellent mutual coherence. The high SNR was also facilitated by the high (7.5%) IDFG conversion efficiency resulting in an average LWIR comb power of 300 mW per channel.


title: Field Theory Approaches to Relativistic Hydrodynamics

abstract: Just as non relativistic fluids, oftentimes we find relativistic fluids in situations where random fluctuations cannot be ignored, thermal and turbulent fluctuations being the most relevant examples. Because of the theory's inherent nonlinearity, fluctuations induce deep and complex changes in the dynamics of the system. The Martin-Siggia-Rose technique is a powerful tool that allows us to translate the original hydrodynamic problem into a quantum field theory one, thus taking advantage of the progress in the treatment of quantum fields out of equilibrium. To demonstrate this technique, we shall consider the thermal fluctuations of the spin two modes of a relativistic fluid, in a theory where hydrodynamics is derived by taking moments of the Boltzmann equation under the relaxation time approximation.


title: Task Grouping for Multilingual Text Recognition

abstract: Most existing OCR methods focus on alphanumeric characters due to the popularity of English and numbers, as well as their corresponding datasets. On extending the characters to more languages, recent methods have shown that training different scripts with different recognition heads can greatly improve the end-to-end recognition accuracy compared to combining characters from all languages in the same recognition head. However, we postulate that similarities between some languages could allow sharing of model parameters and benefit from joint training. Determining language groupings, however, is not immediately obvious. To this end, we propose an automatic method for multilingual text recognition with a task grouping and assignment module using Gumbel-Softmax, introducing a task grouping loss and weighted recognition loss to allow for simultaneous training of the models and grouping modules. Experiments on MLT19 lend evidence to our hypothesis that there is a middle ground between combining every task together and separating every task that achieves a better configuration of task grouping/separation.


title: Autoregressive Uncertainty Modeling for 3D Bounding Box Prediction

abstract: 3D bounding boxes are a widespread intermediate representation in many computer vision applications. However, predicting them is a challenging task, largely due to partial observability, which motivates the need for a strong sense of uncertainty. While many recent methods have explored better architectures for consuming sparse and unstructured point cloud data, we hypothesize that there is room for improvement in the modeling of the output distribution and explore how this can be achieved using an autoregressive prediction head. Additionally, we release a simulated dataset, COB-3D, which highlights new types of ambiguity that arise in real-world robotics applications, where 3D bounding box prediction has largely been underexplored. We propose methods for leveraging our autoregressive model to make high confidence predictions and meaningful uncertainty measures, achieving strong results on SUN-RGBD, Scannet, KITTI, and our new dataset.


title: Metasurface Holographic Optical Traps for Ultracold Atoms

abstract: We propose metasurface holograms as a novel platform to generate optical trap arrays for cold atoms with high fidelity, efficiency, and thermal stability. We developed design and fabrication methodologies to create dielectric, phase-only metasurface holograms based on titanium dioxide. We experimentally demonstrated optical trap arrays of various geometries, including periodic and aperiodic configurations with dimensions ranging from 1D to 3D and the number of trap sites up to a few hundred. We characterized the performance of the holographic metasurfaces in terms of the positioning accuracy, size and intensity uniformity of the generated traps, and power handling capability of the dielectric metasurfaces. Our proposed platform has great potential for enabling fundamental studies of quantum many-body physics, and quantum simulation and computation tasks. The compact form factor, passive nature, good power handling capability, and scalability of generating high-quality, large-scale arrays also make the metasurface platform uniquely suitable for realizing field-deployable devices and systems based on cold atoms.


title: Skill-Based Reinforcement Learning with Intrinsic Reward Matching

abstract: While unsupervised skill discovery has shown promise in autonomously acquiring behavioral primitives, there is still a large methodological disconnect between task-agnostic skill pretraining and downstream, task-aware finetuning. We present Intrinsic Reward Matching (IRM), which unifies these two phases of learning via the $\textit{skill discriminator}$, a pretraining model component often discarded during finetuning. Conventional approaches finetune pretrained agents directly at the policy level, often relying on expensive environment rollouts to empirically determine the optimal skill. However, often the most concise yet complete description of a task is the reward function itself, and skill learning methods learn an $\textit{intrinsic}$ reward function via the discriminator that corresponds to the skill policy. We propose to leverage the skill discriminator to $\textit{match}$ the intrinsic and downstream task rewards and determine the optimal skill for an unseen task without environment samples, consequently finetuning with greater sample-efficiency. Furthermore, we generalize IRM to sequence skills for complex, long-horizon tasks and demonstrate that IRM enables us to utilize pretrained skills far more effectively than previous skill selection methods on both the Fetch tabletop and Franka Kitchen robot manipulation benchmarks.


title: Scalar particles around a Rindler-Schwarzschild wormhole

abstract: In this paper, we study quantum relativistic features of a scalar field around the Rindler-Schwarzschild wormhole. First, we introduce this new class of spacetime, investigating some energy conditions and verifying their violation in a region nearby the wormhole throat, which means that the object has to have an exotic energy in order to prevent its collapse. Then, we study the behavior of the massless scalar field in this spacetime and compute the effective potential by means of tortoise coordinates. We show that such a potential is attractive nearby the wormhole throat and that is traversable via quantum tunneling by massive particles with sufficiently low energies. The solution of the Klein-Gordon equation is obtained subsequently, showing that the energy spectrum of the field is subject to a constraint which induces a decreasing oscillatory behavior. On imposing Dirichlet boundary conditions on a spherical shell nearby the throat we then determine the particle energy levels, and we use this spectrum to calculate the quantum revival of the eigenstates. Finally, we compute the Casimir energy associated with the massless scalar field at zero temperature. We perform this calculation by means of the sum of modes method. The zero-point energy is regularized using the Epstein-Hurwitz zeta-function. We also obtain an analytical expression for the Casimir force acting on the shell.