title: Identification in Tree-shaped Linear Structural Causal Models

abstract: Linear structural equation models represent direct causal effects as directed edges and confounding factors as bidirected edges. An open problem is to identify the causal parameters from correlations between the nodes. We investigate models, whose directed component forms a tree, and show that there, besides classical instrumental variables, missing cycles of bidirected edges can be used to identify the model. They can yield systems of quadratic equations that we explicitly solve to obtain one or two solutions for the causal parameters of adjacent directed edges. We show how multiple missing cycles can be combined to obtain a unique solution. This results in an algorithm that can identify instances that previously required approaches based on Gr\"obner bases, which have doubly-exponential time complexity in the number of structural parameters.


title: Efficient Video Instance Segmentation via Tracklet Query and Proposal

abstract: Video Instance Segmentation (VIS) aims to simultaneously classify, segment, and track multiple object instances in videos. Recent clip-level VIS takes a short video clip as input each time showing stronger performance than frame-level VIS (tracking-by-segmentation), as more temporal context from multiple frames is utilized. Yet, most clip-level methods are neither end-to-end learnable nor real-time. These limitations are addressed by the recent VIS transformer (VisTR) which performs VIS end-to-end within a clip. However, VisTR suffers from long training time due to its frame-wise dense attention. In addition, VisTR is not fully end-to-end learnable in multiple video clips as it requires a hand-crafted data association to link instance tracklets between successive clips. This paper proposes EfficientVIS, a fully end-to-end framework with efficient training and inference. At the core are tracklet query and tracklet proposal that associate and segment regions-of-interest (RoIs) across space and time by an iterative query-video interaction. We further propose a correspondence learning that makes tracklets linking between clips end-to-end learnable. Compared to VisTR, EfficientVIS requires 15x fewer training epochs while achieving state-of-the-art accuracy on the YouTube-VIS benchmark. Meanwhile, our method enables whole video instance segmentation in a single end-to-end pass without data association at all.


title: A study on the distribution of social biases in self-supervised learning visual models

abstract: Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases, such as ineffective or uneven data sampling, but also ethical concerns, as the social biases are implicitly present\textemdash even inadvertently, in the training data or explicitly defined in unfair training schedules. In tasks having impact on human processes, the learning of social biases may produce discriminatory, unethical and untrustworthy consequences. It is often assumed that social biases stem from supervised learning on labelled data, and thus, Self-Supervised Learning (SSL) wrongly appears as an efficient and bias-free solution, as it does not require labelled data. However, it was recently proven that a popular SSL method also incorporates biases. In this paper, we study the biases of a varied set of SSL visual models, trained using ImageNet data, using a method and dataset designed by psychological experts to measure social biases. We show that there is a correlation between the type of the SSL model and the number of biases that it incorporates. Furthermore, the results also suggest that this number does not strictly depend on the model's accuracy and changes throughout the network. Finally, we conclude that a careful SSL model selection process can reduce the number of social biases in the deployed model, whilst keeping high performance.


title: Reasoning about Counterfactuals to Improve Human Inverse Reinforcement Learning

abstract: To collaborate well with robots, we must be able to understand their decision making. Humans naturally infer other agents' beliefs and desires by reasoning about their observable behavior in a way that resembles inverse reinforcement learning (IRL). Thus, robots can convey their beliefs and desires by providing demonstrations that are informative for a human learner's IRL. An informative demonstration is one that differs strongly from the learner's expectations of what the robot will do given their current understanding of the robot's decision making. However, standard IRL does not model the learner's existing expectations, and thus cannot do this counterfactual reasoning. We propose to incorporate the learner's current understanding of the robot's decision making into our model of human IRL, so that a robot can select demonstrations that maximize the human's understanding. We also propose a novel measure for estimating the difficulty for a human to predict instances of a robot's behavior in unseen environments. A user study finds that our test difficulty measure correlates well with human performance and confidence. Interestingly, considering human beliefs and counterfactuals when selecting demonstrations decreases human performance on easy tests, but increases performance on difficult tests, providing insight on how to best utilize such models.


title: Gravitational wave birefringence in spatially curved teleparallel cosmology

abstract: We study tensor perturbations around the most general cosmologically symmetric backgrounds in a class of teleparallel gravity theories known as New General Relativity. These theories comprise a one-parameter class, which is fully consistent with observations at the post-Newtonian level, and which contains the teleparallel equivalent of General Relativity as a special case. We find that for a particular class of cosmological background geometries these theories exhibit gravitational wave birefringence and dispersion, i.e., the dispersion relation for gravitational waves depends on their polarization and wave number. The strength of this effect is directly related to the spatial curvature of the cosmological background and the parameter describing the deviation of the theory from General Relativity. We discuss the possibility of observing this effect in gravitational wave experiments.


title: Improved Approximation Algorithms and Lower Bounds for Search-Diversification Problems

abstract: We study several questions related to diversifying search results. We give improved approximation algorithms in each of the following problems, together with some lower bounds. - We give a polynomial-time approximation scheme (PTAS) for a diversified search ranking problem [Bansal et al., ICALP 2010] whose objective is to minimizes the discounted cumulative gain. Our PTAS runs in time $n^{2^{O(\log(1/\epsilon)/\epsilon)}} \cdot m^{O(1)}$ where $n$ denotes the number of elements in the databases. Complementing this, we show that no PTAS can run in time $f(\epsilon) \cdot (nm)^{2^{o(1/\epsilon)}}$ assuming Gap-ETH; therefore our running time is nearly tight. Both of our bounds answer open questions of Bansal et al. - We next consider the Max-Sum Dispersion problem, whose objective is to select $k$ out of $n$ elements that maximizes the dispersion, which is defined as the sum of the pairwise distances under a given metric. We give a quasipolynomial-time approximation scheme for the problem which runs in time $n^{O_{\epsilon}(\log n)}$. This improves upon previously known polynomial-time algorithms with approximate ratios 0.5 [Hassin et al., Oper. Res. Lett. 1997; Borodin et al., ACM Trans. Algorithms 2017]. Furthermore, we observe that known reductions rule out approximation schemes that run in $n^{\tilde{o}_\epsilon(\log n)}$ time assuming ETH. - We consider a generalization of Max-Sum Dispersion called Max-Sum Diversification. In addition to the sum of pairwise distance, the objective includes another function $f$. For monotone submodular $f$, we give a quasipolynomial-time algorithm with approximation ratio arbitrarily close to $(1 - 1/e)$. This improves upon the best polynomial-time algorithm which has approximation ratio $0.5$ by Borodin et al. Furthermore, the $(1 - 1/e)$ factor is tight as achieving better-than-$(1 - 1/e)$ approximation is NP-hard [Feige, J. ACM 1998].


title: Bloch oscillations in the magnetoconductance of twisted bilayer graphene

abstract: We identify a mapping between two-dimensional (2D) electron transport in a minimally twisted graphene bilayer and a 1D quantum walk, where one spatial dimension plays the role of time. In this mapping a magnetic field B perpendicular to the bilayer maps onto an electric field. Bloch oscillations due to the periodic motion in a 1D Bloch band can then be observed in purely DC transport as magnetoconductance oscillations with periodicity set by the Bloch frequency.


title: Robust PAC$^m$: Training Ensemble Models Under Misspecification and Outliers

abstract: Standard Bayesian learning is known to have suboptimal generalization capabilities under misspecification and in the presence of outliers. PAC-Bayes theory demonstrates that the free energy criterion minimized by Bayesian learning is a bound on the generalization error for Gibbs predictors (i.e., for single models drawn at random from the posterior) under the assumption of sampling distributions uncontaminated by outliers. This viewpoint provides a justification for the limitations of Bayesian learning when the model is misspecified, requiring ensembling, and when data is affected by outliers. In recent work, PAC-Bayes bounds -- referred to as PAC$^m$ -- were derived to introduce free energy metrics that account for the performance of ensemble predictors, obtaining enhanced performance under misspecification. This work presents a novel robust free energy criterion that combines the generalized logarithm score function with PAC$^m$ ensemble bounds. The proposed free energy training criterion produces predictive distributions that are able to concurrently counteract the detrimental effects of misspecification -- with respect to both likelihood and prior distribution -- and outliers.


title: The Potential to Probe Solar Neutrino Physics with LiCl Water Solution

abstract: Lithium chloride water solution is a good option for solar neutrino detection. The $\nu_e$ charged-current (CC) interaction cross-section on $\rm{{}^{7}Li}$ is evaluated with new B(GT) experimental measurements. The total CC interaction cross-section weighted by the solar $^8$B electron neutrino spectrum is $3.759\times10^{-42} \rm{cm}^2$, which is about 60 times that of the neutrino-electron elastic scattering process. The final state effective kinetic energy after the CC interaction on $\rm{{}^{7}Li}$ directly reflects the neutrino energy, which stands in sharp contrast to the plateau structure of recoil electrons of the elastic scattering. With the high solubility of LiCl of 74.5 g/100 g water at 10$^\circ$C and the high natural abundance of 92.41%, the molarity of $\rm{{}^{7}Li}$ in water can reach 11 mol/L for safe operation at room temperature. The CC event rate of $\nu_e$ on $\rm{{}^{7}Li}$ in the LiCl water solution is comparable to that of neutrino-electron elastic scattering. In addition, the $\nu_e$ CC interaction with the contained $\rm{{}^{37}Cl}$ also contributes a few percent of the total CC event rate. The contained $\rm{{}^{35}Cl}$ and $\rm{{}^{6}Li}$ also make a delay-coincidence detection for electron antineutrinos possible. The recrystallization method is found to be applicable for LiCl sample purification. The measured attenuation length of $11\pm1$ m at 430 nm shows that the LiCl solution is practicable for a 10-m diameter detector for solar neutrino detection. Clear advantages are found in studying the upturn effect of solar neutrino oscillation, light sterile neutrinos, and Earth matter effect. The sensitivities in discovering solar neutrino upturn and light sterile neutrinos are shown.


title: Rank-uniform local law for Wigner matrices

abstract: We prove a general local law for Wigner matrices which optimally handles observables of arbitrary rank and thus it unifies the well-known averaged and isotropic local laws. As an application, we prove that the quadratic forms of a general deterministic matrix $A$ on the bulk eigenvectors of a Wigner matrix has approximately Gaussian fluctuation. For the bulk spectrum, we thus generalize our previous result [arXiv:2103.06730] valid for test matrices $A$ of large rank as well as the result of Benigni and Lopatto [arXiv:2103.12013] valid for specific small rank observables.


title: The world seems different in a social context: a neural network analysis of human experimental data

abstract: Human perception and behavior are affected by the situational context, in particular during social interactions. A recent study demonstrated that humans perceive visual stimuli differently depending on whether they do the task by themselves or together with a robot. Specifically, it was found that the central tendency effect is stronger in social than in non-social task settings. The particular nature of such behavioral changes induced by social interaction, and their underlying cognitive processes in the human brain are, however, still not well understood. In this paper, we address this question by training an artificial neural network inspired by the predictive coding theory on the above behavioral data set. Using this computational model, we investigate whether the change in behavior that was caused by the situational context in the human experiment could be explained by continuous modifications of a parameter expressing how strongly sensory and prior information affect perception. We demonstrate that it is possible to replicate human behavioral data in both individual and social task settings by modifying the precision of prior and sensory signals, indicating that social and non-social task settings might in fact exist on a continuum. At the same time an analysis of the neural activation traces of the trained networks provides evidence that information is coded in fundamentally different ways in the network in the individual and in the social conditions. Our results emphasize the importance of computational replications of behavioral data for generating hypotheses on the underlying cognitive mechanisms of shared perception and may provide inspiration for follow-up studies in the field of neuroscience.


title: NuSTAR discovery of a cyclotron line in GRO J1750-27

abstract: GRO J1750-27, discovered during an outburst in 1995 with CGRO-BATSE, is one of the farthest known galactic Be-X-ray binary systems. This relatively poorly studied system recently went into an outburst in September 2021. The source was observed during the latest outburst using the NuSTAR telescope during the rising phase of the outburst. We estimate the spin period of the source to be 4.45 s using which we produced energy-resolved pulse profiles between 3 and 65 keV. We find that the profile is double-peaked at low energies (<18 keV) while evolving into a single peak at higher energies (>18 keV). The broadband spectrum of this source was fitted well with a high energy cutoff power-law model and we report the discovery of a cyclotron resonant scattering feature (CRSF) in this source at 43 keV, indicating a magnetic field strength of $3.7 \times 10^{12}$ G. Our estimate of the magnetic field strength using the cyclotron line is consistent with the estimates made earlier using the accretion torque model from measurements of spin-up rates and fluxes during the previous outbursts.


title: Robustness and Adaptation to Hidden Factors of Variation

abstract: We tackle here a specific, still not widely addressed aspect, of AI robustness, which consists of seeking invariance / insensitivity of model performance to hidden factors of variations in the data. Towards this end, we employ a two step strategy that a) does unsupervised discovery, via generative models, of sensitive factors that cause models to under-perform, and b) intervenes models to make their performance invariant to these sensitive factors' influence. We consider 3 separate interventions for robustness, including: data augmentation, semantic consistency, and adversarial alignment. We evaluate our method using metrics that measure trade offs between invariance (insensitivity) and overall performance (utility) and show the benefits of our method for 3 settings (unsupervised, semi-supervised and generalization).


title: Real eigenstructure of regular simplex tensors

abstract: We are concerned with the eigenstructure of supersymmetric tensors. Like in the matrix case, normalized tensor eigenvectors are fixed points of the tensor power iteration map. However, unless the given tensor is orthogonally decomposable, some of these fixed points may be repelling and therefore be undetectable by any numerical scheme. In this paper, we consider the case of regular simplex tensors whose symmetric decomposition is induced by an overcomplete, equiangular set of $n+1$ vectors from $\mathbb R^n$. We discuss the full real eigenstructure of such tensors, including the robustness analysis of all normalized eigenvectors. As it turns out, regular simplex tensors exhibit robust as well as non-robust eigenvectors which, moreover, only partly coincide with the generators from the symmetric tensor decomposition.


title: Jupiter's inhomogeneous envelope

abstract: While Jupiter's massive gas envelope consists mainly of hydrogen and helium, the key to understanding Jupiter's formation and evolution lies in the distribution of the remaining (heavy) elements. Before the Juno mission, the lack of high-precision gravity harmonics precluded the use of statistical analyses in a robust determination of the heavy-elements distribution in Jupiter's envelope. In this paper, we assemble the most comprehensive and diverse collection of Jupiter interior models to date and use it to study the distribution of heavy elements in the planet's envelope. We apply a Bayesian statistical approach to our interior model calculations, reproducing the Juno gravitational and atmospheric measurements and constraints from the deep zonal flows. Our results show that the gravity constraints lead to a deep entropy of Jupiter corresponding to a 1 bar temperature 5-15 K higher than traditionally assumed. We also find that uncertainties in the equation of state are crucial when determining the amount of heavy elements in Jupiter's interior. Our models put an upper limit to the inner compact core of Jupiter of 7 Earth masses, independently on the structure model (with or without dilute core) and the equation of state considered. Furthermore, we robustly demonstrate that Jupiter's envelope is inhomogenous, with a heavy-element enrichment in the interior relative to the outer envelope. This implies that heavy element enrichment continued through the gas accretion phase, with important implications for the formation of giant planets in our solar system and beyond.


title: Axial and Vector Structure Functions for Lepton-Nucleon Scattering, NuFact 2021 Update

abstract: We report on an update (2021) of a phenomenological model for inelastic neutrino- and electron-nucleon scattering cross sections using effective leading order parton distribution functions with a new scaling variable $\xi_w$. Non-perturbative effects are well described using the $\xi_w$ scaling variable in combination with multiplicative $K$ factors at low $Q^2$. The model describes all inelastic charged-lepton-nucleon scattering data (HERA/NMC/BCDMS/SLAC/JLab) ranging from very high $Q^2$ to very low $Q^2$ and down to the $Q^2=0$ photo-production region. The model has been developed to be used in analyses of neutrino oscillation experiments in the few GeV region. The 2021 update accounts for the difference between axial and vector structure functions which brings it into much better agreement with neutrino-nucleon total cross section measurements. The model has been developed primarily for hadronic final state masses $W$ above 1.8 GeV. However with additional parameters the model also describes the $average$ neutrino cross sections in the resonance region down to $W$=1.4 GeV.


title: Optimal Transport Reconstruction of Baryon Acoustic Oscillations

abstract: A weighted, semi-discrete, fast optimal transport (OT) algorithm for reconstructing the Lagrangian positions of proto-halos from their evolved Eulerian positions is presented. The algorithm makes use of a mass estimate of the biased tracers and of the distribution of the remaining mass (the `dust'), but is robust to errors in the mass estimates. Tests with state-of-art cosmological simulations show that if the dust is assumed to have a uniform spatial distribution, then the shape of the OT-reconstructed pair correlation function of the tracers is very close to linear theory, enabling sub-percent precision in the BAO distance scale that depends weakly, if at all, on a cosmological model. With a more sophisticated model for the dust, OT returns an estimate of the displacement field which yields superb reconstruction of the proto-halo positions, and hence of the shape and amplitude of the initial pair correlation function of the tracers. This enables direct and independent determinations of the bias factor $b$ and the smearing scale $\Sigma$, potentially providing new methods for breaking the degeneracy between $b$ and $\sigma_8$.


title: Gaussian Process-based Spatial Reconstruction of Electromagnetic fields

abstract: These days we live in a world with a permanent electromagnetic field. This raises many questions about our health and the deployment of new equipment. The problem is that these fields remain difficult to visualize easily, which only some experts can understand. To tackle this problem, we propose to spatially estimate the level of the field based on a few observations at all positions of the considered space. This work presents an algorithm for spatial reconstruction of electromagnetic fields using the Gaussian Process. We consider a spatial, physical phenomenon observed by a sensor network. A Gaussian Process regression model with selected mean and covariance function is implemented to develop a 9 sensors-based estimation algorithm. A Bayesian inference approach is used to perform the model selection of the covariance function and to learn the hyperparameters from our data set. We present the prediction performance of the proposed model and compare it with the case where the mean is zero. The results show that the proposed Gaussian Process-based prediction model reconstructs the EM fields in all positions only using 9 sensors.


title: KamNet: An Integrated Spatiotemporal Deep Neural Network for Rare Event Search in KamLAND-Zen

abstract: Rare event searches allow us to search for new physics at energy scales inaccessible with other means by leveraging specialized large-mass detectors. Machine learning provides a new tool to maximize the information provided by these detectors. The information is sparse, which forces these algorithms to start from the lowest level data and exploit all symmetries in the detector to produce results. In this work we present KamNet which harnesses breakthroughs in geometric deep learning and spatiotemporal data analysis to maximize the physics reach of KamLAND-Zen, a kiloton scale spherical liquid scintillator detector searching for neutrinoless double beta decay ($0\nu\beta\beta$). Using a simplified background model for KamLAND we show that KamNet outperforms a conventional CNN on benchmarking MC simulations with an increasing level of robustness. Using simulated data, we then demonstrate KamNet's ability to increase KamLAND-Zen's sensitivity to $0\nu\beta\beta$ and $0\nu\beta\beta$ to excited states. A key component of this work is the addition of an attention mechanism to elucidate the underlying physics KamNet is using for the background rejection.


title: Euclidean de Sitter Black Holes and Microcanonical Equilibrium

abstract: Schwarzschild-de Sitter (SdS) black holes do not admit a completely smooth Euclidean continuation. We discuss some modifications of the gravitational path integral that give Euclidean SdS a semiclassical equilibrium interpretation. First we consider "gravity in a cavity," defining the canonical ensemble in a box that excises one horizon. However, this standard approach does not work for positive cosmological constant: the solution of lowest free energy has a negative heat capacity, which is inconsistent if it is to provide the leading semiclassical contribution to a canonical partition function. Instead we modify the boundary conditions in the path integral to construct the microcanonical partition function, which appears to be well-defined. We then bring two ensembles into contact and remove the boundary, producing states of a larger microcanonical ensemble that contain, for example, both a black hole and a cosmological horizon at once. These systems are closed and have no boundary, but they must possess some form of mild metric discontinuity. We discuss the case where the discontinuity is equivalent to the insertion of a thin, rigid membrane, separating two systems that can exchange energy and are at local equilibrium. Equilibrium configurations obtained in this way are found to be thermodynamically unstable if they contain a black hole.


title: Don't Roll the Dice, Ask Twice: The Two-Query Distortion of Matching Problems and Beyond

abstract: In most social choice settings, the participating agents express their preferences over the different alternatives in the form of linear orderings. While this clearly simplifies preference elicitation, it inevitably leads to poor performance with respect to optimizing a cardinal objective, such as the social welfare, since the values of the agents remain virtually unknown. This loss in performance because of lack of information is measured by the notion of distortion. A recent array of works put forward the agenda of designing mechanisms that learn the values of the agents for a small number of alternatives via queries, and use this limited extra information to make better-informed decisions, thus improving distortion. Following this agenda, in this work we focus on a class of combinatorial problems that includes most well-known matching problems and several of their generalizations, such as One-Sided Matching, Two-Sided Matching, General Graph Matching, and $k$-Constrained Resource Allocation. We design two-query mechanisms that achieve the best-possible worst-case distortion in terms of social welfare, and outperform the best-possible expected distortion achieved by randomized ordinal mechanisms.


title: Kinetic modeling of three-dimensional electrostatic-solitary and surface waves in beam neutralization

abstract: This work studies the fundamental plasma processes involved in the neutralization of an ion beam's space-charge by electrons emitted by a filament using Particle-in-Cell simulations. While filament neutralization is economical, previous experiments have shown that a variety of waves become excited in this process that limit the space-charge neutralization. In this work, the formation and movement of electrostatic solitary waves(ESWs), which have low dissipation rates, are characterized for 2D planar and 3D cylindrical beams and are observed to generate waves that survive for a long time and slow the process of beam neutralization. Further, through a 1D Bernstein-Greene-Kruskal (BGK) analysis, we find that the non-Maxwellian nature of the beam electrons gives rise to large-sized ESWs that are not predicted by theory which assumes that the electrons may be described by a Maxwellian distribution. Our PIC simulations are sufficiently sensitive to be able to resolve important three-dimensional effects in a 3D cylindrical geometry that lead to the excitation of Trivelpiece-Gould surface waves due to high-energy electrons present at the beginning of neutralization.


title: Thermodynamics-informed graph neural networks

abstract: In this paper we present a deep learning method to predict the temporal evolution of dissipative dynamic systems. We propose using both geometric and thermodynamic inductive biases to improve accuracy and generalization of the resulting integration scheme. The first is achieved with Graph Neural Networks, which induces a non-Euclidean geometrical prior with permutation invariant node and edge update functions. The second bias is forced by learning the GENERIC structure of the problem, an extension of the Hamiltonian formalism, to model more general non-conservative dynamics. Several examples are provided in both Eulerian and Lagrangian description in the context of fluid and solid mechanics respectively, achieving relative mean errors of less than 3% in all the tested examples. Two ablation studies are provided based on recent works in both physics-informed and geometric deep learning.


title: Low complexity equalization for AFDM in doubly dispersive channels

abstract: Affine Frequency Division Multiplexing (AFDM), which is based on discrete affine Fourier transform (DAFT), has recently been proposed for reliable communication in high-mobility scenarios. Two low complexity detectors for AFDM are introduced here. Approximating the channel matrix as a band matrix via placing null symbols in the AFDM frame in the DAFT domain, a low complexity MMSE detection is proposed by means of the $\rm{LDL}$ factorization. Furthermore, exploiting the sparsity of the channel matrix, we propose a low complexity iterative decision feedback equalizer (DFE) based on weighted maximal ratio combining (MRC), which extracts and combines the received multipath components of the transmitted symbols in the DAFT domain. Simulation results show that the proposed detectors have similar performance, while weighted MRC-based DFE has lower complexity than band-matrix-approximation LMMSE when the channel impulse response has gaps.


title: Cohomology of finite subgroups of the plane Cremona group

abstract: An equivariant stable birational invariant of an action of a finite group on a smooth projective variety is the first cohomology group of the Picard module. Bogomolov-Prokhorov and Shinder computed this for actions of cyclic groups on rational surfaces, with maximal stabilizers, in terms of the geometry of the fixed point locus. Using the Brauer group of the quotient stack, we extend the computation to more general actions and relate it to the equivariant Burnside group formalism.


title: Query Processing on Tensor Computation Runtimes

abstract: The huge demand for computation in artificial intelligence (AI) is driving unparalleled investments in hardware and software systems for AI. This leads to an explosion in the number of specialized hardware devices, which are now offered by major cloud vendors. By hiding the low-level complexity through a tensor-based interface, tensor computation runtimes (TCRs) such as PyTorch allow data scientists to efficiently exploit the exciting capabilities offered by the new hardware. In this paper, we explore how database management systems can ride the wave of innovation happening in the AI space. We design, build, and evaluate Tensor Query Processor (TQP): TQP transforms SQL queries into tensor programs and executes them on TCRs. TQP is able to run the full TPC-H benchmark by implementing novel algorithms for relational operators on the tensor routines. At the same time, TQP can support various hardware while only requiring a fraction of the usual development effort. Experiments show that TQP can improve query execution time by up to 10$\times$ over specialized CPU- and GPU-only systems. Finally, TQP can accelerate queries mixing ML predictions and SQL end-to-end, and deliver up to 9$\times$ speedup over CPU baselines.


title: Highly efficient UV detection in a metal-semiconductor-metal detector with epigraphene

abstract: We show that epitaxial graphene on silicon carbide (epigraphene) grown at high temperatures (T > 1850 {\deg}C) readily acts as material for implementing solar-blind ultraviolet (UV) detectors with outstanding performance. We present centimeter-sized epigraphene metal-semiconductor-metal (MSM) detectors with peak external quantum efficiency of ~ 85% for wavelengths 250-280 nm, corresponding to nearly 100% internal quantum efficiency when accounting for reflection losses. Zero bias operation is possible in asymmetric devices, with the responsivity to UV remaining as high as R = 134 mA/W, making this a self-powered detector. The low dark currents Io ~50 fA translate into an estimated record high specific detectivity D = 3.5 x 10^15 Jones. The performance that we demonstrate, together with material reproducibility, renders epigraphene technologically attractive to implement high-performance planar MSM devices with a low processing effort, including multi-pixel UV sensor arrays, suitable for a number of practical applications.


title: An observer cascade for velocity and multiple line estimation

abstract: Previous incremental estimation methods consider estimating a single line, requiring as many observers as the number of lines to be mapped. This leads to the need for having at least $4N$ state variables, with $N$ being the number of lines. This paper presents the first approach for multi-line incremental estimation. Since lines are common in structured environments, we aim to exploit that structure to reduce the state space. The modeling of structured environments proposed in this paper reduces the state space to $3N + 3$ and is also less susceptible to singular configurations. An assumption the previous methods make is that the camera velocity is available at all times. However, the velocity is usually retrieved from odometry, which is noisy. With this in mind, we propose coupling the camera with an Inertial Measurement Unit (IMU) and an observer cascade. A first observer retrieves the scale of the linear velocity and a second observer for the lines mapping. The stability of the entire system is analyzed. The cascade is shown to be asymptotically stable and shown to converge in experiments with simulated data.


title: LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction

abstract: Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these problems, we propose LatentFormer, a transformer-based model for predicting future vehicle trajectories. The proposed method leverages a novel technique for modeling interactions among dynamic objects in the scene. Contrary to many existing approaches which model cross-agent interactions during the observation time, our method additionally exploits the future states of the agents. This is accomplished using a hierarchical attention mechanism where the evolving states of the agents autoregressively control the contributions of past trajectories and scene encodings in the final prediction. Furthermore, we propose a multi-resolution map encoding scheme that relies on a vision transformer module to effectively capture both local and global scene context to guide the generation of more admissible future trajectories. We evaluate the proposed method on the nuScenes benchmark dataset and show that our approach achieves state-of-the-art performance and improves upon trajectory metrics by up to 40%. We further investigate the contributions of various components of the proposed technique via extensive ablation studies.


title: Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features

abstract: Self-supervised learning (SSL) has shown impressive results in downstream classification tasks. However, there is limited work in understanding their failure modes and interpreting their learned representations. In this paper, we study the representation space of state-of-the-art self-supervised models including SimCLR, SwaV, MoCo, BYOL, DINO, SimSiam, VICReg and Barlow Twins. Without the use of class label information, we discover discriminative features that correspond to unique physical attributes in images, present mostly in correctly-classified representations. Using these features, we can compress the representation space by up to 40% without significantly affecting linear classification performance. We then propose Self-Supervised Representation Quality Score (or Q-Score), an unsupervised score that can reliably predict if a given sample is likely to be mis-classified during linear evaluation, achieving AUPRC of 91.45 on ImageNet-100 and 78.78 on ImageNet-1K. Q-Score can also be used as a regularization term on pre-trained encoders to remedy low-quality representations. Fine-tuning with Q-Score regularization can boost the linear probing accuracy of SSL models by up to 5.8% on ImageNet-100 and 3.7% on ImageNet-1K compared to their baselines. Finally, using gradient heatmaps and Salient ImageNet masks, we define a metric to quantify the interpretability of each representation. We show that discriminative features are strongly correlated to core attributes and, enhancing these features through Q-score regularization makes SSL representations more interpretable.


title: DenseUNets with feedback non-local attention for the segmentation of specular microscopy images of the corneal endothelium with guttae

abstract: To estimate the corneal endothelial parameters from specular microscopy images depicting cornea guttata (Fuchs dystrophy), we propose a new deep learning methodology that includes a novel attention mechanism named feedback non-local attention (fNLA). Our approach first infers the cell edges, then selects the cells that are well detected, and finally applies a postprocessing method to correct mistakes and provide the binary segmentation from which the corneal parameters are estimated (cell density [ECD], coefficient of variation [CV], and hexagonality [HEX]). In this study, we analyzed 1203 images acquired with a Topcon SP-1P microscope, 500 of which contained guttae. Manual segmentation was performed in all images. We compared the results of different networks (UNet, ResUNeXt, DenseUNets, UNet++) and found that DenseUNets with fNLA provided the best performance, with a mean absolute error of 23.16 [cells/mm$^{2}$] in ECD, 1.28 [%] in CV, and 3.13 [%] in HEX, which was 3-6 times smaller than the error obtained by Topcon's built-in software. Our approach handled the cells affected by guttae remarkably well, detecting cell edges occluded by small guttae while discarding areas covered by large guttae. Overall, the proposed method obtained accurate estimations in extremely challenging specular images.


title: ROCT-Net: A new ensemble deep convolutional model with improved spatial resolution learning for detecting common diseases from retinal OCT images

abstract: Optical coherence tomography (OCT) imaging is a well-known technology for visualizing retinal layers and helps ophthalmologists to detect possible diseases. Accurate and early diagnosis of common retinal diseases can prevent the patients from suffering critical damages to their vision. Computer-aided diagnosis (CAD) systems can significantly assist ophthalmologists in improving their examinations. This paper presents a new enhanced deep ensemble convolutional neural network for detecting retinal diseases from OCT images. Our model generates rich and multi-resolution features by employing the learning architectures of two robust convolutional models. Spatial resolution is a critical factor in medical images, especially the OCT images that contain tiny essential points. To empower our model, we apply a new post-architecture model to our ensemble model for enhancing spatial resolution learning without increasing computational costs. The introduced post-architecture model can be deployed to any feature extraction model to improve the utilization of the feature map's spatial values. We have collected two open-source datasets for our experiments to make our models capable of detecting six crucial retinal diseases: Age-related Macular Degeneration (AMD), Central Serous Retinopathy (CSR), Diabetic Retinopathy (DR), Choroidal Neovascularization (CNV), Diabetic Macular Edema (DME), and Drusen alongside the normal cases. Our experiments on two datasets and comparing our model with some other well-known deep convolutional neural networks have proven that our architecture can increase the classification accuracy up to 5%. We hope that our proposed methods create the next step of CAD systems development and help future researches. The code of this paper is shared at https://github.com/mr7495/OCT-classification.


title: Graph Neural Networks for Multimodal Single-Cell Data Integration

abstract: Recent advances in multimodal single-cell technologies have enabled simultaneous acquisitions of multiple omics data from the same cell, providing deeper insights into cellular states and dynamics. However, it is challenging to learn the joint representations from the multimodal data, model the relationship between modalities, and, more importantly, incorporate the vast amount of single-modality datasets into the downstream analyses. To address these challenges and correspondingly facilitate multimodal single-cell data analyses, three key tasks have been introduced: $\textit{modality prediction}$, $\textit{modality matching}$ and $\textit{joint embedding}$. In this work, we present a general Graph Neural Network framework $\textit{scMoGNN}$ to tackle these three tasks and show that $\textit{scMoGNN}$ demonstrates superior results in all three tasks compared with the state-of-the-art and conventional approaches. Our method is an official winner in the overall ranking of $\textit{Modality prediction}$ from NeurIPS 2021 Competition, and all implementations of our methods have been integrated into DANCE package~\url{https://github.com/OmicsML/dance}.


title: TCTrack: Temporal Contexts for Aerial Tracking

abstract: Temporal contexts among consecutive frames are far from being fully utilized in existing visual trackers. In this work, we present TCTrack, a comprehensive framework to fully exploit temporal contexts for aerial tracking. The temporal contexts are incorporated at \textbf{two levels}: the extraction of \textbf{features} and the refinement of \textbf{similarity maps}. Specifically, for feature extraction, an online temporally adaptive convolution is proposed to enhance the spatial features using temporal information, which is achieved by dynamically calibrating the convolution weights according to the previous frames. For similarity map refinement, we propose an adaptive temporal transformer, which first effectively encodes temporal knowledge in a memory-efficient way, before the temporal knowledge is decoded for accurate adjustment of the similarity map. TCTrack is effective and efficient: evaluation on four aerial tracking benchmarks shows its impressive performance; real-world UAV tests show its high speed of over 27 FPS on NVIDIA Jetson AGX Xavier.


title: Excitation of electrostatic solitary waves and surface waves in ion beam neutralization process

abstract: Unusually long electrostatic solitary waves (ESWs) are discovered in 2D and 3D Particle-in-Cell studies of the process of ion beam neutralization by electron emission from filaments. These ESWs are long because trapped and untrapped electron density perturbations nearly compensate each other. Surface waves were discovered in the process of neutralization but were only observed in 3D simulations. This is because the phase velocity of surface waves in a 2D geometry is higher than in 3D giving the high-energy electrons generated upstream near the electron source enough energy to excite such waves only in 3D cylindrical beams.


title: Natural Almost Hermitian Structures on Conformally Foliated 4-Dimensional Lie Groups with Minimal Leaves

abstract: Let $(G,g)$ be a 4-dimensional Riemannian Lie group with a 2-dimensional left-invariant, conformal foliation $\mathcal{F}$ with minimal leaves. Let $J$ be an almost Hermitian structure on $G$ adapted to the foliation $\mathcal{F}$. The corresponding Lie algebra $\mathfrak{g}$ must then belong to one of 20 families $\mathfrak{g}_1,\dots,\mathfrak{g}_{20}$ according to S. Gudmundsson and M. Svensson. We classify such structures $J$ which are almost K\"{a}hler $(\mathcal{A}\mathcal{K})$, integrable $(\mathcal{I})$ or K\"{a}hler $(\mathcal{K})$. Hereby, we construct 16 multi-dimensional almost K\"{a}hler families, 18 integrable families and 11 K\"{a}hler families.


title: Discovery of charge order and corresponding edge state in kagome magnet FeGe

abstract: Kagome materials often host exotic quantum phases, including spin liquids, Chern gap, charge order, and superconductivity. Existing scanning microscopy studies of the kagome charge order have been limited to non-kagome surface layers. Here we tunnel into the kagome lattice of FeGe to uncover features of the charge order. Our spectroscopic imaging identifes a 2x2 charge order in the magnetic kagome lattice, resembling that discovered in kagome superconductors. Spin-mapping across steps of unit-cell-height demonstrates that this charge order emerges from spin-polarized electrons with an antiferromagnetic stacking order. We further uncover the correlation between antiferromagnetism and charge order anisotropy, highlighting the unusual magnetic coupling of the charge order. Finally, we detect a pronounced edge state within the charge order energy gap, which is robust against the irregular shape of the kagome lattice edges. We discuss our results with the theoretically considered topological features of the kagome charge order including orbital magnetism and bulk-boundary correspondence.


title: Quantum Reinforcement Learning via Policy Iteration

abstract: Quantum computing has shown the potential to substantially speed up machine learning applications, in particular for supervised and unsupervised learning. Reinforcement learning, on the other hand, has become essential for solving many decision making problems and policy iteration methods remain the foundation of such approaches. In this paper, we provide a general framework for performing quantum reinforcement learning via policy iteration. We validate our framework by designing and analyzing: \emph{quantum policy evaluation} methods for infinite horizon discounted problems by building quantum states that approximately encode the value function of a policy $\pi$; and \emph{quantum policy improvement} methods by post-processing measurement outcomes on these quantum states. Last, we study the theoretical and experimental performance of our quantum algorithms on two environments from OpenAI's Gym.


title: Integrated correlators in $\mathcal{N}=4$ super Yang-Mills and periods

abstract: We study perturbative aspects of recently proposed integrated four-point correlators in $\mathcal{N}=4$ supersymmetric Yang-Mills with all classical gauge groups using standard Feynman diagram computations. We argue that perturbative contributions of the integrated correlators are given by linear combinations of periods of certain conformal Feynman graphs, which were originally introduced for the construction of perturbative loop integrands of the un-integrated correlator. This observation allows us to evaluate the integrated correlators to high loop orders. We explicitly compute one of the integrated correlators up to four loops in the planar limit, and up to three loops for the other integrated correlator, and find agreement with the results obtained from supersymmetric localisation. The identification between the integrated correlators and certain periods also implies non-trivial relations among these periods, given that one may compute the integrated correlators using localisation. We illustrate this idea by considering one of the integrated correlators at five loops in the planar limit, where the localisation result leads to a prediction for the period of a certain six-loop integral.


title: Feasibility of detecting and characterizing embedded low-mass giant planets in gaps in the VIS/NIR wavelength range

abstract: High-contrast imaging in the visible and near-infrared (VIS/NIR) has revealed the presence of a plethora of substructures in circumstellar disks (CSDs). One of the most commonly observed substructures are concentric gaps that may hint at the presence of embedded forming planets. However, direct detections of them are rare, and thus ambiguity regarding the origin of most gap features remains. The aim of this study is to investigate the capabilities of high-contrast VIS/NIR imaging of directly detecting and characterizing low-mass giant planets in gaps. To this end, a grid of models of protoplanetary disks was generated. The models include a central T Tauri star surrounded by a face-on CSD harboring an accreting planet, which itself is surrounded by a circumplanetary disk (CPD) and carves a gap. We use the Monte Carlo radiative transfer code Mol3D to generate temperature distributions and synthetic observations. Based on these simulations, we measured the impact the planet and its CPD have on contrast curves and quantified the impact of the observing wavelength and of five key parameters on the determined signal strength. Then, we applied a detection criterion on our results and assess the capabilities of SPHERE/VLT of detecting the embedded planets. We find that a part of the investigated parameter space includes detectable planets, and we elaborate on the implications of a non-detection. Furthermore, we analyze the potential loss of valuable information by the use of a too small coronagraphic mask. However, we find this outcome to be very unlikely. Finally, within the VIS/NIR we identify for each of the investigated basic properties of the planets and the disks the most promising observing wavelengths that enable us to distinguish between different underlying parameter values. We find, that the detectability and the characterization often benefit from different observing wavelengths.


title: Incompressible polar active fluids with quenched disorder in dimensions $d> 2$

abstract: We present a hydrodynamic theory of incompressible polar active fluids with quenched disorder. This theory shows that such fluids can overcome the disruption caused by the quenched disorder and move coherently, in the sense of having a non-zero mean velocity in the hydrodynamic limit. However, the scaling behavior of this class of active systems cannot be described by linearized hydrodynamics in spatial dimensions between 2 and 5. Nonetheless, we obtain the exact dimension-dependent scaling exponents in these dimensions.


title: A Transdisciplinary Approach for Generating Synthetic but Realistic Domestic Sex Trafficking Networks

abstract: One of the major challenges associated with applying operations research (OR) models to disrupting human trafficking networks is the limited amount of reliable data sources readily available for public use, since operations are intentionally hidden to prevent detection, and data from known operations are often incomplete. To help address this data gap, we propose a network generator for domestic sex trafficking networks by integrating OR concepts and qualitative research. Multiple sources regarding sex trafficking in the upper Midwest of the United States have been triangulated to ensure that networks produced by the generator are realistic, including law enforcement case file analysis, interviews with domain experts, and a survivor-centered advisory group with first-hand knowledge of sex trafficking. The output models the relationships between traffickers, so-called "bottoms", and victims. This generator allows operations researchers to access realistic sex trafficking network structures in a responsible manner that does not disclose identifiable details of the people involved. We demonstrate the use of output networks in exploring policy recommendations from max flow network interdiction with restructuring. To do so, we propose a novel conceptualization of flow as the ability of a trafficker to control their victims. Our results show the importance of understanding how sex traffickers react to disruptions, especially in terms of recruiting new victims.


title: Reconstruction of univariate functions from directional persistence diagrams

abstract: We describe a method for approximating a single-variable function $f$ using persistence diagrams of sublevel sets of $f$ from height functions in different directions. We provide algorithms for the piecewise linear case and for the smooth case. Three directions suffice to locate all local maxima and minima of a piecewise linear continuous function from its collection of directional persistence diagrams, while five directions are needed in the case of smooth functions with non-degenerate critical points. Our approximation of functions by means of persistence diagrams is motivated by a study of importance attribution in machine learning, where one seeks to reduce the number of critical points of signal functions without a significant loss of information for a neural network classifier.


title: Improving Health Mentioning Classification of Tweets using Contrastive Adversarial Training

abstract: Health mentioning classification (HMC) classifies an input text as health mention or not. Figurative and non-health mention of disease words makes the classification task challenging. Learning the context of the input text is the key to this problem. The idea is to learn word representation by its surrounding words and utilize emojis in the text to help improve the classification results. In this paper, we improve the word representation of the input text using adversarial training that acts as a regularizer during fine-tuning of the model. We generate adversarial examples by perturbing the embeddings of the model and then train the model on a pair of clean and adversarial examples. Additionally, we utilize contrastive loss that pushes a pair of clean and perturbed examples close to each other and other examples away in the representation space. We train and evaluate the method on an extended version of the publicly available PHM2017 dataset. Experiments show an improvement of 1.0% over BERT-Large baseline and 0.6% over RoBERTa-Large baseline, whereas 5.8% over the state-of-the-art in terms of F1 score. Furthermore, we provide a brief analysis of the results by utilizing the power of explainable AI.


title: Triangulations of Flow Polytopes, Ample Framings, and Gentle Algebras

abstract: The cone of nonnegative flows for a directed acyclic graph (DAG) is known to admit regular unimodular triangulations induced by framings of the DAG. These triangulations restrict to triangulations of the flow polytope for strength one flows, which are called DKK triangulations. For a special class of framings called ample framings, these triangulations of the flow cone project to a complete fan. We characterize the DAGs that admit ample framings, and we enumerate the number of ample framings for a fixed DAG. We establish a connection between maximal simplices in DKK triangulations and $\tau$-tilting posets for certain gentle algebras, which allows us to impose a poset structure on the dual graph of any DKK triangulation for an amply framed DAG. Using this connection, we are able to prove that for full DAGs, i.e., those DAGs with inner vertices having in-degree and out-degree equal to two, the flow polytopes are Gorenstein and have unimodal Ehrhart $h^\ast$-polynomials.


title: A general adaptive framework for multivariate point null testing

abstract: As a common step in refining their scientific inquiry, investigators are often interested in performing some screening of a collection of given statistical hypotheses. For example, they may wish to determine whether any one of several patient characteristics are associated with a health outcome of interest. Existing generic methods for testing a multivariate hypothesis -- such as multiplicity corrections applied to individual hypothesis tests -- can easily be applied across a variety of problems but can suffer from low power in some settings. Tailor-made procedures can attain higher power by building around problem-specific information but typically cannot be easily adapted to novel settings. In this work, we propose a general framework for testing a multivariate point null hypothesis in which the test statistic is adaptively selected to provide increased power. We present theoretical large-sample guarantees for our test under both fixed and local alternatives. In simulation studies, we show that tests created using our framework can perform as well as tailor-made methods when the latter are available, and we illustrate how our procedure can be used to create tests in two settings in which tailor-made methods are not currently available.


title: Determination of the Solar Rotation Elements and Period from Ru{\dj}er Bo\v{s}kovi\'c's Sunspot Observations in 1777

abstract: This paper focuses on the observations of sunspots made by Ru{\dj}er Bo\v{s}kovi\'c in 1777. We derived the expressions needed to calculate the elements of the Sun's rotation and period from observations. We used modern ephemeris data in the processing of the observation results. Obtained results are very similar to Bo\v{s}kovi\'c's original calculations. In addition to historical significance, they also provide scientifically valuable data on the Sun's differential rotation, which plays a significant role in generating and maintaining solar magnetic activity.


title: Field theory for zero temperature soft anharmonic spin glasses in a field

abstract: We introduce a finite dimensional anharmonic soft spin glass in a field and show how it allows the construction a field theory at zero temperature and the corresponding loop expansion. The mean field level of the model coincides with a recently introduced fully connected model, the KHGPS model, and it has a spin glass transition in a field at zero temperature driven by the appearance of pseudogapped non-linear excitations. We analyze the zero temperature limit of the theory and the behavior of the bare masses and couplings on approaching the mean field zero temperature critical point. Focusing on the so called replicon sector of the field theory, we show that the bare mass corresponding to fluctuations in this sector is strictly positive at the transition in a certain region of control parameter space. At the same time the two relevant cubic coupling constants $g_1$ and $g_2$ show a non-analytic behavior in their bare values: approaching the critical point at zero temperature, $g_1\to \infty$ while $g_2\propto T$ with a prefactor diverging at the transition. Along the same lines we also develop the field theory to study the density of states of the model in finite dimension. We show that in the mean field limit the density of states converges to the one of the KHGPS model. However the construction allows a treatment of finite dimensional effects in perturbation theory.


title: Sparse Bayesian Optimization

abstract: Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and simplicity of the configurations into consideration, a setting that has not been previously studied in the BO literature. To make BO useful for this setting, we present several regularization-based approaches that allow us to discover sparse and more interpretable configurations. We propose a novel differentiable relaxation based on homotopy continuation that makes it possible to target sparsity by working directly with $L_0$ regularization. We identify failure modes for regularized BO and develop a hyperparameter-free method, sparsity exploring Bayesian optimization (SEBO) that seeks to simultaneously maximize a target objective and sparsity. SEBO and methods based on fixed regularization are evaluated on synthetic and real-world problems, and we show that we are able to efficiently optimize for sparsity.


title: Cubic sublattices

abstract: A sublattice of the three-dimensional integer lattice $\mathbb Z^3$ is called cubic sublattice if there exists a basis of the sublattice whose elements are pairwise orthogonal and of equal lengths. We show that for an integer vector $\mathbf v\in\mathbb Z^3$ whose squared length is divisible by $d^2$, there exists a cubic sublattice containing $\mathbf v$ with edge length $d$. This improves one of the main result of a paper [arxiv:0806.3943] of Goswick et al., where similar theorem was proved by using the decomposition theory of Hurwitz integral quaternions. We give an elementary proof heavily using cross product. This method allows us to characterize the cubic sublattices.


title: Instance Segmentation for Autonomous Log Grasping in Forestry Operations

abstract: Wood logs picking is a challenging task to automate. Indeed, logs usually come in cluttered configurations, randomly orientated and overlapping. Recent work on log picking automation usually assume that the logs' pose is known, with little consideration given to the actual perception problem. In this paper, we squarely address the latter, using a data-driven approach. First, we introduce a novel dataset, named TimberSeg 1.0, that is densely annotated, i.e., that includes both bounding boxes and pixel-level mask annotations for logs. This dataset comprises 220 images with 2500 individually segmented logs. Using our dataset, we then compare three neural network architectures on the task of individual logs detection and segmentation; two region-based methods and one attention-based method. Unsurprisingly, our results show that axis-aligned proposals, failing to take into account the directional nature of logs, underperform with 19.03 mAP. A rotation-aware proposal method significantly improve results to 31.83 mAP. More interestingly, a Transformer-based approach, without any inductive bias on rotations, outperformed the two others, achieving a mAP of 57.53 on our dataset. Our use case demonstrates the limitations of region-based approaches for cluttered, elongated objects. It also highlights the potential of attention-based methods on this specific task, as they work directly at the pixel-level. These encouraging results indicate that such a perception system could be used to assist the operators on the short-term, or to fully automate log picking operations in the future.


title: Pay Attention to Relations: Multi-embeddings for Attributed Multiplex Networks

abstract: Graph Convolutional Neural Networks (GCNs) have become effective machine learning algorithms for many downstream network mining tasks such as node classification, link prediction, and community detection. However, most GCN methods have been developed for homogenous networks and are limited to a single embedding for each node. Complex systems, often represented by heterogeneous, multiplex networks present a more difficult challenge for GCN models and require that such techniques capture the diverse contexts and assorted interactions that occur between nodes. In this work, we propose RAHMeN, a novel unified relation-aware embedding framework for attributed heterogeneous multiplex networks. Our model incorporates node attributes, motif-based features, relation-based GCN approaches, and relational self-attention to learn embeddings of nodes with respect to the various relations in a heterogeneous, multiplex network. In contrast to prior work, RAHMeN is a more expressive embedding framework that embraces the multi-faceted nature of nodes in such networks, producing a set of multi-embeddings that capture the varied and diverse contexts of nodes. We evaluate our model on four real-world datasets from Amazon, Twitter, YouTube, and Tissue PPIs in both transductive and inductive settings. Our results show that RAHMeN consistently outperforms comparable state-of-the-art network embedding models, and an analysis of RAHMeN's relational self-attention demonstrates that our model discovers interpretable connections between relations present in heterogeneous, multiplex networks.


title: Detection of the S(1) Rotational Line of H2 toward IRC+10216: A Simultaneous Measurement of Mass-Loss Rate and CO Abundance

abstract: We report the first detection of the S(1) pure rotational line of ortho-H2 at 17.04 um in an asymptotic giant branch star, using observations of IRC+10216 with the Echelon-cross-echelle Spectrograph (EXES) mounted on the Stratospheric Observatory for Infrared Astronomy (SOFIA). This line, which was observed in a very high sensitivity spectrum (RMS noise ~0.04% of the continuum), was detected in the wing of a strong telluric line and displayed a P Cygni profile. The spectral ranges around the frequencies of the S(5) and S(7) ortho-H2 transitions were observed as well but no feature was detected in spectra with sensitivities of 0.12% and 0.09% regarding the continuum emission, respectively. We used a radiation transfer code to model these three lines and derived a mass-loss rate of 2.43(0.21)E-05 M_sun/yr without using the CO abundance. The comparison of this rate with previous estimates derived from CO observations suggests that the CO abundance relative to H2 is 6.7(1.4)E-04. From this quantity and previously reported molecular abundances, we estimate the O/H and C/H ratios to be 3.3(0.7)E-04 and >5.2(0.9)E-04, respectively. The C/O ratio is >1.5(0.4). The absence of the S(5) and S(7) lines of ortho-H2 in our observations can be explained by the opacity of hot dust within 5R* from the center of the star. We estimate the intensity of the S(0) and S(2) lines of para-H2 to be ~0.1% and 0.2% of the continuum, respectively, which are below the detection limit of EXES.


title: Time-resolved Ultrafast Interatomic Coulombic Decay in Superexcited Sodium-doped Helium Nanodroplets

abstract: The autoionization dynamics of superexcited superfluid He nanodroplets doped with Na atoms is studied by extreme-ultraviolet (XUV) time-resolved electron spectroscopy. Following excitation into the higher-lying droplet absorption band, the droplet relaxes into the lowest metastable atomic $1s2s$ $^{1,\,3}$S states from which Interatomic Coulombic Decay (ICD) takes places either between two excited He atoms or between an excited He atom and a Na atom attached to the droplet surface. Four main ICD channels are identified and their time constants are determined by varying the delay between the XUV pulse and a UV pulse that ionizes the initial excited state and thereby quenches ICD. The time constants for the different channels all fall in the range $\sim$1~ps indicating that the ICD dynamics are mainly determined by the droplet environment. A periodic modulation of the transient ICD signals is tentatively attributed to the oscillation of the bubble forming around the localized He excitation. The ICD efficiency depends on the total number of excited states in a droplet rather than the density of excited states pointing to a collective enhancement of ICD.


title: The Kawahara Equation: Traveling Wave Solutions Joining Periodic Waves

abstract: The Kawahara equation is a weakly nonlinear long-wave model of dispersive waves that emerges when leading order dispersive effects are in balance with the next order correction. Traveling wave solutions of the Kawahara equation satisfy a fourth-order ordinary differential equation in which the traveling wave speed is a parameter. The fourth order equation has Hamiltonian structure and admits a two-parameter family of single-phase periodic solutions with varying speed and Hamiltonian. A set of jump conditions is derived for pairs of periodic solutions with equal speed and Hamiltonian. These are necessary conditions for the existence of traveling waves that asymptote to the periodic orbits at $\pm \infty$. Bifurcation theory and parameter continuation are used to construct multiple solution branches of the jump conditions. For each pair of compatible periodic solutions, the heteroclinic orbit representing the traveling wave is constructed from the intersection of stable and unstable manifolds of the periodic orbits. Each branch terminates at an equilibrium-to-periodic solution in which the equilibrium is the background for a solitary wave that connects to the associated periodic solution.


title: Computer Vision Aided Blockage Prediction in Real-World Millimeter Wave Deployments

abstract: This paper provides the first real-world evaluation of using visual (RGB camera) data and machine learning for proactively predicting millimeter wave (mmWave) dynamic link blockages before they happen. Proactively predicting line-of-sight (LOS) link blockages enables mmWave/sub-THz networks to make proactive network management decisions, such as proactive beam switching and hand-off) before a link failure happens. This can significantly enhance the network reliability and latency while efficiently utilizing the wireless resources. To evaluate this gain in reality, this paper (i) develops a computer vision based solution that processes the visual data captured by a camera installed at the infrastructure node and (ii) studies the feasibility of the proposed solution based on the large-scale real-world dataset, DeepSense 6G, that comprises multi-modal sensing and communication data. Based on the adopted real-world dataset, the developed solution achieves $\approx 90\%$ accuracy in predicting blockages happening within the future $0.1$s and $\approx 80\%$ for blockages happening within $1$s, which highlights a promising solution for mmWave/sub-THz communication networks.


title: On the nonintegrality of certain generalized binomial sums

abstract: We consider certain generalized binomial sums $\mathcal{S}_{(r,n)}(\ell)$ and discuss the nonintegrality of their values for integral parameters $n,r \geq 1$ and $\ell \in \mathbb{Z}$ in several cases using $p$-adic methods. In particular, we show some properties of the denominator of $\mathcal{S}_{(r,n)}(\ell)$. Viewed as polynomials, the sequence $(\mathcal{S}_{(r,n)}(x))_{n \geq 0}$ forms an Appell sequence. The special case $\mathcal{S}_{(r,n)}(2)$ reduces to the sum $\sum_{k=0}^{n} \binom{n}{k} \frac{r}{r+k}$, which has recently received some attention from several authors regarding the conjectured nonintegrality of its values. So far, only a few cases have been proved. The generalized results imply, among other things, for even $|\ell| \geq 2$ that $\mathcal{S}_{(r,n)}(\ell) \notin \mathbb{Z}$ when $\binom{r+n}{r}$ is even, e.g., $r$ and $n$ are odd. Although there exist exceptions where $\mathcal{S}_{(r,n)}(\ell) \in \mathbb{Z}$, ``almost all'' values of $\mathcal{S}_{(r,n)}(\ell)$ for $n,r \geq 1$ are nonintegral for any fixed $|\ell| \geq 2$. Subsequently, we also derive explicit inequalities between the parameters for which $\mathcal{S}_{(r,n)}(\ell) \notin \mathbb{Z}$. Especially, this is shown for certain small values of $\ell$ for $r \geq n$ and $n > r \geq \frac{1}{5} n$. As a supplement, we finally discuss exceptional cases where $\mathcal{S}_{(r,n)}(\ell) \in \mathbb{Z}$.


title: An Adaptive Human Driver Model for Realistic Race Car Simulations

abstract: Engineering a high-performance race car requires a direct consideration of the human driver using real-world tests or Human-Driver-in-the-Loop simulations. Apart from that, offline simulations with human-like race driver models could make this vehicle development process more effective and efficient but are hard to obtain due to various challenges. With this work, we intend to provide a better understanding of race driver behavior and introduce an adaptive human race driver model based on imitation learning. Using existing findings and an interview with a professional race engineer, we identify fundamental adaptation mechanisms and how drivers learn to optimize lap time on a new track. Subsequently, we use these insights to develop generalization and adaptation techniques for a recently presented probabilistic driver modeling approach and evaluate it using data from professional race drivers and a state-of-the-art race car simulator. We show that our framework can create realistic driving line distributions on unseen race tracks with almost human-like performance. Moreover, our driver model optimizes its driving lap by lap, correcting driving errors from previous laps while achieving faster lap times. This work contributes to a better understanding and modeling of the human driver, aiming to expedite simulation methods in the modern vehicle development process and potentially supporting automated driving and racing technologies.


title: Efficient Data Structures for Exploiting Sparsity and Structure in Representation of Polynomial Optimization Problems: Implementation in SOSTOOLS

abstract: We present a new data structure for representation of polynomial variables in the parsing of sum-of-squares (SOS) programs. In SOS programs, the variables $s(x;Q)$ are polynomial in the independent variables $x$, but linear in the decision variables $Q$. Current SOS parsers, however, fail to exploit the semi-linear structure of the polynomial variables, treating the decision variables as independent variables in their representation. This results in unnecessary overhead in storage and manipulation of the polynomial variables, prohibiting the parser from addressing larger-scale optimization problems. To eliminate this computational overhead, we introduce a new representation of polynomial variables, the "dpvar" structure, that is affine in the decision variables. We show that the complexity of operations on variables in the dpvar representation scales favorably with the number of decision variables. We further show that the required memory for storing polynomial variables is relatively small using the dpvar structure, particularly when exploiting the MATLAB sparse storage structure. Finally, we incorporate the dpvar data structure into SOSTOOLS 4.00, and test the performance of the parser for several polynomial optimization problems.


title: The Cartier core map for Cartier algebras

abstract: Let $R$ be a commutative Noetherian $F$-finite ring of prime characteristic and let $\mathcal{D}$ be a Cartier algebra. We define a self-map on the Frobenius split locus of the pair $(R,\mathcal{D})$ by sending a point $P$ to the splitting prime of $(R_P, \mathcal{D}_P)$. We prove this map is continuous, containment preserving, and fixes the $\mathcal{D}$-compatible ideals. We show this map can be extended to arbitrary ideals $J$, where in the Frobenius split case it gives the largest $\mathcal{D}$-compatible ideal contained in $J$. Finally, we apply Glassbrenner's criterion to prove that the prime uniformly $F$-compatible ideals of a Stanley-Reisner rings are the sums of its minimal primes.


title: Bayesian Spillover Graphs for Dynamic Networks

abstract: We present Bayesian Spillover Graphs (BSG), a novel method for learning temporal relationships, identifying critical nodes, and quantifying uncertainty for multi-horizon spillover effects in a dynamic system. BSG leverages both an interpretable framework via forecast error variance decompositions (FEVD) and comprehensive uncertainty quantification via Bayesian time series models to contextualize temporal relationships in terms of systemic risk and prediction variability. Forecast horizon hyperparameter $h$ allows for learning both short-term and equilibrium state network behaviors. Experiments for identifying source and sink nodes under various graph and error specifications show significant performance gains against state-of-the-art Bayesian Networks and deep-learning baselines. Applications to real-world systems also showcase BSG as an exploratory analysis tool for uncovering indirect spillovers and quantifying systemic risk.


title: NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

abstract: Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo techniques. While traditional pipelines struggle with objects like these, Neural Radiance Fields (NeRFs) have recently been shown to be remarkably effective for performing view synthesis on objects with thin structures or reflective materials. In this paper we explore the use of NeRF as a new source of supervision for robust robot vision systems. In particular, we demonstrate that a NeRF representation of a scene can be used to train dense object descriptors. We use an optimized NeRF to extract dense correspondences between multiple views of an object, and then use these correspondences as training data for learning a view-invariant representation of the object. NeRF's usage of a density field allows us to reformulate the correspondence problem with a novel distribution-of-depths formulation, as opposed to the conventional approach of using a depth map. Dense correspondence models supervised with our method significantly outperform off-the-shelf learned descriptors by 106% (PCK@3px metric, more than doubling performance) and outperform our baseline supervised with multi-view stereo by 29%. Furthermore, we demonstrate the learned dense descriptors enable robots to perform accurate 6-degree of freedom (6-DoF) pick and place of thin and reflective objects.


title: Playable Environments: Video Manipulation in Space and Time

abstract: We present Playable Environments - a new representation for interactive video generation and manipulation in space and time. With a single image at inference time, our novel framework allows the user to move objects in 3D while generating a video by providing a sequence of desired actions. The actions are learnt in an unsupervised manner. The camera can be controlled to get the desired viewpoint. Our method builds an environment state for each frame, which can be manipulated by our proposed action module and decoded back to the image space with volumetric rendering. To support diverse appearances of objects, we extend neural radiance fields with style-based modulation. Our method trains on a collection of various monocular videos requiring only the estimated camera parameters and 2D object locations. To set a challenging benchmark, we introduce two large scale video datasets with significant camera movements. As evidenced by our experiments, playable environments enable several creative applications not attainable by prior video synthesis works, including playable 3D video generation, stylization and manipulation. Further details, code and examples are available at https://willi-menapace.github.io/playable-environments-website


title: The dispersion and propagation of topological Langmuir-cyclotron waves in cold magnetized plasmas

abstract: Topological Langmuir-Cyclotron Wave (TLCW) is a recently identified topological surface excitation in magnetized plasmas. We show that TLCW originates from the topological phase transition at the Langmuir wave-cyclotron wave resonance. By isofrequency surface analysis and 2D and 3D time-dependent simulations, we demonstrate that the TLCW can propagate robustly along complex phase transition interfaces in a unidirectional manner and without scattering. Because of these desirable features, the TLCW could be explored as an effective mechanism to drive current and flow in magnetized plasmas. The analysis also establishes a close connection between the newly instituted topological phase classification of plasmas and the classical CMA diagram of plasma waves.


title: Emergence of local irreversibility in complex interacting systems

abstract: Living systems are fundamentally irreversible, breaking detailed balance and establishing an arrow of time. But how does the evident arrow of time for a whole system arise from the interactions among its multiple elements? We show that the local evidence for the arrow of time, which is the entropy production for thermodynamic systems, can be decomposed. First, it can be split into two components: an independent term reflecting the dynamics of individual elements and an interaction term driven by the dependencies among elements. Adapting tools from non--equilibrium physics, we further decompose the interaction term into contributions from pairs of elements, triplets, and higher--order terms. We illustrate our methods on models of cellular sensing and logical computations, as well as on patterns of neural activity in the retina as it responds to visual inputs. We find that neural activity can define the arrow of time even when the visual inputs do not, and that the dominant contribution to this breaking of detailed balance comes from interactions among pairs of neurons.


title: Subcritical monotone cellular automata

abstract: We study monotone cellular automata (also known as $\mathcal{U}$-bootstrap percolation) in $\mathbb{Z}^d$ with random initial configurations. Confirming a conjecture of Balister, Bollob\'as, Przykucki and Smith, who proved the corresponding result in two dimensions, we show that the critical probability is non-zero for all subcritical models.


title: Investigating the limited performance of a deep-learning-based SPECT denoising approach: An observer-study-based characterization

abstract: Multiple objective assessment of image-quality-based studies have reported that several deep-learning-based denoising methods show limited performance on signal-detection tasks. Our goal was to investigate the reasons for this limited performance. To achieve this goal, we conducted a task-based characterization of a DL-based denoising approach for individual signal properties. We conducted this study in the context of evaluating a DL-based approach for denoising SPECT images. The training data consisted of signals of different sizes and shapes within a clustered-lumpy background, imaged with a 2D parallel-hole-collimator SPECT system. The projections were generated at normal and 20% low count level, both of which were reconstructed using an OSEM algorithm. A CNN-based denoiser was trained to process the low-count images. The performance of this CNN was characterized for five different signal sizes and four different SBR by designing each evaluation as an SKE/BKS signal-detection task. Performance on this task was evaluated using an anthropomorphic CHO. As in previous studies, we observed that the DL-based denoising method did not improve performance on signal-detection tasks. Evaluation using the idea of observer-study-based characterization demonstrated that the DL-based denoising approach did not improve performance on the signal-detection task for any of the signal types. Overall, these results provide new insights on the performance of the DL-based denoising approach as a function of signal size and contrast. More generally, the observer study-based characterization provides a mechanism to evaluate the sensitivity of the method to specific object properties and may be explored as analogous to characterizations such as modulation transfer function for linear systems. Finally, this work underscores the need for objective task-based evaluation of DL-based denoising approaches.


title: Slowly rotating black holes in nonlinear electrodynamics

abstract: We show how (at least in principle) one can construct electrically and magnetically charged slowly rotating black hole solutions coupled to non-linear electrodynamics (NLE). Our generalized Lense-Thirring ansatz is, apart from the static metric function $f$ and the electrostatic potential $\phi$ inherited from the corresponding spherical solution, characterized by two new functions $h$ (in the metric) and $\omega$ (in the vector potential) encoding the effect of rotation. In the linear Maxwell case, the rotating solutions are completely characterized by static solution, featuring $h=(f-1)/r^2$ and $\omega=1$. We show that when the first is imposed, the ansatz is inconsistent with any restricted (see below) NLE but the Maxwell electrodynamics. In particular, this implies that the (standard) Newman-Janis algorithm cannot be used to generate rotating solutions for any restricted non-trivial NLE. We present a few explicit examples of slowly rotating solutions in particular models of NLE, as well as briefly discuss the NLE charged Taub-NUT spacetimes.


title: High fidelity state preparation and measurement of ion hyperfine qubits with I > 1/2

abstract: We present a method for achieving high fidelity state preparation and measurement (SPAM) using trapped ion hyperfine qubits with nuclear spins higher than $I = 1/2$. The ground states of these higher nuclear spin isotopes do not afford a simple frequency-selective state preparation scheme. We circumvent this limitation by stroboscopically driving strong and weak transitions, blending fast optical pumping using dipole transitions and narrow microwave or optical quadrupole transitions. We demonstrate this method with the $I=3/2$ isotope $^{137}\mbox{Ba}^+$ to achieve a SPAM infidelity of $\left(9.0 \pm 1.3\right) \times 10^{-5}$ ($-40.5 \pm 0.6$ dB), facilitating the use of a wider range of ion isotopes with favorable wavelengths and masses for quantum computation.


title: NUQ: A Noise Metric for Diffusion MRI via Uncertainty Discrepancy Quantification

abstract: Diffusion MRI (dMRI) is the only non-invasive technique sensitive to tissue micro-architecture, which can, in turn, be used to reconstruct tissue microstructure and white matter pathways. The accuracy of such tasks is hampered by the low signal-to-noise ratio in dMRI. Today, the noise is characterized mainly by visual inspection of residual maps and estimated standard deviation. However, it is hard to estimate the impact of noise on downstream tasks based only on such qualitative assessments. To address this issue, we introduce a novel metric, Noise Uncertainty Quantification (NUQ), for quantitative image quality analysis in the absence of a ground truth reference image. NUQ uses a recent Bayesian formulation of dMRI models to estimate the uncertainty of microstructural measures. Specifically, NUQ uses the maximum mean discrepancy metric to compute a pooled quality score by comparing samples drawn from the posterior distribution of the microstructure measures. We show that NUQ allows a fine-grained analysis of noise, capturing details that are visually imperceptible. We perform qualitative and quantitative comparisons on real datasets, showing that NUQ generates consistent scores across different denoisers and acquisitions. Lastly, by using NUQ on a cohort of schizophrenics and controls, we quantify the substantial impact of denoising on group differences.


title: Vision-Language Intelligence: Tasks, Representation Learning, and Large Models

abstract: This paper presents a comprehensive survey of vision-language (VL) intelligence from the perspective of time. This survey is inspired by the remarkable progress in both computer vision and natural language processing, and recent trends shifting from single modality processing to multiple modality comprehension. We summarize the development in this field into three time periods, namely task-specific methods, vision-language pre-training (VLP) methods, and larger models empowered by large-scale weakly-labeled data. We first take some common VL tasks as examples to introduce the development of task-specific methods. Then we focus on VLP methods and comprehensively review key components of the model structures and training methods. After that, we show how recent work utilizes large-scale raw image-text data to learn language-aligned visual representations that generalize better on zero or few shot learning tasks. Finally, we discuss some potential future trends towards modality cooperation, unified representation, and knowledge incorporation. We believe that this review will be of help for researchers and practitioners of AI and ML, especially those interested in computer vision and natural language processing.


title: Recovering 3D Human Mesh from Monocular Images: A Survey

abstract: Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining well-aligned and physically plausible mesh results, two paradigms have been developed to overcome challenges in the 2D-to-3D lifting process: i) an optimization-based paradigm, where different data terms and regularization terms are exploited as optimization objectives; and ii) a regression-based paradigm, where deep learning techniques are embraced to solve the problem in an end-to-end fashion. Meanwhile, continuous efforts are devoted to improving the quality of 3D mesh labels for a wide range of datasets. Though remarkable progress has been achieved in the past decade, the task is still challenging due to flexible body motions, diverse appearances, complex environments, and insufficient in-the-wild annotations. To the best of our knowledge, this is the first survey that focuses on the task of monocular 3D human mesh recovery. We start with the introduction of body models and then elaborate recovery frameworks and training objectives by providing in-depth analyses of their strengths and weaknesses. We also summarize datasets, evaluation metrics, and benchmark results. Open issues and future directions are discussed in the end, hoping to motivate researchers and facilitate their research in this area. A regularly updated project page can be found at https://github.com/tinatiansjz/hmr-survey.


title: Min-Max Bilevel Multi-objective Optimization with Applications in Machine Learning

abstract: We consider a generic min-max multi-objective bilevel optimization problem with applications in robust machine learning such as representation learning and hyperparameter optimization. We design MORBiT, a novel single-loop gradient descent-ascent bilevel optimization algorithm, to solve the generic problem and present a novel analysis showing that MORBiT converges to the first-order stationary point at a rate of $\widetilde{\mathcal{O}}(n^{1/2} K^{-2/5})$ for a class of weakly convex problems with $n$ objectives upon $K$ iterations of the algorithm. Our analysis utilizes novel results to handle the non-smooth min-max multi-objective setup and to obtain a sublinear dependence in the number of objectives $n$. Experimental results on robust representation learning and robust hyperparameter optimization showcase (i) the advantages of considering the min-max multi-objective setup, and (ii) convergence properties of the proposed MORBiT. Our code is at https://github.com/minimario/MORBiT.


title: Label-Only Model Inversion Attacks via Boundary Repulsion

abstract: Recent studies show that the state-of-the-art deep neural networks are vulnerable to model inversion attacks, in which access to a model is abused to reconstruct private training data of any given target class. Existing attacks rely on having access to either the complete target model (whitebox) or the model's soft-labels (blackbox). However, no prior work has been done in the harder but more practical scenario, in which the attacker only has access to the model's predicted label, without a confidence measure. In this paper, we introduce an algorithm, Boundary-Repelling Model Inversion (BREP-MI), to invert private training data using only the target model's predicted labels. The key idea of our algorithm is to evaluate the model's predicted labels over a sphere and then estimate the direction to reach the target class's centroid. Using the example of face recognition, we show that the images reconstructed by BREP-MI successfully reproduce the semantics of the private training data for various datasets and target model architectures. We compare BREP-MI with the state-of-the-art whitebox and blackbox model inversion attacks and the results show that despite assuming less knowledge about the target model, BREP-MI outperforms the blackbox attack and achieves comparable results to the whitebox attack.


title: Gaussian processes and effective field theory of $f(T)$ gravity under the $H_0$ tension

abstract: We consider the effective field theory formulation of torsional gravity in a cosmological framework to alter the background evolution. Then we use the latest $H_0$ measurement from the SH0ES Team as well as observational Hubble data from cosmic chronometer (CC) and radial baryon acoustic oscillations (BAO) and we reconstruct the $f(T)$ form in a model-independent way by applying Gaussian processes. Since the special square-root term does not affect the evolution at the background level, we finally summarize a family of functions that can produce the background evolution required by the data. Lastly, performing a fitting using polynomial functions, and implementing the Bayesian Information Criterion (BIC), we find an analytic expression that may describe the cosmological evolution in great agreement with observations.


title: As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive Conditioning

abstract: Omission and addition of content is a typical issue in neural machine translation. We propose a method for detecting such phenomena with off-the-shelf translation models. Using contrastive conditioning, we compare the likelihood of a full sequence under a translation model to the likelihood of its parts, given the corresponding source or target sequence. This allows to pinpoint superfluous words in the translation and untranslated words in the source even in the absence of a reference translation. The accuracy of our method is comparable to a supervised method that requires a custom quality estimation model.


title: Label-Free Explainability for Unsupervised Models

abstract: Unsupervised black-box models are challenging to interpret. Indeed, most existing explainability methods require labels to select which component(s) of the black-box's output to interpret. In the absence of labels, black-box outputs often are representation vectors whose components do not correspond to any meaningful quantity. Hence, choosing which component(s) to interpret in a label-free unsupervised/self-supervised setting is an important, yet unsolved problem. To bridge this gap in the literature, we introduce two crucial extensions of post-hoc explanation techniques: (1) label-free feature importance and (2) label-free example importance that respectively highlight influential features and training examples for a black-box to construct representations at inference time. We demonstrate that our extensions can be successfully implemented as simple wrappers around many existing feature and example importance methods. We illustrate the utility of our label-free explainability paradigm through a qualitative and quantitative comparison of representation spaces learned by various autoencoders trained on distinct unsupervised tasks.


title: CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation

abstract: This paper studies the complex task of simultaneous multi-object 3D reconstruction, 6D pose and size estimation from a single-view RGB-D observation. In contrast to instance-level pose estimation, we focus on a more challenging problem where CAD models are not available at inference time. Existing approaches mainly follow a complex multi-stage pipeline which first localizes and detects each object instance in the image and then regresses to either their 3D meshes or 6D poses. These approaches suffer from high-computational cost and low performance in complex multi-object scenarios, where occlusions can be present. Hence, we present a simple one-stage approach to predict both the 3D shape and estimate the 6D pose and size jointly in a bounding-box free manner. In particular, our method treats object instances as spatial centers where each center denotes the complete shape of an object along with its 6D pose and size. Through this per-pixel representation, our approach can reconstruct in real-time (40 FPS) multiple novel object instances and predict their 6D pose and sizes in a single-forward pass. Through extensive experiments, we demonstrate that our approach significantly outperforms all shape completion and categorical 6D pose and size estimation baselines on multi-object ShapeNet and NOCS datasets respectively with a 12.6% absolute improvement in mAP for 6D pose for novel real-world object instances.


title: Electron correlations and charge density wave in the topological kagome metal FeGe

abstract: Charge order in kagome metals is of extensive current interest. Recently, a charge density wave was discovered in the magnetic binary kagome metal FeGe. In analogy to its predecessor, the non-magnetic $A$V$_3$Sb$_5$ ($A$=K, Cs, Rb), the in-plane ordering occurs at the $M$ point. In contrast, however, the system manifestly shows effects of substantial correlations. Here we identify the topological bands crossing the Fermi energy (E$_F$) in FeGe and characterize the correlation-induced renormalization of these bands. We then derive a charge order from an effective model comprising topological kagome `flat' bands in the presence of a magnetic order. We demonstrate edge states as well as excess out-of-plane magnetic moment associated with the charge order; both are fingerprints of non-trivial band topology and consistent with recent experimental observations. Our results point to FeGe as an ideal platform to realize and elucidate correlated topological physics.