title: TR-MOT: Multi-Object Tracking by Reference

abstract: Multi-object Tracking (MOT) generally can be split into two sub-tasks, i.e., detection and association. Many previous methods follow the tracking by detection paradigm, which first obtain detections at each frame and then associate them between adjacent frames. Though with an impressive performance by utilizing a strong detector, it will degrade their detection and association performance under scenes with many occlusions and large motion if not using temporal information. In this paper, we propose a novel Reference Search (RS) module to provide a more reliable association based on the deformable transformer structure, which is natural to learn the feature alignment for each object among frames. RS takes previous detected results as references to aggregate the corresponding features from the combined features of the adjacent frames and makes a one-to-one track state prediction for each reference in parallel. Therefore, RS can attain a reliable association coping with unexpected motions by leveraging visual temporal features while maintaining the strong detection performance by decoupling from the detector. Our RS module can also be compatible with the structure of the other tracking by detection frameworks. Furthermore, we propose a joint training strategy and an effective matching pipeline for our online MOT framework with the RS module. Our method achieves competitive results on MOT17 and MOT20 datasets.


title: Federated Learning for the Classification of Tumor Infiltrating Lymphocytes

abstract: We evaluate the performance of federated learning (FL) in developing deep learning models for analysis of digitized tissue sections. A classification application was considered as the example use case, on quantifiying the distribution of tumor infiltrating lymphocytes within whole slide images (WSIs). A deep learning classification model was trained using 50*50 square micron patches extracted from the WSIs. We simulated a FL environment in which a dataset, generated from WSIs of cancer from numerous anatomical sites available by The Cancer Genome Atlas repository, is partitioned in 8 different nodes. Our results show that the model trained with the federated training approach achieves similar performance, both quantitatively and qualitatively, to that of a model trained with all the training data pooled at a centralized location. Our study shows that FL has tremendous potential for enabling development of more robust and accurate models for histopathology image analysis without having to collect large and diverse training data at a single location.


title: Subgradient-Push Is of the Optimal Convergence Rate

abstract: The push-sum based subgradient is an important method for distributed convex optimization over unbalanced directed graphs, which is known to converge at a rate of $O(\ln t/\sqrt{t})$. This paper shows that the subgradient-push algorithm actually converges at a rate of $O(1/\sqrt{t})$, which is the same as that of the single-agent subgradient and thus optimal. The proposed tool for analyzing push-sum based algorithms is of independent interest.


title: Multi Antenna Radar System for American Sign Language (ASL) Recognition Using Deep Learning

abstract: This paper investigates RF-based system for automatic American Sign Language (ASL) recognition. We consider radar for ASL by joint spatio-temporal preprocessing of radar returns using time frequency (TF) analysis and high-resolution receive beamforming. The additional degrees of freedom offered by joint temporal and spatial processing using a multiple antenna sensor can help to recognize ASL conversation between two or more individuals. This is performed by applying beamforming to collect spatial images in an attempt to resolve individuals communicating at the same time through hand and arm movements. The spatio-temporal images are fused and classified by a convolutional neural network (CNN) which is capable of discerning signs performed by different individuals even when the beamformer is unable to separate the respective signs completely. The focus group comprises individuals with varying expertise with sign language, and real time measurements at 77 GHz frequency are performed using Texas Instruments (TI) cascade radar.


title: In icy ocean worlds, size matters!

abstract: The ice shell and subsurface ocean on icy worlds are strongly coupled together -- heat and salinity flux from the ice shell induced by the ice thickness gradient drives circulation in the ocean, and in turn, the heat transport by ocean circulation shapes the ice shell. Since measurements in the near future are likely to remain constrained to above the ice shell, understanding this ocean-ice interaction is crucial. Using an ocean box model and a series of experiments simulating the 2D ocean circulation, we find that large icy moons with strong gravity tend to have stronger ocean heat transport under the same ice-shell topography. As a result, the equilibrium ice shell geometry is expected to be flatter on moons with larger size, and vice versa. This finding is broadly consistent with the observed ice shell geometry for Enceladus and Europa.


title: DDNeRF: Depth Distribution Neural Radiance Fields

abstract: In recent years, the field of implicit neural representation has progressed significantly. Models such as neural radiance fields (NeRF), which uses relatively small neural networks, can represent high-quality scenes and achieve state-of-the-art results for novel view synthesis. Training these types of networks, however, is still computationally very expensive. We present depth distribution neural radiance field (DDNeRF), a new method that significantly increases sampling efficiency along rays during training while achieving superior results for a given sampling budget. DDNeRF achieves this by learning a more accurate representation of the density distribution along rays. More specifically, we train a coarse model to predict the internal distribution of the transparency of an input volume in addition to the volume's total density. This finer distribution then guides the sampling procedure of the fine model. This method allows us to use fewer samples during training while reducing computational resources.


title: A Bayesian framework for incorporating exposure uncertainty into health analyses with application to air pollution and stillbirth

abstract: Studies of the relationships between environmental exposures and adverse health outcomes often rely on a two-stage statistical modeling approach, where exposure is modeled/predicted in the first stage and used as input to a separately fit health outcome analysis in the second stage. Uncertainty in these predictions is frequently ignored, or accounted for in an overly simplistic manner, when estimating the associations of interest. Working in the Bayesian setting, we propose a flexible kernel density estimation (KDE) approach for fully utilizing posterior output from the first stage modeling/prediction to make accurate inference on the association between exposure and health in the second stage, derive the full conditional distributions needed for efficient model fitting, detail its connections with existing approaches, and compare its performance through simulation. Our KDE approach is shown to generally have improved performance across several settings and model comparison metrics. Using competing approaches, we investigate the association between lagged daily ambient fine particulate matter levels and stillbirth counts in New Jersey (2011-2015), observing an increase in risk with elevated exposure three days prior to delivery. The newly developed methods are available in the R package KDExp.


title: Physics-constrained Unsupervised Learning of Partial Differential Equations using Meshes

abstract: Enhancing neural networks with knowledge of physical equations has become an efficient way of solving various physics problems, from fluid flow to electromagnetism. Graph neural networks show promise in accurately representing irregularly meshed objects and learning their dynamics, but have so far required supervision through large datasets. In this work, we represent meshes naturally as graphs, process these using Graph Networks, and formulate our physics-based loss to provide an unsupervised learning framework for partial differential equations (PDE). We quantitatively compare our results to a classical numerical PDE solver, and show that our computationally efficient approach can be used as an interactive PDE solver that is adjusting boundary conditions in real-time and remains sufficiently close to the baseline solution. Our inherently differentiable framework will enable the application of PDE solvers in interactive settings, such as model-based control of soft-body deformations, or in gradient-based optimization methods that require a fully differentiable pipeline.


title: A new parameterized monogamy relation between entanglement and equality

abstract: We provide a generalized definition of the monogamy relation for entanglement measures. A monogamy equality rather than the usual inequality is presented based on the monogamy weight, from which we give monogamy relations satisfied by the $\alpha$th $(\alpha>0)$ power of the entanglement measures. Taking concurrence as an example, we further demonstrate the significance and advantages of these relations. In addition, we show that monogamy relations can be recovered by considering multiple copies of states for every non-additive entanglement measure that violates the inequalities. We also demonstrate that the such relations for tripartite states can be generalized to multipartite systems.


title: The popular myth of the drunk fireworks in the Valencian Fallas: "If you run, it chases you"

abstract: There is a popular myth transferred from generation to generation related to the festivity of the Valencian Fallas. During these days, it is traditional to throw pyrotechnic devices of all kinds. There is a legend about the so-called drunk fireworks, small rockets that move randomly at high speed. According to folk wisdom, if you try to run away from a drunk firework, it will chase you until it hits you. It is performed a Monte Carlo simulation without considering aerodynamic effects to see if there is indeed a greater chance of a person being hit when moving. The results indicate that the popular myth is correct, at least in terms of having a higher probability of impact. Once again, it is demonstrated that popular myths can be a source of valuable knowledge beyond formal science.


title: Extreme value theory for a sequence of suprema of a class of Gaussian processes with trend

abstract: We investigate extreme value theory of a class of random sequences defined by the all-time suprema of aggregated self-similar Gaussian processes with trend. This study is motivated by its potential applications in various areas and its theoretical interestingness. We consider both stationary sequences and non-stationary sequences obtained by considering whether the trend functions are identical or not. We show that a sequence of suitably normalised $k$th order statistics converges in distribution to a limiting random variable which can be a negative log transformed Erlang distributed random variable, a Normal random variable or a mixture of them, according to three conditions deduced through the model parameters. Remarkably, this phenomenon resembles that for the stationary Normal sequence. We also show that various moments of the normalised $k$th order statistics converge to the moments of the corresponding limiting random variable. The obtained results enable us to analyze various properties of these random sequences, which reveals the interesting particularities of this class of random sequences in extreme value theory.


title: Controllable Augmentations for Video Representation Learning

abstract: This paper focuses on self-supervised video representation learning. Most existing approaches follow the contrastive learning pipeline to construct positive and negative pairs by sampling different clips. However, this formulation tends to bias to static background and have difficulty establishing global temporal structures. The major reason is that the positive pairs, i.e., different clips sampled from the same video, have limited temporal receptive field, and usually share similar background but differ in motions. To address these problems, we propose a framework to jointly utilize local clips and global videos to learn from detailed region-level correspondence as well as general long-term temporal relations. Based on a set of controllable augmentations, we achieve accurate appearance and motion pattern alignment through soft spatio-temporal region contrast. Our formulation is able to avoid the low-level redundancy shortcut by mutual information minimization to improve the generalization. We also introduce local-global temporal order dependency to further bridge the gap between clip-level and video-level representations for robust temporal modeling. Extensive experiments demonstrate that our framework is superior on three video benchmarks in action recognition and video retrieval, capturing more accurate temporal dynamics.


title: Model Predictive Optimized Path Integral Strategies

abstract: We generalize the derivation of model predictive path integral control (MPPI) to allow for a single joint distribution across controls in the control sequence. This reformation allows for the implementation of adaptive importance sampling (AIS) algorithms into the original importance sampling step while still maintaining the benefits of MPPI such as working with arbitrary system dynamics and cost functions. The benefit of optimizing the proposal distribution by integrating AIS at each control step is demonstrated in simulated environments including controlling multiple cars around a track. The new algorithm is more sample efficient than MPPI, achieving better performance with fewer samples. This performance disparity grows as the dimension of the action space increases. Results from simulations suggest the new algorithm can be used as an anytime algorithm, increasing the value of control at each iteration versus relying on a large set of samples.


title: Transformer Language Models without Positional Encodings Still Learn Positional Information

abstract: Causal transformer language models (LMs), such as GPT-3, typically require some form of positional encoding, such as positional embeddings. However, we show that LMs without any explicit positional encoding are still competitive with standard models, and that this phenomenon is robust across different datasets, model sizes, and sequence lengths. Probing experiments reveal that such models acquire an implicit notion of absolute positions throughout the network, effectively compensating for the missing information. We conjecture that causal attention enables the model to infer the number of predecessors that each token can attend to, thereby approximating its absolute position. Our findings indicate that causal LMs might derive positional awareness not only from the explicit positioning mechanism, but also from the effects of the causal mask.


title: Can the abyss swallow gravitational waves or why we do not observe echoes?

abstract: Here we propose a simple explanation why echoes from wormholes mimicking black holes may be so small that they cannot be observed. The essence of the effect is in the redistribution of the initial energy of gravitational wave among multiple universes, connected by a wormhole.


title: Convex bodies of constant width in spaces of constant curvature and the extremal area of Reuleaux triangles

abstract: Extending Blaschke and Lebesgue's classical result in the Euclidean plane, it has been recently proved in spherical and the hyperbolic cases, as well, that Reuleaux triangles have the minimal area among convex domains of constant width $D$. We prove an essentially optimal stability version of this statement in each of the three types of surfaces of constant curvature. In addition, we summarize the fundamental properties of convex bodies of constant width in spaces of constant curvature, and provide a characterization in the hyperbolic case in terms of horospheres.


title: Hybrid Handcrafted and Learnable Audio Representation for Analysis of Speech Under Cognitive and Physical Load

abstract: As a neurophysiological response to threat or adverse conditions, stress can affect cognition, emotion and behaviour with potentially detrimental effects on health in the case of sustained exposure. Since the affective content of speech is inherently modulated by an individual's physical and mental state, a substantial body of research has been devoted to the study of paralinguistic correlates of stress-inducing task load. Historically, voice stress analysis (VSA) has been conducted using conventional digital signal processing (DSP) techniques. Despite the development of modern methods based on deep neural networks (DNNs), accurately detecting stress in speech remains difficult due to the wide variety of stressors and considerable variability in the individual stress perception. To that end, we introduce a set of five datasets for task load detection in speech. The voice recordings were collected as either cognitive or physical stress was induced in the cohort of volunteers, with a cumulative number of more than a hundred speakers. We used the datasets to design and evaluate a novel self-supervised audio representation that leverages the effectiveness of handcrafted features (DSP-based) and the complexity of data-driven DNN representations. Notably, the proposed approach outperformed both extensive handcrafted feature sets and novel DNN-based audio representation learning approaches.


title: Compatibility of balanced and SKT metrics on two-step solvable Lie groups

abstract: It has been conjectured by Fino and Vezzoni that a compact complex manifold admitting both a compatible SKT and a compatible balanced metric also admits a compatible K\"ahler metric. Using the shear construction and classification results for two-step solvable SKT Lie algebras from our previous work, we prove this conjecture for compact two-step solvmanifolds endowed with an invariant complex structure which is either (a) of pure type or (b) of dimension six. In contrast, we provide two counterexamples for a natural generalisation of this conjecture in the homogeneous invariant setting. As part of the work, we obtain further classification results for invariant SKT, balanced and K\"ahler structures on two-step solvable Lie groups. In particular, we give the full classification of left-invariant SKT structures on two-step solvable Lie groups in dimension six.


title: FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations

abstract: We present a meta-learning framework for learning new visual concepts quickly, from just one or a few examples, guided by multiple naturally occurring data streams: simultaneously looking at images, reading sentences that describe the objects in the scene, and interpreting supplemental sentences that relate the novel concept with other concepts. The learned concepts support downstream applications, such as answering questions by reasoning about unseen images. Our model, namely FALCON, represents individual visual concepts, such as colors and shapes, as axis-aligned boxes in a high-dimensional space (the "box embedding space"). Given an input image and its paired sentence, our model first resolves the referential expression in the sentence and associates the novel concept with particular objects in the scene. Next, our model interprets supplemental sentences to relate the novel concept with other known concepts, such as "X has property Y" or "X is a kind of Y". Finally, it infers an optimal box embedding for the novel concept that jointly 1) maximizes the likelihood of the observed instances in the image, and 2) satisfies the relationships between the novel concepts and the known ones. We demonstrate the effectiveness of our model on both synthetic and real-world datasets.


title: Task-driven Modular Co-design of Vehicle Control Systems

abstract: When designing autonomous systems, we need to consider multiple trade-offs at various abstraction levels, and the choices of single (hardware and software) components need to be studied jointly. In this work we consider the problem of designing the control algorithm as well as the platform on which it is executed. In particular, we focus on vehicle control systems, and formalize state-of-the-art control schemes as monotone feasibility relations. We then show how, leveraging a monotone theory of co-design, we can study the embedding of control synthesis problems into the task-driven co-design problem of a robotic platform. The properties of the proposed approach are illustrated by considering urban driving scenarios. We show how, given a particular task, we can efficiently compute Pareto optimal design solutions.


title: Joint Sensing, Communication and Localization of a Silent Abnormality Using Molecular Diffusion

abstract: In this paper, we propose a molecular communication system to localize an abnormality in a diffusion based medium. We consider a general setup to perform joint sensing, communication and localization. This setup consists of three types of devices, each for a different task: mobile sensors for navigation and molecule releasing (for communication), fusion centers (FC)s for sampling, amplifying and forwarding the signal, and a gateway for making decision or exchanging the information with an external device. The sensors move randomly in the environment to reach the abnormality. We consider both collaborative and non-collaborative sensors that simultaneously release their molecules to the FCs when the number of activated sensors or the moving time reach a certain threshold, respectively. The FCs amplify the received signal and forward it to the gateway for decision making using either an ideal or a noisy communication channel. A practical application of the proposed model is drug delivery in a tissue of human body, in order to guide the nanomachine bound drug to the exact location. The decision rules and probabilities of error are obtained for two considered sensors types in both ideal and noisy communication channels.


title: Data-driven Prediction of Relevant Scenarios for Robust Combinatorial Optimization

abstract: We study iterative methods for (two-stage) robust combinatorial optimization problems with discrete uncertainty. We propose a machine-learning-based heuristic to determine starting scenarios that provide strong lower bounds. To this end, we design dimension-independent features and train a Random Forest Classifier on small-dimensional instances. Experiments show that our method improves the solution process for larger instances than contained in the training set and also provides a feature importance-score which gives insights into the role of scenario properties.


title: Adaptive Observer for a Class of Systems with Switched Unknown Parameters Using DREM

abstract: In this note, we develop an adaptive observer for a class of nonlinear systems with switched unknown parameters to estimate the states and parameters simultaneously. The main challenge lies in how to eliminate the disturbance effect of zero-input responses caused by the switching on the parameter estimation. These responses depend on the unknown states at switching instants (SASI) and constitute an additive disturbance to the parameter estimation, which obstructs parameter convergence to zero. Our solution is to treat the zero-input responses as excitations instead of disturbances. This is realized by first augmenting the system parameter with the SASI and then developing an estimator for the augmented parameter using the \textit{dynamic regression extension and mixing} (DREM) technique. Thanks to its property of element-wise parameter adaptation, the system parameter estimation is decoupled from the SASI. As a result, the estimation errors of system states and parameters converge to zero asymptotically. Furthermore, the robustness of the proposed adaptive observer is guaranteed in the presence of disturbances and noise. A numerical example validates the effectiveness of the proposed approach.


title: Boundary conditions for isolated asymptotically anti-de Sitter spacetimes

abstract: We revisit the propagation of classical scalar fields in a spacetime which is asymptotically anti-de Sitter. The lack of global hyperbolicity of the underlying background gives rise to an ambiguity in the dynamical evolution of solutions of the wave equation, requiring the prescription of extra boundary conditions at the conformal infinity to be fixed. We show that the only boundary conditions tha are compatible with the hypothesis that the system is isolated, as defined by the (improved) energy-momentum tensor, are of Dirichlet and Neumann types.


title: A Toy Model for Damped Water Waves

abstract: We consider a toy model for a damped water waves system in a domain $\Omega_t \subset \mathbb{T} \times \mathbb{R}$. The toy model is based on the paradifferential water waves equation derived in the work of Alazard-Burq-Zuily. The form of damping we utilize we utilize is a modified sponge layer proposed for the three-dimensional water waves system by Clamond, et. al. We show that, in the case of small Cauchy data, solutions to the toy model exhibit a quadratic lifespan. This is done via proving energy estimates with the energy being constructed from appropriately chosen vector fields.


title: Generation of Speaker Representations Using Heterogeneous Training Batch Assembly

abstract: In traditional speaker diarization systems, a well-trained speaker model is a key component to extract representations from consecutive and partially overlapping segments in a long speech session. To be more consistent with the back-end segmentation and clustering, we propose a new CNN-based speaker modeling scheme, which takes into account the heterogeneity of the speakers in each training segment and batch. We randomly and synthetically augment the training data into a set of segments, each of which contains more than one speaker and some overlapping parts. A soft label is imposed on each segment based on its speaker occupation ratio, and the standard cross entropy loss is implemented in model training. In this way, the speaker model should have the ability to generate a geometrically meaningful embedding for each multi-speaker segment. Experimental results show that our system is superior to the baseline system using x-vectors in two speaker diarization tasks. In the CALLHOME task trained on the NIST SRE and Switchboard datasets, our system achieves a relative reduction of 12.93% in DER. In Track 2 of CHiME-6, our system provides 13.24%, 12.60%, and 5.65% relative reductions in DER, JER, and WER, respectively.


title: Linking the properties of accreting white dwarfs with the ionization state of their ambient medium

abstract: Steadily accreting white dwarfs (WDs) are efficient sources of ionization and thus, are able to create extended ionized nebulae in their vicinity. These nebulae represent ideal tools for the detection of accreting WDs, given that in most cases the source itself is faint. In this work, we combine radiation transfer simulations with known H and He accreting WD models, providing for the first time the ionization state and the emission line spectra of the formed nebulae as a function of the WD mass, the accretion rate and the chemical composition of the accreted material. We find that the nebular optical line fluxes and radial extent vary strongly with the WD's accretion properties, peaking in systems with WD masses of 0.8 - 1.2 $\rm~M_{\odot}$. Projecting our results on the 'BPT' diagnostic diagrams, we show that accreting WDs nebulae possess characteristics distinct from those of H II-like regions, while they share similar line ratios with the galactic low-ionization emission-line regions. Finally, we compare our results to the relevant constraints imposed by the lack of ionized nebulae in the vicinity of supersoft X-ray sources (SSSs) and Type Ia supernova remnants - sources which are related to steadily accreting WDs. The large discrepancies uncovered by our comparison rule out any steadily accreting WD as a potential progenitor of the studied remnants and additionally require the ambient medium around the SSSs to be less dense than 0.2 $\rm~cm^{-3}$. We discuss possible alternatives that could bridge the incompatibility between the theoretical expectations and the relevant observations.


title: Predicting Winners of the Reality TV Dating Show $\textit{The Bachelor}$ Using Machine Learning Algorithms

abstract: $\textit{The Bachelor}$ is a reality TV dating show in which a single bachelor selects his wife from a pool of approximately 30 female contestants over eight weeks of filming (American Broadcasting Company 2002). We collected the following data on all 422 contestants that participated in seasons 11 through 25: their Age, Hometown, Career, Race, Week they got their first 1-on-1 date, whether they got the first impression rose, and what "place" they ended up getting. We then trained three machine learning models to predict the ideal characteristics of a successful contestant on $\textit{The Bachelor}$. The three algorithms that we tested were: random forest classification, neural networks, and linear regression. We found consistency across all three models, although the neural network performed the best overall. Our models found that a woman has the highest probability of progressing far on $\textit{The Bachelor}$ if she is: 26 years old, white, from the Northwest, works as an dancer, received a 1-on-1 in week 6, and did not receive the First Impression Rose. Our methodology is broadly applicable to all romantic reality television, and our results will inform future $\textit{The Bachelor}$ production and contestant strategies. While our models were relatively successful, we still encountered high misclassification rates. This may be because: (1) Our training dataset had fewer than 400 points or (2) Our models were too simple to parameterize the complex romantic connections contestants forge over the course of a season.


title: Comparing constellations across cultures

abstract: Cultural astronomy reveals ways in which perception and culture have shaped the interpretation of the night sky.


title: Robust Beamforming for Localization-Aided Millimeter Wave Communication Systems

abstract: In this letter, we investigate a robust beamforming problem for localization-aided millimeter wave (mmWave) communication systems. To handle this problem, we propose a novel restriction and relaxation (R&R) method. The proposed R&R method aims at minimizing the total transmit power while the positioning error follows a Gaussian distribution. Specifically, in the restriction phase of R&R, the probabilistic constraint is transformed into the deterministic form by using the Bernsteintype inequality. In the relaxation phase of R&R, the non-convex optimization problem is reformulated into a convex semidefinite program (SDP) by using semidefinite relaxation (SDR) and firstorder Taylor expansion methods. To the best of our knowledge, we first consider the impact of the distribution of the positioning error on the channel state information (CSI), which further influences the data rate. Numerical results present the trade-off of the beamforming between the communication and positioning.


title: Universal location of Yang-Lee edge singularity for a one-component field theory in $1\le d \le 4$

abstract: We determine the universal location of the Yang-Lee edge singularity in the entire relevant domain of spatial dimensions $1\le d \le 4$ for the Ising universality class. To that end, we present analytical results for $d=1,2,4$ and near four dimensions. For $d=3$ and a set of fractional dimensions, we perform numerical calculations using a systematic Functional Renormalization Group approach.


title: The diversity of rotation curves of simulated galaxies with cusps and cores

abstract: We use $\Lambda$CDM cosmological hydrodynamical simulations to explore the kinematics of gaseous discs in late-type dwarf galaxies. We create high-resolution 21-cm 'observations' of simulated dwarfs produced in two variations of the EAGLE galaxy formation model: one where supernova-driven gas flows redistribute dark matter and form constant-density central 'cores', and another where the central 'cusps' survive intact. We 'observe' each galaxy along multiple sight lines and derive a rotation curve for each observation using a conventional tilted-ring approach to model the gas kinematics. We find that the modelling process introduces systematic discrepancies between the recovered rotation curve and the actual circular velocity curve driven primarily by (i) non-circular gas orbits within the discs; (ii) the finite thickness of gaseous discs, which leads to overlap of different radii in projection; and (iii) departures from dynamical equilibrium. Dwarfs with dark matter cusps often appear to have a core, whilst the inverse error is less common. These effects naturally reproduce an observed trend which other models struggle to explain: late-type dwarfs with more steeply-rising rotation curves appear to be dark matter-dominated in the inner regions, whereas the opposite seems to hold in galaxies with core-like rotation curves. We conclude that if similar effects affect the rotation curves of observed dwarfs, a late-type dwarf population in which all galaxies have sizeable dark matter cores is most likely incompatible with current measurements.


title: Error Identification Strategies for Python Jupyter Notebooks

abstract: Computational notebooks -- such as Jupyter or Colab -- combine text and data analysis code. They have become ubiquitous in the world of data science and exploratory data analysis. Since these notebooks present a different programming paradigm than conventional IDE-driven programming, it is plausible that debugging in computational notebooks might also be different. More specifically, since creating notebooks blends domain knowledge, statistical analysis, and programming, the ways in which notebook users find and fix errors in these different forms might be different. In this paper, we present an exploratory, observational study on how Python Jupyter notebook users find and understand potential errors in notebooks. Through a conceptual replication of study design investigating the error identification strategies of R notebook users, we presented users with Python Jupyter notebooks pre-populated with common notebook errors -- errors rooted in either the statistical data analysis, the knowledge of domain concepts, or in the programming. We then analyzed the strategies our study participants used to find these errors and determined how successful each strategy was at identifying errors. Our findings indicate that while the notebook programming environment is different from the environments used for traditional programming, debugging strategies remain quite similar. It is our hope that the insights presented in this paper will help both notebook tool designers and educators make changes to improve how data scientists discover errors more easily in the notebooks they write.


title: Geographic Spines in the 2020 Census Disclosure Avoidance System

abstract: The 2020 Census Disclosure Avoidance System (DAS) is a formally private mechanism that first adds independent noise to cross tabulations for a set of pre-specified hierarchical geographic units, which is known as the geographic spine. After post-processing these noisy measurements, DAS outputs a formally private database with fields indicating location in the standard census geographic spine, which is defined by the United States as a whole, states, counties, census tracts, block groups, and census blocks. This paper describes how the geographic spine used internally within DAS to define the initial noisy measurements impacts accuracy of the output database. Specifically, tabulations for geographic areas tend to be most accurate for geographic areas that both 1) can be derived by aggregating together geographic units above the block geographic level of the internal spine, and 2) are closer to the geographic units of the internal spine. After describing the accuracy tradeoffs relevant to the choice of internal DAS geographic spine, we provide the settings used to define the 2020 Census production DAS runs.


title: No Redshift Evolution of Dust Temperatures from $0 < z < 2$

abstract: Some recent literature has claimed there to be an evolution in galaxies' dust temperatures towards warmer (or colder) spectral energy distributions (SEDs) between low and high redshift. These conclusions are driven by both theoretical models and empirical measurement. Such claims sometimes contradict one another and are prone to biases in samples or SED fitting techniques. What has made direct comparisons difficult is that there is no uniform approach to fitting galaxies' infrared/millimeter SEDs. Here we aim to standardize the measurement of galaxies' dust temperatures with a python-based SED fitting procedure, MCIRSED. We draw on reference datasets observed by IRAS, Herschel, and Scuba-2 to test for redshift evolution out to $z\sim2$. We anchor our work to the L$_{IR}$-$\lambda_{peak}$ plane, where there is an empirically observed anti-correlation between IR luminosity and rest-frame peak wavelength (an observational proxy for luminosity-weighted dust temperature) such that $\lambda_{peak}=\lambda_{t}({L_{IR}}/{L_{t}})^{\eta}$ where $\eta=-0.09\pm0.01$, L$_{t}=10^{12}$ L$_{\odot}$, and $\lambda_{t}=92\pm2\mu$m. We find no evidence for redshift evolution of galaxies' temperatures, or $\lambda_{peak}$, at fixed L$_{IR}$ from $0<z<2$ with >99.99% confidence. Our finding does not preclude evolution in dust temperatures at fixed stellar mass, which is expected from a non-evolving L$_{IR}$-$\lambda_{peak}$ relation and a strongly evolving SFR-M$_\star$ relation. The breadth of dust temperatures at a given L$_{IR}$ is likely driven by variation in galaxies' dust geometries and sizes and does not evolve. Testing for L$_{IR}$-$\lambda_{peak}$ evolution toward higher redshift ($z\sim5-6$) requires better sampling of galaxies' dust SEDs near their peaks (observed $\sim$200-600$\mu$m) with $<$1 mJy sensitivity. This poses a significant challenge to current instrumentation.


title: A local rigidity theorem for minimal two-spheres in an electrovacuum spacetime

abstract: The purpose of this article is to prove that, under suitable constrains on the electrovacuum spacetime $M$, if $\Sigma\subset M$ is an embedded strictly stable minimal two-sphere which locally maximizes the charged Hawking mass, then there exist a neighborhood of it in $M$ isometric to the Reissner-Nordstr\"om-de Sitter space. At the same time, motived by \cite{Brendle}, we will deduce an estimate for area of a two-sphere which is locally area minimizing in an electrovacuum spacetime. Moreover, if the equality holds, then there exist a neighborhood of it in $M$ isometric to the charged Nariai space.


title: Community Integration Algorithms (CIAs) for Dynamical Systems on Networks

abstract: Dynamics of large-scale network processes underlies crucial phenomena ranging across all sciences. Forward simulation of large network models is often computationally prohibitive. Yet, most networks have intrinsic community structure. We exploit these communities and propose a fast simulation algorithm for network dynamics. In particular, aggregating the inputs a node receives constitutes the limiting factor in numerically simulating large-scale network dynamics. We develop community integration algorithms (CIAs) significantly reducing function-evaluations. We obtain a substantial reduction from polynomial to linear computational complexity. We illustrate our results in multiple applications including classical and higher-order Kuramoto-type systems for synchronisation and Cucker--Smale systems exhibiting flocking behaviour on synthetic as well as real-world networks. Numerical comparison and theoretical analysis confirm the robustness and efficiency of CIAs.


title: On Sequences in Cyclic Groups with Distinct Partial Sums

abstract: A subset of an abelian group is {\em sequenceable} if there is an ordering $(x_1, \ldots, x_k)$ of its elements such that the partial sums $(y_0, y_1, \ldots, y_k)$, given by $y_0 = 0$ and $y_i = \sum_{j=1}^i x_i$ for $1 \leq i \leq k$, are distinct, with the possible exception that we may have $y_k = y_0 = 0$. We demonstrate the sequenceability of subsets of size $k$ of $\mathbb{Z}_n \setminus \{ 0 \}$ when $n = mt$ in many cases, including when $m$ is either prime or has all prime factors larger than $k! /2$ for $k \leq 11$ and $t \leq 5$ and for $k=12$ and $t \leq 4$. We obtain similar, but partial, results for $13 \leq k \leq 15$. This represents progress on a variety of questions and conjectures in the literature concerning the sequenceability of subsets of abelian groups, which we combine and summarize into the conjecture that if a subset of an abelian group does not contain 0 then it is sequenceable.


title: Completing the Theory of Electron with Gravitational Torsion

abstract: We demonstrate that classical and quantum electrodynamics can be completed by gravitational torsion appearing in Einstein-Cartan-Sciama-Kibble theory of gravity, providing the missing part of the electron theory. One of the equations of this theory, a version of Dirac type equation for fermions called Hehl-Datta equation, contains a gravitational spin-torsion term in the Lagrangian density for quantum electrodynamics. This term relates the charged fermion spin to gravitational torsion and provides a mechanical energy counter-balance to the infinite electromagnetic self-energy. As a result, there is no "bare" mass for an electron, nor is renormalization required for many scenarios.


title: On The Role of Social Identity in the Market for (Mis)information

abstract: Motivated by recent works in the communication and psychology literature, we model and study the role social identity -- a person's sense of belonging to a group -- plays in human information consumption. A hallmark of Social Identity Theory (SIT) is the notion of 'status', i.e., an individual's desire to enhance their and their 'in-group's' utility relative to that of an 'out-group'. In the context of belief formation, this comes off as a desire to believe positive news about the in-group and negative news about the out-group, which has been empirically shown to support belief in misinformation and false news. We model this phenomenon as a Stackelberg game being played over an information channel between a news-source (sender) and news-consumer (receiver), with the receiver incorporating the 'status' associated with social identity in their utility, in addition to accuracy. We characterize the strategy that must be employed by the sender to ensure that its message is trusted by receivers of all identities while maximizing their overall quality of information. We show that, as a rule, this optimal quality of information at equilibrium decreases when a receiver's sense of identity increases. We further demonstrate how extensions of our model can be used to quantitatively estimate the level of importance given to identity in a population.


title: A Liouville's theorem for some Monge-Amp\`ere type equations

abstract: We study a Monge-Amp\`ere type equation that interpolates the classical {\sigma_2} -Yamabe equation in conformal geometry and the 2-Hessian equation in dimension 4.


title: Overcoming challenges in leveraging GANs for few-shot data augmentation

abstract: In this paper, we explore the use of GAN-based few-shot data augmentation as a method to improve few-shot classification performance. We perform an exploration into how a GAN can be fine-tuned for such a task (one of which is in a class-incremental manner), as well as a rigorous empirical investigation into how well these models can perform to improve few-shot classification. We identify issues related to the difficulty of training such generative models under a purely supervised regime with very few examples, as well as issues regarding the evaluation protocols of existing works. We also find that in this regime, classification accuracy is highly sensitive to how the classes of the dataset are randomly split. Therefore, we propose a semi-supervised fine-tuning approach as a more pragmatic way forward to address these problems.


title: Robust Reputation Independence in Ranking Systems for Multiple Sensitive Attributes

abstract: Ranking systems have an unprecedented influence on how and what information people access, and their impact on our society is being analyzed from different perspectives, such as users' discrimination. A notable example is represented by reputation-based ranking systems, a class of systems that rely on users' reputation to generate a non-personalized item-ranking, proved to be biased against certain demographic classes. To safeguard that a given sensitive user's attribute does not systematically affect the reputation of that user, prior work has operationalized a reputation independence constraint on this class of systems. In this paper, we uncover that guaranteeing reputation independence for a single sensitive attribute is not enough. When mitigating biases based on one sensitive attribute (e.g., gender), the final ranking might still be biased against certain demographic groups formed based on another attribute (e.g., age). Hence, we propose a novel approach to introduce reputation independence for multiple sensitive attributes simultaneously. We then analyze the extent to which our approach impacts on discrimination and other important properties of the ranking system, such as its quality and robustness against attacks. Experiments on two real-world datasets show that our approach leads to less biased rankings with respect to multiple users' sensitive attributes, without affecting the system's quality and robustness.


title: Semi-explicit integration of second order for weakly coupled poroelasticity

abstract: We introduce a semi-explicit time-stepping scheme of second order for linear poroelasticity satisfying a weak coupling condition. Here, semi-explicit means that the system, which needs to be solved in each step, decouples and hence improves the computational efficiency. The construction and the convergence proof are based on the connection to a differential equation with two time delays, namely one and two times the step size. Numerical experiments confirm the theoretical results and indicate the applicability to higher-order schemes.


title: Low Energy Protons as Probes of Hadronization Dynamics

abstract: Energetic quarks liberated from hadrons in nuclear deep-inelastic scattering propagate through the nuclear medium, interacting with it via several processes. These include quark energy loss and nuclear interactions of forming hadrons. One manifestation of these interactions is the enhanced emission of low-energy charged particles, referred to as grey tracks. We use the theoretical components of the BeAGLE event generator to interpret grey track signatures of parton transport and hadron formation by comparing its predictions to E665 data. We extend the base version of BeAGLE by adding four different options for describing parton energy loss. The E665 data we used consists of multiplicity ratios for fixed-target scattering of 490 GeV muons on Xe normalized to deuterium as a function of the number of grey tracks. We compare multiplicity ratios for E665 grey tracks to the predictions of BeAGLE, varying the options and parameters to determine which physics phenomena can be identified by these data. We find that grey tracks are unaffected by modifications of the forward production. Thus their production must be dominated by interactions with hadrons in the backward region. This offers the advantage that selecting certain particles in the forward region is unlikely to bias a centrality selection. We see a strong correlation between the number of grey tracks and the in-medium path length. Our energy loss model does not reproduce the suppression observed in the projectile region. We see an underprediction of the proton production rate in backward kinematics, suggesting that a stronger source of interaction with the nuclear medium is needed for accurate modeling. These results lay an important foundation for future spectator tagging studies at both Jefferson Lab and at the Electron-Ion Collider, where neutron and proton grey track studies will be feasible down to very small momenta.


title: Hawkes Process Modeling of Block Arrivals in Bitcoin Blockchain

abstract: The paper constructs a multi-variate Hawkes process model of Bitcoin block arrivals and price jumps. Hawkes processes are selfexciting point processes that can capture the self- and cross-excitation effects of block mining and Bitcoin price volatility. We use publicly available blockchain datasets to estimate the model parameters via maximum likelihood estimation. The results show that Bitcoin price volatility boost block mining rate and Bitcoin investment return demonstrates mean reversion. Quantile-Quantile plots show that the proposed Hawkes process model is a better fit to the blockchain datasets than a Poisson process model.


title: Quantum transport in chaotic cavities with tunnel barriers

abstract: We bring together the semiclassical approximation, matrix integrals and the theory of symmetric polynomials in order to solve a long standing problem in the field of quantum chaos: to compute transport moments when tunnel barriers are present and the number of open channels, $M$, is small. In contrast to previous approaches, ours is non-perturbative in $M$; instead, we arrive at an explicit expression in the form of a power series in the barrier's reflectivity, whose coefficients are rational functions of $M$. For general moments we must require that the barriers are equal and time reversal symmetry is broken, but for conductance we treat the general situation. Our method accounts for exponentially small non-perturbative terms that were not accessible to previous semiclassical approaches. We also show how to include more than two leads in the system.


title: Flexible and Efficient Contextual Bandits with Heterogeneous Treatment Effect Oracles

abstract: Contextual bandit algorithms often estimate reward models to inform decision-making. However, true rewards can contain action-independent redundancies that are not relevant for decision-making. We show it is more data-efficient to estimate any function that explains the reward differences between actions, that is, the treatment effects. Motivated by this observation, building on recent work on oracle-based bandit algorithms, we provide the first reduction of contextual bandits to general-purpose heterogeneous treatment effect estimation, and we design a simple and computationally efficient algorithm based on this reduction. Our theoretical and experimental results demonstrate that heterogeneous treatment effect estimation in contextual bandits offers practical advantages over reward estimation, including more efficient model estimation and greater flexibility to model misspecification.


title: Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucination

abstract: In Heterogeneous Face Recognition (HFR), the objective is to match faces across two different domains such as visible and thermal. Large domain discrepancy makes HFR a difficult problem. Recent methods attempting to fill the gap via synthesis have achieved promising results, but their performance is still limited by the scarcity of paired training data. In practice, large-scale heterogeneous face data are often inaccessible due to the high cost of acquisition and annotation process as well as privacy regulations. In this paper, we propose a new face hallucination paradigm for HFR, which not only enables data-efficient synthesis but also allows to scale up model training without breaking any privacy policy. Unlike existing methods that learn face synthesis entirely from scratch, our approach is particularly designed to take advantage of rich and diverse facial priors from visible domain for more faithful hallucination. On the other hand, large-scale training is enabled by introducing a new federated learning scheme to allow institution-wise collaborations while avoiding explicit data sharing. Extensive experiments demonstrate the advantages of our approach in tackling HFR under current data limitations. In a unified framework, our method yields the state-of-the-art hallucination results on multiple HFR datasets.


title: PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decomposition

abstract: Intrinsic image decomposition is the process of recovering the image formation components (reflectance and shading) from an image. Previous methods employ either explicit priors to constrain the problem or implicit constraints as formulated by their losses (deep learning). These methods can be negatively influenced by strong illumination conditions causing shading-reflectance leakages. Therefore, in this paper, an end-to-end edge-driven hybrid CNN approach is proposed for intrinsic image decomposition. Edges correspond to illumination invariant gradients. To handle hard negative illumination transitions, a hierarchical approach is taken including global and local refinement layers. We make use of attention layers to further strengthen the learning process. An extensive ablation study and large scale experiments are conducted showing that it is beneficial for edge-driven hybrid IID networks to make use of illumination invariant descriptors and that separating global and local cues helps in improving the performance of the network. Finally, it is shown that the proposed method obtains state of the art performance and is able to generalise well to real world images. The project page with pretrained models, finetuned models and network code can be found at https://ivi.fnwi.uva.nl/cv/pienet/.


title: Can X-ray Observations Improve Optical-UV-based Accretion-Rate Estimates for Quasars?

abstract: Current estimates of the normalized accretion rates of quasars (L/L_Edd), rely on measuring the velocity widths of broad optical-UV emission lines (e.g., H$\beta$ and Mg II $\lambda2800$). However, such lines tend to be weak or inaccessible in the most distant quasars, leading to increasing uncertainty in L/L_Edd estimates at $z > 6$. Utilizing a carefully selected sample of 53 radio-quiet quasars that have H$\beta$ and C IV $\lambda1549$ spectroscopy as well as {\sl Chandra} coverage, we searched for a robust accretion-rate indicator for quasars, particularly at the highest-accessible redshifts ($z \sim 6-7$). Our analysis explored relationships between the H$\beta$-based L/L_Edd, the equivalent width (EW) of C IV, and the optical-to-X-ray spectral slope (a_ox). Our results show that EW(C IV) is the strongest indicator of the H$\beta$-based L/L_Edd parameter, consistent with previous studies, although significant scatter persists particularly for sources with weak C IV lines. We do not find evidence for the a_ox parameter improving this relation, and we do not find a significant correlation between a_ox and H$\beta$-based L/L_Edd. This absence of an improved relationship may reveal a limitation in our sample. X-ray observations of additional luminous sources, found at $z \gtrsim 1$, may allow us to mitigate the biases inherent in our archival sample and test whether X-ray data could improve L/L_Edd estimates. Furthermore, deeper X-ray observations of our sources may provide accurate measurements of the hard-X-ray power-law photon index ($\Gamma$), which is considered an unbiased L/L_Edd indicator. Correlations between EW(C IV) and a_ox with $\Gamma$-based L/L_Edd may yield a more robust prediction of a quasar normalized accretion rate.


title: Long-term variability of Class I methanol masers in the high mass star forming region DR21(OH)

abstract: High mass stars play an important role in the Interstellar Medium, but much remains to be known about their formation. Class I methanol masers may be unique tracers of an early stage of high mass star formation, and a better understanding of such masers will allow them to be used as more effective probes of the high mass star forming process. We present an investigation of the long-term variability of Class I methanol masers at 44 GHz toward the high mass star forming region DR21(OH). We compare observations taken in 2017 to 2012 and also to 2001 data from the literature. A total of 57 maser spots were found in the 2017 data, with center velocities ranging between -8.65 km/s to +2.56 km/s. The masers are arranged in a western and an eastern lobe with two arcs in each lobe that look like bowshocks, consistent with previous observations. The general trend is an increase in intensity from 2001 to 2012, and a decrease from 2012 to 2017. Variability appears to be more prevalent in the inner arc of the western lobe than in the outer arc. We speculate that this may be a consequence of episodic accretion, in which a later accretion event has resulted in ejection of material whose shock reached the inner arc at some point in time after 2001. We conclude that class I methanol masers are variable on long timescales (of the order of 5-10 years).


title: System Identification via Nuclear Norm Regularization

abstract: This paper studies the problem of identifying low-order linear systems via Hankel nuclear norm regularization. Hankel regularization encourages the low-rankness of the Hankel matrix, which maps to the low-orderness of the system. We provide novel statistical analysis for this regularization and carefully contrast it with the unregularized ordinary least-squares (OLS) estimator. Our analysis leads to new bounds on estimating the impulse response and the Hankel matrix associated with the linear system. We first design an input excitation and show that Hankel regularization enables one to recover the system using optimal number of observations in the true system order and achieve strong statistical estimation rates. Surprisingly, we demonstrate that the input design indeed matters, by showing that intuitive choices such as i.i.d. Gaussian input leads to provably sub-optimal sample complexity. To better understand the benefits of regularization, we also revisit the OLS estimator. Besides refining existing bounds, we experimentally identify when regularized approach improves over OLS: (1) For low-order systems with slow impulse-response decay, OLS method performs poorly in terms of sample complexity, (2) Hankel matrix returned by regularization has a more clear singular value gap that ease identification of the system order, (3) Hankel regularization is less sensitive to hyperparameter choice. Finally, we establish model selection guarantees through a joint train-validation procedure where we tune the regularization parameter for near-optimal estimation.

categories: stat.ML cs.LG cs.SY eess.SY math.DS math.OC


title: A generalization of the Beurling--Malliavin Majorant theorem

abstract: In this article we prove a generalization of the Beurling--Malliavin Majorant Theorem. In more detail, we establish a new sufficient condition for a function to be a Beurling--Malliavin Majorant. Our result is strictly more general than that of the Beurling--Malliavin Majorant Theorem. We also show that our result is sharp in a number senses.


title: Kinematics and Metallicity of Red Giant Branch Stars in the Northeast Shelf of M31

abstract: We obtained Keck/DEIMOS spectra of 556 individual red giant branch stars in 4 spectroscopic fields spanning $13-31$ projected kpc along the Northeast (NE) shelf of M31. We present the first detection of a complete wedge pattern in the space of projected M31-centric radial distance versus line-of-sight velocity for this feature, which includes the returning stream component of the shelf. This wedge pattern agrees with expectations of a tidal shell formed in a radial merger and provides strong evidence in favor of predictions of Giant Stellar Stream (GSS) formation models in which the NE shelf originates from the second orbital wrap of the tidal debris. The observed concentric wedge patterns of the NE, West (W), and Southeast (SE) shelves corroborate this interpretation independently of the models. We do not detect a kinematical signature in the NE shelf region corresponding to an intact progenitor core, favoring GSS formation models in which the progenitor is completely disrupted. The shelf's photometric metallicity distribution implies that it is dominated by tidal material, as opposed to the phase-mixed stellar halo or the disk. The metallicity distribution ([Fe/H]$_{\rm phot}$ = $-0.42$ $\pm$ $0.01$) also matches the GSS, and consequently the W and SE shelves, further supporting a direct physical association between the tidal features.


title: Exploring the hysteresis properties of nanocrystalline permanent magnets using deep learning

abstract: We demonstrate the use of model order reduction and neural networks for estimating the hysteresis properties of nanocrystalline permanent magnets from microstructure. With a data-driven approach, we learn the demagnetization curve from data-sets created by grain growth and micromagnetic simulations. We show that the granular structure of a magnet can be encoded within a low-dimensional latent space. Latent codes are constructed using a variational autoencoder. The mapping of structure code to hysteresis properties is a multi-target regression problem. We apply deep neural network and use parameter sharing, in order to predict anchor points along the demagnetization curves from the magnet's structure code. The method is applied to study the magnetic properties of nanocrystalline permanent magnets. We show how new grain structures can be generated by interpolation between two points in the latent space and how the magnetic properties of the resulting magnets can be predicted.


title: First-principles Landau-like potential for BiFeO$_3$ and related materials

abstract: In this work we introduce the simplest, lowest-order Landau-like potential for BiFeO$_3$ and La-doped BiFeO$_3$ as an expansion around the paraelectric cubic phase in powers of polarization, FeO$_6$ octahedral rotations and strains. We present an analytical approach for computing the model parameters from density functional theory. We illustrate our approach by computing the potentials for BiFeO$_3$ and La$_{0.25}$Bi$_{0.75}$FeO$_3$ and show that, overall, we are able to capture the first-principles results accurately. The computed models allow us to identify and explain the main interactions controlling the relative stability of the competing low-energy phases of these compounds.


title: Knowledge-Spreader: Learning Facial Action Unit Dynamics with Extremely Limited Labels

abstract: Recent studies on the automatic detection of facial action unit (AU) have extensively relied on large-sized annotations. However, manually AU labeling is difficult, time-consuming, and costly. Most existing semi-supervised works ignore the informative cues from the temporal domain, and are highly dependent on densely annotated videos, making the learning process less efficient. To alleviate these problems, we propose a deep semi-supervised framework Knowledge-Spreader (KS), which differs from conventional methods in two aspects. First, rather than only encoding human knowledge as constraints, KS also learns the Spatial-Temporal AU correlation knowledge in order to strengthen its out-of-distribution generalization ability. Second, we approach KS by applying consistency regularization and pseudo-labeling in multiple student networks alternately and dynamically. It spreads the spatial knowledge from labeled frames to unlabeled data, and completes the temporal information of partially labeled video clips. Thus, the design allows KS to learn AU dynamics from video clips with only one label allocated, which significantly reduce the requirements of using annotations. Extensive experiments demonstrate that the proposed KS achieves competitive performance as compared to the state of the arts under the circumstances of using only 2% labels on BP4D and 5% labels on DISFA. In addition, we test it on our newly developed large-scale comprehensive emotion database, which contains considerable samples across well-synchronized and aligned sensor modalities for easing the scarcity issue of annotations and identities in human affective computing. The new database will be released to the research community.


title: Which cluster morphism categories are CAT(0)

abstract: The cluster morphism category of an hereditary algebra was introduced in [5] to show that the picture space of an hereditary algebra of finite representation type is a $K(\pi,1)$ for the associated picture group, thereby allowing for the computation of the homology of picture groups of finite type as carried out in [7] for the case of $A_n$. In this paper we show that the cluster morphism category is a $CAT(0)$-category for hereditary algebras of finite or tame type with only small tubes. As a consequence, we get that the classifying space of the cluster morphism category is a locally $CAT(0)$ space and, as a consequence of that, we get that this classifying space is a $K(\pi,1)$.


title: Learning the Effect of Registration Hyperparameters with HyperMorph

abstract: We introduce HyperMorph, a framework that facilitates efficient hyperparameter tuning in learning-based deformable image registration. Classical registration algorithms perform an iterative pair-wise optimization to compute a deformation field that aligns two images. Recent learning-based approaches leverage large image datasets to learn a function that rapidly estimates a deformation for a given image pair. In both strategies, the accuracy of the resulting spatial correspondences is strongly influenced by the choice of certain hyperparameter values. However, an effective hyperparameter search consumes substantial time and human effort as it often involves training multiple models for different fixed hyperparameter values and may lead to suboptimal registration. We propose an amortized hyperparameter learning strategy to alleviate this burden by learning the impact of hyperparameters on deformation fields. We design a meta network, or hypernetwork, that predicts the parameters of a registration network for input hyperparameters, thereby comprising a single model that generates the optimal deformation field corresponding to given hyperparameter values. This strategy enables fast, high-resolution hyperparameter search at test-time, reducing the inefficiency of traditional approaches while increasing flexibility. We also demonstrate additional benefits of HyperMorph, including enhanced robustness to model initialization and the ability to rapidly identify optimal hyperparameter values specific to a dataset, image contrast, task, or even anatomical region, all without the need to retrain models. We make our code publicly available at http://hypermorph.voxelmorph.net.


title: Face Relighting with Geometrically Consistent Shadows

abstract: Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose. Methods that propose techniques for handling hard shadows often do not produce geometrically consistent shadows since they do not directly leverage the estimated face geometry while synthesizing them. We propose a novel differentiable algorithm for synthesizing hard shadows based on ray tracing, which we incorporate into training our face relighting model. Our proposed algorithm directly utilizes the estimated face geometry to synthesize geometrically consistent hard shadows. We demonstrate through quantitative and qualitative experiments on Multi-PIE and FFHQ that our method produces more geometrically consistent shadows than previous face relighting methods while also achieving state-of-the-art face relighting performance under directional lighting. In addition, we demonstrate that our differentiable hard shadow modeling improves the quality of the estimated face geometry over diffuse shading models.


title: To Find Waldo You Need Contextual Cues: Debiasing Who's Waldo

abstract: We present a debiased dataset for the Person-centric Visual Grounding (PCVG) task first proposed by Cui et al. (2021) in the Who's Waldo dataset. Given an image and a caption, PCVG requires pairing up a person's name mentioned in a caption with a bounding box that points to the person in the image. We find that the original Who's Waldo dataset compiled for this task contains a large number of biased samples that are solvable simply by heuristic methods; for instance, in many cases the first name in the sentence corresponds to the largest bounding box, or the sequence of names in the sentence corresponds to an exact left-to-right order in the image. Naturally, models trained on these biased data lead to over-estimation of performance on the benchmark. To enforce models being correct for the correct reasons, we design automated tools to filter and debias the original dataset by ruling out all examples of insufficient context, such as those with no verb or with a long chain of conjunct names in their captions. Our experiments show that our new sub-sampled dataset contains less bias with much lowered heuristic performances and widened gaps between heuristic and supervised methods. We also demonstrate the same benchmark model trained on our debiased training set outperforms that trained on the original biased (and larger) training set on our debiased test set. We argue our debiased dataset offers the PCVG task a more practical baseline for reliable benchmarking and future improvements.


title: Active Learning for Computationally Efficient Distribution of Binary Evolution Simulations

abstract: Binary stars undergo a variety of interactions and evolutionary phases, critical for predicting and explaining observed properties. Binary population synthesis with full stellar-structure and evolution simulations are computationally expensive requiring a large number of mass-transfer sequences. The recently developed binary population synthesis code POSYDON incorporates grids of MESA binary star simulations which are then interpolated to model large-scale populations of massive binaries. The traditional method of computing a high-density rectilinear grid of simulations is not scalable for higher-dimension grids, accounting for a range of metallicities, rotation, and eccentricity. We present a new active learning algorithm, psy-cris, which uses machine learning in the data-gathering process to adaptively and iteratively select targeted simulations to run, resulting in a custom, high-performance training set. We test psy-cris on a toy problem and find the resulting training sets require fewer simulations for accurate classification and regression than either regular or randomly sampled grids. We further apply psy-cris to the target problem of building a dynamic grid of MESA simulations, and we demonstrate that, even without fine tuning, a simulation set of only $\sim 1/4$ the size of a rectilinear grid is sufficient to achieve the same classification accuracy. We anticipate further gains when algorithmic parameters are optimized for the targeted application. We find that optimizing for classification only may lead to performance losses in regression, and vice versa. Lowering the computational cost of producing grids will enable future versions of POSYDON to cover more input parameters while preserving interpolation accuracies.


title: DBSP: Automatic Incremental View Maintenance for Rich Query Languages

abstract: Incremental view maintenance has been for a long time a central problem in database theory. Many solutions have been proposed for restricted classes of database languages, such as the relational algebra, or Datalog. These techniques do not naturally generalize to richer languages. In this paper we give a general solution to this problem in 3 steps: (1) we describe a simple but expressive language called DBSP for describing computations over data streams; (2) we give a general algorithm for solving the incremental view maintenance problem for arbitrary DBSP programs, and (3) we show how to model many rich database query languages (including the full relational queries, grouping and aggregation, monotonic and non-monotonic recursion, and streaming aggregation) using DBSP. As a consequence, we obtain efficient incremental view maintenance techniques for all these rich languages.


title: Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

abstract: This paper presents a streaming speaker-attributed automatic speech recognition (SA-ASR) model that can recognize ``who spoke what'' with low latency even when multiple people are speaking simultaneously. Our model is based on token-level serialized output training (t-SOT) which was recently proposed to transcribe multi-talker speech in a streaming fashion. To further recognize speaker identities, we propose an encoder-decoder based speaker embedding extractor that can estimate a speaker representation for each recognized token not only from non-overlapping speech but also from overlapping speech. The proposed speaker embedding, named t-vector, is extracted synchronously with the t-SOT ASR model, enabling joint execution of speaker identification (SID) or speaker diarization (SD) with the multi-talker transcription with low latency. We evaluate the proposed model for a joint task of ASR and SID/SD by using LibriSpeechMix and LibriCSS corpora. The proposed model achieves substantially better accuracy than a prior streaming model and shows comparable or sometimes even superior results to the state-of-the-art offline SA-ASR model.


title: Decentralized convex optimization under affine constraints for power systems control

abstract: Modern power systems are now in continuous process of massive changes. Increased penetration of distributed generation, usage of energy storage and controllable demand require introduction of a new control paradigm that does not rely on massive information exchange required by centralized approaches. Distributed algorithms can rely only on limited information from neighbours to obtain an optimal solution for various optimization problems, such as optimal power flow, unit commitment etc. As a generalization of these problems we consider the problem of decentralized minimization of the smooth and convex partially separable function $f = \sum_{k=1}^l f^k(x^k,\tilde x)$ under the coupled $\sum_{k=1}^l (A^k x^k - b^k) \leq 0$ and the shared $\tilde{A} \tilde{x} - \tilde{b} \leq 0$ affine constraints, where the information about $A^k$ and $b^k$ is only available for the $k$-th node of the computational network. One way to handle the coupled constraints in a distributed manner is to rewrite them in a distributed-friendly form using the Laplace matrix of the communication graph and auxiliary variables (Khamisov, CDC, 2017). Instead of using this method we reformulate the constrained optimization problem as a saddle point problem (SPP) and utilize the consensus constraint technique to make it distributed-friendly. Then we provide a complexity analysis for state-of-the-art SPP solving algorithms applied to this SPP.


title: Quasi-orthogonality and intrinsic dimensions as measures of learning and generalisation

abstract: Finding best architectures of learning machines, such as deep neural networks, is a well-known technical and theoretical challenge. Recent work by Mellor et al (2021) showed that there may exist correlations between the accuracies of trained networks and the values of some easily computable measures defined on randomly initialised networks which may enable to search tens of thousands of neural architectures without training. Mellor et al used the Hamming distance evaluated over all ReLU neurons as such a measure. Motivated by these findings, in our work, we ask the question of the existence of other and perhaps more principled measures which could be used as determinants of success of a given neural architecture. In particular, we examine, if the dimensionality and quasi-orthogonality of neural networks' feature space could be correlated with the network's performance after training. We showed, using the setup as in Mellor et al, that dimensionality and quasi-orthogonality may jointly serve as network's performance discriminants. In addition to offering new opportunities to accelerate neural architecture search, our findings suggest important relationships between the networks' final performance and properties of their randomly initialised feature spaces: data dimension and quasi-orthogonality.


title: Eigenvector-Assisted Statistical Inference for Signal-Plus-Noise Matrix Models

abstract: In this paper, we develop a generalized Bayesian inference framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon an asymptotically unbiased estimating equation with the assistance of the leading eigenvectors of the data matrix. The solution to the estimating equation coincides with the maximizer of an appropriate statistical criterion function. The generalized posterior distribution is constructed by replacing the usual log-likelihood function in the Bayes formula with the criterion function. The proposed framework does not require the complete specification of the sampling distribution and is convenient for uncertainty quantification via a Markov Chain Monte Carlo sampler, circumventing the inconvenience of resampling the data matrix. Under mild regularity conditions, we establish the large sample properties of the estimating equation estimator and the generalized posterior distributions. In particular, the generalized posterior credible sets have the correct frequentist nominal coverage probability provided that the so-called generalized information equality holds. The validity and usefulness of the proposed framework are demonstrated through the analysis of synthetic datasets and the real-world ENZYMES network datasets.


title: Undecidable problems in quantum field theory

abstract: We point out that some questions in quantum field theory are undecidable in a precise mathematical sense. More concretely, it will be demonstrated that there is no algorithm answering whether a given 2d supersymmetric Lagrangian theory breaks supersymmetry or not. It will also be shown that there is a specific 2d supersymmetric Lagrangian theory which breaks supersymmetry if and only if the standard Zermelo-Fraenkel set theory with the axiom of choice is consistent, which can never be proved or disproved as the consequence of G\"odel's second incompleteness theorem. The article includes a brief and informal introduction to the phenomenon of undecidability and its previous appearances in theoretical physics.


title: GTP-SLAM: Game-Theoretic Priors for Simultaneous Localization and Mapping in Multi-Agent Scenarios

abstract: Robots operating in multi-player settings must simultaneously model the environment and the behavior of human or robotic agents who share that environment. This modeling is often approached using Simultaneous Localization and Mapping (SLAM); however, SLAM algorithms usually neglect multi-player interactions. In contrast, the motion planning literature often uses dynamic game theory to explicitly model noncooperative interactions of multiple agents in a known environment with perfect localization. Here, we present GTP-SLAM, a novel, iterative best response-based SLAM algorithm that accurately performs state localization and map reconstruction, while using game theoretic priors to capture the inherent non-cooperative interactions among multiple agents in an uncharted scene. By formulating the underlying SLAM problem as a potential game, we inherit a strong convergence guarantee. Empirical results indicate that, when deployed in a realistic traffic simulation, our approach performs localization and mapping more accurately than a standard bundle adjustment algorithm across a wide range of noise levels.


title: MAE-AST: Masked Autoencoding Audio Spectrogram Transformer

abstract: In this paper, we propose a simple yet powerful improvement over the recent Self-Supervised Audio Spectrogram Transformer (SSAST) model for speech and audio classification. Specifically, we leverage the insight that the SSAST uses a very high masking ratio (75%) during pretraining, meaning that the vast majority of self-attention compute is performed on mask tokens. We address this by integrating the encoder-decoder architecture from Masked Autoencoders are Scalable Vision Learners (MAE) into the SSAST, where a deep encoder operates on only unmasked input, and a shallow decoder operates on encoder outputs and mask tokens. We find that MAE-like pretraining can provide a 3x speedup and 2x memory usage reduction over the vanilla SSAST using current audio pretraining strategies with ordinary model and input sizes. When fine-tuning on downstream tasks, which only uses the encoder, we find that our approach outperforms the SSAST on a variety of downstream tasks. We further conduct comprehensive evaluations into different strategies of pretraining and explore differences in MAE-style pretraining between the visual and audio domains.


title: Machine learning based data-driven discovery of nonlinear phase-field dynamics

abstract: One of the main questions regarding complex systems at large scales concerns the effective interactions and driving forces that emerge from the detailed microscopic properties. Coarse-grained models aim to describe complex systems in terms of coarse-scale equations with a reduced number of degrees of freedom. Recent developments in machine learning (ML) algorithms have significantly empowered the discovery process of the governing equations directly from data. However, it remains difficult to discover partial differential equations (PDEs) with high-order derivatives. In this paper, we present new data-driven architectures based on multi-layer perceptron (MLP), convolutional neural network (CNN), and a combination of CNN and long short-term memory (CNN-LSTM) structures for discovering the non-linear equations of motion for phase-field models with non-conserved and conserved order parameters. The well-known Allen--Cahn, Cahn--Hilliard, and the phase-field crystal (PFC) models were used as the test cases. Two conceptually different types of implementations were used: (a) guided by physical intuition (such as local dependence of the derivatives) and (b) in the absence of any physical assumptions (black-box model). We show that not only can we effectively learn the time derivatives of the field in both scenarios, but we can also use the data-driven PDEs to propagate the field in time and achieve results in good agreement with the original PDEs.


title: A characterization of finite simple set-theoretic solutions of the Yang-Baxter equation

abstract: In this paper we present a characterization of finite simple involutive non-degenerate set-theoretic solutions of the Yang-Baxter equation by means of left braces and we provide some significant examples.


title: Stacking-Mediated Diffusion of Ruthenium Nanoclusters in Graphite

abstract: The diffusion, penetration and intercalation of metallic atomic dopants is an important question for various graphite applications in engineering and nanotechnology. We have performed systematic first-principles calculations of the behaviour of ruthenium nanoclusters on a graphene monolayer and intercalated into a bilayer. Our computational results show that at a sufficiently high density of single Ru atom interstitials, intercalated atoms can shear the surrounding lattice to an AA stacking configuration, an effect which weakens with increasing cluster size. Moreover, the interlayer stacking configuration, in turn, has a significant effect on cluster diffusion. We therefore find different trends in diffusivity as a function of cluster size and interlayer stacking. For monolayer graphene and an AA graphene bilayer, the formation of small clusters generally lowers diffusion barriers, while the opposite behaviour is found for the preferred AB stacking configuration. These results demonstrate that conditions of local impurity concentration and interlayer disregistry are able to regulate the diffusivity of metallic impurities in graphite.


title: Atomistically-informed continuum modeling and isogeometric analysis of 2D materials over holey substrates

abstract: This work develops, discretizes, and validates a continuum model of a molybdenum disulfide (MoS$_2$) monolayer interacting with a periodic holey silicon nitride substrate via van der Waals (vdW) forces. The MoS$_2$ layer is modeled as a geometrically nonlinear Kirchhoff-Love shell, and vdW forces are modeled by a Lennard-Jones potential, simplified using approximations for a smooth substrate topography. The material parameters of the shell model are calibrated by comparing small-strain tensile and bending tests with atomistic simulations. This model is efficiently discretized using isogeometric analysis (IGA) for the shell structure and a pseudo-time continuation method for energy minimization. The IGA shell model is validated against fully-atomistic calculations for several benchmark problems with different substrate geometries. The continuum simulations reproduce deflections, strains and curvatures predicted by atomistic simulations, which are known to strongly affect the electronic properties of MoS$_2$, with deviations well below the modeling errors suggested by differences between the widely-used reactive empirical bond order and Stillinger-Weber interatomic potentials. Agreement with atomistic results depends on geometric nonlinearity in some cases, but a simple isotropic St. Venant-Kirchhoff model is found to be sufficient to represent material behavior. We find that the IGA discretization of the continuum model has a much lower computational cost than atomistic simulations, and expect that it will enable efficient design space exploration in strain engineering applications. This is demonstrated by studying the dependence of strain and curvature in MoS$_2$ over a holey substrate as a function of the hole spacing on scales inaccessible to atomistic calculations. The results show an unexpected qualitative change in the deformation pattern below a critical hole separation.


title: Kernel theorems for Beurling-Bj\"orck type spaces

abstract: We prove new kernel theorems for a general class of Beurling-Bj\"orck type spaces. In particular, our results cover the classical Beurling-Bj\"orck spaces $\mathcal{S}^{(\omega)}_{(\eta)}$ and $\mathcal{S}^{\{\omega\}}_{\{\eta\}}$ defined via weight functions $\omega$ and $\eta$.


title: Type-Directed Program Synthesis for RESTful APIs

abstract: With the rise of software-as-a-service and microservice architectures, RESTful APIs are now ubiquitous in mobile and web applications. A service can have tens or hundreds of API methods, making it a challenge for programmers to find the right combination of methods to solve their task. We present APIphany, a component-based synthesizer for programs that compose calls to RESTful APIs. The main innovation behind APIphany is the use of precise semantic types, both to specify user intent and to direct the search. APIphany contributes three novel mechanisms to overcome challenges in adapting component-based synthesis to the REST domain: (1) a type inference algorithm for augmenting REST specifications with semantic types; (2) an efficient synthesis technique for "wrangling" semi-structured data, which is commonly required in working with RESTful APIs; and (3) a new form of simulated execution to avoid executing APIs calls during synthesis. We evaluate APIphany on three real-world APIs and 32 tasks extracted from GitHub repositories and StackOverflow. In our experiments, APIphany found correct solutions to 29 tasks, with 23 of them reported among top ten synthesis results.


title: Majorana fermions as quanta of a superfluid vacuum

abstract: This short article on a thermodynamic signature of Majorana fermions confined on the surface of a 3D topological superfluid in the presence of a moving condensate was circulated to a limited audience in Fall 2013. Since recent experiments are looking at possible signatures of a gas of Majorana excitations confined in two dimensions on the surface of superfluid $^3$He-B it seems timely to post this earlier perspective to arXiv.


title: Excitation and Measurement Patterns for the Identifiability of Directed Acyclic Graphs

abstract: This paper deals with the design of Excitation and Measurement Patterns (EMP) for the identification of a class of dynamical networks whose topology has the structure of a Directed Acyclic Graph (DAG). In addition to the by now well known condition that the identifiabiltiy of any dynamical network requires that the sources be excited, the sinks be measured, and all other nodes be either excited or measured, we show that for DAGs two other types of nodes have special excitation and measurement requirements. Armed with this result, we propose a systematic procedure for the design of EMPs that guarantee identifiability of a network with DAG topology.


title: Can second-order perturbation theory accurately predict electron density of open-shell molecules? The importance of self-consistency

abstract: Electron density distribution plays an essential role in predicting molecular properties. It is also a simple observable from which machine-learning models for molecular electronic structure can be derived. In the present work, we present the performance of the one-body M{\o}ller-Plesset second-order perturbation (OBMP2) theory that we have recently developed. In OBMP2, an effective one-body Hamiltonian including dynamic correlation at the MP2 level is derived using the canonical transformation followed by the cumulant approximation. We evaluate electron density and related properties of three groups of open-shell systems: atoms and their ions, main-group radicals, and halogen dimmers. We find that OBMP2 outperforms standard MP2 and density functional theory in all cases considered here, and its accuracy is comparable to coupled-cluster singles and doubles (CCSD), a higher-level method. OBMP2 is thus believed to be an effective method for predicting the accurate electron density of open-shell molecules.


title: Towards Differential Relational Privacy and its use in Question Answering

abstract: Memorization of the relation between entities in a dataset can lead to privacy issues when using a trained model for question answering. We introduce Relational Memorization (RM) to understand, quantify and control this phenomenon. While bounding general memorization can have detrimental effects on the performance of a trained model, bounding RM does not prevent effective learning. The difference is most pronounced when the data distribution is long-tailed, with many queries having only few training examples: Impeding general memorization prevents effective learning, while impeding only relational memorization still allows learning general properties of the underlying concepts. We formalize the notion of Relational Privacy (RP) and, inspired by Differential Privacy (DP), we provide a possible definition of Differential Relational Privacy (DrP). These notions can be used to describe and compute bounds on the amount of RM in a trained model. We illustrate Relational Privacy concepts in experiments with large-scale models for Question Answering.


title: Weighted homomorphisms between C*-algebras

abstract: We show that a bounded, linear map between C*-algebras is a weighted $\ast$-homomorphism (the central compression of a $\ast$-homomorphism) if and only if it preserves zero-products, range-orthogonality, and domain-orthogonality. It follows that a self-adjoint, bounded, linear map is a weighted $\ast$-homomorphism if and only if it preserves zero-products. As an application we show that a linear map between C*-algebras is completely positive, order zero in the sense of Winter-Zacharias if and only if it is positive and preserves zero-products.


title: Probing highly collimated photon-jets with deep learning

abstract: Many extensions of the standard model (SM) predict the existence of axion-like particles and/or dark Higgs in the sub-GeV scale. Two new sub-GeV particles, a scalar and a pseudoscalar, produced through the Higgs boson exotic decays, are investigated. The decay signatures of these two new particles with highly collimated photons in the final states are discriminated from the ones of SM backgrounds using the Convolutional Neural Networks and Boosted Decision Trees techniques. The sensitivities of searching for such new physics signatures at the Large Hadron Collider are obtained.


title: Complexity factor of spherically anisotropic polytropes from gravitational decoupling

abstract: In this work we will analyse the complexity factor, proposed by L. Herrera, for spherically symmetric static matter distributions satisfying a polytropic equation through the gravitational decoupling method. Specifically, we will use the 2-step GD, which is a particular case of the extended geometric deformation (EGD), to obtain analytic polytropic solutions of Einstein's equations. In order to give an example, we construct a model satisfying a polytropic equation of state using Tolman IV as a seed solution.


title: Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversion

abstract: Traditional studies on voice conversion (VC) have made progress with parallel training data and known speakers. Good voice conversion quality is obtained by exploring better alignment modules or expressive mapping functions. In this study, we investigate zero-shot VC from a novel perspective of self-supervised disentangled speech representation learning. Specifically, we achieve the disentanglement by balancing the information flow between global speaker representation and time-varying content representation in a sequential variational autoencoder (VAE). A zero-shot voice conversion is performed by feeding an arbitrary speaker embedding and content embeddings to the VAE decoder. Besides that, an on-the-fly data augmentation training strategy is applied to make the learned representation noise invariant. On TIMIT and VCTK datasets, we achieve state-of-the-art performance on both objective evaluation, i.e., speaker verification (SV) on speaker embedding and content embedding, and subjective evaluation, i.e., voice naturalness and similarity, and remains to be robust even with noisy source/target utterances.


title: Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard

abstract: Incorporating artificial intelligence and machine learning (AI/ML) methods within the 5G wireless standard promises autonomous network behavior and ultra-low-latency reconfiguration. However, the effort so far has purely focused on learning from radio frequency (RF) signals. Future standards and next-generation (nextG) networks beyond 5G will have two significant evolutions over the state-of-the-art 5G implementations: (i) massive number of antenna elements, scaling up to hundreds-to-thousands in number, and (ii) inclusion of AI/ML in the critical path of the network reconfiguration process that can access sensor feeds from a variety of RF and non-RF sources. While the former allows unprecedented flexibility in 'beamforming', where signals combine constructively at a target receiver, the latter enables the network with enhanced situation awareness not captured by a single and isolated data modality. This survey presents a thorough analysis of the different approaches used for beamforming today, focusing on mmWave bands, and then proceeds to make a compelling case for considering non-RF sensor data from multiple modalities, such as LiDAR, Radar, GPS for increasing beamforming directional accuracy and reducing processing time. This so called idea of multimodal beamforming will require deep learning based fusion techniques, which will serve to augment the current RF-only and classical signal processing methods that do not scale well for massive antenna arrays. The survey describes relevant deep learning architectures for multimodal beamforming, identifies computational challenges and the role of edge computing in this process, dataset generation tools, and finally, lists open challenges that the community should tackle to realize this transformative vision of the future of beamforming.


title: Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits

abstract: Variational quantum algorithms stand at the forefront of simulations on near-term and future fault-tolerant quantum devices. While most variational quantum algorithms involve only continuous optimization variables, the representational power of the variational ansatz can sometimes be significantly enhanced by adding certain discrete optimization variables, as is exemplified by the generalized quantum approximate optimization algorithm (QAOA). However, the hybrid discrete-continuous optimization problem in the generalized QAOA poses a challenge to the optimization. We propose a new algorithm called MCTS-QAOA, which combines a Monte Carlo tree search method with an improved natural policy gradient solver to optimize the discrete and continuous variables in the quantum circuit, respectively. We find that MCTS-QAOA has excellent noise-resilience properties and outperforms prior algorithms in challenging instances of the generalized QAOA.

categories: quant-ph cond-mat.quant-gas cs.LG physics.comp-ph