title: Move Beyond Trajectories: Distribution Space Coupling for Crowd Navigation

abstract: Cooperatively avoiding collision is a critical functionality for robots navigating in dense human crowds, failure of which could lead to either overaggressive or overcautious behavior. A necessary condition for cooperative collision avoidance is to couple the prediction of the agents' trajectories with the planning of the robot's trajectory. However, it is unclear that trajectory based cooperative collision avoidance captures the correct agent attributes. In this work we migrate from trajectory based coupling to a formalism that couples agent preference distributions. In particular, we show that preference distributions (probability density functions representing agents' intentions) can capture higher order statistics of agent behaviors, such as willingness to cooperate. Thus, coupling in distribution space exploits more information about inter-agent cooperation than coupling in trajectory space. We thus introduce a general objective for coupled prediction and planning in distribution space, and propose an iterative best response optimization method based on variational analysis with guaranteed sufficient decrease. Based on this analysis, we develop a sampling-based motion planning framework called DistNav that runs in real time on a laptop CPU. We evaluate our approach on challenging scenarios from both real world datasets and simulation environments, and benchmark against a wide variety of model based and machine learning based approaches. The safety and efficiency statistics of our approach outperform all other models. Finally, we find that DistNav is competitive with human safety and efficiency performance.


title: Quantum compressed sensing of ultra-wideband radio-frequency signal

abstract: Real-time sensing of ultra-wideband radio-frequency signal with high frequency resolution is challenging, which is confined by the sampling rate of electronic analog-to-digital converter and the capability of digital signal processing. By combining quantum mechanics with compressed sensing, quantum compressed sensing is proposed for wideband radio-frequency signal frequency measurement. By using an electro-optical crystal as a sensor which modulates the wave function of the coherent photons with the signal to be measured. The frequency spectrum could be recovered by detecting the modulated sparse photons with a low time-jitter single-photon detector and a time-to-digital converter. More than 50 GHz real-time analysis bandwidth is demonstrated with the Fourier transform limit resolution. The further simulation shows it can be extended to more than 300 GHz with the present technologies.


title: Multi-player Multi-armed Bandits with Collision-Dependent Reward Distributions

abstract: We study a new stochastic multi-player multi-armed bandits (MP-MAB) problem, where the reward distribution changes if a collision occurs on the arm. Existing literature always assumes a zero reward for involved players if collision happens, but for applications such as cognitive radio, the more realistic scenario is that collision reduces the mean reward but not necessarily to zero. We focus on the more practical no-sensing setting where players do not perceive collisions directly, and propose the Error-Correction Collision Communication (EC3) algorithm that models implicit communication as a reliable communication over noisy channel problem, for which random coding error exponent is used to establish the optimal regret that no communication protocol can beat. Finally, optimizing the tradeoff between code length and decoding error rate leads to a regret that approaches the centralized MP-MAB regret, which represents a natural lower bound. Experiments with practical error-correction codes on both synthetic and real-world datasets demonstrate the superiority of EC3. In particular, the results show that the choice of coding schemes has a profound impact on the regret performance.


title: Sovereign wealth funds: main activity trends

abstract: Sovereign wealth funds are created in those countries whose budget is highly dependent on market factors, usually world commodity prices. At the same time, these funds are large institutional investors. An analysis of the nature of investments by the State Pension Fund Global of Norway showed that investments of the Fund are based on a seven-level model of diversifying its investments. This model can also be applied to the investments of the National Wealth Fund of Russia to increase its profitability.


title: Noise limits on two-photon interferometric sensing

abstract: When a photon interferes with itself while traversing a Mach-Zehnder inteferometer, the output port where it emerges is influenced by the phase difference between the interferometer arms. This allows for highly precise estimation of the path length difference (delay) but is extremely sensitive to phase noise. By contrast, a delay between the arms of the two-photon Hong-Ou-Mandel interferometer directly affects the relative indistinguishability of the photon pair, affecting the rate of recorded coincidences. This likewise allows for delay estimation; notably less precise but with the advantage of being less sensitive to perturbations of the photons' phase. Focusing on two-photon input states, we here investigate to what degree of noise Mach-Zehnder interferometry retains its edge over Hong-Ou-Mandel interferometry. We also explore the competing benefits of different two-photon inputs for a Mach-Zehnder interferometer, and under what parameter regimes each input performs best.


title: Exposing individual differences through network topology

abstract: Social animals, including humans, have a broad range of personality traits, which can be used to predict individual behavioral responses and decisions. Current methods to quantify individual personality traits in humans rely on self-report questionnaires, which require time and effort to collect and rely on active cooperation. However, personality differences naturally manifest in social interactions such as online social networks. Here, we demonstrate that the topology of an online social network can be used to characterize the personality traits of its members. We analyzed the directed social graph formed by the users of the LiveJournal (LJ) blogging platform. Individual users personality traits, inferred from their self-reported domains of interest (DOIs), were associated with their network measures. Empirical clustering of DOIs by topological similarity exposed two main self-emergent DOI groups that were in alignment with the personality meta-traits plasticity and stability. Closeness, a global topological measure of network centrality, was significantly higher for bloggers associated with plasticity (vs. stability). A local network motif (a triad of 3 connected bloggers) that correlated with closeness also separated the personality meta-traits. Finally, topology-based classification of DOIs (without analyzing the content of the blogs) attained > 70% accuracy (average AUC of the test-set). These results indicate that personality traits are evident and detectable in network topology. This has serious implications for user privacy. But, if used responsibly, network identification of personality traits could aid in early identification of health-related risks, at the population level.


title: Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy

abstract: Providing privacy protection has been one of the primary motivations of Federated Learning (FL). Recently, there has been a line of work on incorporating the formal privacy notion of differential privacy with FL. To guarantee the client-level differential privacy in FL algorithms, the clients' transmitted model updates have to be clipped before adding privacy noise. Such clipping operation is substantially different from its counterpart of gradient clipping in the centralized differentially private SGD and has not been well-understood. In this paper, we first empirically demonstrate that the clipped FedAvg can perform surprisingly well even with substantial data heterogeneity when training neural networks, which is partly because the clients' updates become similar for several popular deep architectures. Based on this key observation, we provide the convergence analysis of a differential private (DP) FedAvg algorithm and highlight the relationship between clipping bias and the distribution of the clients' updates. To the best of our knowledge, this is the first work that rigorously investigates theoretical and empirical issues regarding the clipping operation in FL algorithms.


title: A partial uniqueness result and an asymptotically sharp nonuniqueness result for the Zhikov problem on the torus

abstract: We consider the stationary diffusion equation $-\mathrm{div} (\nabla u + bu )=f$ in $n$-dimensional torus $\mathbb{T}^n$, where $f\in H^{-1}$ is a given forcing and $b\in L^p$ is a divergence-free drift. Zhikov (Funkts. Anal. Prilozhen., 2004) considered this equation in the case of a bounded, Lipschitz domain $\Omega \subset \mathbb{R}^n$, and proved existence of solutions for $b\in L^{2n/(n+2)}$, uniqueness for $b\in L^2$, and has provided a point-singularity counterexample that shows nonuniqueness for $b\in L^{3/2-}$ and $n=3,4,5$. We apply a duality method and a DiPerna-Lions-type estimate to show uniqueness of the solutions constructed by Zhikov for $b\in W^{1,1}$. We use a Nash iteration to demonstrate sharpness of this result, and also show that solutions in $H^1\cap L^{p/(p-1)}$ are flexible for $b\in L^p$, $p\in [1,2(n-1)/(n+1))$; namely we show that the set of $b\in L^p$ for which nonuniqueness in the class $H^1\cap L^{p/(p-1)}$ occurs is dense in the divergence-free subspace of $L^p$.


title: Creating and Implementing a Smart Speaker

abstract: We have seen significant advancements in Artificial Intelligence and Machine Learning in the 21st century. It has enabled a new technology where we can have a human-like conversation with the machines. The most significant use of this speech recognition and contextual understanding technology exists in the form of a Smart Speaker. We have a wide variety of Smart Speaker products available to us. This paper aims to decode its creation and explain the technology that makes these Speakers, "Smart."


title: Ultraviolet Line Profiles of Slowly Rotating Massive Star Winds Using the "Analytic Dynamical Magnetosphere" Formalism

abstract: Recent large-scale spectropolarimetric surveys have established that a small but significant percentage of massive stars host stable, surface dipolar magnetic fields with strengths on the order of kG. These fields channel the dense, radiatively driven stellar wind into circumstellar magnetospheres, whose density and velocity structure can be probed using ultraviolet (UV) spectroscopy of wind-sensitive resonance lines. Coupled with appropriate magnetosphere models, UV spectroscopy provides a valuable way to investigate the wind-field interaction, and can yield quantitative estimates of the wind parameters of magnetic massive stars. We report a systematic investigation of the formation of UV resonance lines in slowly rotating magnetic massive stars with dynamical magnetospheres. We pair the Analytic Dynamical Magnetosphere (ADM) formalism with a simplified radiative transfer technique to produce synthetic UV line profiles. Using a grid of models, we examine the effect of magnetosphere size, the line strength parameter, and the cooling parameter on the structure and modulation of the line profile. We find that magnetic massive stars uniquely exhibit redshifted absorption at most viewing angles and magnetosphere sizes, and that significant changes to the shape and variation of the line profile with varying line strengths can be explained by examining the individual wind components described in the ADM formalism. Finally, we show that the cooling parameter has a negligible effect on the line profiles.


title: The AMBRE Project: Solar neighbourhood chemodynamical constraints on Galactic disc evolution

abstract: We analysed the chemodynamical evolution of the Galactic disc using precise [Mg/Fe] abundances from a previous study and accurate Gaia data. For this purpose, we estimated ages and dynamical properties for 366 MSTO solar neighbourhood stars from the AMBRE Project using PARSEC isochrones together with astrometric and photometric values from Gaia DR2. We find a radial gradient of -0.099 ${\pm}$ 0.031 dex kpc$^{-1}$ for [M/H] and +0.023 ${\pm}$ 0.009 dex kpc for the [Mg/Fe] abundance. The steeper [Mg/Fe] gradient than that found in the literature is a result of the improvement of the AMBRE [Mg/Fe] estimates in the metal-rich regime. In addition, we find a significant spread of stellar age at any given [Mg/Fe] value, and observe a clear correlated dispersion of the [Mg/Fe] abundance with metallicity at a given age. While for [M/H] < -0.2, a clear age-[Mg/Fe] trend is observed, more metal-rich stars display ages from 3 up to 12 Gyr, describing an almost flat trend in the [Mg/Fe]-age relation. Moreover, we report the presence of radially migrated stars for a wide range of stellar ages, although we note the large uncertainties of the amplitude of the inferred change in orbital guiding radii. Finally, we observe the appearance of a second chemical sequence in the outer disc, 10-12 Gyr ago, populating the metal-poor, low-[Mg/Fe] tail. These stars are more metal-poor than the coexisting stellar population in the inner parts of the disc, and show lower [Mg/Fe] abundances than prior disc stars of the same metallicity, leading to a chemical discontinuity. Our data favour the rapid formation of an early disc that settled in the inner regions, followed by the accretion of external metal-poor gas -- probably related to a major accretion event such as the Gaia-Enceladus/Sausage one -- that may have triggered the formation of the thin disc population and steepened the abundance gradient in the early disc.


title: Long-Time Magnetic Relaxation in Antiferromagnetic Topological Material EuCd$_2$As$_2$

abstract: Magnetic topological materials have attracted much attention due to the correlation between topology and magnetism. Recent studies suggest that EuCd$_2$As$_2$ is an antiferromagnetic topological material. Here by carrying out thorough magnetic, electrical and thermodynamic property measurements, we discover a long time relaxation of the magnetic susceptibility in EuCd$_2$As$_2$. The (001) in-plane magnetic susceptibility at 5 K is found to continuously increase up to $\sim$10% over the time of $\sim$14 hours. The magnetic relaxation is anisotropic and strongly depends on the temperature and the applied magnetic field. These results will stimulate further theoretical and experimental studies to understand the origin of the relaxation process and its effect on the electronic structure and physical properties of the magnetic topological materials.


title: Shape registration in the time of transformers

abstract: In this paper, we propose a transformer-based procedure for the efficient registration of non-rigid 3D point clouds. The proposed approach is data-driven and adopts for the first time the transformer architecture in the registration task. Our method is general and applies to different settings. Given a fixed template with some desired properties (e.g. skinning weights or other animation cues), we can register raw acquired data to it, thereby transferring all the template properties to the input geometry. Alternatively, given a pair of shapes, our method can register the first onto the second (or vice-versa), obtaining a high-quality dense correspondence between the two. In both contexts, the quality of our results enables us to target real applications such as texture transfer and shape interpolation. Furthermore, we also show that including an estimation of the underlying density of the surface eases the learning process. By exploiting the potential of this architecture, we can train our model requiring only a sparse set of ground truth correspondences ($10\sim20\%$ of the total points). The proposed model and the analysis that we perform pave the way for future exploration of transformer-based architectures for registration and matching applications. Qualitative and quantitative evaluations demonstrate that our pipeline outperforms state-of-the-art methods for deformable and unordered 3D data registration on different datasets and scenarios.


title: Resolved and subgrid-scale crossing trajectory effects in Eulerian large eddy simulations of polydisperse droplet transport

abstract: We study the dispersion characteristics of slightly buoyant droplets in a turbulent jet using large eddy simulations (LES). The droplet number density fields are represented using an Eulerian approach with the dispersed phase modelled using the Fast-Eulerian method (Ferry & Balachandar 2001) that includes the droplet rise velocity. Radial concentration profiles and turbulent concentration fluxes for droplets of different sizes are analyzed to quantify the "trajectory crossing effect", when relative motions between particles and turbulent eddies tend to reduce turbulent diffusion. For finer LES grid resolutions, the model captures the differential, size based dispersion characteristics of the droplets with the transverse dispersion of the larger droplet sizes suppressed, since trajectory crossing effects are explicitly resolved in LES. We examine a similarity solution model for the size dependent radial concentration profiles based on a modified Schmidt number derived from the theory of turbulent diffusion of particles in the atmosphere proposed by Csanady 1963. The results are validated with the high resolution LES data and show good agreement. Then, the size dependent Schmidt number model is reformulated as a model for unresolved subgrid-scale trajectory crossing effects and used to calculate the subgrid concentration flux in a coarse LES of a turbulent jet, with slightly buoyant droplets injected at the centerline in the self-similar region of the jet. The results are compared to a simulation with higher grid resolution and a coarse simulation with a constant Schmidt number SGS model. We find that the subgrid model enhances the prediction accuracy of the concentration profiles and turbulent concentration flux for the coarse LES.


title: Robust Matrix Factorization with Grouping Effect

abstract: Although many techniques have been applied to matrix factorization (MF), they may not fully exploit the feature structure. In this paper, we incorporate the grouping effect into MF and propose a novel method called Robust Matrix Factorization with Grouping effect (GRMF). The grouping effect is a generalization of the sparsity effect, which conducts denoising by clustering similar values around multiple centers instead of just around 0. Compared with existing algorithms, the proposed GRMF can automatically learn the grouping structure and sparsity in MF without prior knowledge, by introducing a naturally adjustable non-convex regularization to achieve simultaneous sparsity and grouping effect. Specifically, GRMF uses an efficient alternating minimization framework to perform MF, in which the original non-convex problem is first converted into a convex problem through Difference-of-Convex (DC) programming, and then solved by Alternating Direction Method of Multipliers (ADMM). In addition, GRMF can be easily extended to the Non-negative Matrix Factorization (NMF) settings. Extensive experiments have been conducted using real-world data sets with outliers and contaminated noise, where the experimental results show that GRMF has promoted performance and robustness, compared to five benchmark algorithms.


title: Prediction of Hereditary Cancers Using Neural Networks

abstract: Family history is a major risk factor for many types of cancer. Mendelian risk prediction models translate family histories into cancer risk predictions based on knowledge of cancer susceptibility genes. These models are widely used in clinical practice to help identify high-risk individuals. Mendelian models leverage the entire family history, but they rely on many assumptions about cancer susceptibility genes that are either unrealistic or challenging to validate due to low mutation prevalence. Training more flexible models, such as neural networks, on large databases of pedigrees can potentially lead to accuracy gains. In this paper, we develop a framework to apply neural networks to family history data and investigate their ability to learn inherited susceptibility to cancer. While there is an extensive literature on neural networks and their state-of-the-art performance in many tasks, there is little work applying them to family history data. We propose adaptations of fully-connected neural networks and convolutional neural networks to pedigrees. In data simulated under Mendelian inheritance, we demonstrate that our proposed neural network models are able to achieve nearly optimal prediction performance. Moreover, when the observed family history includes misreported cancer diagnoses, neural networks are able to outperform the Mendelian BRCAPRO model embedding the correct inheritance laws. Using a large dataset of over 200,000 family histories, the Risk Service cohort, we train prediction models for future risk of breast cancer. We validate the models using data from the Cancer Genetics Network.


title: A proximal-proximal majorization-minimization algorithm for nonconvex tuning-free robust regression problems

abstract: In this paper, we introduce a proximal-proximal majorization-minimization (PPMM) algorithm for nonconvex tuning-free robust regression problems. The basic idea is to apply the proximal majorization-minimization algorithm to solve the nonconvex problem with the inner subproblems solved by a sparse semismooth Newton (SSN) method based proximal point algorithm (PPA). We must emphasize that the main difficulty in the design of the algorithm lies in how to overcome the singular difficulty of the inner subproblem. Furthermore, we also prove that the PPMM algorithm converges to a d-stationary point. Due to the Kurdyka-Lojasiewicz (KL) property of the problem, we present the convergence rate of the PPMM algorithm. Numerical experiments demonstrate that our proposed algorithm outperforms the existing state-of-the-art algorithms.

categories: math.OC cs.LG cs.NA math.NA stat.CO stat.ML


title: New constraints on tau-coupled Heavy Neutral Leptons with masses $m_N = 280-970$ MeV

abstract: A search for Heavy Neutral Leptons has been performed with the ArgoNeuT detector exposed to the NuMI neutrino beam at Fermilab. We search for the decay signature $N \to \nu \mu^+ \mu^-$, considering decays occurring both inside ArgoNeuT and in the upstream cavern. In the data, corresponding to an exposure to $1.25 \times 10^{20}$ POT, zero passing events are observed consistent with the expected background. This measurement leads to a new constraint at 90\% confidence level on the mixing angle $\left\vert U_{\tau N}\right\rvert^2$ of tau-coupled Dirac Heavy Neutral Leptons with masses $m_N =$ 280 - 970 MeV, assuming $\left\vert U_{eN}\right\rvert^2 = \left\vert U_{\mu N}\right\rvert^2 = 0$.


title: Feature Grouping and Sparse Principal Component Analysis with Truncated Regularization

abstract: In this paper, we consider a new variant for principal component analysis (PCA), aiming to capture the grouping and/or sparse structures of factor loadings simultaneously. To achieve these goals, we employ a non-convex truncated regularization with naturally adjustable sparsity and grouping effects, and propose the Feature Grouping and Sparse Principal Component Analysis (FGSPCA). The proposed FGSPCA method encourages the factor loadings with similar values to collapse into disjoint homogeneous groups for feature grouping or into a special zero-valued group for feature selection, which in turn helps reducing model complexity and increasing model interpretation. Usually, existing structured PCA methods require prior knowledge to construct the regularization term. However, the proposed FGSPCA can simultaneously capture the grouping and/or sparse structures of factor loadings without any prior information. To solve the resulting non-convex optimization problem, we propose an alternating algorithm that incorporates the difference-of-convex programming, augmented Lagrange method and coordinate descent method. Experimental results demonstrate the promising performance and efficiency of the new method on both synthetic and real-world datasets. An R implementation of FGSPCA can be found on github {https://github.com/higeeks/FGSPCA}.


title: Cross-Modal Knowledge Distillation Method for Automatic Cued Speech Recognition

abstract: Cued Speech (CS) is a visual communication system for the deaf or hearing impaired people. It combines lip movements with hand cues to obtain a complete phonetic repertoire. Current deep learning based methods on automatic CS recognition suffer from a common problem, which is the data scarcity. Until now, there are only two public single speaker datasets for French (238 sentences) and British English (97 sentences). In this work, we propose a cross-modal knowledge distillation method with teacher-student structure, which transfers audio speech information to CS to overcome the limited data problem. Firstly, we pretrain a teacher model for CS recognition with a large amount of open source audio speech data, and simultaneously pretrain the feature extractors for lips and hands using CS data. Then, we distill the knowledge from teacher model to the student model with frame-level and sequence-level distillation strategies. Importantly, for frame-level, we exploit multi-task learning to weigh losses automatically, to obtain the balance coefficient. Besides, we establish a five-speaker British English CS dataset for the first time. The proposed method is evaluated on French and British English CS datasets, showing superior CS recognition performance to the state-of-the-art (SOTA) by a large margin.


title: panda-gym: Open-source goal-conditioned environments for robotic learning

abstract: This paper presents panda-gym, a set of Reinforcement Learning (RL) environments for the Franka Emika Panda robot integrated with OpenAI Gym. Five tasks are included: reach, push, slide, pick & place and stack. They all follow a Multi-Goal RL framework, allowing to use goal-oriented RL algorithms. To foster open-research, we chose to use the open-source physics engine PyBullet. The implementation chosen for this package allows to define very easily new tasks or new robots. This paper also presents a baseline of results obtained with state-of-the-art model-free off-policy algorithms. panda-gym is open-source and freely available at https://github.com/qgallouedec/panda-gym.


title: Inelastic Neutron Scattering Analysis with Time-Dependent Gaussian-Field Models

abstract: Converting neutron scattering data to real-space time-dependent structures can only be achieved through suitable models, which is particularly challenging for geometrically disordered structures. We address this problem by introducing time-dependent clipped Gaussian field models. General expressions are derived for all space- and time-correlation functions relevant to coherent inelastic neutron scattering, for multiphase systems and arbitrary scattering contrasts. Various dynamic models are introduced that enable one to add time-dependence to any given spatial statistics, as captured e.g. by small-angle scattering. In a first approach, the Gaussian field is decomposed into localised waves that are allowed to fluctuate in time or to move, either ballistically or diffusively. In a second approach, a dispersion relation is used to make the spectral components of the field time-dependent. The various models lead to qualitatively different dynamics, which can be discriminated by neutron scattering. The methods of the paper are illustrated with oil/water microemulsion studied by small-angle scattering and neutron spin-echo. All available data - in both film and bulk contrasts, over the entire range of $q$ and $\tau$- are analyzed jointly with a single model. The analysis points to static large-scale structure of the oil and water domains, while the interfaces are subject to thermal fluctuations. The fluctuations have an amplitude around 6 nm and contribute to 30 % of the total interface area.


title: Semantic annotation for computational pathology: Multidisciplinary experience and best practice recommendations

abstract: Recent advances in whole slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence (AI) based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath) offers an integrated solution to utilize information embedded in pathology WSIs beyond what we obtain through visual assessment. For automated analysis of WSIs and validation of machine learning (ML) models, annotations at the slide, tissue and cellular levels are required. The annotation of important visual constructs in pathology images is an important component of CPath projects. Improper annotations can result in algorithms which are hard to interpret and can potentially produce inaccurate and inconsistent results. Despite the crucial role of annotations in CPath projects, there are no well-defined guidelines or best practices on how annotations should be carried out. In this paper, we address this shortcoming by presenting the experience and best practices acquired during the execution of a large-scale annotation exercise involving a multidisciplinary team of pathologists, ML experts and researchers as part of the Pathology image data Lake for Analytics, Knowledge and Education (PathLAKE) consortium. We present a real-world case study along with examples of different types of annotations, diagnostic algorithm, annotation data dictionary and annotation constructs. The analyses reported in this work highlight best practice recommendations that can be used as annotation guidelines over the lifecycle of a CPath project.


title: A Multilevel Method for Self-Concordant Minimization

abstract: The analysis of second-order optimization methods based either on sub-sampling, randomization or sketching has two serious shortcomings compared to the conventional Newton method. The first shortcoming is that the analysis of the iterates has only been shown to be scale-invariant only under specific assumptions on the problem structure. The second shortfall is that the fast convergence rates of second-order methods have only been established by making assumptions regarding the input data. In this paper, we propose a randomized Newton method for self-concordant functions to address both shortfalls. We propose a Self-concordant Iterative-minimization-Galerkin-based Multilevel Algorithm (SIGMA) and establish its super-linear convergence rate using the theory of self-concordant functions. Our analysis is based on the connections between multigrid optimization methods, and the role of coarse-grained or reduced-order models in the computation of search directions. We take advantage of the insights from theanalysis to significantly improve the performance of second-order methods in machine learning applications. We report encouraging initial experiments that suggest SIGMA outperforms other state-of-the-art sub-sampled/sketched Newton methods for both medium and large-scale problems.


title: Atomic-scale analysis of disorder by similarity learning from tunneling spectroscopy

abstract: Rapid proliferation of hyperspectral imaging in scanning probe microscopies creates unique opportunities to systematically capture and categorize higher dimensional datasets, toward new insights into electronic, mechanical and chemical properties of materials with nano- and atomic-scale resolution. Here we demonstrate similarity learning for tunneling spectroscopy acquired on superconducting material (FeSe) with sparse density of imperfections (Fe vacancies). Popular methods for unsupervised learning and discrete representation of the data in terms of clusters of characteristic behaviors were found to produce inconsistencies with respect to capturing the location and tunneling characteristics of the vacancy sites. To this end, we applied a more general, non-linear similarity learning. This approach was found to outperform several widely used methods for dimensionality reduction and produce a clear differentiation of the type of tunneling spectra. In particular, significant spectral weight transfer likely associated with the electronic reconstruction by the vacancy sites, is systematically captured, as is the spatial extent of the vacancy region. Given that a great variety of electronic materials will exhibit similarly smooth variation of the spectral responses due to random or engineered inhomogeneities in their structure, we believe our approach will be useful for systematic analysis of hyperspectral imaging with minimal prior knowledge, as well as prospective comparison of experimental measurements to theoretical calculations with explicit consideration of disorder.


title: Device-independent lower bounds on the conditional von Neumann entropy

abstract: The rates of several device-independent (DI) protocols, including quantum key-distribution (QKD) and randomness expansion (RE), can be computed via an optimization of the conditional von Neumann entropy over a particular class of quantum states. In this work we introduce a numerical method to compute lower bounds on such rates. We derive a sequence of optimization problems that converge to the conditional von Neumann entropy of systems defined on general separable Hilbert spaces. Using the Navascu\'es-Pironio-Ac\'in hierarchy we can then relax these problems to semidefinite programs, giving a computationally tractable method to compute lower bounds on the rates of DI protocols. Applying our method to compute the rates of DI-RE and DI-QKD protocols we find substantial improvements over all previous numerical techniques, demonstrating significantly higher rates for both DI-RE and DI-QKD. In particular, for DI-QKD we show a minimal detection efficiency threshold which is within the realm of current capabilities. Moreover, we demonstrate that our method is capable of converging rapidly by recovering all known tight analytical bounds up to several decimal places. Finally, we note that our method is compatible with the entropy accumulation theorem and can thus be used to compute rates of finite round protocols and subsequently prove their security.


title: Temporal Modes of Light in Satellite-to-Earth Quantum Communications

abstract: The photonic Temporal Mode (TM) represents a possible candidate for the delivery of viable multidimensional quantum communications. However, relative to other multidimensional quantum information carriers such as the Orbital Angular Momentum (OAM), the TM has received less attention. Moreover, in the context of the emerging quantum internet and satellite-based quantum communications, the TM has received no attention. In this work, we remedy this situation by considering the traversal through the satellite-to-Earth channel of single photons encoded in TM space. Our results indicate that for anticipated atmospheric conditions the photonic TM offers a promising avenue for the delivery of high-throughput quantum communications from a satellite to a terrestrial receiver. In particular, we show how these modes can provide for improved multiplexing performance and superior quantum key distribution in the satellite-to-Earth channel, relative to OAM single-photon states. The levels of TM discrimination that guarantee this outcome are outlined and implications of our results for the emerging satellite-based quantum internet are discussed.

categories: quant-ph cs.CR cs.IT math.IT physics.optics


title: Posterior Covariance Information Criterion for Weighted Inference

abstract: For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC. PCIC generalises the widely applicable information criterion WAIC so as to effectively handle predictive scenarios where likelihoods for the estimation and the evaluation of the model may be different. A typical example of such scenarios is the weighted likelihood inference, including prediction under covariate shift and counterfactual prediction. The proposed criterion utilises a posterior covariance form and is computed by using only one Markov chain Monte Carlo run. Through numerical examples, we demonstrate how PCIC can apply in practice. Further, we show that PCIC is asymptotically unbiased to the quasi-Bayesian generalization error under mild conditions in weighted inference with both regular and singular statistical models.


title: CADDA: Class-wise Automatic Differentiable Data Augmentation for EEG Signals

abstract: Data augmentation is a key element of deep learning pipelines, as it informs the network during training about transformations of the input data that keep the label unchanged. Manually finding adequate augmentation methods and parameters for a given pipeline is however rapidly cumbersome. In particular, while intuition can guide this decision for images, the design and choice of augmentation policies remains unclear for more complex types of data, such as neuroscience signals. Besides, class-dependent augmentation strategies have been surprisingly unexplored in the literature, although it is quite intuitive: changing the color of a car image does not change the object class to be predicted, but doing the same to the picture of an orange does. This paper investigates gradient-based automatic data augmentation algorithms amenable to class-wise policies with exponentially larger search spaces. Motivated by supervised learning applications using EEG signals for which good augmentation policies are mostly unknown, we propose a new differentiable relaxation of the problem. In the class-agnostic setting, results show that our new relaxation leads to optimal performance with faster training than competing gradient-based methods, while also outperforming gradient-free methods in the class-wise setting. This work proposes also novel differentiable augmentation operations relevant for sleep stage classification.


title: Image-to-image Transformation with Auxiliary Condition

abstract: The performance of image recognition like human pose detection, trained with simulated images would usually get worse due to the divergence between real and simulated data. To make the distribution of a simulated image close to that of real one, there are several works applying GAN-based image-to-image transformation methods, e.g., SimGAN and CycleGAN. However, these methods would not be sensitive enough to the various change in pose and shape of subjects, especially when the training data are imbalanced, e.g., some particular poses and shapes are minor in the training data. To overcome this problem, we propose to introduce the label information of subjects, e.g., pose and type of objects in the training of CycleGAN, and lead it to obtain label-wise transforamtion models. We evaluate our proposed method called Label-CycleGAN, through experiments on the digit image transformation from SVHN to MNIST and the surveillance camera image transformation from simulated to real images.


title: Active Learning in Robotics: A Review of Control Principles

abstract: Active learning is a decision-making process. In both abstract and physical settings, active learning demands both analysis and action. This is a review of active learning in robotics, focusing on methods amenable to the demands of embodied learning systems. Robots must be able to learn efficiently and flexibly through continuous online deployment. This poses a distinct set of control-oriented challenges -- one must choose suitable measures as objectives, synthesize real-time control, and produce analyses that guarantee performance and safety with limited knowledge of the environment or robot itself. In this work, we survey the fundamental components of robotic active learning systems. We discuss classes of learning tasks that robots typically encounter, measures with which they gauge the information content of observations, and algorithms for generating action plans. Moreover, we provide a variety of examples -- from environmental mapping to nonparametric shape estimation -- that highlight the qualitative differences between learning tasks, information measures, and control techniques. We conclude with a discussion of control-oriented open challenges, including safety-constrained learning and distributed learning.


title: Generic identifiability of pairs of ternary forms

abstract: We prove that two general ternary forms are simultaneously identifiable only in the classical cases of two quadratic and a cubic and a quadratic form. We translate the problem into the study of a certain linear system on a projective bundle on the plane, and we apply techniques from projective and birational geometry to prove that the associated map is not birational.


title: Fast rotation limit for the 2-D non-homogeneous incompressible Euler equations

abstract: In the present paper, we study the fast rotation limit for the density-dependent incompressible Euler equations in two space dimensions with the presence of the Coriolis force. In the case when the initial densities are small perturbation of a constant profile, we show the convergence of solutions towards the solutions of a quasi-homogeneous incompressible Euler system. The proof relies on a combination of uniform estimates in high regularity norms with a compensated compactness argument for passing to the limit. This technique allows us to treat the case of ill-prepared initial data.


title: ViTAS: Vision Transformer Architecture Search

abstract: Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via the widely used neural architecture search (NAS) in CNNs. However, we empirically find this straightforward adaptation would encounter catastrophic failures and be frustratingly unstable for the training of superformer. In this paper, we argue that since ViTs mainly operate on token embeddings with little inductive bias, imbalance of channels for different architectures would worsen the weight-sharing assumption and cause the training instability as a result. Therefore, we develop a new cyclic weight-sharing mechanism for token embeddings of the ViTs, which enables each channel could more evenly contribute to all candidate architectures. Besides, we also propose identity shifting to alleviate the many-to-one issue in superformer and leverage weak augmentation and regularization techniques for more steady training empirically. Based on these, our proposed method, ViTAS, has achieved significant superiority in both DeiT- and Twins-based ViTs. For example, with only $1.4$G FLOPs budget, our searched architecture has $3.3\%$ ImageNet-$1$k accuracy than the baseline DeiT. With $3.0$G FLOPs, our results achieve $82.0\%$ accuracy on ImageNet-$1$k, and $45.9\%$ mAP on COCO$2017$ which is $2.4\%$ superior than other ViTs.


title: Feasibility Study and Perspectives of proton Dielectric Laser Accelerators (p-DLA): from nanosource to accelerator scheme

abstract: In this paper we discuss the possibility to generate and accelerate proton nanobeams in fully dielectric laser-driven accelerators (p-DLAs). High gradient on-chip optical-power dielectric laser accelerators (DLAs) could represent one of the most promising way towards future miniaturized particle accelerator. A primary challenge for DLAs are small beam apertures having a size of the order of the driving laser wavelength where low charge high-repetition (or also CW) ultralow emittance nanobeams have to be transported. For electrons beams generation and acceleration, intense research activities are ongoing, and several demonstrations have been already obtained by using electrons nanotip (or flat photocathode) sources feeding dielectric microstructures. In this article we aim at the possibility to integrate a nanosource for the generation of a light ion or proton nano-beams suitable for the subsequent acceleration into sub-relativistic (low-beta) p-DLA stages. Such integration includes the idea to use a proton dielectric radiofrequency quadrupole (p-DRFQ) for bridging the gap between the accelerator front-end and the drift-tube and high-beta sections. The paper has been prepared as a white book including state-of-art technologies and new solutions that now put the ambitious frontier of a fully nanostructured proton accelerator into reach. Conceptual studies of p-DLAs here presented could enable table-top proton nano-beams for several applications: proton beam writing, nuclear reaction analysis at sub-micrometer scales, the construction of miniaturized Proton-Boron Nuclear Fusion based Reactors, biological analysis at the micrometer scale, ion beam analysis at the sub-cellular level, mini-beams ion therapy to spare the shallow tissues, proton irradiation of transistors, compact proton linac for neutron generation.


title: Perturbed primal-dual dynamics with damping and time scaling coefficients for affine constrained convex optimization problems

abstract: In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several damping coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing the energy functions, we investigate the convergence rates with different choices of the damping coefficients and time scaling coefficients. Our results extend the inertial dynamical approaches for unconstrained convex optimization problems to affine constrained convex optimization problems.


title: Task-Driven Detection of Distribution Shifts with Statistical Guarantees for Robot Learning

abstract: Our goal is to perform out-of-distribution (OOD) detection, i.e., to detect when a robot is operating in environments drawn from a different distribution than the ones used to train the robot. We leverage Probably Approximately Correct (PAC)-Bayes theory to train a policy with a guaranteed bound on performance on the training distribution. Our idea for OOD detection relies on the following intuition: violation of the performance bound on test environments provides evidence that the robot is operating OOD. We formalize this via statistical techniques based on p-values and concentration inequalities. The approach provides guaranteed confidence bounds on OOD detection including bounds on both the false positive and false negative rates of the detector and is task-driven and only sensitive to changes that impact the robot's performance. We demonstrate our approach in simulation and hardware for a grasping task using objects with unfamiliar shapes or poses and a drone performing vision-based obstacle avoidance in environments with wind disturbances and varied obstacle densities. Our examples demonstrate that we can perform task-driven OOD detection within just a handful of trials.


title: Strongly Minimal Steiner Systems II: Coordinatization and Quasigroups

abstract: We note that a strongly minimal Steiner $k$-Steiner system $(M,R)$ from (Baldwin-Paolini 2020) can be `coordinatized' in the sense of (Gantner-Werner 1975) by a quasigroup if $k$ is a prime-power. But for the basic construction this coordinatization is never definable in $(M,R)$. Nevertheless, by refining the construction, if $k$ is a prime power there is a $(2,k)$-variety of quasigroups which is strongly minimal and definably coordinatizes a Steiner $k$-system.


title: Quantum Optimal Control of Nuclear Spin Qudecimals in $^{87}\text{Sr}$

abstract: We study the ability to implement unitary maps on states of the $I=9/2$ nuclear spin in \textsuperscript{87}Sr, a $d=10$ dimensional (qudecimal) Hilbert space, using quantum optimal control. Through a combination of nuclear spin-resonance and a tensor AC-Stark shift, by solely modulating the phase of a radio-frequency magnetic field, the system is quantum controllable. Alkaline earth atoms, such as \textsuperscript{87}Sr, have a very favorable figure-of-merit for such control due to narrow intercombination lines and the large hyperfine splitting in the excited states. We numerically study the quantum speed-limit, optimal parameters, and the fidelity of arbitrary state preparation and full SU(10) maps, including the presence of decoherence due to optical pumping induced by the light-shifting laser. We also study the use of robust control to mitigate some dephasing due to inhomogeneities in the light shift. We find that with an rf-Rabi frequency of $\Omega_\text{rf}$ and 0.5\% inhomogeneity in the the light shift we can prepare an arbitrary Haar-random state in a time $T={4.5}\pi/\Omega_\text{rf}$ with average fidelity $\langle \mathcal{F}_\psi \rangle =0.9992$, and an arbitrary Haar-random SU(10) map in a time $T=24\pi/\Omega_\text{rf}$ with average fidelity $\langle \mathcal{F}_U \rangle = 0.9923$.


title: Accelerated Computation of a High Dimensional Kolmogorov-Smirnov Distance

abstract: Statistical testing is widespread and critical for a variety of scientific disciplines. The advent of machine learning and the increase of computing power has increased the interest in the analysis and statistical testing of multidimensional data. We extend the powerful Kolmogorov-Smirnov two sample test to a high dimensional form in a similar manner to Fasano (Fasano, 1987). We call our result the d-dimensional Kolmogorov-Smirnov test (ddKS) and provide three novel contributions therewith: we develop an analytical equation for the significance of a given ddKS score, we provide an algorithm for computation of ddKS on modern computing hardware that is of constant time complexity for small sample sizes and dimensions, and we provide two approximate calculations of ddKS: one that reduces the time complexity to linear at larger sample sizes, and another that reduces the time complexity to linear with increasing dimension. We perform power analysis of ddKS and its approximations on a corpus of datasets and compare to other common high dimensional two sample tests and distances: Hotelling's T^2 test and Kullback-Leibler divergence. Our ddKS test performs well for all datasets, dimensions, and sizes tested, whereas the other tests and distances fail to reject the null hypothesis on at least one dataset. We therefore conclude that ddKS is a powerful multidimensional two sample test for general use, and can be calculated in a fast and efficient manner using our parallel or approximate methods. Open source implementations of all methods described in this work are located at https://github.com/pnnl/ddks.


title: A Fast Graph Kernel Based Classification Method for Wireless Link Scheduling on Riemannian Manifold

abstract: In this paper, we propose a novel graph kernel method for the wireless link scheduling problem in device-to-device (D2D) networks on Riemannian manifold. The link scheduling problem can be considered as a binary classification problem since each D2D pair can only hold the state active or inactive. Our goal is to learn a novel metric that facilitates the design of an efficient but less computationally demanding machine learning (ML) solution for the binary classification task of link scheduling problem that requires no channel state information (CSI) and a fewer number of training samples as opposed to other benchmark ML algorithms. To this aim, we first represent the wireless D2D network as a graph and model the features of each D2D pair, including its communication and interference links, as regularized (i.e., positively-shifted) Laplacian matrices which are symmetric positive definite (SPD) one. By doing so, we represent the feature information of each D2D pair as a point on the SPD manifold, and we analyze the topology through Riemannian geometry. We compute the Riemannian metric, e.g., Log-Euclidean metric (LEM), which are suitable distance measures between the regularized Laplacian matrices. The LEM is then utilized to define a positive definite graph kernel for the binary classification of the link scheduling decisions. Simulation results demonstrate that the proposed graph Kernel-based method is computationally less demanding and achieves a sum rate of more than 95% of benchmark algorithm FPLinQ [1] for 10 D2D pairs without using CSI and less than a hundred training network layouts.


title: Worldlines and social networks

abstract: Familiar laws of physics are applied to study human relations, modelled by their world lines (worldlines, WLs) combined with social networks. We focus upon the simplest, basic element of any society: a married couple, stable due to the dynamic balance between attraction and repulsion. By building worldlines/worldsheets, we arrive at a two-level coordinate systems: one describing the behaviour of a string-like binary system (here, a married couple), the other one, external, corresponding to the motion of this couple in the medium, in which the worldline is embedded, sweeping there a string-like sheet or brane. The approach is illustrated by simple examples (semi-quantitative toy models) of worldlines/sheets, open to further extension, perfections and generalization. World lines (WLs) are combined with social networks (SN). Our innovation is in the application of basic physical laws, attraction and repulsion to human behaviour. Simple illustrative examples with empirical inputs taken from intuition and/or observation are appended. This is an initial attempt, open to unlimited applications.


title: A constructive theory of shape

abstract: We formulate a theory of shape valid for objects of arbitrary dimension whose contours are path connected. We apply this theory to the design and modeling of viable trajectories of complex dynamical systems. Infinite families of qualitatively similar shapes are constructed giving as input a finite ordered set of characteristic points (landmarks) and the value of a continuous parameter $\kappa \in (0,\infty)$. We prove that all shapes belonging to the same family are located within the convex hull of the landmarks. The theory is constructive in the sense that it provides a systematic means to build a mathematical model for any shape taken from the physical world. We illustrate this with a variety of examples: (chaotic) time series, plane curves, space filling curves, knots and strange attractors.


title: L, Q, R, and T -- Which Spin Bit Cousin Is Here to Stay?

abstract: Network operators utilize traffic monitoring to locate and fix faults or performance bottlenecks. This often relies on intrinsic protocol semantics, e.g., sequence numbers, that many protocols share implicitly through their packet headers. The arrival of (almost) fully encrypted transport protocols, such as QUIC, significantly complicates this monitoring as header data is no longer visible to passive observers. Recognizing this challenge, QUIC offers explicit measurement semantics by exposing the spin bit to measure a flow's RTT. Ongoing efforts in the IETF IPPM working group argue to expose further information and enable the passive quantification of packet loss. This work implements and evaluates four currently proposed measurement techniques (L-, Q-, R-, and T-bit). We find that all techniques generally provide accurate loss estimations, but that longer algorithmic intervals for Q and R, yet foremost for T, complicate detecting very small loss rates or loss on short connections. Deployment combinations of Q & R as well as Q & L, thus, have the best potential for accurately grasping the loss in networks.


title: Multimodal Emergent Fake News Detection via Meta Neural Process Networks

abstract: Fake news travels at unprecedented speeds, reaches global audiences and puts users and communities at great risk via social media platforms. Deep learning based models show good performance when trained on large amounts of labeled data on events of interest, whereas the performance of models tends to degrade on other events due to domain shift. Therefore, significant challenges are posed for existing detection approaches to detect fake news on emergent events, where large-scale labeled datasets are difficult to obtain. Moreover, adding the knowledge from newly emergent events requires to build a new model from scratch or continue to fine-tune the model, which can be challenging, expensive, and unrealistic for real-world settings. In order to address those challenges, we propose an end-to-end fake news detection framework named MetaFEND, which is able to learn quickly to detect fake news on emergent events with a few verified posts. Specifically, the proposed model integrates meta-learning and neural process methods together to enjoy the benefits of these approaches. In particular, a label embedding module and a hard attention mechanism are proposed to enhance the effectiveness by handling categorical information and trimming irrelevant posts. Extensive experiments are conducted on multimedia datasets collected from Twitter and Weibo. The experimental results show our proposed MetaFEND model can detect fake news on never-seen events effectively and outperform the state-of-the-art methods.


title: Cybersecurity Challenges in Distributed Control

abstract: Cyber-physical systems are becoming core of the most modern systems consisting control, data sharing and real-time monitoring. While centralized control technique has been implemented in the past, recent innovation in distributed control schemes makes it attractive due to various reasons. One of them is the use of state-of-the-art communication protocols that makes the system more robust toward extreme conditions and ensures observability. Thus, as an application of cyber-physical systems, distributed control architectures are prone to various cyber-vulnerability which makes cybersecurity research critical in this application domain. This paper reviews recent researches of distributed control architectures, their cyber-vulnerabilities, and reported mitigation schemes. Finally, some research needs are addressed.


title: The Numerical Unified Transform Method for the Nonlinear Schr\"odinger equation on the half-line

abstract: We implement the Numerical Unified Transform Method to solve the Nonlinear Schr\"odinger equation on the half-line. For so-called linearizable boundary conditions, the method solves the half-line problems with comparable complexity as the Numerical Inverse Scattering Transform solves whole-line problems. In particular, the method computes the solution at any $x$ and $t$ without spatial discretization or time stepping. Contour deformations based on the method of nonlinear steepest descent are used so that the method's computational cost does not increase for large $x,t$ and the method is more accurate as $x,t$ increase. Our ideas also apply to some cases where the boundary conditions are not linearizable.


title: Time Reversal of the Overdamped Langevin Equation and Fixman's Law

abstract: We discuss how the first order Langevin equation for the overdamped dynamics of an interacting system has a natural time reversal of simple but surprising form, with consequences for correlation functions. This leads to the correlation of interactions as a strictly restraining term in the time-dependent diffusion tensor of the system, deriving the relation first suggested by Fixman. Applying this to the time-dependent diffusion of dilute polymer coils leads to the quantitative calibration of Kirkwood's approximation for their hydrodynamic radius. We find the generalized ``Fixman Law" for dissipation with a memory kernel, which has revealing causal structure, and we also discuss the case of the second order Langevin Equation.


title: Learning to Sample Replacements for ELECTRA Pre-Training

abstract: ELECTRA pretrains a discriminator to detect replaced tokens, where the replacements are sampled from a generator trained with masked language modeling. Despite the compelling performance, ELECTRA suffers from the following two issues. First, there is no direct feedback loop from discriminator to generator, which renders replacement sampling inefficient. Second, the generator's prediction tends to be over-confident along with training, making replacements biased to correct tokens. In this paper, we propose two methods to improve replacement sampling for ELECTRA pre-training. Specifically, we augment sampling with a hardness prediction mechanism, so that the generator can encourage the discriminator to learn what it has not acquired. We also prove that efficient sampling reduces the training variance of the discriminator. Moreover, we propose to use a focal loss for the generator in order to relieve oversampling of correct tokens as replacements. Experimental results show that our method improves ELECTRA pre-training on various downstream tasks.


title: Non-K\"ahler Calabi-Yau geometry and pluriclosed flow

abstract: Hermitian, pluriclosed metrics with vanishing Bismut-Ricci form give a natural extension of Calabi-Yau metrics to the setting of complex, non-K\"ahler manifolds, and arise independently in mathematical physics. We reinterpret this condition in terms of the Hermitian-Einstein equation on an associated holomorphic Courant algebroid, and thus refer to solutions as Bismut Hermitian-Einstein. This implies Mumford-Takemoto slope stability obstructions, and using these we exhibit infinitely many topologically distinct complex manifolds in every dimension with vanishing first Chern class which do not admit Bismut Hermitian-Einstein metrics. This reformulation also leads to a new description of pluriclosed flow in terms of Hermitian metrics on holomorphic Courant algebroids, implying new global existence results, in particular on all complex non-K\"ahler surfaces of nonnegative Kodaira dimension. On complex manifolds which admit Bismut-flat metrics we show global existence and convergence of pluriclosed flow to a Bismut-flat metric, which in turn gives a classification of generalized K\"ahler structures on these spaces.


title: Optimizing Rayleigh quotient with symmetric constraints and their applications to perturbations of the structured polynomial eigenvalue problem

abstract: For a Hermitian matrix $H \in \mathbb C^{n,n}$ and symmetric matrices $S_0, S_1,\ldots,S_k \in \mathbb C^{n,n}$, we consider the problem of computing the supremum of $\left\{ \frac{v^*Hv}{v^*v}:~v\in \mathbb C^{n}\setminus \{0\},\,v^TS_iv=0~\text{for}~i=0,\ldots,k\right\}$. For this, we derive an estimation in the form of minimizing the second largest eigenvalue of a parameter depending Hermitian matrix, which is exact when the eigenvalue at the optimal is simple. The results are then applied to compute the eigenvalue backward errors of higher degree matrix polynomials with T-palindromic, T-antipalindromic, T-even, T-odd, and skew-symmetric structures. The results are illustrated by numerical experiments.


title: Black Box Probabilistic Numerics

abstract: Probabilistic numerics casts numerical tasks, such the numerical solution of differential equations, as inference problems to be solved. One approach is to model the unknown quantity of interest as a random variable, and to constrain this variable using data generated during the course of a traditional numerical method. However, data may be nonlinearly related to the quantity of interest, rendering the proper conditioning of random variables difficult and limiting the range of numerical tasks that can be addressed. Instead, this paper proposes to construct probabilistic numerical methods based only on the final output from a traditional method. A convergent sequence of approximations to the quantity of interest constitute a dataset, from which the limiting quantity of interest can be extrapolated, in a probabilistic analogue of Richardson's deferred approach to the limit. This black box approach (1) massively expands the range of tasks to which probabilistic numerics can be applied, (2) inherits the features and performance of state-of-the-art numerical methods, and (3) enables provably higher orders of convergence to be achieved. Applications are presented for nonlinear ordinary and partial differential equations, as well as for eigenvalue problems-a setting for which no probabilistic numerical methods have yet been developed.


title: Reionization Era Bright Emission Line Survey: Selection and Characterization of Luminous Interstellar Medium Reservoirs in the z>6.5 Universe

abstract: The Reionization Era Bright Emission Line Survey (REBELS) is a cycle-7 ALMA Large Program (LP) that is identifying and performing a first characterization of many of the most luminous star-forming galaxies known in the z>6.5 universe. REBELS is providing this probe by systematically scanning 40 of the brightest UV-selected galaxies identified over a 7-deg**2 area for bright 158-micron [CII] and 88-micron [OIII] lines and dust-continuum emission. Selection of the 40 REBELS targets was done by combining our own and other photometric selections, each of which is subject to extensive vetting using three completely independent sets of photometry and template-fitting codes. Building on the observational strategy deployed in two pilot programs, we are increasing the number of massive interstellar medium (ISM) reservoirs known at z>6.5 by ~4-5x to >30. In this manuscript, we motivate the observational strategy deployed in the REBELS program and present initial results. Based on the 60.6 hours of ALMA observations taken in the first year of the program (November 2019 to January 2020), 18 highly significant >~7sigma [CII] lines have already been discovered, the bulk of which (13/18) also show >~3.3 sigma dust-continuum emission. These newly discovered lines more than triple the number of bright ISM-cooling lines known in the z>6.5 universe, such that the number of ALMA-derived redshifts at z>6.5 already rival Lya redshift discoveries. An analysis of the completeness of our search results vs. star formation rate (SFR) suggests an ~79% efficiency in scanning for [CII] when the SFR(UV+IR) is in excess of 28 M_sol/yr. These new LP results further demonstrate ALMA's efficiency as a "redshift machine", particularly in the epoch of reionization.


title: The electron mass shift in an intense plane wave

abstract: Upcoming experiments on the interaction of electrons with intense laser fields are envisaged to become more and more accurate, which calls for theoretical computations of rates and probabilities with correspondingly higher precision. In strong-field QED this requires the knowledge of radiative corrections to be added to leading-order results. Here, we first derive the mass operator in momentum space of an off-shell electron in the presence of an arbitrary plane wave. By taking the average of the mass operator in momentum space over an on-shell electron state, we obtain a new representation, equivalent to but more compact than the known one computed in [Sov. Phys. JETP \textbf{42}, 400 (1975)]. Moreover, we use the obtained mass operator to determine the electron mass shift in an arbitrary plane wave, which generalizes the already known expression in a constant crossed field. The spin-dependent part of the electron mass shift can be related to the anomalous magnetic moment of the electron in the plane wave. We show that within the locally constant field approximation it is possible to conveniently define a local expression of the electron anomalous magnetic moment, which reduces to the known expression in a constant crossed field. Beyond the locally constant field approximation, however, the interaction between the electron and the plane wave is non-local such that it is not possible to conveniently introduce an electron anomalous magnetic moment.


title: SDP-quality bounds via convex quadratic relaxations for global optimization of mixed-integer quadratic programs

abstract: We consider the global optimization of nonconvex mixed-integer quadratic programs with linear equality constraints. In particular, we present a new class of convex quadratic relaxations which are derived via quadratic cuts. To construct these quadratic cuts, we solve a separation problem involving a linear matrix inequality with a special structure that allows the use of specialized solution algorithms. Our quadratic cuts are nonconvex, but define a convex feasible set when intersected with the equality constraints. We show that our relaxations are an outer-approximation of a semi-infinite convex program which under certain conditions is equivalent to a well-known semidefinite program relaxation. The new relaxations are implemented in the global optimization solver BARON, and tested by conducting numerical experiments on a large collection of problems. Results demonstrate that, for our test problems, these relaxations lead to a significant improvement in the performance of BARON.


title: A Curiously Effective Backtracking Strategy for Connection Tableaux

abstract: Automated proof search with connection tableaux, such as implemented by Otten's leanCoP prover, depends on backtracking for completeness. Otten's restricted backtracking strategy loses completeness, yet for many problems, it significantly reduces the time required to find a proof. I introduce a new, less restricted backtracking strategy based on the notion of exclusive cuts. I implement the strategy in a new prover called meanCoP and show that it greatly improves upon the previous best strategy in leanCoP.


title: Scale-invariant multilevel Monte Carlo method and application to linear elasticity

abstract: We propose a novel scale-invariant version of the mean and variance multi-level Monte Carlo estimate. The computation cost across grid levels is optimised using a normalized error based on t-statistics. By doing so, the algorithm achieves convergence independent of the physical scale at which the estimate is computed. The effectiveness of this algorithm is demonstrated through testing on a linear elastic example, where material uncertainty incorporating both heterogeneity and anisotropy is considered in the constitutive law.


title: Primordial non-Gaussianity from the Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey I: Catalogue Preparation and Systematic Mitigation

abstract: We investigate the large-scale clustering of the final spectroscopic sample of quasars from the recently completed extended Baryon Oscillation Spectroscopic Survey (eBOSS). The sample contains $343708$ objects in the redshift range $0.8<z<2.2$ and $72667$ objects with redshifts $2.2<z<3.5$, covering an effective area of $4699~{\rm deg}^{2}$. We develop a neural network-based approach to mitigate spurious fluctuations in the density field caused by spatial variations in the quality of the imaging data used to select targets for follow-up spectroscopy. Simulations are used with the same angular and radial distributions as the real data to estimate covariance matrices, perform error analyses, and assess residual systematic uncertainties. We measure the mean density contrast and cross-correlations of the eBOSS quasars against maps of potential sources of imaging systematics to address algorithm effectiveness, finding that the neural network-based approach outperforms standard linear regression. Stellar density is one of the most important sources of spurious fluctuations, and a new template constructed using data from the Gaia spacecraft provides the best match to the observed quasar clustering. The end-product from this work is a new value-added quasar catalogue with the improved weights to correct for nonlinear imaging systematic effects, which will be made public. Our quasar catalogue is used to measure the local-type primordial non-Gaussianity in our companion paper, Mueller et al. in preparation.

categories: astro-ph.CO cs.LG physics.comp-ph physics.data-an


title: The clustering of galaxies in the completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Primordial non-Gaussianity in Fourier Space

abstract: We present measurements of the local primordial non-Gaussianity parameter \fNLloc from the clustering of 343,708 quasars with redshifts 0.8 < z < 2.2 distributed over 4808 square degrees from the final data release (DR16) of the extended Baryon acoustic Oscillation Spectroscopic Survey (eBOSS), the largest volume spectroscopic survey up to date. Our analysis is performed in Fourier space, using the power spectrum monopole at very large scales to constrain the scale dependent halo bias. We carefully assess the impact of systematics on our measurement and test multiple contamination removal methods. We demonstrate the robustness of our analysis pipeline with EZ-mock catalogues that simulate the eBOSS DR16 target selection. We find $f_\mathrm{NL}=-12\pm 21$ (68\% confidence) for the main clustering sample including quasars with redshifts between 0.8 and 2.2, after exploiting a novel neural network scheme for cleaning the DR16 sample and in particular after applying redshift weighting techniques, designed for non-Gaussianity measurement from large scales structure, to optimize our analysis, which improve our results by 37\%.


title: On second order q-difference equations for high-order Sobolev-type q-Hermite orthogonal polynomials

abstract: The q-Hermite I-Sobolev type polynomials of higher order are consider for their study. Their hypergeometric representation is provided together with further useful properties such as several structure relations which give rise to a three-term recurrence relation of their elements. Two different q-difference equations satisfied by the q-Hermite I-Sobolev type polynomials of higher order are also established.


title: Interval and fuzzy physics-informed neural networks for uncertain fields

abstract: Temporally and spatially dependent uncertain parameters are regularly encountered in engineering applications. Commonly these uncertainties are accounted for using random fields and processes, which require knowledge about the appearing probability distributions functions that is not readily available. In these cases non-probabilistic approaches such as interval analysis and fuzzy set theory are helpful uncertainty measures. Partial differential equations involving fuzzy and interval fields are traditionally solved using the finite element method where the input fields are sampled using some basis function expansion methods. This approach however is problematic, as it is reliant on knowledge about the spatial correlation fields. In this work we utilize physics-informed neural networks (PINNs) to solve interval and fuzzy partial differential equations. The resulting network structures termed interval physics-informed neural networks (iPINNs) and fuzzy physics-informed neural networks (fPINNs) show promising results for obtaining bounded solutions of equations involving spatially and/or temporally uncertain parameter fields. In contrast to finite element approaches, no correlation length specification of the input fields as well as no Monte-Carlo simulations are necessary. In fact, information about the input interval fields is obtained directly as a byproduct of the presented solution scheme. Furthermore, all major advantages of PINNs are retained, i.e. meshfree nature of the scheme, and ease of inverse problem set-up.


title: Linking ghost penalty and aggregated unfitted methods

abstract: In this work, we analyse the links between ghost penalty stabilisation and aggregation-based discrete extension operators for the numerical approximation of elliptic partial differential equations on unfitted meshes. We explore the behavior of ghost penalty methods in the limit as the penalty parameter goes to infinity, which returns a strong version of these methods. We observe that these methods suffer locking in that limit. On the contrary, aggregated finite element spaces are locking-free because they can be expressed as an extension operator from well-posed to ill-posed degrees of freedom. Next, we propose novel ghost penalty methods that penalise the distance between the solution and its aggregation-based discrete extension. These methods are locking-free and converge to aggregated finite element methods in the infinite penalty parameter limit. We include an exhaustive set of numerical experiments in which we compare weak (ghost penalty) and strong (aggregated finite elements) schemes in terms of error quantities, condition numbers and sensitivity with respect to penalty coefficients on different geometries, intersection locations and mesh topologies.


title: Computations of general Heun functions from their integral series representations

abstract: We present a numerical implementation of the recently developed unconditionally convergent representation of general Heun functions as integral series. We produce two codes in Python available for download, one of which is especially aimed at reproducing the output of Mathematica's HeunG function. We show that the present code compares favorably with Mathematica's HeunG and with an Octave/Matlab code of Motygin, in particular when the Heun function is to be evaluated at a large number of points if less accuracy is sufficient. We suggest further improvements concerning the accuracy and discuss the issue of singularities.


title: The two-scale transformation method

abstract: We prove the two-scale transformation method which allows rigorous homogenisation of problems defined on locally periodic domains by transformation on periodic domains. The idea to consider periodic substitute problems was originally proposed by M. A. Peter for the homogenisation on evolving microstructure and is applied in several works. However, only the homogenisation of the periodic substitute problems was proven, whereas the method itself was just postulated (i.e. the equivalence to the homogenisation of the actual problem had to be assumed). In this work, we develop this idea further and formulate a rigorous two-scale convergence concept for microscopic transformation to prove this method. Moreover, we show a new two-scale transformation rule for gradients which allows to derive new limit problems that are now transformationally independent.


title: Ranger21: a synergistic deep learning optimizer

abstract: As optimizers are critical to the performances of neural networks, every year a large number of papers innovating on the subject are published. However, while most of these publications provide incremental improvements to existing algorithms, they tend to be presented as new optimizers rather than composable algorithms. Thus, many worthwhile improvements are rarely seen out of their initial publication. Taking advantage of this untapped potential, we introduce Ranger21, a new optimizer which combines AdamW with eight components, carefully selected after reviewing and testing ideas from the literature. We found that the resulting optimizer provides significantly improved validation accuracy and training speed, smoother training curves, and is even able to train a ResNet50 on ImageNet2012 without Batch Normalization layers. A problem on which AdamW stays systematically stuck in a bad initial state.


title: Recurrent Coupled Topic Modeling over Sequential Documents

abstract: The abundant sequential documents such as online archival, social media and news feeds are streamingly updated, where each chunk of documents is incorporated with smoothly evolving yet dependent topics. Such digital texts have attracted extensive research on dynamic topic modeling to infer hidden evolving topics and their temporal dependencies. However, most of the existing approaches focus on single-topic-thread evolution and ignore the fact that a current topic may be coupled with multiple relevant prior topics. In addition, these approaches also incur the intractable inference problem when inferring latent parameters, resulting in a high computational cost and performance degradation. In this work, we assume that a current topic evolves from all prior topics with corresponding coupling weights, forming the multi-topic-thread evolution. Our method models the dependencies between evolving topics and thoroughly encodes their complex multi-couplings across time steps. To conquer the intractable inference challenge, a new solution with a set of novel data augmentation techniques is proposed, which successfully discomposes the multi-couplings between evolving topics. A fully conjugate model is thus obtained to guarantee the effectiveness and efficiency of the inference technique. A novel Gibbs sampler with a backward-forward filter algorithm efficiently learns latent timeevolving parameters in a closed-form. In addition, the latent Indian Buffet Process (IBP) compound distribution is exploited to automatically infer the overall topic number and customize the sparse topic proportions for each sequential document without bias. The proposed method is evaluated on both synthetic and real-world datasets against the competitive baselines, demonstrating its superiority over the baselines in terms of the low per-word perplexity, high coherent topics, and better document time prediction.


title: Graph and hypergraph colouring via nibble methods: A survey

abstract: This paper provides a survey of methods, results, and open problems on graph and hypergraph colourings, with a particular emphasis on semi-random `nibble' methods. We also give a detailed sketch of some aspects of the recent proof of the Erd\H{o}s-Faber-Lov\'{a}sz conjecture.


title: Projection-wise Disentangling for Fair and Interpretable Representation Learning: Application to 3D Facial Shape Analysis

abstract: Confounding bias is a crucial problem when applying machine learning to practice, especially in clinical practice. We consider the problem of learning representations independent to multiple biases. In literature, this is mostly solved by purging the bias information from learned representations. We however expect this strategy to harm the diversity of information in the representation, and thus limiting its prospective usage (e.g., interpretation). Therefore, we propose to mitigate the bias while keeping almost all information in the latent representations, which enables us to observe and interpret them as well. To achieve this, we project latent features onto a learned vector direction, and enforce the independence between biases and projected features rather than all learned features. To interpret the mapping between projected features and input data, we propose projection-wise disentangling: a sampling and reconstruction along the learned vector direction. The proposed method was evaluated on the analysis of 3D facial shape and patient characteristics (N=5011). Experiments showed that this conceptually simple method achieved state-of-the-art fair prediction performance and interpretability, showing its great potential for clinical applications.


title: Some Braces of Cardinality $p^{4}$ and Related Hopf-Galois Extensions

abstract: We describe all $\mathbb F_{p}$-braces of cardinality $p^{4}$ which are not right nilpotent. Our solution illustrates a general way of investigating $\mathbb F_{p}$-braces of cardinality $p^{n}$ with a given multiplicative group. The constructed braces are left nilpotent, solvable and prime, and they also contain a non-zero strongly nilpotent ideal.


title: DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders

abstract: While pretrained encoders have achieved success in various natural language understanding (NLU) tasks, there is a gap between these pretrained encoders and natural language generation (NLG). NLG tasks are often based on the encoder-decoder framework, where the pretrained encoders can only benefit part of it. To reduce this gap, we introduce DeltaLM, a pretrained multilingual encoder-decoder model that regards the decoder as the task layer of off-the-shelf pretrained encoders. Specifically, we augment the pretrained multilingual encoder with a decoder and pre-train it in a self-supervised way. To take advantage of both the large-scale monolingual data and bilingual data, we adopt the span corruption and translation span corruption as the pre-training tasks. Experiments show that DeltaLM outperforms various strong baselines on both natural language generation and translation tasks, including machine translation, abstractive text summarization, data-to-text, and question generation. The code and pretrained models are available at \url{https://aka.ms/deltalm}.


title: A Time-domain Approach to the Design of Coupled-Resonator Microstrip Filters

abstract: Coupled-resonator microstrip filters are among the most versatile filter topologies. A known design approach uses full-wave electromagnetic simulations to determine the coupling coefficient between resonators as a function of their relative position. This could be done using time-domain simulations using a fast Fourier transform (FFT) to extract the couplings from the S parameters obtained from time-domain signals. However, this approach has a poor performance in terms of resolution and specially for weak couplings, leading to unreasonably long simulation times. To overcome this, we introduce a technique to obtain the couplings directly from time signals, without moving to the frequency domain. This procedure works for strong and weak couplings, with much shorter simulation times and a reduced simulation domain over the FFT approach. This technique is used to design coupled resonator filter efficiently from time domain simulations. We implement this procedure using the finite-difference time-domain framework using an open source solver and discuss our implementation. We show that its results are very similar to previously published ones obtained from frequency domain simulations, even in the case of very weak couplings. Finally, we design and measure a filter to show the good performance of the proposed approach.


title: The Dirichlet problem for p-minimizers on finely open sets in metric spaces

abstract: We initiate the study of fine $p$-(super)minimizers, associated with $p$-harmonic functions, on finely open sets in metric spaces, where $1 < p < \infty$. After having developed their basic theory, we obtain the $p$-fine continuity of the solution of the Dirichlet problem on a finely open set with continuous Sobolev boundary values, as a by-product of similar pointwise results. These results are new also on unweighted $\mathbf{R}^n$. We build this theory in a complete metric space equipped with a doubling measure supporting a $p$-Poincar\'e inequality.


title: Re-parameterizing VAEs for stability

abstract: We propose a theoretical approach towards the training numerical stability of Variational AutoEncoders (VAE). Our work is motivated by recent studies empowering VAEs to reach state of the art generative results on complex image datasets. These very deep VAE architectures, as well as VAEs using more complex output distributions, highlight a tendency to haphazardly produce high training gradients as well as NaN losses. The empirical fixes proposed to train them despite their limitations are neither fully theoretically grounded nor generally sufficient in practice. Building on this, we localize the source of the problem at the interface between the model's neural networks and their output probabilistic distributions. We explain a common source of instability stemming from an incautious formulation of the encoded Normal distribution's variance, and apply the same approach on other, less obvious sources. We show that by implementing small changes to the way we parameterize the Normal distributions on which they rely, VAEs can securely be trained.


title: Advancing Methodology for Social Science Research Using Alternate Reality Games: Proof-of-Concept Through Measuring Individual Differences and Adaptability and their impact on Team Performance

abstract: While work in fields of CSCW (Computer Supported Collaborative Work), Psychology and Social Sciences have progressed our understanding of team processes and their effect performance and effectiveness, current methods rely on observations or self-report, with little work directed towards studying team processes with quantifiable measures based on behavioral data. In this report we discuss work tackling this open problem with a focus on understanding individual differences and its effect on team adaptation, and further explore the effect of these factors on team performance as both an outcome and a process. We specifically discuss our contribution in terms of methods that augment survey data and behavioral data that allow us to gain more insight on team performance as well as develop a method to evaluate adaptation and performance across and within a group. To make this problem more tractable we chose to focus on specific types of environments, Alternate Reality Games (ARGs), and for several reasons. First, these types of games involve setups that are similar to a real-world setup, e.g., communication through slack or email. Second, they are more controllable than real environments allowing us to embed stimuli if needed. Lastly, they allow us to collect data needed to understand decisions and communications made through the entire duration of the experience, which makes team processes more transparent than otherwise possible. In this report we discuss the work we did so far and demonstrate the efficacy of the approach.


title: Spectral Conditions for the Bipancyclic Bipartite Graphs

abstract: Let $G = (X, Y; E)$ be a bipartite graph with two vertex partition subsets $X$ and $Y$. $G$ is said to be balanced if $|X| = |Y|$. $G$ is said to be bipancyclic if it contains cycles of every even length from $4$ to $|V(G)|$. In this note, we present spectral conditions for the bipancyclic bipartite graphs.


title: Glyph: Visualization Tool for Understanding Problem Solving Strategies in Puzzle Games

abstract: Understanding player strategies is a key question when analyzing player behavior both for academic researchers and industry practitioners. For game designers and game user researchers, it is important to gauge the distance between intended strategies and emergent strategies; this comparison allows identification of glitches or undesirable behaviors. For academic researchers using games for serious purposes such as education, the strategies adopted by players are indicative of their cognitive progress in relation to serious goals, such as learning process. Current techniques and systems created to address these needs present a few drawbacks. Qualitative methods are difficult to scale upwards to include large number of players and are prone to subjective biases. Other approaches such as visualization and analytical tools are either designed to provide an aggregated overview of the data, losing the nuances of individual player behaviors, or, in the attempt of accounting for individual behavior, are not specifically designed to reduce the visual cognitive load. In this work, we propose a novel visualization technique that specifically addresses the tasks of comparing behavior sequences in order to capture an overview of the strategies enacted by players and at the same time examine individual player behaviors to identify differences and outliers. This approach allows users to form hypotheses about player strategies and verify them. We demonstrate the effectiveness of the technique through a case study: utilizing a prototype system to investigate data collected from a commercial educational puzzle game. While the prototype's usability can be improved, initial testing results show that core features of the system proved useful to our potential users for understanding player strategies.


title: Privileged Zero-Shot AutoML

abstract: This work improves the quality of automated machine learning (AutoML) systems by using dataset and function descriptions while significantly decreasing computation time from minutes to milliseconds by using a zero-shot approach. Given a new dataset and a well-defined machine learning task, humans begin by reading a description of the dataset and documentation for the algorithms to be used. This work is the first to use these textual descriptions, which we call privileged information, for AutoML. We use a pre-trained Transformer model to process the privileged text and demonstrate that using this information improves AutoML performance. Thus, our approach leverages the progress of unsupervised representation learning in natural language processing to provide a significant boost to AutoML. We demonstrate that using only textual descriptions of the data and functions achieves reasonable classification performance, and adding textual descriptions to data meta-features improves classification across tabular datasets. To achieve zero-shot AutoML we train a graph neural network with these description embeddings and the data meta-features. Each node represents a training dataset, which we use to predict the best machine learning pipeline for a new test dataset in a zero-shot fashion. Our zero-shot approach rapidly predicts a high-quality pipeline for a supervised learning task and dataset. In contrast, most AutoML systems require tens or hundreds of pipeline evaluations. We show that zero-shot AutoML reduces running and prediction times from minutes to milliseconds, consistently across datasets. By speeding up AutoML by orders of magnitude this work demonstrates real-time AutoML.


title: Fully tunable hyperfine interactions of hole spin qubits in Si and Ge quantum dots

abstract: Hole spin qubits are frontrunner platforms for scalable quantum computers, but state-of-the-art devices suffer from noise originating from the hyperfine interactions with nuclear defects. We show that these interactions have a highly tunable anisotropy that is controlled by device design and external electric fields. This tunability enables sweet spots where the hyperfine noise is suppressed by an order of magnitude and is comparable to isotopically purified materials. We identify surprisingly simple designs where the qubits are highly coherent and are largely unaffected by both charge and hyperfine noise. We find that the large spin-orbit interaction typical of elongated quantum dots not only speeds up qubit operations, but also dramatically renormalizes the hyperfine noise, altering qualitatively the dynamics of driven qubits and enhancing the fidelity of qubit gates. Our findings serve as guidelines to design high performance qubits for scaling up quantum computers.


title: Classification of metric measure spaces and their ends using $p$-harmonic functions

abstract: By seeing whether a Liouville type theorem holds for positive, bounded, and/or finite energy $p$-harmonic and $p$-quasiharmonic functions, we classify proper metric spaces equipped with a locally doubling measure supporting a local $p$-Poincar\'e inequality. Similar classifications have earlier been obtained for Riemann surfaces and Riemannian manifolds. We also study the inclusions between these classes of metric measure spaces, and their relationship to the $p$-hyperbolicity of the metric space and its ends. In particular, we characterize spaces that carry nonconstant $p$-harmonic functions with finite energy as spaces having at least two well-separated $p$-hyperbolic sequences. We also show that every such space $X$ has a function $f \notin L^p(X) + \mathbb{R} $ with finite $p$-energy.


title: On Incorporating Inductive Biases into VAEs

abstract: We explain why directly changing the prior can be a surprisingly ineffective mechanism for incorporating inductive biases into VAEs, and introduce a simple and effective alternative approach: Intermediary Latent Space VAEs(InteL-VAEs). InteL-VAEs use an intermediary set of latent variables to control the stochasticity of the encoding process, before mapping these in turn to the latent representation using a parametric function that encapsulates our desired inductive bias(es). This allows us to impose properties like sparsity or clustering on learned representations, and incorporate human knowledge into the generative model. Whereas changing the prior only indirectly encourages behavior through regularizing the encoder, InteL-VAEs are able to directly enforce desired characteristics. Moreover, they bypass the computation and encoder design issues caused by non-Gaussian priors, while allowing for additional flexibility through training of the parametric mapping function. We show that these advantages, in turn, lead to both better generative models and better representations being learned.


title: Unpacking Adherence and Engagement in Pervasive Health Games

abstract: Pervasive health games have a potential to impact health-related behaviors. And, similar to other types of interventions, engagement and adherence in health games is the keystone for examining their short- and long-term effects. Many health-based applications have turned to gamification principles specifically to. enhance their engagement. However, according to many reports, only 41% of participants are retained in single player games and 29% in social games after 90 days. These statistics raise multiple questions about factors influencing adherence and engagement. This paper presents an in-depth mixed-methods investigation of game design factors affecting engagement with and adherence to a pervasive commercial health game, called SpaPlay. We analyzed interview and game behavior log data using theoretical constructs of sustained engagement to identify design elements affecting engagement and adherence. Our findings indicate that design elements associated with autonomy. and relatedness from the Self-Determination Theory and integrability, a measure of how well activities align with a person's life style, are important factors affecting engagement and adherence.