title: PRGFlow: Benchmarking SWAP-Aware Unified Deep Visual Inertial Odometry

abstract: Odometry on aerial robots has to be of low latency and high robustness whilst also respecting the Size, Weight, Area and Power (SWAP) constraints as demanded by the size of the robot. A combination of visual sensors coupled with Inertial Measurement Units (IMUs) has proven to be the best combination to obtain robust and low latency odometry on resource-constrained aerial robots. Recently, deep learning approaches for Visual Inertial fusion have gained momentum due to their high accuracy and robustness. However, the remarkable advantages of these techniques are their inherent scalability (adaptation to different sized aerial robots) and unification (same method works on different sized aerial robots) by utilizing compression methods and hardware acceleration, which have been lacking from previous approaches. To this end, we present a deep learning approach for visual translation estimation and loosely fuse it with an Inertial sensor for full 6DoF odometry estimation. We also present a detailed benchmark comparing different architectures, loss functions and compression methods to enable scalability. We evaluate our network on the MSCOCO dataset and evaluate the VI fusion on multiple real-flight trajectories.


title: Quaternion Linear Canonical Wavelet Transform and The Corresponding Uncertainty Inequalities

abstract: The linear canonical wavelet transform has been shown to be a valuable and powerful time-frequency analyzing tool for optics and signal processing. In this article, we propose a novel transform called quaternion linear canonical wavelet transform which is designed to represent two dimensional quaternion-valued signals at different scales, locations and orientations. The proposed transform not only inherits the features of quaternion wavelet transform but also has the capability of signal representation in quaternion linear canonical domain. We investigate the fundamental properties of quaternion linear canonical wavelet transform including Parseval's formula, energy conservation, inversion formula, and characterization of its range using the machinery of quaternion linear canonical transform and its convolution. We conclude our investigation by deriving an analogue of the classical Heisenberg-Pauli-Weyl uncertainty inequality and the associated logarithmic and local versions for the quaternion linear canonical wavelet transform.


title: Conditional Sampling with Monotone GANs: from Generative Models to Likelihood-Free Inference

abstract: We present a novel framework for conditional sampling of probability measures, using block triangular transport maps. We develop the theoretical foundations of block triangular transport in a Banach space setting, establishing general conditions under which conditional sampling can be achieved and drawing connections between monotone block triangular maps and optimal transport. Based on this theory, we then introduce a computational approach, called monotone generative adversarial networks (M-GANs), to learn suitable block triangular maps. Our algorithm uses only samples from the underlying joint probability measure and is hence likelihood-free. Numerical experiments with M-GAN demonstrate accurate sampling of conditional measures in synthetic examples, Bayesian inverse problems involving ordinary and partial differential equations, and probabilistic image in-painting.


title: On Improving Temporal Consistency for Online Face Liveness Detection

abstract: In this paper, we focus on improving the online face liveness detection system to enhance the security of the downstream face recognition system. Most of the existing frame-based methods are suffering from the prediction inconsistency across time. To address the issue, a simple yet effective solution based on temporal consistency is proposed. Specifically, in the training stage, to integrate the temporal consistency constraint, a temporal self-supervision loss and a class consistency loss are proposed in addition to the softmax cross-entropy loss. In the deployment stage, a training-free non-parametric uncertainty estimation module is developed to smooth the predictions adaptively. Beyond the common evaluation approach, a video segment-based evaluation is proposed to accommodate more practical scenarios. Extensive experiments demonstrated that our solution is more robust against several presentation attacks in various scenarios, and significantly outperformed the state-of-the-art on multiple public datasets by at least 40% in terms of ACER. Besides, with much less computational complexity (33% fewer FLOPs), it provides great potential for low-latency online applications.


title: Semidistributive Laurent Series Rings

abstract: If $A$ is a ring with automorphism $\varphi$ and the skew Laurent series ring $A((x,\varphi ))$ is a right semidistributive semilocal ring then $A$ is a right semidistributive right Artinian ring. The Laurent series ring $A((x))$ is a right semidistributive semilocal ring if and only if $A$ is a right semidistributive right Artinian ring. The study is supported by Russian Scientific Foundation (project 16-11-10013).


title: Last-passage time for linear diffusions and application to the emptying time of a box

abstract: We study the statistics of last-passage time for linear diffusions. First we present an elementary derivation of the Laplace transform of the probability density of the last-passage time, thus recovering known results from the mathematical literature. We then illustrate them on several explicit examples. In a second step we study the spectral properties of the Schr\"{o}dinger operator associated to such diffusions in an even potential $U(x) = U(-x)$, unveiling the role played by the so-called Weyl coefficient. Indeed, in this case, our approach allows us to relate the last-passage times for dual diffusions (i.e., diffusions driven by opposite force fields) and to obtain new explicit formulae for the mean last-passage time. We further show that, for such even potentials, the small time $t$ expansion of the mean last-passage time on the interval $[0,t]$ involves the Korteveg-de Vries invariants, which are well known in the theory of Schr\"odinger operators. Finally, we apply these results to study the emptying time of a one-dimensional box, of size $L$, containing $N$ independent Brownian particles subjected to a constant drift. In the scaling limit where both $N \to \infty$ and $L \to \infty$, keeping the density $\rho = N/L$ fixed, we show that the limiting density of the emptying time is given by a Gumbel distribution. Our analysis provides a new example of the applications of extreme value statistics to out-of-equilibrium systems.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: On the Tightness of Semidefinite Relaxations for Certifying Robustness to Adversarial Examples

abstract: The robustness of a neural network to adversarial examples can be provably certified by solving a convex relaxation. If the relaxation is loose, however, then the resulting certificate can be too conservative to be practically useful. Recently, a less conservative robustness certificate was proposed, based on a semidefinite programming (SDP) relaxation of the ReLU activation function. In this paper, we describe a geometric technique that determines whether this SDP certificate is exact, meaning whether it provides both a lower-bound on the size of the smallest adversarial perturbation, as well as a globally optimal perturbation that attains the lower-bound. Concretely, we show, for a least-squares restriction of the usual adversarial attack problem, that the SDP relaxation amounts to the nonconvex projection of a point onto a hyperbola. The resulting SDP certificate is exact if and only if the projection of the point lies on the major axis of the hyperbola. Using this geometric technique, we prove that the certificate is exact over a single hidden layer under mild assumptions, and explain why it is usually conservative for several hidden layers. We experimentally confirm our theoretical insights using a general-purpose interior-point method and a custom rank-2 Burer-Monteiro algorithm.


title: An Unconditionally Stable Space-Time FE Method for the Korteweg-de Vries Equation

abstract: We introduce an unconditionally stable finite element (FE) method, the automatic variationally stable FE (AVS-FE) method for the numerical analysis of the Korteweg-de Vries (KdV) equation. The AVS-FE method is a Petrov-Galerkin method which employs the concept of optimal discontinuous test functions of the discontinuous Petrov- Galerkin (DPG) method. However, since AVS-FE method is a minimum residual method, we establish a global saddle point system instead of computing optimal test functions element-by-element. This system allows us to seek both the approximate solution of the KdV initial boundary value problem (IBVP) and a Riesz representer of the approximation error. The AVS-FE method distinguishes itself from other minimum residual methods by using globally continuous Hilbert spaces, such as H1, while at the same time using broken Hilbert spaces for the test. Consequently, the AVS-FE approximations are classical C0 continuous FE solutions. The unconditional stability of this method allows us to solve the KdV equation space and time without having to satisfy a CFL condition. We present several numerical verifications for both linear and nonlinear versions of the KdV equation leading to optimal convergence behavior. Finally, we present a numerical verification of adaptive mesh refinements in both space and time for the nonlinear KdV equation.


title: Curricular Complexity Versus Quality of Computer Science Programs

abstract: In this research paper we describe a study that involves measuring the complexities of undergraduate curricula offered by computer science departments, and then comparing them to the quality of these departments, where quality is determined by a metric-based ranking system. The study objective was to determine whether or not a relationship exists between the quality of computer science departments and the complexity of the curricula they offer. The relationship between curricular complexity and program quality was previously investigated for the case of undergraduate electrical engineering programs, with surprising results. It was found that if the US News & World Report Best Undergraduate Programs ranking is used as a proxy for quality, then a statistically significant difference in curricular complexities exists between higher and lower quality electrical engineering programs. Furthermore, it was found that higher quality electrical engineering programs tend to have lower complexity curricula, and vice versa. In the study reported in this paper, a sufficient amount of data was collected in order to determine that an inverse relationship between program quality and curricular complexity also exists in undergraduate computer science departments. This brings up an interesting question regarding the extent to which this phenomenon exists across the spectrum of STEM disciplines.


title: Ansor: Generating High-Performance Tensor Programs for Deep Learning

abstract: High-performance tensor programs are crucial to guarantee efficient execution of deep neural networks. However, obtaining performant tensor programs for different operators on various hardware platforms is notoriously challenging. Currently, deep learning systems rely on vendor-provided kernel libraries or various search strategies to get performant tensor programs. These approaches either require significant engineering effort to develop platform-specific optimization code or fall short of finding high-performance programs due to restricted search space and ineffective exploration strategy. We present Ansor, a tensor program generation framework for deep learning applications. Compared with existing search strategies, Ansor explores many more optimization combinations by sampling programs from a hierarchical representation of the search space. Ansor then fine-tunes the sampled programs with evolutionary search and a learned cost model to identify the best programs. Ansor can find high-performance programs that are outside the search space of existing state-of-the-art approaches. In addition, Ansor utilizes a task scheduler to simultaneously optimize multiple subgraphs in deep neural networks. We show that Ansor improves the execution performance of deep neural networks relative to the state-of-the-art on the Intel CPU, ARM CPU, and NVIDIA GPU by up to $3.8\times$, $2.6\times$, and $1.7\times$, respectively.


title: Stochastic Saddle-Point Optimization for Wasserstein Barycenters

abstract: We consider the population Wasserstein barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data. This leads to a complicated stochastic optimization problem where the objective is given as an expectation of a function given as a solution to a random optimization problem. We employ the structure of the problem and obtain a convex-concave stochastic saddle-point reformulation of this problem. In the setting when the distribution of random probability measures is discrete, we propose a stochastic optimization algorithm and estimate its complexity. The second result, based on kernel methods, extends the previous one to the arbitrary distribution of random probability measures. Moreover, this new algorithm has a total complexity better than the Stochastic Approximation approach combined with the Sinkhorn algorithm in many cases. We also illustrate our developments by a series of numerical experiments.


title: A Discrete Event Simulation Model for Coordinating Inventory Management and Material Handling in Hospitals

abstract: For operating rooms (ORs) and hospitals, inventory management of surgical instruments and material handling decisions of perioperative services are critical to hospitals' service levels and costs. However, efficiently integrating these decisions is challenging due to hospitals' interdependence and the uncertainties they face. These challenges motivated the development of this study to answer the following research questions: (R1) How does the inventory level of surgical instruments, including owned, borrowed and consigned, impact the efficiency of ORs? (R2) How do material handling activities impact the efficiency of ORs? (R3) How do integrating decisions about inventory and material handling impact the efficiency of ORs? Three discrete event simulation models are developed here to address these questions. Model 1, Current, assumes no coordination of material handling and inventory decisions. Model 2, Two Batch, assumes partial coordination, and Model 3, Just-In-Time (JIT), assumes full coordination. These models are verified and validated using real life-data from a partnering hospital. A thorough numerical analysis indicates that, in general, coordination of inventory management of surgical instruments and material handling decisions has the potential to improve the efficiency and reduce OR costs. More specifically, a JIT delivery of instruments used in short-duration surgeries leads to lower inventory levels without jeopardizing the service level provided.


title: Purely cosmetic surgeries and pretzel knots

abstract: We show that all pretzel knots satisfy the (purely) cosmetic surgery conjecture, i.e. Dehn surgeries with different slopes along a pretzel knot provide different oriented three-manifolds.


title: Thermodynamical and dynamical equilibrium of a self-gravitating uncharged thin shell

abstract: The dynamical stability of massive thin shells with a given equation of state (EOS) is here compared (both for the barotropic and non-barotropic case) with the results coming from thermodynamical stability. Our results show that the restrictions in the parameter space of equilibrium configurations of the shell following from thermodynamical stability are much more stringent that those obtained from dynamical stability. As a byproduct, we furnish evidence that the link between the maximum mass along a sequence of equilibrium configurations and the onset of dynamical stability is valid for EOS of the type $P=P(\sigma, R)$.


title: Functional modules from variable genes: Leveraging percolation to analyze noisy, high-dimensional data

abstract: While measurement advances now allow extensive surveys of gene activity (large numbers of genes across many samples), interpretation of these data is often confounded by noise -- expression counts can differ strongly across samples due to variation of both biological and experimental origin. Complimentary to perturbation approaches, we extract functionally related groups of genes by analyzing the standing variation within a sampled population. To distinguish biologically meaningful patterns from uninterpretable noise, we focus on correlated variation and develop a novel density-based clustering approach that takes advantage of a percolation transition generically arising in random, uncorrelated data. We apply our approach to two contrasting RNA sequencing data sets that sample individual variation -- across single cells of fission yeast and whole animals of C. elegans worms -- and demonstrate robust applicability and versatility in revealing correlated gene clusters of diverse biological origin, including cell cycle phase, development/reproduction, tissue-specific functions, and feeding history. Our technique exploits generic features of noisy high-dimensional data and is applicable, beyond gene expression, to feature-rich data that sample population-level variability in the presence of noise.


title: Central configurations in spatial n-body problem for n = 5, 6 with equal masses

abstract: We present a computer assisted proof of the full listing of central configurations for spatial n-body problem for n = 5 and 6, with equal masses. For each central configuration we give a full list of its euclidean symmetries. For all masses sufficiently close to the equal masses case we give an exact count of configurations in the planar case for n = 4, 5, 6, 7 and in the spatial case for n = 4, 5, 6.


title: One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outliers

abstract: We propose the first general and practical framework to design certifiable algorithms for robust geometric perception in the presence of a large amount of outliers. We investigate the use of a truncated least squares (TLS) cost function, which is known to be robust to outliers, but leads to hard, nonconvex, and nonsmooth optimization problems. Our first contribution is to show that -for a broad class of geometric perception problems- TLS estimation can be reformulated as an optimization over the ring of polynomials and Lasserre's hierarchy of convex moment relaxations is empirically tight at the minimum relaxation order (i.e., certifiably obtains the global minimum of the nonconvex TLS problem). Our second contribution is to exploit the structural sparsity of the objective and constraint polynomials and leverage basis reduction to significantly reduce the size of the semidefinite program (SDP) resulting from the moment relaxation, without compromising its tightness. Our third contribution is to develop scalable dual optimality certifiers from the lens of sums-of-squares (SOS) relaxation, that can compute the suboptimality gap and possibly certify global optimality of any candidate solution (e.g., returned by fast heuristics such as RANSAC or graduated non-convexity). Our dual certifiers leverage Douglas-Rachford Splitting to solve a convex feasibility SDP. Numerical experiments across different perception problems, including single rotation averaging, shape alignment, 3D point cloud and mesh registration, and high-integrity satellite pose estimation, demonstrate the tightness of our relaxations, the correctness of the certification, and the scalability of the proposed dual certifiers to large problems, beyond the reach of current SDP solvers.


title: A first coherent structure in elasto-inertial turbulence

abstract: Two dimensional channel flow simulations of FENE-P fluid in the elasto-inertial turbulence regime reveal distinct regimes ranging from chaos to a steady travelling wave which takes the form of an arrowhead structure. This coherent structure provides new insights in the polymer/flow interactions driving EIT, which are observed in a set of controlled numerical experiments and the study of transfer between elastic and turbulent kinetic energy.


title: Randomized Consensus with Regular Registers

abstract: The well-known randomized consensus algorithm by Aspnes and Herlihy for asynchronous shared-memory systems was proved to work, even against a strong adversary, under the assumption that the registers that it uses are atomic registers. With atomic registers, every read or write operation is instantaneous (and thus indivisible). As pointed out by Golab et al. (2011), however, a randomized algorithm that works with atomic registers does not necessarily work if we replace the atomic registers that it uses with linearizable implementations of registers. This raises the following question: does the randomized consensus algorithm by Aspnes and Herlihy still work against a strong adversary if we replace its atomic registers with linearizable registers? We show that the answer is affirmative, in fact, we show that even linearizable registers are not necessary. More precisely, we prove that the algorithm by Aspnes and Herlihy works against a strong adversary even if the algorithm uses only regular registers.


title: On the smoothness of $C^1$-contact maps in $C^{\infty}$-rigid Carnot groups

abstract: We show that in any $C^\infty$-rigid Carnot group in the sense of Ottazzi - Warhurst, $C^1$-contact maps are automatically smooth.


title: Delegation in Veto Bargaining

abstract: A proposer requires the approval of a veto player to change a status quo. Preferences are single peaked. Proposer is uncertain about Vetoer's ideal point. We study Proposer's optimal mechanism without transfers. Vetoer is given a menu, or a delegation set, to choose from. The optimal delegation set balances the extent of Proposer's compromise with the risk of a veto. Under reasonable conditions, "full delegation" is optimal: Vetoer can choose any action between the status quo and Proposer's ideal action. This outcome largely nullifies Proposer's bargaining power; Vetoer frequently obtains her ideal point, and there is Pareto efficiency despite asymmetric information. More generally, we identify when "interval delegation" is optimal. Optimal interval delegation can be a Pareto improvement over cheap talk. We derive comparative statics. Vetoer receives less discretion when preferences are more likely to be aligned, by contrast to expertise-based delegation. Methodologically, our analysis handles stochastic mechanisms.


title: On the multifractal spectrum of weighted Birkhoff averages

abstract: In this paper, we study the topological spectrum of weighted Birkhoff averages over aperiodic and irreducible subshifts of finite type. We show that for a uniformly continuous family of potentials, the spectrum is continuous and concave over its domain. In case of typical weights with respect to some ergodic quasi-Bernoulli measure, we determine the spectrum. Moreover, in case of full shift and under the assumption that the potentials depend only on the first coordinate, we show that our result is applicable for regular weights, like M\"obius sequence.


title: BioDynaMo: a general platform for scalable agent-based simulation

abstract: Motivation: Agent-based modeling is an indispensable tool for studying complex biological systems. However, existing simulators do not always take full advantage of modern hardware and often have a field-specific software design. Results: We present a novel simulation platform called BioDynaMo that alleviates both of these problems. BioDynaMo features a general-purpose and high-performance simulation engine. We demonstrate that BioDynaMo can be used to simulate use cases in: neuroscience, oncology, and epidemiology. For each use case we validate our findings with experimental data or an analytical solution. Our performance results show that BioDynaMo performs up to three orders of magnitude faster than the state-of-the-art baseline. This improvement makes it feasible to simulate each use case with one billion agents on a single server, showcasing the potential BioDynaMo has for computational biology research. Availability: BioDynaMo is an open-source project under the Apache 2.0 license and is available at www.biodynamo.org. Instructions to reproduce the results are available in supplementary information. Contact: lukas.breitwieser@inf.ethz.ch, a.s.hesam@tudelft.nl, omutlu@ethz.ch, r.bauer@surrey.ac.uk Supplementary information: Available at https://doi.org/10.5281/zenodo.4501515


title: Incentives and Efficiency in Constrained Allocation Mechanisms

abstract: We study private-good allocation under general constraints. Several prominent examples are special cases, including house allocation, roommate matching, social choice, and multiple assignment. Every individually strategy-proof and Pareto efficient two-agent mechanism is an "adapted local dictatorship." Every group strategy-proof N-agent mechanism has two-agent marginal mechanisms that are adapted local dictatorships. These results yield new characterizations and unifying insights for known characterizations. We find all group strategy-proof and Pareto efficient mechanisms for the roommates problem. We give a related result for multiple assignment. We prove the Gibbard--Satterthwaite Theorem and give a partial converse.


title: Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware

abstract: In this paper, we propose a design methodology to partition and map the neurons and synapses of online learning SNN-based applications to neuromorphic architectures at {run-time}. Our design methodology operates in two steps -- step 1 is a layer-wise greedy approach to partition SNNs into clusters of neurons and synapses incorporating the constraints of the neuromorphic architecture, and step 2 is a hill-climbing optimization algorithm that minimizes the total spikes communicated between clusters, improving energy consumption on the shared interconnect of the architecture. We conduct experiments to evaluate the feasibility of our algorithm using synthetic and realistic SNN-based applications. We demonstrate that our algorithm reduces SNN mapping time by an average 780x compared to a state-of-the-art design-time based SNN partitioning approach with only 6.25\% lower solution quality.


title: Baryon and lepton number intricacies in axion models

abstract: Because the Peccei-Quinn (PQ) symmetry has to be anomalous to solve the strong CP puzzle, some colored and chiral fermions have to transform non-trivially under this symmetry. But when the SM fermions are charged, as in the PQ or DFSZ models, this symmetry ends up entangled with the SM global symmetries, baryon (B) and lepton (L) numbers. This raises several questions addressed in this paper. First, the compatibility of axion models with some explicit B and/or L violating effects is analyzed, including those arising from seesaw mechanisms, electroweak instanton interactions, or explicit B and L violating effective operators. Second, how many of these effects can be simultaneously present is quantified, along with the consequences for the axion mass and vacuum alignment if too many of them are introduced. Finally, large classes of B and/or L violating interactions without impact on axion phenomenology are identified, like for example the various implementations of the type I and II seesaw mechanisms in the DFSZ context.


title: Quantum Molecular Robots

abstract: Living organisms exploit complex molecular machines to execute crucial functions in chaotic environments. Inspired by nature's molecular setups we explore the idea of a quantum mechanical device whose purpose is self-protecting quantum information against a noisy environment.


title: Tangent Space Sensitivity and Distribution of Linear Regions in ReLU Networks

abstract: Recent articles indicate that deep neural networks are efficient models for various learning problems. However they are often highly sensitive to various changes that cannot be detected by an independent observer. As our understanding of deep neural networks with traditional generalization bounds still remains incomplete, there are several measures which capture the behaviour of the model in case of small changes at a specific state. In this paper we consider adversarial stability in the tangent space and suggest tangent sensitivity in order to characterize stability. We focus on a particular kind of stability with respect to changes in parameters that are induced by individual examples without known labels. We derive several easily computable bounds and empirical measures for feed-forward fully connected ReLU (Rectified Linear Unit) networks and connect tangent sensitivity to the distribution of the activation regions in the input space realized by the network. Our experiments suggest that even simple bounds and measures are associated with the empirical generalization gap.


title: Biconical-dominated Accretion Flow onto Seed Black Holes in a Hyper-accretion Regime

abstract: Hyperaccretion occurs when the gas inflow rate onto a black hole (BH) is so high that the radiative feedback cannot reverse the accretion flow. This extreme process is a promising mechanism for the rapid growth of seed BHs in the early universe, which can explain high-redshift quasars powered by billion solar mass BHs. In theoretical models, spherical symmetry is commonly adopted for hyperaccretion flows; however, the sustainability of such structures on timescales corresponding to the BH growth has not been addressed yet. Here we show that stochastic interactions between the ionizing radiation from the BH and nonuniform accretion flow can lead to the formation of a rotating gas disk around the BH. Once the disk forms, the supply of gas to the BH preferentially occurs via biconical-dominated accretion flow perpendicular to the disk, avoiding the centrifugal barrier of the disk. Biconical-dominated accretion flows from opposite directions collide in the vicinity of the BH supplying high-density, low angular momentum gas to the BH, whereas most of the gas with nonnegligible angular momentum is deflected to the rotationally supported outflowing decretion disk. The disk becomes reinforced progressively as more mass from the biconical flow transfers to the disk and some of the outflowing gas from the disk is redirected to the biconical accretion funnels through a meridional structure. This axisymmetric hydrodynamic structure of a biconical-dominated accretion flow and decretion disk continues to provide uninterrupted flow of high-density gas to the BH.


title: Convergence Analysis of Accelerated Stochastic Gradient Descent under the Growth Condition

abstract: We study the convergence of accelerated stochastic gradient descent for strongly convex objectives under the growth condition, which states that the variance of stochastic gradient is bounded by a multiplicative part that grows with the full gradient, and a constant additive part. Through the lens of the growth condition, we investigate four widely used accelerated methods: Nesterov's accelerated method (NAM), robust momentum method (RMM), accelerated dual averaging method (DAM+), and implicit DAM+ (iDAM+). While these methods are known to improve the convergence rate of SGD under the condition that the stochastic gradient has bounded variance, it is not well understood how their convergence rates are affected by the multiplicative noise. In this paper, we show that these methods all converge to a neighborhood of the optimum with accelerated convergence rates (compared to SGD) even under the growth condition. In particular, NAM, RMM, iDAM+ enjoy acceleration only with a mild multiplicative noise, while DAM+ enjoys acceleration even with a large multiplicative noise. Furthermore, we propose a generic tail-averaged scheme that allows the accelerated rates of DAM+ and iDAM+ to nearly attain the theoretical lower bound (up to a logarithmic factor in the variance term). We conduct numerical experiments to support our theoretical conclusions.


title: Evading Curse of Dimensionality in Unconstrained Private GLMs via Private Gradient Descent

abstract: We revisit the well-studied problem of differentially private empirical risk minimization (ERM). We show that for unconstrained convex generalized linear models (GLMs), one can obtain an excess empirical risk of $\tilde O\left(\sqrt{{\texttt{rank}}}/\epsilon n\right)$, where ${\texttt{rank}}$ is the rank of the feature matrix in the GLM problem, $n$ is the number of data samples, and $\epsilon$ is the privacy parameter. This bound is attained via differentially private gradient descent (DP-GD). Furthermore, via the first lower bound for unconstrained private ERM, we show that our upper bound is tight. In sharp contrast to the constrained ERM setting, there is no dependence on the dimensionality of the ambient model space ($p$). (Notice that ${\texttt{rank}}\leq \min\{n, p\}$.) Besides, we obtain an analogous excess population risk bound which depends on ${\texttt{rank}}$ instead of $p$. For the smooth non-convex GLM setting (i.e., where the objective function is non-convex but preserves the GLM structure), we further show that DP-GD attains a dimension-independent convergence of $\tilde O\left(\sqrt{{\texttt{rank}}}/\epsilon n\right)$ to a first-order-stationary-point of the underlying objective. Finally, we show that for convex GLMs, a variant of DP-GD commonly used in practice (which involves clipping the individual gradients) also exhibits the same dimension-independent convergence to the minimum of a well-defined objective. To that end, we provide a structural lemma that characterizes the effect of clipping on the optimization profile of DP-GD.


title: Self-testing mutually unbiased bases in higher dimensions with space-division multiplexing optical fiber technology

abstract: In the device-independent quantum information approach, the implementation of a given task can be self-tested solely from the recorded statistics and without detailed models for the employed devices. Even though experimentally demanding, it provides appealing verification schemes for advanced quantum technologies that naturally fulfil the associated requirements. In this work, we experimentally study whether self-testing protocols can be adopted to certify the proper functioning of new quantum devices built with modern space-division multiplexing optical fiber technology. Specifically, we consider the prepare-and-measure protocol of M.~Farkas and J.~Kaniewski (Phys.~Rev.~A 99, 032316) for self-testing measurements corresponding to mutually unbiased bases (MUBs) in a dimension $d>2$. In our scheme, the state preparation and measurement stages are implemented with a multi-arm interferometer built with new multi-core optical fibers and related components. Due to the high-overlap of the interferometer's optical modes achieved with this technology, we are able to reach the required visibilities for self-testing the implementation of two four-dimensional MUBs. We also quantify two operational quantities of the measurements: (i) the incompatibility robustness, connected to Bell violations, and (ii) the randomness extractable from the outcomes. Since MUBs lie at the core of several quantum information protocols, our results are of practical interest for future quantum works relying on space-division multiplexing optical fibers.


title: The Noncommutative Geometry of the Landau Hamiltonian: Metric Aspects

abstract: This work provides a first step towards the construction of a noncommutative geometry for the quantum Hall effect in the continuum. Taking inspiration from the ideas developed by Bellissard during the 80's we build a spectral triple for the $C^*$-algebra of continuous magnetic operators based on a Dirac operator with compact resolvent. The metric aspects of this spectral triple are studied, and an important piece of Bellissard's theory (the so-called first Connes' formula) is proved.


title: Distinguished correlation properties of Chebyshev dynamical systems and their generalisations

abstract: We show that, among all smooth one-dimensional maps conjugated to an N-ary shift (a Bernoulli shift of N symbols), Chebyshev maps are distinguished in the sense that they have least higher-order correlations. We generalise our consideration and study a family of shifted Chebyshev maps, presenting analytic results for two-point and higher-order correlation functions. We also review results for the eigenvalues and eigenfunctions of the Perron-Frobenius operator of N-th order Chebyshev maps and their shifted generalisations. The spectrum is degenerate for odd N. Finally, we consider coupled map lattices (CMLs) of shifted Chebyshev maps and numerically investigate zeros of the temporal and spatial nearest-neighbour correlations, which are of interest in chaotically quantized field theories.


title: On Improving the Generalization of Face Recognition in the Presence of Occlusions

abstract: In this paper, we address a key limitation of existing 2D face recognition methods: robustness to occlusions. To accomplish this task, we systematically analyzed the impact of facial attributes on the performance of a state-of-the-art face recognition method and through extensive experimentation, quantitatively analyzed the performance degradation under different types of occlusion. Our proposed Occlusion-aware face REcOgnition (OREO) approach learned discriminative facial templates despite the presence of such occlusions. First, an attention mechanism was proposed that extracted local identity-related region. The local features were then aggregated with the global representations to form a single template. Second, a simple, yet effective, training strategy was introduced to balance the non-occluded and occluded facial images. Extensive experiments demonstrated that OREO improved the generalization ability of face recognition under occlusions by (10.17%) in a single-image-based setting and outperformed the baseline by approximately (2%) in terms of rank-1 accuracy in an image-set-based scenario.


title: Characters for Projective Modules in the BGG Category $\mathcal{O}$ for the Orthosymplectic Lie Superalgebra $\mathfrak{osp}(3|4)$

abstract: We determine the Verma multiplicities of standard filtrations of projective modules for integral atypical blocks in the BGG category $\mathcal{O}$ for the orthosymplectic Lie superalgebras $\mathfrak{osp}(3|4)$ by way of translation functors. We then explicitly determine the composition factor multiplicities of Verma modules using BGG reciprocity.


title: Effects of 6 MeV proton irradiation on the vortex ensemble in BaFe$_{2}$(As$_{0.67}$P$_{0.33}$)$_2$ revealed through magnetization measurements and real-space vortex imaging

abstract: The change in vortex ensemble in BaFe$_{2}$(As$_{0.67}$P$_{0.33}$)$_2$, an isovalently doped iron-based superconductor (IBS), is studied through global magnetization measurements and single vortex imaging before and after 6 MeV proton irradiation. The field dependence of the critical current density ($J_\mathrm{c}$) is analyzed through the strong pinning model, with which the pristine sample is consistent. After the irradiation, the $J_\mathrm{c}$ aberrates from the strong pinning field dependence of $B^{-5/8}$, and evolves to a weaker $B^{-1/3}$ dependence with an anomalous two-step behavior creating a cusp like feature. The cusp coincides with the field of the local minima in the normalized relaxation rate ($S$), manifested by increased pinning due to increased intervortex interactions followed by fast vortex dynamics caused by flux activation at higher fields. Furthermore, single vortex imaging reveals that while long-range triangular correlation of the Abrikosov vortex lattice is observed in pristine samples, irradiated samples exhibit a highly disordered glassy vortex state which is more densely packed with increased pinning force. These artificial defects incorporated via proton irradiation have the same pinning effect as Co doping which not only shifts the pinning force to a higher degree but also broadens its distribution, in contrast to P doping which only broadens the pinning distribution without inducing a shift. All in all, through this investigation, we provide a systematic understanding of the pinning behavior in BaFe$_{2}$(As$_{0.67}$P$_{0.33}$)$_2$ through carefully controlling the defects in the system.


title: On Frequentist Regret of Linear Thompson Sampling

abstract: This paper studies the stochastic linear bandit problem, where a decision-maker chooses actions from possibly time-dependent sets of vectors in $\mathbb{R}^d$ and receives noisy rewards. The objective is to minimize regret, the difference between the cumulative expected reward of the decision-maker and that of an oracle with access to the expected reward of each action, over a sequence of $T$ decisions. Linear Thompson Sampling (LinTS) is a popular Bayesian heuristic, supported by theoretical analysis that shows its Bayesian regret is bounded by $\widetilde{\mathcal{O}}(d\sqrt{T})$, matching minimax lower bounds. However, previous studies demonstrate that the frequentist regret bound for LinTS is $\widetilde{\mathcal{O}}(d\sqrt{dT})$, which requires posterior variance inflation and is by a factor of $\sqrt{d}$ worse than the best optimism-based algorithms. We prove that this inflation is fundamental and that the frequentist bound of $\widetilde{\mathcal{O}}(d\sqrt{dT})$ is the best possible, by demonstrating a randomization bias phenomenon in LinTS that can cause linear regret without inflation.We propose a data-driven version of LinTS that adjusts posterior inflation using observed data, which can achieve minimax optimal frequentist regret, under additional conditions. Our analysis provides new insights into LinTS and settles an open problem in the field.


title: Deep Transfer Learning with Ridge Regression

abstract: The large amount of online data and vast array of computing resources enable current researchers in both industry and academia to employ the power of deep learning with neural networks. While deep models trained with massive amounts of data demonstrate promising generalisation ability on unseen data from relevant domains, the computational cost of finetuning gradually becomes a bottleneck in transfering the learning to new domains. We address this issue by leveraging the low-rank property of learnt feature vectors produced from deep neural networks (DNNs) with the closed-form solution provided in kernel ridge regression (KRR). This frees transfer learning from finetuning and replaces it with an ensemble of linear systems with many fewer hyperparameters. Our method is successful on supervised and semi-supervised transfer learning tasks.


title: Quantile Multi-Armed Bandits: Optimal Best-Arm Identification and a Differentially Private Scheme

abstract: We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private) successive elimination algorithm for strictly optimal best-arm identification, we show that our algorithm is $\delta$-PAC and we characterize its sample complexity. Further, we provide a lower bound on the expected number of pulls, showing that the proposed algorithm is essentially optimal up to logarithmic factors. Both upper and lower complexity bounds depend on a special definition of the associated suboptimality gap, designed in particular for the quantile bandit problem, as we show when the gap approaches zero, best-arm identification is impossible. Second, motivated by applications where the rewards are private, we provide a differentially private successive elimination algorithm whose sample complexity is finite even for distributions with infinite support-size, and we characterize its sample complexity. Our algorithms do not require prior knowledge of either the suboptimality gap or other statistical information related to the bandit problem at hand.


title: Separability of the Planar $1/\rho^{2}$ Potential In Multiple Coordinate Systems

abstract: With a number of special Hamiltonians, solutions of the Schr\"{o}dinger equation may be found by separation of variables in more than one coordinate system. The class of potentials involved includes a number of important examples, including the isotropic harmonic oscillator and the Coulomb potential. Multiply separable Hamiltonians exhibit a number of interesting features, including "accidental" degeneracies in their bound state spectra and often classical bound state orbits that always close. We examine another potential, for which the Schr\"{o}dinger equation is separable in both cylindrical and parabolic coordinates: a $z$-independent $V\propto 1/\rho^{2}=1/(x^{2}+y^{2})$ in three dimensions. All the persistent, bound classical orbits in this potential close, because all other orbits with negative energies fall to the center at $\rho=0$. When separated in parabolic coordinates, the Schr\"{o}dinger equation splits into three individual equations, two of which are equivalent to the radial equation in a Coulomb potential---one equation with an attractive potential, the other with an equally strong repulsive potential.


title: Machine-Learning Interatomic Potentials Enable First-Principles Multiscale Modeling of Lattice Thermal Conductivity in Graphene/Borophene Heterostructures

abstract: One of the ultimate goals of computational modeling in condensed matter is to be able to accurately compute materials properties with minimal empirical information. First-principles approaches such as the density functional theory (DFT) provide the best possible accuracy on electronic properties but they are limited to systems up to a few hundreds, or at most thousands of atoms. On the other hand, classical molecular dynamics (CMD) simulations and finite element method (FEM) are extensively employed to study larger and more realistic systems, but conversely depend on empirical information. Here, we show that machine-learning interatomic potentials (MLIPs) trained over short ab-initio molecular dynamics trajectories enable first-principles multiscale modeling, in which DFT simulations can be hierarchically bridged to efficiently simulate macroscopic structures. As a case study, we analyze the lattice thermal conductivity of coplanar graphene/borophene heterostructures, recently synthesized experimentally (Sci. Adv. 2019; 5: eaax6444), for which no viable classical modeling alternative is presently available. Our MLIP-based approach can efficiently predict the lattice thermal conductivity of graphene and borophene pristine phases, the thermal conductance of complex graphene/borophene interfaces and subsequently enable the study of effective thermal transport along the heterostructures at continuum level. This work highlights that MLIPs can be effectively and conveniently employed to enable first-principles multiscale modeling via hierarchical employment of DFT/CMD/FEM simulations, thus expanding the capability for computational design of novel nanostructures.


title: An Integrated Optimization Model for the Multi-Port Stowage Planning and the Container Relocation Problems

abstract: This paper introduces a new optimization model that integrates the multi-port stowage planning problem with the container relocation problem. This problem is formulated as a binary mathematical programming model that must find the containers' move sequence so that the number of relocations during the whole journey of a ship, as well as the associated port yards is minimized. Modeling by binary variables to represent the cargo status in a ship and yards makes the problem very complex to be solved by exact methods. To the best of our knowledge, this integrated model has not been developed yet as that such problems are always addressed in a partitioned or hierarchical way. A demonstration of the benefits of an integrated approach is given. The model is solved in two different commercial solvers and the results for randomly generated instances are presented and compared to the hierarchical approach. Two heuristics approaches are proposed to quickly generate feasible solutions for warm-starting the model. Extensive computational tests are performed and the results indicate that the solution approaches can reach optimal solutions for small sized instances and good quality solutions on real-scale based instances within reasonable computation time. This is a promising model to support decisions in these problems in an integrated way.


title: An intermittent extreme BL Lac: MWL study of 1ES 2344+514 in an enhanced state

abstract: Extreme High-frequency BL~Lacs (EHBL) feature their synchrotron peak of the broadband spectral energy distribution (SED) at $\nu_{\rm s} \geq $10$^{17}$\,Hz. The BL~Lac object 1ES~2344+514 was included in the EHBL family because of its impressive shift of the synchrotron peak in 1996. During the following years, the source appeared to be in a low state without showing any extreme behaviours. In August 2016, 1ES~2344+514 was detected with the ground-based $\gamma$-ray telescope FACT during a high $\gamma$-ray state, triggering multi-wavelength (MWL) observations. We studied the MWL light curves of 1ES~2344+514 during the 2016 flaring state, using data from radio to VHE $\gamma$ rays taken with OVRO, KAIT, KVA, NOT, some telescopes of the GASP-WEBT collaboration at the Teide, Crimean, and St. Petersburg observatories, \textit{Swift}-UVOT, \textit{Swift}-XRT, \textit{Fermi}-LAT, FACT and MAGIC. With simultaneous observations of the flare, we built the broadband SED and studied it in the framework of a leptonic and an hadronic model. The VHE $\gamma$-ray observations show a flux level of 55\% of the Crab Nebula flux above 300\,GeV, similar to the historical maximum of 1995. The combination of MAGIC and \textit{Fermi}-LAT spectra provides an unprecedented characterization of the inverse-Compton peak for this object during a flaring episode. The $\Gamma$ index of the intrinsic spectrum in the VHE $\gamma$-ray band is $2.04\pm0.12_{\rm stat}\pm0.15_{\rm sys}$. We find the source in an extreme state with a shift of the position of the synchrotron peak to frequencies above or equal to $10^{18}$\,Hz


title: Tensor-Based Modulation for Unsourced Massive Random Access

abstract: We introduce a modulation for unsourced massive random access whereby the transmitted symbols are rank-1 tensors constructed from Grassmannian sub-constellations. The use of a low-rank tensor structure, together with tensor decomposition in order to separate the users at the receiver, allows a convenient uncoupling between multi-user separation and single-user demapping. The proposed signaling scheme is designed for the block fading channel and multiple-antenna settings, and is shown to perform well in comparison to state-of-the-art unsourced approaches.


title: Inference of Experimental Radial Impurity Transport on Alcator C-Mod: Bayesian Parameter Estimation and Model Selection

abstract: We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. We find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

categories: physics.plasm-ph physics.app-ph physics.comp-ph physics.data-an


title: Multigrid-in-Channels Architectures for Wide Convolutional Neural Networks

abstract: We present a multigrid approach that combats the quadratic growth of the number of parameters with respect to the number of channels in standard convolutional neural networks (CNNs). It has been shown that there is a redundancy in standard CNNs, as networks with much sparser convolution operators can yield similar performance to full networks. The sparsity patterns that lead to such behavior, however, are typically random, hampering hardware efficiency. In this work, we present a multigrid-in-channels approach for building CNN architectures that achieves full coupling of the channels, and whose number of parameters is linearly proportional to the width of the network. To this end, we replace each convolution layer in a generic CNN with a multilevel layer consisting of structured (i.e., grouped) convolutions. Our examples from supervised image classification show that applying this strategy to residual networks and MobileNetV2 considerably reduces the number of parameters without negatively affecting accuracy. Therefore, we can widen networks without dramatically increasing the number of parameters or operations.


title: Compatibility conditions of continua using Riemann-Cartan geometry

abstract: The compatibility conditions for generalised continua are studied in the framework of differential geometry, in particular Riemann-Cartan geometry. We show that Vall\'{e}e's compatibility condition in linear elasticity theory is equivalent to the vanishing of the three dimensional Einstein tensor. Moreover, we show that the compatibility condition satisfied by Nye's tensor also arises from the three dimensional Einstein tensor which appears to play a pivotal role in continuum mechanics not mentioned before. We discuss further compatibility conditions which can be obtained using our geometrical approach and apply it to the micro-continuum theories.


title: Spatial inhomogeneity and the metal-insulator transition in Ca$_3$(Ru$_{1-x}$Ti$_x$)$_2$O$_7$

abstract: Turning a pristine Mott insulator into a correlated metal by chemical doping is a common procedure in strongly correlated materials physics, e.g. underlying the phenomenology of high-$T_c$ cuprates. The ruthenate bilayer compound Ca$_3$Ru$_2$O$_7$ is a prominent example of a reversed case, namely a correlated metal at stoichiometry that realizes a transition into an insulating state via Ti doping. We here investigate this puzzling metal-insulator transition (MIT) by first-principles many-body theory and elucidate a challenging interplay between electronic correlations and symmetry breakings on the Ru sublattice. While average effects on the Ca$_3$Ru$_2$O$_7$ crystal structure are still relevant, key to the MIT is the cooperation of electronic correlations with the spatial inhomogeneity in the defect regime. Together they give rise to the emergence of site-selective Mott criticality and competing orbital-ordering tendencies.


title: QCD2019 Workshop Summary

abstract: The topical workshop {\it Strong QCD from Hadron Structure Experiments} took place at Jefferson Lab from Nov. 6-9, 2019. Impressive progress in relating hadron structure observables to the strong QCD mechanisms has been achieved from the {\it ab initio} QCD description of hadron structure in a diverse array of methods in order to expose emergent phenomena via quasi-particle formation. The wealth of experimental data and the advances in hadron structure theory make it possible to gain insight into strong interaction dynamics in the regime of large quark-gluon coupling (the strong QCD regime), which will address the most challenging problems of the Standard Model on the nature of the dominant part of hadron mass, quark-gluon confinement, and the emergence of the ground and excited state hadrons, as well as atomic nuclei, from QCD. This workshop aimed to develop plans and to facilitate the future synergistic efforts between experimentalists, phenomenologists, and theorists working on studies of hadron spectroscopy and structure with the goal to connect the properties of hadrons and atomic nuclei available from data to the strong QCD dynamics underlying their emergence from QCD. These results pave the way for a future breakthrough extension in the studies of QCD with an Electron-Ion Collider in the U.S.


title: Query Training: Learning a Worse Model to Infer Better Marginals in Undirected Graphical Models with Hidden Variables

abstract: Probabilistic graphical models (PGMs) provide a compact representation of knowledge that can be queried in a flexible way: after learning the parameters of a graphical model once, new probabilistic queries can be answered at test time without retraining. However, when using undirected PGMS with hidden variables, two sources of error typically compound in all but the simplest models (a) learning error (both computing the partition function and integrating out the hidden variables is intractable); and (b) prediction error (exact inference is also intractable). Here we introduce query training (QT), a mechanism to learn a PGM that is optimized for the approximate inference algorithm that will be paired with it. The resulting PGM is a worse model of the data (as measured by the likelihood), but it is tuned to produce better marginals for a given inference algorithm. Unlike prior works, our approach preserves the querying flexibility of the original PGM: at test time, we can estimate the marginal of any variable given any partial evidence. We demonstrate experimentally that QT can be used to learn a challenging 8-connected grid Markov random field with hidden variables and that it consistently outperforms the state-of-the-art AdVIL when tested on three undirected models across multiple datasets.


title: Evidence for increasing frequency of extreme coastal sea levels

abstract: Projections of extreme sea levels (ESLs) are critical for managing coastal risks, but are made complicated by deep uncertainties. One key uncertainty is the choice of model structure used to estimate coastal hazards. Differences in model structural choices contribute to uncertainty in estimated coastal hazard, so it is important to characterize how model structural choice affects estimates of ESL. Here, we present a collection of 36 ESL data sets, from tide gauge stations along the United States East and Gulf Coasts. The data are processed using both annual block maxima and peaks-over-thresholds approaches for modeling distributions of extremes. We use these data sets to fit a suite of potentially nonstationary extreme value models by covarying the ESL statistics with multiple climate variables. We demonstrate how this data set enables inquiry into deep uncertainty surrounding coastal hazards. For all of the models and sites considered here, we find that accounting for changes in the frequency of coastal extreme sea levels provides a better fit than using a stationary extreme value model.


title: Automated Identification of Thoracic Pathology from Chest Radiographs with Enhanced Training Pipeline

abstract: Chest x-rays are the most common radiology studies for diagnosing lung and heart disease. Hence, a system for automated pre-reporting of pathologic findings on chest x-rays would greatly enhance radiologists' productivity. To this end, we investigate a deep-learning framework with novel training schemes for classification of different thoracic pathology labels from chest x-rays. We use the currently largest publicly available annotated dataset ChestX-ray14 of 112,120 chest radiographs of 30,805 patients. Each image was annotated with either a 'NoFinding' class, or one or more of 14 thoracic pathology labels. Subjects can have multiple pathologies, resulting in a multi-class, multi-label problem. We encoded labels as binary vectors using k-hot encoding. We study the ResNet34 architecture, pre-trained on ImageNet, where two key modifications were incorporated into the training framework: (1) Stochastic gradient descent with momentum and with restarts using cosine annealing, (2) Variable image sizes for fine-tuning to prevent overfitting. Additionally, we use a heuristic algorithm to select a good learning rate. Learning with restarts was used to avoid local minima. Area Under receiver operating characteristics Curve (AUC) was used to quantitatively evaluate diagnostic quality. Our results are comparable to, or outperform the best results of current state-of-the-art methods with AUCs as follows: Atelectasis:0.81, Cardiomegaly:0.91, Consolidation:0.81, Edema:0.92, Effusion:0.89, Emphysema: 0.92, Fibrosis:0.81, Hernia:0.84, Infiltration:0.73, Mass:0.85, Nodule:0.76, Pleural Thickening:0.81, Pneumonia:0.77, Pneumothorax:0.89 and NoFinding:0.79. Our results suggest that, in addition to using sophisticated network architectures, a good learning rate, scheduler and a robust optimizer can boost performance.


title: Benchmarking at the Frontier of Hardware Security: Lessons from Logic Locking

abstract: Integrated circuits (ICs) are the foundation of all computing systems. They comprise high-value hardware intellectual property (IP) that are at risk of piracy, reverse-engineering, and modifications while making their way through the geographically-distributed IC supply chain. On the frontier of hardware security are various design-for-trust techniques that claim to protect designs from untrusted entities across the design flow. Logic locking is one technique that promises protection from the gamut of threats in IC manufacturing. In this work, we perform a critical review of logic locking techniques in the literature, and expose several shortcomings. Taking inspiration from other cybersecurity competitions, we devise a community-led benchmarking exercise to address the evaluation deficiencies. In reflecting on this process, we shed new light on deficiencies in evaluation of logic locking and reveal important future directions. The lessons learned can guide future endeavors in other areas of hardware security.


title: A flexible parametric accelerated failure time model

abstract: Accelerated failure time (AFT) models are used widely in medical research, though to a much lesser extent than proportional hazards models. In an AFT model, the effect of covariates act to accelerate or decelerate the time to event of interest, i.e. shorten or extend the time to event. Commonly used parametric AFT models are limited in the underlying shapes that they can capture. In this article, we propose a general parametric AFT model, and in particular concentrate on using restricted cubic splines to model the baseline to provide substantial flexibility. We then extend the model to accommodate time-dependent acceleration factors. Delayed entry is also allowed, and hence, time-dependent covariates. We evaluate the proposed model through simulation, showing substantial improvements compared to standard parametric AFT models. We also show analytically and through simulations that the AFT models are collapsible, suggesting that this model class will be well suited to causal inference. We illustrate the methods with a dataset of patients with breast cancer. User friendly Stata and R software packages are provided.


title: Limit behavior of the invariant measure for Langevin dynamics

abstract: In this manuscript, we consider the Langevin dynamics on $\mathbb{R}^d$ with an overdamped vector field and driven by multiplicative Brownian noise of small amplitude $\sqrt{\epsilon}$, $\epsilon>0$. Under suitable assumptions on the vector field and the diffusion coefficient, it is well-known that it possesses a unique invariant probability measure $\mu^{\epsilon}$. As $\epsilon$ tends to zero, we prove that the probability measure $\epsilon^{d/2} \mu^{\epsilon}(\sqrt{\epsilon}\mathrm{d} x)$ converges in the $p$-Wasserstein distance for $p\in [1,2]$ to a Gaussian measure with zero-mean vector and non-degenerate covariance matrix which solves a Lyapunov matrix equation. Moreover, the error term is estimated. We emphasize that generically no explicit formula for $\mu^{\epsilon}$ can be found.


title: A Stochastic Biomass Blending Problem in Decentralized Supply Chains

abstract: Blending biomass materials of different physical or chemical properties provides an opportunity to adjust the quality of the feedstock to meet the specifications of the conversion platform. We propose a model which identifies the right mix of biomass to optimize the performance of the thermochemical conversion process at the minimum cost. This is a chance-constraint programming (CCP) model which takes into account the stochastic nature of biomass quality. The proposed CCP model ensures that process requirements, which are impacted by physical and chemical properties of biomass, are met most of the time. We consider two problem settings, a centralized and a decentralized supply chain. We propose a mixed-integer linear program to model the blending problem in the centralized setting and a bilevel program to model the blending problem in the decentralized setting. We use the sample average approximation (SAA) method to approximate the chance constraints, and propose solution algorithms to solve this approximation. We develop a case study for South Carolina using data provided by the Billion Ton Study. Based on our results, the blends identified consist mainly of pine and softwood residues. The cost of the centralized supply chain is 2 to 6% lower, which shows that the assumption of centralized decision making leads to underestimating costs in the supply chain.


title: Complete Order Equivalence of Spin Unitaries

abstract: This paper is a study of linear spaces of matrices and linear maps on matrix algebras that arise from \emph{spin systems}, or \emph{spin unitaries}, which are finite sets $\mathcal S$ of selfadjoint unitary matrices such that any two unitaries in $\mathcal S$ anticommute. We are especially interested in linear isomorphisms between these linear spaces of matrices such that the matricial order within these spaces is preserved; such isomorphisms are called complete order isomorphisms, which might be viewed as weaker notion of unitary similarity. The main result of this paper shows that all $m$-tuples of anticommuting selfadjoint unitary matrices are equivalent in this sense, meaning that there exists a unital complete order isomorphism between the unital linear subspaces that these tuples generate. We also show that the C$^*$-envelope of any operator system generated by a spin system of cardinality $2k$ or $2k+1$ is the simple matrix algebra $\mathcal M_{2^k}(\mathbb C)$. As an application of the main result, we show that the free spectrahedra determined by spin unitaries depend only upon the number of the unitaries, not upon the particular choice of unitaries, and we give a new, direct proof of the fact [Helton-Klep-McCullough-Schweighofer, "Dilations, linear matrix inequalities, the matrix cube problem and beta distributions", Mem. Amer. Math. Soc. 257(2019)] that the spin ball $\mathfrak B_m^{\rm spin}$ and max ball $\mathfrak B_m^{\rm max}$ coincide as matrix convex sets in the cases $m=1,2$. We also derive analogous results for countable spin systems and their C$^*$-envelopes.


title: Sublinear Circuits and the Constrained Signomial Nonnegativity Problem

abstract: Conditional Sums-of-AM/GM-Exponentials (conditional SAGE) is a decomposition method to prove nonnegativity of a signomial or polynomial over some subset $X$ of real space. In this article, we undertake the first structural analysis of conditional SAGE signomials for convex sets $X$. We introduce the $X$-circuits of a finite subset $\mathcal{A} \subset \mathbb{R}^n$, which generalize the simplicial circuits of the affine-linear matroid induced by $\mathcal{A}$ to a constrained setting. The $X$-circuits serve as the main tool in our analysis and exhibit particularly rich combinatorial properties for polyhedral $X$, in which case the set of $X$-circuits is comprised of one-dimensional cones of suitable polyhedral fans. The framework of $X$-circuits transparently reveals when an $X$-nonnegative conditional AM/GM-exponential can in fact be further decomposed as a sum of simpler $X$-nonnegative signomials. We develop a duality theory for $X$-circuits with connections to geometry of sets that are convex according to the geometric mean. This theory provides an optimal power cone reconstruction of conditional SAGE signomials when $X$ is polyhedral. In conjunction with a notion of reduced $X$-circuits, the duality theory facilitates a characterization of the extreme rays of conditional SAGE cones. Since signomials under logarithmic variable substitutions give polynomials, our results also have implications for nonnegative polynomials and polynomial optimization.


title: Population kinetics of many-electron atoms in ionizing plasmas studied using a continuous collisional radiative model

abstract: Collisional--radiative (CR) models based on \textit{ab initio} atomic structure calculation have been utilized over 20 years to analyze many-electron atomic and ionic spectra. Although the population distribution of the excited states in plasmas and their emission spectra are computed using the CR models, systematic and analytical understanding of the population kinetics are still lacking. % In this work, we present a reduced model of the population dynamics in many-electron atomic ions, in which we approximate the dense energy structure of complex many-electron atoms by a continuum, a continuous CR model (CCRM). Using this simplification, we show an analytical population distribution of many-electron atoms in plasmas and its electron-density and temperature dependence. % In particular, the CCRM shows that the population distribution of highly excited states of many-electron atoms in plasmas resembles a Boltzmann distribution but with an effective excitation temperature. We also show the existence of three typical electron-density regions and two electron-temperature regions where the parameter dependence of the excitation temperature is different. Analytical representations of the effective excitation temperature and the boundaries of these phases are also presented.


title: Symbolic Regression using Mixed-Integer Nonlinear Optimization

abstract: The Symbolic Regression (SR) problem, where the goal is to find a regression function that does not have a pre-specified form but is any function that can be composed of a list of operators, is a hard problem in machine learning, both theoretically and computationally. Genetic programming based methods, that heuristically search over a very large space of functions, are the most commonly used methods to tackle SR problems. An alternative mathematical programming approach, proposed in the last decade, is to express the optimal symbolic expression as the solution of a system of nonlinear equations over continuous and discrete variables that minimizes a certain objective, and to solve this system via a global solver for mixed-integer nonlinear programming problems. Algorithms based on the latter approach are often very slow. We propose a hybrid algorithm that combines mixed-integer nonlinear optimization with explicit enumeration and incorporates constraints from dimensional analysis. We show that our algorithm is competitive, for some synthetic data sets, with a state-of-the-art SR software and a recent physics-inspired method called AI Feynman.


title: Modelling Hierarchical Structure between Dialogue Policy and Natural Language Generator with Option Framework for Task-oriented Dialogue System

abstract: Designing task-oriented dialogue systems is a challenging research topic, since it needs not only to generate utterances fulfilling user requests but also to guarantee the comprehensibility. Many previous works trained end-to-end (E2E) models with supervised learning (SL), however, the bias in annotated system utterances remains as a bottleneck. Reinforcement learning (RL) deals with the problem through using non-differentiable evaluation metrics (e.g., the success rate) as rewards. Nonetheless, existing works with RL showed that the comprehensibility of generated system utterances could be corrupted when improving the performance on fulfilling user requests. In our work, we (1) propose modelling the hierarchical structure between dialogue policy and natural language generator (NLG) with the option framework, called HDNO, where the latent dialogue act is applied to avoid designing specific dialogue act representations; (2) train HDNO via hierarchical reinforcement learning (HRL), as well as suggest the asynchronous updates between dialogue policy and NLG during training to theoretically guarantee their convergence to a local maximizer; and (3) propose using a discriminator modelled with language models as an additional reward to further improve the comprehensibility. We test HDNO on MultiWoz 2.0 and MultiWoz 2.1, the datasets on multi-domain dialogues, in comparison with word-level E2E model trained with RL, LaRL and HDSA, showing improvements on the performance evaluated by automatic evaluation metrics and human evaluation. Finally, we demonstrate the semantic meanings of latent dialogue acts to show the explanability for HDNO.


title: Discussing Privacy and Surveillance on Twitter: A Case Study of COVID-19

abstract: Technology is uniquely positioned to help us analyze large amounts of information to provide valuable insight during widespread public health concerns, like the ongoing COVID-19 pandemic. In fact, information technology companies like Apple and Google have recently launched tools for contact tracing-the ability to process location data to determine the people who have been in contact with a possible patient, in order to contain the spread of the virus. While China and Singapore have successfully led the effort, more and more countries are now implementing such surveillance systems, raising potential privacy concerns about this long term surveillance. For example, it is not clear what happens to the information post-pandemic because people are more likely to share their information during a global crisis without governments having to elaborate on their data policies. Digital Ethnography on Twitter, which has over 330 million users worldwide, with a majority in the United States where the pandemic has the worst effects provides a unique opportunity to learn about real-time opinions of the general public about current affairs in a rather naturalistic setting. Consequently, it might be useful to highlight the privacy concerns of users, should they exist, through analysis of Twitter data and information sharing policies during unprecedented public health outbreaks. This will allow governments to protect their citizens both during and after health emergencies.


title: K-moduli of curves on a quadric surface and K3 surfaces

abstract: We show that the K-moduli spaces of log Fano pairs $(\mathbb{P}^1\times\mathbb{P}^1, cC)$ where $C$ is a $(4,4)$-curve and their wall crossings coincide with the VGIT quotients of $(2,4)$ complete intersection curves in $\mathbb{P}^3$. This, together with recent results by Laza-O'Grady, implies that these K-moduli spaces form a natural interpolation between the GIT moduli space of $(4,4)$-curves on $\mathbb{P}^1\times\mathbb{P}^1$ and the Baily-Borel compactification of moduli of quartic hyperelliptic K3 surfaces.


title: Effects of tilt on the orientation dynamics of the large-scale circulation in turbulent Rayleigh-B{\'e}nard convection

abstract: We experimentally test the effects of tilting a turbulent Rayleigh-B{\'e}nard convection cell on the dynamics of the large-scale circulation (LSC) orientation $\theta_0$. The probability distribution of $\theta_0$ is measured, and used to obtain a tilt-induced potential acting on $\theta_0$, which is used in a low-dimensional model of diffusion of $\theta_0$ in a potential. The form of the potential is sinusoidal in $\theta_0$, and linear in tilt angle for small tilt angles, which is explained by a simple geometric model of the vector direction of the mean buoyancy force acting on the LSC. However, the magnitude of the tilt-induced forcing is found to be two orders of magnitude larger than previously predicted. When this parameter is adjusted to match values obtained from the probability distribution of $\theta_0$, the diffusive model can quantitatively predict effects of tilt on $\theta_0$. In particular, tilt causes a change in potential barrier height between neighboring corners of a cubic cell, and changes in the barrier-crossing rate for $\theta_0$ to escape a corner are predicted with an accuracy of $\pm30\%$. As a cylindrical cell is tilted, the tilt-induced potential provides a restoring force which induces oscillations when it exceeds the strength of damping; this critical tilt angle is predicted within 20\%, and the prediction is consistent with measured oscillation frequencies. These observations show that a self-consistent low-dimensional model can be extended to include the dynamics of $\theta_0$ due to tilt. However, the underprediction of the effect of tilt on $\theta_0$ warrants revisiting the predicted magnitude.


title: Multiband Polarimetric Imaging of HR 4796A with the Gemini Planet Imager

abstract: HR4796A hosts a well-studied debris disk with a long history due to its high fractional luminosity and favorable inclination lending itself well to both unresolved and resolved observations. We present new J- and K1-band images of the resolved debris disk HR4796A taken in the polarimetric mode of the Gemini Planet Imager (GPI). The polarized intensity features a strongly forward scattered brightness distribution and is undetected at the far side of the disk. The total intensity is detected at all scattering angles and also exhibits a strong forward scattering peak. We use a forward modelled geometric disk in order to extract geometric parameters, polarized fraction and total intensity scattering phase functions for these data as well as H-band data previously taken by GPI. We find the polarized phase function becomes increasingly more forward scattering as wavelength increases. We fit Mie and distribution of hollow spheres grain (DHS) models to the extracted functions. We find that while it is possible to describe generate a satisfactory model for the total intensity using a DHS model, but not with a Mie model. We find that no single grain population of DHS or Mie grains of arbitrary composition can simultaneously reproduce the polarized fraction and total intensity scattering phase functions, indicating the need for more sophisticated grain models.


title: A robust modeling framework for energy analysis of data centers

abstract: Global digitalization has given birth to the explosion of digital services in approximately every sector of contemporary life. Applications of artificial intelligence, blockchain technologies, and internet of things are promising to accelerate digitalization further. As a consequence, the number of data centers, which provide the services of data processing, storage, and communication services, is also increasing rapidly. Because data centers are energy-intensive with significant and growing electricity demand, an energy model of data centers with temporal, spatial, and predictive analysis capability is critical for guiding industry and governmental authorities for making technology investment decisions. However, current models fail to provide consistent and high dimensional energy analysis for data centers due to severe data gaps. This can be further attributed to the lack of the modeling capabilities for energy analysis of data center components including IT equipment and data center cooling and power provisioning infrastructure in current energy models. In this research, a technology-based modeling framework, in hybrid with a data-driven approach, is proposed to address the knowledge gaps in current data center energy models. The research aims to provide policy makers and data center energy analysts with comprehensive understanding of data center energy use and efficiency opportunities and a better understanding of macro-level data center energy demand and energy saving potentials, in addition to the technological barriers for adopting energy efficiency measures.


title: Calendar Graph Neural Networks for Modeling Time Structures in Spatiotemporal User Behaviors

abstract: User behavior modeling is important for industrial applications such as demographic attribute prediction, content recommendation, and target advertising. Existing methods represent behavior log as a sequence of adopted items and find sequential patterns; however, concrete location and time information in the behavior log, reflecting dynamic and periodic patterns, joint with the spatial dimension, can be useful for modeling users and predicting their characteristics. In this work, we propose a novel model based on graph neural networks for learning user representations from spatiotemporal behavior data. A behavior log comprises a sequence of sessions; and a session has a location, start time, end time, and a sequence of adopted items. Our model's architecture incorporates two networked structures. One is a tripartite network of items, sessions, and locations. The other is a hierarchical calendar network of hour, week, and weekday nodes. It first aggregates embeddings of location and items into session embeddings via the tripartite network, and then generates user embeddings from the session embeddings via the calendar structure. The user embeddings preserve spatial patterns and temporal patterns of a variety of periodicity (e.g., hourly, weekly, and weekday patterns). It adopts the attention mechanism to model complex interactions among the multiple patterns in user behaviors. Experiments on real datasets (i.e., clicks on news articles in a mobile app) show our approach outperforms strong baselines for predicting missing demographic attributes.


title: To Each Optimizer a Norm, To Each Norm its Generalization

abstract: We study the implicit regularization of optimization methods for linear models interpolating the training data in the under-parametrized and over-parametrized regimes. Since it is difficult to determine whether an optimizer converges to solutions that minimize a known norm, we flip the problem and investigate what is the corresponding norm minimized by an interpolating solution. Using this reasoning, we prove that for over-parameterized linear regression, projections onto linear spans can be used to move between different interpolating solutions. For under-parameterized linear classification, we prove that for any linear classifier separating the data, there exists a family of quadratic norms ||.||_P such that the classifier's direction is the same as that of the maximum P-margin solution. For linear classification, we argue that analyzing convergence to the standard maximum l2-margin is arbitrary and show that minimizing the norm induced by the data results in better generalization. Furthermore, for over-parameterized linear classification, projections onto the data-span enable us to use techniques from the under-parameterized setting. On the empirical side, we propose techniques to bias optimizers towards better generalizing solutions, improving their test performance. We validate our theoretical results via synthetic experiments, and use the neural tangent kernel to handle non-linear models.


title: Coronavirus Contact Tracing: Evaluating The Potential Of Using Bluetooth Received Signal Strength For Proximity Detection

abstract: We report on measurements of Bluetooth Low Energy (LE) received signal strength taken on mobile handsets in a variety of common, real-world settings. We note that a key difficulty is obtaining the ground truth as to when people are in close proximity to one another. Knowledge of this ground truth is important for accurately evaluating the accuracy with which contact events are detected by Bluetooth LE. We approach this by adopting a scenario-based approach. In summary, we find that the Bluetooth LE received signal strength can vary substantially depending on the relative orientation of handsets, on absorption by the human body, reflection/absorption of radio signals in buildings and trains. Indeed we observe that the received signal strength need not decrease with increasing distance. This suggests that the development of accurate methods for proximity detection based on Bluetooth LE received signal strength is likely to be challenging. Our measurements also suggest that combining use of Bluetooth LE contact tracing apps with adoption of new social protocols may yield benefits but this requires further investigation. For example, placing phones on the table during meetings is likely to simplify proximity detection using received signal strength. Similarly, carrying handbags with phones placed close to the outside surface. In locations where the complexity of signal propagation makes proximity detection using received signal strength problematic entry/exit from the location might instead be logged in an app by e.g. scanning a time-varying QR code or the like.


title: Combining the band-limited parameterization and Semi-Lagrangian Runge--Kutta integration for efficient PDE-constrained LDDMM

abstract: The family of PDE-constrained LDDMM methods is emerging as a particularly interesting approach for physically meaningful diffeomorphic transformations. The original combination of Gauss--Newton--Krylov optimization and Runge--Kutta integration, shows excellent numerical accuracy and fast convergence rate. However, its most significant limitation is the huge computational complexity, hindering its extensive use in Computational Anatomy applied studies. This limitation has been treated independently by the problem formulation in the space of band-limited vector fields and Semi-Lagrangian integration. The purpose of this work is to combine both in three variants of band-limited PDE-constrained LDDMM for further increasing their computational efficiency. The accuracy of the resulting methods is evaluated extensively. For all the variants, the proposed combined approach shows a significant increment of the computational efficiency. In addition, the variant based on the deformation state equation is positioned consistently as the best performing method across all the evaluation frameworks in terms of accuracy and efficiency.


title: Mixing rates for potentials of non-summable variations

abstract: Mixing rates and decay of correlations for dynamics defined by potentials with summable variations are well understood, but little is known for non-summable variations. In this paper, we exhibit upper bounds for these quantities in the case of dynamics defined by potentials with square summable variations. We obtain these bounds as corollaries of a new block coupling inequality between pair of dynamics starting with different histories. As applications of our results, we prove a new weak invariance principle and a Chernoff-type inequality.


title: On Computing the Kronecker Structure of Polynomial and Rational Matrices using Julia

abstract: In this paper we discuss the mathematical background and the computational aspects which underly the implementation of a collection of Julia functions in the MatrixPencils package for the determination of structural properties of polynomial and rational matrices. We primarily focus on the computation of the finite and infinite spectral structures (e.g., eigenvalues, zeros, poles) as well as the left and right singular structures (e.g., Kronecker indices), which play a fundamental role in the structure of the solution of many problems involving polynomial and rational matrices. The basic analysis tool is the determination of the Kronecker structure of linear matrix pencils using numerically reliable algorithms, which is used in conjunction with several linearization techniques of polynomial and rational matrices. Examples of polynomial and rational matrices, which exhibit all relevant structural features, are considered to illustrate the main mathematical concepts and the capabilities of implemented tools.


title: Fibration symmetries uncover the building blocks of biological networks

abstract: A major ambition of systems science is to uncover the building blocks of any biological network to decipher how cellular function emerges from their interactions. Here, we introduce a graph representation of the information flow in these networks as a set of input trees, one for each node, which contains all pathways along which information can be transmitted in the network. In this representation, we find remarkable symmetries in the input trees that deconstruct the network into functional building blocks called fibers. Nodes in a fiber have isomorphic input trees and thus process equivalent dynamics and synchronize their activity. Each fiber can then be collapsed into a single representative base node through an information-preserving transformation called 'symmetry fibration', introduced by Grothendieck in the context of algebraic geometry. We exemplify the symmetry fibrations in gene regulatory networks and then show that they universally apply across species and domains from biology to social and infrastructure networks. The building blocks are classified into topological classes of input trees characterized by integer branching ratios and fractal golden ratios of Fibonacci sequences representing cycles of information. Thus, symmetry fibrations describe how complex networks are built from the bottom up to process information through the synchronization of their constitutive building blocks.


title: A useful technique for piecewise deterministic Markov decision processes

abstract: This paper presents with justifications a technique that is useful for the study of piecewise deterministic Markov decision processes (PDMDPs) with general policies and unbounded transition intensities. This technique produces an auxiliary PDMDP from the original one. As to be discussed and claified, the auxiliary PDMDP possesses certain desired properties, which may not be possessed by the original PDMDP. Moreover, the performance measure of any policy in the original PDMDP can be replicated by the auxiliary PDMDP for a large class of performance criteria. As an application, we apply this technique to risk-sensitive PDMDPs with total cost criteria.


title: A Fast, Simple, Robust Algorithm for Coronal Temperature Reconstruction

abstract: We describe a new algorithm for reconstruction of Differential Emission Measures (DEMs) in the solar corona. Although a number of such algorithms currently exist, they can have difficulty converging for some cases, and can be complex, slow, or idiosyncratic in their output (i.e., their inversions can have features that are a result of the inversion code and instrument response, not of the solar source); we will document some of these issues in this paper. The new algorithm described here significantly reduces these drawbacks and is particularly notable for its simplicity; it is reproduced here, in full, on a single page. After we describe the algorithm, we compare its performance and fidelity with some prevalent methods. Although presented here for extreme ultraviolet (EUV) data, the algorithm is robust and extensible to any other wavelengths (e.g., X-rays) where the DEM treatment is valid.


title: Probing fMRI brain connectivity and activity changes during emotion regulation by EEG neurofeedback

abstract: Neurofeedback is a non-invasive brain training with long-term medical and non-medical applications. Despite the existence of several emotion regulation studies using neurofeedback, further investigation is needed to understand interactions of the brain regions involved in the process. We implemented EEG neurofeedback with simultaneous fMRI using a modified happiness-inducing task through autobiographical memories to upregulate positive emotion. The results showed increased activity of prefrontal, occipital, parietal, and limbic regions and increased functional connectivity between prefrontal, parietal, limbic system, and insula in the experimental group. New connectivity links were identified by comparing the functional connectivity of different experimental conditions within the experimental group and between the experimental and control groups. The proposed multimodal approach quantified the changes in the brain activity (up to 1.9% increase) and connectivity (FDR-corrected for multiple comparison, q = 0.05) during emotion regulation in/between prefrontal, parietal, limbic, and insula regions. Psychometric assessments confirmed significant changes in positive and negative mood states by neurofeedback with a p-value smaller than 0.002 in the experimental group. This study quantifies the effects of EEG neurofeedback in changing functional connectivity of all brain regions involved in emotion regulation. For the brain regions involved in emotion regulation, we found significant BOLD and functional connectivity increases due to neurofeedback in the experimental group but no learning effect was observed in the control group. The results reveal the neurobiological substrate of emotion regulation by the EEG neurofeedback and separate the effect of the neurofeedback and the recall of the autobiographical memories.


title: Data Augmentation for Graph Neural Networks

abstract: Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs, which limits possible manipulation operations. Augmentation operations commonly used in vision and language have no analogs for graphs. Our work studies graph data augmentation for graph neural networks (GNNs) in the context of improving semi-supervised node-classification. We discuss practical and theoretical motivations, considerations and strategies for graph data augmentation. Our work shows that neural edge predictors can effectively encode class-homophilic structure to promote intra-class edges and demote inter-class edges in given graph structure, and our main contribution introduces the GAug graph data augmentation framework, which leverages these insights to improve performance in GNN-based node classification via edge prediction. Extensive experiments on multiple benchmarks show that augmentation via GAug improves performance across GNN architectures and datasets.


title: Algorithmic recourse under imperfect causal knowledge: a probabilistic approach

abstract: Recent work has discussed the limitations of counterfactual explanations to recommend actions for algorithmic recourse, and argued for the need of taking causal relationships between features into consideration. Unfortunately, in practice, the true underlying structural causal model is generally unknown. In this work, we first show that it is impossible to guarantee recourse without access to the true structural equations. To address this limitation, we propose two probabilistic approaches to select optimal actions that achieve recourse with high probability given limited causal knowledge (e.g., only the causal graph). The first captures uncertainty over structural equations under additive Gaussian noise, and uses Bayesian model averaging to estimate the counterfactual distribution. The second removes any assumptions on the structural equations by instead computing the average effect of recourse actions on individuals similar to the person who seeks recourse, leading to a novel subpopulation-based interventional notion of recourse. We then derive a gradient-based procedure for selecting optimal recourse actions, and empirically show that the proposed approaches lead to more reliable recommendations under imperfect causal knowledge than non-probabilistic baselines.


title: Quasi-independence models with rational maximum likelihood estimator

abstract: We classify the two-way independence quasi-independence models (or independence models with structural zeros) that have rational maximum likelihood estimators, or MLEs. We give a necessary and sufficient condition on the bipartite graph associated to the model for the MLE to be rational. In this case, we give an explicit formula for the MLE in terms of combinatorial features of this graph. We also use the Horn uniformization to show that for general log-linear models $\mathcal{M}$ with rational MLE, any model obtained by restricting to a face of the cone of sufficient statistics of $\mathcal{M}$ also has rational MLE.


title: An improved result for Falconer's distance set problem in even dimensions

abstract: We show that if compact set $E\subset \mathbb{R}^d$ has Hausdorff dimension larger than $\frac{d}{2}+\frac{1}{4}$, where $d\geq 4$ is an even integer, then the distance set of $E$ has positive Lebesgue measure. This improves the previously best known result towards Falconer's distance set conjecture in even dimensions.