title: Quick Question: Interrupting Users for Microtasks with Reinforcement Learning

abstract: Human attention is a scarce resource in modern computing. A multitude of microtasks vie for user attention to crowdsource information, perform momentary assessments, personalize services, and execute actions with a single touch. A lot gets done when these tasks take up the invisible free moments of the day. However, an interruption at an inappropriate time degrades productivity and causes annoyance. Prior works have exploited contextual cues and behavioral data to identify interruptibility for microtasks with much success. With Quick Question, we explore use of reinforcement learning (RL) to schedule microtasks while minimizing user annoyance and compare its performance with supervised learning. We model the problem as a Markov decision process and use Advantage Actor Critic algorithm to identify interruptible moments based on context and history of user interactions. In our 5-week, 30-participant study, we compare the proposed RL algorithm against supervised learning methods. While the mean number of responses between both methods is commensurate, RL is more effective at avoiding dismissal of notifications and improves user experience over time.


title: Unique determination of absorption coefficients in a semilinear transport equation

abstract: Motivated by applications in quantitative photoacoustic imaging, we study inverse problems to a semilinear radiative transport equation (RTE) where we intend to reconstruct absorption coefficients in the equation from single and multiple internal data sets. We derive uniqueness and stability results for the inverse transport problem in the absence of scattering (in which case we also derive some explicit reconstruction methods) and in the presence of known scattering.


title: CO Depletion in Protoplanetary Disks: A Unified Picture Combining Physical Sequestration and Chemical Processing

abstract: The gas-phase CO abundance (relative to hydrogen) in protoplanetary disks decreases by up to 2 orders of magnitude from its ISM value ${\sim}10^{-4}$, even after accounting for freeze-out and photo-dissociation. Previous studies have shown that while local chemical processing of CO and the sequestration of CO ice on solids in the midplane can both contribute, neither of these processes appears capable of consistently reaching the observed depletion factors on the relevant timescale of $1{-}3\mathrm{~Myr}$. In this study, we model these processes simultaneously by including a compact chemical network (centered on carbon and oxygen) to 2D ($r+z$) simulations of the outer ($r>20\mathrm{~au}$) disk regions that include turbulent diffusion, pebble formation, and pebble dynamics. In general, we find that the CO/H$_2$ abundance is a complex function of time and location. Focusing on CO in the warm molecular layer, we find that only the most complete model (with chemistry and pebble evolution included) can reach depletion factors consistent with observations. In the absence of pressure traps, highly-efficient planetesimal formation, or high cosmic ray ionization rates, this model also predicts a resurgence of CO vapor interior to the CO snowline. We show the impact of physical and chemical processes on the elemental (C/O) and (C/H) ratios (in the gas and ice phases), discuss the use of CO as a disk mass tracer, and, finally, connect our predicted pebble ice compositions to those of pristine planetesimals as found in the Cold Classical Kuiper Belt and debris disks.


title: The Effect of Supernovae on the Turbulence and Dispersal of Molecular Clouds

abstract: While the importance of supernova feedback in galaxies is well established, its role on the scale of molecular clouds is still debated. In this work, we focus on the impact of supernovae on individual clouds, using a high-resolution magneto-hydrodynamic simulation of a region of 250 pc where we resolve the formation of individual massive stars. The supernova feedback is implemented with real supernovae that are the natural evolution of the resolved massive stars, so their position and timing are self-consistent. We select a large sample of molecular clouds from the simulation to investigate the supernova energy injection and the resulting properties of molecular clouds. We find that molecular clouds have a lifetime of a few dynamical times, less then half of them contract to the point of becoming gravitationally bound, and the dispersal time of bound clouds, of order one dynamical time, is a factor of two shorter than that of unbound clouds. We stress the importance of internal supernovae, that is massive stars that explode inside their parent cloud, in setting the cloud dispersal time, and their huge overdensity compared to models where the supernovae are randomly distributed. We also quantify the energy injection efficiency of supernovae as a function of supernova distance to the clouds. We conclude that intermittent driving by supernovae can maintain molecular-cloud turbulence and may be the main process of cloud dispersal. The role of supernovae in the evolution of molecular clouds cannot be fully accounted for without a self-consistent implementation of their feedback.


title: Scheduling fixed length quarantines to minimize the total number of fatalities during an epidemic

abstract: We consider a susceptible, infected, removed (SIR) system where the transmission rate may be temporarily reduced for a fixed amount of time. We show that in order to minimize the total number of fatalities, the transmission rate should be reduced on a single contiguous time interval, and we characterize this interval via an integral condition. We conclude with a few numerical simulations showing the actual reduction obtained.


title: Holographic complexity growth for a charged AdS-dilaton black holes with fixed and dynamical boundary respectively

abstract: The holographic complexity conjectures are considered in a Einstein-Maxwell-Dilaton gravity, by using the "Complexity-Volume" proposal. Specifically, we calculate the growth rate of complexity for an eternal charged AdS-dilaton black holes with fixed and dynamical boundaries respectively. The dynamical boundary is achieved by introducing a moving self-graviting brane on which the induced metric has an exact FLRW form. In case of fixed AdS boundary, there exists a bound for evolution of growth rate on late time, while this bound will become larger as the dilaton coupling constant $\alpha$ increases. In large $\alpha$ limit, we analytically prove that this bound is a finite value which is proportional to the black hole mass. In case of dynamical boundary, namely the brane-bulk system, the growth rate decreases monotonously on late time, after reaching a maximum value at a certain time. We find that the evolution of growth rate for brane-bulk system on late time is dominated by the velocity of the moving brane. We guess this result is model-independent.


title: Tomography Based Learning for Load Distribution through Opaque Networks

abstract: Applications such as virtual reality and online gaming require low delays for acceptable user experience. A key task for over-the-top (OTT) service providers who provide these applications is sending traffic through the networks to minimize delays. OTT traffic is typically generated from multiple data centers which are multi-homed to several network ingresses. However, information about the path characteristics of the underlying network from the ingresses to destinations is not explicitly available to OTT services. These can only be inferred from external probing. In this paper, we combine network tomography with machine learning to minimize delays. We consider this problem in a general setting where traffic sources can choose a set of ingresses through which their traffic enter a black box network. The problem in this setting can be viewed as a reinforcement learning problem with constraints on a continuous action space, which to the best of our knowledge have not been investigated by the machine learning community. Key technical challenges to solving this problem include the high dimensionality of the problem and handling constraints that are intrinsic to networks. Evaluation results show that our methods achieve up to 60% delay reductions in comparison to standard heuristics. Moreover, the methods we develop can be used in a centralized manner or in a distributed manner by multiple independent agents.


title: Learning Geometry-Dependent and Physics-Based Inverse Image Reconstruction

abstract: Deep neural networks have shown great potential in image reconstruction problems in Euclidean space. However, many reconstruction problems involve imaging physics that are dependent on the underlying non-Euclidean geometry. In this paper, we present a new approach to learn inverse imaging that exploit the underlying geometry and physics. We first introduce a non-Euclidean encoding-decoding network that allows us to describe the unknown and measurement variables over their respective geometrical domains. We then learn the geometry-dependent physics in between the two domains by explicitly modeling it via a bipartite graph over the graphical embedding of the two geometry. We applied the presented network to reconstructing electrical activity on the heart surface from body-surface potential. In a series of generalization tasks with increasing difficulty, we demonstrated the improved ability of the presented network to generalize across geometrical changes underlying the data in comparison to its Euclidean alternatives.


title: Unruh and analogue Unruh temperatures for circular motion in 3+1 and 2+1 dimensions

abstract: The Unruh effect states that a uniformly linearly accelerated observer with proper acceleration $a$ experiences Minkowski vacuum as a thermal state in the temperature $T_{\text{lin}} = a/(2\pi)$, operationally measurable via the detailed balance condition between excitation and de-excitation probabilities. An observer in uniform circular motion experiences a similar Unruh-type temperature $T_{\text{circ}}$, operationally measurable via the detailed balance condition, but $T_{\text{circ}}$ depends not just on the proper acceleration but also on the orbital radius and on the excitation energy. We establish analytic results for $T_{\text{circ}}$ for a massless scalar field in $3+1$ and $2+1$ spacetime dimensions in several asymptotic regions of the parameter space, and we give numerical results in the interpolating regions. In the ultrarelativistic limit, we verify that in $3+1$ dimensions $T_{\text{circ}}$ is of the order of $T_{\text{lin}}$ uniformly in the energy, as previously found by Unruh, but in $2+1$ dimensions $T_{\text{circ}}$ is significantly lower at low energies. We translate these results to an analogue spacetime nonrelativistic field theory in which the circular acceleration effects may become experimentally testable in the near future. We establish in particular that the circular motion analogue Unruh temperature grows arbitrarily large in the near-sonic limit, encouragingly for the experimental prospects, but the growth is weaker in effective spacetime dimension $2+1$ than in $3+1$.


title: A Manifold Proximal Linear Method for Sparse Spectral Clustering with Application to Single-Cell RNA Sequencing Data Analysis

abstract: Spectral clustering is one of the fundamental unsupervised learning methods widely used in data analysis. Sparse spectral clustering (SSC) imposes sparsity to the spectral clustering and it improves the interpretability of the model. This paper considers a widely adopted model for SSC, which can be formulated as an optimization problem over the Stiefel manifold with nonsmooth and nonconvex objective. Such an optimization problem is very challenging to solve. Existing methods usually solve its convex relaxation or need to smooth its nonsmooth part using certain smoothing techniques. In this paper, we propose a manifold proximal linear method (ManPL) that solves the original SSC formulation. We also extend the algorithm to solve the multiple-kernel SSC problems, for which an alternating ManPL algorithm is proposed. Convergence and iteration complexity results of the proposed methods are established. We demonstrate the advantage of our proposed methods over existing methods via the single-cell RNA sequencing data analysis.


title: New Proximal Newton-Type Methods for Convex Optimization

abstract: In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since they do not require evaluating the Hessian at each iteration while keeping fast convergence rate. More specifically, we prove the global convergence is guaranteed and the superlinear convergence is achieved in the vicinity of an optimal solution. We also develop several practical variants by incorporating quasi-Newton and inexact subproblem solving schemes and provide theoretical guarantee for them under certain conditions. Experimental results on real-world datasets demonstrate the effectiveness and efficiency of new methods.


title: The realization of input-output maps using bialgebras

abstract: We use the theory of bialgebras to provide the algebraic background for state space realization theorems for input-output maps of control systems. This allows us to consider from a common viewpoint classical results about formal state space realizations of nonlinear systems and more recent results involving analysis related to families of trees. If $H$ is a bialgebra, we say that $p \in H^*$ is differentially produced by the algebra $R$ with the augmentation $\epsilon$ if there is right $H$-module algebra structure on $R$ and there exists $f \in R$ satisfying $p(h) = \epsilon(f \cdot h)$. We characterize those $p \in H^*$ which are differentially produced.


title: Abstraction based Output Range Analysis for Neural Networks

abstract: In this paper, we consider the problem of output range analysis for feed-forward neural networks with ReLU activation functions. The existing approaches reduce the output range analysis problem to satisfiability and optimization solving, which are NP-hard problems, and whose computational complexity increases with the number of neurons in the network. To tackle the computational complexity, we present a novel abstraction technique that constructs a simpler neural network with fewer neurons, albeit with interval weights called interval neural network (INN), which over-approximates the output range of the given neural network. We reduce the output range analysis on the INNs to solving a mixed integer linear programming problem. Our experimental results highlight the trade-off between the computation time and the precision of the computed output range.


title: Resistive AC-Coupled Silicon Detectors: principles of operation and first results from a combined analysis of beam test and laser data

abstract: This paper presents the principles of operation of Resistive AC-Coupled Silicon Detectors (RSDs) and measurements of the temporal and spatial resolutions using a combined analysis of laser and beam test data. RSDs are a new type of n-in-p silicon sensor based on the Low-Gain Avalanche Diode (LGAD) technology, where the $n^+$ implant has been designed to be resistive, and the read-out is obtained via AC-coupling. The truly innovative feature of RSD is that the signal generated by an impinging particle is shared isotropically among multiple read-out pads without the need for floating electrodes or an external magnetic field. Careful tuning of the coupling oxide thickness and the $n^+$ doping profile is at the basis of the successful functioning of this device. Several RSD matrices with different pad width-pitch geometries have been extensively tested with a laser setup in the Laboratory for Innovative Silicon Sensors in Torino, while a smaller set of devices have been tested at the Fermilab Test Beam Facility with a 120 GeV/c proton beam. The measured spatial resolution ranges between $2.5\; \mu m$ for 70-100 pad-pitch geometry and $17\; \mu m$ with 200-500 matrices, a factor of 10 better than what is achievable in binary read-out ($bin\; size/ \sqrt{12}$). Beam test data show a temporal resolution of $\sim 40\; ps$ for 200-$\mu m$ pitch devices, in line with the best performances of LGAD sensors at the same gain.


title: Single View Metrology in the Wild

abstract: Most 3D reconstruction methods may only recover scene properties up to a global scale ambiguity. We present a novel approach to single view metrology that can recover the absolute scale of a scene represented by 3D heights of objects or camera height above the ground as well as camera parameters of orientation and field of view, using just a monocular image acquired in unconstrained condition. Our method relies on data-driven priors learned by a deep network specifically designed to imbibe weakly supervised constraints from the interplay of the unknown camera with 3D entities such as object heights, through estimation of bounding box projections. We leverage categorical priors for objects such as humans or cars that commonly occur in natural images, as references for scale estimation. We demonstrate state-of-the-art qualitative and quantitative results on several datasets as well as applications including virtual object insertion. Furthermore, the perceptual quality of our outputs is validated by a user study.


title: A Distributionally Robust Approach to Fair Classification

abstract: We propose a distributionally robust logistic regression model with an unfairness penalty that prevents discrimination with respect to sensitive attributes such as gender or ethnicity. This model is equivalent to a tractable convex optimization problem if a Wasserstein ball centered at the empirical distribution on the training data is used to model distributional uncertainty and if a new convex unfairness measure is used to incentivize equalized opportunities. We demonstrate that the resulting classifier improves fairness at a marginal loss of predictive accuracy on both synthetic and real datasets. We also derive linear programming-based confidence bounds on the level of unfairness of any pre-trained classifier by leveraging techniques from optimal uncertainty quantification over Wasserstein balls.


title: A finite element method for Allen-Cahn equation on deforming surface

abstract: The paper studies an Allen-Cahn-type equation defined on a time-dependent surface as a model of phase separation with order-disorder transition in a thin material layer. By a formal inner-outer expansion, it is shown that the limiting behavior of the solution is a geodesic mean curvature type flow in reference coordinates. A geometrically unfitted finite element method, known as a trace FEM, is considered for the numerical solution of the equation. The paper provides full stability analysis and convergence analysis that accounts for interpolation errors and an approximate recovery of the geometry.


title: Fast Learning for Renewal Optimization in Online Task Scheduling

abstract: This paper considers online optimization of a renewal-reward system. A controller performs a sequence of tasks back-to-back. Each task has a random vector of parameters, called the task type vector, that affects the task processing options and also affects the resulting reward and time duration of the task. The probability distribution for the task type vector is unknown and the controller must learn to make efficient decisions so that time average reward converges to optimality. Prior work on such renewal optimization problems leaves open the question of optimal convergence time. This paper develops an algorithm with an optimality gap that decays like $O(1/\sqrt{k})$, where $k$ is the number of tasks processed. The same algorithm is shown to have faster $O(\log(k)/k)$ performance when the system satisfies a strong concavity property. The proposed algorithm uses an auxiliary variable that is updated according to a classic Robbins-Monro iteration. It makes online scheduling decisions at the start of each renewal frame based on this variable and on the observed task type. A matching converse is obtained for the strongly concave case by constructing an example system for which all algorithms have performance at best $\Omega(\log(k)/k)$. A matching $\Omega(1/\sqrt{k})$ converse is also shown for the general case without strong concavity.


title: Relativistic Nonthermal Particle Acceleration in Two-Dimensional Collisionless Magnetic Reconnection

abstract: Magnetic reconnection, especially in the relativistic regime, provides an efficient mechanism for accelerating relativistic particles and thus offers an attractive physical explanation for nonthermal high-energy emission from various astrophysical sources. I present a simple analytical model that elucidates key physical processes responsible for reconnection-driven relativistic nonthermal particle acceleration (NTPA) in the large-system, plasmoid-dominated regime in two dimensions. The model aims to explain the numerically-observed dependencies of the power-law index $p$ and high-energy cutoff $\gamma_c$ of the resulting nonthermal particle energy spectrum $f(\gamma)$ on the ambient plasma magnetization $\sigma$, and (for $\gamma_c$) on the system size $L$. In this self-similar model, energetic particles are continuously accelerated by the out-of-plane reconnection electric field $E_{\rm rec}$ until they become magnetized by the reconnected magnetic field and eventually trapped in plasmoids large enough to confine them. The model also includes diffusive Fermi acceleration by particle bouncing off rapidly moving plasmoids. I argue that the balance between electric acceleration and magnetization controls the power-law index, while trapping in plasmoids governs the cutoff, thus tying the particle energy spectrum to the plasmoid distribution.


title: A Quasi-Orthogonal Matching Pursuit Algorithm for Compressive Sensing

abstract: In this paper, we propose a new orthogonal matching pursuit algorithm called quasi-OMP algorithm which greatly enhances the performance of classical orthogonal matching pursuit (OMP) algorithm, at some cost of computational complexity. We are able to show that under some sufficient conditions of mutual coherence of the sensing matrix, the QOMP Algorithm succeeds in recovering the s-sparse signal vector x within s iterations where a total number of 2s columns are selected under the both noiseless and noisy settings. In addition, we show that for Gaussian sensing matrix, the norm of the residual of each iteration will go to zero linearly depends on the size of the matrix with high probability. The numerical experiments are demonstrated to show the effectiveness of QOMP algorithm in recovering sparse solutions which outperforms the classic OMP and GOMP algorithm.


title: A semi-analytical collocation method for solving multi-term variable-order time fractional partial differential equations

abstract: This paper presents a novel semi-analytical collocation method to solve multi-term variable-order time fractional partial differential equations (VOTFPDEs). In the proposed method it employs the Fourier series expansion for spatial discretization, which transforms the original multi-term VOTFPDEs into a sequence of multi-term variable-order time fractional ordinary differential equations (VOTFODEs). Then these VOTFODEs can be solved by using the recent-developed backward substitution method. Several numerical examples verify the accuracy and efficiency of the proposed numerical approach in the solution of multi-term VOTFPDEs.


title: Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

abstract: Mining a set of meaningful topics organized into a hierarchy is intuitively appealing since topic correlations are ubiquitous in massive text corpora. To account for potential hierarchical topic structures, hierarchical topic models generalize flat topic models by incorporating latent topic hierarchies into their generative modeling process. However, due to their purely unsupervised nature, the learned topic hierarchy often deviates from users' particular needs or interests. To guide the hierarchical topic discovery process with minimal user supervision, we propose a new task, Hierarchical Topic Mining, which takes a category tree described by category names only, and aims to mine a set of representative terms for each category from a text corpus to help a user comprehend his/her interested topics. We develop a novel joint tree and text embedding method along with a principled optimization procedure that allows simultaneous modeling of the category tree structure and the corpus generative process in the spherical space for effective category-representative term discovery. Our comprehensive experiments show that our model, named JoSH, mines a high-quality set of hierarchical topics with high efficiency and benefits weakly-supervised hierarchical text classification tasks.


title: A New Doctrine for Hardware Security

abstract: In this paper, we promote the idea that recent woes in hardware security are not because of a lack of technical solutions but rather because market forces and incentives prevent those with the ability to fix problems from doing so. At the root of the problem is the fact that hardware security comes at a cost; Present issues in hardware security can be seen as the result of the players in the game of hardware security finding ways of avoiding paying this cost. We formulate this idea into a doctrine of security, namely the Doctrine of Shared Burdens. Three cases studies---Rowhammer, Spectre, and Meltdown---are interpreted though the lens of this doctrine. Our doctrine illuminates why these problems and exist and what can be done about them.


title: Dynamic tensor approximation of high-dimensional nonlinear PDEs

abstract: We present a new method based on functional tensor decomposition and dynamic tensor approximation to compute the solution of a high-dimensional time-dependent nonlinear partial differential equation (PDE). The idea of dynamic approximation is to project the time derivative of the PDE solution onto the tangent space of a low-rank functional tensor manifold at each time. Such a projection can be computed by minimizing a convex energy functional over the tangent space. This minimization problem yields the unique optimal velocity vector that allows us to integrate the PDE forward in time on a tensor manifold of constant rank. In the case of initial/boundary value problems defined in real separable Hilbert spaces, this procedure yields evolution equations for the tensor modes in the form of a coupled system of one-dimensional time-dependent PDEs. We apply the dynamic tensor approximation to a four-dimensional Fokker-Planck equation with non-constant drift and diffusion coefficients, and demonstrate its accuracy in predicting relaxation to statistical equilibrium.


title: Gaussian kernel smoothing

abstract: Image acquisition and segmentation are likely to introduce noise. Further image processing such as image registration and parameterization can introduce additional noise. It is thus imperative to reduce noise measurements and boost signal. In order to increase the signal-to-noise ratio (SNR) and smoothness of data required for the subsequent random field theory based statistical inference, some type of smoothing is necessary. Among many image smoothing methods, Gaussian kernel smoothing has emerged as a de facto smoothing technique among brain imaging researchers due to its simplicity in numerical implementation. Gaussian kernel smoothing also increases statistical sensitivity and statistical power as well as Gausianness. Gaussian kernel smoothing can be viewed as weighted averaging of voxel values. Then from the central limit theorem, the weighted average should be more Gaussian.


title: Multi-Principal Assistance Games

abstract: Assistance games (also known as cooperative inverse reinforcement learning games) have been proposed as a model for beneficial AI, wherein a robotic agent must act on behalf of a human principal but is initially uncertain about the humans payoff function. This paper studies multi-principal assistance games, which cover the more general case in which the robot acts on behalf of N humans who may have widely differing payoffs. Impossibility theorems in social choice theory and voting theory can be applied to such games, suggesting that strategic behavior by the human principals may complicate the robots task in learning their payoffs. We analyze in particular a bandit apprentice game in which the humans act first to demonstrate their individual preferences for the arms and then the robot acts to maximize the sum of human payoffs. We explore the extent to which the cost of choosing suboptimal arms reduces the incentive to mislead, a form of natural mechanism design. In this context we propose a social choice method that uses shared control of a system to combine preference inference with social welfare optimization.


title: Same-Day Delivery with Fairness

abstract: The demand for same-day delivery (SDD) has increased rapidly in the last few years and has particularly boomed during the COVID-19 pandemic. The fast growth is not without its challenge. In 2016, due to low concentrations of memberships and far distance from the depot, certain minority neighborhoods were excluded from receiving Amazon's SDD service, raising concerns about fairness. In this paper, we study the problem of offering fair SDD-service to customers. The service area is partitioned into different regions. Over the course of a day, customers request for SDD service, and the timing of requests and delivery locations are not known in advance. The dispatcher dynamically assigns vehicles to make deliveries to accepted customers before their delivery deadline. In addition to the overall service rate (utility), we maximize the minimal regional service rate across all regions (fairness). We model the problem as a multi-objective Markov decision process and develop a deep Q-learning solution approach. We introduce a novel transformation of learning from rates to actual services, which creates a stable and efficient learning process. Computational results demonstrate the effectiveness of our approach in alleviating unfairness both spatially and temporally in different customer geographies. We also show this effectiveness is valid with different depot locations, providing businesses with an opportunity to achieve better fairness from any location. Further, we consider the impact of ignoring fairness in service, and results show that our policies eventually outperform the utility-driven baseline when customers have a high expectation on service level.


title: Liquid-liquid Phase transitions in silicon

abstract: We use computationally simple neutral pseudo-atom (`average atom') one-center density functional theory (DFT) and standard N-center DFT-Molecular Dynamics simulations to elucidate liquid-liquid phase transitions (LPTs) in supercooled liquid silicon at 1200K ,and also in silicon under warm-dense matter conditions up to 11604k (1 eV). An ionization-driven transition and three LPTs including the known LPT near 2.5 g/cm$^3$ are found. They are robust even to 1 eV. The pair distributions functions, pair potentials, electrical conductivities, and compressibilites are reported. The LPTs are elucidated within a Fermi liquid picture of electron scattering at the Fermi energy that complements the usual transient covalent bonding picture.


title: Thermal photons as a sensitive probe of $\alpha$-cluster in C+Au collisions at the BNL Relativistic Heavy Ion Collider

abstract: Different orientations of $\alpha$-clustered carbon nuclei colliding with heavy ions can result in a large variation in the value of anisotropic flow. Thus, photon flow observables from clustered ${\rm^{12}C}$ and ${\rm^{197}Au}$ collisions could be a potential probe to study the `direct photon puzzle'. We calculate the transverse momentum spectra and anisotropic flow coefficients ($v_n$) of thermal photons from collisions of triangular $\alpha$-clustered carbon and gold at $\sqrt{s_{\rm NN}}=200$ GeV at RHIC using a hydrodynamic model framework and compare the results with those obtained from unclustered carbon and gold collisions. The slope of the thermal photon spectra is found to vary moderately for different orientations of collisions. However, we find that the elliptic ($v_2$) and triangular flow ($v_3$) coefficients of direct photons for specific configurations are significantly larger and predominantly formed by the QGP radiation. A strong anti-correlation between initial spatial ellipticity and triangularity is observed in an event-by-event framework of $\alpha$-clustered ${\rm C+Au}$ collisions. These special features provide us an opportunity to detect the exotic nature of cluster structure inside carbon nucleus using the photon probe in the future experiments.


title: Strong superadditivity relations for multiqubit systems

abstract: We investigate the distributions of quantum coherence characterized by superadditivity relations in multipartite quantum systems. General superadditivity inequalities based on the $\alpha$th ($\alpha\geqslant 1$) power of $l_1$ norm of coherence are presented for multiqubit states, which include the existing ones as special cases. Our result is shown to be tighter than the existing one by a specific example.


title: ContactPose: A Dataset of Grasps with Object Contact and Hand Pose

abstract: Grasping is natural for humans. However, it involves complex hand configurations and soft tissue deformation that can result in complicated regions of contact between the hand and the object. Understanding and modeling this contact can potentially improve hand models, AR/VR experiences, and robotic grasping. Yet, we currently lack datasets of hand-object contact paired with other data modalities, which is crucial for developing and evaluating contact modeling techniques. We introduce ContactPose, the first dataset of hand-object contact paired with hand pose, object pose, and RGB-D images. ContactPose has 2306 unique grasps of 25 household objects grasped with 2 functional intents by 50 participants, and more than 2.9 M RGB-D grasp images. Analysis of ContactPose data reveals interesting relationships between hand pose and contact. We use this data to rigorously evaluate various data representations, heuristics from the literature, and learning methods for contact modeling. Data, code, and trained models are available at https://contactpose.cc.gatech.edu.


title: The ion-deposited energy formulas and their applications for the interaction of various energetic ions with carbon nanostructures

abstract: Based on Monte Carlo (MC) simulations of the interaction of energetic noble gas ions with carbon nanostructures, we have derived the ion-deposited energy formulas and their applications for the above interaction. We also have studied the nuclear point mass effects i.e. the well-known mass ratio effects, and the nuclear point charge effects on the ion-deposited energy then the damage regularities. In particular, we, for first time, find a straight line of the penetrating point threshold energies for energetic noble gas ions. Near this straight line, the nuclear point charge effects dominate the ion-deposited energy then the damage regularities.


title: Sat2Graph: Road Graph Extraction through Graph-Tensor Encoding

abstract: Inferring road graphs from satellite imagery is a challenging computer vision task. Prior solutions fall into two categories: (1) pixel-wise segmentation-based approaches, which predict whether each pixel is on a road, and (2) graph-based approaches, which predict the road graph iteratively. We find that these two approaches have complementary strengths while suffering from their own inherent limitations. In this paper, we propose a new method, Sat2Graph, which combines the advantages of the two prior categories into a unified framework. The key idea in Sat2Graph is a novel encoding scheme, graph-tensor encoding (GTE), which encodes the road graph into a tensor representation. GTE makes it possible to train a simple, non-recurrent, supervised model to predict a rich set of features that capture the graph structure directly from an image. We evaluate Sat2Graph using two large datasets. We find that Sat2Graph surpasses prior methods on two widely used metrics, TOPO and APLS. Furthermore, whereas prior work only infers planar road graphs, our approach is capable of inferring stacked roads (e.g., overpasses), and does so robustly.


title: Kinematic 3D Object Detection in Monocular Video

abstract: Perceiving the physical world in 3D is fundamental for self-driving applications. Although temporal motion is an invaluable resource to human vision for detection, tracking, and depth perception, such features have not been thoroughly utilized in modern 3D object detectors. In this work, we propose a novel method for monocular video-based 3D object detection which carefully leverages kinematic motion to improve precision of 3D localization. Specifically, we first propose a novel decomposition of object orientation as well as a self-balancing 3D confidence. We show that both components are critical to enable our kinematic model to work effectively. Collectively, using only a single model, we efficiently leverage 3D kinematics from monocular videos to improve the overall localization precision in 3D object detection while also producing useful by-products of scene dynamics (ego-motion and per-object velocity). We achieve state-of-the-art performance on monocular 3D object detection and the Bird's Eye View tasks within the KITTI self-driving dataset.


title: Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learning

abstract: Zero-shot learning (ZSL) addresses the unseen class recognition problem by leveraging semantic information to transfer knowledge from seen classes to unseen classes. Generative models synthesize the unseen visual features and convert ZSL into a classical supervised learning problem. These generative models are trained using the seen classes and are expected to implicitly transfer the knowledge from seen to unseen classes. However, their performance is stymied by overfitting, which leads to substandard performance on Generalized Zero-Shot learning (GZSL). To address this concern, we propose the novel LsrGAN, a generative model that Leverages the Semantic Relationship between seen and unseen categories and explicitly performs knowledge transfer by incorporating a novel Semantic Regularized Loss (SR-Loss). The SR-loss guides the LsrGAN to generate visual features that mirror the semantic relationships between seen and unseen classes. Experiments on seven benchmark datasets, including the challenging Wikipedia text-based CUB and NABirds splits, and Attribute-based AWA, CUB, and SUN, demonstrates the superiority of the LsrGAN compared to previous state-of-the-art approaches under both ZSL and GZSL. Code is available at https: // github. com/ Maunil/ LsrGAN


title: Predicting risk of late age-related macular degeneration using deep learning

abstract: By 2040, age-related macular degeneration (AMD) will affect approximately 288 million people worldwide. Identifying individuals at high risk of progression to late AMD, the sight-threatening stage, is critical for clinical actions, including medical interventions and timely monitoring. Although deep learning has shown promise in diagnosing/screening AMD using color fundus photographs, it remains difficult to predict individuals' risks of late AMD accurately. For both tasks, these initial deep learning attempts have remained largely unvalidated in independent cohorts. Here, we demonstrate how deep learning and survival analysis can predict the probability of progression to late AMD using 3,298 participants (over 80,000 images) from the Age-Related Eye Disease Studies AREDS and AREDS2, the largest longitudinal clinical trials in AMD. When validated against an independent test dataset of 601 participants, our model achieved high prognostic accuracy (five-year C-statistic 86.4 (95% confidence interval 86.2-86.6)) that substantially exceeded that of retinal specialists using two existing clinical standards (81.3 (81.1-81.5) and 82.0 (81.8-82.3), respectively). Interestingly, our approach offers additional strengths over the existing clinical standards in AMD prognosis (e.g., risk ascertainment above 50%) and is likely to be highly generalizable, given the breadth of training data from 82 US retinal specialty clinics. Indeed, during external validation through training on AREDS and testing on AREDS2 as an independent cohort, our model retained substantially higher prognostic accuracy than existing clinical standards. These results highlight the potential of deep learning systems to enhance clinical decision-making in AMD patients.


title: Understanding Spatial Relations through Multiple Modalities

abstract: Recognizing spatial relations and reasoning about them is essential in multiple applications including navigation, direction giving and human-computer interaction in general. Spatial relations between objects can either be explicit -- expressed as spatial prepositions, or implicit -- expressed by spatial verbs such as moving, walking, shifting, etc. Both these, but implicit relations in particular, require significant common sense understanding. In this paper, we introduce the task of inferring implicit and explicit spatial relations between two entities in an image. We design a model that uses both textual and visual information to predict the spatial relations, making use of both positional and size information of objects and image embeddings. We contrast our spatial model with powerful language models and show how our modeling complements the power of these, improving prediction accuracy and coverage and facilitates dealing with unseen subjects, objects and relations.


title: Sequential Hierarchical Learning with Distribution Transformation for Image Super-Resolution

abstract: Multi-scale design has been considered in recent image super-resolution (SR) works to explore the hierarchical feature information. Existing multi-scale networks aim to build elaborate blocks or progressive architecture for restoration. In general, larger scale features concentrate more on structural and high-level information, while smaller scale features contain plentiful details and textured information. In this point of view, information from larger scale features can be derived from smaller ones. Based on the observation, in this paper, we build a sequential hierarchical learning super-resolution network (SHSR) for effective image SR. Specially, we consider the inter-scale correlations of features, and devise a sequential multi-scale block (SMB) to progressively explore the hierarchical information. SMB is designed in a recursive way based on the linearity of convolution with restricted parameters. Besides the sequential hierarchical learning, we also investigate the correlations among the feature maps and devise a distribution transformation block (DTB). Different from attention-based methods, DTB regards the transformation in a normalization manner, and jointly considers the spatial and channel-wise correlations with scaling and bias factors. Experiment results show SHSR achieves superior quantitative performance and visual quality to state-of-the-art methods with near 34\% parameters and 50\% MACs off when scaling factor is $\times4$. To boost the performance without further training, the extension model SHSR$^+$ with self-ensemble achieves competitive performance than larger networks with near 92\% parameters and 42\% MACs off with scaling factor $\times4$.


title: Using double Weil sums in finding the $c$-Boomerang Connectivity Table for monomial functions on finite fields

abstract: In this paper we characterize the $c$-Boomerang Connectivity Table (BCT), $c\neq 0$ (thus, including the classical $c=1$ case), for all monomial function $x^d$ in terms of characters and Weil sums on the finite field~$\F_{p^n}$. We further simplify these expressions for the Gold functions $x^{p^k+1}$ for all $1\leq k<n$, and $p$ odd. It is the first such attempt for a complete description for the classical BCT and its relative $c$-BCT, for all parameters involved.


title: Referring Expression Comprehension: A Survey of Methods and Datasets

abstract: Referring expression comprehension (REC) aims to localize a target object in an image described by a referring expression phrased in natural language. Different from the object detection task that queried object labels have been pre-defined, the REC problem only can observe the queries during the test. It thus more challenging than a conventional computer vision problem. This task has attracted a lot of attention from both computer vision and natural language processing community, and several lines of work have been proposed, from CNN-RNN model, modular network to complex graph-based model. In this survey, we first examine the state of the art by comparing modern approaches to the problem. We classify methods by their mechanism to encode the visual and textual modalities. In particular, we examine the common approach of joint embedding images and expressions to a common feature space. We also discuss modular architectures and graph-based models that interface with structured graph representation. In the second part of this survey, we review the datasets available for training and evaluating REC systems. We then group results according to the datasets, backbone models, settings so that they can be fairly compared. Finally, we discuss promising future directions for the field, in particular the compositional referring expression comprehension that requires longer reasoning chain to address.


title: Physics Letters B, Physical Review Letters and arXiv publications. Correlating PLB, PRL and arXiv articles for nuclear, particle and astro-physics

abstract: When analyzing the content of Physics Letter B (PLB) web pages, one goal was to separate articles from particle physics(HEP) and nuclear physics(NP). PLB contains information about the subject area of an article: Astrophysics and Cosmology, Experiments, Phenomenology or Theory. Those subject areas have been used since 2004. To extend those areas to earlier dates and try to separate HEP and NP publications, the idea was to use the information on the arXiv to accomplish this, by correlating a publication in PLB with a publication in one of the different arXiv repositories for particle, nuclear or astrophysics. The arXiv articles go back to at least 1995. When building the correlation between an arXiv article and each PLB article, it was found that many PLB articles do not have an existing reference in an arXiv article. Given that, the same analysis was performed using particle, nuclear and astro physics publications in Physical Review Letters (PRL). A similar result was obtained, but for a much shorter period of time. Finally, a title match was performed between the two journals and the arXiv, to see whether the preprint version of the journal article existed on the arXiv at all. They do, but without a journal reference.


title: A $2^{n/2}$-Time Algorithm for $\sqrt{n}$-SVP and $\sqrt{n}$-Hermite SVP, and an Improved Time-Approximation Tradeoff for (H)SVP

abstract: We show a $2^{n/2+o(n)}$-time algorithm that finds a (non-zero) vector in a lattice $\mathcal{L} \subset \mathbb{R}^n$ with norm at most $\tilde{O}(\sqrt{n})\cdot \min\{\lambda_1(\mathcal{L}), \det(\mathcal{L})^{1/n}\}$, where $\lambda_1(\mathcal{L})$ is the length of a shortest non-zero lattice vector and $\det(\mathcal{L})$ is the lattice determinant. Minkowski showed that $\lambda_1(\mathcal{L}) \leq \sqrt{n} \det(\mathcal{L})^{1/n}$ and that there exist lattices with $\lambda_1(\mathcal{L}) \geq \Omega(\sqrt{n}) \cdot \det(\mathcal{L})^{1/n}$, so that our algorithm finds vectors that are as short as possible relative to the determinant (up to a polylogarithmic factor). The main technical contribution behind this result is new analysis of (a simpler variant of) an algorithm from arXiv:1412.7994, which was only previously known to solve less useful problems. To achieve this, we rely crucially on the ``reverse Minkowski theorem'' (conjectured by Dadush arXiv:1606.06913 and proven by arXiv:1611.05979), which can be thought of as a partial converse to the fact that $\lambda_1(\mathcal{L}) \leq \sqrt{n} \det(\mathcal{L})^{1/n}$. Previously, the fastest known algorithm for finding such a vector was the $2^{.802n + o(n)}$-time algorithm due to [Liu, Wang, Xu, and Zheng, 2011], which actually found a non-zero lattice vector with length $O(1) \cdot \lambda_1(\mathcal{L})$. Though we do not show how to find lattice vectors with this length in time $2^{n/2+o(n)}$, we do show that our algorithm suffices for the most important application of such algorithms: basis reduction. In particular, we show a modified version of Gama and Nguyen's slide-reduction algorithm [Gama and Nguyen, STOC 2008], which can be combined with the algorithm above to improve the time-length tradeoff for shortest-vector algorithms in nearly all regimes, including the regimes relevant to cryptography.


title: From Spatial Relations to Spatial Configurations

abstract: Spatial Reasoning from language is essential for natural language understanding. Supporting it requires a representation scheme that can capture spatial phenomena encountered in language as well as in images and videos. Existing spatial representations are not sufficient for describing spatial configurations used in complex tasks. This paper extends the capabilities of existing spatial representation languages and increases coverage of the semantic aspects that are needed to ground the spatial meaning of natural language text in the world. Our spatial relation language is able to represent a large, comprehensive set of spatial concepts crucial for reasoning and is designed to support the composition of static and dynamic spatial configurations. We integrate this language with the Abstract Meaning Representation(AMR) annotation schema and present a corpus annotated by this extended AMR. To exhibit the applicability of our representation scheme, we annotate text taken from diverse datasets and show how we extend the capabilities of existing spatial representation languages with the fine-grained decomposition of semantics and blend it seamlessly with AMRs of sentences and discourse representations as a whole.


title: Resolution Switchable Networks for Runtime Efficient Image Recognition

abstract: We propose a general method to train a single convolutional neural network which is capable of switching image resolutions at inference. Thus the running speed can be selected to meet various computational resource limits. Networks trained with the proposed method are named Resolution Switchable Networks (RS-Nets). The basic training framework shares network parameters for handling images which differ in resolution, yet keeps separate batch normalization layers. Though it is parameter-efficient in design, it leads to inconsistent accuracy variations at different resolutions, for which we provide a detailed analysis from the aspect of the train-test recognition discrepancy. A multi-resolution ensemble distillation is further designed, where a teacher is learnt on the fly as a weighted ensemble over resolutions. Thanks to the ensemble and knowledge distillation, RS-Nets enjoy accuracy improvements at a wide range of resolutions compared with individually trained models. Extensive experiments on the ImageNet dataset are provided, and we additionally consider quantization problems. Code and models are available at https://github.com/yikaiw/RS-Nets.


title: An explicit expression for Euclidean self-dual cyclic codes of length $2^k$ over Galois ring ${\rm GR}(4,m)$

abstract: For any positive integers $m$ and $k$, existing literature only determines the number of all Euclidean self-dual cyclic codes of length $2^k$ over the Galois ring ${\rm GR}(4,m)$, such as in [Des. Codes Cryptogr. (2012) 63:105--112]. Using properties for Kronecker products of matrices of a specific type and column vectors of these matrices, we give a simple and efficient method to construct all these self-dual cyclic codes precisely. On this basis, we provide an explicit expression to accurately represent all distinct Euclidean self-dual cyclic codes of length $2^k$ over ${\rm GR}(4,m)$, using combination numbers. As an application, we list all distinct Euclidean self-dual cyclic codes over ${\rm GR}(4,m)$ of length $2^k$ explicitly, for $k=4,5,6$.


title: The Overfitted Brain: Dreams evolved to assist generalization

abstract: Understanding of the evolved biological function of sleep has advanced considerably in the past decade. However, no equivalent understanding of dreams has emerged. Contemporary neuroscientific theories generally view dreams as epiphenomena, and the few proposals for their biological function are contradicted by the phenomenology of dreams themselves. Now, the recent advent of deep neural networks (DNNs) has finally provided the novel conceptual framework within which to understand the evolved function of dreams. Notably, all DNNs face the issue of overfitting as they learn, which is when performance on one data set increases but the network's performance fails to generalize (often measured by the divergence of performance on training vs. testing data sets). This ubiquitous problem in DNNs is often solved by modelers via "noise injections" in the form of noisy or corrupted inputs. The goal of this paper is to argue that the brain faces a similar challenge of overfitting, and that nightly dreams evolved to combat the brain's overfitting during its daily learning. That is, dreams are a biological mechanism for increasing generalizability via the creation of corrupted sensory inputs from stochastic activity across the hierarchy of neural structures. Sleep loss, specifically dream loss, leads to an overfitted brain that can still memorize and learn but fails to generalize appropriately. Herein this "overfitted brain hypothesis" is explicitly developed and then compared and contrasted with existing contemporary neuroscientific theories of dreams. Existing evidence for the hypothesis is surveyed within both neuroscience and deep learning, and a set of testable predictions are put forward that can be pursued both in vivo and in silico.


title: Leader-Driven Opinion Dynamics in Signed Social Networks With Asynchronous Trust/Distrust Level Evolution

abstract: Trust and distrust are common in the opinion interactions among agents in social networks, and they are described by the edges with positive and negative weights in the signed digraph, respectively. It has been shown in social psychology that although the opinions of most agents (followers) tend to prevail, sometimes one agent (leader) with a firm stand and strong influence can impact or even overthrow the preferences of followers. This paper aims to analyze how the leader influences the formation of followers' opinions in signed social networks. In addition, this paper considers an asynchronous evolution mechanism of trust/distrust level based on opinion difference, in which the trust/distrust level between neighboring agents is portrayed as a nonlinear weight function of their opinion difference, and each agent interacts with the neighbors to update the trust/distrust level and opinion at the times determined by its own will. Based on the related properties of sub-stochastic and super-stochastic matrices, the inequality conditions about positive and negative weights to achieve opinion consensus and polarization are established. Some numerical simulations based on two well-known networks called the ``12 Angry Men" network and the Karate Club network are provided to verify the correctness of the theoretical results.


title: Learning to Play Cup-and-Ball with Noisy Camera Observations

abstract: Playing the cup-and-ball game is an intriguing task for robotics research since it abstracts important problem characteristics including system nonlinearity, contact forces and precise positioning as terminal goal. In this paper, we present a learning model based control strategy for the cup-and-ball game, where a Universal Robots UR5e manipulator arm learns to catch a ball in one of the cups on a Kendama. Our control problem is divided into two sub-tasks, namely $(i)$ swinging the ball up in a constrained motion, and $(ii)$ catching the free-falling ball. The swing-up trajectory is computed offline, and applied in open-loop to the arm. Subsequently, a convex optimization problem is solved online during the ball's free-fall to control the manipulator and catch the ball. The controller utilizes noisy position feedback of the ball from an Intel RealSense D435 depth camera. We propose a novel iterative framework, where data is used to learn the support of the camera noise distribution iteratively in order to update the control policy. The probability of a catch with a fixed policy is computed empirically with a user specified number of roll-outs. Our design guarantees that probability of the catch increases in the limit, as the learned support nears the true support of the camera noise distribution. High-fidelity Mujoco simulations and preliminary experimental results support our theoretical analysis.


title: Autonomy and Unmanned Vehicles Augmented Reactive Mission-Motion Planning Architecture for Autonomous Vehicles

abstract: Advances in hardware technology have facilitated more integration of sophisticated software toward augmenting the development of Unmanned Vehicles (UVs) and mitigating constraints for onboard intelligence. As a result, UVs can operate in complex missions where continuous trans-formation in environmental condition calls for a higher level of situational responsiveness and autonomous decision making. This book is a research monograph that aims to provide a comprehensive survey of UVs autonomy and its related properties in internal and external situation awareness to-ward robust mission planning in severe conditions. An advance level of intelligence is essential to minimize the reliance on the human supervisor, which is a main concept of autonomy. A self-controlled system needs a robust mission management strategy to push the boundaries towards autonomous structures, and the UV should be aware of its internal state and capabilities to assess whether current mission goal is achievable or find an alternative solution. In this book, the AUVs will become the major case study thread but other cases/types of vehicle will also be considered. In-deed the research monograph, the review chapters and the new approaches we have developed would be appropriate for use as a reference in upper years or postgraduate degrees for its coverage of literature and algorithms relating to Robot/Vehicle planning, tasking, routing, and trust.


title: Momentum-resolved measurement of electronic nematic susceptibility in the FeSe$_{0.9}$S$_{0.1}$ superconductor

abstract: Unveiling the driving force for a phase transition is normally difficult when multiple degrees of freedom are strongly coupled. One example is the nematic phase transition in iron-based superconductors. Its mechanism remains controversial due to a complex intertwining among different degrees of freedom. In this paper, we report a method for measuring the nematic susceptibly of FeSe$_{0.9}$S$_{0.1}$ using angle-resolved photoemission spectroscopy (ARPES) and an $in$-$situ$ strain-tuning device. The nematic susceptibility is characterized as an energy shift of band induced by a tunable uniaxial strain. We found that the temperature-dependence of the nematic susceptibility is strongly momentum dependent. As the temperature approaches the nematic transition temperature from the high temperature side, the nematic susceptibility remains weak at the Brillouin zone center while showing divergent behavior at the Brillouin zone corner. Our results highlight the complexity of the nematic order parameter in the momentum space, which provides crucial clues to the driving mechanism of the nematic phase transition. Our experimental method which can directly probe the electronic susceptibly in the momentum space provides a new way to study the complex phase transitions in various materials.


title: Anomalous spectral weight transfer in the nematic state of iron-selenide superconductor

abstract: Nematic phase intertwines closely with high-Tc superconductivity in iron-based superconductors. Its mechanism, which is closely related to the pairing mechanism of superconductivity, still remains controversial. Comprehensive characterization of how the electronic state reconstructs in the nematic phase is thus crucial. However, most experiments focus only on the reconstruction of band dispersions. Another important characteristic of electronic state, the spectral weight, has not been studied in details so far. Here, we studied the spectral weight transfer in the nematic phase of FeSe$_{0.9}$S$_{0.1}$ using angle-resolved photoemission spectroscopy and in-situ detwinning technique. There are two elliptical electron pockets overlapping with each other orthogonally at the Brillouin zone corner. We found that, upon cooling, one electron pocket loses spectral weight and fades away, while the other electron pocket gains spectral weight and becomes pronounced. Our results show that the symmetry breaking of electronic state is manifested by not only the anisotropic band dispersion but also the band-selective modulation of spectral weight. Our observation completes our understanding of the nematic electronic state, and put strong constraints on the theoretical models. It further provide crucial clues to understand the gap anisotropy and orbital-selective pairing in iron-selenide superconductors.


title: Authoritarian Governments Appear to Manipulate COVID Data

abstract: Because SARS-Cov-2 (COVID-19) statistics affect economic policies and political outcomes, governments have an incentive to control them. Manipulation may be less likely in democracies, which have checks to ensure transparency. We show that data on disease burden bear indicia of data modification by authoritarian governments relative to democratic governments. First, data on COVID-19 cases and deaths from authoritarian governments show significantly less variation from a 7 day moving average. Because governments have no reason to add noise to data, lower deviation is evidence that data may be massaged. Second, data on COVID-19 deaths from authoritarian governments do not follow Benford's law, which describes the distribution of leading digits of numbers. Deviations from this law are used to test for accounting fraud. Smoothing and adjustments to COVID-19 data may indicate other alterations to these data and a need to account for such alterations when tracking the disease.


title: Optimal slip velocities of micro-swimmers with arbitrary axisymmetric shapes

abstract: This article presents a computational approach for determining the optimal slip velocities on any given shape of an axisymmetric micro-swimmer suspended in a viscous fluid. The objective is to minimize the power loss to maintain a target swimming speed, or equivalently to maximize the efficiency of the micro-swimmer. Owing to the linearity of the Stokes equations governing the fluid motion, we show that this PDE-constrained optimization problem reduces to a simpler quadratic optimization problem, whose solution is found using a high-order accurate boundary integral method. We consider various families of shapes parameterized by the reduced volume and compute their swimming efficiency. {Among those, prolate spheroids were found to be the most efficient micro-swimmer shapes for a given reduced volume. We propose a simple shape-based scalar metric that can determine whether the optimal slip on a given shape makes it a pusher, a puller, or a neutral swimmer.}


title: Only Time Will Tell: Credible Dynamic Signaling

abstract: This paper characterizes informational outcomes in a model of dynamic signaling with vanishing commitment power. It shows that contrary to popular belief, informative equilibria with payoff-relevant signaling can exist without requiring unreasonable off-path beliefs. The paper provides a sharp characterization of possible separating equilibria: all signaling must take place through attrition, when the weakest type mixes between revealing own type and pooling with the stronger types. The framework explored in the paper is general, imposing only minimal assumptions on payoff monotonicity and single-crossing. Applications to bargaining, monopoly price signaling, and labor market signaling are developed to demonstrate the results in specific contexts.


title: Understanding and Mitigating the Limitations of Prioritized Experience Replay

abstract: Prioritized Experience Replay (ER) has been empirically shown to improve sample efficiency across many domains and attracted great attention; however, there is little theoretical understanding of why such prioritized sampling helps and its limitations. In this work, we take a deep look at the prioritized ER. In a supervised learning setting, we show the equivalence between the error-based prioritized sampling method for mean squared error and uniform sampling for cubic power loss. We then provide theoretical insight into why it improves convergence rate upon uniform sampling during early learning. Based on the insight, we further point out two limitations of the prioritized ER method: 1) outdated priorities and 2) insufficient coverage of the sample space. To mitigate the limitations, we propose our model-based stochastic gradient Langevin dynamics sampling method. We show that our method does provide states distributed close to an ideal prioritized sampling distribution estimated by the brute-force method, which does not suffer from the two limitations. We conduct experiments on both discrete and continuous control problems to show our approach's efficacy and examine the practical implication of our method in an autonomous driving application.


title: Phase-synchronization properties of laminar cylinder wake for periodic external forcings

abstract: We investigate the synchronization properties of the two-dimensional periodic flow over a circular cylinder using the principles of phase-reduction theory. The influence of harmonic external forcings on the wake dynamics, and the possible synchronization of the vortex shedding behind the cylinder to these forcings, is determined by evaluating the phase response of the system to weak impulse perturbations. These horizontal and vertical perturbations are added at different phase values over a period, in order to develop a linear one-dimensional model with respect to the limit cycle that describes the high-dimensional and nonlinear dynamics of the fluid flow via only a single scalar phase variable. This model is then utilized to acquire the theoretical conditions for the synchronization between the cylinder wake and the harmonic forcings added in the global near-wake region. Valuable insights are gained by comparing the findings of the present research against those rendered by the dynamic mode decomposition and adjoint analysis of the wake dynamics in earlier works. The present analysis reveals regions in the flow which enable phase synchronization or desynchronization to periodic excitations for applications such as active flow control and fluid-structure interactions.


title: Compact integrated optical sensors and electromagnetic actuators for vibration isolation systems in the gravitational-wave detector KAGRA

abstract: This paper reports on the design and characteristics of a compact module integrating an optical displacement sensor and an electromagnetic actuator for use with vibration-isolation systems installed in KAGRA, the 3-km baseline gravitational-wave detector in Japan. In technical concept, the module belongs to a family tree of similar modules called OSEMs, used in other interferometric gravitational-wave detector projects. After the initial test run of KAGRA in 2016, the sensor part, which is a type of slot sensor, was modified by increasing the spacing of the slot from 5 mm to 15 mm to avoid the risk of mechanical interference with the sensor flag. We confirm the sensor performance is comparable to that of the previous design despite the modification. We also confirm the sensor noise is consistent with the theoretical noise budget. The noise level is 0.5 nm/rtHz at 1 Hz and 0.1 nm/rtHz at 10 Hz, and the linear range of the sensor is 0.7 mm or more. We measured the response of the actuator to be 1 N/A, and also measured the resistances and inductances of coils of the actuators to confirm consistency with theory. Coupling coefficients among the different degrees of freedom were also measured and shown to be negligible, varying little between designs. A potential concern about thermal noise contribution due to eddy current loss is discussed. As of 2020, 42 of the modules are in operation at the site.


title: Isostructural spin-density-wave and superconducting gap anisotropies in iron-arsenide superconductors

abstract: When passing through a phase transition, electronic system saves energy by opening energy gaps at the Fermi level. Delineating the energy gap anisotropy provides insights into the origin of the interactions that drive the phase transition. Here, we report the angle-resolved photoemission spectroscopy (ARPES) study on the detailed gap anisotropies in both the tetragonal magnetic and superconducting phases in Sr$_{1-x}$Na$_x$Fe$_2$As$_2$. First, we found that the spin-density-wave (SDW) gap is strongly anisotropic in the tetragonal magnetic phase. The gap magnitude correlates with the orbital character of Fermi surface closely. Second, we found that the SDW gap anisotropy is isostructural to the superconducting gap anisotropy regarding to the angular dependence, gap minima locations, and relative gap magnitudes. Our results indicate that the superconducting pairing interaction and magnetic interaction share the same origin. The intra-orbital scattering plays an important role in constructing these interactions resulting in the orbital-selective magnetism and superconductivity in iron-based superconductors.


title: Monogamy of Logarithmic Negativity and Logarithmic Convex-Roof Extended Negativity

abstract: One of the fundamental traits of quantum entanglement is the restricted shareability among multipartite quantum systems, namely monogamy of entanglement, while it is well known that monogamy inequalities are always satisfied by entanglement measures with convexity. Here we present a measure of entanglement, logarithmic convex-roof extended negativity (LCREN) satisfying important characteristics of an entanglement measure, and investigate the monogamy relation for logarithmic negativity and LCREN both without convexity. We show exactly that the $\alpha$th power of logarithmic negativity, and a newly defined good measure of entanglement, LCREN, obey a class of general monogamy inequalities in multiqubit systems, $2\otimes2\otimes3$ systems and $2\otimes2\otimes2^{n}$ systems for $\alpha\geq4\ln2$. We provide a class of general polygamy inequalities of multiqubit systems in terms of logarithmic convex-roof extended negativity of assistance (LCRENoA) for $0\leq\beta\leq2$. Given that the logarithmic negativity and LCREN are not convex these results are surprising. Using the power of the logarithmic negativity and LCREN, we further establish a class of tight monogamy inequalities of multiqubit systems, $2\otimes2\otimes3$ systems and $2\otimes2\otimes2^{n}$ systems in terms of the $\alpha$th power of logarithmic negativity and LCREN for $\alpha\geq4\ln2$. We also show that the $\beta$th power of LCRENoA obeys a class of tight polygamy inequalities of multiqubit systems for $0\leq\beta\leq2$.


title: Simulation of memristive synapses and neuromorphic computing on a quantum computer

abstract: One of the major approaches to neuromorphic computing is using memristors as analogue synapses. We propose unitary quantum gates that exhibit memristive behaviours, including Ohm's law, pinched hysteresis loop and synaptic plasticity. Hysteresis depending on the quantum phase and long-term plasticity that encodes the quantum state are observed. We also propose a three-layer neural network with the capability of universal quantum computing. Quantum state classification on the memristive neural network is demonstrated. Our results pave the way towards brain-inspired quantum computing. We obtain these results in numerical simulations and experiments on the superconducting quantum computer ibmq_vigo.


title: Instability intervals of the Whittaker-Hill operator

abstract: The Hill operator admits a band gap structure. As a special case, like the Mathieu operator, one has only open gaps, however, the instability intervals of the Whittaker-Hill operator may be open or closed. In 2007, P. Djakov and B. Mityagin gave the asymptotics of band gaps for a special Whittaker-Hill operator [P. Djakov and B. Mityagin, J. Funct. Anal., 242, 157-194 (2007).]. In this paper, a more general Whittaker-Hill operator is considered and the asymptotics of the instability intervals are studied.


title: Inference on Average Treatment Effect under Minimization and Other Covariate-Adaptive Randomization Methods

abstract: Covariate-adaptive randomization schemes such as the minimization and stratified permuted blocks are often applied in clinical trials to balance treatment assignments across prognostic factors. The existing theoretical developments on inference after covariate-adaptive randomization are mostly limited to situations where a correct model between the response and covariates can be specified or the randomization method has well-understood properties. Based on stratification with covariate levels utilized in randomization and a further adjusting for covariates not used in randomization, in this article we propose several estimators for model free inference on average treatment effect defined as the difference between response means under two treatments. We establish asymptotic normality of the proposed estimators under all popular covariate-adaptive randomization schemes including the minimization whose theoretical property is unclear, and we show that the asymptotic distributions are invariant with respect to covariate-adaptive randomization methods. Consistent variance estimators are constructed for asymptotic inference. Asymptotic relative efficiencies and finite sample properties of estimators are also studied. We recommend using one of our proposed estimators for valid and model free inference after covariate-adaptive randomization.


title: Distributed ARIMA Models for Ultra-long Time Series

abstract: Providing forecasts for ultra-long time series plays a vital role in various activities, such as investment decisions, industrial production arrangements, and farm management. This paper develops a novel distributed forecasting framework to tackle challenges associated with forecasting ultra-long time series by using the industry-standard MapReduce framework. The proposed model combination approach facilitates distributed time series forecasting by combining the local estimators of time series models delivered from worker nodes and minimizing a global loss function. In this way, instead of unrealistically assuming the data generating process (DGP) of an ultra-long time series stays invariant, we make assumptions only on the DGP of subseries spanning shorter time periods. We investigate the performance of the proposed approach with AutoRegressive Integrated Moving Average (ARIMA) models using the real data application as well as numerical simulations. Compared to directly fitting the whole data with ARIMA models, our approach results in improved forecasting accuracy and computational efficiency both in point forecasts and prediction intervals, especially for longer forecast horizons. Moreover, we explore some potential factors that may affect the forecasting performance of our approach.


title: NeuroMAX: A High Throughput, Multi-Threaded, Log-Based Accelerator for Convolutional Neural Networks

abstract: Convolutional neural networks (CNNs) require high throughput hardware accelerators for real time applications owing to their huge computational cost. Most traditional CNN accelerators rely on single core, linear processing elements (PEs) in conjunction with 1D dataflows for accelerating convolution operations. This limits the maximum achievable ratio of peak throughput per PE count to unity. Most of the past works optimize their dataflows to attain close to a 100% hardware utilization to reach this ratio. In this paper, we introduce a high throughput, multi-threaded, log-based PE core. The designed core provides a 200% increase in peak throughput per PE count while only incurring a 6% increase in area overhead compared to a single, linear multiplier PE core with same output bit precision. We also present a 2D weight broadcast dataflow which exploits the multi-threaded nature of the PE cores to achieve a high hardware utilization per layer for various CNNs. The entire architecture, which we refer to as NeuroMAX, is implemented on Xilinx Zynq 7020 SoC at 200 MHz processing clock. Detailed analysis is performed on throughput, hardware utilization, area and power breakdown, and latency to show performance improvement compared to previous FPGA and ASIC designs.


title: Welfare-Preserving $\varepsilon$-BIC to BIC Transformation with Negligible Revenue Loss

abstract: In this paper, we provide a transform from an $\varepsilon$-BIC mechanism into an exactly BIC mechanism without any loss of social welfare and with additive and negligible revenue loss. This is the first $\varepsilon$-BIC to BIC transformation that preserves welfare and provides negligible revenue loss. The revenue loss bound is tight given the requirement to maintain social welfare. Previous $\varepsilon$-BIC to BIC transformations preserve social welfare but have no revenue guarantee~\citep{BeiHuang11}, or suffer welfare loss while incurring a revenue loss with both a multiplicative and an additive term, e.g.,~\citet{DasWeinberg12, Rubinstein18, Cai19}. The revenue loss achieved by our transformation is incomparable to these earlier approaches and can be significantly less. \newnew{Our approach is different from the previous replica-surrogate matching methods and we directly make use of a directed and weighted type graph (induced by the types' regret), one for each agent. The transformation runs a \emph{fractional rotation step} and a \emph{payment reducing step} iteratively to make the mechanism Bayesian incentive compatible.} We also analyze $\varepsilon$-expected ex-post IC ($\varepsilon$-EEIC) mechanisms~\citep{DuettingFJLLP12}. We provide a welfare-preserving transformation in this setting with the same revenue loss guarantee for uniform type distributions and give an impossibility result for non-uniform distributions. We apply the transform to linear-programming based and machine-learning based methods of automated mechanism design.


title: Length-Controllable Image Captioning

abstract: The last decade has witnessed remarkable progress in the image captioning task; however, most existing methods cannot control their captions, \emph{e.g.}, choosing to describe the image either roughly or in detail. In this paper, we propose to use a simple length level embedding to endow them with this ability. Moreover, due to their autoregressive nature, the computational complexity of existing models increases linearly as the length of the generated captions grows. Thus, we further devise a non-autoregressive image captioning approach that can generate captions in a length-irrelevant complexity. We verify the merit of the proposed length level embedding on three models: two state-of-the-art (SOTA) autoregressive models with different types of decoder, as well as our proposed non-autoregressive model, to show its generalization ability. In the experiments, our length-controllable image captioning models not only achieve SOTA performance on the challenging MS COCO dataset but also generate length-controllable and diverse image captions. Specifically, our non-autoregressive model outperforms the autoregressive baselines in terms of controllability and diversity, and also significantly improves the decoding efficiency for long captions. Our code and models are released at \textcolor{magenta}{\texttt{https://github.com/bearcatt/LaBERT}}.


title: Fast Adaptable Mobile Robot Navigation in Dynamic Environment

abstract: Autonomous navigation in dynamic environment heavily depends on the environment and its topology. Prior knowledge of the environment is not usually accurate as the environment keeps evolving in time. Since robot is continuously evaluating the environment as it proceeds, deciding the optimal way to traverse the environment to get to the goal, computationally efficient yet mathematically adaptive navigation algorithms are needed. In this paper, a navigation scheme for mobile robot, capable of dealing with time variant environment is proposed. This approach consists of a global planner (A*) and local planner (VFH) to assure an optimal and collision-free robot motion. The algorithm is tested both in simulation and experimentation in different environments that are known to result in failures in VFH and ROS navigation stack, for comparison purposes. Overall, the algorithm enables the robot to get to the goal faster and also produces a smoother path while doing so.


title: Modeling film flows down a fibre influenced by nozzle geometry

abstract: We study the effects of nozzle geometry on the dynamics of thin fluid films flowing down a vertical cylindrical fibre. Recent experiments show that varying the nozzle diameter can lead to different flow regimes and droplet characteristics in the film. Using a weighted residual modeling approach, we develop a system of coupled equations that account for inertia, surface tension effects, gravity, and a film stabilization mechanism to describe both near-nozzle fluid structures and downstream bead dynamics. We report good agreement between the predicted droplet properties and the experimental data.


title: Revisiting Reynolds and Nusselt numbers in turbulent thermal convection

abstract: In this paper, we extend Grossmann and Lohse's (GL) model [Phys. Rev. Lett. {\bf 86}, 3316 (2001)] for the predictions of Reynolds number (Re) and Nusselt number (Nu) in turbulent Rayleigh-B\'{e}nard convection (RBC). Towards this objective, we use functional forms for the prefactors of the dissipation rates in the bulk and the boundary layers. The functional forms arise due to inhibition of nonlinear interactions in the presence of walls and buoyancy compared to free turbulence, along with a deviation of viscous boundary layer profile from Prandtl-Blasius theory. We perform 60 numerical runs on a three-dimensional unit box for a range of Rayleigh numbers (Ra) and Prandtl numbers (Pr) and determine the aforementioned functional forms using machine learning. The revised predictions are in better agreement with the past numerical and experimental results than those of the GL model, especially for extreme Prandtl numbers.


title: PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments

abstract: Object detection using an oriented bounding box (OBB) can better target rotated objects by reducing the overlap with background areas. Existing OBB approaches are mostly built on horizontal bounding box detectors by introducing an additional angle dimension optimized by a distance loss. However, as the distance loss only minimizes the angle error of the OBB and that it loosely correlates to the IoU, it is insensitive to objects with high aspect ratios. Therefore, a novel loss, Pixels-IoU (PIoU) Loss, is formulated to exploit both the angle and IoU for accurate OBB regression. The PIoU loss is derived from IoU metric with a pixel-wise form, which is simple and suitable for both horizontal and oriented bounding box. To demonstrate its effectiveness, we evaluate the PIoU loss on both anchor-based and anchor-free frameworks. The experimental results show that PIoU loss can dramatically improve the performance of OBB detectors, particularly on objects with high aspect ratios and complex backgrounds. Besides, previous evaluation datasets did not include scenarios where the objects have high aspect ratios, hence a new dataset, Retail50K, is introduced to encourage the community to adapt OBB detectors for more complex environments.


title: Optimal Delocalization for Generalized Wigner Matrices

abstract: We study the eigenvectors of generalized Wigner matrices with subexponential entries and prove that they delocalize at the optimal rate with overwhelming probability. We also prove high probability delocalization bounds with sharp constants. Our proof uses an analysis of the eigenvector moment flow introduced by Bourgade and Yau (2017) to bound logarithmic moments of eigenvector entries for random matrices with small Gaussian components. We then extend this control to all generalized Wigner matrices by comparison arguments based on a framework of regularized eigenvectors, level repulsion, and the observable employed by Landon, Lopatto, and Marcinek (2018) to compare extremal eigenvalue statistics. Additionally, we prove level repulsion and eigenvalue overcrowding estimates for the entire spectrum, which may be of independent interest.


title: A zero-carbon, reliable and affordable energy future in Australia

abstract: Australia has one of the highest per capita consumption of energy and emissions of greenhouse gases in the world. It is also the global leader in rapid per capita annual deployment of new solar and wind energy, which is causing the country's emissions to decline. Australia is located at low-moderate latitudes along with three quarters of the global population. These factors make the Australian experience globally significant. In this study, we model a fully decarbonised electricity system together with complete electrification of heating, transport and industry in Australia leading to an 80% reduction in greenhouse gas emissions. An energy supply-demand balance is simulated based on long-term (10 years), high-resolution (half-hourly) meteorological and energy demand data. A significant feature of this model is that short-term off-river energy storage and distributed energy storage are utilised to support the large-scale integration of variable solar and wind energy. The results show that high levels of energy reliability and affordability can be effectively achieved through a synergy of flexible energy sources; interconnection of electricity grids over large areas; response from demand-side participation; and mass energy storage. This strategy represents a rapid and generic pathway towards zero-carbon energy futures within the Sunbelt.


title: Coherence measures with respect to general quantum measurements

abstract: Quantum coherence with respect to orthonormal bases has been studied extensively in the past few years. Recently, Bischof, et al. [Phys. Rev. Lett. 123, 110402 (2019)] generalized it to the case of general positive operator-valued measure (POVM) measurements. Such POVM-based coherence, including the block coherence as a special case, have significant operational interpretations in quantifying the advantage of quantum states in quantum information processing. In this work we first establish an alternative framework for quantifying the block coherence and provide several block coherence measures. We then present several coherence measures with respect to POVM measurements, and prove a conjecture on the $l_{1}$-norm related POVM coherence measure.


title: PUF-RLA: A PUF-based Reliable and Lightweight Authentication Protocol employing Binary String Shuffling

abstract: Physically unclonable functions (PUFs) can be employed for device identification, authentication, secret key storage, and other security tasks. However, PUFs are susceptible to modeling attacks if a number of PUFs' challenge-response pairs (CRPs) are exposed to the adversary. Furthermore, many of the embedded devices requiring authentication have stringent resource constraints and thus require a lightweight authentication mechanism. We propose PUF-RLA, a PUF-based lightweight, highly reliable authentication scheme employing binary string shuffling. The proposed scheme enhances the reliability of PUF as well as alleviates the resource constraints by employing error correction in the server instead of the device without compromising the security. The proposed PUF-RLA is robust against brute force, replay, and modeling attacks. In PUF-RLA, we introduce an inexpensive yet secure stream authentication scheme inside the device which authenticates the server before the underlying PUF can be invoked. This prevents an adversary from brute forcing the device's PUF to acquire CRPs essentially locking out the device from unauthorized model generation. Additionally, we also introduce a lightweight CRP obfuscation mechanism involving XOR and shuffle operations. Results and security analysis verify that the PUF-RLA is secure against brute force, replay, and modeling attacks, and provides ~99% reliable authentication. In addition, PUF-RLA provides a reduction of 63% and 74% for look-up tables (LUTs) and register count, respectively, in FPGA compared to a recently proposed approach while providing additional authentication advantages.


title: High Performance Data Engineering Everywhere

abstract: The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide. However this is just a small part of the issues facing the overall data processing environment, which must also support a raft of data engineering for pre- and post-data processing, communication, and system integration. An important requirement of data analytics tools is to be able to easily integrate with existing frameworks in a multitude of languages, thereby increasing user productivity and efficiency. All this demands an efficient and highly distributed integrated approach for data processing, yet many of today's popular data analytics tools are unable to satisfy all these requirements at the same time. In this paper we present Cylon, an open-source high performance distributed data processing library that can be seamlessly integrated with existing Big Data and AI/ML frameworks. It is developed with a flexible C++ core on top of a compact data structure and exposes language bindings to C++, Java, and Python. We discuss Cylon's architecture in detail, and reveal how it can be imported as a library to existing applications or operate as a standalone framework. Initial experiments show that Cylon enhances popular tools such as Apache Spark and Dask with major performance improvements for key operations and better component linkages. Finally, we show how its design enables Cylon to be used cross-platform with minimum overhead, which includes popular AI tools such as PyTorch, Tensorflow, and Jupyter notebooks.


title: AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation

abstract: In this paper, we propose an adaptive weighting regression (AWR) method to leverage the advantages of both detection-based and regression-based methods. Hand joint coordinates are estimated as discrete integration of all pixels in dense representation, guided by adaptive weight maps. This learnable aggregation process introduces both dense and joint supervision that allows end-to-end training and brings adaptability to weight maps, making the network more accurate and robust. Comprehensive exploration experiments are conducted to validate the effectiveness and generality of AWR under various experimental settings, especially its usefulness for different types of dense representation and input modality. Our method outperforms other state-of-the-art methods on four publicly available datasets, including NYU, ICVL, MSRA and HANDS 2017 dataset.


title: Non-uniqueness of steady-state weak solutions to the surface quasi-geostrophic equations

abstract: We show the existence of nontrivial stationary weak solutions to the surface quasi-geostrophic equations on the two dimensional periodic torus.


title: Semantic Equivalent Adversarial Data Augmentation for Visual Question Answering

abstract: Visual Question Answering (VQA) has achieved great success thanks to the fast development of deep neural networks (DNN). On the other hand, the data augmentation, as one of the major tricks for DNN, has been widely used in many computer vision tasks. However, there are few works studying the data augmentation problem for VQA and none of the existing image based augmentation schemes (such as rotation and flipping) can be directly applied to VQA due to its semantic structure -- an $\langle image, question, answer\rangle$ triplet needs to be maintained correctly. For example, a direction related Question-Answer (QA) pair may not be true if the associated image is rotated or flipped. In this paper, instead of directly manipulating images and questions, we use generated adversarial examples for both images and questions as the augmented data. The augmented examples do not change the visual properties presented in the image as well as the \textbf{semantic} meaning of the question, the correctness of the $\langle image, question, answer\rangle$ is thus still maintained. We then use adversarial learning to train a classic VQA model (BUTD) with our augmented data. We find that we not only improve the overall performance on VQAv2, but also can withstand adversarial attack effectively, compared to the baseline model. The source code is available at https://github.com/zaynmi/seada-vqa.


title: On the role of gradients for machine learning of molecular energies and forces

abstract: The accuracy of any machine learning potential can only be as good as the data used in the fitting process. The most efficient model therefore selects the training data that will yield the highest accuracy compared to the cost of obtaining the training data. We investigate the convergence of prediction errors of quantum machine learning models for organic molecules trained on energy and force labels, two common data types in molecular simulations. When training and predicting on different geometries corresponding to the same single molecule, we find that the inclusion of atomic forces in the training data increases the accuracy of the predicted energies and forces 7-fold, compared to models trained on energy only. Surprisingly, for models trained on sets of organic molecules of varying size and composition in non-equilibrium conformations, inclusion of forces in the training does not improve the predicted energies of unseen molecules in new conformations. Predicted forces, however, also improve about 7-fold. For the systems studied, we find that force labels and energy labels contribute equally per label to the convergence of the prediction errors. Choosing to include derivatives such as atomic forces in the training set or not should thus depend on, not only on the computational cost of acquiring the force labels for training, but also on the application domain, the property of interest, and the desirable size of the machine learning model. Based on our observations we describe key considerations for the creation of datasets for potential energy surfaces of molecules which maximize the efficiency of the resulting machine learning models.


title: Mapping in a cycle: Sinkhorn regularized unsupervised learning for point cloud shapes

abstract: We propose an unsupervised learning framework with the pretext task of finding dense correspondences between point cloud shapes from the same category based on the cycle-consistency formulation. In order to learn discriminative pointwise features from point cloud data, we incorporate in the formulation a regularization term based on Sinkhorn normalization to enhance the learned pointwise mappings to be as bijective as possible. Besides, a random rigid transform of the source shape is introduced to form a triplet cycle to improve the model's robustness against perturbations. Comprehensive experiments demonstrate that the learned pointwise features through our framework benefits various point cloud analysis tasks, e.g. partial shape registration and keypoint transfer. We also show that the learned pointwise features can be leveraged by supervised methods to improve the part segmentation performance with either the full training dataset or just a small portion of it.


title: Risk-aware Path and Motion Planning for a Tethered Aerial Visual Assistant in Unstructured or Confined Environments

abstract: This research aims at developing path and motion planning algorithms for a tethered Unmanned Aerial Vehicle (UAV) to visually assist a teleoperated primary robot in unstructured or confined environments. The emerging state of the practice for nuclear operations, bomb squad, disaster robots, and other domains with novel tasks or highly occluded environments is to use two robots, a primary and a secondary that acts as a visual assistant to overcome the perceptual limitations of the sensors by providing an external viewpoint. However, the benefits of using an assistant have been limited for at least three reasons: (1) users tend to choose suboptimal viewpoints, (2) only ground robot assistants are considered, ignoring the rapid evolution of small unmanned aerial systems for indoor flying, (3) introducing a whole crew for the second teleoperated robot is not cost effective, may introduce further teamwork demands, and therefore could lead to miscommunication. This dissertation proposes to use an autonomous tethered aerial visual assistant to replace the secondary robot and its operating crew. Along with a pre-established theory of viewpoint quality based on affordances, this dissertation aims at defining and representing robot motion risk in unstructured or confined environments. Based on those theories, a novel high level path planning algorithm is developed to enable risk-aware planning, which balances the tradeoff between viewpoint quality and motion risk in order to provide safe and trustworthy visual assistance flight. The planned flight trajectory is then realized on a tethered UAV platform. The perception and actuation are tailored to fit the tethered agent in the form of a low level motion suite, including a novel tether-based localization model with negligible computational overhead, motion primitives for the tethered airframe based on position and velocity control, and two different