title: Visualizing a Field of Research: A Methodology of Systematic Scientometric Reviews

abstract: Systematic scientometric reviews, empowered by scientometric and visual analytic techniques, offer opportunities to improve the timeliness, accessibility, and reproducibility of conventional systematic reviews. While increasingly accessible science mapping tools enable end users to visualize the structure and dynamics of a research field, a common bottleneck in the current practice is the construction of a collection of scholarly publications as the input of the subsequent scientometric analysis and visualization. End users often have to face a dilemma in the preparation process: the more they know about a knowledge domain, the easier it is for them to find the relevant data to meet their needs adequately; the little they know, the harder the problem is. What can we do to avoid missing something valuable but beyond our initial description? In this article, we introduce a flexible and generic methodology, cascading citation expansion, to increase the quality of constructing a bibliographic dataset for systematic reviews. Furthermore, the methodology simplifies the conceptualization of globalism and localism in science mapping and unifies them on a consistent and continuous spectrum. We demonstrate an application of the methodology to the research of literature-based discovery and compare five datasets constructed based on three use scenarios, namely a conventional keyword-based search (one dataset), an expansion process starting with a groundbreaking article of the knowledge domain (two datasets), and an expansion process starting with a recently published review article by a prominent expert in the domain (two datasets). The unique coverage of each of the datasets is inspected through network visualization overlays with reference to other datasets in a broad and integrated context.


title: Van der Waals epitaxy of Mn-doped MoSe$_2$ on mica

abstract: The magnetic order associated with the degree of freedom of spin in two-dimensional (2D) materials is subjected to intense investigation because of its potential application in 2D spintronics and valley-related magnetic phenomena. We report here a bottom-up strategy using molecular beam epitaxy to grow and dope large-area (cm$^2$) few-layer MoSe$_2$ with Mn as a magnetic dopant. High-quality Mn-doped MoSe$_2$ layers are obtained for Mn content of less than 5 % (atomic). When increasing the Mn content above 5 % we observe a clear transition from layer-by-layer to cluster growth. Magnetic measurements involving a transfer process of the cm$^2$-large doped layers on 100-micron-thick silicon substrate, show plausible proof of high-temperature ferromagnetism of 1 % and 10 % Mn-doped MoSe$_2$. Although we could not point to a correlation between magnetic and electrical properties, we demonstrate that the transfer process described in this report permits to achieve conventional electrical and magnetic measurements on the doped layers transferred on any substrate. Therefore, this study provides a promising route to characterize stable ferromagnetic 2D layers, which is broadening the current start-of-the-art of 2D materials-based applications.


title: Efficient Method for Updating IDF Curves to Future Climate Projections

abstract: If climate stationarity is dead, how should engineering design standards be modified to account for potential changes in extreme precipitation? Many standards rely on precipitation intensity-duration-frequency (IDF) curves provided in NOAA's Atlas 14. General Circulation Models (GCMs) predict increases in average temperature throughout the US, but are less clear on changes in precipitation. In many areas GCMs predict relatively small changes in total precipitation volume, but also suggest increased magnitude of extreme events as warmer air can hold more water. Unfortunately, GCMs have limited skill in predicting individual storm events. This research developed an efficient approach to solve this problem that replicates Atlas 14 methods, which fit a generalized extreme value distribution to the annual maximum series. GCM biases are addressed through equidistant quantile mapping, mapping from a GCM's historical simulation to future predictions, then applying this mapping from the fit to data used in Atlas 14. The approach is efficient because it requires only the annual maxima, allowing rapid examination of results across the range of GCM projections.


title: Optimum LoRaWAN Configuration Under Wi-SUN Interference

abstract: Smart Utility Networks (SUN) rely on the Wireless-SUN (Wi-SUN) specification for years. Recently practitioners and researchers have considered Low-Power Wide-Area Networks (LPWAN) like LoRaWAN for SUN applications. With distinct technologies deployed in the same area and sharing unlicensed bands, one can expect these networks to interfere with one another. This paper builds over a LoRaWAN model to optimize network parameters while accounting for inter-technology interference. Our analytic model accounts for the interference LoRaWAN receives from IEEE 802.15.4g networks, which forms the bottom layers of Wi-SUN systems. We derive closed-form equations for the expected reliability of LoRaWAN in such scenarios. We set the model parameters with data from real measurements of the interplay among the technologies. Finally, we propose two optimization algorithms to determine the best LoRaWAN configurations, given a targeted minimum reliability level. The algorithms maximize either communication range or the number of users given constraints on the minimum number of users, minimum communication range, and minimum reliability. We validate the models and algorithms through numerical analysis and simulations. The proposed methods are useful tools for planning interference-limited networks with requirements of minimum reliability.


title: Active Distribution Grids offering Ancillary Services in Islanded and Grid-connected Mode

abstract: Future active distribution grids (ADGs) will incorporate a plethora of Distributed Generators (DGs) and other Distributed Energy Resources (DERs), allowing them to provide ancillary services in grid-connected mode and, if necessary, operate in an islanded mode to increase reliability and resilience. In this paper, we investigate the ability of an ADG to provide frequency control (FC) in grid-connected mode and ensure reliable islanded operation for a pre-specified time period. First, we formulate the operation of the grid participating in European-type FC markets as a centralized multi-period optimal power flow problem with a rolling horizon of 24 hours. Then, we include constraints to the grid-connected operational problem to guarantee the ability to switch to islanded operation at every time instant. Finally, we explore the technical and economic feasibility of offering these services on a balanced low-voltage distribution network. The results show that the proposed scheme is able to offer and respond to different FC products, while ensuring that there is adequate energy capacity at every time step to satisfy critical load in the islanded mode.


title: Generalized Proca and its Constraint Algebra

abstract: We reconsider the construction of general derivative self-interactions for a massive Proca field. The constructed Lagrangian is such that the vector field propagates at most three degrees of freedom, thus avoiding the ghostly nature of a fourth polarisation. The construction makes use of the well-known condition for constrained systems of having a degenerate Hessian. We briefly discuss the casuistry according to the nature of the existing constraints algebra. We also explore various classes of interesting new interactions that have been recently raised in the literature. For the sixth order Lagrangian that satisfies the constraints by itself we prove its topological character, making such a term irrelevant. There is however a window of opportunity for exploring other classes of fully-nonlinear interactions that satisfy the constraint algebra by mixing terms of various order.


title: The K\H{o}nig Graph Process

abstract: Say that a graph G has property $\mathcal{K}$ if the size of its maximum matching is equal to the order of a minimal vertex cover. We study the following process. Set $N:= \binom{n}{2}$ and let $e_1, e_2, \dots e_{N}$ be a uniformly random ordering of the edges of $K_n$, with $n$ an even integer. Let $G_0$ be the empty graph on $n$ vertices. For $m \geq 0$, $G_{m+1}$ is obtained from $G_m$ by adding the edge $e_{m+1}$ exactly if $G_m \cup \{ e_{m+1}\}$ has property $\mathcal{K}$. We analyse the behaviour of this process, focusing mainly on two questions: What can be said about the structure of $G_N$ and for which $m$ will $G_m$ contain a perfect matching?


title: A note on extensions of multilinear maps defined on multilinear varieties

abstract: Let $G_1, \dots, G_k$ be finite-dimensional vector spaces over a finite field $\mathbb{F}$. A multilinear variety of codimension $d$ is a subset of $G_1 \times \dots \times G_k$ defined as the zero set of $d$ forms, each of which is multilinear on some subset of the coordinates. A map $\phi$ defined on a multilinear variety $B$ is multilinear if for each coordinate $d$ and all choices of $x_i \in G_i$, $i\not=d$, the restriction map $y \mapsto \phi(x_1, \dots, x_{d-1}, y, x_{d+1}, \dots, x_k)$ is linear where defined. In this note, we show that a multilinear map defined on a multilinear variety of codimension $d$ coincides on a multilinear variety of codimension $d^{O(1)}$ with a multilinear map defined on the whole of $G_1\times\dots\times G_k$.


title: Electromagnetic fields on Kerr spacetime, Hertz potentials and Lorenz gauge

abstract: We review two procedures for constructing the vector potential of the electromagnetic field on Kerr spacetime, namely, the classic method of Cohen & Kegeles, yielding $A^\mu$ in a radiation gauge, and the newer method of Frolov et al., yielding $A^\mu$ in Lorenz gauge. We demonstrate that the vector potentials are related by straightforward gauge transformations, which we give in closed form. We obtain a new result for a separable Hertz potential $H^{\mu \nu}$ such that $A_{\text{lor}}^\mu = \nabla_\nu H^{\mu \nu}$.


title: Suppressing Model Overfitting for Image Super-Resolution Networks

abstract: Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved. However, in real-world scenarios, due to the limited accessible training pairs, large models exhibit undesirable behaviors such as overfitting and memorization. To suppress model overfitting and further enjoy the merits of large model capacity, we thoroughly investigate generic approaches for supplying additional training data pairs. In particular, we introduce a simple learning principle MixUp to train networks on interpolations of sample pairs, which encourages networks to support linear behavior in-between training samples. In addition, we propose a data synthesis method with learned degradation, enabling models to use extra high-quality images with higher content diversity. This strategy proves to be successful in reducing biases of data. By combining these components -- MixUp and synthetic training data, large models can be trained without overfitting under very limited data samples and achieve satisfactory generalization performance. Our method won the second place in NTIRE2019 Real SR Challenge.


title: Lyapunov Differential Equation Hierarchy and Polynomial Lyapunov Functions for Switched Linear Systems

abstract: This work studies the problem of searching for homogeneous polynomial Lyapunov functions for stable switched linear systems. Specifically, we show an equivalence between polynomial Lyapunov functions for systems of this class and quadratic Lyapunov functions for a related hierarchy of Lyapunov differential equations. This creates an intuitive procedure for checking the stability properties of switched linear systems and a computationally competitive algorithm is presented for generating high-order homogeneous polynomial Lyapunov functions in this manner. Additionally, we provide a comparison between polynomial Lyapunov functions generated with our proposed approach and polynomial Lyapunov functions generated with a more traditional sum-of-squares based approach.


title: Enhancing the Vertical Mobility of a Robot Hexapod Using Microspines

abstract: Modern climbing robots have risen to great heights, but mechanisms meant to scale cliffs often locomote slowly and over-cautiously on level ground. Here we introduce T-RHex, an iteration on the classic cockroach-inspired hexapod that has been augmented with microspine feet for climbing. T-RHex is a mechanically intelligent platform capable of efficient locomotion on ground with added climbing abilities. The legs integrate the compliance required for the microspines with the compliance required for locomotion in order to simplify the design and reduce mass. The microspine fabrication is simplified by embedding the spines during an additive manufacturing process. We present results that show that the addition of microspines to the T-RHex platform greatly increases the maximum slope that the robot is able to statically hang on (up to a 45 degree overhang) and ascend (up to 55 degrees) without sacrificing ground mobility.


title: The EAS approach for graphical selection consistency in vector autoregression models

abstract: As evidenced by various recent and significant papers within the frequentist literature, along with numerous applications in macroeconomics, genomics, and neuroscience, there continues to be substantial interest to understand the theoretical estimation properties of high-dimensional vector autoregression (VAR) models. To date, however, while Bayesian VAR (BVAR) models have been developed and studied empirically (primarily in the econometrics literature) there exist very few theoretical investigations of the repeated sampling properties for BVAR models in the literature. In this direction, we construct methodology via the $\varepsilon$-$admissible$ subsets (EAS) approach for posterior-like inference based on a generalized fiducial distribution of relative model probabilities over all sets of active/inactive components (graphs) of the VAR transition matrix. We provide a mathematical proof of $pairwise$ and $strong$ graphical selection consistency for the EAS approach for stable VAR(1) models which is robust to model misspecification, and demonstrate numerically that it is an effective strategy in high-dimensional settings.


title: Towards Inverse Reinforcement Learning for Limit Order Book Dynamics

abstract: Multi-agent learning is a promising method to simulate aggregate competitive behaviour in finance. Learning expert agents' reward functions through their external demonstrations is hence particularly relevant for subsequent design of realistic agent-based simulations. Inverse Reinforcement Learning (IRL) aims at acquiring such reward functions through inference, allowing to generalize the resulting policy to states not observed in the past. This paper investigates whether IRL can infer such rewards from agents within real financial stochastic environments: limit order books (LOB). We introduce a simple one-level LOB, where the interactions of a number of stochastic agents and an expert trading agent are modelled as a Markov decision process. We consider two cases for the expert's reward: either a simple linear function of state features; or a complex, more realistic non-linear function. Given the expert agent's demonstrations, we attempt to discover their strategy by modelling their latent reward function using linear and Gaussian process (GP) regressors from previous literature, and our own approach through Bayesian neural networks (BNN). While the three methods can learn the linear case, only the GP-based and our proposed BNN methods are able to discover the non-linear reward case. Our BNN IRL algorithm outperforms the other two approaches as the number of samples increases. These results illustrate that complex behaviours, induced by non-linear reward functions amid agent-based stochastic scenarios, can be deduced through inference, encouraging the use of inverse reinforcement learning for opponent-modelling in multi-agent systems.


title: Relating microswimmer synthesis to rheotactic tunability

abstract: We explore the behavior of micron-scale autophoretic Janus (Au/Pt) rods, having various Au/Pt length ratios, swimming near a wall in an imposed background flow. We find that their ability to robustly orient and move upstream, i.e. to rheotax, depends strongly on the Au/Pt ratio, which is easily tunable in synthesis. Numerical simulations of swimming rods actuated by a surface slip show a similar rheotactic tunability when varying the location of the surface slip versus surface drag. Slip location determines whether swimmers are Pushers (rear-actuated), Pullers (front-actuated), or in between. Our simulations and modeling show that Pullers rheotax most robustly due to their larger tilt angle to the wall, which makes them responsive to flow gradients. Thus, rheotactic response infers the nature of difficult to measure flow-fields of an active particle, establishes its dependence on swimmer type, and shows how Janus rods can be tuned for flow responsiveness. We demonstrate the effectiveness of a simple geometric sieve for rheotactic ability.


title: Topological modes in radiofrequency resonator arrays

abstract: Topological properties of solid states have sparked considerable recent interest due to their importance in the physics of lattices with a non-trivial basis and their potential in the design of novel materials. Here we describe an experimental and an accompanying numerical toolbox to create and analyze topological states in coupled radiofrequency resonator arrays. The arrays are coupled harmonic oscillator systems that are very easily constructed, offer a variety of geometric configurations, and whose eigenfunctions and eigenvalues are amenable to detailed analysis. These systems offer well defined analogs to coupled oscillator systems in general in that they are characterized by resonances whose frequency spectra depend on the individual resonators, the interactions between them, and the geometric and topological symmetries and boundary conditions. In particular, we describe an experimental analog of a small one-dimensional system, with excellent agreement with theory. The numerical part of the toolbox allows for simulations of larger mesoscopic systems with a semi-continuous band structure, in which all resonators still exhibit individual signatures. Systematic parameter variation yields an astonishing richness of band structures in this simple linear system, allowing for further explorations into novel phenomena of topological modes.


title: Disentangling Planets from Photoelectric Instability in Gas-Rich Optically Thin Dusty Disks

abstract: Structures in circumstellar disks such as gaps and rings are often attributed to planets. This connection has been difficult to show unequivocally, as other processes may also produce these features. Particularly, a photoelectric instability (PEI) has been proposed, operating in gas-rich optically thin disks, that generates structures predicted by planet--disk interactions. We examine the question of how to disentangle planetary effects on disk structure from the effects of the PEI. We use the Pencil Code to perform 2D global hydrodynamical models of the dynamics of gas and dust in a thin disk, with and without planetary perturbers. Photoelectric heating is modeled with an equation of state where pressure is proportional to dust surface density. The drag force on grains and its backreaction on the gas are included. Analyzing the situation without PEI, we find that gas--dust interactions alter the shape of the planetary gap from the dust-free case when the local dust-to-gas ratio $\varepsilon$ approaches unity. This result applies also to primordial disks, because dust drifting inwards accumulates at the edge of the planetary gap, and any initial dust-to-gas ratio eventually achieves $\varepsilon=1$ if the dust reservoir is sufficient. We find a result particular to high dust-to-gas ratio disks as well: as dust drifts inwards, the dust front becomes a sharp transition, and the backreaction triggers the Rossby wave instability. When PEI is included, we find that it obscures structures induced by planets unless the planet's mass is sufficiently large to carve a noticeable gap. Specifically, the instability generates arcs and rings of regular spacing: a planet is discernible when it carves a dust gap wider than the wavelength of the PEI.


title: Position-aware Graph Neural Networks

abstract: Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs. However, existing Graph Neural Network (GNN) architectures have limited power in capturing the position/location of a given node with respect to all other nodes of the graph. Here we propose Position-aware Graph Neural Networks (P-GNNs), a new class of GNNs for computing position-aware node embeddings. P-GNN first samples sets of anchor nodes, computes the distance of a given target node to each anchor-set,and then learns a non-linear distance-weighted aggregation scheme over the anchor-sets. This way P-GNNs can capture positions/locations of nodes with respect to the anchor nodes. P-GNNs have several advantages: they are inductive, scalable,and can incorporate node feature information. We apply P-GNNs to multiple prediction tasks including link prediction and community detection. We show that P-GNNs consistently outperform state of the art GNNs, with up to 66% improvement in terms of the ROC AUC score.


title: Medium-Term Load Forecasting Using Support Vector Regression, Feature Selection, and Symbiotic Organism Search Optimization

abstract: An accurate load forecasting has always been one of the main indispensable parts in the operation and planning of power systems. Among different time horizons of forecasting, while short-term load forecasting (STLF) and long-term load forecasting (LTLF) have respectively got benefits of accurate predictors and probabilistic forecasting, medium-term load forecasting (MTLF) demands more attention due to its vital role in power system operation and planning such as optimal scheduling of generation units, robust planning program for customer service, and economic supply. In this study, a hybrid method, composed of Support Vector Regression (SVR) and Symbiotic Organism Search Optimization (SOSO) method, is proposed for MTLF. In the proposed forecasting model, SVR is the main part of the forecasting algorithm while SOSO is embedded into it to optimize the parameters of SVR. In addition, a minimum redundancy-maximum relevance feature selection algorithm is used to in the preprocessing of input data. The proposed method is tested on EUNITE competition dataset to demonstrate its proper performance. Furthermore, it is compared with some previous works to show eligibility of our method.


title: ADASS: Adaptive Sample Selection for Training Acceleration

abstract: Stochastic gradient decent~(SGD) and its variants, including some accelerated variants, have become popular for training in machine learning. However, in all existing SGD and its variants, the sample size in each iteration~(epoch) of training is the same as the size of the full training set. In this paper, we propose a new method, called \underline{ada}ptive \underline{s}ample \underline{s}election~(ADASS), for training acceleration. During different epoches of training, ADASS only need to visit different training subsets which are adaptively selected from the full training set according to the Lipschitz constants of the loss functions on samples. It means that in ADASS the sample size in each epoch of training can be smaller than the size of the full training set, by discarding some samples. ADASS can be seamlessly integrated with existing optimization methods, such as SGD and momentum SGD, for training acceleration. Theoretical results show that the learning accuracy of ADASS is comparable to that of counterparts with full training set. Furthermore, empirical results on both shallow models and deep models also show that ADASS can accelerate the training process of existing methods without sacrificing accuracy.


title: Kinetics and clustering of dust particles in supersonic turbulence with self-gravity

abstract: We present a simulation of isothermal supersonic (rms Mach number $\mathcal{M}_{\rm rms} \sim 3$) turbulent gas with inertial particles (dust) and self-gravity in statistical steady-state, which we compare with a corresponding simulation without self-gravity. The former is in steady state, but close to gravitationally unstable, since we match the scale of the simulation box with Jeans wavelength, which provides the strongest influence of gravity on the dynamics of gas and dust without causing irreversible gravitational collapses. We find that self-gravity does not cause any significant increase in clustering of particles, regardless of particle size, but heavy particles show elevated mean velocities in the presence of self-gravity. The speed distributions are significantly shifted to higher values compared to simulations without self-gravity, but maintains the same shape.


title: Effects of the magnetic field direction on the Tsallis statistic

abstract: We extend the use of the Tsallis statistic to measure the differences in gas dynamics relative to the mean magnetic field present from natural eddy-type motions existing in magnetohydrodynamical (MHD) turbulence. The variation in gas dynamics was estimated using the Tsallis parameters on the incremental probability distribution function of the observables (intensity and velocity centroid) obtained from compressible MHD simulations. We find that the Tsallis statistic is susceptible to the anisotropy produce by the magnetic field, even when anisotropy is percent the Tsallis statistic can be use to determine MHD parameters such as the Sonic Mach number. We quantize the goodness of the Tsallis parameters using the coefficient of determination to measure the differences in the gas dynamics. These parameters also determine the level of magnetization and compressibility of the medium. To further simulate realistic spectroscopic observational data we introduced smoothing, noise, and cloud boundaries to the MHD simulations.


title: Generalized Beta Prime Distribution: Stochastic Model of Economic Exchange and Properties of Inequality Indices

abstract: We argue that a stochastic model of economic exchange, whose steady-state distribution is a Generalized Beta Prime (also known as GB2), and some unique properties of the latter, are the reason for GB2's success in describing wealth/income distributions. We use housing sale prices as a proxy to wealth/income distribution to numerically illustrate this point. We also explore parametric limits of the distribution to do so analytically. We discuss parametric properties of the inequality indices -- Gini, Hoover, Theil T and Theil L -- vis-a-vis those of GB2 and introduce a new inequality index, which serves a similar purpose. We argue that Hoover and Theil L are more appropriate measures for distributions with power-law dependencies, especially fat tails, such as GB2.


title: An automatic dynamic balancer in a rotating mechanism with time-varying angular velocity

abstract: We consider the system of a two ball automatic dynamic balancer attached to a rotating disc with nonconstant angular velocity. We directly compare the scenario of constant angular velocity with that when the acceleration of the rotor is taken into consideration. In doing so we show that there are cases where one must take the acceleration phase into consideration to obtain an accurate picture of the dynamics. Similarly we identify cases where the acceleration phase of the disc may be ignored. Finally, we briefly consider nonmonotonic variations of the angular velocity, with a view of maximising the basin of attraction of the desired solution, corresponding to damped vibrations.


title: Advertising in an oligopoly with differentiated goods under general demand and cost functions: A differential game approach

abstract: We present an analysis of advertising activities in a dynamic oligopoly with differentiated goods by differential game approach under general demand and cost functions. Mainly we show the following results. The comparison of the open-loop solution and that of the closed-loop solution depends on whether the outputs of the firms are strategic substitutes or strategic complements, and the memoryless closed-loop solution and the feedback solution are equivalent when there is no spillover effect of advertising activities.


title: Customizing Pareto Simulated Annealing for Multi-objective Optimization of Control Cabinet Layout

abstract: Determining the optimal location of control cabinet components requires the exploration of a large configuration space. For real-world control cabinets it is impractical to evaluate all possible cabinet configurations. Therefore, we need to apply methods for intelligent exploration of cabinet configuration space that enable to find a near-optimal configuration without evaluation of all possible configurations. In this paper, we describe an approach for multi-objective optimization of control cabinet layout that is based on Pareto Simulated Annealing. Optimization aims at minimizing the total wire length used for interconnection of components and the heat convection within the cabinet. We simulate heat convection to study the warm air flow within the control cabinet and determine the optimal position of components that generate heat during the operation. We evaluate and demonstrate the effectiveness of our approach empirically for various control cabinet sizes and usage scenarios.


title: Synthesis and characterization of cotton fiber-based nanocellulose

abstract: Nanocellulose prepared from the natural material has a promising wide range of opportunities to obtain the superior material properties towards various end-products. In this research, commercially available natural cotton was treated with aqueous sodium hydroxide solution to eliminate the hemicellulose and lignin, then cellulose was collected. The collected cellulose was subjected to acid hydrolysis using sulphuric acid to obtain nanocellulose. The prepared nanocellulose was further characterized with the aid of Fourier transform infrared spectroscopy, X-ray diffraction and Scanning Electron Microscopy to elucidate the chemical structure, crystallinity and the morphology.


title: Some Open Problems in Sasaki Geometry

abstract: This paper has been submitted to the Proceedings of the Australian-German Workshop on Differential Geometry in the Large held at the mathematical research institute MATRIX in Creswick, Victoria, Australia, Feb.2-Feb.14, 2019. We describe and discuss 2 important open problems in Sasaki geometry.


title: Mathematical model of a flow of reacting substances in a channel of network

abstract: Complex systems often have features that can be modeled by advanced mathematical tools [1]. Of special interests are the features of complex systems that have a network structure as such systems are important for modeling technological and social processes [3, 4]. In our previous research we have discussed the flow of a single substance in a channel of network. It may happen however that two substances flow in the same channel of network. In addition the substances may react and then the question arises about the distribution of the amounts of the substances in the segments of the channel. A study of the dynamics of the flow of the substances as well as a study of the distribution of the substances is presented in this paper on the base of a discrete - time model of flow of substances in the nodes of a channel of a network.


title: Primer on Detectors and Electronics for Particle Physics Experiments

abstract: This primer is a brief introduction to the technologies used in particle detectors designed for high-energy particle physics experiments. The intended readers are students, especially undergraduates, starting laboratory work.


title: Polymorphic Relaxed Noninterference

abstract: Information-flow security typing statically preserves confidentiality by enforcing noninterference. To address the practical need of selective and flexible declassification of confidential information, several approaches have developed a notion of relaxed noninterference, where security labels are either functions or types. The labels-as-types approach to relaxed noninterference supports expressive declassification policies, including recursive ones, via a simple subtyping-based ordering, and provides a local, modular reasoning principle. In this work, we extend this expressive declassification approach in order to support polymorphic declassification. First, we identify the need for bounded polymorphism through concrete examples. We then formalize polymorphic relaxed noninterference in a typed object-oriented calculus, using a step-indexed logical relation to prove that all well-typed terms are secure. Finally, we address the case of primitive types, which requires a form of ad-hoc polymorphism. Therefore, this work addresses practical hurdles to providing controlled and expressive declassification for the construction of information-flow secure systems.


title: Photometry of Beta Lyrae in 2018 by the BRITE satellites

abstract: Observations of Beta Lyr in four months of 2018 by three BRITE Constellation satellites (the red-filter BTr and BHr, and the blue-filter BLb) permitted a first, limited look into the light-curve variability in two spectral bands. The variations were found to be well correlated outside the innermost primary minima with the blue variations appearing to have smaller amplitudes than the red; this reduction may reflect their presumed origin in the cooler, outer parts of the accretion disk. This result must be confirmed with more extensive material as the current conclusions are based on observations spanning slightly less than three orbital cycles of the binary. The assumption of an instrumental problem and the applied corrections made to explain the unexpectedly large amplitude of the red-filter light-curve observed with the BTr satellite in 2016 are fully confirmed by the 2018 results.


title: UnLimited TRAnsfers for Multi-Modal Route Planning: An Efficient Solution

abstract: We study a multimodal journey planning scenario consisting of a public transit network and a transfer graph which represents a secondary transportation mode (e.g., walking, cycling, e-scooter). The objective is to compute Pareto-optimal journeys with respect to arrival time and the number of used public transit trips. While various existing algorithms can efficiently compute optimal journeys in either a pure public transit network or a pure transfer graph, combining the two increases running times significantly. Existing approaches therefore typically only support limited walking between stops, either by imposing a maximum transfer distance or by requiring the transfer graph to be transitively closed. To overcome these shortcomings, we propose a novel preprocessing technique called ULTRA (UnLimited TRAnsfers): Given an unlimited transfer graph, which may represent any non-schedule-based transportation mode, ULTRA computes a small number of transfer shortcuts that are provably sufficient for computing a Pareto set of optimal journeys. These transfer shortcuts can be integrated into a variety of state-of-the-art public transit algorithms, establishing the ULTRA-Query algorithm family. Our extensive experimental evaluation shows that ULTRA improves these algorithms from limited to unlimited transfers without sacrificing query speed. This is true not just for walking, but also for faster transfer modes such as bicycle or car. Compared to the state of the art for multimodal journey planning, the fastest ULTRA-based algorithm achieves a speedup of an order of magnitude.


title: Weakly-supervised Compositional FeatureAggregation for Few-shot Recognition

abstract: Learning from a few examples is a challenging task for machine learning. While recent progress has been made for this problem, most of the existing methods ignore the compositionality in visual concept representation (e.g. objects are built from parts or composed of semantic attributes), which is key to the human ability to easily learn from a small number of examples. To enhance the few-shot learning models with compositionality, in this paper we present the simple yet powerful Compositional Feature Aggregation (CFA) module as a weakly-supervised regularization for deep networks. Given the deep feature maps extracted from the input, our CFA module first disentangles the feature space into disjoint semantic subspaces that model different attributes, and then bilinearly aggregates the local features within each of these subspaces. CFA explicitly regularizes the representation with both semantic and spatial compositionality to produce discriminative representations for few-shot recognition tasks. Moreover, our method does not need any supervision for attributes and object parts during training, thus can be conveniently plugged into existing models for end-to-end optimization while keeping the model size and computation cost nearly the same. Extensive experiments on few-shot image classification and action recognition tasks demonstrate that our method provides substantial improvements over recent state-of-the-art methods.


title: Relaxed random walks at scale

abstract: Relaxed random walk (RRW) models of trait evolution introduce branch-specific rate multipliers to modulate the variance of a standard Brownian diffusion process along a phylogeny and more accurately model overdispersed biological data. Increased taxonomic sampling challenges inference under RRWs as the number of unknown parameters grows with the number of taxa. To solve this problem, we present a scalable method to efficiently fit RRWs and infer this branch-specific variation in a Bayesian framework. We develop a Hamiltonian Monte Carlo (HMC) sampler to approximate the high-dimensional, correlated posterior that exploits a closed-form evaluation of the gradient of the trait data log-likelihood with respect to all branch-rate multipliers simultaneously. Our gradient calculation achieves computational complexity that scales only linearly with the number of taxa under study. We compare the efficiency of our HMC sampler to the previously standard univariable Metropolis-Hastings approach while studying the spatial emergence of the West Nile virus in North America in the early 2000s. Our method achieves an over 300-fold speed-increase over the univariable approach. Additionally, we demonstrate the scalability of our method by applying the RRW to study the correlation between five mammalian life history traits in a phylogenetic tree with 3650 tips.


title: Hard-state accretion disk winds from black holes: the revealing case of MAXI J1820+070

abstract: We report on a detailed optical spectroscopic follow-up of the black hole transient MAXI J1820+070 (ASASSN-18ey). The observations cover the main part of the X-ray binary outburst, when the source alternated between hard and soft states following the classical pattern widely seen in other systems. We focus the analysis on the He I emission lines at 5876 and 6678 Angs, as well as on Halpha. We detect clear accretion disk wind features (P-Cyg profiles and broad emission line wings) in the hard state, both during outburst rise and decay. These are not witnessed during the several months long soft state. However, our data suggest that the visibility of the outflow might be significantly affected by the ionisation state of the accretion disk. The terminal velocity of the wind is above ~ 1200 km/s, which is similar to outflow velocities derived from (hard-state) optical winds and (soft-state) X-ray winds in other systems. The wind signatures, in particular the P-Cyg profiles, are very shallow, and their detection has only been possible thanks to a combination of source brightness and intense monitoring at very high signal-to-noise. This study indicates that cold, optical winds are most likely a common feature of black hole accretion, and therefore, that wind-like outflows are a general mechanism of mass and angular momentum removal operating throughout the entire X-ray binary outburst.


title: Unmasking Bias in News

abstract: We present experiments on detecting hyperpartisanship in news using a 'masking' method that allows us to assess the role of style vs. content for the task at hand. Our results corroborate previous research on this task in that topic related features yield better results than stylistic ones. We additionally show that competitive results can be achieved by simply including higher-length n-grams, which suggests the need to develop more challenging datasets and tasks that address implicit and more subtle forms of bias.


title: Toward Best Practices for Explainable B2B Machine Learning

abstract: To design tools and data pipelines for explainable B2B machine learning (ML) systems, we need to recognize not only the immediate audience of such tools and data, but also (1) their organizational context and (2) secondary audiences. Our learnings are based on building custom ML-based chatbots for recruitment. We believe that in the B2B context, "explainable" ML means not only a system that can "explain itself" through tools and data pipelines, but also enables its domain-expert users to explain it to other stakeholders.


title: Edge-Direct Visual Odometry

abstract: In this paper we propose an edge-direct visual odometry algorithm that efficiently utilizes edge pixels to find the relative pose that minimizes the photometric error between images. Prior work on exploiting edge pixels instead treats edges as features and employ various techniques to match edge lines or pixels, which adds unnecessary complexity. Direct methods typically operate on all pixel intensities, which proves to be highly redundant. In contrast our method builds on direct visual odometry methods naturally with minimal added computation. It is not only more efficient than direct dense methods since we iterate with a fraction of the pixels, but also more accurate. We achieve high accuracy and efficiency by extracting edges from only one image, and utilize robust Gauss-Newton to minimize the photometric error of these edge pixels. This simultaneously finds the edge pixels in the reference image, as well as the relative camera pose that minimizes the photometric error. We test various edge detectors, including learned edges, and determine that the optimal edge detector for this method is the Canny edge detection algorithm using automatic thresholding. We highlight key differences between our edge direct method and direct dense methods, in particular how higher levels of image pyramids can lead to significant aliasing effects and result in incorrect solution convergence. We show experimentally that reducing the photometric error of edge pixels also reduces the photometric error of all pixels, and we show through an ablation study the increase in accuracy obtained by optimizing edge pixels only. We evaluate our method on the RGB-D TUM benchmark on which we achieve state-of-the-art performance.


title: Expansiveness for the geodesic and horocycle flows on compact Riemann surfaces of constant negative curvature

abstract: We study expansive properties for the geodesic and horocycle flows on compact Riemann surfaces of constant negative curvature. It is well-known that the geodesic flow is expansive in the sense of Bowen-Walters and the horocycle flow is positive and negative separating in the sense of Gura. In this paper, we give a new proof of the expansiveness in the sense of Bowen-Walters for the geodesic flow and show that the horocycle flow is positive and negative kinematic expensive in the sense of Artigue as well as expansive in the sense of Katok-Hasselblatt but not expensive in the sense of Bowen-Walters. We also point out that the geodesic flow is neither positive nor negative separating.


title: Weighted, Bipartite, or Directed Stream Graphs for the Modeling of Temporal Networks

abstract: We recently introduced a formalism for the modeling of temporal networks, that we call stream graphs. It emphasizes the streaming nature of data and allows rigorous definitions of many important concepts generalizing classical graphs. This includes in particular size, density, clique, neighborhood, degree, clustering coefficient, and transitivity. In this contribution, we show that, like graphs, stream graphs may be extended to cope with bipartite structures, with node and link weights, or with link directions. We review the main bipartite, weighted or directed graph concepts proposed in the literature, we generalize them to the cases of bipartite, weighted, or directed stream graphs, and we show that obtained concepts are consistent with graph and stream graph ones. This provides a formal ground for an accurate modeling of the many temporal networks that have one or several of these features.


title: Moments of angular distribution and beam asymmetries in $\eta\pi^0$ photoproduction at GlueX

abstract: In the search for exotic mesons, the GlueX collaboration will soon extract moments of the $\eta\pi^0$ angular distribution. In the perspective of these results, we generalize the formalism of moment extraction to the case in which the two mesons are produced with a linearly polarized beam, and build a model for the reaction $\vec \gamma p \to \eta \pi^0 p$. The model includes resonant $S$-, $P$-, $D$-waves in $\eta\pi^0$, produced by natural exchanges. Moments of the $\eta\pi^0$ angular distribution are computed with and without the $P$-wave, to illustrate the sensitivity to exotic resonances. Although little sensitivity to the $P$-wave is found in moments of even angular momentum, moments of odd angular momentum are proportional to the interference between the $P$-wave and the dominant $S$- and $D$-waves. We also generalize the definition of the beam asymmetry for two mesons photoproduction and show that, when the meson momenta are perpendicular to the reaction plane, the beam asymmetry enhances the sensitivity to the exotic $P$-wave.


title: Similarity Problems in High Dimensions

abstract: The main contribution of this dissertation is the introduction of new or improved approximation algorithms and data structures for several similarity search problems. We examine the furthest neighbor query, the annulus query, distance sensitive membership, nearest neighbor preserving embeddings and set similarity queries in the large-scale, high-dimensional setting.


title: Circumnuclear rings and Lindblad resonances in spiral galaxies

abstract: In order to study the location of circumnuclear rings (CNR) and their possible relation with the inner Lindblad resonances (ILR), we investigate a sample of spiral galaxies. For this purpose, we have obtained and analyzed medium resolution spectra of 5 spiral galaxies in the range 6200 \AA \ to 6900 \AA.\, Through the H$\alpha$ emission line, we constructed the radial velocity curves, and then the rotation curves. By fitting them, considering two or three components of an axisymetric Miyamoto$-$Nagai gravitational potential, we constructed the angular velocity and Lindblad curves. In addition, we determined the CNR radius by using the 2D spectra and generating the H$\alpha$ spatial emission radial profiles. We determined the position of the resonances and we calculated the angular velocity pattern, which are in the range of 26 $-$ 47 km s$^{-1}$ kpc$^{-1}$ for the galaxies of the sample. According to our results, the CNRs are located between the inner ILR (iILR) and the outer ILR (oILR), or between the center of the galaxy and the ILR, when the object has only one of such resonance; in agreement with previous results. In addition, we calculated the dimensionless parameter defined as $\mathcal{R}=$ R$_{CR}$ / R$_{bar}$, being in the range 1.1 $-$ 1.6, in agreement with previous results found in the literature.


title: A monotone data augmentation algorithm for longitudinal data analysis via multivariate skew-t, skew-normal or t distributions

abstract: The mixed effects model for repeated measures (MMRM) has been widely used for the analysis of longitudinal clinical data collected at a number of fixed time points. We propose a robust extension of the MMRM for skewed and heavy-tailed data on basis of the multivariate skew-t distribution, and it includes the multivariate normal, t, and skew-normal distributions as special cases. An efficient Markov chain Monte Carlo algorithm is developed using the monotone data augmentation and parameter expansion techniques. We employ the algorithm to perform controlled pattern imputations for sensitivity analyses of longitudinal clinical trials with nonignorable dropouts. The proposed methods are illustrated by real data analyses. Sample SAS programs for the analyses are provided in the online supplementary material.


title: Discrepancy, Coresets, and Sketches in Machine Learning

abstract: This paper defines the notion of class discrepancy for families of functions. It shows that low discrepancy classes admit small offline and streaming coresets. We provide general techniques for bounding the class discrepancy of machine learning problems. As corollaries of the general technique we bound the discrepancy (and therefore coreset complexity) of logistic regression, sigmoid activation loss, matrix covariance, kernel density and any analytic function of the dot product or the squared distance. Our results prove the existence of epsilon-approximation O(sqrt{d}/epsilon) sized coresets for the above problems. This resolves the long-standing open problem regarding the coreset complexity of Gaussian kernel density estimation. We provide two more related but independent results. First, an exponential improvement of the widely used merge-and-reduce trick which gives improved streaming sketches for any low discrepancy problem. Second, an extremely simple deterministic algorithm for finding low discrepancy sequences (and therefore coresets) for any positive semi-definite kernel. This paper establishes some explicit connections between class discrepancy, coreset complexity, learnability, and streaming algorithms.


title: Transfer matrix theory of surface spin echo experiments with molecules

abstract: ${}^3$He beam spin-echo experiments have been used to study surface morphology, molecular and atomic surface diffusion, phonon dispersions, phason dispersions and phase transitions of ionic liquids. However, the interactions between ${}^3$He atoms and surfaces or their adsorbates are typically isotropic and weak. To overcome these limitations, one can use molecules instead of ${}^3$He in surface spin-echo experiments. The molecular degrees of freedom, such as rotation, may be exploited to provide additional insight into surfaces and the behaviour of their adsorbates. Indeed, a recent experiment has shown that $\textit{ortho}$-hydrogen can be used as a probe that is sensitive to the orientation of a Cu(115) surface [Godsi et al., Nat. Comm. $\textbf{8}$, 15357 (2017)]. However, the additional degrees of freedom offered by molecules also pose a theoretical challenge: a large manifold of molecular states and magnetic field-induced couplings between internal states. Here, we present a fully quantum mechanical approach to model molecular surface spin-echo experiments and connect the experimental signal to the elements of the time-independent molecule-surface scattering matrix. We present a one-dimensional transfer matrix method that includes the molecular hyperfine degrees of freedom and accounts for the spatial separation of the molecular wavepackets due to the magnetic control fields. We apply the method to the case of $\textit{ortho}$-hydrogen, show that the calculated experimental signal is sensitive to the scattering matrix elements, and perform a preliminary comparison to experiment. This work sets the stage for Bayesian optimization to determine the scattering matrix elements from experimental measurements and for a framework that describes molecular surface spin-echo experiments to study dynamic surfaces.


title: On the balance problem for two rotating and charged black holes

abstract: It is an interesting open problem whether two non-extremal rotating and electrically charged black holes can be in physical equilibrium, which might be possible due to a balance between the gravitational attraction and the spin-spin and electrical repulsions. Exact candidate solutions were constructed, but it is unclear whether they are physically acceptable. These solutions were obtained by assuming a particular behaviour on the symmetry axis. However, it was not known whether the assumed form of the axis data covers the general case or whether data of some other type need to be considered as well. By studying a boundary value problem for the axisymmetric and stationary Einstein-Maxwell equations, we address this question and derive the most general form of permissible axis potentials for possible equilibrium configurations.


title: A Closer Look at the Optimization Landscapes of Generative Adversarial Networks

abstract: Generative adversarial networks have been very successful in generative modeling, however they remain relatively challenging to train compared to standard deep neural networks. In this paper, we propose new visualization techniques for the optimization landscapes of GANs that enable us to study the game vector field resulting from the concatenation of the gradient of both players. Using these visualization techniques we try to bridge the gap between theory and practice by showing empirically that the training of GANs exhibits significant rotations around Local Stable Stationary Points (LSSP), similar to the one predicted by theory on toy examples. Moreover, we provide empirical evidence that GAN training converge to a stable stationary point which is a saddle point for the generator loss, not a minimum, while still achieving excellent performance.


title: Adiabatic frequency shifting in epsilon near zero materials: The role of group velocity

abstract: We investigate adiabatic frequency conversion using epsilon near zero (ENZ) materials and show that while the maximum frequency conversion for a given change of permittivity does not exhibit increase in the vicinity of {\epsilon}=0 condition. However, that change can be achieved in a shorter length, and if the pump is also in the ENZ vicinity, at a lower pump intensity. This slow propagation effect makes the conversion efficiency in the ENZ material comparable to that in microresonators and other structured slow light schemes, but unlike the latter no nanofabrication is required for ENZ materials which constitutes their major advantage over alternative frequency conversion approaches.


title: Defect-Moderated Oxidative Etching of MoS2

abstract: We report a simple technique for the selective etching of bilayer and monolayer MoS$_2$. In this work, chosen regions of MoS$_2$ were activated for oxygen adsorption and reaction by the application of low doses of He$^+$ at 30 keV in a gas ion microscope. Raman spectroscopy, optical microscopy and scanning electron microscopy were used to characterize both the etched features and the remaining material. It has been found that by using a pre-treatment to introduce defects, MoS$_2$ can be etched very efficiently and with high region specificity by heating in air.


title: Spin imbalance of charge carriers induced by an electric current

abstract: We analyze the contribution of the inhomogeneous magnetic field induced by an electrical current to the spin Hall effect in metals. The Zeeman coupling between the field and the electron spin leads to a spin dependent force, and to spin accumulation at the edges. We compare the effect of this relativistic correction to the electron dynamics to the features induced by the spin-orbit interaction. The effect of current induced magnetic fields on the spin Hall effect can be comparable to the extrinsic contribution from the spin-orbit interaction, although it does not require the presence of heavy elements with a strong spin-orbit interaction. The induced spins are oriented normal to the metal slab.


title: Snake-Like Robots for Minimally Invasive, Single Port, and Intraluminal Surgeries

abstract: The surgical paradigm of Minimally Invasive Surgery (MIS) has been a key driver to the adoption of robotic surgical assistance. Progress in the last three decades has led to a gradual transition from manual laparoscopic surgery with rigid instruments to robot-assisted surgery. In the last decade, the increasing demand for new surgical paradigms to enable access into the anatomy without skin incision (intraluminal surgery) or with a single skin incision (Single Port Access surgery - SPA) has led researchers to investigate snake-like flexible surgical devices. In this chapter, we first present an overview of the background, motivation, and taxonomy of MIS and its newer derivatives. Challenges of MIS and its newer derivatives (SPA and intraluminal surgery) are outlined along with the architectures of new snake-like robots meeting these challenges. We also examine the commercial and research surgical platforms developed over the years, to address the specific functional requirements and constraints imposed by operations in confined spaces. The chapter concludes with an evaluation of open problems in surgical robotics for intraluminal and SPA, and a look at future trends in surgical robot design that could potentially address these unmet needs.


title: Absorption of Gravitational Waves from Distant Sources

abstract: The rate of gravitational wave absorption by inverse bremsstrahlung is calculated. It increases with decreasing frequency $\nu$ as $\nu^{-3}$. Nevertheless, because of the near cancellation of absorption by stimulated emission, the ionized gas in galaxy clusters does not block gravitational waves at the nanohertz frequencies that may be detected by the use of pulsar timing observations.


title: Task-Aware Feature Generation for Zero-Shot Compositional Learning

abstract: Visual concepts (e.g., red apple, big elephant) are often semantically compositional and each element of the compositions can be reused to construct novel concepts (e.g., red elephant). Compositional feature synthesis, which generates image feature distributions exploiting the semantic compositionality, is a promising approach to sample-efficient model generalization. In this work, we propose a task-aware feature generation (TFG) framework for compositional learning, which generates features of novel visual concepts by transferring knowledge from previously seen concepts. These synthetic features are then used to train a classifier to recognize novel concepts in a zero-shot manner. Our novel TFG design injects task-conditioned noise layer-by-layer, producing task-relevant variation at each level. We find the proposed generator design improves classification accuracy and sample efficiency. Our model establishes a new state of the art on three zero-shot compositional learning (ZSCL) benchmarks, outperforming the previous discriminative models by a large margin. Our model improves the performance of the prior arts by over 2x in the generalized ZSCL setting.


title: Modified log-Sobolev inequality for a compact PJMP with degenerate jumps

abstract: We study the modified log-Sobolev inequality for a class of pure jump Markov processes that describe the interactions between brain neurons. In particular, we focus on a finite and compact process with degenerate jumps inspired by the model introduced by Galves and L\"ocherbach. As a result, we obtain concentration properties for empirical approximations of the process.


title: On the classical and quantum Geroch group

abstract: The Geroch group is an infinite dimensional transitive group of symmetries of classical cylindrically symmetric gravitational waves which acts by non-canonical transformations on the phase space of these waves. Here this symmetry is rederived and the unique Poisson bracket on the Geroch group which makes its action on the gravitational phase space Lie-Poisson is obtained. Two possible notions of asymptotic flatness are proposed that are compatible with the Poisson bracket on the phase space, and corresponding asymptotic flatness preserving subgroups of the Geroch group are defined which turn out to be compatible with the Poisson bracket on the group. A quantization of the Geroch group is proposed that is similar to, but distinct from, the $\mathfrak{sl}_2$ Yangian, and a certain action of this quantum Geroch group on gravitational observables is shown to preserve the commutation relations of Korotkin and Samtleben's quantization of asymptotically flat cylindrically symmetric gravitational waves. The action also preserves three of the additional conditions that define their quantization. It is conjectured that the action preserves the remaining two conditions (asymptotic flatness and a unit determinant condition on a certain basic field) as well and is, in fact, a symmetry of their model. Our results on the quantum theory are formal, but a possible rigorous formulation based on algebraic quantum theory is outlined.


title: Fast Trajectory Optimization via Successive Convexification for Spacecraft Rendezvous with Integer Constraints

abstract: In this paper we present a fast method based on successive convexification for generating fuel-optimized spacecraft rendezvous trajectories in the presence of mixed-integer constraints. A recently developed paradigm of state-triggered constraints allows to efficiently embed a subset of discrete decision constraints into the continuous optimization framework of successive convexification. As a result, we are able to solve difficult trajectory optimization problems at interactive speeds, as opposed to a mixed-integer programming approach that would require significantly more solution time and computing power. Our method is applied to the real problem of transposition and docking of the Apollo command and service module with the lunar module. We demonstrate that, within seconds, we are able to obtain trajectories that are up to 90 percent more fuel efficient (saving up to 45 kg of fuel) than non-optimization based Apollo-era design targets. Our trajectories take explicit account of minimum thrust pulse width and plume impingement constraints. Both of these constraints are naturally mixed-integer, but we handle them as state-triggered constraints. In its current state, our algorithm will serve as a useful off-line design tool for rapid trajectory trade studies.


title: Primordial Extremal Black Holes as Dark Matter

abstract: We show that primordial (nearly) extremal black holes with a wide range of masses from the Planck scale to around $10^9$ g could be cosmologically stable and explain dark matter, given a dark electromagnetism and a heavy dark electron. For individual black holes, Hawking radiation and Schwinger discharge processes are suppressed by near-extremality and the heaviness of the dark electron, respectively. In contrast, the merger events of binary systems provide an opportunity to directly observe Hawking radiation. Because the merger products are not extremal, they rapidly evaporate and produce transient high-energy neutrino and gamma ray signals that can be observed at telescopes like IceCube and HAWC. The relationship between the near-extremal black hole and dark electron masses could also shed light on the weak gravity conjecture.


title: Reinforcement Learning for Integer Programming: Learning to Cut

abstract: Integer programming (IP) is a general optimization framework widely applicable to a variety of unstructured and structured problems arising in, e.g., scheduling, production planning, and graph optimization. As IP models many provably hard to solve problems, modern IP solvers rely on many heuristics. These heuristics are usually human-designed, and naturally prone to suboptimality. The goal of this work is to show that the performance of those solvers can be greatly enhanced using reinforcement learning (RL). In particular, we investigate a specific methodology for solving IPs, known as the Cutting Plane Method. This method is employed as a subroutine by all modern IP solvers. We present a deep RL formulation, network architecture, and algorithms for intelligent adaptive selection of cutting planes (aka cuts). Across a wide range of IP tasks, we show that the trained RL agent significantly outperforms human-designed heuristics, and effectively generalizes to 10X larger instances and across IP problem classes. The trained agent is also demonstrated to benefit the popular downstream application of cutting plane methods in Branch-and-Cut algorithm, which is the backbone of state-of-the-art commercial IP solvers.


title: A mixed-integer linear programming approach for soft graph clustering

abstract: This paper proposes a Mixed-Integer Linear Programming approach for the Soft Graph Clustering Problem. This is the first method that simultaneously allocates membership proportion for vertices that lie in multiple clusters, and that enforces an equal balance of the cluster memberships. Compared to ([Palla et al., 2005], [Derenyi et al., 2005], [Adamcsek et al., 2006]), the clusters found in our method are not limited to k-clique neighbourhoods. Compared to ([Hope and Keller, 2013]), our method can produce non-trivial clusters even for a connected unweighted graph.


title: Homological Connectivity in Random \v{C}ech Complexes

abstract: We study the homology of random \v{C}ech complexes generated by a homogeneous Poisson process. We focus on 'homological connectivity' - the stage where the random complex is dense enough, so that its homology "stabilizes" and becomes isomorphic to that of the underlying topological space. Our results form a comprehensive high-dimensional analogue of well-known phenomena related to connectivity in the Erd\H{o}s-R\'enyi graph and random geometric graphs. We first prove that there is a sharp phase transition describing homological connectivity. Next, we analyze the behavior of the complex in the critical window. We show that the cycles obstructing homological connectivity have a very unique and simple shape. In addition, we prove that the process counting the last obstructions converges to a Poisson process. We make a heavy use of Morse theory, and its adaptation to distance functions. In particular, our results classify the critical points of random distance functions according to their exact effect on homology.


title: A Comment on Privacy-Preserving Scalar Product Protocols as proposed in "SPOC"

abstract: Privacy-preserving scalar product (PPSP) protocols are an important building block for secure computation tasks in various applications. Lu et al. (TPDS'13) introduced a PPSP protocol that does not rely on cryptographic assumptions and that is used in a wide range of publications to date. In this comment paper, we show that Lu et al.'s protocol is insecure and should not be used. We describe specific attacks against it and, using impossibility results of Impagliazzo and Rudich (STOC'89), show that it is inherently insecure and cannot be fixed without relying on at least some cryptographic assumptions.


title: Statistical guarantees for local graph clustering

abstract: Local graph clustering methods aim to find small clusters in very large graphs. These methods take as input a graph and a seed node, and they return as output a good cluster in a running time that depends on the size of the output cluster but that is independent of the size of the input graph. In this paper, we adopt a statistical perspective on local graph clustering, and we analyze the performance of the l1-regularized PageRank method~(Fountoulakis et. al.) for the recovery of a single target cluster, given a seed node inside the cluster. Assuming the target cluster has been generated by a random model, we present two results. In the first, we show that the optimal support of l1-regularized PageRank recovers the full target cluster, with bounded false positives. In the second, we show that if the seed node is connected solely to the target cluster then the optimal support of l1-regularized PageRank recovers exactly the target cluster. We also show empirically that l1-regularized PageRank has a state-of-the-art performance on many real graphs, demonstrating the superiority of the method. From a computational perspective, we show that the solution path of l1-regularized PageRank is monotonic. This allows for the application of the forward stagewise algorithm, which approximates the solution path in running time that does not depend on the size of the whole graph. Finally, we show that l1-regularized PageRank and approximate personalized PageRank (APPR), another very popular method for local graph clustering, are equivalent in the sense that we can lower and upper bound the output of one with the output of the other. Based on this relation, we establish for APPR similar results to those we establish for l1-regularized PageRank.


title: Resource-efficient and fault-tolerant topological quantum computation with hybrid entanglement of light

abstract: We propose an all-linear-optical scheme to ballistically generate a cluster state for measurement-based topological fault-tolerant quantum computation using hybrid photonic qubits entangled in a continuous-discrete domain. Availability of near-deterministic Bell-state measurements on hybrid qubits is exploited for the purpose. In the presence of photon losses, we show that our scheme leads to a significant enhancement in both tolerable photon-loss rate and resource overheads. More specifically, we report a photon-loss threshold of $\sim3.3\times 10^{-3}$, which is higher than those of known optical schemes under a reasonable error model. Furthermore, resource overheads to achieve logical error rate of $10^{-6} (10^{-15})$ is estimated to be $\sim8.5\times10^{5} (1.7\times10^{7})$ which is significantly less by multiple orders of magnitude compared to other reported values in the literature.


title: Fine's Theorem for Leggett-Garg tests with an arbitrary number of measurement times

abstract: If the time evolution of a system can be understood classically, then there must exist an underlying probability distribution for the variables describing the system at all times. It is well known that for systems described by a single time-evolving dichotomic variable $Q$ and for which a given set of temporal correlation functions are specified, a necessary set of conditions for the existence of such a probability are provided by the Leggett-Garg (LG) inequalities. Fine's theorem in this context is the non-trivial result that a suitably augmented set of LG inequalities are both necessary and sufficient conditions for the existence of an underlying probability. We present a proof of Fine's theorem for the case of measurements on a dichotomic variable at an abitrary number of times, thereby generalizing the familiar proofs for three and four times. We demonstrate how the LG framework and Fine's theorem can be extended to the case in which all possible two-time correlation functions are measured (instead of the partial set of two-time correlators normally studied). We examine the limit of a large number of measurements for both of the above cases.


title: On regularization for a convolutional kernel in neural networks

abstract: Convolutional neural network is an important model in deep learning. To avoid exploding/vanishing gradient problems and to improve the generalizability of a neural network, it is desirable to have a convolution operation that nearly preserves the norm, or to have the singular values of the transformation matrix corresponding to a convolutional kernel bounded around $1$. We propose a penalty function that can be used in the optimization of a convolutional neural network to constrain the singular values of the transformation matrix around $1$. We derive an algorithm to carry out the gradient descent minimization of this penalty function in terms of convolution kernels. Numerical examples are presented to demonstrate the effectiveness of the method.


title: Influence of 3D plasmoid dynamics on the transition from collisional to kinetic reconnection

abstract: Within the resistive magnetohydrodynamic model, high-Lundquist number reconnection layers are unstable to the plasmoid instability, leading to a turbulent evolution where the reconnection rate can be independent of the underlying resistivity. However, the physical relevance of these results remains questionable for many applications. First, the reconnection electric field is often well above the runaway limit, implying that collisional resistivity is invalid. Furthermore, both theory and simulations suggest that plasmoid formation may rapidly induce a transition to kinetic scales, due to the formation of thin current sheets. Here, this problem is studied for the first time using a first-principles kinetic simulation with a Fokker-Planck collision operator in 3D. The low-$\beta$ reconnecting current layer thins rapidly due to Joule heating before onset of the oblique plasmoid instability. Linear growth rates for standard ($k_y = 0$) tearing modes agree with semi-collisional boundary layer theory, but the angular spectrum of oblique ($|k_y|>0$) modes is significantly narrower than predicted. In the non-linear regime, flux-ropes formed by the instability undergo complex interactions as they are advected and rotated by the reconnection outflow jets, leading to a turbulent state with stochastic magnetic field. In a manner similar to previous 2D results, super-Dreicer fields induce a transition to kinetic reconnection in thin current layers that form between flux-ropes. These results may be testable within new laboratory experiments.


title: Semi-flat minima and saddle points by embedding neural networks to overparameterization

abstract: We theoretically study the landscape of the training error for neural networks in overparameterized cases. We consider three basic methods for embedding a network into a wider one with more hidden units, and discuss whether a minimum point of the narrower network gives a minimum or saddle point of the wider one. Our results show that the networks with smooth and ReLU activation have different partially flat landscapes around the embedded point. We also relate these results to a difference of their generalization abilities in overparameterized realization.


title: An ultraweak formulation of the Reissner-Mindlin plate bending model and DPG approximation

abstract: We develop and analyze an ultraweak variational formulation of the Reissner-Mindlin plate bending model both for the clamped and the soft simply supported cases. We prove well-posedness of the formulation, uniformly with respect to the plate thickness $t$. We also prove weak convergence of the Reissner-Mindlin solution to the solution of the corresponding Kirchhoff-Love model when $t\to 0$. Based on the ultraweak formulation, we introduce a discretization of the discontinuous Petrov-Galerkin type with optimal test functions (DPG) and prove its uniform quasi-optimal convergence. Our theory covers the case of non-convex polygonal plates. A numerical experiment for some smooth model solutions with fixed load confirms that our scheme is locking free.


title: Communication-Efficient Accurate Statistical Estimation

abstract: When the data are stored in a distributed manner, direct application of traditional statistical inference procedures is often prohibitive due to communication cost and privacy concerns. This paper develops and investigates two Communication-Efficient Accurate Statistical Estimators (CEASE), implemented through iterative algorithms for distributed optimization. In each iteration, node machines carry out computation in parallel and communicate with the central processor, which then broadcasts aggregated information to node machines for new updates. The algorithms adapt to the similarity among loss functions on node machines, and converge rapidly when each node machine has large enough sample size. Moreover, they do not require good initialization and enjoy linear converge guarantees under general conditions. The contraction rate of optimization errors is presented explicitly, with dependence on the local sample size unveiled. In addition, the improved statistical accuracy per iteration is derived. By regarding the proposed method as a multi-step statistical estimator, we show that statistical efficiency can be achieved in finite steps in typical statistical applications. In addition, we give the conditions under which the one-step CEASE estimator is statistically efficient. Extensive numerical experiments on both synthetic and real data validate the theoretical results and demonstrate the superior performance of our algorithms.


title: Nearly Finitary Matroids

abstract: In this thesis, we study nearly finitary matroids by introducing new definitions and prove various properties of nearly finitary matroids. In 2010, an axiom system for infinite matroids was proposed by Bruhn et al. We use this axiom system for this thesis. In Chapter 2, we summarize our main results after reviewing historical background and motivation. In Chapter 3, we define a notion of spectrum for matroids. Moreover, we show that the spectrum of a nearly finitary matroid can be larger than any fixed finite size. We also give an example of a matroid with infinitely large spectrum that is not nearly finitary. Assuming the existence of a single matroid that is nearly finitary but not $k$-nearly finitary, we construct classes of matroids that are nearly finitary but not $k$-nearly finitary. We also show that finite rank matroids are unionable. In Chapter 4, we will introduce a notion of near finitarization. We also give an example of a nearly finitary independence system that is not $k$-nearly finitary. This independence system is not a matroid. In Chapter 5, we will talk about Psi-matroids and introduce a possible generalization. Moreover, we study these new matroids to search for an example of a nearly finitary matroid that is not $k$-nearly finitary. We have not yet found such an example. In Chapter 6, we will discuss thin sums matroids and consider our problem restricted to this class of matroids. Our results are motivated by the open problem concerning whether every nearly finitary matroid is $k$-nearly finitary for some $k$.


title: Quantum Kibble-Zurek physics in long-range transverse-field Ising models

abstract: We analyze the quantum phase transitions taking place in a one-dimensional transverse field Ising model with long-range couplings that decay algebraically with distance. We are interested in the Kibble-Zurek universal scaling laws emerging in non-equilibrium dynamics and in the potential for the unambiguous observation of such behavior in a realistic experimental setup based on trapped ions. To this end, we determine the phase diagram of the model and the critical exponents characterizing its quantum phase transitions by means of density-matrix renormalization group calculations and finite-size scaling theory, which allows us to obtain good estimates for different range of ferro- and antiferromagnetic interactions. Beyond critical equilibrium properties, we tackle a non-equilibrium scenario in which quantum Kibble-Zurek scaling laws may be retrieved. Here it is found that the predicted non-equilibrium universal behavior, i.e. the scaling laws as a function of the quench rate and critical exponents, can be observed in systems comprising an experimentally feasible number of spins. Finally, a scheme is introduced to simulate the algebraically decaying couplings accurately by means of a digital quantum simulation with trapped ions. Our results suggest that quantum Kibble-Zurek physics can be explored and observed in state-of-the-art experiments with trapped ions realizing long-range Ising models.


title: Photoproduction of $\rm J/\psi$ with forward hadron tagging in hadronic collisions

abstract: We study the photoproduction of $\rm J/\psi$ using the NRQCD formalism with forward hadron tagging at the Large Hadron Collider. We estimate the total cross sections and event rates with and without nuclear shadowing effects in high energy proton-proton, proton-nucleus and nucleus-nucleus collisions. Our results show that the processes which involve $\rm J/\psi$ photoproduction depend on the choice of forward detector acceptances $\xi$. Under some precise cut of $\rm p_{T}^{J/\psi}$ and $\rm z^{J/\psi}$ kinematic variables, we find that the distributions of photoproduction of $\rm J/\psi$ are led by the Fock state $\rm ^{1}S_{0}^{[8]}$ or $\rm ^{3}S_{1}^{[1]}$. The total cross sections and event rates will be smaller if the nuclear shadowing effects are considered. The processes give a crucial photoproduction signature at the LHC with forward detector acceptances. The exploration and the detection of the interactions will be useful for studying the mechanism of heavy quarkonium production.


title: Dual-energy CT imaging using a single-energy CT data is feasible via deep learning

abstract: In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is, therefore, challenging to differentiate and quantify materials. Dual-energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single-energy CT (SECT) scanners. Here we develop a deep learning approach to perform DECT imaging by using standard SECT data. A deep learning model to map low-energy image to high-energy image using a two-stage convolutional neural network (CNN) is developed. The model was evaluated using patients who received contrast-enhanced abdomen DECT scan with a popular DE application: virtual non-contrast (VNC) imaging and contrast quantification. The HU differences between the predicted and original high-energy CT images are 3.47, 2.95, 2.38 and 2.40 HU for ROIs on the spine, aorta, liver, and stomach, respectively. The HU differences between VNC images obtained from original DECT and deep learning DECT are 4.10, 3.75, 2.33 and 2.92 HU for the 4 ROIs, respectively. The aorta iodine quantification difference between iodine maps obtained from original DECT and deep learning DECT images is 0.9\%, suggesting high consistency between the predicted and the original high-energy CT images. This study demonstrates that highly accurate DECT imaging with single low-energy data is achievable by using a deep learning approach. The proposed method can significantly simplify the DECT system design, reducing the scanning dose and imaging cost.


title: A New Proof of Hopf's Inequality Using a Complex Extension of the Hilbert Metric

abstract: It is well known from the Perron-Frobenius theory that the spectral gap of a positive square matrix is positive. In this paper, we give a more quantitative characterization of the spectral gap. More specifically, using a complex extension of the Hilbert metric, we show that the so-called spectral ratio of a positive square matrix is upper bounded by its Birkhoff contraction coefficient, which in turn yields a lower bound on its spectral gap.


title: Learning Predicates as Functions to Enable Few-shot Scene Graph Prediction

abstract: Scene graph prediction --- classifying the set of objects and predicates in a visual scene --- requires substantial training data. However, most predicates only occur a handful of times making them difficult to learn. We introduce the first scene graph prediction model that supports few-shot learning of predicates. Existing scene graph generation models represent objects using pretrained object detectors or word embeddings that capture semantic object information at the cost of encoding information about which relationships they afford. So, these object representations are unable to generalize to new few-shot relationships. We introduce a framework that induces object representations that are structured according to their visual relationships. Unlike past methods, our framework embeds objects that afford similar relationships closer together. This property allows our model to perform well in the few-shot setting. For example, applying the 'riding' predicate transformation to 'person' modifies the representation towards objects like 'skateboard' and 'horse' that enable riding. We generate object representations by learning predicates trained as message passing functions within a new graph convolution framework. The object representations are used to build few-shot predicate classifiers for rare predicates with as few as 1 labeled example. We achieve a 5-shot performance of 22.70 recall@50, a 3.7 increase when compared to strong transfer learning baselines.


title: Analytic-geometric methods for finite Markov chains with applications to quasi-stationarity

abstract: For a relatively large class of well-behaved absorbing (or killed) finite Markov chains, we give detailed quantitative estimates regarding the behavior of the chain before it is absorbed (or killed). Typical examples are random walks on box-like finite subsets of the square lattice $\mathbb Z^d$ absorbed (or killed) at the boundary. The analysis is based on Poincar\'e, Nash, and Harnack inequalities, moderate growth, and on the notions of John and inner-uniform domains.


title: The Effect of Binarity on Circumstellar Disk Evolution

abstract: We present new results on how the presence of stellar companions affects disk evolution based on a study of the 5-11 Myr old Upper Scorpius OB Association. Of the 50 G0-M3 Upper Sco members with disks in our sample, only seven host a stellar companion within 2" and brighter than K = 15, compared to 35 of 75 members without disks. This matches a trend seen in the 1-2 Myr old Taurus region, where systems with a stellar companion within 40 au have a lower fraction of infrared-identified disks than those without such companions, indicating shorter disk lifetimes in close multiple systems. However, the fractions of disk systems with a stellar companion within 40 au match in Upper Sco and Taurus. Additionally, we see no difference in the millimeter brightnesses of disks in Upper Sco systems with and without companions, in contrast to Taurus where systems with a companion within 300 au are significantly fainter than wider and single systems. These results suggest that the effects of stellar companions on disk lifetimes occur within the first 1-2 Myr of disk evolution, after which companions play little further role. By contrast, disks around single stars lose the millimeter-sized dust grains in their outer regions between ages of 1-2 Myr and 5-11 Myr. The end result of small dust disk sizes and faint millimeter luminosities is the same whether the disk has been truncated by a companion or has evolved through internal processes.


title: Gambler's ruin estimates on finite inner uniform domains

abstract: Gambler's ruin estimates can be viewed as harmonic measure estimates for finite Markov chains which are absorbed (or killed) at boundary points. We relate such estimates to properties of the underlying chain and its Doob transform. Precisely, we show that gambler's ruin estimates reduce to a good understanding of the Perron-Frobenius eigenfunction and eigenvalue whenever the underlying chain and its Doob transform are Harnack Markov chains. Finite inner-uniform domains (say, in the square grid $\mathbb Z^n$) provide a large class of examples where these ideas apply and lead to detailed estimates. In general, understanding the behavior of the Perron-Frobenius eigenfunction remains a challenge.


title: Probing the Sivers asymmetries through $\rm J/\psi$ photoproduction in $\rm p^\uparrow p$ collision with forward proton tagging

abstract: In this paper we probe the Sivers asymmetries through $\rm J/\psi$ photoproduction in $\rm p^\uparrow p$ collision within the non-relativistic QCD framework, based on color octet model and the Transverse Momentum Dependent Parton Distributions (TMDs). Both the DGLAP evolution and the TMD evolution are included. The intensity and the sign of the Sivers asymmetry is strongly related on evolution model used to investigate the Gluon Sivers Function (GSF). A sizable asymmetry is obtained as a function of the rapidity, $\rm log{(x_{\gamma})}$ or $\rm log{(x_{g})}$ dependence using a recent parametrization of GSF at the RHIC and AFTER@LHC experiments with the LHC planned forward detector acceptances.


title: Multiple instance learning with graph neural networks

abstract: Multiple instance learning (MIL) aims to learn the mapping between a bag of instances and the bag-level label. In this paper, we propose a new end-to-end graph neural network (GNN) based algorithm for MIL: we treat each bag as a graph and use GNN to learn the bag embedding, in order to explore the useful structural information among instances in bags. The final graph representation is fed into a classifier for label prediction. Our algorithm is the first attempt to use GNN for MIL. We empirically show that the proposed algorithm achieves the state of the art performance on several popular MIL data sets without losing model interpretability.


title: (Co)isotropic triples and poset representations

abstract: We study triples of coisotropic or isotropic subspaces in symplectic vector spaces; in particular, we classify indecomposable structures of this kind. The classification depends on the ground field, which we only assume to be perfect and not of characteristic 2. Our work uses the theory of representations of partially ordered sets with (order reversing) involution; for (co)isotropic triples, the relevant poset is "$2 + 2 + 2$" consisting of three independent ordered pairs, with the involution exchanging the members of each pair. A key feature of the classification is that any indecomposable (co)isotropic triple is either "split" or "non-split". The latter is the case when the poset representation underlying an indecomposable (co)isotropic triple is itself indecomposable. Otherwise, in the "split" case, the underlying representation is decomposable and necessarily the direct sum of a dual pair of indecomposable poset representations; the (co)isotropic triple is a "symplectification". In the course of the paper we develop the framework of "symplectic poset representations", which can be applied to a range of problems of symplectic linear algebra. The classification of linear Hamiltonian vector fields, up to conjugation, is an example; we briefly explain the connection between these and (co)isotropic triples. The framework lends itself equally well to studying poset representations on spaces carrying a non-degenerate symmetric bilinear form; we mainly keep our focus, however, on the symplectic side.


title: Double quarkonium hadroproduction as a probe of gluon Sivers function

abstract: The prediction of single spin asymmetry (SSA) in double $\rm J/\psi$ production in proton-proton collision is given out within the framework of non-relativistic QCD, using the recently obtained best fit parameters for the gluon Sivers function extracted from PHENIX data in $\rm p+p^\uparrow\to\pi^0+X$. The color singlet state $\rm ^3 S_1^{(1)}$ and color octet state $\rm ^3 S_1^{(8)}$ are considered to the SSA contribution in the double $\rm J/\psi$ hadroproduction. Our result shows that a sizable asymmetry can be estimated as functions of different kinematic variables.


title: Top FCNC interactions through dimension six four-fermion operators at the electron proton collider

abstract: We investigate the flavour changing neutral currents (FCNC) generated by dimension six four-fermion operators at the Large Hadron-Electron Collider (LHeC) proposed at CERN in an effective approach. This is performed by monte carlo analysis at the full detector level, as the background is successfully reduced by using invariant mass scheme to require the final states to reconstruct the mass (transverse mass) of the top quark (W boson). Our analysis shows that the future electron proton colliders like the LHeC can probe competitive limits for the top FCNC dimension six four fermion operators such as $C_{lq}^{(1)ee31} < 0.0647$, $C_{lu}^{ee31} < 0.109$, $C_{lequ}^{(1)ee31} < 0.217$ and $C_{lequ}^{(3)ee31} < 0.0209$ in the Warsaw basis.


title: Homology, lower central series, and hyperplane arrangements

abstract: We explore finitely generated groups by studying the nilpotent towers and the various Lie algebras attached to such groups. Our main goal is to relate an isomorphism extension problem in the Postnikov tower to the existence of certain commuting diagrams. This recasts a result of G. Rybnikov in a more general framework and leads to an application to hyperplane arrangements, whereby we show that all the nilpotent quotients of a decomposable arrangement group are combinatorially determined.


title: Run-Time Efficient RNN Compression for Inference on Edge Devices

abstract: Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities while still having run-time constraints. As a result, there is a need for compression techniques that can achieve significant compression without negatively impacting inference run-time and task accuracy. This paper explores a new compressed RNN cell implementation called Hybrid Matrix Decomposition (HMD) that achieves this dual objective. This scheme divides the weight matrix into two parts - an unconstrained upper half and a lower half composed of rank-1 blocks. This results in output features where the upper sub-vector has "richer" features while the lower-sub vector has "constrained features". HMD can compress RNNs by a factor of 2-4x while having a faster run-time than pruning (Zhu &Gupta, 2017) and retaining more model accuracy than matrix factorization (Grachev et al., 2017). We evaluate this technique on 5 benchmarks spanning 3 different applications, illustrating its generality in the domain of edge computing.


title: Using Small Proxy Datasets to Accelerate Hyperparameter Search

abstract: One of the biggest bottlenecks in a machine learning workflow is waiting for models to train. Depending on the available computing resources, it can take days to weeks to train a neural network on a large dataset with many classes such as ImageNet. For researchers experimenting with new algorithmic approaches, this is impractically time consuming and costly. We aim to generate smaller "proxy datasets" where experiments are cheaper to run but results are highly correlated with experimental results on the full dataset. We generate these proxy datasets using by randomly sampling from examples or classes, training on only the easiest or hardest examples and training on synthetic examples generated by "data distillation". We compare these techniques to the more widely used baseline of training on the full dataset for fewer epochs. For each proxying strategy, we estimate three measures of "proxy quality": how much of the variance in experimental results on the full dataset can be explained by experimental results on the proxy dataset. Experiments on Imagenette and Imagewoof (Howard, 2019) show that running hyperparameter search on the easiest 10% of examples explains 81% of the variance in experiment results on the target task, and using the easiest 50% of examples can explain 95% of the variance, significantly more than training on all the data for fewer epochs, a more widely used baseline. These "easy" proxies are higher quality than training on the full dataset for a reduced number of epochs (but equivalent computational cost), and, unexpectedly, higher quality than proxies constructed from the hardest examples. Without access to a trained model, researchers can improve proxy quality by restricting the subset to fewer classes; proxies built on half the classes are higher quality than those with an equivalent number of examples spread across all classes.


title: Adaptive Navigation Scheme for Optimal Deep-Sea Localization Using Multimodal Perception Cues

abstract: Underwater robot interventions require a high level of safety and reliability. A major challenge to address is a robust and accurate acquisition of localization estimates, as it is a prerequisite to enable more complex tasks, e.g. floating manipulation and mapping. State-of-the-art navigation in commercial operations, such as oil & gas production (OGP), rely on costly instrumentation. These can be partially replaced or assisted by visual navigation methods, especially in deep-sea scenarios where equipment deployment has high costs and risks. Our work presents a multimodal approach that adapts state-of-the-art methods from on-land robotics, i.e., dense point cloud generation in combination with plane representation and registration, to boost underwater localization performance. A two-stage navigation scheme is proposed that initially generates a coarse probabilistic map of the workspace, which is used to filter noise from computed point clouds and planes in the second stage. Furthermore, an adaptive decision-making approach is introduced that determines which perception cues to incorporate into the localization filter to optimize accuracy and computation performance. Our approach is investigated first in simulation and then validated with data from field trials in OGP monitoring and maintenance scenarios.


title: Model Testing for Generalized Scalar-on-Function Linear Models

abstract: Scalar-on-function linear models are commonly used to regress functional predictors on a scalar response. However, functional models are more difficult to estimate and interpret than traditional linear models, and may be unnecessarily complex for a data application. Hypothesis testing can be used to guide model selection by determining if a functional predictor is necessary. Using a mixed effects representation with penalized splines and variance component tests, we propose a framework for testing functional linear models with responses from exponential family distributions. The proposed method can accommodate dense and sparse functional data, and be used to test functional predictors for no effect and form of the effect. We show via simulation study that the proposed method achieves the nominal level and has high power, and we demonstrate its utility with two data applications.