title: Selective machine learning of doubly robust functionals

abstract: While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we propose a selective machine learning framework for making inferences about a finite-dimensional functional defined on a semiparametric model, when the latter admits a doubly robust estimating function and several candidate machine learning algorithms are available for estimating the nuisance parameters. We introduce a new selection criterion aimed at bias reduction in estimating the functional of interest based on a novel definition of pseudo-risk inspired by the double robustness property. Intuitively, the proposed criterion selects a pair of learners with the smallest pseudo-risk, so that the estimated functional is least sensitive to perturbations of a nuisance parameter. We establish an oracle property for a multi-fold cross-validation version of the new selection criterion which states that our empirical criterion performs nearly as well as an oracle with a priori knowledge of the pseudo-risk for each pair of candidate learners. Finally, we apply the approach to model selection of a semiparametric estimator of average treatment effect given an ensemble of candidate machine learners to account for confounding in an observational study which we illustrate in simulations and a data application.


title: Geodesic distance: A descriptor of geometry and correlator of pre-geometric density of spacetime events

abstract: Classical geometry can be described either in terms of a metric tensor $g_{ab}(x)$ or in terms of the geodesic distance $\sigma^2(x,x')$. Recent work, however, has shown that the geodesic distance is better suited to describe the quantum structure of spacetime. This is because one can incorporate some of the key quantum effects by replacing $\sigma^2$ by another function $S[\sigma^2]$ such that $S[0]=L_0^2$ is non-zero. This allows one to introduce a zero-point-length in the spacetime. I show that the geodesic distance can be an emergent construct, arising in the form of a correlator $S[\sigma^2(x,y)]=\langle J(x)J(y)\rangle$, of a pregeometric variable $J(x)$, which, in turn, can be interpreted as the quantum density of spacetime events. This approach also shows why null surfaces play a special role in the interface of quantum theory and gravity. I describe several technical and conceptual aspects of this construction and discuss some of its implications.


title: A general definition of $JT_a$ -- deformed QFTs

abstract: We propose a general path-integral definition of two-dimensional quantum field theories deformed by an integrable, irrelevant vector operator constructed from the components of the stress tensor and those of a $U(1)$ current. The deformed theory is obtained by coupling the original QFT to a flat dynamical gauge field and "half" a flat dynamical vielbein. The resulting partition function is shown to satisfy a geometric flow equation, which perfectly reproduces the flow equations for the deformed energy levels that were previously derived in the literature. The S-matrix of the deformed QFT differs from the original S-matrix only by an overall phase factor that depends on the charges and momenta of the external particles, thus supporting the conjecture that such QFTs are UV complete, although intrinsically non-local. For the special case of an integrable QFT, we check that this phase factor precisely reproduces the change in the finite-size spectrum via the Thermodynamic Bethe Ansatz equations.


title: H$\alpha$ Emission and the Dependence of the Circumgalactic Cool Gas Fraction on Halo Mass

abstract: We continue our empirical study of the emission line flux originating in the cool ($T\sim10^4$ K) gas that populates the halos of galaxies and their environments. Specifically, we present results obtained for a sample of nearly half a million individual galaxies, groups, and clusters of galaxies, intersected by more than two million SDSS lines of sight at projected separations of up to a quarter of the virial radius. Adopting simple power law relationships between the circumgalactic (CGM) cool gas fraction and either the halo or stellar mass, we present expressions for the CGM cool gas fraction as a function of either halo or stellar mass, $f_{\rm cool}(M_h) = (0.25^{+0.07}_{-0.06}) \times (M_h/10^{12}M_\odot)^{(-0.39^{+0.06}_{-0.07})}$ or $f_{\rm cool}(M_{*}) = (0.28^{+0.07}_{-0.06}) \times (M_{\rm *}/10^{10.0}M_\odot)^{(-0.33\pm 0.06)}$. Where we can compare, our results are consistent with previous constraints from absorption line studies, our own previous emission line work, and simulations. The cool gas can be the dominant baryonic CGM component, comprising a fraction as high as $> 90\%$ of halo gaseous baryons, in low mass halos, $M_h\sim$ $10^{10.5} M_\odot$, and a minor fraction, $<$ 5\%, in groups and clusters, $M_h > 10^{14} M_\odot$.


title: Sequentially loop supressed fermion masses from a unique discrete symmetry

abstract: We propose a systematic and renormalizable sequential loop suppression mechanism to generate the hierarchy of the Standard Model fermion masses from one discrete symmetry. The discrete symmetry is sequentially softly broken in order to generate one-loop level masses for the bottom, charm, tau and muon leptons and two-loop level masses for the lightest Standard Model charged fermions. The tiny masses for the light active neutrinos are produced from radiative type-I seesaw mechanism, where the Dirac mass terms are effectively generated at two-loop level.


title: Revived Fossil Plasma Sources in Galaxy Clusters

abstract: It is well established that particle acceleration by shocks and turbulence in the intra-cluster medium can produce cluster-scale synchrotron emitting sources. However, the detailed physics of these particle acceleration processes is still not well understood. One of the main open questions is the role of fossil relativistic electrons that have been deposited in the intra-cluster medium by radio galaxies. These synchrotron-emitting electrons are very difficult to study, as their radiative life time is only tens of Myrs at GHz frequencies, and are therefore a relatively unexplored population. Despite the typical steep radio spectrum due to synchrotron losses, these fossil electrons are barely visible even at radio frequencies well below a GHz. However, when a pocket of fossil radio plasma is compressed, it boosts the visibility at sub-GHz frequencies, creating so-called radio phoenices. This compression can be the result of bulk motion and shocks in the ICM due to merger activity. In this paper, we demonstrate the discovery potential of low frequency radio sky surveys to find and study revived fossil plasma sources in galaxy clusters. We used the 150~MHz TGSS and 1.4 GHz NVSS sky surveys to identify candidate radio phoenices. A subset of three candidates were studied in detail using deep multi-band radio observations (LOFAR and GMRT), X-ray (\textit{Chandra} or \textit{XMM-Newton}) and archival optical observations. Two of the three sources are new discoveries. Using these observations, we identified common observational properties (radio morphology, ultra-steep spectrum, X-ray luminosity, dynamical state) that will enable us to identify this class of sources more easily, and help to understand the physical origin of these sources.


title: Efficiently Learning Structured Distributions from Untrusted Batches

abstract: We study the problem, introduced by Qiao and Valiant, of learning from untrusted batches. Here, we assume $m$ users, all of whom have samples from some underlying distribution $p$ over $1, \ldots, n$. Each user sends a batch of $k$ i.i.d. samples from this distribution; however an $\epsilon$-fraction of users are untrustworthy and can send adversarially chosen responses. The goal is then to learn $p$ in total variation distance. When $k = 1$ this is the standard robust univariate density estimation setting and it is well-understood that $\Omega (\epsilon)$ error is unavoidable. Suprisingly, Qiao and Valiant gave an estimator which improves upon this rate when $k$ is large. Unfortunately, their algorithms run in time exponential in either $n$ or $k$. We first give a sequence of polynomial time algorithms whose estimation error approaches the information-theoretically optimal bound for this problem. Our approach is based on recent algorithms derived from the sum-of-squares hierarchy, in the context of high-dimensional robust estimation. We show that algorithms for learning from untrusted batches can also be cast in this framework, but by working with a more complicated set of test functions. It turns out this abstraction is quite powerful and can be generalized to incorporate additional problem specific constraints. Our second and main result is to show that this technology can be leveraged to build in prior knowledge about the shape of the distribution. Crucially, this allows us to reduce the sample complexity of learning from untrusted batches to polylogarithmic in $n$ for most natural classes of distributions, which is important in many applications. To do so, we demonstrate that these sum-of-squares algorithms for robust mean estimation can be made to handle complex combinatorial constraints (e.g. those arising from VC theory), which may be of independent technical interest.


title: Overcoming the efficiency-bandwidth tradeoff for optical harmonics generation using nonlinear time-variant resonators

abstract: Highly resonant photonic structures, such as cavities and metasurfaces, can dramatically enhance the efficiency of nonlinear processes by utilizing strong optical field enhancement at the resonance. The latter, however, comes at the expense of the bandwidth. Here, we overcome such tradeoff by utilizing time-varying resonant structures. Using harmonics generation as an example, we show that the amplitude and phase format of the excitation, as well as the time evolution of the resonator, can be optimized to yield the strongest nonlinear response. We find the conditions for an efficient synthesis of electromagnetic signals that surpass the cavity bandwidth, and discuss a potential experimental realization of this concept.


title: Comments on the Progenitor of NGC6946-BH1

abstract: The broad-band colors of the progenitor of the black hole candidate in NGC 6946 suggest that it was a yellow hypergiant on a post-red supergiant track when the core collapse occurred.


title: Using Name Confusion to Enhance Security

abstract: We introduce a novel concept, called Name Confusion, and demonstrate how it can be employed to thwart multiple classes of code-reuse attacks. By building upon Name Confusion, we derive Phantom Name System (PNS): a security protocol that provides multiple names (addresses) to program instructions. Unlike the conventional model of virtual memory with a one-to-one mapping between instructions and virtual memory addresses, PNS creates N mappings for the same instruction, and randomly switches between them at runtime. PNS achieves fast randomization, at the granularity of basic blocks, which mitigates a class of attacks known as (just-in-time) code-reuse. If an attacker uses a memory safety-related vulnerability to cause any of the instruction addresses to be different from the one chosen during a fetch, the exploited program will crash. We quantitatively evaluate how PNS mitigates real-world code-reuse attacks by reducing the success probability of typical exploits to approximately $10^{-12}$. We implement PNS and validate it by running SPEC CPU2017 benchmark suite. We further verify its practicality by adding it to a RISC-V core on an FPGA. Lastly, PNS is mainly designed for resource constrained (wimpy) devices and has negligible performance overhead, compared to commercially-available, state-of-the-art, hardware-based protections.


title: Secular Eccentricity Oscillations in Axisymmetric Disks of Eccentric Orbits

abstract: Massive bodies undergo orbital eccentricity oscillations when embedded in an axisymmetric disk of smaller mass orbits. These eccentricity oscillations are driven by secular torques that seek to equalize the apsidal precession rates of all the orbits in the disk. We investigate this mechanism within the context of detached objects in the outer Solar System, but we find that the oscillation timescale is too long for it to be dynamically important. It could however be interesting for phenomenon a bit farther from home; namely, feeding supermassive blackholes and polluting the surfaces of white dwarf stars.


title: Angle Covers: Algorithms and Complexity

abstract: Consider a graph with a rotation system, namely, for every vertex, a circular ordering of the incident edges. Given such a graph, an angle cover maps every vertex to a pair of consecutive edges in the ordering -- an angle -- such that each edge participates in at least one such pair. We show that any graph of maximum degree 4 admits an angle cover, give a poly-time algorithm for deciding if a graph with no degree-3 vertices has an angle-cover, and prove that, given a graph of maximum degree 5, it is NP-hard to decide whether it admits an angle cover. We also consider extensions of the angle cover problem where every vertex selects a fixed number $a>1$ of angles or where an angle consists of more than two consecutive edges. We show an application of angle covers to the problem of deciding if the 2-blowup of a planar graph has isomorphic thickness 2.


title: The impact of quenching on galaxy profiles in the Simba simulation

abstract: We study specific star formation rate (sSFR) and gas profiles of star forming and green valley galaxies in the Simba cosmological hydrodynamic simulation. Star-forming galaxy half-light radii ($R_{\rm half}$) at $z=0$ and their evolution ($\propto(1+z)^{-0.78}$) agree with observations. Passive galaxy $R_{\rm half}$ agree with observations at high redshift, but by $z=0$ are too large, owing to numerical heating. We compare Simba $z=0$ sSFR radial profiles for star forming and green valley galaxies to observations. Simba shows strong central depressions in star formation rate (SFR), sSFR, and gas fraction in green valley galaxies and massive star-forming systems, qualitatively as observed, owing to black hole X-ray feedback, which pushes central gas outwards. Turning off X-ray feedback leads to centrally peaked sSFR profiles as in other simulations. In conflict with observations, Simba yields green valley galaxies with strongly dropping sSFR profiles beyond $\gtrsim R_{\rm half}$, regardless of AGN feedback. The central depression owes to lowering molecular gas content; the drop in the outskirts owes to reduced star formation efficiency. Simba's satellites have higher central sSFR and lower outskirts sSFR than centrals, in qualitative agreement with observations. At $z=2$ Simba does not show central depressions in massive star-forming galaxies, suggesting Simba's X-ray feedback should be more active at high-$z$. High resolution tests indicate central sSFR suppression is not sensitive to numerical resolution. Reproducing the central sSFR depression in $z=0$ green valley galaxies represents a unique success of Simba. The remaining discrepancies highlight the importance of SFR and gas profiles in constraining quenching mechanisms.


title: GRACE: Generating Concise and Informative Contrastive Sample to Explain Neural Network Model's Prediction

abstract: Despite the recent development in the topic of explainable AI/ML for image and text data, the majority of current solutions are not suitable to explain the prediction of neural network models when the datasets are tabular and their features are in high-dimensional vectorized formats. To mitigate this limitation, therefore, we borrow two notable ideas (i.e., "explanation by intervention" from causality and "explanation are contrastive" from philosophy) and propose a novel solution, named as GRACE, that better explains neural network models' predictions for tabular datasets. In particular, given a model's prediction as label X, GRACE intervenes and generates a minimally-modified contrastive sample to be classified as Y, with an intuitive textual explanation, answering the question of "Why X rather than Y?" We carry out comprehensive experiments using eleven public datasets of different scales and domains (e.g., # of features ranges from 5 to 216) and compare GRACE with competing baselines on different measures: fidelity, conciseness, info-gain, and influence. The user-studies show that our generated explanation is not only more intuitive and easy-to-understand but also facilitates end-users to make as much as 60% more accurate post-explanation decisions than that of Lime.


title: O(N^2) fragmentation algorithm

abstract: Collisional fragmentation is a ubiquitous phenomenon arising in a variety of astrophysical systems, from asteroid belts to debris and protoplanetary disks. Numerical studies of fragmentation typically rely on discretizing the size distribution of colliding objects into a large number N of bins in mass space, usually logarithmically spaced. A standard approach for redistributing the debris produced in collisions into the corresponding mass bins results in O(N^3) calculation, which leads to significant computational overhead when N is large. Here we formulate a more efficient explicit O(N^2) fragmentation algorithm, which works when the size spectrum of fragments produced in an individual collision has a self-similar shape with only a single characteristic mass scale (which can have arbitrary dependence on the energy and masses of colliding objects). Fragment size spectra used in existing fragmentation codes typically possess this property. We also show that our O(N^2) approach can be easily extended to work with non-self-similar fragment size distributions, for which we provide a worked example. This algorithm offers a substantial speedup of fragmentation calculations for large N> 100, even over the implicit methods, making it an attractive tool for studying collisionally evolving systems.


title: Identifying Covariational Reasoning Behaviors in Expert Physicists in Graphing Tasks

abstract: Covariational reasoning -- how one thinks about the way changes in one quantity affect another quantity -- is essential to calculus and physics instruction alike. As physics is often centered on understanding and predicting changes in quantities, it is an excellent discipline to develop covariational reasoning. However, while significant work has been done on covariational reasoning in mathematics education research, it is only beginning to be studied in physics contexts. This work presents preliminary results from an investigation into expert physicists' covariational reasoning in a replication study of Hobson and Moore's 2017 investigation of covariational reasoning modes in mathematics graduate students. Additionally, we expand on this work to include results from a study that uses slightly more complex physics-context questions. Two behavioral modes were identified across contexts that appear distinct from those articulated in the Hobson and Moore study: the use of compiled relationships and neighborhood analysis.


title: Ground State and Hidden Symmetry of Magic Angle Graphene at Even Integer Filling

abstract: In magic angle twisted bilayer graphene, electron-electron interactions play a central role resulting in correlated insulating states at certain integer fillings. Identifying the nature of these insulators is a central question and potentially linked to the relatively high temperature superconductivity observed in the same devices. Here we address this question using a combination of analytical strong-coupling arguments and a comprehensive Hartree-Fock numerical calculation which includes the effect of remote bands. The ground state we obtain at charge neutrality is an unusual ordered state which we call the Kramers intervalley-coherent (K-IVC) insulator. In its simplest form, the K-IVC exhibits a pattern of alternating circulating currents which triples the graphene unit cell leading to an "orbital magnetization density wave". Although translation and time reversal symmetry are broken, a combined `Kramers' time reversal symmetry is preserved. Our analytic arguments are built on first identifying an approximate ${\rm U}(4) \times {\rm U}(4)$ symmetry, resulting from the remarkable properties of the tBG band structure, which helps select a low energy manifold of states, which are further split to favor the K-IVC. This low energy manifold is also found in the Hartree-Fock numerical calculation. We show that symmetry lowering perturbations can stabilize other insulators and the semi-metallic state, and discuss the ground state at half filling and a comparison with experiments.


title: Data Poisoning Attacks to Local Differential Privacy Protocols

abstract: Local Differential Privacy (LDP) protocols enable an untrusted data collector to perform privacy-preserving data analytics. In particular, each user locally perturbs its data to preserve privacy before sending it to the data collector, who aggregates the perturbed data to obtain statistics of interest. In the past several years, researchers from multiple communities -- such as security, database, and theoretical computer science -- have proposed many LDP protocols. These studies mainly focused on improving the utility of the LDP protocols. However, the security of LDP protocols is largely unexplored. In this work, we aim to bridge this gap. We focus on LDP protocols for frequency estimation and heavy hitter identification, which are two basic data analytics tasks. Specifically, we show that an attacker can inject fake users into an LDP protocol and the fake users send carefully crafted data to the data collector such that the LDP protocol estimates high frequencies for arbitrary attacker-chosen items or identifies them as heavy hitters. We call our attacks data poisoning attacks. We theoretically and/or empirically show the effectiveness of our attacks. We also explore three countermeasures against our attacks. Our experimental results show that they can effectively defend against our attacks in some scenarios but have limited effectiveness in others, highlighting the needs for new defenses against our attacks.


title: Massive stars in the Tarantula Nebula: A Rosetta Stone for Extragalactic Supergiant HII Regions

abstract: A review of the properties of the Tarantula Nebula (30 Doradus) in the Large Magellanic Cloud is presented, primarily from the perspective of its massive star content. The proximity of the Tarantula and its accessibility to X-ray through radio observations permit it to serve as a Rosetta Stone amongst extragalactic supergiant HII regions since one can consider both its integrated characteristics and the individual properties of individual massive stars. Recent surveys of its high mass stellar content, notably the VLT FLAMES Tarantula Survey (VFTS), are reviewed, together with VLT/MUSE observations of the central ionizing region NGC 2070 and HST/STIS spectroscopy of the young dense cluster R136, provide a near complete Hertzsprung-Russell diagram of the region, and cumulative ionizing output. Several high mass binaries are highlighted, some of which have been identified from a recent X-ray survey. Brief comparisons with the stellar content of giant HII regions in the Milky Way (NGC 3372) and Small Magellanic Cloud (NGC 346) are also made, together with Green Pea galaxies and star forming knots in high-z galaxies. Finally, the prospect of studying massive stars in metal poor galaxies is evaluated.


title: Guided Layer-wise Learning for Deep Models using Side Information

abstract: Training of deep models for classification tasks is hindered by local minima problems and vanishing gradients, while unsupervised layer-wise pretraining does not exploit information from class labels. Here, we propose a new regularization technique, called diversifying regularization (DR), which applies a penalty on hidden units at any layer if they obtain similar features for different types of data. For generative models, DR is defined as divergence over the variational posteriori distributions and included in the maximum likelihood estimation as a prior. Thus, DR includes class label information for greedy pretraining of deep belief networks which result in a better weight initialization for fine-tuning methods. On the other hand, for discriminative training of deep neural networks, DR is defined as a distance over the features and included in the learning objective. With our experimental tests, we show that DR can help the backpropagation to cope with vanishing gradient problems and to provide faster convergence and smaller generalization errors.


title: An evolve-then-correct reduced order model for hidden fluid dynamics

abstract: In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomposition. We then formulate a recurrent neural network emulator based on the assumption that observed data is a manifestation of all relevant processes. We further enhance our approach by using an orthonormality conforming basis interpolation approach on a Grassmannian manifold to address off-design conditions. The proposed framework is illustrated here with the application of two-dimensional co-rotating vortex simulations under modeling uncertainty. The results demonstrate highly accurate predictions underlining the effectiveness of the evolve-then-correct approach toward realtime simulations, where the full process model is not known a priori.


title: Satellite Pose Estimation Challenge: Dataset, Competition Design and Results

abstract: Reliable pose estimation of uncooperative satellites is a key technology for enabling future on-orbit servicing and debris removal missions. The Kelvins Satellite Pose Estimation Challenge aims at evaluating and comparing monocular vision-based approaches and pushing the state-of-the-art on this problem. This work is based on the Satellite Pose Estimation Dataset, the first publicly available machine learning set of synthetic and real spacecraft imageries. The choice of dataset reflects one of the unique challenges associated with spaceborne computer vision tasks, namely the lack of spaceborne images to train and validate the developed algorithms. This work briefly reviews the basic properties and the collection process of the dataset which was made publicly available. The competition design, including the definition of performance metrics and the adopted testbed, is also discussed. The main contribution of this paper is the analysis of the submissions of the 48 competitors, which compares the performance of different approaches and uncovers what factors make the satellite pose estimation problem especially challenging.


title: Transmission Spectroscopy of WASP-79b from 0.6 to 5.0 $\mu$m

abstract: As part of the PanCET program, we have conducted a spectroscopic study of WASP-79b, an inflated hot Jupiter orbiting an F-type star in Eridanus with a period of 3.66 days. Building on the original WASP and TRAPPIST photometry of Smalley et al (2012), we examine HST/WFC3 (1.125 - 1.650 $\mu$m), Magellan/LDSS-3C (0.6 - 1 $\mu$m) data, and Spitzer data (3.6 and 4.5 $\mu$m). Using data from all three instruments, we constrain the water abundance to be --2.20 $\leq$ log(H$_2$O) $\leq$ --1.55. We present these results along with the results of an atmospheric retrieval analysis, which favor inclusion of FeH and H$^-$ in the atmospheric model. We also provide an updated ephemeris based on the Smalley, HST/WFC3, LDSS-3C, Spitzer, and TESS transit times. With the detectable water feature and its occupation of the clear/cloudy transition region of the temperature/gravity phase space, WASP-79b is a target of interest for the approved JWST Director's Discretionary Early Release Science (DD ERS) program, with ERS observations planned to be the first to execute in Cycle 1. Transiting exoplanets have been approved for 78.1 hours of data collection, and with the delay in the JWST launch, WASP-79b is now a target for the Panchromatic Transmission program. This program will observe WASP-79b for 42 hours in 4 different instrument modes, providing substantially more data by which to investigate this hot Jupiter.


title: A Method to Model Conditional Distributions with Normalizing Flows

abstract: In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our method uses only a single loss and is easy to train. This is an improvement on the previous method that solves similar inverse problems with invertible neural networks but which involves a combination of several loss terms with ad-hoc weighting. In addition, our method provides a natural framework to incorporate conditioning in normalizing flows, and therefore, we can train an invertible network to perform conditional generation. We analyze our method and perform a careful comparison with previous approaches. Simple experiments show the effectiveness of our method, and more comprehensive experimental evaluations are undergoing.


title: Alleviating Label Switching with Optimal Transport

abstract: Label switching is a phenomenon arising in mixture model posterior inference that prevents one from meaningfully assessing posterior statistics using standard Monte Carlo procedures. This issue arises due to invariance of the posterior under actions of a group; for example, permuting the ordering of mixture components has no effect on the likelihood. We propose a resolution to label switching that leverages machinery from optimal transport. Our algorithm efficiently computes posterior statistics in the quotient space of the symmetry group. We give conditions under which there is a meaningful solution to label switching and demonstrate advantages over alternative approaches on simulated and real data.


title: Federated Adversarial Domain Adaptation

abstract: Federated learning improves data privacy and efficiency in machine learning performed over networks of distributed devices, such as mobile phones, IoT and wearable devices, etc. Yet models trained with federated learning can still fail to generalize to new devices due to the problem of domain shift. Domain shift occurs when the labeled data collected by source nodes statistically differs from the target node's unlabeled data. In this work, we present a principled approach to the problem of federated domain adaptation, which aims to align the representations learned among the different nodes with the data distribution of the target node. Our approach extends adversarial adaptation techniques to the constraints of the federated setting. In addition, we devise a dynamic attention mechanism and leverage feature disentanglement to enhance knowledge transfer. Empirically, we perform extensive experiments on several image and text classification tasks and show promising results under unsupervised federated domain adaptation setting.


title: Existence of steady very weak solutions to Navier-Stokes equations with non-Newtonian stress tensors

abstract: We provide existence of very weak solutions and new a-priori estimates for steady flows of non-Newtonian fluids when the right-hand sides are not in the natural existence class. To obtain the a-priori estimates we make use of a newly developed solenoidal Lipschitz truncation that preserves zero boundary values. We provide also estimates in (Muckenhoupt) weighted spaces which permit us to regain a duality pairing. Our estimates are valid even in the presence of the convective term. They are obtained via a newly developed comparison method that allows to "cut out" the singularities of the right hand side such that the skew symmetry of the convective term can be used for large parts of the right hand side.


title: Response Prediction for Low-Regret Agents

abstract: Companies like Google and Microsoft run billions of auctions every day to sell advertising opportunities. Any change to the rules of these auctions can have a tremendous effect on the revenue of the company and the welfare of the advertisers and the users. Therefore, any change requires careful evaluation of its potential impacts. Currently, such impacts are often evaluated by running simulations or small controlled experiments. This, however, misses the important factor that the advertisers respond to changes. Our goal is to build a theoretical framework for predicting the actions of an agent (the advertiser) that is optimizing her actions in an uncertain environment. We model this problem using a variant of the multi-armed bandit setting where playing an arm is costly. The cost of each arm changes over time and is publicly observable. The value of playing an arm is drawn stochastically from a static distribution and is observed by the agent and not by us. We, however, observe the actions of the agent. Our main result is that assuming the agent is playing a strategy with a regret of at most $f(T)$ within the first $T$ rounds, we can learn to play the multi-armed bandits game (without observing the rewards) in such a way that the regret of our selected actions is at most $O(k^4(f(T)+1)\log(T))$, where $k$ is the number of arms.


title: Impurity Moments Conceal Low-Energy Relaxation of Quantum Spin Liquids

abstract: We scrutinize the magnetic properties of $\kappa$-(BEDT-TTF)$_2$Hg(SCN)$_2$Cl through its first-order metal-insulator transition at $T_{\rm CO}=30$ K by means of $^1$H nuclear magnetic resonance (NMR). While in the metal we find Fermi-liquid behavior with temperature-independent $(T_1T)^{-1}$, the relaxation rate exhibits a pronounced enhancement when charge order sets in. The NMR spectra remain unchanged through the transition and no magnetic order stabilizes down to 25 mK. Similar to the isostructural spin-liquid candidates $\kappa$-(BEDT-TTF)$_2$Cu$_2$(CN)$_3$ and $\kappa$-(BEDT-TTF)$_2$Ag$_2$(CN)$_3$, $T_1^{-1}$ acquires a dominant maximum (here around 5 K). Field-dependent experiments identify the low-temperature feature as a dynamic inhomogeneity contribution that is typically dominant over the intrinsic relaxation but gets suppressed with magnetic field.


title: A Transversal Property for Permutation Groups Motivated by Partial Transformations

abstract: In this paper we introduce the definition of $(k,l)$-universal transversal property, which is a refinement of the definition of $k$-universal transversal property, which in turn is a refinement of the classic definition of $k$-homogeneity for permutation groups. In particular, a group possesses the $(2,n)$-universal transversal property if and only if it is primitive; it possesses the $(2,2)$-universal transversal property if and only if it is $2$-homogeneous. Up to a few undecided cases, we give a classification of groups satisfying the $(k,l)$-universal transversal property, for $k\ge 3$. Then we apply this result for studying regular semigroups of partial transformations.


title: Nonreciprocal Phased-Array Antennas

abstract: A phased-array antenna is a device that generates radiation patterns whose shape and direction can be electronically controlled by tailoring the amplitude and phase of the signals that feed each element of the array. These devices provide identical responses in transmission and reception due to the constrains imposed by time-reversal symmetry. Here, we introduce the concept of nonreciprocal phased-array antennas and we demonstrate that they can exhibit drastically different radiation patterns when operated in transmission or in reception. The building block of the array consists of a time-modulated resonant antenna element that provides very efficient frequency conversion between only two frequencies: one associated to waves propagating in free-space and the other related to guided signals. Controlling the tunable nonreciprocal phase response of these elements with the phase of low-frequency modulation signals permits to independently tailor the transmission and reception radiation patterns of the entire array. Measured results at microwaves confirm isolation levels over 40 dB at desired directions in space with an overall loss below 4 dB. We believe that this concept can be extended across the electromagnetic spectrum provided adequate tuning elements are available, with important implications in communication, sensing, and radar systems, as well as in thermal management and energy harvesting.


title: Infusing Knowledge into the Textual Entailment Task Using Graph Convolutional Networks

abstract: Textual entailment is a fundamental task in natural language processing. Most approaches for solving the problem use only the textual content present in training data. A few approaches have shown that information from external knowledge sources like knowledge graphs (KGs) can add value, in addition to the textual content, by providing background knowledge that may be critical for a task. However, the proposed models do not fully exploit the information in the usually large and noisy KGs, and it is not clear how it can be effectively encoded to be useful for entailment. We present an approach that complements text-based entailment models with information from KGs by (1) using Personalized PageR- ank to generate contextual subgraphs with reduced noise and (2) encoding these subgraphs using graph convolutional networks to capture KG structure. Our technique extends the capability of text models exploiting structural and semantic information found in KGs. We evaluate our approach on multiple textual entailment datasets and show that the use of external knowledge helps improve prediction accuracy. This is particularly evident in the challenging BreakingNLI dataset, where we see an absolute improvement of 5-20% over multiple text-based entailment models.


title: Smart Advertisement for Maximal Clicks in Online Social Networks Without User Data

abstract: Click-through rate (CTR) prediction of advertisements on online social network platforms to optimize advertising is of much interest. Prior works build machine learning models that take a user-centric approach in terms of training -- using predominantly user data to classify whether a user will click on an advertisement or not. While this approach has proven effective, it is inaccessible to most entities and relies heavily on user data. To accommodate for this, we first consider a large set of advertisement data on Facebook and use natural language processing (NLP) to extract key concepts that we call conceptual nodes. To predict the value of CTR for a combination of conceptual nodes, we use the advertisement data to train four machine learning (ML) models. We then cast the problem of finding the optimal combination of conceptual nodes as an optimization problem. Given a certain budget $k$, we are interested in finding the optimal combination of conceptual nodes that maximize the CTR. A discussion of the hardness and possible NP-hardness of the optimization problem is provided. Then, we propose a greedy algorithm and a genetic algorithm to find near-optimal combinations of conceptual nodes in polynomial time, with the genetic algorithm nearly matching the optimal solution. We observe that Decision Tree Regressor and Random Forest Regressor exhibit the highest Pearson correlation coefficients w.r.t. click predictions and real click values. Additionally, we find that the conceptual nodes of "politics", "celebrity", and "organization" are notably more influential than other considered conceptual nodes.


title: Light-Cone Sum Rules for Gravitational Form Factors

abstract: We outline the developed approach within the light-cone sum rules at the leading order for calculation of the gravitational form factors related to the nucleon valence quark combinations. The predictions for the gravitational form factor $D(t)$ ($D$-term contributions) have been presented.


title: Exploring the Suitability of BLE Beacons to Track Poacher Vehicles in Harsh Jungle Terrains

abstract: Our overall aim is focused on exploring whether we could use Bluetooth Low Energy (BLE) technology to track poacher vehicles in remote and rural areas such as Sabah, in Malaysia, especially deep inside the jungle terrain with little or no communication technologies exists. Tracking technologies are currently limited to relying on satellites or cellular towers, for environments that do not permit access to these signals, very few viable alternatives exist. This paper explores the use of BLE as a method to track vehicles. It works by mounting Bluetooth beacons beside a road and placing a receiver concealed somewhere inside the vehicle. As the vehicle drives past the beacon, the receiver and beacon are momentarily in range, the receiver then stores a unique ID from the beacon and when the vehicle is then in an area with GSM signal, an SMS is sent containing the unique IDs of the beacons that have been detected. This project is prototyped and tested in collaboration with the Danau Girang Field Centre in Sabah, Malaysia. The results offer insights for how effective BLE beacons are in a tracking situation for where the beacon and receiver are in range for a short period of time as well as how different obstructions will affect the range and strength of the signal. It is important to note that our objective is not to catch the poacher, instead to understand how they move around within jungle terrain, as we can use such information to develop a comprehensive plan against poaching activities.


title: Dynamics of strongly interacting kink-antikink pairs for scalar fields on a line

abstract: This paper concerns classical nonlinear scalar field models on the real line. If the potential is a symmetric double-well, such a model admits static solutions called kinks and antikinks, which are perhaps the simplest examples of topological solitons. We study pure kink-antikink pairs, which are solutions that converge in one infinite time direction to a superposition of one kink and one antikink, without radiation. Our main result is a complete classification of all kink-antikink pairs in the strongly interacting regime, which means the speeds of the kinks tend asymptotically to zero. We show that up to translation there is exactly one such solution, and we give a precise description of the dynamics of the kink separation.


title: A Deep Reinforcement Learning Approach to First-Order Logic Theorem Proving

abstract: Automated theorem provers have traditionally relied on manually tuned heuristics to guide how they perform proof search. Deep reinforcement learning has been proposed as a way to obviate the need for such heuristics, however, its deployment in automated theorem proving remains a challenge. In this paper we introduce TRAIL, a system that applies deep reinforcement learning to saturation-based theorem proving. TRAIL leverages (a) a novel neural representation of the state of a theorem prover and (b) a novel characterization of the inference selection process in terms of an attention-based action policy. We show through systematic analysis that these mechanisms allow TRAIL to significantly outperform previous reinforcement-learning-based theorem provers on two benchmark datasets for first-order logic automated theorem proving (proving around 15% more theorems).


title: On the Smallness Condition in Linear Inviscid Damping: Monotonicity and Resonance Chains

abstract: We consider the linearized Euler equations around a smooth, bilipschitz shear profile $U(y)$ on $\mathbb{T}_L \times \mathbb{R}$. We construct an explicit flow which exhibits linear inviscid damping for $L$ sufficiently small, but for which damping fails if $L$ is large. In particular, similar to the instability results for convex profiles for a shear flow being bilipschitz is not sufficient for linear inviscid damping to hold. Instead of an eigenvalue-based argument the underlying mechanism here is shown to be based on a new cascade of resonances moving to higher and higher frequencies in $y$, which is distinct from the echo chain mechanism in the nonlinear problem.


title: Robo-advising: Learning Investors' Risk Preferences via Portfolio Choices

abstract: We introduce a reinforcement learning framework for retail robo-advising. The robo-advisor does not know the investor's risk preference, but learns it over time by observing her portfolio choices in different market environments. We develop an exploration-exploitation algorithm which trades off costly solicitations of portfolio choices by the investor with autonomous trading decisions based on stale estimates of investor's risk aversion. We show that the algorithm's value function converges to the optimal value function of an omniscient robo-advisor over a number of periods that is polynomial in the state and action space. By correcting for the investor's mistakes, the robo-advisor may outperform a stand-alone investor, regardless of the investor's opportunity cost for making portfolio decisions.


title: Metal$/BaTiO_{3}/\beta-Ga_{2}O_{3}$ Dielectric Heterojunction Diode with 5.7 MV/cm Breakdown Field

abstract: Wide and ultra-wide band gap semiconductors can provide excellent performance due to their high energy band gap, which leads to breakdown electric fields that are more than an order of magnitude higher than conventional silicon electronics. In materials where p-type doping is not available, achieving this high breakdown field in a vertical diode or transistor is very challenging. We propose and demonstrate the use of dielectric heterojunctions that use extreme permittivity materials to achieve high breakdown field in a unipolar device. We demonstrate the integration of a high permittivity material BaTiO3 with n-type $\beta$-Ga2O3 to enable 5.7 MV/cm average electric field and 7 MV/cm peak electric field at the device edge, while maintaining forward conduction with relatively low on-resistance and voltage loss. The proposed dielectric heterojunction could enable new design strategies to achieve theoretical device performance limits in wide and ultra-wide band gap semiconductors where bipolar doping is challenging.


title: Hierarchical Mixtures of Generators for Adversarial Learning

abstract: Generative adversarial networks (GANs) are deep neural networks that allow us to sample from an arbitrary probability distribution without explicitly estimating the distribution. There is a generator that takes a latent vector as input and transforms it into a valid sample from the distribution. There is also a discriminator that is trained to discriminate such fake samples from true samples of the distribution; at the same time, the generator is trained to generate fakes that the discriminator cannot tell apart from the true samples. Instead of learning a global generator, a recent approach involves training multiple generators each responsible from one part of the distribution. In this work, we review such approaches and propose the hierarchical mixture of generators, inspired from the hierarchical mixture of experts model, that learns a tree structure implementing a hierarchical clustering with soft splits in the decision nodes and local generators in the leaves. Since the generators are combined softly, the whole model is continuous and can be trained using gradient-based optimization, just like the original GAN model. Our experiments on five image data sets, namely, MNIST, FashionMNIST, UTZap50K, Oxford Flowers, and CelebA, show that our proposed model generates samples of high quality and diversity in terms of popular GAN evaluation metrics. The learned hierarchical structure also leads to knowledge extraction.


title: Fredholm conditions for invariant operators: finite abelian groups and boundary value problems

abstract: We answer the question of when an invariant pseudodifferential operator is Fredholm on a fixed, given isotypical component. More precisely, let $\Gamma$ be a compact group acting on a smooth, compact, manifold $M$ without boundary and let $P \in \psi^m(M; E_0, E_1)$ be a $\Gamma$-invariant, classical, pseudodifferential operator acting between sections of two $\Gamma$-equivariant vector bundles $E_0$ and $E_1$. Let $\alpha$ be an irreducible representation of the group $\Gamma$. Then $P$ induces by restriction a map $\pi_\alpha(P) : H^s(M; E_0)_\alpha \to H^{s-m}(M; E_1)_\alpha$ between the $\alpha$-isotypical components of the corresponding Sobolev spaces of sections. We study in this paper conditions on the map $\pi_\alpha(P)$ to be Fredholm. It turns out that the discrete and non-discrete cases are quite different. Additionally, the discrete abelian case, which provides some of the most interesting applications, presents some special features and is much easier than the general case. We thus concentrate in this paper on the case when $\Gamma$ is finite abelian. We prove then that the restriction $\pi_\alpha(P)$ is Fredholm if, and only if, $P$ is "$\alpha$-elliptic", a condition defined in terms of the principal symbol of $P$. If $P$ is elliptic, then $P$ is also $\alpha$-elliptic, but the converse is not true in general. However, if $\Gamma$ acts freely on a dense open subset of $M$, then $P$ is $\alpha$-elliptic for the given fixed $\alpha$ if, and only if, it is elliptic. The proofs are based on the study of the structure of the algebra $\psi^{m}(M; E)^\Gamma$ of classical, $\Gamma$-invariant pseudodifferential operators acting on sections of the vector bundle $E \to M$ and of the structure of its restrictions to the isotypical components of $\Gamma$. These structures are described in terms of the isotropy groups of the action of the group $\Gamma$ on $E \to M$.


title: Sato-Tate groups of abelian threefolds: a preview of the classification

abstract: We announce the classification of Sato-Tate groups of abelian threefolds over number fields; there are 410 possible conjugacy classes of closed subgroups of USp(6) that occur. We summarize the key points of the "upper bound" aspect of the classification, and give a more rigorous treatment of the "lower bound" by realizing 33 groups that appear in the classification as maximal cases with respect to inclusions of finite index. Further details will be provided in a subsequent paper.


title: Weak compactness and fixed point property for affine bi-Lipschitz maps

abstract: Let $X$ be a Banach space and let $C$ be a closed convex bounded subset of $X$. It is proved that $C$ is weakly compact if, and only if, $C$ has the {it generic} fixed point property ($\mathcal{G}$-FPP) for the class of $L$-bi-Lipschitz affine mappings for every $L>1$. It is also proved that if $X$ has Pe\l czy\'nski's property $(u)$, then either $C$ is weakly compact, contains an $\ell_1$-sequence or a $\mathrm{c}_0$-summing basic sequence. In this case, weak compactness of $C$ is equivalent to the $\mathcal{G}$-FPP for the strengthened class of affine mappings that are uniformly bi-Lipschitz. We also introduce a generalized form of property $(u)$, called {it property $(\mathfrak{su})$}, and use it to prove that if $X$ has property $(\mathfrak{su})$ then either $C$ is weakly compact or contains a wide-$(s)$ sequence which is uniformly shift equivalent. In this case, weak compactness in such spaces can also be characterized in terms of the $\mathcal{G}$-FPP for affine uniformly bi-Lipschitz mappings. It is also proved that every Banach space with a spreading basis has property $(\mathfrak{su})$, thus property $(\mathfrak{su})$ is stronger than property $(u)$. These results yield a significant strengthening of an important theorem of Benavides, Jap\'on-Pineda and Prus published in 2004.


title: OtoMechanic: Auditory Automobile Diagnostics via Query-by-Example

abstract: Early detection and repair of failing components in automobiles reduces the risk of vehicle failure in life-threatening situations. Many automobile components in need of repair produce characteristic sounds. For example, loose drive belts emit a high-pitched squeaking sound, and bad starter motors have a characteristic whirring or clicking noise. Often drivers can tell that the sound of their car is not normal, but may not be able to identify the cause. To mitigate this knowledge gap, we have developed OtoMechanic, a web application to detect and diagnose vehicle component issues from their corresponding sounds. It compares a user's recording of a problematic sound to a database of annotated sounds caused by failing automobile components. OtoMechanic returns the most similar sounds, and provides weblinks for more information on the diagnosis associated with each sound, along with an estimate of the similarity of each retrieved sound. In user studies, we find that OtoMechanic significantly increases diagnostic accuracy relative to a baseline accuracy of consumer performance.


title: Computational Separations between Sampling and Optimization

abstract: Two commonly arising computational tasks in Bayesian learning are Optimization (Maximum A Posteriori estimation) and Sampling (from the posterior distribution). In the convex case these two problems are efficiently reducible to each other. Recent work (Ma et al. 2019) shows that in the non-convex case, sampling can sometimes be provably faster. We present a simpler and stronger separation. We then compare sampling and optimization in more detail and show that they are provably incomparable: there are families of continuous functions for which optimization is easy but sampling is NP-hard, and vice versa. Further, we show function families that exhibit a sharp phase transition in the computational complexity of sampling, as one varies the natural temperature parameter. Our results draw on a connection to analogous separations in the discrete setting which are well-studied.


title: Extended main sequence turnoffs in open clusters as seen by Gaia -- II. The enigma of NGC 2509

abstract: We investigate the morphology of the colour-magnitude diagram (CMD) of the open cluster NGC 2509 in comparison with other Galactic open clusters of similar age using Gaia photometry. At $\sim900$ Myr Galactic open clusters in our sample all show an extended main sequence turn off (eMSTO) with the exception of NGC 2509, which presents an exceptionally narrow CMD. Our analysis of the Gaia data rules out differential extinction, stellar density, and binaries as a cause for the singular MSTO morphology in this cluster. We interpret this feature as a consequence of the stellar rotation distribution within the cluster and present the analysis with MIST stellar evolution models that include the effect of stellar rotation on which we based our conclusion. In particular, these models point to an unusually narrow range of stellar rotation rates ($\Omega/\Omega_{\rm{crit,ZAMS}} = [0.4, 0.6]$) within the cluster as the cause of this singular feature in the CMD of NGC 2509. Interestingly, models that do not include rotation are not as good at reproducing the morphology of the observed CMD in this cluster.


title: Advanced High-Performance Large Diameter Cs2HfCl6 (CHC) and Mixed Halides Scintillator

abstract: This paper reports on successful growth and performance evaluation of two large diameter Cs2HfCl6 (CHC) and Cs2HfCl4Br2 (CHCB), both recently developed scintillator crystals. The discovery of Cs2HfCl6 (CHC) as a scintillator has lately generated much interest in this material and its family, which belongs to the K2PtCl6 cubic crystal structure. CHC is an intrinsic scintillator that is non-hygroscopic, has no self-radioactivity, provides excellent energy resolution, and has excellent non-proportionality. CHC has a moderate density of 3.9 g/cm3 and an effective atomic number of 58. Reported in this paper are transparent crack-free single crystal CHC and CHCB boules of one inch in diameter, both grown using the vertical Bridgman method. Samples retrieved from the boules, sized 23mm dia. x 30mm and 23mm dia. x 26mm, respectively, are characterized for their optical and scintillation properties. Energy resolutions of 3.5% and 3.7% (FWHM) at 662 keV, respectively, are reported. Results comparable to previously reported results for smaller crystals have been obtained. Studies on light yield, decay time, non-proportionality, as well as detector characterization are also reported.


title: Ab initio molecular dynamics description of proton transfer at water-tricalcium silicate interface

abstract: For the first time, an ab initio molecular dynamics simulation was performed to describe the C$_3$S/water interface. The simulation shows that oxides with favorable environment are protonated at first, creating very stable hydroxide groups. Proton transfers occur between water and silicates, and between water and hydroxides formed upon water dissociation on the surface. The typical lifetime of these events is on the same timescale than interconversion between Eigen and Zundel ions in bulk water. At the very early stage of the hydration encompassed by our simulation, silanol groups are very unstable and molecular adsorption of water is slightly more stable than dissociative adsorption.


title: Properties of Bc Mesons and Variational Constraints on their Masses

abstract: Spectrum, radii, radial wave functions at origin, decay constants and momentum widths for radial and orbital excited $B_c$ mesons are derived within non-relativistic quark model framework through finding numerical solution of the Schrodinger equation by shooting method. Masses of orbitally excited states are derived with a more simpler method that is developed by combining the uncertainty and variational principles. Masses of $B_c$ mesons are also calculated by using Momentum widths. Besides calculations, theoretical results are compared with the experimental observations which have implications for scalar form factors and leptonic decays of $B_c$ mesons.


title: Post-Training 4-bit Quantization on Embedding Tables

abstract: Continuous representations have been widely adopted in recommender systems where a large number of entities are represented using embedding vectors. As the cardinality of the entities increases, the embedding components can easily contain millions of parameters and become the bottleneck in both storage and inference due to large memory consumption. This work focuses on post-training 4-bit quantization on the continuous embeddings. We propose row-wise uniform quantization with greedy search and codebook-based quantization that consistently outperforms state-of-the-art quantization approaches on reducing accuracy degradation. We deploy our uniform quantization technique on a production model in Facebook and demonstrate that it can reduce the model size to only 13.89% of the single-precision version while the model quality stays neutral.


title: Lesson Learnt: Modularization of Deep Networks Allow Cross-Modality Reuse

abstract: Fundus photography and Optical Coherence Tomography Angiography (OCT-A) are two commonly used modalities in ophthalmic imaging. With the development of deep learning algorithms, fundus image processing, especially retinal vessel segmentation, has been extensively studied. Built upon the known operator theory, interpretable deep network pipelines with well-defined modules have been constructed on fundus images. In this work, we firstly train a modularized network pipeline for the task of retinal vessel segmentation on the fundus database DRIVE. The pretrained preprocessing module from the pipeline is then directly transferred onto OCT-A data for image quality enhancement without further fine-tuning. Output images show that the preprocessing net can balance the contrast, suppress noise and thereby produce vessel trees with improved connectivity in both image modalities. The visual impression is confirmed by an observer study with five OCT-A experts. Statistics of the grades by the experts indicate that the transferred module improves both the image quality and the diagnostic quality. Our work provides an example that modules within network pipelines that are built upon the known operator theory facilitate cross-modality reuse without additional training or transfer learning.


title: Classical Systems in Quantum Mechanics

abstract: If we admit that quantum mechanics (QM) is universal theory, then QM should contain also some description of classical mechanical systems. The presented text contains description of two different ways how the mathematical description of kinematics and dynamics of classical systems emerges from the mathematical formalism of QM. The first of these ways is to obtain an equivalent description of QM (with finite number of degrees of freedom) as a classical Hamiltonian field theory and afterwards restrict it in dependence of specific classical system to obtain the classical Hamiltonian mechanics of that finite system. The second way is transition to QM of systems with infinite number of degrees of freedom - i.e. of macroscopic systems - and extract from it classical mechanics (with finite number of degrees of freedom) of macroscopic variables of this quantum system. The last chapter contains some considerations concerning the "measurement problem in QM", in which a measured quantum "microsystem" has to be dynamically connected with changes of classical states of a macroscopic quantum (sub-)system - the measuring device. Several models of this process are presented.


title: Magnetic ordering in metal-free radical thin films

abstract: Molecular systems are materials that intersect with many different promising fields such as organic/molecular electronics and spintronics, organic magnetism and quantum computing1-7. Particularly, magnetism in organic materials is very intriguing: the possibility to realize long-range magnetic order in completely metal-free systems means that magnetic moments are coupled to useful properties of organic materials, such as optical transparency, low-cost fabrication, and flexible chemical design. Magnetic ordering in light elements, such as nitrogen and carbon, has been studied in magnetic-edged graphene nanoribbons8 and bilayers9, and polymers10 while in organic thin films most of the investigations show this effect as due to the proximity of light atoms to heavy metals, impurities, or vacancies11. Purely organic radicals are molecules that carry one unpaired electron giving rise to a permanent magnetic moment, in the complete absence of metal ions.12-14 Inspired by their tremendous potential, here we investigate thin films of an exceptionally chemically stable Blatter radical derivative15 by using X-ray magnetic circular dichroism (XMCD)16-18. Here we observe XMCD at the nitrogen K-edge. Our results show a magnetic ordering different than in the single crystals and calculations indicate, although weak, a long-range intermolecular coupling. We anticipate our work to be a starting point for investigating and modelling magnetic behaviour in purely organic thin films. The tuning of the magnetic properties by the molecular arrangement in organic films is an exciting perspective towards revealing new properties and applications.


title: Application of a bipolar nanopore as a sensor: rectification as an additional device function

abstract: We model and simulate a nanopore sensor that selectively binds analyte ions. This binding leads to the modulation of the local concentrations of the ions of the background electrolyte (KCl), and, thus, to the modulation of the ionic current flowing through the pore. The nanopore's wall carries a bipolar charge pattern with a larger positive buffer region determining the anions as the main charge carriers and the smaller negative binding region containing binding sites. This charge pattern proved to be an appropriate one as shown by a previous comparative study of varying charge patterns (M\'adai et al.\ \textit{J. Mol. Liq.}, 2019, \textbf{283}, 391--398.). Binding of the positive analyte ions attracts more anions in the pore thus increasing the current. The asymmetric nature of the pore results in an additional device function, rectification. Our model, therefore, is a dual response device. Using a reduced model of the nanopore studied by a hybrid computer simulation method (Local Equilibrium Monte Carlo coupled to the Nernst-Planck equation) we show that we can create a sensor whose underlying mechanisms are based on the changes of the local electric field as a response to changing thermodynamic conditions. The change of the electric field results in changes in the local ionic concentrations (depletion zones), and, thus, changes in ionic currents.


title: The Torelli map restricted to the hyperelliptic locus

abstract: Let $g \geq 2$ and let the Torelli map denote the map sending a genus $g$ curve to its principally polarized Jacobian. We show that the restriction of the Torelli map to the hyperelliptic locus is an immersion in characteristic not $2$. In characteristic $2$, we show the Torelli map restricted to the hyperelliptic locus fails to be an immersion because it is generically inseparable; moreover, the induced map on tangent spaces has kernel of dimension $g-2$ at every point.


title: Path-Based Contextualization of Knowledge Graphs for Textual Entailment

abstract: In this paper, we introduce the problem of knowledge graph contextualization -- that is, given a specific NLP task, the problem of extracting meaningful and relevant sub-graphs from a given knowledge graph. The task in the case of this paper is the textual entailment problem, and the context is a relevant sub-graph for an instance of the textual entailment problem -- where given two sentences p and h, the entailment relationship between them has to be predicted automatically. We base our methodology on finding paths in a cost-customized external knowledge graph, and building the most relevant sub-graph that connects p and h. We show that our path selection mechanism to generate sub-graphs not only reduces noise, but also retrieves meaningful information from large knowledge graphs. Our evaluation shows that using information on entities as well as the relationships between them improves on the performance of purely text-based systems.


title: Small-Footprint Keyword Spotting on Raw Audio Data with Sinc-Convolutions

abstract: Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also demanding high accuracy as well as real-time capability. Previous architectures first extracted acoustic features and then applied a neural network to classify keyword probabilities, optimizing towards memory footprint and execution time. Compared to previous publications, we took additional steps to reduce power and memory consumption without reducing classification accuracy. Power-consuming audio preprocessing and data transfer steps are eliminated by directly classifying from raw audio. For this, our end-to-end architecture extracts spectral features using parametrized Sinc-convolutions. Its memory footprint is further reduced by grouping depthwise separable convolutions. Our network achieves the competitive accuracy of 96.4% on Google's Speech Commands test set with only 62k parameters.


title: Planck evidence for a closed Universe and a possible crisis for cosmology

abstract: The recent Planck Legacy 2018 release has confirmed the presence of an enhanced lensing amplitude in CMB power spectra compared to that predicted in the standard $\Lambda$CDM model. A closed universe can provide a physical explanation for this effect, with the Planck CMB spectra now preferring a positive curvature at more than $99 \%$ C.L. Here we further investigate the evidence for a closed universe from Planck, showing that positive curvature naturally explains the anomalous lensing amplitude and demonstrating that it also removes a well-known tension within the Planck data set concerning the values of cosmological parameters derived at different angular scales. We show that since the Planck power spectra prefer a closed universe, discordances higher than generally estimated arise for most of the local cosmological observables, including BAO. The assumption of a flat universe could, therefore, mask a cosmological crisis where disparate observed properties of the Universe appear to be mutually inconsistent. Future measurements are needed to clarify whether the observed discordances are due to undetected systematics, or to new physics, or simply are a statistical fluctuation.


title: An Alternative Probabilistic Interpretation of the Huber Loss

abstract: The Huber loss is a robust loss function used for a wide range of regression tasks. To utilize the Huber loss, a parameter that controls the transitions from a quadratic function to an absolute value function needs to be selected. We believe the standard probabilistic interpretation that relates the Huber loss to the Huber density fails to provide adequate intuition for identifying the transition point. As a result, a hyper-parameter search is often necessary to determine an appropriate value. In this work, we propose an alternative probabilistic interpretation of the Huber loss, which relates minimizing the loss to minimizing an upper-bound on the Kullback-Leibler divergence between Laplace distributions, where one distribution represents the noise in the ground-truth and the other represents the noise in the prediction. In addition, we show that the parameters of the Laplace distributions are directly related to the transition point of the Huber loss. We demonstrate, through a toy problem, that the optimal transition point of the Huber loss is closely related to the distribution of the noise in the ground-truth data. As a result, our interpretation provides an intuitive way to identify well-suited hyper-parameters by approximating the amount of noise in the data, which we demonstrate through a case study and experimentation on the Faster R-CNN and RetinaNet object detectors.


title: Informed reversible jump algorithms

abstract: Incorporating information about the target distribution in proposal mechanisms generally produces efficient Markov chain Monte Carlo algorithms (or at least, algorithms that are more efficient than uninformed counterparts). For instance, it has proved successful to incorporate gradient information in fixed-dimensional algorithms, as seen with algorithms such as Hamiltonian Monte Carlo. In trans-dimensional algorithms, Green (2003) recommended to sample the parameter proposals during model switches from normal distributions with informative means and covariance matrices. These proposal distributions can be viewed as asymptotic approximations to the parameter distributions, where the limit is with regard to the sample size. Models are typically proposed using uninformed uniform distributions. In this paper, we build on the approach of Zanella (2020) for discrete spaces to incorporate information about neighbouring models. We rely on approximations to posterior model probabilities that are asymptotically exact. We prove that, in some scenarios, the samplers combining this approach with that of Green (2003) behave like ideal ones that use the exact model probabilities and sample from the correct parameter distributions, in the large-sample regime. We show that the implementation of the proposed samplers is straightforward in some cases. The methodology is applied to a real-data example. The code is available online.


title: The feasible region of hypergraphs

abstract: Let $\mathcal{F}$ be a family of $r$-uniform hypergraphs. The feasible region $\Omega(\mathcal{F})$ of $\mathcal{F}$ is the set of points $(x,y)$ in the unit square such that there exists a sequence of $\mathcal{F}$-free $r$-uniform hypergraphs whose edge density approaches $x$ and whose shadow density approaches $y$. The feasible region provides a lot of combinatorial information, for example, the supremum of $y$ over all $(x,y) \in \Omega(\mathcal{F})$ is the Tur\'{a}n density $\pi(\mathcal{F})$, and $\Omega(\emptyset)$ gives the Kruskal-Katona theorem. We undertake a systematic study of $\Omega(\mathcal{F})$, and prove that $\Omega(\mathcal{F})$ is completely determined by a left-continuous almost everywhere differentiable function; and moreover, there exists an $\mathcal{F}$ for which this function is not continuous. We also extend some old related theorems. For example, we generalize a result of Fisher and Ryan to hypergraphs and extend a classical result of Bollob\'as by almost completely determining the feasible region for cancellative triple systems.


title: Closing the Training/Inference Gap for Deep Attractor Networks

abstract: This paper improves the deep attractor network (DANet) approach by closing its gap between training and inference. During training, DANet relies on attractors, which are computed from the ground truth separations. As this information is not available at inference time, the attractors have to be estimated, which is typically done by k-means. This results in two mismatches: The first mismatch stems from using classical k-means with Euclidean norm, whereas masks are computed during training using the dot product similarity. By using spherical k-means instead, we can show that we can already improve the performance of DANet. Furthermore, we show that we can fully incorporate k-means clustering into the DANet training. This yields the benefit of having no training/inference gap and consequently results in an scale-invariant signal-to-distortion ratio (SI-SDR) improvement of 1.1dB on the Wall Street Journal corpus (WSJ0).


title: Characteristic Cohomology I: Singularities of Given Type

abstract: For a germ of a variety $\mathcal{V}, 0 \subset \mathbb C^N, 0$, a singularity $\mathcal{V}_0$ of type $\mathcal{V}$, is given by a germ $f_0 : \mathbb C^n, 0 \to \mathbb C^N, 0$ which is transverse to $\mathcal{V}$ in an appropriate sense so that $\mathcal{V}_0 = f_0^{-1}(\mathcal{V})$. For these singularities, we introduce "characteristic cohomology" to capture the contribution of the topology of $\mathcal{V}$ to that of $\mathcal{V}_0$, for the Milnor fiber (for $\mathcal{V}, 0$ a hypersurface), and complement and link of $\mathcal{V}_0$ (in the general case). The characteristic cohomology of both the Milnor fiber and complement are subalgebras of the cohomology of the Milnor fibers, respectively the complement. For a fixed $\mathcal{V}$, they are functorial over the category of singularities of type $\mathcal{V}$. In addition, for the link of $\mathcal{V}_0$ there is a characteristic cohomology subgroup of the cohomology of the link over a field of characteristic 0. The characteristic cohomologies for Milnor fiber and complement are shown to be invariant under the $\mathcal K_{\mathcal{V}}$-equivalence of defining germs $f_0$, resp. for the link invariant under the $\mathcal K_{H}$-equivalence of $f_0$ for $H$ the defining equation of $\mathcal V, 0$. We give a geometric criteria involving "vanishing compact models", which detect nonvanishing subalgebras of the characteristic cohomologies, resp. subgroups for the link. In part II of this paper we specialize to the case of square matrix singularities, which may be general, symmetric or skew-symmetric.


title: Neutrino direction and energy resolution of Askaryan detectors

abstract: Detection of high-energy neutrinos via the radio technique allows for an exploration of the neutrino energy range from $\sim10^{16}$\~eV to $\sim10^{20}$\~eV with unprecedented precision. These Askaryan detectors have matured in two pilot arrays (ARA and ARIANNA) and the construction of a large-scale detector is actively discussed in the community. In this contribution, we present reconstruction techniques to determine the neutrino direction and energy from the observed few-nanoseconds short radio flashes and quantify the resolution of one of such detectors. The reconstruction of the neutrino direction requires a precise measurement of both the signal direction as well as the signal polarization. The reconstruction of the neutrino energy requires, in addition, the measurement of the vertex distance, obtainable from the time difference of two signal paths through the ice, and the viewing angle of the in-ice shower via the frequency spectrum. We discuss the required algorithms and quantify the resolution using a detailed Monte Carlo simulation study.


title: Towards quantum internet and non-local communication in position based qubits

abstract: Non-local communication among position based qubits is described for the system of the quantum electromagnetic resonator entangled to two semiconductor electrostatic qubits via interaction between matter and radiation by Jaynes-Cummings tight-binding Hamiltonian. Principle of quantum communication between position dependent qubits is explained with usage of simplistic model. All stages of derivation are presented. The case of two semiconductor position-dependent qubits interacting with quantum electromagnetic cavity is discussed and general form of tight-binding Hamiltonian is derived with renormalized tight-binding coefficients. The obtained results bring foundation for the construction of quantum networks and prospect of quantum internet. The presented work brings the perspective of creation of quantum communication networks between electrostatic position based qubits that are implementable in semiconductor single electron devices and in particular in current CMOS technologies. The case of two capacitively interacting qubits biased to quantum electromagnetic cavity is also described.


title: IBM Functional Genomics Platform, A Cloud-Based Platform for Studying Microbial Life at Scale

abstract: The rapid growth in biological sequence data is revolutionizing our understanding of genotypic diversity and challenging conventional approaches to informatics. With the increasing availability of genomic data, traditional bioinformatic tools require substantial computational time and the creation of ever-larger indices each time a researcher seeks to gain insight from the data. To address these challenges, we pre-computed important relationships between biological entities spanning the Central Dogma of Molecular Biology and captured this information in a relational database. The database can be queried across hundreds of millions of entities and returns results in a fraction of the time required by traditional methods. In this paper, we describe \textit{IBM Functional Genomics Platform} (formerly known as OMXWare), a comprehensive database relating genotype to phenotype for bacterial life. Continually updated, IBM Functional Genomics Platform today contains data derived from 200,000 curated, self-consistently assembled genomes. The database stores functional data for over 68 million genes, 52 million proteins, and 239 million domains with associated biological activity annotations from Gene Ontology, KEGG, MetaCyc, and Reactome. IBM Functional Genomics Platform maps all of the many-to-many connections between each biological entity including the originating genome, gene, protein, and protein domain. Various microbial studies, from infectious disease to environmental health, can benefit from the rich data and connections. We describe the data selection, the pipeline to create and update the IBM Functional Genomics Platform, and the developer tools (Python SDK and REST APIs) which allow researchers to efficiently study microbial life at scale.


title: The Plectic Weight Filtration on Cohomology of Shimura Varieties and Partial Frobenius

abstract: We prove that there is a natural plectic weight filtration on the cohomology of Hilbert modular varieties in the spirit of Nekovar and Scholl. This is achieved with the help of Morel's work on weight t-structures and a detailed study of partial Frobenius. We prove in particular that the partial Frobenius extends to toroidal and minimal compactifications.


title: Lie symmetries of two-dimensional shallow water equations with variable bottom topography

abstract: We carry out the group classification of the class of two-dimensional shallow water equations with variable bottom topography using an optimized version of the method of furcate splitting. The equivalence group of this class is found by the algebraic method. Using algebraic techniques, we construct additional point equivalences between some of the listed cases of Lie-symmetry extensions, which are inequivalent up to transformations from the equivalence group.


title: A Scalable Multilabel Classification to Deploy Deep Learning Architectures For Edge Devices

abstract: Convolution Neural Networks (CNN) have performed well in many applications such as object detection, pattern recognition, video surveillance and so on. CNN carryout feature extraction on labelled data to perform classification. Multi-label classification assigns more than one label to a particular data sample in a data set. In multi-label classification, properties of a data point that are considered to be mutually exclusive are classified. However, existing multi-label classification requires some form of data pre-processing that involves image training data cropping or image tiling. The computation and memory requirement of these multi-label CNN models makes their deployment on edge devices challenging. In this paper, we propose a methodology that solves this problem by extending the capability of existing multi-label classification and provide models with lower latency that requires smaller memory size when deployed on edge devices. We make use of a single CNN model designed with multiple loss layers and multiple accuracy layers. This methodology is tested on state-of-the-art deep learning algorithms such as AlexNet, GoogleNet and SqueezeNet using the Stanford Cars Dataset and deployed on Raspberry Pi3. From the results the proposed methodology achieves comparable accuracy with 1.8x less MACC operation, 0.97x reduction in latency and 0.5x, 0.84x and 0.97x reduction in size for the generated AlexNet, GoogleNet and SqueezeNet CNN models respectively when compared to conventional ways of achieving multi-label classification like hard-coding multi-label instances into single labels. The methodology also yields CNN models that achieve 50\% less MACC operations, 50% reduction in latency and size of generated versions of AlexNet, GoogleNet and SqueezeNet respectively when compared to conventional ways using 2 different single-labelled models to achieve multi-label classification.


title: Work distribution in thermal processes

abstract: We find the moment generating function (mgf) of the nonequilibrium work for open systems undergoing a thermal process, ie, when the stochastic dynamics maps thermal states into time dependent thermal states. The mgf is given in terms of a temperature-like scalar satisfying a first order ODE. We apply the result to some paradigmatic situations: a levitated nanoparticle in a breathing optical trap, a brownian particle in a box with a moving piston and a two state system driven by an external field, where the work mgfs are obtained for different timescales and compared with Monte Carlo simulations.


title: Reinterpreting the Middle-Levels Theorem via Natural Enumeration of Ordered Trees

abstract: Let $0<k\in\mathbb{Z}$. A reinterpretation of the proof of existence of Hamilton cycles in the middle-levels graph $M_k$ induced by the vertices of the $(2k+1)$-cube representing the $k$- and $(k+1)$-subsets of $\{0,\ldots,2k\}$ is given via an associated dihedral quotient graph of $M_k$ whose vertices represent the ordered (rooted) trees of order $k+1$ and size $k$.


title: Exploring Effects on Magnifications due to Line-of-Sight Galaxies in the Hubble Frontier Fields

abstract: Cluster lensing has become an important tool in the search for high redshift galaxies through its ability to magnify sources. In order to determine the intrinsic properties of these galaxies, lensing mass models must be constructed to determine the magnification of the images. These models are traditionally two-dimensional, focusing on the mass within the cluster and either ignoring or approximating any contribution from line-of-sight galaxies. In this paper, we present the first full set of three-dimensional mass models of the six Hubble Frontier Fields and use them to test for systematic biases in magnifications due to using the traditional 2D approach. We find that omitting foreground or background galaxies causes image position offsets between 0.1-0.4", a non-negligible fraction of the typical 0.3-0.7" residuals of current state-of-the-art models. We also find that median image magnifications can shift by up to 6%, though it is dependent on the field. This can be alleviated in some cases by approximating the mass in the lensing plane, but a 5% magnification bias still exists in other cases; image position offsets are also improved, but are still present at 0.10".


title: Characteristic Cohomology II: Matrix Singularities

abstract: Let $\mathcal{V} \subset M$ denote any of the varieties of singular $m \times m$ complex matrices which may be general, symmetric, or skew-symmetric ($m$ even), or $m \times p$ matrices, in the corresponding space $M$ of such matrices. A "matrix singularity", $\mathcal{V}_0$ of "type $\mathcal{V}$", for any of the $\mathcal{V} \subset M$ is defined as $\mathcal{V}_0 = f_0^{-1}(\mathcal{V})$ by a germ $f_0 : \mathbb C^n, 0 \to M, 0$ (appropriately transverse to $\mathcal{V}$). In part I of this paper we introduced the notion of characteristic cohomology for a singularity $\mathcal{V}_0$ of type $\mathcal{V}$ for the Milnor fiber (for $\mathcal{V}$ a hypersurface) and for the complement and link (in the general case). We determine here the characteristic cohomology for matrix singularities in all of these cases. For these singularities we had shown in another paper that the Milnor fibers and complements have "compact model submanifolds", which are classical symmetric spaces in the sense of Cartan. We show that characteristic subalgebra is the image of an exterior algebra (or in one case a module on two generators over an exterior algebra) on an explicit set of generators. We give "detection criteria"using the vanishing compact models for identifying a exterior subalgebras in the characteristic sublgebra, when $f_0$ contains a special type of "unfurled kite map". This will be valid for the Milnor fiber, complement, and link.


title: Recurrent Instance Segmentation using Sequences of Referring Expressions

abstract: The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions). We propose a deep neural network with recurrent layers that output a sequence of binary masks, one for each referring expression provided by the user. The recurrent layers in the architecture allow the model to condition each predicted mask on the previous ones, from a spatial perspective within the same image. Our multimodal approach uses off-the-shelf architectures to encode both the image and the referring expressions. The visual branch provides a tensor of pixel embeddings that are concatenated with the phrase embeddings produced by a language encoder. Our experiments on the RefCOCO dataset for still images indicate how the proposed architecture successfully exploits the sequences of referring expressions to solve a pixel-wise task of instance segmentation.


title: Perceived Intensities of Normal and Shear Skin Stimuli using a Wearable Haptic Bracelet

abstract: Our aim is to provide effective interaction with virtual objects, despite the lack of co-location of virtual and real-world contacts, while taking advantage of relatively large skin area and ease of mounting on the forearm. We performed two human participant studies to determine the effects of haptic feedback in the normal and shear directions during virtual manipulation using haptic devices worn near the wrist. In the first study, participants performed significantly better while discriminating stiffness values of virtual objects when the feedback consisted of normal displacements compared to shear displacements. Participants also commented that they could detect normal cues much easier than shear, which motivated us to perform a second study to find the point of subjective equality (PSE) between normal and shear stimuli. Our results show that shear stimuli require a larger actuator displacement but less force than normal stimuli to achieve perceptual equality for our haptic bracelets. We found that normal and shear stimuli cannot be equalized through skin displacement nor the interaction forces across all users. Rather, a calibration method is needed to find the point of equality for each user where normal and shear stimuli create the same intensity on the user's skin.


title: Spatial-Temporal Cluster Relations -- A Foundation for Trajectory Cluster Lifetime Analysis

abstract: Spatial-temporal data, that is information about objects that exist at a particular location and time period, are rich in value and, as a consequence, the target of so many initiative efforts. Clustering approaches aim at grouping datapoints based on similar properties for classification tasks. These approaches have been widely used in domains such as human mobility, ecology, health and astronomy. However, clustering approaches typically address only the static nature of a cluster, and do not take into consideration its dynamic aspects. A desirable approach needs to investigate relations between dynamic clusters and their elements that can be used to derive new insights about what happened to the clusters during their lifetimes. A fundamental step towards this goal is to provide a formal definition of spatial-temporal cluster relations. This report introduces, describes, and formalizes 14 novel spatial-temporal cluster relations that may occur during the existence of a cluster and involve both trajectory-cluster membership conditions and cluster-cluster comparisons. We evaluate the proposed relations with a discussion on how they are able to interpret complex cases that are difficult to be distinguished without a formal relation specification. We conclude the report by summarizing our results and describing avenues for further research.


title: Designing over uncertain outcomes with stochastic sampling Bayesian optimization

abstract: Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these scenarios must consider this stochasticity to properly guide the design of future experiments. Here, we adapt Bayesian optimization to handle uncertain outcomes, proposing a new framework called stochastic sampling Bayesian optimization (SSBO). We show that the bounds on expected regret for an upper confidence bound search in SSBO resemble those of earlier Bayesian optimization approaches, with added penalties due to the stochastic generation of inputs. Additionally, we adapt existing batch optimization techniques to properly limit the myopic decision making that can arise when selecting multiple instances before feedback. Finally, we show that SSBO techniques properly optimize a set of standard optimization problems as well as an applied problem inspired by bioengineering.


title: Characterization and Integration of the Singular Test Integrals in the Method-of-Moments Implementation of the Electric-Field Integral Equation

abstract: In this paper, we characterize the logarithmic singularities arising in the method of moments from the Green's function in integrals over the test domain, and we use two approaches for designing geometrically symmetric quadrature rules to integrate these singular integrands. These rules exhibit better convergence properties than quadrature rules for polynomials and, in general, lead to better accuracy with a lower number of quadrature points. We demonstrate their effectiveness for several examples encountered in both the scalar and vector potentials of the electric-field integral equation (singular, near-singular, and far interactions) as compared to the commonly employed polynomial scheme and the double Ma--Rokhlin--Wandzura (DMRW) rules, whose sample points are located asymmetrically within triangles.

categories: physics.comp-ph cs.NA math.NA physics.class-ph


title: Cosmic Magnetism

abstract: Magnetic fields are involved in every astrophysical process on every scale: from planetary and stellar interiors to neutron stars, stellar wind bubbles and supernova remnants; from the interstellar medium in galactic disks, nuclei, spiral arms and halos to the intracluster and intergalactic media. They are involved in essentially every particle acceleration process and are thus fundamental to non-thermal physics in the Universe. Key questions include the origin of magnetic fields, their evolution over cosmic time, the amplification and decay processes that modify their strength, and their impact on other processes such as star formation and galaxy evolution. Astrophysical plasmas provide a unique laboratory for testing magnetic dynamo theory. The study of magnetic fields requires observations that span the wavelength range from radio through infrared, optical, UV, X-ray, and gamma-ray. Canada has an extremely strong record of research in cosmic magnetism, and has a significant leadership role in several ongoing and upcoming global programs. This white paper will review the science questions to be addressed in the study of cosmic magnetic fields and will describe the observational and theoretical opportunities and challenges afforded by the telescopes and modelling capabilities of today and tomorrow.


title: Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs

abstract: This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional construction and employs least-squares functionals as loss functions to determine parameters of the deep neural network. There are various least-squares functionals for a partial differential equation. This paper focuses on the so-called first-order system least-squares (FOSLS) functional studied in [3], which is based on a first-order system of scalar second-order elliptic PDEs. Numerical results for second-order elliptic PDEs in one dimension are presented.

categories: cs.LG cs.NA math.NA physics.comp-ph stat.ML


title: On the existence of the Green function for elliptic systems in divergence form

abstract: We study the existence of the Green function for an elliptic system in divergence form $-\nabla\cdot a\nabla$ in $\mathbb{R}^d$, with $d>2$. The tensor field $a=a(x)$ is only assumed to be bounded and $\lambda$-coercive. For almost every point $y \in \mathbb{R}^d$, the existence of a Green's function $G(a; \cdot, y)$ centered in $y$ has been proven in [J. Conlon, A. Giunti and F.Otto, "Green's function for elliptic systems: Delmotte-Deuschel bounds", 2017]. In this paper, we show that the set of points $y \in \mathbb{R}^d$ for which $G(a; \cdot, y)$ does not exist has zero $p$-capacity, for an exponent $p >2$ depending only on the dimension $d$ and the ellipticity ratio of $a$.


title: Distributed Resource Allocation with Binary Decisions via Newton-like Neural Network Dynamics

abstract: This paper aims to solve a distributed resource allocation problem with binary local constraints. The problem is formulated as a binary program with a cost function defined by the summation of agent costs plus a global mismatch/penalty term. We propose a modification of the Hopfield Neural Network (HNN) dynamics in order to solve this problem while incorporating a novel Newton-like weighting factor. This addition lends itself to fast avoidance of saddle points, which the gradient-like HNN is susceptible to. Turning to a multi-agent setting, we reformulate the problem and develop a distributed implementation of the Newton-like dynamics. We show that if a local solution to the distributed reformulation is obtained, it is also a local solution to the centralized problem. A main contribution of this work is to show that the probability of converging to a saddle point of an appropriately defined energy function in both the centralized and distributed settings is zero under light assumptions. Finally, we enlarge our algorithm with an annealing technique which gradually learns a feasible binary solution. Simulation results demonstrate that the proposed methods are competitive with centralized greedy and SDP relaxation approaches in terms of solution quality, while the main advantage of our approach is a significant improvement in runtime over the SDP relaxation method and the distributed quality of implementation.


title: Discovering Earth's transient moons with the Large Synoptic Survey Telescope

abstract: Earth's temporarily-captured orbiters (TCOs) are a sub-population of near-Earth objects (NEOs). TCOs can provide constraints for NEO population models in the 1--10-metre-diameter range, and they are outstanding targets for in situ exploration of asteroids due to a low requirement on $\Delta v$. So far there has only been a single serendipitous discovery of a TCO. Here we assess in detail the possibility of their discovery with the upcoming Large Synoptic Survey Telescope (LSST), previously identified as the primary facility for such discoveries. We simulated observations of TCOs by combining a synthetic TCO population with an LSST survey simulation. We then assessed the detection rates, detection linking and orbit computation, and sources for confusion. Typical velocities of detectable TCOs will range from 1$^{\circ}$/day to 50$^{\circ}$/day, and typical apparent $V$ magnitudes from 21 to 23. Potentially-hazardous asteroids have observational characteristics similar to TCOs, but the two populations can be distinguished based on their orbits with LSST data alone. We predict that a TCO can be discovered once every year with the baseline moving-object processing system (MOPS). The rate can be increased to one TCO discovery every two months if tools complementary to the baseline MOPS are developed for the specific purpose of discovering these objects.