title: Energy levels and radiative rates for transitions in S-like Sc~VI, V VIII, Cr IX, and Mn~X

abstract: Energy levels, radiative rates and lifetimes are reported for four S-like ions, namely Sc~VI, V VIII, Cr IX, and Mn~X. Two independent atomic structure codes, namely the general-purpose relativistic atomic structure package ({\sc grasp}) and the flexible atomic code ({\sc fac}), have been adopted for calculating the energy levels, with differing amounts of configuration interaction. This is mainly to make some assessment of accuracy. However, the {\sc grasp} alone is used for calculating the remaining parameters. Results are reported for varying number of levels of these ions, and for calculating lifetimes contributions are included from all types of transitions, i.e. E1, E2, M1, and M2. Comparisons are made with the earlier available experimental and theoretical results and assessments of accuracy are given for each ion. Additionally, the presently reported data cover a significantly larger number of levels and transitions than already available in the literature for the four S-like ions.


title: Two body problem in presence of cosmological constant

abstract: We consider the Kepler two-body problem in presence of the cosmological constant $\Lambda$. Contrary to the classical case, where finite solutions exist for any angular momentum of the system $L$, in presence of $\Lambda$ finite solutions exist only in the interval $0<L< L_{lim}(\Lambda)$. The qualitative picture of the two-body motion is described, and critical parameters of the problem are found. Application are made to the relative motion of the Local Group and Virgo cluster.


title: Sub-policy Adaptation for Hierarchical Reinforcement Learning

abstract: Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a higher level that controls the skills in a new task. Leaving the skills fixed can lead to significant sub-optimality in the transfer setting. In this work, we propose a novel algorithm to discover a set of skills, and continuously adapt them along with the higher level even when training on a new task. Our main contributions are two-fold. First, we derive a new hierarchical policy gradient with an unbiased latent-dependent baseline, and we introduce Hierarchical Proximal Policy Optimization (HiPPO), an on-policy method to efficiently train all levels of the hierarchy jointly. Second, we propose a method for training time-abstractions that improves the robustness of the obtained skills to environment changes. Code and results are available at sites.google.com/view/hippo-rl


title: Quantization in chiral higher order topological insulators: circular dichroism and local Chern marker

abstract: The robust quantization of observables in units of universal constants is a hallmark of topological phases. We show that chiral higher order topological insulators (HOTIs), bulk insulators with chiral hinge states, present two unusual features related to quantization. First, we show that circular dichroism is quantized to an integer or zero depending on the orientation of the sample. This probe locates the hinge states, and can be used to distinguish different types of chiral HOTIs. Second, we find that the average of the local Chern marker over a single surface, an observable related to the surface Hall conductivity known to be quantized in the infinite slab geometry, is nonuniversal for a finite surface. This is due to a nonuniversal contribution of the hinge states, previously unaccounted for, that distinguishes surfaces of chiral HOTIs from Chern insulators. Our findings are relevant to establish higher order topology in systems such as the axion insulator candidate EuIn$_2$As$_2$, and cold atomic realizations.


title: Mergers of globular clusters in the Galactic disc: intermediate mass black hole coalescence and implications for gravitational waves detection

abstract: We propose a new formation channel for intermediate mass black hole (IMBH) binaries via globular cluster collisions in the Galactic disc. Using numerical simulations, we show that the IMBHs form a tight binary that enters the gravitational waves (GWs) emission dominated regime driven by stellar interactions, and ultimately merge in $\lesssim 0.5$ Gyr. These events are clearly audible to LISA and can be associated with electromagnetic emission during the last evolutionary stages. During their orbital evolution, the IMBHs produce runaway stars comparable with GAIA and LAMOST observations.


title: Simulating realistic disc formation in tidal disruption events

abstract: A star coming too close to a supermassive black hole gets disrupted by the tidal force of the compact object in a tidal disruption event, or TDE. Following this encounter, the debris evolves into an elongated stream, half of which coming back to pericenter. Relativistic apsidal precession then leads to a self-crossing shock that initiates the formation of an accretion disc. We perform the first simulation of this process considering a realistic stellar trajectory and black hole mass, which has so far eluded investigations for computational reasons. This numerical issue is alleviated by using as initial conditions the outflow launched by the self-crossing shock according the local simulation of Lu & Bonnerot (2019). We find that the gas leaving the intersection point experiences numerous secondary shocks that result in the rapid formation of a thick and marginally-bound disc. The mass distribution features two overdensities identified as spiral shocks that drive slow gas inflow along the mid-plane. Inward motion primarily takes place along the funnels of the newly-formed torus, from which a fraction of the matter can get accreted. Further out, the gas moves outward forming an extended envelope completely surrounding the accretion flow. Secondary shocks heat the debris at a rate of a few times $10^{44} \, \rm erg \, s^{-1}$ with a large fraction likely participating to the bolometric luminosity. These results pave the way towards a complete understanding of the early radiation from TDEs that progressively becomes accessible from observations.


title: Proper Fourier decomposition formalism for cosmological fields in spherical shells

abstract: Cosmological random fields are often analysed in spherical Fourier-Bessel basis. Compared to the Cartesian Fourier basis this has an advantage of properly taking into account some of the relevant physical processes (redshift-space distortions, redshift evolution). The observations usually come in redshift slices and have a partial sky coverage. These masking effects strongly correlate Fourier-Bessel modes that are meant for a perfect spherical geometry and result in a lot of redundant measurements. This work proposes a new Fourier basis that is better suited for measurements in redshift shells and results in fewer Fourier modes, with the radial modes strictly uncorrelated on large scales and the angular modes with significantly reduced redundancy. I argue that the spherical Fourier analysis of cosmological fields should always use these new modes instead of the historically established Fourier-Bessel eigenfunctions. The new angular modes on the other hand have number of practical advantages and disadvantages and whether or not to adopt them for a particular analysis should be made on a case by case basis.


title: Constraining the dark matter halo mass of isolated low-surface-brightness galaxies

abstract: Recent advancements in the imaging of low-surface-brightness objects revealed numerous ultra-diffuse galaxies in the local Universe. These peculiar objects are unusually extended and faint: their effective radii are comparable to the Milky Way, but their surface brightnesses are lower than that of dwarf galaxies. Their ambiguous properties motivate two potential formation scenarios: the "failed" Milky Way and the dwarf galaxy scenario. In this paper, for the first time, we employ X-ray observations to test these formation scenarios on a sample of isolated, low-surface-brightness galaxies. Since hot gas X-ray luminosities correlate with the dark matter halo mass, "failed" Milky Way-type galaxies, which reside in massive dark matter halos, are expected to have significantly higher X-ray luminosities than dwarf galaxies, which reside in low-mass dark matter halos. We perform X-ray photometry on a subset of low-surface-brightness galaxies identified in the Hyper Suprime-Cam Subaru survey, utilizing the XMM-Newton XXL North survey. We find that none of the individual galaxies show significant X-ray emission. By co-adding the signal of individual galaxies, the stacked galaxies remain undetected and we set an X-ray luminosity upper limit of ${L_{\rm{0.3-1.2keV}}\leq6.2 \times 10^{37} (d/65 \rm{Mpc})^2 \ \rm{erg \ s^{-1}}}$ for an average isolated low-surface-brightness galaxy. This upper limit is about 40 times lower than that expected in a galaxy with a massive dark matter halo, implying that the majority of isolated low-surface-brightness galaxies reside in dwarf-size dark matter halos.


title: Rectangular W-(super)algebras and their representations

abstract: We study W-algebras obtained by quantum Hamiltonian reduction of $sl(Mn)$ associated to the $sl(2)$ embedding of rectangular type. The algebra can be realized as the asymptotic symmetry of higher spin gravity with $M \times M$ matrix valued fields. In our previous work, we examined the basic properties of the W-algebra and claimed that the algebra can be realized as the symmetry of Grassmannian-like coset even with finite central charge based on a proposal of holography. In this paper, we extend the analysis in the following ways. First, we compute the operator product expansions among low spin generators removing the restriction of $n = 2$. Second, we investigate the degenerate representations in several ways, and see the relations to the coset spectrum and the conical defect geometry of the higher spin gravity. For these analyses, we mainly set $M=n=2$. Finally, we extend the previous analysis by introducing $\mathcal{N}=2$ supersymmetry.


title: The Planetary Accretion Shock. II. Grid of Post-Shock Entropies and Radiative Shock Efficiencies for Non-Equilibrium Radiation Transport

abstract: In the core-accretion formation scenario of gas giants, most of the gas accreting onto a planet is processed through an accretion shock. In this series of papers we study this shock since it is key in setting the forming planet's structure and thus its post-formation luminosity, with dramatic observational consequences. We perform one-dimensional grey radiation-hydrodynamical simulations with non-equilibrium (two-temperature) radiation transport and up-to-date opacities. We survey the parameter space of accretion rate, planet mass, and planet radius and obtain post-shock temperatures, pressures, and entropies, as well as global radiation efficiencies. We find that usually, the shock temperature T_shock is given by the "free-streaming" limit. At low temperatures the dust opacity can make the shock hotter but not significantly. We corroborate this with an original semi-analytical derivation of T_shock . We also estimate the change in luminosity between the shock and the nebula. Neither T_shock nor the luminosity profile depend directly on the optical depth between the shock and the nebula. Rather, T_shock depends on the immediate pre-shock opacity, and the luminosity change on the equation of state (EOS). We find quite high immediate post-shock entropies (S ~ 13-20 kB/mH), which makes it seem unlikely that the shock can cool the planet. The global radiation efficiencies are high (eta^phys > 97%) but the remainder of the total incoming energy, which is brought into the planet, exceeds the internal luminosity of classical cold starts by orders of magnitude. Overall, these findings suggest that warm or hot starts are more plausible.


title: No Violation of the Second Law in Extended Black Hole Thermodynamics

abstract: Recently a number of papers have claimed that the horizon area - and thus the entropy - of near extremal black holes in anti-de Sitter spacetimes can be reduced by dropping particles into them. In this note we point out that this is a consequence of an underlying assumption that the energy of an infalling particle changes only the internal energy of the black hole, whereas a more physical assumption would be that it changes the enthalpy (mass). In fact, under the latter choice, the second law of extended black hole thermodynamics is no longer violated.


title: Spectral characterization of newly detected young substellar binaries with SINFONI

abstract: We observe 14 young low-mass substellar objects in young moving groups using the SINFONI IFS with LGS-AO to detect and characterize 3 candidate binary systems. Together with the adopted young moving group ages we employ isochrones from substellar evolutionary models to estimate individual masses for the binaries. We find 2MASS J15104786-2818174 to be part of the $\approx 30 - 50$ Myr Argus moving group and composed of a $34 - 48\,M_{\rm Jup}$ primary brown dwarf with spectral type M$9\gamma$ and a fainter $15 - 22\, M_{\rm Jup}$ companion, separated by $\approx 100$ mas. 2MASS J22025794-5605087 is identified as an almost equal-mass binary in the AB Dor moving group, with a projected separation of $\approx 60$ mas. Both components share spectral type M$9\gamma/\beta$, which with the adopted age of $120 - 200$ Myr yields individual masses between $50 - 68\,M_{\rm Jup}$. The observations of 2MASS J15474719-2423493 are of lesser quality and we obtain no spectral characterization for the target, but resolve two components separated by $\approx 170$ mas which with the predicted young field age of $30 - 50$ Myr yields individual masses below $20\,M_{\rm Jup}$. Out of the 3 candidate binary systems, 2MASS J22025794-5605087 has unambiguous spectroscopic signs of being a bona-fide binary, while the other two will require second-epoch confirmation. The small projected separations between the binary components corresponds to physical separations of $\approx 4 - 7$ AU, allowing for astrometric monitoring of just a few years in order to generate constrained orbital fits and dynamical masses for the systems. In combination with their young ages, these binaries will prove to be excellent benchmarks for calibrating substellar evolutionary models down to a very low-mass regime.


title: Rectangular W-algebras of types $so(M)$ and $sp(2M)$ and dual coset CFTs

abstract: We examine rectangular W-algebras with $so(M)$ or $sp(2M)$ symmetry, which can be realized as the asymptotic symmetry of higher spin gravities with restricted matrix extensions. We compute the central charges of the algebras and the levels of $so(M)$ or $sp(2M)$ affine subalgebras by applying the Hamiltonian reductions of $so$ or $sp$ type Lie algebras. For simple cases with generators of spin up to two, we obtain their operator product expansions by requiring the associativity. We further claim that the W-algebras can be realized as the symmetry algebras of dual coset CFTs and provide several strong supports. The analysis can be regarded as a check of extended higher spin holographies including full quantum corrections. We also extend the analysis by introducing $\mathcal{N}=1$ supersymmetry.


title: Full-Sky Lensing Reconstruction of 21 cm Intensity Maps

abstract: Weak gravitational lensing of the 21 cm radiation is expected to be an important cosmological probe for post-reionization physics. We investigate the reconstruction of the matter density perturbations using a quadratic minimum variance estimator. The next generation of line intensity mapping (LIM) surveys such as HIRAX and CHIME will cover a larger sky fraction, which requires one to account for the curvature in the sky. Thus, we extend the plane-parallel flat-sky formalism for lensing reconstruction to account for a full-sky survey using the Spherical Fourier-Bessel (SFB) expansion. Using the HIRAX 21 cm survey as a basis, we make predictions for lensing-reconstruction noise in our formalism and compare our results with the predictions from the plane-parallel formalism. We find agreement with the plane-parallel noise power spectrum at small scales and a significant deviation at scales $L\lesssim \ell_{\rm res}-k_{\rm eq}R$ where $R$ is the radius of the shell volume, $k_{\rm eq}$ is the wavenumber for matter-radiation equality, and $\ell_{\rm res}$ is the angular resolution scale. Furthermore, we derive the SFB flat-sky reconstruction noise and compare it with the full-sky SFB case as well as the plane-parallel case, finding minor deviations from the full-sky noise due to sphericity. We also determine that, in the absence of non-Gaussian statistics of the intensity field but accounting for foregrounds, the signal-to-noise ratio (SNR) for $C_\ell^{\phi\phi}$ using our SFB estimator increases by 107%. This shows that accounting for the curved sky in LIM weak lensing will be crucial for large-scale cosmology.


title: Anomaly in the Opacity of the Post-Reionization Intergalactic Medium in the Ly$\alpha$ and Ly$\beta$ Forest

abstract: We measure the intergalactic medium (IGM) opacity in the Ly$\alpha$ as well as in the Ly$\beta$ forest along $19$ quasar sightlines between $5.5\lesssim z_{\rm abs}\lesssim 6.1$, probing the end stages of the reionization epoch. Owing to its lower oscillator strength the Ly$\beta$ transition is sensitive to different gas temperatures and densities than Ly$\alpha$, providing additional constraints on the ionization and thermal state of the IGM. A comparison of our measurements to different inhomogeneous reionization models, derived from post-processing the Nyx cosmological hydrodynamical simulation to include spatial fluctuations in the ultraviolet background (UVB) or the gas temperature field, as well as to a uniform reionization model with varying thermal states of the IGM, leads to two primary conclusions: First, we find that including the effects of spectral noise is key for a proper data to model comparison. Noise effectively reduces the sensitivity to high opacity regions, and thus even stronger spatial inhomogeneities are required to match the observed scatter in the observations than previously inferred. Second, we find that models which come close to reproducing the distribution of Ly$\alpha$ effective optical depths nevertheless underpredict the Ly$\beta$ opacity at the same spatial locations. The origin of this disagreement is not entirely clear but models with an inversion in the temperature-density relation of the IGM just after reionization is completed match our measurements best, although they still do not fully capture the observations at $z\gtrsim 5.8$.


title: Breakdown of the classical double copy for the effective action of dilaton-gravity at NNLO

abstract: We demonstrate that a recently proposed classical double copy procedure to construct the effective action of two massive particles in dilaton-gravity from the analogous problem of two color charged particles in Yang-Mills gauge theory fails at next-to-next-to-leading orders in the post-Minkowskian (3PM) or post-Newtonian (2PN) expansions.


title: Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets

abstract: Although photometric redshifts (photo-z's) are crucial ingredients for current and upcoming large-scale surveys, the high-quality spectroscopic redshifts currently available to train, validate, and test them are substantially non-representative in both magnitude and color. We investigate the nature and structure of this bias by tracking how objects from a heterogeneous training sample contribute to photo-z predictions as a function of magnitude and color, and illustrate that the underlying redshift distribution at fixed color can evolve strongly as a function of magnitude. We then test the robustness of the galaxy-galaxy lensing signal in 120 deg$^2$ of HSC-SSP DR1 data to spectroscopic completeness and photo-z biases, and find that their impacts are sub-dominant to current statistical uncertainties. Our methodology provides a framework to investigate how spectroscopic incompleteness can impact photo-z-based weak lensing predictions in future surveys such as LSST and WFIRST.


title: Reversing a philosophy: from counting to square functions and decoupling

abstract: Breakthrough work of Bourgain, Demeter, and Guth recently established that decoupling inequalities can prove powerful results on counting integral solutions to systems of Diophantine equations. In this note we demonstrate that in appropriate situations this implication can also be reversed. As a first example, we observe that a count for the number of integral solutions to a system of Diophantine equations implies a discrete decoupling inequality. Second, in our main result we prove an $L^{2n}$ square function estimate (which implies a corresponding decoupling estimate) for the extension operator associated to a non-degenerate curve in $\mathbb{R}^n$. The proof is via a combinatorial argument that builds on the idea that if $\gamma$ is a non-degenerate curve in $\mathbb{R}^n$, then as long as $x_1,\ldots, x_{2n}$ are chosen from a sufficiently well-separated set, then $ \gamma(x_1)+\cdots+\gamma(x_n) = \gamma(x_{n+1}) + \cdots + \gamma(x_{2n}) $ essentially only admits solutions in which $x_1,\ldots,x_n$ is a permutation of $x_{n+1},\ldots, x_{2n}$.


title: Fast Radio Bursts: An Extragalactic Enigma

abstract: We summarize our understanding of millisecond radio bursts from an extragalactic population of sources. FRBs occur at an extraordinary rate, thousands per day over the entire sky with radiation energy densities at the source about ten billion times larger than those from Galactic pulsars. We survey FRB phenomenology, source models and host galaxies, coherent radiation models, and the role of plasma propagation effects in burst detection. The FRB field is guaranteed to be exciting: new telescopes will expand the sample from the current ~80 unique burst sources (and a few secure localizations and redshifts) to thousands, with burst localizations that enable host-galaxy redshifts emerging directly from interferometric surveys. * FRBs are now established as an extragalactic phenomenon. * Only a few sources are known to repeat. Despite the failure to redetect other FRBs, they are not inconsistent with all being repeaters. * FRB sources may be new, exotic kinds of objects or known types in extreme circumstances. Many inventive models exist, ranging from alien spacecraft to cosmic strings but those concerning compact objects and supermassive black holes have gained the most attention. A rapidly rotating magnetar is a promising explanation for FRB 121102 along with the persistent source associated with it, but alternative source models are not ruled out for it or other FRBs. * FRBs are powerful tracers of circumsource environments, `missing baryons' in the IGM, and dark matter. * The relative contributions of host galaxies and the IGM to propagation effects have yet to be disentangled, so dispersion measure distances have large uncertainties.


title: Joint Concept Matching based Learning for Zero-Shot Recognition

abstract: Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods typically learn a projection map between the visual feature space and the semantic space and mainly suffer which is prone to a projection domain shift primarily due to a large domain gap between seen and unseen classes. In this paper, we propose a novel inductive ZSL model based on projecting both visual and semantic features into a common distinct latent space with class-specific knowledge, and on reconstructing both visual and semantic features by such a distinct common space to narrow the domain shift gap. We show that all these constraints on the latent space, class-specific knowledge, reconstruction of features and their combinations enhance the robustness against the projection domain shift problem, and improve the generalization ability to unseen object classes. Comprehensive experiments on four benchmark datasets demonstrate that our proposed method is superior to state-of-the-art algorithms.


title: Fundamental solution for Cauchy initial value problem for parabolic PDEs with discontinuous unbounded first-order coefficient at the origin. Extension of the classical parametrix method

abstract: We prove the existence of a fundamental solution of the Cauchy initial boundary value problem on the whole space for a parabolic partial differential equation with discontinuous unbounded first-order coefficient at the origin. We establish also non-asymptotic, rapidly decreasing at infinity, upper and lower estimates for the fundamental solution. We extend the classical parametrix method provided by E.E. Levi.


title: Astra Version 1.0: Evaluating Translations from Alloy to SMT-LIB

abstract: We present a variety of translation options for converting Alloy to SMT-LIB via Alloy's Kodkod interface. Our translations, which are implemented in a library that we call Astra, are based on converting the set and relational operations of Alloy into their equivalent in typed first-order logic (TFOL). We investigate and compare the performance of an SMT solver for many translation options. We compare using only one universal type to recovering Alloy type information from the Kodkod representation and using multiple types in TFOL. We compare a direct translation of the relations to predicates in TFOL to one where we recover functions from their relational form in Kodkod and represent these as functions in TFOL. We compare representations in TFOL with unbounded scopes to ones with bounded scopes, either pre or post quantifier expansion. Our results across all these dimensions provide directions for portfolio solvers, modelling improvements, and optimizing SMT solvers.


title: XeF$_2$-Enhanced Focused Ion Beam Etching and Passivation of GaSb

abstract: Focused ion beams (FIBs) are widely used to modify optoelectronic devices, but their utility is severely restricted in some III-V materials due to adverse effects such as nanofibre growth and contamination. This study describes an effective machining method for the modification and passivation of GaSb using a focused Ga$^+$ beam with the addition of XeF$_2$ gas. The added gas suppressed the nanofibre growth and allowed for controlled etching. Moreover, the milled surface exhibited much lower roughness and contained much lower levels of carbon and oxygen contaminants. These effects are attributed to the formation of a gallium fluoride layer, which inhibits the catalytic vapour-liquid-solid (VLS) nanofibre growth. The fluoride layer prevents the surface oxidation, acting as an effective passivation layer. This gas-assisted FIB process eliminates the idiosyncratic challenges of modifying GaSb with an ion beam and it can be implemented cost-effectively and rapidly in conventional FIB systems---allowing for site-specific modification of bespoke GaSb-based devices.


title: Antiferromagnetism and spin density waves in 3D Dirac semimetals

abstract: We perform mean-field study of possible magnetic instabilities in Dirac semimetals. We find that Dirac electrons naturally host antiferromagnetic or spin density wave ground states, though their specific configurations may vary depending on specific model, as well as chemical potential and temperature. We also discuss paramagnetic susceptibility of Dirac semimetals. In the cases, when Dirac electrons do not have orbital momentum, the magnetic properties may be $\mu$ and $T$ independent.


title: Report-Sensitive Spot-Checking in Peer-Grading Systems

abstract: Peer grading systems make large courses more scalable, provide students with faster and more detailed feedback, and help students to learn by thinking critically about the work of others. A key obstacle to the broader adoption of peer grading systems is motivating students to provide accurate grades. The literature has explored many different approaches to incentivizing accurate grading (which we survey in detail), but the strongest incentive guarantees have been offered by mechanisms that compare peer grades to trusted TA grades with a fixed probability. In this work, we show that less TA work is required when these probabilities are allowed to depend on the grades that students report. We prove this result in a model with two possible grades, arbitrary numbers of agents, no requirement that students grade multiple assignments, arbitrary but homogeneous noisy observation of the ground truth which students can pay a fixed cost to observe, and the possibility of misreporting grades before or after observing this signal. We give necessary and sufficient conditions for our new mechanism's feasibility, prove its optimality under these assumptions, and characterize its improvement over the previous state of the art both analytically and empirically. Finally, we relax our homogeneity assumption, allowing each student and TA to observe the ground truth according to a different noise model.


title: Shell potentials for microgravity Bose-Einstein condensates

abstract: Extending the understanding of Bose-Einstein condensate (BEC) physics to new geometries and topologies has a long and varied history in ultracold atomic physics. One such new geometry is that of a bubble, where a condensate would be confined to the surface of an ellipsoidal shell. Study of this geometry would give insight into new collective modes, self-interference effects, topology-dependent vortex behavior, dimensionality crossovers from thick to thin shells, and the properties of condensates pushed into the ultradilute limit. Here we discuss a proposal to implement a realistic experimental framework for generating shell-geometry BEC using radiofrequency dressing of magnetically-trapped samples. Such a tantalizing state of matter is inaccessible terrestrially due to the distorting effect of gravity on experimentally-feasible shell potentials. The debut of an orbital BEC machine (NASA Cold Atom Laboratory, aboard the International Space Station) has enabled the operation of quantum-gas experiments in a regime of perpetual freefall, and thus has permitted the planning of microgravity shell-geometry BEC experiments. We discuss specific experimental configurations, applicable inhomogeneities and other experimental challenges, and outline potential experiments.


title: Predicting Superhard Materials via a Machine Learning Informed Evolutionary Structure Search

abstract: Good agreement was found between experimental Vickers hardnesses, $H_\text{v}$, of a wide range of materials and those calculated by three macroscopic hardness models that employ the shear and/or bulk moduli obtained from: (i) first principles via AFLOW-AEL (AFLOW Automatic Elastic Library), and (ii) a machine learning (ML) model trained on materials within the AFLOW repository. Because $H_\text{v}^\text{ML} $ values can be quickly estimated, they can be used in conjunction with an evolutionary search to predict stable, superhard materials. This methodology is implemented in the XtalOpt evolutionary algorithm. Each crystal is minimized to the nearest local minimum, and its Vickers hardness is computed via a linear relationship with the shear modulus discovered by Teter. Both the energy/enthalpy and $H_\text{v, Teter}^{\text{ML}}$ are employed to determine a structure's fitness. This implementation is applied towards the carbon system, and 43 new superhard phases are found. A topological analysis reveals that phases estimated to be slightly harder than diamond contain a substantial fraction of diamond and/or lonsdaleite.


title: Sentiment analysis is not solved! Assessing and probing sentiment classification

abstract: Neural methods for SA have led to quantitative improvements over previous approaches, but these advances are not always accompanied with a thorough analysis of the qualitative differences. Therefore, it is not clear what outstanding conceptual challenges for sentiment analysis remain. In this work, we attempt to discover what challenges still prove a problem for sentiment classifiers for English and to provide a challenging dataset. We collect the subset of sentences that an (oracle) ensemble of state-of-the-art sentiment classifiers misclassify and then annotate them for 18 linguistic and paralinguistic phenomena, such as negation, sarcasm, modality, etc. The dataset is available at https://github.com/ltgoslo/assessing_and_probing_sentiment. Finally, we provide a case study that demonstrates the usefulness of the dataset to probe the performance of a given sentiment classifier with respect to linguistic phenomena.


title: Can generalised relative pose estimation solve sparse 3D registration?

abstract: Popular 3D scan registration projects, such as Stanford digital Michelangelo or KinectFusion, exploit the high-resolution sensor data for scan alignment. It is particularly challenging to solve the registration of sparse 3D scans in the absence of RGB components. In this case, we can not establish point correspondences since the same 3D point cannot be captured in two successive scans. In contrast to correspondence based methods, we take a different viewpoint and formulate the sparse 3D registration problem based on the constraints from the intersection of line segments from adjacent scans. We obtain the line segments by modeling every horizontal and vertical scan-line as piece-wise linear segments. We propose a new alternating projection algorithm for solving the scan alignment problem using line intersection constraints. We develop two new minimal solvers for scan alignment in the presence of plane correspondences: 1) 3 line intersections and 1 plane correspondence, and 2) 1 line intersection and 2 plane correspondences. We outperform other competing methods on Kinect and LiDAR datasets.


title: On the Effect of Word Order on Cross-lingual Sentiment Analysis

abstract: Current state-of-the-art models for sentiment analysis make use of word order either explicitly by pre-training on a language modeling objective or implicitly by using recurrent neural networks (RNNs) or convolutional networks (CNNs). This is a problem for cross-lingual models that use bilingual embeddings as features, as the difference in word order between source and target languages is not resolved. In this work, we explore reordering as a pre-processing step for sentence-level cross-lingual sentiment classification with two language combinations (English-Spanish, English-Catalan). We find that while reordering helps both models, CNNS are more sensitive to local reorderings, while global reordering benefits RNNs.


title: Gradient Descent Maximizes the Margin of Homogeneous Neural Networks

abstract: In this paper, we study the implicit regularization of the gradient descent algorithm in homogeneous neural networks, including fully-connected and convolutional neural networks with ReLU or LeakyReLU activations. In particular, we study the gradient descent or gradient flow (i.e., gradient descent with infinitesimal step size) optimizing the logistic loss or cross-entropy loss of any homogeneous model (possibly non-smooth), and show that if the training loss decreases below a certain threshold, then we can define a smoothed version of the normalized margin which increases over time. We also formulate a natural constrained optimization problem related to margin maximization, and prove that both the normalized margin and its smoothed version converge to the objective value at a KKT point of the optimization problem. Our results generalize the previous results for logistic regression with one-layer or multi-layer linear networks, and provide more quantitative convergence results with weaker assumptions than previous results for homogeneous smooth neural networks. We conduct several experiments to justify our theoretical finding on MNIST and CIFAR-10 datasets. Finally, as margin is closely related to robustness, we discuss potential benefits of training longer for improving the robustness of the model.


title: Three Dimensional Optimal Spectral Extraction (TDOSE) from Integral Field Spectroscopy

abstract: [Abbreviated] The amount of integral field spectrograph (IFS) data has grown considerable over the last few decades. The demand for tools to analyze such data is therefore bigger now than ever. We present TDOSE; a flexible Python tool for Three Dimensional Optimal Spectral Extraction from IFS data cubes. TDOSE works on any three-dimensional data cube and bases the spectral extractions on morphological reference image models. In each wavelength layer of the IFS data cube, TDOSE simultaneously optimizes all sources in the morphological model to minimize the difference between the scaled model components and the IFS data. The flux optimization produces individual data cubes containing the scaled three-dimensional source models. This allows for efficient de-blending of flux in both the spatial and spectral dimensions of the IFS data cubes, and extraction of the corresponding one-dimensional spectra. We present an example of how the three-dimensional source models generated by TDOSE can be used to improve two-dimensional maps of physical parameters. By extracting TDOSE spectra of $\sim$150 [OII] emitters from the MUSE-Wide survey we show that the median increase in line flux is $\sim$5% when using multi-component models as opposed to single-component models. However, the increase in recovered line emission in individual cases can be as much as 50%. Comparing the TDOSE model-based extractions of the MUSE-Wide [OII] emitters with aperture spectra, the TDOSE spectra provides a median flux (S/N) increase of 9% (14%). Hence, TDOSE spectra optimizes the S/N while still being able to recover the total emitted flux. TDOSE version 3.0 presented in this paper is available at https://github.com/kasperschmidt/TDOSE.


title: Was the Sun a Slow Rotator? -- Sodium and Potassium Constraints from the Lunar Regolith

abstract: While the Earth and Moon are generally similar in composition, a notable difference between the two is the apparent depletion in moderately volatile elements in lunar samples. This is often attributed to the formation process of the Moon and demonstrates the importance of these elements as evolutionary tracers. Here we show that paleo space weather may have driven the loss of a significant portion of moderate volatiles, such as sodium and potassium from the surface of the Moon. The remaining sodium and potassium in the regolith is dependent on the primordial rotation state of the Sun. Notably, given the joint constraints shown in the observed degree of depletion of sodium and potassium in lunar samples and the evolution of activity of solar analogues over time, the Sun is highly likely to have been a slow rotator. Since the young Sun's activity was important in affecting the evolution of planetary surfaces, atmospheres, and habitability in the early Solar System, this is an important constraint on the solar activity environment at that time. Finally, since solar activity was strongest in the first billion years of the Solar System, when the Moon was most heavily bombarded by impactors, evolution of the Sun's activity may also be recorded in lunar crust and would be an important well-preserved and relatively accessible record of past Solar System processes.


title: IntrinSeqNet: Learning to Estimate the Reflectance from Varying Illumination

abstract: This article has been removed by arXiv administrators because the submitter did not have the rights to agree to the license at the time of submission


title: Semantics to Space(S2S): Embedding semantics into spatial space for zero-shot verb-object query inferencing

abstract: We present a novel deep zero-shot learning (ZSL) model for inferencing human-object-interaction with verb-object (VO) query. While the previous two-stream ZSL approaches only use the semantic/textual information to be fed into the query stream, we seek to incorporate and embed the semantics into the visual representation stream as well. Our approach is powered by Semantics-to-Space (S2S) architecture where semantics derived from the residing objects are embedded into a spatial space of the visual stream. This architecture allows the co-capturing of the semantic attributes of the human and the objects along with their location/size/silhouette information. To validate, we have constructed a new dataset, Verb-Transferability 60 (VT60). VT60 provides 60 different VO pairs with overlapping verbs tailored for testing two-stream ZSL approaches with VO query. Experimental evaluations show that our approach not only outperforms the state-of-the-art, but also shows the capability of consistently improving performance regardless of which ZSL baseline architecture is used.


title: Learning to Forget for Meta-Learning

abstract: Few-shot learning is a challenging problem where the goal is to achieve generalization from only few examples. Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks, which is then used to quickly adapt to unseen tasks. However, forcibly sharing an initialization can lead to conflicts among tasks and the compromised (undesired by tasks) location on optimization landscape, thereby hindering the task adaptation. Further, we observe that the degree of conflict differs among not only tasks but also layers of a neural network. Thus, we propose task-and-layer-wise attenuation on the compromised initialization to reduce its influence. As the attenuation dynamically controls (or selectively forgets) the influence of prior knowledge for a given task and each layer, we name our method as L2F (Learn to Forget). The experimental results demonstrate that the proposed method provides faster adaptation and greatly improves the performance. Furthermore, L2F can be easily applied and improve other state-of-the-art MAML-based frameworks, illustrating its simplicity and generalizability.


title: Learning Instance Occlusion for Panoptic Segmentation

abstract: Panoptic segmentation requires segments of both "things" (countable object instances) and "stuff" (uncountable and amorphous regions) within a single output. A common approach involves the fusion of instance segmentation (for "things") and semantic segmentation (for "stuff") into a non-overlapping placement of segments, and resolves overlaps. However, instance ordering with detection confidence do not correlate well with natural occlusion relationship. To resolve this issue, we propose a branch that is tasked with modeling how two instance masks should overlap one another as a binary relation. Our method, named OCFusion, is lightweight but particularly effective in the instance fusion process. OCFusion is trained with the ground truth relation derived automatically from the existing dataset annotations. We obtain state-of-the-art results on COCO and show competitive results on the Cityscapes panoptic segmentation benchmark.


title: Dynamic PET cardiac and parametric image reconstruction: a fixed-point proximity gradient approach using patch-based DCT and tensor SVD regularization

abstract: Our aim was to enhance visual quality and quantitative accuracy of dynamic positron emission tomography (PET)uptake images by improved image reconstruction, using sophisticated sparse penalty models that incorporate both 2D spatial+1D temporal (3DT) information. We developed two new 3DT PET reconstruction algorithms, incorporating different temporal and spatial penalties based on discrete cosine transform (DCT)w/ patches, and tensor nuclear norm (TNN) w/ patches, and compared to frame-by-frame methods; conventional 2D ordered subsets expectation maximization (OSEM) w/ post-filtering and 2D-DCT and 2D-TNN. A 3DT brain phantom with kinetic uptake (2-tissue model), and a moving 3DT cardiac/lung phantom was simulated and reconstructed. For the cardiac/lung phantom, an additional cardiac gated 2D-OSEM set was reconstructed. The structural similarity index (SSIM) and relative root mean squared error (rRMSE) relative ground truth was investigated. The image derived left ventricular (LV) volume for the cardiac/lung images was found by region growing and parametric images of the brain phantom were calculated. For the cardiac/lung phantom, 3DT-TNN yielded optimal images, and 3DT-DCT was best for the brain phantom. The optimal LV volume from the 3DT-TNN images was on average 11 and 55 percentage points closer to the true value compared to cardiac gated 2D-OSEM and 2D-OSEM respectively. Compared to 2D-OSEM, parametric images based on 3DT-DCT images generally had smaller bias and higher SSIM. Our novel methods that incorporate both 2D spatial and 1D temporal penalties produced dynamic PET images of higher quality than conventional 2D methods, w/o need for post-filtering. Breathing and cardiac motion were simultaneously captured w/o need for respiratory or cardiac gating. LV volumes were better recovered, and subsequently fitted parametric images were generally less biased and of higher quality.


title: Stochastic PDEs for large portfolios with general mean-reverting volatility processes

abstract: We consider a structural stochastic volatility model for the loss from a large portfolio of credit risky assets. Both the asset value and the volatility processes are correlated through systemic Brownian motions, with default determined by the asset value reaching a lower boundary. We prove that if our volatility models are picked from a class of mean-reverting diffusions, the system converges as the portfolio becomes large and, when the vol-of-vol function satisfies certain regularity and boundedness conditions, the limit of the empirical measure process has a density given in terms of a solution to a stochastic initial-boundary value problem on a half-space. The problem is defined in a special weighted Sobolev space. Regularity results are established for solutions to this problem, and then we show that there exists a unique solution. In contrast to the CIR volatility setting covered by the existing literature, our results hold even when the systemic Brownian motions are taken to be correlated.

categories: math.PR math.AP q-fin.PM q-fin.PR q-fin.RM


title: Enhancing the Open-Circuit Voltage of Perovskite Solar Cells by up to 120 mV using {\pi}-Extended Phosphoniumfluorene Electrolytes as Hole Blocking Layers

abstract: Four {\pi}-extended phosphoniumfluorene electrolytes ({\pi}-PFEs) are introduced as hole-blocking layers (HBL) in inverted architecture planar perovskite solar cells (PVSCs) with the structure of ITO/PEDOT:PSS/MAPbI3/PCBM/HBL/Ag. The deep-lying highest occupied molecular orbital (HOMO) energy level of the {\pi}-PFEs effectively blocks holes, decreasing contact recombination. We demonstrate that the incorporation of {\pi}-PFEs introduces a dipole moment at the PCBM/Ag interface, resulting in a significant enhancement of the built-in potential of the device. This enhancement results in an increase in the open-circuit voltage of the device by up to 120 mV, when compared to the commonly used bathocuproine HBL. The results are confirmed both experimentally and by numerical simulation. Our work demonstrates that interfacial engineering of the transport layer/contact interface by small molecule electrolytes is a promising route to suppress non-radiative recombination in perovskite devices and compensate for a non-ideal energetic alignment at the hole-transport layer/perovskite interface.


title: Development of large area focal plane detectors for MAGIX

abstract: MAGIX is a planned experiment that will be implemented at the upcoming accelerator MESA in Mainz. Due to its location in the energy-recovering lane of the accelerator beam-currents up to 1mA with a maximum energy of 105 MeV will be available for precision experiments. MAGIX itself consists of a jet-target and two magnetic spectrometers. Inside the spectrometers GEM-based detectors will be used in the focal plane for track reconstruction. The design goals for the detector modules are a spatial resolution of 50 um, a size of 1.20 m x 0.3 m and a minimal material budget. To accomplish these goals we started developing several GEM-prototypes to study different behaviors and techniques to optimize the final detector design. The GEM foils used are provided by CERN and are trained, stretched and framed in our laboratory. The readout is done with an SRS based system. In this contribution the requirements, achievements and the ongoing developments are presented.


title: Automorphism Groups for Semidirect Products of Cyclic Groups

abstract: Every semidirect product of groups $K\rtimes H$ has size $\left | K \right | \cdot \left | H\right |$, yet the size of such a group's automorphism group varies with the chosen action of $H$ on $K$. This paper will explore groups of the form $\text{Aut}(K\rtimes H)$, considering especially the case where $H$ and $K$ are cyclic. Only finite groups will be considered.


title: Absorption and opacity threshold for a thin foil in a strong circularly polarized laser field

abstract: We show that a commonly accepted transparency threshold for a thin foil in a strong circularly polarized normally incident laser pulse needs a refinement. We present a new analytical model, which correctly accounts for laser absorption. The refined threshold is determined not solely by the laser amplitude, but other parameters are equally or even more important. Our predictions are in a perfect agreement with PIC simulations. The refined criterion is crucial for configuring laser plasma experiments in the high field domain. Besides, an opaque foil steepens the pulse front, this can be important for numerous applications.


title: Single spin resonance in a van der Waals embedded paramagnetic defect

abstract: Spins constitute a group of quantum objects forming a key resource in modern quantum technology. Two-dimensional (2D) van der Waals materials are of fundamental interest for studying nanoscale magnetic phenomena. However, isolating singular paramagnetic spins in 2D systems is challenging. We report here on a quantum emitting source embedded within hexgonal boron nitride (h-BN) exhibiting optical magnetic resonance (ODMR). We extract an isotropic $g$ factor close to 2 and derive an upper bound for a zero field splitting (ZFS) ($\leq$ 4 MHz). Photoluminescence (PL) behavior under temperature cycling using different excitations is presented, assigning probable zero phonon lines (ZPLs) / phonon side band (PSBs) to emission peaks, compatible with h-BN's phonon density of states, indicating their intrinsic nature. Narrow and inhomogeneous broadened ODMR lines differ significantly from monoatomic vacancy defect lines known in literature. We derive a hyperfine coupling of around 10 MHz. Its angular dependence indicates an unpaired electron in an out-of-plane $\pi$-orbital, probably originating from an additional substitutional carbon impurity or other low mass atom. We determine the spin relaxation time $T_1$ to be around 17 $\mu$s.


title: Stability of Talagrand's Gaussian transport-entropy inequality via the F\"ollmer process

abstract: We establish a dimension-free improvement of Talagrand's Gaussian transport-entropy inequality, under the assumption that the measures satisfy a Poincar\'e inequality. We also study stability of the inequality, in terms of relative entropy, when restricted to measures whose covariance matrix trace is smaller than the ambient dimension. In case the covariance matrix is strictly smaller than the identity, we give dimension-free estimates which depend on its eigenvalues. To complement our results, we show that our conditions cannot be relaxed, and that there exist measures with covariance larger than the identity, for which the inequality is not stable, in relative entropy. To deal with these examples, we show that, without any assumptions, one can always get quantitative stability estimates in terms of relative entropy to Gaussian mixtures. Our approach gives rise to a new point of view which sheds light on the hierarchy between Fisher information, entropy, and transportation distance, and may be of independent interest. In particular, it implies that the described results apply verbatim to the log-Sobolev inequality and improve upon some known estimates in the literature.


title: The induced semigroup of Schwarz maps to the space of Hilbert-Schmidt operators

abstract: We prove that for every semigroup of Schwarz maps on the von~Neumann algebra of all bounded linear operators on a Hilbert space which has a subinvariant faithful normal state there exists an associated semigroup of contractions on the space of Hilbert-Schmidt operators of the Hilbert space. Moreover, we show that if the original semigroup is weak$^*$ continuous then the associated semigroup is strongly continuous. We introduce the notion of the extended generator of a semigroup on the bounded operators of a Hilbert space with respect to an orthonormal basis of the Hilbert space. We describe the form of the generator of a quantum Markov semigroup on the von~Neumann algebra of all bounded linear operators on a Hilbert space which has an invariant faithful normal state under the assumption that the generator of the associated semigroup has compact resolvent.


title: Meaning to Form: Measuring Systematicity as Information

abstract: A longstanding debate in semiotics centers on the relationship between linguistic signs and their corresponding semantics: is there an arbitrary relationship between a word form and its meaning, or does some systematic phenomenon pervade? For instance, does the character bigram \textit{gl} have any systematic relationship to the meaning of words like \textit{glisten}, \textit{gleam} and \textit{glow}? In this work, we offer a holistic quantification of the systematicity of the sign using mutual information and recurrent neural networks. We employ these in a data-driven and massively multilingual approach to the question, examining 106 languages. We find a statistically significant reduction in entropy when modeling a word form conditioned on its semantic representation. Encouragingly, we also recover well-attested English examples of systematic affixes. We conclude with the meta-point: Our approximate effect size (measured in bits) is quite small---despite some amount of systematicity between form and meaning, an arbitrary relationship and its resulting benefits dominate human language.


title: Moduli of polarized Calabi-Yau pairs

abstract: We prove that the irreducible components of the moduli space of polarized Calabi-Yau pairs are projective.


title: Perfect matchings and derangements on graphs

abstract: We show that each perfect matching in a bipartite graph $G$ intersects at least half of the perfect matchings in $G$. This result has equivalent formulations in terms of the permanent of the adjacency matrix of a graph, and in terms of derangements and permutations on graphs. We give several related results and open questions.


title: Stand-Alone Self-Attention in Vision Models

abstract: Convolutions are a fundamental building block of modern computer vision systems. Recent approaches have argued for going beyond convolutions in order to capture long-range dependencies. These efforts focus on augmenting convolutional models with content-based interactions, such as self-attention and non-local means, to achieve gains on a number of vision tasks. The natural question that arises is whether attention can be a stand-alone primitive for vision models instead of serving as just an augmentation on top of convolutions. In developing and testing a pure self-attention vision model, we verify that self-attention can indeed be an effective stand-alone layer. A simple procedure of replacing all instances of spatial convolutions with a form of self-attention applied to ResNet model produces a fully self-attentional model that outperforms the baseline on ImageNet classification with 12% fewer FLOPS and 29% fewer parameters. On COCO object detection, a pure self-attention model matches the mAP of a baseline RetinaNet while having 39% fewer FLOPS and 34% fewer parameters. Detailed ablation studies demonstrate that self-attention is especially impactful when used in later layers. These results establish that stand-alone self-attention is an important addition to the vision practitioner's toolbox.


title: Hallucinating IDT Descriptors and I3D Optical Flow Features for Action Recognition with CNNs

abstract: In this paper, we revive the use of old-fashioned handcrafted video representations for action recognition and put new life into these techniques via a CNN-based hallucination step. Despite of the use of RGB and optical flow frames, the I3D model (amongst others) thrives on combining its output with the Improved Dense Trajectory (IDT) and extracted with its low-level video descriptors encoded via Bag-of-Words (BoW) and Fisher Vectors (FV). Such a fusion of CNNs and handcrafted representations is time-consuming due to pre-processing, descriptor extraction, encoding and tuning parameters. Thus, we propose an end-to-end trainable network with streams which learn the IDT-based BoW/FV representations at the training stage and are simple to integrate with the I3D model. Specifically, each stream takes I3D feature maps ahead of the last 1D conv. layer and learns to `translate' these maps to BoW/FV representations. Thus, our model can hallucinate and use such synthesized BoW/FV representations at the testing stage. We show that even features of the entire I3D optical flow stream can be hallucinated thus simplifying the pipeline. Our model saves 20-55h of computations and yields state-of-the-art results on four publicly available datasets.


title: Data Science for Influencer Marketing : feature processing and quantitative analysis

abstract: Influencing a target audience through social media content has become a new focus of interest for marketing leaders. While a large amount of heterogeneous data is produced by influencers on a daily basis, professionals in the influ-encer marketing (IM) field still rely on simple quantitative metrics such as community size or engagement rate to estimate the value of an influencer. As few research papers have proposed a framework to quantify the performance of an influencer by using quantitative influencer data (number of followers, engagement,...), qualitative information (age, country, city, etc...), natural text (profile and post descriptions) and visual information (images and videos), we decided to explore these variables and quantitatively evaluate their dependencies. By analyzing 713,824 influencers on 5 social media platforms over a period of one year, we identified relationships between value proposition data (engagement, reach, audience), demographics, natural text patterns and visual information. The main goal of this paper is to provide IM professionals with a modern methodology to better understand the value of their influencers and to feed machine learning algorithms for clustering, scoring or recommendation.


title: A Variational Autoencoder for Probabilistic Non-Negative Matrix Factorisation

abstract: We introduce and demonstrate the variational autoencoder (VAE) for probabilistic non-negative matrix factorisation (PAE-NMF). We design a network which can perform non-negative matrix factorisation (NMF) and add in aspects of a VAE to make the coefficients of the latent space probabilistic. By restricting the weights in the final layer of the network to be non-negative and using the non-negative Weibull distribution we produce a probabilistic form of NMF which allows us to generate new data and find a probability distribution that effectively links the latent and input variables. We demonstrate the effectiveness of PAE-NMF on three heterogeneous datasets: images, financial time series and genomic.


title: Smooth, nonsymplectic embeddings of rational balls in the complex projective plane

abstract: We exhibit an infinite family of rational homology balls which embed smoothly but not symplectically in the complex projective plane. We also obtain a new lattice embedding obstruction from Donaldson's diagonalisation theorem, and use this to show that no two of our examples may be embedded disjointly.


title: Uniqueness of bubbling solutions of mean field equations with non-quantized singularities

abstract: For singular mean field equations defined on a compact Riemann surface, we prove the uniqueness of bubbling solutions if some blowup points coincide with bubbling sources. If the strength of the bubbling sources at blowup points are not multiple of $4\pi$ we prove that bubbling solutions are unique under non-degeneracy assumptions. This work extends a previous work of Bartolucci, et, al \cite{bart-4}.


title: Recurrent Neural Processes

abstract: We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but containing slow long-term variabilities, RNPs may derive appropriate slow latent time scales. They do so in an efficient manner by establishing conditional independence among subsequences of the time series. Our theoretically grounded framework for stochastic processes expands the applicability of NPs while retaining their benefits of flexibility, uncertainty estimation, and favorable runtime with respect to Gaussian Processes (GPs). We demonstrate that state spaces learned by RNPs benefit predictive performance on real-world time-series data and nonlinear system identification, even in the case of limited data availability.


title: Link Dimension and Exact Construction of a Graph

abstract: Minimum resolution set and associated metric dimension provide the basis for unique and systematic labeling of nodes of a graph using distances to a set of landmarks. Such a distance vector set, however, may not be unique to the graph and does not allow for its exact construction. The concept of construction set is presented, which facilitates the unique representation of nodes and the graph as well as its exact construction. Link dimension is the minimum number of landmarks in a construction set. Results presented include necessary conditions for a set of landmarks to be a construction set, bounds for link dimension, and guidelines for transforming a resolution set to a construction set.


title: A Comprehensive Survey of Navigation Systems for the Visual Impaired

abstract: Sight is essential for humans to navigate their surrounding environment independently. Tasks that are simple for the sighted are often close to impossible for the visually impaired. Throughout the years, many researchers dedicated their time and efforts to design and implement technologies and devices that can help the visually impaired to navigate in unknown areas independently. A navigation assistive system for the visually impaired is built on multiple components of which localization, navigation, obstacle avoidance, and human-machine interaction form the essential components. Individual components have been explored extensively in the literature and it is a daunting task to review it in its entirety. In this paper, a compact but comprehensive collection of available methods to build each component has been provided. The discussed methods may not have been implemented for a navigation assistive technology for visually impaired directly but they can be employed to build an individual building block. Given that every approach has its own challenges, methods to combat those challenges have been presented. The purpose of this paper is to provide researchers with a shortcut to review most of the available methods to build each component, provide them with the essential knowledge to understand the nuances in each component and give them a baseline to start with.


title: Comparison of Methods for the Assessment of Nonlinearity in Short-Term Heart Rate Variability under different Physiopathological States

abstract: Despite the widespread diffusion of nonlinear methods for heart rate variability (HRV) analysis, the presence and the extent to which nonlinear dynamics contribute to short-term HRV is still controversial. This work aims at testing the hypothesis that different types of nonlinearity can be observed in HRV depending on the method adopted and on the physiopathological state. Two entropy-based measures of time series complexity (normalized complexity index, NCI) and regularity (information storage, IS), and a measure quantifying deviations from linear correlations in a time series (Gaussian linear contrast, GLC), are applied to short HRV recordings obtained in young (Y) and old (O) healthy subjects and in myocardial infarction (MI) patients monitored in the resting supine position and in the upright position reached through head-up tilt. The method of surrogate data is employed to detect the presence of and quantify the contribution of nonlinear dynamics to HRV. We find that the three measures differ both in their variations across groups and conditions and in the number and strength of nonlinear HRV dynamics detected: at rest, IS reveals a significantly lower number of nonlinear dynamics in Y, whereas during tilt GLC reveals significantly stronger nonlinear HRV dynamics in MI; in the transition from rest to tilt, all measures detect a significant weakening of nonlinear HRV dynamics in Y, while only GLC detects a significant strengthening of such dynamics in MI. These results suggest that distinct dynamic structures, detected with different sensitivity by nonlinear measures, lie beneath short-term HRV in different physiological states and pathological conditions.


title: Arcula: A Secure Hierarchical Deterministic Wallet for Multi-asset Blockchains

abstract: This work presents Arcula, a new design for hierarchical deterministic wallets that brings identity-based addresses to the blockchain. Arcula is built on top of provably secure cryptographic primitives. It generates all its cryptographic secrets from a user-provided seed and enables the derivation of new public keys based on the identities of users, without requiring any secret information. Unlike other wallets, it achieves all these properties while being secure against privilege escalation. We formalize the security model of hierarchical deterministic wallets and prove that an attacker compromising an arbitrary number of users within an Arcula wallet cannot escalate his privileges and compromise users higher in the access hierarchy. Our design works out-of-the-box with any blockchain that enables the verification of signatures on arbitrary messages. We evaluate its usage in a real-world scenario on the Bitcoin Cash network.


title: The Caustic Design of the Dark Matter Web

abstract: Matter density is formally infinite at the location of caustic surfaces, where dark matter sheet folds in phase-space. The caustics separate regions with different number of streams and the volume elements change the parity by turning inside out when passing through the caustic stage. Being measure-zero structures, identification of caustics via matter density fields is usually restricted to fine-grained simulations. Here we employ a generic algorithm to identify caustics directly using the triangulation of the Lagrangian sub-manifold x(q,t) obtained in N-body simulations. In our approach the caustic surfaces are approximated by a set of triangles whose vertices are particles of the simulation. The major obstacle we encountered was insufficient sampling of small scale perturbations. We overcame it by a brute force approach. We continued to raise the scale of the cutoff in the initial power spectrum until obtained the reliable resolution of the caustics shells up to seven layers. Although quite modest, our result is the first reliable direct construction of caustic surfaces in N-body simulation. It reveals a number of unexpected geometrical features. In particular shapes of some of them are contrastingly different from the known shapes of the caustics formed in the Zeldovich approximation.


title: Symmetric Algorithmic Components for Shape Analysis with Diffeomorphisms

abstract: In computational anatomy, the statistical analysis of temporal deformations and inter-subject variability relies on shape registration. However, the numerical integration and optimization required in diffeomorphic registration often lead to important numerical errors. In many cases, it is well known that the error can be drastically reduced in the presence of a symmetry. In this work, the leading idea is to approximate the space of deformations and images with a possibly non-metric symmetric space structure using an involution, with the aim to perform parallel transport. Through basic properties of symmetries, we investigate how the implementations of a midpoint and the involution compare with the ones of the Riemannian exponential and logarithm on diffeomorphisms and propose a modification of these maps using registration errors. This leads us to identify transvections, the composition of two symmetries, as a mean to measure how far from symmetric the underlying structure is. We test our method on a set of 138 cardiac shapes and demonstrate improved numerical consistency in the Pole Ladder scheme.


title: Thread Batching for High-performance Energy-efficient GPU Memory Design

abstract: Massive multi-threading in GPU imposes tremendous pressure on memory subsystems. Due to rapid growth in thread-level parallelism of GPU and slowly improved peak memory bandwidth, the memory becomes a bottleneck of GPU's performance and energy efficiency. In this work, we propose an integrated architectural scheme to optimize the memory accesses and therefore boost the performance and energy efficiency of GPU. Firstly, we propose a thread batch enabled memory partitioning (TEMP) to improve GPU memory access parallelism. In particular, TEMP groups multiple thread blocks that share the same set of pages into a thread batch and applies a page coloring mechanism to bound each stream multiprocessor (SM) to the dedicated memory banks. After that, TEMP dispatches the thread batch to an SM to ensure high-parallel memory-access streaming from the different thread blocks. Secondly, a thread batch-aware scheduling (TBAS) scheme is introduced to improve the GPU memory access locality and to reduce the contention on memory controllers and interconnection networks. Experimental results show that the integration of TEMP and TBAS can achieve up to 10.3% performance improvement and 11.3% DRAM energy reduction across diverse GPU applications. We also evaluate the performance interference of the mixed CPU+GPU workloads when they are run on a heterogeneous system that employs our proposed schemes. Our results show that a simple solution can effectively ensure the efficient execution of both GPU and CPU applications.


title: STEM beam channeling in BaSnO3/LaAlO3 perovskite bilayers and visualization of 2D misfit dislocation network

abstract: A study of the STEM probe channeling in a heterostructures crystalline specimen is presented here with a goal to guide appropriate STEM-based characterization for complex structures. STEM analysis of perovskite BaSnO3/LaAlO3 bilayers is performed and the dominating effects of beam channeling on HAADF- and LAADF-STEM are illustrated. To study the electron beam propagating through BaSnO3/LaAlO3 bilayers, probe intensity depth profiles are calculated, and the effects of probe defocus and atomic column alignment are discussed. Characteristics of the beam channeling are correlated to resulting ADF-STEM images, which is then tested by comparing focal series of plan-view HAADF-STEM images to those recorded experimentally. Additionally, discussions on how to visualize the misfit dislocation network at the BaSnO3/LaAlO3 interface using HAADF- and LAADF-STEM images are provided.


title: Phonon dynamics in the layered negative thermal expansion compounds Cu$_x$Ni$_{2-x}$(CN)$_4$

abstract: This study explores the relationship between phonon dynamics and negative thermal expansion (NTE) in Cu$_x$Ni$_{2-x}$(CN)$_4$. The partial replacement of nickel (II) by copper (II) in Ni(CN)$_2$ leads to a line phase, CuNi(CN)$_4$ (x = 1), and a solid solution, Cu$_x$Ni$_{2-x}$(CN)$_4$ (0 $\leq$ x $\leq$ 0.5). CuNi(CN)$_4$ adopts a layered structure related to that of Ni(CN)$_2$ (x = 0), and interestingly exhibits 2D NTE which is about 1.5 times larger. Inelastic neutron scattering (INS) measurements combined with first principles lattice dynamical calculations provide insights into the effect of Cu$^{2+}$ on the underlying mechanisms behind the anomalous thermal behavior in all the Cu$_x$Ni$_{2-x}$(CN)$_4$ compounds. The solid solutions are presently reported to also show 2D NTE. The INS results highlight that as the Cu$^{2+}$ content increases in Cu$_x$Ni$_{2-x}$(CN)$_4$, large shifts to lower energies are observed in modes consisting of localized in- and out-of-plane librational motions of the CN ligand, which contribute to the NTE in CuNi(CN)$_4$. Mode Gr\"uneisen parameters calculated for CuNi(CN)$_4$ show that acoustic and low-energy optic modes contribute the most to the NTE, as previously shown in Ni(CN)$_2$. However, mode eigenvectors reveal a large deformation of the [CuN4] units compared to the [NiC4] units, resulting in phonon modes not found in Ni(CN)$_2$, whose NTE-driving phonons consist predominately of rigid-unit modes. The deformations in CuNi(CN)$_4$ arise because the d$^9$ square-planar center is easier to deform than the d$^8$ one, resulting in a greater range of out-of-plane motions for the adjoining ligands.


title: Deep Learning Development Environment in Virtual Reality

abstract: Virtual reality (VR) offers immersive visualization and intuitive interaction. We leverage VR to enable any biomedical professional to deploy a deep learning (DL) model for image classification. While DL models can be powerful tools for data analysis, they are also challenging to understand and develop. To make deep learning more accessible and intuitive, we have built a virtual reality-based DL development environment. Within our environment, the user can move tangible objects to construct a neural network only using their hands. Our software automatically translates these configurations into a trainable model and then reports its resulting accuracy on a test dataset in real-time. Furthermore, we have enriched the virtual objects with visualizations of the model's components such that users can achieve insight about the DL models that they are developing. With this approach, we bridge the gap between professionals in different fields of expertise while offering a novel perspective for model analysis and data interaction. We further suggest that techniques of development and visualization in deep learning can benefit by integrating virtual reality.


title: N-body Approach to the Traveling Salesman Problem (TSP)

abstract: In the Traveling Salesman Problem (TSP), a list of cities and the distances between them are given. The goal is to find the shortest possible route that visits each city exactly once and returns to the original city. The TSP has a wide range of applications in many different industries including, but not limited to, optimizing mail and shipping routes, guiding industrial machines, mapping genomes, and improving autonomous vehicles. For centuries, traveling salesmen, politicians, and circuit preachers have tackled their own versions of the problem. Within the last century, the TSP has become one of the most important problems in the fields of mathematics and computer science. The time to find an exact solution is often impractically long, which has led to the development of numerous approximation techniques, ranging from linear programming methods to nature-inspired models. Here, we present a novel N-body approach to the TSP.


title: Primitive root bias for twin primes II: Schinzel-type theorems for totient quotients and the sum-of-divisors function

abstract: Garcia, Kahoro, and Luca showed that the Bateman-Horn conjecture implies $\phi(p-1) \geq \phi(p+1)$ for a majority of twin-primes pairs $p,p+2$ and that the reverse inequality holds for a small positive proportion of the twin primes. That is, $p$ tends to have more primitive roots than does $p+2$. We prove that Dickson's conjecture, which is much weaker than Bateman-Horn, implies that the quotients $\frac{\phi(p+1)}{\phi(p-1)}$, as $p,p+2$ range over the twin primes, are dense in the positive reals. We also establish several Schinzel-type theorems, some of them unconditional, about the behavior of $\frac{\phi(p+1)}{\phi(p)}$ and $\frac{\sigma(p+1)}{\sigma(p)}$, in which $\sigma$ denotes the sum-of-divisors function.


title: Unsupervised Video Interpolation Using Cycle Consistency

abstract: Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised techniques to synthesize high frame rate videos directly from low frame rate videos using cycle consistency. For a triplet of consecutive frames, we optimize models to minimize the discrepancy between the center frame and its cycle reconstruction, obtained by interpolating back from interpolated intermediate frames. This simple unsupervised constraint alone achieves results comparable with supervision using the ground truth intermediate frames. We further introduce a pseudo supervised loss term that enforces the interpolated frames to be consistent with predictions of a pre-trained interpolation model. The pseudo supervised loss term, used together with cycle consistency, can effectively adapt a pre-trained model to a new target domain. With no additional data and in a completely unsupervised fashion, our techniques significantly improve pre-trained models on new target domains, increasing PSNR values from 32.84dB to 33.05dB on the Slowflow and from 31.82dB to 32.53dB on the Sintel evaluation datasets.


title: Solving Large-Scale 0-1 Knapsack Problems and its Application to Point Cloud Resampling

abstract: 0-1 knapsack is of fundamental importance in computer science, business, operations research, etc. In this paper, we present a deep learning technique-based method to solve large-scale 0-1 knapsack problems where the number of products (items) is large and/or the values of products are not necessarily predetermined but decided by an external value assignment function during the optimization process. Our solution is greatly inspired by the method of Lagrange multiplier and some recent adoptions of game theory to deep learning. After formally defining our proposed method based on them, we develop an adaptive gradient ascent method to stabilize its optimization process. In our experiments, the presented method solves all the large-scale benchmark KP instances in a minute whereas existing methods show fluctuating runtime. We also show that our method can be used for other applications, including but not limited to the point cloud resampling.


title: Cross-View Policy Learning for Street Navigation

abstract: The ability to navigate from visual observations in unfamiliar environments is a core component of intelligent agents and an ongoing challenge for Deep Reinforcement Learning (RL). Street View can be a sensible testbed for such RL agents, because it provides real-world photographic imagery at ground level, with diverse street appearances; it has been made into an interactive environment called StreetLearn and used for research on navigation. However, goal-driven street navigation agents have not so far been able to transfer to unseen areas without extensive retraining, and relying on simulation is not a scalable solution. Since aerial images are easily and globally accessible, we propose instead to train a multi-modal policy on ground and aerial views, then transfer the ground view policy to unseen (target) parts of the city by utilizing aerial view observations. Our core idea is to pair the ground view with an aerial view and to learn a joint policy that is transferable across views. We achieve this by learning a similar embedding space for both views, distilling the policy across views and dropping out visual modalities. We further reformulate the transfer learning paradigm into three stages: 1) cross-modal training, when the agent is initially trained on multiple city regions, 2) aerial view-only adaptation to a new area, when the agent is adapted to a held-out region using only the easily obtainable aerial view, and 3) ground view-only transfer, when the agent is tested on navigation tasks on unseen ground views, without aerial imagery. Experimental results suggest that the proposed cross-view policy learning enables better generalization of the agent and allows for more effective transfer to unseen environments.


title: On Horadam-Lucas sequence

abstract: Horadam introduced a new generalized sequence of numbers, describing its key features and the special sub-sequences that are obtained depending on the choices of initial parameters. This sequence and its sub-sequences are known as the Horadam, generalized Fibonacci, and generalized Lucas numbers, respectively. In the present study, we propose another new sequence, which satisfies a second-order recurrence relation, in addition to Horadam's definition. Further, we prove the Binet's formula, some famous identities, and summation formulas for this new sequence. In particular, we demonstrate the interrelationships between our new sequence and the Horadam sequence.


title: Forward elastic scattering: Dynamical gluon mass and semihard interactions

abstract: The role of low-$x$ parton dynamics in dictating the high-energy behavior of forward scattering observables at LHC energies is investigated using a QCD-based model with even-under-crossing amplitude dominance at high-energies. We explore the effects of different sets of pre- and post-LHC fine-tuned parton distributions on the forward quantities $\sigma_{tot}$ and $\rho$, from $pp$ and $\bar{p}p$ scattering in the interval 10 GeV - 13 TeV. We also investigate the role of the leading soft contribution, the low-energy cuttoff, and the energy dependence of the semihard form factor on these observables. We show that in all cases investigated the highly restrictive data on $\rho$ parameter at $\sqrt{s}=13$ TeV indicate that a crossing-odd component may play a crucial role in forward elastic scattering at the highest energies. In the Regge language an odd-under-crossing object is called Odderon.


title: Constraints on Lorentz Invariance Violations from Gravitational Wave Observations

abstract: Using a deformed dispersion relation for gravitational waves, Advanced LIGO and Advanced Virgo have been able to place constraints on violations of local Lorentz invariance as well as the mass of the graviton. We summarise the method to obtain the current bounds from the 10 significant binary black hole detections made during the first and second observing runs of the above detectors.


title: Experimental Constraint on Stellar Electron-Capture Rates from the ${}^{88}\text{Sr}(t,{}^{3}\text{He}+\gamma){}^{88}\text{Rb}$ reaction at 115 MeV/u

abstract: The Gamow-Teller strength distribution from ${}^{88}$Sr was extracted from a $(t,{}^{3}\text{He}+\gamma)$ experiment at 115 MeV/$u$ to constrain estimates for the electron-capture rates on nuclei around $N=50$, between and including $^{78}$Ni and $^{88}$Sr, which are important for the late evolution of core-collapse supernovae. The observed strength below an excitation energy of 8 MeV was consistent with zero and below 10 MeV amounted to $0.1\pm0.05$. Except for a very-weak transition that could come from the 2.231-MeV $1^{+}$ state, no $\gamma$ lines that could be associated with the decay of known $1^{+}$ states were identified. The derived electron-capture rate from the measured strength distribution is more than an order of magnitude smaller than rates based on the single-state approximation presently used in astrophysical simulations for most nuclei near $N=50$. Rates based on shell-model and quasiparticle random-phase approximation calculations that account for Pauli blocking and core-polarization effects provide better estimates than the single-state approximation, although a relatively strong transition to the first $1^{+}$ state in $^{88}$Rb is not observed in the data. Pauli unblocking effects due to high stellar temperatures could partially counter the low electron-capture rates. The new data serves as a zero-temperature benchmark for constraining models used to estimate such effects.


title: Study of PeV neutrinos around dwarf galaxies near giant lobes of Centaurus A

abstract: The origin of recently discovered PeV neutrinos is an unsolved problem. In this work we consider a hadronic scenario to produce PeV neutrinos from a region around giant lobes of Centaurus A. Although ultrahigh-energy cosmic rays (UHECRs) are accelerated and confined by giant lobes, they can escape to be later injected in the inter-group medium where galaxies near the giant lobes provides the condition to confine them. UHECRs interact with low-energy photons and protons producing high-energy photons and neutrinos. We found that the IC35 event cannot be generated neither inside the giant lobes nor galaxies close to the lobes of Centaurus A.


title: Layered SGD: A Decentralized and Synchronous SGD Algorithm for Scalable Deep Neural Network Training

abstract: Stochastic Gradient Descent (SGD) is the most popular algorithm for training deep neural networks (DNNs). As larger networks and datasets cause longer training times, training on distributed systems is common and distributed SGD variants, mainly asynchronous and synchronous SGD, are widely used. Asynchronous SGD is communication efficient but suffers from accuracy degradation due to delayed parameter updating. Synchronous SGD becomes communication intensive when the number of nodes increases regardless of its advantage. To address these issues, we introduce Layered SGD (LSGD), a new decentralized synchronous SGD algorithm. LSGD partitions computing resources into subgroups that each contain a communication layer (communicator) and a computation layer (worker). Each subgroup has centralized communication for parameter updates while communication between subgroups is handled by communicators. As a result, communication time is overlapped with I/O latency of workers. The efficiency of the algorithm is tested by training a deep network on the ImageNet classification task.


title: A Complete Language for Faceted Dataflow Programs

abstract: We present a complete categorical axiomatization of a wide class of dataflow programs. This gives a three-dimensional diagrammatic language for workflows, more expressive than the directed acyclic graphs generally used for this purpose. This calls for an implementation of these representations in data transformation tools.


title: Solutions of the Allen-Cahn equation on closed manifolds in the presence of symmetry

abstract: We prove that given a minimal hypersurface $\Gamma$ in a compact Riemannian manifold $M$ without boundary, if all the Jacobi fields of $\Gamma$ are generated by ambient isometries, then we can find solutions of the Allen-Cahn equation $-\varepsilon^2\Delta u +W'(u)=0$ on $M$, for sufficiently small $\varepsilon>0$, whose nodal sets converge to $\Gamma$. This extends the results of Pacard-Ritor\'e (in the case of closed manifolds and zero mean curvature).


title: Embedding Biomedical Ontologies by Jointly Encoding Network Structure and Textual Node Descriptors

abstract: Network Embedding (NE) methods, which map network nodes to low-dimensional feature vectors, have wide applications in network analysis and bioinformatics. Many existing NE methods rely only on network structure, overlooking other information associated with the nodes, e.g., text describing the nodes. Recent attempts to combine the two sources of information only consider local network structure. We extend NODE2VEC, a well-known NE method that considers broader network structure, to also consider textual node descriptors using recurrent neural encoders. Our method is evaluated on link prediction in two networks derived from UMLS. Experimental results demonstrate the effectiveness of the proposed approach compared to previous work.


title: Inclusive production of two rapidity-separated heavy quarks as a probe of BFKL dynamics

abstract: The inclusive photoproduction of two heavy quarks, separated by a large rapidity interval, is proposed as a new channel for the manifestation of the Balitsky-Fadin-Kuraev-Lipatov (BFKL) dynamics. The extension to the hadroproduction case is also discussed.


title: Kinetic energy functionals and the $N$-representability of the electron pair-density given by the classical map hyper-netted-chain (CHNC) method

abstract: The classical map hypernetted-chain (CHNC) method for interacting electrons uses a kinetic energy functional in the form of a classical-fluid temperature. Here we show that the CHNC generated two-body densities and pair-distribution functions (PDFs) correspond to $N$-representable densities. Comparisons of results from CHNC with quantum Monte Carlo (QMC) and Path Integral Monte Carlo (PIMC) are used to validate the CHNC results. Since the PDFs are sufficient to obtain the equation of state or linear-response properties of electron-ion systems, we apply the CHNC method for fully classical calculations of electron-ion systems in the quantum regime, using hydrogen at 4000K and 350 times the solid density as an example since QMC comparisons are available. We also present neutral pseudo-atom (NPA) calculations which use rigorous density-functional theory (DFT) to reduces the many nuclear problem to an effective one-ion problem. The CHNC PDFs and NPA results agree well with the ion-ion, electron-ion and electron-electron PDFs from QMC, PIMC, or DFT coupled to molecular dynamics simulations where available. The PDFs of a 2D electron-hole system at 5K are given as an example of 2D `warm dense' matter where the electrons and the counter particles (holes) are all in the quantum regime. Basic methods like QMC, PIMC or even DFT become prohibitive while CHNC methods, being independent of the number of particles or the temperature, prove to be easily deployable.


title: Asymptotic Structure for the Clique Density Theorem

abstract: The famous Erd\H{o}s-Rademacher problem asks for the smallest number of $r$-cliques in a graph with the given number of vertices and edges. Despite decades of active attempts, the asymptotic value of this extremal function for all $r$ was determined only recently, by Reiher [Annals of Mathematics, 184 (2016) 683--707]. Here we describe the asymptotic structure of all almost extremal graphs. This task for $r=3$ was previously accomplished by Pikhurko and Razborov [Combinatorics, Probability and Computing, 26 (2017) 138--160].


title: Water-Quenched Effects of 5 wt.% (Fe, Ti) particle-doped MgB$_2$ Superconductor and Low Limit of Pinning Effect

abstract: \begin{abstract} We have studied magnetic properties of water-quenched 5 wt.% (Fe, Ti) particle-doped MgB$_2$ comparing with that of air-cooled one. Generally, grain refinement is achieved by increasing cooling rate, which implies an increase of grainboundaries in the superconductor. Here we show that increased grainboundaries influence what kinds of effects on the field dependence of magnetization and what is the mechanism. As a result, they are served as a pinning center at a high field whereas they are served as a pathway to facilitate the movement of fluxes pinned on volume defects at a low field. As modeling grainboundaries in a superconductor, we explained that they had a flux pinning effect as well as the flux-penetrating promotion effect. As temperature increases, the pinning ability of a grainboundaries decreases, which was caused by increased coherence length. Stacking fault planes and twin boundaries have also been considered by using the model. It explained the reason for that stacking fault planes of MgB$_2$ do not have any pinning effect and the twin boundary of HTSC have the strong pinning or strong flux-penetration effect depending on the direction of the applied field.


title: Statistical Inference for Generative Models with Maximum Mean Discrepancy

abstract: While likelihood-based inference and its variants provide a statistically efficient and widely applicable approach to parametric inference, their application to models involving intractable likelihoods poses challenges. In this work, we study a class of minimum distance estimators for intractable generative models, that is, statistical models for which the likelihood is intractable, but simulation is cheap. The distance considered, maximum mean discrepancy (MMD), is defined through the embedding of probability measures into a reproducing kernel Hilbert space. We study the theoretical properties of these estimators, showing that they are consistent, asymptotically normal and robust to model misspecification. A main advantage of these estimators is the flexibility offered by the choice of kernel, which can be used to trade-off statistical efficiency and robustness. On the algorithmic side, we study the geometry induced by MMD on the parameter space and use this to introduce a novel natural gradient descent-like algorithm for efficient implementation of these estimators. We illustrate the relevance of our theoretical results on several classes of models including a discrete-time latent Markov process and two multivariate stochastic differential equation models.

categories: stat.ME cs.LG math.ST stat.CO stat.ML stat.TH


title: A Tight and Unified Analysis of Gradient-Based Methods for a Whole Spectrum of Games

abstract: We consider differentiable games where the goal is to find a Nash equilibrium. The machine learning community has recently started using variants of the gradient method (GD). Prime examples are extragradient (EG), the optimistic gradient method (OG) and consensus optimization (CO), which enjoy linear convergence in cases like bilinear games, where the standard GD fails. The full benefits of theses relatively new methods are not known as there is no unified analysis for both strongly monotone and bilinear games. We provide new analyses of the EG's local and global convergence properties and use is to get a tighter global convergence rate for OG and CO. Our analysis covers the whole range of settings between bilinear and strongly monotone games. It reveals that these methods converge via different mechanisms at these extremes; in between, it exploits the most favorable mechanism for the given problem. We then prove that EG achieves the optimal rate for a wide class of algorithms with any number of extrapolations. Our tight analysis of EG's convergence rate in games shows that, unlike in convex minimization, EG may be much faster than GD.


title: A universal route to pattern formation

abstract: Self-organization, the ability of a system of microscopically interacting entities to shape macroscopically ordered structures, is ubiquitous in Nature. Spatio-temporal patterns are abundantly observed in a large plethora of applications, encompassing different fields and scales. Examples of emerging patterns are the spots and stripes on the coat or skin of animals, the spatial distribution of vegetation in arid areas, the organization of the colonies of insects in host-parasitoid systems and the architecture of large complex ecosystems. Spatial self-organization can be described following the visionary intuition of Alan Turing, who showed how non-linear interactions between slow diffusing activators and fast diffusing inhibitors could induce patterns. The Turing instability, as the mechanism described is universally referred to, was raised to paradigm status in those realms of investigations where microscopic entities are subject to diffusion, from small biological systems to large ecosystems. Requiring a significant ratio of the assigned diffusion constants however is a stringent constraint, which limited the applicability of the theory. Building on the observation that spatial interactions are usually direction biased, and often strongly asymmetric, we here propose a novel framework for the generation of short wavelength patterns which overcomes the limitation inherent in the Turing formulation. In particular, we will prove that patterns can always set in when the system is composed by sufficiently many cells - the units of spatial patchiness - and for virtually any ratio of the diffusivities involved. Macroscopic patterns that follow the onset of the instability are robust and show oscillatory or steady-state behavior.


title: Temporal Transformer Networks: Joint Learning of Invariant and Discriminative Time Warping

abstract: Many time-series classification problems involve developing metrics that are invariant to temporal misalignment. In human activity analysis, temporal misalignment arises due to various reasons including differing initial phase, sensor sampling rates, and elastic time-warps due to subject-specific biomechanics. Past work in this area has only looked at reducing intra-class variability by elastic temporal alignment. In this paper, we propose a hybrid model-based and data-driven approach to learn warping functions that not just reduce intra-class variability, but also increase inter-class separation. We call this a temporal transformer network (TTN). TTN is an interpretable differentiable module, which can be easily integrated at the front end of a classification network. The module is capable of reducing intra-class variance by generating input-dependent warping functions which lead to rate-robust representations. At the same time, it increases inter-class variance by learning warping functions that are more discriminative. We show improvements over strong baselines in 3D action recognition on challenging datasets using the proposed framework. The improvements are especially pronounced when training sets are smaller.