title: Reflections on kernelizing and computing unrooted agreement forests

abstract: Phylogenetic trees are leaf-labelled trees used to model the evolution of species. Here we explore the practical impact of kernelization (i.e. data reduction) on the NP-hard problem of computing the TBR distance between two unrooted binary phylogenetic trees. This problem is better-known in the literature as the maximum agreement forest problem, where the goal is to partition the two trees into a minimum number of common, non-overlapping subtrees. We have implemented two well-known reduction rules, the subtree and chain reduction, and five more recent, theoretically stronger reduction rules, and compare the reduction achieved with and without the stronger rules. We find that the new rules yield smaller reduced instances and thus have clear practical added value. In many cases they also cause the TBR distance to decrease in a controlled fashion. Next, we compare the achieved reduction to the known worst-case theoretical bounds of 15k-9 and 11k-9 respectively, on the number of leaves of the two reduced trees, where k is the TBR distance, observing in both cases a far larger reduction in practice. As a by-product of our experimental framework we obtain a number of new insights into the actual computation of TBR distance. We find, for example, that very strong lower bounds on TBR distance can be obtained efficiently by randomly sampling certain carefully constructed partitions of the leaf labels, and identify instances which seem particularly challenging to solve exactly. The reduction rules have been implemented within our new solver Tubro which combines kernelization with an Integer Linear Programming (ILP) approach. Tubro also incorporates a number of additional features, such as a cluster reduction and a practical upper-bounding heuristic, and it can leverage combinatorial insights emerging from the proofs of correctness of the reduction rules to simplify the ILP.


title: Controllable Optical Resonances and Unidirectional Scattering by Core-shell Nanoparticles

abstract: Nanoparticles supporting a distinct series of Mie resonances have enabled a new class of nanoantennas and provide efficient ways to manipulate light at the nanoscale. The ability to flexibly tune the optical resonances and scattering directionality are particularly essential for various applications ranging from biosensing to nanolasers. In this paper, we investigate the core-shell nanoparticles that support both electric and magnetic Mie resonances and for the first time systematically reveal the mode evolution from a pure high-index dielectric nanosphere to a pure plasmonic one, where it has a sudden transition when core-shell ratio increases from 0.4 to 0.5. Furthermore, by engineering the electric and magnetic resonances, we demonstrate the unidirectional forward and backward scattering in such a system and reveal its tunability via geometric tuning.


title: HR-Depth: High Resolution Self-Supervised Monocular Depth Estimation

abstract: Self-supervised learning shows great potential in monoculardepth estimation, using image sequences as the only source ofsupervision. Although people try to use the high-resolutionimage for depth estimation, the accuracy of prediction hasnot been significantly improved. In this work, we find thecore reason comes from the inaccurate depth estimation inlarge gradient regions, making the bilinear interpolation er-ror gradually disappear as the resolution increases. To obtainmore accurate depth estimation in large gradient regions, itis necessary to obtain high-resolution features with spatialand semantic information. Therefore, we present an improvedDepthNet, HR-Depth, with two effective strategies: (1) re-design the skip-connection in DepthNet to get better high-resolution features and (2) propose feature fusion Squeeze-and-Excitation(fSE) module to fuse feature more efficiently.Using Resnet-18 as the encoder, HR-Depth surpasses all pre-vious state-of-the-art(SoTA) methods with the least param-eters at both high and low resolution. Moreover, previousstate-of-the-art methods are based on fairly complex and deepnetworks with a mass of parameters which limits their realapplications. Thus we also construct a lightweight networkwhich uses MobileNetV3 as encoder. Experiments show thatthe lightweight network can perform on par with many largemodels like Monodepth2 at high-resolution with only20%parameters. All codes and models will be available at https://github.com/shawLyu/HR-Depth.


title: Probing the star formation origin of gamma rays from 3FHL J1907.0+0713

abstract: Star-forming (SF) regions embedded inside giant molecular clouds (GMCs) are potential contributors to Galactic gamma rays. The gamma-ray source 3FHL J1907.0+0713 is detected with a significance of roughly 13$\sigma$ in the 0.2 $-$ 300 GeV energy range after the removal of gamma-ray pulsation periods of PSR J1906+0722 from the Fermi-LAT data set of about 10 years. The energy spectrum of 3FHL J1907.0+0713 is best-fitted to a power law model with a spectral index of 2.26 $\pm$ 0.05. The CO($J$ = 1$-$0) data taken by NANTEN2 revealed that 3FHL J1907.0+0713 is overlapping with a GMC having a peak velocity of about 38 km s$^{-1}$. The best-fitting location of 3FHL J1907.0+0713 is measured to be approximately 0.13 degrees away from the Galactic supernova remnant (SNR) 3C 397 and it overlaps with a star that is associated with a bow-shock nebula. We show that there is no physical connection between 3FHL J1907.0+0713, 3C 397, as well as any positional coincidence with the pulsar. The spectrum of 3FHL J1907.0+0713 is fitting to both hadronic and leptonic gamma-ray emission models and the total luminosity at a distance of 2.6 kpc is calculated to be 1.1 $\times$ 10$^{34}$ erg s$^{-1}$. We also discuss possible SF origins of gamma rays from 3FHL J1907.0+0713, where SNRs, massive protostar outflows, stellar winds from runaway stars, colliding wind binaries, and young stellar clusters are considered as candidate sources.


title: Quantum torsion and a Hartle-Hawking "beam''

abstract: In the Einstein-Cartan framework the torsion-free conditions arise within the Hamiltonian treatment as second-class constraints. The standard strategy is to solve these constraints, eliminating the torsion from the classical theory, before quantization. Here we advocate leaving the torsion inside the other constraints before quantization, leading at first to wave functions that can be called ``kinematical'' with regards to the torsion, but not the other constraints. The torsion-free condition can then be imposed as a condition upon the physical wave packets one constructs, satisfying the usual uncertainty relations, and so with room for quantum fluctuations in the torsion. This alternative strategy has the surprising effect of clarifying the sense in which the wave functions solving an explicitly real theory are ``delta-function normalizable''. Such solutions with zero (or any fixed) torsion, should be interpreted as plane waves in torsion space. Properly constructed wave packets are therefore normalizable in the standard sense. Given that they are canonical duals, this statement applies equally well to the Chern-Simons state (connection representation) and the Hartle-Hawking wave function (metric representation). We show how, when torsion is taken into account, the Hartle-Hawking wave function is replaced by a Gauss-Airy function, with finite norm, which we call the Hartle-Hawking beam. The Chern-Simons state, instead, becomes a packet with a Gaussian probability distribution in connection space. We conclude the paper with two sections explaining how to generalize these results beyond minisuperspace.


title: The scalar potential of the 331 model: theoretical constraints

abstract: We discuss the main features of the scalar sector of a class of BSM models with enlarged gauge symmetry, the so called 331 Models. The theoretical constraints on the scalar potential such as unitarity, perturbativity and boundedness-from-below, are presented, together with the analytical exact digitalization of the scalar sector. The phenomenology of exotic scenarios predicted by the 331 Models can be tested in light of these theoretical constraints.


title: Measurement of the Born cross sections for $e^+e^- \to \eta^\prime \pi^{+}\pi^{-}$ at center-of-mass energies between $2.00$ and $3.08$ GeV

abstract: The Born cross sections for the process $e^+e^- \to \eta^\prime \pi^{+}\pi^{-}$ at different center-of-mass energies between $2.00$ and $3.08$ GeV are reported with improved precision from an analysis of data samples collected with the BESIII detector operating at the BEPCII storage ring. An obvious structure is observed in the Born cross section line shape. Fit as a Breit-Wigner resonance, it has a statistical significance of $6.3\sigma$ and a mass and width of $M=(2111\pm43\pm25)$~MeV/$c^2$ and $\Gamma=(135\pm34\pm30)$~MeV, where the uncertainties are statistical and systematic, respectively. These measured resonance parameters agree with the measurements of BABAR in $e^+e^- \to \eta^\prime \pi^{+}\pi^{-}$ and BESIII in $e^+e^- \to \omega\pi^0$ within two standard deviations.


title: Von Staudt Constructions for Skew-Linear and Multilinear Matroids

abstract: This paper compares skew-linear and multilinear matroid representations. These are matroids that are representable over division rings and (roughly speaking) invertible matrices, respectively. The main tool is the von Staudt construction, by which we translate our problems to algebra. After giving an exposition of a simple variant of the von Staudt construction we present the following results: $\bullet$ Undecidability of several matroid representation problems over division rings. $\bullet$ An example of a matroid with an infinite multilinear characteristic set, but which is not multilinear in characteristic $0$. $\bullet$ An example of a skew-linear matroid that is not multilinear.


title: Roles of Blackbody Friction Forces in the Rb and Cs Atom Interferometers

abstract: Atom interferometry is amongst the most advanced technologies that provides very high-precision measurements. There can exist a number of obscure forces that can interfere with the atoms used in this instrument. In the present work, we are probing possible roles of one such important forces, known as ``blackbody friction force (BBFF)'', that may affect the precisions in the measurements made using atom interferometers based on the Rb and Cs atoms. The BBFF can be generated on atoms due to the black-body radiations emitted by the stray electromagnetic fields present in the experimental set-up and other metallic shielding. The strength of the BBFF can be calculated by integrating the complex parts of the dynamic polarizabilities of atoms, which show varying behaviour at the resonant and non-resonant transitions in the above atoms. Our analyses suggest that the off-resonant atomic transitions make significant contributions to the BBFF at low temperatures in the Rb and Cs atom interferometers. Present study also advocates that it is imperative to carry out the integration over a wide spectrum of frequencies for correct evaluation of the BBFF; specially at higher temperatures.


title: Outlier-Robust Optimal Transport

abstract: Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning. Despite their prevalence and advantages, OT loss functions can be extremely sensitive to outliers. In fact, a single adversarially-picked outlier can increase the standard $W_2$-distance arbitrarily. To address this issue, we propose an outlier-robust formulation of OT. Our formulation is convex but challenging to scale at a first glance. Our main contribution is deriving an \emph{equivalent} formulation based on cost truncation that is easy to incorporate into modern algorithms for computational OT. We demonstrate the benefits of our formulation in mean estimation problems under the Huber contamination model in simulations and outlier detection tasks on real data.


title: On Some Fractional order Binomial sequence spaces with infinite Matrices

abstract: The main purpose of this article is to introduce some new binomial difference sequence spaces of fractional order ${\tilde{\alpha}} $ along with infinite matrices. Some topological properties of these spaces are considered along with the Schauder basis and ${\alpha} -,\beta -$ and $\gamma -$duals of the spaces.


title: The trivial fiber topology and framed motives over the integers

abstract: This paper introduces the trivial fiber topology on schemes. For one-dimensional base schemes, we use it to describe fibrant replacements in the stable motivic homotopy category and motivic infinite loop spaces. We also extend the Garkusha-Panin and Voevodsky strict $\mathbb{A}^{1}$-invariance theorems to one-dimensional base schemes. The trivial fiber topology plays a central role in the proof of refined localization results for motivic homotopy categories. Moreover, we extend Morel's $\mathbb{A}^{1}$-connectivity theorem on Nisnevich sheaves of stable motivic homotopy groups. These results open new vistas for computations of motivic invariants over deeper base schemes of arithmetic interest.


title: Long-range Josephson effect controlled by temperature gradient and circuit topology

abstract: We demonstrate that the supercurrent can be strongly enhanced in cross-like superconducting hybrid nanostructures (X-junctions) exposed to a temperature gradient. At temperatures T exceeding the Thouless energy of our X-junction the Josephson current decays algebraically with increasing T and can be further enhanced by a proper choice of the circuit topology. At large values of the temperature gradient the non-equilibrium contribution to the supercurrent may become as large as the equilibrium one at low T. We also predict a variety of transitions between 0- and $\pi$-junction states controlled by the temperature gradient as well as by the system geometry. Our predictions can be directly verified in modern experiments.


title: Simulations of stray light from the surface scattering of the Solar Corona Imager primary mirror

abstract: The Solar Corona Imager is an internally occulted coronagraph on board the ASO-S mission, which has the advantage of imaging the inner corona in H I {Lyman-\textalpha} (Ly-alpha) and white-light (WL) wavebands. However, scattering of solar disk light by the primary mirror (M1) becomes the main source of stray light. To study the methods of stray light suppression, three scattering models are used to model M1 scattering in Zemax OpticStudio. The ratio of coronal emission to predicted stray light decrease along field of view in both channels. The stray light in Ly-alpha channel is generally lower than coronal emission, but the stray light in WL channel tends to be one order of magnitude higher than coronal signal at 2.5 Rsun. Optimized parameter combinations that suppress the stray light to required level are obtained, which put some limitations on the M1 manufacture. Besides, K-correlation model is recommended to simulate surface scattering.


title: Effective Algorithms for Optimal Portfolio Deleveraging Problem with Cross Impact

abstract: We investigate the optimal portfolio deleveraging (OPD) problem with permanent and temporary price impacts, where the objective is to maximize equity while meeting a prescribed debt/equity requirement. We take the real situation with cross impact among different assets into consideration. The resulting problem is, however, a non-convex quadratic program with a quadratic constraint and a box constraint, which is known to be NP-hard. In this paper, we first develop a successive convex optimization (SCO) approach for solving the OPD problem and show that the SCO algorithm converges to a KKT point of its transformed problem. Second, we propose an effective global algorithm for the OPD problem, which integrates the SCO method, simple convex relaxation and a branch-and-bound framework, to identify a global optimal solution to the OPD problem within a pre-specified $\epsilon$-tolerance. We establish the global convergence of our algorithm and estimate its complexity. We also conduct numerical experiments to demonstrate the effectiveness of our proposed algorithms with both the real data and the randomly generated medium- and large-scale OPD problem instances.


title: Learning for MPC with Stability & Safety Guarantees

abstract: The combination of learning methods with Model Predictive Control (MPC) has attracted a significant amount of attention in the recent literature. The hope of this combination is to reduce the reliance of MPC schemes on accurate models, and to tap into the fast developing machine learning and reinforcement learning tools to exploit the growing amount of data available for many systems. In particular, the combination of reinforcement learning and MPC has been proposed as a viable and theoretically justified approach to introduce explainable, safe and stable policies in reinforcement learning. However, a formal theory detailing how the safety and stability of an MPC-based policy can be maintained through the parameter updates delivered by the learning tools is still lacking. This paper addresses this gap. The theory is developed for the generic Robust MPC case, and applied in simulation in the robust tube-based linear MPC case, where the theory is fairly easy to deploy in practice. The paper focuses on Reinforcement Learning as a learning tool, but it applies to any learning method that updates the MPC parameters online.


title: The Faddeev-Reshetikhin model from a 4D Chern-Simons theory

abstract: We derive the Faddeev-Reshetikhin (FR) model from a four-dimensional Chern- Simons theory with two order surface defects by following the work by Costello and Yamazaki [arXiv:1908.02289]. Then we present a trigonometric deformation of the FR model by employing a boundary condition with an R-operator of Drinfeld-Jimbo type. This is a generalization of the work by Delduc, Lacroix, Magro and Vicedo [arXiv:1909.13824] from the disorder surface defect case to the order one.


title: Incremental Treatments of the Full Configuration Interaction Problem

abstract: The recent many-body expanded full configuration interaction (MBE-FCI) method is reviewed by critically assessing its advantages and drawbacks in the context of contemporary near-exact electronic structure theory. Besides providing a succinct summary of the history of MBE-FCI to date within a generalized and unified theoretical setting, its finer algorithmic details are discussed alongside our optimized computational implementation of the theory. A selected few of the most recent applications of MBE-FCI are revisited, before we close by outlining its future research directions as well as its place among modern near-exact wave function-based methods.


title: Disentangled Information Bottleneck

abstract: The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms. However, the IB Lagrangian is hard to optimize, and multiple trials for tuning values of Lagrangian multiplier are required. Moreover, we show that the prediction performance strictly decreases as the compression gets stronger during optimizing the IB Lagrangian. In this paper, we implement the IB method from the perspective of supervised disentangling. Specifically, we introduce Disentangled Information Bottleneck (DisenIB) that is consistent on compressing source maximally without target prediction performance loss (maximum compression). Theoretical and experimental results demonstrate that our method is consistent on maximum compression, and performs well in terms of generalization, robustness to adversarial attack, out-of-distribution detection, and supervised disentangling.


title: Intensity mapping of post-reionization 21-cm signal and its cross-correlations as a probe of $f(R)$ gravity

abstract: We propose the intensity mapping of the redshifted HI 21-cm signal from the post-reionization epoch as a cosmological probe of $f(R)$ gravity. We consider the Hu-Sawicki class of $f(R)$ gravity models characterized by a single parameter $f_{,R0}$. The $f(R)$ modification to gravity affects the post-reionization $21$-cm power spectrum through the change in the growth rate of density fluctuations. We find that a radio interferometric observation with a SKA1-Mid like radio telescope in both auto-correlation and cross-correlation with galaxy weak-lensing and Ly-$\alpha$ forest may distinguish $f(R)$ models from $LCDM$ cosmology at a precision which is competitive with other probes of $f(R)$ gravity.


title: Quantum phase transition in a non-Hermitian XY spin chain with global complex transverse field

abstract: In this work, we investigate the quantum phase transition in a non-Hermitian XY spin chain. The phase diagram shows that the critical points of Ising phase transition expand into a critical transition zone after introducing a non-Hermitian effect. By analyzing the non-Hermitian gap and long-range correlation function, one can distinguish different phases by means of different gap features and decay properties of correlation function, a tricky problem in traditional XY model. Furthermore, the results reveal the relationship among different regions of the phase diagram, non-Hermitian energy gap and long-range correlation function.


title: Hamiltonian chromatic number of trees

abstract: Let $G$ be a simple finite connected graph of order $n$. The detour distance between two distinct vertices $u$ and $v$ denoted by $D(u,v)$ is the length of a longest $uv$-path in $G$. A hamiltonian coloring $h$ of a graph $G$ of order $n$ is a mapping $h : V(G) \rightarrow \{0,1,2,...\}$ such that $D(u,v) + |h(u)-h(v)| \geq n-1$, for every two distinct vertices $u$ and $v$ of $G$. The span of $h$, denoted by $span(h)$, is $\max\{|h(u)-h(v)| : u, v \in V(G)\}$. The hamiltonian chromatic number of $G$ is defined as $hc(G) := \min\{span(h)\}$ with minimum taken over all hamiltonian coloring $h$ of $G$. In this paper, we give an improved lower bound for the hamiltonian chromatic number of trees and give a necessary and sufficient condition to achieve the improved lower bound. Using this result, we determine the hamiltonian chromatic number of two families of trees.


title: Observer-Based Adaptive Scheme for Fixed-Time Frequency Estimation of Biased Sinusoidal Signals

abstract: In this technical communique, we propose a novel observer-based adaptive scheme to deal with the parameter estimation problem of biased sinusoidal signals. Different from the existing adaptive frequency estimation scheme, the proposed scheme can achieve fixed-time frequency estimation, whose convergence time is independent of the initial errors. Simulation example with different initial values shows the effectiveness of the theoretical result.


title: A Virgo Environmental Survey Tracing Ionised Gas Emission (VESTIGE).IX. The effects of ram pressure stripping down to the scale of individual HII regions in the dwarf galaxy IC 3476

abstract: We study the IB(s)m galaxy IC 3476 observed in the context of VESTIGE, a blind narrow-band Halpha+[NII] imaging survey of the Virgo cluster. The deep narrow-band (NB) image reveals a very pertubed ionised gas distribution, characterised by a prominent banana-shaped structure in the front of the galaxy formed of giant HII regions crossing the stellar disc, with star forming structures at ~8 kpc from the edges of the stellar disc, detected also in a deep FUV ASTROSAT/UVIT image. This particular morphology indicates that the galaxy is undergoing an almost edge-on ram pressure stripping event. The NB image also shows that the star formation activity is totally quenched in the leading edge of the disc, where the gas has been removed during the interaction. The SED fitting analysis indicates that this quenching episode is very recent (~50 Myr), and roughly corresponds to an increase of the star formation activity in the inner regions with respect to what expected for secular evolution. The analysis of these data, whose angular resolution allows the study of the induced effects of the perturbation down to the scale of individual HII regions, also suggests that the increase of the star formation activity is due to the compression of the gas along the stellar disc of the galaxy, which is able to increase its mean electron density and boost the star formation process producing bright HII regions. The hydrodynamic interaction has deeply perturbed the velocity field of the ionised gas component while leaving unaffected that of the stellar disc. The comparison of the data with hydrodynamic simulations accounting for the different gas phases (atomic, molecular, ionised) consistently indicates that the perturbing event is very recent, once again confirming that ram pressure stripping is a violent phenomenon able to perturb on short timescales the evolution of galaxies in rich environments.


title: Exact real-time longitudinal correlation functions of the massive XXZ chain

abstract: We apply the recently developed thermal form factor expansion method to evaluate the real-time longitudinal spin-spin correlation functions of the spin-$\frac{1}{2}$ XXZ chain in the antiferromagnetically ordered regime at temperature $T=0$. An analytical result containing all types of excitations in the model is obtained, without any approximations. This allows for the accurate calculation of the real-time correlation functions in this strongly interacting quantum system for arbitrary distances and times.

categories: cond-mat.stat-mech hep-th math-ph math.MP nlin.SI


title: Generating Math Word Problems from Equations with Topic Controlling and Commonsense Enforcement

abstract: Recent years have seen significant advancement in text generation tasks with the help of neural language models. However, there exists a challenging task: generating math problem text based on mathematical equations, which has made little progress so far. In this paper, we present a novel equation-to-problem text generation model. In our model, 1) we propose a flexible scheme to effectively encode math equations, we then enhance the equation encoder by a Varitional Autoen-coder (VAE) 2) given a math equation, we perform topic selection, followed by which a dynamic topic memory mechanism is introduced to restrict the topic distribution of the generator 3) to avoid commonsense violation in traditional generation model, we pretrain word embedding with background knowledge graph (KG), and we link decoded words to related words in KG, targeted at injecting background knowledge into our model. We evaluate our model through both automatic metrices and human evaluation, experiments demonstrate our model outperforms baseline and previous models in both accuracy and richness of generated problem text.


title: Automatic Property-based Testing of GraphQL APIs

abstract: In recent years, GraphQL has become a popular way to expose web APIs. With its raise of adoption in industry, the quality of GraphQL APIs must be also assessed, as with any part of a software system, and preferably in an automated manner. However, there is currently a lack of methods to automatically generate tests to exercise GraphQL APIs. In this paper, we propose a method for automatically producing GraphQL queries to test GraphQL APIs. This is achieved using a property-based approach to create a generator for queries based on the GraphQL schema of the system under test. Our evaluation on a real world software system shows that this approach is both effective, in terms of finding real bugs, and efficient, as a complete schema can be covered in seconds. In addition, we evaluate the fault finding capability of the method when seeding known faults. 73% of the seeded faults where found, with room for improvements with regards to domain specific behavior, a common oracle challenge in automatic test generation.


title: Influence-Driven Data Poisoning in Graph-Based Semi-Supervised Classifiers

abstract: Graph-based Semi-Supervised Learning (GSSL) is a practical solution to learn from a limited amount of labelled data together with a vast amount of unlabelled data. However, due to their reliance on the known labels to infer the unknown labels, these algorithms are sensitive to data quality. It is therefore essential to study the potential threats related to the labelled data, more specifically, label poisoning. In this paper, we propose a novel data poisoning method which efficiently approximates the result of label inference to identify the inputs which, if poisoned, would produce the highest number of incorrectly inferred labels. We extensively evaluate our approach on three classification problems under 24 different experimental settings each. Compared to the state of the art, our influence-driven attack produces an average increase of error rate 50\% higher, while being faster by multiple orders of magnitude. Moreover, our method can inform engineers of inputs that deserve investigation (relabelling them) before training the learning model. We show that relabelling one-third of the poisoned inputs (selected based on their influence) reduces the poisoning effect by 50\%.


title: Antiferromagnetic fluctuations in the one-dimensional Hubbard model

abstract: We study the low-temperature critical behavior of the one-dimensional Hubbard model near half filling caused by enhanced antiferromagnetic fluctuations. We use a mean-field-type approximation with a two-particle self-consistency renormalizing the bare interaction. It allows us to control a transition from high to low temperatures as well as from weak to strong-coupling. We show that there is a crossover temperature $T_{0}= t\exp\{-1/U\rho(0)\}$ for arbitrary interaction $U>0$ and the bare density of states at the Fermi energy $\rho(0)>0$. The solution at lower temperatures goes over to strong coupling and approaches a quantum critical point with the diverging staggered susceptibility and a gap in the excitation spectrum at zero temperature.


title: Federated Learning under Importance Sampling

abstract: Federated learning encapsulates distributed learning strategies that are managed by a central unit. Since it relies on using a selected number of agents at each iteration, and since each agent, in turn, taps into its local data, it is only natural to study optimal sampling policies for selecting agents and their data in federated learning implementations. Usually, only uniform sampling schemes are used. However, in this work, we examine the effect of importance sampling and devise schemes for sampling agents and data non-uniformly guided by a performance measure. We find that in schemes involving sampling without replacement, the performance of the resulting architecture is controlled by two factors related to data variability at each agent, and model variability across agents. We illustrate the theoretical findings with experiments on simulated and real data and show the improvement in performance that results from the proposed strategies.


title: Mapping Diffuse Emission in Lyman UV band

abstract: The CAFE (Census of warm-hot intergalactic medium, Accretion, and Feedback Explorer) and LyRIC (Lyman UV Radiation from Interstellar medium and Circum-galactic medium) have been proposed to the space agencies in China respectively. CAFE was first proposed in 2015 as a joint scientific CAS-ESA small space mission. LyRIC was proposed in 2019 as an independent external payload operating on the Chinese Space Station. Both missions are dedicated to mapping the Lyman UV emission (ionized oxygen (O VI) resonance lines at 103.2 and 103.8 nm, and Lyman series) for the diffuse sources in our Galaxy and the circum-galactic mediums of the nearby galaxies. We present the primary science objectives, mission concepts, the enabling technologies, as well as the current status.


title: Model-assisted estimation in high-dimensional settings for survey data

abstract: Model-assisted estimators have attracted a lot of attention in the last three decades. These estimators attempt to make an efficient use of auxiliary information available at the estimation stage. A working model linking the survey variable to the auxiliary variables is specified and fitted on the sample data to obtain a set of predictions, which are then incorporated in the estimation procedures. A nice feature of model-assisted procedures is that they maintain important design properties such as consistency and asymptotic unbiasedness irrespective of whether or not the working model is correctly specified. In this article, we examine several model-assisted estimators from a design-based point of view and in a high-dimensional setting, including penalized estimators and tree-based estimators. We conduct an extensive simulation study using data from the Irish Commission for Energy Regulation Smart Metering Project, in order to assess the performance of several model-assisted estimators in terms of bias and efficiency in this high-dimensional data set.


title: Phase Retrieval with Holography and Untrained Priors: Tackling the Challenges of Low-Photon Nanoscale Imaging

abstract: Phase retrieval is the inverse problem of recovering a signal from magnitude-only Fourier measurements, and underlies numerous imaging modalities, such as Coherent Diffraction Imaging (CDI). A variant of this setup, known as holography, includes a reference object that is placed adjacent to the specimen of interest before measurements are collected. The resulting inverse problem, known as holographic phase retrieval, is well-known to have improved problem conditioning relative to the original. This innovation, i.e. Holographic CDI, becomes crucial at the nanoscale, where imaging specimens such as viruses, proteins, and crystals require low-photon measurements. This data is highly corrupted by Poisson shot noise, and often lacks low-frequency content as well. In this work, we introduce a dataset-free deep learning framework for holographic phase retrieval adapted to these challenges. The key ingredients of our approach are the explicit and flexible incorporation of the physical forward model into an automatic differentiation procedure, the Poisson log-likelihood objective function, and an optional untrained deep image prior. We perform extensive evaluation under realistic conditions. Compared to competing classical methods, our method recovers signal from higher noise levels and is more resilient to suboptimal reference design, as well as to large missing regions of low frequencies in the observations. Finally, we show that these properties carry over to experimental data acquired on optical wavelengths. To the best of our knowledge, this is the first work to consider a dataset-free machine learning approach for holographic phase retrieval.


title: A comparison of self-supervised speech representations as input features for unsupervised acoustic word embeddings

abstract: Many speech processing tasks involve measuring the acoustic similarity between speech segments. Acoustic word embeddings (AWE) allow for efficient comparisons by mapping speech segments of arbitrary duration to fixed-dimensional vectors. For zero-resource speech processing, where unlabelled speech is the only available resource, some of the best AWE approaches rely on weak top-down constraints in the form of automatically discovered word-like segments. Rather than learning embeddings at the segment level, another line of zero-resource research has looked at representation learning at the short-time frame level. Recent approaches include self-supervised predictive coding and correspondence autoencoder (CAE) models. In this paper we consider whether these frame-level features are beneficial when used as inputs for training to an unsupervised AWE model. We compare frame-level features from contrastive predictive coding (CPC), autoregressive predictive coding and a CAE to conventional MFCCs. These are used as inputs to a recurrent CAE-based AWE model. In a word discrimination task on English and Xitsonga data, all three representation learning approaches outperform MFCCs, with CPC consistently showing the biggest improvement. In cross-lingual experiments we find that CPC features trained on English can also be transferred to Xitsonga.


title: Fiber Nonlinearity Mitigation by Short-Length Probabilistic Constellation Shaping for Pilot-Aided Signaling

abstract: Probabilistic constellation shaping (PCS) offers a significant performance improvement over uniform signaling. It was recently discovered that long blocks are not required to achieve maximum shaping gain when transmitting over the nonlinear fiber channel because short-length PCS effectively mitigates fiber nonlinear interference (NLI). The reason for this behavior is that short-length PCS implicitly induces some temporal properties in the shaped transmit sequence that are beneficial for the fiber-optic channel. To achieve robust data-aided digital signal processing of high-order QAM, periodic quaternary phase shift keying pilots are typically inserted into the high-order QAM transmit sequence. In this work, we investigate in simulations the effect of such pilot-aided signaling on NLI mitigation. Albeit modifying the temporal properties of the shaped transmit sequence, a pilot rate of 1/32 is found to not alter the beneficial effects of short-length PCS. The operation meaning of this finding is that even with pilot-aided signaling, long PCS block lengths are not required for maximum shaping gain.


title: Holographic MIMO Communications Under Spatially-Stationary Scattering

abstract: Holographic MIMO is a spatially-constrained MIMO system with a massive number of antennas, possibly thought of, in its ultimate form, as a spatially-continuous electromagnetic aperture. Accurate and tractable channel modeling is critical to understanding the full potential of this technology. This paper considers arbitrary spatially-stationary scattering and provides a 4D plane-wave representation in Cartesian coordinates, which captures the essence of electromagnetic propagation and allows to evaluate the capacity of Holographic MIMO systems with rectangular volumetric arrays. The developed framework generalizes the virtual channel representation, which was originally developed for uniform linear arrays.


title: Preferential attachment with fitness dependent choice

abstract: We study the asymptotic behavior of the maximum degree in the evolving tree model with a choice based on both degree and fitness of a vertex. The tree is constructed in the following recursive way. Each vertex is assigned a parameter to it that is called a fitness of a vertex. We start from two vertices and an edge between them. On each step we consider a sample with repetition of $d$ vertices, chosen with probabilities proportional to their degrees plus some parameter $\beta>-1$. Then we add a new vertex and draw an edge from it to the vertex from the sample with the highest product of fitness and degree. We prove that dependent on parameters of the model, the maximum degree could exhibit three types of asymptotic behavior: sublinear, linear and of $n/\ln n$ order, where $n$ is the number of edges in the graph.


title: Measure-valued solutions to the stochastic compressible Euler equations and incompressible limits

abstract: We introduce a new concept of dissipative measure-valued martingale solutions to the stochastic compressible Euler equations. These solutions are weak in the probabilistic sense i.e., the probability space and the driving Wiener process are an integral part of the solution. We derive the relative energy inequality for the stochastic compressible Euler equations and, as a corollary, we exhibit pathwise weak-strong uniqueness principle. Moreover, making use of the relative energy inequality, we investigate the low Mach limit (incompressible limit) of the underlying system of equations. As a main novelty with respect to the related literature, our results apply to general nonlinear multiplicative stochastic perturbations of Nemytskij type.


title: Effective Non-Minimal Quadratic Gravity and the Classical Cut-Off

abstract: In this paper we consider Quadratic Gravity as a low energy effective field theory of some unknown UV-complete theory of gravity. Using the spin-2 ghost pathology that occurs in Quadratic Gravity, we derive maximum value for the classical cut-off of the low energy effective field theory in various configurations. We then add on higher order, bottom-up, effective terms. At each order we allow the introduction of non-minimally coupled scalar field terms, and we calculate the vacuum expectation value of the theory under an assumed $\mathbb{Z}_2$ symmetry breaking of the scalar field. This symmetry breaking leads us to introduce a constant in the action which is required to ensure that the physical spin-2 degree of freedom is massless in the flat space approximation, an implicit assumption we make throughout the work. We then consider the case in which we do not fine tune the introduced constant, which leads to an (Anti-)de Sitter solution about which we can then expand. The sign of the chosen cosmological constant is the major factor in determining whether the geometry is de Sitter or Anti-de Sitter. Then expanding about this geometry allows us to increase the theoretical classical cut-off as compared to the flat space case by an amount that is proportional to the free cosmological constant parameter.


title: Direct simulation of aerodynamic entrainment with inter-particle cohesions

abstract: Aerodynamic entrainment acts as the pioneer of saltation movement and is critical for understanding the development of aeolian phenomena. Here we performed direct numerical simulations on the aerodynamic lifting of surface particles on a random arranged sediment bed using the discrete element method, and provided evidence that particles do not leave the bed vertically with speeds equal to that needed to reach a height of one grain diameter, as people widely accepted, but with much smaller angles toward the bed surface and much larger velocities. The entrainment rate does not exhibit a quadratic dependence with the shear velocity, but a nearly linear one, because the velocity of entrained particle increases linearly with shear velocity. Moreover, inter-particle cohesion increases the fluid entrainment threshold significantly, but has no effect on the entrainment rate, as well as the take-off velocity and angle distributions of entrained particles, because the collisions between entrained and bed particles destroy the inter-particle bonds. The completely entrainment scheme is given, which provides a credible approach to explore the development and evolution of aeolian transports.


title: Transverse motions in sunspot super-penumbral fibrils

abstract: Sunspots have played a key role in aiding our understanding of magnetohydrodynamic (MHD) wave phenomenon in the Sun's atmosphere, and it is well known they demonstrate a number of wave phenomenon associated with slow MHD modes. Recent studies have shown that transverse wave modes are present throughout the majority of the chromosphere. Using high-resolution Ca II 8542 {\AA} observations from the Swedish Solar Telescope, we provide the first demonstration that the chromospheric super-penumbral fibrils, which span out from the sunspot, also show ubiquitous transverse motions. We interpret these motions as transverse waves, in particular the MHD kink mode. We compile the statistical properties of over 2000 transverse motions to find distributions for periods and amplitudes, finding they are broadly consistent with previous observations of chromospheric transverse waves in quiet Sun fibrils. The very presence of the waves in super-penumbral fibrils raises important questions about how they are generated, and could have implications for our understanding of how MHD wave energy is transferred through the atmosphere of a sunspot.


title: The mass-energy equivalence and length contraction are consistent with compression of a fluidic aether with a speed of sound equal to the speed of light

abstract: The Lorentz aether theory was the mathematically equivalent precursor to the special theory of relativity (SR). It assumed the existence of a static aether filling space in which particles are affected by the Lorentz factor for length contraction to explain the null result of the Michelson-Morley experiment. However, it was early abandoned in favour of SR due to the apparent arbitrary introduction of the Lorentz factor. The aether has thereafter been assumed not to exist as it is seemingly undetectable and not needed for the SR. In this discussion paper it is argued that this reasoning to reject the aether is unfounded since the Lorentz factor also appears as an increased resistance term in fluid dynamics when the speed of sound is approached. This means that, for example, particle accelerator tests of the Lorentz factor can be interpreted as a form of detection of a fluidic aether. Furthermore, it is shown that the mass-energy equivalence is identical to the energy for compression of a fluid with the speed of sound equal to the speed of light. It is thus possible that the aether not only exists but that it also is the matter all particles are made of.


title: Towards localisation of keywords in speech using weak supervision

abstract: Developments in weakly supervised and self-supervised models could enable speech technology in low-resource settings where full transcriptions are not available. We consider whether keyword localisation is possible using two forms of weak supervision where location information is not provided explicitly. In the first, only the presence or absence of a word is indicated, i.e. a bag-of-words (BoW) labelling. In the second, visual context is provided in the form of an image paired with an unlabelled utterance; a model then needs to be trained in a self-supervised fashion using the paired data. For keyword localisation, we adapt a saliency-based method typically used in the vision domain. We compare this to an existing technique that performs localisation as a part of the network architecture. While the saliency-based method is more flexible (it can be applied without architectural restrictions), we identify a critical limitation when using it for keyword localisation. Of the two forms of supervision, the visually trained model performs worse than the BoW-trained model. We show qualitatively that the visually trained model sometimes locate semantically related words, but this is not consistent. While our results show that there is some signal allowing for localisation, it also calls for other localisation methods better matched to these forms of weak supervision.


title: Molecular graph generation with Graph Neural Networks

abstract: Drug Discovery is a fundamental and ever-evolving field of research. The design of new candidate molecules requires large amounts of time and money, and computational methods are being increasingly employed to cut these costs. Machine learning methods are ideal for the design of large amounts of potential new candidate molecules, which are naturally represented as graphs. Graph generation is being revolutionized by deep learning methods, and molecular generation is one of its most promising applications. In this paper, we introduce a sequential molecular graph generator based on a set of graph neural network modules, which we call MG^2N^2. At each step, a node or a group of nodes is added to the graph, along with its connections. The modular architecture simplifies the training procedure, also allowing an independent retraining of a single module. Sequentiality and modularity make the generation process interpretable. The use of graph neural networks maximizes the information in input at each generative step, which consists of the subgraph produced during the previous steps. Experiments of unconditional generation on the QM9 and Zinc datasets show that our model is capable of generalizing molecular patterns seen during the training phase, without overfitting. The results indicate that our method is competitive, and outperforms challenging baselines for unconditional generation.


title: Free (rational) Derivation

abstract: By representing elements in free fields (over a commutative field and a finite alphabet) using Cohn and Reutenauer's linear representations, we provide an algorithmic construction for the (partial) non-commutative (or Hausdorff-) derivative and show how it can be applied to the non-commutative version of the Newton iteration to find roots of matrix-valued rational equations.


title: Robust Unsupervised Learning via L-Statistic Minimization

abstract: Designing learning algorithms that are resistant to perturbations of the underlying data distribution is a problem of wide practical and theoretical importance. We present a general approach to this problem focusing on unsupervised learning. The key assumption is that the perturbing distribution is characterized by larger losses relative to a given class of admissible models. This is exploited by a general descent algorithm which minimizes an $L$-statistic criterion over the model class, weighting small losses more. Our analysis characterizes the robustness of the method in terms of bounds on the reconstruction error relative to the underlying unperturbed distribution. As a byproduct, we prove uniform convergence bounds with respect to the proposed criterion for several popular models in unsupervised learning, a result which may be of independent interest.Numerical experiments with kmeans clustering and principal subspace analysis demonstrate the effectiveness of our approach.


title: A Differential Analogue of Favard's Theorem

abstract: Favard's theorem characterizes bases of functions $\{p_n\}_{n\in\mathbb{Z}_+}$ for which $x p_n(x)$ is a linear combination of $p_{n-1}(x)$, $p_n(x)$, and $p_{n+1}(x)$ for all $n \geq 0$ with $p_{0}\equiv1$ (and $p_{-1}\equiv 0$ by convention). In this paper we explore the differential analogue of this theorem, that is, bases of functions $\{\varphi_n\}_{n\in\mathbb{Z}_+}$ for which $\varphi_n'(x)$ is a linear combination of $\varphi_{n-1}(x)$, $\varphi_n(x)$, and $\varphi_{n+1}(x)$ for all $n \geq 0$ with $\varphi_{0}(x)$ given (and $\varphi_{-1}\equiv 0$ by convention). We answer questions about orthogonality and completeness of such functions, provide characterisation results, and also, of course, give plenty of examples and list challenges for further research. Motivation for this work originated in the numerical solution of differential equations, in particular spectral methods which give rise to highly structured matrices and stable-by-design methods for partial differential equations of evolution. However, we believe this theory to be of interest in its own right, due to the interesting links between orthogonal polynomials, Fourier analysis and Paley--Wiener spaces, and the resulting identities between different families of special functions.


title: A Stochastic Alternating Direction Method of Multipliers for Non-smooth and Non-convex Optimization

abstract: Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale of the optimization problems to solve becomes large. In this paper, we consider combining ADMM with a class of stochastic gradient with variance reduction for solving large-scale non-convex and non-smooth optimization problems. Global convergence of the generated sequence is established under the extra additional assumption that the object function satisfies Kurdyka-Lojasiewicz (KL) property. Numerical experiments on graph-guided fused Lasso and computed tomography are presented to demonstrate the performance of the proposed methods.


title: Invertible analytic functions on Drinfeld symmetric spaces and universal extensions of Steinberg representations

abstract: Recently, Gekeler proved that the group of invertible analytic functions modulo constant functions on Drinfeld's upper half space is isomorphic to the dual of an integral generalized Steinberg representation. In this note we show that the group of invertible functions is the dual of a universal extension of that Steinberg representation. As an application, we show that lifting obstructions of rigid analytic theta cocycles of Hilbert modular forms in the sense of Darmon--Vonk can be computed in terms of $\mathcal{L}$-invariants of the associated Galois representation. The same argument applies to theta cocycles for definite unitary groups.


title: One-Shot Learning with Triplet Loss for Vegetation Classification Tasks

abstract: Triplet loss function is one of the options that can significantly improve the accuracy of the One-shot Learning tasks. Starting from 2015, many projects use Siamese networks and this kind of loss for face recognition and object classification. In our research, we focused on two tasks related to vegetation. The first one is plant disease detection on 25 classes of five crops (grape, cotton, wheat, cucumbers, and corn). This task is motivated because harvest losses due to diseases is a serious problem for both large farming structures and rural families. The second task is the identification of moss species (5 classes). Mosses are natural bioaccumulators of pollutants; therefore, they are used in environmental monitoring programs. The identification of moss species is an important step in the sample preprocessing. In both tasks, we used self-collected image databases. We tried several deep learning architectures and approaches. Our Siamese network architecture with a triplet loss function and MobileNetV2 as a base network showed the most impressive results in both above-mentioned tasks. The average accuracy for plant disease detection amounted to over 97.8% and 97.6% for moss species classification.


title: The geometry of some thermodynamic systems

abstract: In this article, we continue the program started in our previous article of exploring an important class of thermodynamic systems from a geometric point of view. In order to model the time evolution of systems verifying the two laws of thermodynamics, we show that the notion of evolution vector field is adequate to appropriately describe such systems. Our formulation naturally arises from the introduction of a skew-symmetric bracket to which numerical methods based on discrete gradients fit nicely. Moreover, we study the corresponding Lagrangian and Hamiltonian formalism, discussing the fundamental principles from which the equations are derived. An important class of systems that is naturally covered by our formalism are composed thermodynamic systems, which are described by at least two thermal variables and exchange heat between its components.}.


title: Thermally induced spin torque and domain wall motion in superconductor/antiferromagnetic insulator bilayers

abstract: We theoretically investigate domain wall motion in an antiferromagnetic insulator layer caused by thermally generated spin currents in an adjacent spin-split superconductor layer. An uncompensated antiferromagnet interface enables the two crucial ingredients underlying the mechanism - spin splitting in the superconductor and absorption of spin currents by the antiferromagnet. Treating the superconductor using the quasiclassical theory and the antiferromagnet via Landau-Lifshitz-Gilbert description, we find domain wall propagation along the thermal gradient with relatively large velocities $\sim 100$ m/s. Our proposal exploits the giant thermal response of spin-split superconductors in achieving large spin torques towards driving domain wall and other spin textures in antiferromagnets.


title: General path integrals and stable SDEs

abstract: The theory of one-dimensional stochastic differential equations driven by Brownian motion is classical and has been largely understood for several decades. For stochastic differential equations with jumps the picture is still incomplete, and even some of the most basic questions are only partially understood. In the present article we study existence and uniqueness of weak solutions to \[ {\rm d}Z_t=\sigma(Z_{t-}){\rm d} X_t \]driven by a (symmetric) $\alpha$-stable L\'evy process, in the spirit of the classical Engelbert-Schmidt time-change approach. Extending and completing results of Zanzotto we derive a complete characterisation for existence und uniqueness of weak solutions for $\alpha\in(0,1)$. Our approach is not based on classical stochastic calculus arguments but on the general theory of Markov processes. We proof integral tests for finiteness of path integrals under minimal assumptions.


title: In-Orbit Aerodynamic Coefficient Measurements using SOAR (Satellite for Orbital Aerodynamics Research)

abstract: The Satellite for Orbital Aerodynamics Research (SOAR) is a CubeSat mission, due to be launched in 2021, to investigate the interaction between different materials and the atmospheric flow regime in very low Earth orbits (VLEO). Improving knowledge of the gas-surface interactions at these altitudes and identification of novel materials that can minimise drag or improve aerodynamic control are important for the design of future spacecraft that can operate in lower altitude orbits. Such satellites may be smaller and cheaper to develop or can provide improved Earth observation data or communications link-budgets and latency. Using precise orbit and attitude determination information and the measured atmospheric flow characteristics the forces and torques experienced by the satellite in orbit can be studied and estimates of the aerodynamic coefficients calculated. This paper presents the scientific concept and design of the SOAR mission. The methodology for recovery of the aerodynamic coefficients from the measured orbit, attitude, and in-situ atmospheric data using a least-squares orbit determination and free-parameter fitting process is described and the experimental uncertainty of the resolved aerodynamic coefficients is estimated. The presented results indicate that the combination of the satellite design and experimental methodology are capable of clearly illustrating the variation of drag and lift coefficient for differing surface incidence angle. The lowest uncertainties for the drag coefficient measurement are found at approximately 300 km, whilst the measurement of lift coefficient improves for reducing orbital altitude to 200 km.


title: Searching for New Physics with $B^{0} \to K^{*0} \mu^+ \mu^-$

abstract: One of the main indications for New Physics in rare $B$-decays is deduced from the tension between experimental and Standard Model predictions of the angular analysis of the $B^0 \to K^{*0} \mu^+\mu^-$ decay. There are however possible non-local hadronic effects which in principle can also explain these tensions. In this work, we consider a statistical approach for differentiating the source of the tension in $B^0 \to K^{*0} \mu^+\mu^-$ observables and we also investigate the prospects of such a comparison with future data from the LHCb experiment.


title: On a result of Hayman concerning the maximum modulus set

abstract: The set of points where an entire function achieves its maximum modulus is known as the maximum modulus set. In 1951, Hayman studied the structure of this set near the origin. Following work of Blumenthal, he showed that, near zero, the maximum modulus set consists of a collection of disjoint analytic curves, and provided an upper bound for the number of these curves. In this paper, we establish the exact number of these curves for all entire functions, except for a "small" set whose Taylor series coefficients satisfy a certain simple, algebraic condition. Moreover, we give new results concerning the structure of this set near the origin, and make an interesting conjecture regarding the most general case. We prove this conjecture for polynomials of degree less than four.


title: Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension

abstract: In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog context to generate a reasonable response. Hence, in this paper, we propose to improve the response generation performance by examining the model's ability to answer a reading comprehension question, where the question is focused on the omitted information in the dialog. Enlightened by the multi-task learning scheme, we propose a joint framework that unifies these two tasks, sharing the same encoder to extract the common and task-invariant features with different decoders to learn task-specific features. To better fusing information from the question and the dialog history in the encoding part, we propose to augment the Transformer architecture with a memory updater, which is designed to selectively store and update the history dialog information so as to support downstream tasks. For the experiment, we employ human annotators to write and examine a large-scale dialog reading comprehension dataset. Extensive experiments are conducted on this dataset, and the results show that the proposed model brings substantial improvements over several strong baselines on both tasks. In this way, we demonstrate that reasoning can indeed help better response generation and vice versa. We release our large-scale dataset for further research.


title: Schottky vertex operator cluster algebras

abstract: Using recursion formulas for vertex operator algebra higher genus characters with formal parameters identified with local coordinates around marked points on a Riemann surface of arbitrary genus, we introduce the notion of a vertex operator cluster algebra structure. Cluster elements and mutation rules are explicitly defined, and the simplest example of a vertex operator cluster algebra is presented.


title: Fork or Fail: Cycle-Consistent Training with Many-to-One Mappings

abstract: Cycle-consistent training is widely used for jointly learning a forward and inverse mapping between two domains of interest without the cumbersome requirement of collecting matched pairs within each domain. In this regard, the implicit assumption is that there exists (at least approximately) a ground-truth bijection such that a given input from either domain can be accurately reconstructed from successive application of the respective mappings. But in many applications no such bijection can be expected to exist and large reconstruction errors can compromise the success of cycle-consistent training. As one important instance of this limitation, we consider practically-relevant situations where there exists a many-to-one or surjective mapping between domains. To address this regime, we develop a conditional variational autoencoder (CVAE) approach that can be viewed as converting surjective mappings to implicit bijections whereby reconstruction errors in both directions can be minimized, and as a natural byproduct, realistic output diversity can be obtained in the one-to-many direction. As theoretical motivation, we analyze a simplified scenario whereby minima of the proposed CVAE-based energy function align with the recovery of ground-truth surjective mappings. On the empirical side, we consider a synthetic image dataset with known ground-truth, as well as a real-world application involving natural language generation from knowledge graphs and vice versa, a prototypical surjective case. For the latter, our CVAE pipeline can capture such many-to-one mappings during cycle training while promoting textural diversity for graph-to-text tasks. Our code is available at github.com/QipengGuo/CycleGT *A condensed version of this paper has been accepted to AISTATS 2021. This version contains additional content and updates.


title: NMR studies of adsorption and diffusion in porous carbonaceous materials

abstract: Porous carbonaceous materials have many important industrial applications including energy storage, water purification, and adsorption of volatile organic compounds. Most of their applications rely upon the adsorption of molecules or ions within the interior pore volume of the carbon particles. Understanding the behaviour and properties of adsorbate species on the molecular level is therefore key for optimising porous carbon materials, but this is very challenging owing to the complexity of the disordered carbon structure and the presence of multiple phases in the system. In recent years, NMR spectroscopy has emerged as one of the few experimental techniques that can resolve adsorbed species from those outside the pore network. Adsorbed, or "in-pore" species give rise to resonances that appear at lower chemical shifts compared to their free (or "ex-pore") counterparts. This shielding effect arises primarily due to ring currents in the carbon structure in the presence of a magnetic field, such that the observed chemical shift differences upon adsorption are nucleus-independent to a first approximation. Theoretical modelling has played an important role in rationalising and explaining these experimental observations. Together, experiments and simulations have enabled a large amount of information to be gained on the adsorption and diffusion of adsorbed species, as well as on the structural and magnetic properties of the porous carbon adsorbent. Here, we review the methodological developments and applications of NMR spectroscopy and related modelling in this field, and provide perspectives on possible future applications and research directions.


title: Cosmic Acceleration in an Extended Brans-Dicke-Higgs Theory

abstract: We consider an extended scalar-tensor theory of gravity where the action has two interacting scalar fields, a Brans-Dicke field which makes the effective Newtonian constant a function of coordinates and a Higgs field which has derivative and non-derivative interaction with the lagrangian. There is a non-trivial interaction between the two scalar fields which dictates the dominance of different scalar fields in different era. We investigate if this setup can describe a late-time cosmic acceleration preceded by a smooth transition from deceleration in recent past. From a cosmological reconstruction technique we find the scalar profiles as a function of redshift. We find the constraints on the model parameters from a Markov Chain Monte Carlo analysis using observational data. Evolution of an effective equation of state, matter density contrast and thermodynamic equilibrium of the universe are studied and their significance in comparison with a LCDM cosmology is discussed.


title: A subexponential bound on the cardinality of abelian quotients in finite transitive groups

abstract: We show that, for every transitive group $G$ of degree $n\ge 2$, the largest abelian quotient of $G$ has cardinality at most $4^{n/\sqrt{\log_2 n}}$. This gives a positive answer to a 1989 outstanding question of L\'aszl\'o Kov\'acs and Cheryl Praeger.


title: Stability Analysis of Nash Equilibrium for 2-Agent Loss-Aversion-Based Noncooperative Switched Systems

abstract: The stability property of the loss-aversion-based noncooperative switched systems with quadratic payoffs is investigated. In this system, each agent adopts the lower sensitivity parameter in the myopic pseudo-gradient dynamics for the case of losing utility than gaining utility, and both systems' dynamics and switching events (conditions) are depending on agents' payoff functions. Sufficient conditions under which agents' state converges towards the Nash equilibrium are derived in accordance with the location of the Nash equilibrium. In the analysis, the mode transition sequence and interesting phenomena which we call flash switching instants are characterized. Finally, we present several numerical examples to illustrate the properties of our results.


title: The fundamental inequality for cocompact Fuchsian groups

abstract: We prove that the hitting measure is singular with respect to Lebesgue measure for any random walk on a cocompact Fuchsian group generated by translations joining opposite sides of a symmetric hyperbolic polygon. Moreover, the Hausdorff dimension of the hitting measure is strictly less than 1. A similar statement is proven for Coxeter groups. Along the way, we prove for cocompact Fuchsian groups a purely geometric inequality for geodesic lengths, strongly reminiscent of the Anderson-Canary-Culler-Shalen inequality for free Kleinian groups.


title: Multifarious roles of hidden chiral-scale symmetry:"Quenching" ${g_A}$ in nuclei

abstract: I discuss how the axial current coupling constant $g_A$ renormalized in scale symmetric chiral EFT defined at a chiral matching scale impacts on the axial current matrix elements on beta decays in nuclei with and without neutrinos. The "quenched" $g_A$ observed in nuclear superallowed Gamow-Teller transitions, a long-standing puzzle in nuclear physics, is shown to encode the emergence of chiral-scale symmetry hidden in QCD in the vacuum. This enables one to explore how trace-anomaly-induced scale symmetry breaking enters in the renormalized $g_A$ in nuclei applicable to certain non-unique forbidden processes involved in neutrinoless double beta decays. A parallel is made between the roles of chiral-scale symmetry in quenching $g_A$ in highly dense medium and in hadron-quark continuity in the EoS of dense matter in massive compact stars. A systematic chiral-scale EFT, presently lacking in nuclear theory and potentially crucial for the future progress, is suggested as a challenge in the field.


title: The Style-Content Duality of Attractiveness: Learning to Write Eye-Catching Headlines via Disentanglement

abstract: Eye-catching headlines function as the first device to trigger more clicks, bringing reciprocal effect between producers and viewers. Producers can obtain more traffic and profits, and readers can have access to outstanding articles. When generating attractive headlines, it is important to not only capture the attractive content but also follow an eye-catching written style. In this paper, we propose a Disentanglement-based Attractive Headline Generator (DAHG) that generates headline which captures the attractive content following the attractive style. Concretely, we first devise a disentanglement module to divide the style and content of an attractive prototype headline into latent spaces, with two auxiliary constraints to ensure the two spaces are indeed disentangled. The latent content information is then used to further polish the document representation and help capture the salient part. Finally, the generator takes the polished document as input to generate headline under the guidance of the attractive style. Extensive experiments on the public Kuaibao dataset show that DAHG achieves state-of-the-art performance. Human evaluation also demonstrates that DAHG triggers 22% more clicks than existing models.


title: Grids of stellar models with rotation: V. Models from 1.7 to 120 Msun at zero metallicity

abstract: Understanding the nature of the first stars is key to understanding the early universe. With new facilities such as JWST we may soon have the first observations of the earliest stellar populations, but to understand these observations we require detailed theoretical models. Here we compute a grid of stellar evolution models using the Geneva code with the aim to improve our understanding of the evolution of zero-metallicity stars, with particular interest in how rotation affects surface properties, interior structure, and metal enrichment. We produce a range of models of initial masses (Mini) from 1.7 Msun to 120 Msun, focusing on massive models of 9 Msun < Mini < 120 Msun. Our grid includes models with and without rotation, with rotating models having an initial velocity of 40% of the critical velocity. We find that rotation strongly impacts the evolution of the first stars, mainly through increased core size and stronger H-burning shells during core He-burning. Without radiative mass loss, angular momentum builds at the surface in rotating models, thus models of initial masses Mini > 60 Msun reach critical rotation on the main sequence and experience mass loss. We find that rotational mixing strongly affects metal enrichment, but does not always increase metal production as we see at higher metallicities. This is because rotation leads to an earlier CNO boost to the H shell during He-burning, which may hinder metal enrichment depending on initial mass and rotational velocity. Electronic tables of this new grid of Population III models are publicly available.


title: WILDS: A Benchmark of in-the-Wild Distribution Shifts

abstract: Distribution shifts -- where the training distribution differs from the test distribution -- can substantially degrade the accuracy of machine learning (ML) systems deployed in the wild. Despite their ubiquity in the real-world deployments, these distribution shifts are under-represented in the datasets widely used in the ML community today. To address this gap, we present WILDS, a curated benchmark of 10 datasets reflecting a diverse range of distribution shifts that naturally arise in real-world applications, such as shifts across hospitals for tumor identification; across camera traps for wildlife monitoring; and across time and location in satellite imaging and poverty mapping. On each dataset, we show that standard training yields substantially lower out-of-distribution than in-distribution performance. This gap remains even with models trained by existing methods for tackling distribution shifts, underscoring the need for new methods for training models that are more robust to the types of distribution shifts that arise in practice. To facilitate method development, we provide an open-source package that automates dataset loading, contains default model architectures and hyperparameters, and standardizes evaluations. Code and leaderboards are available at https://wilds.stanford.edu.


title: Discovery of a damped Ly$\alpha$ galaxy at z $\sim$ 3 towards the quasar SDSS J011852+040644

abstract: We report the detection of the host galaxy of a damped Ly$\alpha$ system (DLA) with log N(HI) $ [\rm cm^{-2}]$ = $21.0 \pm 0.10$ at $z \approx 3.0091$ towards the background quasar SDSS J011852+040644 using the Palomar Cosmic Web Imager (PCWI) at the Hale (P200) telescope. We detect Ly$\alpha$ emission in the dark core of the DLA trough at a 3.3$\sigma$ confidence level, with Ly$\alpha$ luminosity of $L_{\rm Ly\alpha}$ $\rm = (3.8 \pm 0.8) \times 10^{42}\ erg\ s^{-1}$, corresponding to a star formation rate of $\gtrsim 2\ \rm M_{\odot}\ yr^{-1}$ (considering a lower limit on Ly$\alpha$ escape fraction $f_{esc}^{Ly{\alpha}} \sim 2\%$) as typical for Lyman break galaxies at these redshifts. The Ly$\alpha$ emission is blueshifted with respect to the systemic redshift derived from metal absorption lines by $281 \pm 43$ km/s. The associated galaxy is at very small impact parameter of $\lesssim 12 \rm\ kpc$ from the background quasar, which is in line with the observed anticorrelation between column density and impact parameter in spectroscopic searches tracing the large-scale environments of DLA host galaxies.


title: Twisted superfluid and supersolid phases of triplons in bilayer honeycomb magnets

abstract: We demonstrate that low-lying triplon excitations in a bilayer Heisenberg antiferromagnet provide a promising avenue to realize magnetic analogs of twisted superfluid and supersolid phases that were recently reported for two-component ultracold atomic condensate in an optical lattice. Using a cluster Gutzwiller mean-field theory, we establish that Dzyaloshinskii-Moriya interactions (DMI), that are common in many quantum magnets, stabilize these phases in a magnetic system, in contrast to the pair hopping process that is necessary for ultracold atoms. The critical value of DMI for transition to the twisted superfluid and twisted supersolid phases depends on the strength of the (frustrated) interlayer interactions that can be tuned by applying external pressure on and / or shearing force between the layers. Furthermore, we show that the strength of DMI can be controllably varied by coupling to tailored circularly polarized light. Our results provide crucial guidance for the experimental search of twisted superfluid and supersolid phases of triplons in real quantum magnets.


title: On interference effects in top-philic decay chains

abstract: Sizeable exotic Higgs boson production through gluon fusion via top quark loops is correlated with large Higgs decay probabilities into top quark final states, if these are kinematically accessible. It is known that $gg\to S \to t\bar t$ is particularly susceptible to signal-background interference effects that can significantly impact discovery sensitivities. In such an instance, identifying more robust signatures to enhance the discovery sensitivity becomes necessary, shifting phenomenological focus to final states that show a reduced destructive signal-background interference. In this work, we discuss the phenomenological relevance of signal-signal and signal-background interference effects for decay chains. In particular, we identify asymmetric cascade decays in models of scalar extensions of the SM Higgs sector as new promising candidates. In parallel, characteristic interference patterns can provide a formidable tool for indirect CP spectroscopy of BSM sectors if a discovery is made in the future. This motivates associated searches at present and future colliders as robust discovery modes of new physics, in addition to serving as a sensitive tool for the reconstruction of the underlying UV electroweak potential.


title: Predicting contrast sensitivity to segmented aperture misalignment modes for the HiCAT testbed

abstract: This paper presents the setup for empirical validations of the Pair-based Analytical model for Segmented Telescope Imaging from Space (PASTIS) tolerancing model for segmented coronagraphy. We show the hardware configuration of the High-contrast imager for Complex Aperture Telescopes (HiCAT) testbed on which these experiments will be conducted at an intermediate contrast regime between $10^{-6}$ and $10^{-8}$. We describe the optical performance of the testbed with a classical Lyot coronagraph and describe the recent hardware upgrade to a segmented mode, using an IrisAO segmented deformable mirror. Implementing experiments on HiCAT is made easy through its top-level control infrastructure that uses the same code base to run on the real testbed, or to invoke the optical simulator. The experiments presented in this paper are run on the HiCAT testbed emulator, which makes them ready to be performed on actual hardware. We show results of three experiments with results from the emulator, with the goal to demonstrate PASTIS on hardware next. We measure the testbed PASTIS matrix, and validate the PASTIS analytical propagation model by comparing its contrast predictions to simulator results. We perform the tolerancing analysis on the optical eigenmodes (PASTIS modes) and on independent segments, then validate these results in respective experiments. This work prepares and enables the experimental validation of the analytical segment-based tolerancing model for segmented aperture coronagraphy with the specific application to the HiCAT testbed.


title: Towards the complete phase profiling of attosecond wave packets

abstract: Realistic attosecond wave packets have complex profiles that, in dispersive conditions, rapidly broaden or split into multiple components. Such behaviors are encoded in sharp features of the wave packet spectral phase. Here, we exploit the quantum beating between one- and two-photon transitions in an attosecond photoionization experiment to measure the photoelectron spectral phase continuously across a broad energy range. Supported by numerical simulations, we demonstrate that this experimental technique is able to reconstruct sharp fine-scale features of the spectral phase, continuously as a function of energy and across the full spectral range of the pulse train, thus beyond the capabilities of existing attosecond spectroscopies. In a proof-of-principle experiment, we retrieve the periodic modulations of the spectral phase of an attosecond pulse train due to the individual chirp of each harmonic.


title: DSM Refinement with Deep Encoder-Decoder Networks

abstract: 3D city models can be generated from aerial images. However, the calculated DSMs suffer from noise, artefacts, and data holes that have to be manually cleaned up in a time-consuming process. This work presents an approach that automatically refines such DSMs. The key idea is to teach a neural network the characteristics of urban area from reference data. In order to achieve this goal, a loss function consisting of an L1 norm and a feature loss is proposed. These features are constructed using a pre-trained image classification network. To learn to update the height maps, the network architecture is set up based on the concept of deep residual learning and an encoder-decoder structure. The results show that this combination is highly effective in preserving the relevant geometric structures while removing the undesired artefacts and noise.


title: Mind the Gap: On the Relationship Between Automatically Measured and Self-Reported Productivity

abstract: To improve software developers' productivity has been the holy grail of software engineering research. But before we can claim to have improved it, we must first be able to measure productivity. This is far from trivial. In fact, two separate research lines on software engineers' productivity have co-existed almost in complete isolation for a long time: automated product and process measures on the one hand and self-reported or perceived productivity on the other hand. In this article, we bridge the gap between the two with an empirical study of 81 software developers at Microsoft.


title: Approximate Laplace approximations for scalable model selection

abstract: We propose the approximate Laplace approximation (ALA) to evaluate integrated likelihoods, a bottleneck in Bayesian model selection. The Laplace approximation (LA) is a popular tool that speeds up such computation and equips strong model selection properties. However, when the sample size is large or one considers many models the cost of the required optimizations becomes impractical. ALA reduces the cost to that of solving a least-squares problem for each model. Further, it enables efficient computation across models such as sharing pre-computed sufficient statistics and certain operations in matrix decompositions. We prove that in generalized (possibly non-linear) models ALA achieves a strong form of model selection consistency for a suitably-defined optimal model, at the same functional rates as exact computation. We consider fixed- and high-dimensional problems, group and hierarchical constraints, and the possibility that all models are misspecified. We also obtain ALA rates for Gaussian regression under non-local priors, an important example where the LA can be costly and does not consistently estimate the integrated likelihood. Our examples include non-linear regression, logistic, Poisson and survival models. We implement the methodology in the R package mombf.


title: Pyramid-Focus-Augmentation: Medical Image Segmentation with Step-Wise Focus

abstract: Segmentation of findings in the gastrointestinal tract is a challenging but also an important task which is an important building stone for sufficient automatic decision support systems. In this work, we present our solution for the Medico 2020 task, which focused on the problem of colon polyp segmentation. We present our simple but efficient idea of using an augmentation method that uses grids in a pyramid-like manner (large to small) for segmentation. Our results show that the proposed methods work as indented and can also lead to comparable results when competing with other methods.


title: Continual Lie algebras determined by chain complexes

abstract: Continual Lie algebras are infinite dimensional generalizations of ordinary Lie with continuous set of roots. In this paper we establish a general relation between chain complexes and continual Lie algebras. First, by defining and appropriate product among a chain complex spaces we endow it with the structure of an exterior differential graded algebra $\mathcal C$. The natural orthogonality condition with respect to a product bring about to $\mathcal C$ the structure of a graded algebra with differential relations and compatibility conditions for elements of chain complex spaces. By considering the union of all relations for independent elements in the tree graph structure of the system, we prove the main result of this paper: a chain complex brings about the structure of a continual Lie algebra with the root space determined by parameters for the complex. This provides a new source of examples of continual Lie algebras. Finally, as an example, we consider the case of \v{C}ech-de Rham complex associated to a foliation on a smooth manifold. In a particular case of this chain complex, we derive explicitly the commutation relations for corresponding continual Lie algebra.


title: Cross Layer Attacks and How to Use Them (for DNS Cache Poisoning, Device Tracking and More)

abstract: We analyze the prandom pseudo random number generator (PRNG) in use in the Linux kernel (which is the kernel of the Linux operating system, as well as of Android) and demonstrate that this PRNG is weak. The prandom PRNG is in use by many "consumers" in the Linux kernel. We focused on three consumers at the network level -- the UDP source port generation algorithm, the IPv6 flow label generation algorithm and the IPv4 ID generation algorithm. The flawed prandom PRNG is shared by all these consumers, which enables us to mount "cross layer attacks" against the Linux kernel. In these attacks, we infer the internal state of the prandom PRNG from one OSI layer, and use it to either predict the values of the PRNG employed by the other OSI layer, or to correlate it to an internal state of the PRNG inferred from the other protocol. Using this approach we can mount a very efficient DNS cache poisoning attack against Linux. We collect TCP/IPv6 flow label values, or UDP source ports, or TCP/IPv4 IP ID values, reconstruct the internal PRNG state, then predict an outbound DNS query UDP source port, which speeds up the attack by a factor of x3000 to x6000. This attack works remotely, but can also be mounted locally, across Linux users and across containers, and (depending on the stub resolver) can poison the cache with an arbitrary DNS record. Additionally, we can identify and track Linux and Android devices -- we collect TCP/IPv6 flow label values and/or UDP source port values and/or TCP/IPv4 ID fields, reconstruct the PRNG internal state and correlate this new state to previously extracted PRNG states to identify the same device.


title: On Low-Rank Hankel Matrix Denoising

abstract: The low-complexity assumption in linear systems can often be expressed as rank deficiency in data matrices with generalized Hankel structure. This makes it possible to denoise the data by estimating the underlying structured low-rank matrix. However, standard low-rank approximation approaches are not guaranteed to perform well in estimating the noise-free matrix. In this paper, recent results in matrix denoising by singular value shrinkage are reviewed. A novel approach is proposed to solve the low-rank Hankel matrix denoising problem by using an iterative algorithm in structured low-rank approximation modified with data-driven singular value shrinkage. It is shown numerically in both the input-output trajectory denoising and the impulse response denoising problems, that the proposed method performs the best in terms of estimating the noise-free matrix among existing algorithms of low-rank matrix approximation and denoising.


title: An Adaptive Memory Multi-Batch L-BFGS Algorithm for Neural Network Training

abstract: Motivated by the potential for parallel implementation of batch-based algorithms and the accelerated convergence achievable with approximated second order information a limited memory version of the BFGS algorithm has been receiving increasing attention in recent years for large neural network training problems. As the shape of the cost function is generally not quadratic and only becomes approximately quadratic in the vicinity of a minimum, the use of second order information by L-BFGS can be unreliable during the initial phase of training, i.e. when far from a minimum. Therefore, to control the influence of second order information as training progresses, we propose a multi-batch L-BFGS algorithm, namely MB-AM, that gradually increases its trust in the curvature information by implementing a progressive storage and use of curvature data through a development-based increase (dev-increase) scheme. Using six discriminative modelling benchmark problems we show empirically that MB-AM has slightly faster convergence and, on average, achieves better solutions than the standard multi-batch L-BFGS algorithm when training MLP and CNN models.


title: $L^{p}$-estimates for the Hessians of solutions to fully nonlinear parabolic equations with oblique boundary conditions

abstract: We study fully nonlinear parabolic equations in nondivergence form with oblique boundary conditions. An optimal and global Calder\'{o}n-Zygmund estimate is obtained by proving that the Hessian of the viscosity solution to the oblique boundary problem is as integrable as the nonhomogeneous term in $L^{p}$ spaces under minimal regularity requirement on the nonlinear operator, the boundary data and the boundary of the domain.


title: Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting

abstract: Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability to capture precise long-range dependency coupling between output and input efficiently. Recent studies have shown the potential of Transformer to increase the prediction capacity. However, there are several severe issues with Transformer that prevent it from being directly applicable to LSTF, including quadratic time complexity, high memory usage, and inherent limitation of the encoder-decoder architecture. To address these issues, we design an efficient transformer-based model for LSTF, named Informer, with three distinctive characteristics: (i) a $ProbSparse$ self-attention mechanism, which achieves $O(L \log L)$ in time complexity and memory usage, and has comparable performance on sequences' dependency alignment. (ii) the self-attention distilling highlights dominating attention by halving cascading layer input, and efficiently handles extreme long input sequences. (iii) the generative style decoder, while conceptually simple, predicts the long time-series sequences at one forward operation rather than a step-by-step way, which drastically improves the inference speed of long-sequence predictions. Extensive experiments on four large-scale datasets demonstrate that Informer significantly outperforms existing methods and provides a new solution to the LSTF problem.


title: Rethinking the Promotion Brought by Contrastive Learning to Semi-Supervised Node Classification

abstract: Graph Contrastive Learning (GCL) has proven highly effective in promoting the performance of Semi-Supervised Node Classification (SSNC). However, existing GCL methods are generally transferred from other fields like CV or NLP, whose underlying working mechanism remains under-explored. In this work, we first deeply probe the working mechanism of GCL in SSNC, and find that the promotion brought by GCL is severely unevenly distributed: the improvement mainly comes from subgraphs with less annotated information, which is fundamentally different from contrastive learning in other fields. However, existing GCL methods generally ignore this uneven distribution of annotated information and apply GCL evenly to the whole graph. To remedy this issue and further improve GCL in SSNC, we propose the Topology InFormation gain-Aware Graph Contrastive Learning (TIFA-GCL) framework that considers the annotated information distribution across graph in GCL. Extensive experiments on six benchmark graph datasets, including the enormous OGB-Products graph, show that TIFA-GCL can bring a larger improvement than existing GCL methods in both transductive and inductive settings. Further experiments demonstrate the generalizability and interpretability of TIFA-GCL.


title: Inhomogeneity in the early Galactic chemical enrichment exposed by beryllium abundances in extremely metal-poor stars

abstract: Abundances of beryllium in metal-poor stars scale linearly with metallicity down to [Fe/H] ~ -3.0. In the stars where Be has been detected at this extremely metal-poor regime, an increased abundance scatter has been previously reported. This scatter could indicate a flattening of the relation between Be and [Fe/H]. Our aim is to perform a new investigation of Be abundances in extremely metal-poor stars and try to clarify whether a Be abundance plateau exists. We revisited the Be abundances in a sample of nine dwarfs with [Fe/H] ~ -3.0. Additionally, we analysed the Be lines in the spectra of stars BPS BS 16968-0061 and CD-33 1173 for the first time. We took advantage of Gaia DR2 parallaxes to refine values of the surface gravity of the stars. Abundances of Be were determined using spectrum synthesis. Some of the stars indeed suggest a flattening. Between [Fe/H] ~ -2.70 and -3.26, the Be abundances stay mostly constant at log(Be/H) ~ -13.2 dex. Nevertheless, for several stars we could only place upper limits that are below that level. Most of the sample stars are consistent with having been formed at the progenitor of the so-called Gaia-Enceladus merger. Two out of the three stars likely formed in-situ are the ones that deviate the most from the linear relation. The mixed origin of these stars offers a clue to understanding the flattening. We suggest that our observations can be understood as a consequence of the inhomogeneous star forming conditions in the early Galaxy. Without efficient mixing, the early ISM would be characterised by a large scatter in Fe abundances at a given moment. Beryllium, on the other hand, because of its origins in cosmic-ray spallation, would have more homogeneous abundances (in a Galaxy-wide sense). We therefore suggest that the observed flattening of the Be-versus-Fe relation reflects a stronger scatter in the Galactic Fe abundances at a given age [abridged].


title: Graphs for deep learning representations

abstract: In recent years, Deep Learning methods have achieved state of the art performance in a vast range of machine learning tasks, including image classification and multilingual automatic text translation. These architectures are trained to solve machine learning tasks in an end-to-end fashion. In order to reach top-tier performance, these architectures often require a very large number of trainable parameters. There are multiple undesirable consequences, and in order to tackle these issues, it is desired to be able to open the black boxes of deep learning architectures. Problematically, doing so is difficult due to the high dimensionality of representations and the stochasticity of the training process. In this thesis, we investigate these architectures by introducing a graph formalism based on the recent advances in Graph Signal Processing (GSP). Namely, we use graphs to represent the latent spaces of deep neural networks. We showcase that this graph formalism allows us to answer various questions including: ensuring generalization abilities, reducing the amount of arbitrary choices in the design of the learning process, improving robustness to small perturbations added to the inputs, and reducing computational complexity


title: Tensoring volatility calibration

abstract: Inspired by a series of remarkable papers in recent years that use Deep Neural Nets to substantially speed up the calibration of pricing models, we investigate the use of Chebyshev Tensors instead of Deep Neural Nets. Given that Chebyshev Tensors can be, under certain circumstances, more efficient than Deep Neural Nets at exploring the input space of the function to be approximated, due to their exponential convergence, the problem of calibration of pricing models seems, a priori, a good case where Chebyshev Tensors can excel. In this piece of research, we built Chebyshev Tensors, either directly or with the help of the Tensor Extension Algorithms, to tackle the computational bottleneck associated with the calibration of the rough Bergomi volatility model. Results are encouraging as the accuracy of model calibration via Chebyshev Tensors is similar to that when using Deep Neural Nets, but with building efforts that range between 5 and 100 times more efficient in the experiments run. Our tests indicate that when using Chebyshev Tensors, the calibration of the rough Bergomi volatility model is around 40,000 times more efficient than if calibrated via brute-force (using the pricing function).