title: Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method?

abstract: We investigate the self-attention mechanism of BERT in a fine-tuning scenario for the classification of scientific articles over a taxonomy of research disciplines. We observe how self-attention focuses on words that are highly related to the domain of the article. Particularly, a small subset of vocabulary words tends to receive most of the attention. We compare and evaluate the subset of the most attended words with feature selection methods normally used for text classification in order to characterize self-attention as a possible feature selection approach. Using ConceptNet as ground truth, we also find that attended words are more related to the research fields of the articles. However, conventional feature selection methods are still a better option to learn classifiers from scratch. This result suggests that, while self-attention identifies domain-relevant terms, the discriminatory information in BERT is encoded in the contextualized outputs and the classification layer. It also raises the question whether injecting feature selection methods in the self-attention mechanism could further optimize single sequence classification using transformers.


title: On Liouville systems at critical parameters, Part 2: Multiple bubbles

abstract: In this paper, we continue to consider the generalized Liouville system: $$ \Delta_g u_i+\sum_{j=1}^n a_{ij}\rho_j\left(\frac{h_j e^{u_j}}{\int h_j e^{u_j}}- {1} \right)=0\quad\text{in \,}M,\quad i\in I=\{1,\cdots,n\}, $$ where $(M,g)$ is a Riemann surface $M$ with volume $1$, $h_1,..,h_n$ are positive smooth functions and $\rho_j\in \mathbb R^+$($j\in I$). In previous works Lin-Zhang identified a family of hyper-surfaces $\Gamma_N$ and proved a priori estimates for $\rho=(\rho_1,..,\rho_n)$ in areas separated by $\Gamma_N$. Later Lin-Zhang also calculated the leading term of $\rho^k-\rho$ where $\rho\in \Gamma_1$ is the limit of $\rho^k$ on $\Gamma_1$ and $\rho^k$ is the parameter of a bubbling sequence. This leading term is particularly important for applications but it is very hard to be identified if $\rho^k$ tends to a higher order hypersurface $\Gamma_N$ ($N>1$). Over the years numerous attempts have failed but in this article we overcome all the stumbling blocks and completely solve the problem under the most general context: We not only capture the leading terms of $\rho^k-\rho\in \Gamma_N$, but also reveal new robustness relations of coefficient functions at different blowup points.


title: Improving type information inferred by decompilers with supervised machine learning

abstract: In software reverse engineering, decompilation is the process of recovering source code from binary files. Decompilers are used when it is necessary to understand or analyze software for which the source code is not available. Although existing decompilers commonly obtain source code with the same behavior as the binaries, that source code is usually hard to interpret and certainly differs from the original code written by the programmer. Massive codebases could be used to build supervised machine learning models aimed at improving existing decompilers. In this article, we build different classification models capable of inferring the high-level type returned by functions, with significantly higher accuracy than existing decompilers. We automatically instrument C source code to allow the association of binary patterns with their corresponding high-level constructs. A dataset is created with a collection of real open-source applications plus a huge number of synthetic programs. Our system is able to predict function return types with a 79.1% F1-measure, whereas the best decompiler obtains a 30% F1-measure. Moreover, we document the binary patterns used by our classifier to allow their addition in the implementation of existing decompilers.


title: Core Fragmentation in Simplest Superfluid Dark Matter Scenario

abstract: We study the structure of galactic halos within a scalar dark matter model, endowed with a repulsive quartic self-interaction, capable of undergoing the superfluid phase transition in high-density regions. We demonstrate that the thermalized cores are prone to fragmentation into superfluid droplets due to the Jeans instability. Furthermore, since cores of astrophysical size may be generated only when most of the particles comprising the halo reside in a highly degenerate phase-space, the well-known bound on the dark matter self-interaction cross section inferred from the collision of clusters needs to be revised, accounting for the enhancement of the interaction rate due to degeneracy. As a result, generation of kpc-size superfluid solitons, within the parameter subspace consistent with the Bullet Cluster bound, requires dark matter particles to be ultra-light.


title: An extension of Deligne-Henniart's twisting formula and its applications

abstract: Let $F/\bbQ_p$ be a non-Archimedean local field, and $G_F$ be the absolute Galois group of $F$. Let $\rho_1$ and $\rho_2$ be two finite-dimensional complex representations of $G_F$. Let $\psi$ be a nontrivial additive character of $F$. Then, the question is: What is the twisting formula for the root number $W(\rho_1\otimes\rho_2,\psi)$?} In general, the answer to this question is not yet known. However, if one of $\rho_i \quad(i=1,2)$ is one-dimensional with ``sufficiently'' large conductor, then in [13], Deligne gave a twisting formula for $W(\rho_1\otimes\rho_2,\psi)$. Later, in [12], Deligne and Henniart gave a general twisting formula for a {\it zero}-dimensional virtual representation twisted by a finite-dimensional representation of $G_F$. In this paper, we first extend Deligne's twisting formula for U-isotropic Heisenberg representation of dimension prime $p$, then we further extend Deligne-Henniart's result. Finally, we provide two very important applications of our twisting formula: -- (i) invariant formula for the local root numbers for U-isotropic Heisenberg representations, and (ii) a converse theorem on the Galois side.


title: Review of Machine Learning Applications in Wireless Communications

abstract: This paper looks at various aspects of Machine Learning (ML) applications in wireless communication technologies, focusing mainly on fifth-generation (5G) and millimeter wave (mmWave) technologies. This paper includes the summaries of 3 papers on machine learning applications in wireless communication technology. The paper deals with the need for integration of machine learning in wireless communication, types of machine learning techniques used in wireless communication, advantages and potential of ML in wireless communication, and implementation parameters of ML in wireless communication, as well as a study on RSS-Based Classification of usage in indoor millimeter-wave wireless networks.


title: On the restriction formula

abstract: Let $\varphi$ be a quasi-psh function on a complex manifold $X$ and let $S\subset X$ be a complex submanifold. Then the multiplier ideal sheaves $\mathcal{I}(\varphi|_S)\subset\mathcal{I}(\varphi)|_{S}$ and the complex singularity exponents $c_{x}\left(\varphi|_{S}\right)\leqslant c_{x}(\varphi)$ by Ohsawa-Takegoshi $L^{2}$ extension theorem. An interesting question is to know whether it is possible to get equalities in the above formulas. In the present article, we show that the answer is positive when $S$ is chosen outside a measure zero set in a suitable projective space.


title: Effect of Oxygen and Aluminium Incorporation on Local Structure of GaN Nanowires: Insight from Extended X-ray Absorption Fine Structure Analysis

abstract: A thorough investigation of local structure, influencing macroscopic properties of the solid is of potential interest. We investigated the local structure of GaN nanowires (NWs) with different native defect concentration synthesized by the chemical vapor deposition technique. Extended X-ray absorption fine structure (EXAFS) analysis and semi-empirical and the density functional theory (DFT) calculations were used to address the effect of dopant incorporation along with other defects on the co-ordination number and bond length values. The decrease of the bond length values along preferential crystal axes in the local tetrahedral structure of GaN emphasizes the preferred lattice site for oxygen doping. The preferential bond length contraction is corroborated by the simulations. We have also studied the impact on the local atomic configuration of GaN NWs with Al incorporation. AlxGa1-xN NWs are synthesized via novel ion beam techniques of ion beam mixing and post-irradiation diffusion process. The change in the local tetrahedral structure of GaN with Al incorporation is investigated by EXAFS analysis. The analysis provides a clear understanding of choosing a suitable process for ternary III-nitride random alloy formation. The local structure study with the EXAFS analysis is corroborated with the observed macroscopic properties studied using Raman spectroscopy.


title: Self-supervised pre-training enhances change detection in Sentinel-2 imagery

abstract: While annotated images for change detection using satellite imagery are scarce and costly to obtain, there is a wealth of unlabeled images being generated every day. In order to leverage these data to learn an image representation more adequate for change detection, we explore methods that exploit the temporal consistency of Sentinel-2 times series to obtain a usable self-supervised learning signal. For this, we build and make publicly available (https://zenodo.org/record/4280482) the Sentinel-2 Multitemporal Cities Pairs (S2MTCP) dataset, containing multitemporal image pairs from 1520 urban areas worldwide. We test the results of multiple self-supervised learning methods for pre-training models for change detection and apply it on a public change detection dataset made of Sentinel-2 image pairs (OSCD).


title: Technological Competence is a Precondition for Effective Implementation of Virtual Reality Head Mounted Displays in Human Neuroscience: A Technological Review and Meta-analysis

abstract: Immersive virtual reality (VR) emerges as a promising research and clinical tool. However, several studies suggest that VR induced adverse symptoms and effects (VRISE) may undermine the health and safety standards, and the reliability of the scientific results. In the current literature review, the technical reasons for the adverse symptomatology are investigated to provide suggestions and technological knowledge for the implementation of VR head-mounted display (HMD) systems in cognitive neuroscience. The technological systematic literature indicated features pertinent to display, sound, motion tracking, navigation, ergonomic interactions, user experience, and computer hardware that should be considered by the researchers. Subsequently, a meta-analysis of 44 neuroscientific or neuropsychological studies involving VR HMD systems was performed. The meta-analysis of the VR studies demonstrated that new generation HMDs induced significantly less VRISE and marginally fewer dropouts.Importantly, the commercial versions of the new generation HMDs with ergonomic interactions had zero incidents of adverse symptomatology and dropouts. HMDs equivalent to or greater than the commercial versions of contemporary HMDs accompanied with ergonomic interactions are suitable for implementation in cognitive neuroscience. In conclusion, researchers technological competency, along with meticulous methods and reports pertinent to software, hardware, and VRISE, are paramount to ensure the health and safety standards and the reliability of neuroscientific results.


title: Electron-phonon coupling and electronic thermoelectric properties of n-type PbTe driven near the soft-mode phase transition via lattice expansion

abstract: IV-VI materials are some of the most efficient bulk thermoelectric materials due to their proximity to soft-mode phase transitions, which leads to low lattice thermal conductivity. It has been shown that the lattice thermal conductivity of PbTe can be considerably reduced by bringing PbTe closer to the phase transition e.g. via lattice expansion. However, the effect of soft phonon modes on the electronic thermoelectric properties of such system remains unknown. Using first principles calculations, we show that the soft zone center transverse optical phonons do not deteriorate the electronic thermoelectric properties of PbTe driven closer to the phase transition via lattice expansion due to external stress, and thus enhance the thermoelectric figure of merit. We find that the optical deformation potentials change very weakly as the proximity to the phase transition increases, but the population and scattering phase space of soft phonon modes increase. Nevertheless, scattering between electronic states near the band edge and soft optical phonons remains relatively weak even very near the phase transition.


title: Exponential-sum-approximation technique for variable-order time-fractional diffusion equations

abstract: In this paper, we study the variable-order (VO) time-fractional diffusion equations. For a VO function $\alpha(t)\in(0,1)$, we develop an exponential-sum-approximation (ESA) technique to approach the VO Caputo fractional derivative. The ESA technique keeps both the quadrature exponents and the number of exponentials in the summation unchanged at the different time levels. Approximating parameters are properly selected to achieve efficient accuracy. Compared with the general direct method, the proposed method reduces the storage requirement from $\mathcal{O}(n)$ to $\mathcal{O}(\log^2 n)$ and the computational cost from $\mathcal{O}(n^2)$ to $\mathcal{O}(n\log^2 n)$, respectively, with $n$ being the number of the time levels. When this fast algorithm is exploited to construct a fast ESA scheme for the VO time-fractional diffusion equations, the computational complexity of the proposed scheme is only of $\mathcal{O}(mn\log^2 n)$ with $\mathcal{O}(m\log^2n)$ storage requirement, where $m$ denotes the number of spatial grids. Theoretically, the unconditional stability and error analysis of the fast ESA scheme are given. The effectiveness of the proposed algorithm is verified by numerical examples.


title: A short proof on the rate of convergence of the empirical measure for the Wasserstein distance

abstract: We provide a short proof that the Wasserstein distance between the empirical measure of a n-sample and the estimated measure is of order n^-(1/d), if the measure has a lower and upper bounded density on the d-dimensional flat torus.


title: Effect of undecided agents on an opinion-forming model

abstract: The effect of undecided agents is studied within populations in an opinion-forming dynamic, varying the number of undecided agents for different proportions of populations in a complete opinion-exchange network. The result is that the dynamic depends on the number of undecided agents, with 10\% of the undecided population potentially affecting the change in consensus and then becoming linear with a negative slope.


title: 5 Reasons to expect an 8 MeV line in the SN 1987A neutrino spectrum

abstract: Evidence was previously reported for an 8 MeV neutrino line associated with SN 1987A based on an analysis of 997 events recorded in the Kamiokande-II detector on the day of the supernova. That claimed line, however, occurred at the peak of the background spectrum, and both had a similar shape, making the claim tenuous at best. Here the claim is buttressed by providing five reasons to expect such an 8 MeV neutrino line. A final section of the paper concerns the ongoing KATRIN experiment to find the neutrino mass, which might provide additional support for the line, should it validate a controversial 3 + 3 model of the neutrino masses, including a tachyonic (m2 < 0) mass.


title: Effective Energy Efficiency of Ultra-reliable Low Latency Communication

abstract: Effective Capacity defines the maximum communication rate subject to a specific delay constraint, while effective energy efficiency (EEE) indicates the ratio between effective capacity and power consumption. We analyze the EEE of ultra-reliable networks operating in the finite blocklength regime. We obtain a closed form approximation for the EEE in quasi-static Nakagami-$m$ (and Rayleigh as sub-case) fading channels as a function of power, error probability, and latency. Furthermore, we characterize the QoS constrained EEE maximization problem for different power consumption models, which shows a significant difference between finite and infinite blocklength coding with respect to EEE and optimal power allocation strategy. As asserted in the literature, achieving ultra-reliability using one transmission consumes huge amount of power, which is not applicable for energy limited IoT devices. In this context, accounting for empty buffer probability in machine type communication (MTC) and extending the maximum delay tolerance jointly enhances the EEE and allows for adaptive retransmission of faulty packets. Our analysis reveals that obtaining the optimum error probability for each transmission by minimizing the non-empty buffer probability approaches EEE optimality, while being analytically tractable via Dinkelbach's algorithm. Furthermore, the results illustrate the power saving and the significant EEE gain attained by applying adaptive retransmission protocols, while sacrificing a limited increase in latency.


title: Machine learning for rapid discovery of laminar flow channel wall modifications that enhance heat transfer

abstract: Numerical simulation of fluids plays an essential role in modeling many physical phenomena, which enables technological advancements, contributes to sustainable practices, and expands our understanding of various natural and engineered systems. The calculation of heat transfer in fluid flow in simple flat channels is a relatively easy task for various simulation methods. However, once the channel geometry becomes more complex, numerical simulations become a bottleneck in optimizing wall geometries. We present a combination of accurate numerical simulations of arbitrary, flat, and non-flat channels and machine learning models predicting drag coefficient and Stanton number. We show that convolutional neural networks (CNN) can accurately predict the target properties at a fraction of the time of numerical simulations. We use the CNN models in a virtual high-throughput screening approach to explore a large number of possible, randomly generated wall architectures. Data Augmentation was applied to existing geometries data to add generated new training data which have the same number of parameters of heat transfer to improve the model's generalization. The general approach is not only applicable to simple flow setups as presented here but can be extended to more complex tasks, such as multiphase or even reactive unit operations in chemical engineering.


title: Pulse energy distribution for RRAT J0139+33 according to observations at the frequency 111 MHz

abstract: Using five year monitoring observations, we did a blind search for pulses for rotating radio transient (RRAT) J0139+33 and PSR B0320+39. At the interval \pm 1.5m of the time corresponding to the source passing through the meridian, we detected 39377 individual pulses for the pulsar B0320+39 and 1013 pulses for RRAT J0139+33. The share of registered pulses from the total number of observed periods for the pulsar B0320+39 is 74%, and for the transient J0139+33 it is 0.42%. Signal-to-noise ratio (S/N) for the strongest registered pulses is approximately equal to: S/N = 262 (for B0320+39) and S/N = 154 (for J0139+33). Distributions of the number of detected pulses in S/N units for the pulsar and for the rotating transient are obtained. The distributions could be approximated with a lognormal and power dependencies. For B0320+39 pulsar, the dependence is lognormal, it turns into a power dependence at high values of S/N, and for RRAT J0139+33, the distribution of pulses by energy is described by a broken (bimodal) power dependence with an exponent of about 0.4 and 1.8 (S/N < 19 and S/N > 19). We have not detected regular (pulsar) emission of J0139+33. Analysis of the obtained data suggests that RRAT J0139+33 is a pulsar with giant pulses.


title: The (in)security of some recently proposed lightweight key distribution schemes

abstract: Two recently published papers propose some very simple key distribution schemes designed to enable two or more parties to establish a shared secret key with the aid of a third party. Unfortunately, as we show, most of the schemes are inherently insecure and all are incompletely specified - moreover, claims that the schemes are inherently lightweight are shown to be highly misleading. We also briefly critique a somewhat related very recent paper by the same authors that uses similar techniques to achieve what are claimed to be secure multiparty computations.


title: Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates

abstract: Annotating training data for sequence tagging of texts is usually very time-consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to significantly reduce the necessary annotation budget. We are the first to thoroughly investigate this powerful combination for the sequence tagging task. We conduct an extensive empirical study of various Bayesian uncertainty estimation methods and Monte Carlo dropout options for deep pre-trained models in the active learning framework and find the best combinations for different types of models. Besides, we also demonstrate that to acquire instances during active learning, a full-size Transformer can be substituted with a distilled version, which yields better computational performance and reduces obstacles for applying deep active learning in practice.


title: Zero-Cost Proxies for Lightweight NAS

abstract: Neural Architecture Search (NAS) is quickly becoming the standard methodology to design neural network models. However, NAS is typically compute-intensive because multiple models need to be evaluated before choosing the best one. To reduce the computational power and time needed, a proxy task is often used for evaluating each model instead of full training. In this paper, we evaluate conventional reduced-training proxies and quantify how well they preserve ranking between multiple models during search when compared with the rankings produced by final trained accuracy. We propose a series of zero-cost proxies, based on recent pruning literature, that use just a single minibatch of training data to compute a model's score. Our zero-cost proxies use 3 orders of magnitude less computation but can match and even outperform conventional proxies. For example, Spearman's rank correlation coefficient between final validation accuracy and our best zero-cost proxy on NAS-Bench-201 is 0.82, compared to 0.61 for EcoNAS (a recently proposed reduced-training proxy). Finally, we use these zero-cost proxies to enhance existing NAS search algorithms such as random search, reinforcement learning, evolutionary search and predictor-based search. For all search methodologies and across three different NAS datasets, we are able to significantly improve sample efficiency, and thereby decrease computation, by using our zero-cost proxies. For example on NAS-Bench-101, we achieved the same accuracy 4$\times$ quicker than the best previous result. Our code is made public at: https://github.com/mohsaied/zero-cost-nas.


title: Equivalence between condensation and boiling in a Lennard Jones fluid

abstract: Condensation and boiling are phase transitions highly relevant to industry, geology or atmospheric science. These phase transitions are initiated by the nucleation of a drop in a supersaturated vapor and of a bubble in an overstretched liquid respectively. The surface tension between both phases, liquid and vapor, is a key parameter in the development of such nucleation stage. Whereas the surface tension can be readily measured for a flat interface, there are technical and conceptual limitations to obtain it for the curved interface of the nucleus. On the technical side, it is quite difficult to observe a critical nucleus in experiments. From a conceptual point of view, the interfacial free energy depends on the choice of the dividing surface, being the surface of tension the one relevant for nucleation. We bypass the technical limitation by performing simulations of a Lennard Jones fluid where we equilibrate critical nuclei (both drops and bubbles). Regarding the conceptual hurdle, we find the relevant cluster size by searching the radius that correctly predicts nucleation rates and nucleation free energy barriers when combined with Classical Nucleation Theory. With such definition of the cluster size we find the same value of the surface tension for drops and bubbles of a given radius. Thus, condensation and boiling can be viewed as two sides of the same coin. Finally, we combine the data coming from drops and bubbles to obtain, via two different routes, estimates of the Tolman length, a parameter that allows describing the curvature dependence of the surface tension in a theoretical framework.


title: High-throughput fast full-color digital pathology based on Fourier ptychographic microscopy via color transfer

abstract: Full-color imaging is significant in digital pathology. Compared with a grayscale image or a pseudo-color image that only contains the contrast information, it can identify and detect the target object better with color texture information. Fourier ptychographic microscopy (FPM) is a high-throughput computational imaging technique that breaks the tradeoff between high resolution (HR) and large field-of-view (FOV), which eliminates the artifacts of scanning and stitching in digital pathology and improves its imaging efficiency. However, the conventional full-color digital pathology based on FPM is still time-consuming due to the repeated experiments with tri-wavelengths. A color transfer FPM approach, termed CFPM was reported. The color texture information of a low resolution (LR) full-color pathologic image is directly transferred to the HR grayscale FPM image captured by only a single wavelength. The color space of FPM based on the standard CIE-XYZ color model and display based on the standard RGB (sRGB) color space were established. Different FPM colorization schemes were analyzed and compared with thirty different biological samples. The average root-mean-square error (RMSE) of the conventional method and CFPM compared with the ground truth is 5.3% and 5.7%, respectively. Therefore, the acquisition time is significantly reduced by 2/3 with the sacrifice of precision of only 0.4%. And CFPM method is also compatible with advanced fast FPM approaches to reduce computation time further.


title: Modelling and Optimal Control of Multi Strain Epidemics, with Application to COVID-19

abstract: This work introduces a novel epidemiological model that simultaneously considers multiple viral strains, reinfections due to waning immunity response over time and an optimal control formulation. This enables us to derive optimal mitigation strategies over a prescribed time horizon under a more realistic framework that does not imply perennial immunity and a single strain, although these can also be derived as particular cases of our formulation. The model also allows estimation of the number of infections over time in the absence of mitigation strategies under any number of viral strains. We validate our approach in the light of the COVID-19 epidemic and present a number of experiments to shed light on the overall behaviour under one or two strains in the absence of sufficient mitigation measures. We also derive optimal control strategies for distinct mitigation costs and evaluate the effect of these costs on the optimal mitigation measures over a two-year horizon. The results show that relaxations in the mitigation measures cause a rapid increase in the number of cases, which then demand more restrictive measures in the future.


title: On the curvature extrema of special cubic B\'ezier curves

abstract: It is proved that special cubic B\'ezier curves, generated from quadratic curves by the use of a scalar parameter, have at most one local curvature extremum in the $(0,1)$ parameter interval.


title: Relativistic quantum information as radiation reaction: entanglement entropy and self-force of a moving mirror analog to the CGHS black hole

abstract: The CGHS black hole has a spectrum and temperature that corresponds to an accelerated reflecting boundary condition in flat spacetime. The beta coefficients are identical to a moving mirror model where the acceleration is exponential in laboratory time. The center and the event horizon of the black hole are at the same location modeled by the perfectly reflecting regularity condition that red-shifts the field modes. In addition to computing the energy flux, we find the corresponding parameter associated with the black hole mass and the cosmological constant in the gravitational analog system. Generalized to any mirror trajectory we derive the self-force (Lorentz-Abraham-Dirac) and express it and the power (Larmor) in connection with entanglement entropy, inviting an interpretation of acceleration radiation in terms of information flow. The mirror self-force and radiative power are applied to the particular CGHS black hole analog moving mirror which reveals the physics of information at the horizon during asymptotic approach to thermal equilibrium.


title: The effects of q-statistics on cosmology

abstract: Considering Verlinde's entropic gravity proposal, we focus the effects of fermionic $q$ deformation on the Einstein's field equations and Friedmann equations. For this purpose, we represent the thermodynamical properties of the deformed fermion gas model in two-dimensional space. To describe the behavior of the quantum black holes, deformed Einstein field equations are derived with the help of deformed entropy function. Moreover, deformed Friedmann equations are investigated by using Friedmann-Robertson-Walker (FRW) metric. We also present the effective ones of the energy density, the pressure, and the equation of state for the dark energy. Lastly, we derive an analytical expression of the effective density parameter of dark energy.


title: Positive spectrahedra: Invariance principles and Pseudorandom generators

abstract: In a recent work, O'Donnell, Servedio and Tan (STOC 2019) gave explicit pseudorandom generators (PRGs) for arbitrary $m$-facet polytopes in $n$ variables with seed length poly-logarithmic in $m,n$, concluding a sequence of works in the last decade, that was started by Diakonikolas, Gopalan, Jaiswal, Servedio, Viola (SICOMP 2010) and Meka, Zuckerman (SICOMP 2013) for fooling linear and polynomial threshold functions, respectively. In this work, we consider a natural extension of PRGs for intersections of positive spectrahedrons. A positive spectrahedron is a Boolean function $f(x)=[x_1A^1+\cdots +x_nA^n \preceq B]$ where the $A^i$s are $k\times k$ positive semidefinite matrices. We construct explicit PRGs that $\delta$-fool "regular" width-$M$ positive spectrahedrons (i.e., when none of the $A^i$s are dominant) over the Boolean space with seed length $\textsf{poly}(\log k,\log n, M, 1/\delta)$. Our main technical contributions are the following: We first prove an invariance principle for positive spectrahedra via the well-known Lindeberg method. As far as we are aware such a generalization of the Lindeberg method was unknown. Second, we prove an upper bound on noise sensitivity and a Littlewood-Offord theorem for positive spectrahedra. Using these results, we give applications for constructing PRGs for positive spectrahedra, learning theory, discrepancy sets for positive spectrahedra (over the Boolean cube) and PRGs for intersections of structured polynomial threshold functions.


title: Generalized Fej\'er-Hermite-Hadamard type via generalized $(h-m)$-convexity on fractal sets and applications

abstract: In this article, we define a new class of convexity called generalized $(h-m)$-convexity, which generalizes $h$-convexity and $m$-convexity on fractal sets $\mathbb{R}^{\alpha}$ $(0<\alpha\leq 1)$. Some properties of this new class are discussed. Using local fractional integrals and generalized $(h-m)$-convexity, we generalized Hermite-Hadamard (H-H) and Fej\'er-Hermite-Hadamard (Fej\'er-H-H) types inequalities. We also obtained a new result of the Fej\'er-H-H type for the function whose derivative in absolute value is the generalized $(h-m)$-convexity on fractal sets. Some applications to random variables and numerical integrations are studied.


title: Fast Evaluation for Relevant Quantities of Opinion Dynamics

abstract: One of the main subjects in the field of social networks is to quantify conflict, disagreement, controversy, and polarization, and some quantitative indicators have been developed to quantify these concepts. However, direct computation of these indicators involves the operations of matrix inversion and multiplication, which make it computationally infeasible for large-scale graphs with millions of nodes. In this paper, by reducing the problem of computing relevant quantities to evaluating $\ell_2$ norms of some vectors, we present a nearly linear time algorithm to estimate all these quantities. Our algorithm is based on the Laplacian solvers, and has a proved theoretical guarantee of error for each quantity. We execute extensive numerical experiments on a variety of real networks, which demonstrate that our approximation algorithm is efficient and effective, scalable to large graphs having millions of nodes.


title: Development of Large-Format Camera Systems Based on the Latest Generation Sensors for the 6-m Telescope

abstract: The design and implementation of astronomical cameras based on the large-format CCD and CMOS detectors is described in this paper. The Dinacon-5 controller is used for work with the CCDs and to achieve high performance and low noise. A new controller is designed for CMOS sensors. The main characteristics of the provided systems are estimated on the basis of experimental data. The spatial autocorrelation analysis is applied for PSF estimation. The obtained test results are presented.


title: The Log Moment formula for implied volatility

abstract: We revisit the foundational Moment Formula proved by Roger Lee fifteen years ago. We show that when the underlying stock price martingale admits finite log-moments E[|log(S)|^q] for some positive q, the arbitrage-free growth in the left wing of the implied volatility smile is less constrained than Lee's bound. The result is rationalised by a market trading discretely monitored variance swaps wherein the payoff is a function of squared log-returns, and requires no assumption for the underlying martingale to admit any negative moment. In this respect, the result can derived from a model-independent setup. As a byproduct, we relax the moment assumptions on the stock price to provide a new proof of the notorious Gatheral-Fukasawa formula expressing variance swaps in terms of the implied volatility.


title: Validation of the Virtual Reality Neuroscience Questionnaire: Maximum Duration of Immersive Virtual Reality Sessions Without the Presence of Pertinent Adverse Symptomatology

abstract: Research suggests that the duration of a VR session modulates the presence and intensity of VRISE, but there are no suggestions regarding the appropriate maximum duration of VR sessions. The implementation of high-end VR HMDs in conjunction with ergonomic VR software seems to mitigate the presence of VRISE substantially. However, a brief tool does not currently exist to appraise and report both the quality of software features and VRISE intensity quantitatively. The VRNQ was developed to assess the quality of VR software in terms of user experience, game mechanics, in-game assistance, and VRISE. Forty participants aged between 28 and 43 years were recruited (18 gamers and 22 non-gamers) for the study. They participated in 3 different VR sessions until they felt weary or discomfort and subsequently filled in the VRNQ. Our results demonstrated that VRNQ is a valid tool for assessing VR software as it has good convergent, discriminant, and construct validity. The maximum duration of VR sessions should be between 55-70 minutes when the VR software meets or exceeds the parsimonious cut-offs of the VRNQ and the users are familiarized with the VR system. Also. the gaming experience does not seem to affect how long VR sessions should last. Also, while the quality of VR software substantially modulates the maximum duration of VR sessions, age and education do not. Finally, deeper immersion, better quality of graphics and sound, and more helpful in-game instructions and prompts were found to reduce VRISE intensity. The VRNQ facilitates the brief assessment and reporting of the quality of VR software features and/or the intensity of VRISE, while its minimum and parsimonious cut-offs may appraise the suitability of VR software. The findings of this study contribute to the establishment of rigorous VR methods that are crucial for the viability of immersive VR as a research and clinical tool.


title: Vibrational Quenching of CN- in Collisions with He and Ar

abstract: The vibrational quenching cross sections and corresponding low-temperature rate constants for the v = 1 and v = 2 states of CN- colliding with He and Ar atoms have been computed ab initio using new three dimensional potential energy surfaces. Little work has so far been carried out on low-energy vibrationally inelastic collisions for anions with neutral atoms. The cross sections and rates calculated at energies and temperatures relevant for both ion traps and astrochemical modelling, are found by the present calculations to be even smaller than those of the similar C2- /He and C2-/Ar systems which are in turn of the order of those existing for the collisions involving neutral diatom-atom systems. The implications of our finding in the present case rather small computed rate constants are discussed for their possible role in the dynamics of molecular cooling and in the evolution of astrochemical modelling networks.


title: Dynamical Scaling of Surface Roughness and Entanglement Entropy in Disordered Fermion Models

abstract: Localization is one of the most fundamental interference phenomena caused by randomness, and its universal aspects have been extensively explored from the perspective of one-parameter scaling mainly for static properties. We numerically study dynamics of fermions on disordered onedimensional potentials exhibiting localization and find dynamical one-parameter scaling for surface roughness, which represents particle-number fluctuations at a given lengthscale, and for entanglement entropy when the system is in delocalized phases. This dynamical scaling corresponds to the Family-Vicsek scaling originally developed in classical surface growth, and the associated scaling exponents depend on the type of disorder. Notably, we find that partially localized states in the delocalized phase of the random-dimer model lead to anomalous scaling, where destructive interference unique to quantum systems leads to exponents unknown for classical systems and clean systems.


title: Constrained reachability problems for a planar manipulator

abstract: We address an optimal reachability problem for a planar manipulator in a constrained environment. After introducing the optmization problem in full generality, we practically embed the geometry of the workspace in the problem, by considering some classes of obstacles. To this end, we present an analytical approximation of the distance function from the ellipse. We then apply our method to particular models of hyper-redundant and soft manipulators, by also presenting some numerical experiments.


title: Optimising longitudinal and lateral calorimeter granularity for software compensation in hadronic showers using deep neural networks

abstract: We investigate the effect of longitudinal and transverse calorimeter segmentation on event-by-event software compensation for hadronic showers. To factorize out sampling and electronics effects, events are simulated in which a single charged pion is shot at a homogenous lead glass calorimeter, split into longitudinal and transverse segments of varying size. As an approximation of an optimal reconstruction, a neural network-based energy regression is trained. The architecture is based on blocks of convolutional kernels customized for shower energy regression using local energy densities; biases at the edges of the training dataset are mitigated using a histogram technique. With this approximation, we find that a longitudinal and transverse segment size less than or equal to 0.5 and 1.3 nuclear interaction lengths, respectively, is necessary to achieve an optimal energy measurement. In addition, an intrinsic energy resolution of $8\%/\sqrt{E}$ for pion showers is observed.


title: Composable Programming of Hybrid Workflows for Quantum Simulation

abstract: We present a composable design scheme for the development of hybrid quantum/classical algorithms and workflows for applications of quantum simulation. Our object-oriented approach is based on constructing an expressive set of common data structures and methods that enable programming of a broad variety of complex hybrid quantum simulation applications. The abstract core of our scheme is distilled from the analysis of the current quantum simulation algorithms. Subsequently, it allows a synthesis of new hybrid algorithms and workflows via the extension, specialization, and dynamic customization of the abstract core classes defined by our design. We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library. To validate our implementation, we test and show its utility on commercial quantum processors from IBM, running some prototypical quantum simulations.


title: Rank the Episodes: A Simple Approach for Exploration in Procedurally-Generated Environments

abstract: Exploration under sparse reward is a long-standing challenge of model-free reinforcement learning. The state-of-the-art methods address this challenge by introducing intrinsic rewards to encourage exploration in novel states or uncertain environment dynamics. Unfortunately, methods based on intrinsic rewards often fall short in procedurally-generated environments, where a different environment is generated in each episode so that the agent is not likely to visit the same state more than once. Motivated by how humans distinguish good exploration behaviors by looking into the entire episode, we introduce RAPID, a simple yet effective episode-level exploration method for procedurally-generated environments. RAPID regards each episode as a whole and gives an episodic exploration score from both per-episode and long-term views. Those highly scored episodes are treated as good exploration behaviors and are stored in a small ranking buffer. The agent then imitates the episodes in the buffer to reproduce the past good exploration behaviors. We demonstrate our method on several procedurally-generated MiniGrid environments, a first-person-view 3D Maze navigation task from MiniWorld, and several sparse MuJoCo tasks. The results show that RAPID significantly outperforms the state-of-the-art intrinsic reward strategies in terms of sample efficiency and final performance. The code is available at https://github.com/daochenzha/rapid


title: Shielding Atari Games with Bounded Prescience

abstract: Deep reinforcement learning (DRL) is applied in safety-critical domains such as robotics and autonomous driving. It achieves superhuman abilities in many tasks, however whether DRL agents can be shown to act safely is an open problem. Atari games are a simple yet challenging exemplar for evaluating the safety of DRL agents and feature a diverse portfolio of game mechanics. The safety of neural agents has been studied before using methods that either require a model of the system dynamics or an abstraction; unfortunately, these are unsuitable to Atari games because their low-level dynamics are complex and hidden inside their emulator. We present the first exact method for analysing and ensuring the safety of DRL agents for Atari games. Our method only requires access to the emulator. First, we give a set of 43 properties that characterise "safe behaviour" for 30 games. Second, we develop a method for exploring all traces induced by an agent and a game and consider a variety of sources of game non-determinism. We observe that the best available DRL agents reliably satisfy only very few properties; several critical properties are violated by all agents. Finally, we propose a countermeasure that combines a bounded explicit-state exploration with shielding. We demonstrate that our method improves the safety of all agents over multiple properties.


title: Fooling thermal infrared pedestrian detectors in real world using small bulbs

abstract: Thermal infrared detection systems play an important role in many areas such as night security, autonomous driving, and body temperature detection. They have the unique advantages of passive imaging, temperature sensitivity and penetration. But the security of these systems themselves has not been fully explored, which poses risks in applying these systems. We propose a physical attack method with small bulbs on a board against the state of-the-art pedestrian detectors. Our goal is to make infrared pedestrian detectors unable to detect real-world pedestrians. Towards this goal, we first showed that it is possible to use two kinds of patches to attack the infrared pedestrian detector based on YOLOv3. The average precision (AP) dropped by 64.12% in the digital world, while a blank board with the same size caused the AP to drop by 29.69% only. After that, we designed and manufactured a physical board and successfully attacked YOLOv3 in the real world. In recorded videos, the physical board caused AP of the target detector to drop by 34.48%, while a blank board with the same size caused the AP to drop by 14.91% only. With the ensemble attack techniques, the designed physical board had good transferability to unseen detectors. We also proposed the first physical multispectral (infrared and visible) attack. By using a combination method, we successfully hide from the visible light and infrared object detection systems at the same time.


title: On the Readability of Abstract Set Visualizations

abstract: Set systems are used to model data that naturally arises in many contexts: social networks have communities, musicians have genres, and patients have symptoms. Visualizations that accurately reflect the information in the underlying set system make it possible to identify the set elements, the sets themselves, and the relationships between the sets. In static contexts, such as print media or infographics, it is necessary to capture this information without the help of interactions. With this in mind, we consider three different systems for medium-sized set data, LineSets, EulerView, and MetroSets, and report the results of a controlled human-subjects experiment comparing their effectiveness. Specifically, we evaluate the performance, in terms of time and error, on tasks that cover the spectrum of static set-based tasks. We also collect and analyze qualitative data about the three different visualization systems. Our results include statistically significant differences, suggesting that MetroSets performs and scales better.


title: Extensive Studies of the Neutron Star Equation of State from the Deep Learning Inference with the Observational Data Augmentation

abstract: We discuss deep learning inference for the neutron star equation of state (EoS) using the real observational data of the mass and the radius. We make a quantitative comparison between the conventional polynomial regression and the neural network approach for the EoS parametrization. For our deep learning method to incorporate uncertainties in observation, we augment the training data with noise fluctuations corresponding to observational uncertainties. Deduced EoSs can accommodate a weak first-order phase transition, and we make a histogram for likely first-order regions. We also find that our observational data augmentation has a byproduct to tame the overfitting behavior. To check the performance improved by the data augmentation, we set up a toy model as the simplest inference problem to recover a double-peaked function and monitor the validation loss. We conclude that the data augmentation could be a useful technique to evade the overfitting without tuning the neural network architecture such as inserting the dropout.

categories: nucl-th astro-ph.HE astro-ph.IM cs.LG hep-ph


title: Spin-current mediated exchange coupling in MgO-based magnetic tunnel junctions

abstract: Heterostructures composed of ferromagnetic layers that are mutually interacting through a nonmagnetic spacer are at the core of magnetic sensor and memory devices. In the present study, layer-resolved ferromagnetic resonance was used to investigate the coupling between the magnetic layers of a Co/MgO/Permalloy magnetic tunnel junction. Two magnetic resonance peaks were observed for both magnetic layers, as probed at the Co and Ni L3 x-ray absorption edges, showing a strong interlayer interaction through the insulating MgO barrier. A theoretical model based on the Landau-Lifshitz-Gilbert-Slonczewski equation was developed, including exchange coupling and spin pumping between the magnetic layers. Fits to the experimental data were carried out, both with and without a spin pumping term, and the goodness of the fit was compared using a likelihood ratio test. This rigorous statistical approach provides an unambiguous proof of the existence of interlayer coupling mediated by spin pumping.


title: Focal and Efficient IOU Loss for Accurate Bounding Box Regression

abstract: In object detection, bounding box regression (BBR) is a crucial step that determines the object localization performance. However, we find that most previous loss functions for BBR have two main drawbacks: (i) Both $\ell_n$-norm and IOU-based loss functions are inefficient to depict the objective of BBR, which leads to slow convergence and inaccurate regression results. (ii) Most of the loss functions ignore the imbalance problem in BBR that the large number of anchor boxes which have small overlaps with the target boxes contribute most to the optimization of BBR. To mitigate the adverse effects caused thereby, we perform thorough studies to exploit the potential of BBR losses in this paper. Firstly, an Efficient Intersection over Union (EIOU) loss is proposed, which explicitly measures the discrepancies of three geometric factors in BBR, i.e., the overlap area, the central point and the side length. After that, we state the Effective Example Mining (EEM) problem and propose a regression version of focal loss to make the regression process focus on high-quality anchor boxes. Finally, the above two parts are combined to obtain a new loss function, namely Focal-EIOU loss. Extensive experiments on both synthetic and real datasets are performed. Notable superiorities on both the convergence speed and the localization accuracy can be achieved over other BBR losses.


title: Cohomogeneity One Groupoid Analysis of the Dynamical System of Rings of Continuous Functions

abstract: Using the group $G(1)$ of invertible elements and the maximal ideals $\mathfrak{m}_x$ of the commutative algebra $C(X)$ of real-valued functions on a compact regular space $X$, we define a Borel action of the algebra on the measure space $(X,\mu)$ with $\mu$ a Radon measure. The zero sets $Z(X)$ of the algebra $C(X)$ is used to study the ergodicity of the $G(1)$-action via its action on the maximal ideals $\mathfrak{m}_x$ which defines an action groupoid $\mathcal{G} = \mathfrak{m}_x \ltimes G(1)$ trivialized on $X$. The resulting measure groupoid $(\mathcal{G},\mathcal{C})$ is used to define a proper action on the generalized space $\mathcal{M}(X)$. The existence of slice at each point of $\mathcal{M}(X)$ present it as a cohomogeneity-one $\mathcal{G}$-space. The dynamical system of the algebra $C(X)$ is defined by the action of the measure groupoid $(\mathcal{G},\mathcal{C}) \times \mathcal{M}(X) \to \mathcal{M}(X)$.


title: Optimal Low-Thrust Orbit Transfers Made Easy: A Direct Approach

abstract: The optimization of low-thrust, multi-revolution orbit transfer trajectories is often regarded as a difficult problem in modern astrodynamics. In this paper, a flexible and computationally efficient approach is presented for the optimization of low-thrust orbit transfers under eclipse constraints. The proposed approach leverages a new dynamic model of the orbital motion and a Lyapunov-based initial guess generation scheme that is very easy to tune. A multi-objective, single-phase formulation of the optimal control problem is devised, which provides a convenient way to trade off fuel consumption and time of flight. A distinctive feature of such a formulation is that it requires no prior information about the structure of the optimal solution. Simulation results for two benchmark orbit transfer scenarios indicate that minimum-time, minimum-fuel and mixed time/fuel-optimal instances of the control problem can be readily solved via direct collocation, while incurring a significantly lower computational demand with respect to existing techniques.


title: Rational numbers represented by sign-variable Cantor series

abstract: The present article is devoted to representations of rational numbers in terms sign-variable Cantor expansions. The main attention is given to one of the discussions given by J. Galambos in [4].


title: Lessons from the German Tank Problem

abstract: During World War II the German army used tanks to devastating advantage. The Allies needed accurate estimates of their tank production and deployment. They used two approaches to find these values: spies, and statistics. This note describes the statistical approach. Assuming the tanks are labeled consecutively starting at 1, if we observe $k$ serial numbers from an unknown number $N$ of tanks, with the maximum observed value $m$, then the best estimate for $N$ is $m(1 + 1/k) - 1$. This is now known as the German Tank Problem, and is a terrific example of the applicability of mathematics and statistics in the real world. The first part of the paper reproduces known results, specifically deriving this estimate and comparing its effectiveness to that of the spies. The second part presents a result we have not found in print elsewhere, the generalization to the case where the smallest value is not necessarily 1. We emphasize in detail why we are able to obtain such clean, closed-form expressions for the estimates, and conclude with an appendix highlighting how to use this problem to teach regression and how statistics can help us find functional relationships.


title: Pairing Pythagorean Pairs

abstract: A pair $(a, b)$ of positive integers is a pythagorean pair if $a^2 + b^2 = \Box$ (i.e., $a^2 + b^2$ is a square). A pythagorean pair $(a, b)$ is called a double-pythapotent pair if there is another pythagorean pair $(k,l)$ such that $(ak,bl)$ is a pythagorean pair, and it is called a quadratic pythapotent pair if there is another pythagorean pair $(k,l)$ which is not a multiple of $(a,b)$, such that $(a^2k,b^2l)$ is a pythagorean pair. To each pythagorean pair $(a, b)$ we assign an elliptic curve $\Gamma_{a,b}$ with torsion group $\mathbb Z/2\mathbb Z\times\mathbb Z/4\mathbb Z$, such that $\Gamma_{a,b}$ has positive rank if and only if $(a, b)$ is a double-pythapotent pair. Similarly, to each pythagorean pair $(a, b)$ we assign an elliptic curve $\Gamma_{a^2 ,b^2}$ with torsion group $\mathbb Z/2\mathbb Z\times\mathbb Z/8\mathbb Z$, such that $\Gamma_{a^2,b^2}$ has positive rank if and only if $(a,b)$ is a quadratic pythapotent pair. Moreover, in the later case we obtain that every elliptic curve $\Gamma$ with torsion group $\mathbb Z/2\mathbb Z\times\mathbb Z/8\mathbb Z$ is isomorphic to a curve of the form $\Gamma_{a^2 ,b^2}$ , where $(a,b)$ is a pythagorean pair. As a side-result we get that if $(a,b)$ is a double-pythapotent pair, then there are infinitely many pythagorean pairs $(k, l)$, not multiples of each other, such that $(ak, bl)$ is a pythagorean pair; the analogous result holds for quadratic pythapotent pairs.


title: Successive occurrences of quasi-circular ribbon flares in a fan-spine-like configuration involving hyperbolic flux tube

abstract: We present a comprehensive analysis of the formation and evolution of a fan-spine-like configuration that developed over a complex photospheric configuration where dispersed negative polarity regions were surrounded by positive polarity regions. This unique photospheric configuration, analogous to the geological "atoll" shape, hosted four homologous flares within its boundary. Computation of the degree of squashing factor (Q) maps clearly revealed an elongated region of high Q-values between the inner and outer spine-like lines, implying the presence of an hyperbolic flux tube (HFT). The coronal region associated with the photospheric atoll configuration was distinctly identified in the form of a diffused dome-shaped bright structure directly observed in EUV images. A filament channel resided near the boundary of the atoll region. The activation and eruption of flux ropes from the filament channel led to the onset of four eruptive homologous quasi-circular ribbon flares within an interval of $\approx$11 hours. During the interval of the four flares, we observed continuous decay and cancellation of negative polarity flux within the atoll region. Accordingly, the apparent length of the HFT gradually reduced to a null-point-like configuration before the fourth flare. Prior to each flare, we observed localised brightening beneath the filaments which, together with flux cancellation, provided support for the tether-cutting model of solar eruption. The analysis of magnetic decay index revealed favourable conditions for the eruption, once the pre-activated flux ropes attained the critical heights for torus instability.


title: Video Relation Detection with Trajectory-aware Multi-modal Features

abstract: Video relation detection problem refers to the detection of the relationship between different objects in videos, such as spatial relationship and action relationship. In this paper, we present video relation detection with trajectory-aware multi-modal features to solve this task. Considering the complexity of doing visual relation detection in videos, we decompose this task into three sub-tasks: object detection, trajectory proposal and relation prediction. We use the state-of-the-art object detection method to ensure the accuracy of object trajectory detection and multi-modal feature representation to help the prediction of relation between objects. Our method won the first place on the video relation detection task of Video Relation Understanding Grand Challenge in ACM Multimedia 2020 with 11.74\% mAP, which surpasses other methods by a large margin.


title: Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL)

abstract: Virtual reality (VR) head-mounted displays (HMD) appear to be effective research tools, which may address the problem of ecological validity in neuropsychological testing. However, their widespread implementation is hindered by VR induced symptoms and effects (VRISE) and the lack of skills in VR software development. This study offers guidelines for the development of VR software in cognitive neuroscience and neuropsychology, by describing and discussing the stages of the development of Virtual Reality Everyday Assessment Lab (VR-EAL), the first neuropsychological battery in immersive VR. Techniques for evaluating cognitive functions within a realistic storyline are discussed. The utility of various assets in Unity, software development kits, and other software are described so that cognitive scientists can overcome challenges pertinent to VRISE and the quality of the VR software. In addition, this pilot study attempts to evaluate VR-EAL in accordance with the necessary criteria for VR software for research purposes. The VR neuroscience questionnaire (VRNQ; Kourtesis et al., 2019b) was implemented to appraise the quality of the three versions of VR-EAL in terms of user experience, game mechanics, in-game assistance, and VRISE. Twenty-five participants aged between 20 and 45 years with 12-16 years of full-time education evaluated various versions of VR-EAL. The final version of VR-EAL achieved high scores in every sub-score of the VRNQ and exceeded its parsimonious cut-offs. It also appeared to have better in-game assistance and game mechanics, while its improved graphics substantially increased the quality of the user experience and almost eradicated VRISE. The results substantially support the feasibility of the development of effective VR research and clinical software without the presence of VRISE during a 60-minute VR session.


title: Neural-based Modeling for Performance Tuning of Spark Data Analytics

abstract: Cloud data analytics has become an integral part of enterprise business operations for data-driven insight discovery. Performance modeling of cloud data analytics is crucial for performance tuning and other critical operations in the cloud. Traditional modeling techniques fail to adapt to the high degree of diversity in workloads and system behaviors in this domain. In this paper, we bring recent Deep Learning techniques to bear on the process of automated performance modeling of cloud data analytics, with a focus on Spark data analytics as representative workloads. At the core of our work is the notion of learning workload embeddings (with a set of desired properties) to represent fundamental computational characteristics of different jobs, which enable performance prediction when used together with job configurations that control resource allocation and other system knobs. Our work provides an in-depth study of different modeling choices that suit our requirements. Results of extensive experiments reveal the strengths and limitations of different modeling methods, as well as superior performance of our best performing method over a state-of-the-art modeling tool for cloud analytics.


title: Optimal-order convergence of Nesterov acceleration for linear ill-posed problems

abstract: We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a priori stopping rule and for the discrepancy principle. The essential tool to obtain this result is a representation of the residual polynomials via Gegenbauer polynomials.


title: mt5se: An Open Source Framework for Building Autonomous Trading Robots

abstract: Autonomous trading robots have been studied in artificial intelligence area for quite some time. Many AI techniques have been tested for building autonomous agents able to trade financial assets. These initiatives include traditional neural networks, fuzzy logic, reinforcement learning but also more recent approaches like deep neural networks and deep reinforcement learning. Many developers claim to be successful in creating robots with great performance when simulating execution with historical price series, so called backtesting. However, when these robots are used in real markets frequently they present poor performance in terms of risks and return. In this paper, we propose an open source framework (mt5se) that helps the development, backtesting, live testing and real operation of autonomous traders. We built and tested several traders using mt5se. The results indicate that it may help the development of better traders. Furthermore, we discuss the simple architecture that is used in many studies and propose an alternative multiagent architecture. Such architecture separates two main concerns for portfolio manager (PM) : price prediction and capital allocation. More than achieve a high accuracy, a PM should increase profits when it is right and reduce loss when it is wrong. Furthermore, price prediction is highly dependent of asset's nature and history, while capital allocation is dependent only on analyst's prediction performance and assets' correlation. Finally, we discuss some promising technologies in the area.


title: SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism

abstract: Graph representation learning has attracted increasing research attention. However, most existing studies fuse all structural features and node attributes to provide an overarching view of graphs, neglecting finer substructures' semantics, and suffering from interpretation enigmas. This paper presents a novel hierarchical subgraph-level selection and embedding based graph neural network for graph classification, namely SUGAR, to learn more discriminative subgraph representations and respond in an explanatory way. SUGAR reconstructs a sketched graph by extracting striking subgraphs as the representative part of the original graph to reveal subgraph-level patterns. To adaptively select striking subgraphs without prior knowledge, we develop a reinforcement pooling mechanism, which improves the generalization ability of the model. To differentiate subgraph representations among graphs, we present a self-supervised mutual information mechanism to encourage subgraph embedding to be mindful of the global graph structural properties by maximizing their mutual information. Extensive experiments on six typical bioinformatics datasets demonstrate a significant and consistent improvement in model quality with competitive performance and interpretability.


title: tRecX -- an environment for solving time-dependent Schr\"odinger-like problems

abstract: TRecX is a C++ code for solving generalized inhomogeneous time-dependent Schr\"odinger-type equations $id\Psi/dt = H[t,\Psi] + \Phi$ in arbitrary dimensions and in a variety of coordinate systems. The operator $H[t,\Psi]$ may have simple non-linearities, as in Gross-Pitaevskii and Hartree(-Fock) problems. Primary application of tRecX has been non-perturbative strong-field single and double photo-electron emission in atomic and molecular physics. The code is designed for large-scale {\it ab initio} calculations, for exploring models, and for advanced teaching in computational physics. Distinctive numerical methods are the time-dependent surface flux method for the computation of single and double emission spectra and exterior complex scaling for absorption. Wave functions and operators are handled by tree-structures with the systematic use of recursion on the coarse-grain level. Numerical, analytic, and grid-based discretizations can be combined and are treated on the same abstract level. Operators are specified in the input using a script language including symbolic algebra. User-friendly in- and output, error safety, and documentation are integrated by design.


title: Characterisation of the hydrospheres of TRAPPIST-1 planets

abstract: Context. Planetary mass and radius data are showing a wide variety in densities of low-mass exoplanets. This includes sub-Neptunes, whose low densities can be explained with the presence of a volatile-rich layer. Water is one of the most abundant volatiles, which can be in the form of different phases depending on the planetary surface conditions. To constrain their composition and interior structure, it is required to develop models that calculate accurately the properties of water at its different phases. Aims. We present an interior structure model that includes a multiphase water layer with steam, supercritical and condensed phases. We derive the constraints for planetary compositional parameters and their uncertainties, focusing on the multiplanetary system TRAPPIST-1, which presents both warm and temperate planets. Methods. We use a 1D steam atmosphere in radiative-convective equilibrium with an interior whose water layer is in supercritical phase self-consistently. For temperate surface conditions, we implement liquid and ice Ih to ice VII phases in the hydrosphere. We adopt a MCMC inversion scheme to derive the probability distributions of core and water compositional parameters Results. We refine the composition of all planets and derive atmospheric parameters for planets b and c. The latter would be in a post-runaway greenhouse state and could be extended enough to be probed by space mission such as JWST. Planets d to h present condensed ice phases, with maximum water mass fractions below 20%. Conclusions. The derived amounts of water for TRAPPIST-1 planets show a general increase with semi-major axis, with the exception of planet d. This deviation from the trend could be due to formation mechanisms, such as migration and an enrichment of water in the region where planet d formed, or an extended CO$_{2}$-rich atmosphere.


title: Quasirandom Graphs and the Pantograph Equation

abstract: The pantograph differential equation and its solution, the deformed exponential function, are remarkable objects that appear in areas as diverse as combinatorics, number theory, statistical mechanics, and electrical engineering. In this article we describe a new surprising application of these objects in graph theory, by showing that the set of all cliques is not forcing for quasirandomness. This provides a natural example of an infinite family of graphs, which is not forcing, and answers a natural question posed by P. Horn.


title: A mathematical model to describe the alpha dose rate from a UO2 surface

abstract: A model to determine the dose rate of a planar alpha-emitting surface, has been developed. The approach presented is a computationally efficient mathematical model using stopping range data from the Stopping Ranges of Ions in Matter (SRIM) software. The alpha dose rates as a function of distance from irradiated UO2 spent fuel surfaces were produced for bench-marking with previous modelling attempts. This method is able to replicate a Monte Carlo (MCNPX) study of an irradiated UO2 fuel surface within 0.6 % of the resulting total dose rate and displays a similar dose profile.


title: Bayesian GARCH Modeling of Functional Sports Data

abstract: The use of statistical methods in sport analytics has gained a rapidly growing interest over the last decade, and nowadays is common practice. In particular, the interest in understanding and predicting an athlete's performance throughout his/her career is motivated by the need to evaluate the efficacy of training programs, anticipate fatigue to prevent injuries and detect unexpected of disproportionate increases in performance that might be indicative of doping. Moreover, fast evolving data gathering technologies require up to date modelling techniques that adapt to the distinctive features of sports data. In this work, we propose a hierarchical Bayesian model for describing and predicting the evolution of performance over time for shot put athletes. To account for seasonality and heterogeneity in recorded results, we rely both on a smooth functional contribution and on a linear mixed effect model with heteroskedastic errors to represent the athlete-specific trajectories. The resulting model provides an accurate description of the performance trajectories and helps specifying both the intra- and inter-seasonal variability of measurements. Further, the model allows for the prediction of athletes' performance in future seasons. We apply our model to an extensive real world data set on performance data of professional shot put athletes recorded at elite competitions.


title: Introduction to Normalizing Flows for Lattice Field Theory

abstract: This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072, arXiv:2002.02428, and arXiv:2003.06413 are reviewed and a concrete implementation of the framework is presented. We apply this framework to a lattice scalar field theory and to U(1) gauge theory, explicitly encoding gauge symmetries in the flow-based approach to the latter. This presentation is intended to be interactive and working with the attached Jupyter notebook is recommended.


title: On Provable Backdoor Defense in Collaborative Learning

abstract: As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden backdoors. The so-called backdoor attacks are especially difficult to detect since the model behaves normally on standard test data but gives wrong outputs when triggered by certain backdoor keys. Although Byzantine-tolerant training algorithms provide convergence guarantee, provable defense against backdoor attacks remains largely unsolved. Methods based on randomized smoothing can only correct a small number of corrupted pixels or labels; methods based on subset aggregation cause a severe drop in classification accuracy due to low data utilization. We propose a novel framework that generalizes existing subset aggregation methods. The framework shows that the subset selection process, a deciding factor for subset aggregation methods, can be viewed as a code design problem. We derive the theoretical bound of data utilization ratio and provide optimal code construction. Experiments on non-IID versions of MNIST and CIFAR-10 show that our method with optimal codes significantly outperforms baselines using non-overlapping partition and random selection. Additionally, integration with existing coding theory results shows that special codes can track the location of the attackers. Such capability provides new countermeasures to backdoor attacks.


title: Relic gravitational waves from the chiral magnetic effect

abstract: Relic gravitational waves (GWs) can be produced by primordial magnetic fields. However, not much is known about the resulting GW amplitudes and their dependence on the details of the generation mechanism. Here we treat magnetic field generation through the chiral magnetic effect (CME) as a generic mechanism and explore its dependence on the speed of generation (the product of magnetic diffusivity and characteristic wavenumber) and the speed characterizing the maximum magnetic field strength expected from the CME. When the latter exceeds the former (regime I), the regime applicable to the early universe, we obtain an inverse cascade with moderate GW energy that scales with the third power of the magnetic energy. When the generation speed exceeds the CME limit (regime II), the GW energy continues to increase without a corresponding increase of magnetic energy. In the early kinematic phase, the GW energy spectrum (per linear wavenumber interval) has opposite slopes in both regimes and is characterized by an inertial range spectrum in regime I and a white noise spectrum in regime II. The occurrence of these two slopes is shown to be a generic consequence of a nearly monochromatic exponential growth of the magnetic field. The resulting GW energy is found to be proportional to the fifth power of the limiting CME speed and the first power of the generation speed.


title: Reaching the sensitivity limit of a Sagnac gyroscope through linear regression analysis

abstract: The sensitivity to angular rotation of the top class Sagnac gyroscope GINGERINO is carefully investigated with standard statistical means, using 103 days of continuous operation and the available geodesic measurements of the Earth angular rotation rate. All features of the Earth rotation rate are correctly reproduced. The sensitivity of fractions of frad/s is attained for long term runs. This excellent sensitivity and stability put Sagnac gyroscopes at the forefront for fundamental physics, in particular for tests of general relativity and Lorentz violation, where the sensitivity plays the key role to provide reliable data for deeper theoretical investigations. The achieved sensitivity overcomes the conventionally expected one for Sagnac ring laser gyroscopes.


title: Validating Fewest-Switches Surface Hopping in the Presence of Laser Fields

abstract: The capability of fewest-switches surface hopping (FSSH) to describe non-adiabatic dynamics of small and medium sized molecules under explicit excitation with external fields is evaluated. Different parameters in FSSH and combinations thereof are benchmarked against multi-configurational time dependent Hartree (MCTDH) reference calculations using SO$_2$ and 2-thiocytosine as model, yet realistic, molecular systems. Qualitatively, we find that FSSH is able to reproduce the trends in the MCTDH dynamics with (and without) an explicit external field; however, no set of FSSH parameters is ideal. An adequate treatment of the overcoherence in FSSH is identified as the driving factor to improve the description of the excitation process with respect to the MCTDH reference. Here two corrections were tested, the augmented-FSSH (AFSSH) and the energy-based decoherence correction. A dependence on the employed basis is detected for the AFSSH algorithm, performing better when spin-orbit and external laser field couplings are treated as off-diagonal elements instead of projecting them onto the diagonal of the Hamilton operator. In the presence of an electric field, the excited state dynamics was found to depend strongly on the vector used to rescale the kinetic energy along after a transition between surfaces. For SO$_2$, recurrence of the excited wave packet throughout the duration of the applied laser pulse is observed for long laser pulses (>100~fs), resulting in additional interferences not captured by FSSH and only visible in variational multi-configurational Gaussian when utilizing a large amount of gaussian basis functions. This feature essentially vanishes when going towards larger molecules, such as 2-thiocytosine, where this effect is barely visible in a laser pulse with a full width at half maximum of 200~fs.


title: Fair Asynchronous Session Subtyping

abstract: Session types are widely used as abstractions of asynchronous message passing systems. Refinement for such abstractions is crucial as it allows improvements of a given component without compromising its compatibility with the rest of the system. In the context of session types, the most general notion of refinement is asynchronous session subtyping, which allows message emissions to be anticipated w.r.t. a bounded amount of message consumptions. In this paper we investigate the possibility to anticipate emissions w.r.t. an unbounded amount of consumptions: to this aim we propose to consider fair compliance over asynchronous session types and fair refinement as the relation that preserves it. This allows us to propose a novel variant of session subtyping that leverages the notion of controllability from service contract theory and that is a sound characterisation of fair refinement. In addition, we show that both fair refinement and our novel subtyping are undecidable. We also present a sound algorithm which deals with examples that feature potentially unbounded buffering. Finally, we present an implementation of our algorithm and an empirical evaluation of it on synthetic benchmarks.


title: Coherently combined 16 channel multicore fiber laser system

abstract: We present a coherently combined laser amplifier with 16 channels from a multicore fiber in a proof-of-principle demonstration. Filled aperture beam splitting and combination together with temporal phasing is realized in a compact and low-component-count setup. Combined average power of up to 70 W with 40 ps pulses are achieved with combination efficiencies around 80%.


title: Mask-GD Segmentation Based Robotic Grasp Detection

abstract: The reliability of grasp detection for target objects in complex scenes is a challenging task and a critical problem that needs to be solved urgently in practical application. At present, the grasp detection location comes from searching the feature space of the whole image. However, the cluttered background information in the image impairs the accuracy of grasping detection. In this paper, a robotic grasp detection algorithm named MASK-GD is proposed, which provides a feasible solution to this problem. MASK is a segmented image that only contains the pixels of the target object. MASK-GD for grasp detection only uses MASK features rather than the features of the entire image in the scene. It has two stages: the first stage is to provide the MASK of the target object as the input image, and the second stage is a grasp detector based on the MASK feature. Experimental results demonstrate that MASK-GD's performance is comparable with state-of-the-art grasp detection algorithms on Cornell Datasets and Jacquard Dataset. In the meantime, MASK-GD performs much better in complex scenes.


title: Fixpoint Theory -- Upside Down

abstract: Knaster-Tarski's theorem, characterising the greatest fixpoint of a monotone function over a complete lattice as the largest post-fixpoint, naturally leads to the so-called coinduction proof principle for showing that some element is below the greatest fixpoint (e.g., for providing bisimilarity witnesses). The dual principle, used for showing that an element is above the least fixpoint, is related to inductive invariants. In this paper we provide proof rules which are similar in spirit but for showing that an element is above the greatest fixpoint or, dually, below the least fixpoint. The theory is developed for non-expansive monotone functions on suitable lattices of the form $\mathbb{M}^Y$, where $Y$ is a finite set and $\mathbb{M}$ an MV-algebra, and it is based on the construction of (finitary) approximations of the original functions. We show that our theory applies to a wide range of examples, including termination probabilities, metric transition systems, behavioural distances for probabilistic automata and bisimilarity. Moreover it allows us to determine original algorithms for solving simple stochastic games.


title: Energetic sub-2-cycle laser with 220 W average power

abstract: Few-cycle lasers are essential for many research areas such as attosecond physics that promises to address fundamental questions in science and technology. Therefore, further advancements are connected to significant progress in the underlying laser technology. Here, two-stage nonlinear compression of a 660 W femtosecond fiber laser system is utilized to achieve unprecedented average power levels of energetic ultrashort or even few-cycle laser pulses. In a first compression step 408 W, 320 uJ, 30fs pulses are achieved, which can be further compressed to 216 W, 170 uJ, 6.3 fs pulses in a second compression stage. This is the highest average power few-cycle laser system presented so far. It is expected to significantly advance the fields of high harmonic generation and attosecond science.


title: Radiative process of two entangled uniformly accelerated atoms in a thermal bath: a possible case of anti-Unruh event

abstract: We study the radiative process of two entangled two-level atoms uniformly accelerated in a thermal bath, coupled to a massless scalar field. First, using the positive frequency Wightman function from the Minkowski modes with a Rindler transformation we provide the transition probabilities for the transitions from maximally entangled symmetric and anti-symmetric Bell states to the collective excited state in $(1+1)$ and $(1+3)$ dimensions. We observe a possible case of \emph{anti-Unruh-like} event in these transition probabilities, though the $(1+1)$ and $(1+3)$ dimensional results are not completely equivalent. We infer that thermal bath plays a major role in the occurrence of the anti-Unruh-like effect, as it is also present in the transition probabilities corresponding to a single detector in this case. Second, we have considered the Green's functions in terms of the Rindler modes with the vacuum of Unruh modes for estimating the same. Here the anti-Unruh effect appears only for the transition from the anti-symmetric state to the collective excited state. It is noticed that here the $(1+1)$ and $(1+3)$ dimensional results are equivalent, and for a single detector, we do not observe any anti-Unruh effect. This suggests that the entanglement between the states of the atoms is the main cause for the observed anti-Unruh effect in this case. In going through the investigation, we find that the transition probability for a single detector case is symmetric under the interchange between the thermal bath's temperature and the Unruh temperature for Rindler mode analysis; whereas this is not the case for Minkowski mode. We further comment on whether this observation may shed light on the analogy between an accelerated observer and a real thermal bath. An elaborate investigation for the classifications of our observed anti-Unruh effects is also thoroughly demonstrated.


title: Cohomological splitting, realization, and finiteness

abstract: We search for some splitting (resp. finiteness) criteria of a given module $M$ over a local ring $(R,\fm,k)$ in terms of the splitting (resp. finiteness) property of certain cohomological functors evaluated at $M$. In particular, we deal with the cohomological splitting question posted by Vasconcelos. We present a connection from our approach to the realization problem of Nunke. This is equipped with several applications. For instance, we recover some results of Jensen (and others) by applying simple methods. Additional applications, including a computation of the projective dimension of some injective modules, are given. This enables us to extend some results of Matlis (resp. Osofsky) on the projective dimension of $E_R(k)$ (resp. $\mathcal{Q}$) from Cohen-Macaulay rings (resp. regular rings) to non-Cohen-Macaulay (resp. Cohen-Macaulay) rings.


title: Uncovering and Displaying the Coherent Groups of Rank Data by Exploratory Riffle Shuffling

abstract: Let n respondents rank order d items, and suppose that d << n. Our main task is to uncover and display the structure of the observed rank data by an exploratory riffle shuffling procedure which sequentially decomposes the n voters into a finite number of coherent groups plus a noisy group : where the noisy group represents the outlier voters and each coherent group is composed of a finite number of coherent clusters. We consider exploratory riffle shuffling of a set of items to be equivalent to optimal two blocks seriation of the items with crossing of some scores between the two blocks. A riffle shuffled coherent cluster of voters within its coherent group is essentially characterized by the following facts : a) Voters have identical first TCA factor score, where TCA designates taxicab correspondence analysis, an L1 variant of correspondence analysis ; b) Any preference is easily interpreted as riffle shuffling of its items ; c) The nature of different riffle shuffling of items can be seen in the structure of the contingency table of the first-order marginals constructed from the Borda scorings of the voters ; d) The first TCA factor scores of the items of a coherent cluster are interpreted as Borda scale of the items. We also introduce a crossing index, which measures the extent of crossing of scores of voters between the two blocks seriation of the items. The novel approach is explained on the benchmarking SUSHI data set, where we show that this data set has a very simple structure, which can also be communicated in a tabular form.


title: Protected Long-Distance Guiding of Hypersound Underneath a Nano-Corrugated Surface

abstract: Within a new paradigm for communications on the nanoscale, high-frequency surface acoustic waves are becoming effective data carrier and encoder. On-chip communications require acoustic wave propagation along nano-corrugated surfaces which strongly scatter traditional Rayleigh waves. Here we propose the delivery of information using subsurface acoustic waves with hypersound frequencies ~20 GHz, which is a nanoscale analogue of subsurface sound waves in the ocean. A bunch of subsurface hypersound modes is generated by pulsed optical excitation in a multilayer semiconductor structure with a metallic nanograting on top. The guided hypersound modes propagate coherently beneath the nanograting, retaining the surface imprinted information, on a distance of more than 50 {\mu}m which essentially exceeds the propagation length of Rayleigh waves. The concept is suitable for interfacing single photon emitters, such as buried quantum dots, carrying coherent spin excitations in magnonic devices, and encoding the signals for optical communications at the nanoscale.


title: Maximum induced forests in random graphs

abstract: We prove that with high probability maximum sizes of induced forests in dense binomial random graphs are concentrated in two consecutive values.


title: Existence of Primitive Normal Pairs with One Prescribed Trace over Finite Fields

abstract: Given $m, n, q\in \mathbb{N}$ such that $q$ is a prime power and $m\geq 3$, $a\in \mathbb{F}_q$, we establish a sufficient condition for the existence of primitive pair $(\alpha, f(\alpha))$ in $\mathbb{F}_{q^m}$ such that $\alpha$ is normal over $\mathbb{F}_q$ and $\text{Tr}_{\mathbb{F}_{q^m}/\mathbb{F}_q}(\alpha^{-1})=a$, where $f(x)\in \mathbb{F}_{q^m}(x)$ is a rational function of degree sum $n$. Further, when $n=2$ and $q=5^k$ for some $k\in \mathbb{N}$, such a pair definitely exists for all $(q, m)$ apart from at most $20$ choices.


title: Brick partition problems in three dimensions

abstract: A $d$-dimensional brick is a set $I_1\times \cdots \times I_d$ where each $I_i$ is an interval. Given a brick $B$, a brick partition of $B$ is a partition of $B$ into bricks. A brick partition $\mathcal{P}_d$ of a $d$-dimensional brick is $k$-piercing if every axis-parallel line intersects at least $k$ bricks in $\mathcal{P}_d$. Bucic et al. explicitly asked the minimum size $p(d, k)$ of a $k$-piercing brick partition of a $d$-dimensional brick. The answer is known to be $4(k-1)$ when $d=2$. Our first result almost determines $p(3, k)$. Namely, we construct a $k$-piercing brick partition of a $3$-dimensional brick with $12k-15$ parts, which is off by only $1$ from the known lower bound. As a generalization of the above question, we also seek the minimum size $s(d, k)$ of a brick partition $\mathcal{P}_d$ of a $d$-dimensional brick where each axis-parallel plane intersects at least $k$ bricks in $\mathcal{P}_d$. We resolve the question in the $3$-dimensional case by determining $s(3, k)$ for all $k$.


title: Mathematical foundations of moral preferences

abstract: One-shot anonymous unselfishness in economic games is commonly explained by social preferences, which assume that people care about the monetary payoffs of others. However, during the last ten years, research has shown that different types of unselfish behaviour, including cooperation, altruism, truth-telling, altruistic punishment, and trustworthiness are in fact better explained by preferences for following one's own personal norms - internal standards about what is right or wrong in a given situation. Beyond better organising various forms of unselfish behaviour, this moral preference hypothesis has recently also been used to increase charitable donations, simply by means of interventions that make the morality of an action salient. Here we review experimental and theoretical work dedicated to this rapidly growing field of research, and in doing so we outline mathematical foundations for moral preferences that can be used in future models to better understand selfless human actions and to adjust policies accordingly. These foundations can also be used by artificial intelligence to better navigate the complex landscape of human morality.


title: Onion under Microscope: An in-depth analysis of the Tor network

abstract: Tor is an anonymity network that allows offering and accessing various kinds of resources, known as hidden services, while guaranteeing sender and receiver anonymity. The Tor web is the set of web resources that exist on the Tor network, and Tor websites are part of the so-called dark web. Recent research works have evaluated Tor security, evolution over time, and thematic organization. Nevertheless, few information are available about the structure of the graph defined by the network of Tor websites. The limited number of Tor entry points that can be used to crawl the network renders the study of this graph far from being simple. In this paper we aim at better characterizing the Tor Web by analyzing three crawling datasets collected over a five-month time frame. On the one hand, we extensively study the global properties of the Tor Web, considering two different graph representations and verifying the impact of Tor's renowned volatility. We present an in depth investigation of the key features of the Tor Web graph showing what makes it different from the surface Web graph. On the other hand, we assess the relationship between contents and structural features. We analyse the local properties of the Tor Web to better characterize the role different services play in the network and to understand to which extent topological features are related to the contents of a service.


title: Machine learning emulation of gravity wave drag in numerical weather forecasting

abstract: We assess the value of machine learning as an accelerator for the parameterisation schemes of operational weather forecasting systems, specifically the parameterisation of non-orographic gravity wave drag. Emulators of this scheme can be trained to produce stable and accurate results up to seasonal forecasting timescales. Generally, more complex networks produce more accurate emulators. By training on an increased complexity version of the existing parameterisation scheme we build emulators that produce more accurate forecasts. {For medium range forecasting we find evidence our emulators are more accurate} than the version of the parametrisation scheme that is used for operational predictions. Using the current operational CPU hardware our emulators have a similar computational cost to the existing scheme, but are heavily limited by data movement. On GPU hardware our emulators perform ten times faster than the existing scheme on a CPU.


title: Variational manifold learning from incomplete data: application to multislice dynamic MRI

abstract: Current deep learning-based manifold learning algorithms such as the variational autoencoder (VAE) require fully sampled data to learn the probability density of real-world datasets. Once learned, the density can be used for a variety of tasks, including data imputation. However, fully sampled data is often unavailable in a variety of problems, including the recovery of dynamic and high-resolution MRI data considered in this work. To overcome this problem, we introduce a novel variational approach to learn a manifold from undersampled data. The VAE uses a decoder fed by latent vectors, drawn from a conditional density estimated from the fully sampled images using an encoder. Since fully sampled images are not available in our setting, we approximate the conditional density of the latent vectors by a parametric model whose parameters are estimated from the undersampled measurements using back-propagation. We use the framework for the joint alignment and recovery of multislice free breathing and ungated cardiac MRI data from highly undersampled measurements. Most of the current self-gating and manifold cardiac MRI approaches consider the independent recovery of images from each slice; these methods are not capable of exploiting the inter-slice redundancies in the datasets and require sophisticated post-processing or manual approaches to align the images from different slices. By contrast, the proposed scheme is able to align the multislice data and exploit the redundancies. Experimental results demonstrate the utility of the proposed scheme in dynamic imaging alignment and reconstructions.


title: Open-Domain Conversational Search Assistant with Transformers

abstract: Open-domain conversational search assistants aim at answering user questions about open topics in a conversational manner. In this paper we show how the Transformer architecture achieves state-of-the-art results in key IR tasks, leveraging the creation of conversational assistants that engage in open-domain conversational search with single, yet informative, answers. In particular, we propose an open-domain abstractive conversational search agent pipeline to address two major challenges: first, conversation context-aware search and second, abstractive search-answers generation. To address the first challenge, the conversation context is modeled with a query rewriting method that unfolds the context of the conversation up to a specific moment to search for the correct answers. These answers are then passed to a Transformer-based re-ranker to further improve retrieval performance. The second challenge, is tackled with recent Abstractive Transformer architectures to generate a digest of the top most relevant passages. Experiments show that Transformers deliver a solid performance across all tasks in conversational search, outperforming the best TREC CAsT 2019 baseline.