title: Distilling Knowledge for Fast Retrieval-based Chat-bots

abstract: Response retrieval is a subset of neural ranking in which a model selects a suitable response from a set of candidates given a conversation history. Retrieval-based chat-bots are typically employed in information seeking conversational systems such as customer support agents. In order to make pairwise comparisons between a conversation history and a candidate response, two approaches are common: cross-encoders performing full self-attention over the pair and bi-encoders encoding the pair separately. The former gives better prediction quality but is too slow for practical use. In this paper, we propose a new cross-encoder architecture and transfer knowledge from this model to a bi-encoder model using distillation. This effectively boosts bi-encoder performance at no cost during inference time. We perform a detailed analysis of this approach on three response retrieval datasets.


title: Structural, physical and photocatalytic properties of mixed-valence double-perovskite Ba$_{2}$Pr(Bi,Sb)O$_{6}$ semiconductor synthesized by citrate pyrolysis technique

abstract: We demonstrated crystal structures, magnetic, optical, and photocatalytic properties of the B-site substituted double perovskite Ba$_{2}$Pr(Bi$_{1-x}$Sb$_{x}$)O$_{6}$ ($x$=0, 0.1, 0.2, 0.5 and 1.0) synthesized by the citrate pyrolysis method. The single-phase polycrystalline samples with the light Sb substitution crystallized in a monoclinic structure ($I2/m$). Magnetization measurements on all the samples showed that the effective magnetic moments are located around 3 $\mu_{B}$ , indicating the valence mixing states between Pr$^{3+}$ and Pr$^{4+}$.The magnitudes of band gap energy for the two end member samples were estimated from the optical measurements to be $E_{g}$ =1.06 eV at $x$=0 and 2.71 eV at $x$=1.0. The Ba$_{2}$Pr(Bi$_{1-x}$Sb$_{x}$)O$_{6}$ ($x$=0, and 0.1) powders obtained by the present technique exhibited enhanced photocatalytic activities when compared to the same compounds prepared by the conventional solid state method. Our findings suggest that the higher photocatalytic activities strongly depend on powder preparation method as well as the band gaps and charge separation.


title: A system of unstable higher Toda brackets

abstract: We show that a system of unstable higher Toda brackets can be defined inductively.


title: Entropic identification of the first order freezing transition of a suspension of hard sphere particles

abstract: We analyse the experimental particle current auto correlation function (CAF) of suspensions of hard spheres. Interactions between the particles are mediated by thermally activated acoustic excitations in the solvent. Those acoustic modes are tantamount to the system's (energy) microstates and by their orthogonality, each of those modes can be identified with an independent Brownian particle current. Accordingly, partitioning of the system's energy states is impressed on the CAF. This impression provides a novel measure of the entropy and location of a partitioning/entropy limit at a packing fraction that coincides with that of the observed suspension's first order freezing transition.


title: On the Fourier analysis of the Einstein-Klein-Gordon system: Growth and Decay of the Fourier constants

abstract: We consider the $(1 + 3)$-dimensional Einstein equations with negative cosmological constant coupled to a spherically-symmetric, massless scalar field and study perturbations around the Anti-de Sitter spacetime. We derive the resonant systems, pick out vanishing secular terms and discuss issues related to small divisors. Most importantly, we rigorously establish (sharp, in most of the cases) asymptotic behaviour for all the interaction coefficients. The latter is based on uniform estimates for the eigenfunctions associated to the linearized operator as well as on some oscillatory integrals.


title: Topological and non-topological features of generalized Su-Schrieffer-Heeger models

abstract: The (one-dimensional) Su-Schrieffer-Heeger Hamiltonian, augmented by spin-orbit coupling and longer-range hopping, is studied at half filling for an even number of sites. The ground-state phase diagram depends sensitively on the symmetry of the model. Charge-conjugation (particle-hole) symmetry is conserved if hopping is only allowed between the two sublattices of even and odd sites. In this case (of BDI symmetry) we find a variety of topologically non-trivial phases, characterized by different numbers of edge states (or, equivalently, different quantized Zak phases). The transitions between these phases are clearly signalled by the entanglement entropy. Charge-conjugation symmetry is broken if hopping within the sublattices is admitted (driving the system into the AI symmetry class). We study specifically next-nearest-neighbor hopping with amplitudes $t_a$ and $t_b$ for the $A$ and $B$ sublattices, respectively. For $t_a=t_b$ parity is conserved, and also the quantized Zak phases remain unchanged in the gapped regions of the phase diagram. However, metallic patches appear due to the overlap between conduction and valence bands in some regions of parameter space. The case of alternating next-nearest neighbor hopping, $t_a=-t_b$, is also remarkable, as it breaks both charge-conjugation $C$ and parity $P$ but conserves the product $CP$. Both the Zak phase and the entanglement spectrum still provide relevant information, in particular about the broken parity. Thus the Zak phase for small values of $t_a$ measures the disparity between bond strengths on $A$ and $B$ sublattices, in close analogy to the proportionality between the Zak phase and the polarization in the case of the related Aubry-Andr\'e model.


title: Proceedings of the ICLR Workshop on Computer Vision for Agriculture (CV4A) 2020

abstract: This is the proceedings of the Computer Vision for Agriculture (CV4A) Workshop that was held in conjunction with the International Conference on Learning Representations (ICLR) 2020. The Computer Vision for Agriculture (CV4A) 2020 workshop was scheduled to be held in Addis Ababa, Ethiopia, on April 26th, 2020. It was held virtually that same day due to the COVID-19 pandemic. The workshop was held in conjunction with the International Conference on Learning Representations (ICLR) 2020.


title: Particle approximation of the two-fluid model for superfluid $^4$He using smoothed particle hydrodynamics

abstract: This paper presents a finite particle approximation of the two-fluid model for liquid $^4$He using smoothed particle hydrodynamics (SPH). In recent years, several studies have combined the vortex filament model (VFM), which describes quantized vortices in superfluid components, with the Navier-Stokes equations, which describe the motion of normal fluids. These studies led us to assume that coupling both components of the two-fluid model instead of using the VFM to describe the superfluid component enables us to approximate the system. In this study, we formulated a new SPH model that simultaneously solves both equations of motion of the two-fluid model. We then performed a numerical simulation of the rotating liquid $^4$He using our SPH. The results showed that the two major phenomena, the emergence of multiple independent vortices parallel to the circular axis and that of the so-called rigid-body rotation, can be reproduced by solving the two-fluid model using SPH. This finding is interesting because it was previously assumed that only a single vortex emerges when addressing similar problems without considering quantum mechanics. Our further analysis found that the emergence of multiple independent vortices can be realized by reformulating the viscosity term of the two-fluid model to conserve the angular momentum of the particles around their axes. Consequently, our model succeeded in reproducing the phenomena observed in quantum cases, even though we solve the phenomenological governing equations of liquid $^4$He.


title: Projection-Free Optimization on Uniformly Convex Sets

abstract: The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints: polytopes and strongly-convex sets. Uniformly convex sets non-trivially subsume strongly convex sets and form a large variety of \textit{curved} convex sets commonly encountered in machine learning and signal processing. For instance, the $\ell_p$-balls are uniformly convex for all $p > 1$, but strongly convex for $p\in]1,2]$ only. We show that these sets systematically induce accelerated convergence rates for the original Frank-Wolfe algorithm, which continuously interpolate between known rates. Our accelerated convergence rates emphasize that it is the curvature of the constraint sets -- not just their strong convexity -- that leads to accelerated convergence rates. These results also importantly highlight that the Frank-Wolfe algorithm is adaptive to much more generic constraint set structures, thus explaining faster empirical convergence. Finally, we also show accelerated convergence rates when the set is only locally uniformly convex and provide similar results in online linear optimization.


title: Learning Dialog Policies from Weak Demonstrations

abstract: Deep reinforcement learning is a promising approach to training a dialog manager, but current methods struggle with the large state and action spaces of multi-domain dialog systems. Building upon Deep Q-learning from Demonstrations (DQfD), an algorithm that scores highly in difficult Atari games, we leverage dialog data to guide the agent to successfully respond to a user's requests. We make progressively fewer assumptions about the data needed, using labeled, reduced-labeled, and even unlabeled data to train expert demonstrators. We introduce Reinforced Fine-tune Learning, an extension to DQfD, enabling us to overcome the domain gap between the datasets and the environment. Experiments in a challenging multi-domain dialog system framework validate our approaches, and get high success rates even when trained on out-of-domain data.


title: On Bayesian Search for the Feasible Space Under Computationally Expensive Constraints

abstract: We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of exploration would be prohibitive. Bayesian search is data-efficient for such problems: starting from a small dataset, the central concept is to use Bayesian models of constraints with an acquisition function to locate promising solutions that may improve predictions of feasibility when the dataset is augmented. At the end of this sequential active learning approach with a limited number of expensive evaluations, the models can accurately predict the feasibility of any solution obviating the need for full simulations. In this paper, we propose a novel acquisition function that combines the probability that a solution lies at the boundary between feasible and infeasible spaces (representing exploitation) and the entropy in predictions (representing exploration). Experiments confirmed the efficacy of the proposed function.


title: Analytic Simplification of Neural Network based Intra-Prediction Modes for Video Compression

abstract: With the increasing demand for video content at higher resolutions, it is evermore critical to find ways to limit the complexity of video encoding tasks in order to reduce costs, power consumption and environmental impact of video services. In the last few years, algorithms based on Neural Networks (NN) have been shown to benefit many conventional video coding modules. But while such techniques can considerably improve the compression efficiency, they usually are very computationally intensive. It is highly beneficial to simplify models learnt by NN so that meaningful insights can be exploited with the goal of deriving less complex solutions. This paper presents two ways to derive simplified intra-prediction from learnt models, and shows that these streamlined techniques can lead to efficient compression solutions.


title: Weakly contractive iterated function systems and beyond: A manual

abstract: We give a systematic account of iterated function systems (IFS) of weak contractions of different types (Browder, Rakotch, topological). We show that the existence of attractors and asymptotically stable invariant measures, and the validity of the random iteration algorithm ("chaos game"), can be obtained rather easily for weakly contractive systems. We show that the class of attractors of weakly contractive IFSs is essentially wider than the class of classical IFSs' fractals. On the other hand, we show that, in reasonable spaces, a typical compact set is not an attractor of any weakly contractive IFS. We explore the possibilities and restrictions to break the contractivity barrier by employing several tools from fixed point theory: geometry of balls, average contractions, remetrization technique, ordered sets, and measures of noncompactness. From these considerations it follows that while the existence of invariant sets and invariant measures can be assured rather easily for general iterated function systems under mild conditions, to establish the existence of attractors and unique invariant measures is a substantially more difficult problem. This explains the central role of contractive systems in the theory of IFSs.


title: Strong coupling between magnons confined in a single magnonic cavity

abstract: Strong coupling between magnons and cavity photons was studied extensively for quantum electrodynamics in the past few years. Recently, the strong magnon-magnon coupling between adjacent layers in magnetic multilayers has been reported. However, the strongly coupled magnons confined in a single nanomagnet remains to be revealed. Here, we report the interaction between different magnon modes in a single magnonic cavity. The intermodel coupling between edge and center magnon modes in the strong coupling regime was approached with a maximum coupling strength of 0.494 GHz and cooperativity of 60.1 with a damping of 1X10-3. Furthermore, it is found that the coupling strength is highly dependent on the geometric parameters of the magnonic cavity. Our findings could greatly enrich the still evolving field of quantum magnonics.


title: Evaluating FPGA Accelerator Performance with a Parameterized OpenCL Adaptation of the HPCChallenge Benchmark Suite

abstract: FPGAs have found increasing adoption in data center applications since a new generation of high-level tools have become available which noticeably reduce development time for FPGA accelerators and still provide high quality of results. There is however no high-level benchmark suite available which specifically enables a comparison of FPGA architectures, programming tools and libraries for HPC applications. To fill this gap, we have developed an OpenCL-based open source implementation of the HPCC benchmark suite for Xilinx and Intel FPGAs. This benchmark can serve to analyze the current capabilities of FPGA devices, cards and development tool flows, track progress over time and point out specific difficulties for FPGA acceleration in the HPC domain. Additionally, the benchmark documents proven performance optimization patterns. We will continue optimizing and porting the benchmark for new generations of FPGAs and design tools and encourage active participation to create a valuable tool for the community.


title: The Spread of Almost Simple Classical Groups

abstract: Every finite simple group can be generated by two elements, and in 2000, Guralnick and Kantor resolved a 1962 question of Steinberg by proving that in a finite simple group every nontrivial element belongs to a generating pair. Groups with this property are said to be $\frac{3}{2}$-generated. Which finite groups are $\frac{3}{2}$-generated? Every proper quotient of a $\frac{3}{2}$-generated group is cyclic, and in 2008, Breuer, Guralnick and Kantor made the striking conjecture that this condition alone provides a complete characterisation of the finite groups with this property. This conjecture has recently been reduced to the almost simple groups and results of Piccard (1939) and Woldar (1994) show that the conjecture is true for almost simple groups whose socles are alternating or sporadic groups. Therefore, the central focus is now on the almost simple groups of Lie type. In this monograph we prove a strong version of this conjecture for almost simple classical groups, building on earlier work of Burness and Guest (2013) and the author (2017). More precisely, we show that every relevant almost simple classical group has uniform spread at least two, unless it is isomorphic to the symmetric group of degree six. We also prove that the uniform spread of these groups tends to infinity if the size of the underlying field tends to infinity. To prove these results, we are guided by a probabilistic approach introduced by Guralnick and Kantor. This requires a detailed analysis of automorphisms, fixed point ratios and subgroup structure of almost simple classical groups, so the first half of this monograph is dedicated to these general topics. In particular, we give a general exposition of the useful technique of Shintani descent, which plays an important role throughout.


title: Key Atmospheric Signatures for Identifying the Source Reservoirs of Volatiles in Uranus and Neptune

abstract: We investigate the enrichment patterns of several delivery scenarios of the volatiles to the atmospheres of ice giants, having in mind that the only well constrained determination made remotely, i.e. the carbon abundance measurement, suggests that their envelopes possess highly supersolar metallicities, i.e. close to two orders of magnitude above that of the protosolar nebula. In the framework of the core accretion model, only the delivery of volatiles in solid forms (amorphous ice, clathrates, pure condensates) to these planets can account for the apparent supersolar metallicity of their envelopes. In contrast, because of the inward drift of icy particles through various snowlines, all mechanisms invoking the delivery of volatiles in vapor forms predict subsolar abundances in the envelopes of Uranus and Neptune. Alternatively, even if the disk instability mechanism remains questionable in our solar system, it might be consistent with the supersolar metallicities observed in Uranus and Neptune, assuming the two planets suffered subsequent erosion of their H-He envelopes. The enrichment patterns derived for each delivery scenario considered should be useful to interpret future in situ measurements by atmospheric entry probes.


title: Accurate runtime selection of optimal MPI collective algorithms using analytical performance modelling

abstract: The performance of collective operations has been a critical issue since the advent of MPI. Many algorithms have been proposed for each MPI collective operation but none of them proved optimal in all situations. Different algorithms demonstrate superior performance depending on the platform, the message size, the number of processes, etc. MPI implementations perform the selection of the collective algorithm empirically, executing a simple runtime decision function. While efficient, this approach does not guarantee the optimal selection. As a more accurate but equally efficient alternative, the use of analytical performance models of collective algorithms for the selection process was proposed and studied. Unfortunately, the previous attempts in this direction have not been successful. We revisit the analytical model-based approach and propose two innovations that significantly improve the selective accuracy of analytical models: (1) We derive analytical models from the code implementing the algorithms rather than from their high-level mathematical definitions. This results in more detailed models. (2) We estimate model parameters separately for each collective algorithm and include the execution of this algorithm in the corresponding communication experiment. We experimentally demonstrate the accuracy and efficiency of our approach using Open MPI broadcast and gather algorithms and a Grid5000 cluster.


title: Color dependence of tensor and scalar glueball masses in Yang-Mills theories

abstract: We report the masses of the lightest spin-0 and spin-2 glueballs obtained in an extensive lattice study of the continuum and infinite volume limits of $Sp(N_c)$ gauge theories for $N_c=2,4,6,8$. We also extrapolate the combined results towards the large-$N_c$ limit. We compute the ratio of scalar and tensor masses, and observe evidence that this ratio is independent of $N_{c}$. Other lattice studies of Yang-Mills theories at the same space-time dimension provide a compatible ratio. We further compare these results to various analytical ones and discuss them in view of symmetry-based arguments related to the breaking of scale invariance in the underlying dynamics, showing that a constant ratio might emerge in a scenario in which the $0^{++}$ glueball is interpreted as a dilaton state.


title: On time periodic solutions to the conformal cubic wave equation on the Einstein cylinder

abstract: We consider the conformal wave equation on the Einstein cylinder with a defocusing cubic non-linearity. Motivated by a method developed by Rostworowski-Maliborski on the existence of time periodic solutions to the spherically symmetric Einstein-Klein-Gordon system, we study perturbations around the zero solution as a formal series expansion and assume that the perturbations bifurcate from $1-$mode. In the center of this work stands a rigorous proof on how one can choose the initial data to cancel out all secular terms in the resonant system. Interestingly, our analysis reveals that the only possible choice for the existence of time periodic solutions is when the error terms in the expansion are all proportional to the dominant $1-$mode. Finally, we use techniques from ordinary differential equations and establish the existence of time periodic solutions for initial data proportional to the first mode of the linearized operator.


title: Controlling a Networked SIS Model via a Single Input over Undirected Graphs

abstract: This paper formulates and studies the problem of controlling a networked SIS model using a single input in which the network structure is described by a connected undirected graph. A necessary and sufficient condition on the values of curing and infection rates for the healthy state to be exponentially stable is obtained via the analysis of signed Laplacians when the control input is the curing budget of a single agent. In the case when the healthy state is stabilizable, an explicit expression for the minimum curing budget is provided. The utility of the algorithm is demonstrated using a simulation over a network of cities in the northeastern United States.


title: Mean field analysis of reverse annealing for code-division multiple-access multiuser detection

abstract: We evaluate the typical ARA performance of the CDMA multiuser detection by means of statistical mechanics using the replica method. At first, we consider the oracle cases where the initial candidate solution is randomly generated with a fixed fraction of the original signal in the initial state. In the oracle cases, the first-order phase transition can be avoided or mitigated by ARA if we prepare for the proper initial candidate solution. We validate our theoretical analysis with quantum Monte Carlo simulations. The theoretical results to avoid the first-order phase transition are consistent with the numerical results. Next, we consider the practical cases where we prepare for the initial candidate solution obtained by commonly used algorithms. We show that the practical algorithms can exceed the threshold to avoid the first-order phase transition. Finally, we test the performance of ARA with the initial candidate solution obtained by the practical algorithm. In this case, the ARA can not avoid the first-order phase transition even if the initial candidate solution exceeds the threshold to avoid the first-order phase transition.


title: Nanoscale Detection of Magnon Excitations with Variable Wavevectors Through a Quantum Spin Sensor

abstract: We report the optical detection of magnons with a broad range of wavevectors in magnetic insulator Y3Fe5O12 thin films by proximate nitrogen-vacancy (NV) single-spin sensors. Through multi-magnon scattering processes, the excited magnons generate fluctuating magnetic fields at the NV electron spin resonance frequencies, which accelerate the relaxation of NV spins. By measuring the variation of the emitted spin-dependent photoluminescence of the NV centers, magnons with variable wavevectors up to ~ 5 x 10^7 m-1 can be optically accessed, providing an alternative perspective to reveal the underlying spin behaviors in magnetic systems. Our results highlight the significant opportunities offered by NV single-spin quantum sensors in exploring nanoscale spin dynamics of emergent spintronic materials.


title: The CMS Precision Proton Spectrometer timing system: performance in Run 2, future upgrades and sensor radiation hardness studies

abstract: Central exclusive processes can be studied in CMS by combining the information of the central detector with the Precision Proton Spectrometer (PPS). PPS detectors, placed symmetrically at more than 200 m from the interaction point, can detect the scattered protons that survive the interaction. PPS has taken data at high luminosity while fully integrated in the CMS experiment. The total amount of collected data corresponds to more than 100 fb$^{-1}$ during the LHC Run 2. PPS consists of 3D silicon tracking stations as well as timing detectors that measure both the position and direction of protons and their time-of-flight with high precision. The detectors are hosted in special movable vacuum chambers, the Roman Pots, which are placed in the primary vacuum of the LHC beam pipe. The sensors reach a distance of few mm from the beam. Detectors have to operate in vacuum and must be able to sustain highly non-uniform irradiation: sensors used in Run 2 have accumulated an integrated dose with a local peak of $\sim 5 \cdot 10^{15}$ protons/cm$^2$. The timing system is made with high purity scCVD diamond sensors. A new architecture with two diamond crystals read out in parallel by the same electronic channel has been used to enhance the detector performance. In this paper, after a general overview of the PPS detector, we describe the timing system in detail. The sensor and the dedicated amplification chain are described, together with the signal digitization technique. Performance of the detector in Run 2 is reported. Recently the sensors used in Run 2 have been tested for efficiency and timing performance in a dedicated test beam at DESY. Preliminary results on radiation damage are reported. Important upgrades of the timing system are ongoing for the LHC Run 3, with the goal of reaching an ultimate timing resolution better than 30 ps; they are also discussed here.


title: Finite dimensional simple modules of $(q, \mathbf{Q})$-current algebras

abstract: The $(q, \mathbf{Q})$-current algebra associated with the general linear Lie algebra was introduced by the second author in the study of representation theory of cyclotomic $q$-Schur algebras. In this paper, we study the $(q, \mathbf{Q})$-current algebra $U_q(\mathfrak{sl}_n^{\langle \mathbf{Q} \rangle}[x])$ associated with the special linear Lie algebra $\mathfrak{sl}_n$. In particular, we classify finite dimensional simple $U_q(\mathfrak{sl}_n^{\langle \mathbf{Q} \rangle}[x])$-modules.


title: Millimeter-Wave Full-Duplex UAV Relay: Joint Positioning, Beamforming, and Power Control

abstract: In this paper, a full-duplex unmanned aerial vehicle (FD-UAV) relay is employed to increase the communication capacity of millimeter-wave (mmWave) networks. Large antenna arrays are equipped at the source node (SN), destination node (DN), and FD-UAV relay to overcome the high path loss of mmWave channels and to help mitigate the self-interference at the FD-UAV relay. Specifically, we formulate a problem for maximization of the achievable rate from the SN to the DN, where the UAV position, analog beamforming, and power control are jointly optimized. Since the problem is highly non-convex and involves high-dimensional, highly coupled variable vectors, we first obtain the conditional optimal position of the FD-UAV relay for maximization of an approximate upper bound on the achievable rate in closed form, under the assumption of a line-of-sight (LoS) environment and ideal beamforming. Then, the UAV is deployed to the position which is closest to the conditional optimal position and yields LoS paths for both air-to-ground links. Subsequently, we propose an alternating interference suppression (AIS) algorithm for the joint design of the beamforming vectors and the power control variables. In each iteration, the beamforming vectors are optimized for maximization of the beamforming gains of the target signals and the successive reduction of the interference, where the optimal power control variables are obtained in closed form. Our simulation results confirm the superiority of the proposed positioning, beamforming, and power control method compared to three benchmark schemes. Furthermore, our results show that the proposed solution closely approaches a performance upper bound for mmWave FD-UAV systems.


title: SEVurity: No Security Without Integrity -- Breaking Integrity-Free Memory Encryption with Minimal Assumptions

abstract: One reason for not adopting cloud services is the required trust in the cloud provider: As they control the hypervisor, any data processed in the system is accessible to them. Full memory encryption for Virtual Machines (VM) protects against curious cloud providers as well as otherwise compromised hypervisors. AMD Secure Encrypted Virtualization (SEV) is the most prevalent hardware-based full memory encryption for VMs. Its newest extension, SEV-ES, also protects the entire VM state during context switches, aiming to ensure that the host neither learns anything about the data that is processed inside the VM, nor is able to modify its execution state. Several previous works have analyzed the security of SEV and have shown that, by controlling I/O, it is possible to exfiltrate data or even gain control over the VM's execution. In this work, we introduce two new methods that allow us to inject arbitrary code into SEV-ES secured virtual machines. Due to the lack of proper integrity protection, it is sufficient to reuse existing ciphertext to build a high-speed encryption oracle. As a result, our attack no longer depends on control over the I/O, which is needed by prior attacks. As I/O manipulation is highly detectable, our attacks are stealthier. In addition, we reverse-engineer the previously unknown, improved Xor-Encrypt-Xor (XEX) based encryption mode, that AMD is using on updated processors, and show, for the first time, how it can be overcome by our new attacks.


title: Improved Noise and Attack Robustness for Semantic Segmentation by Using Multi-Task Training with Self-Supervised Depth Estimation

abstract: While current approaches for neural network training often aim at improving performance, less focus is put on training methods aiming at robustness towards varying noise conditions or directed attacks by adversarial examples. In this paper, we propose to improve robustness by a multi-task training, which extends supervised semantic segmentation by a self-supervised monocular depth estimation on unlabeled videos. This additional task is only performed during training to improve the semantic segmentation model's robustness at test time under several input perturbations. Moreover, we even find that our joint training approach also improves the performance of the model on the original (supervised) semantic segmentation task. Our evaluation exhibits a particular novelty in that it allows to mutually compare the effect of input noises and adversarial attacks on the robustness of the semantic segmentation. We show the effectiveness of our method on the Cityscapes dataset, where our multi-task training approach consistently outperforms the single-task semantic segmentation baseline in terms of both robustness vs. noise and in terms of adversarial attacks, without the need for depth labels in training.


title: Intermittent fluctuations due to Lorentzian pulses in turbulent thermal convection

abstract: Turbulent motions due to flux-driven thermal convection is investigated by numerical simulations and stochastic modelling. Tilting of convection cells leads to the formation of sheared flows and quasi-periodic relaxation oscillations for the energy integrals far from the threshold for linear instability. The probability density function for the temperature and radial velocity fluctuations in the fluid layer changes from a normal distribution at the onset of turbulence to a distribution with an exponential tail for large fluctuation amplitudes for strongly driven systems. The frequency power spectral density has an exponential shape, which is a signature of deterministic chaos. By use of a novel deconvolution method, this is shown to result from the presence of Lorentzian pulses in the underlying time series, demonstrating that exponential frequency spectra can persist in also in turbulent flow regimes.


title: Thresholds of ultraperipheral processes

abstract: Threshold behavior of the cross sections of ultraperipheral nuclear interactions is studied. Production of $e^+e^-$ and $\mu ^+\mu ^-$ pairs as well as $\pi ^0$ and parapositronium is treated. The values of corresponding energy thresholds are presented and the total cross sections of these processes at the newly constructed NICA and FAIR facilities are estimated.


title: Fast Convex Relaxations using Graph Discretizations

abstract: Matching and partitioning problems are fundamentals of computer vision applications with examples in multilabel segmentation, stereo estimation and optical-flow computation. These tasks can be posed as non-convex energy minimization problems and solved near-globally optimal by recent convex lifting approaches. Yet, applying these techniques comes with a significant computational effort, reducing their feasibility in practical applications. We discuss spatial discretization of continuous partitioning problems into a graph structure, generalizing discretization onto a Cartesian grid. This setup allows us to faithfully work on super-pixel graphs constructed by SLIC or Cut-Pursuit, massively decreasing the computational effort for lifted partitioning problems compared to a Cartesian grid, while optimal energy values remain similar: The global matching is still solved near-globally optimal. We discuss this methodology in detail and show examples in multi-label segmentation by minimal partitions and stereo estimation, where we demonstrate that the proposed graph discretization can reduce runtime as well as memory consumption of convex relaxations of matching problems by up to a factor of 10.


title: DAN: A Deformation-Aware Network for Consecutive Biomedical Image Interpolation

abstract: The continuity of biological tissue between consecutive biomedical images makes it possible for the video interpolation algorithm, to recover large area defects and tears that are common in biomedical images. However, noise and blur differences, large deformation, and drift between biomedical images, make the task challenging. To address the problem, this paper introduces a deformation-aware network to synthesize each pixel in accordance with the continuity of biological tissue. First, we develop a deformation-aware layer for consecutive biomedical images interpolation that implicitly adopting global perceptual deformation. Second, we present an adaptive style-balance loss to take the style differences of consecutive biomedical images such as blur and noise into consideration. Guided by the deformation-aware module, we synthesize each pixel from a global domain adaptively which further improves the performance of pixel synthesis. Quantitative and qualitative experiments on the benchmark dataset show that the proposed method is superior to the state-of-the-art approaches.


title: Quantaized Winograd/Toom-Cook Convolution for DNNs: Beyond Canonical Polynomials Base

abstract: The problem how to speed up the convolution computations in Deep Neural Networks is widely investigated in recent years. The Winograd convolution algorithm is a common used method that significantly reduces time consumption. However, it suffers from a problem with numerical accuracy particularly for lower precisions. In this paper we present the application of base change technique for quantized Winograd-aware training model. We show that we can train the $8$ bit quantized network to nearly the same accuracy (up to 0.5% loss) for tested network (Resnet18) and dataset (CIFAR10) as for quantized direct convolution with few additional operations in pre/post transformations. Keeping Hadamard product on $9$ bits allow us to obtain the same accuracy as for direct convolution.


title: Measurement of the central exclusive production of charged particle pairs in proton-proton collisions at $\sqrt{s} = 200$ GeV with the STAR detector at RHIC

abstract: We report on the measurement of the Central Exclusive Production of charged particle pairs $h^{+}h^{-}$ ($h = \pi, K, p$) with the STAR detector at RHIC in proton-proton collisions at $\sqrt{s} = 200$ GeV. The charged particle pairs produced in the reaction $pp\to p^\prime+h^{+}h^{-}+p^\prime$ are reconstructed from the tracks in the central detector, while the forward-scattered protons are measured in the Roman Pot system. Differential cross sections are measured in the fiducial region, which roughly corresponds to the square of the four-momentum transfers at the proton vertices in the range $0.04~\mbox{GeV}^2 < -t_1 , -t_2 < 0.2~\mbox{GeV}^2$, invariant masses of the charged particle pairs up to a few GeV and pseudorapidities of the centrally-produced hadrons in the range $|\eta|<0.7$. The measured cross sections are compared to phenomenological predictions based on the Double Pomeron Exchange (DPE) model. Structures observed in the mass spectra of $\pi^{+}\pi^{-}$ and $K^{+}K^{-}$ pairs are consistent with the DPE model, while angular distributions of pions suggest a dominant spin-0 contribution to $\pi^{+}\pi^{-}$ production. The fiducial $\pi^+\pi^-$ cross section is extrapolated to the Lorentz-invariant region, which allows decomposition of the invariant mass spectrum into continuum and resonant contributions. The extrapolated cross section is well described by the continuum production and at least three resonances, the $f_0(980)$, $f_2(1270)$ and $f_0(1500)$, with a possible small contribution from the $f_0(1370)$. Fits to the extrapolated differential cross section as a function of $t_1$ and $t_2$ enable extraction of the exponential slope parameters in several bins of the invariant mass of $\pi^+\pi^-$ pairs. These parameters are sensitive to the size of the interaction region.


title: The Maxwell-Stefan Diffusion Limit of a Hard-Sphere Kinetic Model for Mixtures

abstract: We study a kinetic model for non-reactive mixtures of monatomic gases with hard-sphere cross-sections under isothermal condition. By considering a diffusive scaling of the kinetic model and using the method of moments, we formally obtain from the continuity and momentum balance equations of the species, in the limit as the scaling parameter goes to zero, the Maxwell-Stefan diffusion equations, with an explicit expression for the diffusion coefficients.


title: Using DSP Slices as Content-Addressable Update Queues

abstract: Content-Addressable Memory (CAM) is a powerful abstraction for building memory caches, routing tables and hazard detection logic. Without a native CAM structure available on FPGA devices, their functionality must be emulated using the structural primitives at hand. Such an emulation causes significant overhead in the consumption of the underlying resources, typically general-purpose fabric and on-chip block RAM (BRAM). This often motivates mitigating trade-offs, such as the reduction of the associativity of memory caches. This paper describes a technique to implement the hazard resolution in a memory update queue that hides the off-chip memory readout latency of read-modify-write cycles while guaranteeing the delivery of the full memory bandwidth. The innovative use of DSP slices allows them to assume and combine the functions of (a) the tag and data storage, (b) the tag matching, and (c) the data update in this key-value storage scenario. The proposed approach provides designers with extra flexibility by adding this resource type as another option to implement CAM.


title: Coupling semantic and statistical techniques for dynamically enriching web ontologies

abstract: With the development of the Semantic Web technology, the use of ontologies to store and retrieve information covering several domains has increased. However, very few ontologies are able to cope with the ever-growing need of frequently updated semantic information or specific user requirements in specialized domains. As a result, a critical issue is related to the unavailability of relational information between concepts, also coined missing background knowledge. One solution to address this issue relies on the manual enrichment of ontologies by domain experts which is however a time consuming and costly process, hence the need for dynamic ontology enrichment. In this paper we present an automatic coupled statistical/semantic framework for dynamically enriching large-scale generic ontologies from the World Wide Web. Using the massive amount of information encoded in texts on the Web as a corpus, missing background knowledge can therefore be discovered through a combination of semantic relatedness measures and pattern acquisition techniques and subsequently exploited. The benefits of our approach are: (i) proposing the dynamic enrichment of large-scale generic ontologies with missing background knowledge, and thus, enabling the reuse of such knowledge, (ii) dealing with the issue of costly ontological manual enrichment by domain experts. Experimental results in a precision-based evaluation setting demonstrate the effectiveness of the proposed techniques.


title: Direct measurement of electron-phonon coupling with time-resolved ARPES

abstract: Time and angular resolved photoelectron spectroscopy is a powerful technique to measure electron dynamics in solids. Recent advances in this technique have facilitated band and energy resolved observations of the effect that excited phonons, have on the electronic structure. Here, we show with the help of \textit{ab initio} simulations that the Fourier analysis of time-resolved measurements of solids with excited phonon modes leads, in fact, to an observation of the band- and mode-resolved electron-phonon coupling directly from the experimental data and without need for theoretical computations.


title: Coupled intrinsic and extrinsic human language resource-based query expansion

abstract: Poor information retrieval performance has often been attributed to the query-document vocabulary mismatch problem which is defined as the difficulty for human users to formulate precise natural language queries that are in line with the vocabulary of the documents deemed relevant to a specific search goal. To alleviate this problem, query expansion processes are applied in order to spawn and integrate additional terms to an initial query. This requires accurate identification of main query concepts to ensure the intended search goal is duly emphasized and relevant expansion concepts are extracted and included in the enriched query. Natural language queries have intrinsic linguistic properties such as parts-of-speech labels and grammatical relations which can be utilized in determining the intended search goal. Additionally, extrinsic language-based resources such as ontologies are needed to suggest expansion concepts semantically coherent with the query content. We present here a query expansion framework which capitalizes on both linguistic characteristics of user queries and ontology resources for query constituent encoding, expansion concept extraction and concept weighting. A thorough empirical evaluation on real-world datasets validates our approach against unigram language model, relevance model and a sequential dependence based technique.


title: Setting the Free Material Design problem through the methods of optimal mass distribution

abstract: The paper deals with the Free Material Design (FMD) problem aimed at constructing the least compliant structures from an elastic material the constitutive field of which play the role of the design variable in the form of a tensor valued measure $\lambda$ supported in the design domain. Point-wise the constitutive tensor is referred to a given anisotropy class $\mathscr{H}$ while the integral of a cost $c(\lambda)$ is bounded from above. The convex $p$-homogeneous elastic potential $j$ is parameterized by the constitutive tensor. The work puts forward the existence result and shows that the original problem can be reduced to the Linear Constrained Problem (LCP) known from the theory of optimal mass distribution by G. Bouchitt\'{e} and G. Buttazzo. A theorem linking solutions of (FMD) and (LCP) allows to effectively solve the original problem. The developed theory encompasses several optimal anisotropy design problems known in the literature as well as it unlocks new optimization problems including design of structures made of a material whose elastic response is dissymmetric in tension and compression. By employing the explicitly derived optimality conditions we give several analytical examples of optimal designs.


title: SL-DML: Signal Level Deep Metric Learning for Multimodal One-Shot Action Recognition

abstract: Recognizing an activity with a single reference sample using metric learning approaches is a promising research field. The majority of few-shot methods focus on object recognition or face-identification. We propose a metric learning approach to reduce the action recognition problem to a nearest neighbor search in embedding space. We encode signals into images and extract features using a deep residual CNN. Using triplet loss, we learn a feature embedding. The resulting encoder transforms features into an embedding space in which closer distances encode similar actions while higher distances encode different actions. Our approach is based on a signal level formulation and remains flexible across a variety of modalities. It further outperforms the baseline on the large scale NTU RGB+D 120 dataset for the One-Shot action recognition protocol by 5.6%. With just 60% of the training data, our approach still outperforms the baseline approach by 3.7%. With 40% of the training data, our approach performs comparably well to the second follow up. Further, we show that our approach generalizes well in experiments on the UTD-MHAD dataset for inertial, skeleton and fused data and the Simitate dataset for motion capturing data. Furthermore, our inter-joint and inter-sensor experiments suggest good capabilities on previously unseen setups.


title: Quantum Gradient Algorithm for General Polynomials

abstract: Gradient-based algorithms, popular strategies to optimization problems, are essential for many modern machine-learning techniques. Theoretically, extreme points of certain cost functions can be found iteratively along the directions of the gradient. The time required to calculating the gradient of $d$-dimensional problems is at a level of $\mathcal{O}(poly(d))$, which could be boosted by quantum techniques, benefiting the high-dimensional data processing, especially the modern machine-learning engineering with the number of optimized parameters being in billions. Here, we propose a quantum gradient algorithm for optimizing general polynomials with the dressed amplitude encoding, aiming at solving fast-convergence polynomials problems within both time and memory consumption in $\mathcal{O}(poly (\log{d}))$. Furthermore, numerical simulations are carried out to inspect the performance of this protocol by considering the noises or perturbations from initialization, operation and truncation. For the potential values in high-dimension optimizations, this quantum gradient algorithm is supposed to facilitate the polynomial-optimizations, being a subroutine for future practical quantum computer.


title: Emissions of photons near the horizons of Kerr-Sen black holes

abstract: We investigate the escape probabilities of the photons near the horizon of the Kerr-Sen black hole. We find that the escape probabilities of the photons are nonzero in the event horizon limit of the extreme Kerr-Sen black hole if the light sources are near the equator. We show that the escape probability of a photon increases with the radial position of the light source. It is also uncovered that the escape probability decreases if the light source with constant radius moves from the equatorial plane to the pole. Besides, we discover that the escape probability of a photon in the Carter frame is always greater than the one in the locally non-rotating frame, except on the pole, where they are equal.


title: Optimal Ergodic Control of Linear Stochastic Differential Equations with Quadratic Cost Functionals Having Indefinite Weights

abstract: An optimal ergodic control problem (EC problem, for short) is investigated for a linear stochastic differential equation with quadratic cost functional. Constant nonhomogeneous terms, not all zero, appear in the state equation, which lead to the asymptotic limit of the state non-zero. Under the stabilizability condition, for any (admissible) closed-loop strategy, an invariant measure is proved to exist, which makes the ergodic cost functional well-defined and the EC problem well-formulated. Sufficient conditions, including those allowing the weighting matrices of cost functional to be indefinite, are introduced for finiteness and solvability for the EC problem. Some comparisons are made between the solvability of EC problem and the closed-loop solvability of stochastic linear quadratic optimal control problem in the infinite horizon. Regularized EC problem is introduced to be used to obtain the optimal value of the EC problem.


title: Simulation of constrained elastic curves and application to a conical sheet indentation problem

abstract: We consider variational problems that model the bending behavior of curves that are constrained to belong to given hypersurfaces. Finite element discretizations of corresponding functionals are justified rigorously via Gamma-convergence. The stability of semi-implicit discretizations of gradient flows is investigated which provide a practical method to determine stationary configurations. A particular application of the considered models arises in the description of conical sheet deformations.


title: The Supersymmetric $(B-L)$ model with three non-identical right-handed neutrinos

abstract: We build a supersymmetric version with $SU(3)_{C}\otimes SU(2)_{L}\otimes U(1)_{Y^{\prime}}\otimes U(1)_{(B-L)}$ gauge symmetry, where $Y^{\prime}$ is a new charge and ($B$) and ($L$) are the usual baryonic and leptonic numbers, respectivelly. The model has three right-handed neutrinos with non identical $(B-L)$ charges. We will use the superfield formalism in order to build our lagrangian and it is possible to accommodate all fermion masses at the tree level. In particular, the type-I seesaw mechanism is implemented for the generation of the active neutrino masses and also explain the mixing angle at the fermion sector. There are good candidates to Dark Matter, it can be the lighest righ-handed neutrinos or lighest right-handed sneutrinos or the lighest usual scalar field and due a Majorana phase at sneutrinos right-handed masses, it can induce Leptogenesis in this model.


title: Algorithmic approach to diagrammatic expansions for real-frequency evaluation of susceptibility functions

abstract: We systematically generate the perturbative expansion for the two-particle spin susceptibility in the Feynman diagrammatic formalism and apply this expansion to a model system - the single-band Hubbard model on a square lattice. We make use of algorithmic Matsubara integration (AMI) [A. Taheridehkordi, S. H. Curnoe, and J. P. F. LeBlanc, Phys. Rev. B 99, 035120 (2019)] to analytically evaluate Matsubara frequency summations, allowing us to symbolically impose analytic continuation to the real frequency axis. We minimize our computational expense by applying graph invariant transformations [Amir Taheridehkordi, S. H. Curnoe, and J. P. F. LeBlanc, Phys. Rev. B 101, 125109 (2020)]. We highlight extensions of the random-phase approximation and T-matrix methods that, due to AMI, become tractable. We present results for weak interaction strength where the direct perturbative expansion is convergent, and verify our results on the Matsubara axis by comparison to other numerical methods. By examining the spin susceptibility as a function of real-frequency via an order-by-order expansion we can identify precisely what role higher order corrections play on spin susceptibility and demonstrate the utility and limitations of our approach.


title: Momentum broadening of heavy quark in a magnetized thermal QCD medium

abstract: Anisotropic momentum diffusion coefficients of heavy quarks have been computed in a strongly magnetized quark-gluon plasma beyond the static limit within the framework of Langevin dynamics. Depending on the orientation of the motion of the heavy quark with respect to the direction of the magnetic field, five momentum diffusion coefficients of heavy quark have been estimated in the magnetized thermal medium. Specifically, we have focussed our attention to temperature range and strength of magnetic field satisfying the condition, $\it{i.e.}$ $M\gg\sqrt{eB}\gg T$, $M$ being the mass of heavy quark. The light quarks/antiquarks follow $1+1-$dimensional lowest Landau level (LLL) kinematics, and heavy quark dynamics are not directly affected by the magnetic field in the medium. The thermal gluon contribution to the diffusion coefficient is proportions to $T^3$, whereas, the contribution of light quarks in the lowest Landau state to the same is seen to be proportional to $T|eB|$. Furthermore, it is observed that for the case of heavy quark motion parallel to the magnetic field, the component of diffusion coefficient transverse both to the field and the heavy quark velocity $(\kappa^{\parallel}_{TT})$ turns out to be dominant as compared to the component longitudinal to both the field and motion $(\kappa^{\parallel}_{LL})$, $i.e.$, $\kappa^{\parallel}_{TT}\gg \kappa^{\parallel}_{LL}$. Further, for the case of heavy quark moving perpendicular to the magnetic field, it is seen that the diffusion coefficients transverse to the magnetic field are dominant, i.e., $\kappa^{\perp}_{LT}, \kappa^{\perp}_{TT}\gg \kappa^{\perp}_{TL}$.


title: Natural language technology and query expansion: issues, state-of-the-art and perspectives

abstract: The availability of an abundance of knowledge sources has spurred a large amount of effort in the development and enhancement of Information Retrieval techniques. Users information needs are expressed in natural language and successful retrieval is very much dependent on the effective communication of the intended purpose. Natural language queries consist of multiple linguistic features which serve to represent the intended search goal. Linguistic characteristics that cause semantic ambiguity and misinterpretation of queries as well as additional factors such as the lack of familiarity with the search environment affect the users ability to accurately represent their information needs, coined by the concept intention gap. The latter directly affects the relevance of the returned search results which may not be to the users satisfaction and therefore is a major issue impacting the effectiveness of information retrieval systems. Central to our discussion is the identification of the significant constituents that characterize the query intent and their enrichment through the addition of meaningful terms, phrases or even latent representations, either manually or automatically to capture their intended meaning. Specifically, we discuss techniques to achieve the enrichment and in particular those utilizing the information gathered from statistical processing of term dependencies within a document corpus or from external knowledge sources such as ontologies. We lay down the anatomy of a generic linguistic based query expansion framework and propose its module-based decomposition, covering topical issues from query processing, information retrieval, computational linguistics and ontology engineering. For each of the modules we review state-of-the-art solutions in the literature categorized and analyzed under the light of the techniques used.


title: Consistent Online Gaussian Process Regression Without the Sample Complexity Bottleneck

abstract: Gaussian processes provide a framework for nonlinear nonparametric Bayesian inference widely applicable across science and engineering. Unfortunately, their computational burden scales cubically with the training sample size, which in the case that samples arrive in perpetuity, approaches infinity. This issue necessitates approximations for use with streaming data, which to date mostly lack convergence guarantees. Thus, we develop the first online Gaussian process approximation that preserves convergence to the population posterior, i.e., asymptotic posterior consistency, while ameliorating its intractable complexity growth with the sample size. We propose an online compression scheme that, following each a posteriori update, fixes an error neighborhood with respect to the Hellinger metric centered at the current posterior, and greedily tosses out past kernel dictionary elements until its boundary is hit. We call the resulting method Parsimonious Online Gaussian Processes (POG). For diminishing error radius, exact asymptotic consistency is preserved (Theorem 1(i)) at the cost of unbounded memory in the limit. On the other hand, for constant error radius, POG converges to a neighborhood of the population posterior (Theorem 1(ii))but with finite memory at-worst determined by the metric entropy of the feature space (Theorem 2). Experimental results are presented on several nonlinear regression problems which illuminates the merits of this approach as compared with alternatives that fix the subspace dimension defining the history of past points.


title: Large-momentun tail of one-dimensional Fermi gases with spin-orbit coupling

abstract: We study the contacts, large-momentum tail, radio-frequency spectroscopy, and some other universal relations for an ultracold one-dimensional (1D) two-component Fermi gas with spin-orbit coupling (SOC). Different from previous studies, we find that the $q^{-8}$ tail in the spin-mixing (off-diagonal) terms of the momentum distribution matrix is dependent on the two SOC parameters in the laboratory frame for 1D systems, where $q$ is the relative momentum. This tail can be observed through time-of-flight measurement as a direct manifestation of the SOC effects on the many-body level. Besides the traditional 1D even-wave scattering length, we find that two new physical quantities must be introduced due to the SOC. Consequently, two new adiabatic energy relations with respect to the two SOC parameters are obtained. Furthermore, we derive the pressure relation and virial theorem at short distances for this system. To find how the SOC modifies the large-momentum behavior, we take the SOC parameters as perturbations since the strength of the SOC should be much smaller than the corresponding strength scale of the interatomic interactions. In addition, by using the operator product expansion method, we derive the asymptotic behavior of the large-momentum distribution matrix up to the $q^{-8}$ order and find that the diagonal terms of the distribution matrix include the contact of traditional 1D even-wave scattering length as the leading term and the SOC modified terms beyond the leading term, the off-diagonal term is beyond the subleading term and is corrected by the SOC parameters. We also find that the momentum distribution matrix shows spin-dependent and anisotropic features. Furthermore, we calculate the momentum distribution matrix in the laboratory frame for the experimental implication.


title: Astraeus II: Quantifying the impact of cosmic variance during the Epoch of Reionization

abstract: Next generation telescopes such as the James Webb Space Telescope (JWST) and the Nancy Grace Roman Space Telescope (NGRST) will enable us to study the first billion years of our Universe in unprecedented detail. In this work we use the ASTRAEUS (semi-numerical rAdiative tranSfer coupling of galaxy formaTion and Reionization in N-body dArk mattEr simUlationS) framework, that couples galaxy formation and reionization (for a wide range of reionization feedback models), to estimate the cosmic variance expected in the UV Luminosity Function (UV LF) and the Stellar Mass Function (SMF) in JWST surveys. We find that different reionization scenarios play a minor role in the cosmic variance. Most of the cosmic variance is completely driven by the underlying density field and increases above $100\%$ for ${\rm M}_{\rm UV} \sim -17.5 (-20)$ at $z =12 (6)$ for the JADES-deep survey (the deep JWST Advanced Extragalactic Survey with an area of 46 arcmin$^2$); the cosmic variance decreases with an increasing survey area roughly independently of redshift. We find that the faint-end (${\rm M}_{\rm UV} > -17$) slope of the Lyman Break Galaxies (LBGs) UV LF becomes increasingly shallower with increasing reionization feedback and show how JWST observations will be able to distinguish between different models of reionization feedback at $z>9$, even accounting for cosmic variance. We also show the environments (in terms of density and ionization fields)of Lyman Break Galaxies during the EoR, finding that the underlying over-density and ionization fraction scale positively with the UV luminosity. Finally, we also provide a public software tool to allow interested readers to compute cosmic variance for different redshifts and survey areas.


title: Deterministic Sparse Sublinear FFT with Improved Numerical Stability

abstract: In this paper we extend the deterministic sublinear FFT algorithm in Plonka et al. (2018) for fast reconstruction of $M$-sparse vectors ${\mathbf x}$ of length $N= 2^J$, where we assume that all components of the discrete Fourier transform $\hat{\mathbf x}= {\mathbf F}_{N} {\mathbf x}$ are available. The sparsity of ${\mathbf x}$ needs not to be known a priori, but is determined by the algorithm. If the sparsity $M$ is larger than $2^{J/2}$, then the algorithm turns into a usual FFT algorithm with runtime ${\mathcal O}(N \log N)$. For $M^{2} < N$, the runtime of the algorithm is ${\mathcal O}(M^2 \, \log N)$. The proposed modifications of the approach in Plonka et al. (2018) lead to a significant improvement of the condition numbers of the Vandermonde matrices which are employed in the iterative reconstruction. Our numerical experiments show that our modification has a huge impact on the stability of the algorithm. While the algorithm in Plonka et al. (2018) starts to be unreliable for $M>20$ because of numerical instabilities, the modified algorithm is still numerically stable for $M=200$.


title: A Kernel Two-sample Test for Dynamical Systems

abstract: Evaluating whether data streams are drawn from the same distribution is at the heart of various machine learning problems. This is particularly relevant for data generated by dynamical systems since such systems are essential for many real-world processes in biomedical, economic, or engineering systems. While kernel two-sample tests are powerful for comparing independent and identically distributed random variables, no established method exists for comparing dynamical systems. The main problem is the inherently violated independence assumption. We propose a two-sample test for dynamical systems by addressing three core challenges: we (i) introduce a novel notion of mixing that captures autocorrelations in a relevant metric, (ii) propose an efficient way to estimate the speed of mixing relying purely on data, and (iii) integrate these into established kernel two-sample tests. The result is a data-driven method that is straightforward to use in practice and comes with sound theoretical guarantees. In an example application to anomaly detection from human walking data, we show that the test is readily applicable without any human expert knowledge and feature engineering.


title: Optimal Rank-1 Hankel Approximation of Matrices: Frobenius Norm, Spectral Norm, and Cadzow's Algorithm

abstract: We characterize optimal rank-1 matrix approximations with Hankel or Toeplitz structure with regard to two different norms, the Frobenius norm and the spectral norm, in a new way. More precisely, we show that these rank-1 matrix approximation problems can be solved by maximizing special rational functions. Our approach enables us to show that the optimal solutions with respect to these two norms have completely different structure and only coincide in the trivial case when the singular value decomposition already provides an optimal rank-1 approximation with the desired Hankel or Toeplitz structure. We also prove that the Cadzow algorithm for structured low-rank approximations always converges to a fixed point in the rank-1 case. However, it usually does not converge to the optimal solution, neither with regard to the Frobenius norm nor the spectral norm.


title: Analysis of the Blade Element Momentum Theory

abstract: The blade element momentum (BEM) theory introduced by Lock et al. and formulated in its modern form by Glauert provides a framework to model the aerodynamic interaction between a turbine and a fluid flow. This theory is used either to estimate turbine efficiency or as a design aid. However, a lack of mathematical interpretation limits the understanding of some of its issues. The aim of this paper is to propose an analysis of BEM equations. Our approach is based on a reformulation of Glauert's model which enables us to identify criteria to guarantee the existence of solutions, analyze the convergence of usual and new (and more efficient) solution algorithms, and study turbine design procedures. The mathematical analysis is completed by numerical experiments.


title: On the variety of Euclidean point sets

abstract: We construct a continuum of non-homeomorphic compact subspaces of the real line R without singleton components. Thus from the purely topological point of view the real line contains not only more closed sets than open sets but also more closures of open sets than open sets. On the other hand, we show that this discrepancy vanishes either if the topological point of view is sharpened in the metrical or in the order-theoretical direction, or if R is replaced with R^n for dimension n>1. Furthermore, we track down a continuum of topological types of closed and totally disconnected subsets of R. In doing so we also track down a continuum of metrical types of infinite, discrete subsets of the unit interval [0,1]. (As a consequence, any countably infinite discrete space has a continuum of non-homeomorphic metrizable compactifications.)


title: Normal form near orbit segments of convex Hamiltonian systems

abstract: In the study of Hamiltonian systems on cotangent bundles, it is natural to perturb Hamiltoni-ans by adding potentials (functions depending only on the base point). This led to the definition of Ma{\~n}{\'e} genericity: a property is generic if, given a Hamiltonian H, the set of potentials u such that H + u satisfies the property is generic. This notion is mostly used in the context of Hamiltonians which are convex in p, in the sense that $\partial$ 2 pp H is positive definite at each points. We will also restrict our study to this situation. There is a close relation between perturbations of Hamiltonians by a small additive potential and perturbations by a positive factor close to one. Indeed, the Hamiltonians H + u and H/(1 -- u) have the same level one energy surface, hence their dynamics on this energy surface are reparametrisation of each other, this is the Maupertuis principle. This remark is particularly relevant when H is homogeneous in the fibers (which corresponds to Finsler metrics) or even fiberwise quadratic (which corresponds to Riemannian metrics). In these cases, perturbations by potentials of the Hamiltonian correspond, up to parametrisation, to conformal perturbations of the metric. One of the widely studied aspects is to understand to what extent the return map associated to a periodic orbit can be perturbed by adding a small potential. This kind of question depend strongly on the context in which they are posed. Some of the most studied contexts are, in increasing order of difficulty, perturbations of general vector fields, perturbations of Hamiltonian systems inside the class of Hamiltonian systems, perturbations of Riemannian metrics inside the class of Riemannian metrics, Ma{\~n}{\'e} perturbations of convex Hamiltonians. It is for example well-known that each vector field can be perturbed to a vector field with only hyperbolic periodic orbits, this is part of the Kupka-Smale theorem, see [5, 13]. There is no such result in the context of Hamiltonian vector fields, but it remains true that each Hamiltonian can be perturbed to a Hamiltonian with only non-degenerate periodic orbits (including the iterated ones), see [11, 12]. The same result is true in the context of Riemannian metrics: every Riemannian metric can be perturbed to a Riemannian metric with only non-degenerate closed geodesics, this is the bumpy metric theorem, see [4, 2, 1]. The question was investigated only much more recently in the context of Ma{\~n}{\'e} perturbations of convex Hamiltonians, see [9, 10]. It is proved in [10] that the same result holds : If H is a convex Hamiltonian and a is a regular value of H, then there exist arbitrarily small potentials u such that all periodic orbits (including iterated ones) of H + u at energy a are non-degenerate. The proof given in [10] is actually rather similar to the ones given in papers on the perturbations of Riemannian metrics. In all these proofs, it is very useful to work


title: Separation of quantum, spatial quantum, and approximate quantum correlations

abstract: Quantum nonlocal correlations are generated by implementation of local quantum measurements on spatially separated quantum subsystems. Depending on the underlying mathematical model, various notions of sets of quantum correlations can be defined. In this paper we prove separations of such sets of quantum correlations. In particular, we show that the set of bipartite quantum correlations with four binary measurements per party becomes strictly smaller once we restrict the local Hilbert spaces to be finite dimensional, i.e., $\mathcal{C}_{q}^{(4, 4, 2,2)} \neq \mathcal{C}_{qs}^{(4, 4, 2,2)}$. We also prove non-closure of the set of bipartite quantum correlations with four ternary measurements per party, i.e., $\mathcal{C}_{qs}^{(4, 4, 3,3)} \neq \mathcal{C}_{qa}^{(4, 4, 3,3)}$.


title: Low-frequency observations of the Giant Radio Galaxy NGC 6251

abstract: We present LOFAR observations at 150 MHz of the borderline FRI/FRII giant radio galaxy NGC 6251. This paper presents the most sensitive and highest-resolution images of NGC 6251 at these frequencies to date, revealing for the first time a low-surface-brightness extension to the northern lobe, and a possible backflow associated with the southern lobe. The integrated spectra of components of NGC 6251 are consistent with previous measurements at higher frequencies, similar to results from other LOFAR studies of nearby radio galaxies. We find the outer structures of NGC 6251 to be either at equipartition or slightly electron dominated, similar to those of FRII sources rather than FRIs; but this conclusion remains tentative because of uncertainties associated with the geometry and the extrapolation of X-ray measurements to determine the external pressure distribution on the scale of the outer lobes. We place lower limits on the ages of the extension of the northern lobe and the backflow of the southern lobe of $t \gtrsim 250$ Myr and $t \gtrsim 210$ Myr respectively. We present the first detection of polarisation at 150 MHz in NGC 6251. Taking advantage of the high Faraday resolution of LOFAR, we place an upper limit on the magnetic field in the group of $B < 0.2 (\Lambda_B / 10 {\rm kpc})^{-0.5} \mu$G for a coherence scale of $\Lambda_B < 60 {\rm kpc}$ and $B < 13 \mu$G for $\Lambda_B = 240$ kpc.


title: A quasi-sure optional decomposition and super-hedging result on the Skorokhod space

abstract: We prove a robust super-hedging duality result for path-dependent options on assets with jumps, in a continuous time setting. It requires that the collection of martingale measures is rich enough and that the payoff function satisfies some continuity property. It is a by-product of a quasi-sure version of the optional decomposition theorem, which can also be viewed as a functional version of It{\^o}'s Lemma, that applies to non-smooth functionals (of c{\`a}dl{\`a}g processes) which are only concave in space and non-increasing in time, in the sense of Dupire.


title: Toward establishing the low-lying $P$-wave $\Sigma_b$ states

abstract: In the present work, we analyze the $P$-wave singly-heavy baryon spectrum belonging to $\mathbf{6}_F$ by combining the observations of the heavy baryon states, and restudy the strong decays of the $1P$ wave $\Sigma_b$ states within the $j$-$j$ coupling scheme using the chiral quark model. We obtain that: (i) the structure $\Sigma_b(6097)$ observed in the $\Lambda_b\pi$ final state may arise from the overlapping of $\Sigma_b|J^P=\frac{3}{2}^-,2\rangle$ and $\Sigma_b|J^P=\frac{5}{2}^-,2\rangle$. (ii) The broad structure $\Sigma_b(6072)$ observed in the $\Lambda_b\pi\pi$ final state may arise from the overlapping of $\Sigma_b|J^P=\frac{1}{2}^-,1\rangle$ and $\Sigma_b|J^P=\frac{3}{2}^-,1\rangle$. (iii) The missing state $\Sigma_b|J^P=\frac{1}{2}^-,0\rangle$ is most likely to be a narrow state with a width of $\Gamma\sim10$ MeV, and mainly decays into $\Lambda_b\pi$ channel.


title: Spontaneous emission in anisotropic dielectrics

abstract: The emission properties of atoms lie at the foundations of both quantum theory and light-matter interactions. In the context of macroscopic media, exact knowledge thereof is important both in current quantum technologies as well as in fundamental studies. While for isotropic media, this is a very well-studied problem, there are still big gaps in the theory of anisotropic media. In particular, to the best of our knowledge, an explicit expression for the spontaneous emission rate in general anisotropic media has not been presented. In this work, we first derive the quantised electromagnetic field operators to calculate the emission rate in uniaxial media. For the more general case of biaxial media we propose an approximate expression based on interpolation between the limiting cases of uniaxial media. We support our model with numerical simulations which are in strong agreement for typical media configurations, and furthermore show how local field effects can be taken into account in the model.


title: Colors and patterns of black hole X-ray binary GX 339-4

abstract: Black hole X-ray binaries show signs of non-thermal emission in the optical/near-infrared range. We analyze the optical/near-infrared SMARTS data on GX339$-$4 over the 2002--2011 period. Using the soft state data, we estimate the interstellar extinction towards the source and characteristic color temperatures of the accretion disk. We show that various spectral states of regular outbursts occupy similar regions on the color-magnitude diagrams, and that transitions between the states proceed along the same tracks despite substantial differences in the observed light curves morphology. We determine the typical duration of the hard-to-soft and soft-to-hard state transitions and the hard state at the decaying stage of the outburst to be one, two and four weeks, respectively. We find that the failed outbursts cannot be easily distinguished from the regular ones at their early stages, but if the source reaches 16 mag in $V$-band, it will transit to the soft state. By subtracting the contribution of the accretion disk, we obtain the spectra of the non-thermal component, which have constant, nearly flat shape during the transitions between the hard and soft states. In contrast to the slowly evolving non-thermal component seen at optical and near-infrared wavelengths, the mid-infrared spectrum is strongly variable on short timescales and sometimes shows a prominent excess with a cutoff below $10^{14}$ Hz. We show that the radio to optical spectrum can be modeled using three components corresponding to the jet, hot flow and irradiated accretion disk.


title: On the sodium enhancement in spectra of slow meteors and the origin of Na-rich meteoroids

abstract: The detected Na/Mg ratio in a sample of 17 Na-enhanced and Na-rich meteors is investigated based on obtained spectral, orbital and structural data. We utilize the meteor observations of the AMOS network obtained within a survey of medium-sized meteoroids supplemented by higher-resolution spectra observed on the Canary Islands. Ground-based meteor observations are then compared with high-resolution Echelle spectra of simulated ablation of known meteorite samples in a high-enthalpy plasma wind tunnel. It was found that most Na-enhanced and Na-rich spectra can be explained by the effect of low meteor speed related to low ablation temperatures and generally do not reflect real meteoroid composition. Spectra obtained by the laboratory experiment simulating low meteor speeds show corresponding Na-rich profiles irrespectively of the meteorite composition. We estimate that for an H-type ordinary chondrite with speed of $\approx$ 10 km/s, the Na line intensity is increased by a factor of 40 to 95. The dynamical analysis has revealed that all Na-rich meteors originated on Apollo-type orbits and exhibit consistent chondritic material strengths. For more clarity in the classification of Na-enhanced and Na-rich meteoroids, we propose new speed-dependent boundaries between the spectral classes. Real compositional Na enhancement was confirmed in five cometary meteoroids: two Perseids, an $\alpha$-Capricornid, $\nu$-Draconid and a sporadic. The two Na-enhanced Perseids were linked with increased material strength suggesting that the detected increase of volatile content has implications for the meteoroid structure.


title: Prospecting chiral multi-site interactions in prototypical magnetic systems

abstract: Atomistic spin models have found enormous success in addressing the properties of magnetic materials, grounded on the identification of the relevant underlying magnetic interactions. The huge development in the field of magnetic skyrmions and other noncollinear magnetic structures is largely due to our understanding of the chiral Dzyaloshinskii-Moriya interaction. Recently, various works have proposed new types of chiral interactions, with seemingly different forms, but the big picture is still missing. Here, we present a systematic construction of a generalized spin model containing isotropic and chiral multi-site interactions. These are motivated by a microscopic model that incorporates local spin moments and the spin-orbit interaction, and their symmetry properties are established. We show that the chiral interactions arise solely from the spin-orbit interaction and that the multi-site interactions do not have to follow Moriya's rules, unlike the Dzyaloshinskii-Moriya and chiral biquadratic interactions. The chiral multi-site interactions do not vanish due to inversion symmetry, and comply with a generalized Moriya rule: If all sites connected by the interaction lie in the same mirror plane, the chiral interaction vector must be perpendicular to this plane. We then illustrate our theoretical considerations with density functional theory calculations for prototypical magnetic systems. These are triangular trimers built out of Cr, Mn, Fe and Co adatoms on the Re(0001), Pt(111) and Au(111) surfaces, for which $C_\mathrm{3v}$ symmetry applies, and Cr and Fe square tetramers on Pt(001) with $C_\mathrm{4v}$ symmetry. The multi-site interactions are substantial in magnitude and cannot be neglected when comparing the energy of different magnetic structures. Finally, we discuss the recent literature in light of our findings, and clarify several unclear or confusing points.


title: Relative non-pluripolar products of currents

abstract: Given a closed positive current T on a compact Kahler manifold X, we introduce the notion of non-pluripolar product relative to T of closed positive (1,1)-currents. We recover the well-known non-pluripolar product when T is the current of integration along X. Our main results are a monotonicity property of relative non-pluripolar products, a necessary condition for currents to be of relative full mass intersection in terms of Lelong numbers, and the convexity of weighted classes of currents of relative full mass intersection. The former two results are new even when T is the current of integration along X.


title: A Simple Differential Geometry for Complex Networks

abstract: We introduce new definitions of sectional, Ricci and scalar curvature for networks and their higher dimensional counterparts, derived from two classical notions of curvature for curves in general metric spaces, namely, the Menger curvature and the Haantjes curvature. These curvatures are applicable to unweighted or weighted and undirected or directed networks, and are more intuitive and easier to compute than other network curvatures. In particular, the proposed curvatures based on the interpretation of Haantjes definition as geodesic curvature allow us to give a network analogue of the classical local Gauss-Bonnet theorem. Furthermore, we propose even simpler and more intuitive proxies for the Haantjes curvature that allow for even faster and easier computations in large-scale networks. In addition, we also investigate the embedding properties of the proposed Ricci curvatures. Lastly, we also investigate the behaviour, both on model and real-world networks, of the curvatures introduced herein with more established notions of Ricci curvature and other widely-used network measures.


title: Human-Machine Collaboration for Democratizing Data Science

abstract: Everybody wants to analyse their data, but only few posses the data science expertise to to this. Motivated by this observation we introduce a novel framework and system \textsc{VisualSynth} for human-machine collaboration in data science. It wants to democratize data science by allowing users to interact with standard spreadsheet software in order to perform and automate various data analysis tasks ranging from data wrangling, data selection, clustering, constraint learning, predictive modeling and auto-completion. \textsc{VisualSynth} relies on the user providing colored sketches, i.e., coloring parts of the spreadsheet, to partially specify data science tasks, which are then determined and executed using artificial intelligence techniques.


title: Improving the Interpretability of fMRI Decoding using Deep Neural Networks and Adversarial Robustness

abstract: Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what input information is used by the DNN in the process, something important in both cognitive neuroscience and clinical applications. A saliency map is a common approach for producing interpretable visualizations of the relative importance of input features for a prediction. However, methods for creating maps often fail due to DNNs being sensitive to input noise, or by focusing too much on the input and too little on the model. It is also challenging to evaluate how well saliency maps correspond to the truly relevant input information, as ground truth is not always available. In this paper, we review a variety of methods for producing gradient-based saliency maps, and present a new adversarial training method we developed to make DNNs robust to input noise, with the goal of improving interpretability. We introduce two quantitative evaluation procedures for saliency map methods in fMRI, applicable whenever a DNN or linear model is being trained to decode some information from imaging data. We evaluate the procedures using a synthetic dataset where the complex activation structure is known, and on saliency maps produced for DNN and linear models for task decoding in the Human Connectome Project (HCP) dataset. Our key finding is that saliency maps produced with different methods vary widely in interpretability, in both in synthetic and HCP fMRI data. Strikingly, even when DNN and linear models decode at comparable levels of performance, DNN saliency maps score higher on interpretability than linear model saliency maps (derived via weights or gradient). Finally, saliency maps produced with our adversarial training method outperform those from other methods.


title: Adaptive evolution of hybrid bacteria by horizontal gene transfer

abstract: Horizontal gene transfer is an important factor in bacterial evolution that can act across species boundaries. Yet, we know little about rate and genomic targets of cross-lineage gene transfer, and about its effects on the recipient organism's physiology and fitness. Here, we address these questions in a parallel evolution experiment with two Bacillus subtilis lineages of 7% sequence divergence. We observe rapid evolution of hybrid organisms: gene transfer swaps ~12% of the core genome in just 200 generations, and 60% of core genes are replaced in at least one population. By genomics, transcriptomics, fitness assays, and statistical modeling, we show that transfer generates adaptive evolution and functional alterations in hybrids. Specifically, our experiments reveal a strong, repeatable fitness increase of evolved populations in the stationary growth phase. By genomic analysis of the transfer statistics across replicate populations, we infer that selection on HGT has a broad genetic basis: 40% of the observed transfers are adaptive. At the level of functional gene networks, we find signatures of negative and positive selection, consistent with hybrid incompatibilities and adaptive evolution of network functions. Our results suggest that gene transfer navigates a complex cross-lineage fitness landscape, bridging epistatic barriers along multiple high-fitness paths.


title: Deep Learning Classification With Noisy Labels

abstract: Deep Learning systems have shown tremendous accuracy in image classification, at the cost of big image datasets. Collecting such amounts of data can lead to labelling errors in the training set. Indexing multimedia content for retrieval, classification or recommendation can involve tagging or classification based on multiple criteria. In our case, we train face recognition systems for actors identification with a closed set of identities while being exposed to a significant number of perturbators (actors unknown to our database). Face classifiers are known to be sensitive to label noise. We review recent works on how to manage noisy annotations when training deep learning classifiers, independently from our interest in face recognition.


title: Ionic Self-Diffusion and the Glass Transition Anomaly in Aluminosilicates

abstract: The glass transition temperature (Tg) is the temperature, after which the supercooled liquid undergoes a dynamical arrest. Usually, the glass network modifiers (e.g., Na2O) affect the behavior of Tg. However, in aluminosilicate glasses, the effect of different modifiers on Tg is still unclear and show an anomalous behavior. Here, based on molecular dynamics simulations, we show that the glass transition temperature decreases with increasing charge balancing cations field strength (FS) in the aluminosilicate glasses, which is an anomalous behavior as compared to other oxide glasses. The results show that the origins of this anomaly come from the dynamics of the supercooled liquid above Tg, which in turn is correlated to pair excess entropy. Our results deepen our understanding of the effect of different modifiers on the properties of the aluminosilicate glasses.


title: Some Applications of Lie Groups in Theory of Technical Progress

abstract: In recent decades, we have known some interesting applications of Lie theory in the theory of technological progress. Firstly, we will discuss some results of R. Saito in \cite{rS1980} and \cite{rS1981} about the application modeling of Lie groups in the theory of technical progress. Next, we will describe the result on Romanian economy of G. Zaman and Z. Goschin in \cite{ZG2010}. Finally, by using Sato's results and applying the method of G. Zaman and Z. Goschin, we give an estimation of the GDP function of Viet Nam for the 1995-2018 period and give several important observations about the impact of technical progress on economic growth of Viet Nam.


title: Hydrogen Bond Interaction Promotes Flash Energy Transport at MXene-water Interface

abstract: There are emerging applications for photothermal conversion utilizing MXene, but the mechanism under these applications related interfacial energy migration from MXene to the attached surface layer is still unknown. In this paper, with comprehensive ultrafast studies, we reported the energy migration pathway from MXene (Ti3C2Tx) to local environment under plasmonic excitation. Our data found that in water, energy dissipation is divided into fast hydrogen bond mediated channel and slow lattice motion mediated channel.The experimental results suggest that in water, nearly 80% energy in MXene that gained from the photoexcitation quickly dissipates into surrounding water molecules within 7 ps as a hydrogen bond mediated fast channel, and the remaining energy vanishes with time constant ~100 ps as a lattice motion mediated slow channel. The fast energy migration would result in the prominent interfacial energy conductance 150-300 MW *m{-2}* K{-1} for MXene-water interface. Tuning the solvent into ethanol could both narrow the energy dissipation to 35% through the fast channel and slow down the thermal channel (400 ps). To gain the molecular insight, molecular dynamic results presented different solvents had significantly different H bond forming ability on MXene surface. Our results suggested that interfacial interaction is crucial for effective hydrogen bonds on MXene surface to channel the excitation dissipation, providing important insights into the photothermal applications with MXene.


title: Software-Level Accuracy Using Stochastic Computing With Charge-Trap-Flash Based Weight Matrix

abstract: The in-memory computing paradigm with emerging memory devices has been recently shown to be a promising way to accelerate deep learning. Resistive processing unit (RPU) has been proposed to enable the vector-vector outer product in a crossbar array using a stochastic train of identical pulses to enable one-shot weight update, promising intense speed-up in matrix multiplication operations, which form the bulk of training neural networks. However, the performance of the system suffers if the device does not satisfy the condition of linear conductance change over around 1,000 conductance levels. This is a challenge for nanoscale memories. Recently, Charge Trap Flash (CTF) memory was shown to have a large number of levels before saturation, but variable non-linearity. In this paper, we explore the trade-off between the range of conductance change and linearity. We show, through simulations, that at an optimum choice of the range, our system performs nearly as well as the models trained using exact floating point operations, with less than 1% reduction in the performance. Our system reaches an accuracy of 97.9% on MNIST dataset, 89.1% and 70.5% accuracy on CIFAR-10 and CIFAR-100 datasets (using pre-extracted features). We also show its use in reinforcement learning, where it is used for value function approximation in Q-Learning, and learns to complete an episode the mountain car control problem in around 146 steps. Benchmarked to state-of-the-art, the CTF based RPU shows best in class performance to enable software equivalent performance.


title: Quantifying the Economic Impact of Extreme Shocks on Businesses using Human Mobility Data: a Bayesian Causal Inference Approach

abstract: In recent years, extreme shocks, such as natural disasters, are increasing in both frequency and intensity, causing significant economic loss to many cities around the world. Quantifying the economic cost of local businesses after extreme shocks is important for post-disaster assessment and pre-disaster planning. Conventionally, surveys have been the primary source of data used to quantify damages inflicted on businesses by disasters. However, surveys often suffer from high cost and long time for implementation, spatio-temporal sparsity in observations, and limitations in scalability. Recently, large scale human mobility data (e.g. mobile phone GPS) have been used to observe and analyze human mobility patterns in an unprecedented spatio-temporal granularity and scale. In this work, we use location data collected from mobile phones to estimate and analyze the causal impact of hurricanes on business performance. To quantify the causal impact of the disaster, we use a Bayesian structural time series model to predict the counterfactual performances of affected businesses (what if the disaster did not occur?), which may use performances of other businesses outside the disaster areas as covariates. The method is tested to quantify the resilience of 635 businesses across 9 categories in Puerto Rico after Hurricane Maria. Furthermore, hierarchical Bayesian models are used to reveal the effect of business characteristics such as location and category on the long-term resilience of businesses. The study presents a novel and more efficient method to quantify business resilience, which could assist policy makers in disaster preparation and relief processes.


title: Optimizing the reliability of a bank with Logistic Regression and Particle Swarm Optimization

abstract: It is well-known that disciplines such as mechanical engineering, electrical engineering, civil engineering, aerospace engineering, chemical engineering and software engineering witnessed successful applications of reliability engineering concepts. However, the concept of reliability in its strict sense is missing in financial services. Therefore, in order to fill this gap, in a first-of-its-kind-study, we define the reliability of a bank/firm in terms of the financial ratios connoting the financial health of the bank to withstand the likelihood of insolvency or bankruptcy. For the purpose of estimating the reliability of a bank, we invoke a statistical and machine learning algorithm namely, logistic regression (LR). Once, the parameters are estimated in the 1st stage, we fix them and treat the financial ratios as decision variables. Thus, in the 1st stage, we accomplish the hitherto unknown way of estimating the reliability of a bank. Subsequently, in the 2nd stage, in order to maximize the reliability of the bank, we formulate an unconstrained optimization problem in a single-objective environment and solve it using the well-known particle swarm optimization (PSO) algorithm. Thus, in essence, these two stages correspond to predictive and prescriptive analytics respectively. The proposed 2-stage strategy of using them in tandem is beneficial to the decision-makers within a bank who can try to achieve the optimal or near-optimal values of the financial ratios in order to maximize the reliability which is tantamount to safeguarding their bank against solvency or bankruptcy.


title: Imputation of missing sub-hourly precipitation data in a large sensor network: a machine learning approach

abstract: Precipitation data collected at sub-hourly resolution represents specific challenges for missing data recovery by being largely stochastic in nature and highly unbalanced in the duration of rain vs non-rain. Here we present a two-step analysis utilising current machine learning techniques for imputing precipitation data sampled at 30-minute intervals by devolving the task into (a) the classification of rain or non-rain samples, and (b) regressing the absolute values of predicted rain samples. Investigating 37 weather stations in the UK, this machine learning process produces more accurate predictions for recovering precipitation data than an established surface fitting technique utilising neighbouring rain gauges. Increasing available features for the training of machine learning algorithms increases performance with the integration of weather data at the target site with externally sourced rain gauges providing the highest performance. This method informs machine learning models by utilising information in concurrently collected environmental data to make accurate predictions of missing rain data. Capturing complex non-linear relationships from weakly correlated variables is critical for data recovery at sub-hourly resolutions. Such pipelines for data recovery can be developed and deployed for highly automated and near instantaneous imputation of missing values in ongoing datasets at high temporal resolutions.


title: Group-level selection avoids the tragedy of the commons

abstract: The public goods game is a famous example illustrating the tragedy of the commons. In this game cooperating individuals contribute to a pool, which in turn is distributed to all members of the group, including defectors who reap the same rewards as cooperators without having made a contribution before. The question is now, how to incentivize group members to all cooperate as it maximizes the common good. While costly punishment presents one such method, the cost of punishment still reduces the common good. Here we show how group-level selection can be such an incentive, and specifically how even fractions of group-level selection can overcome the benefits defectors receive. Further, we show how punishment and group-level selection interact. This work suggests that a redistribution similar to a basic income that is coupled to the economic success of the entire group could overcome the tragedy of the commons.