title: Intracellular Electrochemical Nanomeasurements Reveal that Exocytosis of Molecules at Living Neurons is Subquantal and Complex

abstract: Since the early work of Bernard Katz, the process of cellular chemical communication via exocytosis, quantal release, has been considered to be all or none. Recent evidence has shown exocytosis to be partial or 'subquantal' at single-cell model systems, but there is a need to understand this at communicating nerve cells. Partial release allows nerve cells to control the signal at the site of release during individual events, where the smaller the fraction released, the greater the range of regulation. Here we show that the fraction of the vesicular octopamine content released from a living Drosophila larval neuromuscular neuron is very small. The percentage of released molecules was found to be only 4.5% for simple events and 10.7% for complex (i.e., oscillating or flickering) events. This large content, combined with partial release controlled by fluctuations of the fusion pore, offers presynaptic plasticity that can be widely regulated. Two works published in 2010 suggested that the Katz principle, [1] was incorrect for all-or-none release and that only part of the chemical load of vesicles was released during exocytosis, at least as measured as a full spike during amperometry. [2] The combination of electrochemical methods to measure both release and vesicle content in 2015 added a wealth of information to support the concept of partial release in exocytosis. [3] Additionally, this has recently been supported by work with TIRF microscopy showing 'subquantal' release from vesicles in adrenal chromaffin cells and using super-resolution STED microscopy. [4] It appears that the full event generally involves release of only part of the load of chemical messenger in single-cell model systems like adrenal chromaffin and PC12 cells. Is this also true at living neurons in a nervous system and to what extent? To answer this critical question, we quantified the number of octopamine molecules in the neuromuscular neurons of Drosophila larvae by adapting an amperometric technique developed in our


title: Nonlinear maps preserving the mixed Jordan triple $\eta$-$*$-product between factors

abstract: Let $\mathcal{A}$ and $\mathcal{B}$ be two factor von Neumann algebras and $\eta$ be a non-zero complex number. A nonlinear bijective map $\phi:\mathcal A\rightarrow\mathcal B$ has been demonstrated to satisfy $$\phi([A,B]_{*}^{\eta}\diamond_{\eta} C)=[\phi(A),\phi(B)]_{*}^{\eta}\diamond_{\eta}\phi(C)$$ for all $A,B,C\in\mathcal A.$ If $\eta=1,$ then $\phi$ is a linear $*$-isomorphism, a conjugate linear $*$-isomorphism, the negative of a linear $*$-isomorphism, or the negative of a conjugate linear $*$-isomorphism. If $\eta\neq 1$ and satisfies $\phi(I)=1,$ then $\phi$ is either a linear $*$-isomorphism or a conjugate linear $*$-isomorphism.


title: A Constraint-Based Algorithm for the Structural Learning of Continuous-Time Bayesian Networks

abstract: Dynamic Bayesian networks have been well explored in the literature as discrete-time models: however, their continuous-time extensions have seen comparatively little attention. In this paper, we propose the first constraint-based algorithm for learning the structure of continuous-time Bayesian networks. We discuss the different statistical tests and the underlying hypotheses used by our proposal to establish conditional independence. Furthermore, we analyze and discuss the computational complexity of the best and worst cases for the proposed algorithm. Finally, we validate its performance using synthetic data, and we discuss its strengths and limitations comparing it with the score-based structure learning algorithm from Nodelman et al. (2003). We find the latter to be more accurate in learning networks with binary variables, while our constraint-based approach is more accurate with variables assuming more than two values. Numerical experiments confirm that score-based and constraint-based algorithms are comparable in terms of computation time.


title: Agafonov's Proof of Agafonov's Theorem: A Modern Account and New Insights

abstract: We give a modern account of Agafonov's original proof of his eponymous theorem. The original proof was only reported in Russian in a journal not widely available, and the work most commonly cited in western literature is instead the English translation of a summary version containing no proofs, and the main proof relied heavily on material well-known in Russian mathematical circles of the day, which perhaps obscures the main thrust of argumentation for modern readers.Our present account recasts Aganofov's arguments using more basic building blocks than in the original proof, and contains some further embellishments to Agafonov's original arguments, made in the interest of clarity. We posit that the modern account provides new insight to the underlying phenomena of the theorem.We also provides some historical context to Agafonov's work, including a short description of some of the ideas that led to Agafonov's own proof, especially emphasizing the important work of Postnikova.


title: Harmonic quasi-isometric maps III :quotients of Hadamard manifolds

abstract: In a previous paper, we proved that a quasi-isometric map $f:X\longrightarrow Y$ between two pinched Hadamard manifolds $X$ and $Y$ is within bounded distance from a unique harmonic map. We extend this result to maps $f:\Gamma\backslash X\longrightarrow Y$, where $\Gamma$ is a convex cocompact discrete group of isometries of $X$ and $f$ is locally quasi-isometric at infinity.


title: Automated and Formal Synthesis of Neural Barrier Certificates for Dynamical Models

abstract: We introduce an automated, formal, counterexample-based approach to synthesise Barrier Certificates (BC) for the safety verification of continuous and hybrid dynamical models. The approach is underpinned by an inductive framework: this is structured as a sequential loop between a learner, which manipulates a candidate BC structured as a neural network, and a sound verifier, which either certifies the candidate's validity or generates counter-examples to further guide the learner. We compare the approach against state-of-the-art techniques, over polynomial and non-polynomial dynamical models: the outcomes show that we can synthesise sound BCs up to two orders of magnitude faster, with in particular a stark speedup on the verification engine (up to five orders less), whilst needing a far smaller data set (up to three orders less) for the learning part. Beyond improvements over the state of the art, we further challenge the new approach on a hybrid dynamical model and on larger-dimensional models, and showcase the numerical robustness of our algorithms and codebase.


title: Driving frequency effect on discharge parameters and higher harmonic generation in capacitive discharges at constant power densities

abstract: Very high frequency (VHF) driven capacitive discharges are now being increasingly adopted for plasma-based materials processing due to their high processing rates and lower substrate damage. Past studies related to complex plasma dynamics and higher harmonics generation in such systems were limited to constant voltage/current conditions, whereas, industrial systems are mostly driven by constant power density sources. In the present study, using particle-in-cell (PIC) simulation, we explore the dynamics of collisionless symmetric capacitive discharges that is operated at constant power densities. Our focus is on the effect of the driving frequency on the discharge parameters like the electron density/temperature, the electron energy distribution function (EEDF), the ion energy distribution function (IEDF), and the generation of higher harmonics in the device. The simulations are performed for a driving frequency from 27.12-100 MHz in argon plasma at a gas pressure of 1 Pa and for two values of the power density, namely, 2 kW/m3 and 20 kW/m3. It is observed that the required discharge voltage for maintaining constant power density decreases and discharge current increases with an increase in the driving frequency. A transition frequency is observed at both power densities. The density decreases (electron temperature increases) before the transition frequency and the trend is reversed after crossing the transition frequency. The EEDF shows an enhancement in the population of the mid-energy range of electrons as the driving frequency increases up to the transition frequency thereby changing the shape of EEDF from bi-Maxwellian to nearly Maxwellian, and then transforms into a nearly bi-Maxwellian at higher driving frequencies.


title: Doubly infinite residual neural networks: a diffusion process approach

abstract: Modern neural networks (NN) featuring a large number of layers (depth) and units per layer (width) have achieved a remarkable performance across many domains. While there exists a vast literature on the interplay between infinitely wide NNs and Gaussian processes, a little is known about analogous interplays with respect to infinitely deep NNs. NNs with independent and identically distributed (i.i.d.) initializations exhibit undesirable forward and backward propagation properties as the number of layers increases. To overcome these drawbacks, Peluchetti and Favaro (2020) considered fully-connected residual networks (ResNets) with network's parameters initialized by means of distributions that shrink as the number of layers increases, thus establishing an interplay between infinitely deep ResNets and solutions to stochastic differential equations, i.e. diffusion processes, and showing that infinitely deep ResNets does not suffer from undesirable forward-propagation properties. In this paper, we review the results of Peluchetti and Favaro (2020), extending them to convolutional ResNets, and we establish analogous backward-propagation results, which directly relate to the problem of training fully-connected deep ResNets. Then, we investigate the more general setting of doubly infinite NNs, where both network's width and network's depth grow unboundedly. We focus on doubly infinite fully-connected ResNets, for which we consider i.i.d. initializations. Under this setting, we show that the dynamics of quantities of interest converge, at initialization, to deterministic limits. This allow us to provide analytical expressions for inference, both in the case of weakly trained and fully trained ResNets. Our results highlight a limited expressive power of doubly infinite ResNets when the unscaled network's parameters are i.i.d. and the residual blocks are shallow.


title: Auto-CASH: Autonomous Classification Algorithm Selection with Deep Q-Network

abstract: The great amount of datasets generated by various data sources have posed the challenge to machine learning algorithm selection and hyperparameter configuration. For a specific machine learning task, it usually takes domain experts plenty of time to select an appropriate algorithm and configure its hyperparameters. If the problem of algorithm selection and hyperparameter optimization can be solved automatically, the task will be executed more efficiently with performance guarantee. Such problem is also known as the CASH problem. Early work either requires a large amount of human labor, or suffers from high time or space complexity. In our work, we present Auto-CASH, a pre-trained model based on meta-learning, to solve the CASH problem more efficiently. Auto-CASH is the first approach that utilizes Deep Q-Network to automatically select the meta-features for each dataset, thus reducing the time cost tremendously without introducing too much human labor. To demonstrate the effectiveness of our model, we conduct extensive experiments on 120 real-world classification datasets. Compared with classical and the state-of-art CASH approaches, experimental results show that Auto-CASH achieves better performance within shorter time.


title: Universal criticality of thermodynamic curvatures for charged AdS black holes

abstract: In this paper, we analytically study the critical exponents and universal amplitudes of the thermodynamic curvatures such as the intrinsic and extrinsic curvature at the critical point of the small-large black hole phase transition for the charged AdS black holes. At the critical point, it is found that the normalized intrinsic curvature $R_N$ and extrinsic curvature $K_N$ has critical exponents 2 and 1, respectively. Based on them, the universal amplitudes $R_Nt^2$ and $K_Nt$ are calculated with the temperature parameter $t=T/T_c-1$ where $T_c$ the critical value of the temperature. Near the critical point, we find that the critical amplitude of $R_Nt^2$ and $K_Nt$ is $-\frac{1}{2}$ when $t\rightarrow0^+$, whereas $R_Nt^2\approx -\frac{1}{8}$ and $K_Nt\approx-\frac{1}{4}$ in the limit $t\rightarrow0^-$. These results not only hold for the four dimensional charged AdS black hole, but also for the higher dimensional cases. Therefore, such universal properties will cast new insight into the thermodynamic geometries and black hole phase transitions.

categories: gr-qc cond-mat.stat-mech hep-th quant-ph


title: Strichartz estimates and local regularity for the elastic wave equation with singular potentials

abstract: We obtain weighted $L^2$ estimates for the elastic wave equation perturbed by singular potentials including the inverse-square potential. We then deduce the Strichartz estimates under the sole ellipticity condition for the Lam\'e operator $-\Delta^\ast$. This improves upon the previous result in \cite{BFRVV} which relies on a stronger condition to guarantee the self-adjointness of $-\Delta^\ast$. Furthermore, by establishing local energy estimates for the elastic wave equation we also prove that the solution has local regularity.


title: Current Fluctuations Driven by Ferromagnetic and Antiferromagnetic Resonance

abstract: We consider electron transport in ferromagnets or antiferromagnets sandwiched between metals. When spins in the magnetic materials precess, they emit currents into the surrounding conductors. Generally, adiabatic pumping in mesoscopic systems also enhances current fluctuations. We generalize the description of current fluctuations driven by spin dynamics in three ways using scattering theory. First, our theory describes a general junction with any given electron scattering properties. Second, we consider antiferromagnets as well as ferromagnets. Third, we treat multiterminal devices. Using shot noise-induced current fluctuations to reveal antiferromagnetic resonance appears to be easier than using them to reveal ferromagnetic resonance. The origin of this result is that the associated energies are much higher as compared to the thermal energy. The thermal energy governs the Johnson-Nyquist that is independent of the spin dynamics. We give results for various junctions, such as ballistic and disordered contacts. Finally, we discuss experimental consequences.


title: A Compton-thick nucleus in the dual AGN of Mrk 266

abstract: We present results of our analysis of NuSTAR data of the luminous infrared galaxy Mrk 266, which contains two nuclei, SW and NE, resolved in previous Chandra imaging. Combining with the Chandra data, we intepret the hard X-ray spectrum obtained from a NuSTAR observation as resulting from steeply rising flux from a Compton-thick AGN in the SW nucleus which is very faint in the Chandra band, confirming the previous claim of Mazzarella et al. (2012). This hard X-ray component is dominated by reflection, and its intrinsic 2-10 keV luminosity is likely to be ~1e43 erg/s. Although it is bright in soft X-ray, only moderately absorbed NE nucleus has a 2-10 keV luminosity of 4e41 erg/s, placing it in the low-luminosity AGN class. These results have implications for understanding the detectability and duty cycles of emission from dual AGN in heavily obscured mergers.


title: On spectrum of strings with $\delta'$-like perturbations of mass density

abstract: We study the asymptotic behaviour of eigenvalues and eigenfunctions of a boundary value problem for the Sturm-Liouville operator with general boundary conditions and the weight function perturbed by the so-called $\delta'$-like sequence $\varepsilon^{-2}h(x/\varepsilon)$. The eigenvalue problem is realized as a family of non-self-adjoint matrix operators acting on the same Hilbert space and the norm resolvent convergence of this family is established. We also prove the Hausdorff convergence of the perturbed spectra.


title: ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting

abstract: We propose ResRep, a novel method for lossless channel pruning (a.k.a. filter pruning), which slims down a CNN by reducing the width (number of output channels) of convolutional layers. Inspired by the neurobiology research about the independence of remembering and forgetting, we propose to re-parameterize a CNN into the remembering parts and forgetting parts, where the former learn to maintain the performance and the latter learn to prune. Via training with regular SGD on the former but a novel update rule with penalty gradients on the latter, we realize structured sparsity. Then we equivalently merge the remembering and forgetting parts into the original architecture with narrower layers. In this sense, ResRep can be viewed as a successful application of Structural Re-parameterization. Such a methodology distinguishes ResRep from the traditional learning-based pruning paradigm that applies a penalty on parameters to produce sparsity, which may suppress the parameters essential for the remembering. ResRep slims down a standard ResNet-50 with 76.15% accuracy on ImageNet to a narrower one with only 45% FLOPs and no accuracy drop, which is the first to achieve lossless pruning with such a high compression ratio. The code and models are at https://github.com/DingXiaoH/ResRep.


title: ADM formulation and Hamiltonian analysis of Coincident General Relativity

abstract: We consider a simpler geometrical formulation of General Relativity based on non-metricity, known as Coincident General Relativity. We study the ADM formulation of the theory and perform a detailed Hamiltonian analysis. We explicitly show the propagation of two physical degrees of freedom, as it should, even though the role of boundary terms and gauge conditions is significantly altered. This might represent an alternative promising new route for numerical relativity and canonical quantum gravity. We also give an outlook on the number of propagating degrees of freedom in non-linear extension of non-metricity scalar.


title: RGBT Salient Object Detection: A Large-scale Dataset and Benchmark

abstract: Salient object detection in complex scenes and environments is a challenging research topic. Most works focus on RGB-based salient object detection, which limits its performance of real-life applications when confronted with adverse conditions such as dark environments and complex backgrounds. Taking advantage of RGB and thermal infrared images becomes a new research direction for detecting salient object in complex scenes recently, as thermal infrared spectrum imaging provides the complementary information and has been applied to many computer vision tasks. However, current research for RGBT salient object detection is limited by the lack of a large-scale dataset and comprehensive benchmark. This work contributes such a RGBT image dataset named VT5000, including 5000 spatially aligned RGBT image pairs with ground truth annotations. VT5000 has 11 challenges collected in different scenes and environments for exploring the robustness of algorithms. With this dataset, we propose a powerful baseline approach, which extracts multi-level features within each modality and aggregates these features of all modalities with the attention mechanism, for accurate RGBT salient object detection. Extensive experiments show that the proposed baseline approach outperforms the state-of-the-art methods on VT5000 dataset and other two public datasets. In addition, we carry out a comprehensive analysis of different algorithms of RGBT salient object detection on VT5000 dataset, and then make several valuable conclusions and provide some potential research directions for RGBT salient object detection.


title: Decoupled Spatial-Temporal Attention Network for Skeleton-Based Action Recognition

abstract: Dynamic skeletal data, represented as the 2D/3D coordinates of human joints, has been widely studied for human action recognition due to its high-level semantic information and environmental robustness. However, previous methods heavily rely on designing hand-crafted traversal rules or graph topologies to draw dependencies between the joints, which are limited in performance and generalizability. In this work, we present a novel decoupled spatial-temporal attention network(DSTA-Net) for skeleton-based action recognition. It involves solely the attention blocks, allowing for modeling spatial-temporal dependencies between joints without the requirement of knowing their positions or mutual connections. Specifically, to meet the specific requirements of the skeletal data, three techniques are proposed for building attention blocks, namely, spatial-temporal attention decoupling, decoupled position encoding and spatial global regularization. Besides, from the data aspect, we introduce a skeletal data decoupling technique to emphasize the specific characteristics of space/time and different motion scales, resulting in a more comprehensive understanding of the human actions.To test the effectiveness of the proposed method, extensive experiments are conducted on four challenging datasets for skeleton-based gesture and action recognition, namely, SHREC, DHG, NTU-60 and NTU-120, where DSTA-Net achieves state-of-the-art performance on all of them.


title: Weyl doubling

abstract: We study a host of spacetimes where the Weyl curvature may be expressed algebraically in terms of an Abelian field strength. These include Type D spacetimes in four and higher dimensions which obey a simple quadratic relation between the field strength and the Weyl tensor, following the Weyl spinor double copy relation. However, we diverge from the usual double copy paradigm by taking the gauge fields to be in the curved spacetime as opposed to an auxiliary flat space. We show how for Gibbons-Hawking spacetimes with more than two centres a generalisation of the Weyl doubling formula is needed by including a derivative-dependent expression which is linear in the Abelian field strength. We also find a type of twisted doubling formula in a case of a manifold with Spin(7) holonomy in eight dimensions. For Einstein Maxwell theories where there is an independent gauge field defined on spacetime, we investigate how the gauge fields determine the Weyl spacetime curvature via a doubling formula. We first show that this occurs for the Reissner-Nordstrom metric in any dimension, and that this generalises to the electrically-charged Born-Infeld solutions. Finally, we consider brane systems in supergravity, showing that a similar doubling formula applies. This Weyl formula is based on the field strength of the p-form potential that minimally couples to the brane and the brane world volume Killing vectors.


title: Single- versus two-parameter Fisher information in quantum interferometry

abstract: In this paper we reconsider the single parameter quantum Fisher information (QFI) and compare it with the two-parameter one. We find simple relations connecting the single parameter QFI (both in the asymmetric and symmetric phase shift cases) to the two parameter Fisher matrix coefficients. Following some clarifications about the role of an external phase [Phys. Rev. A 85, 011801(R) (2012)], the single-parameter QFI and its over-optimistic predictions have been disregarded in the literature. We show in this paper that both the single- and two-parameter QFI have physical meaning and their predicted quantum Cram\'er-Rao bounds are often attainable with the appropriate experimental setup. Moreover, we give practical situations of interest in quantum metrology, where the phase sensitivities of a number of input states approach the quantum Cram\'er-Rao bound induced by the single-parameter QFI, outperforming the two-parameter QFI.


title: Topology-Aware Joint Graph Filter and Edge Weight Identification for Network Processes

abstract: Data defined over a network have been successfully modelled by means of graph filters. However, although in many scenarios the connectivity of the network is known, e.g., smart grids, social networks, etc., the lack of well-defined interaction weights hinders the ability to model the observed networked data using graph filters. Therefore, in this paper, we focus on the joint identification of coefficients and graph weights defining the graph filter that best models the observed input/output network data. While these two problems have been mostly addressed separately, we here propose an iterative method that exploits the knowledge of the support of the graph for the joint identification of graph filter coefficients and edge weights. We further show that our iterative scheme guarantees a non-increasing cost at every iteration, ensuring a globally-convergent behavior. Numerical experiments confirm the applicability of our proposed approach.


title: On the families of polynomials forming a part of the Askey--Wilson scheme and their probabilistic applications

abstract: We review the properties of six families of orthogonal polynomials that form the main bulk of the collection called the Askey--Wilson scheme of polynomials. We give connection coefficients between them as well as the so-called linearization formulae and other useful important finite and infinite expansions and identities. An important part of the paper is the presentation of probabilistic models where most of these families of polynomials appear. These results were scattered within the literature in recent 15 years. We put them together to enable an overall outlook on these families and understand their crucial r\^{o}le in the attempts to generalize Gaussian distributions and find their bounded support generalizations. The paper is based on 65 items in the predominantly recent literature.


title: Magnetic properties and magnetic structure of the frustrated quasi-one-dimensional antiferromagnet SrCuTe$_2$O$_6$

abstract: Magnetization measurements on single-crystal cubic SrCuTe$_2$O$_6$ with an applied magnetic field of along three inequivalent high symmetry directions $[100]$, $[110]$, and $[111]$ reveal weak magnetic anisotropy. The fits of the magnetic susceptibility to the result from a quantum Monte Carlo simulation on the Heisenberg spin-chain model, where the chain is formed via the dominant third-nearest-neighbor exchange interaction $J_3$, yield the intra-chain interaction $(J_3/k_B)$ between 50.12(7) K for the applied field along $[110]$ and 52.5(2) K along $[100]$ with about the same $g$-factor of 2.2. Single-crystal neutron diffraction unveils the transition to the magnetic ordered state as evidenced by the onset of the magnetic Bragg intensity at $T_\textrm{N1}=5.25(9)$ K with no anomaly of the second transition at $T_\textrm{N2}$ reported previously. Based on irreducible representation theory and magnetic space group analysis of powder and single-crystal neutron diffraction data, the magnetic structure in the Shubnikov space group $P4_132$, where the Cu$^{2+}$~$S=1/2$ spins antiferromagnetically align in the direction perpendicular to the spin chain, is proposed. The measured ordered moment of $0.52(6)~\mu_B$, which represents 48% reduction from the expected value of $1~\mu_B$, suggests the remaining influence of frustration resulting from the $J_1$ and $J_2$ bonds.


title: Single Storage Semi-Global Matching for Real Time Depth Processing

abstract: Depth-map is the key computation in computer vision and robotics. One of the most popular approach is via computation of disparity-map of images obtained from Stereo Camera. Semi Global Matching (SGM) method is a popular choice for good accuracy with reasonable computation time. To use such compute-intensive algorithms for real-time applications such as for autonomous aerial vehicles, blind Aid, etc. acceleration using GPU, FPGA is necessary. In this paper, we show the design and implementation of a stereo-vision system, which is based on FPGA-implementation of More Global Matching(MGM). MGM is a variant of SGM. We use 4 paths but store a single cumulative cost value for a corresponding pixel. Our stereo-vision prototype uses Zedboard containing an ARM-based Zynq-SoC, ZED-stereo-camera / ELP stereo-camera / Intel RealSense D435i, and VGA for visualization. The power consumption attributed to the custom FPGA-based acceleration of disparity map computation required for depth-map is just 0.72 watt. The update rate of the disparity map is realistic 10.5 fps.


title: Dynamical system of a mosquito population with distinct birth-death rates

abstract: We study the discrete-time dynamical systems of a model of wild mosquito population with distinct birth (denoted by $\beta$) and death (denoted by $\mu$) rates. The case $\mu=\beta$ was considered in our previous work. In this paper we prove that for $\beta<\mu$ the mosquito population will die and for $\beta>\mu$ the population will survive, namely, the number of the larvaes goes to infinite and the number of adults has finite limit ${\alpha\over \mu}$, where $\alpha>0$ is the maximum emergence rete.


title: CMPCC: Corridor-based Model Predictive Contouring Control for Aggressive Drone Flight

abstract: In this paper, we propose an efficient, receding horizon, local adaptive low-level planner as the middle layer between our original planner and controller. Our method is named as corridor-based model predictive contouring control (CMPCC) since it builds upon on MPCC and utilizes the flight corridor as hard safety constraints. It optimizes the flight aggressiveness and tracking accuracy simultaneously, thus improving our system's robustness by overcoming unmeasured disturbances. Our method features its online flight speed optimization, strict safety and feasibility, and real-time performance, and will be released as a low-level plugin for a large variety of quadrotor systems.


title: Full Duplex Integrated Access and Backhaul for 5G NR: Analyses and Prototype Measurements

abstract: Integrated access and backhaul (IAB) frameworks for 5G new radio (NR) as a cost-effective alternative to the wired backhaul have been investigated by 3GPP. A promising solution for this framework is the integration of full duplex (FD) technologies to enhance the spectral efficiency and make an efficient use of the network resources-termed FD IAB. However, FD IAB presents significant technical challenges, such as self-interference (SI) in the IAB framework, which may cast doubt over the feasibility of FD IAB. In this article, we present a brief tutorial of the FD IAB framework and its enabling technologies. We then numerically evaluate and discuss the link-level SI reduction and the system-level downlink throughput performance of the FD IAB. Finally, we validate the feasibility of FD IAB using 28 GHz hardware prototype measurements of propagation-domain SI suppression. Our numerical evaluations and prototype measurements confirm that the FD IAB serves as a promising framework for 5G NR.


title: Coded Computing for Federated Learning at the Edge

abstract: Federated Learning (FL) is an exciting new paradigm that enables training a global model from data generated locally at the client nodes, without moving client data to a centralized server. Performance of FL in a multi-access edge computing (MEC) network suffers from slow convergence due to heterogeneity and stochastic fluctuations in compute power and communication link qualities across clients. A recent work, Coded Federated Learning (CFL), proposes to mitigate stragglers and speed up training for linear regression tasks by assigning redundant computations at the MEC server. Coding redundancy in CFL is computed by exploiting statistical properties of compute and communication delays. We develop CodedFedL that addresses the difficult task of extending CFL to distributed non-linear regression and classification problems with multioutput labels. The key innovation of our work is to exploit distributed kernel embedding using random Fourier features that transforms the training task into distributed linear regression. We provide an analytical solution for load allocation, and demonstrate significant performance gains for CodedFedL through experiments over benchmark datasets using practical network parameters.


title: Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network

abstract: Inspired by the mammal's auditory localization pathway, in this paper we propose a pure spiking neural network (SNN) based computational model for precise sound localization in the noisy real-world environment, and implement this algorithm in a real-time robotic system with a microphone array. The key of this model relies on the MTPC scheme, which encodes the interaural time difference (ITD) cues into spike patterns. This scheme naturally follows the functional structures of the human auditory localization system, rather than artificially computing of time difference of arrival. Besides, it highlights the advantages of SNN, such as event-driven and power efficiency. The MTPC is pipelined with two different SNN architectures, the convolutional SNN and recurrent SNN, by which it shows the applicability to various SNNs. This proposal is evaluated by the microphone collected location-dependent acoustic data, in a real-world environment with noise, obstruction, reflection, or other affects. The experiment results show a mean error azimuth of 1~3 degrees, which surpasses the accuracy of the other biologically plausible neuromorphic approach for sound source localization.


title: An Advanced Approach for Choosing Security Patterns and Checking their Implementation

abstract: This paper tackles the problems of generating concrete test cases for testing whether an application is vulnerable to attacks, and of checking whether security solutions are correctly implemented. The approach proposed in the paper aims at guiding developers towards the implementation of secure applications, from the threat modelling stage up to the testing one. This approach relies on a knowledge base integrating varied security data, e.g., attacks, attack steps, and security patterns that are generic and re-usable solutions to design secure applications. The first stage of the approach consists in assisting developers in the design of Attack Defense Trees expressing the attacker possibilities to compromise an application and the defenses that may be implemented. These defenses are given under the form of security pattern combinations. In the second stage, these trees are used to guide developers in the test case generation. After the test case execution, test verdicts show whether an application is vulnerable to the threats modelled by an ADTree. The last stage of the approach checks whether behavioural properties of security patterns hold in the application traces collected while the test case execution. These properties are formalised with LTL properties, which are generated from the knowledge base. Developers do not have to write LTL properties not to be expert in formal models. We experimented the approach on 10 Web applications to evaluate its testing effectiveness and its performance.


title: Electron Currents from Gradual Heating in Tilted Dirac Cone Materials

abstract: Materials hosting tilted Dirac/Weyl fermions provide an emergent spacetime structure for the solid state physics. They admit a geometric description in terms of an effective spacetime metric. Using this metric that is rooted in the long-distance behavior of the underlying lattice, we formulate the hydrodynamic theory for tilted Dirac/Weyl materials in $2+1$ spacetime dimensions. We find that the mingling of space and time through the off-diagonal components of the metric gives rise to: (i) heat and electric currents in response to the $temporal$ gradient of temperature, $\partial_t T$ and (ii) a non-zero symmetric Hall-like conductance $\sigma^{ij}\propto \zeta^i\zeta^j$ where $\zeta^j$ parameterize the tilt in $j$'th space direction. The finding (i) above that can be demonstrated in the laboratory in state of the art cooling/heating rate settings, implies that the non-trivial emergent spacetime geometry in these materials empowers them with a fascinating capability to harvest the naturally available sources of $\partial_t T$ of hot deserts to produce electric energy. We further find a tilt-induced contribution to the conductivity which is an offspring of Drude pole and can be experimentally disentangled from the Drude pole itself.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el gr-qc hep-th


title: On population growth with catastrophes

abstract: In this paper we study a particular class of Piecewise deterministic Markov processes (PDMP's) which are semi-stochastic catastrophe versions of deterministic population growth models. In between successive jumps the process follows a flow describing deterministic population growth. Moreover, at random jump times, governed by state-dependent rates, the size of the population shrinks by a random amount of its current size, an event possibly leading to instantaneous local (or total) extinction. A special separable shrinkage transition kernel is investigated in more detail, including the case of total disasters. We discuss conditions under which such processes are recurrent (positive or null) or transient. To do so, we introduce a modified scale function which is used to compute, when relevant, the law of the height of excursions and to decide if the process is recurrent or not. The question of the finiteness of the time to extinction is investigated together with the evaluation of the mean time to extinction when the last one is finite. Some information on the embedded jump chain of the PDMP is also required when dealing with the classification of states 0 and infinity that we exhibit.


title: Self-organizing Democratized Learning: Towards Large-scale Distributed Learning Systems

abstract: Emerging cross-device artificial intelligence (AI) applications require a transition from conventional centralized learning systems towards large-scale distributed AI systems that can collaboratively perform complex learning tasks. In this regard, democratized learning (Dem-AI) lays out a holistic philosophy with underlying principles for building large-scale distributed and democratized machine learning systems. The outlined principles are meant to study a generalization in distributed learning systems that goes beyond existing mechanisms such as federated learning. Moreover, such learning systems rely on hierarchical self-organization of well-connected distributed learning agents who have limited and highly personalized data and can evolve and regulate themselves based on the underlying duality of specialized and generalized processes. Inspired by Dem-AI philosophy, a novel distributed learning approach is proposed in this paper. The approach consists of a self-organizing hierarchical structuring mechanism based on agglomerative clustering, hierarchical generalization, and corresponding learning mechanism. Subsequently, hierarchical generalized learning problems in recursive forms are formulated and shown to be approximately solved using the solutions of distributed personalized learning problems and hierarchical update mechanisms. To that end, a distributed learning algorithm, namely DemLearn is proposed. Extensive experiments on benchmark MNIST, Fashion-MNIST, FE-MNIST, and CIFAR-10 datasets show that the proposed algorithms demonstrate better results in the generalization performance of learning models in agents compared to the conventional FL algorithms. The detailed analysis provides useful observations to further handle both the generalization and specialization performance of the learning models in Dem-AI systems.


title: Rigidity theorems for minimal Lagrangian surfaces with Legendrian capillary boundary

abstract: In this note, we study minimal Lagrangian surfaces in $\mathbb{B}^4$ with Legendrian capillary boundary on $\mathbb{S}^3$. On the one hand, we prove that any minimal Lagrangian surface in $\mathbb{B}^4$ with Legendrian free boundary on $\mathbb{S}^3$ must be an equatorial plane disk. One the other hand, we show that any annulus type minimal Lagrangian surface in $\mathbb{B}^4$ with Legendrian capillary boundary on $\mathbb{S}^3$ must be congruent to one of the Lagrangian catenoids. These results confirm the conjecture proposed by Li, Wang and Weng (Sci. China Math., 2020).


title: Nonequilibrium Multiple Transitions in the Core-shell Ising Nanoparticles Driven by Randomly Varying Magnetic Fields

abstract: The nonequilibrium behaviour of a core-shell nanoparticle has been studied by Monte- Carlo simulation. The core consists of Ising spins of $\sigma=1/2$ and the shell contains Ising spins of $S=1$. The interactions within the core and in the shell are considered ferromagnetic but the interfacial interaction between core and shell is antiferromagnetic. The nanoparticle system is kept in open boundary conditions and is driven by randomly varying (in time but uniform over the space) magnetic field. Depending on the width of the randomly varying field and the temperature of the system, the core, shell and total magnetization varies in such a manner that the time averages vanish for higher magnitude of the width of random field, exhibiting a dynamical symmetry breaking transitions. The susceptibilities get peaked at two different temperatures indicating nonequilibrium multiple transitions. The phase boundaries of the nonequilibrium multiple transitions are drawn in the plane formed by the axes of temperature and the width of the randomly varying field. Furthermore, the effects of the core and shell thicknesses on the multiple transitions have been discussed.


title: Spectral Graph-based Features for Recognition of Handwritten Characters: A Case Study on Handwritten Devanagari Numerals

abstract: Interpretation of different writing styles, unconstrained cursiveness and relationship between different primitive parts is an essential and challenging task for recognition of handwritten characters. As feature representation is inadequate, appropriate interpretation/description of handwritten characters seems to be a challenging task. Although existing research in handwritten characters is extensive, it still remains a challenge to get the effective representation of characters in feature space. In this paper, we make an attempt to circumvent these problems by proposing an approach that exploits the robust graph representation and spectral graph embedding concept to characterise and effectively represent handwritten characters, taking into account writing styles, cursiveness and relationships. For corroboration of the efficacy of the proposed method, extensive experiments were carried out on the standard handwritten numeral Computer Vision Pattern Recognition, Unit of Indian Statistical Institute Kolkata dataset. The experimental results demonstrate promising findings, which can be used in future studies.


title: LabelEnc: A New Intermediate Supervision Method for Object Detection

abstract: In this paper we propose a new intermediate supervision method, named LabelEnc, to boost the training of object detection systems. The key idea is to introduce a novel label encoding function, mapping the ground-truth labels into latent embedding, acting as an auxiliary intermediate supervision to the detection backbone during training. Our approach mainly involves a two-step training procedure. First, we optimize the label encoding function via an AutoEncoder defined in the label space, approximating the "desired" intermediate representations for the target object detector. Second, taking advantage of the learned label encoding function, we introduce a new auxiliary loss attached to the detection backbones, thus benefiting the performance of the derived detector. Experiments show our method improves a variety of detection systems by around 2% on COCO dataset, no matter one-stage or two-stage frameworks. Moreover, the auxiliary structures only exist during training, i.e. it is completely cost-free in inference time. Code is available at: https://github.com/megvii-model/LabelEnc


title: The benefits of peer transparency in safe workplace operation post pandemic lockdown

abstract: The benefits, both in terms of productivity and public health, are investigated for different levels of engagement with the test, trace and isolate procedures in the context of a pandemic in which there is little or no herd immunity. Simple mathematical modelling is used in the context of a single, relatively closed workplace such as a factory or back-office where, in normal operation, each worker has lengthy interactions with a fixed set of colleagues. A discrete-time SEIR model on a fixed interaction graph is simulated with parameters that are motivated by the recent COVID-19 pandemic in the UK during a post-peak phase, including a small risk of viral infection from outside the working environment. Two kinds of worker are assumed, transparents who regularly test, share their results with colleagues and isolate as soon as a contact tests positive for the disease, and opaques who do none of these. Moreover, the simulations are constructed as a ``playable model" in which the transparency level, disease parameters and mean interaction degree can be varied by the user. The model is analysed in the continuum limit. All simulations point to the double benefit of transparency in maximising productivity and minimising overall infection rates. Based on these findings, public policy implications are discussed on how to incentivise this mutually beneficial behaviour in different kinds of workplace, and simple recommendations are made.


title: The entropic force between two horizons of charged Gauss-Bonnet Black hole in de Sitter Spacetime

abstract: The basic equations of the thermodynamic system give the relationship between the internal energy, entropy and volume of two neighboring equilibrium states. By using the functional relationship between the state parameters in the basic equation, we give the differential equation satisfied by the entropy of spacetime. We can obtain the expression of the entropy by solving the differential equationy. This expression is the sum of entropy corresponding to the two event horizons and the interaction term. The interaction term is a function of the ratio of the locations of the black hole horizon and the cosmological horizon. The entropic force, which is strikingly similar to the Lennard-Jones force between particles, varies with the ratio of the two event horizons. The discovery of this phenomenon makes us realize that the entropic force between the two horizons may be one of the candidates to promote the expansion of the universe.


title: Stochastic Linear Bandits Robust to Adversarial Attacks

abstract: We consider a stochastic linear bandit problem in which the rewards are not only subject to random noise, but also adversarial attacks subject to a suitable budget $C$ (i.e., an upper bound on the sum of corruption magnitudes across the time horizon). We provide two variants of a Robust Phased Elimination algorithm, one that knows $C$ and one that does not. Both variants are shown to attain near-optimal regret in the non-corrupted case $C = 0$, while incurring additional additive terms respectively having a linear and quadratic dependency on $C$ in general. We present algorithm independent lower bounds showing that these additive terms are near-optimal. In addition, in a contextual setting, we revisit a setup of diverse contexts, and show that a simple greedy algorithm is provably robust with a near-optimal additive regret term, despite performing no explicit exploration and not knowing $C$.


title: An Entropy Equation for Energy

abstract: This paper describes an entropy equation, but one that should be used for measuring energy and not information. In relation to the human brain therefore, both of these quantities can be used to represent the stored information. The human brain makes use of energy efficiency to form its structures, which is likely to be linked to the neuron wiring. This energy efficiency can also be used as the basis for a clustering algorithm, which is described in a different paper. This paper is more of a discussion about global properties, where the rules used for the clustering algorithm can also create the entropy equation E = (mean * variance). This states that work is done through the energy released by the 'change' in entropy. The equation is so simplistic and generic that it can offer arguments for completely different domains, where the journey ends with a discussion about global energy properties in physics and beyond. A comparison with Einstein's relativity equation is made and also the audacious suggestion that a black hole has zero-energy inside.


title: Two-pathogen model with competition on clustered networks

abstract: Networks provide a mathematically rich framework to represent social contacts sufficient for the transmission of disease. Social networks are often highly clustered and fail to be locally tree-like. In this paper, we study the effects of clustering on the spread of sequential strains of a pathogen using the generating function formulation under a complete cross-immunity coupling, deriving conditions for the threshold of coexistence of the second strain. We show that clustering reduces the coexistence threshold of the second strain and its outbreak size in Poisson networks, whilst exhibiting the opposite effects on uniform-degree models. We conclude that clustering within a population must increase the ability of the second wave of an epidemic to spread over a network. We apply our model to the study of multilayer clustered networks and observe the fracturing of the residual graph at two distinct transmissibilities.


title: Longitudinal mediation analysis of time-to-event endpoints in the presence of competing risks

abstract: This proposal is motivated by an analysis of the English Longitudinal Study of Ageing (ELSA), which aims to investigate the role of loneliness in explaining the negative impact of hearing loss on dementia. The methodological challenges that complicate this mediation analysis include the use of a time-to-event endpoint subject to competing risks, as well as the presence of feedback relationships between the mediator and confounders that are both repeatedly measured over time. To account for these challenges, we introduce natural effect proportional (cause-specific) hazard models. These extend marginal structural proportional (cause-specific) hazard models to enable effect decomposition. We show that under certain causal assumptions, the path-specific direct and indirect effects indexing this model are identifiable from the observed data. We next propose an inverse probability weighting approach to estimate these effects. On the ELSA data, this approach reveals little evidence that the total efect of hearing loss on dementia is mediated through the feeling of loneliness, with a non-statistically significant indirect effect equal to 1.012 (hazard ratio (HR) scale; 95% confidence interval (CI) 0.986 to 1.053).


title: BPS Lie algebras and the less perverse filtration on the preprojective CoHA

abstract: The affinization morphism for the stack $\mathfrak{M}(\Pi_Q)$ of representations of a preprojective algebra $\Pi_Q$ is a local model for the morphism from the stack of objects in a general 2-Calabi-Yau category to the good moduli space. We show that the derived direct image of the dualizing complex along this morphism is pure, and admits a decomposition in the sense of the Beilinson-Bernstein-Deligne-Gabber decomposition theorem. We introduce a new perverse filtration on the Borel-Moore homology of $\mathfrak{M}(\Pi_Q)$, using this decomposition. We show that the zeroth piece of the resulting filtration on the cohomological Hall algebra built out of the Borel-Moore homology of $\mathfrak{M}(\Pi_Q)$ is isomorphic to the universal enveloping algebra of an associated BPS Lie algebra $\mathfrak{g}_{\Pi_Q}$. This Lie algebra is defined via the Kontsevich-Soibelman theory of critical cohomological Hall algebras for 3-Calabi-Yau categories. We then lift this Lie algebra to a Lie algebra object in the category of perverse sheaves on the coarse moduli space of $\Pi_Q$-modules, and use this algebra structure to prove results about the summands appearing in the above decomposition theorem. In particular, we prove that the intersection cohomology of singular spaces of semistable $\Pi_Q$-modules provide "cuspidal cohomology" - a conjecturally complete subspace of canonical generators for $\mathfrak{g}_{\Pi_Q}$.


title: Generalized Random Energy Models in a Transversal Magnetic Field: Free Energy and Phase Diagrams

abstract: We determine explicit variational expressions for the free energy of mean-field spin glasses in a transversal magnetic field, whose glass interaction is given by a hierarchical Gaussian potential as in Derrida's Generalized Random Energy Model (GREM), its continuous version (CREM) or the non-hierarchical GREM. The corresponding phase diagrams, which generally include glass transitions as well as magnetic transitions, are discussed. In the glass phase, the free energy is generally determined by both the parameters of the classical model and the transversal field.


title: A Classification of Weak Asynchronous Models of Distributed Computing

abstract: We conduct a systematic study of asynchronous models of distributed computing consisting of identical finite-state devices that cooperate in a network to decide if the network satisfies a given graph-theoretical property. Models discussed in the literature differ in the detection capabilities of the agents residing at the nodes of the network (detecting the set of states of their neighbors, or counting the number of neighbors in each state), the notion of acceptance (acceptance by halting in a particular configuration, or by stable consensus), the notion of step (synchronous move, interleaving, or arbitrary timing), and the fairness assumptions (non-starving, or stochastic-like). We study the expressive power of the combinations of these features, and show that the initially twenty possible combinations fit into seven equivalence classes. The classification is the consequence of several equi-expressivity results with a clear interpretation. In particular, we show that acceptance by halting configuration only has non-trivial expressive power if it is combined with counting, and that synchronous and interleaving models have the same power as those in which an arbitrary set of nodes can move at the same time. We also identify simple graph properties that distinguish the expressive power of the seven classes.


title: Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancer

abstract: With the long-term rapid increase in incidences of colorectal cancer (CRC), there is an urgent clinical need to improve risk stratification. The conventional pathology report is usually limited to only a few histopathological features. However, most of the tumor microenvironments used to describe patterns of aggressive tumor behavior are ignored. In this work, we aim to learn histopathological patterns within cancerous tissue regions that can be used to improve prognostic stratification for colorectal cancer. To do so, we propose a self-supervised learning method that jointly learns a representation of tissue regions as well as a metric of the clustering to obtain their underlying patterns. These histopathological patterns are then used to represent the interaction between complex tissues and predict clinical outcomes directly. We furthermore show that the proposed approach can benefit from linear predictors to avoid overfitting in patient outcomes predictions. To this end, we introduce a new well-characterized clinicopathological dataset, including a retrospective collective of 374 patients, with their survival time and treatment information. Histomorphological clusters obtained by our method are evaluated by training survival models. The experimental results demonstrate statistically significant patient stratification, and our approach outperformed the state-of-the-art deep clustering methods.


title: Single Shot MC Dropout Approximation

abstract: Deep neural networks (DNNs) are known for their high prediction performance, especially in perceptual tasks such as object recognition or autonomous driving. Still, DNNs are prone to yield unreliable predictions when encountering completely new situations without indicating their uncertainty. Bayesian variants of DNNs (BDNNs), such as MC dropout BDNNs, do provide uncertainty measures. However, BDNNs are slow during test time because they rely on a sampling approach. Here we present a single shot MC dropout approximation that preserves the advantages of BDNNs without being slower than a DNN. Our approach is to analytically approximate for each layer in a fully connected network the expected value and the variance of the MC dropout signal. We evaluate our approach on different benchmark datasets and a simulated toy example. We demonstrate that our single shot MC dropout approximation resembles the point estimate and the uncertainty estimate of the predictive distribution that is achieved with an MC approach, while being fast enough for real-time deployments of BDNNs.


title: Automatic Ischemic Stroke Lesion Segmentation from Computed Tomography Perfusion Images by Image Synthesis and Attention-Based Deep Neural Networks

abstract: Ischemic stroke lesion segmentation from Computed Tomography Perfusion (CTP) images is important for accurate diagnosis of stroke in acute care units. However, it is challenged by low image contrast and resolution of the perfusion parameter maps, in addition to the complex appearance of the lesion. To deal with this problem, we propose a novel framework based on synthesized pseudo Diffusion-Weighted Imaging (DWI) from perfusion parameter maps to obtain better image quality for more accurate segmentation. Our framework consists of three components based on Convolutional Neural Networks (CNNs) and is trained end-to-end. First, a feature extractor is used to obtain both a low-level and high-level compact representation of the raw spatiotemporal Computed Tomography Angiography (CTA) images. Second, a pseudo DWI generator takes as input the concatenation of CTP perfusion parameter maps and our extracted features to obtain the synthesized pseudo DWI. To achieve better synthesis quality, we propose a hybrid loss function that pays more attention to lesion regions and encourages high-level contextual consistency. Finally, we segment the lesion region from the synthesized pseudo DWI, where the segmentation network is based on switchable normalization and channel calibration for better performance. Experimental results showed that our framework achieved the top performance on ISLES 2018 challenge and: 1) our method using synthesized pseudo DWI outperformed methods segmenting the lesion from perfusion parameter maps directly; 2) the feature extractor exploiting additional spatiotemporal CTA images led to better synthesized pseudo DWI quality and higher segmentation accuracy; and 3) the proposed loss functions and network structure improved the pseudo DWI synthesis and lesion segmentation performance.


title: Gaussian conversion protocols for cubic phase state generation

abstract: Universal quantum computing with continuous variables requires non-Gaussian resources, in addition to a Gaussian set of operations. A known resource enabling universal quantum computation is the cubic phase state, a non-Gaussian state whose experimental implementation has so far remained elusive. In this paper, we introduce two Gaussian conversion protocols that allow for the conversion of a non-Gaussian state that has been achieved experimentally, namely the trisqueezed state [Sandbo Changet al., Phys. Rev. X10, 011011 (2020)],to a cubic phase state. The first protocol is deterministic and it involves active (in-line) squeezing, achieving large fidelities that saturate the bound for deterministic Gaussian protocols. The second protocol is probabilistic and it involves an auxiliary squeezed state, thus removing the necessity of in-line squeezing but still maintaining significant success probabilities and fidelities even larger than for the deterministic case. The success of these protocols provides strong evidence for using trisqueezed states as resources for universal quantum computation.


title: Enhancing dipolar interactions between molecules using state-dependent optical tweezer traps

abstract: We show how state-dependent optical potentials can be used to trap a pair of molecules in different internal states at a separation much smaller than the wavelength of the trapping light. This close spacing greatly enhances the dipole-dipole interaction and we show how it can be used to implement two-qubit gates between molecules that are 100 times faster than existing protocols and than rotational coherence times already demonstrated. We analyze complications due to hyperfine structure, tensor light shifts, photon scattering and collisional loss, and conclude that none is a barrier to implementing the scheme.


title: Forecasting Australian subnational age-specific mortality rates

abstract: When modeling sub-national mortality rates, it is important to incorporate any possible correlation among sub-populations to improve forecast accuracy. Moreover, forecasts at the sub-national level should aggregate consistently across the forecasts at the national level. In this study, we apply a grouped multivariate functional time series to forecast Australian regional and remote age-specific mortality rates and reconcile forecasts in a group structure using various methods. Our proposed method compares favorably to a grouped univariate functional time series forecasting method by comparing one-step-ahead to five-step-ahead point forecast accuracy. Thus, we demonstrate that joint modeling of sub-populations with similar mortality patterns can improve point forecast accuracy.


title: DS-Sync: Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training

abstract: Bulk synchronous parallel (BSP) is the de-facto paradigm for distributed DNN training in today's production clusters. However, due to the global synchronization nature, its performance can be significantly influenced by network bottlenecks caused by either static topology heterogeneity or dynamic bandwidth contentions. Existing solutions, either system-level optimizations strengthening BSP (e.g., Ring or Hierarchical All-reduce) or algorithmic optimizations replacing BSP (e.g., ASP or SSP, which relax the global barriers), do not completely solve the problem, as they may still suffer from communication inefficiency or risk convergence inaccuracy. In this paper, we present a novel divide-and-shuffle synchronization (DS-Sync) to realize communication efficiency without sacrificing convergence accuracy for distributed DNN training. At its heart, by taking into account the network bottlenecks, DS-Sync improves communication efficiency by dividing workers into non-overlap groups to synchronize independently in a bottleneck-free manner. Meanwhile, it maintains convergence accuracy by iteratively shuffling workers among different groups to ensure a global consensus. We theoretically prove that DS-Sync converges properly in non-convex and smooth conditions like DNN. We further implement DS-Sync and integrate it with PyTorch, and our testbed experiments show that DS-Sync can achieve up to $94\%$ improvements on the end-to-end training time with existing solutions while maintaining the same accuracy.


title: Asymmetric pulse effects on pair production in polarized electric fields

abstract: Using the Dirac-Heisenberg-Wigner (DHW) formalism, e?ects of asymmetric pulse shape on the generation of electron-positron pairs in three typical polarized fields, i.e., the linear, middle elliptical and circular ones, are investigated. Two kinds of asymmetries for the falling pulse length, one is compressed and the other is elongated, are studied. It is found that the interference e?ect disappears with the compression of the pulse length, and finally the peak value of the momentum spectrum is concentrated in the center of the momentum space. For the opposite situation by extending the falling pulse length, a multi-ring structure without interference appears in the momentum spectrum. Research results exhibit that the momentum spectrum is very sensitive to the asymmetry of the pulse as well as to the polarization of the fields. It is also found that the number density of electron-positron pairs under di?erent polarizations is sensitive to the asymmetry of electric field. For the compressed falling pulse, the number density can be enhanced significantly over 2 orders of magnitude. These results could be useful in planning high power or/and high-intensity laser experiments.


title: Superradiance by ferroelectrics in cavity resonators

abstract: A theory is presented showing that, under appropriate conditions, a ferroelectric in a cavity resonator can emit superradiant pulses. Initially, the ferroelectric has to be prepared in a nonequilibrium state from which it relaxes emitting a coherent pulse in the infrared region. Polarization dipolar waves play the role of the triggering mechanism initiating the beginning of the process.


title: Influence of Ln elements (Ln = La, Pr, Nd, Sm) on the structure and oxygen permeability of Ca-containing dual-phase membranes

abstract: Developing good performance and low-cost oxygen permeable membranes for CO2 capture based on the oxy-fuel concept is greatly desirable but challenging. Despite tremendous efforts in exploring new CO2-stable dual-phase membranes, its presence is however still far from meeting the industrial requirements. Here we report a series of new Ca-containing CO2-resistant oxygen transporting membranes with composition 60wt.%Ce0.9Ln0.1O2-40wt.%Ln0.6Ca0.4FeO3(CLnO-LnCFO; Ln = La, Pr, Nd, Sm) synthesized via a Pechini one-pot method. Our results indicate all investigated compounds are composed of perovskite and fluorite phases, while the perovskite phases in the CNO-NCFO and CSO-SCFO membranes after sintering generates Ca-rich and Ca-less two kinds of grains with different morphologies, where the Ca-less small perovskite grains block the transport of oxygen ions and eventually result in poor oxygen permeability. Among our investigated CLnO-LnCFO membranes, CPO-PCFO exhibits the highest oxygen permeability and excellent CO2 stability, which were mainly associated with the improvement in crystal symmetry, non-negligible electronic conductivity of fluorite phase and the enhancement in electronic conductivity of perovskite. Our results establish Ca-containing oxides as candidate material platforms for membrane engineering devices that combine CO2 capture and oxygen separation.


title: VPS: Excavating High-Level C++ Constructs from Low-Level Binaries to Protect Dynamic Dispatching

abstract: Polymorphism and inheritance make C++ suitable for writing complex software, but significantly increase the attack surface because the implementation relies on virtual function tables (vtables). These vtables contain function pointers that attackers can potentially hijack and in practice, vtable hijacking is one of the most important attack vector for C++ binaries. In this paper, we present VTable Pointer Separation (VPS), a practical binary-level defense against vtable hijacking in C++ applications. Unlike previous binary-level defenses, which rely on unsound static analyses to match classes to virtual callsites, VPS achieves a more accurate protection by restricting virtual callsites to validly created objects. More specifically, VPS ensures that virtual callsites can only use objects created at valid object construction sites, and only if those objects can reach the callsite. Moreover, VPS explicitly prevents false positives (falsely identified virtual callsites) from breaking the binary, an issue existing work does not handle correctly or at all. We evaluate the prototype implementation of VPS on a diverse set of complex, real-world applications (MongoDB, MySQL server, Node.js, SPEC CPU2017/CPU2006), showing that our approach protects on average 97.8% of all virtual callsites in SPEC CPU2006 and 97.4% in SPEC CPU2017 (all C++ benchmarks), with a moderate performance overhead of 11% and 9% geomean, respectively. Furthermore, our evaluation reveals 86 false negatives in VTV, a popular source-based defense which is part of GCC.


title: qgam: Bayesian non-parametric quantile regression modelling in R

abstract: Generalized additive models (GAMs) are flexible non-linear regression models, which can be fitted efficiently using the approximate Bayesian methods provided by the mgcv R package. While the GAM methods provided by mgcv are based on the assumption that the response distribution is modelled parametrically, here we discuss more flexible methods that do not entail any parametric assumption. In particular, this article introduces the qgam package, which is an extension of mgcv providing fast calibrated Bayesian methods for fitting quantile GAMs (QGAMs) in R. QGAMs are based on a smooth version of the pinball loss of Koenker (2005), rather than on a likelihood function, hence jointly achieving satisfactory accuracy of the quantile point estimates and coverage of the corresponding credible intervals requires adopting the specialized Bayesian fitting framework of Fasiolo, Wood, Zaffran, Nedellec, and Goude (2020b). Here we detail how this framework is implemented in qgam and we provide examples illustrating how the package should be used in practice.


title: Learning to Generate Novel Domains for Domain Generalization

abstract: This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited diversity, hampering the model's ability to learn to generalize. We therefore employ a data generator to synthesize data from pseudo-novel domains to augment the source domains. This explicitly increases the diversity of available training domains and leads to a more generalizable model. To train the generator, we model the distribution divergence between source and synthesized pseudo-novel domains using optimal transport, and maximize the divergence. To ensure that semantics are preserved in the synthesized data, we further impose cycle-consistency and classification losses on the generator. Our method, L2A-OT (Learning to Augment by Optimal Transport) outperforms current state-of-the-art DG methods on four benchmark datasets.


title: From API to NLI: A New Interface for Library Reuse

abstract: Developers frequently reuse APIs from existing libraries to implement certain functionality. However, learning APIs is difficult due to their large scale and complexity. In this paper, we design an abstract framework NLI2Code to ease the reuse process. Under the framework, users can reuse library functionalities with a high-level, automatically-generated NLI (Natural Language Interface) instead of the detailed API elements. The framework consists of three components: a functional feature extractor to summarize the frequently-used library functions in natural language form, a code pattern miner to give a code template for each functional feature, and a synthesizer to complete code patterns into well-typed snippets. From the perspective of a user, a reuse task under NLI2Code starts from choosing a functional feature and our framework will guide the user to synthesize the desired solution. We instantiated the framework as a tool to reuse Java libraries. The evaluation shows our tool can generate a high-quality natural language interface and save half of the coding time for newcomers to solve real-world programming tasks.


title: Characterization of Errors in Interferometry with Entangled Atoms

abstract: Recent progress in generating entangled spin states of neutral atoms provides opportunities to advance quantum sensing technology. In particular, entanglement can enhance the performance of accelerometers and gravimeters based on light-pulse atom interferometry. We study the effects of error sources that may limit the sensitivity of such devices, including errors in the preparation of the initial entangled state, imperfections in the laser pulses, momentum spread of the initial atomic wave packet, measurement errors, spontaneous emission, and atom loss. We determine that, for each of these errors, the expectation value of the parity operator $\Pi$ has the general form, $\overline{\langle \Pi \rangle} = \Pi_0 \cos( N \phi )$, where $\phi$ is the interferometer phase and $N$ is the number of atoms prepared in the maximally entangled Greenberger--Horne--Zeilinger state. Correspondingly, the minimum phase uncertainty has the general form, $\Delta\phi = (\Pi_0 N)^{-1}$. Each error manifests itself through a reduction of the amplitude of the parity oscillations, $\Pi_0$, below the ideal value of $\Pi_0 = 1$. For each of the errors, we derive an analytic result that expresses the dependence of $\Pi_0$ on error parameter(s) and $N$, and also obtain a simplified approximate expression valid when the error is small. Based on the performed analysis, entanglement-enhanced atom interferometry appears to be feasible with existing experimental capabilities.


title: An optimised tiling pattern for multi-object spectroscopic surveys: application to the 4MOST survey

abstract: Large multi-object spectroscopic surveys require automated algorithms to optimise their observing strategy. One of the most ambitious upcoming spectroscopic surveys is the 4MOST survey. The 4MOST survey facility is a fibre-fed spectroscopic instrument on the VISTA telescope with a large enough field of view to survey a large fraction of the southern sky within a few years. Several Galactic and extragalactic surveys will be carried out simultaneously, so the combined target density will strongly vary. In this paper, we describe a new tiling algorithm that can naturally deal with the large target density variations on the sky and which automatically handles the different exposure times of targets. The tiling pattern is modelled as a marked point process, which is characterised by a probability density that integrates the requirements imposed by the 4MOST survey. The optimal tilling pattern with respect to the defined model is estimated by the tiles configuration that maximises the proposed probability density. In order to achieve this maximisation a simulated annealing algorithm is implemented. The algorithm automatically finds an optimal tiling pattern and assigns a tentative sky brightness condition and exposure time for each tile, while minimising the total execution time that is needed to observe the list of targets in the combined input catalogue of all surveys. Hence, the algorithm maximises the long-term observing efficiency and provides an optimal tiling solution for the survey. While designed for the 4MOST survey, the algorithm is flexible and can with simple modifications be applied to any other multi-object spectroscopic survey.


title: The ordering of future observations from multiple groups

abstract: There are many situations where comparison of different groups is of great interest. Considering the ordering of the efficiency of some treatments is an example. We present nonparametric predictive inference (NPI) for the ordering of real-valued future observations from multiple independent groups. The uncertainty is quantified using NPI lower and upper probabilities for the event that the next future observations from these groups are ordered in a specific way. Several applications of these NPI lower and upper probabilities are explored, including multiple groups inference, diagnostic accuracy and ranked set sampling.


title: On spectra and spectral measures of Schreier and Cayley graphs

abstract: We are interested in various aspects of spectral rigidity of Cayley and Schreier graphs of finitely generated groups. For each pair of integers $d\geq 2$ and $m \ge 1$, we consider an uncountable family of groups of automorphisms of the rooted $d$-regular tree which provide examples of the following interesting phenomena. For $d=2$ and any $m\geq 2$, we get an uncountable family of non quasi-isometric Cayley graphs with the same Laplacian spectrum, absolutely continuous on the union of two intervals, that we compute explicitly. Some of the groups provide examples where the spectrum of the Cayley graph is connected for one generating set and has a gap for another. For each $d\geq 3, m\geq 1$, we exhibit infinite Schreier graphs of these groups with the spectrum a Cantor set of Lebesgue measure zero union a countable set of isolated points accumulating on it. The Kesten spectral measures of the Laplacian on these Schreier graphs are discrete and concentrated on the isolated points. We construct moreover a complete system of eigenfunctions which are strongly localized.


title: DAM: Deliberation, Abandon and Memory Networks for Generating Detailed and Non-repetitive Responses in Visual Dialogue

abstract: Visual Dialogue task requires an agent to be engaged in a conversation with human about an image. The ability of generating detailed and non-repetitive responses is crucial for the agent to achieve human-like conversation. In this paper, we propose a novel generative decoding architecture to generate high-quality responses, which moves away from decoding the whole encoded semantics towards the design that advocates both transparency and flexibility. In this architecture, word generation is decomposed into a series of attention-based information selection steps, performed by the novel recurrent Deliberation, Abandon and Memory (DAM) module. Each DAM module performs an adaptive combination of the response-level semantics captured from the encoder and the word-level semantics specifically selected for generating each word. Therefore, the responses contain more detailed and non-repetitive descriptions while maintaining the semantic accuracy. Furthermore, DAM is flexible to cooperate with existing visual dialogue encoders and adaptive to the encoder structures by constraining the information selection mode in DAM. We apply DAM to three typical encoders and verify the performance on the VisDial v1.0 dataset. Experimental results show that the proposed models achieve new state-of-the-art performance with high-quality responses. The code is available at https://github.com/JXZe/DAM.


title: An Accelerated DFO Algorithm for Finite-sum Convex Functions

abstract: Derivative-free optimization (DFO) has recently gained a lot of momentum in machine learning, spawning interest in the community to design faster methods for problems where gradients are not accessible. While some attention has been given to the concept of acceleration in the DFO literature, existing stochastic algorithms for objective functions with a finite-sum structure have not been shown theoretically to achieve an accelerated rate of convergence. Algorithms that use acceleration in such a setting are prone to instabilities, making it difficult to reach convergence. In this work, we exploit the finite-sum structure of the objective in order to design a variance-reduced DFO algorithm that provably yields acceleration. We prove rates of convergence for both smooth convex and strongly-convex finite-sum objective functions. Finally, we validate our theoretical results empirically on several tasks and datasets.


title: On the Construction of Polar Codes in the Middleton Class-A Channels

abstract: Although power line communication (PLC) systems are available everywhere, unfortunately these systems are not suitable for information transmission due to the effects of the impulsive noise. Therefore, many previous studies on channel codes have been carried out for the purpose of reducing the impulsive noise in such channels. This paper investigates some methods for the construction of polar codes under PLC systems in the presence of Middleton class-A noise. We discuss here the most feasible construction methods which already have been adopted with other channels. In addition, we present an illustrative example for the construction in these methods and also we discuss a comparison between the methods in terms of performance.


title: Predictive Maintenance for Edge-Based Sensor Networks: A Deep Reinforcement Learning Approach

abstract: Failure of mission-critical equipment interrupts production and results in monetary loss. The risk of unplanned equipment downtime can be minimized through Predictive Maintenance of revenue generating assets to ensure optimal performance and safe operation of equipment. However, the increased sensorization of the equipment generates a data deluge, and existing machine-learning based predictive model alone becomes inadequate for timely equipment condition predictions. In this paper, a model-free Deep Reinforcement Learning algorithm is proposed for predictive equipment maintenance from an equipment-based sensor network context. Within each equipment, a sensor device aggregates raw sensor data, and the equipment health status is analyzed for anomalous events. Unlike traditional black-box regression models, the proposed algorithm self-learns an optimal maintenance policy and provides actionable recommendation for each equipment. Our experimental results demonstrate the potential for broader range of equipment maintenance applications as an automatic learning framework.


title: The exact solution to the Shallow water Equations Riemann problem at width jumps in rectangular channels

abstract: Riemann problems at geometric discontinuities are a classic and fascinating issue of hydraulics. In the present paper, the complete solution to the Riemann problem of the one-dimensional Shallow water Equations at monotonic width discontinuities is presented. This solution is based on the assumption that the relationship between the states immediately to the left and to the right of the discontinuity is a stationary weak solution of the one-dimensional variable-width Shallow water Equations. It is demonstrated that the solution to the Riemann problem always exists and it is unique, but there are cases where three solutions are possible. The appearance of multiple solutions is connected to a phenomenon, known as hydraulic hysteresis, observed for supercritical flow in contracting channel. The analysis of a Finite Volume numerical scheme from the literature (Cozzolino et al. 2018b) shows that the algorithm captures the solution with supercritical flow through the width discontinuity when multiple solutions are possible. Interestingly, the one-dimensional variable-width Shallow water Equations are formally identical to the one-dimensional Porous Shallow water Equations, implying that the exact solutions and the numerical scheme discussed in the present paper are relevant for two-dimensional Porous Shallow water numerical models aiming at urban flooding simulations. The exact solution presented here may be used not only as a benchmark, but also as a guide for the construction of new algorithms, and it can be even embedded in an exact solver.


title: Manifold Learning via Manifold Deflation

abstract: Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as vulnerability to noise, repeated eigendirections, holes in convex bodies, and boundary bias. We derive an embedding method for Riemannian manifolds that iteratively uses single-coordinate estimates to eliminate dimensions from an underlying differential operator, thus "deflating" it. These differential operators have been shown to characterize any local, spectral dimensionality reduction method. The key to our method is a novel, incremental tangent space estimator that incorporates global structure as coordinates are added. We prove its consistency when the coordinates converge to true coordinates. Empirically, we show our algorithm recovers novel and interesting embeddings on real-world and synthetic datasets.


title: Graph Neural Networks with Continual Learning for Fake News Detection from Social Media

abstract: Although significant effort has been applied to fact-checking, the prevalence of fake news over social media, which has profound impact on justice, public trust and our society, remains a serious problem. In this work, we focus on propagation-based fake news detection, as recent studies have demonstrated that fake news and real news spread differently online. Specifically, considering the capability of graph neural networks (GNNs) in dealing with non-Euclidean data, we use GNNs to differentiate between the propagation patterns of fake and real news on social media. In particular, we concentrate on two questions: (1) Without relying on any text information, e.g., tweet content, replies and user descriptions, how accurately can GNNs identify fake news? Machine learning models are known to be vulnerable to adversarial attacks, and avoiding the dependence on text-based features can make the model less susceptible to the manipulation of advanced fake news fabricators. (2) How to deal with new, unseen data? In other words, how does a GNN trained on a given dataset perform on a new and potentially vastly different dataset? If it achieves unsatisfactory performance, how do we solve the problem without re-training the model on the entire data from scratch? We study the above questions on two datasets with thousands of labelled news items, and our results show that: (1) GNNs can achieve comparable or superior performance without any text information to state-of-the-art methods. (2) GNNs trained on a given dataset may perform poorly on new, unseen data, and direct incremental training cannot solve the problem---this issue has not been addressed in the previous work that applies GNNs for fake news detection. In order to solve the problem, we propose a method that achieves balanced performance on both existing and new datasets, by using techniques from continual learning to train GNNs incrementally.


title: Efficient Learning of Generative Models via Finite-Difference Score Matching

abstract: Several machine learning applications involve the optimization of higher-order derivatives (e.g., gradients of gradients) during training, which can be expensive in respect to memory and computation even with automatic differentiation. As a typical example in generative modeling, score matching (SM) involves the optimization of the trace of a Hessian. To improve computing efficiency, we rewrite the SM objective and its variants in terms of directional derivatives, and present a generic strategy to efficiently approximate any-order directional derivative with finite difference (FD). Our approximation only involves function evaluations, which can be executed in parallel, and no gradient computations. Thus, it reduces the total computational cost while also improving numerical stability. We provide two instantiations by reformulating variants of SM objectives into the FD forms. Empirically, we demonstrate that our methods produce results comparable to the gradient-based counterparts while being much more computationally efficient.


title: Revealing the formation mechanism of the shell galaxy NGC474 with MUSE

abstract: Stellar shells around galaxies could provide precious insights into their assembly history. However, their formation mechanism remains poorly empirically constrained, in particular the type of galaxy collisions at their origin. We present MUSE@VLT data of the most prominent outer shell of NGC 474, to constrain its formation history. The stellar shell spectrum is clearly detected, with a signal-to-noise ratio of around 65 pix$^{-1}$. We use a full spectral fitting method to determine the line-of-sight velocity and the age and metallicity of the shell and associated point-like sources within the MUSE field of view. We detect six GC candidates and eight PN candidates which are all kinematically associated to the stellar shell. We show that the shell has an intermediate metallicity, [M/H] = $-0.83^{+0.12}_{-0.12}$ and a possible $\alpha$-enrichment, [$\alpha$/Fe] ~ 0.3. Assuming the material of the shell comes from a lower mass companion, and that the latter had no initial metallicity gradient, such a stellar metallicity would constrain the mass of the progenitor to be around 7.4 x 10^8 M$_\odot$, implying a merger mass ratio of about 1:100. However our census of PNs and earlier photometry of the shell would suggest a much higher ratio, around 1:20. Given the uncertainties, this difference is significant only at the ~1sigma level. We discuss the characteristics of the progenitor, in particular whether the progenitor could also be composed of stars from the low metallicity outskirts from a more massive galaxy. Ultimately, the presented data does not allow us to put a firm constraint on the progenitor mass. We show that at least two globular cluster candidates possibly associated with the shell are quite young, with ages below 1.5~Gyr. We also note the presence of a young (~1Gyr) stellar population in the center of NGC 474. The two may have resulted from the same event.


title: Ab-initio calculation of the proton and the neutron's scalar couplings for new physics searches

abstract: Many low-energy, particle-physics experiments seek to reveal new fundamental physics by searching for very rare scattering events on atomic nuclei. The interpretation of their results requires quantifying the non-linear effects of the strong interaction on the spin-independent couplings of this new physics to protons and neutrons. Here we present a fully-controlled, ab-initio calculation of these couplings to the quarks within those constituents of nuclei. We use lattice quantum chromodynamics computations for the four lightest species of quarks and heavy-quark expansions for the remaining two. We determine each of the six quark contributions with an accuracy better than 15%. Our results are especially important for guiding and interpreting experimental searches for our universe's dark matter.


title: Higher-Page Bott-Chern and Aeppli Cohomologies and Applications

abstract: For every positive integer $r$, we introduce two new cohomologies, that we call $E_r$-Bott-Chern and $E_r$-Aeppli, on compact complex manifolds. When $r=1$, they coincide with the usual Bott-Chern and Aeppli cohomologies, but they are coarser, respectively finer, than these when $r\geq 2$. They provide analogues in the Bott-Chern-Aeppli context of the $E_r$-cohomologies featuring in the Fr\"olicher spectral sequence of the manifold. We apply these new cohomologies in several ways to characterise the notion of page-$(r-1)$-$\partial\bar\partial$-manifolds that we introduced very recently. We also prove analogues of the Serre duality for these higher-page Bott-Chern and Aeppli cohomologies and for the spaces featuring in the Fr\"olicher spectral sequence. We obtain a further group of applications of our cohomologies to the study of Hermitian-symplectic and strongly Gauduchon metrics for which we show that they provide the natural cohomological framework.


title: New physics at nuSTORM

abstract: In this work we investigate the usefulness of nuSTORM as a probe of two new-physics scenarios which are sterile neutrinos and non-unitarity of the neutrino mixing matrix. For the sterile neutrino we show the importance of the neutral current events when combined with the charged current events to constrain the effective mixing angle, $\theta_{\mu \mu}$, and the sterile mixing angles $\theta_{14}$ and $\theta_{24}$. We also study the role nuSTORM will play in the study of neutrino oscillation physics if the three generation neutrino mixing matrix is non-unitary. In this context we elucidate the role of nuSTORM, considering both charged current and neutral current events, in constraining the various non-unitarity parameters such as $\alpha_{11}$, $|\alpha_{21}|$ and $\alpha_{22}$.


title: Operator factorization of range space relations

abstract: Given two range space relations A and B in Hilbert spaces, we characterize the existence of a range space operator T such that A = BT, respectively A = TB.


title: The Stackelberg Kidney Exchange Problem is $\Sigma_2^p$-complete

abstract: We introduce the Stackelberg kidney exchange problem. In this problem, an agent (e.g. a hospital or a national organization) has control over a number of incompatible patient-donor pairs whose patients are in need of a transplant. The agent has the opportunity to join a collaborative effort which aims to increase the maximum total number of transplants that can be realized. However, the individual agent is only interested in maximizing the number of transplants within the set of patients under its control. Then, the question becomes which patients to submit to the collaborative effort. We show that, whenever we allow exchanges involving at most a fixed number $K \ge 3$ pairs, answering this question is $\Sigma_2^p$-complete. However, when we restrict ourselves to pairwise exchanges only, the problem becomes solvable in polynomial time


title: Mapping the Future of Particle Radiobiology in Europe: The INSPIRE Project

abstract: Particle therapy is a growing cancer treatment modality worldwide. However, there still remains a number of unanswered questions considering differences in the biological response between particles and photons. These questions, and probing of biological mechanisms in general, necessitate experimental investigation. The Infrastructure in Proton International Research (INSPIRE) project was created to provide an infrastructure for European research, unify research efforts on the topic of proton and ion therapy across Europe, and to facilitate the sharing of information and resources. This work highlights the radiobiological capabilities of the INSPIRE partners, providing details of physics (available particle types and energies), biology (sample preparation and post-irradiation analysis), and researcher access (the process of applying for beam time). The collection of information reported here is designed to provide researchers both in Europe and worldwide with the tools required to select the optimal center for their research needs. We also highlight areas of redundancy in capabilities and suggest areas for future investment.


title: Structured (De)composable Representations Trained with Neural Networks

abstract: The paper proposes a novel technique for representing templates and instances of concept classes. A template representation refers to the generic representation that captures the characteristics of an entire class. The proposed technique uses end-to-end deep learning to learn structured and composable representations from input images and discrete labels. The obtained representations are based on distance estimates between the distributions given by the class label and those given by contextual information, which are modeled as environments. We prove that the representations have a clear structure allowing to decompose the representation into factors that represent classes and environments. We evaluate our novel technique on classification and retrieval tasks involving different modalities (visual and language data).


title: An Integer Programming Approach to Deep Neural Networks with Binary Activation Functions

abstract: We study deep neural networks with binary activation functions (BDNN), i.e. the activation function only has two states. We show that the BDNN can be reformulated as a mixed-integer linear program which can be solved to global optimality by classical integer programming solvers. Additionally, a heuristic solution algorithm is presented and we study the model under data uncertainty, applying a two-stage robust optimization approach. We implemented our methods on random and real datasets and show that the heuristic version of the BDNN outperforms classical deep neural networks on the Breast Cancer Wisconsin dataset while performing worse on random data.


title: Novel shadows from the asymmetric thin-shell wormhole

abstract: For dark compact objects such as black holes or wormholes, the shadow size has long been thought to be determined by the unstable photon sphere (region). However, by considering the asymmetric thin-shell wormhole (ATSW) model, we find that the impact parameter of the null geodesics is discontinuous through the wormhole in general and hence we identify novel shadows whose sizes are dependent of the photon sphere in the other side of the spacetime. The novel shadows appear in three cases: (A2) The observer's spacetime contains a photon sphere and the mass parameter is smaller than that of the opposite side; (B1, B2) there' s no photon sphere no matter which mass parameter is bigger. In particular, comparing with the black hole, the wormhole shadow size is always smaller and their difference is significant in most cases, which provides a potential way to observe wormholes directly through Event Horizon Telescope with better detection capability in the future.


title: Guided Exploration with Proximal Policy Optimization using a Single Demonstration

abstract: Solving sparse reward tasks through exploration is one of the major challenges in deep reinforcement learning, especially in three-dimensional, partially-observable environments. Critically, the algorithm proposed in this article uses a single human demonstration to solve hard-exploration problems. We train an agent on a combination of demonstrations and own experience to solve problems with variable initial conditions. We adapt this idea and integrate it with the proximal policy optimization (PPO). The agent is able to increase its performance and to tackle harder problems by replaying its own past trajectories prioritizing them based on the obtained reward and the maximum value of the trajectory. We compare different variations of this algorithm to behavioral cloning on a set of hard-exploration tasks in the Animal-AI Olympics environment. To the best of our knowledge, learning a task in a three-dimensional environment with comparable difficulty has never been considered before using only one human demonstration.