title: Evolutionary Optimization of Deep Learning Activation Functions

abstract: The choice of activation function can have a large effect on the performance of a neural network. While there have been some attempts to hand-engineer novel activation functions, the Rectified Linear Unit (ReLU) remains the most commonly-used in practice. This paper shows that evolutionary algorithms can discover novel activation functions that outperform ReLU. A tree-based search space of candidate activation functions is defined and explored with mutation, crossover, and exhaustive search. Experiments on training wide residual networks on the CIFAR-10 and CIFAR-100 image datasets show that this approach is effective. Replacing ReLU with evolved activation functions results in statistically significant increases in network accuracy. Optimal performance is achieved when evolution is allowed to customize activation functions to a particular task; however, these novel activation functions are shown to generalize, achieving high performance across tasks. Evolutionary optimization of activation functions is therefore a promising new dimension of metalearning in neural networks.


title: Rate Splitting for Multi-Antenna Downlink: Precoder Design and Practical Implementation

abstract: Rate splitting (RS) is a potentially powerful and flexible technique for multi-antenna downlink transmission. In this paper, we address several technical challenges towards its practical implementation for beyond 5G systems. To this end, we focus on a single-cell system with a multi-antenna base station (BS) and K single-antenna receivers. We consider RS in its most general form, and joint decoding to fully exploit the potential of RS. First, we investigate the achievable rates under joint decoding and formulate the precoder design problems to maximize a general utility function, or to minimize the transmit power under pre-defined rate targets. Building upon the concave-convex procedure (CCCP), we propose precoder design algorithms for an arbitrary number of users. Our proposed algorithms approximate the intractable non-convex problems with a number of successively refined convex problems, and provably converge to stationary points of the original problems. Then, to reduce the decoding complexity, we consider the optimization of the precoder and the decoding order under successive decoding. Further, we propose a stream selection algorithm to reduce the number of precoded signals. With a reduced number of streams and successive decoding at the receivers, our proposed algorithm can even be implemented when the number of users is relatively large, whereas the complexity was previously considered as prohibitively high in the same setting. Finally, we propose a simple adaptation of our algorithms to account for the imperfection of the channel state information at the transmitter. Numerical results demonstrate that the general RS scheme provides a substantial performance gain as compared to state-of-the-art linear precoding schemes, especially with a moderately large number of users.


title: Galaxy Cold Gas Contents in Modern Cosmological Hydrodynamic Simulations

abstract: We present a comparison of galaxy atomic and molecular gas properties in three recent cosmological hydrodynamic simulations, Simba, EAGLE, and Illustris-TNG, versus observations from $z\sim 0-2$. These simulations all rely on similar sub-resolution prescriptions to model cold interstellar gas which they cannot represent directly, and qualitatively reproduce the observed $z\approx 0$ HI and H$_2$ mass functions (HIMF, H2MF), CO(1-0) luminosity functions (COLF), and gas scaling relations versus stellar mass, specific star formation rate, and stellar surface density $\mu_*$, with some quantitative differences. To compare to the COLF, we apply an H$_2$-to-CO conversion factor to the simulated galaxies based on their average molecular surface density and metallicity, yielding substantial variations in $\alpha_{\rm CO}$ and significant differences between models. Using this, predicted $z=0$ COLFs agree better with data than predicted H2MFs. Out to $z\sim 2$, EAGLE's and Simba's HIMF and COLF strongly increase, while TNG's HIMF declines and COLF evolves slowly. EAGLE and Simba reproduce high $L_{\rm CO1-0}$ galaxies at $z\sim 1-2$ as observed, owing partly to a median $\alpha_{\rm CO}(z=2)\sim 1$ versus $\alpha_{\rm CO}(z=0)\sim 3$. Examining \HI, H$_2$, and CO scaling relations, their trends with $M_*$ are broadly reproduced in all models, but EAGLE yields too little HI in green valley galaxies, TNG and Simba overproduce cold gas in massive galaxies, and Simba overproduces molecular gas in small systems. Using Simba variants that exclude individual AGN feedback modules, we find that Simba's AGN jet feedback is primarily responsible by lowering cold gas contents from $z\sim 1\to0$ by suppressing cold gas in $M_*> 10^{10}{\rm M}_\odot$ galaxies, while X-ray feedback suppresses the formation of high-$\mu_*$ systems.


title: Dual-Attention GAN for Large-Pose Face Frontalization

abstract: Face frontalization provides an effective and efficient way for face data augmentation and further improves the face recognition performance in extreme pose scenario. Despite recent advances in deep learning-based face synthesis approaches, this problem is still challenging due to significant pose and illumination discrepancy. In this paper, we present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization by capturing both contextual dependencies and local consistency during GAN training. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies yielding better feature representations, and hence generate faces that preserve identities better, especially for larger pose angles. Moreover, a novel face-attention-based discriminator is applied to emphasize local features of face regions, and hence reinforce the realism of synthetic frontal faces. Guided by semantic segmentation, four independent discriminators are used to distinguish between different aspects of a face (\ie skin, keypoints, hairline, and frontalized face). By introducing these two complementary attention mechanisms in generator and discriminator separately, we can learn a richer feature representation and generate identity preserving inference of frontal views with much finer details (i.e., more accurate facial appearance and textures) comparing to the state-of-the-art. Quantitative and qualitative experimental results demonstrate the effectiveness and efficiency of our DA-GAN approach.


title: Electromagnetic-gravitational perturbations of Kerr-Newman spacetime: the Teukolsky and Regge-Wheeler equations

abstract: We derive the equations governing the linear stability of Kerr-Newman spacetime to coupled electromagnetic-gravitational perturbations. The equations generalize the celebrated Teukolsky equation for curvature perturbations of Kerr, and the Regge-Wheeler equation for metric perturbations of Reissner-Nordstr\"om. Because of the "apparent indissolubility of the coupling between the spin-1 and spin-2 fields", as put by Chandrasekhar, the stability of Kerr-Newman spacetime can not be obtained through standard decomposition in modes. Due to the impossibility to decouple the modes of the gravitational and electromagnetic fields, the equations governing the linear stability of Kerr-Newman have not been previously derived. Using a tensorial approach that was applied to Kerr, we produce a set of generalized Regge-Wheeler equations for perturbations of Kerr-Newman, which are suitable for the study of linearized stability by physical space methods. The physical space analysis overcomes the issue of coupling of spin-1 and spin-2 fields and represents the first step towards an analytical proof of the stability of the Kerr-Newman black hole.


title: How Do Expectations Affect Learning About Fundamentals? Some Experimental Evidence

abstract: We test how individuals with incorrect beliefs about their ability learn about an external parameter (`fundamental') when they cannot separately identify the effects of their ability, actions, and the parameter on their output. Heidhues et al. (2018) argue that learning makes overconfident individuals worse off as their beliefs about the fundamental get less accurate, causing them to take worse actions. In our experiment, subjects take incorrectly-marked tests, and we measure how they learn about the marker's accuracy over time. Overconfident subjects put in less effort, and their beliefs about the marker's accuracy got worse, as they learnt. Beliefs about the proportion of correct answers marked as correct fell by 0.05 over the experiment. We find no effect in underconfident subjects.


title: Effect of binary evolution on the inferred initial and final core masses of hydrogen-rich, Type~II supernova progenitors

abstract: The majority of massive stars, the progenitors of core-collapse supernovae (SNe), are found in close binary systems. Zapartas et al. (2019) modeled the fraction of hydrogen-rich, Type II SN progenitors which have their evolution affected by mass exchange with their companion, finding this to be between 1/3 and 1/2 for most assumptions. Here we study in more depth the impact of this binary history of Type II SN progenitors on their final pre-SN core mass distribution, using population synthesis simulations. We find that binary star progenitors of Type II SNe typically end their life with a larger core mass than they would have had if they had lived in isolation, because they gained mass or merged with a companion before explosion. The combination of the diverse binary evolutionary paths typically lead to a marginally shallower final core mass distribution. Discussing our results in the context of the red supergiant problem, i.e., the reported lack of detected high luminosity progenitors, we conclude that binary evolution does not seem to significantly affect the issue. This conclusion is quite robust against our variations in the assumptions of binary physics. We also predict that inferring the initial masses of Type II SN progenitors from "age-dating" its surrounding environment systematically yields lower masses compared to methods that probe the pre-SN core mass or luminosity. A robust discrepancy between the inferred initial masses of a SN progenitor from those different techniques could indicate an evolutionary history of binary mass accretion or merging.


title: Orthogonal Frequency Division Multiplexing With Subcarrier Power Modulation for Doubling the Spectral Efficiency of 6G and Beyond Networks

abstract: With the emergence of new applications (e.g., extended reality and haptics), which require to be simultaneously served not just with low latency and sufficient reliability, but also with high spectral efficiency, future networks (i.e., 6G) should be capable of meeting this demand by introducing new effective transmission designs. Motivated by this, a novel modulation technique termed as orthogonal frequency division multiplexing with subcarrier power modulation (OFDM-SPM) is proposed for providing highly spectral-efficient data transmission with low-latency and less-complexity for future 6G wireless communication systems. OFDM-SPM utilizes the power of subcarriers in OFDM blocks as a third dimension to convey extra information bits while reducing both complexity and latency compared to conventional schemes. In this paper, the concept of OFDM-SPM is introduced and its validity as a future adopted modulation technique is investigated over a wireless multipath Rayleigh fading channel. The proposed system structure is explained, an analytical expression of the bit error rate (BER) is derived, and numerical simulations of BER and throughput performances of OFDM-SPM are carried out. OFDM-SPM is found to greatly enhance the spectral efficiency where it is capable of doubling it. Additionally, OFDM-SPM introduces negligible complexity to the system, does not exhibit error propagation, reduces the transmission delay, and decreases the transmission power by half.


title: How quantum evolution with memory is generated in a time-local way

abstract: Two widely used but distinct approaches to the dynamics of open quantum systems are the Nakajima-Zwanzig and time-convolutionless quantum master equation, respectively. Although both describe identical quantum evolutions with strong memory effects, the first uses a time-nonlocal memory kernel $\mathcal{K}$, whereas the second achieves the same using a time-local generator $\mathcal{G}$. Here we show that the two are connected by a simple yet general fixed-point relation: $\mathcal{G} = \hat{\mathcal{K}}[\mathcal{G}]$. This allows one to extract nontrivial relations between the two completely different ways of computing the time-evolution and combine their strengths. We first discuss the stationary generator, which enables a Markov approximation that is both nonperturbative and completely positive for a large class of evolutions. We show that this generator is not equal to the low-frequency limit of the memory kernel, but additionally "samples" it at nonzero characteristic frequencies. This clarifies the subtle roles of frequency dependence and semigroup factorization in existing Markov approximation strategies. Second, we prove that the fixed-point equation sums up the time-domain gradient / Moyal expansion for the time-nonlocal quantum master equation, providing nonperturbative insight into the generation of memory effects. Finally, we show that the fixed-point relation enables a direct iterative numerical computation of both the stationary and the transient generator from a given memory kernel. For the transient generator this produces non-semigroup approximations which are constrained to be both initially and asymptotically accurate at each iteration step.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: On the Discrepancy between Density Estimation and Sequence Generation

abstract: Many sequence-to-sequence generation tasks, including machine translation and text-to-speech, can be posed as estimating the density of the output y given the input x: p(y|x). Given this interpretation, it is natural to evaluate sequence-to-sequence models using conditional log-likelihood on a test set. However, the goal of sequence-to-sequence generation (or structured prediction) is to find the best output y^ given an input x, and each task has its own downstream metric R that scores a model output by comparing against a set of references y*: R(y^, y* | x). While we hope that a model that excels in density estimation also performs well on the downstream metric, the exact correlation has not been studied for sequence generation tasks. In this paper, by comparing several density estimators on five machine translation tasks, we find that the correlation between rankings of models based on log-likelihood and BLEU varies significantly depending on the range of the model families being compared. First, log-likelihood is highly correlated with BLEU when we consider models within the same family (e.g. autoregressive models, or latent variable models with the same parameterization of the prior). However, we observe no correlation between rankings of models across different families: (1) among non-autoregressive latent variable models, a flexible prior distribution is better at density estimation but gives worse generation quality than a simple prior, and (2) autoregressive models offer the best translation performance overall, while latent variable models with a normalizing flow prior give the highest held-out log-likelihood across all datasets. Therefore, we recommend using a simple prior for the latent variable non-autoregressive model when fast generation speed is desired.


title: Multiscale analysis for traveling-pulse solutions to the stochastic FitzHugh-Nagumo equations

abstract: We investigate the stability of traveling-pulse solutions to the stochastic FitzHughNagumo equations with additive noise. Special attention is given to the effect of small noise on the classical deterministically stable fast traveling pulse. Our method is based on adapting the velocity of the traveling wave by solving a scalar stochastic ordinary differential equation (SODE) and tracking perturbations to the wave meeting a system of a scalar stochastic partial differential equation (SPDE) coupled to a scalar ordinary differential equation (ODE). This approach has been recently employed by Kr\"uger and Stannat for scalar stochastic bistable reaction-diffusion equations such as the Nagumo equation. A main difference in our situation of an SPDE coupled to an ODE is that the linearization has essential spectrum parallel to the imaginary axis and thus only generates a strongly continuous semigroup. Furthermore, the linearization around the traveling wave is not self-adjoint anymore, so that fluctuations around the wave cannot be expected to be orthogonal in a corresponding inner product. We demonstrate that this problem can be overcome by making use of Riesz instead of orthogonal spectral projections as recently employed in a series of papers by Hamster and Hupkes in case of analytic semigroups. We expect that our approach can also be applied to traveling waves and other patterns in more general situations such as systems of SPDEs with linearizations only generating a strongly continuous semigroup. This provides a relevant generalization as these systems are prevalent in many applications.


title: Time-Space Tradeoffs for Distinguishing Distributions and Applications to Security of Goldreich's PRG

abstract: In this work, we establish lower-bounds against memory bounded algorithms for distinguishing between natural pairs of related distributions from samples that arrive in a streaming setting. In our first result, we show that any algorithm that distinguishes between uniform distribution on $\{0,1\}^n$ and uniform distribution on an $n/2$-dimensional linear subspace of $\{0,1\}^n$ with non-negligible advantage needs $2^{\Omega(n)}$ samples or $\Omega(n^2)$ memory. Our second result applies to distinguishing outputs of Goldreich's local pseudorandom generator from the uniform distribution on the output domain. Specifically, Goldreich's pseudorandom generator $G$ fixes a predicate $P:\{0,1\}^k \rightarrow \{0,1\}$ and a collection of subsets $S_1, S_2, \ldots, S_m \subseteq [n]$ of size $k$. For any seed $x \in \{0,1\}^n$, it outputs $P(x_{S_1}), P(x_{S_2}), \ldots, P(x_{S_m})$ where $x_{S_i}$ is the projection of $x$ to the coordinates in $S_i$. We prove that whenever $P$ is $t$-resilient (all non-zero Fourier coefficients of $(-1)^P$ are of degree $t$ or higher), then no algorithm, with $<n^\epsilon$ memory, can distinguish the output of $G$ from the uniform distribution on $\{0,1\}^m$ with a large inverse polynomial advantage, for stretch $m \le \left(\frac{n}{t}\right)^{\frac{(1-\epsilon)}{36}\cdot t}$ (barring some restrictions on $k$). The lower bound holds in the streaming model where at each time step $i$, $S_i\subseteq [n]$ is a randomly chosen (ordered) subset of size $k$ and the distinguisher sees either $P(x_{S_i})$ or a uniformly random bit along with $S_i$. Our proof builds on the recently developed machinery for proving time-space trade-offs (Raz 2016 and follow-ups) for search/learning problems.


title: GACEM: Generalized Autoregressive Cross Entropy Method for Multi-Modal Black Box Constraint Satisfaction

abstract: In this work we present a new method of black-box optimization and constraint satisfaction. Existing algorithms that have attempted to solve this problem are unable to consider multiple modes, and are not able to adapt to changes in environment dynamics. To address these issues, we developed a modified Cross-Entropy Method (CEM) that uses a masked auto-regressive neural network for modeling uniform distributions over the solution space. We train the model using maximum entropy policy gradient methods from Reinforcement Learning. Our algorithm is able to express complicated solution spaces, thus allowing it to track a variety of different solution regions. We empirically compare our algorithm with variations of CEM, including one with a Gaussian prior with fixed variance, and demonstrate better performance in terms of: number of diverse solutions, better mode discovery in multi-modal problems, and better sample efficiency in certain cases.


title: Prediction of Dementia-related Agitation Using Multivariate Ambient Environmental Time-series Data

abstract: Dementia-related agitation causes high stress for dementia caregivers (CG) and to persons with dementia (PWD). Current clinical research suggests that dementia agitation can be affected or triggered by the ambient environment and other contextual factors. In this study, we evaluate this hypothesis through an analysis of ambient environmental data collected with a remote sensing system deployed in the homes of PWDs and their CGs. Furthermore, we determine if the occurrence of dementia-related agitation can be predicted from ambient environmental data, creating the potential for agitation to be prevented via the environmental alteration. These collected data are used to learn the environmental patterns using a predictive model approach. The agitation labels, used in model training, are provided by the CGs living with the PWDs. The results of the agitation prediction model evaluation suggest that ambient environment can be used as predictors for upcoming dementia-related agitation. We also observed that environmental triggers for agitation are PWD-specific. Future opportunities and techniques used to understand triggers for dementia agitation are also discussed.


title: Blossoming bijection for bipartite pointed maps and parametric rationality of general maps of any surface

abstract: We construct an explicit bijection between bipartite pointed maps of an arbitrary surface $\mathbb{S}$, and specific unicellular blossoming maps of the same surface. Our bijection gives access to the degrees of all the faces, and distances from the pointed vertex in the initial map. The main construction generalizes recent work of the second author which covered the case of an orientable surface. Our bijection gives rise to a first combinatorial proof of a parametric rationality result concerning the bivariate generating series of maps of a given surface with respect to their numbers of faces and vertices. In particular, it provides a combinatorial explanation of the structural difference between the aforementioned bivariate parametric generating series in the case of orientable and non-orientable maps.


title: Extracting hierarchical backbones from bipartite networks

abstract: We propose a method for extracting hierarchical backbones from a bipartite network. Our method leverages the observation that a hierarchical relationship between two nodes in a bipartite network is often manifested as an asymmetry in the conditional probability of observing the connections to them from the other node set. Our method estimates both the importance and direction of the hierarchical relationship between a pair of nodes, thereby providing a flexible way to identify the essential part of the networks. Using semi-synthetic benchmarks, we show that our method outperforms existing methods at identifying planted hierarchy while offering more flexibility. Application of our method to empirical datasets---a bipartite network of skills and individuals as well as the network between gene products and Gene Ontology (GO) terms---demonstrates the possibility of automatically extracting or augmenting ontology from data.


title: Surface chiral superconductivity in odd-parity nematic superconductors with magnetic impurities

abstract: We study odd-parity nematic superconductivity in doped topological insulators in presence of surface magnetic impurities. The peculiar surface subgap spectrum, characterized by a Majorana flatband, nodal cones and the surface states of the parent topological insulator, gives rise to an overall ferromagnetic RKKY interactions between the surface impurities. An additional coupling between the impurities and a preemptive chiral order parameter promote a surface time-reversal symmetry breaking solution at the surface of the system. We discuss the relevant scenarios and suggest to engineer surface chiral superconductivity by properly choosing magnetic adatoms with highly anisotropic exchange coupling.


title: Codes with few weights arising from linear sets

abstract: In this article we present a class of codes with few weights arising from special type of linear sets. We explicitly show the weights of such codes, their weight enumerator and possible choices for their generator matrices. In particular, our construction yields also to linear codes with three weights and, in some cases, to almost MDS codes. The interest for these codes relies on their applications to authentication codes and secret schemes, and their connections with further objects such as association schemes and graphs.


title: Bayesian Quantile Factor Models

abstract: Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often have an interesting theoretical interpretation in real problems. However, in some specific cases the interest involves the effects of latent factors not only in the mean, but in the entire response distribution, represented by a quantile. This paper introduces a new class of models, named quantile factor models, which combines factor model theory with distribution-free quantile regression producing a robust statistical method. Bayesian estimation for the proposed model is performed using an efficient Markov chain Monte Carlo algorithm. The proposed model is evaluated using synthetic datasets in different settings, in order to evaluate its robustness and performance under different quantiles compared to more usual methods. The model is also applied to a financial sector dataset and a heart disease experiment.


title: Kinetic Beaming in Radiative Relativistic Magnetic Reconnection: A Mechanism for Rapid Gamma-Ray Flares in Jets

abstract: Rapid gamma-ray flares pose an astrophysical puzzle, requiring mechanisms both to accelerate energetic particles and to produce fast observed variability. These dual requirements may be satisfied by collisionless relativistic magnetic reconnection. On the one hand, relativistic reconnection can energize gamma-ray emitting electrons. On the other, as previous kinetic simulations have shown, the reconnection acceleration mechanism preferentially focuses high-energy particles -- and their emitted photons -- into beams, which may create rapid blips in flux as they cross a telescope's line of sight. Using a series of 2D pair-plasma particle-in-cell simulations, we explicitly demonstrate the critical role played by radiative cooling in mediating the observable signatures of this `kinetic beaming' effect. Only in our efficiently cooled simulations do we measure kinetic beaming beyond one light crossing time of the reconnection layer. We find a correlation between the cooling strength and the photon energy range across which persistent kinetic beaming occurs: stronger cooling coincides with a wider range of beamed photon energies. We also apply our results to rapid gamma-ray flares in flat-spectrum radio quasars, suggesting that a paradigm of radiatively efficient kinetic beaming constrains relevant emission models. In particular, beaming-produced variability may be more easily realized in two-zone (e.g. spine-sheath) set-ups, with Compton seed photons originating in the jet itself, rather than in one-zone external Compton scenarios.


title: Fission Fragment Excitation Energy Sharing Beyond Scission

abstract: A simplified, though realistic, model describing two receding and accelerating fission fragments, due to their mutual Coulomb repulsion, shows that fission fragments share excitation energy well after they ceased to exchange nucleons. This mechanism leads to a lower total kinetic energy of the fission fragments, particularly if the pygmy resonances in the fission fragments are excited. Even though the emphasis here is on fission, similar arguments apply to fragments in heavy-ion reactions.


title: Pa$\beta$, H$\alpha$, and Attenuation in NGC 5194 and NGC 6946

abstract: We combine Hubble Space Telescope (HST) Paschen $\beta$ (Pa$\beta$) imaging with ground-based, previously published H$\alpha$ maps to estimate the attenuation affecting H$\alpha$, A(H$\alpha$), across the nearby, face-on galaxies NGC 5194 and NGC 6946. We estimate A(H$\alpha$) in ~ 2,000 independent 2" ~75 pc diameter apertures in each galaxy, spanning out to a galactocentric radius of almost 10 kpc. In both galaxies, A(H$\alpha$) drops with radius, with a bright, high attenuation inner region, though in detail the profiles differ between the two galaxies. Regions with the highest attenuation-corrected H$\alpha$ luminosity show the highest attenuation, but the observed H$\alpha$ luminosity of a region is not a good predictor of attenuation in our data. Consistent with much previous work, the IR-to-H$\alpha$ color does a good job of predicting A(H$\alpha$). We calculate the best-fit empirical coefficients for use combining H$\alpha$ with 8, 12, 24, 70, or 100 $\mu$m to correct for attenuation. These agree well with previous work but we also measure significant scatter around each of these linear relations. The local atomic plus molecular gas column density, N(H), also predicts A(H$\alpha$) well. We show that a screen with magnitude ~ 0.2 times the expected for a Milky Way gas-to-dust value does a reasonable job of explaining A(H$\alpha$) as a function of N(H). This could be expected if only ~ 40% of gas and dust directly overlap regions of H$\alpha$ emission.


title: Regularized Training and Tight Certification for Randomized Smoothed Classifier with Provable Robustness

abstract: Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded adversarial perturbations. However, how to train a good base classifier that is accurate and robust when smoothed has not been fully investigated. In this work, we derive a new regularized risk, in which the regularizer can adaptively encourage the accuracy and robustness of the smoothed counterpart when training the base classifier. It is computationally efficient and can be implemented in parallel with other empirical defense methods. We discuss how to implement it under both standard (non-adversarial) and adversarial training scheme. At the same time, we also design a new certification algorithm, which can leverage the regularization effect to provide tighter robustness lower bound that holds with high probability. Our extensive experimentation demonstrates the effectiveness of the proposed training and certification approaches on CIFAR-10 and ImageNet datasets.


title: Liouville-type theorems for unbounded solutions of elliptic equations in half-spaces

abstract: We prove that the Dirichlet problem for the Lane-Emden equation in a half-space has no positive solutions which grow at most like the distance to the boundary to a power given by the natural scaling exponent of the equation; in other words, we rule out {\it type~I grow-up} solutions. Such a nonexistence result was previously available only for bounded solutions, or under a restriction on the power in the nonlinearity. Instrumental in the proof are local pointwise bounds for the logarithmic gradient of the solution and its normal derivative, which we also establish.


title: Tournaments and the Strong Erd\H{o}s-Hajnal Property

abstract: A conjecture of Alon, Pach and Solymosi, which is equivalent to the celebrated Erd\H{o}s-Hajnal Conjecture, states that for every tournament $S$ there exists $\epsilon(S)>0$ such that if $T$ is an $n$-vertex tournament that does not contains $S$ as a subtournament, then $T$ contains a transitive subtournament on at least $n^{\epsilon(S)}$ vertices. Let $C_5$ be the unique five-vertex tournament where every vertex has two inneighbors and two outneighbors. The Alon-Pach-Solymosi conjecture is known to be true for the case when $S=C_5$. Here we prove a strengthening of this result, showing that in every tournament $T$ with no subtorunament isomorphic to $C_5$ there exist disjoint vertex subsets $A$ and $B$, each containing a linear proportion of the vertices of $T$, and such that every vertex of $A$ is adjacent to every vertex of $B$.


title: Integrating products of quadratic forms

abstract: We prove that if $q_1, \ldots, q_m: {\Bbb R}^n \longrightarrow {\Bbb R}$ are quadratic forms in variables $x_1, \ldots, x_n$ such that each $q_k$ depends on at most $r$ variables and each $q_k$ has common variables with at most $r$ other forms, then the average value of the product $\left(1+ q_1\right) \cdots \left(1+q_m\right)$ with respect to the standard Gaussian measure in ${\Bbb R}^n$ can be approximated within relative error $\epsilon >0$ in quasi-polynomial $n^{O(1)} m^{O(\ln m -\ln \epsilon)}$ time, provided $|q_k(x)| \leq \gamma \|x\|^2 /r$ for some absolute constant $\gamma > 0$ and $k=1, \ldots, m$. When $q_k$ are interpreted as pairwise squared distances for configurations of points in Euclidean space, the average can be interpreted as the partition function of systems of particles with mollified logarithmic potentials. We sketch a possible application to testing the feasibility of systems of real quadratic equations.


title: Legendre's Singular Modulus

abstract: We elaborate Legendre's original proof of his discovery of the first singular modulus in the history of mathematics, as well as its appearance in Ramanujan's formula for the arc length of an ellipse with said singular modulus as eccentricity, and its appearance in the three-body choreography of Bernoulli's lemniscate.


title: Significance of Black Hole Quasinormal Modes: A Closer Look

abstract: It is known that approximating the Regge-Wheeler Potential with step functions significantly modifies the Schwarzschild black hole quasinormal mode spectrum. Surprisingly, this change in the spectrum has little impact on the ringdown waveform. We examine whether this issue is caused by the jump discontinuities and/or the piecewise constant nature of step functions. We show that replacing the step functions with a continuous piecewise linear function does not qualitatively change the results. However, in contrast to previously published results, we discover that the ringdown waveform can be approximated to arbitrary precision using either step functions or a piecewise linear function. Thus, this approximation process provides a new mathematical tool to calculate the ringdown waveform. In addition, similar to normal modes, the quasinormal modes of the approximate potentials seem to form a complete set that describes the entire time evolution of the ringdown waveform. We also examine smoother approximations to the Regge-Wheeler potential, where the quasinormal modes can be computed exactly, to better understand how different portions of the potential impact various regions of the quasinormal mode spectrum.


title: Investigating Extensions to Random Walk Based Graph Embedding

abstract: Graph embedding has recently gained momentum in the research community, in particular after the introduction of random walk and neural network based approaches. However, most of the embedding approaches focus on representing the local neighborhood of nodes and fail to capture the global graph structure, i.e. to retain the relations to distant nodes. To counter that problem, we propose a novel extension to random walk based graph embedding, which removes a percentage of least frequent nodes from the walks at different levels. By this removal, we simulate farther distant nodes to reside in the close neighborhood of a node and hence explicitly represent their connection. Besides the common evaluation tasks for graph embeddings, such as node classification and link prediction, we evaluate and compare our approach against related methods on shortest path approximation. The results indicate, that extensions to random walk based methods (including our own) improve the predictive performance only slightly - if at all.


title: MuPix and ATLASPix -- Architectures and Results

abstract: High Voltage Monolithic Active Pixel Sensors (HV-MAPS) are based on a commercial High Voltage CMOS process and collect charge by drift inside a reversely biased diode. HV-MAPS represent a promising technology for future pixel tracking detectors. Two recent developments are presented. The MuPix has a continuous readout and is being developed for the Mu3e experiment whereas the ATLASPix is being developed for LHC applications with a triggered readout. Both variants have a fully monolithic design including state machines, clock circuitries and serial drivers. Several prototypes and design variants were characterised in the lab and in testbeam campaigns to measure efficiencies, noise, time resolution and radiation tolerance. Results from recent MuPix and ATLASPix prototypes are presented and prospects for future improvements are discussed.


title: Stationary properties of a Brownian gyrator with non-Markovian baths

abstract: We investigate the stochastic behavior of a two-temperature Langevin system with non-Markovian thermal reservoirs. The model describes an overdamped Brownian particle in a quadratic potential and coupled to heat baths at different temperatures. The reservoirs are characterized by Gaussian white and colored noises and a dissipation memory kernel. The stationary states present non-trivial average rotational motion influenced by stochastic torques due to harmonic, friction and fluctuating thermal forces. However, the Markovian limit leads to a vanishing average torque produced by fluctuating thermal forces. We also study the effects of memory on the stochastic heat and the entropy production in the steady-state regime.


title: Nonparametric Bayesian Deconvolution of a Symmetric Unimodal Density

abstract: We consider nonparametric measurement error density deconvolution subject to heteroscedastic measurement errors as well as symmetry about zero and shape constraints, in particular unimodality. The problem is motivated by applications where the observed data are estimated effect sizes from regressions on multiple factors, where the target is the distribution of the true effect sizes. We exploit the fact that any symmetric and unimodal density can be expressed as a mixture of symmetric uniform densities, and model the mixing density in a new way using a Dirichlet process location-mixture of Gamma distributions. We do the computations within a Bayesian context, describe a simple scalable implementation that is linear in the sample size, and show that the estimate of the unknown target density is consistent. Within our application context of regression effect sizes, the target density is likely to have a large probability near zero (the near null effects) coupled with a heavy-tailed distribution (the actual effects). Simulations show that unlike standard deconvolution methods, our Constrained Bayesian Deconvolution method does a much better job of reconstruction of the target density. Applications to a genome-wise association study (GWAS) and microarray data reveal similar results.


title: The upper density of an automatic set is rational

abstract: Given a natural number $k\ge 2$ and a $k$-automatic set $S$ of natural numbers, we show that the lower density and upper density of $S$ are recursively computable rational numbers and we provide an algorithm for computing these quantities. In addition, we show that for every natural number $k\ge 2$ and every pair of rational numbers $(\alpha,\beta)$ with $0<\alpha<\beta<1$ or with $(\alpha,\beta)\in \{(0,0),(1,1)\}$ there is a $k$-automatic subset of the natural numbers whose lower density and upper density are $\alpha$ and $\beta$ respectively, and we show that these are precisely the values that can occur as the lower and upper densities of an automatic set.


title: An Networked HIL Simulation System for Modeling Large-scale Power Systems

abstract: This paper presents a network hardware-in-the-loop (HIL) simulation system for modeling large-scale power systems. Researchers have developed many HIL test systems for power systems in recent years. Those test systems can model both microsecond-level dynamic responses of power electronic systems and millisecond-level transients of transmission and distribution grids. By integrating individual HIL test systems into a network of HIL test systems, we can create large-scale power grid digital twins with flexible structures at required modeling resolution that fits for a wide range of system operating conditions. This will not only significantly reduce the need for field tests when developing new technologies but also greatly shorten the model development cycle. In this paper, we present a networked OPAL-RT based HIL test system for developing transmission-distribution coordinative Volt-VAR regulation technologies as an example to illustrate system setups, communication requirements among different HIL simulation systems, and system connection mechanisms. Impacts of communication delays, information exchange cycles, and computing delays are illustrated. Simulation results show that the performance of a networked HIL test system is satisfactory.


title: Statistically Efficient, Polynomial Time Algorithms for Combinatorial Semi Bandits

abstract: We consider combinatorial semi-bandits over a set of arms ${\cal X} \subset \{0,1\}^d$ where rewards are uncorrelated across items. For this problem, the algorithm ESCB yields the smallest known regret bound $R(T) = {\cal O}\Big( {d (\ln m)^2 (\ln T) \over \Delta_{\min} }\Big)$, but it has computational complexity ${\cal O}(|{\cal X}|)$ which is typically exponential in $d$, and cannot be used in large dimensions. We propose the first algorithm which is both computationally and statistically efficient for this problem with regret $R(T) = {\cal O} \Big({d (\ln m)^2 (\ln T)\over \Delta_{\min} }\Big)$ and computational complexity ${\cal O}(T {\bf poly}(d))$. Our approach involves carefully designing an approximate version of ESCB with the same regret guarantees, showing that this approximate algorithm can be implemented in time ${\cal O}(T {\bf poly}(d))$ by repeatedly maximizing a linear function over ${\cal X}$ subject to a linear budget constraint, and showing how to solve this maximization problems efficiently.


title: Identifying Critical Neurons in ANN Architectures using Mixed Integer Programming

abstract: We introduce a mixed integer program (MIP) for assigning importance scores to each neuron in deep neural network architectures which is guided by the impact of their simultaneous pruning on the main learning task of the network. By carefully devising the objective function of the MIP, we drive the solver to minimize the number of critical neurons (i.e., with high importance score) that need to be kept for maintaining the overall accuracy of the trained neural network. Further, the proposed formulation generalizes the recently considered lottery ticket optimization by identifying multiple "lucky" sub-networks resulting in optimized architecture that not only performs well on a single dataset, but also generalizes across multiple ones upon retraining of network weights. Finally, we present a scalable implementation of our method by decoupling the importance scores across layers using auxiliary networks. We demonstrate the ability of our formulation to prune neural networks with marginal loss in accuracy and generalizability on popular datasets and architectures.


title: The not so simple stellar system Omega Cen. II. Evidence in support of a merging scenario

abstract: We present multi-band photometry covering $\sim$ 5\deg $\times$ 5\deg across $\omega$ Cen collected with the Dark Energy Camera, combined to Hubble Space Telescope and Wide Field Imager data for the central regions. The unprecedented photometric accuracy and field coverage allowed us to confirm the different spatial distribution of blue and red main-sequence stars, and of red-giant branch (RGB) stars with different metallicities. The ratio of the number of blue to red main-sequence stars shows that the blue main-sequence sub-population has a more extended spatial distribution compared to the red main-sequence one, and the frequency of blue main-sequence stars increases at a distance of $\sim$ 20 arcmin from $\omega$ Cen center. Similarly, the more metal-rich RGB stars show a more extended spatial distribution compared to the more metal-poor ones in the outskirts of the cluster. Moreover, the centers of the distributions of metal-rich and metal-poor RGB stars are shifted in different directions with respect to the geometrical center of $\omega$ Cen. We constructed stellar density profiles for the blue and red main-sequence stars; they confirm that the blue main-sequence sub-population has a more extended spatial distribution compared to the red main-sequence one in the outskirts of $\omega$ Cen, as found based on the star number ratio. We also computed the ellipticity profile of $\omega$ Cen, which has a maximum value of 0.16 at a distance of $\sim$ 8 arcmin from the center, and a minimum of 0.05 at $\sim$ 30 arcmin; the average ellipticity is $\sim0.10$. The circumstantial evidence presented in this work suggests a merging scenario for the formation of the peculiar stellar system $\omega$ Cen.


title: Estimating processes in adapted Wasserstein distance

abstract: A number of researchers have independently introduced topologies on the set of laws of stochastic processes that extend the usual weak topology. Depending on the respective scientific background this was motivated by applications and connections to various areas (e.g. Plug-Pichler - stochastic programming, Hellwig - game theory, Aldous - stability of optimal stopping, Hoover-Keisler - model theory). Remarkably, all these seemingly independent approaches define the same adapted weak topology in finite discrete time. Our first main result is to construct an adapted variant of the empirical measure that consistently estimates the laws of stochastic processes in full generality. A natural compatible metric for the weak adapted topology is the given by an adapted refinement of the Wasserstein distance, as established in the seminal works of Pflug-Pichler. Specifically, the adapted Wasserstein distance allows to control the error in stochastic optimization problems, pricing and hedging problems, optimal stopping problems, etc. in a Lipschitz fashion. The second main result of this article yields quantitative bounds for the convergence of the adapted empirical measure with respect to adapted Wasserstein distance. Surprisingly, we obtain virtually the same optimal rates and concentration results that are known for the classical empirical measure wrt. Wasserstein distance.


title: Denotational semantics as a foundation for cost recurrence extraction for functional languages

abstract: A standard informal method for analyzing the asymptotic complexity of a program is to extract a recurrence that describes its cost in terms of the size of its input, and then to compute a closed-form upper bound on that recurrence. We give a formal account of that method for functional programs in a higher-order language with let-polymorphism. The method consists of two phases. In the first phase, a monadic translation is performed to extract a cost-annotated version of the original program. In the second phase, the extracted program is interpreted in a model. The key feature of this second phase is that different models describe different notions of size. This plays out in several ways. For example, when analyzing functions that take arguments of inductive types, different notions of size may be appropriate depending on the analysis. When analyzing polymorphic functions, our approach shows that one can formally describe the notion of size of an argument in terms of the data that is common to the notions of size for each type instance of the domain type. We give several examples of different models that formally justify various informal cost analyses to show the applicability of our approach.


title: Reliable Photometric Membership (RPM) of Galaxies in Clusters. I. A Machine Learning Method and its Performance in the Local Universe

abstract: We introduce a new method to determine galaxy cluster membership based solely on photometric properties. We adopt a machine learning approach to recover a cluster membership probability from galaxy photometric parameters and finally derive a membership classification. After testing several machine learning techniques (such as Stochastic Gradient Boosting, Model Averaged Neural Network and k-Nearest Neighbors), we found the Support Vector Machine (SVM) algorithm to perform better when applied to our data. Our training and validation data are from the Sloan Digital Sky Survey (SDSS) main sample. Hence, to be complete to $M_r^* + 3$ we limit our work to 30 clusters with $z_{\text{phot-cl}} \le 0.045$. Masses ($M_{200}$) are larger than $\sim 0.6\times10^{14} M_{\odot}$ (most above $3\times10^{14} M_{\odot}$). Our results are derived taking in account all galaxies in the line of sight of each cluster, with no photometric redshift cuts or background corrections. Our method is non-parametric, making no assumptions on the number density or luminosity profiles of galaxies in clusters. Our approach delivers extremely accurate results (completeness, C $\sim 92\%$ and purity, P $\sim 87\%$) within R$_{200}$, so that we named our code {\bf RPM}. We discuss possible dependencies on magnitude, colour and cluster mass. Finally, we present some applications of our method, stressing its impact to galaxy evolution and cosmological studies based on future large scale surveys, such as eROSITA, EUCLID and LSST.


title: Combining SchNet and SHARC: The SchNarc machine learning approach for excited-state dynamics

abstract: In recent years, deep learning has become a part of our everyday life and is revolutionizing quantum chemistry as well. In this work, we show how deep learning can be used to advance the research field of photochemistry by learning all important properties for photodynamics simulations. The properties are multiple energies, forces, nonadiabatic couplings and spin-orbit couplings. The nonadiabatic couplings are learned in a phase-free manner as derivatives of a virtually constructed property by the deep learning model, which guarantees rotational covariance. Additionally, an approximation for nonadiabatic couplings is introduced, based on the potentials, their gradients and Hessians. As deep-learning method, we employ SchNet extended for multiple electronic states. In combination with the molecular dynamics program SHARC, our approach termed SchNarc is tested on a model system and two realistic polyatomic molecules and paves the way towards efficient photodynamics simulations of complex systems.


title: Ensemble Evolutionary Studies of White Dwarfs in Open Star Clusters

abstract: White dwarfs (WDs) in open star clusters are a highly useful ensemble of stars. While numerous researchers use open cluster WDs to study the initial-final mass relation, numerous other evolutionary studies are also enabled by this sample of stars, including searches for stochastic mass loss, studies of binary star evolution, and measurements of metallicity impacts on WD formation and evolution. However, it is crucial to use astrometric data such as proper motions to remove contaminating field WDs from open cluster samples; multi-epoch ground based imaging is needed for most open cluster WDs. Also, the strongly correlated errors in the initial mass - final mass plane must be considered; we illustrate the importance of this consideration using a large open cluster WD sample and Monte Carlo techniques.


title: Predicting new superconductors and their critical temperatures using unsupervised machine learning

abstract: We used the superconductors in the SuperCon database to construct element vectors and then perform unsupervised learning of their critical temperatures (T$_c$). Only the chemical composition of superconductors was used in this procedure. No physical predictors (neither experimental nor computational) of any kind were used. We achieved the coefficient of determination R$^2$$\simeq$0.93, which is comparable and in some cases higher then similar estimates using other artificial intelligence techniques. Based on this machine learning model, we predicted several new superconductors with high critical temperatures. We also discuss the factors that limit the learning process and suggest possible ways to overcome them.


title: Spectral dominance of complex roots for single-delay linear equations

abstract: This paper provides necessary and sufficient conditions for the existence of a pair of complex conjugate roots, each of multiplicity two, in the spectrum of a linear time-invariant single-delay equation of retarded type. This pair of roots is also shown to be always strictly dominant, determining thus the asymptotic behavior of the system. The proof of this result is based on the corresponding result for real roots of multiplicity four, continuous dependence of roots with respect to parameters, and the study of crossing imaginary roots. We also present how this design can be applied to vibration suppression and flexible mode compensation.


title: P2C2: Peer-to-Peer Car Charging

abstract: With the rising concerns of fossil fuel depletion and the impact of Internal Combustion Engine(ICE) vehicles on our climate, the transportation industry is observing a rapid proliferation of electric vehicles (EVs). However, long-distance travel withEV is not possible yet without making multiple halt at EV charging stations. Many remote regions do not have charging stations, and even if they are present, it can take several hours to recharge the battery. Conversely, ICE vehicle fueling stations are much more prevalent, and re-fueling takes a couple of minutes. These facts have deterred many from moving to EVs. Existing solutions to these problems, such as building more charging stations, increasing battery capacity, and road-charging have not been proven efficient so far. In this paper, we propose Peer-to-Peer Car Charging (P2C2), a highly scalable novel technique for charging EVs on the go with minimal cost overhead. We allow EVs to share charge among each others based on the instructions from a cloud-based control system. The control system assigns and guides EVs for charge sharing. We also introduce mobile Charging Stations (MoCS), which are high battery capacity vehicles that are used to replenish the overall charge in the vehicle networks. We have implemented P2C2 and integrated it with the traffic simulator, SUMO. We observe promising results with up to 65% reduction in the number of EV halts with up to 24.4% reduction in required battery capacity without any extra halts.


title: 3D Gated Recurrent Fusion for Semantic Scene Completion

abstract: This paper tackles the problem of data fusion in the semantic scene completion (SSC) task, which can simultaneously deal with semantic labeling and scene completion. RGB images contain texture details of the object(s) which are vital for semantic scene understanding. Meanwhile, depth images capture geometric clues of high relevance for shape completion. Using both RGB and depth images can further boost the accuracy of SSC over employing one modality in isolation. We propose a 3D gated recurrent fusion network (GRFNet), which learns to adaptively select and fuse the relevant information from depth and RGB by making use of the gate and memory modules. Based on the single-stage fusion, we further propose a multi-stage fusion strategy, which could model the correlations among different stages within the network. Extensive experiments on two benchmark datasets demonstrate the superior performance and the effectiveness of the proposed GRFNet for data fusion in SSC. Code will be made available.


title: Thou Shalt Not Reject the P-value

abstract: Since its debut in the 18th century, the P-value has been an important part of hypothesis testing-based scientific discoveries. As the statistical engine accelerates, questions are beginning to be raised, asking to what extent scientific discoveries based on P-values are reliable and reproducible, and the voice calling for adjusting the significance level or banning the P-value has been increasingly heard. Inspired by these questions and discussions, here we enquire into the useful roles and misuses of the P-value in scientific studies. For common misuses and misinterpretations, we provide modest recommendations for practitioners. Additionally, we compare statistical significance with clinical relevance. In parallel, we review the Bayesian alternatives for seeking evidence. Finally, we discuss the promises and risks of using meta-analysis to pool P-values from multiple studies to aggregate evidence. Taken together, the P-value underpins a useful probabilistic decision-making system and provides evidence at a continuous scale. But its interpretation must be contextual, considering the scientific question, experimental design (including the model specification, sample size, and significance level), statistical power, effect size, and reproducibility.


title: Information Theory as a Means of Determining the Main Factors Affecting the Processors Architecture

abstract: In this article we are investigating the computers development process in the past decades in order to identify the factors that influence it the most. We describe such factors and use them to predict the direction of further development. To solve these problems, we use the concept of the Computer Capacity, which allows us to estimate the performance of computers theoretically, relying only on the description of its architecture.


title: Revisit to the $b\to c\tau\nu$ transition: in and beyond the SM

abstract: We perform an analysis of the $b\to c\tau\nu$ data, including $R(D^{(*)})$, $R(J/\psi)$, $P_\tau(D^{*})$ and $F_L^{D^*}$, within and beyond the Standard Model (SM). We fit the $B\to D^{(*)}$ hadronic form factors in the HQET parametrization to the lattice and the light-cone sum rule (LCSR) results, applying the general strong unitarity bounds corresponding to $J^P=1^-$, $1^+$, $0^-$ and $0^+$. Using the obtained HQET relations between helicity amplitudes, we give the strong unitarity bounds on individual helicity amplitudes, which can be used in the BGL fits. Using the fitted form factors and taking into account the most recent Belle measurement of $R(D^{(*)})$ we investigate the model-independent and the leptoquark model explanations of the $b\to c\tau\nu$ anomalies. Specifically, we consider the one-operator, the two-operator new physics (NP) scenarios and the NP models with a single $R_2$, $S_1$ or $U_1$ leptoquark which is supposed to be able to address the $b\to c\tau\nu$ anomalies, and our results show that the $R_2$ leptoquark model is in tension with the limit $\mathcal B(B_c\to \tau\nu)<10\%$. Furthermore, we give predictions for the various observables in the SM and the NP scenarios/leptoquark models based on the present form factor study and the analysis of NP.


title: Thermal energy harvesting using pyroelectric-electrochemical coupling in ferroelectric materials

abstract: Recently, the coupling of ferroelectrics with electrochemical reactions has attracted increasing interest for harvesting waste heat. The change of polarisation of a ferroelectric with temperature can be used to influence chemical reactions, especially when the material is cycled near its Curie temperature. In this perspective, we introduce the principle of pyroelectric controlled electrochemical processes by harvesting waste heat energy and explore their potential electrochemical applications, such as water treatment, air purificiation and hydrogen generation. As an emerging approach for driving electrochemical reactions, the presence of thermal fluctuations and/or transient waste heat in the environment has the potential to be the primary thermal input for driving the change in polarisation of a pyroelectric to release charge for such reactions. There are a number of avenues to explore and we summarize strategies for forming multi-functional or hybrid materials and future directions such as selecting pyroelectrics with low Curie temperature (< 100 {\deg}C), improved heat conductivity, enhanced surface area or porosity, tailored microstructures and systems capable of operating over a broader temperature range.


title: Playing Against Opponents With Limited Memory

abstract: We study \emph{partial-information} two-player turn-based games on graphs with omega-regular objectives, when the partial-information player has \emph{limited memory}. Such games are a natural formalization for reactive synthesis when the environment player is not genuinely adversarial to the system player. The environment player has goals of its own, but the exact goal of the environment player is unknown to the system player. We prove that the problem of determining the existence of a winning strategy for the system player is PSPACE-hard for reachability, safety, and parity objectives. Moreover, when the environment player is memoryless, the problem is PSPACE-complete. However, it is simpler to decide if the environment player has a winning strategy; it is only NP-complete. Additionally, we construct a game where the the partial-information player needs at least $\mathcal{O}(\sqrt{n})$ bits of memory to retain winning strategies in a game of size $\mathcal{O}(n)$.


title: Zeta functions of edge-free quotients of graphs

abstract: We consider the Ihara zeta function $\zeta(u,X//G)$ and Artin-Ihara $L$-function of the quotient graph of groups $X//G$, where $G$ is a group acting on a finite graph $X$ with trivial edge stabilizers. We determine the relationship between the primes of $X$ and $X//G$ and show that $X\to X//G$ can be naturally viewed as an unramified Galois covering of graphs of groups. We show that the $L$-function of $X//G$ evaluated at the regular representation is equal to $\zeta(u,X)$ and that $\zeta(u,X//G)$ divides $\zeta(u,X)$. We derive two-term and three-term determinant formulas for the zeta and $L$-functions, and compute several examples of $L$-functions of edge-free quotients of the tetrahedron graph $K_4$.


title: Index one minimal surfaces in positively curved $3$-manifolds

abstract: We construct a Riemannian metric of positive sectional curvature on the $3$-dimensional projective space with a two-sided closed embedded minimal surface of genus $3$, index $1$ and nullity $0$.


title: 5G Simulation-Based Experimentation Framework for Vertical Performance Assessment

abstract: 5G is being designed as a common platform where multiple vertical applications will be able to co-exist and grow in a seamless manner. The diversity of the vertical requirements as well as the particular features of the 5G network itself, make it a real challenge to be able to assess or predict applications performance for those verticals. In this paper we motivate the fact that because of the very nature of verticals and 5G infrastructure, measurements alone will not be sufficient for application performance monitoring and prediction. We then propose a comprehensive framework to integrate those measurements in a simulation setting, presenting the key features and current roadblocks for an end-to-end wide-spread implementation.


title: On Succinctness and Recognisability of Alternating Good-for-Games Automata

abstract: We study alternating good-for-games (GFG) automata, i.e., alternating automata where both conjunctive and disjunctive choices can be resolved in an online manner, without knowledge of the suffix of the input word still to be read. We show that they can be exponentially more succinct than both their nondeterministic and universal counterparts. Furthermore, we lift many results from nondeterministic parity GFG automata to alternating ones: a single exponential determinisation procedure, an Exptime upper bound to the GFGness problem, a PTime algorithm for the GFGness problem of weak automata, and a reduction from a positive solution to the $G_2$ conjecture to a PTime algorithm for the GFGness problem of parity automata with a fixed index. The $G_2$ conjecture states that a nondeterministic parity automaton A is GFG if and only if a token game, known as the $G_2$ game, played on A is won by the first player. So far, it had only been proved for B\"uchi automata; we provide further evidence for it by proving it for coB\"uchi automata. We also study the complexity of deciding "half-GFGness", a property specific to alternating automata that only requires nondeterministic choices to be resolved in an online manner. We show that this problem is strictly more difficult than GFGness check, already for alternating automata on finite words.


title: Formal Methods: From Academia to Industrial Practice. A Travel Guide

abstract: For many decades, formal methods are considered to be the way forward to help the software industry to make more reliable and trustworthy software. However, despite this strong belief and many individual success stories, no real change in industrial software development seems to be occurring. In fact, the software industry itself is moving forward rapidly, and the gap between what formal methods can achieve and the daily software-development practice does not appear to be getting smaller (and might even be growing). In the past, many recommendations have already been made on how to develop formal-methods research in order to close this gap. This paper investigates why the gap nevertheless still exists and provides its own recommendations on what can be done by the formal-methods-research community to bridge it. Our recommendations do not focus on open research questions. In fact, formal-methods tools and techniques are already of high quality and can address many non-trivial problems; we do give some technical recommendations on how tools and techniques can be made more accessible. To a greater extent, we focus on the human aspect: how to achieve impact, how to change the way of thinking of the various stakeholders about this issue, and in particular, as a research community, how to alter our behaviour, and instead of competing, collaborate to address this issue.


title: A covariant model for the decuplet to octet Dalitz decays

abstract: In the last years it became possible to measure in HADES the dilepton decays of several baryons. The baryon dilepton decays provide information about the electromagnetic structure of the baryons in the timelike region. In the present work, we study the $B^\prime \to e^+ e^- B$ decays, where $B^\prime$ is a baryon decuplet member and $B$ is a baryon octet member. Our calculations are based on the covariant spectator quark model, where the contribution of the quark core is complemented with an $SU(3)$ contribution from the pion cloud. The pion cloud contribution prove to be relevant in the range of study. We present predictions for the $\Sigma^0 (1385) \to e^+ e^- \Lambda(1116)$ and $\Sigma^{+}(1385) \to e^+ e^- \Sigma^+(1193)$ decays, which may be tested at HADES in a near future. Predictions for the remaining decuplet baryon Dalitz decays are also presented. We conclude that different orders of magnitudes are expected for the baryon decuplet Dalitz decay widths, according to the quark content of the baryons. We also conclude that the dependence of the transition form factors on the square momentum transfer ($q^2$) is important for some transitions.


title: Deep Fourier Kernel for Self-Attentive Point Processes

abstract: We present a novel attention-based model for discrete event data to capture complex non-linear temporal dependence structures. We borrow the idea from the attention mechanism and incorporate it into the point processes' conditional intensity function. We further introduce a novel score function using Fourier kernel embedding, whose spectrum is represented using neural networks, which drastically differs from the traditional dot-product kernel and can capture a more complex similarity structure. We establish our approach's theoretical properties and demonstrate our approach's competitive performance compared to the state-of-the-art for synthetic and real data.


title: Langevin DQN

abstract: Algorithms that tackle deep exploration -- an important challenge in reinforcement learning -- have relied on epistemic uncertainty representation through ensembles or other hypermodels, exploration bonuses, or visitation count distributions. An open question is whether deep exploration can be achieved by an incremental reinforcement learning algorithm that tracks a single point estimate, without additional complexity required to account for epistemic uncertainty. We answer this question in the affirmative. In particular, we develop Langevin DQN, a variation of DQN that differs only in perturbing parameter updates with Gaussian noise and demonstrate through a computational study that the presented algorithm achieves deep exploration. We also offer some intuition to how Langevin DQN achieves deep exploration. In addition, we present a modification of the Langevin DQN algorithm to improve the computational efficiency.


title: Variable Accretion onto Protoplanet Host Star PDS 70

abstract: The PDS 70 system has been subject to many studies in the past year following the discovery of two accreting planets in the gap of its circumstellar disk. Nevertheless, the mass accretion rate onto the star is still not well known. Here we determined the stellar mass accretion rate and its variability based on TESS and HARPS observations. The stellar light curve shows a strong signal with a $3.03\pm0.06$ days period, which we attribute to stellar rotation. Our analysis of the HARPS spectra shows a rotational velocity of $v\sin\,i=16.0\pm0.5\,{\rm km\,s^{-1}}$, indicating that the inclination of the rotation axis is $50\pm8$ degrees. This implies that the rotation axes of the star and its circumstellar disk are parallel within the measurement error. We apply magnetospheric accretion models to fit the profiles of the H$\alpha$ line and derive mass accretion rates onto the star in the range of $0.6-2.2\times10^{-10}\,{\rm M_{\odot}yr^{-1}}$, varying over the rotation phase. The measured accretion rates are in agreement with those estimated from NUV fluxes using accretion shock models. The derived accretion rates are higher than expected from the disk mass and planets properties for the low values of the viscous parameter $\alpha$ suggested by recent studies, potentially pointing to an additional mass reservoir in the inner disk to feed the accretion, such as a dead zone. We find that the He I $\lambda$10830 line shows a blueshifted absorption feature, indicative of a wind. The mass-loss rate estimated from the line depth is consistent with an accretion-driven inner disk MHD wind.


title: Sharp Asymptotics and Optimal Performance for Inference in Binary Models

abstract: We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features. Importantly, the predictions hold for a wide class of convex loss functions, which we exploit in order to prove a bound on the best achievable performance among them. Notably, we show that the proposed bound is tight for popular binary models (such as Signed, Logistic or Probit), by constructing appropriate loss functions that achieve it. More interestingly, for binary linear classification under the Logistic and Probit models, we prove that the performance of least-squares is no worse than 0.997 and 0.98 times the optimal one. Numerical simulations corroborate our theoretical findings and suggest they are accurate even for relatively small problem dimensions.

categories: math.ST cs.IT eess.SP math.IT stat.ML stat.TH


title: Double/Debiased Machine Learning for Dynamic Treatment Effects via g-Estimation

abstract: We consider the estimation of treatment effects in settings when multiple treatments are assigned over time and treatments can have a causal effect on future outcomes or the state of the treated unit. We propose an extension of the double/debiased machine learning framework to estimate the dynamic effects of treatments, which can be viewed as a Neyman orthogonal (locally robust) cross-fitted version of $g$-estimation in the dynamic treatment regime. Our method applies to a general class of non-linear dynamic treatment models known as Structural Nested Mean Models and allows the use of machine learning methods to control for potentially high dimensional state variables, subject to a mean square error guarantee, while still allowing parametric estimation and construction of confidence intervals for the structural parameters of interest. These structural parameters can be used for off-policy evaluation of any target dynamic policy at parametric rates, subject to semi-parametric restrictions on the data generating process. Our work is based on a recursive peeling process, typical in $g$-estimation, and formulates a strongly convex objective at each stage, which allows us to extend the $g$-estimation framework in multiple directions: i) to provide finite sample guarantees, ii) to estimate non-linear effect heterogeneity with respect to fixed unit characteristics, within arbitrary function spaces, enabling a dynamic analogue of the RLearner algorithm for heterogeneous effects, iii) to allow for high-dimensional sparse parameterizations of the target structural functions, enabling automated model selection via a recursive lasso algorithm. We also provide guarantees for data stemming from a single treated unit over a long horizon and under stationarity conditions.


title: Inhomogeneities in chainable continua

abstract: We study a class of chainable continua which contains, among others, all inverse limit spaces generated by a single interval bonding map which is piecewise monotone and locally eventually onto. Such spaces are realized as attractors of non-hyperbolic surface homeomorphisms. Using dynamical properties of the bonding map, we give conditions for existence of endpoints, characterize the set of local inhomogeneities, and determine when it consists only of endpoints. As a side product we also obtain a characterization of arcs as inverse limits for piecewise monotone bonding maps, which is interesting in its own right.


title: Sorting and Ranking of Self-Delimiting Numbers with Applications to Outerplanar Graph Isomorphism

abstract: Assume that an $N$-bit sequence $S$ of $k$ numbers encoded as Elias gamma codes is given as input. We present space-efficient algorithms for sorting, dense ranking and competitive ranking on $S$ in the word RAM model with word size $\Omega(\log N)$ bits. Our algorithms run in $O(k + \frac{N}{\log N})$ time and use $O(N)$ bits. The sorting algorithm returns the given numbers in sorted order, stored within a bit-vector of $N$ bits, whereas our ranking algorithms construct data structures that allow us subsequently to return the dense/competitive rank of each number $x$ in $S$ in constant time. For numbers $x \in \mathbb{N}$ with $x > N$ we require the position $p_x$ of $x$ as the input for our dense-/competitive-rank data structure. As an application of our algorithms above we give an algorithm for tree isomorphism, which runs in $O(n)$ time and uses $O(n)$ bits on $n$-node trees. Finally, we generalize our result for tree isomorphism to forests and outerplanar graphs, while maintaining a space-usage of $O(n)$ bits. The previous best linear-time algorithms for trees, forests and outerplanar graph isomorphism all use $\Theta(n \log n)$ bits.


title: Complex symmetry of composition operators on weighted Bergman spaces

abstract: In this article, we study the complex symmetry of compositions operators $C_{\phi}f=f\circ \phi$ induced on weighted Bergman spaces $A^2_{\beta}(\mathbb{D}),\ \beta\geq -1,$ by analytic self-maps of the unit disk. One of ours main results shows that $\phi$ has a fixed point in $\mathbb{D}$ whenever $C_{\phi}$ is complex symmetric. Our works establishes a strong relation between complex symmetry and cyclicity. By assuming $\beta\in \mathbb{N}$ and $\phi$ is an elliptic automorphism of $\mathbb{D}$ which not a rotation, we show that $C_{\phi}$ is not complex symmetric whenever $\phi$ has order greater than $2(3+\beta).$


title: A Depth-Aware Swap Insertion Scheme for the Qubit Mapping Problem

abstract: The rapid progress of physical implementation of quantum computers paved the way of realising the design of tools to help users write quantum programs for any given quantum devices. The physical constraints inherent to the current NISQ architectures prevent most quantum algorithms from being directly executed on quantum devices. To enable two-qubit gates in the algorithm, existing works focus on inserting SWAP gates to dynamically remap logical qubits to physical qubits. However, their schemes lack the consideration of the depth of generated quantum circuits. In this work, we propose a depth-aware SWAP insertion scheme for qubit mapping problem in the NISQ era.


title: Stochastic Gauss-Newton Algorithms for Nonconvex Compositional Optimization

abstract: We develop two new stochastic Gauss-Newton algorithms for solving a class of non-convex stochastic compositional optimization problems frequently arising in practice. We consider both the expectation and finite-sum settings under standard assumptions, and use both classical stochastic and SARAH estimators for approximating function values and Jacobians. In the expectation case, we establish $\mathcal{O}(\varepsilon^{-2})$ iteration-complexity to achieve a stationary point in expectation and estimate the total number of stochastic oracle calls for both function value and its Jacobian, where $\varepsilon$ is a desired accuracy. In the finite sum case, we also estimate $\mathcal{O}(\varepsilon^{-2})$ iteration-complexity and the total oracle calls with high probability. To our best knowledge, this is the first time such global stochastic oracle complexity is established for stochastic Gauss-Newton methods. Finally, we illustrate our theoretical results via two numerical examples on both synthetic and real datasets.


title: A relative trace formula for obstacle scattering

abstract: We consider the case of scattering of several obstacles in $\mathbb{R}^d$ for $d \geq 2$. In this setting the absolutely continuous part of the Laplace operator $\Delta$ with Dirichlet boundary conditions and the free Laplace operator $\Delta_0$ are unitarily equivalent. For suitable functions that decay sufficiently fast we have that the difference $g(\Delta)-g(\Delta_0)$ is a trace-class operator and its trace is described by the Krein spectral shift function. In this paper we study the contribution to the trace (and hence the Krein spectral shift function) that arises from assembling several obstacles relative to a setting where the obstacles are completely separated. In the case of two obstacles we consider the Laplace operators $\Delta_1$ and $\Delta_2$ obtained by imposing Dirichlet boundary conditions only on one of the objects. Our main result in this case states that then $g(\Delta) - g(\Delta_1) - g(\Delta_2) + g(\Delta_0)$ is a trace class operator for a much larger class of functions (including functions of polynomial growth) and that this trace may still be computed by a modification of the Birman-Krein formula. In case $g(x)=x^\frac{1}{2}$ the relative trace has a physical meaning as the vacuum energy of the massless scalar field and is expressible as an integral involving boundary layer operators. Such integrals have been derived in the physics literature using non-rigorous path integral derivations and our formula provides both a rigorous justification as well as a generalisation.


title: Non-Equilibrium Interaction Between Catalytic Colloids: Boundary Conditions and Penetration Depth

abstract: Spherical colloids that catalyze the interconversion reaction $A \leftrightharpoons B$ between solute molecules $A$ and $B$ whose concentration at infinity is maintained away from equilibrium effectively interact due to the non-uniform fields of solute concentrations. We show that this long range $1/r$ interaction is suppressed via a mechanism that is superficially reminiscent but qualitatively very different from electrostatic screening: catalytic activity drives the concentrations of solute molecules towards their equilibrium values and reduces the chemical imbalance that drives the interaction between the colloids. The imposed non-equilibrium boundary conditions give rise to a variety of geometry-dependent scenarios; while long-range interactions are suppressed (except for a finite penetration depth) in the bulk of the colloid solution in 3D, they can persist in quasi-2D geometry in which the colloids but not the solutes are confined to a surface, resulting in the formation of clusters or Wigner crystals, depending on the sign of the interaction between colloids.


title: Improving Tracking through Human-Robot Sensory Augmentation

abstract: This paper introduces human-robot sensory augmentation and illustrates it on a tracking task, where performance can be improved by the exchange of sensory information between the robot and its human user. It was recently found that during interaction between humans, the partners use each other's sensory information to improve their own sensing, thus also their performance and learning. In this paper, we develop a computational model of this unique human ability, and use it to build a novel control framework for human-robot interaction. The human partner's control is formulated as a feedback control with unknown control gains and desired trajectory. A Kalman filter is used to estimate first the control gains and then the desired trajectory. The estimated human partner's desired trajectory is used as augmented sensory information about the system and combined with the robot's measurement to estimate an uncertain target trajectory. Simulations and an implementation of the presented framework on a robotic interface validate the proposed observer-predictor pair for a tracking task. The results obtained using this robot demonstrate how the human user's control can be identified, and exhibit similar benefits of this sensory augmentation as was observed between interacting humans.


title: Shear induced ordering in systems with competing interactions: A machine learning study

abstract: When short-range attractions are combined with long-range repulsions in colloidal particle systems, complex microphases can emerge. Here, we study a system of isotropic particles which can form lamellar structures or a disordered fluid phase when temperature is varied. We show that at equilibrium the lamellar structure crystallizes, while out of equilibrium the system forms a variety of structures at different shear rates and temperatures above melting. The shear-induced ordering is analyzed by means of principal component analysis and artificial neural networks, which are applied to data of reduced dimensionality. Our results reveal the possibility of inducing ordering by shear, potentially providing a feasible route to the fabrication of ordered lamellar structures from isotropic particles.


title: Planar minimal surfaces with polynomial growth in the $\mathrm{Sp}(4, \mathbb{R})$-symmetric space

abstract: We study the asymptotic geometry of a family of conformally planar minimal surfaces with polynomial growth in the $\mathrm{Sp}(4,\mathbb{R})$-symmetric space. We describe a homeomomorphism between the "Hitchin component" of wild $\mathrm{Sp}(4,\mathbb{R})$-Higgs bundles over $\mathbb{CP}^1$ with a single pole at infinity and a component of maximal surfaces with light-like polygonal boundary in $\mathbb{H}^{2,2}$. Moreover, we identify those surfaces with convex embeddings into the Grassmannian of symplectic planes of $\mathbb{R}^{4}$. We show, in addition, that our planar maximal surfaces are the local limits of equivariant maximal surfaces in $\mathbb{H}^{2,2}$ associated to $\mathrm{Sp}(4,\mathbb{R})$-Hitchin representations along rays of holomorphic quartic differentials.


title: RKHS Embedding for Estimating Nonlinear Piezoelectric Systems

abstract: Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from the first principles of all the sources of nonlinearity in a system. As a specific example, in traditional modeling techniques that use electric enthalpy density with higher-order terms, it can be problematic to choose which polynomial nonlinearities are essential. This paper introduces adaptive estimator techniques to estimate the nonlinearities that can arise in certain piezoelectric systems. Here an underlying assumption is that the nonlinearities can be modeled as functions in a reproducing kernel Hilbert space (RKHS). Unlike traditional modeling approaches, the approach discussed in this paper allows the development of models without knowledge of the precise form or structure of the nonlinearity. This approach can be viewed as a data-driven method to approximate the unknown nonlinear system. This paper introduces the theory behind the adaptive estimator and studies the effectiveness of this approach numerically for a class of nonlinear piezoelectric composite beams.


title: Estimating the number and effect sizes of non-null hypotheses

abstract: We study the problem of estimating the distribution of effect sizes (the mean of the test statistic under the alternate hypothesis) in a multiple testing setting. Knowing this distribution allows us to calculate the power (type II error) of any experimental design. We show that it is possible to estimate this distribution using an inexpensive pilot experiment, which takes significantly fewer samples than would be required by an experiment that identified the discoveries. Our estimator can be used to guarantee the number of discoveries that will be made using a given experimental design in a future experiment. We prove that this simple and computationally efficient estimator enjoys a number of favorable theoretical properties, and demonstrate its effectiveness on data from a gene knockout experiment on influenza inhibition in Drosophila.


title: Weyl-Kondo Semimetal: Towards Control of Weyl Nodes

abstract: Heavy fermion semimetals represent a promising setting to explore topological metals driven by strong correlations. In this paper, we i) summarize the theoretical results in a Weyl-Kondo semimetal phase for a strongly correlated model with inversion-symmetry-breaking and time-reversal invariance, and the concurrent work that has experimentally discovered this phase in the non-magnetic non-centrosymmetric heavy fermion system Ce$_3$Bi$_4$Pd$_3$; and ii) describe what is expected theoretically when the time-reversal symmetry is also broken.


title: Structure theorems above a strongly compact cardinal

abstract: While many inner model theoretic combinatorial principles are incompatible with large cardinal axioms, on some rare occasions, large cardinals actually imply that the structure of the universe of sets is analogous to the canonical inner models. This note provides two new instances of this phenomenon.


title: A steep-slope MoS2-nanoribbon MOSFET based on an intrinsic cold-contact effect

abstract: We propose a steep-slope MoS2-nanoribbon field-effect transistor that exploits a narrow-energy conduction band to intrinsically filter out the thermionic tail of the electron energy distribution. We study the device operation principle and the performance dependence on the design parameters through atomistic self-consistent quantum simulations. Our results indicate that the device can provide high ION/IOFF ratios, compatible with electronic applications, albeit biased at ultralow voltages of around 0.1 V.


title: Laser-Induced Transient Magnons in Sr3Ir2O7 Throughout the Brillouin Zone

abstract: Although ultrafast manipulation of magnetism holds great promise for new physical phenomena and applications, targeting specific states is held back by our limited understanding of how magnetic correlations evolve on ultrafast timescales. Using ultrafast resonant inelastic x-ray scattering we demonstrate that femtosecond laser pulses can excite transient magnons at large wavevectors in gapped antiferromagnets, and that they persist for several picoseconds which is opposite to what is observed in nearly gapless magnets. Our work suggests that materials with isotropic magnetic interactions are preferred to achieve rapid manipulation of magnetism.


title: Covariant Mass and Geometrical setup in Euclidean gauge theories

abstract: A nonlocal mass operator can be consistently set in local form through the introduction of a set of additional fields with geometrical appropriated properties. A local and polynomial gauge invariant action is thus identified. Equations compatible with the study of renormalization, from the algebraic point of view, are presented in the Landau Gauge.


title: Constructive expressive power of population protocols

abstract: Population protocols are a model of distributed computation intended for the study of networks of independent computing agents with dynamic communication structure. Each agent has a finite number of states, and communication opportunities occur nondeterministically, allowing the agents involved to change their states based on each other's states. Population protocols are often studied in terms of reaching a consensus on whether the input configuration satisfied some predicate. In the present paper we propose an alternative point of view. Instead of studying the properties of inputs that a protocol can recognise, we study the properties of outputs that a protocol eventually ensures. We define constructive expressive power. We show that for general population protocols and immediate observation population protocols the constructive expressive power coincides with the normal expressive power. Immediate observation protocols also preserve their relatively low verification complexity in the constructive expressive power setting.


title: High Cadence Optical Transient Searches using Drift Scan Imaging I: Proof of Concept with a Pre-Prototype System

abstract: An imaging technique with sensitivity to short duration optical transients is described. The technique is based on the use of wide-field cameras operating in a drift scanning mode, whereby persistent objects produce trails on the sensor and short duration transients occupy localised groups of pixels. A benefit of the technique is that sensitivity to short duration signals is not accompanied by massive data rates, because the exposure time >> transient duration. The technique is demonstrated using a pre-prototype system composed of readily available and inexpensive commercial components, coupled with common coding environments, commercially available software, and free web-based services. The performance of the technique and the pre-prototype system is explored, including aspects of photometric and astrometric calibration, detection sensitivity, characterisation of candidate transients, and the differentiation of astronomical signals from non-astronomical signals (primarily glints from satellites in Earth orbit and cosmic ray hits on sensor pixels). Test observations were made using the pre-prototype system, achieving sensitivity to transients with 21 ms duration, resulting in the detection of five candidate transients. An investigation of these candidates concludes they are most likely due to cosmic ray hits on the sensor and/or satellites. The sensitivity obtained with the pre-prototype system is such that, under some models for the optical emission from FRBs, the detection of a typical FRB, such as FRB181228, to a distance of approximately 100 Mpc is plausible. Several options for improving the system/technique in the future are described.


title: Key rates for quantum key distribution protocols with asymmetric noise

abstract: We consider the asymptotic key rates achieved in the simplest quantum key distribution protocols, namely the BB84 and the six-state protocols, when non-uniform noise is present in the system. We first observe that higher qubit error rates do not necessarily imply lower key rates. Secondly, we consider protocols with advantage distillation and show that it can be advantageous to use the basis with higher quantum bit error rate for the key generation. We then discuss the relation between advantage distillation and entanglement distillation protocols. We show that applying advantage distillation to a string of bits formed by the outcomes of measurements in the basis with higher quantum bit error rate is closely connected to the two-to-one entanglement distillation protocol DEJMPS. Finally, we discuss the implications of these results for implementations of quantum key distribution.


title: From English To Foreign Languages: Transferring Pre-trained Language Models

abstract: Pre-trained models have demonstrated their effectiveness in many downstream natural language processing (NLP) tasks. The availability of multilingual pre-trained models enables zero-shot transfer of NLP tasks from high resource languages to low resource ones. However, recent research in improving pre-trained models focuses heavily on English. While it is possible to train the latest neural architectures for other languages from scratch, it is undesirable due to the required amount of compute. In this work, we tackle the problem of transferring an existing pre-trained model from English to other languages under a limited computational budget. With a single GPU, our approach can obtain a foreign BERT base model within a day and a foreign BERT large within two days. Furthermore, evaluating our models on six languages, we demonstrate that our models are better than multilingual BERT on two zero-shot tasks: natural language inference and dependency parsing.


title: Species Population Dynamics with Competition and Random Events

abstract: Population dynamics of a competitive two-species system under the influence of random events are analyzed and expressions for the steady-state population mean, fluctuations, and cross-correlation of the two species are presented. It is shown that random events cause the population mean of each specie to make smooth transition from far above to far below of its growth rate threshold. At the same time, the population mean of the weaker specie never reaches the extinction point. It is also shown that, as a result of competition, the relative population fluctuations do not die out as the growth rates of both species are raised far above their respective thresholds. This behavior is most remarkable at the maximum competition point where the weaker specie's population statistics becomes completely chaotic regardless of how far its growth rate in raised.


title: Parity non-conservation in a condensed matter system

abstract: The nuclear spin of a He$^3$ quasiparticle dissolved in superfluid He$^4$ sees an apparent magnetic field proportional to the Fermi coupling constant, the superfluid condensate density, and the electron current at the He$^3$ nucleus. Whereas the direction of the current must be parallel to the quasiparticle momentum, calculating its magnitude presents an interesting theoretical challenge because it vanishes in the Born-Oppenheimer approximation. We find the effect is too small to be observed and present our results in the hope others will be inspired to look for similar effects in other systems.


title: Discovering ePassport Vulnerabilities using Bisimilarity

abstract: We uncover privacy vulnerabilities in the ICAO 9303 standard implemented by ePassports worldwide. These vulnerabilities, confirmed by ICAO, enable an ePassport holder who recently passed through a checkpoint to be reidentified without opening their ePassport. This paper explains how bisimilarity was used to discover these vulnerabilities, which exploit the BAC protocol - the original ICAO 9303 standard ePassport authentication protocol - and remains valid for the PACE protocol, which improves on the security of BAC in the latest ICAO 9303 standards. In order to tackle such bisimilarity problems, we develop here a chain of methods for the applied $\pi$-calculus including a symbolic under-approximation of bisimilarity, called open bisimilarity, and a modal logic, called classical FM, for describing and certifying attacks. Evidence is provided to argue for a new scheme for specifying such unlinkability problems that more accurately reflects the capabilities of an attacker.


title: Neutral Hydrogen in Nearby Dwarf Galaxies

abstract: Here I briefly highlight our studies of the gas content, kinematics and star formation in nearby dwarf galaxies (D < 10 Mpc) based on the `Local Volume HI Survey' (LVHIS, Koribalski et al. 2018), which was conducted with the Australia Telescope Compact Array (ATCA). The LVHIS sample consists of nearly 100 galaxies, including new discoveries, spanning a large diversity in size, shape, mass and degree of peculiarity. The hydrogen properties of dwarf galaxies in two nearby groups, Sculptor and CenA / M83, are analysed and compared with many rather isolated dwarf galaxies. Around 10% of LVHIS galaxies are transitional or mixed-type dwarf galaxies (dIrr/dSph), the formation of which is explored. - I also provide a brief update on WALLABY Early Science, where we focus on studying the HI properties of galaxies as a function of environment. WALLABY (Dec < +30 degr, z < 0.26) is conducted with the Australian SKA Pathfinder (ASKAP), a 6-km diameter array of 36 x 12-m dishes, each equipped with wide-field (30 sq degr) Chequerboard Phased Array Feeds.