title: Visualizing MuZero Models

abstract: MuZero, a model-based reinforcement learning algorithm that uses a value equivalent dynamics model, achieved state-of-the-art performance in Chess, Shogi and the game of Go. In contrast to standard forward dynamics models that predict a full next state, value equivalent models are trained to predict a future value, thereby emphasizing value relevant information in the representations. While value equivalent models have shown strong empirical success, there is no research yet that visualizes and investigates what types of representations these models actually learn. Therefore, in this paper we visualize the latent representation of MuZero agents. We find that action trajectories may diverge between observation embeddings and internal state transition dynamics, which could lead to instability during planning. Based on this insight, we propose two regularization techniques to stabilize MuZero's performance. Additionally, we provide an open-source implementation of MuZero along with an interactive visualizer of learned representations, which may aid further investigation of value equivalent algorithms.


title: Intrinsic Dynamics of Protein-Peptide Unbinding

abstract: The dynamics of peptide-protein binding and unbinding of a variant of the RNase S system has been investigated. To initiate the process, a photoswitchable azobenzene moiety has been covalently linked to the S-peptide, thereby switching its binding affinity to the S-protein. Transient fluorescence quenching was measured with the help of a time-resolved fluorometer, which has been specifically designed for these experiments and is based on inexpensive LED's and laser diodes only. One mutant shows on-off behaviour with no specific binding detectable in one of the states of the photoswitch. Unbinding is faster by at least two orders of magnitudes, as compared to other variants of the RNase S system. It is concluded that unbinding is essentially barrier-less in that case, revealing the intrinsic dynamics of the unbinding event, which occurs on a few 100 microseconds timescale in a strongly stretched-exponential manner.


title: Persistent Homology and Graphs Representation Learning

abstract: This article aims to study the topological invariant properties encoded in node graph representational embeddings by utilizing tools available in persistent homology. Specifically, given a node embedding representation algorithm, we consider the case when these embeddings are real-valued. By viewing these embeddings as scalar functions on a domain of interest, we can utilize the tools available in persistent homology to study the topological information encoded in these representations. Our construction effectively defines a unique persistence-based graph descriptor, on both the graph and node levels, for every node representation algorithm. To demonstrate the effectiveness of the proposed method, we study the topological descriptors induced by DeepWalk, Node2Vec and Diff2Vec.


title: A Control Function Approach to Estimate Panel Data Binary Response Model

abstract: We propose a new control function (CF) method to estimate a binary response model in a triangular system with multiple unobserved heterogeneities The CFs are the expected values of the heterogeneity terms in the reduced form equations conditional on the histories of the endogenous and the exogenous variables. The method requires weaker restrictions compared to CF methods with similar imposed structures. If the support of endogenous regressors is large, average partial effects are point-identified even when instruments are discrete. Bounds are provided when the support assumption is violated. An application and Monte Carlo experiments compare several alternative methods with ours.


title: Alice meets Boojums in neutron stars: vortices penetrating two-flavor quark-hadron continuity

abstract: Alice and Boojums are both representative characters created by Lewis Carroll. We show that they possibly meet in cores of rotating neutron stars. Recent studies of quark-hadron continuity suggest that neutron superfluid matter can connect smoothly to two-flavor symmetric quark matter at high densities. We study how this can be maintained in the presence of the vortices. In the neutron matter, quantized superfluid vortices arise. In the two-flavor dense quark matter, vortices carrying color magnetic fluxes together with fractionally quantized superfluid circulations appear as the most stable configuration, and we call these as the non-Abelian Alice strings. We show that three integer neutron superfluid vortices and three non-Abelian Alice strings of different color magnetic fluxes with total color flux canceled out are joined at a junction called a Boojum.

categories: hep-ph astro-ph.HE cond-mat.supr-con hep-th nucl-th


title: Lingering Dynamics in Microvascular Blood Flow

abstract: The microvascular networks in the body of vertebrates consist of the smallest vessels such as arterioles, capillaries, and venules. The flow of RBCs through these networks ensures the gas exchange in as well as the transport of nutrients to the tissues. Any alterations in this blood flow may have severe implications on the health state. Since the vessels in these networks obey dimensions similar to the diameter of RBCs, dynamic effects on the cellular scale play a key role. The steady progression in the numerical modeling of RBCs, even in complex networks, has led to novel findings in the field of hemodynamics, especially concerning the impact and the dynamics of lingering events, when a cell meets a branch of the network. However, these results are yet to be matched by a detailed analysis of the lingering experiments in vivo. To quantify this lingering effect in in vivo experiments, this study analyzes branching vessels in the microvasculature of Syrian golden hamsters via intravital microscopy and the use of an implanted dorsal skinfold chamber. It also presents a detailed analysis of these lingering effects of cells at the apex of bifurcating vessels, affecting the temporal distribution of cell-free areas of blood flow in the branches, even causing a partial blockage in severe cases.


title: CF-moves for virtual links

abstract: Oikawa defined an unknotting operation on virtual knots, called a CF-move, and gave a classification of 2-component virtual links up to CF-moves by the virtual linking number and his $n$-invariant. In particular, it was proved that a CF-move characterizes the information contained in the virtual linking number for 2-component odd virtual links. In this paper, we extend this result by classifying odd virtual links and almost odd virtual links with arbitrary number of components up to CF-moves, using the virtual linking number. Moreover, we extend Oikawa's $n$-invariant and introduce two invariants for 3-component even virtual links. Using these invariants together with the virtual linking number, we classify 3-component even virtual links up to CF-moves. As a result, a classification of 3-component virtual links up to CF-moves is provided.


title: Finite and semisimple Boolean inverse monoids

abstract: We describe the structure of finite Boolean inverse monoids and apply our results to the representation theory of finite inverse semigroups. We then generalize to semisimple Boolean inverse semigroups.


title: Statistical mechanics of one-dimensional quantum droplets

abstract: We study the statistical mechanics and the dynamical relaxation process of modulationally unstable one-dimensional quantum droplets described by a modified Gross-Pitaevskii equation. To determine the classical partition function thereof, we leverage the semi-analytical transfer integral operator (TIO) technique. The latter predicts a distribution of the observed wave function amplitudes and yields two-point correlation functions providing insights into the emergent dynamics involving quantum droplets. We compare the ensuing TIO results with the probability distributions obtained at large times of the modulationally unstable dynamics as well as with the equilibrium properties of a suitably constructed Langevin dynamics. We find that the instability leads to the spontaneous formation of quantum droplets featuring multiple collisions and by which are found to coalesce at large evolution times. Our results from the distinct methodologies are in good agreement aside from the case of low temperatures in the special limit where the droplet widens. In this limit, the distribution acquires a pronounced bimodal character, exhibiting a deviation between the TIO solution and the Langevin dynamics.

categories: cond-mat.quant-gas cond-mat.other nlin.PS physics.atom-ph quant-ph


title: A Novel Finite Difference Method for Euler Equations in 2D Unstructured Meshes

abstract: Finite difference method was extended to unstructured meshes to solve Euler equations. The spatial discretization is made of two steps. First, numerical fluxes are computed at the middle point of each edge with high order accuracy. In this step, a one-dimensional curvilinear stencil is assembled for each edge to perform one-dimensional fast non-uniform WENO interpolation derived in this paper, which is much easier and faster than multi-dimensional interpolation. The second step is to compute the divergence of fluxes at each vertex from the fluxes at nearby edges and vertices by least square approximation of multi-dimensional polynomials. The order of the WENO interpolation in the first step and the degree of the polynomial in the second step determined the order of accuracy of the spatial scheme. After that, explicit RungeKutta time discrete scheme is used to update conservative variables. Several canonical numerical cases were solved to test the accuracy, performance and the capability of shock capturing of the developed method.


title: A Survey of Schreier-Type Extensions of Monoids

abstract: We give an overview of a number of Schreier-type extensions of monoids and discuss the relation between them. We begin by discussing the characterisations of split extensions of groups, extensions of groups with abelian kernel and finally non-abelian group extensions. We see how these characterisations may be immediately lifted to Schreier split extensions, special Schreier extensions and Schreier extensions respectively. Finally, we look at weakenings of these Schreier extensions and provide a unified account of their characterisation in terms of relaxed actions.


abstract: We study $Z_N$ symmetry in $SU(N)$ gauge theories in the presence of matter fields in the fundamental representation, by restricting the lattice partition function integration to matter fields which are uniform in spatial directions and gauge fields with vanishing spatial components. In this approximation the gauge matter field interaction effectively reduces to a 1-dimensional gauged chain. This makes analytical calculations of the matter field contribution to the Polyakov loop free energy possible. We show that in the limit of large number of temporal sites the explicit breaking of $Z_N$ symmetry in this free energy vanishes, driven by dominance of the density of states. We argue that the spatial links as well as the spatial modes of the matter fields determine the boundaries separating regions where $Z_N$ symmetry is realised from rest of the phase diagram.


title: Risk factor identification for incident heart failure using neural network distillation and variable selection

abstract: Recent evidence shows that deep learning models trained on electronic health records from millions of patients can deliver substantially more accurate predictions of risk compared to their statistical counterparts. While this provides an important opportunity for improving clinical decision-making, the lack of interpretability is a major barrier to the incorporation of these black-box models in routine care, limiting their trustworthiness and preventing further hypothesis-testing investigations. In this study, we propose two methods, namely, model distillation and variable selection, to untangle hidden patterns learned by an established deep learning model (BEHRT) for risk association identification. Due to the clinical importance and diversity of heart failure as a phenotype, it was used to showcase the merits of the proposed methods. A cohort with 788,880 (8.3% incident heart failure) patients was considered for the study. Model distillation identified 598 and 379 diseases that were associated and dissociated with heart failure at the population level, respectively. While the associations were broadly consistent with prior knowledge, our method also highlighted several less appreciated links that are worth further investigation. In addition to these important population-level insights, we developed an approach to individual-level interpretation to take account of varying manifestation of heart failure in clinical practice. This was achieved through variable selection by detecting a minimal set of encounters that can maximally preserve the accuracy of prediction for individuals. Our proposed work provides a discovery-enabling tool to identify risk factors in both population and individual levels from a data-driven perspective. This helps to generate new hypotheses and guides further investigations on causal links.


title: Sliding down over a horizontally moving semi-sphere

abstract: We studied the dynamics of an object sliding down on a semi-sphere with radius $R$. We consider the physical setup where the semi-sphere is free to move over a flat surface. For simplicity, we assume that all surfaces are friction-less. We analyze the values for the last contact angle $\theta^\star$, corresponding to the angle when the object and the semi-sphere detach one of each other. We consider all possible scenarios with different combination of mass values: $m_A$ and $m_B$, and the initial velocity of the sliding object $A$. We found that the last contact angle only depends on the ratio between the masses, and it is independent of the acceleration of gravity and semi-sphere's radius. In addition, we found that the largest possible value of $\theta^\star$ is $48.19^{\circ}$ that coincides with the case of a fixed semi-sphere. On the opposite case, the minimum value of $\theta^\star$ is $0^\circ$ and it occurs then the object on the semi-sphere is extremely heavy, occurring the detachment as soon as the sliding body touches the semi-sphere. In addition, we found that if the initial kinetic energy of the sliding object $A$ is half the value of the potential energy with respect to the floor. The object detaches at the top of the semi-sphere.


title: On Posterior consistency of Bayesian Changepoint models

abstract: While there have been a lot of recent developments in the context of Bayesian model selection and variable selection for high dimensional linear models, there is not much work in the presence of change point in literature, unlike the frequentist counterpart. We consider a hierarchical Bayesian linear model where the active set of covariates that affects the observations through a mean model can vary between different time segments. Such structure may arise in social sciences/ economic sciences, such as sudden change of house price based on external economic factor, crime rate changes based on social and built-environment factors, and others. Using an appropriate adaptive prior, we outline the development of a hierarchical Bayesian methodology that can select the true change point as well as the true covariates, with high probability. We provide the first detailed theoretical analysis for posterior consistency with or without covariates, under suitable conditions. Gibbs sampling techniques provide an efficient computational strategy. We also consider small sample simulation study as well as application to crime forecasting applications.


title: Cosmological Complexity in K-essence

abstract: We calculate the cosmological complexity under the framework of scalar curvature perturbations for a K-essence model with constant potential. In particular, the squeezed quantum states are defined by acting a two-mode squeezed operator which is characterized by squeezing parameters $r_k$ and $\phi_k$ on vacuum state. The evolution of these squeezing parameters are governed by the $Schr\ddot{o}dinger$ equation, in which the Hamiltonian operator is derived from the cosmological perturbative action. With aid of the solutions of $r_k$ and $\phi_k$, one can calculate the quantum circuit complexity between unsqueezed vacuum state and squeezed quantum states via the wave-function approach. One advantage of K-essence is that it allows us to explore the effects of varied sound speeds on evolution of cosmological complexity. Besides, this model also provides a way for us to distinguish the different cosmological phases by extracting some basic informations, like the scrambling time and Lyapunov exponent etc, from the evolution of cosmological complexity.


title: Global well-posedness and exponential decay to the Cauchy problem of nonhomogeneous Navier-Stokes equations with density-dependent viscosity and vacuum in $\mathbb{R}^2$

abstract: We study global well-posedness of strong solutions for the nonhomogeneous Navier-Stokes equations with density-dependent viscosity and initial density allowing vanish in $\mathbb{R}^2$. Applying a logarithmic interpolation inequality and delicate energy estimates, we show the global existence of a unique strong solution provided that $\|\nabla\mu(\rho_0)\|_{L^q}$ is suitably small, which improves the previous result of Huang and Wang [SIAM J. Math. Anal. 46, 1771--1788 (2014)] to the whole space case. Moreover, we also derive exponential decay rates of the solution. In particular, there is no need to require additional initial compatibility condition despite the presence of vacuum.


title: Checkpointing and Localized Recovery for Nested Fork-Join Programs

abstract: While checkpointing is typically combined with a restart of the whole application, localized recovery permits all but the affected processes to continue. In task-based cluster programming, for instance, the application can then be finished on the intact nodes, and the lost tasks be reassigned. This extended abstract suggests to adapt a checkpointing and localized recovery technique that has originally been developed for independent tasks to nested fork-join programs. We consider a Cilk-like work stealing scheme with work-first policy in a distributed memory setting, and describe the required algorithmic changes. The original technique has checkpointing overheads below 1% and neglectable costs for recovery, we expect the new algorithm to achieve a similar performance.


title: Structured Prediction for CRiSP Inverse Kinematics Learning with Misspecified Robot Models

abstract: With the recent advances in machine learning, problems that traditionally would require accurate modeling to be solved analytically can now be successfully approached with data-driven strategies. Among these, computing the inverse kinematics of a redundant robot arm poses a significant challenge due to the non-linear structure of the robot, the hard joint constraints and the non-invertible kinematics map. Moreover, most learning algorithms consider a completely data-driven approach, while often useful information on the structure of the robot is available and should be positively exploited. In this work, we present a simple, yet effective, approach for learning the inverse kinematics. We introduce a structured prediction algorithm that combines a data-driven strategy with the model provided by a forward kinematics function -- even when this function is misspecified -- to accurately solve the problem. The proposed approach ensures that predicted joint configurations are well within the robot's constraints. We also provide statistical guarantees on the generalization properties of our estimator as well as an empirical evaluation of its performance on trajectory reconstruction tasks.


title: Local BCJ numerators for ten-dimensional SYM at one loop

abstract: We obtain local numerators satisfying the BCJ color-kinematics duality at one loop for super-Yang-Mills theory in ten dimensions. This is done explicitly for six points via the field-theory limit of the genus-one open superstring correlators for different color orderings, in an analogous manner to an earlier derivation of local BCJ-satisfying numerators at tree level from disk correlators. These results solve an outstanding puzzle from a previous analysis where the six-point numerators did not satisfy the color-kinematics duality.


title: Spin-Polarized Fractional Corner Charges and Their Photonic Realization

abstract: We demonstrate that a spin degree of freedom can introduce additional texture to higher order topological insulators (HOTIs), manifesting itself in novel topological invariants, phases, and phase transitions. Spin-polarized mid-gap corner states of various multiplicities are predicted for different HOTI phases, and novel bulk-boundary correspondence principles are defined based on quantized bulk invariants such as total and spin corner charge. Those are shown to be robust with respect to symmetry-preserving spin-flipping perturbations. Photonic realizations of spin-linked topological phases are demonstrated in engineered systems with synthetically emulated spin degree of freedom.


title: Design of the Single Balanced Mixer (Using HSMS-281x Diode) and Measurements

abstract: We designed the Mixer operating at 2.4 GHz for WIFI-band using ADS software and fabricated using Rogers 4350B substrate. We designed the single-balanced mixer using the diode (HSMS-281x model). We measured the isolation across all ports of the mixer. We measured the conversion loss of the mixer. We performed the non-linear measurements, which include IM3 vs frequency. The performance metrics are compared with the data-sheet values and explained if any discrepancy exists.


title: The precessing jets of classical nova YZ Reticuli

abstract: The classical nova YZ Reticuli was discovered in July 2020. Shortly after this we commenced a sustained, highly time-sampled coverage of its subsequent rapid evolution with time-resolved spectroscopy from the Global Jet Watch observatories. Its H-alpha complex exhibited qualitatively different spectral signatures in the following weeks and months. We find that these H-alpha complexes are well described by the same five Gaussian emission components throughout the six months following eruption. These five components appear to constitute two pairs of lines, from jet outflows and an accretion disc, together with an additional central component. The correlated, symmetric patterns that these jet/accretion disc pairs exhibit suggest precession, probably in response to the large perturbation caused by the nova eruption. The jet and accretion disc signatures persist from the first ten days after brightening -- evidence that the accretion disc survived the disruption. We also compare another classical nova (V6568 Sgr) that erupted in July 2020 whose H-alpha complex can be described analogously, but with faster line-of-sight jet speeds exceeding 4000 km/s. We suggest that classical novae with higher mass white dwarfs bridge the gap between recurrent novae and classical novae such as YZ Reticuli.


title: Single Ion Thermal Wave Packet Analyzed Via Time-Of-Flight Detection

abstract: A single $^{40}$Ca ion is confine in the harmonic potential of a Paul trap and cooled to a temperature of a few mK, with a wave packet of sub-m spatial and sub-m/s velocity uncertainty. Deterministically extracted from the Paul trap, the single ion is propagating over a distance of 0.27 m and detected. By engineering the ion extraction process on the initial wave packet, theoretically modeling the ion trajectories, and studying experimentally the time-of-flight distribution, we directly infer the state of the previously trapped ion. This analysis allows for accurate remote sensing of the previous motional excitation in the trap potential, both coherently or incoherently. Our method paves a way to extract, manipulate and design quantum wave packets also outside of the Paul trap.


title: Provably Breaking the Quadratic Error Compounding Barrier in Imitation Learning, Optimally

abstract: We study the statistical limits of Imitation Learning (IL) in episodic Markov Decision Processes (MDPs) with a state space $\mathcal{S}$. We focus on the known-transition setting where the learner is provided a dataset of $N$ length-$H$ trajectories from a deterministic expert policy and knows the MDP transition. We establish an upper bound $O(|\mathcal{S}|H^{3/2}/N)$ for the suboptimality using the Mimic-MD algorithm in Rajaraman et al (2020) which we prove to be computationally efficient. In contrast, we show the minimax suboptimality grows as $\Omega( H^{3/2}/N)$ when $|\mathcal{S}|\geq 3$ while the unknown-transition setting suffers from a larger sharp rate $\Theta(|\mathcal{S}|H^2/N)$ (Rajaraman et al (2020)). The lower bound is established by proving a two-way reduction between IL and the value estimation problem of the unknown expert policy under any given reward function, as well as building connections with linear functional estimation with subsampled observations. We further show that under the additional assumption that the expert is optimal for the true reward function, there exists an efficient algorithm, which we term as Mimic-Mixture, that provably achieves suboptimality $O(1/N)$ for arbitrary 3-state MDPs with rewards only at the terminal layer. In contrast, no algorithm can achieve suboptimality $O(\sqrt{H}/N)$ with high probability if the expert is not constrained to be optimal. Our work formally establishes the benefit of the expert optimal assumption in the known transition setting, while Rajaraman et al (2020) showed it does not help when transitions are unknown.


title: Delegating Multi-Party Quantum Computations vs. Dishonest Majority in Two Quantum Rounds

abstract: Multi-Party Quantum Computation (MPQC) has attracted a lot of attention as a potential killer-app for quantum networks through it's ability to preserve privacy and integrity of the highly valuable computations they would enable. Contributing to the latest challenges in this field, we present a composable protocol achieving blindness and verifiability even in the case of a single honest client. The security of our protocol is reduced, in an information-theoretically secure way, to that of a classical composable Secure Multi-Party Computation (SMPC) used to coordinate the various parties. Our scheme thus provides a statistically secure upgrade of such classical scheme to a quantum one with the same level of security. In addition, (i) the clients can delegate their computation to a powerful fully fault-tolerant server and only need to perform single qubit operations to unlock the full potential of multi-party quantum computation; (ii) the amount of quantum communication with the server is reduced to sending quantum states at the beginning of the computation and receiving the output states at the end, which is optimal and removes the need for interactive quantum communication; and (iii) it has a low constant multiplicative qubit overhead compared to the single-client delegated protocol it is built upon. The main technical ingredient of our paper is the bootstraping of the MPQC construction by Double Blind Quantum Computation, a new composable resource for blind multiparty quantum computation, that demonstrates the surprising fact that the full protocol does not require verifiability of all components to achieve security.


title: Probing doubly charged scalar bosons from the doublet at future high-energy colliders

abstract: The isospin doublet scalar field with hypercharge 3/2 is introduced in some new physics models such as tiny neutrino masses. Detecting the doubly charged scalar bosons from the doublet field can be a good probe of such models. However, their collider phenomenology has not been examined sufficiently. We investigate collider signatures of the doubly and singly charged scalar bosons at the LHC for the high-luminosity upgraded option (HL-LHC) by looking at transverse mass distributions etc. With the appropriate kinematical cuts we demonstrate the background reduction in the minimal model in the following two cases depending on the mass of the scalar bosons. (1) The main decay mode of the singly charged scalar bosons is the tau lepton and missing (as well as charm and strange quarks). (2) That is into a top bottom pair. In the both cases, we assume that the doubly charged scalar boson is heavier than the singly charged ones. We conclude that the scalar doublet field with $Y = 3/2$ is expected to be detectable at the HL-LHC unless the mass is too large.


title: An algorithm to factorize quantum walks into shift and coin operations

abstract: We provide an algorithm that factorizes one-dimensional quantum walks into a protocol of two basic operations: A fixed conditional shift that transports particles between cells and suitable coin operators that act locally in each cell. This allows to tailor quantum walk protocols to any experimental setup by rephrasing it on the cell structure determined by the experimental limitations. We give the example of a walk defined on a qutrit chain compiled to run an a qubit chain.


title: On the consistency of the Kozachenko-Leonenko entropy estimate

abstract: We revisit the problem of the estimation of the differential entropy $H(f)$ of a random vector $X$ in $R^d$ with density $f$, assuming that $H(f)$ exists and is finite. In this note, we study the consistency of the popular nearest neighbor estimate $H_n$ of Kozachenko and Leonenko. Without any smoothness condition we show that the estimate is consistent ($E\{|H_n - H(f)|\} \to 0$ as $n \to \infty$) if and only if $\mathbb{E} \{ \log ( \| X \| + 1 )\} < \infty$. Furthermore, if $X$ has compact support, then $H_n \to H(f)$ almost surely.


abstract: Common resource management methods in supercomputing systems usually include hard divisions, capping, and quota allotment. Those methods, despite their 'advantages', have some known serious disadvantages including unoptimized utilization of an expensive facility, and occasionally there is still a need to dynamically reschedule and reallocate the resources. Consequently, those methods involve bad supply-and-demand management rather than a free market playground that will eventually increase system utilization and productivity. In this work, we propose the newly Optimized Memoryless Fair-Share HPC Resources Scheduling using Transparent Checkpoint-Restart Preemption, in which the social welfare increases using a free-of-cost interchangeable proprietary possession scheme. Accordingly, we permanently keep the status-quo in regard to the fairness of the resources distribution while maximizing the ability of all users to achieve more CPUs and CPU hours for longer period without any non-straightforward costs, penalties or additional human intervention.


title: Thermal conductivity measurements of sub-surface buried substrates by steady-state thermoreflectance

abstract: Measuring the thermal conductivity of sub-surface buried substrates are of significant practical interests. However, this remains challenging with traditional pump-probe spectroscopies due to their limited thermal penetration depths (TPD). Here, we experimentally and numerically investigate the TPD of recently developed optical pump-probe technique steady-state thermoreflectance (SSTR) and explore its capability for measuring the thermal properties of buried substrates. The conventional definition of the TPD does not truly represent the upper limit of how far beneath the surface SSTR can probe. For estimating the uncertainty of SSTR measurements of a buried substrate a priori, sensitivity calculations provide the best means. Thus, detailed sensitivity calculations are provided to guide future measurements. Due to the steady-state nature of SSTR, it can measure the thermal conductivity of buried substrates typically inaccessible by traditional pump-probe techniques, exemplified by measuring three control samples. We also discuss the required criteria for SSTR to isolate the thermal properties of a buried film. Our study establishes SSTR as a suitable technique for thermal characterizations of sub-surface buried substrates in typical device geometries.


title: On the closure property of Lepage equivalents of Lagrangians

abstract: Lepage equivalents of Lagrangians are a higher order, field-theoretical generalization of the notion of Poincare-Cartan form from mechanics and play a similar role: they give rise to a geometric formulation (and to a geometric understanding) of the calculus of variations. A long-standing open problem is the determination, for field-theoretical Lagrangians of order greater than one, of a Lepage equivalent with the so-called closure property: the Lepage equivalent is a closed differential form if and only if the Lagrangian has vanishing Euler-Lagrange expressions. The present paper proposes a solution to this problem, for general Lagrangians, of any order. The construction is a local one; yet, we show that in most of the cases of interest for physical applications, the obtained Lepage equivalent is actually globally defined. A variant of this construction, which is advantageous for reducible Lagrangians, is also introduced. In particular, for reducible Lagrangians of order two, the obtained Lepage equivalents are of order one.


title: Stein Variational Gradient Descent: many-particle and long-time asymptotics

abstract: Stein variational gradient descent (SVGD) refers to a class of methods for Bayesian inference based on interacting particle systems. In this paper, we consider the originally proposed deterministic dynamics as well as a stochastic variant, each of which represent one of the two main paradigms in Bayesian computational statistics: variational inference and Markov chain Monte Carlo. As it turns out, these are tightly linked through a correspondence between gradient flow structures and large-deviation principles rooted in statistical physics. To expose this relationship, we develop the cotangent space construction for the Stein geometry, prove its basic properties, and determine the large-deviation functional governing the many-particle limit for the empirical measure. Moreover, we identify the Stein-Fisher information (or kernelised Stein discrepancy) as its leading order contribution in the long-time and many-particle regime in the sense of $\Gamma$-convergence, shedding some light on the finite-particle properties of SVGD. Finally, we establish a comparison principle between the Stein-Fisher information and RKHS-norms that might be of independent interest.

categories: stat.ML cs.LG cs.NA math.AP math.NA math.PR math.ST stat.TH


title: Credit Assignment with Meta-Policy Gradient for Multi-Agent Reinforcement Learning

abstract: Reward decomposition is a critical problem in centralized training with decentralized execution~(CTDE) paradigm for multi-agent reinforcement learning. To take full advantage of global information, which exploits the states from all agents and the related environment for decomposing Q values into individual credits, we propose a general meta-learning-based Mixing Network with Meta Policy Gradient~(MNMPG) framework to distill the global hierarchy for delicate reward decomposition. The excitation signal for learning global hierarchy is deduced from the episode reward difference between before and after "exercise updates" through the utility network. Our method is generally applicable to the CTDE method using a monotonic mixing network. Experiments on the StarCraft II micromanagement benchmark demonstrate that our method just with a simple utility network is able to outperform the current state-of-the-art MARL algorithms on 4 of 5 super hard scenarios. Better performance can be further achieved when combined with a role-based utility network.


title: Analyticity of resolvents of elliptic operators on quantum graphs with small edges

abstract: We consider an arbitrary metric graph, to which we glue another graph with edges of lengths proportional to $\varepsilon$, where $\varepsilon$ is a small positive parameter. On such graph, we consider a general self-adjoint second order differential operator $\mathcal{H}_\varepsilon$ with varying coefficients subject to general vertex conditions; all coefficients in differential expression and vertex conditions are supposed to be analytic in $\varepsilon$. We introduce a special operator on a certain graph obtained by rescaling the aforementioned small edges and assume that it has no embedded eigenvalues at the threshold of its essential spectrum. Under such assumption, we show that certain parts of the resolvent of $\mathcal{H}_\varepsilon$ are analytic in $\varepsilon$. This allows us to represent the resolvent of $\mathcal{H}_\varepsilon$ by an uniformly converging Taylor-like series and its partial sums can be used for approximating the resolvent up to an arbitrary power of $\varepsilon$. In particular, the zero-order approximation reproduces recent convergence results by G. Berkolaiko, Yu. Latushkin, S. Sukhtaiev and by C. Cacciapuoti, but we additionally show that next-to-leading terms in $\varepsilon$-expansions of the coefficients in the differential expression and vertex conditions can contribute to the limiting operator producing the Robin part at the vertices, to which small edges are incident. We also discuss possible generalizations of our model including both the cases of a more general geometry of the small parts of the graph and a non-analytic $\varepsilon$-dependence of the coefficients in the differential expression and vertex conditions.


title: Bayesian OOD detection with aleatoric uncertainty and outlier exposure

abstract: Typical Bayesian approaches to OOD detection use epistemic uncertainty. Surprisingly from the Bayesian perspective, there are a number of methods that successfully use aleatoric uncertainty to detect OOD points (e.g. Hendryks et al. 2018). In addition, it is difficult to use outlier exposure to improve a Bayesian OOD detection model, as it is not clear whether it is possible or desirable to increase posterior (epistemic) uncertainty at outlier points. We show that a generative model of data curation provides a principled account of aleatoric uncertainty for OOD detection. In particular, aleatoric uncertainty signals a specific type of OOD point: one without a well-defined class-label, and our model of data curation gives a likelihood for these points, giving us a mechanism for conditioning on outlier points and thus performing principled Bayesian outlier exposure. Our principled Bayesian approach, combining aleatoric and epistemic uncertainty with outlier exposure performs better than methods using aleatoric or epistemic alone.


title: Deep learning based electrical noise removal enables high spectral optoacoustic contrast in deep tissue

abstract: Image contrast in multispectral optoacoustic tomography (MSOT) can be severely reduced by electrical noise and interference in the acquired optoacoustic signals. Signal processing techniques have proven insufficient to remove the effects of electrical noise because they typically rely on simplified models and fail to capture complex characteristics of signal and noise. Moreover, they often involve time-consuming processing steps that are unsuited for real-time imaging applications. In this work, we develop and demonstrate a discriminative deep learning (DL) approach to separate electrical noise from optoacoustic signals prior to image reconstruction. The proposed DL algorithm is based on two key features. First, it learns spatiotemporal correlations in both noise and signal by using the entire optoacoustic sinogram as input. Second, it employs training based on a large dataset of experimentally acquired pure noise and synthetic optoacoustic signals. We validated the ability of the trained model to accurately remove electrical noise on synthetic data and on optoacoustic images of a phantom and the human breast. We demonstrate significant enhancements of morphological and spectral optoacoustic images reaching 19% higher blood vessel contrast and localized spectral contrast at depths of more than 2 cm for images acquired in vivo. We discuss how the proposed denoising framework is applicable to clinical multispectral optoacoustic tomography and suitable for real-time operation.


title: On regret bounds for continual single-index learning

abstract: In this paper, we generalize the problem of single-index model to the context of continual learning in which a learner is challenged with a sequence of tasks one by one and the dataset of each task is revealed in an online fashion. We propose a randomized strategy that is able to learn a common single-index (meta-parameter) for all tasks and a specific link function for each task. The common single-index allows to transfer the information gained from the previous tasks to a new one. We provide a rigorous theoretical analysis of our proposed strategy by proving some regret bounds under different assumption on the loss function.


title: Bias-reduced Multi-step Hindsight Experience Replay for Efficient Multi-goal Reinforcement Learning

abstract: Multi-goal reinforcement learning is widely applied in planning and robot manipulation. Two main challenges in multi-goal reinforcement learning are sparse rewards and sample inefficiency. Hindsight Experience Replay (HER) aims to tackle the two challenges via goal relabeling. However, HER-related works still need millions of samples and a huge computation. In this paper, we propose Multi-step Hindsight Experience Replay (MHER), incorporating multi-step relabeled returns based on $n$-step relabeling to improve sample efficiency. Despite the advantages of $n$-step relabeling, we theoretically and experimentally prove the off-policy $n$-step bias introduced by $n$-step relabeling may lead to poor performance in many environments. To address the above issue, two bias-reduced MHER algorithms, MHER($\lambda$) and Model-based MHER (MMHER) are presented. MHER($\lambda$) exploits the $\lambda$ return while MMHER benefits from model-based value expansions. Experimental results on numerous multi-goal robotic tasks show that our solutions can successfully alleviate off-policy $n$-step bias and achieve significantly higher sample efficiency than HER and Curriculum-guided HER with little additional computation beyond HER.


title: Event-Driven Receding Horizon Control of Energy-Aware Dynamic Agents For Distributed Persistent Monitoring

abstract: This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to jointly optimize the overall agent energy consumption and a measure of overall node state uncertainty, evaluated over a finite period of interest. To achieve these objectives, we extend an established event-driven Receding Horizon Control (RHC) solution by adding an optimal controller to account for agent motion dynamics and associated energy consumption. The resulting RHC solution is computationally efficient, distributed and on-line. Finally, numerical results are provided highlighting improvements compared to an existing RHC solution that uses energy-agnostic first-order agents.


title: The Bloch-Okounkov theorem for congruence subgroups and Taylor coefficients of quasi-Jacobi forms

abstract: There are many families of functions on partitions, such as the shifted symmetric functions, for which the corresponding q-brackets are quasimodular forms. We extend these families so that the corresponding q-brackets are quasimodular for a congruence subgroup. Moreover, we find subspaces of these families for which the q-bracket is a modular form. These results follow from the properties of Taylor coefficients of strictly meromorphic quasi-Jacobi forms around rational lattice points.


title: Partially-Averaged Navier-Stokes Closure Modeling for Variable-Density Turbulent Flow

abstract: This work extends the framework of the partially-averaged Navier-Stokes (PANS) equations to variable-density flow, \text{i.e.}, multi-material and/or compressible mixing problems with density variations and production of turbulence kinetic energy by both shear and buoyancy mechanisms. The proposed methodology is utilized to derive the PANS BHR-LEVM closure. This includes \textit{a-priori} testing to analyze and develop guidelines toward the efficient selection of the parameters controlling the physical resolution and, consequently, the range of resolved scales of PANS. Two archetypal test-cases involving transient turbulence, hydrodynamic instabilities, and coherent structures are used to illustrate the accuracy and potential of the method: the Taylor-Green vortex (TGV) at Reynolds number $\mathrm{Re}=3000$, and the Rayleigh-Taylor (RT) flow at Atwood number $0.5$ and $(\mathrm{Re})_{\max}\approx 500$. These representative problems, for which turbulence is generated by shear and buoyancy processes, constitute the initial validation space of the new model, and their results are comprehensively discussed in two subsequent studies. The computations indicate that PANS can accurately predict the selected flow problems, resolving only a fraction of the scales of large eddy simulation and direct numerical simulation strategies. The results also reiterate that the physical resolution of the PANS model must guarantee that the key instabilities and coherent structures of the flow are resolved. The remaining scales can be modeled through an adequate turbulence scale-dependent closure.


title: Higher-dimensional Calabi-Yau varieties with dense sets of rational points

abstract: We construct higher-dimensional Calabi-Yau varieties defined over a given number field with Zariski dense sets of rational points. We give two elementary constructions in arbitrary dimensions as well as another construction in dimension three which involves certain Calabi-Yau threefolds containing an Enriques surface. The constructions also show that potential density holds for (sufficiently) general members of the families.


title: A statistical framework for efficient out of distribution detection in deep neural networks

abstract: Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a dissimilar distribution. This is a major concern for deployment in real-world applications, where such behavior may come at a considerable cost, such as industrial production lines, autonomous vehicles, or healthcare applications. Contributions. We frame Out Of Distribution (OOD) detection in DNNs as a statistical hypothesis testing problem. Tests generated within our proposed framework combine evidence from the entire network. Unlike previous OOD detection heuristics, this framework returns a $p$-value for each test sample. It is guaranteed to maintain the Type I Error (T1E - incorrectly predicting OOD for an actual in-distribution sample) for test data. Moreover, this allows to combine several detectors while maintaining the T1E. Building on this framework, we suggest a novel OOD procedure based on low-order statistics. Our method achieves comparable or better results than state-of-the-art methods on well-accepted OOD benchmarks, without retraining the network parameters or assuming prior knowledge on the test distribution -- and at a fraction of the computational cost.


title: Random hypergraphs and property B

abstract: In 1964 Erd\H{o}s proved that $(1+\oh{1})) \frac{\eul \ln(2)}{4} k^2 2^{k}$ edges are sufficient to build a $k$-graph which is not two colorable. To this day, it is not known whether there exist such $k$-graphs with smaller number of edges. Erd\H{o}s' bound is consequence of the fact that a hypergraph with $k^2/2$ vertices and $M(k)=(1+\oh{1}) \frac{\eul \ln(2)}{4} k^2 2^{k}$ randomly chosen edges of size $k$ is asymptotically almost surely not two colorable. Our first main result implies that for any $\varepsilon > 0$, any $k$-graph with $(1-\varepsilon) M(k)$ randomly and uniformly chosen edges is a.a.s. two colorable. The presented proof is an adaptation of the second moment method analogous to the developments of Achlioptas and Moore from 2002 who considered the problem with fixed size of edges and number of vertices tending to infinity. In the second part of the paper we consider the problem of algorithmic coloring of random $k$-graphs. We show that quite simple, and somewhat greedy procedure, a.a.s. finds a proper two coloring for random $k$-graphs on $k^2/2$ vertices, with at most $\Oh{k\ln k\cdot 2^k}$ edges. That is of the same asymptotic order as the analogue of the \emph{algorithmic barrier} defined by Achlioptas and Coja-Oghlan in 2008, for the case of fixed $k$.


title: Controlling nonlinear dynamical systems into arbitrary states using machine learning

abstract: We propose a novel and fully data driven control scheme which relies on machine learning (ML). Exploiting recently developed ML-based prediction capabilities of complex systems, we demonstrate that nonlinear systems can be forced to stay in arbitrary dynamical target states coming from any initial state. We outline our approach using the examples of the Lorenz and the R\"ossler system and show how these systems can very accurately be brought not only to periodic but also to e.g. intermittent and different chaotic behavior. Having this highly flexible control scheme with little demands on the amount of required data on hand, we briefly discuss possible applications that range from engineering to medicine.


title: A microservice-based framework for exploring data selection in cross-building knowledge transfer

abstract: Supervised deep learning has achieved remarkable success in various applications. Successful machine learning application however depends on the availability of sufficiently large amount of data. In the absence of data from the target domain, representative data collection from multiple sources is often needed. However, a model trained on existing multi-source data might generalize poorly on the unseen target domain. This problem is referred to as domain shift. In this paper, we explore the suitability of multi-source training data selection to tackle the domain shift challenge in the context of domain generalization. We also propose a microservice-oriented methodology for supporting this solution. We perform our experimental study on the use case of building energy consumption prediction. Experimental results suggest that minimal building description is capable of improving cross-building generalization performances when used to select energy consumption data.


title: Are pre-trained text representations useful for multilingual and multi-dimensional language proficiency modeling?

abstract: Development of language proficiency models for non-native learners has been an active area of interest in NLP research for the past few years. Although language proficiency is multidimensional in nature, existing research typically considers a single "overall proficiency" while building models. Further, existing approaches also considers only one language at a time. This paper describes our experiments and observations about the role of pre-trained and fine-tuned multilingual embeddings in performing multi-dimensional, multilingual language proficiency classification. We report experiments with three languages -- German, Italian, and Czech -- and model seven dimensions of proficiency ranging from vocabulary control to sociolinguistic appropriateness. Our results indicate that while fine-tuned embeddings are useful for multilingual proficiency modeling, none of the features achieve consistently best performance for all dimensions of language proficiency. All code, data and related supplementary material can be found at: https://github.com/nishkalavallabhi/MultidimCEFRScoring.


title: Wallpaper Groups and Auxetic Metamaterials

abstract: We examine a fundamental material property called Poisson's ratio, which establishes the relationship for the relative deformation of a physical system in orthogonal directions. Architects and engineers have designed advanced systems using repeating patterns that can potentially exhibit auxetic behavior, which is the property of having a negative Poisson's ratio. Because two-dimensional cross sections of each of these patterns has an associated wallpaper group, we can look for useful correlations between this geometric information and the two-dimensional response as defined by Poisson's ratio. By analyzing the data, we find two properties of the wallpaper group that correlate with more effective Poisson's ratio required for applications. This paper also contains an introduction to wallpaper groups and orbifold notation and an appendix contains some literature references recreated to use our preferred notation.


title: Benchmarking quantum co-processors in an application-centric, hardware-agnostic and scalable way

abstract: Existing protocols for benchmarking current quantum co-processors fail to meet the usual standards for assessing the performance of High-Performance-Computing platforms. After a synthetic review of these protocols -- whether at the gate, circuit or application level -- we introduce a new benchmark, dubbed Atos Q-score (TM), that is application-centric, hardware-agnostic and scalable to quantum advantage processor sizes and beyond. The Q-score measures the maximum number of qubits that can be used effectively to solve the MaxCut combinatorial optimization problem with the Quantum Approximate Optimization Algorithm. We give a robust definition of the notion of effective performance by introducing an improved approximation ratio based on the scaling of random and optimal algorithms. We illustrate the behavior of Q-score using perfect and noisy simulations of quantum processors. Finally, we provide an open-source implementation of Q-score that makes it easy to compute the Q-score of any quantum hardware.


title: Learning High-Order Interactions via Targeted Pattern Search

abstract: Logistic Regression (LR) is a widely used statistical method in empirical binary classification studies. However, real-life scenarios oftentimes share complexities that prevent from the use of the as-is LR model, and instead highlight the need to include high-order interactions to capture data variability. This becomes even more challenging because of: (i) datasets growing wider, with more and more variables; (ii) studies being typically conducted in strongly imbalanced settings; (iii) samples going from very large to extremely small; (iv) the need of providing both predictive models and interpretable results. In this paper we present a novel algorithm, Learning high-order Interactions via targeted Pattern Search (LIPS), to select interaction terms of varying order to include in a LR model for an imbalanced binary classification task when input data are categorical. LIPS's rationale stems from the duality between item sets and categorical interactions. The algorithm relies on an interaction learning step based on a well-known frequent item set mining algorithm, and a novel dissimilarity-based interaction selection step that allows the user to specify the number of interactions to be included in the LR model. In addition, we particularize two variants (Scores LIPS and Clusters LIPS), that can address even more specific needs. Through a set of experiments we validate our algorithm and prove its wide applicability to real-life research scenarios, showing that it outperforms a benchmark state-of-the-art algorithm.


title: The Power of $D$-hops in Matching Power-Law Graphs

abstract: This paper studies seeded graph matching for power-law graphs. Assume that two edge-correlated graphs are independently edge-sampled from a common parent graph with a power-law degree distribution. A set of correctly matched vertex-pairs is chosen at random and revealed as initial seeds. Our goal is to use the seeds to recover the remaining latent vertex correspondence between the two graphs. Departing from the existing approaches that focus on the use of high-degree seeds in $1$-hop neighborhoods, we develop an efficient algorithm that exploits the low-degree seeds in suitably-defined $D$-hop neighborhoods. Specifically, we first match a set of vertex-pairs with appropriate degrees (which we refer to as the first slice) based on the number of low-degree seeds in their $D$-hop neighborhoods. This significantly reduces the number of initial seeds needed to trigger a cascading process to match the rest of the graphs. Under the Chung-Lu random graph model with $n$ vertices, max degree $\Theta(\sqrt{n})$, and the power-law exponent $2<\beta<3$, we show that as soon as $D> \frac{4-\beta}{3-\beta}$, by optimally choosing the first slice, with high probability our algorithm can correctly match a constant fraction of the true pairs without any error, provided with only $\Omega((\log n)^{4-\beta})$ initial seeds. Our result achieves an exponential reduction in the seed size requirement, as the best previously known result requires $n^{1/2+\epsilon}$ seeds (for any small constant $\epsilon>0$). Performance evaluation with synthetic and real data further corroborates the improved performance of our algorithm.


title: A Hybrid Approximation to the Marginal Likelihood

abstract: Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples obtained from a Markov Chain Monte Carlo (MCMC) algorithm. As the dimension of the parameter space increases, however, many of these methods become prohibitively slow and potentially inaccurate. In this paper, we propose a novel method in which we use the MCMC samples to learn a high probability partition of the parameter space and then form a deterministic approximation over each of these partition sets. This two-step procedure, which constitutes both a probabilistic and a deterministic component, is termed a Hybrid approximation to the marginal likelihood. We demonstrate its versatility in a plethora of examples with varying dimension and sample size, and we also highlight the Hybrid approximation's effectiveness in situations where there is either a limited number or only approximate MCMC samples available.


title: Two-descent on some genus two curves

abstract: For the hyperelliptic curve C_p with equation y^2=x(x-2p)(x-p)(x+p)(x+2p) with p a prime number, we discuss bounds for the rank of its Jacobian over Q, find many cases having 2-torsion in the associated Shafarevich-Tate group, and we present some results on rational points of C_p.


title: Generation of a Bessel beam in FDTD using a cylindrical antenna

abstract: Bessel beams are becoming a very useful tool in many areas of optics and photonics, because of the invariance of their intensity profile over an extended propagation range. Finite-Difference-Time-Domain (FDTD) approach is widely used for the modeling of the beam interaction with nanostructures. However, the generation of the Bessel beam in this approach is a computationally challenging problem. In this work, we report an approach for the generation of the infinite Bessel beams in three-dimensional FDTD. It is based on the injection of the Bessel solutions of Maxwell's equations from a cylindrical hollow annulus. This configuration is compatible with Particle In Cell simulations of laser plasma interactions. This configuration allows using a smaller computation box and is therefore computationally more efficient than the creation of a Bessel-Gauss beam from a wall and models more precisely the analytical infinite Bessel beam. Zeroth and higher-order Bessel beams with different cone angles are successfully produced. We investigate the effects of the injector parameters on the error with respect to the analytical solution. In all cases, the relative deviation is in the range of 0.01-7.0 percent.


title: Polymer brush-induced depletion interactions and clustering of membrane proteins

abstract: We investigate the effect of mobile polymer brushes on proteins embedded in biological membranes by employing both Asakura-Oosawa type of theoretical model and coarse-grained molecular dynamics simulations. The brush polymer-induced depletion attraction between proteins changes non-monotonically with the size of brush. The depletion interaction, which is determined by the ratio of protein size to the grafting distance between brush polymers, increases linearly with brush size as long as the polymer brush height is shorter than the protein size. When the brush height exceeds the protein size, however, the depletion attraction among proteins is slightly reduced. We also explore the possibility of brush polymer-induced assembly of a large protein cluster, which can be related to one of many molecular mechanisms underlying recent experimental observations of integrin nanocluster formation and signaling.


title: Non-invasive Cognitive-level Human Interfacing for the Robotic Restoration of Reaching & Grasping

abstract: Assistive and Wearable Robotics have the potential to support humans with different types of motor impairments to become independent and fulfil their activities of daily living successfully. The success of these robot systems, however, relies on the ability to meaningfully decode human action intentions and carry them out appropriately. Neural interfaces have been explored for use in such system with several successes, however, they tend to be invasive and require training periods in the order of months. We present a robotic system for human augmentation, capable of actuating the user's arm and fingers for them, effectively restoring the capability of reaching, grasping and manipulating objects; controlled solely through the user's eye movements. We combine wearable eye tracking, the visual context of the environment and the structural grammar of human actions to create a cognitive-level assistive robotic setup that enables the users in fulfilling activities of daily living, while conserving interpretability, and the agency of the user. The interface is worn, calibrated and ready to use within 5 minutes. Users learn to control and make successful use of the system with an additional 5 minutes of interaction. The system is tested with 5 healthy participants, showing an average success rate of $96.6\%$ on first attempt across 6 tasks.


title: The Black-Box Simplex Architecture for Runtime Assurance of Autonomous CPS

abstract: The Simplex Architecture is a runtime assurance framework where control authority may switch from an unverified and potentially unsafe advanced controller to a backup baseline controller in order to maintain the safety of an autonomous cyber-physical system. In this work, we show that runtime checks can replace the requirement to statically verify safety of the baseline controller. This is important as there are many powerful control techniques, such as model-predictive control and neural network controllers, that work well in practice but are difficult to statically verify. Since the method does not use internal information about the advanced or baseline controller, we call the approach the Black-Box Simplex Architecture. We prove the architecture is safe and present two case studies where (i) model-predictive control provides safe multi-robot coordination, and (ii) neural networks provably prevent collisions in groups of F-16 aircraft, despite the controllers occasionally outputting unsafe commands.


title: A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives

abstract: Modern natural language processing (NLP) methods employ self-supervised pretraining objectives such as masked language modeling to boost the performance of various application tasks. These pretraining methods are frequently extended with recurrence, adversarial or linguistic property masking, and more recently with contrastive learning objectives. Contrastive self-supervised training objectives enabled recent successes in image representation pretraining by learning to contrast input-input pairs of augmented images as either similar or dissimilar. However, in NLP, automated creation of text input augmentations is still very challenging because a single token can invert the meaning of a sentence. For this reason, some contrastive NLP pretraining methods contrast over input-label pairs, rather than over input-input pairs, using methods from Metric Learning and Energy Based Models. In this survey, we summarize recent self-supervised and supervised contrastive NLP pretraining methods and describe where they are used to improve language modeling, few or zero-shot learning, pretraining data-efficiency and specific NLP end-tasks. We introduce key contrastive learning concepts with lessons learned from prior research and structure works by applications and cross-field relations. Finally, we point to open challenges and future directions for contrastive NLP to encourage bringing contrastive NLP pretraining closer to recent successes in image representation pretraining.


title: Observations of Her X-1 in low states during SRG/eROSITA all-sky survey

abstract: eROSITA (extended ROentgen Survey with an Imaging Telescope Array) instrument onboard the Russian-German `Spectrum-Roentgen-Gamma' (SRG) mission observed the Her X-1/HZ Her binary system in multiple scans over the source during the first and second SRG all-sky surveys. Both observations occurred during a low state of the X-ray source when the outer parts of the accretion disk blocked the neutron star from view. The orbital modulation of the X-ray flux was detected during the low states. We argue that the detected X-ray radiation results from scattering of the emission of the central source by three distinct regions: (a) an optically thin hot corona with temperature $\sim (2-4) \times 10^6$ K above the irradiated hemisphere of the optical star; (b) an optically thin hot halo above the accretion disk; and (c) the optically thick cold atmosphere of the optical star. The latter region effectively scatters photons with energies above $5-6$ keV.


title: Variable Weights Neural Network For Diabetes Classification

abstract: As witnessed in the past year, where the world was brought to the ground by a pandemic, fighting Life-threatening diseases have found greater focus than ever. The first step in fighting a disease is to diagnose it at the right time. Diabetes has been affecting people for a long time and is growing among people faster than ever. The number of people who have Diabetes reached 422 million in 2018, as reported by WHO, and the global prevalence of diabetes among adults above the age of 18 has risen to 8.5%. Now Diabetes is a disease that shows no or very few symptoms among the people affected by it for a long time, and even in some cases, people realize they have it when they have lost any chance of controlling it. So getting Diabetes diagnosed at an early stage can make a huge difference in how one can approach curing it. Moving in this direction in this paper, we have designed a liquid machine learning approach to detect Diabetes with no cost using deep learning. In this work, we have used a dataset of 520 instances. Our approach shows a significant improvement in the previous state-of-the-art results. Its power to generalize well on small dataset deals with the critical problem of lesser data in medical sciences.


title: A Novel Framework for Neural Architecture Search in the Hill Climbing Domain

abstract: Neural networks have now long been used for solving complex problems of image domain, yet designing the same needs manual expertise. Furthermore, techniques for automatically generating a suitable deep learning architecture for a given dataset have frequently made use of reinforcement learning and evolutionary methods which take extensive computational resources and time. We propose a new framework for neural architecture search based on a hill-climbing procedure using morphism operators that makes use of a novel gradient update scheme. The update is based on the aging of neural network layers and results in the reduction in the overall training time. This technique can search in a broader search space which subsequently yields competitive results. We achieve a 4.96% error rate on the CIFAR-10 dataset in 19.4 hours of a single GPU training.


title: Role of tensor terms of the Skyrme energy-density functional on neutron deformed magic numbers in the rare-earth region

abstract: The role of the tensor part of the nuclear interaction is actively investigated in recent years due to experimental advancement yielding new data in nuclei far from the $\beta$-stability line. In this article we study the effect of this part of the nuclear interaction on deformed neutron magic numbers in the rare-earth region within the Skyrme energy-density functional for various TIJ \cite{lesinski:2007} parametrizations. Two quantities signaling magic numbers are considered: two-neutron separation energies and single-particle energies. They are calculated in isotopic series involving well-deformed rare-earth nuclei ranging from $Z=64$ to $Z=72$ in the $N=100$ region. Obtained results show that, whereas the neutron-proton tensor contribution to binding energies is important to reproduce neutron sub-shell closure at $N = 104$ in heavier rare earths Yb ($Z=70$) and Hf ($Z=72$) isotopes, like-particle tensor also plays a role in the single-particle spectrum around Fermi level and is even favored in lighter Gd ($Z=64$) and Dy ($Z=66$) rare-earth isotopes.


title: Density Functional Theory for two-dimensional homogeneous materials

abstract: We study Density Functional Theory models for systems which are translationally invariant in some directions, such as a homogeneous 2-d slab in the 3-d space. We show how the different terms of the energy are modified and we derive reduced equations in the remaining directions. In the Thomas-Fermi model, we prove that there is perfect screening, and provide decay estimates for the electronic density away from the slab. In Kohn-Sham models, we prove that the Pauli principle is replaced by a penalization term in the energy. In the reduced Hartree-Fock model in particular, we prove that the resulting model is well-posed, and provide some properties for the minimizer.


title: General bounds on electronic shot noise in the absence of currents

abstract: We investigate the charge and heat electronic noise in a generic two-terminal mesoscopic conductor in the absence of the corresponding charge and heat currents. Despite these currents being zero, shot noise is generated in the system. We show that, irrespective of the conductor's details and the specific nonequilibrium conditions, the charge shot noise never exceeds its thermal counterpart, thus establishing a general bound. Such a bound does not exist in the case of heat noise, which reveals a fundamental difference between charge and heat transport under zero-current conditions.


title: Distributed Optimization with Coupling Constraints

abstract: In this paper, we develop a novel distributed algorithm for addressing convex optimization with both nonlinear inequality and linear equality constraints, where the objective function can be a general nonsmooth convex function and all the constraints can be fully coupled. Specifically, we first separate the constraints into three groups, and design two primal-dual methods and utilize a virtual-queue-based method to handle each group of the constraints independently. Then, we integrate these three methods in a strategic way, leading to an integrated primal-dual proximal (IPLUX) algorithm, and enable the distributed implementation of IPLUX. We show that IPLUX achieves an $O(1/k)$ rate of convergence in terms of optimality and feasibility, which is stronger than the convergence results of the state-of-the-art distributed algorithms for convex optimization with coupling nonlinear constraints. Finally, IPLUX exhibits competitive practical performance in the simulations.


title: Metal-Oxide Sensor Array for Selective Gas Detection in Mixtures

abstract: We present a monolithic, microfabricated, metal-oxide semiconductor (MOS) sensor array in conjunction with a machine learning algorithm to determine unique fingerprints of individual gases within homogenous mixtures. The array comprises four different metal oxides, and is engineered for independent temperature control and readout from each individual pixel in a multiplexed fashion. The sensor pixels are designed on a very thin membrane to minimize heat dissipation, thereby significantly lowering the overall power consumption ($<$30 $\mu$W average power). The high dimensional data obtained by running the pixels at different temperatures, is used to train our machine learning algorithm with an average accuracy $\sim$ 88$\%$ for high resolution detection and estimation of concentration of individual constituents in a homogenous mixture. While the response of MOS sensors to various gases has been demonstrated, very few studies have investigated the response of these sensors to homogeneous mixtures of gases comprising several gases. We demonstrate this principle for a binary homogeneous mixture of ozone and carbon monoxide, both of which are criteria pollutant gases. Our findings indicate that a multiplicity of MOS elements together with the ability to vary and measure at various temperatures are essential in predicting concentration of individual gases within mixtures, thereby overcoming a key limitation of MOS sensors - poor selectivity. The small form-factor and microfabrication approach of our sensor array also lends itself to CMOS integration paving the way for a platform for wearable and portable applications.


title: Test of beta and antineutrino spectra symmetry in beta-decay

abstract: The mechanism of beta decay in nature is not understood yet. Mirrored energy spectra of electron and antineutrino can clarify the situation. A special experiment is needed to measure antineutrino spectrum from known beta-decaying isotope to compare it with the beta one. One of ongoing experiments with large volume detector can be chosen to make the experiment. Another possibility is to make a special experiment close to a powerful source of mixture of known beta-decaying isotopes. If sufficient differences in shape will be observed the method of antineutrino spectrum calculation should be revised.


title: Reducing charge delocalization error of density functional theory

abstract: The charge delocalization error, besides nondynamic correlation, has been a major challenge to density functional theory. Contemporary functionals undershoot the dissociation of symmetric charged dimers A2+, a simple but stringent test, predict a spurious barrier and improperly delocalize charges for charged molecular clusters. We extend a functional designed for nondynamic correlation to treat the charge delocalization error by modifying the nondynamic correlation for parallel spins. The modified functional eliminates those problems and reduces the multielectron self-interaction error. Furthermore, its results are the closest to those of CCSD(T) in the whole range of the dissociation compared with contemporary functionals. It correctly localizes the net positive charge in (CH4)n+ clusters and predicts a nearly constant ionization potential as a result. Testing of the SIE4x4 set shows that the new functional outperforms a wide variety of functionals assessed for this set in the literature. Overall, we show the feasibility of treating charge delocalization together with nondynamic correlation.


title: Designable Dynamical Systems for the Generalized Landau Scenario and the Nonlinear Complexification of Periodic Orbits

abstract: We have found a way for penetrating the space of the dynamical systems towards systems of arbitrary dimension exhibiting the nonlinear mixing of a large number of oscillation modes through which extraordinarily complex time evolutions arise. The system design is based on assuring the occurrence of a number of Hopf bifurcations in a set of fixed points of a relatively generic system of ordinary differential equations, in which the main peculiarity is that the nonlinearities appear through functions of a linear combination of the system variables. The paper presents the design procedure and a selection of numerical simulations with a variety of designed systems whose dynamical behaviors are really rich and full of unknown features. For concreteness, the presentation is focused to illustrating the oscillatory mixing effects on the periodic orbits, through which the harmonic oscillation born in a Hopf bifurcation becomes successively enriched with the intermittent incorporation of other oscillation modes of higher frequencies while the orbit remains periodic and without necessity of bifurcating instabilities. Even in the absence of a proper mathematical theory covering the nonlinear mixing mechanisms we find enough evidence to expect that the oscillatory scenario be truly scalable concerning the phase space dimension, the multiplicity of involved fixed points and the range of time scales, so that extremely complex but ordered dynamical behaviors could be sustained through it.


title: $FM^2$: Field-matrixed Factorization Machines for Recommender Systems

abstract: Click-through rate (CTR) prediction plays a critical role in recommender systems and online advertising. The data used in these applications are multi-field categorical data, where each feature belongs to one field. Field information is proved to be important and there are several works considering fields in their models. In this paper, we proposed a novel approach to model the field information effectively and efficiently. The proposed approach is a direct improvement of FwFM, and is named as Field-matrixed Factorization Machines (FmFM, or $FM^2$). We also proposed a new explanation of FM and FwFM within the FmFM framework, and compared it with the FFM. Besides pruning the cross terms, our model supports field-specific variable dimensions of embedding vectors, which acts as soft pruning. We also proposed an efficient way to minimize the dimension while keeping the model performance. The FmFM model can also be optimized further by caching the intermediate vectors, and it only takes thousands of floating-point operations (FLOPs) to make a prediction. Our experiment results show that it can out-perform the FFM, which is more complex. The FmFM model's performance is also comparable to DNN models which require much more FLOPs in runtime.


title: Fast-growing series are transcendental

abstract: Let $R$ be a subring of $\mathbb{C}[[z]]$, and let $X \in \mathbb{C}[[z]]$. The Newton-Puiseux Theorem implies that if the coefficients of $X$ grow sufficiently rapidly relative to the coefficients of the series in $R$, then $X$ is transcendental over $R$. We prove an alternative proof of this result by establishing a relationship between the coefficients of $A(X)$ and $A^\prime(X)$, where $A(T)$ is a polynomial over $\mathbb{C}[[z]]$.


title: Evidence of zero point fluctuation of vortices in a very weakly pinned a-MoGe thin film

abstract: In a Type II superconductor, the vortex core behaves like a normal metal. Consequently, the single-particle density of states in the vortex core of a conventional Type II superconductor remains either flat or (for very clean single crystals) exhibits a peak at zero bias due to the formation of Caroli-de Gennes-Matricon bound state inside the core. Here we report an unusual observation from scanning tunneling spectroscopy measurements in a weakly pinned thin film of the conventional s-wave superconductor a-MoGe, namely, that a soft gap in the local density of states continues to exist even at the center of the vortex core. We ascribe this observation to rapid fluctuation of vortices about their mean position that blurs the boundary between the gapless normal core and the gapped superconducting region outside. Analyzing the data as a function of magnetic field we show that the variation of fluctuation amplitude as a function of magnetic field is consistent with quantum zero-point motion of vortices.


title: Data-Driven Incident Detection in Power Distribution Systems

abstract: In a power distribution network with energy storage systems (ESS) and advanced controls, traditional monitoring and protection schemes are not well suited for detecting anomalies such as malfunction of controllable devices. In this work, we propose a data-driven technique for the detection of incidents relevant to the operation of ESS in distribution grids. This approach leverages the causal relationship observed among sensor data streams, and does not require prior knowledge of the system model or parameters. Our methodology includes a data augmentation step which allows for the detection of incidents even when sensing is scarce. The effectiveness of our technique is illustrated through case studies which consider active power dispatch and reactive power control of ESS.


title: Deep NMF Topic Modeling

abstract: Nonnegative matrix factorization (NMF) based topic modeling methods do not rely on model- or data-assumptions much. However, they are usually formulated as difficult optimization problems, which may suffer from bad local minima and high computational complexity. In this paper, we propose a deep NMF (DNMF) topic modeling framework to alleviate the aforementioned problems. It first applies an unsupervised deep learning method to learn latent hierarchical structures of documents, under the assumption that if we could learn a good representation of documents by, e.g. a deep model, then the topic word discovery problem can be boosted. Then, it takes the output of the deep model to constrain a topic-document distribution for the discovery of the discriminant topic words, which not only improves the efficacy but also reduces the computational complexity over conventional unsupervised NMF methods. We constrain the topic-document distribution in three ways, which takes the advantages of the three major sub-categories of NMF -- basic NMF, structured NMF, and constrained NMF respectively. To overcome the weaknesses of deep neural networks in unsupervised topic modeling, we adopt a non-neural-network deep model -- multilayer bootstrap network. To our knowledge, this is the first time that a deep NMF model is used for unsupervised topic modeling. We have compared the proposed method with a number of representative references covering major branches of topic modeling on a variety of real-world text corpora. Experimental results illustrate the effectiveness of the proposed method under various evaluation metrics.


title: An Advection-Diffusion based Filter for Machinable Designs in Topology Optimization

abstract: This paper introduces a simple formulation for topology optimization problems ensuring manufacturability by machining. The method distinguishes itself from existing methods by using the advection-diffusion equation with Robin boundary conditions to perform a filtering of the design variables. The proposed approach is less computationally expensive than the traditional methods used. Furthermore, the approach is easy to implement on unstructured meshes and in a distributed memory setting. Finally, the proposed approach can be performed with few to no continuation steps in any system parameters. Applications are demonstrated with topology optimization on unstructured meshes with up to 64 million elements and up to 29 milling tool directions.


title: A Forty Year Journey

abstract: I try to describe the stepwise progress in proving that massive black holes do exist in the Universe. As compared to forty years ago, measurements have pushed the 'size' of the 4 million solar mass concentration in the Galactic Center downward by almost 10^6, and its density up by 10^18. Looking ahead toward the future, the question is probably no longer whether SgrA* must be a MBH, but rather whether GR is correct on the scales of the event horizon, whether space-time is described by the Kerr metric and whether the 'no hair theorem' holds. Further improvements of the VLT interferometer GRAVITY (to GRAVITY+) and the next generation 25-40m telescopes (the ESO-ELT, the TMT and the GMT) promise further progress. A test of the no hair theorem in the Galactic Center might come from combining the stellar dynamics with EHT measurements of the photon ring of SgrA*.


title: Lorentzian distance functions in contact geometry

abstract: We define a Lorentzian distance function on the group of contactomorphisms of a closed contact manifold. This distance function is continuous with respect to the Hofer norm on the group of contactomorphisms defined by Shelukhin and finite if and only if the group of contactomorphisms is orderable. To prove this we show that intervals defined by the positivity relation are open with respect to the topology induced by the Hofer norm. For orderable Legendrian isotopy classes we show that the Chekanov-type metric defined by Rosen and Zhang is non-degenerate. In this case similar results hold for a Lorentzian distance function on Legendrian isotopy classes. This leads to a natural class of metrics associated to a globally hyperbolic Lorentzian manifold such that its Cauchy hypersurface has a unit co-tangent bundle with orderable isotopy class of the fibres.


title: Maximizing Cosine Similarity Between Spatial Features for Unsupervised Domain Adaptation in Semantic Segmentation

abstract: We propose a novel method that tackles the problem of unsupervised domain adaptation for semantic segmentation by maximizing the cosine similarity between the source and the target domain at the feature level. A segmentation network mainly consists of two parts, a feature extractor and a classification head. We expect that if we can make the two domains have small domain gap at the feature level, they would also have small domain discrepancy at the classification head. Our method computes a cosine similarity matrix between the source feature map and the target feature map, then we maximize the elements exceeding a threshold to guide the target features to have high similarity with the most similar source feature. Moreover, we use a class-wise source feature dictionary which stores the latest features of the source domain to prevent the unmatching problem when computing the cosine similarity matrix and be able to compare a target feature with various source features from various images. Through extensive experiments, we verify that our method gains performance on two unsupervised domain adaptation tasks (GTA5$\to$ Cityscaspes and SYNTHIA$\to$ Cityscapes).


title: An introduction to distributed training of deep neural networks for segmentation tasks with large seismic datasets

abstract: Deep learning applications are drastically progressing in seismic processing and interpretation tasks. However, the majority of approaches subsample data volumes and restrict model sizes to minimise computational requirements. Subsampling the data risks losing vital spatio-temporal information which could aid training whilst restricting model sizes can impact model performance, or in some extreme cases, renders more complicated tasks such as segmentation impossible. This paper illustrates how to tackle the two main issues of training of large neural networks: memory limitations and impracticably large training times. Typically, training data is preloaded into memory prior to training, a particular challenge for seismic applications where data is typically four times larger than that used for standard image processing tasks (float32 vs. uint8). Using a microseismic use case, we illustrate how over 750GB of data can be used to train a model by using a data generator approach which only stores in memory the data required for that training batch. Furthermore, efficient training over large models is illustrated through the training of a 7-layer UNet with input data dimensions of 4096X4096. Through a batch-splitting distributed training approach, training times are reduced by a factor of four. The combination of data generators and distributed training removes any necessity of data 1 subsampling or restriction of neural network sizes, offering the opportunity of utilisation of larger networks, higher-resolution input data or moving from 2D to 3D problem spaces.


title: Towards Unbiased and Accurate Deferral to Multiple Experts

abstract: Machine learning models are often implemented in cohort with humans in the pipeline, with the model having an option to defer to a domain expert in cases where it has low confidence in its inference. Our goal is to design mechanisms for ensuring accuracy and fairness in such prediction systems that combine machine learning model inferences and domain expert predictions. Prior work on "deferral systems" in classification settings has focused on the setting of a pipeline with a single expert and aimed to accommodate the inaccuracies and biases of this expert to simultaneously learn an inference model and a deferral system. Our work extends this framework to settings where multiple experts are available, with each expert having their own domain of expertise and biases. We propose a framework that simultaneously learns a classifier and a deferral system, with the deferral system choosing to defer to one or more human experts in cases of input where the classifier has low confidence. We test our framework on a synthetic dataset and a content moderation dataset with biased synthetic experts, and show that it significantly improves the accuracy and fairness of the final predictions, compared to the baselines. We also collect crowdsourced labels for the content moderation task to construct a real-world dataset for the evaluation of hybrid machine-human frameworks and show that our proposed learning framework outperforms baselines on this real-world dataset as well.


title: Determinantal formulas with major indices

abstract: We give a simple proof of a major index determinant formula in the symmetric group discovered by Krattenthaler and first proved by Thibon using noncommutative symmetric functions. We do so by proving a factorization of an element in the group ring of the symmetric group. By applying similar methods to the groups of signed permutations and colored permutations, we prove determinant formulas in these groups as conjectured by Krattenthaler.


title: Affine Quantum Harmonic Analysis

abstract: We develop a quantum harmonic analysis framework for the affine group. This encapsulates several examples in the literature such as affine localization operators, covariant integral quantizations, and affine quadratic time-frequency representations. In the process, we develop a notion of admissibility for operators and extend well known results to the operator setting. A major theme of the paper is the interaction between operator convolutions, affine Weyl quantization, and admissibility.


title: An Introduction to Modeling Approaches of Active Matter

abstract: This article is based on lecture notes for the Marie Curie Training school "Initial Training on Numerical Methods for Active Matter". It provides an introductory overview of modeling approaches for active matter and is primarily targeted at PhD students (or other readers) who encounter some of these approaches for the first time. The aim of the article is to help put the described modeling approaches into perspective.


title: Imitation Learning with Human Eye Gaze via Multi-Objective Prediction

abstract: Approaches for teaching learning agents via human demonstrations have been widely studied and successfully applied to multiple domains. However, the majority of imitation learning work utilizes only behavioral information from the demonstrator, i.e. which actions were taken, and ignores other useful information. In particular, eye gaze information can give valuable insight towards where the demonstrator is allocating visual attention, and holds the potential to improve agent performance and generalization. In this work, we propose Gaze Regularized Imitation Learning (GRIL), a novel context-aware, imitation learning architecture that learns concurrently from both human demonstrations and eye gaze to solve tasks where visual attention provides important context. We apply GRIL to a visual navigation task, in which an unmanned quadrotor is trained to search for and navigate to a target vehicle in a photorealistic simulated environment. We show that GRIL outperforms several state-of-the-art gaze-based imitation learning algorithms, simultaneously learns to predict human visual attention, and generalizes to scenarios not present in the training data. Supplemental videos and code can be found at https://sites.google.com/view/gaze-regularized-il/.


title: t-SNE, Forceful Colorings and Mean Field Limits

abstract: t-SNE is one of the most commonly used force-based nonlinear dimensionality reduction methods. This paper has two contributions: the first is forceful colorings, an idea that is also applicable to other force-based methods (UMAP, ForceAtlas2,...). In every equilibrium, the attractive and repulsive forces acting on a particle cancel out: however, both the size and the direction of the attractive (or repulsive) forces acting on a particle are related to its properties: the force vector can serve as an additional feature. Secondly, we analyze the case of t-SNE acting on a single homogeneous cluster (modeled by affinities coming from the adjacency matrix of a random k-regular graph); we derive a mean-field model that leads to interesting questions in classical calculus of variations. The model predicts that, in the limit, the t-SNE embedding of a single perfectly homogeneous cluster is not a point but a thin annulus of diameter $\sim k^{-1/4} n^{-1/4}$. This is supported by numerical results. The mean field ansatz extends to other force-based dimensionality reduction methods.


title: Optical Near-Field Electron Microscopy

abstract: Imaging dynamical processes at interfaces and on the nanoscale is of great importance throughout science and technology. While light-optical imaging techniques often cannot provide the necessary spatial resolution, electron-optical techniques damage the specimen and cause dose-induced artefacts. Here, Optical Near-field Electron Microscopy (ONEM) is proposed, an imaging technique that combines non-invasive probing with light, with a high spatial resolution read-out via electron optics. Close to the specimen, the optical near-fields are converted into a spatially varying electron flux using a planar photocathode. The electron flux is imaged using low energy electron microscopy, enabling label-free nanometric resolution without the need to scan a probe across the sample. The specimen is never exposed to damaging electrons.

categories: physics.app-ph cond-mat.mtrl-sci physics.bio-ph physics.ins-det physics.optics


title: Learning for Unconstrained Space-Time Video Super-Resolution

abstract: Recent years have seen considerable research activities devoted to video enhancement that simultaneously increases temporal frame rate and spatial resolution. However, the existing methods either fail to explore the intrinsic relationship between temporal and spatial information or lack flexibility in the choice of final temporal/spatial resolution. In this work, we propose an unconstrained space-time video super-resolution network, which can effectively exploit space-time correlation to boost performance. Moreover, it has complete freedom in adjusting the temporal frame rate and spatial resolution through the use of the optical flow technique and a generalized pixelshuffle operation. Our extensive experiments demonstrate that the proposed method not only outperforms the state-of-the-art, but also requires far fewer parameters and less running time.


title: Twin actor twin delayed deep deterministic policy gradient (TATD3) learning for batch process control

abstract: Control of batch processes is a difficult task due to their complex nonlinear dynamics and unsteady-state operating conditions within batch and batch-to-batch. It is expected that some of these challenges can be addressed by developing control strategies that directly interact with the process and learning from experiences. Recent studies in the literature have indicated the advantage of having an ensemble of actors in actor-critic Reinforcement Learning (RL) frameworks for improving the policy. The present study proposes an actor-critic RL algorithm, namely, twin actor twin delayed deep deterministic policy gradient (TATD3), by incorporating twin actor networks in the existing twin-delayed deep deterministic policy gradient (TD3) algorithm for the continuous control. In addition, two types of novel reward functions are also proposed for TATD3 controller. We showcase the efficacy of the TATD3 based controller for various batch process examples by comparing it with some of the existing RL algorithms presented in the literature.


title: Optimising the mitigation of epidemic spreading through targeted adoption of contact tracing apps

abstract: The ongoing COVID-19 pandemic is the first epidemic in human history in which digital contact-tracing has been deployed at a global scale. Tracking and quarantining all the contacts of individuals who test positive to a virus can help slowing-down an epidemic, but the impact of contact-tracing is severely limited by the generally low adoption of contact-tracing apps in the population. We derive here an analytical expression for the effectiveness of contact-tracing app installation strategies in a SIR model on a given contact graph. We propose a decentralised heuristic to improve the effectiveness of contact tracing under fixed adoption rates, which targets a set of individuals to install contact-tracing apps, and can be easily implemented. Simulations on a large number of real-world contact networks confirm that this heuristic represents a feasible alternative to the current state of the art.