title: Impacts of Heat Decarbonisation on System Adequacy considering Increased Meteorological Sensitivity

abstract: This paper explores the impacts of decarbonisation of heat on demand and subsequently on the generation capacity required to secure against system adequacy standards. Gas demand is explored as a proxy variable for modelling the electrification of heating demand in existing housing stock, with a focus on impacts on timescales of capacity markets (up to four years ahead). The work considers the systemic changes that electrification of heating could introduce, including biases that could be introduced if legacy modelling approaches continue to prevail. Covariates from gas and electrical regression models are combined to form a novel, time-collapsed system model, with demand-weather sensitivities determined using lasso-regularized linear regression. It is shown, using a GB case study with one million domestic heat pump installations per year, that the sensitivity of electrical system demand to temperature (and subsequently sensitivities to cold/warm winter seasons) could increase by 50% following four years of heat demand electrification. A central estimate of 1.75 kW additional peak demand per heat pump is estimated, with variability across three published heat demand profiles leading to a range of more than 14 GW in the most extreme cases. It is shown that the legacy approach of scaling historic demand, as compared to the explicit modelling of heat, could lead to over-procurement of 0.79 GW due to bias in estimates of additional capacity to secure. Failure to address this issue could lead to {\pounds}100m overspend on capacity over ten years.


title: The geometric classification of nilpotent algebras

abstract: We give a geometric classification of $n$-dimensional nilpotent, commutative nilpotent and anticommutative nilpotent algebras. We prove that the corresponding geometric varieties are irreducible, find their dimensions and describe explicit generic families of algebras which define each of these varieties. We show some applications of these results in the study of the length of anticommutative algebras.


title: On the tensor nuclear norm and the total variation regularization for image and video completion

abstract: In the present paper we propose two new algorithms of tensor completion for three-order tensors. The proposed methods consist in minimizing the average rank of the underlying tensor using its approximate function namely the tensor nuclear norm and then the recovered data will be obtained by using the total variation regularisation technique. We will adopt the Alternating Direction Method of Multipliers (ADM), using the tensor T-product, to solve the main optimization problems associated to the two algorithms. In the last section, we present some numerical experiments and comparisons with the most known image completion methods.


title: Fast magnetization reversal of a magnetic nanoparticle induced by cosine chirp microwave field pulse

abstract: We investigate the magnetization reversal of single-domain magnetic nanoparticle driven by the circularly polarized cosine chirp microwave pulse (CCMP). The numerical findings, based on the Landau-Lifshitz-Gilbert equation, reveal that the CCMP is by itself capable of driving fast and energy-efficient magnetization reversal. The microwave field amplitude and initial frequency required by a CCMP are much smaller than that of the linear down-chirp microwave pulse. This is achieved as the frequency change of the CCMP closely matches the frequency change of the magnetization precession which leads to an efficient stimulated microwave energy absorption (emission) by (from) the magnetic particle before (after) it crosses over the energy barrier. We further find that the enhancement of easy-plane shape anisotropy significantly reduces the required microwave amplitude and the initial frequency of CCMP. We also find that there is an optimal Gilbert damping for fast magnetization reversal. These findings may provide a pathway to realize the fast and low-cost memory device.


title: On Calibration and Out-of-domain Generalization

abstract: Out-of-domain (OOD) generalization is a significant challenge for machine learning models. Many techniques have been proposed to overcome this challenge, often focused on learning models with certain invariance properties. In this work, we draw a link between OOD performance and model calibration, arguing that calibration across multiple domains can be viewed as a special case of an invariant representation leading to better OOD generalization. Specifically, we show that under certain conditions, models which achieve \emph{multi-domain calibration} are provably free of spurious correlations. This leads us to propose multi-domain calibration as a measurable and trainable surrogate for the OOD performance of a classifier. We therefore introduce methods that are easy to apply and allow practitioners to improve multi-domain calibration by training or modifying an existing model, leading to better performance on unseen domains. Using four datasets from the recently proposed WILDS OOD benchmark, as well as the Colored MNIST dataset, we demonstrate that training or tuning models so they are calibrated across multiple domains leads to significantly improved performance on unseen test domains. We believe this intriguing connection between calibration and OOD generalization is promising from both a practical and theoretical point of view.


title: Efficient Numerical Methods for Secrecy Capacity of Gaussian MIMO Wiretap Channel

abstract: This paper presents two different low-complexity methods for obtaining the secrecy capacity of multiple-input multiple-output (MIMO) wiretap channel subject to a sum power constraint (SPC). The challenges in deriving computationally efficient solutions to the secrecy capacity problem are due to the fact that the secrecy rate is a difference of convex functions (DC) of the transmit covariance matrix, for which its convexity is only known for \emph{the degraded case}. In the first method, we capitalize on the accelerated DC algorithm, which requires solving a sequence of convex subproblems. In particular, we show that each subproblem indeed admits a water-filling solution. In the second method, based on the equivalent convex-concave reformulation of the secrecy capacity problem, we develop a so-called partial best response algorithm (PBRA). Each iteration of the PBRA is also done in closed form. Simulation results are provided to demonstrate the superior performance of the proposed methods.


title: Diameter of generalized Petersen graphs

abstract: Due to their broad application to different fields of theory and practice, generalized Petersen graphs $GPG(n,s)$ have been extensively investigated. Despite the regularity of generalized Petersen graphs, determining an exact formula for the diameter is still a difficult problem. In their paper, Beenker and Van Lint have proved that if the circulant graph $C_n(1,s)$ has diameter $d$, then $GPG(n,s)$ has diameter at least $d+1$ and at most $d+2$. In this paper, we provide necessary and sufficient conditions so that the diameter of $GPG(n,s)$ is equal to $d+1,$ and sufficient conditions so that the diameter of $GPG(n,s)$ is equal to $d+2.$ Afterwards, we give exact values for the diameter of $GPG(n,s)$ for almost all cases of $n$ and $s.$ Furthermore, we show that there exists an algorithm computing the diameter of generalized Petersen graphs with running time $O$(log$n$).


title: All-Chalcogenide Programmable All-Optical Deep Neural Networks

abstract: Deeplearning algorithms are revolutionising many aspects of modern life. Typically, they are implemented in CMOS-based hardware with severely limited memory access times and inefficient data-routing. All-optical neural networks without any electro-optic conversions could alleviate these shortcomings. However, an all-optical nonlinear activation function, which is a vital building block for optical neural networks, needs to be developed efficiently on-chip. Here, we introduce and demonstrate both optical synapse weighting and all-optical nonlinear thresholding using two different effects in a chalcogenide material photonic platform. We show how the structural phase transitions in a wide-bandgap phase-change material enables storing the neural network weights via non-volatile photonic memory, whilst resonant bond destabilisation is used as a nonlinear activation threshold without changing the material. These two different transitions within chalcogenides enable programmable neural networks with near-zero static power consumption once trained, in addition to picosecond delays performing inference tasks not limited by wire charging that limit electrical circuits; for instance, we show that nanosecond-order weight programming and near-instantaneous weight updates enable accurate inference tasks within 20 picoseconds in a 3-layer all-optical neural network. Optical neural networks that bypass electro-optic conversion altogether hold promise for network-edge machine learning applications where decision-making in real-time are critical, such as for autonomous vehicles or navigation systems such as signal pre-processing of LIDAR systems.


title: Molecular Dynamics Simulations of Active Matter using LAMMPS

abstract: LAMMPS is a widely popular classical Molecular Dynamics package. It was designed for materials modeling but it is well prepared for simulations in Soft Matter. The use packages like LAMMPS has advantages and disadvantages. The main advantage is the optimization of the methods, mainly for parallel computing. The main disadvantage is that, due to the complexity of the code, it ha long learning curve. One purpose of these notes is to shorten that curve for researchers are starting to use LAMMPS to simulate soft active matter. In these notes, we first discuss some Molecular Dynamics methods implemented in LAMMPS. We present an hands-on introduction to first-time users and we finish with an advanced hands-on section, where we implement and test Active Brownian particles simulations.


title: On a nonlinear electromechanical model of nerve

abstract: The generation of action potential brings into play specific mechanosensory stimuli manifest in the variation of membrane capacitance, resulting from the selective membrane permeability to ions exchanges and testifying to the central role of electromechanical processes in the buildup mechanism of nerve impulse. As well established [See e.g. D. Gross et al, Cellular and Molecular Neurobiology vol. 3, p. 89 (1983)], in these electromechanical processes the net instantaneous charge stored in the membrane is regulated by the rate of change of the net fluid density through the membrane, orresponding to the difference in densities of extacellular and intracellular fluids. An electromechanical model is proposed for which mechanical forces are assumed to result from the flow of ionic liquids through the nerve membrane, generating pressure waves stimulating the membrane and hence controlling the net charge stored in the membrane capacitor. The model features coupled nonlinear partial differential equations: the familiar Hodgkin-Huxley's cable equation for the transmembrane voltage in which the membrane capacitor is now a capacitive diode, and the Heimburg-Jackson's nonlinear hydrodynamic equation for the pressure wave controlling the total charge in the membrane capacitor. In the stationary regime, the Hodgkin-Huxley cable equation with variable capacitance reduces to a linear operator problem with zero eigenvalue, the bound states of which can be obtained exactly for specific values of characteristic parameters of the model. In the dynamical regime, numerical simulations of the modified Hodgkin-Huxley equation lead to a variety of typical figures for the transmembrane voltage, reminiscent of action potentials observed in real physiological contexts.


title: Fluid dynamics in clouds: The sum of its parts

abstract: This entry is aimed at describing cloud physics with an emphasis on fluid dynamics. As is inevitable for a review of an enormously complicated problem, it is highly selective and reflects of the authors' focus. The range of scales involved, and the relevant physics at each scale is described. Particular attention is given to droplet dynamics and growth, and turbulence with and without thermodynamics.


title: Geometry near the inner horizon of a rotating, accreting black hole

abstract: Here we present a novel classical model to describe the near-inner horizon geometry of a rotating, accreting black hole. The model assumes spacetime is homogeneous and is sourced by radial streams of a collisionless, null fluid, and it predicts that the standard Poisson-Israel mass inflation phenomenon will be interrupted by a Kasner-like collapse toward a spacelike singularity. Such a model is shown to be valid at the inner horizon of astrophysically realistic black holes through comparison to the conformally-separable model, which provides a natural connection of the Kerr metric to a self-similar, accreting spacetime. We then analyze the behavior of null geodesics in our model, connecting them to the Kerr metric in order to answer the practical question of what an infalling observer approaching the inner horizon might see.


title: GLAM: Graph Learning by Modeling Affinity to Labeled Nodes for Graph Neural Networks

abstract: Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor (kNN) graphs from the given data have shown to give improvements when used with GNNs over other semi-supervised methods. This paper proposes a semi-supervised graph learning method for cases when there are no graphs available. This method learns a graph as a convex combination of the unsupervised kNN graph and a supervised label-affinity graph. The label-affinity graph directly captures all the nodes' label-affinity with the labeled nodes, i.e., how likely a node has the same label as the labeled nodes. This affinity measure contrasts with the kNN graph where the metric measures closeness in the feature space. Our experiments suggest that this approach gives close to or better performance (up to 1.5%), while being simpler and faster (up to 70x) to train, than state-of-the-art graph learning methods. We also conduct several experiments to highlight the importance of individual components and contrast them with state-of-the-art methods.


title: Effects of $N(2000){5/2}^+$ on $\gamma p \to K^+ \Lambda(1405)$

abstract: The photoproduction reaction of $\gamma p \to K^+\Lambda(1405)$ is investigated based on an effective Lagrangian approach at the tree-level approximation with the purpose of understanding the reaction mechanism and extracting the resonance contents and the associated resonance parameters in this reaction. Apart from the $t$-channel $K$ and $K^\ast$ exchanges, $s$-channel nucleon ($N$) exchange, $u$-channel $\Sigma$, $\Lambda$, and $\Lambda(1405)$ exchanges, and generalized contact term, the exchanges of a minimum number of $N$ resonances in the $s$ channel are taken into account in constructing the reaction amplitudes to describe the experimental data. It is found that by introducing the $N(2000){5/2}^+$ resonance exchange in the $s$ channel, one can reproduce the most recent differential cross-section data from the CLAS Collaboration quite well. Further analysis shows that the cross sections of $\gamma p \to K^+\Lambda(1405)$ at high energies are dominated by the $t$-channel $K$ exchange, while the contributions from the $s$-channel $N$ and $N(2000){5/2}^+$ exchanges are rather significant to the cross sections in the near-threshold energy region. Predictions for the beam and target asymmetries for $\gamma p \to K^+\Lambda(1405)$ are given.


title: Analyzing Novel Grant-Based and Grant-Free Access Schemes for Small Data Transmission

abstract: Fifth Generation (5G) New Radio (NR) does not support data transmission during random access (RA) procedures, which results in unnecessary control signalling overhead and power consumption, especially for small data transmission (SDT). Motivated by this, 3GPP has proposed 4/2-step SDT RA schemes based on the existing grant-based (4-step) and grant-free (2-step) RA schemes, with the aim to enable data transmission during RA procedures in Radio Resource Control (RRC) Inactive state. To compare the 4/2-step SDT RA schemes with the benchmark 4/2-step RA schemes, we provide a spatio-temporal analytical framework to evaluate the RA schemes, which jointly models the preamble detection, Physical Uplink Shared Channel (PUSCH) decoding, and data transmission procedures. Based on this analytical model, we derive the analytical expressions for the overall packet transmission success probability and average throughput in each RACH attempt. We also derive the average energy consumption in each RACH attempt. Our results show that 2-step SDT RA scheme provides the highest overall packet transmission success probability, and the lowest average energy consumption, but the performance gain decreases with the increase of device intensity.


title: Gerbes in Geometry, Field Theory, and Quantisation

abstract: This is a mostly self-contained survey article about bundle gerbes and some of their recent applications in geometry, field theory, and quantisation. We cover the definition of bundle gerbes with connection and their morphisms, and explain the classification of bundle gerbes with connection in terms of differential cohomology. We then survey how the surface holonomy of bundle gerbes combines with their transgression line bundles to yield a smooth bordism-type field theory. Finally, we exhibit the use of bundle gerbes in geometric quantisation of 2-plectic as well as 1- and 2-shifted symplectic forms. This generalises earlier applications of gerbes to the prequantisation of quasi-symplectic groupoids.


title: VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning

abstract: The ability to quickly learn from a small quantity oftraining data widens the range of machine learning applications. In this paper, we propose a data-efficient image captioning model, VisualGPT, which leverages the linguistic knowledge from a large pretrained language model(LM). A crucial challenge is to balance between the use of visual information in the image and prior linguistic knowledge acquired from pretraining. We designed a novel self-resurrecting encoder-decoder attention mechanism to quickly adapt the pretrained LM as the language decoder ona small amount of in-domain training data. The proposed self-resurrecting activation unit produces sparse activations but has reduced susceptibility to zero gradients. We train the proposed model, VisualGPT, on 0.1%, 0.5% and 1% of MSCOCO and Conceptual Captions training data. Under these conditions, we outperform the best baseline model by up to 10.8% CIDEr on MS COCO and upto 5.4% CIDEr on Conceptual Captions. Further, Visual-GPT achieves the state-of-the-art result on IU X-ray, a medical report generation dataset. To the best of our knowledge, this is the first work that improves data efficiency of image captioning by utilizing LM pretrained on unimodal data. Our code is available at: https://github.com/Vision-CAIR/VisualGPT.


title: Numerical analysis of a topology optimization problem for Stokes flow

abstract: T. Borrvall and J. Petersson [Topology optimization of fluids in Stokes flow, International Journal for Numerical Methods in Fluids 41 (1) (2003) 77--107] developed the first model for topology optimization of fluids in Stokes flow. They proved the existence of minimizers in the infinite-dimensional setting and showed that a suitably chosen finite element method will converge in a weak(-*) sense to an unspecified solution. In this work, we prove novel regularity results and extend their numerical analysis. In particular, given an isolated local minimizer to the infinite-dimensional problem, we show that there exists a sequence of finite element solutions, satisfying necessary first-order optimality conditions, that strongly converges to it. We also provide the first numerical investigation into convergence rates.


title: Sombor index of certain graphs

abstract: Let $G=(V,E)$ be a finite simple graph. The Sombor index $SO(G)$ of $G$ is defined as $\sum_{uv\in E(G)}\sqrt{d_u^2+d_v^2}$, where $d_u$ is the degree of vertex $u$ in $G$. In this paper, we study this index for certain graphs and we examine the effects on $SO(G)$ when $G$ is modified by operations on vertex and edge of $G$. Also we present bounds for the Sombor index of join and corona product of two graphs.


title: NUBOT: Embedded Knowledge Graph With RASA Framework for Generating Semantic Intents Responses in Roman Urdu

abstract: The understanding of the human language is quantified by identifying intents and entities. Even though classification methods that rely on labeled information are often used for the comprehension of language understanding, it is incredibly time consuming and tedious process to generate high propensity supervised datasets. In this paper, we present the generation of accurate intents for the corresponding Roman Urdu unstructured data and integrate this corpus in RASA NLU module for intent classification. We embed knowledge graph with RASA Framework to maintain the dialog history for semantic based natural language mechanism for chatbot communication. We compare results of our work with existing linguistic systems combined with semantic technologies. Minimum accuracy of intents generation is 64 percent of confidence and in the response generation part minimum accuracy is 82.1 percent and maximum accuracy gain is 96.7 percent. All the scores refers to log precision, recall, and f1 measure for each intents once summarized for all. Furthermore, it creates a confusion matrix represents that which intents are ambiguously recognized by approach.


title: Some remarks on vector valued distributions

abstract: We argue that the fundamental solution corresponding to a maximal rank differential operator, where the symbol is regarded as a vector valued distribution, is not necessarily very regular. Thus, for a fundamental solution, the property of being very regular, is not invariant to change of local coordinates.


title: A comprehensive analysis using 9 dark matter halo models on the spiral galaxy NGC 4321

abstract: This paper addressed the dark matter analysis on the spiral galaxy NGC 4321 (M100) by considering the nine different dark matter profiles so far lacking in the scientific literature, i.e. Pseudoisothermal, Burkert, NFW, Moore, Einasto, core-modified, DC14, coreNFW and Lucky13 profiles. In this paper, we analyzed the rotation curve analysis on the galaxy NGC 4321 by using nonlinear fitting of star, gaseous and dark matter halo equations with selected VLA HI observation data. Among the nine dark matter profiles, four dark matter profiles (DC14, Lucky13, Burkert and Moore profiles) showed declining features and hence found to be not suitable for this galaxy. This is concluded to be mainly due to the characteristics of those dark matter profiles and also due to the varying levels of problems within the inner regions fittings. For the remaining five accepted dark matter profiles, we further conducted analysis by using the reduced chi-square test. Four out of the five accepted dark matter profiles lie within the range of 0.40 < reduced chi-square < 1.70, except for the case of the core-modified profile. In addition, Pseudoisothermal profile achieved the best fitting i.e. reduced chi-square nearest to 1, mainly due to its linearity in the inner region and flatness at large radii.


title: Analysis methods and code for very high-precision mass measurements of unstable isotopes

abstract: We present a robust analysis code developed in the Python language and incorporating libraries of the ROOT data analysis framework for the state-of-the-art mass spectrometry method called phase-imaging ion-cyclotron-resonance (PI-ICR). A step-by-step description of the dataset construction and analysis algorithm is given. The code features a new phase-determination approach that offers up to 10 times smaller statistical uncertainties. This improvement in statistical uncertainty is confirmed using extensive Monte-Carlo simulations and allows for very high-precision studies of exotic nuclear masses to test, among others, the standard model of particle physics.


title: Synthetic Galaxy Clusters and Observations Based on Dark Energy Survey Year 3 Data

abstract: We develop a novel data-driven method for generating synthetic optical observations of galaxy clusters. In cluster weak lensing, the interplay between analysis choices and systematic effects related to source galaxy selection, shape measurement and photometric redshift estimation can be best characterized in end-to-end tests going from mock observations to recovered cluster masses. To create such test scenarios, we measure and model the photometric properties of galaxy clusters and their sky environments from the Dark Energy Survey Year 3 (DES Y3) data in two bins of cluster richness $\lambda\in[30;\,45)$, $\lambda\in[45;\,60)$ and three bins in cluster redshift ($z\in[0.3;\,0.35)$, $z\in[0.45;\,0.5)$ and $z\in[0.6;\,0.65)$. Using deep-field imaging data we extrapolate galaxy populations beyond the limiting magnitude of DES Y3 and calculate the properties of cluster member galaxies via statistical background subtraction. We construct mock galaxy clusters as random draws from a distribution function, and render mock clusters and line-of-sight catalogs into synthetic images in the same format as actual survey observations. Synthetic galaxy clusters are generated from real observational data, and thus are independent from the assumptions inherent to cosmological simulations. The recipe can be straightforwardly modified to incorporate extra information, and correct for survey incompleteness. New realizations of synthetic clusters can be created at minimal cost, which will allow future analyses to generate the large number of images needed to characterize systematic uncertainties in cluster mass measurements.


title: Observation of mode splitting in artificial spin ice

abstract: We report the dependence of the magnetization dynamics in a square artificial spin-ice lattice on the in-plane magnetic field angle. Using two complementary measurement techniques - broadband ferromagnetic resonance and micro-focused Brillouin light scattering spectroscopy - we systematically study the evolution of the lattice dynamics, both for a coherent radiofrequency excitation and an incoherent thermal excitation of spin dynamics. We observe a splitting of modes facilitated by inter-element interactions that can be controlled by the external field angle and magnitude. Detailed time-dependent micromagnetic simulations reveal that the split modes are localized in different regions of the square network. This observation suggests that it is possible to disentangle modes with different spatial profiles by tuning the external field configuration.


title: Simplest Non-Regular Deterministic Context-Free Language

abstract: We introduce a new notion of C-simple problems for a class C of decision problems (i.e. languages), w.r.t. a particular reduction. A problem is C-simple if it can be reduced to each problem in C. This can be viewed as a conceptual counterpart to C-hard problems to which all problems in C reduce. Our concrete example is the class of non-regular deterministic context-free languages (DCFL'), with a truth-table reduction by Mealy machines (which proves to be a preorder). The main technical result is a proof that the DCFL' language $L=\{0^n1^n; n\geq 1\}$ is DCFL'-simple, which can thus be viewed as the simplest problem in the class DCFL'. This result has already provided an application, to the computational model of neural networks 1ANN at the first level of analog neuron hierarchy. This model was proven not to recognize $L$, by using a specialized technical argument that can hardly be generalized to other languages in DCFL'. By the result that $L$ is DCFL'-simple, w.r.t. the reduction that can be implemented by 1ANN, we immediately obtain that 1ANN cannot accept any language in DCFL'. It thus seems worthwhile to explore if looking for C-simple problems in other classes C under suitable reductions could provide effective tools for expanding the lower-bound results known for single problems to the whole classes of problems.


title: Typically bounding torsion on elliptic curves with rational $j$-invariant

abstract: A family $\mathcal{F}$ of elliptic curves defined over number fields is said to be typically bounded in torsion if the torsion subgroups $E(F)[$tors$]$ of those elliptic curves $E_{/F}\in \mathcal{F}$ can be made uniformly bounded after removing from $\mathcal{F}$ those whose number field degrees lie in a subset of $\mathbb{Z}^+$ with arbitrarily small upper density. For every number field $F$, we prove unconditionally that the family $\mathcal{E}_F$ of elliptic curves defined over number fields and with $F$-rational $j$-invariant is typically bounded in torsion. For any integer $d\in\mathbb{Z}^+$, we also strengthen a result on typically bounding torsion for the family $\mathcal{E}_d$ of elliptic curves defined over number fields and with degree $d$ $j$-invariant.


title: Thermal lensing-induced soliton molecules in beta-phase Gallium Oxide

abstract: In recent years, beta gallium oxide (beta-\ce{Ga2O3}) has become the most investigated isomorph of gallium oxide polymorphs, due to the great potential it represents for applications in optoelectronics and photonics for solar technology, particularly in blind ultraviolet photodetector solar cells (SBUV) designs. To optimize its use in these applications, and to identify possible new features, knowledge of its fundamental properties is relevant. In this respect, optical, thermal and electronic properties of beta-\ce{Ga2O3} have been studied expriementally, providing evidence of a wide-band inorganic and transparent semiconductor with a Kerr nonlinearity. Thermo-optical properties of the material, probed in SBUV sensing experiments, have highlighted a sizable heat diffusion characterized by a temperature gradient along the path of optical beams, quadratic in beam position and promoting a refractive-index change with temperature. The experimentally observed Kerr nonlinearity together with the thermally induced birefringence, point unambiguously to a possible formation of soliton molecules during propagation of high-intensity fields in beta-\ce{Ga2O3}. To put this conjecture on a firm ground we propose a theoretical analysis, based on the cubic nonlinear Schroedinger equation in 1+1 spatial dimension, in which thermal lensing creates an effective potential quadratic in the coordinate of beam position. Using the non-isospectral inverse-scattering transform method, the exact one-soliton solution to the propagation equation is obtained. This solution features a bound state of entangled pulses forming a soliton molecule, in which pulses are more or less entangled depending on characteristic parameters of the system.


title: General-relativistic hydrodynamics of non-perfect fluids: 3+1 conservative formulation and application to viscous black-hole accretion

abstract: We consider the relativistic hydrodynamics of non-perfect fluids with the goal of determining a formulation that is suited for numerical integration in special-relativistic and general-relativistic scenarios. To this end, we review the various formulations of relativistic second-order dissipative hydrodynamics proposed so far and present in detail a particular formulation that is fully general, causal, and can be cast into a 3+1 flux-conservative form, as the one employed in modern numerical-relativity codes. As an example, we employ a variant of this formulation restricted to a relaxation-type equation for the bulk viscosity in the general-relativistic magnetohydrodynamics code $\texttt{BHAC}$. After adopting the formulation for a series of standard and non-standard tests in 1+1-dimensional special-relativistic hydrodynamics, we consider a novel general-relativistic scenario, namely, the stationary, spherically symmetric, viscous accretion onto a black hole. The newly developed solution $-$ which can exhibit even considerable deviations from the inviscid counterpart $-$ can be used as a testbed for numerical codes simulating non-perfect fluids on curved backgrounds.


title: Soliton-mode proliferation induced by cross-phase modulation of harmonic waves by a dark-soliton crystal in optical media

abstract: The generation of high-intensity optical fields from harmonic-wave photons, interacting via a cross-phase modulation with dark solitons both propagating in a Kerr nonlinear medium, is examined. The focus is on a pump consisting of time-entangled dark-soliton patterns, forming a periodic waveguide along the path of the harmonic-wave probe. It is shown that an increase of the strength of cross-phase modulation respective to the self-phase modulation, favors soliton-mode proliferation in the bound-state spectrum of the trapped harmonic-wave probe. The induced soliton modes, which display the structures of periodic soliton lattices, are not just rich in numbers, they also form a great diversity of population of soliton crystals with a high degree of degeneracy.


title: Robotic Contact Juggling

abstract: We define "robotic contact juggling" to be the purposeful control of the motion of a three-dimensional smooth object as it rolls freely on a motion-controlled robot manipulator, or "hand." While specific examples of robotic contact juggling have been studied before, in this paper we provide the first general formulation and solution method for the case of an arbitrary smooth object in single-point rolling contact on an arbitrary smooth hand. Our formulation splits the problem into four subproblems: (1) deriving the second-order rolling kinematics; (2) deriving the three-dimensional rolling dynamics; (3) planning rolling motions that satisfy the rolling dynamics; and (4) feedback stabilization of planned rolling trajectories. The theoretical results are demonstrated in simulation and experiment using feedback from a high-speed vision system.


title: Laser dynamics in nonlinear transparent media with electron plasma generation: effects of electron-hole radiative recombinations

abstract: The performance of optical devices manufactured via laser micromachining on nonlinear transparent materials, relies usually on three main factors which are the characteristic laser parameters (i.e. the laser power, pulse duration and pulse repetition rate), characteristic properties of host materials (e.g. their chromatic dispersions, optical nonlinearities or self-focusing features, etc.) and the relative importance of physical processes such as the avalanche impact ionization, multiphoton ionization and electron-hole radiative recombination processes. These factors act in conjunction to impose the regime of laser operation, in particular their competition determines the appropriate laser operation regime. In this work a theoretical study is proposed to explore the effects of the competition between multiphoton absorption, plasma ionization and electron-hole radiative recombination processes, on the laser dynamics in transparent materials with Kerr nonlinearity. The study rests on a model consisting of a K-order nonlinear complex Ginzburg-Landau equation, coupled to a first-order equation describing time variation of the electron plasma density. An analysis of stability of continuous waves, following the modulational-instability approach, reveals that the combination of multiphoton absorption and electron-hole radiative recombination processes can be detrimental or favorable to continuous-wave operation, depending on the group-velocity dispersion of the host medium. Numerical simulations of the model equations in the full nonlinear regime, reveal the eixstence of pulse trains the amplitudes of which are enhanced by the radiative recombination processes. Numerical results for the density of the induced electron plasma feature two distinct regimes of time evolution, depending on the strength of the electron-hole radiative recombination processes.


title: An Evaluation of Edge TPU Accelerators for Convolutional Neural Networks

abstract: Edge TPUs are a domain of accelerators for low-power, edge devices and are widely used in various Google products such as Coral and Pixel devices. In this paper, we first discuss the major microarchitectural details of Edge TPUs. Then, we extensively evaluate three classes of Edge TPUs, covering different computing ecosystems, that are either currently deployed in Google products or are the product pipeline, across 423K unique convolutional neural networks. Building upon this extensive study, we discuss critical and interpretable microarchitectural insights about the studied classes of Edge TPUs. Mainly, we discuss how Edge TPU accelerators perform across convolutional neural networks with different structures. Finally, we present our ongoing efforts in developing high-accuracy learned machine learning models to estimate the major performance metrics of accelerators such as latency and energy consumption. These learned models enable significantly faster (in the order of milliseconds) evaluations of accelerators as an alternative to time-consuming cycle-accurate simulators and establish an exciting opportunity for rapid hard-ware/software co-design.


title: GIST: Distributed Training for Large-Scale Graph Convolutional Networks

abstract: The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the number of model parameters. Although some work has explored training on large-scale graphs (e.g., GraphSAGE, ClusterGCN, etc.), we pioneer efficient training of large-scale GCN models (i.e., ultra-wide, overparameterized models) with the proposal of a novel, distributed training framework. Our proposed training methodology, called GIST, disjointly partitions the parameters of a GCN model into several, smaller sub-GCNs that are trained independently and in parallel. In addition to being compatible with all GCN architectures and existing sampling techniques for efficient GCN training, GIST i) improves model performance, ii) scales to training on arbitrarily large graphs, iii) decreases wall-clock training time, and iv) enables the training of markedly overparameterized GCN models. Remarkably, with GIST, we train an astonishgly-wide 32,768-dimensional GraphSAGE model, which exceeds the capacity of a single GPU by a factor of 8x, to SOTA performance on the Amazon2M dataset.


title: Soft supersymmetry breaking terms and lepton flavor violations in modular flavor models

abstract: We study the soft supersymmetry (SUSY) breaking terms due to the modulus F-term in the modular flavor models of leptons. It is found that the soft SUSY breaking terms are constrained by the modular forms, and specific patterns are derived. Those phenomenological implications are discussed in such as the lepton flavor violation, $\mu \rightarrow e + \gamma$ decay. In order to examine numerically, two modular flavor $A_4$ models are taken. The SUSY breaking scale is significantly constrained by inputting the observed upper bound of the $\mu \rightarrow e + \gamma$ decay. The SUSY mass scale is larger than around $8$ TeV and $5$ TeV for the two $A_4$ models, respectively. Therefore, the current experimental upper bound for the $\mu \to e + \gamma$ decay corresponds to the new physics of the SUSY particle at the $5$ -- $10$ TeV scale in the modular flavor models. The predicted branching ratio depends on a modulus $\tau$ significantly. It decreases of one order at the large ${\rm Im}\,\tau$. We also calculate the branching ratios of tauon decays to $e + \gamma$ and $\mu + \gamma$. Predicted ones are at most ${\cal O}(10^{-15})$, which are much below the current experimental bounds.


title: Dynamic Selective Positioning for High-Precision Accuracy in 5G NR V2X Networks

abstract: The capability to achieve high-precision positioning accuracy has been considered as one of the most critical requirements for vehicle-to-everything (V2X) services in the fifth-generation (5G) cellular networks. The non-line-of-sight (NLOS) connectivity, coverage, reliability requirements, the minimum number of available anchors, and bandwidth limitations are among the main challenges to achieve high accuracy in V2X services. This work provides an overview of the potential solutions to provide the new radio (NR) V2X users (UEs) with high positioning accuracy in the future 3GPP releases. In particular, we propose a novel selective positioning solution to dynamically switch between different positioning technologies to improve the overall positioning accuracy in NR V2X services, taking into account the locations of V2X UEs and the accuracy of the collected measurements. Furthermore, we use high-fidelity system-level simulations to evaluate the performance gains of fusing the positioning measurements from different technologies in NR V2X services. Our numerical results show that the proposed hybridized schemes achieve a positioning error $\boldsymbol{\leq}$ 3 m with $\boldsymbol{\approx}$ 76\% availability compared to $\boldsymbol{\approx}$ 55\% availability when traditional positioning methods are used. The numerical results also reveal a potential gain of $\boldsymbol{\approx}$ 56\% after leveraging the road-side units (RSUs) to improve the tail of the UE's positioning error distribution, i.e., worst-case scenarios, in NR V2X services.


title: Challenges for the future of tandem photovoltaics on the path to terawatt levels: A technology review

abstract: As the photovoltaic sector approaches 1 TW in cumulative installed capacity, we provide an overview of the current challenges to achieve further technological improvements. On the raw materials side, we see no fundamental limitation to expansion in capacity of the current market technologies, even though basic estimates predict that the PV sector will become the largest consumer of Ag in the world after 2030. On the other hand, recent market data on PV costs indicates that the largest cost fraction is now infrastructure and area-related, and nearly independent of the core cell technology. Therefore, additional value adding is likely to proceed via an increase in energy yield metrics such as the power density and/or efficiency of the PV module. However, current market technologies are near their fundamental detailed balance efficiency limits. The transition to multijunction PV in tandem configurations is regarded as the most promising path to surpass this limitation and increase the power per unit area of PV modules. So far, each specific multijunction concept faces particular obstacles that have prevented their upscaling, but the field is rapidly improving. In this review work, we provide a global comparison between the different types of multijunction concepts, including III-Vs, Si-based tandems and the emergence of perovskite/Si devices. Coupled with analyses of new notable developments in the field, we discuss the challenges common to different multijunction cell architectures, and the specific challenges of each type of device, both on a cell level and on a module integration level. From the analysis, we conclude that several tandem concepts are nearing the disruption level where a breakthrough into mainstream PV is possible.


title: On the base size of the symmetric and the alternating group acting on partitions

abstract: Given three positive integers $n,a,b$ with $n=ab$, we determine the base size of the symmetric group and of the alternating group of degree $n$ in their action on the set of partitions into $b$ parts having cardinality $a$.


title: A Note on Taylor's Expansion and Mean Value Theorem With Respect to a Random Variable

abstract: We introduce a stochastic version of Taylor's expansion and Mean Value Theorem, originally proved by Aliprantis and Border (1999), and extend them to a multivariate case. For a univariate case, the theorem asserts that "suppose a real-valued function $f$ has a continuous derivative $f'$ on a closed interval $I$ and $X$ is a random variable on a probability space $(\Omega, \mathcal{F}, P)$. Fix $a \in I$, there exists a \textit{random variable} $\xi$ such that $\xi(\omega) \in I$ for every $\omega \in \Omega$ and $f(X(\omega)) = f(a) + f'(\xi(\omega))(X(\omega) - a)$." The proof is not trivial. By applying these results in statistics, one may simplify some details in the proofs of the Delta method or the asymptotic properties for a maximum likelihood estimator. In particular, when mentioning "there exists $\theta ^ *$ between $\hat{\theta}$ (a maximum likelihood estimator) and $\theta_0$ (the true value)", a stochastic version of Mean Value Theorem guarantees $\theta ^ *$ is a random variable (or a random vector).


title: Cybersecurity Awareness Platform with Virtual Coach and Automated Challenge Assessment

abstract: Over the last years, the number of cyber-attacks on industrial control systems has been steadily increasing. Among several factors, proper software development plays a vital role in keeping these systems secure. To achieve secure software, developers need to be aware of secure coding guidelines and secure coding best practices. This work presents a platform geared towards software developers in the industry that aims to increase awareness of secure software development. The authors also introduce an interactive game component, a virtual coach, which implements a simple artificial intelligence engine based on the laddering technique for interviews. Through a survey, a preliminary evaluation of the implemented artifact with real-world players (from academia and industry) shows a positive acceptance of the developed platform. Furthermore, the players agree that the platform is adequate for training their secure coding skills. The impact of our work is to introduce a new automatic challenge evaluation method together with a virtual coach to improve existing cybersecurity awareness training programs. These training workshops can be easily held remotely or off-line.


title: Raising Secure Coding Awareness for Software Developers in the Industry

abstract: Many industrial IT security standards and policies mandate the usage of a secure coding methodology in the software development process. This implies two different aspects: first, secure coding must be based on a set of secure coding guidelines, and second software developers must be aware of these secure coding practices. On the one side, secure coding guidelines seems a bit like a black-art: while there exist abstract guidelines that are widely accepted, low-level secure coding guidelines for different programming languages are scarce. On the other side, once a set of secure coding guidelines is chosen, a good methodology is needed to make them known by the people which should be using them, i.e. software developers. Motivated both by the secure coding requirements from industry standards and also by the mandate to train staff on IT security by the global industry initiative "Charter of Trust", this paper presents an overview of important research questions on how to choose secure coding guidelines and on how to raise software developer awareness for secure coding using serious games.


title: CyberSecurity Challenges: Serious Games for Awareness Training in Industrial Environments

abstract: Awareness of cybersecurity topics, e.g., related to secure coding guidelines, enables software developers to write secure code. This awareness is vital in industrial environments for the products and services in critical infrastructures. In this work, we introduce and discuss a new serious game designed for software developers in the industry. This game addresses software developers' needs and is shown to be well suited for raising secure coding awareness of software developers in the industry. Our work results from the experience of the authors gained in conducting more than ten CyberSecurity Challenges in the industry. The presented game design, which is shown to be well accepted by software developers, is a novel alternative to traditional classroom training. We hope to make a positive impact in the industry by improving the cybersecurity of products at their early production stages.


title: A Novel Key Generation Scheme Using Quaternary PUF Responses and Wiretap Polar Coding

abstract: Physical unclonable functions (PUFs) are widely considered in secret key generation for resource constrained devices. However, PUFs require additional hardware overhead. In this paper, we focus on developing a PUF-efficient, robust, and secure key generation scheme. First, a novel method for extracting quaternary PUF responses is proposed to increase the entropy of a PUF response, in which a 2-bit response is extracted from evaluating a single PUF cell multiple times. The probability masses of the responses can be adjusted by setting parameters appropriately. Then, a chosen secret model based fuzzy extractor (FE) is designed to extract secret keys from the quaternary PUF responses. To improve the security of this FE, it is modeled as a wiretap channel system, and wiretap polar coding is adopted to reduce secrecy leakage. An upper bound of secrecy leakage is also given in this paper, and it suggests that an arbitrarily small (even zero) leakage can be achieved by properly choosing parameters of the quaternary PUF responses generation. Comparison results show that the required number of PUF cells to achieve the same level of secrecy in our scheme is as low as half that of the state-of-the-art schemes.


title: Adaptive dose-response studies to establish proof-of-concept in learning-phase clinical trials

abstract: In learning-phase clinical trials in drug development, adaptive designs can be efficient and highly informative when used appropriately. In this article, we extend the multiple comparison procedures with modeling techniques (MCP-Mod) procedure with generalized multiple contrast tests (GMCTs) to two-stage adaptive designs for establishing proof-of-concept. The results of an interim analysis of first-stage data are used to adapt the candidate dose-response models and the dosages studied in the second stage. GMCTs are used in both stages to obtain stage-wise p-values, which are then combined to determine an overall p-value. An alternative approach is also considered that combines the t-statistics across stages, employing the conditional rejection probability (CRP) principle to preserve the Type I error probability. Simulation studies demonstrate that the adaptive designs are advantageous compared to the corresponding tests in a non-adaptive design if the selection of the candidate set of dose-response models is not well informed by evidence from preclinical and early-phase studies.


title: MHDeep: Mental Health Disorder Detection System based on Body-Area and Deep Neural Networks

abstract: Mental health problems impact quality of life of millions of people around the world. However, diagnosis of mental health disorders is a challenging problem that often relies on self-reporting by patients about their behavioral patterns. Therefore, there is a need for new strategies for diagnosis of mental health problems. The recent introduction of body-area networks consisting of a plethora of accurate sensors embedded in smartwatches and smartphones and deep neural networks (DNNs) points towards a possible solution. However, disease diagnosis based on WMSs and DNNs, and their deployment on edge devices, remains a challenging problem. To this end, we propose a framework called MHDeep that utilizes commercially available WMSs and efficient DNN models to diagnose three important mental health disorders: schizoaffective, major depressive, and bipolar. MHDeep uses eight different categories of data obtained from sensors integrated in a smartwatch and smartphone. Due to limited available data, MHDeep uses a synthetic data generation module to augment real data with synthetic data drawn from the same probability distribution. We use the synthetic dataset to pre-train the DNN models, thus imposing a prior on the weights. We use a grow-and-prune DNN synthesis approach to learn both the architecture and weights during the training process. We use three different data partitions to evaluate the MHDeep models trained with data collected from 74 individuals. We conduct data instance level and patient level evaluations. MHDeep achieves an average test accuracy of 90.4%, 87.3%, and 82.4%, respectively, for classifications between healthy instances and schizoaffective disorder instances, major depressive disorder instances, and bipolar disorder instances. At the patient level, MHDeep DNNs achieve an accuracy of 100%, 100%, and 90.0% for the three mental health disorders, respectively.


title: Raising Security Awareness using Cybersecurity Challenges in Embedded Programming Courses

abstract: Security bugs are errors in code that, when exploited, can lead to serious software vulnerabilities. These bugs could allow an attacker to take over an application and steal information. One of the ways to address this issue is by means of awareness training. The Sifu platform was developed in the industry, for the industry, with the aim to raise software developers' awareness of secure coding. This paper extends the Sifu platform with three challenges that specifically address embedded programming courses, and describes how to implement these challenges, while also evaluating the usefulness of these challenges to raise security awareness in an academic setting. Our work presents technical details on the detection mechanisms for software vulnerabilities and gives practical advice on how to implement them. The evaluation of the challenges is performed through two trial runs with a total of 16 participants. Our preliminary results show that the challenges are suitable for academia, and can even potentially be included in official teaching curricula. One major finding is an indicator of the lack of awareness of secure coding by undergraduates. Finally, we compare our results with previous work done in the industry and extract advice for practitioners.


title: Understanding and Enhancing the Use of Context for Machine Translation

abstract: To understand and infer meaning in language, neural models have to learn complicated nuances. Discovering distinctive linguistic phenomena from data is not an easy task. For instance, lexical ambiguity is a fundamental feature of language which is challenging to learn. Even more prominently, inferring the meaning of rare and unseen lexical units is difficult with neural networks. Meaning is often determined from context. With context, languages allow meaning to be conveyed even when the specific words used are not known by the reader. To model this learning process, a system has to learn from a few instances in context and be able to generalize well to unseen cases. The learning process is hindered when training data is scarce for a task. Even with sufficient data, learning patterns for the long tail of the lexical distribution is challenging. In this thesis, we focus on understanding certain potentials of contexts in neural models and design augmentation models to benefit from them. We focus on machine translation as an important instance of the more general language understanding problem. To translate from a source language to a target language, a neural model has to understand the meaning of constituents in the provided context and generate constituents with the same meanings in the target language. This task accentuates the value of capturing nuances of language and the necessity of generalization from few observations. The main problem we study in this thesis is what neural machine translation models learn from data and how we can devise more focused contexts to enhance this learning. Looking more in-depth into the role of context and the impact of data on learning models is essential to advance the NLP field. Moreover, it helps highlight the vulnerabilities of current neural networks and provides insights into designing more robust models.


title: Unsupervised Medical Image Alignment with Curriculum Learning

abstract: We explore different curriculum learning methods for training convolutional neural networks on the task of deformable pairwise 3D medical image registration. To the best of our knowledge, we are the first to attempt to improve performance by training medical image registration models using curriculum learning, starting from an easy training setup in the first training stages, and gradually increasing the complexity of the setup. On the one hand, we consider two existing curriculum learning approaches, namely curriculum dropout and curriculum by smoothing. On the other hand, we propose a novel and simple strategy to achieve curriculum, namely to use purposely blurred images at the beginning, then gradually transit to sharper images in the later training stages. Our experiments with an underlying state-of-the-art deep learning model show that curriculum learning can lead to superior results compared to conventional training. Additionally, we show that curriculum by input blur has the best accuracy versus speed trade-off among the compared curriculum learning approaches.


title: Retrain or not retrain: Conformal test martingales for change-point detection

abstract: We argue for supplementing the process of training a prediction algorithm by setting up a scheme for detecting the moment when the distribution of the data changes and the algorithm needs to be retrained. Our proposed schemes are based on exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the data. Our method, based on conformal prediction, is general and can be applied on top of any modern prediction algorithm. Its validity is guaranteed, and in this paper we make first steps in exploring its efficiency.


title: Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Models

abstract: While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sum-product networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, effectively subsuming Pearl's do-operator, the gate function predicts the parameters of the SPN. The resulting interventional SPNs are motivated and illustrated by a structural causal model themed around personal health. Our empirical evaluation on three benchmark data sets as well as a synthetic health data set clearly demonstrates that interventional SPNs indeed are both expressive in modelling and flexible in adapting to the interventions.


title: Antigenic waves of virus-immune co-evolution

abstract: The evolution of many microbes and pathogens, including circulating viruses such as seasonal influenza, is driven by immune pressure from the host population. In turn, the immune systems of infected populations get updated, chasing viruses even further away. Quantitatively understanding how these dynamics result in observed patterns of rapid pathogen and immune adaptation is instrumental to epidemiological and evolutionary forecasting. Here we present a mathematical theory of co-evolution between immune systems and viruses in a finite-dimensional antigenic space, which describes the cross-reactivity of viral strains and immune systems primed by previous infections. We show the emergence of an antigenic wave that is pushed forward and canalized by cross-reactivity. We obtain analytical results for shape, speed, and angular diffusion of the wave. In particular, we show that viral-immune co-evolution generates a new emergent timescale, the persistence time of the wave's direction in antigenic space, which can be much longer than the coalescence time of the viral population. We compare these dynamics to the observed antigenic turnover of influenza strains, and we discuss how the dimensionality of antigenic space impacts on the predictability of the evolutionary dynamics. Our results provide a concrete and tractable framework to describe pathogen-host co-evolution.


title: Byzantine Agreement with Unknown Participants and Failures

abstract: A set of mutually distrusting participants that want to agree on a common opinion must solve an instance of a Byzantine agreement problem. These problems have been extensively studied in the literature. However, most of the existing solutions assume that the participants are aware of $n$ -- the total number of participants in the system -- and $f$ -- an upper bound on the number of Byzantine participants. In this paper, we show that most of the fundamental agreement problems can be solved without affecting resiliency even if the participants do not know the values of (possibly changing) $n$ and $f$. Specifically, we consider a synchronous system where the participants have unique but not necessarily consecutive identifiers, and give Byzantine agreement algorithms for reliable broadcast, approximate agreement, rotor-coordinator, early terminating consensus and total ordering in static and dynamic systems, all with the optimal resiliency of $n> 3f$. Moreover, we show that synchrony is necessary as an agreement with probabilistic termination is impossible in a semi-synchronous or asynchronous system if the participants are unaware of $n$ and $f$.


title: Estimation and Inference by Stochastic Optimization: Three Examples

abstract: This paper illustrates two algorithms designed in Forneron & Ng (2020): the resampled Newton-Raphson (rNR) and resampled quasi-Newton (rqN) algorithms which speed-up estimation and bootstrap inference for structural models. An empirical application to BLP shows that computation time decreases from nearly 5 hours with the standard bootstrap to just over 1 hour with rNR, and only 15 minutes using rqN. A first Monte-Carlo exercise illustrates the accuracy of the method for estimation and inference in a probit IV regression. A second exercise additionally illustrates statistical efficiency gains relative to standard estimation for simulation-based estimation using a dynamic panel regression example.


title: Yet another proof of Tychonoff's Theorem

abstract: In 1971 I announced what I described as a nice proof of Tychonoff's Theorem, an immediate corollary of a result concerning closed projections combined with Mrowka's characterization of compactness: a space X is compact if and only if for each space Y the projection from X x Y to Y is closed. I described the proof as to appear but to date it has not. In 2019 I published a generalization of the stronger closed projection result which yields a different look to the proof. Both versions are presented here.


title: On the profinite distinguishability of hyperbolic Dehn fillings of finite-volume 3-manifolds

abstract: We use model theory to study relative profinite rigidity of $3$-manifold groups and show that given any residually finite group $\Gamma$ with finite character variety and single-cusped finite volume hyperbolic $3$-manifold $M$, cofinitely many Dehn fillings $M_{p/q}$ are profinitely distinguishable from $\Gamma$.


title: Squeeze-and-Excitation Normalization for Automated Delineation of Head and Neck Primary Tumors in Combined PET and CT Images

abstract: Development of robust and accurate fully automated methods for medical image segmentation is crucial in clinical practice and radiomics studies. In this work, we contributed an automated approach for Head and Neck (H&N) primary tumor segmentation in combined positron emission tomography / computed tomography (PET/CT) images in the context of the MICCAI 2020 Head and Neck Tumor segmentation challenge (HECKTOR). Our model was designed on the U-Net architecture with residual layers and supplemented with Squeeze-and-Excitation Normalization. The described method achieved competitive results in cross-validation (DSC 0.745, precision 0.760, recall 0.789) performed on different centers, as well as on the test set (DSC 0.759, precision 0.833, recall 0.740) that allowed us to win first prize in the HECKTOR challenge among 21 participating teams. The full implementation based on PyTorch and the trained models are available at https://github.com/iantsen/hecktor


title: Importance of Environment Design in Reinforcement Learning: A Study of a Robotic Environment

abstract: An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process (MDP) framework is studied in this paper. The optimal state-action combinations of the MDP are calculated with the non-linear Bellman optimality equations. This system of equations can be solved with relative ease by the computational power of Wolfram Mathematica, where the obtained optimal action-values point to the optimal policy. Unlike other RL algorithms, this methodology does not approximate the optimal behavior, it gives the exact, explicit solution, which provides a strong foundation for our study. With this, we offer new insights into understanding the action selection mechanisms in RL by presenting various small modifications on the very same schema that lead to different optimal policies.


title: An ecologically valid examination of event-based and time-based prospective memory using immersive virtual reality: the effects of delay and task type on everyday prospective memory

abstract: Recent research has focused on assessing either event- or time-based prospective memory (PM) using laboratory tasks. Yet, the findings pertaining to PM performance on laboratory tasks are often inconsistent with the findings on corresponding naturalistic experiments. Ecologically valid neuropsychological tasks resemble the complexity and cognitive demands of everyday tasks, offer an adequate level of experimental control, and allow a generalisation of the findings to everyday performance. The Virtual Reality Everyday Assessment Lab (VR-EAL), an immersive virtual reality neuropsychological battery with enhanced ecological validity, was implemented to comprehensively assess everyday PM (i.e., focal and non-focal event-based, and time-based). The effects of the length of delay between encoding and initiating the PM intention and the type of PM task on everyday PM performance were examined. The results revealed that everyday PM performance was affected by the length of delay rather than the type of PM task. The effect of the length of delay differentially affected performance on the focal, non-focal, and time-based tasks and was proportional to the PM cue focality (i.e., semantic relationship with the intended action). This study also highlighted methodological considerations such as the differentiation between functioning and ability, distinction of cue attributes, and the necessity of ecological validity.


title: WARP-Q: Quality Prediction For Generative Neural Speech Codecs

abstract: Good speech quality has been achieved using waveform matching and parametric reconstruction coders. Recently developed very low bit rate generative codecs can reconstruct high quality wideband speech with bit streams less than 3 kb/s. These codecs use a DNN with parametric input to synthesise high quality speech outputs. Existing objective speech quality models (e.g., POLQA, ViSQOL) do not accurately predict the quality of coded speech from these generative models underestimating quality due to signal differences not highlighted in subjective listening tests. We present WARP-Q, a full-reference objective speech quality metric that uses dynamic time warping cost for MFCC speech representations. It is robust to small perceptual signal changes. Evaluation using waveform matching, parametric and generative neural vocoder based codecs as well as channel and environmental noise shows that WARP-Q has better correlation and codec quality ranking for novel codecs compared to traditional metrics in addition to versatility for general quality assessment scenarios.


title: Correlation between the scaling factor of the yukawa coupling and cross section for the $e^+ e^- \rightarrow hhf\overline{f}$ ($f\neq t$) in type-I 2HD

abstract: The objective of this study is to correlate the scaling factor of the Standard Model (SM) like Higgs boson and the cross section ratio of the process $e^+ e^- \rightarrow hhf\overline{f}$ where $f\neq t$, normalized to SM predictions in the type I of the Two Higgs Doublet Model. All calculations have been performed at $\sqrt{s}=500$ GeV and $1 \leq \tan{\beta} \leq 30$ for masses $m_H = m_A = m_{H^\pm} = 300GeV$ and $m_H=300$ GeV, $m_A=m_{H^\pm}=500$ GeV. The working scenario is by taking without alignment limit, that is $s_{\beta-\alpha}= 0.98$ and $s_{\beta-\alpha}= 0.99,$ $0.995$, which gives the enhancement in the cross section, particularly a few times greater than the predictions of the SM due to resonant-impacts of the additional heavy neutral Higgs bosons. This shows that enhancement in cross section occurs on leaving the alignment i.e., $s_{\beta-\alpha}=1$, at which all the higgs that couple to vector bosons and fermions have the same values as in SM at tree level. A large value of enhancement factor is obtained at $s_{\beta-\alpha}= 0.98$ compared to $s_{\beta-\alpha}= 0.99,$ $0 .995$. Furthermore, the decrease in the enhancement factor is observed for the case when $m_H=300$ GeV, $m_A=m_{H^\pm}=500$ GeV. The behavior of the scaling factor with $\tan{\beta}$ is also studied, which shows that for large values of $\tan\beta$, the scaling factor becomes equal to $s_{\beta-\alpha}$. Finally a convincing correlation is achieved by taking into account, the experimental and theoretical constraints e.g, perturbative unitarity, vacuum stability and electroweak oblique parameters.


title: Gender-grade-gap zeroed out under a specific intro-physics assessment regime

abstract: Evidence is presented that offering introductory physics courses with an explicit focus on mastery can reduce the gender gap to zero. Taken together with a previous study showing that a concepts-first course may zero out another demographic gap leads one to speculate that demographic grade gaps in introductory physics are just artifacts of the design of the courses and that none of these classes/grades should be assumed to be demographically neutral.


title: Spotting Silent Buffer Overflows in Execution Trace through Graph Neural Network Assisted Data Flow Analysis

abstract: A software vulnerability could be exploited without any visible symptoms. When no source code is available, although such silent program executions could cause very serious damage, the general problem of analyzing silent yet harmful executions is still an open problem. In this work, we propose a graph neural network (GNN) assisted data flow analysis method for spotting silent buffer overflows in execution traces. The new method combines a novel graph structure (denoted DFG+) beyond data-flow graphs, a tool to extract {\tt DFG+} from execution traces, and a modified Relational Graph Convolutional Network as the GNN model to be trained. The evaluation results show that a well-trained model can be used to analyze vulnerabilities in execution traces (of previously-unseen programs) without support of any source code. Our model achieves 94.39\% accuracy on the test data and successfully locates 29 out of 30 real-world silent buffer overflow vulnerabilities. Leveraging deep learning, the proposed method is, to our best knowledge, the first general-purpose analysis method for silent buffer overflows. It is also the first method to spot silent buffer overflows in global variables, stack variables, or heap variables without crossing the boundary of allocated chunks.


title: The Association of Opening K-12 Schools with the Spread of COVID-19 in the United States: County-Level Panel Data Analysis

abstract: This paper empirically examines how the opening of K-12 schools and colleges is associated with the spread of COVID-19 using county-level panel data in the United States. Using data on foot traffic and K-12 school opening plans, we analyze how an increase in visits to schools and opening schools with different teaching methods (in-person, hybrid, and remote) is related to the 2-weeks forward growth rate of confirmed COVID-19 cases. Our debiased panel data regression analysis with a set of county dummies, interactions of state and week dummies, and other controls shows that an increase in visits to both K-12 schools and colleges is associated with a subsequent increase in case growth rates. The estimates indicate that fully opening K-12 schools with in-person learning is associated with a 5 (SE = 2) percentage points increase in the growth rate of cases. We also find that the positive association of K-12 school visits or in-person school openings with case growth is stronger for counties that do not require staff to wear masks at schools. These results have a causal interpretation in a structural model with unobserved county and time confounders. Sensitivity analysis shows that the baseline results are robust to timing assumptions and alternative specifications.


title: On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning

abstract: Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new tasks using a small amount of labeled training data. Despite the generalization power of the meta-model, it remains elusive that how adversarial robustness can be maintained by MAML in few-shot learning. In addition to generalization, robustness is also desired for a meta-model to defend adversarial examples (attacks). Toward promoting adversarial robustness in MAML, we first study WHEN a robustness-promoting regularization should be incorporated, given the fact that MAML adopts a bi-level (fine-tuning vs. meta-update) learning procedure. We show that robustifying the meta-update stage is sufficient to make robustness adapted to the task-specific fine-tuning stage even if the latter uses a standard training protocol. We also make additional justification on the acquired robustness adaptation by peering into the interpretability of neurons' activation maps. Furthermore, we investigate HOW robust regularization can efficiently be designed in MAML. We propose a general but easily-optimized robustness-regularized meta-learning framework, which allows the use of unlabeled data augmentation, fast adversarial attack generation, and computationally-light fine-tuning. In particular, we for the first time show that the auxiliary contrastive learning task can enhance the adversarial robustness of MAML. Finally, extensive experiments are conducted to demonstrate the effectiveness of our proposed methods in robust few-shot learning.


title: Second order Josephson effect in excitonic insulators

abstract: We show that in electron-hole bilayers with excitonic order arising from conduction and valence bands formed by atomic orbitals that have different parities, nonzero interlayer tunneling leads to a second order Josephson effect. This means the interlayer electrical current is related to the phase of the excitonic order parameter as $J = J_c \sin2\theta$ instead of $J = J_c \sin \theta$, and that the system has two degenerate ground states at $\theta=0, \pi$ that can be switched by an interlayer voltage pulse. When generalized to a three dimensional stack of alternating electron-hole planes or a two dimensional stack of chains, AC Josephson effect implies that electric field pulses perpendicular to the layers and chains can steer the order parameter phase between the two degenerate ground states, making these devices ultrafast memories. The order parameter steering also applies to the excitonic insulator candidate Ta$_2$NiSe$_5$.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.quant-gas cond-mat.supr-con


title: Decaying Clipping Range in Proximal Policy Optimization

abstract: Proximal Policy Optimization (PPO) is among the most widely used algorithms in reinforcement learning, which achieves state-of-the-art performance in many challenging problems. The keys to its success are the reliable policy updates through the clipping mechanism and the multiple epochs of minibatch updates. The aim of this research is to give new simple but effective alternatives to the former. For this, we propose linearly and exponentially decaying clipping range approaches throughout the training. With these, we would like to provide higher exploration at the beginning and stronger restrictions at the end of the learning phase. We investigate their performance in several classical control and locomotive robotic environments. During the analysis, we found that they influence the achieved rewards and are effective alternatives to the constant clipping method in many reinforcement learning tasks.


title: Development of the first Portuguese radar tracking sensor for Space Debris

abstract: Currently, space debris represents a threat for satellites and space-based operations, both in-orbit and during the launching process. The yearly increase in space debris represents a serious concern to major space agencies leading to the development of dedicated space programs to deal with this issue. Ground-based radars can detect Earth orbiting debris down to a few square centimeters and therefore constitute a major building block of a space debris monitoring system. New radar sensors are required in Europe to enhance capabilities and availability of its small radar network capable of tracking and surveying space objects and to respond to the debris increase expected from the New Space economy activities. This article presents ATLAS, a new tracking radar system for debris detection located in Portugal. It starts by an extensive technical description of all the system components followed by a study that estimates its future performance. A section dedicated to waveform design is also presented, since the system allows the usage of several types of pulse modulation schemes such as LFM and phase coded modulations while enabling the development and testing of more advanced ones. By presenting an architecture that is highly modular with fully digital signal processing, ATLAS establishes a platform for fast and easy development, research and innovation. The system follows the use of Commercial-Off-The-Shelf technologies and Open Systems which is unique among current radar systems.

categories: physics.space-ph astro-ph.IM cs.SY eess.SP eess.SY


title: Efficient Tomography of Non-Interacting Fermion States

abstract: We give an efficient algorithm that learns a non-interacting fermion state, given copies of the state. For a system of $n$ non-interacting fermions and $m$ modes, we show that $O(m^3 n^2 \log(1/\delta) / \epsilon^4)$ copies of the input state and $O(m^4 n^2 \log(1/\delta)/ \epsilon^4)$ time are sufficient to learn the state to trace distance at most $\epsilon$ with probability at least $1 - \delta$. Our algorithm empirically estimates one-mode correlations in $O(m)$ different measurement bases and uses them to reconstruct a succinct description of the entire state efficiently.


title: Letter/Comment on: Improved predictions for superconductors

abstract: Letter/comment on M. Rini, Physics $\textbf{13}$, s94 (July 27, 2020) and A. Sanna et al., Phys. Rev. Lett. $\textbf{125}$, 057001 (2020).


title: Decompositions of Matrices into Potent and Square-Zero Matrices

abstract: In order to find a suitable expression of an arbitrary square matrix over an arbitrary finite commutative ring, we prove that every such a matrix is always representable as a sum of a potent matrix and a nilpotent matrix of order at most two when the Jacobson radical of the ring has zero-square. This somewhat extends results of ours in Lin. & Multilin. Algebra (2021) established for matrices considered on arbitrary fields. Our main theorem also improves on recent results due to Abyzov et al. in Mat. Zametki (2017), \v{S}ter in Lin. Algebra & Appl. (2018) and Shitov in Indag. Math. (2019).


title: Trumpets: Injective Flows for Inference and Inverse Problems

abstract: We propose injective generative models called Trumpets that generalize invertible normalizing flows. The proposed generators progressively increase dimension from a low-dimensional latent space. We demonstrate that Trumpets can be trained orders of magnitudes faster than standard flows while yielding samples of comparable or better quality. They retain many of the advantages of the standard flows such as training based on maximum likelihood and a fast, exact inverse of the generator. Since Trumpets are injective and have fast inverses, they can be effectively used for downstream Bayesian inference. To wit, we use Trumpet priors for maximum a posteriori estimation in the context of image reconstruction from compressive measurements, outperforming competitive baselines in terms of reconstruction quality and speed. We then propose an efficient method for posterior characterization and uncertainty quantification with Trumpets by taking advantage of the low-dimensional latent space.


title: BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization

abstract: Mixed-precision quantization can potentially achieve the optimal tradeoff between performance and compression rate of deep neural networks, and thus, have been widely investigated. However, it lacks a systematic method to determine the exact quantization scheme. Previous methods either examine only a small manually-designed search space or utilize a cumbersome neural architecture search to explore the vast search space. These approaches cannot lead to an optimal quantization scheme efficiently. This work proposes bit-level sparsity quantization (BSQ) to tackle the mixed-precision quantization from a new angle of inducing bit-level sparsity. We consider each bit of quantized weights as an independent trainable variable and introduce a differentiable bit-sparsity regularizer. BSQ can induce all-zero bits across a group of weight elements and realize the dynamic precision reduction, leading to a mixed-precision quantization scheme of the original model. Our method enables the exploration of the full mixed-precision space with a single gradient-based optimization process, with only one hyperparameter to tradeoff the performance and compression. BSQ achieves both higher accuracy and higher bit reduction on various model architectures on the CIFAR-10 and ImageNet datasets comparing to previous methods.


title: Annular Modes of Variability in the Atmospheres of Mars and Titan

abstract: Annular modes explain much of the internal variability of Earth's atmosphere but have never been identified on other planets. Using reanalyses for Mars and a simulation for Titan, we demonstrate that annular modes are prominent in the atmospheres of both worlds, explaining large fractions of their respective variabilities. One mode describes latitudinal shifts of the jet on Mars, as on Earth, and vertical shifts of the jet on Titan. Another describes pulses of midlatitude eddy kinetic energy on all three worlds, albeit with somewhat different characteristics. We further demonstrate that this latter mode has predictive power for regional dust activity on Mars, revealing its usefulness for understanding Martian weather. In addition, our finding of similar annular variability in dynamically diverse worlds indicates its ubiquity across planetary atmospheres, opening a new avenue for comparative planetology as well as an additional consideration for characterization of extrasolar atmospheres.


title: Statics and Dynamics of Skyrmions Interacting with Pinning: A Review

abstract: Magnetic skyrmions are topologically stable nanoscale particle-like objects that were discovered in 2009. Since that time, intense research interest has led to the identification of numerous compounds that support skyrmions over a range of conditions spanning cryogenic to room temperatures. Skyrmions can be set into motion under various types of driving, and the combination of their size, stability, and dynamics makes them ideal candidates for numerous applications. Skyrmions represent a new class of system in which the energy scales of the skyrmion-skyrmion interactions, sample disorder, temperature, and drive can compete. A growing body of work indicates that the static and dynamic states of skyrmions can be influenced strongly by pinning or disorder in the sample; thus, an understanding of such effects is essential for the eventual use of skyrmions in applications. In this article we review the current state of knowledge regarding individual skyrmions and skyrmion assemblies interacting with quenched disorder or pinning. We outline the microscopic mechanisms for skyrmion pinning, including the repulsive and attractive interactions that can arise from impurities, grain boundaries, or nanostructures. This is followed by descriptions of depinning phenomena, sliding states over disorder, the effect of pinning on the skyrmion Hall angle, the competition between thermal and pinning effects, the control of skyrmion motion using ordered potential landscapes such as one- or two-dimensional periodic asymmetric substrates, the creation of skyrmion diodes, and skyrmion ratchet effects. We highlight the distinctions arising from internal modes and the strong gyroscopic or Magnus forces that cause the dynamical states of skyrmions to differ from those of other systems with pinning. We also discuss future directions and open questions related to the pinning and dynamics in skyrmion systems.


title: Relativistic density-functional theory based on effective quantum electrodynamics

abstract: A relativistic density-functional theory based on a Fock-space effective quantum-electrodynamics (QED) Hamiltonian using the Coulomb or Coulomb-Breit two-particle interaction is developed. This effective QED theory properly includes the effects of vacuum polarization through the creation of electron-positron pairs but does not include explicitly the photon degrees of freedom. It is thus a more tractable alternative to full QED for atomic and molecular calculations. Using the constrained-search formalism, a Kohn-Sham scheme is formulated in a quite similar way to non-relativistic density-functional theory, and some exact properties of the involved density functionals are studied, namely charge-conjugation symmetry and uniform coordinate scaling. The usual no-pair Kohn-Sham scheme is obtained as a well-defined approximation to this relativistic density-functional theory.


title: Time-Dependent Dephasing and Quantum Transport

abstract: The investigation of the phenomenon of dephasing assisted quantum transport, which happens when the presence of dephasing benefits the efficiency of this process, has been mainly focused on Markovian scenarios associated with constant and positive dephasing rates in their respective Lindblad master equations. What happens if we consider a more general framework, where time-dependent dephasing rates are allowed, thereby permitting the possibility of non-Markovian scenarios? Does dephasing assisted transport still manifest for non-Markovian dephasing? Here, we address these open questions in a setup of coupled two-level systems. Our results show that the manifestation of non-Markovian dephasing assisted transport depends on the way in which the incoherent energy sources are locally coupled to the chain. This is illustrated with two different configurations, namely non-symmetric and symmetric. Specifically, we verify that non-Markovian dephasing assisted transport manifested only in the non-symmetric configuration. This allows us to draw a parallel with the conditions in which time-independent Markovian dephasing assisted transport manifests. Finally, we find similar results by considering a controllable and experimentally implementable system, which highlights the significance of our findings for quantum technologies.


title: The Barycenter Method for Direct Optimization: an Overview

abstract: A randomized version of the recently developed barycenter method for derivative--free optimization has desirable properties of a gradient search. We developed a complex version to avoid evaluations at high--gradient points. The method, which is also applicable to non--convex and to non--smooth functions, is parallelizable in a natural way and shown to be robust under noisy measurements. The goal of this paper is to present an overview of the method, whose properties make it particularly useful in control applications.


title: Heterogeneous Demand Effects of Recommendation Strategies in a Mobile Application: Evidence from Econometric Models and Machine-Learning Instruments

abstract: In this paper, we examine the effectiveness of various recommendation strategies in the mobile channel and their impact on consumers' utility and demand levels for individual products. We find significant differences in effectiveness among various recommendation strategies. Interestingly, recommendation strategies that directly embed social proofs for the recommended alternatives outperform other recommendations. Besides, recommendation strategies combining social proofs with higher levels of induced awareness due to the prescribed temporal diversity have an even stronger effect on the mobile channel. In addition, we examine the heterogeneity of the demand effect across items, users, and contextual settings, further verifying empirically the aforementioned information and persuasion mechanisms and generating rich insights. We also facilitate the estimation of causal effects in the presence of endogeneity using machine-learning methods. Specifically, we develop novel econometric instruments that capture product differentiation (isolation) based on deep-learning models of user-generated reviews. Our empirical findings extend the current knowledge regarding the heterogeneous impact of recommender systems, reconcile contradictory prior results in the related literature, and have significant business implications.


title: Using a resource theoretic perspective to witness and engineer quantum generalized contextuality for prepare-and-measure scenarios

abstract: We employ the resource theory of generalized contextuality as a tool for analyzing the structure of prepare-and-measure scenarios. We argue that this framework simplifies proofs of quantum contextuality in complex scenarios and strengthens existing arguments regarding robustness of experimental implementations. As a case study, we demonstrate quantum contextuality associated with any nontrivial noncontextuality inequality for a class of useful scenarios by noticing a connection between the resource theory and measurement simulability. Additionally, we expose a formal composition rule that allows engineering complex scenarios from simpler ones. This approach provides insights into the noncontextual polytope structure for complex scenarios and facilitates the identification of possible quantum violations of noncontextuality inequalities.


title: Classical Instability Effects on Photon Excitations and Entanglement

abstract: The Schr\"{o}dinger dynamics of photon excitation numbers together with entanglement in two non-resonant time-dependent coupled oscillators is investigated. By considering $ \pi-$periodically pumped parameters and using suitable transformations, we obtain the coupled Meissner oscillators. Consequently, our analytical study shows two interesting results, which can be summarized as follows. (i): Classical instability of classical analog of quantum oscillators and photon excitation {averages $\left\langle N_{j}\right\rangle $} are strongly correlated. (ii): Photon excitation's and entanglement are connected to each other. These results can be used to shed light on the link between quantum systems and their classical counterparts. Also it allow to control entanglement by engineering only classical systems where the experiments are less expensive.


title: Multi-Phase Locking Value: A Generalized Method for Determining Instantaneous Multi-frequency Phase Coupling

abstract: Many physical, biological and neural systems behave as coupled oscillators, with characteristic phase coupling across different frequencies. Methods such as $n:m$ phase locking value and bi-phase locking value have previously been proposed to quantify phase coupling between two resonant frequencies (e.g. $f$, $2f/3$) and across three frequencies (e.g. $f_1$, $f_2$, $f_1+f_2$), respectively. However, the existing phase coupling metrics have their limitations and limited applications. They cannot be used to detect or quantify phase coupling across multiple frequencies (e.g. $f_1$, $f_2$, $f_3$, $f_4$, $f_1+f_2+f_3-f_4$), or coupling that involves non-integer multiples of the frequencies (e.g. $f_1$, $f_2$, $2f_1/3+f_2/3$). To address the gap, this paper proposes a generalized approach, named multi-phase locking value (M-PLV), for the quantification of various types of instantaneous multi-frequency phase coupling. Different from most instantaneous phase coupling metrics that measure the simultaneous phase coupling, the proposed M-PLV method also allows the detection of delayed phase coupling and the associated time lag between coupled oscillators. The M-PLV has been tested on cases where synthetic coupled signals are generated using white Gaussian signals, and a system comprised of multiple coupled R\"ossler oscillators. Results indicate that the M-PLV can provide a reliable estimation of the time window and frequency combination where the phase coupling is significant, as well as a precise determination of time lag in the case of delayed coupling. This method has the potential to become a powerful new tool for exploring phase coupling in complex nonlinear dynamic systems.


title: Learning Neural Network Subspaces

abstract: Recent observations have advanced our understanding of the neural network optimization landscape, revealing the existence of (1) paths of high accuracy containing diverse solutions and (2) wider minima offering improved performance. Previous methods observing diverse paths require multiple training runs. In contrast we aim to leverage both property (1) and (2) with a single method and in a single training run. With a similar computational cost as training one model, we learn lines, curves, and simplexes of high-accuracy neural networks. These neural network subspaces contain diverse solutions that can be ensembled, approaching the ensemble performance of independently trained networks without the training cost. Moreover, using the subspace midpoint boosts accuracy, calibration, and robustness to label noise, outperforming Stochastic Weight Averaging.


title: Diagnostics for Conditional Density Models and Bayesian Inference Algorithms

abstract: There has been growing interest in the AI community for precise uncertainty quantification. Conditional density models f(y|x), where x represents potentially high-dimensional features, are an integral part of uncertainty quantification in prediction and Bayesian inference. However, it is challenging to assess conditional density estimates and gain insight into modes of failure. While existing diagnostic tools can determine whether an approximated conditional density is compatible overall with a data sample, they lack a principled framework for identifying, locating, and interpreting the nature of statistically significant discrepancies over the entire feature space. In this paper, we present rigorous and easy-to-interpret diagnostics such as (i) the "Local Coverage Test" (LCT), which distinguishes an arbitrarily misspecified model from the true conditional density of the sample, and (ii) "Amortized Local P-P plots" (ALP) which can quickly provide interpretable graphical summaries of distributional differences at any location x in the feature space. Our validation procedures scale to high dimensions and can potentially adapt to any type of data at hand. We demonstrate the effectiveness of LCT and ALP through a simulated experiment and applications to prediction and parameter inference for image data.


title: Towards the k-server conjecture: A unifying potential, pushing the frontier to the circle

abstract: The $k$-server conjecture, first posed by Manasse, McGeoch and Sleator in 1988, states that a $k$-competitive deterministic algorithm for the $k$-server problem exists. It is conjectured that the work function algorithm (WFA) achieves this guarantee, a multi-purpose algorithm with applications to various online problems. This has been shown for several special cases: $k=2$, $(k+1)$-point metrics, $(k+2)$-point metrics, the line metric, weighted star metrics, and $k=3$ in the Manhattan plane. The known proofs of these results are based on potential functions tied to each particular special case, thus requiring six different potential functions for the six cases. We present a single potential function proving $k$-competitiveness of WFA for all these cases. We also use this potential to show $k$-competitiveness of WFA on multiray spaces and for $k=3$ on trees. While the DoubleCoverage algorithm was known to be $k$-competitive for these latter cases, it has been open for WFA. Our potential captures a type of lazy adversary and thus shows that in all settled cases, the worst-case adversary is lazy. Chrobak and Larmore conjectured in 1992 that a potential capturing the lazy adversary would resolve the $k$-server conjecture. To our major surprise, this is not the case, as we show (using connections to the $k$-taxi problem) that our potential fails for three servers on the circle. Thus, our potential highlights laziness of the adversary as a fundamental property that is shared by all settled cases but violated in general. On the one hand, this weakens our confidence in the validity of the $k$-server conjecture. On the other hand, if the $k$-server conjecture holds, then we believe it can be proved by a variant of our potential.