title: The origin of the [CII]-deficit in a simulated dwarf galaxies starburst

abstract: We present [CII] synthetic observations of smoothed particle hydrodynamics (SPH) simulations of a dwarf galaxy merger. The merging process varies the star-formation rate by more than three orders of magnitude. Several star clusters are formed, the feedback of which disperses and unbinds the dense gas through expanding HII regions and supernova (SN) explosions. For galaxies with properties similar to the modelled ones, we find that the [CII] emission remains optically thin throughout the merging process. We identify the Warm Neutral Medium ($3<\log T_{\rm gas}<4$ with $\chi_{\rm HI}>2\chi_{\rm H2}$) to be the primary source of [CII] emission ($\sim58\%$ contribution), although at stages when the HII regions are young and dense (during star cluster formation or SNe in the form of ionized bubbles) they can contribute $\gtrsim50\%$ to the total [CII] emission. We find that the [CII]/FIR ratio decreases due to thermal saturation of the [CII] emission caused by strong FUV radiation fields emitted by the massive star clusters, leading to a [CII]-deficit medium. We investigate the [CII]-SFR relation and find an approximately linear correlation which agrees well with observations, particularly those from the Dwarf Galaxy Survey. Our simulation reproduces the observed trends of [CII]/FIR versus $\Sigma_{\rm SFR}$ and $\Sigma_{\rm FIR}$, and it agrees well with the Kennicutt relation of SFR-FIR luminosity. We propose that local peaks of [CII] in resolved observations may provide evidence for ongoing massive cluster formation.


title: Hierarchical Merger of Primordial Black Holes in Dwarf Galaxies

abstract: We study the merger history of primordial black holes (PBHs) in a scenario where they represent the dominant dark matter component of a typical dwarf galaxies' core. We investigate the possibility of a sequence of collisions resulting in a hierarchical merger of black holes and look at the final mass spectrum in such {\it clusters}, which initially present a monochromatic (single-mass) PBH population. Our study shows that the merging process results in the transfer of about $40\%$ of the total mass of the core to the merger products regardless of the initial mass of PBHs, with about $5\%$ of energy radiated out in the form of gravitational waves. We find that, in the lighter mass limit, black holes up to eight times more massive than the original population can be formed within a Hubble time.


title: Determining Young's modulus via the eigenmode spectrum of a nanomechanical string resonator

abstract: We present a method for the in-situ determination of Young's modulus of a nanomechanical string resonator subjected to tensile stress. It relies on measuring a large number of harmonic eigenmodes and allows to access Young's modulus even for the case of a stress-dominated frequency response. We use the proposed framework to obtain the Young's modulus of four different wafer materials, comprising the three different material platforms amorphous silicon nitride, crystalline silicon carbide and crystalline indium gallium phosphide. The resulting values are compared with theoretical and literature values where available, revealing the need to measure Young's modulus on the sample material under investigation for precise device characterization.


title: Remote Sensing Novel View Synthesis with Implicit Multiplane Representations

abstract: Novel view synthesis of remote sensing scenes is of great significance for scene visualization, human-computer interaction, and various downstream applications. Despite the recent advances in computer graphics and photogrammetry technology, generating novel views is still challenging particularly for remote sensing images due to its high complexity, view sparsity and limited view-perspective variations. In this paper, we propose a novel remote sensing view synthesis method by leveraging the recent advances in implicit neural representations. Considering the overhead and far depth imaging of remote sensing images, we represent the 3D space by combining implicit multiplane images (MPI) representation and deep neural networks. The 3D scene is reconstructed under a self-supervised optimization paradigm through a differentiable multiplane renderer with multi-view input constraints. Images from any novel views thus can be freely rendered on the basis of the reconstructed model. As a by-product, the depth maps corresponding to the given viewpoint can be generated along with the rendering output. We refer to our method as Implicit Multiplane Images (ImMPI). To further improve the view synthesis under sparse-view inputs, we explore the learning-based initialization of remote sensing 3D scenes and proposed a neural network based Prior extractor to accelerate the optimization process. In addition, we propose a new dataset for remote sensing novel view synthesis with multi-view real-world google earth images. Extensive experiments demonstrate the superiority of the ImMPI over previous state-of-the-art methods in terms of reconstruction accuracy, visual fidelity, and time efficiency. Ablation experiments also suggest the effectiveness of our methodology design. Our dataset and code can be found at https://github.com/wyc-Chang/ImMPI


title: Enhancing data locality of the conjugate gradient method for high-order matrix-free finite-element implementations

abstract: This work investigates a variant of the conjugate gradient (CG) method and embeds it into the context of high-order finite-element schemes with fast matrix-free operator evaluation and cheap preconditioners like the matrix diagonal. Relying on a data-dependency analysis and appropriate enumeration of degrees of freedom, we interleave the vector updates and inner products in a CG iteration with the matrix-vector product with only minor organizational overhead. As a result, around 90% of the vector entries of the three active vectors of the CG method are transferred from slow RAM memory exactly once per iteration, with all additional access hitting fast cache memory. Node-level performance analyses and scaling studies on up to 147k cores show that the CG method with the proposed performance optimizations is around two times faster than a standard CG solver as well as optimized pipelined CG and s-step CG methods for large sizes that exceed processor caches, and provides similar performance near the strong scaling limit.


title: Strong Converses using Change of Measure and Asymptotic Markov Chains

abstract: The main contribution of this paper is a strong converse result for $K$-hop distributed hypothesis testing against independence with multiple (intermediate) decision centers under a Markov condition. Our result shows that the set of type-II error exponents that can simultaneously be achieved at all the terminals does not depend on the maximum permissible type-I error probabilities. Our strong converse proof is based on a change of measure argument and on the asymptotic proof of specific Markov chains. This proof method can also be used for other converse proofs, and is appealing because it does not require resorting to variational characterizations or blowing-up methods as in previous related proofs.


title: Subspace-Based Detection and Localization in Distributed MIMO Radars

abstract: In this paper, we consider a distributed multiple-input multiple-output (MIMO) radar which radiates waveforms with non-ideal cross- and auto-correlation functions and derive a novel subspace-based procedure to detect and localize multiple prospective targets. The proposed solution solves a sequence of composite binary hypothesis testing problems by resorting to the generalized information criterion (GIC); in particular, at each step, it aims to detect and localize one additional target, upon removing the interference caused by the previously-detected targets. An illustrative example is provided.


title: Internet Performance in the 2022 Conflict in Ukraine: An Asymmetric Analysis

abstract: On 24 February 2022 Russia invaded Ukraine, starting one of the largest military conflicts in Europe in recent years. In this paper we present preliminary findings about the impact of the conflict on the Internet performance in Ukraine and in Russia, introducing an ironically asymmetric picture: the Internet performance in Ukraine has significantly degraded, while the performance in Russia has improved.


title: Price Interpretability of Prediction Markets: A Convergence Analysis

abstract: Prediction markets are long known for prediction accuracy. This study systematically explores the fundamental properties of prediction markets, addressing questions about their information aggregation process and the factors contributing to their remarkable efficacy. We propose a novel multivariate utility (MU) based mechanism that unifies several existing automated market-making schemes. Using this mechanism, we establish the convergence results for markets comprised of risk-averse traders who have heterogeneous beliefs and repeatedly interact with the market maker. We demonstrate that the resulting limiting wealth distribution aligns with the Pareto efficient frontier defined by the utilities of all market participants. With the help of this result, we establish analytical and numerical results for the limiting price in different market models. Specifically, we show that the limiting price converges to the geometric mean of agent beliefs in exponential utility-based markets. In risk-measure-based markets, we construct a family of risk measures that satisfy the convergence criteria and prove that the price can converge to a unique level represented by the weighted power mean of agent beliefs. In broader markets with Constant Relative Risk Aversion (CRRA) utilities, we reveal that the limiting price can be characterized by systems of equations that encapsulate agent beliefs, risk parameters, and wealth. Despite the potential impact of traders' trading sequences on the limiting price, we establish a price invariance result for markets with a large trader population. Using this result, we propose an efficient approximation scheme for the limiting price.


title: Existence and Nonexistence of Warped Product Submanifolds of Almost Contact Manifolds

abstract: This paper has two goals; the first is to generalize results for the existence and nonexistence of warped product submanifolds of almost contact manifolds, accordingly a self-contained reference of such submanifolds is offered to save efforts of potential research. Most of the results of this paper are general and decisive enough to generalize both discovered and not discovered results. Moreover, a discrete example of contact CR-warped product submanifold in Kenmotsu manifold is constructed. For further research direction, we addressed a couple of open problems arose from the results of this paper.


title: Correlations in typicality and an affirmative solution to the exact catalytic entropy conjecture

abstract: I show that if a finite-dimensional density matrix has strictly smaller von Neumann entropy than a second one of the same dimension (and the rank is not bigger), then sufficiently (but finitely) many tensor-copies of the first density matrix majorize a density matrix whose single-body marginals are all exactly equal to the second density matrix. This implies an affirmative solution of the exact catalytic entropy conjecture (CEC) introduced by Boes et al. [PRL 122, 210402 (2019)]. Both the Lemma and the solution to the CEC transfer to the classical setting of finite-dimensional probability vectors (with permutations of entries instead of unitary transformations for the CEC).


title: Monoidal Width: Capturing Rank Width

abstract: Monoidal width was recently introduced by the authors as a measure of the complexity of decomposing morphisms in monoidal categories. We have shown that in a monoidal category of cospans of graphs, monoidal width and its variants can be used to capture tree width, path width and branch width. In this paper we study monoidal width in a category of matrices, and in an extension to a different monoidal category of open graphs, where the connectivity information is handled with matrix algebra and graphs are composed along edges instead of vertices. We show that here monoidal width captures rank width: a measure of graph complexity that has received much attention in recent years.


title: Representations of free products of semisimple algebras via quivers

abstract: Let $\mathbb{K}$ denote an algebraically closed field and $A$ a free product of finitely many semisimple associative $\mathbb{K}$-algebras. We associate to $A$ a finite acyclic quiver $\Gamma$ and show that the category of finite dimensional $A$-modules is equivalent to a full subcategory of the category ${\rm rep}(\Gamma)$ of finite dimensional representations of $\Gamma$. Under this equivalence, the simple $A$-modules correspond exactly to the $\theta$-stable representations of $\Gamma$ for some stability parameter $\theta$. This gives us necessary conditions for an $A$-module to be simple, conditions which are also sufficient if the module is in general position. Even though there are indecomposable modules that are not simple, we prove that a module in general position is always semisimple. We also discuss the construction of arbitrary finite dimensional modules using nilpotent representations of quivers. Finally, we apply our results to the case of a free product of finite groups when $\mathbb{K}$ has characteristic zero.


title: Superconducting magnet designs and MRI accessibility: a review

abstract: Presently, Magnetic Resonance Imaging (MRI) magnets must deliver excellent magnetic field (B0) uniformity to achieve optimum image quality. Long magnets can satisfy the homogeneity requirements but require considerable superconducting material. These designs result in large, heavy, costly, and unstable systems that aggravate as field strength increases. This issue is a crucial factor in the disparity of MR density and field strength use across the globe. Low-income settings show reduced access to MRI, especially to high field strengths. This article summarizes the proposed modifications to MRI superconducting magnet design and their impact on accessibility, including compact, reduced liquid Helium and specialty systems. Reducing the amount of superconductor inevitably entails shrinking the magnet size, resulting in higher field inhomogeneity. This work also reviews the state-of-the-art imaging and reconstruction methods to overcome this issue. Finally, we summarize the current and future challenges and opportunities in the design of accessible MRI.


title: The shadow of regular black holes with asymptotically Minkowski core

abstract: We investigate the shadow cast by a sort of new regular black holes which are characterized by an asymptotically Minkowski core and the Sub-Planckian curvature. Firstly, we extend the metric with spherical symmetry to the one of rotating Kerr-like black holes and derive the null geodesics with circular orbit near the horizon of the black hole, and then plot the shadow of black holes with different values of the deviation parameter. It is found that the size of the shadow shrinks with the increase of the deviation parameter, while the shape of the shadow becomes more deformed. In particular, by comparing with the shadow of Bardeen black hole and Hayward black hole with the same values of parameters, we find that in general the shadow of black holes with Minkowski core has a larger deformation than that with de Sitter core, which potentially provides a strategy to distinguish these two sorts of regular black holes with different cores by astronomical observation in future.


title: Finite two-dimensional proof systems for non-finitely axiomatizable logics

abstract: The characterizing properties of a proof-theoretical presentation of a given logic may hang on the choice of proof formalism, on the shape of the logical rules and of the sequents manipulated by a given proof system, on the underlying notion of consequence, and even on the expressiveness of its linguistic resources and on the logical framework into which it is embedded. Standard (one-dimensional) logics determined by (non-deterministic) logical matrices are known to be axiomatizable by analytic and possibly finite proof systems as soon as they turn out to satisfy a certain constraint of sufficient expressiveness. In this paper we introduce a recipe for cooking up a two-dimensional logical matrix (or B-matrix) by the combination of two (possibly partial) non-deterministic logical matrices. We will show that such a combination may result in B-matrices satisfying the property of sufficient expressiveness, even when the input matrices are not sufficiently expressive in isolation, and we will use this result to show that one-dimensional logics that are not finitely axiomatizable may inhabit finitely axiomatizable two-dimensional logics, becoming, thus, finitely axiomatizable by the addition of an extra dimension. We will illustrate the said construction using a well-known logic of formal inconsistency called mCi. We will first prove that this logic is not finitely axiomatizable by a one-dimensional (generalized) Hilbert-style system. Then, taking advantage of a known 5-valued non-deterministic logical matrix for this logic, we will combine it with another one, conveniently chosen so as to give rise to a B-matrix that is axiomatized by a two-dimensional Hilbert-style system that is both finite and analytic.


title: Optimal control problems of nonlocal interaction equations

abstract: In the present work we deal with the existence of solutions for optimal control problems associated to transport equations. The behaviour of a population of individuals will be influenced by the presence of a population of control agents whose role is to lead the dynamics of the individuals towards a specific goal. The dynamics of the population of individuals is described by a suitable nonlocal transport equation, while the role of the population of agents is designed by the optimal control problem. This model has been first studied in [12] for a class of continuous nonlocal potentials, while in the present project we consider the case of mildly singular potentials in a gradient flow formulation of the target transport equation.


title: The games we play: critical complexity improves machine learning

abstract: When mathematical modelling is applied to capture a complex system, multiple models are often created that characterize different aspects of that system. Often, a model at one level will produce a prediction which is contradictory at another level but both models are accepted because they are both useful. Rather than aiming to build a single unified model of a complex system, the modeller acknowledges the infinity of ways of capturing the system of interest, while offering their own specific insight. We refer to this pragmatic applied approach to complex systems -- one which acknowledges that they are incompressible, dynamic, nonlinear, historical, contextual, and value-laden -- as Open Machine Learning (Open ML). In this paper we define Open ML and contrast it with some of the grand narratives of ML of two forms: 1) Closed ML, ML which emphasizes learning with minimal human input (e.g. Google's AlphaZero) and 2) Partially Open ML, ML which is used to parameterize existing models. To achieve this, we use theories of critical complexity to both evaluate these grand narratives and contrast them with the Open ML approach. Specifically, we deconstruct grand ML `theories' by identifying thirteen 'games' played in the ML community. These games lend false legitimacy to models, contribute to over-promise and hype about the capabilities of artificial intelligence, reduce wider participation in the subject, lead to models that exacerbate inequality and cause discrimination and ultimately stifle creativity in research. We argue that best practice in ML should be more consistent with critical complexity perspectives than with rationalist, grand narratives.


title: A generalization of Tur\'{a}n's theorem

abstract: We prove a generalization of Tur\'{a}n's theorem proposed by Balogh and Lidick\'{y}.


title: Financial Time Series Data Augmentation with Generative Adversarial Networks and Extended Intertemporal Return Plots

abstract: Data augmentation is a key regularization method to support the forecast and classification performance of highly parameterized models in computer vision. In the time series domain however, regularization in terms of augmentation is not equally common even though these methods have proven to mitigate effects from small sample size or non-stationarity. In this paper we apply state-of-the art image-based generative models for the task of data augmentation and introduce the extended intertemporal return plot (XIRP), a new image representation for time series. Multiple tests are conducted to assess the quality of the augmentation technique regarding its ability to synthesize time series effectively and improve forecast results on a subset of the M4 competition. We further investigate the relationship between data set characteristics and sampling results via Shapley values for feature attribution on the performance metrics and the optimal ratio of augmented data. Over all data sets, our approach proves to be effective in reducing the return forecast error by 7% on 79% of the financial data sets with varying statistical properties and frequencies.


title: Ancestor regression in linear structural equation models

abstract: We present a new method for causal discovery in linear structural equation models. We propose a simple ``trick'' based on statistical testing in linear models that can distinguish between ancestors and non-ancestors of any given variable. Naturally, this can then be extended to estimating the causal order among all variables. We provide explicit error control for false causal discovery, at least asymptotically. This holds true even under Gaussianity, where other methods fail due to non-identifiable structures. These type I error guarantees come at the cost of reduced empirical power. Additionally, we provide an asymptotically valid goodness of fit p-value to assess whether multivariate data stems from a linear structural equation model.


title: Generating Explanations from Deep Reinforcement Learning Using Episodic Memory

abstract: Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and difficult to understand for humans. A crucial component of human explanations is selectivity, whereby only key decisions and causes are recounted. Imbuing Deep RL agents with such an ability would make their resulting policies easier to understand from a human perspective and generate a concise set of instructions to aid the learning of future agents. To this end we use a Deep RL agent with an episodic memory system to identify and recount key decisions during policy execution. We show that these decisions form a short, human readable explanation that can also be used to speed up the learning of naive Deep RL agents in an algorithm-independent manner.


title: Clustering through pair interactions in swimming zooplankton

abstract: This work focuses on the formation of mating aggregates in zooplankton. In particular, sexual encounters are behaviourally supported by males actively swimming in search for females, and approaching them for mating once they are found. While the random search leads to a diffusive flux of individuals, the approaching for encounter supports attraction. Thus, we ask whether these competing mechanisms of diffusion and attraction can support aggregation and lead to the formation of mating clusters. To answer our question we formulate a model in which particles performing random walks can briefly make contact with other particles if they are found within a particular distance from each other. Our analysis shows that this model supports clustering in a way analogous to the process of colloid aggregation. Following that, we analyze a dataset of 3D trajectories of swimming copepods and show that the results compare well with our model. These results support the hypothesis that pair-interactions promote mating aggregates in zooplankton and are sufficient to overcome the diffusive nature of their mate searching behavior. Our results are useful for understanding small-scale clustering of zooplankton, which is crucial for predicting encounter rates and reproduction rates in the ocean.


title: Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders

abstract: Child welfare agencies across the United States are turning to data-driven predictive technologies (commonly called predictive analytics) which use government administrative data to assist workers' decision-making. While some prior work has explored impacted stakeholders' concerns with current uses of data-driven predictive risk models (PRMs), less work has asked stakeholders whether such tools ought to be used in the first place. In this work, we conducted a set of seven design workshops with 35 stakeholders who have been impacted by the child welfare system or who work in it to understand their beliefs and concerns around PRMs, and to engage them in imagining new uses of data and technologies in the child welfare system. We found that participants worried current PRMs perpetuate or exacerbate existing problems in child welfare. Participants suggested new ways to use data and data-driven tools to better support impacted communities and suggested paths to mitigate possible harms of these tools. Participants also suggested low-tech or no-tech alternatives to PRMs to address problems in child welfare. Our study sheds light on how researchers and designers can work in solidarity with impacted communities, possibly to circumvent or oppose child welfare agencies.


title: Spectral theory of diffusion in partially absorbing media

abstract: A probabilistic framework for studying single-particle diffusion in partially absorbing media has recently been developed in terms of an encounter-based approach. The latter computes the joint probability density (generalized propagator) for particle position $\X_t$ and a Brownian functional ${\mathcal U}_t$ that specifies the amount of time the particle is in contact with a reactive component $\calM$. Absorption occurs as soon as $\calU_t$ crosses a randomly distributed threshold (stopping time). Laplace transforming the propagator with respect to $\calU_t$ leads to a classical boundary value problem (BVP) in which the reactive component has a constant rate of absorption $z$, where $z$ is the corresponding Laplace variable. Hence, a crucial step in the encounter-based approach is finding the inverse Laplace transform. In the case of a reactive boundary $\partial \calM$, this can be achieved by solving a classical Robin BVP in terms of the spectral decomposition of a Dirichlet-to-Neumann operator. In this paper we develop the analogous construction in the case of a reactive substrate $\calM$. In particular, we show that the Laplace transformed propagator can be computed in terms of the spectral decomposition of a pair of Dirichlet-to-Neumann operators. However, inverting the Laplace transform with respect to $z$ is more involved. We illustrate the theory by considering a 1D example where the Dirichlet-to-Neumann operators reduce to scalars.


title: Accumulation times for diffusion-mediated surface reactions

abstract: In this paper we consider a multiparticle version of a recent probabilistic framework for studying diffusion-mediated surface reactions. The basic idea of the probabilistic approach is to consider the joint probability density or generalized propagator for particle position and the so-called boundary local time. The latter characterizes the amount of time that a Brownian particle spends in the neighborhood of a totally reflecting boundary; the effects of surface reactions are then incorporated via an appropriate stopping condition for the local time. The propagator is determined by solving a Robin boundary value problem, in which the constant rate of reactivity is identified as the Laplace variable $z$ conjugate to the local time, and then inverting the solution with respect to $z$. Here we reinterpret the propagator as a particle concentration in which surface absorption is counterbalanced by particle source terms. We investigate conditions under which there exists a non-trivial steady state solution, and analyze the relaxation to steady state by calculating the corresponding accumulation time. In particular, we show that the first two moments of the stopping local time density have to be finite.


title: Gravitational Analysis of Rotating Charged Black Hole-Like Solution in Einstein-Gauss-Bonnet Gravity

abstract: This work analyzes the Einstein-Gauss-Bonnet gravity of charged black hole solutions through Newman-Janis approach. The Hawking temperature for corresponding black hole is also computed. The solution depends upon rotation parameter $a$, black hole mass, charge and horizon. Moreover, the graphical behavior of temperature via event horizon to analyze the stability of black hole under the effects of rotation parameter is discussed. The graphs are plotted in the presence/absence of rotation parameter and charge. Furthermore, the Hawking temperature under gravity effects is studied by using the semi-classical method. It is also observed that the maximum temperature at non-zero horizon depicts the BH remnant. Finally, the logarithmic corrected entropy for given black hole is computed and the logarithmic corrected entropy under effects of rotation and correction parameter are studied.


title: COVID-Net UV: An End-to-End Spatio-Temporal Deep Neural Network Architecture for Automated Diagnosis of COVID-19 Infection from Ultrasound Videos

abstract: Besides vaccination, as an effective way to mitigate the further spread of COVID-19, fast and accurate screening of individuals to test for the disease is yet necessary to ensure public health safety. We propose COVID-Net UV, an end-to-end hybrid spatio-temporal deep neural network architecture, to detect COVID-19 infection from lung point-of-care ultrasound videos captured by convex transducers. COVID-Net UV comprises a convolutional neural network that extracts spatial features and a recurrent neural network that learns temporal dependence. After careful hyperparameter tuning, the network achieves an average accuracy of 94.44% with no false-negative cases for COVID-19 cases. The goal with COVID-Net UV is to assist front-line clinicians in the fight against COVID-19 via accelerating the screening of lung point-of-care ultrasound videos and automatic detection of COVID-19 positive cases.


title: Relations among $B_c \to J/\psi, \eta_c$ form factors

abstract: We analyze the form factors parametrizing the $B_c \to J/\psi, \eta_c$ matrix elements of the operators in a generalized low-energy $b \to c$ semileptonic Hamiltonian. We consider an expansion in nonrelativistic QCD, classifying the heavy quark spin symmetry breaking terms and expressing the form factors in terms of universal functions in a selected kinematical range. Using as an input the lattice QCD results for the $B_c \to J/\psi$ matrix element of the SM operator, we obtain information on other form factors. The extrapolation to the full kinematical range is also presented.


title: Value Function Gradient Learning for Large-Scale Multistage Stochastic Programming Problems

abstract: A stagewise decomposition algorithm called value function gradient learning (VFGL) is proposed for large-scale multistage stochastic convex programs. VFGL finds the parameter values that best fit the gradient of the value function within a given parametric family. Widely used decomposition algorithms for multistage stochastic programming, such as stochastic dual dynamic programming (SDDP), approximate the value function by adding linear subgradient cuts at each iteration. Although this approach has been successful for linear problems, nonlinear problems may suffer from the increasing size of each subproblem as the iteration proceeds. On the other hand, VFGL has a fixed number of parameters; thus, the size of the subproblems remains constant throughout the iteration. Furthermore, VFGL can learn the parameters by means of stochastic gradient descent, which means that it can be easily parallelized and does not require a scenario tree approximation of the underlying uncertainties. VFGL was compared with a deterministic equivalent formulation of the multistage stochastic programming problem and SDDP approaches for three illustrative examples: production planning, hydrothermal generation, and the lifetime financial planning problem. Numerical examples show that VFGL generates high-quality solutions and is computationally efficient.


title: Deep Features for CBIR with Scarce Data using Hebbian Learning

abstract: Features extracted from Deep Neural Networks (DNNs) have proven to be very effective in the context of Content Based Image Retrieval (CBIR). In recent work, biologically inspired \textit{Hebbian} learning algorithms have shown promises for DNN training. In this contribution, we study the performance of such algorithms in the development of feature extractors for CBIR tasks. Specifically, we consider a semi-supervised learning strategy in two steps: first, an unsupervised pre-training stage is performed using Hebbian learning on the image dataset; second, the network is fine-tuned using supervised Stochastic Gradient Descent (SGD) training. For the unsupervised pre-training stage, we explore the nonlinear Hebbian Principal Component Analysis (HPCA) learning rule. For the supervised fine-tuning stage, we assume sample efficiency scenarios, in which the amount of labeled samples is just a small fraction of the whole dataset. Our experimental analysis, conducted on the CIFAR10 and CIFAR100 datasets shows that, when few labeled samples are available, our Hebbian approach provides relevant improvements compared to various alternative methods.


title: Market Making via Reinforcement Learning in China Commodity Market

abstract: Market makers play an essential role in financial markets. A successful market maker should control inventory and adverse selection risks and provide liquidity to the market. As an important methodology in control problems, Reinforcement Learning enjoys the advantage of data-driven and less rigid assumptions, receiving great attention in the market-making field since 2018. However, although the China Commodity market has the biggest trading volume on agricultural products, nonferrous metals, and some other sectors, the study of applying RL to Market Making in China market is still rare. In this thesis, we try to fill the gap. Our contribution is threefold: We develop the Automatic Trading System and verify the feasibility of applying Reinforcement Learning in the China Commodity market. Also, we probe the agent's behavior by analyzing how it reacts to different environmental conditions.


title: Some weighted fourth-order Hardy-Henon equations

abstract: By using a suitable transform related to Sobolev inequality, we investigate the sharp constants and optimizers in radial space for the following weighted Caffarelli-Kohn-Nirenberg-type inequalities: \begin{equation*} \int_{\mathbb{R}^N}|x|^{\alpha}|\Delta u|^2 dx \geq S^{rad}(N,\alpha)\left(\int_{\mathbb{R}^N}|x|^{-\alpha}|u|^{p^*_{\alpha}} dx\right)^{\frac{2}{p^*_{\alpha}}}, \quad u\in C^\infty_c(\mathbb{R}^N), \end{equation*} where $N\geq 3$, $4-N<\alpha<2$, $p^*_{\alpha}=\frac{2(N-\alpha)}{N-4+\alpha}$. Then we obtain the explicit form of the unique (up to scaling) radial positive solution $U_{\lambda,\alpha}$ to the weighted fourth-order Hardy (for $\alpha>0$) or H\'{e}non (for $\alpha<0$) equation: \begin{equation*} \Delta(|x|^{\alpha}\Delta u)=|x|^{-\alpha} u^{p^*_{\alpha}-1},\quad u>0 \quad \mbox{in}\quad \mathbb{R}^N. \end{equation*} %Furthermore, we characterize all the solutions to the linearized problem related to above equation at $U_{1,\alpha}$. For $\alpha\neq 0$, it is known the solutions of above equation are invariant for dilations $\lambda^{\frac{N-4+\alpha}{2}}u(\lambda x)$ but not for translations. However we show that if $\alpha$ is an even integer, there exist new solutions to the linearized problem, which related to above equation at $U_{1,\alpha}$, that "replace" the ones due to the translations invariance. This interesting phenomenon was first shown by Gladiali, Grossi and Neves [Adv. Math. 249, 2013, 1-36] for the second-order H\'{e}non problem. Finally, as applications, we investigate the reminder term of above inequality and also the existence of solutions to some related perturbed equations.


title: SplitBFT: Improving Byzantine Fault Tolerance Safety Using Trusted Compartments

abstract: Byzantine fault-tolerant agreement (BFT) in a partially synchronous system usually requires 3f + 1 nodes to tolerate f faulty replicas. Due to their high throughput and finality property BFT algorithms build the core of recent permissioned blockchains. As a complex and resource-demanding infrastructure, multiple cloud providers have started offering Blockchain-as-a-Service. This eases the deployment of permissioned blockchains but places the cloud provider in a central controlling position, thereby questioning blockchains' fault tolerance and decentralization properties and their underlying BFT algorithm. This paper presents SplitBFT, a new way to utilize trusted execution technology (TEEs), such as Intel SGX, to harden the safety and confidentiality guarantees of BFT systems thereby strengthening the trust in could-based deployments of permissioned blockchains. Deviating from standard assumptions, SplitBFT acknowledges that code protected by trusted execution may fail. We address this by splitting and isolating the core logic of BFT protocols into multiple compartments resulting in a more resilient architecture. We apply SplitBFT to the traditional practical byzantine fault tolerance algorithm (PBFT) and evaluate it using SGX. Our results show that SplitBFT adds only a reasonable overhead compared to the non-compartmentalized variant.


title: Features of Perceived Metaphoricity on the Discourse Level: Abstractness and Emotionality

abstract: Research on metaphorical language has shown ties between abstractness and emotionality with regard to metaphoricity; prior work is however limited to the word and sentence levels, and up to date there is no empirical study establishing the extent to which this is also true on the discourse level. This paper explores which textual and perceptual features human annotators perceive as important for the metaphoricity of discourses and expressions, and addresses two research questions more specifically. First, is a metaphorically-perceived discourse more abstract and more emotional in comparison to a literally-perceived discourse? Second, is a metaphorical expression preceded by a more metaphorical/abstract/emotional context than a synonymous literal alternative? We used a dataset of 1,000 corpus-extracted discourses for which crowdsourced annotators (1) provided judgements on whether they perceived the discourses as more metaphorical or more literal, and (2) systematically listed lexical terms which triggered their decisions in (1). Our results indicate that metaphorical discourses are more emotional and to a certain extent more abstract than literal discourses. However, neither the metaphoricity nor the abstractness and emotionality of the preceding discourse seem to play a role in triggering the choice between synonymous metaphorical vs. literal expressions. Our dataset is available at https://www.ims.uni-stuttgart.de/data/discourse-met-lit.


title: Programming of channels in generalized probabilistic theories

abstract: For a given target system and apparatus described by quantum theory, the so-called quantum no-programming theorem indicates that a family of states called programs in the apparatus with a fixed unitary operation on the total system programs distinct unitary dynamics to the target system only if the initial programs are orthogonal to each other. The current study aims at revealing whether a similar behavior can be observed in generalized probabilistic theories (GPTs). Generalizing the programming scheme to GPTs, we derive a similar theorem to the quantum no-programming theorem. We furthermore demonstrate that programming of reversible dynamics is related closely to a curious structure named a quasi-classical structure on the state space. Programming of irreversible dynamics, i.e., channels in GPTs is also investigated.


title: The CONQUEST code: large scale and linear scaling DFT

abstract: CONQUEST is a DFT code which was designed from the beginning to enable extremely large-scale calculations on massively parallel platforms, implementing both exact and linear scaling solvers for the ground state. It uses local basis sets (both pseudo-atomic orbitals, PAOs, and systematically convergent B-splines) and sparse matrix storage and operations to ensure locality in all aspects of the calculation. Using exact diagonalisation approaches and a full PAO basis set, systems of up to 1,000 atoms can be modelled with relatively modest resources (200-500 cores), while use of multi-site support functions (MSSF) enable calculations of up to 10,000 atoms with similar resources. With linear scaling, the code demonstrates essentially perfect weak scaling (fixed atoms per process), and has been applied to over 1,000,000 atoms, scaling to nearly 200,000 cores; it has been run on both the K computer and Fugaku, among other computers. CONQUEST calculates the total energy, forces and stresses exactly, and allows structural optimisation of both ions and simulation cell. Molecular dynamics calculations within the NVE, NVT and NPT ensembles are possible with both exact diagonalisation and linear scaling[6]. The code interfaces with LibXC to implement LDA and GGA functionals, with metaGGA and hybrid functionals under development. Dispersion interactions can be included using semi-empirical methods (DFT-D2/3, TS) and vdW-DF. The polarisation can be calculated using Resta's approach.


title: Effectiveness of a time to fixate for fitness to drive evaluation in neurological patients

abstract: We present a method to automatically calculate time to fixate (TTF) from the eye-tracker data in subjects with neurological impairment using a driving simulator. TTF presents the time interval for a person to notice the stimulus from its first occurrence. Precisely, we measured the time since the children started to cross the street until the drivers directed their look to the children. From 108 neurological patients recruited for the study, the analysis of TTF was performed in 56 patients to assess fit-, unfit-, and conditionally-fit-to-drive patients. The results showed that the proposed method based on the YOLO (you only look once) object detector is efficient for computing TTFs from the eye-tracker data. We obtained discriminative results for fit-to-drive patients by application of Tukey's honest significant difference post hoc test (p < 0.01), while no difference was observed between conditionally-fit and unfit-to-drive groups (p = 0.542). Moreover, we show that time-to-collision (TTC), initial gaze distance (IGD) from pedestrians, and speed at the hazard onset did not influence the result, while the only significant interaction is among fitness, IGD, and TTC on TTF. Obtained TTFs are also compared with the perception response times (PRT) calculated independently from eye-tracker data and YOLO. Although we reached statistically significant results that speak in favor of possible method application for assessment of fitness to drive, we provide detailed directions for future driving simulation-based evaluation and propose processing workflow to secure reliable TTF calculation and its possible application in for example psychology and neuroscience.


title: CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuning

abstract: This paper focuses on automatically generating the text of an ad, and the goal is that the generated text can capture user interest for achieving higher click-through rate (CTR). We propose CREATER, a CTR-driven advertising text generation approach, to generate ad texts based on high-quality user reviews. To incorporate CTR objective, our model learns from online A/B test data with contrastive learning, which encourages the model to generate ad texts that obtain higher CTR. To alleviate the low-resource issue, we design a customized self-supervised objective reducing the gap between pre-training and fine-tuning. Experiments on industrial datasets show that CREATER significantly outperforms current approaches. It has been deployed online in a leading advertising platform and brings uplift on core online metrics.


title: SoK: The Impact of Unlabelled Data in Cyberthreat Detection

abstract: Machine learning (ML) has become an important paradigm for cyberthreat detection (CTD) in the recent years. A substantial research effort has been invested in the development of specialized algorithms for CTD tasks. From the operational perspective, however, the progress of ML-based CTD is hindered by the difficulty in obtaining the large sets of labelled data to train ML detectors. A potential solution to this problem are semisupervised learning (SsL) methods, which combine small labelled datasets with large amounts of unlabelled data. This paper is aimed at systematization of existing work on SsL for CTD and, in particular, on understanding the utility of unlabelled data in such systems. To this end, we analyze the cost of labelling in various CTD tasks and develop a formal cost model for SsL in this context. Building on this foundation, we formalize a set of requirements for evaluation of SsL methods, which elucidates the contribution of unlabelled data. We review the state-of-the-art and observe that no previous work meets such requirements. To address this problem, we propose a framework for assessing the benefits of unlabelled data in SsL. We showcase an application of this framework by performing the first benchmark evaluation that highlights the tradeoffs of 9 existing SsL methods on 9 public datasets. Our findings verify that, in some cases, unlabelled data provides a small, but statistically significant, performance gain. This paper highlights that SsL in CTD has a lot of room for improvement, which should stimulate future research in this field.


title: Dual Kasch Rings

abstract: It is well known that a ring $R$ is right Kasch if each simple right $R$-module embeds in a projective right $R$-module. In this paper we study the dual notion and call a ring $R$ right dual Kasch if each simple right $R$-module is a homomorphic image of an injective right $R$-module. We prove that $R$ is right dual Kasch if and only if every finitely generated projective right $R$-module is coclosed in its injective hull. Typical examples of dual Kasch rings are self-injective rings, V-rings and commutative perfect rings. Skew group rings of dual Kasch rings by finite groups are dual Kasch if the order of the group is invertible. Many examples are given to separate the notion of Kasch and dual Kasch rings. It is shown that commutative Kasch rings are dual Kasch, and a commutative ring with finite Goldie dimension is dual Kasch if and only if it is a classical ring (i.e. every element is a zero divisor or invertible). We obtain that, for a field $k$, a finite dimensional $k$-algebra is right dual Kasch if and only if it is left Kasch. We also discuss the rings over which every simple right module is a homomorphic image of its injective hull, and these rings are termed strongly dual Kasch.


title: Elliptic analogue of irregular prime numbers for the $p^{n}$-division fields of the curves $y^{2} = x^{3}-(s^{4}+t^{2})x$

abstract: A prime number $p$ is said to be irregular if it divides the class number of the $p$-th cyclotomic field $\mathbb{Q}(\zeta_{p}) = \mathbb{Q}(\mathbb{G}_m[p])$. In this paper, we study its elliptic analogue for the division fields of an elliptic curve. More precisely, for a prime number $p \geq 5$ and a positive integer $n$, we study the $p$-divisibility of the class number of the $p^{n}$-division field $\mathbb{Q}(E[p^{n}])$ of an elliptic curve $E$ of the form $y^{2} = x^{3}-(s^{4}+t^{2})x$. In particular, we construct a certain infinite subfamily consisting of curves with novel properties that they are of Mordell-Weil rank 1 and the class numbers of their $p^{n}$-division fields are divisible by $p^{2n}$. Moreover, we can prove that these division fields are not isomorphic to each other. In our construction, we use recent results obtained by the first author.


title: Distributions, first integrals and Legendrian foliations

abstract: We study germs of holomorphic distributions with "separated variables'. In codimension one, a well know example of this kind of distribution is given by the canonical contact structure on $\mathbb{P}^{2m+1}$ . Another example is the Darboux distribution, which gives the normal local form of any contact structure. Given a germ $D$ of holomorphic distribution with separated variables in $(\mathbb{C}^n,0)$, we show that there exists , for some $\kappa \in \mathbb{Z}_{\geq 0}$ related to the Taylor coefficients of $D$, a holomorphic submersion $H_{D}: (\mathbb{C}^n,0) \rightarrow (\mathbb{C}^{\kappa},0)$ such that $D$ is completely non-integrable on each level of $H_{D}$. Furthermore, we show that there exists a holomorphic vector field $Z$ tangent to $D$, such that each level of $H_{D}$ contains a leaf of $Z$ that is somewhere dense in the level. In particular, the field of meromorphic first integrals of $Z$ and that of $D$ are the same.


title: i-MYO: A Hybrid Prosthetic Hand Control System based on Eye-tracking, Augmented Reality and Myoelectric signal

abstract: Dexterous prosthetic hands have better grasp performance than traditional ones. However, patients still find it difficult to use these hands without a suitable control system. A new hybrid myoelectric control system, termed i-MYO, is presented and evaluated to solve this problem. The core component of the i-MYO is a novel grasp-type switching interface based on eye-tracking and augmented reality (AR), termed i-GSI. With the i-GSI, the user can easily switch a grasp type (six total) for a prosthetic hand by gazing at a GazeButton. The i-GSI is implemented in an AR helmet and is integrated, as an individual module, into the i-MYO system. In the i-MYO system, the myoelectric signal was used to control hand opening /closing proportionally. The operation of the i-MYO was tested on nine healthy subjects who wore HIT-V hand on the forearm and manipulated objects in a reach-and-grasp task. It was also tested on one patient who had an inferior myoelectric signal and was required to control the HIT-V hand to grasp objects. Results showed that in 91.6% of the trials, inexperienced healthy subjects accomplished the task within 5.9 s, and most failed trials were caused by a lack of experience in fine grasping. In addition, in about 1.5% of trials, the subjects also successfully transferred the objects but with a non-optimal grasp type. In 97.0% of the trials, the subjects spent ~1.3 s switching the optimal grasp types. A higher success rate in grasp type (99.1%) for the untrained patient has been observed thanks to more trials conducted. In 98.7 % of trials, the patient only needed another 2 s to control the hand to grasp the object after switching to the optimal grasp type. The tests demonstrate the control capability of the new system in multi-DOF prosthetics, and all inexperienced subjects were able to master the operation of the i-MYO quickly within a few pieces of training and apply it easily.


title: Anti-de Sitter neutron stars in the theory of gravity with nonminimal derivative coupling

abstract: We consider neutron star configurations in the scalar-tensor theory of gravity with the coupling between the kinetic term of a scalar field and the Einstein tensor (such the model is a subclass of Horndeski gravity). Neutron stars in this model were studied earlier for the special case with a vanishing ``bare'' cosmological constant, $\Lambda_0=0$, and a vanishing standard kinetic term, $\alpha=0$. This special case is of interest because it admits so-called stealth configuration, i.e. vacuum configuration with nontrivial scalar field and the Schwarzschild metric. However, generally one has $\Lambda_0\not=0$ and $\alpha\not=0$ and in this case a vacuum configuration is represented as an asymptotically anti-de Sitter (AdS) black hole solution with the nontrivial scalar field. We construct neutron star configurations in this general case and show that resulting diagrams describing the relation between mass and radius of the star essentially differ from those obtained in GR or the particular model with $\alpha=\Lambda_0=0$. Instead, the mass-radius diagrams are similar to those obtained for so-called bare strange stars when a star radius decreases monotonically with decreasing mass. We show also that neutron stars in the theory of gravity with nonminimal derivative coupling are more compact comparing to those in GR or the particular model with $\alpha=\Lambda_0=0$ and suggest a way to estimate possible values of the parameter of nonminimal coupling $\ell$. {\color{red} At last, using the Regge-Wheeler method, we discuss briefly the stability of obtained neutron star configurations.


title: Exploring strong and weak topological states on isostructural substitutions in TlBiSe2

abstract: Topological Insulators (TIs) are unique materials where insulating bulk hosts linearly dispersing surface states protected by the Time-Reversal Symmetry (TRS). These states lead to dissipationless current flow, which makes this class of materials highly promising for spintronic applications. Here, we predict new TIs via high-throughput screening by employing state-of-the-art first-principles based methodologies, viz., Density Functional Theory (DFT) and many-body perturbation theory (G0W0) combined with Spin-Orbit Coupling (SOC). For this, we take a well-known 3D TI, TlBiSe2 and perform complete substitution with suitable materials at different sites to check if the obtained isostructural materials exhibit topological properties. Subsequently, we scan these materials based on SOC-induced parity inversion at Time-Reversal Invariant Momenta (TRIM). Later, to confirm the topological nature of selected materials, we plot their surface states along with calculation of Z2 invariants. Our results show that GaBiSe2 is a Strong Topological Insulator (STI). Besides, we report six Weak Topological Insulators (WTIs) viz. PbBiSe2, SnBiSe2, SbBiSe2, Bi2Se2, TlSnSe2 and PbSbSe2. We have further verified that all the reported TIs are dynamically stable showing all real phonon modes of vibration.


title: Solving high-dimensional optimal stopping problems using optimization based model order reduction

abstract: Solving optimal stopping problems by backward induction in high dimensions is often very complex since the computation of conditional expectations is required. Typically, such computations are based on regression, a method that suffers from the curse of dimensionality. Therefore, the objective of this paper is to establish dimension reduction schemes for large-scale asset price models and to solve related optimal stopping problems (e.g. Bermudan option pricing) in the reduced setting, where regression is feasible. The proposed algorithm is based on an error measure between linear stochastic differential equations. We establish optimality conditions for this error measure with respect to the reduce system coefficients and propose a particular method that satisfies these conditions up to a small deviation. We illustrate the benefit of our approach in several numerical experiments, in which Bermudan option prices are determined.


title: Zigzag normalisation for associative $n$-categories

abstract: The theory of associative $n$-categories has recently been proposed as a strictly associative and unital approach to higher category theory. As a foundation for a proof assistant, this is potentially attractive, since it has the potential to allow simple formal proofs of complex high-dimensional algebraic phenomena. However, the theory relies on an implicit term normalisation procedure to recognize correct composites, with no recursive method available for computing it. Here we describe a new approach to term normalisation in associative $n$-categories, based on the categorical zigzag construction. This radically simplifies the theory, and yields a recursive algorithm for normalisation, which we prove is correct. Our use of categorical lifting properties allows us to give efficient proofs of our results. This normalisation algorithm forms a core component of the proof assistant homotopy.io, and we illustrate our scheme with worked examples.


title: Representation Learning for Content-Sensitive Anomaly Detection in Industrial Networks

abstract: Using a convGRU-based autoencoder, this thesis proposes a framework to learn spatial-temporal aspects of raw network traffic in an unsupervised and protocol-agnostic manner. The learned representations are used to measure the effect on the results of a subsequent anomaly detection and are compared to the application without the extracted features. The evaluation showed, that the anomaly detection could not effectively be enhanced when applied on compressed traffic fragments for the context of network intrusion detection. Yet, the trained autoencoder successfully generates a compressed representation (code) of the network traffic, which hold spatial and temporal information. Based on the models residual loss, the autoencoder is also capable of detecting anomalies by itself. Lastly, an approach for a kind of model interpretability (LRP) was investigated in order to identify relevant areas within the raw input data, which is used to enrich alerts generated by an anomaly detection method.


title: One-way Explainability Isn't The Message

abstract: Recent engineering developments in specialised computational hardware, data-acquisition and storage technology have seen the emergence of Machine Learning (ML) as a powerful form of data analysis with widespread applicability beyond its historical roots in the design of autonomous agents. However -- possibly because of its origins in the development of agents capable of self-discovery -- relatively little attention has been paid to the interaction between people and ML. In this paper we are concerned with the use of ML in automated or semi-automated tools that assist one or more human decision makers. We argue that requirements on both human and machine in this context are significantly different to the use of ML either as part of autonomous agents for self-discovery or as part statistical data analysis. Our principal position is that the design of such human-machine systems should be driven by repeated, two-way intelligibility of information rather than one-way explainability of the ML-system's recommendations. Iterated rounds of intelligible information exchange, we think, will characterise the kinds of collaboration that will be needed to understand complex phenomena for which neither man or machine have complete answers. We propose operational principles -- we call them Intelligibility Axioms -- to guide the design of a collaborative decision-support system. The principles are concerned with: (a) what it means for information provided by the human to be intelligible to the ML system; and (b) what it means for an explanation provided by an ML system to be intelligible to a human. Using examples from the literature on the use of ML for drug-design and in medicine, we demonstrate cases where the conditions of the axioms are met. We describe some additional requirements needed for the design of a truly collaborative decision-support system.


title: Structural Extensions of Basis Pursuit: Guarantees on Adversarial Robustness

abstract: While deep neural networks are sensitive to adversarial noise, sparse coding using the Basis Pursuit (BP) method is robust against such attacks, including its multi-layer extensions. We prove that the stability theorem of BP holds upon the following generalizations: (i) the regularization procedure can be separated into disjoint groups with different weights, (ii) neurons or full layers may form groups, and (iii) the regularizer takes various generalized forms of the $\ell_1$ norm. This result provides the proof for the architectural generalizations of Cazenavette et al. (2021), including (iv) an approximation of the complete architecture as a shallow sparse coding network. Due to this approximation, we settled to experimenting with shallow networks and studied their robustness against the Iterative Fast Gradient Sign Method on a synthetic dataset and MNIST. We introduce classification based on the $\ell_2$ norms of the groups and show numerically that it can be accurate and offers considerable speedups. In this family, linear transformer shows the best performance. Based on the theoretical results and the numerical simulations, we highlight numerical matters that may improve performance further.


title: Marx after Okishio: Falling Rate of Profit with Constant Rate of Exploitation

abstract: Can cost-reducing technical change lead to a fall in the long run rate of profit if class struggle manages to keep the rate of exploitation constant? In a general circulating capital model, we derive sufficient conditions for cost-reducing technical change to both keep the rate of exploitation constant and lead to a fall in the equilibrium rate of profit. Further, if the real wage bundle is such that the maximum price-value ratio is larger than 1 plus the rate of exploitation, then starting from any configuration of technology and real wage, we can always find a viable, CU-LS technical change that satisfies the sufficient conditions for the previous result. Taken together, these results vindicate Marx's claim in Volume III of Capital, that if the rate of exploitation remains unchanged then viable, CU-LS technical change in capitalist economies can lead to a fall in the long run rate of profit.


title: Meta-Learning Sparse Compression Networks

abstract: Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling alternative to the more common multi-dimensional array representation. Recent work on such Implicit Neural Representations (INRs) has shown that - following careful architecture search - INRs can outperform established compression methods such as JPEG (e.g. Dupont et al., 2021). In this paper, we propose crucial steps towards making such ideas scalable: Firstly, we employ state-of-the-art network sparsification techniques to drastically improve compression. Secondly, introduce the first method allowing for sparsification to be employed in the inner-loop of commonly used Meta-Learning algorithms, drastically improving both compression and the computational cost of learning INRs. The generality of this formalism allows us to present results on diverse data modalities such as images, manifolds, signed distance functions, 3D shapes and scenes, several of which establish new state-of-the-art results.


title: The dynamics of a single trapped ion in a high density media: a stochastic approach

abstract: Based on the Langevin equation, a stochastic formulation is implemented to describe the dynamics of a trapped ion in a bath of ultracold atoms, including an excess of micromotion. The ion dynamics is described following a hybrid analytical-numerical approach in which the ion is treated as a classical impurity in a thermal bath. As a result, the ion energy's time evolution and distribution are derived from studying the sympathetic cooling process. Furthermore, the ion dynamics under different stochastic noise terms is also considered to gain information on the bath properties' role in the system's energy transfer processes. Finally, the results obtained from this formulation are contrasted with those obtained with a more traditional Monte Carlo approach.


title: A lightweight multi-scale context network for salient object detection in optical remote sensing images

abstract: Due to the more dramatic multi-scale variations and more complicated foregrounds and backgrounds in optical remote sensing images (RSIs), the salient object detection (SOD) for optical RSIs becomes a huge challenge. However, different from natural scene images (NSIs), the discussion on the optical RSI SOD task still remains scarce. In this paper, we propose a multi-scale context network, namely MSCNet, for SOD in optical RSIs. Specifically, a multi-scale context extraction module is adopted to address the scale variation of salient objects by effectively learning multi-scale contextual information. Meanwhile, in order to accurately detect complete salient objects in complex backgrounds, we design an attention-based pyramid feature aggregation mechanism for gradually aggregating and refining the salient regions from the multi-scale context extraction module. Extensive experiments on two benchmarks demonstrate that MSCNet achieves competitive performance with only 3.26M parameters. The code will be available at https://github.com/NuaaYH/MSCNet.


title: 3D Single Source Localization Based on Euclidean Distance Matrices

abstract: A popular approach for 3D source localization using multiple microphones is the steered-response power method, where the source position is directly estimated by maximizing a function of three continuous position variables. Instead of directly estimating the source position, in this paper we propose an indirect, distance-based method for 3D source localization. Based on properties of Euclidean distance matrices (EDMs), we reformulate the 3D source localization problem as the minimization of a cost function of a single variable, namely the distance between the source and the reference microphone. Using the known microphone geometry and estimated time-differences of arrival (TDOAs) between the microphones, we show how the 3D source position can be computed based on this variable. In addition, instead of using a single TDOA estimate per microphone pair, we propose an extension that enables to select the most appropriate estimate from a set of candidate TDOA estimates, which is especially relevant in reverberant environments with strong early reflections. Experimental results for different source and microphone constellations show that the proposed EDM-based method consistently outperforms the steered-response power method, especially when the source is close to the microphones.


title: Inference in non-equilibrium systems from incomplete information: the case of linear systems and its pitfalls

abstract: Data from experiments and theoretical arguments are the two pillars sustaining the job of modelling physical systems through inference. In order to solve the inference problem, the data should satisfy certain conditions that depend also upon the particular questions addressed in a research. Here we focus on the characterization of systems in terms of a distance from equilibrium, typically the entropy production (time-reversal asymmetry) or the violation of the Kubo fluctuation-dissipation relation. We show how general, counter-intuitive and negative for inference, is the problem of the impossibility to estimate the distance from equilibrium using a series of scalar data which have a Gaussian statistics. This impossibility occurs also when the data are correlated in time, and that is the most interesting case because it usually stems from a multi-dimensional linear Markovian system where there are many time-scales associated to different variables and, possibly, thermal baths. Observing a single variable (or a linear combination of variables) results in a one-dimensional process which is always indistinguishable from an equilibrium one (unless a perturbation-response experiment is available). In a setting where only data analysis (and not new experiments) is allowed, we propose - as a way out - the combined use of different series of data acquired with different parameters. This strategy works when there is a sufficient knowledge of the connection between experimental parameters and model parameters. We also briefly discuss how such results emerge, similarly, in the context of Markov chains within certain coarse-graining schemes. Our conclusion is that the distance from equilibrium is related to quite a fine knowledge of the full phase space, and therefore typically hard to approximate in real experiments.


title: A Family of Homogeneous Operators In The Cowen-Douglas Class Over The Poly-disc

abstract: We construct a large family of positive-definite kernels $K: \mathbb{D}^n\times \mathbb{D}^n \to \mbox{M} (r, \mathbb C)$, holomorphic in the first variable and anti-holomorphic in the second, that are quasi-invariant with respect to the subgroup $\mbox{M\"ob} \times\cdots\times \mbox{M\"ob}$ ($n$ times) of the bi-holomorphic automorphism group of $\mathbb{D}^n$. The adjoint of the $n$ - tuples of multiplication operators by the co-ordinate functions on the Hilbert spaces $\mathcal H_K$ determined by $K$ is then homogeneous with respect to this subgroup. We show that these $n$ - tuples are irreducible, are in the Cowen-Douglas class $\mathrm B_r(\mathbb D^n)$ and that they are mutually pairwise unitarily inequivalent.


title: Breathing of dissipative light bullets of nonlinear polarization mode in Kerr resonators

abstract: We demonstrate the existence of breathing dissipative light bullets in a birefringent optical resonator filled with Kerr media. The propagation of light inside the cavity for each polarized component, which is coupled by cross-phase modulation, is described by the coupled Lugiato-Lefever equations. The space-time dynamics of breathing light bullets are described using Stokes parameters and frequency spectra.


title: Skew constacyclic codes over a class of finite commutative semisimple rings

abstract: In this article, we study skew constacyclic codes over a class of finite commutative semisimple rings. The automorphism group of $\mathcal{R}=\prod_{i=1}^t F_q$ is determined, and we characterize skew constacyclic codes over ring by linear codes over finite field. We also define homomorphisms which map linear codes over $\mathcal{R}$ to matrix product codes over $F_q,$ some optimal linear codes over finite fields are obtained.


title: Two ultracold highly magnetic atoms in a one-dimensional harmonic trap

abstract: We theoretically investigate the properties of two interacting ultracold highly magnetic atoms trapped in a one-dimensional harmonic potential. The atoms interact via an anisotropic long-range dipole-dipole interaction, which in one dimension effectively can be modeled by the contact interaction. We investigate the interplay of the external magnetic field, the spin-spin interaction, and the trapping potential and how they affect the magnetization of the system. We show the role of indistinguishability and symmetries in the dynamics by studying the time evolution of the observables that could be measured experimentally. The presented model may depict the on-site interaction of the extended Hubbard models, therefore giving a better understanding of the fundamental building block of the respective many-body quantum simulators.

categories: physics.atom-ph cond-mat.quant-gas physics.chem-ph quant-ph


title: A Tutorial on Structural Optimization

abstract: Structural optimization is a useful and interesting tool. Unfortunately, it can be hard for new researchers to get started on the topic because existing tutorials assume the reader has substantial domain knowledge. They obscure the fact that structural optimization is really quite simple, elegant, and easy to implement. With that in mind, let's write our own structural optimization code, from scratch, in 180 lines.


title: DL4DS -- Deep Learning for empirical DownScaling

abstract: A common task in Earth Sciences is to infer climate information at local and regional scales from global climate models. Dynamical downscaling requires running expensive numerical models at high resolution which can be prohibitive due to long model runtimes. On the other hand, statistical downscaling techniques present an alternative approach for learning links between the large- and local-scale climate in a more efficient way. A large number of deep neural network-based approaches for statistical downscaling have been proposed in recent years, mostly based on convolutional architectures developed for computer vision and super-resolution tasks. This paper presents DL4DS, Deep Learning for empirical DownScaling, a python library that implements a wide variety of state-of-the-art and novel algorithms for downscaling gridded Earth Science data with deep neural networks. DL4DS has been designed with the goal of providing a general framework for training convolutional neural networks with configurable architectures and learning strategies to facilitate the conduction of comparative and ablation studies in a robust way. We showcase the capabilities of DL4DS on air quality CAMS data over the western Mediterranean area. The DL4DS library can be found in this repository: https://github.com/carlos-gg/dl4ds


title: Monitoring Security of Enterprise Hosts via DNS Data Analysis

abstract: Enterprise Networks are growing in scale and complexity, with heterogeneous connected assets needing to be secured in different ways. Nevertheless, virtually all connected assets use the Domain Name System (DNS) for address resolution, and DNS has thus become a convenient vehicle for attackers to covertly perform Command and Control (C&C) communication, data theft, and service disruption across a wide range of assets. Enterprise security appliances that monitor network traffic typically allow all DNS traffic through as it is vital for accessing any web service; they may at best match against a database of known malicious patterns, and are therefore ineffective against zero-day attacks. This thesis focuses on three high-impact cyber-attacks that leverage DNS, specifically data exfiltration, malware C&C communication, and service disruption. Using big data (over 10B packets) of DNS network traffic collected from a University campus and a Government research organization over a 6-month period, we illustrate the anatomy of these attacks, train machines for automatically detecting such attacks, and evaluate their efficacy in the field.


title: Dynamic multiscaling in stochastically forced Burgers turbulence

abstract: We carry out a detailed study of dynamic multiscaling in the turbulent nonequilibrium, but statistically steady, state of the stochastically forced one-dimensional Burgers equation. We introduce the concept of $\textit{interval collapse times}$ $\tau_{\rm col}$, the time taken for an interval of length $\ell$, demarcated by a pair of Lagrangian tracers, to collapse at a shock. By calculating the dynamic scaling exponent of the order-$p$ moment of $\tau_{\rm col}$, we show that (a) there is $\textit{not one but an infinity of characteristic time scales}$ and (b) the probability distribution function of $\tau_{\rm col}$ is non-Gaussian and has a power-law tail. Our study is based on (a) a theoretical framework that allows us to obtain dynamic-multiscaling exponents analytically, (b) extensive direct numerical simulations, and (c) a careful comparison of the results of (a) and (b). We discuss possible generalizations of our work to dimensions $d >1 $, for the stochastically forced Burgers equation, and to other compressible flows that exhibit turbulence with shocks.


title: A journey through the mathematical world of Karen Uhlenbeck

abstract: This is an expository article discussing some of the work of Uhlenbeck, focusing mainly on work concerning harmonic maps and Yang-Mills fields.


title: Powers of Hamilton cycles in dense graphs perturbed by a random geometric graph

abstract: Let $G$ be a graph obtained as the union of some $n$-vertex graph $H_n$ with minimum degree $\delta(H_n)\geq\alpha n$ and a $d$-dimensional random geometric graph $G^d(n,r)$. We investigate under which conditions for $r$ the graph $G$ will a.a.s. contain the $k$-th power of a Hamilton cycle, for any choice of $H_n$. We provide asymptotically optimal conditions for $r$ for all values of $\alpha$, $d$ and $k$. This has applications in the containment of other spanning structures, such as $F$-factors.


title: The Structure of Configurations in One-Dimensional Majority Cellular Automata: From Cell Stability to Configuration Periodicity

abstract: We study the dynamics of (synchronous) one-dimensional cellular automata with cyclical boundary conditions that evolve according to the majority rule with radius $ r $. We introduce a notion that we term cell stability with which we express the structure of the possible configurations that could emerge in this setting. Our main finding is that apart from the configurations of the form $ (0^{r+1}0^* + 1^{r+1}1^*)^* $, which are always fixed-points, the other configurations that the automata could possibly converge to, which are known to be either fixed-points or 2-cycles, have a particular spatially periodic structure. Namely, each of these configurations is of the form $ s^* $ where $ s $ consists of $ O(r^2) $ consecutive sequences of cells with the same state, each such sequence is of length at most $ r $, and the total length of $ s $ is $ O(r^2) $ as well. We show that an analogous result also holds for the minority rule.


title: Search for $CP$ violation using $\hat{T}$-odd correlations in $B^{0} \to p \bar p K^{+} \pi^{-}$ decays

abstract: A search for $CP$ and $P$ violation in charmless four-body $B^{0} \to p \bar p K^{+} \pi^{-}$ decays is performed using triple-product asymmetry observables. It is based on proton-proton collision data collected by the LHCb experiment at centre-of-mass energies of $7$, $8$ and $13$ TeV, corresponding to a total integrated luminosity of $8.4$ fb$^{-1}$. The $CP$- and $P$-violating asymmetries are measured both in the integrated phase space and in specific regions. No evidence is seen for $CP$ violation. $P$-parity violation is observed at a significance of 5.8 standard deviations


title: One Explanation to Rule them All -- Ensemble Consistent Explanations

abstract: Transparency is a major requirement of modern AI based decision making systems deployed in real world. A popular approach for achieving transparency is by means of explanations. A wide variety of different explanations have been proposed for single decision making systems. In practice it is often the case to have a set (i.e. ensemble) of decisions that are used instead of a single decision only, in particular in complex systems. Unfortunately, explanation methods for single decision making systems are not easily applicable to ensembles -- i.e. they would yield an ensemble of individual explanations which are not necessarily consistent, hence less useful and more difficult to understand than a single consistent explanation of all observed phenomena. We propose a novel concept for consistently explaining an ensemble of decisions locally with a single explanation -- we introduce a formal concept, as well as a specific implementation using counterfactual explanations.


title: Personalized Behaviour Models: A Survey Focusing on Autism Therapy Applications

abstract: Children with Autism Spectrum Disorder find robots easier to communicate with than humans. Thus, robots have been introduced in autism therapies. However, due to the environmental complexity, the used robots often have to be controlled manually. This is a significant drawback of such systems and it is required to make them more autonomous. In particular, the robot should interpret the child's state and continuously adapt its actions according to the behaviour of the child under therapy. This survey elaborates on different forms of personalized robot behaviour models. Various approaches from the field of Human-Robot Interaction, as well as Child-Robot Interaction, are discussed. The aim is to compare them in terms of their deficits, feasibility in real scenarios, and potential usability for autism-specific Robot-Assisted Therapy. The general challenge for algorithms based on which the robot learns proper interaction strategies during therapeutic games is to increase the robot's autonomy, thereby providing a basis for a robot's decision-making.


title: CTL* model checking for data-aware dynamic systems with arithmetic

abstract: The analysis of complex dynamic systems is a core research topic in formal methods and AI, and combined modelling of systems with data has gained increasing importance in applications such as business process management. In addition, process mining techniques are nowadays used to automatically mine process models from event data, often without correctness guarantees. Thus verification techniques for linear and branching time properties are needed to ensure desired behavior. Here we consider data-aware dynamic systems with arithmetic (DDSAs), which constitute a concise but expressive formalism of transition systems with linear arithmetic guards. We present a CTL* model checking procedure for DDSAs that relies on a finite-state abstraction by means of a set of formulas that capture variable configurations. Linear-time verification was shown to be decidable in specific classes of DDSAs where the constraint language or the control flow are suitably confined. We investigate several of these restrictions for the case of CTL*, with both positive and negative results: CTL* verification is proven decidable for monotonicity and integer periodicity constraint systems, but undecidable for feedback free and bounded lookback systems. To demonstrate the feasibility of our approach, we implemented it in the SMT-based prototype ada, showing that many practical business process models can be effectively analyzed.


title: Internet of Intelligence: A Survey on the Enabling Technologies, Applications, and Challenges

abstract: The Internet of intelligence is conceived as an emerging networking paradigm, which will make intelligence as easy to obtain as information. This paper provides an overview of the Internet of intelligence, focusing on motivations, architecture, enabling technologies, applications, and existing challenges. This can provide a good foundation for those who are interested to gain insights into the concept of the Internet of intelligence and the key enablers of this emerging networking paradigm. Specifically, this paper starts by investigating the evolution of networking paradigms and artificial intelligence (AI), based on which we present the motivations of the Internet of intelligence by demonstrating that networking needs intelligence and intelligence needs networking. We then present the layered architecture to characterize the Internet of intelligence systems and discuss the enabling technologies of each layer. Moreover, we discuss the critical applications and their integration with the Internet of intelligence paradigm. Finally, some technical challenges and open issues are summarized to fully exploit the benefits of the Internet of intelligence.


title: Fast Neural Network based Solving of Partial Differential Equations

abstract: We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to converge to a PDE solution much faster than classic Physically Informed Neural Network (PINNs) approaches.


title: Impartial Selection with Additive Guarantees via Iterated Deletion

abstract: Impartial selection is the selection of an individual from a group based on nominations by other members of the group, in such a way that individuals cannot influence their own chance of selection. We give a deterministic mechanism with an additive performance guarantee of $O(n^{(1+\kappa)/2})$ in a setting with $n$ individuals where each individual casts $O(n^{\kappa})$ nominations, where $\kappa\in[0,1]$. For $\kappa=0$, i.e. when each individual casts at most a constant number of nominations, this bound is $O(\sqrt{n})$. This matches the best-known guarantee for randomized mechanisms and a single nomination. For $\kappa=1$ the bound is $O(n)$. This is trivial, as even a mechanism that never selects provides an additive guarantee of $n-1$. We show, however, that it is also best possible: for every deterministic impartial mechanism there exists a situation in which some individual is nominated by every other individual and the mechanism either does not select or selects an individual not nominated by anyone.


title: Sparse superposition codes with rotational invariant coding matrices for memoryless channels

abstract: We recently showed in [1] the superiority of certain structured coding matrices ensembles (such as partial row-orthogonal) for sparse superposition codes when compared with purely random matrices with i.i.d. entries, both information-theoretically and under practical vector approximate message-passing decoding. Here we generalize this result to binary input channels under generalized vector approximate message-passing decoding [2].We focus on specific binary output channels for concreteness but our analysis based on the replica symmetric method from statistical physics applies to any memoryless channel. We confirm that the "spectral criterion" introduced in [1], a coding-matrix design principle which allows the code to be capacity-achieving in the "large section size" asymptotic limit, extends to generic memoryless channels. Moreover, we also show that the vanishing error floor property [3] of this coding scheme is universal for arbitrary spectrum of the coding matrix.


title: A link model approach to identify congestion hotspots

abstract: Congestion emerges when high demand peaks put transportation systems under stress. Understanding the interplay between the spatial organization of demand, the route choices of citizens, and the underlying infrastructures is thus crucial to locate congestion hotspots and mitigate the delay. Here we develop a model where links are responsible for the processing of vehicles that can be solved analytically before and after the onset of congestion providing insights into the global and local congestion. We apply our method to synthetic and real transportation networks observing a strong agreement between the analytical solutions and the monte carlo simulations, and a reasonable agreement with the travel times observed in 12 cities under congested phase. Our framework can incorporate any type of routing extracted from real trajectory data to provide a more detailed description of congestion phenomena and could be used to dynamically adapt the capacity of road segments according to the flow of vehicles or reduce congestion through hotspot pricing.


title: Attention-based Multimodal Feature Representation Model for Micro-video Recommendation

abstract: In recommender systems, models mostly use a combination of embedding layers and multilayer feedforward neural networks. The high-dimensional sparse original features are downscaled in the embedding layer and then fed into the fully connected network to obtain prediction results. However, the above methods have a rather obvious problem, that is, the features directly input are treated as independent individuals, and in fact there are internal correlations between features and features, and even different features have different importance in the recommendation. In this regard, this paper adopts a self-attentive mechanism to mine the internal correlations between features as well as their relative importance. In recent years, as a special form of attention mechanism, self-attention mechanism is favored by many researchers. The self-attentive mechanism captures the internal correlation of data or features by learning itself, thus reducing the dependence on external sources. Therefore, this paper adopts a multi-headed self-attentive mechanism to mine the internal correlations between features and thus learn the internal representation of features. At the same time, considering the rich information often hidden between features, the new feature representation obtained by crossover between the two is likely to imply the new description of the user likes the item. However, not all crossover features are meaningful, i.e., there is a problem of limited expression of feature combinations. Therefore, this paper adopts an attention-based approach to learn the external cross-representation of features.


title: Deep Multi-Frame MVDR Filtering for Binaural Noise Reduction

abstract: To improve speech intelligibility and speech quality in noisy environments, binaural noise reduction algorithms for head-mounted assistive listening devices are of crucial importance. Several binaural noise reduction algorithms such as the well-known binaural minimum variance distortionless response (MVDR) beamformer have been proposed, which exploit spatial correlations of both the target speech and the noise components. Furthermore, for single-microphone scenarios, multi-frame algorithms such as the multi-frame MVDR (MFMVDR) filter have been proposed, which exploit temporal instead of spatial correlations. In this contribution, we propose a binaural extension of the MFMVDR filter, which exploits both spatial and temporal correlations. The binaural MFMVDR filters are embedded in an end-to-end deep learning framework, where the required parameters, i.e., the speech spatio-temporal correlation vectors as well as the (inverse) noise spatio-temporal covariance matrix, are estimated by temporal convolutional networks (TCNs) that are trained by minimizing the mean spectral absolute error loss function. Simulation results comprising measured binaural room impulses and diverse noise sources at signal-to-noise ratios from -5 dB to 20 dB demonstrate the advantage of utilizing the binaural MFMVDR filter structure over directly estimating the binaural multi-frame filter coefficients with TCNs.


title: The complex Maxwell stress tensor theorem: The imaginary stress tensor and the reactive strength of orbital momentum. A novel scenery underlying electromagnetic and optical forces

abstract: We uncover the existence of a universal phenomenon concerning the electromagnetic optical force exerted by light or other electromagnetic waves on a distribution of charges and currents in general, and of particles in particular. This conveys the appearence of underlying reactive quantities that hinder radiation pressure and currently observed time-averaged forces. This constitutes a novel paradigm of the mechanical efficiency of light on matter, and completes the landscape of the electromagnetic force in classical electrodynamics; widening our understanding in the design of both illumination and particles in optical manipulation without the need of increasing the illuminating power, and thus lowering dissipation and heating. We show that this may be accomplished through the minimization of what we establish as the reactive strength of canonical (i.e. orbital) momentum, which plays against the optical force a role analogous to that of the reactive power versus the radiation efficiency of an antenna. This long time overlooked quantity, important for current progress of optical manipulation, and that stems from the complex Maxwell theorem of conservation of complex momentum that we put forward, as well as its alternating flow associated to the imaginary part of the complex Maxwell stress tensor, conform the imaginary Lorentz force that we introduce in this work, and that like the reactive strength of orbital momentum, is antagonic to the well-known time-averaged force; thus making this reactive Lorentz force indirectly observable near wavelengths at which the time-averaged force is lowered.


title: Coherence-Based Frequency Subset Selection For Binaural RTF-Vector-Based Direction of Arrival Estimation for Multiple Speakers

abstract: Recently, a method has been proposed to estimate the direction of arrival (DOA) of a single speaker by minimizing the frequency-averaged Hermitian angle between an estimated relative transfer function (RTF) vector and a database of prototype anechoic RTF vectors. In this paper, we extend this method to multi-speaker localization by introducing the frequency-averaged Hermitian angle spectrum and selecting peaks of this spatial spectrum. To construct the Hermitian angle spectrum, we consider only a subset of frequencies, where it is likely that one speaker is dominant. We compare the effectiveness of the generalized magnitude squared coherence and two coherent-to-diffuse ratio (CDR) estimators as frequency selection criteria. Simulation results for estimating the DOAs of two speakers in a reverberant environment with diffuse-like babble noise using binaural hearing devices show that using the binaural effective-coherence-based CDR estimate as a frequency selection criterion yields the best performance.


title: Predictions for the Sivers Single-Spin Asymmetry from Holographic QCD

abstract: A new approach to nonperturbative QCD, holographic light-front QCD, provides a comprehensive model for hadron dynamics and spectroscopy, incorporating color confinement, a universal hadron mass scale, the prediction of a massless pion in the chiral limit, and connections between the spectroscopy of mesons, baryons and tetraquarks across the full hadron spectrum. In this article we present predictions for the Sivers asymmetry and related transverse momentum distributions for the proton based on the light-front wavefunctions of the baryon eigenstate predicted by holographic QCD.


title: Trading Positional Complexity vs. Deepness in Coordinate Networks

abstract: It is well noted that coordinate-based MLPs benefit -- in terms of preserving high-frequency information -- through the encoding of coordinate positions as an array of Fourier features. Hitherto, the rationale for the effectiveness of these positional encodings has been mainly studied through a Fourier lens. In this paper, we strive to broaden this understanding by showing that alternative non-Fourier embedding functions can indeed be used for positional encoding. Moreover, we show that their performance is entirely determined by a trade-off between the stable rank of the embedded matrix and the distance preservation between embedded coordinates. We further establish that the now ubiquitous Fourier feature mapping of position is a special case that fulfills these conditions. Consequently, we present a more general theory to analyze positional encoding in terms of shifted basis functions. In addition, we argue that employing a more complex positional encoding -- that scales exponentially with the number of modes -- requires only a linear (rather than deep) coordinate function to achieve comparable performance. Counter-intuitively, we demonstrate that trading positional embedding complexity for network deepness is orders of magnitude faster than current state-of-the-art; despite the additional embedding complexity. To this end, we develop the necessary theoretical formulae and empirically verify that our theoretical claims hold in practice.


title: Formalization of Advanced VOs semantics and VO Refinement

abstract: This document lays out the foundations for VO and requirement refinement, abstractions of models, and instantiations. Also, VOs on abstractions and instantiations are considered.


title: Constraining the Attack Space of Machine Learning Models with Distribution Clamping Preprocessing

abstract: Preprocessing and outlier detection techniques have both been applied to neural networks to increase robustness with varying degrees of success. In this paper, we formalize the ideal preprocessor function as one that would take any input and set it to the nearest in-distribution input. In other words, we detect any anomalous pixels and set them such that the new input is in-distribution. We then illustrate a relaxed solution to this problem in the context of patch attacks. Specifically, we demonstrate that we can model constraints on the patch attack that specify regions as out of distribution. With these constraints, we are able to preprocess inputs successfully, increasing robustness on CARLA object detection.


title: Optimising shadow tomography with generalised measurements

abstract: Advances in quantum technology require scalable techniques to efficiently extract information from a quantum system, such as expectation values of observables or its entropy. Traditional tomography is limited to a handful of qubits and shadow tomography has been suggested as a scalable replacement for larger systems. Shadow tomography is conventionally analysed based on outcomes of ideal projective measurements on the system upon application of randomised unitaries. Here, we suggest that shadow tomography can be much more straightforwardly formulated for generalised measurements, or positive operator valued measures. Based on the idea of the least-square estimator, shadow tomography with generalised measurements is both more general and simpler than the traditional formulation with randomisation of unitaries. In particular, this formulation allows us to analyse theoretical aspects of shadow tomography in detail. For example, we provide a detailed study of the implication of symmetries in shadow tomography. Shadow tomography with generalised measurements is also indispensable in realistic implementation of quantum mechanical measurements, when noise is unavoidable. Moreover, we also demonstrate how the optimisation of measurements for shadow tomography tailored toward a particular set of observables can be carried out.


title: Symbolic-Numeric Factorization of Differential Operators

abstract: We present a symbolic-numeric Las Vegas algorithm for factoring Fuchsian ordinary differential operators with rational function coefficients. The new algorithm combines ideas of van Hoeij's "local-to-global" method and of the ''analytic'' approach proposed by van der Hoeven. It essentially reduces to the former in ''easy'' cases where the local-to-global method succeeds, and to an optimized variant of the latter in the "hardest" cases, while handling intermediate cases more efficiently than both.