title: Frame attention networks for facial expression recognition in videos

abstract: The video-based facial expression recognition aims to classify a given video into several basic emotions. How to integrate facial features of individual frames is crucial for this task. In this paper, we propose the Frame Attention Networks (FAN), to automatically highlight some discriminative frames in an end-to-end framework. The network takes a video with a variable number of face images as its input and produces a fixed-dimension representation. The whole network is composed of two modules. The feature embedding module is a deep Convolutional Neural Network (CNN) which embeds face images into feature vectors. The frame attention module learns multiple attention weights which are used to adaptively aggregate the feature vectors to form a single discriminative video representation. We conduct extensive experiments on CK+ and AFEW8.0 datasets. Our proposed FAN shows superior performance compared to other CNN based methods and achieves state-of-the-art performance on CK+.


title: Open-MPI over MOSIX: paralleled computing in a clustered world

abstract: Recent increased interest in Cloud computing emphasizes the need to find an adequate solution to the load-balancing problem in parallel computing -- efficiently running several jobs concurrently on a cluster of shared computers (nodes). One approach to solve this problem is by preemptive process migration -- the transfer of running processes between nodes. A possible drawback of this approach is the increased overhead between heavily communicating processes. This project presents a solution to this last problem by incorporating the process migration capability of MOSIX into Open-MPI and by reducing the resulting communication overhead. Specifically, we developed a module for direct communication (DiCOM) between migrated Open-MPI processes, to overcome the increased communication latency of TCP/IP between such processes. The outcome is reduced run-time by improved resource allocation.


title: Modeling the Generic Breakthrough Curve for Adsorption Process

abstract: This work is aimed at understanding the basic principles of adsorption process in great details as adsorptive separation process has broad applications in the industry. To this end, a simple mathematical model has been used to describe transient fixed bed physical adsorption process. Governing equations are solved numerically to obtain breakthrough curves for single component and multi-component monolayer adsorption. Desorption of a saturated bed by an inert fluid is also considered. A full parametric study is performed to analyze the effects of different parameters such as bed length, velocity, diffusivity, particle radius and isotherm properties on the nature of the breakthrough curve. Analysis of these results led to the development of the generic breakthrough curve for a single component monolayer adsorption which will enable us to tell the nature of breakthrough curve for different process parameters without recourse to the numerical simulation or experiment. Thus this study will be of great interest in the industrial separation process.


title: Statistical estimation of the Kullback-Leibler divergence

abstract: Wide conditions are provided to guarantee asymptotic unbiasedness and L^2-consistency of the introduced estimates of the Kullback-Leibler divergence for probability measures in R^d having densities w.r.t. the Lebesgue measure. These estimates are constructed by means of two independent collections of i.i.d. observations and involve the specified k-nearest neighbor statistics. In particular, the established results are valid for estimates of the Kullback-Leibler divergence between any two Gaussian measures in R^d with nondegenerate covariance matrices. As a byproduct we obtain new statements concerning the Kozachenko-Leonenko estimators of the Shannon differential entropy.


title: An atomistic derivation of von-K\'arm\'an plate theory

abstract: We derive von-K\'arm\'an plate theory from three dimensional, purely atomistic models with classical particle interaction. This derivation is established as a $\Gamma$-limit when considering the limit where the interatomic distance $\varepsilon$ as well as the thickness of the plate $h$ tend to zero. In particular, our analysis includes the ultrathin case where $\varepsilon \sim h$, leading to a new von-K\'arm\'an plate theory for finitely many layers.


title: Hybrid Collision Avoidance for ASVs Compliant with COLREGs Rules 8 and 13-17

abstract: This paper presents a three-layered hybrid collision avoidance (COLAV) system for autonomous surface vehicles, compliant with rules 8 and 13-17 of the International Regulations for Preventing Collisions at Sea (COLREGs). The COLAV system consists of a high-level planner producing an energy-optimized trajectory, a model predictive control based mid-level COLAV algorithm considering moving obstacles and the COLREGs, and the branching-course model predictive control algorithm for short-term COLAV handling emergency situations in accordance with the COLREGs. Previously developed algorithms by the authors are used for the high-level planner and short-term COLAV, while we in this paper further develop the mid-level algorithm to make it comply with COLREGs rules 13-17. This includes developing a state machine for classifying obstacle vessels using a combination of the geometrical situation, the distance and time to the closest point of approach (CPA) and a new CPA-like measure. The performance of the hybrid COLAV system is tested through numerical simulations for three scenarios representing a range of different challenges, including multi-obstacle situations with multiple simultaneously active COLREGs rules, and also obstacles ignoring the COLREGs. The COLAV system avoids collision in all the scenarios, and follows the energy-optimized trajectory when the obstacles do not interfere with it.


title: Incidents Are Meant for Learning, Not Repeating: Sharing Knowledge About Security Incidents in Cyber-Physical Systems

abstract: Cyber-physical systems (CPSs) are part of most critical infrastructures such as industrial automation and transportation systems. Thus, security incidents targeting CPSs can have disruptive consequences to assets and people. As prior incidents tend to re-occur, sharing knowledge about these incidents can help organizations be more prepared to prevent, mitigate or investigate future incidents. This paper proposes a novel approach to enable representation and sharing of knowledge about CPS incidents across different organizations. To support sharing, we represent incident knowledge (incident patterns) capturing incident characteristics that can manifest again, such as incident activities or vulnerabilities exploited by offenders. Incident patterns are a more abstract representation of specific incident instances and, thus, are general enough to be applicable to various systems - different than the one in which the incident occurred. They can also avoid disclosing potentially sensitive information about an organization's assets and resources. We provide an automated technique to extract an incident pattern from a specific incident instance. To understand how an incident pattern can manifest again in other cyber-physical systems, we also provide an automated technique to instantiate incident patterns to specific systems. We demonstrate the feasibility of our approach in the application domain of smart buildings. We evaluate correctness, scalability, and performance using two substantive scenarios inspired by real-world systems and incidents.


title: A duality principle and related computational method for a class of structural optimization problems in elasticity

abstract: In this article we develop a duality principle and concerning computational method for a structural optimization problem in elasticity. We consider the problem of finding the optimal topology for an elastic solid which minimizes its structural inner energy resulting from the action of external loads to be specified. The main results are obtained through standard tools of convex analysis and duality theory. We emphasize our algorithm do not include a filter to process the results, so that the result obtained is indeed a critical point for the original optimization problem. Finally, we present some numerical examples concerning applications of the theoretical results established.


title: A simple representation of oscillation modes in stars: from mixed modes coupling to glitches

abstract: Analytical resonance conditions for oscillation modes in stars are very helpful both to predict and to examine their frequency spectra, as well as to make the link with their internal properties. In this short paper, we introduce a general quantization expression for oscillation modes accounting for the possible existence of a local sharp variation in the equilibrium structure, a so-called glitch. This representation is based on a direct adaptation of the progressive-wave picture of mixed modes proposed by Takata (2016b). In this formulation, a glitch turns out to be characterized by three parameters: its acoustic depth, the phase lags introduced after the wave reflection at the considered point, and a coupling factor. Such an expression has two main advantages. First, it can be easily applicable to a lot of different structural configurations. Second, it does not assume that the glitch is a small perturbation. Actually, we check that the obtained expression tends to the formulations previously derived when the glitch is weak. These research notes represent a preliminary step towards a more generalized description of multi-cavity oscillation modes, that was briefly addressed in the poster presented at the PHOST conference.


title: Recursive axiomatisations from separation properties

abstract: We define a fragment of monadic infinitary second-order logic corresponding to an abstract separation property. We use this to define the concept of a separation subclass. We use model theoretic techniques and games to show that separation subclasses whose axiomatisations are recursively enumerable in our second-order fragment can also be recursively axiomatised in their original first-order language. We pin down the expressive power of this formalism with respect to first-order logic, and investigate some questions relating to decidability and computational complexity. As applications of these results, by showing that certain classes can be straightforwardly defined as separation subclasses, we obtain first-order axiomatisability results for these classes. In particular we apply this technique to graph colourings and a class of partial algebras arising from separation logic.


title: Upper Bounding the Graph Edit Distance Based on Rings and Machine Learning

abstract: The graph edit distance (GED) is a flexible distance measure which is widely used for inexact graph matching. Since its exact computation is NP-hard, heuristics are used in practice. A popular approach is to obtain upper bounds for GED via transformations to the linear sum assignment problem with error-correction (LSAPE). Typically, local structures and distances between them are employed for carrying out this transformation, but recently also machine learning techniques have been used. In this paper, we formally define a unifying framework LSAPE-GED for transformations from GED to LSAPE. We also introduce rings, a new kind of local structures designed for graphs where most information resides in the topology rather than in the node labels. Furthermore, we propose two new ring based heuristics RING and RING-ML, which instantiate LSAPE-GED using the traditional and the machine learning based approach for transforming GED to LSAPE, respectively. Extensive experiments show that using rings for upper bounding GED significantly improves the state of the art on datasets where most information resides in the graphs' topologies. This closes the gap between fast but rather inaccurate LSAPE based heuristics and more accurate but significantly slower GED algorithms based on local search.


title: Polynomial approximation avoiding values in countable sets

abstract: We generalize a version of Lavrent\'ev's theorem which says that a function that is continuous on a compact set K with connected complement and without interior points can be uniformly approximated as closely as desired by a polynomial without zeros on the set K, so that the polynomial can avoid values from any given countable set. We also prove a corresponding version of Mergelyan's theorem when the interior of K is a finite union of Jordan domains, pairwise separated by a positive distance.


title: The Ramanujan Machine: Automatically Generated Conjectures on Fundamental Constants

abstract: Fundamental mathematical constants like $e$ and $\pi$ are ubiquitous in diverse fields of science, from abstract mathematics to physics, biology and chemistry. For centuries, new formulas relating fundamental constants have been scarce and usually discovered sporadically. Here we propose a novel and systematic approach that leverages algorithms for deriving mathematical formulas for fundamental constants and help reveal their underlying structure. Our algorithms find dozens of well-known as well as previously unknown continued fraction representations of $\pi$, $e$, Catalan's constant, and values of the Riemann zeta function. Two example conjectures found by our algorithm and so far unproven are: \begin{equation*} \frac{24}{\pi^2} = 2 + 7\cdot 0\cdot 1+ \frac{8\cdot1^4}{2 + 7\cdot 1\cdot 2 + \frac{8\cdot2^4}{2 + 7\cdot 2\cdot 3 + \frac{8\cdot3^4}{2 + 7\cdot 3\cdot 4 + \frac{8\cdot4^4}{..}}}} \quad\quad,\quad\quad \frac{8}{7 \zeta(3)} = 1\cdot 1 - \frac{1^6}{3\cdot 7 - \frac{2^6}{5\cdot 19 - \frac{3^6}{7\cdot 37 - \frac{4^6}{..}}}} \end{equation*} We present two algorithms that proved useful in finding conjectures: a Meet-In-The-Middle (MITM) algorithm and a Gradient Descent (GD) tailored to the recurrent structure of continued fractions. Both algorithms are based on matching numerical values and thus they conjecture formulas without providing proofs and without requiring prior knowledge on any underlying mathematical structure. This approach is especially attractive for constants for which no mathematical structure is known, as it reverses the conventional approach of sequential logic in formal proofs. Instead, our work supports a different approach for research: algorithms utilizing numerical data to unveil mathematical structures, thus trying to play the role of intuition of great mathematicians of the past, providing leads to new mathematical research.


title: Information-theoretic measures for a position-dependent mass system in an infinite potential well

abstract: In this work we calculate the Cram\'{e}r-Rao, the Fisher-Shannon and the L\'{o}pez-Ruiz-Mancini-Calbert (LMC) complexity measures for eigenstates of a deformed Schr\"{o}dinger equation, being this intrinsically linked with position-dependent mass (PDM) systems. The formalism presented is illustrated with a particle confined in an infinite potential well. Abrupt variation of the complexity near to the asymptotic value of the PDM-function $m(x)$ and erasure of its asymmetry along with negative values of the entropy density in the position space, are reported as a consequence of the interplay between the deformation and the complexity.


title: hammurabi X: Simulating Galactic Synchrotron Emission with Random Magnetic Fields

abstract: We present version X of the hammurabi package, the HEALPix-based numeric simulator for Galactic polarized emission. Improving on its earlier design, we have fully renewed the framework with modern C++ standards and features. Multi-threading support has been built in to meet the growing computational workload in future research. For the first time, we present precision profiles of hammurabi line-of-sight integral kernel with multi-layer HEALPix shells. In addition to fundamental improvements, this report focuses on simulating polarized synchrotron emission with Gaussian random magnetic fields. Two fast methods are proposed for realizing divergence-free random magnetic fields either on the Galactic scale where a field alignment and strength modulation are imposed, or on a local scale where more physically motivated models like a parameterized magneto-hydrodynamic (MHD) turbulence can be applied. As an example application, we discuss the phenomenological implications of Gaussian random magnetic fields for high Galactic latitude synchrotron foregrounds. In this, we numerically find B/E polarization mode ratios lower than unity based on Gaussian realizations of either MHD turbulent spectra or in spatially aligned magnetic fields.


title: Deep Gamblers: Learning to Abstain with Portfolio Theory

abstract: We deal with the \textit{selective classification} problem (supervised-learning problem with a rejection option), where we want to achieve the best performance at a certain level of coverage of the data. We transform the original $m$-class classification problem to $(m+1)$-class where the $(m+1)$-th class represents the model abstaining from making a prediction due to disconfidence. Inspired by portfolio theory, we propose a loss function for the selective classification problem based on the doubling rate of gambling. Minimizing this loss function corresponds naturally to maximizing the return of a \textit{horse race}, where a player aims to balance between betting on an outcome (making a prediction) when confident and reserving one's winnings (abstaining) when not confident. This loss function allows us to train neural networks and characterize the disconfidence of prediction in an end-to-end fashion. In comparison with previous methods, our method requires almost no modification to the model inference algorithm or model architecture. Experiments show that our method can identify uncertainty in data points, and achieves strong results on SVHN and CIFAR10 at various coverages of the data.


title: High Sensitivity Snapshot Spectrometer Based on Deep Network Unmixing

abstract: In this paper, we present a convolution neural network based method to recover the light intensity distribution from the overlapped dispersive spectra instead of adding an extra light path to capture it directly for the first time. Then, we construct a single-path sub-Hadamard snapshot spectrometer based on our previous dual-path snapshot spectrometer. In the proposed single-path spectrometer, we use the reconstructed light intensity as the original light intensity and recover high signal-to-noise ratio spectra successfully. Compared with dual-path snapshot spectrometer, the network based single-path spectrometer has a more compact structure and maintains snapshot and high sensitivity. Abundant simulated and experimental results have demonstrated that the proposed method can obtain a better reconstructed signal-to-noise ratio spectrum than the dual-path sub-Hadamard spectrometer because of its higher light throughput.


title: Maker-Breaker Percolation Games II: Escaping to Infinity

abstract: Let $\Lambda$ be an infinite connected graph, and let $v_0$ be a vertex of $\Lambda$. We consider the following positional game. Two players, Maker and Breaker, play in alternating turns. Initially all edges of $\Lambda$ are marked as unsafe. On each of her turns, Maker marks $p$ unsafe edges as safe, while on each of his turns Breaker takes $q$ unsafe edges and deletes them from the graph. Breaker wins if at any time in the game the component containing $v_0$ becomes finite. Otherwise if Maker is able to ensure that $v_0$ remains in an infinite component indefinitely, then we say she has a winning strategy. This game can be thought of as a variant of the celebrated Shannon switching game. Given $(p,q)$ and $(\Lambda, v_0)$, we would like to know: which of the two players has a winning strategy? Our main result in this paper establishes that when $\Lambda = \mathbb{Z}^2$ and $v_0$ is any vertex, Maker has a winning strategy whenever $p\geq 2q$, while Breaker has a winning strategy whenever $2p\leq q$. In addition, we completely determine which of the two players has a winning strategy for every pair $(p,q)$ when $\Lambda$ is an infinite $d$-regular tree. Finally, we give some results for general graphs and lattices and pose some open problems.


title: Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

abstract: As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the ratio of squared L2-norms, which is sensitive to outliers. In recent research, many L1-norm based robust Principle Component Analysis methods were proposed to improve the robustness to outliers. However, due to the difficulty of L1-norm ratio optimization, so far there is no existing work to utilize sparsity-inducing norms for LDA objective. In this paper, we propose a novel robust linear discriminant analysis method based on the L1,2-norm ratio minimization. Minimizing the L1,2-norm ratio is a much more challenging problem than the traditional methods, and there is no existing optimization algorithm to solve such non-smooth terms ratio problem. We derive a new efficient algorithm to solve this challenging problem, and provide a theoretical analysis on the convergence of our algorithm. The proposed algorithm is easy to implement, and converges fast in practice. Extensive experiments on both synthetic data and nine real benchmark data sets show the effectiveness of the proposed robust LDA method.


title: Detailed study of a moving average trading rule

abstract: We present a detailed study of the performance of a trading rule that uses moving average of past returns to predict future returns on stock indexes. Our main goal is to link performance and the stochastic process of the traded asset. Our study reports short, medium and long term effects by looking at the Sharpe ratio (SR). We calculate the Sharpe ratio of our trading rule as a function of the probability distribution function of the underlying traded asset and compare it with data. We show that if the performance is mainly due to presence of autocorrelation in the returns of the traded assets, the SR as a function of the portfolio formation period (look-back) is very different from performance due to the drift (average return). The SR shows that for look-back periods of a few months the investor is more likely to tap into autocorrelation. However, for look-back larger than few months, the drift of the asset becomes progressively more important. Finally, our empirical work reports a new long-term effect, namely oscillation of the SR and propose a non-stationary model to account for such oscillations.


title: The Case for a High-Redshift Origin of GRB100205A

abstract: The number of long gamma-ray bursts (GRBs) known to have occurred in the distant Universe (z greater than 5) is small (approx 15), however these events provide a powerful way of probing star formation at the onset of galaxy evolution. In this paper, we present the case for GRB100205A being a largely overlooked high-redshift event. While initially noted as a high-z candidate, this event and its host galaxy have not been explored in detail. By combining optical and near-infrared Gemini afterglow imaging (at t less than 1.3 days since burst) with deep late-time limits on host emission from the Hubble Space Telescope, we show that the most likely scenario is that GRB100205A arose in the redshift range 4-8. GRB100205A is an example of a burst whose afterglow, even at 1 hour post-burst, could only be identified by 8m class IR observations, and suggests that such observations of all optically dark bursts may be necessary to significantly enhance the number of high-redshift GRBs known.


title: Learning Where to Look While Tracking Instruments in Robot-assisted Surgery

abstract: Directing of the task-specific attention while tracking instrument in surgery holds great potential in robot-assisted intervention. For this purpose, we propose an end-to-end trainable multitask learning (MTL) model for real-time surgical instrument segmentation and attention prediction. Our model is designed with a weight-shared encoder and two task-oriented decoders and optimized for the joint tasks. We introduce batch-Wasserstein (bW) loss and construct a soft attention module to refine the distinctive visual region for efficient saliency learning. For multitask optimization, it is always challenging to obtain convergence of both tasks in the same epoch. We deal with this problem by adopting `poly' loss weight and two phases of training. We further propose a novel way to generate task-aware saliency map and scanpath of the instruments on MICCAI robotic instrument segmentation dataset. Compared to the state of the art segmentation and saliency models, our model outperforms most of the evaluation metrics.


title: Non-destructive three-dimensional measurement of hand vein based on self-supervised network

abstract: At present, supervised stereo methods based on deep neural network have achieved impressive results. However, in some scenarios, accurate three-dimensional labels are inaccessible for supervised training. In this paper, a self-supervised network is proposed for binocular disparity matching (SDMNet), which computes dense disparity maps from stereo image pairs without disparity labels: In the self-supervised training, we match the stereo images densely to approximate the disparity maps and use them to warp the left and right images to estimate the right and left images; we build the loss function between estimated images and original images for self-supervised training, which adopts perceptual loss to help improve the quality of disparity maps in both detail and structure. Then, we use SDMNet to obtain disparities of hand vein. SDMNet has achieved excellent results on KITTI 2012, KITTI 2015, simulated vein dataset and real vein dataset, outperforming many state-of-the-art supervised matching methods.


title: Quadrilateral Mesh Generation II : Meromorphic Quartic Differentials and Abel-Jacobi Condition

abstract: This work discovers the equivalence relation between quadrilateral meshes and meromorphic quartic. Each quad-mesh induces a conformal structure of the surface, and a meromorphic differential, where the configuration of singular vertices correspond to the configurations the poles and zeros (divisor) of the meroromorphic differential. Due to Riemann surface theory, the configuration of singularities of a quad-mesh satisfies the Abel-Jacobi condition. Inversely, if a satisfies the Abel-Jacobi condition, then there exists a meromorphic quartic differential whose equals to the given one. Furthermore, if the meromorphic quadric differential is with finite, then it also induces a a quad-mesh, the poles and zeros of the meromorphic differential to the singular vertices of the quad-mesh. Besides the theoretic proofs, the computational algorithm for verification of Abel-Jacobi condition is explained in details. Furthermore, constructive algorithm of meromorphic quartic differential on zero surfaces is proposed, which is based on the global algebraic representation of meromorphic. Our experimental results demonstrate the efficiency and efficacy of the algorithm. This opens up a direction for quad-mesh generation using algebraic geometric approach.


title: Predicting Social Perception from Faces: A Deep Learning Approach

abstract: Warmth and competence represent the fundamental traits in social judgment that determine emotional reactions and behavioral intentions towards social targets. This research investigates whether an algorithm can learn visual representations of social categorization and accurately predict human perceivers' impressions of warmth and competence in face images. In addition, this research unravels which areas of a face are important for the classification of warmth and competence. We use Deep Convolutional Neural Networks to extract features from face images and the Gradient-weighted Class Activation Mapping (Grad CAM) method to understand the importance of face regions for the classification. Given a single face image the trained algorithm could correctly predict warmth impressions with an accuracy of about 90% and competence impressions with an accuracy of about 80%. The findings have implications for the automated processing of faces and the design of artificial characters.


title: Latent Variable Sentiment Grammar

abstract: Neural models have been investigated for sentiment classification over constituent trees. They learn phrase composition automatically by encoding tree structures but do not explicitly model sentiment composition, which requires to encode sentiment class labels. To this end, we investigate two formalisms with deep sentiment representations that capture sentiment subtype expressions by latent variables and Gaussian mixture vectors, respectively. Experiments on Stanford Sentiment Treebank (SST) show the effectiveness of sentiment grammar over vanilla neural encoders. Using ELMo embeddings, our method gives the best results on this benchmark.


title: Branching Particle Pricers with Heston Examples

abstract: The use of sequential Monte Carlo within simulation for path-dependent option pricing is proposed and evaluated. Recently, it was shown that explicit solutions and importance sampling are valuable for efficient simulation of spot price and volatility, especially for purposes of path-dependent option pricing. The resulting simulation algorithm is an analog to the weighted particle filtering algorithm that might be improved by resampling or branching. Indeed, some branching algorithms are shown herein to improve pricing performance substantially while some resampling algorithms are shown to be less suitable in certain cases. A historical property is given and explained as the distinguishing feature between the sequential Monte Carlo algorithms that work on path-dependent option pricing and those that do not. In particular, it is recommended to use the so-called effective particle branching algorithm within importance-sampling Monte Carlo methods for path-dependent option pricing. All recommendations are based upon numeric comparison of option pricing problems in the Heston model.


title: Distributed Global Output-Feedback Control for a Class of Euler-Lagrange Systems

abstract: This published paper investigates the distributed tracking control problem for a class of Euler-Lagrange multi-agent systems when the agents can only measure the positions. In this case, the lack of the separation principle and the strong nonlinearity in unmeasurable states pose severe technical challenges to global output-feedback control design. To overcome these difficulties, a global nonsingular coordinate transformation matrix in the upper triangular form is firstly proposed such that the nonlinear dynamic model can be partially linearized with respect to the unmeasurable states. And, a new type of velocity observers is designed to estimate the unmeasurable velocities for each system. Then, based on the outputs of the velocity observers, we propose distributed control laws that enable the coordinated tracking control system to achieve uniform global exponential stability (UGES). Both theoretical analysis and numerical simulations are presented to validate the effectiveness of the proposed control scheme. Followed by the original paper, a typo and a mistake is corrected.


title: Causal Inference Under Interference And Network Uncertainty

abstract: Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the data. Methods for estimating causal effects have been developed in the setting where the structure of dependence between units is known exactly, but in practice there is often substantial uncertainty about the precise network structure. This is true, for example, in trial data drawn from vulnerable communities where social ties are difficult to query directly. In this paper we combine techniques from the structure learning and interference literatures in causal inference, proposing a general method for estimating causal effects under data dependence when the structure of this dependence is not known a priori. We demonstrate the utility of our method on synthetic datasets which exhibit network dependence.


title: Relaxing the Exclusion Restriction in Shift-Share Instrumental Variable Estimation

abstract: Many economic studies use shift-share instruments to estimate causal effects. Often, all shares need to fulfil an exclusion restriction, making the identifying assumption strict. This paper proposes to use methods that relax the exclusion restriction by selecting invalid shares. I apply the methods in two empirical examples: the effect of immigration on wages and of Chinese import exposure on employment. In the first application, the coefficient becomes lower and often changes sign, but this is reconcilable with arguments made in the literature. In the second application, the findings are mostly robust to the use of the new methods.


title: Spatial population dynamics: beyond the Kirkwood superposition approximation by advancing to the Fisher-Kopeliovich ansatz

abstract: The superior Fisher-Kopeliovich closure is applied to the hierarchy of master equations for spatial moments of population dynamics for the first time. As a consequence, the population density, pair and triplet distribution functions are calculated within this closure for a birth-death model with nonlocal dispersal and competition in continuous space. The new results are compared with those obtained by ``exact'' individual-based simulations as well as by the inferior mean-field and Kirkwood superposition approximations. It is shown that the Fisher-Kopeliovich approach significantly improves the quality of the description in a wide range of varying parameters of the model.


title: Observation of anomalous non-Ohmic transport in current-driven nanostructures

abstract: Sufficiently large electric current applied to metallic nanostructures can bring them far out-of-equilibrium, resulting in non-Ohmic behaviors characterized by current-dependent resistance. We experimentally demonstrate a linear dependence of resistance on current in microscopic thin-film metallic wires at cryogenic temperatures, and show that our results are inconsistent with common non-Ohmic mechanisms such as Joule heating. As the temperature is increased, the linear dependence becomes smoothed out, resulting in the crossover to behaviors consistent with Joule heating. A plausible explanation for the observed behaviors is the strongly non-equilibrium distribution of phonons generated by the current. Analysis based on this interpretation suggests that the observed anomalous current-dependent resistance can provide information about phonon transport and electron-phonon interaction at nanoscale. The ability to control the properties of phonons generated by current can lead to new routes for the optimization of thermal properties of electronic nanodevices.


title: Enhanced X-ray emission from candidate Lyman continuum emitting galaxies

abstract: X-ray binaries may have helped reionize the early Universe by enabling Lyman continuum escape. We analyzed a set of 8 local galaxies that are potential Lyman leaking galaxies, identified by a blue color and weak emission lines, using Chandra X-ray observations. Five of the galaxies feature X-ray sources, while three galaxies are not significantly detected in X-rays. X-ray luminosities were found for the galaxies and X-ray sources. Four of the galaxies have elevated X-ray luminosity versus what would be expected based on star formation rate and metallicity. The presence of detected X-ray sources within the galaxies is found to correlate with the ratio of the star formation rate estimated from the near-ultraviolet flux to that estimated from the infrared. This implies reduced obscuration due to dust in the galaxies with X-ray sources. These results support the idea that X-ray binaries may be an important part of the process of reionziation.


title: A new type of charge-density-wave pinning in orthorhombic TaS$_3$ crystals with quenching defects

abstract: Diminishing in the concentration of quenching defects during thermocycling of orthorhombic TaS$_3$ samples in the temperature range below the Peierls transition temperature $T <T_P$ is observed. It makes it possible to study the character of pinning of the charge density wave (CDW) by these defects. A number of fundamental differences from pinning by ordinary local pinning centers - impurities and point defects - have been found. We conclude that quenching defects are extended (non-local) objects (presumably, dislocations) that can diffuse from the crystal during low-temperature termocycling due to their strong interaction with the CDW, which is intrinsic for the Peierls conductors. The presence of these defects leads to a previously unknown non-local type of CDW pinning that acts on $T_P$ and the threshold field for the onset of the CDW sliding, $E_T$, differently in comparison with the local pinning centers.


title: On Asymmetric Unification for the Theory of XOR with a Homomorphism

abstract: Asymmetric unification, or unification with irreducibility constraints, is a newly developed paradigm that arose out of the automated analysis of cryptographic protocols. However, there are still relatively few asymmetric unification algorithms. In this paper we address this lack by exploring the application of automata-based unification methods. We examine the theory of xor with a homomorphism, ACUNh, from the point of view of asymmetric unification, and develop a new automata-based decision procedure. Then, we adapt a recently developed asymmetric combination procedure to produce a general asymmetric- ACUNh decision procedure. Finally, we present a new approach for obtaining a solution-generating asymmetric-ACUNh unification automaton. We also compare our approach to the most commonly used form of asymmetric unification available today, variant unification.


title: On the anisotropic Kirchhoff-Plateau problem

abstract: We extend to the anisotropic setting the existence of solutions for the Kirchhoff-Plateau problem and its dimensional reduction.


title: Free abelian group actions on normal projective varieties: sub-maximal dynamical rank case

abstract: Let $X$ be a normal projective variety of dimension $n$ and $G$ an abelian group of automorphisms such that all elements of $G\setminus \{\mathrm{id}\}$ are of positive entropy. Dinh and Sibony showed that $G$ is actually free abelian of rank $\le n - 1$. The maximal rank case has been well understood by De-Qi Zhang. We aim to characterize the pair $(X, G)$ such that $\mathrm{rank} G = n - 2$.


title: Coexistence of fast and slow gamma oscillations in one population of inhibitory spiking neurons

abstract: Oscillations are a hallmark of neural population activity in various brain regions with a spectrum covering a wide range of frequencies. Within this spectrum gamma oscillations have received particular attention due to their ubiquitous nature and to their correlation with higher brain functions. Recently, it has been reported that gamma oscillations in the hippocampus of behaving rodents are segregated in two distinct frequency bands: slow and fast. These two gamma rhythms correspond to dfferent states of the network, but their origin has been not yet clarified. Here, we show theoretically and numerically that a single inhibitory population can give rise to coexisting slow and fast gamma rhythms corresponding to collective oscillations of a balanced spiking network. The slow and fast gamma rhythms are generated via two different mechanisms: the fast one being driven by the coordinated tonic neural firing and the slow one by endogenous fluctuations due to irregular neural activity. We show that almost instantaneous stimulations can switch the collective gamma oscillations from slow to fast and vice versa. Furthermore, to make a closer contact with the experimental observations, we consider the modulation of the gamma rhythms induced by a slower (theta) rhythm driving the network dynamics. In this context, depending on the strength of the forcing, we observe phase-amplitude and phase-phase coupling between the fast and slow gamma oscillations and the theta forcing. Phase-phase coupling reveals different theta-phases preferences for the two coexisting gamma rhythms.


title: Towards Forward Secure Internet Traffic

abstract: Forward Secrecy (FS) is a security property in key-exchange algorithms which guarantees that a compromise in the secrecy of a long-term private-key does not compromise the secrecy of past session keys. With a growing awareness of long-term mass surveillance programs by governments and others, FS has become widely regarded as a highly desirable property. This is particularly true in the TLS protocol, which is used to secure Internet communication. In this paper, we investigate FS in pre-TLS 1.3 protocols, which do not mandate FS, but still widely used today. We conduct an empirical analysis of over 10 million TLS servers from three different datasets using a novel heuristic approach. Using a modern TLS client handshake algorithms, our results show 5.37% of top domains, 7.51% of random domains, and 26.16% of random IPs do not select FS key-exchange algorithms. Surprisingly, 39.20% of the top domains, 24.40% of the random domains, and 14.46% of the random IPs that do not select FS, do support FS. In light of this analysis, we discuss possible paths toward forward secure Internet traffic. As an improvement of the current state, we propose a new client-side mechanism that we call "Best Effort Forward Secrecy" (BEFS), and an extension of it that we call "Best Effort Forward Secrecy and Authenticated Encryption" (BESAFE), which aims to guide (force) misconfigured servers to FS using a best effort approach. Finally, within our analysis, we introduce a novel adversarial model that we call "discriminatory" adversary, which is applicable to the TLS protocol.


title: Measurement of the beam-helicity asymmetry in photoproduction of $\pi^{0}\eta$ pairs on carbon, aluminum, and lead

abstract: The beam-helicity asymmetry was measured, for the first time, in photoproduction of $\pi^{0}\eta$ pairs on carbon, aluminum, and lead, with the A2 experimental setup at MAMI. The results are compared to an earlier measurement on a free proton and to the corresponding theoretical calculations. The Mainz model is used to predict the beam-helicity asymmetry for the nuclear targets. The present results indicate that the photoproduction mechanism for $\pi^{0}\eta$ pairs on nuclei is similar to photoproduction on a free nucleon. This process is dominated by the $D_{33}$ partial wave with the $\eta\Delta(1232)$ intermediate state.


title: Evaluating Local Geometric Feature Representations for 3D Rigid Data Matching

abstract: Local geometric descriptors remain an essential component for 3D rigid data matching and fusion. The devise of a rotational invariant local geometric descriptor usually consists of two steps: local reference frame (LRF) construction and feature representation. Existing evaluation efforts have mainly been paid on the LRF or the overall descriptor, yet the quantitative comparison of feature representations remains unexplored. This paper fills this gap by comprehensively evaluating nine state-of-the-art local geometric feature representations. Our evaluation is on the ground that ground-truth LRFs are leveraged such that the ranking of tested feature representations are more convincing as opposed to existing studies. The experiments are deployed on six standard datasets with various application scenarios (shape retrieval, point cloud registration, and object recognition) and data modalities (LiDAR, Kinect, and Space Time) as well as perturbations including Gaussian noise, shot noise, data decimation, clutter, occlusion, and limited overlap. The evaluated terms cover the major concerns for a feature representation, e.g., distinctiveness, robustness, compactness, and efficiency. The outcomes present interesting findings that may shed new light on this community and provide complementary perspectives to existing evaluations on the topic of local geometric feature description. A summary of evaluated methods regarding their peculiarities is also presented to guide real-world applications and new descriptor crafting.


title: Most Laplacian eigenvalues of a tree are small

abstract: We show that the number of Laplacian eigenvalues greater than the average degree of a tree having $n$ vertices is at most $\lfloor\frac{n}{2} \rfloor$.


title: Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

abstract: Time series forecasting is an important problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. In this paper, we propose to tackle such forecasting problem with Transformer [1]. Although impressed by its performance in our preliminary study, we found its two major weaknesses: (1) locality-agnostics: the point-wise dot-product self-attention in canonical Transformer architecture is insensitive to local context, which can make the model prone to anomalies in time series; (2) memory bottleneck: space complexity of canonical Transformer grows quadratically with sequence length $L$, making directly modeling long time series infeasible. In order to solve these two issues, we first propose convolutional self-attention by producing queries and keys with causal convolution so that local context can be better incorporated into attention mechanism. Then, we propose LogSparse Transformer with only $O(L(\log L)^{2})$ memory cost, improving forecasting accuracy for time series with fine granularity and strong long-term dependencies under constrained memory budget. Our experiments on both synthetic data and real-world datasets show that it compares favorably to the state-of-the-art.


title: Streaming Quantiles Algorithms with Small Space and Update Time

abstract: Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements their theoretical result by providing a practical variants of their algorithm with improved constants. For a given sketch size, our techniques provably reduce the upper bound on the sketch error by a factor of two. These improvements are verified experimentally. Our modified quantile sketch improves the latency as well by reducing the worst case update time from $O(1/\varepsilon)$ down to $O(\log (1/\varepsilon))$. We also suggest two algorithms for weighted item streams which offer improved asymptotic update times compared to na\"ive extensions. Finally, we provide a specialized data structure for these sketches which reduces both their memory footprints and update times.


title: A generalized Higgs potential with two degenerate minima for a dark QCD matter scenario

abstract: We consider the Higgs potential in generalizations of the Standard Model. The possibility of the potential to develop two almost degenerate minima is explored. This would imply that QCD matter at two distinct sets of quark masses is relevant for astrophysics and cosmology. If in the exotic minimum the QCD matter ground state is electromagnetically neutral, dark matter may consist of QCD matter and antimatter in bubbles of the Higgs field. We predict an abundance of gamma rays in the few MeV region as messengers of dark matter regions in space. In addition the ratio of dark matter to normal matter is expected to show a time dependence.


title: System size dependence of hydration shell occupancy

abstract: The free energies to evacuate the first hydration shell around a solute and a cavity defined by the first hydration shell depend on the system size. This observation interpreted within the quasichemical theory shows that both the hydrophilic and the hydrophobic contributions to hydration depend on the system size, decreasing with increasing system size. Although the net hydration free energy benefits somewhat from the balancing of hydrophilic and hydrophobic contributions, a large system still appears necessary to describe the effect of the solvent on the macromolecule.


title: QCSP monsters and the demise of the Chen Conjecture

abstract: We give a surprising classification for the computational complexity of the Quantified Constraint Satisfaction Problem over a constraint language $\Gamma$, QCSP$(\Gamma)$, where $\Gamma$ is a finite language over $3$ elements which contains all constants. In particular, such problems are either in P, NP-complete, co-NP-complete or PSpace-complete. Our classification refutes the hitherto widely-believed Chen Conjecture. Additionally, we show that already on a 4-element domain there exists a constraint language $\Gamma$ such that QCSP$(\Gamma)$ is DP-complete (from Boolean Hierarchy), and on a 10-element domain there exists a constraint language giving the complexity class $\Theta_{2}^{P}$. Meanwhile, we prove the Chen Conjecture for finite conservative languages $\Gamma$. If the polymorphism clone of $\Gamma$ has the polynomially generated powers (PGP) property then QCSP$(\Gamma)$ is in NP. Otherwise, the polymorphism clone of $\Gamma$ has the exponentially generated powers (EGP) property and QCSP$(\Gamma)$ is PSpace-complete.


title: An Overview of the Ludii General Game System

abstract: The Digital Ludeme Project (DLP) aims to reconstruct and analyse over 1000 traditional strategy games using modern techniques. One of the key aspects of this project is the development of Ludii, a general game system that will be able to model and play the complete range of games required by this project. Such an undertaking will create a wide range of possibilities for new AI challenges. In this paper we describe many of the features of Ludii that can be used. This includes designing and modifying games using the Ludii game description language, creating agents capable of playing these games, and several advantages the system has over prior general game software.


title: Identification In Missing Data Models Represented By Directed Acyclic Graphs

abstract: Missing data is a pervasive problem in data analyses, resulting in datasets that contain censored realizations of a target distribution. Many approaches to inference on the target distribution using censored observed data, rely on missing data models represented as a factorization with respect to a directed acyclic graph. In this paper we consider the identifiability of the target distribution within this class of models, and show that the most general identification strategies proposed so far retain a significant gap in that they fail to identify a wide class of identifiable distributions. To address this gap, we propose a new algorithm that significantly generalizes the types of manipulations used in the ID algorithm, developed in the context of causal inference, in order to obtain identification.


title: Joint Functional Splitting and Content Placement for Green Hybrid CRAN

abstract: A hybrid cloud radio access network (H-CRAN) architecture has been proposed to alleviate the midhaul capacity limitation in C-RAN. In this architecture, functional splitting is utilized to distribute the processing functions between a central cloud and edge clouds. The flexibility of selecting specific split point enables the H-CRAN designer to reduce midhaul bandwidth, or reduce latency, or save energy, or distribute the computation task depending on equipment availability. Meanwhile, techniques for caching are proposed to reduce content delivery latency and the required bandwidth. However, caching imposes new constraints on functional splitting. In this study, considering H-CRAN, a constraint programming problem is formulated to minimize the overall power consumption by selecting the optimal functional split point and content placement, taking into account the content access delay constraint. We also investigate the trade-off between the overall power consumption and occupied midhaul bandwidth in the network. Our results demonstrate that functional splitting together with enabling caching at edge clouds reduces not only content access delays but also fronthaul bandwidth consumption but at the expense of higher power consumption.


title: On algebraic extensions and decomposition of homomorphisms in free groups

abstract: We give a counterexample to a conjecture by Miasnikov, Ventura and Weil, stating that an extension of free groups is algebraic if and only if the corresponding morphism of their core graphs is onto, for every basis of the ambient group. In the course of the proof we present a partition of the set of homomorphisms between free groups which is of independent interest.


title: An Empirical Evaluation of Two General Game Systems: Ludii and RBG

abstract: Although General Game Playing (GGP) systems can facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often computationally inefficient and somewhat specialised to a specific class of games. However, since the start of this year, two General Game Systems have emerged that provide efficient alternatives to the academic state of the art -- the Game Description Language (GDL). In order of publication, these are the Regular Boardgames language (RBG), and the Ludii system. This paper offers an experimental evaluation of Ludii. Here, we focus mainly on a comparison between the two new systems in terms of two key properties for any GGP system: simplicity/clarity (e.g. human-readability), and efficiency.


title: Ludii and XCSP: Playing and Solving Logic Puzzles

abstract: Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it's done. For this reason, using constraint programming is naturally suited to solve them. In this paper, we focus on logic puzzles described in the Ludii general game system and we propose using the XCSP formalism in order to solve them with any CSP solver.


title: Ludii as a Competition Platform

abstract: Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii system, highlighting some of its most important aspects that can potentially lead to many algorithm improvements and new avenues of research. We compare and contrast our proposed competition motivations, goals and frameworks against those of existing general game playing competitions, addressing the strengths and weaknesses of each platform.


title: Second-generation stoichiometric mathematical model to predict methane emissions from oil sands tailings

abstract: Microbial metabolism of fugitive hydrocarbons produces greenhouse gas (GHG) emissions from oil sands tailings ponds (OSTP) and end pit lakes (EPL) that retain semisolid wastes from surface mining of oil sands ores. Predicting GHG production, particularly methane (CH4), would help oil sands operators mitigate tailings emissions and would assist regulators evaluating the trajectory of reclamation scenarios. Using empirical datasets from laboratory incubation of OSTP sediments with pertinent hydrocarbons, we developed a stoichiometric model for CH4 generation by indigenous microbes. This model improved on previous first-approximation models by considering long-term biodegradation kinetics for 18 relevant hydrocarbons from three different oil sands operations, lag times, nutrient limitations, and microbial growth and death rates. Laboratory measurements were used to estimate model parameter values and to validate the new model. Goodness of fit analysis showed that the stoichiometric model predicted CH4 production well; normalized mean square error analysis revealed that it surpassed previous models. Comparison of model predictions with field measurements of CH4 emissions further validated the new model. Importantly, the model also identified parameters that are currently lacking but are needed to enable future robust modeling of CH4 production from OSTP and EPL in situ.


title: Schottky Anomaly of deSitter Black Holes

abstract: The interplay of black hole and cosmological horizons introduces distinctive thermodynamic behavior for deSitter black holes, including well-known upper bounds for the mass and entropy. We point to a new such feature, a Schottky peak in the heat capacity of Schwarzschild-deSitter (SdS) black holes. With this behavior in mind, we explore statistical models for the underlying quantum degrees of freedom of SdS holes. While a simple two-state spin model gives Schottky behavior, in order to capture the non-equilibrium nature of the SdS system we consider a system with a large number of non-interacting spins. We examine to what extent constrained states of this system reproduce the thermodynamic properties of the black hole. We also review results of a recent study of particle production in SdS spacetimes in light of the Schottky anomaly and our spin models.


title: A Data-Validated Host-Parasite Model for Infectious Disease Outbreaks

abstract: The use of model experimental systems and mathematical models is important to further understanding of infectious disease dynamics and strategize disease mitigation. Gyrodactylids are helminth ectoparasites of teleost fish which have many dynamical characteristics of microparasites but offer the advantage that they can be quantified and tracked over time, allowing further insight into within-host and epidemic dynamics. In this paper, we design a model to describe host-parasite dynamics of the well-studied guppy-Gyrodactylus turnbulli system, using experimental data to estimate parameters and validate it. We estimate the basic reproduction number (R_0), for this system. Sensitivity analysis reveals that parasite growth rate, and the rate at which the guppy mounts an immune response have the greatest impact on outbreak peak and timing both for initial outbreaks and on longer time scales. These findings highlight guppy population resistance and parasite virulence as key factors in disease control, and future work should focus on incorporating heterogeneity in host resistance into disease models and extrapolating to other host-parasite systems.


title: Multi-objective multi-generation Gaussian process optimizer for design optimization

abstract: We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is constructed for each objective function with the sample data. The models are used to evaluate solutions and to select the ones with a high potential before they are evaluated on the actual system. Since the trial solutions selected by the GP models tend to have better performance than other methods that only rely on random operations, the new algorithm has much higher efficiency in exploring the parameter space. Simulations with multiple test cases show that the new algorithm has a substantially higher convergence speed and stability than NSGA-II, MOPSO, and some other more recent algorithms.


title: Colored Unlinking

abstract: In links with two components there are three different types of crossings: self-crossings in the first component, self crossings in the second component, and crossings between components. In this paper we examine the minimum number of crossing changes needed to unlink without changing the crossings between components. We restrict our attention to unlinking two component links with linking number zero and both components unknotted. We provide data for links with no more than ten crossings and general results about asymmetry of unlinking between components.


title: Semiclassical dynamics in the mixed quantum-classical limit

abstract: The semiclassical Double Herman-Kluk Initial Value Representation is an accurate approach to computing quantum real time correlation functions, but its applications are limited by the need to evaluate an oscillatory integral. In previous work, we have shown that this `sign problem' can be mitigated using the modified Filinov filtration technique to control the extent to which individual modes of the system contribute to the overall phase of the integrand. Here we follow this idea to a logical conclusion: we analytically derive a general expression for the mixed quantum-classical limit of the semiclassical correlation function - AMQC-IVR, where the phase contributions from the `classical' modes of the system are filtered while the `quantum' modes are treated in the full semiclassical limit. We numerically demonstrate the accuracy and efficiency of the AMQC-IVR formulation in calculations of quantum correlation functions and reaction rates using three model systems with varied coupling strengths between the classical and quantum subsystems. We also introduce a separable prefactor approximation that further reduces the computational cost, but is only accurate in the limit of weak coupling between the quantum and classical subsystems.


title: Asynchronous Behavior Trees with Memory aimed at Aerial Vehicles with Redundancy in Flight Controller

abstract: Complex aircraft systems are becoming a target for automation. For successful operation, they require both efficient and readable mission execution system. Flight control computer (FCC) units, as well as all important subsystems, are often duplicated. Discrete nature of mission execution systems does not allow small differences in data flow among redundant FCCs which are acceptable for continuous control algorithms. Therefore, mission state consistency has to be specifically maintained. We present a novel mission execution system which includes FCC state synchronization. To achieve this result we developed a new concept of Asynchronous Behavior Tree with Memory and proposed a state synchronization algorithm. The implemented system was tested and proven to work in a real-time simulation of High Altitude Pseudo Satellite (HAPS) mission.


title: Remarks on local controllability for the Boussinesq system with Navier boundary condition

abstract: This note deals with the local exact controllability to a particular class of trajectories for the Boussinesq system with nonlinear Navier-slip boundary conditions and internal controls having vanishing components. Briefly speaking, in two dimensions, the local exact controllability property is obtained using only one control in the heat equation, meanwhile two scalar controls are required in three dimensions.


title: Kissing number in hyperbolic space

abstract: This paper provides upper and lower bounds on the kissing number of congruent radius $r > 0$ spheres in $\mathbb{H}^n$, for $n\geq 2$. For that purpose, the kissing number is replaced by the kissing function $\kappa(n, r)$ which depends on the radius $r$. After we obtain some theoretical lower and upper bounds for $\kappa(n, r)$, we study their asymptotic behaviour and show, in particular, that $\lim_{r\to \infty} \frac{\log \kappa(n,r)}{r} = n-1$. Finally, we compare them with the numeric upper bounds obtained by solving a suitable semidefinite program.


title: Global existence, regularity, and uniqueness of infinite energy solutions to the Navier-Stokes equations

abstract: This paper addresses several problems associated to local energy solutions (in the sense of Lemari\'e-Rieusset) to the Navier-Stokes equations with initial data which is sufficiently small at large or small scales as measured using truncated Morrey-type quantities, namely: (1) global existence for a class of data including the critical $L^2$-based Morrey space; (2) initial and eventual regularity of local energy solutions to the Navier-Stokes equations with initial data sufficiently small at small or large scales; (3) small-large uniqueness of local energy solutions for data in the critical $L^2$-based Morrey space. A number of interesting corollaries are included, including eventual regularity in familiar Lebesgue, Lorentz, and Morrey spaces, a new local generalized Von Wahl uniqueness criteria, as well as regularity and uniqueness for local energy solutions with small discretely self-similar data.


title: Hausdorff and Wasserstein metrics on graphs and other structured data

abstract: Optimal transport is widely used in pure and applied mathematics to find probabilistic solutions to hard combinatorial matching problems. We extend the Wasserstein metric and other elements of optimal transport from the matching of sets to the matching of graphs and other structured data. This structure-preserving form of optimal transport relaxes the usual notion of homomorphism between structures. It applies to graphs, directed and undirected, labeled and unlabeled, and to any other structure that can be realized as a $C$-set for some finitely presented category $C$. We construct both Hausdorff-style and Wasserstein-style metrics on $C$-sets and we show that the latter are convex relaxations of the former. Like the classical Wasserstein metric, the Wasserstein metric on $C$-sets is the value of a linear program and is therefore efficiently computable.


title: On the Quantum-to-Classical Transition of Primordial Perturbations

abstract: Detailed measurements of the cosmic microwave background indicate the large-scale homogeneity of the universe. On very small scales, we observe however inhomogeneities such as galaxies, stars, planets and ourselves. In the context of hot Big-Bang cosmology, these inhomogeneities are often explained as the remains of quantum fluctuations at very early times, enlarged to observable scales through the process of inflation. In this dissertation, I examine two important questions surrounding this scenario: a) How do inherently quantal fluctuations transition to the observed inhomogeneities, which behave classically? ; and b) If the initial state of the universe was symmetric, how can the currently observed state? This dissertation is organized in three parts. Part one first introduces the slow-roll inflation model and then discusses the behavior of small (scalar) perturbations to this model. The second part investigates various answers provided to the questions above, starting with some general observations on the classical limit of quantum mechanics with special attention given to the inverted harmonic oscillator. The formalisms of `squeezing' and decoherence are discussed and weak points are pointed out. In the final part, I examine in detail the pilot-wave approach to the problem, discussing in detail the classical limit of the theory and how pilot-wave theory addresses both questions above. Numerical results for pilot-wave trajectories are presented, illustrating directly the classical limit.


title: Infrastructure-Agnostic Hypertext

abstract: This paper presents a novel and formal interpretation of the original vision of hypertext: infrastructure-agnostic hypertext is independent from specific standards such as data formats and network protocols. Its model is illustrated with examples and references to existing technologies that allow for implementation and integration in current information infrastructures such as the Internet.


title: Spectral properties of anti-heptadiagonal persymmetric Hankel matrices

abstract: In this paper we express the eigenvalues of anti-heptadiagonal persymmetric Hankel matrices as the zeros of explicit polynomials giving also a representation of its eigenvectors. We present also an expression depending on localizable parameters to compute its integer powers. In particular, an explicit formula not depending on any unknown parameter for the inverse of anti-heptadiagonal persymmetric Hankel matrices is provided.


title: Intrinsic quantized anomalous Hall effect in a moir\'e heterostructure

abstract: We report the observation of a quantum anomalous Hall effect in twisted bilayer graphene showing Hall resistance quantized to within .1\% of the von Klitzing constant $h/e^2$ at zero magnetic field.The effect is driven by intrinsic strong correlations, which polarize the electron system into a single spin and valley resolved moir\'e miniband with Chern number $C=1$. In contrast to extrinsic, magnetically doped systems, the measured transport energy gap $\Delta/k_B\approx 27$~K is larger than the Curie temperature for magnetic ordering $T_C\approx 9$~K, and Hall quantization persists to temperatures of several Kelvin. Remarkably, we find that electrical currents as small as 1~nA can be used to controllably switch the magnetic order between states of opposite polarization, forming an electrically rewritable magnetic memory.


title: Dissecting Pruned Neural Networks

abstract: Pruning is a standard technique for removing unnecessary structure from a neural network to reduce its storage footprint, computational demands, or energy consumption. Pruning can reduce the parameter-counts of many state-of-the-art neural networks by an order of magnitude without compromising accuracy, meaning these networks contain a vast amount of unnecessary structure. In this paper, we study the relationship between pruning and interpretability. Namely, we consider the effect of removing unnecessary structure on the number of hidden units that learn disentangled representations of human-recognizable concepts as identified by network dissection. We aim to evaluate how the interpretability of pruned neural networks changes as they are compressed. We find that pruning has no detrimental effect on this measure of interpretability until so few parameters remain that accuracy beings to drop. Resnet-50 models trained on ImageNet maintain the same number of interpretable concepts and units until more than 90% of parameters have been pruned.


title: A Power Efficient Artificial Neuron Using Superconducting Nanowires

abstract: With the rising societal demand for more information-processing capacity with lower power consumption, alternative architectures inspired by the parallelism and robustness of the human brain have recently emerged as possible solutions. In particular, spiking neural networks (SNNs) offer a bio-realistic approach, relying on pulses analogous to action potentials as units of information. While software encoded networks provide flexibility and precision, they are often computationally expensive. As a result, hardware SNNs based on the spiking dynamics of a device or circuit represent an increasingly appealing direction. Here, we propose to use superconducting nanowires as a platform for the development of an artificial neuron. Building on an architecture first proposed for Josephson junctions, we rely on the intrinsic nonlinearity of two coupled nanowires to generate spiking behavior, and use electrothermal circuit simulations to demonstrate that the nanowire neuron reproduces multiple characteristics of biological neurons. Furthermore, by harnessing the nonlinearity of the superconducting nanowire's inductance, we develop a design for a variable inductive synapse capable of both excitatory and inhibitory control. We demonstrate that this synapse design supports direct fanout, a feature that has been difficult to achieve in other superconducting architectures, and that the nanowire neuron's nominal energy performance is competitive with that of current technologies.


title: Weighted Sobolev $L^{p}$ estimates for homotopy operators on strictly pseudoconvex domains with $C^{2}$ boundary

abstract: We derive estimates in a weighted Sobolev space $W^{k,p}_{\mu}(D)$ for a homotopy operator on a bounded strictly pseudoconvex domain $D$ of $C^2$ boundary in ${\C}^n$. As a result, we show that given any $2n < p < \infty$, $k > 1$, $q \geq 1$, and a $\dbar$-closed $(0,q)$ form $\var$ of class $W^{k,p}(D)$, there exist a solution $u$ to $\dbar u = \var$ such that $u \in W^{k,p}_{\yh-\ve}(D)$ for any $\ve > 0$. If $k=1$, then we can take $p$ to be any value between $1$ and $\infty$. In other words, the solution gains almost $\yh$-derivative in a suitable sense.


title: A Generalization of Fourier Series occurring in Atomic Theory

abstract: A number of the Fourier Series which occur in the theory of the semi-classical atom due to Englert and Schwinger are generalized and presented.


title: On the number of resolvable Steiner triple systems of small 3-rank

abstract: In a recent work, Jungnickel, Magliveras, Tonchev, and Wassermann derived an overexponential lower bound on the number of nonisomorphic resolvable Steiner triple systems (STS) of order $v$, where $v=3^k$, and $3$-rank $v-k$. We develop an approach to generalize this bound and estimate the number of isomorphism classes of STS$(v)$ of rank $v-k-1$ for an arbitrary $v$ of form $3^kT$.


title: Learning to Generate Synthetic 3D Training Data through Hybrid Gradient

abstract: Synthetic images rendered by graphics engines are a promising source for training deep networks. However, it is challenging to ensure that they can help train a network to perform well on real images, because a graphics-based generation pipeline requires numerous design decisions such as the selection of 3D shapes and the placement of the camera. In this work, we propose a new method that optimizes the generation of 3D training data based on what we call "hybrid gradient". We parametrize the design decisions as a real vector, and combine the approximate gradient and the analytical gradient to obtain the hybrid gradient of the network performance with respect to this vector. We evaluate our approach on the task of estimating surface normal, depth or intrinsic decomposition from a single image. Experiments on standard benchmarks show that our approach can outperform the prior state of the art on optimizing the generation of 3D training data, particularly in terms of computational efficiency.


title: The valley version of the Extended Delta Conjecture

abstract: The Shuffle Theorem of Carlsson and Mellit gives a combinatorial expression for the bigraded Frobenius characteristic of the ring of diagonal harmonics, and the Delta Conjecture of Haglund, Remmel and the second author provides two generalizations of the Shuffle Theorem to the delta operator expression $\Delta'_{e_k} e_n$. Haglund et al. also propose the Extended Delta Conjecture for the delta operator expression $\Delta'_{e_k} \Delta_{h_r}e_n$, which is analogous to the rise version of the Delta Conjecture. Recently, D'Adderio, Iraci and Wyngaerd proved the rise version of the Extended Delta Conjecture at the case when $t=0$. In this paper, we propose a new valley version of the Extended Delta Conjecture. Then, we work on the combinatorics of extended ordered multiset partitions to prove that the two conjectures for $\Delta'_{e_k} \Delta_{h_r}e_n$ are equivalent when $t$ or $q$ equals 0, thus proving the valley version of the Extended Delta Conjecture when $t$ or $q$ equals 0.


title: On Training Flexible Robots using Deep Reinforcement Learning

abstract: The use of robotics in controlled environments has flourished over the last several decades and training robots to perform tasks using control strategies developed from dynamical models of their hardware have proven very effective. However, in many real-world settings, the uncertainties of the environment, the safety requirements and generalized capabilities that are expected of robots make rigid industrial robots unsuitable. This created great research interest into developing control strategies for flexible robot hardware for which building dynamical models are challenging. In this paper, inspired by the success of deep reinforcement learning (DRL) in other areas, we systematically study the efficacy of policy search methods using DRL in training flexible robots. Our results indicate that DRL is successfully able to learn efficient and robust policies for complex tasks at various degrees of flexibility. We also note that DRL using Deep Deterministic Policy Gradients can be sensitive to the choice of sensors and adding more informative sensors does not necessarily make the task easier to learn.


title: An aggregate learning approach for interpretable semi-supervised population prediction and disaggregation using ancillary data

abstract: Census data provide detailed information about population characteristics at a coarse resolution. Nevertheless, fine-grained, high-resolution mappings of population counts are increasingly needed to characterize population dynamics and to assess the consequences of climate shocks, natural disasters, investments in infrastructure, development policies, etc. Dissagregating these census is a complex machine learning, and multiple solutions have been proposed in past research. We propose in this paper to view the problem in the context of the aggregate learning paradigm, where the output value for all training points is not known, but where it is only known for aggregates of the points (i.e. in this context, for regions of pixels where a census is available). We demonstrate with a very simple and interpretable model that this method is on par, and even outperforms on some metrics, the state-of-the-art, despite its simplicity.


title: HTS: A Hardware Task Scheduler for Heterogeneous Systems

abstract: As the Moore's scaling era comes to an end, application specific hardware accelerators appear as an attractive way to improve the performance and power efficiency of our computing systems. A massively heterogeneous system with a large number of hardware accelerators along with multiple general purpose CPUs is a promising direction, but pose several challenges in terms of the run-time scheduling of tasks on the accelerators and design granularity of accelerators. This paper addresses these challenges by developing an example heterogeneous system to enable multiple applications to share the available accelerators. We propose to design accelerators at a lower abstraction to enable applications to be broken down into tasks that can be mapped on several accelerators. We observe that several real-life workloads can be broken down into common primitives that are shared across many workloads. Finally, we propose and design a hardware task scheduler inspired by the hardware schedulers in out-of-order superscalar processors to efficiently utilize the accelerators in the system by scheduling tasks in out-of-order and even speculatively. We evaluate the proposed system on both real-life and synthetic benchmarks based on Digital Signal Processing~(DSP) applications. Compared to executing the benchmark on a system with sequential scheduling, proposed scheduler achieves up to 12x improvement in performance.


title: Intersection Graphs of Non-crossing Paths

abstract: We study graph classes modeled by families of non-crossing (NC) connected sets. Two classic graph classes in this context are disk graphs and proper interval graphs. We focus on the cases when the sets are paths and the host is a tree (generalizing proper interval graphs). Forbidden induced subgraph characterizations and linear time certifying recognition algorithms are given for intersection graphs of NC paths of a tree (and related subclasses). A direct consequence of our certifying algorithms is a linear time algorithm certifying the presence/absence of an induced claw $(K_{1,3})$ in a chordal graph. For the intersection graphs of NC paths of a tree, we characterize the minimum connected dominating sets (leading to a linear time algorithm to compute one). We further observe that there is always an independent dominating set which is a minimum dominating set, leading to the dominating set problem being solvable in linear time. Finally, each such graph $G$ is shown to have a Hamiltonian cycle if and only if it is 2-connected, and when $G$ is not 2-connected, a minimum-leaf spanning tree of $G$ has $\ell$ leaves if and only if $G$'s block-cutpoint tree has exactly $\ell$ leaves (e.g., implying that the block-cutpoint tree is a path if and only if the graph has a Hamiltonian path).


title: DuDoNet: Dual Domain Network for CT Metal Artifact Reduction

abstract: Computed tomography (CT) is an imaging modality widely used for medical diagnosis and treatment. CT images are often corrupted by undesirable artifacts when metallic implants are carried by patients, which creates the problem of metal artifact reduction (MAR). Existing methods for reducing the artifacts due to metallic implants are inadequate for two main reasons. First, metal artifacts are structured and non-local so that simple image domain enhancement approaches would not suffice. Second, the MAR approaches which attempt to reduce metal artifacts in the X-ray projection (sinogram) domain inevitably lead to severe secondary artifact due to sinogram inconsistency. To overcome these difficulties, we propose an end-to-end trainable Dual Domain Network (DuDoNet) to simultaneously restore sinogram consistency and enhance CT images. The linkage between the sigogram and image domains is a novel Radon inversion layer that allows the gradients to back-propagate from the image domain to the sinogram domain during training. Extensive experiments show that our method achieves significant improvements over other single domain MAR approaches. To the best of our knowledge, it is the first end-to-end dual-domain network for MAR.


title: NetTailor: Tuning the Architecture, Not Just the Weights

abstract: Real-world applications of object recognition often require the solution of multiple tasks in a single platform. Under the standard paradigm of network fine-tuning, an entirely new CNN is learned per task, and the final network size is independent of task complexity. This is wasteful, since simple tasks require smaller networks than more complex tasks, and limits the number of tasks that can be solved simultaneously. To address these problems, we propose a transfer learning procedure, denoted NetTailor, in which layers of a pre-trained CNN are used as universal blocks that can be combined with small task-specific layers to generate new networks. Besides minimizing classification error, the new network is trained to mimic the internal activations of a strong unconstrained CNN, and minimize its complexity by the combination of 1) a soft-attention mechanism over blocks and 2) complexity regularization constraints. In this way, NetTailor can adapt the network architecture, not just its weights, to the target task. Experiments show that networks adapted to simple tasks, such as character or traffic sign recognition, become significantly smaller than those adapted to hard tasks, such as fine-grained recognition. More importantly, due to the modular nature of the procedure, this reduction in network complexity is achieved without compromise of either parameter sharing across tasks, or classification accuracy.


title: Efficient Regularized Piecewise-Linear Regression Trees

abstract: We present a detailed analysis of the class of regression decision tree algorithms which employ a regulized piecewise-linear node-splitting criterion and have regularized linear models at the leaves. From a theoretic standpoint, based on Rademacher complexity framework, we present new high-probability upper bounds for the generalization error for the proposed classes of regularized regression decision tree algorithms, including LASSO-type, and $\ell_{2}$ regularization for linear models at the leaves. Theoretical result are further extended by considering a general type of variable selection procedure. Furthermore, in our work we demonstrate that the class of piecewise-linear regression trees is not only numerically stable but can be made tractable via an algorithmic implementation, presented herein, as well as with the help of modern GPU technology. Empirically, we present results on multiple datasets which highlight the strengths and potential pitfalls, of the proposed tree algorithms compared to baselines which grow trees based on piecewise constant models.


title: Stereo relative pose from line and point feature triplets

abstract: Stereo relative pose problem lies at the core of stereo visual odometry systems that are used in many applications. In this work, we present two minimal solvers for the stereo relative pose. We specifically consider the case when a minimal set consists of three point or line features and each of them has three known projections on two stereo cameras. We validate the importance of this formulation for practical purposes in our experiments with motion estimation. We then present a complete classification of minimal cases with three point or line correspondences each having three projections, and present two new solvers that can handle all such cases. We demonstrate a considerable effect from the integration of the new solvers into a visual SLAM system.


title: Active Learning of Probabilistic Movement Primitives

abstract: A Probabilistic Movement Primitive (ProMP) defines a distribution over trajectories with an associated feedback policy. ProMPs are typically initialized from human demonstrations and achieve task generalization through probabilistic operations. However, there is currently no principled guidance in the literature to determine how many demonstrations a teacher should provide and what constitutes a "good" demonstration for promoting generalization. In this paper, we present an active learning approach to learning a library of ProMPs capable of task generalization over a given space. We utilize uncertainty sampling techniques to generate a task instance for which a teacher should provide a demonstration. The provided demonstration is incorporated into an existing ProMP if possible, or a new ProMP is created from the demonstration if it is determined that it is too dissimilar from existing demonstrations. We provide a qualitative comparison between common active learning metrics; motivated by this comparison we present a novel uncertainty sampling approach named Greatest Mahalanobis Distance. We perform grasping experiments on a real KUKA robot and show our novel active learning measure achieves better task generalization with fewer demonstrations than a random sampling over the space.


title: Most abundant isotope peaks and efficient selection on $Y=X_1+X_2+\cdots + X_m$

abstract: The isotope masses and relative abundances for each element are fundamental chemical knowledge. Computing the isotope masses of a compound and their relative abundances is an important and difficult analytical chemistry problem. We demonstrate that this problem is equivalent to sorting $Y=X_1+X_2+\cdots+X_m$. We introduce a novel, practically efficient method for computing the top values in $Y$. then demonstrate the applicability of this method by computing the most abundant isotope masses (and their abundances) from compounds of nontrivial size.


title: Radiative leptonic decays on the lattice

abstract: Adding a hard photon to the final state of a leptonic pseudoscalar-meson decay lifts the helicity suppression and can provide sensitivity to a larger set of operators in the weak effective Hamiltonian. Furthermore, radiative leptonic $B$ decays at high photon energy are well suited to constrain the first inverse moment of the $B$-meson light-cone distribution amplitude, an important parameter in the theory of nonleptonic $B$ decays. We demonstrate that the calculation of radiative leptonic decays is possible using Euclidean lattice QCD, and present preliminary numerical results for $D_s^+ \to \ell^+ \nu\gamma$ and $K^- \to \ell^-\bar{\nu}\gamma$.


title: A Scrapbook of Inadmissible Line Complexes For the X-ray Transform

abstract: We consider a finite field model of the X-ray transform that integrates functions along lines in dimension 3, within the context of finite fields. The admissibility problem asks for minimal sets of lines for which the restricted transform is invertible. Graph theoretic conditions are known which characterize admissible collections of lines, and these have been counted using a brute force computer program. Here we perform the count by hand and, at the same time, produce a detailed illustration of the possible structures of inadmissible complexes. The resulting scrapbook may be of interest in an artificial intelligence approach to enumerating and illustrating admissible complexes in arbitrary dimensions (arbitrarily large ambient spaces, with transforms integrating over subspaces of arbitrary dimensions.)


title: Improving 3D U-Net for Brain Tumor Segmentation by Utilizing Lesion Prior

abstract: We propose a novel, simple and effective method to integrate lesion prior and a 3D U-Net for improving brain tumor segmentation. First, we utilize the ground-truth brain tumor lesions from a group of patients to generate the heatmaps of different types of lesions. These heatmaps are used to create the volume-of-interest (VOI) map which contains prior information about brain tumor lesions. The VOI map is then integrated with the multimodal MR images and input to a 3D U-Net for segmentation. The proposed method is evaluated on a public benchmark dataset, and the experimental results show that the proposed feature fusion method achieves an improvement over the baseline methods. In addition, our proposed method also achieves a competitive performance compared to state-of-the-art methods.


title: ROS 2 for RoboCup

abstract: There has always been much motivation for sharing code and solutions among teams in the RoboCup community. Yet the transfer of code between teams was usually complicated due to a huge variety of used frameworks and their differences in processing sensory information. The RoboCup@Home league has tackled this by transitioning to ROS as a common framework. In contrast, other leagues, such as those using humanoid robots, are reluctant to use ROS, as in those leagues real-time processing and low-computational complexity is crucial. However, ROS 2 now offers built-in support for real-time processing and promises to be suitable for embedded systems and multi-robot systems. It also offers the possibility to compose a set of nodes needed to run a robot into a single process. This, as we will show, reduces communication overhead and allows to have one single binary, which is pertinent to competitions such as the 3D-Simulation League. Although ROS 2 has not yet been announced to be production ready, we started the process to develop ROS 2 packages for using it with humanoid robots (real and simulated). This paper presents the developed modules, our contributions to ROS 2 core and RoboCup related packages, and most importantly it provides benchmarks that indicate that ROS 2 is a promising candidate for a common framework used among leagues.


title: SLAM Endoscopy enhanced by adversarial depth prediction

abstract: Medical endoscopy remains a challenging application for simultaneous localization and mapping (SLAM) due to the sparsity of image features and size constraints that prevent direct depth-sensing. We present a SLAM approach that incorporates depth predictions made by an adversarially-trained convolutional neural network (CNN) applied to monocular endoscopy images. The depth network is trained with synthetic images of a simple colon model, and then fine-tuned with domain-randomized, photorealistic images rendered from computed tomography measurements of human colons. Each image is paired with an error-free depth map for supervised adversarial learning. Monocular RGB images are then fused with corresponding depth predictions, enabling dense reconstruction and mosaicing as an endoscope is advanced through the gastrointestinal tract. Our preliminary results demonstrate that incorporating monocular depth estimation into a SLAM architecture can enable dense reconstruction of endoscopic scenes.


title: The large cardinal strength of Weak Vop\v{e}nka's Principle

abstract: We show that Weak Vop\v{e}nka's Principle, which is the statement that the opposite category of ordinals cannot be fully embedded into the category of graphs, is equivalent to the large cardinal principle Ord is Woodin, which says that for every class C there is a C-strong cardinal. Weak Vop\v{e}nka's Principle was already known to imply the existence of a proper class of measurable cardinals. We improve this lower bound to the optimal one by defining structures whose nontrivial homomorphisms can be used as extenders, thereby producing elementary embeddings witnessing C-strongness of some cardinal.


title: X-CHANGR: Changing Memristive Crossbar Mapping for Mitigating Line-Resistance Induced Accuracy Degradation in Deep Neural Networks

abstract: There is widespread interest in emerging technologies, especially resistive crossbars for accelerating Deep Neural Networks (DNNs). Resistive crossbars offer a highly-parallel and efficient matrix-vector-multiplication (MVM) operation. MVM being the most dominant operation in DNNs makes crossbars ideally suited. However, various sources of device and circuit non-idealities lead to errors in the MVM output, thereby reducing DNN accuracy. Towards that end, we propose crossbar re-mapping strategies to mitigate line-resistance induced accuracy degradation in DNNs, without having to re-train the learned weights, unlike most prior works. Line-resistances degrade the voltage levels along the crossbar columns, thereby inducing more errors at the columns away from the drivers. We rank the DNN weights and kernels based on a sensitivity analysis, and re-arrange the columns such that the most sensitive kernels are mapped closer to the drivers, thereby minimizing the impact of errors on the overall accuracy. We propose two algorithms $-$ static remapping strategy (SRS) and dynamic remapping strategy (DRS), to optimize the crossbar re-arrangement of a pre-trained DNN. We demonstrate the benefits of our approach on a standard VGG16 network trained using CIFAR10 dataset. Our results show that SRS and DRS limit the accuracy degradation to 2.9\% and 2.1\%, respectively, compared to a 5.6\% drop from an as it is mapping of weights and kernels to crossbars. We believe this work brings an additional aspect for optimization, which can be used in tandem with existing mitigation techniques, such as in-situ compensation, technology aware training and re-training approaches, to enhance system performance.


title: On the moments of torsion points modulo primes and their applications

abstract: Let $\mathbb{A}[n]$ be the group of $n$-torsion points of a commutative algebraic group $\mathbb{A}$ defined over a number field $F$. For a prime ideal $\mathfrak{p}$, we let $N_{\mathfrak{p}}(\mathbb{A}[n])$ be the number of $\mathbb{F}_\mathfrak{p}$-solutions of the system of polynomial equations defining $\mathbb{A}[n]$ when reduced modulo $\mathfrak{p}$. Here, $\mathbb{F}_{\mathfrak{p}}$ is the residue field at $\mathfrak{p}$. Let $\pi_F(x)$ denote the number of primes $\mathfrak{p}$ of $F$ whose norm $N(\mathfrak{p})$ do not exceed $x$. We then, for algebraic groups of dimension one, compute the $k$-th moment limit $$M_k(\mathbb{A}/F, n)=\lim_{x\rightarrow \infty} \frac{1}{\pi_F(x)} \sum_{N(\mathfrak{p}) \leq x} N_{\mathfrak{p}}^k(\mathbb{A}[n])$$ by appealing to the prime number theorem for arithmetic progressions and more generally the Chebotarev density theorem. We further interpret this limit as the number of orbits of the action of the absolute Galois group of $F$on $k$ copies of $\mathbb{A}[n]$ by an application of Burnside's Lemma. These concrete examples suggest a possible approach for determining the number of orbits of a group acting on $k$ copies of a set. We also show that for an algebraic set $Y$ of dimension zero, the corresponding arithmetic function $N_\mathfrak{p}(Y)$, defined on primes $\mathfrak{p}$ of $F$, has an asymptotic limiting distribution.


title: Estimating Treatment Effect under Additive Hazards Models with High-dimensional Covariates

abstract: Estimating causal effects for survival outcomes in the high-dimensional setting is an extremely important topic for many biomedical applications as well as areas of social sciences. We propose a new orthogonal score method for treatment effect estimation and inference that results in asymptotically valid confidence intervals assuming only good estimation properties of the hazard outcome model and the conditional probability of treatment. This guarantee allows us to provide valid inference for the conditional treatment effect under the high-dimensional additive hazards model under considerably more generality than existing approaches. In addition, we develop a new Hazards Difference (HDi), estimator. We showcase that our approach has double-robustness properties in high dimensions: with cross-fitting, the HDi estimate is consistent under a wide variety of treatment assignment models; the HDi estimate is also consistent when the hazards model is misspecified and instead the true data generating mechanism follows a partially linear additive hazards model. We further develop a novel sparsity doubly robust result, where either the outcome or the treatment model can be a fully dense high-dimensional model. We apply our methods to study the treatment effect of radical prostatectomy versus conservative management for prostate cancer patients using the SEER-Medicare Linked Data.


title: A New Lower Bound for Kullback-Leibler Divergence Based on Hammersley-Chapman-Robbins Bound

abstract: In this paper, we derive a useful lower bound for the Kullback-Leibler divergence (KL-divergence) based on the Hammersley-Chapman-Robbins bound (HCRB). The HCRB states that the variance of an estimator is bounded from below by the Chi-square divergence and the expectation value of the estimator. By using the relation between the KL-divergence and the Chi-square divergence, we show that the lower bound for the KL-divergence which only depends on the expectation value and the variance of a function we choose. This lower bound can also be derived from an information geometric approach. Furthermore, we show that the equality holds for the Bernoulli distributions and show that the inequality converges to the Cram\'{e}r-Rao bound when two distributions are very close. We also describe application examples and examples of numerical calculation.