title: Computable Upper Bounds on the Capacity of Finite-State Channels

abstract: We consider the use of the well-known dual capacity bounding technique for deriving upper bounds on the capacity of indecomposable finite-state channels (FSCs) with finite input and output alphabets. In this technique, capacity upper bounds are obtained by choosing suitable test distributions on the sequence of channel outputs. We propose test distributions that arise from certain graphical structures called Q-graphs. As we show in this paper, the advantage of this choice of test distribution is that, for the important classes of unifilar and input-driven FSCs, the resulting upper bounds can be formulated as dynamic programming (DP) problem, which makes the bounds tractable. We illustrate this for several examples of FSCs, where we are able to solve the associated DP problems explicitly to obtain capacity upper bounds that either match or beat the best previously reported bounds. For instance, for the classical trapdoor channel, we improve the best known upper bound of 0.66$ (due to Lutz (2014)) to 0.584, shrinking the gap to the best known lower bound of 0.572, all bounds being in units of bits per channel use.


title: Soft Error Resilience and Failure Recovery for Continuum Dynamics Applications

abstract: The persistently growing resilience concerns of large-scale computing systems today require not only generic fault tolerance approaches, but also application-level resilience, due to demanding efficiency and various domain-specific requirements. Scientific applications within a particular domain generally comply with domain conservation laws, which can be leveraged as an error detection criterion to study the resilience of this domain of applications sharing similar program characteristics. However, it is challenging to achieve application resilience: (a) how to identify the invariants of a given domain of applications, knowing the conservation laws, and (b) how to utilize the invariants to efficiently detect and recover from failures in application runs. In this work, we target several continuum dynamics software packages, FleCSALE [1] and CODY [2] (with intrinsic invariants during computation), study their resilience to soft errors online (injected using an open-source fault injector), and investigate the opportunities for non-intrusive and lightweight failure recovery (checksum-based invariant checking). We propose a checksum-retry approach to achieve our goals, and experimental results on a virtualized platform with extensive fault injection campaigns demonstrate the effectiveness and efficiency of the proposed approach.


title: Spatial Attention for Far-field Speech Recognition with Deep Beamforming Neural Networks

abstract: In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the factored complex linear projection, have shown promising results. However, the features extracted by such methods contain redundant information, as only the direction of the target speech is relevant. We propose using a spatial attention subnet to weigh the features from different directions, so that the subsequent acoustic model could focus on the most relevant features for the speech recognition. Our experimental results show that spatial attention achieves up to 9% relative word error rate improvement over methods without the attention.


title: Unsupervised Cross-lingual Representation Learning at Scale

abstract: This paper shows that pretraining multilingual language models at scale leads to significant performance gains for a wide range of cross-lingual transfer tasks. We train a Transformer-based masked language model on one hundred languages, using more than two terabytes of filtered CommonCrawl data. Our model, dubbed XLM-R, significantly outperforms multilingual BERT (mBERT) on a variety of cross-lingual benchmarks, including +14.6% average accuracy on XNLI, +13% average F1 score on MLQA, and +2.4% F1 score on NER. XLM-R performs particularly well on low-resource languages, improving 15.7% in XNLI accuracy for Swahili and 11.4% for Urdu over previous XLM models. We also present a detailed empirical analysis of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and low resource languages at scale. Finally, we show, for the first time, the possibility of multilingual modeling without sacrificing per-language performance; XLM-R is very competitive with strong monolingual models on the GLUE and XNLI benchmarks. We will make our code, data and models publicly available.


title: Simple groups with infinite verbal width and the same positive theory as free groups

abstract: In this paper we show that there exists an uncountable family of finitely generated simple groups with the same positive theory as any non-abelian free group. In particular, these simple groups have infinite $w$-verbal width for all non-trivial words $w$.


title: Failure Analysis and Quantification for Contemporary and Future Supercomputers

abstract: Large-scale computing systems today are assembled by numerous computing units for massive computational capability needed to solve problems at scale, which enables failures common events in supercomputing scenarios. Considering the demanding resilience requirements of supercomputers today, we present a quantitative study on fine-grained failure modeling for contemporary and future large-scale computing systems. We integrate various types of failures from different system hierarchical levels and system components, and summarize the overall system failure rates formally. Given that nowadays system-wise failure rate needs to be capped under a threshold value for reliability and cost-efficiency purposes, we quantitatively discuss different scenarios of system resilience, and analyze the impacts of resilience to different error types on the variation of system failure rates, and the correlation of hierarchical failure rates. Moreover, we formalize and showcase the resilience efficiency of failure-bounded supercomputers today.


title: Limits of Blaschke metrics

abstract: We find a compactification of the $\mathrm{SL}(3,\mathbb{R})$-Hitchin component by studying the degeneration of the Blaschke metrics on the associated equivariant affine spheres. In the process, we establish the closure in the space of projectivized geodesic currents of the space of flat metrics induced by holomorphic cubic differentials on a Riemann surface.


title: Does a central limit theorem hold for the $k$-skeleton of Poisson hyperplanes in hyperbolic space?

abstract: Poisson processes in the space of $(d-1)$-dimensional totally geodesic subspaces (hyperplanes) in a $d$-dimensional hyperbolic space of constant curvature $-1$ are studied. The $k$-dimensional Hausdorff measure of their $k$-skeleton is considered. Explicit formulas for first- and second-order quantities restricted to bounded observation windows are obtained. The central limit problem for the $k$-dimensional Hausdorff measure of the $k$-skeleton is approached in two different set-ups: (i) for a fixed window and growing intensities, and (ii) for fixed intensity and growing spherical windows. While in case (i) the central limit theorem is valid for all $d\geq 2$, it is shown that in case (ii) the central limit theorem holds for $d\in\{2,3\}$ and fails if $d\geq 4$ and $k=d-1$ or if $d\geq 7$ and for general $k$. Also rates of convergence are studied and multivariate central limit theorems are obtained. Moreover, the situation in which the intensity and the spherical window are growing simultaneously is discussed. In the background are the Malliavin-Stein method for normal approximation and the combinatorial moment structure of Poisson U-statistics as well as tools from hyperbolic integral geometry.


title: GAN-enhanced Conditional Echocardiogram Generation

abstract: Echocardiography (echo) is a common means of evaluating cardiac conditions. Due to the label scarcity, semi-supervised paradigms in automated echo analysis are getting traction. One of the most sought-after problems in echo is the segmentation of cardiac structures (e.g. chambers). Accordingly, we propose an echocardiogram generation approach using generative adversarial networks with a conditional patch-based discriminator. In this work, we validate the feasibility of GAN-enhanced echo generation with different conditions (segmentation masks), namely, the left ventricle, ventricular myocardium, and atrium. Results show that the proposed adversarial algorithm can generate high-quality echo frames whose cardiac structures match the given segmentation masks. This method is expected to facilitate the training of other machine learning models in a semi-supervised fashion as suggested in similar researches.


title: uqSim: Scalable and Validated Simulation of Cloud Microservices

abstract: Current cloud services are moving away from monolithic designs and towards graphs of many loosely-coupled, single-concerned microservices. Microservices have several advantages, including speeding up development and deployment, allowing specialization of the software infrastructure, and helping with debugging and error isolation. At the same time they introduce several hardware and software challenges. Given that most of the performance and efficiency implications of microservices happen at scales larger than what is available outside production deployments, studying such effects requires designing the right simulation infrastructures. We present uqSim, a scalable and validated queueing network simulator designed specifically for interactive microservices. uqSim provides detailed intra- and inter-microservice models that allow it to faithfully reproduce the behavior of complex, many-tier applications. uqSim is also modular, allowing reuse of individual models across microservices and end-to-end applications. We have validated uqSim both against simple and more complex microservices graphs, and have shown that it accurately captures performance in terms of throughput and tail latency. Finally, we use uqSim to model the tail at scale effects of request fanout, and the performance impact of power management in latency-sensitive microservices.


title: HIPPI-2: A Versatile High Precision Polarimeter

abstract: We describe the High-Precision Polarimetric Instrument-2 (HIPPI-2) a highly versatile stellar polarimeter developed at the University of New South Wales (UNSW). Two copies of HIPPI-2 have been built and used on the 60-cm telescope at Western Sydney University's (WSU) Penrith Observatory, the 8.1-m Gemini North Telescope at Mauna Kea and extensively on the 3.9-m Anglo-Australian Telescope (AAT). The precision of polarimetry, measured from repeat observations of bright stars in the SDSS g' band, is better than 3.5 ppm (parts per million) on the 3.9-m AAT and better than 11 ppm on the 60-cm WSU telescope. The precision is better at redder wavelengths and poorer in the blue. On the Gemini North 8-m telescope the performance is limited by a very large and strongly wavelength dependent telescope polarization that reached 1000's of ppm at blue wavelengths and is much larger than we have seen on any other telescope.


title: Medians are below joins in semimodular lattices of breadth 2

abstract: Let $L$ be a lattice of finite length and let $d$ denote the minimum path length metric on the covering graph of $L$. For any $\xi=(x_1,\dots,x_k)\in L^k$, an element $y$ belonging to $L$ is called a median of $\xi$ if the sum $d(y,x_1)+\cdots+d(y,x_k)$ is minimum. The lattice $L$ satisfies the $c_1$-median property if, for any $\xi=(x_1,\dots,x_k)\in L^k$ and for any median $y$ of $\xi$, $y\leq x_1\vee\dots\vee x_k$. Our main theorem asserts that if $L$ is an upper semimodular lattice of finite length and the breadth of $L$ is less than or equal to $2$, then $L$ satisfies the $c_1$-median property. Also, we give a construction that yields semimodular lattices, and we use a particular case of this construction to prove that our theorem is sharp in the sense that $2$ cannot be replaced by $3$.


title: A generating function approach to new representation stability phenomena in orbit configuration spaces

abstract: As countless examples show, it can be fruitful to study a sequence of complicated objects all at once via the formalism of generating functions. We apply this point of view to the homology and combinatorics of orbit configuration spaces: using the notion of twisted commutative algebras, which essentially categorify exponential generating functions. This idea allows for a factorization of the orbit configuration space "generating function" into an infinite product, whose terms are surprisingly easy to understand. Beyond the intrinsic aesthetic of this decomposition and its quantitative consequences, it reveals a sequence of primary, secondary, and higher representation stability phenomena. Based on this, we give a simple geometric technique for identifying new stabilization actions with finiteness properties, which we use to unify and generalize known stability results. As a first new application of our methods, we establish secondary and higher stability for configuration spaces on $i$-acyclic spaces. For another application, we describe a natural filtration by which one observes a filtered representation stability phenomenon in configuration spaces on graphs.


title: Control Strategies for Microgrids with Renewable Energy Generation and Battery Energy Storage Systems

abstract: In this report, several control strategies for microgrids with renewable energy resources and battery energy storage systems are proposed. Renewable energy has the potential to reduce global carbon emissions, while higher penetration of renewable energy is hindered by the inherent variability and intermittency of renewable resources. This motivates the development of microgrids supplied by renewable energy resources. With proper control of storage units and communications with the energy market, the non-dispatchable energy can be regulated to reduce the difficulty of power scheduling in the grid operation. Battery energy storage systems (BESS) are widely used to make renewable energy more controllable and usable on demand. With suitable prediction techniques and control algorithms, BESS can store part of the generated renewable energy and supply some stored energy at different periods, so that the actual power dispatched can meet the required operating criteria. The control algorithms introduced in this report are developed to maximize the profit and minimize the energy cost in microgrids, which require predicted data on renewable power, temperature, electricity price, and load demand.


title: Quantum Mixmaster as a model of the Primordial Universe

abstract: The Mixmaster solution to Einstein field equations was examined by C. Misner in an effort to better understand the dynamics of the early universe. We highlight the importance of the quantum version of this model for early universe. This quantum version and its semi-classical portraits are yielded through affine and standard coherent state quantizations and more generally affine and Weyl-Heisenberg covariant integral quantizations. The adiabatic and vibronic approximations widely used in molecular physics can be employed to qualitatively study the dynamics of the model on both quantum and semi-classical levels. Moreover, the semi-classical approach with the exact anisotropy potential can be effective in numerical integration of some solutions. Some promising physical features such as the singularity resolution, smooth bouncing, the excitation of anisotropic oscillations and a substantial amount of post-bounce inflation as the backreaction to the latter are pointed out. Finally, a realistic cosmological scenario based on the quantum mixmaster model, which includes the formation and evolution of local structures is outlined.


title: Plankton: Scalable network configuration verification through model checking

abstract: Network configuration verification enables operators to ensure that the network will behave as intended, prior to deployment of their configurations. Although techniques ranging from graph algorithms to SMT solvers have been proposed, scalable configuration verification with sufficient protocol support continues to be a challenge. In this paper, we show that by combining equivalence partitioning with explicit-state model checking, network configuration verification can be scaled significantly better than the state of the art, while still supporting a rich set of protocol features. We propose Plankton, which uses symbolic partitioning to manage large header spaces and efficient model checking to exhaustively explore protocol behavior. Thanks to a highly effective suite of optimizations including state hashing, partial order reduction, and policy-based pruning, Plankton successfully verifies policies in industrial-scale networks quickly and compactly, at times reaching a 10000$\times$ speedup compared to the state of the art.


title: Annihilation-to-nothing: a quantum gravitational boundary condition for the Schwarzschild black hole

abstract: The interior of a static Schwarzschild metric can be written in terms of two functions, similar to some models of anisotropic cosmology. With a suitable choice of canonical variables, we solve the Wheeler-DeWitt equation (WDW) inside the horizon of a Schwarzschild black hole. By imposing classicality near the horizon, and requiring boundedness of the wave function, we get a rather generic solution of the WDW equation, whose steepest-descent solution, i.e., the ridge of the wave function, coincides nicely with the classical trajectory. However, there is an ambiguity in defining the arrow of time which leads to two possible interpretations - (i) if there is only one arrow of time, one can infer that the steepest-descent of the wave function follows the classical trajectory throughout: coming from the event horizon and going all the way down to the singularity, while (ii) if there are two different arrows of time in two separate regimes, it can be inferred that the steepest-descent of the wave function comes inwards from the event horizon in one region while it moves outwards from the singularity in the other region, and there exists an annihilation process of these two parts of the wave function inside the horizon. Adopting the second interpretation could shed light on the information loss paradox: as time goes on, probabilities for histories that include black holes and singularities decay to zero and eventually only trivial geometries dominate.


title: A unified description of Surface Free Energy and Surface Stress

abstract: Even though the study of interfacial phenomena dates back to Laplace and was formalised by Gibbs, it appears that some concepts and relations among them are still causing some confusion and debates in the literature, particularly for interfaces involving solids. Moreover, ever since the Molecular Dynamics (MD) simulations have started to be widely used in the study of surface properties, these debates only intensified. In this work, we present a systematic description of the interfacial properties from the thermodynamic and statistical mechanics points of view. In particular, we link our derivations to MD simulations, describing precisely what different quantities represent and how they can be calculated. We do not follow the usual way that consists of describing the thermodynamics of the surfaces in general and then considering specific cases (e.g. liquid-liquid interface, liquid-solid interface). Instead, we present our analysis of various properties of surfaces in a hierarchical way, starting with the simplest case that we have identified: a single component liquid-vacuum interface, and then adding more and more complications when we progress to more complex interfaces involving solids. We propose that the term "surface tension" should not be used in the description of surfaces and interfaces involving solids, since its meaning is ambiguous. Only "Surface Free Energy" and "Surface Stress" are well defined and represent distinct, but related, properties of the interfaces. We demonstrate that these quantities, as defined in thermodynamics and measured in MD simulations, satisfy the Shuttleworth equation.


title: A Conway-Maxwell-Multinomial Distribution for Flexible Modeling of Clustered Categorical Data

abstract: Categorical data are often observed as counts resulting from a fixed number of trials in which each trial consists of making one selection from a prespecified set of categories. The multinomial distribution serves as a standard model for such clustered data but assumes that trials are independent and identically distributed. Extensions such as Dirichlet-multinomial and random-clumped multinomial can express positive association, where trials are more likely to result in a common category due to membership in a common cluster. This work considers a Conway-Maxwell-multinomial (CMM) distribution for modeling clustered categorical data exhibiting positively or negatively associated trials. The CMM distribution features a dispersion parameter which allows it to adapt to a range of association levels and includes several recognizable distributions as special cases. We explore properties of CMM, illustrate its flexible characteristics, identify a method to efficiently compute maximum likelihood (ML) estimates, present simulations of small sample properties under ML estimation, and demonstrate the model via several data analysis examples.


title: Role of surface defects and material inhomogeneities for vortex nucleation in superconductors within time-dependent Ginzburg-Landau theory in 2 and 3 dimensions

abstract: We use Time-Dependent Ginzburg-Landau theory to study the nucleation of vortices in type II superconductors in the presence of both geometric and material inhomogeneities. The superconducting Meissner state is meta-stable up to a critical magnetic field, known as the superheating field. For a uniform surface and homogenous material, the superheating transition is driven by a non-local critical mode in which an array of vortices simultaneously penetrate the surface. In contrast, we show that even a small amount of disorder localizes the critical mode and can have a significant reduction in the effective superheating field for a particular sample. Vortices can be nucleated by either surface roughness or local variations in material parameters, such as Tc. Our approach uses a finite element method to simulate a cylindrical geometry in 2 dimensions and a film geometry in 2 and 3 dimensions. We combine saddle node bifurcation analysis along with a novel fitting procedure to evaluate the superheating field and identify the unstable mode. We demonstrate agreement with previous results for homogenous geometries and surface roughness and extend the analysis to include variations in material properties. Finally, we show that in three dimensions, suface divots not aligned with the applied field can increase the super heating field. We discuss implications for fabrication and performance of superconducting resonant frequency cavities in particle accelerators.


title: Contextual Grounding of Natural Language Entities in Images

abstract: In this paper, we introduce a contextual grounding approach that captures the context in corresponding text entities and image regions to improve the grounding accuracy. Specifically, the proposed architecture accepts pre-trained text token embeddings and image object features from an off-the-shelf object detector as input. Additional encoding to capture the positional and spatial information can be added to enhance the feature quality. There are separate text and image branches facilitating respective architectural refinements for different modalities. The text branch is pre-trained on a large-scale masked language modeling task while the image branch is trained from scratch. Next, the model learns the contextual representations of the text tokens and image objects through layers of high-order interaction respectively. The final grounding head ranks the correspondence between the textual and visual representations through cross-modal interaction. In the evaluation, we show that our model achieves the state-of-the-art grounding accuracy of 71.36% over the Flickr30K Entities dataset. No additional pre-training is necessary to deliver competitive results compared with related work that often requires task-agnostic and task-specific pre-training on cross-modal dadasets. The implementation is publicly available at https://gitlab.com/necla-ml/grounding.


title: Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

abstract: Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method for training non-convex models in this setting with a synchronized protocol. However, the assumptions made by FedAvg are not realistic given the heterogeneity of devices. In particular, the volume and distribution of collected data vary in the training process due to different sampling rates of edge devices. The edge devices themselves also vary in their available communication bandwidth and system configurations, such as memory, processor speed, and power requirements. This leads to vastly different training times as well as model/data transfer times. Furthermore, availability issues at edge devices can lead to a lack of contribution from specific edge devices to the federated model. In this paper, we present an Asynchronous Online Federated Learning (ASO-Fed) framework, where the edge devices perform online learning with continuous streaming local data and a central server aggregates model parameters from clients. Our framework updates the central model in an asynchronous manner to tackle the challenges associated with both varying computational loads at heterogeneous edge devices and edge devices that lag behind or dropout. We perform extensive experiments on a simulated benchmark image dataset and three real-world non-IID streaming datasets. The results demonstrate the effectiveness of \model~on converging fast and maintaining good prediction performance.


title: A Discrete Algorithm for General Weakly Hyperbolic Systems

abstract: This paper studies the Cauchy problem for variable coefficient weakly hyperbolic first order systems of partial differential operators. The hyperbolicity assumption is that for each $t, x$ the principal symbol is hyperbolic. No hypothesis is imposed on lower order terms. For coefficients and Cauchy data sufficiently Gevrey regular the Cauchy problem has a unique sufficiently Gevrey regular solution. We prove stability and error estimates for the spectral Crank-Nicholson scheme. Approximate solutions can be computed with accuracy $epsilon$ in the supremum norm with cost growing at most polynomially in $epsilon^{-1}$. The proofs use the symmetrizers from [2].


title: Dissipation and decoherence for generic open quantum systems

abstract: We study generic open quantum systems with Markovian dissipation, focusing on a class of stochastic Liouvillian operators of Lindblad form with independent random dissipation channels (jump operators) and a random Hamiltonian. We perform a thorough numerical study, focusing on global spectral features, the spectral gap, and the steady-state purity and statistics. We establish that all properties follow three different regimes as a function of the dissipation strength, whose boundaries depend on the particular observable. Within each regime, we determine the scaling exponents with the dissipation strength and system size. On the analytical side, we compute the average spectral gap at arbitrary dissipation and provide simple closed-form expressions for the asymptotic values at strong and weak dissipation strength. We also consider spectral correlations in generic complex spectra, such as that of the Liouvillian. We introduce and study, both analytically and numerically, the complex ratio of the nearest-neighbor spacing by next-to-nearest-neighbor spacing. Besides the usual level repulsion, we find that complex spacing ratios have a nontrivial angular dependence which offers a distinct signature of quantum chaos. It distinguishes integrable systems, which support the flat ratio distribution characteristic of Poisson statistics, and chaotic dissipative quantum systems, which conform to Random Matrix Theory statistics. We apply this new signature of quantum chaos to random Liouvillians and boundary-driven dissipative spin-chains. The results of this thesis can help understand the long-time dynamics, steady-state properties, and spectral correlations of generic dissipative systems.


title: Sarnak's conjecture in quantum computing, cyclotomic unitary group coranks, and Shimura curves

abstract: Sarnak's conjecture in quantum computing concerns when the groups $\operatorname{PU}_2$ and $\operatorname{PSU}_2$ over cyclotomic rings $\mathbb{Z}[\zeta_n, 1/2]$ with $\zeta_n=e^{2\pi i/n}$, $4|n$, are generated by the Clifford-cyclotomic gate set. We previously settled this using Euler-Poincar\'{e} characteristics. A generalization of Sarnak's conjecture is to ask when these groups are generated by torsion elements. An obstruction to this is provided by the corank: a group $G$ has $\operatorname{corank} G >0$ only if $G$ is not generated by torsion elements. In this paper we study the corank of these cyclotomic unitary groups in the families $n=2^s$ and $n=3\cdot 2^s$, $n\geq 8$, by letting them act on Bruhat-Tits trees. The quotients by this action are finite graphs whose first Betti number is the corank of the group. Our main result is that for $n=2^s$ and $n=3\cdot 2^s$ the corank groups doubly exponentially in $s$ as $s\rightarrow \infty$; it is $0$ precisely when $n=8,12, 16,24$ and indeed the cyclotomic unitary groups are generated by torsion elements (in fact by the Clifford-cyclotomic gates) for these $n$. We give explicit lower bounds for the corank in two different ways. The first is to bound the isotropy subgroups in the action on the tree by explicit cyclotomy. The second is to relate our graphs to Shimura curves over $F_n=\mathbb{Q}(\zeta_n)^+$ via interchanging local invariants and applying a result of Selberg and Zograf. We show that the cyclotomy arguments give the stronger bounds. In a final section we execute a program of Sarnak to show that our results for the $n=2^s$ and $n=3\cdot 2^s$ families are sufficient to give a second proof of Sarnak's conjecture.


title: Prediction of large barocaloric effects in thermoelectric superionic materials

abstract: We predict the existence of large barocaloric effects above room temperature in the thermoelectric fast-ion conductor Cu$_{2}$Se by using classical molecular dynamics simulations and first-principles computational methods. A hydrostatic pressure of $1$ GPa induces large isothermal entropy changes of $|\Delta S| \sim 15$-$45$ Jkg$^{-1}$K$^{-1}$ and adiabatic temperature shifts of $|\Delta T| \sim 10$ K in the temperature interval $400 \le T \le 700$ K. Structural phase transitions are absent in the analysed thermodynamic range. The causes of such large barocaloric effects are significant $P$-induced variations on the ionic conductivity of Cu$_{2}$Se and the inherently high anharmonicity of the material. Uniaxial stresses of the same magnitude, either compressive or tensile, produce comparatively much smaller caloric effects, namely, $|\Delta S| \sim 1$ Jkg$^{-1}$K$^{-1}$ and $|\Delta T| \sim 0.1$ K, due to practically null influence on the ionic diffusivity of Cu$_{2}$Se. Our simulation work shows that thermoelectric compounds presenting high ionic disorder, like copper and silver-based chalcogenides, may render large mechanocaloric effects and thus are promising materials for engineering solid-state cooling applications that do not require the application of electric fields.


title: Analysis of magnetization induced error field in superconducting magnets

abstract: The field error due to magnetization of superconductors in a superconducting magnet can significantly compromise the field homogeneity which is extremely important for NMR magnets. This is especially true for high Tc superconducting magnets. In this paper, the error field induced by the magnetization of superconducting wires or tapes is analyzed using a magnetic dipole field model. It uses experimentally measured magnetization of superconducting wires, and eludes the need of assuming screening current and its distribution as in previous methods. The field error of a REBCO coil calculated by this model and by a screening current model shows complete agreement. A few cases of field error distribution along the coil axis are calculated. The results are in qualitative agreement with experiments in the literature. This model would be particularly useful for magnets wound by multifilamentary wires or tapes where the filament sizes vary and filament bridging may occur hence screening current distribution is unknown. This model can also be used as a base for numerical calculations of the field error of a large practical magnet.


title: Fully Parameterized Quantile Function for Distributional Reinforcement Learning

abstract: Distributional Reinforcement Learning (RL) differs from traditional RL in that, rather than the expectation of total returns, it estimates distributions and has achieved state-of-the-art performance on Atari Games. The key challenge in practical distributional RL algorithms lies in how to parameterize estimated distributions so as to better approximate the true continuous distribution. Existing distributional RL algorithms parameterize either the probability side or the return value side of the distribution function, leaving the other side uniformly fixed as in C51, QR-DQN or randomly sampled as in IQN. In this paper, we propose fully parameterized quantile function that parameterizes both the quantile fraction axis (i.e., the x-axis) and the value axis (i.e., y-axis) for distributional RL. Our algorithm contains a fraction proposal network that generates a discrete set of quantile fractions and a quantile value network that gives corresponding quantile values. The two networks are jointly trained to find the best approximation of the true distribution. Experiments on 55 Atari Games show that our algorithm significantly outperforms existing distributional RL algorithms and creates a new record for the Atari Learning Environment for non-distributed agents.


title: Automorphic Galois representations and the inverse Galois problem for certain groups of type $D_{m}$

abstract: Let $m$ be an integer greater than three and $\ell$ be an odd prime. In this paper, we prove that at least one of the following groups: $\mbox{P}\Omega^\pm_{2m}(\mathbb{F}_{\ell^s})$, $\mbox{PSO}^\pm_{2m}(\mathbb{F}_{\ell^s})$, $\mbox{PO}_{2m}^\pm(\mathbb{F}_{\ell^s})$ or $\mbox{PGO}^\pm_{2m}(\mathbb{F}_{\ell^s})$ is a Galois group of $\mathbb{Q}$ for infinitely many integers $s > 0$. This is achieved by making use of a slight modification of a group theory result of Khare, Larsen and Savin, and previous results of the author on the images of the Galois representations attached to cuspidal automorphic representations of $\mbox{GL}_{2m}(\mathbb{A}_\mathbb{Q})$..


title: Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]

abstract: Recent research efforts on adversarial machine learning (ML) have investigated problem-space attacks, focusing on the generation of real evasive objects in domains where, unlike images, there is no clear inverse mapping to the feature space (e.g., software). However, the design, comparison, and real-world implications of problem-space attacks remain underexplored. This article makes three major contributions. Firstly, we propose a general formalization for adversarial ML evasion attacks in the problem-space, which includes the definition of a comprehensive set of constraints on available transformations, preserved semantics, absent artifacts, and plausibility. We shed light on the relationship between feature space and problem space, and we introduce the concept of side-effect features as the by-product of the inverse feature-mapping problem. This enables us to define and prove necessary and sufficient conditions for the existence of problem-space attacks. Secondly, building on our general formalization, we propose a novel problem-space attack on Android malware that overcomes past limitations in terms of semantics and artifacts. We have tested our approach on a dataset with 150K Android apps from 2016 and 2018 which show the practical feasibility of evading a state-of-the-art malware classifier along with its hardened version. Thirdly, we explore the effectiveness of adversarial training as a possible approach to enforce robustness against adversarial samples, evaluating its effectiveness on the considered machine learning models under different scenarios. Our results demonstrate that "adversarial-malware as a service" is a realistic threat, as we automatically generate thousands of realistic and inconspicuous adversarial applications at scale, where on average it takes only a few minutes to generate an adversarial instance.


title: Revisiting slow-roll dynamics and the tensor tilt in general single-field inflation

abstract: We explore the possibility of a blue-tilted gravitational wave spectrum from potential-driven slow-roll inflation in the Horndeski theory. In Kamada et al. (2012), it was claimed that a blue gravitational wave spectrum cannot be obtained from stable potential-driven slow-roll inflation within the Horndeski framework. However, it has been demonstrated that the spectrum of primordial gravitational waves can be blue in inflation with the Gauss-Bonnet term, where the potential term is dominant and slow-roll conditions as well as the stability conditions are satisfied. To fill in this gap, we clarify where the discrepancy is coming from. We extend the formulation of Kamada et al. (2012) and show that a blue gravitational wave spectrum can certainly be generated from stable slow-roll inflation if some of the conditions previously imposed on the form of the free functions in the Lagrangian are relaxed.


title: Floquet boundary states in AB-stacked graphite

abstract: We report on the effect of laser illumination with circularly polarized light on the electronic structure of AB-stacked graphite samples. By using Floquet theory in combination with Green's function techniques, we find that the polarized light induces band-gap openings at the Floquet zone edge $\hbar\Omega/2$, bridged by chiral boundary states. These states propagate mainly along the borders of the constituting layers as evidenced by the time-averaged local density of states and the probability current density in several geometries. Semianalytic calculations of the Chern number suggest that these states are of topological nature, similar to those found in illuminated 2D samples like monolayer and bilayer graphene. These states are promising candidates for the realization of a three-dimensional version of the quantum Hall effect for Floquet systems.


title: Uncertainty principles for the windowed Hankel transform

abstract: The aim of this paper is to prove some new uncertainty principles for the windowed Hankel transform. They include uncertainty principle for orthonormal sequence, local uncertainty principle, logarithmic uncertainty principle and Heisenberg-type uncertainty principle. As a side result, we obtain the Shapiro's dispersion theorem for the windowed Hankel transform.


title: Multi-Item Mechanisms without Item-Independence: Learnability via Robustness

abstract: We study the sample complexity of learning revenue-optimal multi-item auctions. We obtain the first set of positive results that go beyond the standard but unrealistic setting of item-independence. In particular, we consider settings where bidders' valuations are drawn from correlated distributions that can be captured by Markov Random Fields or Bayesian Networks -- two of the most prominent graphical models. We establish parametrized sample complexity bounds for learning an up-to-$\varepsilon$ optimal mechanism in both models, which scale polynomially in the size of the model, i.e.~the number of items and bidders, and only exponential in the natural complexity measure of the model, namely either the largest in-degree (for Bayesian Networks) or the size of the largest hyper-edge (for Markov Random Fields). We obtain our learnability results through a novel and modular framework that involves first proving a robustness theorem. We show that, given only ``approximate distributions'' for bidder valuations, we can learn a mechanism whose revenue is nearly optimal simultaneously for all ``true distributions'' that are close to the ones we were given in Prokhorov distance. Thus, to learn a good mechanism, it suffices to learn approximate distributions. When item values are independent, learning in Prokhorov distance is immediate, hence our framework directly implies the main result of Gonczarowski and Weinberg. When item values are sampled from more general graphical models, we combine our robustness theorem with novel sample complexity results for learning Markov Random Fields or Bayesian Networks in Prokhorov distance, which may be of independent interest. Finally, in the single-item case, our robustness result can be strengthened to hold under an even weaker distribution distance, the L\'evy distance.


title: Seq2Emo for Multi-label Emotion Classification Based on Latent Variable Chains Transformation

abstract: Emotion detection in text is an important task in NLP and is essential in many applications. Most of the existing methods treat this task as a problem of single-label multi-class text classification. To predict multiple emotions for one instance, most of the existing works regard it as a general Multi-label Classification (MLC) problem, where they usually either apply a manually determined threshold on the last output layer of their neural network models or train multiple binary classifiers and make predictions in the fashion of one-vs-all. However, compared to labels in the general MLC datasets, the number of emotion categories are much fewer (less than 10). Additionally, emotions tend to have more correlations with each other. For example, the human usually does not express "joy" and "anger" at the same time, but it is very likely to have "joy" and "love" expressed together. Given this intuition, in this paper, we propose a Latent Variable Chain (LVC) transformation and a tailored model -- Seq2Emo model that not only naturally predicts multiple emotion labels but also takes into consideration their correlations. We perform the experiments on the existing multi-label emotion datasets as well as on our newly collected datasets. The results show that our model compares favorably with existing state-of-the-art methods.


title: Average of Dirichlet Coefficients of Cuspidal Representations Related to $\GL(2)$

abstract: Let $\pi$ be a cuspidal representation on $\GL(2,\mathbb{A}_{\mathbb{Q}}).$ We give nontrivial lower and upper bounds for average of absolute values of Dirichlet coefficients associated to $\pi;$ and nontrivial upper bound in the case of $\Sym^k\pi,$ $k=2, 3.$ These bounds generalize the known estimates in holomorphic case to Maass forms, without assuming Ramanujan-Petersson conjecture.


title: Error estimates for backward fractional Feynman-Kac equation with non-smooth initial data

abstract: In this paper, we are concerned with the numerical solution for the backward fractional Feynman-Kac equation with non-smooth initial data. Here we first provide the regularity estimate of the solution. And then we use the backward Euler and second-order backward difference convolution quadratures to approximate the Riemann-Liouville fractional substantial derivative and get the first- and second-order convergence in time. The finite element method is used to discretize the Laplace operator with the optimal convergence rates. Compared with the previous works for the backward fractional Feynman-Kac equation, the main advantage of the current discretization is that we don't need the assumption on the regularity of the solution in temporal and spatial directions. Moreover, the error estimates of the time semi-discrete schemes and the fully discrete schemes are also provided. Finally, we perform the numerical experiments to verify the effectiveness of the presented algorithms.


title: Fast Transformer Decoding: One Write-Head is All You Need

abstract: Multi-head attention layers, as used in the Transformer neural sequence model, are a powerful alternative to RNNs for moving information across and between sequences. While training these layers is generally fast and simple, due to parallelizability across the length of the sequence, incremental inference (where such paralleization is impossible) is often slow, due to the memory-bandwidth cost of repeatedly loading the large "keys" and "values" tensors. We propose a variant called multi-query attention, where the keys and values are shared across all of the different attention "heads", greatly reducing the size of these tensors and hence the memory bandwidth requirements of incremental decoding. We verify experimentally that the resulting models can indeed be much faster to decode, and incur only minor quality degradation from the baseline.


title: Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates

abstract: In this work, we improve upon the stepwise analysis of noisy iterative learning algorithms initiated by Pensia, Jog, and Loh (2018) and recently extended by Bu, Zou, and Veeravalli (2019). Our main contributions are significantly improved mutual information bounds for Stochastic Gradient Langevin Dynamics via data-dependent estimates. Our approach is based on the variational characterization of mutual information and the use of data-dependent priors that forecast the mini-batch gradient based on a subset of the training samples. Our approach is broadly applicable within the information-theoretic framework of Russo and Zou (2015) and Xu and Raginsky (2017). Our bound can be tied to a measure of flatness of the empirical risk surface. As compared with other bounds that depend on the squared norms of gradients, empirical investigations show that the terms in our bounds are orders of magnitude smaller.


title: Sequences of three dimensional manifolds with positive scalar curvature

abstract: We develop two new methods of constructing sequences of manifolds with positive scalar curvature that converge in the Gromov-Hausdorff and Intrinsic Flat sense to limit spaces with "pulled regions". The examples created rigorously within using these methods were announced by us a few years ago and have influenced the statements of some of Gromov's conjectures concerning sequences of manifolds with positive scalar curvature. Both methods extend the notion of "sewing along a curve" developed in prior work of the authors with Dodziuk to create limits that are pulled string spaces. The first method allows us to sew any compact set in a fixed initial manifold to create a limit space in which that compact set has been scrunched to a single point. The second method allows us to edit a sequence of regions or curves in a sequence of distinct manifolds.


title: Are highly connected 1-planar graphs Hamiltonian?

abstract: It is well-known that every planar 4-connected graph has a Hamiltonian cycle. In this paper, we study the question whether every 1-planar 4-connected graph has a Hamiltonian cycle. We show that this is false in general, even for 5-connected graphs, but true if the graph has a 1-planar drawing where every region is a triangle.


title: ESA Voyage 2050 white paper -- GrailQuest: hunting for Atoms of Space and Time hidden in the wrinkle of Space-Time

abstract: GrailQuest (Gamma Ray Astronomy International Laboratory for QUantum Exploration of Space-Time) is a mission concept based on a constellation (hundreds/thousands) of nano/micro/small-satellites in low (or near) Earth orbits. Each satellite hosts a non-collimated array of scintillator crystals coupled with Silicon Drift Detectors with broad energy band coverage (keV-MeV range) and excellent temporal resolution ( below or equal 100 nanoseconds) each with effective area around 100 cm2. This simple and robust design allows for mass-production of the satellites of the fleet. This revolutionary approach implies a huge reduction of costs, flexibility in the segmented launching strategy, and an incremental long-term plan to increase the number of detectors and their performance: a living observatory for next-generation, space-based astronomical facilities. GrailQuest is conceived as an all-sky monitor for fast localisation of high signal-to-noise ratio transients in the X/gamma-ray band, e.g. the elusive electromagnetic counterparts of gravitational wave events. Robust temporal triangulation techniques will allow unprecedented localisation capabilities, in the keV-MeV band, of a few arcseconds or below, depending on the temporal structure of the transient event. The ambitious ultimate goal of this mission is to perform the first experiment, in quantum gravity, to directly probe space-time structure down to the minuscule Planck scale, by constraining or measuring a first order dispersion relation for light in vacuo. This is obtained by detecting delays between photons of different energies in the prompt emission of Gamma-ray Bursts.

categories: astro-ph.IM astro-ph.HE gr-qc hep-ex physics.space-ph


title: Spatially regularized active diffusion learning for high-dimensional images

abstract: An active learning algorithm for the classification of high-dimensional images is proposed in which spatially-regularized nonlinear diffusion geometry is used to characterize cluster cores. The proposed method samples from estimated cluster cores in order to generate a small but potent set of training labels which propagate to the remainder of the dataset via the underlying diffusion process. By spatially regularizing the rich, high-dimensional spectral information of the image to efficiently estimate the most significant and influential points in the data, our approach avoids redundancy in the training dataset. This allows it to produce high-accuracy labelings with a very small number of training labels. The proposed algorithm admits an efficient numerical implementation that scales essentially linearly in the number of data points under a suitable data model and enjoys state-of-the-art performance on real hyperspectral images.


title: Safe Linear Thompson Sampling with Side Information

abstract: The design and performance analysis of bandit algorithms in the presence of stage-wise safety or reliability constraints has recently garnered significant interest. In this work, we consider the linear stochastic bandit problem under additional \textit{linear safety constraints} that need to be satisfied at each round. We provide a new safe algorithm based on linear Thompson Sampling (TS) for this problem and show a frequentist regret of order $\mathcal{O} (d^{3/2}\log^{1/2}d \cdot T^{1/2}\log^{3/2}T)$, which remarkably matches the results provided by (Abeille et al., 2017) for the standard linear TS algorithm in the absence of safety constraints. We compare the performance of our algorithm with UCB-based safe algorithms and highlight how the inherently randomized nature of TS leads to a superior performance in expanding the set of safe actions the algorithm has access to at each round.


title: Global weak solutions and asymptotics of a singular PDE-ODE chemotaxis system with discontinuous data

abstract: This paper is concerned with the well-posedness and large-time behavior of a two dimensional PDE-ODE hybrid chemotaxis system describing the initiation of tumor angiogenesis. We first transform the system via a Cole-Hopf type transformation into a parabolic-hyperbolic system and show that the solution of the transformed system converges to a constant equilibrium state as time tends to infinity. Finally we reverse the Cole-Hopf transformation and obtain the relevant results for the pre-transformed PDE-ODE hybrid system. In contrast to the existing related results, where continuous initial datum is imposed, we are able to prove the asymptotic stability for discontinuous initial data with large oscillations. The key ingredient in our proof is the use of so-called "effective viscous flux", which enables us to obtain the desired energy estimates and regularity. The technique of "effective viscous flux" turns out to be a very useful tool to study chemotaxis systems with initial data having low regularity and was rarely (if not) used in the literature for chemotaxis models.


title: Channel Estimation for Wireless Communication Systems Assisted by Large Intelligent Surfaces

abstract: In this letter, the channel estimation problem is studied for wireless communication systems assisted by large intelligent surface. Due to features of assistant channel, channel estimation (CE) problem for the investigated system is shown as a constrained estimation error minimization problem, which differs from traditional CE problems. A Lagrange multiplier and dual ascent-based estimation scheme is then designed to obtain a closed-form solution for the estimator iteratively. Moreover, the Cramer-Rao lower bounds are deduced for performance evaluation. Simulation results show that the designed scheme could improve estimation accuracy up to 18%, compared with least square method in low signal-to-noise ratio regime.


title: Hypersonic Similarity for the Two Dimensional Steady Potential Flow with Large Data

abstract: In this paper, we establish the first rigorous mathematical global result on the validation of the hypersonic similarity, which is also called the Mach-number independence principle, for the two dimensional steady potential flow. The hypersonic similarity is equivalent to the Van Dyke's similarity theory, that if the hypersonic similarity parameter $K$ is fixed, the shock solution structures (after scaling) are consistent, when the Mach number of the flow is sufficiently large. One of the difficulty is that after scaling, the solutions are usually of large data since the perturbation of the hypersonic flow is usually not small related to the sonic speed. In order to make it, we first employ the modified Glimm scheme to construct the approximate solutions with large data and find fine structure of the elementary wave curves to obtain the global existence of entropy solutions with large data, for fixed $K$ and sufficiently large Mach number of the incoming flow $M_{\infty}$. Finally, we further show that for a fixed hypersonic similarity parameter $K$, if the Mach number $M_{\infty}\rightarrow\infty$, the solutions obtained above approach to the solution of the corresponding initial-boundary value problem of the hypersonic small-disturbance equations. Therefore, the Van Dyke's similarity theory is first verified rigorously.


title: Shrinkage with shrunken shoulders: Gibbs sampling shrinkage model posteriors with guaranteed convergence rates

abstract: Use of continuous shrinkage priors -- with a "spike" near zero and heavy-tails towards infinity -- is an increasingly popular approach to induce sparsity in parameter estimates. When the parameters are only weakly identified by the likelihood, however, the posterior may end up with tails as heavy as the prior, jeopardizing robustness of inference. A natural solution is to "shrink the shoulders" of a shrinkage prior by lightening up its tails beyond a reasonable parameter range, yielding a regularized version of the prior. We develop a regularization approach which, unlike previous proposals, preserves computationally attractive structures of original shrinkage priors. We study theoretical properties of the Gibbs sampler on resulting posterior distributions, with emphasis on convergence rates of the P{\'o}lya-Gamma Gibbs sampler for sparse logistic regression. Our analysis shows that the proposed regularization leads to geometric ergodicity under a broad range of global-local shrinkage priors. Essentially, the only requirement is for the prior $\pi_{\rm local}$ on the local scale $\lambda$ to satisfy $\pi_{\rm local}(0) < \infty$. If $\pi_{\rm local}(\cdot)$ further satisfies $\lim_{\lambda \to 0} \pi_{\rm local}(\lambda) / \lambda^a < \infty$ for $a > 0$, as in the case of Bayesian bridge priors, we show the sampler to be uniformly ergodic.


title: Exact Partitioning of High-order Models with a Novel Convex Tensor Cone Relaxation

abstract: In this paper we propose an algorithm for exact partitioning of high-order models. We define a general class of $m$-degree Homogeneous Polynomial Models, which subsumes several examples motivated from prior literature. Exact partitioning can be formulated as a tensor optimization problem. We relax this high-order combinatorial problem to a convex conic form problem. To this end, we carefully define the Carath\'eodory symmetric tensor cone, and show its convexity, and the convexity of its dual cone. This allows us to construct a primal-dual certificate to show that the solution of the convex relaxation is correct (equal to the unobserved true group assignment) and to analyze the statistical upper bound of exact partitioning.


title: Observation and Confirmation of Nine Strong Lensing Systems in Dark Energy Survey Year 1 Data

abstract: We describe the observation and confirmation of \nbconfirmtext\ new strong gravitational lenses discovered in Year 1 data from the Dark Energy Survey (DES). We created candidate lists based on a) galaxy group and cluster samples and b) photometrically selected galaxy samples. We selected 46 candidates through visual inspection and then used the Gemini Multi-Object Spectrograph (GMOS) at the Gemini South telescope to acquire spectroscopic follow-up of 21 of these candidates. Through analysis of this spectroscopic follow-up data, we confirmed nine new lensing systems and rejected 2 candidates, but the analysis was inconclusive on 10 candidates. For each of the confirmed systems, we report measured spectroscopic properties, estimated \einsteinradiussub, and estimated enclosed masses. The sources that we targeted have an i-band surface brightness range of iSB ~ 22 - 24 mag arcsec^2 and a spectroscopic redshift range of zspec ~0.8 - 2.6. The lens galaxies have a photometric redshift range of zlens ~ 0.3 - 0.7. The lensing systems range in image-lens separation 2 - 9 arcsec and in enclosed mass 10^12 - 10^13 Msol.


title: SRINet: Learning Strictly Rotation-Invariant Representations for Point Cloud Classification and Segmentation

abstract: Point cloud analysis has drawn broader attentions due to its increasing demands in various fields. Despite the impressive performance has been achieved on several databases, researchers neglect the fact that the orientation of those point cloud data is aligned. Varying the orientation of point cloud may lead to the degradation of performance, restricting the capacity of generalizing to real applications where the prior of orientation is often unknown. In this paper, we propose the point projection feature, which is invariant to the rotation of the input point cloud. A novel architecture is designed to mine features of different levels. We adopt a PointNet-based backbone to extract global feature for point cloud, and the graph aggregation operation to perceive local shape structure. Besides, we introduce an efficient key point descriptor to assign each point with different response and help recognize the overall geometry. Mathematical analyses and experimental results demonstrate that the proposed method can extract strictly rotation-invariant representations for point cloud recognition and segmentation without data augmentation, and outperforms other state-of-the-art methods.


title: Sign-Changing Points of Solutions of Homogeneous Sturm-Liouville Equations with Measure-Valued Coefficients

abstract: In this paper we investigate sign-changing points of nontrivial real-valued solutions of homogeneous Sturm-Liouville differential equations of the form $-d(du/d\alpha)+ud\beta=0$, where $d\alpha$ is a positive Borel measure supported everywhere on $(a,b)$ and $d\beta$ is a locally finite real Borel measure on $(a,b)$. Since solutions for such equations are functions of locally bounded variation, sign-changing points are the natural generalization of zeros. We prove that sign-changing points for each nontrivial real-valued solution are isolated in $(a,b)$. We also prove a Sturm-type separation theorem for two nontrivial linearly independent solutions, and conclude the paper by proving a Sturm-type comparison theorem for two differential equations with distinct potentials.


title: Regularity of the free boundary for the two-phase Bernoulli problem

abstract: We prove a regularity theorem for the free boundary of minimizers of the two-phase Bernoulli problem, completing the analysis started by Alt, Caffarelli and Friedman in the 80s. As a consequence, we also show regularity of minimizers of the multiphase spectral optimization problem for the principal eigenvalue of the Dirichlet Laplacian.


abstract: Many reinforcement learning (RL) tasks have specific properties that can be leveraged to modify existing RL algorithms to adapt to those tasks and further improve performance, and a general class of such properties is the multiple reward channel. In those environments the full reward can be decomposed into sub-rewards obtained from different channels. Existing work on reward decomposition either requires prior knowledge of the environment to decompose the full reward, or decomposes reward without prior knowledge but with degraded performance. In this paper, we propose Distributional Reward Decomposition for Reinforcement Learning (DRDRL), a novel reward decomposition algorithm which captures the multiple reward channel structure under distributional setting. Empirically, our method captures the multi-channel structure and discovers meaningful reward decomposition, without any requirements on prior knowledge. Consequently, our agent achieves better performance than existing methods on environments with multiple reward channels.


title: Long-range orientational order of a random near lattice hard sphere and hard disk process

abstract: We show that a point process of hard spheres exhibits long-range orientational order. This process is designed to be a random perturbation of a three-dimensional lattice that satisfies a specific rigidity property, examples include the FCC and HCP lattices. We also define two-dimensional near-lattice processes by local, geometry dependent hard disk conditions. Earlier results about existence of long-range orientational order carry over and we obtain the existence of infinite-volume measures on two-dimensional point configurations that turn out to follow the orientation of a fixed triangular lattice arbitrary closely.


title: CoKE: Contextualized Knowledge Graph Embedding

abstract: Knowledge graph embedding, which projects symbolic entities and relations into continuous vector spaces, is gaining increasing attention. Previous methods allow a single static embedding for each entity or relation, ignoring their intrinsic contextual nature, i.e., entities and relations may appear in different graph contexts, and accordingly, exhibit different properties. This work presents Contextualized Knowledge Graph Embedding (CoKE), a novel paradigm that takes into account such contextual nature, and learns dynamic, flexible, and fully contextualized entity and relation embeddings. Two types of graph contexts are studied: edges and paths, both formulated as sequences of entities and relations. CoKE takes a sequence as input and uses a Transformer encoder to obtain contextualized representations. These representations are hence naturally adaptive to the input, capturing contextual meanings of entities and relations therein. Evaluation on a wide variety of public benchmarks verifies the superiority of CoKE in link prediction and path query answering. It performs consistently better than, or at least equally well as current state-of-the-art in almost every case, in particular offering an absolute improvement of 21.0% in H@10 on path query answering. Our code is available at \url{https://github.com/PaddlePaddle/Research/tree/master/KG/CoKE}.


title: Periodic, almost periodic and almost automorphic solutions for SPDEs with monotone coefficients

abstract: In this paper, we use the variational approach to investigate recurrent properties of solutions for stochastic partial differential equations, which is in contrast to the previous semigroup framework. Consider stochastic differential equations with monotone coefficients. Firstly, we establish the continuous dependence on initial values and coefficients for solutions. Secondly, we prove the existence of recurrent solutions, which include periodic, almost periodic and almost automorphic solutions. Then we show that these recurrent solutions are globally asymptotically stable in square-mean sense. Finally, for illustration of our results we give two applications, i.e. stochastic reaction diffusion equations and stochastic porous media equations.


title: Multi-Paragraph Reasoning with Knowledge-enhanced Graph Neural Network

abstract: Multi-paragraph reasoning is indispensable for open-domain question answering (OpenQA), which receives less attention in the current OpenQA systems. In this work, we propose a knowledge-enhanced graph neural network (KGNN), which performs reasoning over multiple paragraphs with entities. To explicitly capture the entities' relatedness, KGNN utilizes relational facts in knowledge graph to build the entity graph. The experimental results show that KGNN outperforms in both distractor and full wiki settings than baselines methods on HotpotQA dataset. And our further analysis illustrates KGNN is effective and robust with more retrieved paragraphs.


title: Minimax Nonparametric Two-sample Test under Smoothing

abstract: We consider the problem of comparing probability densities between two groups. A new probabilistic tensor product smoothing spline framework is developed to model the joint density of two variables. Under such a framework, the probability density comparison is equivalent to testing the presence/absence of interactions. We propose a penalized likelihood ratio test for such interaction testing and show that the test statistic is asymptotically chi-square distributed under the null hypothesis. Furthermore, we derive a sharp minimax testing rate based on the Bernstein width for nonparametric two-sample tests and show that our proposed test statistics is minimax optimal. In addition, a data-adaptive tuning criterion is developed to choose the penalty parameter. Simulations and real applications demonstrate that the proposed test outperforms the conventional approaches under various scenarios.


title: Interpretable Self-Attention Temporal Reasoning for Driving Behavior Understanding

abstract: Performing driving behaviors based on causal reasoning is essential to ensure driving safety. In this work, we investigated how state-of-the-art 3D Convolutional Neural Networks (CNNs) perform on classifying driving behaviors based on causal reasoning. We proposed a perturbation-based visual explanation method to inspect the models' performance visually. By examining the video attention saliency, we found that existing models could not precisely capture the causes (e.g., traffic light) of the specific action (e.g., stopping). Therefore, the Temporal Reasoning Block (TRB) was proposed and introduced to the models. With the TRB models, we achieved the accuracy of $\mathbf{86.3\%}$, which outperform the state-of-the-art 3D CNNs from previous works. The attention saliency also demonstrated that TRB helped models focus on the causes more precisely. With both numerical and visual evaluations, we concluded that our proposed TRB models were able to provide accurate driving behavior prediction by learning the causal reasoning of the behaviors.


title: Quantile Factor Models

abstract: Quantile Factor Models (QFM) represent a new class of factor models for high-dimensional panel data. Unlike Approximate Factor Models (AFM), where only location-shifting factors can be extracted, QFM also allow to recover unobserved factors shifting other relevant parts of the distributions of observed variables. A quantile regression approach, labeled Quantile Factor Analysis (QFA), is proposed to consistently estimate all the quantile-dependent factors and loadings. Their asymptotic distribution is then derived using a kernel-smoothed version of the QFA estimators. Two consistent model selection criteria, based on information criteria and rank minimization, are developed to determine the number of factors at each quantile. Moreover, in contrast to the conditions required for the use of Principal Components Analysis in AFM, QFA estimation remains valid even when the idiosyncratic errors have heavy-tailed distributions. Three empirical applications (regarding macroeconomic, climate and finance panel data) provide evidence that extra factors shifting the quantiles other than the means could be relevant in practice.


title: Privacy Preserving Threat Hunting in Smart Home Environments

abstract: The recent proliferation of smart home environments offers new and transformative circumstances for various domains with a commitment to enhancing the quality of life and experience. Most of these environments combine different gadgets offered by multiple stakeholders in a dynamic and decentralized manner, which in turn presents new challenges from the perspective of digital investigation. In addition, a plentiful amount of data records got generated because of the day to day interactions between these gadgets and homeowners, which poses difficulty in managing and analyzing such data. The analysts should endorse new digital investigation approaches to tackle the current limitations in traditional approaches when used in these environments. The digital evidence in such environments can be found inside the records of logfiles that store the historical events occurred inside the smart home. Threat hunting can leverage the collective nature of these gadgets to gain deeper insights into the best way for responding to new threats, which in turn can be valuable in reducing the impact of breaches. Nevertheless, this approach depends mainly on the readiness of smart homeowners to share their own personal usage logs that have been extracted from their smart home environments. However, they might disincline to employ such service due to the sensitive nature of the information logged by their personal gateways. In this paper, we presented an approach to enable smart homeowners to share their usage logs in a privacy preserving manner. A distributed threat hunting approach has been developed to permit the composition of diverse threat classes without revealing the logged records to other involved parties. Furthermore, a scenario was proposed to depict a proactive threat Intelligence sharing for the detection of potential threats in smart home environments with some experimental results.


title: Integrating Markov processes with structural causal modeling enables counterfactual inference in complex systems

abstract: This manuscript contributes a general and practical framework for casting a Markov process model of a system at equilibrium as a structural causal model, and carrying out counterfactual inference. Markov processes mathematically describe the mechanisms in the system, and predict the system's equilibrium behavior upon intervention, but do not support counterfactual inference. In contrast, structural causal models support counterfactual inference, but do not identify the mechanisms. This manuscript leverages the benefits of both approaches. We define the structural causal models in terms of the parameters and the equilibrium dynamics of the Markov process models, and counterfactual inference flows from these settings. The proposed approach alleviates the identifiability drawback of the structural causal models, in that the counterfactual inference is consistent with the counterfactual trajectories simulated from the Markov process model. We showcase the benefits of this framework in case studies of complex biomolecular systems with nonlinear dynamics. We illustrate that, in presence of Markov process model misspecification, counterfactual inference leverages prior data, and therefore estimates the outcome of an intervention more accurately than a direct simulation.


title: Cavity-assisted controlled phase-flip gates

abstract: Cavity-mediated two-qubit gates, for example between solid-state spins, are attractive for quantum network applications. We propose three schemes to implement a controlled phase-flip gate mediated by a cavity. The main advantage of all these schemes is the possibility to perform them using a cavity with high cooperativity, but not in the strong coupling regime. We calculate the fidelity of each scheme in detail, taking into account the most important realistic imperfections, and compare them to highlight the optimal conditions for each scheme. Using these results, we discuss which quantum system characteristics might favor one scheme over another.


title: On the applicability of Kramers-Kronig dispersion relations to guided and surface waves

abstract: In unbounded media, the acoustic attenuation as function of frequency is related to the frequency-dependent sound velocity (dispersion) via Kramers-Kronig dispersion relations. These relations are fundamentally important for better understanding of the nature of attenuation and dispersion and as a tool in physical acoustics measurements, where they can be used for control purposes. However, physical acoustic measurements are frequently carried out not in unbounded media, but in acoustic waveguides, e.g. inside liquid-filled pipes. Surface acoustic waves are also often used for physical acoustics measurements. In the present work, the applicability of Kramers-Kronig relations to guided and surface waves is investigated using the approach based on the theory of functions of complex variables. It is demonstrated that Kramers-Kronig relations have limited applicability to guided and surface waves. In particular, they are not applicable to waves propagating in waveguides characterised by the possibility of wave energy leakage from the waveguides into the surrounding medium. For waveguides without leakages, e.g. those formed by rigid walls, Kramers-Kronig relations remain valid for both ideal and viscous liquids. In the former case, Kramers-Kronig relations express the exponential decay of non-propagating (evanescent) higher-order acoustic modes below the cut-off frequencies via the dispersion of the same modes above the cut-off frequencies. Examples of numerical calculations of wave dispersion and attenuation using Kramers-Kronig relations, where applicable, are presented for unbounded media and for waveguides formed by rigid walls.


title: A Language-based Serverless Function Accelerator

abstract: Serverless computing is an approach to cloud computing that allows programmers to run serverless functions in response to external events. Serverless functions are priced at sub-second granularity, support transparent elasticity, and relieve programmers from managing the operating system. Thus serverless functions allow programmers to focus on writing application code, and the cloud provider to manage computing resources globally. Unfortunately, today's serverless platforms exhibit high latency, because it is difficult to maximize resource utilization while minimizing operating costs. This paper presents serverless function acceleration, which is an approach that transparently lowers the latency and resource utilization of a large class of serverless functions. We accomplish this using language-based sandboxing, whereas existing serverless platforms employ more expensive operating system sandboxing technologies, such as containers and virtual machines. OS-based sandboxing is compatible with more programs than language-based techniques. However, instead of ruling out any programs, we use language-based sandboxing when possible, and OS-based sandboxing if necessary. Moreover, we seamlessly transition between language-based and OS-based sandboxing by leveraging the fact that serverless functions must tolerate re-execution for fault tolerance. Therefore, when a serverless function attempts to perform an unsupported operation in the language-based sandbox, we can safely re-execute it in a container. We use a new approach to trace compilation to build source-level, interprocedural, execution trace trees for serverless functions written in JavaScript. We compile trace trees to a safe subset of Rust, validate the compiler output, and link it to a runtime system. We evaluate these techniques in our implementation, which we call Containerless.


title: Weak cosmic growth in coupled dark energy with a Lagrangian formulation

abstract: We investigate a dark energy scenario in which a canonical scalar field $\phi$ is coupled to the four velocity $u_{c}^{\mu}$ of cold dark matter (CDM) through a derivative interaction $u_{c}^{\mu} \partial_{\mu} \phi$. The coupling is described by an interacting Lagrangian $f(X, Z)$, where $f$ depends on $X=-\partial^{\mu} \phi \partial_{\mu} \phi/2$ and $Z=u_{c}^{\mu} \partial_{\mu} \phi$. We derive stability conditions of linear scalar perturbations for the wavelength deep inside the Hubble radius and show that the effective CDM sound speed is close to 0 as in the standard uncoupled case, while the scalar-field propagation speed is affected by the interacting term $f$. Under a quasi-static approximation, we also obtain a general expression of the effective gravitational coupling felt by the CDM perturbation. We study the late-time cosmological dynamics for the coupling $f \propto X^{(2-m)/2}Z^m$ and show that the gravitational coupling weaker than the Newton constant can be naturally realized for $m>0$ on scales relevant to the growth of large-scale structures. This allows the possibility for alleviating the tension of $\sigma_8$ between low- and high-redshift measurements.


title: Transportation cost inequalities for stochastic reaction-diffusion equations with L\'evy noises and non-Lipschitz reaction terms

abstract: For stochastic reaction-diffusion equations with L\'evy noises and non-Lipschitz reaction terms, we prove that $W_1H$ transportation cost inequalities hold for their invariant probability measures and for their process-level laws on the path space with respect to the $L^1$-metric. The proofs are based on the Galerkin approximations.


title: Monotonicity and phase transition for the VRJP and the ERRW

abstract: The vertex-reinforced jump process (VRJP), introduced by Davis and Volkov, is a continuous-time process that tends to come-back to already visited vertices. It is closely linked to the edge-reinforced random walk (ERRW) introduced by Coppersmith and Diaconis in 1986 which is more likely to cross edges it has already crossed. On $\mathbb{Z}^d$ for $d\geq 3$, both models where shown to be recurrent for small enough initial weights (by Sabot, Tarr\`es(2015) and Angel,Crawford,Kozma(2014)) and transient for large enough initial weights (by Disertori,Sabot,Tarr\`es(2015) and Sabot,Tarr\`es(2015)). We show through a coupling of the VRJP for different weights that the VRJP (and the ERRW) exhibits some monotonicity. In particular, we show that increasing the initial weights of the VRJP and the ERRW makes them more transient which means that the recurrence/transience phase transition is necessarily unique. Furthermore, by making the weights go to infinity, we show that the recurrence of the ERRW and the VRJP is implied by the recurrence of a random walk in deterministic electrical network.


title: Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision

abstract: While there has been much recent progress using deep learning techniques to separate speech and music audio signals, these systems typically require large collections of isolated sources during the training process. When extending audio source separation algorithms to more general domains such as environmental monitoring, it may not be possible to obtain isolated signals for training. Here, we propose objective functions and network architectures that enable training a source separation system with weak labels. In this scenario, weak labels are defined in contrast with strong time-frequency (TF) labels such as those obtained from isolated sources, and refer either to frame-level weak labels where one only has access to the time periods when different sources are active in an audio mixture, or to clip-level weak labels that only indicate the presence or absence of sounds in an entire audio clip. We train a separator that estimates a TF mask for each type of sound event, using a sound event classifier as an assessor of the separator's performance to bridge the gap between the TF-level separation and the ground truth weak labels only available at the frame or clip level. Our objective function requires the classifier applied to a separated source to assign high probability to the class corresponding to that source and low probability to all other classes. The objective function also enforces that the separated sources sum up to the mixture. We benchmark the performance of our algorithm using synthetic mixtures of overlapping events created from a database of sounds recorded in urban environments. Compared to training a network using isolated sources, our model achieves somewhat lower but still significant SI-SDR improvement, even in scenarios with significant sound event overlap.


title: Random walk in random environment and their time-reversed counterpart

abstract: The random walk in Dirichlet environment is a random walk in random environment where the transition probabilities are independent Dirichlet random variables. This random walk exhibits a property of statistical invariance by time-reversal which leads to several results. More precisely, a time-reversed random walk in Dirichlet environment (with null divergence) is also a random walk in random environment where the transition probabilities are independent Dirichlet random variables with different parameters. We show that on all graphs that satisfy a few weak assumptions, a random walk in random environment with independent transition probabilities and such that the transition probabilities of the time-reversed random walk in random environment are also independent is a random walk in Dirichlet environment.


title: Symbol-pair Weight Distributions of Some Linear Codes

abstract: In this paper, we investigate the symbol-pair weight distributions of MDS codes and simplex codes over finite fields. Furthermore, the result shows that all the nonzero codewords of simplex codes have the same symbol $b$-weight and rearrangement entries of codewords in simplex code may induce different symbol-pair weight. In addition, the symbol $b$-weight distributions of variation simplex codes over certain finite fields are derived.


title: Holographic Surface Defects in $D=5$, $N=4$ Gauged Supergravity

abstract: Solutions describing holographic surface defects in $D=5,N=4$ gauged supergravity theories are constructed. It is shown that a surface defect solution in pure Romans' gauged supergravity is singular. Adding a single vector multiplet allows for the construction of a non-singular solution. The on-shell action and one point functions of operators in the presence of the defect are computed using holographic renormalization.


title: Electromagnetic contribution to $\Sigma$-$\Lambda$ mixing using lattice QCD+QED

abstract: Mixing in the $\Sigma^0$-$\Lambda^0$ system is a direct consequence of broken isospin symmetry and is a measure of both isospin-symmetry breaking as well as general SU(3)-flavour symmetry breaking. In this work we present a new scheme for calculating the extent of $\Sigma^0$-$\Lambda^0$ mixing using simulations in lattice QCD+QED and perform several extrapolations that compare well with various past determinations. Our scheme allows us to easily contrast the QCD-only mixing case with the full QCD+QED mixing.


title: The infinitesimal Torelli problem

abstract: Let $g \geq 2$ and let the Torelli map denote the map sending a genus $g$ curve to its principally polarized Jacobian. We verify the well known fact that the map induced on tangent spaces by the Torelli map is dual to the multiplication map $\mathrm{Sym}^2 H^0(C, \omega_C) \rightarrow H^0(C, \omega_C^{\otimes 2})$.


title: Exploiting Aggregate Sparsity in Second Order Cone Relaxations for Quadratic Constrained Quadratic Programming Problems

abstract: Among many approaches to increase the computational efficiency of semidefinite programming (SDP) relaxation for quadratic constrained quadratic programming problems (QCQPs), exploiting the aggregate sparsity of the data matrices in the SDP by Fukuda et al. (2001) and second-order cone programming (SOCP) relaxation have been popular. In this paper, we exploit the aggregate sparsity of SOCP relaxation of QCQPs. Specifically, we prove that exploiting the aggregate sparsity reduces the number of second-order cones in the SOCP relaxation, and that we can simplify the matrix completion procedure by Fukuda et al. in both primal and dual of the SOCP relaxation problem without losing the max-determinant property. For numerical experiments, QCQPs from the lattice graph and pooling problem are tested as their SOCP relaxations provide the same optimal value as the SDP relaxations. We demonstrate that exploiting the aggregate sparsity improves the computational efficiency of the SOCP relaxation for the same objective value as the SDP relaxation, thus much larger problems can be handled by the proposed SOCP relaxation than the SDP relaxation.


title: Critical Phenomena of Dynamical Delocalization in Quantum Maps:standard map and Anderson map

abstract: Following the paper exploring the Anderson localization of monochromatically perturbed kicked quantum maps [Phys.Rev. E{\bf 97},012210], the delocalization-localization transition phenomena in polychromatically perturbed quantum maps (QM) is investigated focusing particularly on the dependency of critical phenomena upon the number $M$ of the harmonic perturbations, where $M+1=d$ corresponds to the spatial dimension of the ordinary disordered lattice. The standard map and the Anderson map are treated and compared. As the basis of analysis, we apply the self-consistent theory (SCT) of the localization, taking a plausible hypothesis on the mean-free-path parameter which worked successfully in the analyses of the monochromatically perturbed QMs. We compare in detail the numerical results with the predictions of the SCT, by largely increasing $M$. The numerically obtained index of critical subdiffusion $t^\alpha$~($t$:time) agrees well with the prediction of one-parameter scaling theory $\alpha=2/(M+1)$, but the numerically obtained critical exponent of localization length significantly deviates from the SCT prediction. Deviation from the SCT prediction is drastic for the critical perturbation strength of the transition: if $M$ is fixed the SCT presents plausible prediction for the parameter dependence of the critical value, but its value is $1/(M-1)$times smaller than the SCT prediction, which implies existence of a strong cooperativity of the harmonic perturbations with the main mode.


title: Black hole shadow in the view of freely falling observers

abstract: First sketch of black hole from M87 galaxy was obtained by Event Horizon Telescope, recently. As appearance of black hole shadow reflects space-time geometry of black holes, observations of black hole shadow may be a promising way to test general relativity in strong field regime. In this paper, we focus on angular radius of spherical black hole shadow with respect to freely falling observers. In the framework of general relativity, aberration formulation and angular radius-gravitational redshift relation are presented. For the sake of intuitive, we consider parametrized Schwarzschild black hole and Schwarzschild-de Sitter black hole as representative examples. We find that the freely in-falling observers would observe finite size of shadow, when they go through inner horizon. For observers freely falling from the outer horizon of Schwarzschild-de Sitter black hole, we find that the angular radius of the shadows could increase even when the observers move farther from the black hole.


title: Experience Sharing Between Cooperative Reinforcement Learning Agents

abstract: The idea of experience sharing between cooperative agents naturally emerges from our understanding of how humans learn. Our evolution as a species is tightly linked to the ability to exchange learned knowledge with one another. It follows that experience sharing (ES) between autonomous and independent agents could become the key to accelerate learning in cooperative multiagent settings. We investigate if randomly selecting experiences to share can increase the performance of deep reinforcement learning agents, and propose three new methods for selecting experiences to accelerate the learning process. Firstly, we introduce Focused ES, which prioritizes unexplored regions of the state space. Secondly, we present Prioritized ES, in which temporal-difference error is used as a measure of priority. Finally, we devise Focused Prioritized ES, which combines both previous approaches. The methods are empirically validated in a control problem. While sharing randomly selected experiences between two Deep Q-Network agents shows no improvement over a single agent baseline, we show that the proposed ES methods can successfully outperform the baseline. In particular, the Focused ES accelerates learning by a factor of 2, reducing by 51% the number of episodes required to complete the task.


title: Optimal Design of Experiments on Riemannian Manifolds

abstract: The theory of optimal design of experiments has been traditionally developed on an Euclidean space. In this paper, new theoretical results and an algorithm for finding the optimal design of an experiment located on a Riemannian manifold are provided. It is shown that analogously to the results in Euclidean spaces, D-optimal and G-optimal designs are equivalent on manifolds, and we provide a lower bound for the maximum prediction variance of the response evaluated over the manifold. In addition, a converging algorithm that finds the optimal experimental design on manifold data is proposed. Numerical experiments demonstrate the importance of considering the manifold structure in a designed experiment when present, and the superiority of the proposed algorithm.


title: Stationary Ring and Concentric-Ring Solutions of the Keller-Segel Model with Quadratic Diffusion

abstract: This paper investigates the Keller-Segel model with quadratic cellular diffusion over a disk in $\mathbb R^2$ with a focus on the formation of its nontrivial patterns. We obtain explicit formulas of radially symmetric stationary solutions and such configurations give rise to the ring patterns and concentric airy patterns. These explicit formulas empower us to study the global bifurcation and asymptotic behaviors of these solutions, within which the cell population density has $\delta$-type spiky structures when the chemotaxis rate is large. The explicit formulas are also used to study the uniqueness and quantitative properties of nontrivial stationary radial patterns ruled by several threshold phenomena determined by the chemotaxis rate. We find that all nonconstant radial stationary solutions must have the cellular density compactly supported unless for a discrete sequence of bifurcation values at which there exist strictly positive small-amplitude solutions. The hierarchy of free energy shows that in the radial class the inner ring solution has the least energy while the constant solution has the largest energy, and all these theoretical results are illustrated through bifurcation diagrams. A natural extension of our results to $\mathbb R^2$ yields the existence, uniqueness and closed-form solution of the problem in this whole space. Our results are complemented by numerical simulations that demonstrate the existence of non-radial stationary solutions in the disk.


title: A Rational Finance Explanation of the Stock Predictability Puzzle

abstract: In this paper, we address one of the main puzzles in finance observed in the stock market by proponents of behavioral finance: the stock predictability puzzle. We offer a statistical model within the context of rational finance which can be used without relying on behavioral finance assumptions to model the predictability of stock returns. We incorporate the predictability of stock returns into the well-known Black-Scholes option pricing formula. Empirically, we analyze the option and spot trader's market predictability of stock prices by defining a forward-looking measure which we call "implied excess predictability". The empirical results indicate the effect of option trader's predictability of stock returns on the price of stock options is an increasing function of moneyness, while this effect is decreasing for spot traders. These empirical results indicate potential asymmetric predictability of stock prices by spot and option traders. We show in pricing options with the strike price significantly higher or lower than the stock price, the predictability of the underlying stock's return should be incorporated into the option pricing formula. In pricing options that have moneyness close to one, stock return predictability is not incorporated into the option pricing model because stock return predictability is the same for both types of traders. In other words, spot traders and option traders are equally informed about the future value of the stock market in this case. Comparing different volatility measures, we find that the difference between implied and realized variances or variance risk premium can potentially be used as a stock return predictor.


title: FPFS Shear Estimator: Systematic Tests on the Hyper Suprime-Cam Survey First Year Data

abstract: We apply the Fourier Power Function Shapelets (FPFS) shear estimator to the first year data of the Hyper Suprime-Cam survey to construct a shape catalog. The FPFS shear estimator has been demonstrated to have multiplicative bias less than $1\%$ in the absence of blending, regardless of complexities of galaxy shapes, smears of point spread functions (PSFs) and contamination from noise. The blending bias is calibrated with realistic image simulations, which include the impact of neighboring objects, using the COSMOS Hubble Space Telescope images. Here we carefully test the influence of PSF model residual on the FPFS shear estimation and the uncertainties in the shear calibration. Internal null tests are conducted to characterize potential systematics in the FPFS shape catalog and the results are compared with those measured using a catalog where the shapes were estimated using the re-Gaussianization algorithms. Furthermore, we compare various weak lensing measurements between the FPFS shape catalog and the re-Gaussianization shape catalog and conclude that the weak lensing measurements between these two shape catalogs are consistent with each other within the statistical uncertainty.


title: On determining when small embeddings of partial Steiner triple systems exist

abstract: A partial Steiner triple system of order $u$ is a pair $(U,\mathcal{A})$ where $U$ is a set of $u$ elements and $\mathcal{A}$ is a set of triples of elements of $U$ such that any two elements of $U$ occur together in at most one triple. If each pair of elements occur together in exactly one triple it is a Steiner triple system. An embedding of a partial Steiner triple system $(U,\mathcal{A})$ is a (complete) Steiner triple system $(V,\mathcal{B})$ such that $U \subseteq V$ and $\mathcal{A} \subseteq \mathcal{B}$. For a given partial Steiner triple system of order $u$ it is known that an embedding of order $v \geq 2u+1$ exists whenever $v$ satisfies the obvious necessary conditions. Determining whether "small" embeddings of order $v < 2u+1$ exist is a more difficult task. Here we extend a result of Colbourn on the $\mathsf{NP}$-completeness of these problems. We also exhibit a family of counterexamples to a conjecture concerning when small embeddings exist.


title: A Comparison of Methods of Inference in Randomized Experiments from a Restricted Set of Allocations

abstract: Rerandomization is a strategy of increasing efficiency as compared to complete randomization. The idea with rerandomization is that of removing allocations with imbalance in the observed covariates and then randomizing within the set of allocations with balance in these covariates. Standard asymptotic inference based on mean difference estimator is however conservative after rerandomization. Given a Mahalanobis distance criterion for removing imbalanced allocations, Li et al. (2018) derived the asymptotic distribution of the mean difference estimator and suggested a consistent estimator of its variance. This paper discusses several alternative methods of inference under rerandomization, and compare their performance with that of the method in Li et al. (2018) through a large Monte Carlo simulation. We conclude that some of the methods work better for small or moderate sample sized experiments than the method in Li et al. (2018).


title: An improved binary programming formulation for the secure domination problem

abstract: The secure domination problem, a variation of the domination problem with some important real-world applications, is considered. Very few algorithmic attempts to solve this problem have been presented in literature, and the most successful to date is a binary programming formulation which is solved using CPLEX. A new binary programming formulation is proposed here which requires fewer constraints and fewer binary variables than the existing formulation. It is implemented in CPLEX, and tested on certain families of graphs that have previously been considered in the context of secure domination. It is shown that the runtime required for the new formulation to solve the instances is significantly less than that of the existing formulation. An extension of our formulation that solves the related, but further constrained, secure connected domination problem is also given; to the best of the authors' knowledge, this is the first such formulation in literature.