title: Educational Question Mining At Scale: Prediction, Analysis and Personalization

abstract: Online education platforms enable teachers to share a large number of educational resources such as questions to form exercises and quizzes for students. With large volumes of available questions, it is important to have an automated way to quantify their properties and intelligently select them for students, enabling effective and personalized learning experiences. In this work, we propose a framework for mining insights from educational questions at scale. We utilize the state-of-the-art Bayesian deep learning method, in particular partial variational auto-encoders (p-VAE), to analyze real students' answers to a large collection of questions. Based on p-VAE, we propose two novel metrics that quantify question quality and difficulty, respectively, and a personalized strategy to adaptively select questions for students. We apply our proposed framework to a real-world dataset with tens of thousands of questions and tens of millions of answers from an online education platform. Our framework not only demonstrates promising results in terms of statistical metrics but also obtains highly consistent results with domain experts' evaluation.


title: Analytical expression of aperture efficiency affected by Seidel aberrations

abstract: The effect of aberrations on the aperture efficiency has not been discussed analytically, though aberrations determine the performance of a wide field-of-view system. Expansion of a wavefront error and a feed pattern into a series of the Zernike polynomials enables us to calculate the aperture efficiency. We explicitly show the aperture efficiency affected by the Seidel aberrations and derive the conditions for reducing the effects of the spherical aberration and coma. In particular, the condition for coma can reduce a pointing error. We performed Physical Optics simulations and found that, if the Strehl ratio is higher than 0.8, the derived expression provides the aperture efficiencies with a precision of < 2%.


title: LaserFlow: Efficient and Probabilistic Object Detection and Motion Forecasting

abstract: In this work, we present LaserFlow, an efficient method for 3D object detection and motion forecasting from LiDAR. Unlike the previous work, our approach utilizes the native range view representation of the LiDAR, which enables our method to operate at the full range of the sensor in real-time without voxelization or compression of the data. We propose a new multi-sweep fusion architecture, which extracts and merges temporal features directly from the range images. Furthermore, we propose a novel technique for learning a probability distribution over future trajectories inspired by curriculum learning. We evaluate LaserFlow on two autonomous driving datasets and demonstrate competitive results when compared to the existing state-of-the-art methods.


title: A note on 4d N = 3 from little string theory

abstract: We study little string theory (LST) compactified on $\mathbf{T}^2$, partially breaking supersymmetry by a discrete T-duality twist acting on both the K\"ahler and the complex structure of the torus. This setup gives raise to 4d $\mathcal{N}=3$ models and it can be performed in both the type IIA and type IIB LSTs. We comment on the relation with other constructions proposed in the literature.


title: Inaccessible information in probabilistic models of quantum systems, non-contextuality inequalities and noise thresholds for contextuality

abstract: Classical probabilistic models of (noisy) quantum systems are not only relevant for understanding the non-classical features of quantum mechanics, but they are also useful for determining the possible advantage of using quantum resources for information processing tasks. A common feature of these models is the presence of inaccessible information, as captured by the concept of preparation contextuality: There are ensembles of quantum states described by the same density operator, and hence operationally indistinguishable, and yet in any probabilistic (ontological) model, they should be described by distinct probability distributions. In this work, we quantify the inaccessible information of a model in terms of the maximum distinguishability of probability distributions associated to any pair of ensembles with identical density operators, as quantified by the total variation distance of the distributions. We obtain a family of lower bounds on this maximum distinguishability in terms of experimentally measurable quantities. In the case of an ideal qubit this leads to a lower bound of, approximately, 0.07. These bounds can also be interpreted as a new class of robust preparation non-contextuality inequalities. Our non-contextuality inequalities are phrased in terms of generalizations of max-relative entropy and trace distance for general operational theories, which could be of independent interest. Under sufficiently strong noise any quantum system becomes preparation non-contextual, i.e., can be described by models with zero inaccessible information. Using our non-contextuality inequalities, we show that this can happen only if the noise channel has the average gate fidelity less than or equal to 1/D(1+1/2+...+1/D), where D is the dimension of the Hilbert space.

categories: quant-ph math-ph math.MP physics.data-an


title: Asymptotic description of the formation of black holes from short-pulse data

abstract: In this thesis we present partial progress towards the dynamic formation of black holes in the four-dimensional Einstein vacuum equations from Christodoulou's short-pulse ansatz. We identify natural scaling in a putative solution metric and use the technique of real blowup to propose a desingularized manifold and an associated rescaled tangent bundle (which we call the "short-pulse tangent bundle") on which the putative solution remains regular. We prove the existence of a solution solving the vacuum Einstein equations formally at each boundary face of the blown-up manifold and show that for an open set of restricted short-pulse data, the formal solution exhibits curvature blowup at a hypersurface in one of the boundary hypersurfaces of the desingularized manifold. This thesis is intended to be partially expository. In particular, this thesis presents an exposition of double-null gauges and the solution of the characteristic initial value problem for the Einstein equations, as well as an exposition of a new perspective of Christodoulou's monumental result on the dynamic formation of trapped surfaces.


title: Delay Induced Swarm Pattern Bifurcations in Mixed Reality Experiments

abstract: Swarms of coupled mobile agents subject to inter-agent wireless communication delays are known to exhibit multiple dynamic patterns in space that depend on the strength of the interactions and the magnitude of the communication delays. We experimentally demonstrate communication delay-induced bifurcations in the spatio-temporal patterns of robot swarms using two distinct hardware platforms in a mixed reality framework. Additionally, we make steps toward experimentally validating theoretically predicted parameter regions where transitions between swarm patterns occur. We show that multiple rotation patterns persist even when collision-avoidance strategies are incorporated, and we show the existence of multi-stable, co-existing rotational patterns not predicted by usual mean field dynamics. Our experiments are the first significant steps towards validating existing theory and the existence and robustness of the delay-induced patterns in real robotic swarms.


title: {\AE}GIS: Shielding Vulnerable Smart Contracts Against Attacks

abstract: In recent years, smart contracts have suffered major exploits, costing millions of dollars. Unlike traditional programs, smart contracts are deployed on a blockchain. As such, they cannot be modified once deployed. Though various tools have been proposed to detect vulnerable smart contracts, the majority fails to protect vulnerable contracts that have already been deployed on the blockchain. Only very few solutions have been proposed so far to tackle the issue of post-deployment. However, these solutions suffer from low precision and are not generic enough to prevent any type of attack. In this work, we introduce {\AE}GIS, a dynamic analysis tool that protects smart contracts from being exploited during runtime. Its capability of detecting new vulnerabilities can easily be extended through so-called attack patterns. These patterns are written in a domain-specific language that is tailored to the execution model of Ethereum smart contracts. The language enables the description of malicious control and data flows. In addition, we propose a novel mechanism to streamline and speed up the process of managing attack patterns. Patterns are voted upon and stored via a smart contract, thus leveraging the benefits of tamper-resistance and transparency provided by the blockchain. We compare {\AE}GIS to current state-of-the-art tools and demonstrate that our solution achieves higher precision in detecting attacks. Finally, we perform a large-scale analysis on the first 4.5 million blocks of the Ethereum blockchain, thereby confirming the occurrences of well reported and yet unreported attacks in the wild.


title: Analysis of Hyper-Parameters for Small Games: Iterations or Epochs in Self-Play?

abstract: The landmark achievements of AlphaGo Zero have created great research interest into self-play in reinforcement learning. In self-play, Monte Carlo Tree Search is used to train a deep neural network, that is then used in tree searches. Training itself is governed by many hyperparameters.There has been surprisingly little research on design choices for hyper-parameter values and loss-functions, presumably because of the prohibitive computational cost to explore the parameter space. In this paper, we investigate 12 hyper-parameters in an AlphaZero-like self-play algorithm and evaluate how these parameters contribute to training. We use small games, to achieve meaningful exploration with moderate computational effort. The experimental results show that training is highly sensitive to hyper-parameter choices. Through multi-objective analysis we identify 4 important hyper-parameters to further assess. To start, we find surprising results where too much training can sometimes lead to lower performance. Our main result is that the number of self-play iterations subsumes MCTS-search simulations, game-episodes, and training epochs. The intuition is that these three increase together as self-play iterations increase, and that increasing them individually is sub-optimal. A consequence of our experiments is a direct recommendation for setting hyper-parameter values in self-play: the overarching outer-loop of self-play iterations should be maximized, in favor of the three inner-loop hyper-parameters, which should be set at lower values. A secondary result of our experiments concerns the choice of optimization goals, for which we also provide recommendations.


title: A Multi-criteria Approach for Fast and Outlier-aware Representative Selection from Manifolds

abstract: The problem of representative selection amounts to sampling few informative exemplars from large datasets. This paper presents MOSAIC, a novel representative selection approach from high-dimensional data that may exhibit non-linear structures. Resting upon a novel quadratic formulation, Our method advances a multi-criteria selection approach that maximizes the global representation power of the sampled subset, ensures diversity, and rejects disruptive information by effectively detecting outliers. Through theoretical analyses we characterize the obtained sketch and reveal that the sampled representatives maximize a well-defined notion of data coverage in a transformed space. In addition, we present a highly scalable randomized implementation of the proposed algorithm shown to bring about substantial speedups. MOSAIC's superiority in achieving the desired characteristics of a representative subset all at once while exhibiting remarkable robustness to various outlier types is demonstrated via extensive experiments conducted on both real and synthetic data with comparisons to state-of-the-art algorithms.


title: Estimating Basis Functions in Massive Fields under the Spatial Mixed Effects Model

abstract: Spatial prediction is commonly achieved under the assumption of a Gaussian random field (GRF) by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets, fixed rank kriging using the Expectation-Maximization (EM) algorithm for estimation has been proposed as an alternative to the usual but computationally prohibitive kriging method. The method reduces computation cost of estimation by redefining the spatial process as a linear combination of basis functions and spatial random effects. A disadvantage of this method is that it imposes constraints on the relationship between the observed locations and the knots. We develop an alternative method that utilizes the Spatial Mixed Effects (SME) model, but allows for additional flexibility by estimating the range of the spatial dependence between the observations and the knots via an Alternating Expectation Conditional Maximization (AECM) algorithm. Experiments show that our methodology improves estimation without sacrificing prediction accuracy while also minimizing the additional computational burden of extra parameter estimation. The methodology is applied to a temperature data set archived by the United States National Climate Data Center, with improved results over previous methodology.


title: Autoencoders

abstract: An autoencoder is a specific type of a neural network, which is mainly designed to encode the input into a compressed and meaningful representation, and then decode it back such that the reconstructed input is similar as possible to the original one. This chapter surveys the different types of autoencoders that are mainly used today. It also describes various applications and use-cases of autoencoders.


title: Comments on `Design and Implementation of Model-Predictive Control With Friction Compensation on an Omnidirectional Mobile Robot'

abstract: There are errors in the dynamics model in \cite{b1}. In addition, some details of the derivations and assumptions are missing in the paper. This letter was submitted to the IEEE Transactions on Mechatronics and although reviewers acknowledged the merits of the paper, but was not finally approved to be published and suggested to be submitted as a conference paper. I still think this work is worth disseminating and it is potentially very useful for students or practitioners. In this letter, (i) the assumptions made are presented and the governing dynamics with details are derived, and (ii) the correct equations followed by the correct component of the state-space model ($\boldsymbol{A}$) are given.


title: Analyzing Visual Representations in Embodied Navigation Tasks

abstract: Recent advances in deep reinforcement learning require a large amount of training data and generally result in representations that are often over specialized to the target task. In this work, we present a methodology to study the underlying potential causes for this specialization. We use the recently proposed projection weighted Canonical Correlation Analysis (PWCCA) to measure the similarity of visual representations learned in the same environment by performing different tasks. We then leverage our proposed methodology to examine the task dependence of visual representations learned on related but distinct embodied navigation tasks. Surprisingly, we find that slight differences in task have no measurable effect on the visual representation for both SqueezeNet and ResNet architectures. We then empirically demonstrate that visual representations learned on one task can be effectively transferred to a different task.


title: Estimation of Failure Probabilities via Local Subset Approximations

abstract: We here consider the subset simulation method which approaches a failure event using a decreasing sequence of nested intermediate failure events. The method resembles importance sampling, which actively explores a probability space by conditioning the next evaluation on the previous evaluations using a Markov chain Monte Carlo (MCMC) algorithm. A Markov chain typically requires many steps to estimate the target distribution, which is impractical with expensive numerical models. Therefore, we propose to approximate each step of a Markov chain locally with Gaussian process (GP) regression. Benchmark examples of reliability analysis show that local approximations significantly improve overall efficiency of subset simulation. They reduce the number of expensive limit-state evaluations by over $80\%$. However, GP regression becomes computationally impractical with increasing dimension. Therefore, to make our use of a GP feasible, we employ the partial least squares (PLS) regression, a gradient-free reduction method, locally to explore and utilize a low-dimensional subspace within a Markov chain. Numerical experiments illustrate a significant computational gain with maintained sufficient accuracy.


title: CRWIZ: A Framework for Crowdsourcing Real-Time Wizard-of-Oz Dialogues

abstract: Large corpora of task-based and open-domain conversational dialogues are hugely valuable in the field of data-driven dialogue systems. Crowdsourcing platforms, such as Amazon Mechanical Turk, have been an effective method for collecting such large amounts of data. However, difficulties arise when task-based dialogues require expert domain knowledge or rapid access to domain-relevant information, such as databases for tourism. This will become even more prevalent as dialogue systems become increasingly ambitious, expanding into tasks with high levels of complexity that require collaboration and forward planning, such as in our domain of emergency response. In this paper, we propose CRWIZ: a framework for collecting real-time Wizard of Oz dialogues through crowdsourcing for collaborative, complex tasks. This framework uses semi-guided dialogue to avoid interactions that breach procedures and processes only known to experts, while enabling the capture of a wide variety of interactions. The framework is available at https://github.com/JChiyah/crwiz


title: Meta-Learning GNN Initializations for Low-Resource Molecular Property Prediction

abstract: Building in silico models to predict chemical properties and activities is a crucial step in drug discovery. However, limited labeled data often hinders the application of deep learning in this setting. Meanwhile advances in meta-learning have enabled state-of-the-art performances in few-shot learning benchmarks, naturally prompting the question: Can meta-learning improve deep learning performance in low-resource drug discovery projects? In this work, we assess the transferability of graph neural networks initializations learned by the Model-Agnostic Meta-Learning (MAML) algorithm - and its variants FO-MAML and ANIL - for chemical properties and activities tasks. Using the ChEMBL20 dataset to emulate low-resource settings, our benchmark shows that meta-initializations perform comparably to or outperform multi-task pre-training baselines on 16 out of 20 in-distribution tasks and on all out-of-distribution tasks, providing an average improvement in AUPRC of 11.2% and 26.9% respectively. Finally, we observe that meta-initializations consistently result in the best performing models across fine-tuning sets with $k \in \{16, 32, 64, 128, 256\}$ instances.


title: Efficient Content-Based Sparse Attention with Routing Transformers

abstract: Self-attention has recently been adopted for a wide range of sequence modeling problems. Despite its effectiveness, self-attention suffers from quadratic compute and memory requirements with respect to sequence length. Successful approaches to reduce this complexity focused on attending to local sliding windows or a small set of locations independent of content. Our work proposes to learn dynamic sparse attention patterns that avoid allocating computation and memory to attend to content unrelated to the query of interest. This work builds upon two lines of research: it combines the modeling flexibility of prior work on content-based sparse attention with the efficiency gains from approaches based on local, temporal sparse attention. Our model, the Routing Transformer, endows self-attention with a sparse routing module based on online k-means while reducing the overall complexity of attention to $O\left(n^{1.5}d\right)$ from $O\left(n^2d\right)$ for sequence length $n$ and hidden dimension $d$. We show that our model outperforms comparable sparse attention models on language modeling on Wikitext-103 (15.8 vs 18.3 perplexity) as well as on image generation on ImageNet-64 (3.43 vs 3.44 bits/dim) while using fewer self-attention layers. Additionally, we set a new state-of-the-art on the newly released PG-19 data-set, obtaining a test perplexity of 33.2 with a 22 layer Routing Transformer model trained on sequences of length 8192.


title: Asymmetric spatial distribution of sub-solar metallicity stars in the Milky Way nuclear star cluster

abstract: We present stellar metallicity measurements of more than 600 late-type stars in the central 10 pc of the Galactic centre. Together with our previously published KMOS data, this data set allows us to investigate, for the first time, spatial variations of the nuclear star cluster's metallicity distribution. Using the integral-field spectrograph KMOS (VLT) we observed almost half of the area enclosed by the nuclear star cluster's effective radius. We extract spectra at medium spectral resolution, and apply full spectral fitting utilising the PHOENIX library of synthetic stellar spectra. The stellar metallicities range from [M/H]=-1.25 dex to [M/H]> +0.3 dex, with most of the stars having super-solar metallicity. We are able to measure an anisotropy of the stellar metallicity distribution. In the Galactic North, the portion of sub-solar metallicity stars with [M/H]<0.0 dex is more than twice as high as in the Galactic South. One possible explanation for different fractions of sub-solar metallicity stars in different parts of the cluster is a recent merger event. We propose to test this hypothesis with high-resolution spectroscopy, and by combining the metallicity information with kinematic data.


title: Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting

abstract: We study the problem of adaptive control in partially observable linear quadratic Gaussian control systems, where the model dynamics are unknown a priori. We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty, to effectively minimize the overall control cost. We employ the predictor state evolution representation of the system dynamics and deploy a recently proposed closed-loop system identification method, estimation, and confidence bound construction. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model for further exploration and exploitation. We provide stability guarantees for LqgOpt and prove the regret upper bound of $\tilde{\mathcal{O}}(\sqrt{T})$ for adaptive control of linear quadratic Gaussian (LQG) systems, where $T$ is the time horizon of the problem.


title: Human Grasp Classification for Reactive Human-to-Robot Handovers

abstract: Transfer of objects between humans and robots is a critical capability for collaborative robots. Although there has been a recent surge of interest in human-robot handovers, most prior research focus on robot-to-human handovers. Further, work on the equally critical human-to-robot handovers often assumes humans can place the object in the robot's gripper. In this paper, we propose an approach for human-to-robot handovers in which the robot meets the human halfway, by classifying the human's grasp of the object and quickly planning a trajectory accordingly to take the object from the human's hand according to their intent. To do this, we collect a human grasp dataset which covers typical ways of holding objects with various hand shapes and poses, and learn a deep model on this dataset to classify the hand grasps into one of these categories. We present a planning and execution approach that takes the object from the human hand according to the detected grasp and hand position, and replans as necessary when the handover is interrupted. Through a systematic evaluation, we demonstrate that our system results in more fluent handovers versus two baselines. We also present findings from a user study (N = 9) demonstrating the effectiveness and usability of our approach with naive users in different scenarios. More results and videos can be found at http://wyang.me/handovers.


title: Numerical Approximation of Nonlinear SPDE's

abstract: The numerical analysis of stochastic parabolic partial differential equations of the form $$ du + A(u) = f \,dt + g \, dW, $$ is surveyed, where $A$ is a partial operator and $W$ a Brownian motion. This manuscript unifies much of the theory developed over the last decade into a cohesive framework which integrates techniques for the approximation of deterministic partial differential equations with methods for the approximation of stochastic ordinary differential equations. The manuscript is intended to be accessible to audiences versed in either of these disciplines, and examples are presented to illustrate the applicability of the theory.


title: Bayesian Posterior Interval Calibration to Improve the Interpretability of Observational Studies

abstract: Observational healthcare data offer the potential to estimate causal effects of medical products on a large scale. However, the confidence intervals and p-values produced by observational studies only account for random error and fail to account for systematic error. As a consequence, operating characteristics such as confidence interval coverage and Type I error rates often deviate sharply from their nominal values and render interpretation impossible. While there is longstanding awareness of systematic error in observational studies, analytic approaches to empirically account for systematic error are relatively new. Several authors have proposed approaches using negative controls (also known as "falsification hypotheses") and positive controls. The basic idea is to adjust confidence intervals and p-values in light of the bias (if any) detected in the analyses of the negative and positive control. In this work, we propose a Bayesian statistical procedure for posterior interval calibration that uses negative and positive controls. We show that the posterior interval calibration procedure restores nominal characteristics, such as 95% coverage of the true effect size by the 95% posterior interval.


title: Optimal Sensing Precision in Ensemble and Unscented Kalman Filtering

abstract: We consider the problem of selecting an optimal set of sensor precisions to estimate the states of a non-linear dynamical system using an Ensemble Kalman filter and an Unscented Kalman filter, which uses random and deterministic ensembles respectively. Specifically, the goal is to choose at run-time, a sparse set of sensor precisions for active-sensing that satisfies certain constraints on the estimated state covariance. In this paper, we show that this sensor precision selection problem is a semidefinite programming problem when we use l1 norm over precision vector as the surrogate measure to induce sparsity. We formulate a sensor selection scheme over multiple time steps, for certain constraints on the terminal estimated state covariance.


title: On the definition of irreducible holomorphic symplectic manifolds and their singular analogs

abstract: In the definition of irreducible holomorphic symplectic manifolds the condition of being simply connected can be replaced by vanishing irregularity. We discuss finite quotients X of complex tori where the space of reflexive 2-forms is generated by a holomorphic symplectic form, and their Lagrangian fibrations. Neither X nor the base can be smooth unless X is a 2-torus.


title: Model Agnostic Multilevel Explanations

abstract: In recent years, post-hoc local instance-level and global dataset-level explainability of black-box models has received a lot of attention. Much less attention has been given to obtaining insights at intermediate or group levels, which is a need outlined in recent works that study the challenges in realizing the guidelines in the General Data Protection Regulation (GDPR). In this paper, we propose a meta-method that, given a typical local explainability method, can build a multilevel explanation tree. The leaves of this tree correspond to the local explanations, the root corresponds to the global explanation, and intermediate levels correspond to explanations for groups of data points that it automatically clusters. The method can also leverage side information, where users can specify points for which they may want the explanations to be similar. We argue that such a multilevel structure can also be an effective form of communication, where one could obtain few explanations that characterize the entire dataset by considering an appropriate level in our explanation tree. Explanations for novel test points can be cost-efficiently obtained by associating them with the closest training points. When the local explainability technique is generalized additive (viz. LIME, GAMs), we develop a fast approximate algorithm for building the multilevel tree and study its convergence behavior. We validate the effectiveness of the proposed technique based on two human studies -- one with experts and the other with non-expert users -- on real world datasets, and show that we produce high fidelity sparse explanations on several other public datasets.


title: A mismatch between self-efficacy and performance: Undergraduate women in engineering tend to have lower self-efficacy despite earning higher grades than men

abstract: There is a significant underrepresentation of women in many Science, Technology, Engineering, and Mathematics (STEM) majors and careers. Prior research has shown that self-efficacy can be a critical factor in student learning, and that there is a tendency for women to have lower self-efficacy than men in STEM disciplines. This study investigates gender differences in the relationship between engineering students' self-efficacy and course grades in foundational courses. By focusing on engineering students, we examined these gender differences simultaneously in four STEM disciplines (mathematics, engineering, physics, and chemistry) among the same population. Using survey data collected longitudinally at three time points and course grade data from five cohorts of engineering students at a large US-based research university, effect sizes of gender differences are calculated using Cohen's d on two measures: responses to survey items on discipline-specific self-efficacy and course grades in all first-year foundational courses and second-year mathematics courses. In engineering, physics, and mathematics courses, we find sizeable discrepancies between self-efficacy and performance, with men appearing significantly more confident than women despite small or reverse direction differences in grades. In chemistry, women earn higher grades and have higher self-efficacy. The patterns are consistent across courses within each discipline. All self-efficacy gender differences close by the fourth year except physics self-efficacy. The disconnect between self-efficacy and course grades across subjects provides useful clues for targeted interventions to promote equitable learning environments. The most extreme disconnect occurs in physics and may help explain the severe underrepresentation of women in "physics-heavy" engineering disciplines, highlighting the importance of such interventions.


title: A Fault-Tolerance Shim for Serverless Computing

abstract: Serverless computing has grown in popularity in recent years, with an increasing number of applications being built on Functions-as-a-Service (FaaS) platforms. By default, FaaS platforms support retry-based fault tolerance, but this is insufficient for programs that modify shared state, as they can unwittingly persist partial sets of updates in case of failures. To address this challenge, we would like atomic visibility of the updates made by a FaaS application. In this paper, we present AFT, an atomic fault tolerance shim for serverless applications. AFT interposes between a commodity FaaS platform and storage engine and ensures atomic visibility of updates by enforcing the read atomic isolation guarantee. AFT supports new protocols to guarantee read atomic isolation in the serverless setting. We demonstrate that aft introduces minimal overhead relative to existing storage engines and scales smoothly to thousands of requests per second, while preventing a significant number of consistency anomalies.


title: The helicity uniqueness conjecture in 3D hydrodynamics

abstract: We prove that the helicity is the only regular Casimir function for the coadjoint action of the volume-preserving diffeomorphism group $\text{SDiff}(M)$ on smooth exact divergence-free vector fields on a closed three-dimensional manifold $M$. More precisely, any regular $C^1$ functional defined on the space of $C^\infty$ (more generally, $C^k$, $k\ge 4$) exact divergence-free vector fields and invariant under arbitrary volume-preserving diffeomorphisms can be expressed as a $C^1$ function of the helicity. This gives a complete description of Casimirs for adjoint and coadjoint actions of $\text{SDiff}(M)$ in 3D and completes the proof of Arnold-Khesin's 1998 conjecture for a manifold $M$ with trivial first homology group. Our proofs make use of different tools from the theory of dynamical systems, including normal forms for divergence-free vector fields, the Poincar\'e-Birkhoff theorem, and a division lemma for vector fields with hyperbolic zeros.


title: Isochronous Architecture-Based Voltage-Active Power Droop for Multi-Inverter Systems

abstract: Advanced microgrids consisting of distributed energy resources interfaced with multi-inverter systems are becoming more common. Consequently, the effectiveness of voltage and frequency regulation in microgrids using conventional droop-based methodologies is challenged by uncertainty in the sizeand schedule of loads. This article proposes an isochronous architecture of parallel inverters with only voltage-active power droop (VP-D) control for improving active power sharing as well as plug-and-play of multi-inverter based distributed energyresources (DERs). In spite of not employing explicit control for frequency regulation, this architecture allows even sharing of reactive power while maintaining reduced circulating currents between inverters. The performance is achieved even when there are mismatches between commanded reference and power demanded from the actual load in the network. The isochronous architecture is implemented by employing a global positioning system (GPS) to disseminate timing signals that enable the microgrid to maintain nominal system frequency in the entire network. This enables direct control of active power through voltage source inverter (VSI) output voltage regulation, even in the presence of system disturbances. A small signal eigenvalue analysis of a multi-inverter system near the steady-state operating point is presented to evaluate the stability of the multi-inverter system with the proposed VP-D control. Simulation studies and hardware experiments on an 1.2 kVA prototype are conducted. The effectiveness of the proposed architecture towards active and reactive power sharing between inverters with load scenarios are demonstrated. Results of the hardware experiments corroborate the viability of the proposed VP-D control architecture.


title: Mathematical treatment of PDE model describing chemotactic E. coli colonies

abstract: We consider an initial-boundary value problem describing the formation of colony patterns of bacteria Escherichia coli. This model consists of reaction-diffusion equations coupled with the Keller-Segel system from the chemotaxis theory in a bounded domain, supplemented with zero-flux boundary conditions and with non-negative initial data. We answer questions on the global in time existence of solutions as well as on their large time behaviour. Moreover, we show that solutions of a related model may blow up in a finite time.


title: Performance limits of adaptive-optics/high-contrast imagers with pyramid wave-front sensors

abstract: Advanced AO systems will likely utilise Pyramid wave-front sensors (PWFS) over the traditional Shack-Hartmann sensor in the quest for increased sensitivity, peak performance and ultimate contrast. Here, we wish to bring knowledge and quantify the PWFS theoretical limits as a means to highlight its properties and use cases. We explore forward models for the PWFS in the spatial-frequency domain for they prove quite useful since a) they emanate directly from physical-optics (Fourier) diffraction theory; b) provide a straightforward path to meaningful error breakdowns, c) allow for reconstruction algorithms with $O (n\,log(n))$ complexity for large-scale systems and d) tie in seamlessly with decoupled (distributed) optimal predictive dynamic control for performance and contrast optimisation. All these aspects are dealt with here. We focus on recent analytical PWFS developments and demonstrate the performance using both analytic and end-to-end simulations. We anchor our estimates with observed on-sky contrast on existing systems and then show very good agreement between analytical and Monte-Carlo estimates for the PWFS. For a potential upgrade of existing high-contrast imagers on 10\,m-class telescopes with visible or near-infrared PWFS, we show under median conditions at Paranal a contrast improvement (limited by chromatic and scintillation effects) of 2x-5x by replacing the wave-front sensor alone at large separations close to the AO control radius where aliasing dominates, and factors in excess of 10x by coupling distributed control with the PWFS over most of the AO control region, from small separations starting with the Inner Working Angle of typically 1-2 $\lambda/D$ to the AO correction edge (here 20 $\lambda/D$).


title: Multi-Frequency Observations of the Candidate Neutrino Emitting Blazar BZB J0955+3551

abstract: The recent spatial and temporal coincidence of the blazar TXS 0506+056 with the IceCube detected neutrino event IC-170922A has opened up a realm of multi-messenger astronomy with blazar jets as a plausible site of cosmic-ray acceleration. After TXS 0506+056, a second blazar, BZB J0955+3551, has recently been found to be spatially coincident with the IceCube detected neutrino event IC-200107A and undergoing its brightest X-ray flare measured so far. Here, we present the results of our multi-frequency campaign to study this peculiar event that includes observations with the NuSTAR, Swift, NICER, and 10.4 m Gran Telescopio Canarias (GTC). The optical spectroscopic observation from GTC secured its redshift as $z=0.55703^{+0.00033}_{-0.00021}$ and the central black hole mass as 10$^{8.90\pm0.16}~M_{\odot}$. Both NuSTAR and NICER data reveal a rapid flux variability albeit at low-significance ($\lesssim3.5\sigma$). We explore the origin of the target photon field needed for the photo-pion production using analytical calculations and considering the observed optical-to-X-ray flux level. We conclude that seed photons may originate from outside the jet, similar to that reported for TXS 0506+056, although a scenario invoking a co-moving target photon field (e.g., electron-synchrotron) can not be ruled out. The electromagnetic output from the neutrino-producing photo-hadronic processes are likely to make only a sub-dominant contribution to the observed spectral energy distribution suggesting that the X-ray flaring event may not be directly connected with IC-200107A.


title: Calibration-Free Positioning Technique Using Wi-Fi Ranging and Built-in Sensors of Mobile Devices

abstract: As positioning solutions integrate multiple components to improve accuracy, the number of parameters that require calibration has increased. This paper studies a calibration-free positioning technique using Wi-Fi ranging and pedestrian dead reckoning (PDR), where every parameter in the system is optimized in real-time. This significantly decreases the time and effort required to perform manual calibration procedures and enables the positioning solution to achieve robust performance in various situations. Additionally, this paper studies an efficient way of performing irregular Wi-Fi ranging procedures to improve battery life and network performance of mobile devices. The positioning performance of the proposed method was verified using a real-time Android application on several mobile devices under a large indoor office environment. Without any calibration, the proposed method achieved up to 1.38 m average positioning accuracy for received signal strength (RSS)-based ranging scenarios, which differs only by 30 cm from the benchmark assuming perfect calibration. In addition, the proposed method achieved up to 1.04 m accuracy for round trip time (RTT)-based ranging scenarios with a 40 MHz bandwidth configuration, which differs only by 10 cm from the benchmark.


title: The space consisting of uniformly continuous functions on a metric measure space with the $L^p$ norm

abstract: In this paper, we shall show that the space of real-valued uniformly continuous functions on a metric measure space with the $L^p$ norm is homeomorphic to the subspace consisting of sequences conversing to $0$ in the pseudo interior.


title: Accretion-induced prompt black hole formation in asymmetric neutron star mergers, dynamical ejecta and kilonova signals

abstract: We present new numerical relativity results of neutron star mergers with chirp mass $1.188M_\odot$ and mass ratios $q=1.67$ and $q=1.8$ using finite-temperature equations of state (EOS), approximate neutrino transport and a subgrid model for magnetohydrodynamics-induced turbulent viscosity. The EOS are compatible with nuclear and astrophysical constraints and include a new microphysical model derived from ab-initio calculations based on the Brueckner-Hartree-Fock approach. We report for the first time evidence for accretion-induced prompt collapse in high-mass-ratio mergers, in which the tidal disruption of the companion and its accretion onto the primary star determine prompt black hole formation. As a result of the tidal disruption, an accretion disc of neutron-rich and cold matter forms with baryon masses ${\sim}0.15M_\odot$, and it is significantly heavier than the remnant discs in equal-masses prompt collapse mergers. Massive dynamical ejecta of order ${\sim}0.01M_\odot$ also originate from the tidal disruption. They are neutron rich and expand from the orbital plane with a crescent-like geometry. Consequently, bright, red and temporally extended kilonova emission is predicted from these mergers. Our results show that prompt black hole mergers can power bright electromagnetic counterparts for high-mass-ratio binaries, and that the binary mass ratio can be in principle constrained from multimessenger observations.


title: Invariant Causal Prediction for Block MDPs

abstract: Generalization across environments is critical to the successful application of reinforcement learning algorithms to real-world challenges. In this paper, we consider the problem of learning abstractions that generalize in block MDPs, families of environments with a shared latent state space and dynamics structure over that latent space, but varying observations. We leverage tools from causal inference to propose a method of invariant prediction to learn model-irrelevance state abstractions (MISA) that generalize to novel observations in the multi-environment setting. We prove that for certain classes of environments, this approach outputs with high probability a state abstraction corresponding to the causal feature set with respect to the return. We further provide more general bounds on model error and generalization error in the multi-environment setting, in the process showing a connection between causal variable selection and the state abstraction framework for MDPs. We give empirical evidence that our methods work in both linear and nonlinear settings, attaining improved generalization over single- and multi-task baselines.


title: Measurement of Liquid Flow Rate among the Annular Flow in Vertical Tee Junction

abstract: Since the liquid flow rate of the annular flow is closely related to the heat exchange efficiency, it has great significance to measure the liquid flow rate of the annular flow in vertical tee junction. In order to acquire the liquid flow rate of the annular flow in vertical tee junction, a measurement method has been designed, which implements the digital subtraction method to measure the thickness of the liquid film under the visible light and to apply the image feature matching algorithm to obtain the liquid velocity field. Moreover, the accuracy of the liquid film velocity field as well as the spatial and temporal stability of the mass flow rate is tested by proposed algorithms in this study. Experimental results show that the measurement error of our method is approximately 5% in the lower section of the main pipe and the branch pipe, and lower than 15% in the upper section of the main pipe. Therefore, this method has a high accuracy in comparison with other measurement approaches. Our method can be applied to measure and analyse the shape and property of the annular flow in the vertical tee junction.


title: Exploring the Limits of Open Quantum Dynamics I: Motivation, New Results from Toy Models to Applications

abstract: Which quantum states can be reached by controlling open Markovian $n$-level quantum systems? Here, we address reachable sets of coherently controllable quantum systems with switchable coupling to a thermal bath of temperature $T$. The core problem reduces to a toy model of studying points in the standard simplex allowing for two types of controls: (i) permutations within the simplex, (ii) contractions by a dissipative semigroup. By illustration, we put the problem into context and show how toy-model solutions pertain to the reachable set of the original controlled Markovian quantum system. Beyond the case $T=0$ (amplitude damping) we present new results for $0 <T < \infty$ using methods of $d$-majorisation.


title: Disturbing the Peace: Anatomy of the Hostile Takeover of China Vanke Co

abstract: Wang Shi, a business mogul who created his empire of wealth from scratch, relished in his fame and basked in the glory of his affluent business. Nothing lasts forever! After mastering the turbulent business of real estate development in his country and therefore enjoying a rising and robust stock price, China Vanke Co. Ltd ("Vanke") founder and Chairman of the Board of Directors, Wang Shi was suddenly presented with a scathing notice from the Hong Kong Stock Exchange: rival Baoneng Group ("Baoneng") filed the regulatory documentation indicating that it had nicodemously acquired 5% of his company and was looking to buy more. Vanke case became brutal and sparked national controversy over corporate governance and the role of Chinese government in capital markets.


title: Extreme Space Weather Events Recorded in History

abstract: This section shows an overview of a recent development of the studies on great space weather events in history. Its discussion starts from the Carrington event and compare its intensity with the extreme storms within the coverage of the regular magnetic measurements. Extending its analyses back beyond their onset, this section shows several case studies of extreme storms with sunspot records in the telescopic observations and candidate auroral records in historical records. Before the onset of telescopic observations, this section shows the chronological coverages of the records of unaided-eye sunspot and candidate aurorae and several case studies on their basis.


title: Discrete-to-Continuous Extensions: Lov\'asz extension and Morse theory

abstract: This is the first of a series of papers that develop a systematic bridge between constructions in discrete mathematics and the corresponding continuous analogs. In this paper, we establish an equivalence between Forman's discrete Morse theory on a simplicial complex and the continuous Morse theory (in the sense of any known non-smooth Morse theory) on the associated order complex via the Lov\'asz extension. Furthermore, we propose a new version of the Lusternik-Schnirelman category on abstract simplicial complexes to bridge the classical Lusternik-Schnirelman theorem and its discrete analog on finite complexes. More generally, we can suggest a discrete Morse theory on hypergraphs by employing piecewise-linear (PL) Morse theory and Lov\'asz extension, hoping to provide new tools for exploring the structure of hypergraphs.


title: Mathematical Formulae for the Vibration Frequencies of Rubber Wiper on Windshield

abstract: Automotive engineers want to reduce the noise generated by the vibrations of rubber wiper on the windshield of an automobile. To understand the vibrations of wiper noise, certain spring-mass models were presented by some specialists, over the past few years, to simulate the vibrations of rubber wiper on windshield. In this article, we will give precise mathematical formulas for the vibration frequencies of rubber wiper on windshield. Comparison of our model predictions with experimental data confirms the accuracy of our mathematical formulas for the vibration frequencies of wiper on windshield. In fact, our model predictions are in almost perfect agreement with experimental data. These mathematical formulas for the vibration frequencies of rubber wiper on windshield are derived from our analysis of a 3-dimensional elastic model with specific boundary conditions. These specific boundary conditions are set up due to mechanical and mathematical consideration. Our mathematical formulas can be used to test the quality of wiper design.


title: Causal Spillover Effects Using Instrumental Variables

abstract: I set up a potential outcomes framework to analyze spillover effects using instrumental variables. I characterize the population compliance types in a setting in which spillovers can occur on both treatment take-up and outcomes, and provide conditions for identification of the marginal distribution of compliance types. I show that intention-to-treat (ITT) parameters aggregate multiple direct and spillover effects for different compliance types, and hence do not have a clear link to causally interpretable parameters. Moreover, rescaling ITT parameters by first-stage estimands generally recovers a weighted combination of average effects where the sum of weights is larger than one. I then analyze identification of causal direct and spillover effects under one-sided noncompliance, and show that causal effects can be estimated by 2SLS in this case. I illustrate the proposed methods using data from an experiment on social interactions and voting behavior. I also introduce an alternative assumption, independence of peers' types, that identifies parameters of interest under two-sided noncompliance by restricting the amount of heterogeneity in average potential outcomes.


title: Existence and Uniqueness of the Kronecker Covariance MLE

abstract: In matrix-valued datasets the sampled matrices often exhibit correlations among both their rows and their columns. A useful and parsimonious model of such dependence is the matrix normal model, in which the covariances among the elements of a random matrix are parameterized in terms of the Kronecker product of two covariance matrices, one representing row covariances and one representing column covariance. An appealing feature of such a matrix normal model is that the Kronecker covariance structure allows for standard likelihood inference even when only a very small number of data matrices is available. For instance, in some cases a likelihood ratio test of dependence may be performed with a sample size of one. However, more generally the sample size required to ensure boundedness of the matrix normal likelihood or the existence of a unique maximizer depends in a complicated way on the matrix dimensions. This motivates the study of how large a sample size is needed to ensure that maximum likelihood estimators exist, and exist uniquely with probability one. Our main result gives precise sample size thresholds in the paradigm where the number of rows and the number of columns of the data matrices differ by at most a factor of two. Our proof uses invariance properties that allow us to consider data matrices in canonical form, as obtained from the Kronecker canonical form for matrix pencils.


title: On properties of weighted Hardy constant for means

abstract: For a given weighted mean $\mathscr{M}$ defined on a subinterval of $\mathbb{R}_+$ and a sequence of weights $\lambda=(\lambda_n)_{n=1}^\infty$ we define a Hardy constant $\mathscr H(\lambda)$ as the smallest extended real number such that $$ \sum_{n=1}^\infty \lambda_n \mathscr{M}\big((x_1,\dots,x_n),(\lambda_1,\dots,\lambda_n)\big) \le \mathscr H(\lambda) \cdot \sum_{n=1}^\infty \lambda_n x_n \text{ for all }x \in \ell^1(\lambda).$$ The aim of this note is to present a comprehensive study of the mapping $\mathscr H$. For example we prove that it is lower semicontinuous in the pointwise topology. Moreover we show that whenever $\mathscr{M}$ is a monotone and Jensen-concave mean which is continuous in its weights then $\mathscr H$ is monotone with respect to the partitioning of the vector. Finally we deliver some sufficient conditions for $\lambda$ to validate the equality $\mathscr H(\lambda)=\sup \mathscr H$ for every symmetric and monotone mean.


title: Convergence of Local Supermartingales

abstract: We characterize the event of convergence of a local supermartingale. Conditions are given in terms of its predictable characteristics and quadratic variation. The notion of stationarily local integrability plays a key role.


title: A General Approach to Seismic Inversion with Automatic Differentiation

abstract: Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. The mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.


title: Optimal Transport Based Filtering with Nonlinear State Equality Constraints

abstract: In this work we propose a framework to address the issue of state dependent nonlinear equality-constrained state estimation using Bayesian filtering. This framework is constructed specifically for a linear approximation of Bayesian filtering that uses the theory of Optimal Transport. As a part of this framework, we present three traditionally-used nonlinear equality constraint-preserving algorithms coupled with the Optimal Transport based filter: the equality-constrained Optimal Transport filter, the projected Optimal Transport filter, and the measurement-augmented Optimal Transport filter. In cases where the nonlinear equality-constraints represent an arbitrary convex manifold, we show that the re-sampling step of Optimal Transport filter, can generate initial samples for filtering, from any probability distribution function defined on this manifold. We show numerical results using our proposed framework.


title: Eigen Value Analysis in Lower Bounding Uncertainty of Kalman Filter Estimates

abstract: In this paper we are concerned with the error-covariance lower-bounding problem in Kalman filtering: a sensor releases a set of measurements to the data fusion/estimation center, which has a perfect knowledge of the dynamic model, to allow it to estimate the states, while preventing it to estimate the states beyond a given accuracy. We propose a measurement noise manipulation scheme to ensure lower-bound on the estimation accuracy of states. Our proposed method ensures lower-bound on the steady state estimation error of Kalman filter, using mathematical tools from eigen value analysis.


title: Dysprosium mid-infrared lasers: current status and future prospects

abstract: With growing interest in the mid-infrared spectral region, dysprosium has recently been revisited for efficient high-performance infrared source development. Despite historically receiving less attention than other rare earth ions, in recent years lasers utilizing the dysprosium ion as the laser material have set record mid-infrared performance, including tunability from 2.8 to 3.4 um (in addition to 4.3 um lasing), continuous wave powers exceeding 10 W, greater than 73% slope efficiencies, and even ultrafast pulsed operation. Herein, the unique energy level structure and spectroscopy of the dysprosium ion are examined and the major developments that have led to this resurgence of interest and subsequent record mid-infrared laser performance are surveyed. Also mid-infrared applications of emerging dysprosium lasers are highlighted, in addition to surveying the many opportunities that lie ahead.


title: Analysis and forecast of COVID-19 spreading in China, Italy and France

abstract: In this note we analyze the temporal dynamics of the coronavirus disease 2019 outbreak in China, Italy and France in the time window $22/01-09/03/2020$. A first analysis of simple day-lag maps points to some universality in the epidemic spreading, suggesting that simple mean-field models can be meaningfully used to gather a quantitative picture of the epidemic spreading, and notably the height and time of the peak of confirmed infected individuals. The analysis of the same data within a simple susceptible-(confirmed) infected-recovered-deaths model indicates that the kinetic parameter that describes the rate of recovery seems to be the same, irrespective of the country, while the infection and death rates appear to be more variable. The model places the peak in Italy around March 20$^{\rm th}$ 2020, with a maximum number of confirmed infected individuals of about 16,000.


title: The shape of SN 1993J re-analyzed

abstract: SN 1993J is one of the best studied Type IIb supernovae. Spectropolarimetric data analyses were published over two decades ago at a time when the field of supernova spectropolarimetry was in its infancy. Here we present a new analysis of the spectropolarimetric data of SN 1993J and an improved estimate of its interstellar polarization (ISP) as well as a critical review of ISP removal techniques employed in the field. The polarization of SN 1993J is found to show significant alignment on the $q-u$ plane, suggesting the presence of a dominant axis and therefore of continuum polarization. We also see strong line polarization features, including $\mathrm{H\beta}$, He\,{\sc i} $\lambda 5876$, $\mathrm{H\alpha}$, He\,{\sc i} $\lambda 6678$, He\,{\sc i} $\lambda 7065$, and high velocity (HV) components of He\,{\sc i} $\lambda 5876$ and $\mathrm{H\alpha}$. SN 1993J is therefore the second example of a stripped envelope supernova, alongside iPTF13bvn, with prominent HV helium polarization features, and the first to show a likely HV \halpha contribution. Overall, we determine that the observed features can be interpreted as the superposition of anisotropically distributed line forming regions over ellipsoidal ejecta. We cannot exclude the possibility of an off-axis energy source within the ejecta. These data demonstrate the rich structures that are inaccessible if solely considering the flux spectra but can be probed by spectropolarimetric observations. In future studies, the new ISP corrected data can be used in conjunction with 3D radiative transfer models to better map the geometry of the ejecta of SN 1993J.


title: Smooth constructions of homotopy-coherent actions

abstract: We prove that, for nice classes of infinite-dimensional smooth groups G, natural constructions in smooth topology and symplectic topology yield homotopically coherent group actions of G. This yields a bridge between infinite-dimensional smooth groups and homotopy theory. The result relies on two computations: One showing that the diffeological homotopy groups of the Milnor classifying space BG are naturally equivalent to the (continuous) homotopy groups, and a second showing that a particular strict category localizes to yield the homotopy type of BG. We then prove a result in symplectic geometry: These methods are applicable to the group of Liouville automorphisms of a Liouville sector. The present work is written with an eye toward [OT19], where our constructions show that higher homotopy groups of symplectic automorphism groups map to Fukaya-categorical invariants, and where we prove a conjecture of Teleman from the 2014 ICM in the Liouville and monotone settings.


title: Ammonium salts are a reservoir of nitrogen on a cometary nucleus and possibly on some asteroids

abstract: The measured nitrogen-to-carbon ratio in comets is lower than for the Sun, a discrepancy which could be alleviated if there is an unknown reservoir of nitrogen in comets. The nucleus of comet 67P/Churyumov-Gerasimenko exhibits an unidentified broad spectral reflectance feature around 3.2 micrometers, which is ubiquitous across its surface. On the basis of laboratory experiments, we attribute this absorption band to ammonium salts mixed with dust on the surface. The depth of the band indicates that semivolatile ammonium salts are a substantial reservoir of nitrogen in the comet, potentially dominating over refractory organic matter and more volatile species. Similar absorption features appear in the spectra of some asteroids, implying a compositional link between asteroids, comets, and the parent interstellar cloud.


title: Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

abstract: A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (~1$\mu$m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from in vivo imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost.


title: A Polyhedral Approach to Bisubmodular Function Minimization

abstract: We consider minimization problems with bisubmodular objective functions. We propose valid inequalities, namely the poly-bimatroid inequalities, and provide a complete linear description of the convex hull of the epigraph of a bisubmodular function. Furthermore, we develop a cutting plane algorithm for constrained bisubmodular minimization based on the poly-bimatroid inequalities. Our computational experiments on the minimization subproblem in robust coupled sensor placement show that our algorithm can solve highly non-linear problems that do not admit compact mixed-integer linear formulations.


title: A spatial causal analysis of wildland fire-contributed PM2.5 using numerical model output

abstract: Wildland fire smoke contains hazardous levels of fine particulate matter PM2.5, a pollutant shown to adversely effect health. Estimating fire attributable PM2.5 concentrations is key to quantifying the impact on air quality and subsequent health burden. This is a challenging problem since only total PM2.5 is measured at monitoring stations and both fire-attributable PM2.5 and PM2.5 from all other sources are correlated in space and time. We propose a framework for estimating fire-contributed PM2.5 and PM2.5 from all other sources using a novel causal inference framework and bias-adjusted chemical model representations of PM2.5 under counterfactual scenarios. The chemical model representation of PM2.5 for this analysis is simulated using Community Multi-Scale Air Quality Modeling System (CMAQ), run with and without fire emissions across the contiguous U.S. for the 2008-2012 wildfire seasons. The CMAQ output is calibrated with observations from monitoring sites for the same spatial domain and time period. We use a Bayesian model that accounts for spatial variation to estimate the effect of wildland fires on PM2.5 and state assumptions under which the estimate has a valid causal interpretation. Our results include estimates of absolute, relative and cumulative contributions of wildfire smoke to PM2.5 for the contiguous U.S. Additionally, we compute the health burden associated with the PM2.5 attributable to wildfire smoke.


title: Low-dimensional firing-rate dynamics for populations of renewal-type spiking neurons

abstract: The macroscopic dynamics of large populations of neurons can be mathematically analyzed using low-dimensional firing-rate or neural-mass models. However, these models fail to capture spike synchronization effects of stochastic spiking neurons such as the non-stationary population response to rapidly changing stimuli. Here, we derive low-dimensional firing-rate models for homogeneous populations of general renewal-type neurons, including integrate-and-fire models driven by white noise. Renewal models account for neuronal refractoriness and spike synchronization dynamics. The derivation is based on an eigenmode expansion of the associated refractory density equation, which generalizes previous spectral methods for Fokker-Planck equations to arbitrary renewal models. We find a simple relation between the eigenvalues, which determine the characteristic time scales of the firing rate dynamics, and the Laplace transform of the interspike interval density or the survival function of the renewal process. Analytical expressions for the Laplace transforms are readily available for many renewal models including the leaky integrate-and-fire model. Retaining only the first eigenmode yields already an adequate low-dimensional approximation of the firing-rate dynamics that captures spike synchronization effects and fast transient dynamics at stimulus onset. We explicitly demonstrate the validity of our model for a large homogeneous population of Poisson neurons with absolute refractoriness, and other renewal models that admit an explicit analytical calculation of the eigenvalues. The here presented eigenmode expansion provides a systematic framework for novel firing-rate models in computational neuroscience based on spiking neuron dynamics with refractoriness.


title: High precision mass measurements of the isomeric and ground states of $^{44}$V: improving constraints on the IMME parameters of the A=44, $\text{0}^{\text{+}}$ quintet

abstract: The Isobaric Multiplet Mass Equation (IMME) has been successful at predicting the masses of isobaric analogue states in the same multiplet, while its coefficients are known to follow trends as functions of mass number. The Atomic Mass Evaluation 2016 [Chin. Phys. C 41, 030003 (2017)] $^{44}$V mass value results in an negative $c$ coefficient for the IMME quadratic term. The $b$ and $c$ coefficients can provide constraints for construction of the isospin-nonconserving (INC) Hamiltonians for the $pf$ shell. The excitation energy of the $0^+, T=2$ level in $^{44}$V is currently unknown and can be used to constrain the $^{44}$Cr mass. The aim of the experiment was to perform high-precision mass measurements to resolve the difference between $^{44}$V isomeric and ground states, to test the IMME, and to provide ingredients for identifying the $0^+$, $T=2$ state in $^{44}$V. High-precision Penning trap mass spectrometry was performed at LEBIT, to measure the cyclotron frequency ratios of [$^{44g,m}$VO]$^+$ versus [$^{32}$SCO]$^+$, a reference mass, to extract both the isomeric and ground state masses of $^{44}$V. The mass excess of the ground and isomeric states in $^{44}$V were measured to be $-23\ 804.9(80)$ keV/$\text{c}^2$ and $-23\ 537.0(55)$ keV/$\text{c}^2$. This yielded a new proton separation energy of $S_p$ = 1\ 773(10) keV. The new mass values of $^{44}$V have been used to deduce the IMME $b$ and $c$ coefficients of the lowest $2^+$ and $6^+$ triplets in $A=44$. The $2^+$ $c$ coefficient is verified with the IMME trend and agrees with the shell-model predictions using charge-dependent Hamiltonians. The mirror energy differences were determined between $^{44}$V and $^{44}$Sc, in line with isospin-symmetry. The new value of the proton separation energy determined will be important for the determination of the $0^+$, $T=2$ state in $^{44}$V and for prediction of the mass of $^{44}$Cr.


title: On modified kernel polynomials and classical type Sobolev orthogonal polynomials

abstract: In this paper we study modified kernel polynomials: $u_n(x) = \sum_{k=0}^n c_k g_k(x)$, depending on parameters $c_k>0$, where $\{ g_k \}_0^\infty$ are orthonormal polynomials on the real line. Besides kernel polynomials with $c_k = g_k(t_0)>0$, for example, $c_k$ may be chosen to be some other solutions of the corresponding second-order difference equation of $g_k$. It is shown that all these polynomials satisfy a $4$-th order recurrence relation. The cases with $g_k$ being Jacobi or Laguerre polynomials are of a special interest. Suitable choices of parameters $c_k$ imply $u_n$ to be Sobolev orthogonal polynomials with a $(3\times 3)$ matrix measure. Moreover, a further selection of parameters gives differential equations for $u_n$. In the latter case, polynomials $u_n(x)$ are solutions to a generalized eigenvalue problems both in $x$ and in $n$.


title: On Robustness Metrics for Learning STL Tasks

abstract: Signal temporal logic (STL) is a powerful tool for describing complex behaviors for dynamical systems. Among many approaches, the control problem for systems under STL task constraints is well suited for learning-based solutions, because STL is equipped with robustness metrics that quantify the satisfaction of task specifications and thus serve as useful rewards. In this work, we examine existing and potential robustness metrics specifically from the perspective of how they can aid such learning algorithms. We show that various desirable properties restrict the form of potential metrics, and introduce a new one based on the results. The effectiveness of this new robustness metric for accelerating the learning procedure is demonstrated through an insightful case study.


title: RSSI-Based Hybrid Beamforming Design with Deep Learning

abstract: Hybrid beamforming is a promising technology for 5G millimetre-wave communications. However, its implementation is challenging in practical multiple-input multiple-output (MIMO) systems because non-convex optimization problems have to be solved, introducing additional latency and energy consumption. In addition, the channel-state information (CSI) must be either estimated from pilot signals or fed back through dedicated channels, introducing a large signaling overhead. In this paper, a hybrid precoder is designed based only on received signal strength indicator (RSSI) feedback from each user. A deep learning method is proposed to perform the associated optimization with reasonable complexity. Results demonstrate that the obtained sum-rates are very close to the ones obtained with full-CSI optimal but complex solutions. Finally, the proposed solution allows to greatly increase the spectral efficiency of the system when compared to existing techniques, as minimal CSI feedback is required.


title: A magnetar engine for short GRBs and kilonovae

abstract: We investigate the influence of magnetic fields on the evolution of binary neutron-star (BNS) merger remnants via three-dimensional (3D) dynamical-spacetime general-relativistic (GR) magnetohydrodynamic (MHD) simulations. We evolve a postmerger remnant with an initial poloidal magnetic field, resolve the magnetoturbulence driven by shear flows, and include a microphysical finite-temperature equation of state (EOS). A neutrino leakage scheme that captures the overall energetics and lepton number exchange is also included. We find that turbulence induced by the magnetorotational instability (MRI) in the hypermassive neutron star (HMNS) amplifies magnetic field to beyond magnetar-strength ($10^{15}\, \mathrm{G}$). The ultra-strong toroidal field is able to launch a relativistic jet from the HMNS. We also find a magnetized wind that ejects neutron-rich material with a rate of $\dot{M}_{\mathrm{ej}} \simeq 1 \times10^{-1}\, \mathrm{M_{\odot}\, s^{-1}}$. The total ejecta mass in our simulation is $5\times 10^{-3}\, \mathrm{M_{\odot}}$. This makes the ejecta from the HMNS an important component in BNS mergers and a promising source of $r$-process elements that can power a kilonova. The jet from the HMNS reaches a terminal Lorentz factor of $\sim 5$ in our highest-resolution simulation. The formation of this jet is aided by neutrino-cooling preventing the accretion disk from protruding into the polar region. As neutrino pair-annihilation and radiative processes in the jet (which were not included in the simulations) will boost the Lorentz factor in the jet further, our simulations demonstrate that magnetars formed in BNS mergers are a viable engine for short gamma-ray bursts (sGRBs).


title: Local Contextual Attention with Hierarchical Structure for Dialogue Act Recognition

abstract: Dialogue act recognition is a fundamental task for an intelligent dialogue system. Previous work models the whole dialog to predict dialog acts, which may bring the noise from unrelated sentences. In this work, we design a hierarchical model based on self-attention to capture intra-sentence and inter-sentence information. We revise the attention distribution to focus on the local and contextual semantic information by incorporating the relative position information between utterances. Based on the found that the length of dialog affects the performance, we introduce a new dialog segmentation mechanism to analyze the effect of dialog length and context padding length under online and offline settings. The experiment shows that our method achieves promising performance on two datasets: Switchboard Dialogue Act and DailyDialog with the accuracy of 80.34\% and 85.81\% respectively. Visualization of the attention weights shows that our method can learn the context dependency between utterances explicitly.


title: Interaction Graphs for Object Importance Estimation in On-road Driving Videos

abstract: A vehicle driving along the road is surrounded by many objects, but only a small subset of them influence the driver's decisions and actions. Learning to estimate the importance of each object on the driver's real-time decision-making may help better understand human driving behavior and lead to more reliable autonomous driving systems. Solving this problem requires models that understand the interactions between the ego-vehicle and the surrounding objects. However, interactions among other objects in the scene can potentially also be very helpful, e.g., a pedestrian beginning to cross the road between the ego-vehicle and the car in front will make the car in front less important. We propose a novel framework for object importance estimation using an interaction graph, in which the features of each object node are updated by interacting with others through graph convolution. Experiments show that our model outperforms state-of-the-art baselines with much less input and pre-processing.


title: Height fluctuations in homoepitaxial thin film growth: A numerical study

abstract: We report on the investigation of height distributions (HDs) and spatial covariances of two-dimensional surfaces obtained from extensive numerical simulations of the celebrated Clarke-Vvedensky (CV) model for homoepitaxial thin film growth. In this model, the effect of temperature, deposition flux, and strengths of atom-atom interactions are encoded in two parameters: the diffusion to deposition ratio $R=D/F$ and $\varepsilon$, which is related to the probability of an adatom "breaking" a lateral bond. We demonstrate that the HDs present a strong dependence on both $R$ and $\varepsilon$, and even after the deposition of $10^5$ monolayers (MLs) they are still far from the asymptotics in some cases. For instance, the temporal evolution of the HDs' skewness (kurtosis) displays a pronounced minimum (maximum), for small $R$ and $\varepsilon$, and only at long times it passes to increase (decrease) toward its asymptotic value. However, it is hard to determine whether they converge to a single value or different nonuniversal ones. For large $R$ and/or $\varepsilon$, on the other hand, these quantities clearly converge to the values expected for the Villain-Lai-Das Sarma (VLDS) universality class. A similar behavior is observed in the spatial covariances, but with weaker finite-time effects, so that rescaled curves of them collapse quite well with the one for the VLDS class at long times. Simulations of a model with limited mobility of particles, which captures some essential features of the CV model in the limit of irreversible aggregation ($\varepsilon=0$), reveal a similar scenario. Overall, these results point out that the study of fluctuations in homoepitaxial thin films' surfaces can be a very difficult task and shall be performed very carefully, once typical experimental films have $\lesssim 10^4$ MLs, so that their HDs and covariances can be in the realm of transient regimes.


title: Turbulent characteristics within roughness sublayer over spanwise homogeneous transversal bars

abstract: Turbulent characteristics within shear layer have been studied, recently, within vegetative canopy, buildings, dunes. Kevin-Helmholtz instability triggered hairpin vortex shedding has been widely concluded as the "signature" of mixing layer analogy. However, convoluted roughness types complicate the observing practice of turbulent evolving progress. To simplify that, spanwise homogeneous roughness has been adopted in this work to capture the streamwise flow alternations under different streamwise roughness element distances. Streamwise successive object distance $\lambda_x$ is used to show the roughness element distance. The transitional trends from turbulent channel flow to canopy flow have been observed from Case 1 to Case 4. However, when $\lambda_x/h<1.0$, as successive distance decreases, the evidences indicate turbulent flow is transferring from canopy flow into channel flow from Case 4 to Case 6. Instantaneous results verifies the enhancement of turbulent mixing and decreasing turbulent coherency. The attached-eddy hypothesis (AEH) becomes valid in $\lambda_x/h<1.0$ Cases. Meanwhile, Reynolds-averaged flow results show the roughness shear "curve" effectiveness will decrease when $\lambda_x$ keeps decreasing after $\lambda_x/h<1.0$. The probability density function (PDF) of three fluctuating variables on a sampling point over element display the "increasing-decreasing" trend of decreasing spacing effect on upper region, wherein the maximal effect emerges in Case 2 and 3. And the swirling structural visualizations also demonstrate the progress of turbulent structure changing in roughness sublayer at different streamwise successive object distances. Finally, the instantaneous results show wall-normal momentum flux transports and turbulence swirling structures are correlated to the element spacing.


title: Wasserstein-based Graph Alignment

abstract: We propose a novel method for comparing non-aligned graphs of different sizes, based on the Wasserstein distance between graph signal distributions induced by the respective graph Laplacian matrices. Specifically, we cast a new formulation for the one-to-many graph alignment problem, which aims at matching a node in the smaller graph with one or more nodes in the larger graph. By integrating optimal transport in our graph comparison framework, we generate both a structurally-meaningful graph distance, and a signal transportation plan that models the structure of graph data. The resulting alignment problem is solved with stochastic gradient descent, where we use a novel Dykstra operator to ensure that the solution is a one-to-many (soft) assignment matrix. We demonstrate the performance of our novel framework on graph alignment and graph classification, and we show that our method leads to significant improvements with respect to the state-of-the-art algorithms for each of these tasks.


title: Model reduction with pole-zero placement and high order moment matching

abstract: In this paper, we compute a low order approximation of a system of large order $n$ that matches $\nu$ moments of order $j_i$ of the transfer function, at $\nu$ interpolation points, has $\ell$ poles and $k$ zeros fixed and also matches $\nu-(\ell +k)$ moments of order $j_i+1$, where $j_i+1$ is the multiplicity of the $i$-th interpolation point. We derive explicit linear systems in the free parameters to simultaneously achieve the required pole-zero placement and match the desired high order moments. We compute the closed form of the free parameters that meet the constraints, as the solution of a $\nu$ order linear system. Furthermore, for data-driven model reduction, we generalize the construction of the Loewner matrices to include the data and the imposed pole and higher order moment constraints. The resulting approximations achieve a trade-off between the good norm approximation and the preservation of the dynamics of the original system in a region of interest.


title: Heterogeneous Relational Reasoning in Knowledge Graphs with Reinforcement Learning

abstract: Path-based relational reasoning over knowledge graphs has become increasingly popular due to a variety of downstream applications such as question answering in dialogue systems, fact prediction, and recommender systems. In recent years, reinforcement learning (RL) has provided solutions that are more interpretable and explainable than other deep learning models. However, these solutions still face several challenges, including large action space for the RL agent and accurate representation of entity neighborhood structure. We address these problems by introducing a type-enhanced RL agent that uses the local neighborhood information for efficient path-based reasoning over knowledge graphs. Our solution uses graph neural network (GNN) for encoding the neighborhood information and utilizes entity types to prune the action space. Experiments on real-world dataset show that our method outperforms state-of-the-art RL methods and discovers more novel paths during the training procedure.


title: NesTPP: Modeling Thread Dynamics in Online Discussion Forums

abstract: Online discussion forum creates an asynchronous conversation environment for online users to exchange ideas and share opinions through a unique thread-reply communication mode. Accurately modeling information dynamics under such a mode is important, as it provides a means of mining latent spread patterns and understanding user behaviors. In this paper, we design a novel temporal point process model to characterize information cascades in online discussion forums. The proposed model views the entire event space as a nested structure composed of main thread streams and their linked reply streams, and it explicitly models the correlations between these two types of streams through their intensity functions. Leveraging the Reddit data, we examine the performance of the designed model in different applications and compare it with other popular methods. The experimental results have shown that our model can produce competitive results, and it outperforms state-of-the-art methods in most cases.


title: Absence of the Higuchi bound in a family of alternative linear massive spin-2 models

abstract: There is a well known result from the Fierz-Pauli (FP) theory in de Sitter background that is the existence of a lower bound for the mass $m$ of the spin 2 particle, the Higuchi bound. It establishes that $m^2\geq 2H^2$, where $H$ is the Hubble parameter, in order to the theory presents no ghost-like instabilities. In this sense, $m$ should be unacceptable high in order to fulfill this condition at the time of the inflationary epoch of the Universe, posing a difficulty to conciliate the FP theory with cosmology. In this letter we show that the Higuchi bound can be circumvented in an alternative description of massive spin-2 particles known as $\mathcal{L}(a_1)$ models. In maximally symmetric spaces the theory has two free parameters which can be consistently chosen in order to make the model absent of a lower bound for $m$. Then, $m$ can be arbitrarily smaller than the energy scale of inflation avoiding instabilities at that time.


title: Measurement of nuclear effects on $\psi\rm{(2S)}$ production in p-Pb collisions at $\sqrt{\textit{s}_{\rm NN}} = 8.16$ TeV

abstract: Inclusive $\psi$(2S) production is measured in p-Pb collisions at the centre-of-mass energy per nucleon-nucleon pair $\sqrt{s_{\rm{NN}}}=8.16$ TeV, using the ALICE detector at the CERN LHC. The production of $\psi$(2S) is studied at forward ($2.03 < y_{\rm cms} < 3.53$) and backward ($-4.46 < y_{\rm cms} < -2.96$) centre-of-mass rapidity and for transverse momentum $p_{\rm{T}}$ $<$ 12 GeV/$c$ via the decay to muon pairs. In this paper, we report the integrated as well as the $y_{\rm cms}$- and $p_{\rm T}$-differential inclusive production cross sections. Nuclear effects on $\psi$(2S) production are studied via the determination of the nuclear modification factor that shows a strong suppression at both forward and backward centre-of-mass rapidities. Comparisons with corresponding results for inclusive J/$\psi$ show a similar suppression for the two states at forward rapidity (p-going direction), but a stronger suppression for $\psi$(2S) at backward rapidity (Pb-going direction). As a function of $p_{\rm T}$, no clear dependence of the nuclear modification factor is found. The relative size of nuclear effects on $\psi$(2S) production compared to J/$\psi$ is also studied via the double ratio of production cross sections $[\sigma_{\psi(2S)}/\sigma_{\rm{J/}\psi}]_{\rm pPb}/[\sigma_{\psi(2S)}/\sigma_{\rm{J/}\psi}]_{\rm pp}$ between p-Pb and pp collisions. The results are compared with theoretical models that include various effects related to the initial and final state of the collision system and also with previous measurements at $\sqrt{s_{\rm{NN}}}$ = 5.02 TeV.


title: Deep Domain-Adversarial Image Generation for Domain Generalisation

abstract: Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to leverage data from multiple source domains so that a trained model can generalise to unseen domains. In this paper, we propose a novel DG approach based on \emph{Deep Domain-Adversarial Image Generation} (DDAIG). Specifically, DDAIG consists of three components, namely a label classifier, a domain classifier and a domain transformation network (DoTNet). The goal for DoTNet is to map the source training data to unseen domains. This is achieved by having a learning objective formulated to ensure that the generated data can be correctly classified by the label classifier while fooling the domain classifier. By augmenting the source training data with the generated unseen domain data, we can make the label classifier more robust to unknown domain changes. Extensive experiments on four DG datasets demonstrate the effectiveness of our approach.


title: Derived Poincar\'e-Birkhoff-Witt theorems (with an appendix by Vladimir Dotsenko)

abstract: We define derived Poincar\'e--Birkhoff--Witt maps of dg operads or derived PBW maps, for short, which extend the definition of PBW maps between operads of V.~Dotsenko and the second author in 1804.06485, with the purpose of studying the universal enveloping algebra of dg Lie algebras as a functor on the homotopy category. Our main result shows that the map from the homotopy Lie operad to the homotopy associative operad is derived PBW, which gives us an amenable description of the homology of the universal envelope of an $L_\infty$-algebra in the sense of Lada--Markl. We deduce from this several known results involving universal envelopes of $L_\infty$-algebras of V. Baranovsky and J. Moreno-Fern\'andez, and extend D. Quillen's classical quasi-isomorphism $\mathcal C \longrightarrow BU$ from dg Lie algebras to $L_\infty$-algebras; this confirms a conjecture of J. Moreno-Fern\'andez.


title: Moser-Trudinger inequality for the complex Monge-Ampere equation

abstract: In this paper, we prove a Moser-Trudinger type inequality for pluri-subharmonic functions vanishing on the boundary. Our proof uses a descent gradient flow for the complex Monge-Ampere functional.


title: An arithmetic zeta function respecting multiplicities

abstract: In this paper, we study the arithmetic zeta function $$\mathscr{Z}_{\mathcal{X}}(s) = \prod_p \prod_{\substack{x \in \mathcal{X}_p \\ \text{closed}}} \Big( \frac{1}{1-|\kappa(x)|^{-s}} \Big)^{\mathfrak{m}_{p}(x)}$$ associated to a scheme $\mathcal{X}$ of finite type over $\mathbb{Z}$, where $\kappa(x)$ denotes the residue field and $\mathfrak{m}_{p}(x)$ the multiplicity of $x$ in $\mathcal{X}_p$. If $\mathcal{X}$ is defined over a finite field, then $\mathscr{Z}_{\mathcal{X}}$ appears naturally in the context of point counting with multiplicities. We prove that $\mathscr{Z}_{\mathcal{X}}$ admits a meromorphic continuation to $\{s \in \mathbb{C} \colon \mathrm{Re}(s) > \mathrm{dim}(\mathcal{X})-1/2\}$ and determine the order of its pole at $s = \mathrm{dim}(\mathcal{X})$. Finally, we relate $\mathscr{Z}_{\mathcal{X}}$ to a zeta function $\zeta_f$ encoding the residual factorization patterns of a polynomial $f$.


title: Unification of the wave and guidance equations for spin 1/2

abstract: We generalize our previous unification of the Schrodinger and guidance equations in a single inhomogeneous Schrodinger equation to a Riemannian manifold with an external vector potential. A special case yields the unified theory for a spin 1/2 rigid rotator. The theory is proved to be symmetrical under the Galileo group, the unified field that integrates the particle and guiding wave being a 2-spinor.


title: A priori estimate for the complex Monge-Ampere equation


title: Your GAN is Secretly an Energy-based Model and You Should use Discriminator Driven Latent Sampling

abstract: We show that the sum of the implicit generator log-density $\log p_g$ of a GAN with the logit score of the discriminator defines an energy function which yields the true data density when the generator is imperfect but the discriminator is optimal, thus making it possible to improve on the typical generator (with implicit density $p_g$). To make that practical, we show that sampling from this modified density can be achieved by sampling in latent space according to an energy-based model induced by the sum of the latent prior log-density and the discriminator output score. This can be achieved by running a Langevin MCMC in latent space and then applying the generator function, which we call Discriminator Driven Latent Sampling~(DDLS). We show that DDLS is highly efficient compared to previous methods which work in the high-dimensional pixel space and can be applied to improve on previously trained GANs of many types. We evaluate DDLS on both synthetic and real-world datasets qualitatively and quantitatively. On CIFAR-10, DDLS substantially improves the Inception Score of an off-the-shelf pre-trained SN-GAN~\citep{sngan} from $8.22$ to $9.09$ which is even comparable to the class-conditional BigGAN~\citep{biggan} model. This achieves a new state-of-the-art in unconditional image synthesis setting without introducing extra parameters or additional training.


title: Geometry-aware Dynamic Movement Primitives

abstract: In many robot control problems, factors such as stiffness and damping matrices and manipulability ellipsoids are naturally represented as symmetric positive definite (SPD) matrices, which capture the specific geometric characteristics of those factors. Typical learned skill models such as dynamic movement primitives (DMPs) can not, however, be directly employed with quantities expressed as SPD matrices as they are limited to data in Euclidean space. In this paper, we propose a novel and mathematically principled framework that uses Riemannian metrics to reformulate DMPs such that the resulting formulation can operate with SPD data in the SPD manifold. Evaluation of the approach demonstrates that beneficial properties of DMPs such as change of the goal during operation apply also to the proposed formulation.


title: Efficient Compression Of The Environment Of An Open Quantum System

abstract: In order to simulate open quantum systems, many approaches (such as Hamiltonian-based solvers in dynamical mean-field theory) aim for a reproduction of a desired environment spectral density in terms of a discrete set of bath states, mimicking the open system as a larger closed problem. Existing strategies to find a compressed representation of the environment for this purpose can be numerically demanding, or lack the compactness and systematic improvability required for an accurate description of the system propagator. We propose a method in which bath orbitals are constructed explicitly by an algebraic construction based on the Schmidt-decomposition of response wave functions, efficiently and systematically compressing the description of the full environment. These resulting bath orbitals are designed to directly reproduce the system Green's function, not hybridization, which allows for consideration of the relevant system energy scales to optimally model. This results in an accurate and efficient truncation of the environment, with applications in a wide range of numerical simulations of open quantum systems.


title: Collins-Soper Kernel for TMD Evolution from Lattice QCD

abstract: The Collins-Soper kernel relates transverse momentum-dependent parton distribution functions (TMDPDFs) at different energy scales. For small parton transverse momentum $q_T\sim \Lambda_\text{QCD}$, this kernel is non-perturbative and can only be determined with controlled uncertainties through experiment or first-principles calculations. This work presents the first exploratory determination of the Collins-Soper kernel using the lattice formulation of Quantum Chromodynamics. In a quenched calculation, the $N_f=0$ kernel is determined at scales in the range 250 MeV $< q_T < 2$ GeV, and an analysis of the remaining systematic uncertainties is undertaken.


title: Characterizing Optimizations to Memory Access Patterns using Architecture-Independent Program Features

abstract: High-performance computing developers are faced with the challenge of optimizing the performance of OpenCL workloads on diverse architectures. The Architecture-Independent Workload Characterization (AIWC) tool is a plugin for the Oclgrind OpenCL simulator that gathers metrics of OpenCL programs that can be used to understand and predict program performance on an arbitrary given hardware architecture. However, AIWC metrics are not always easily interpreted and do not reflect some important memory access patterns affecting efficiency across architectures. We propose a new metric of parallel spatial locality -- the closeness of memory accesses simultaneously issued by OpenCL work-items (threads). We implement the parallel spatial locality metric in the AIWC framework, and analyse gathered results on matrix multiply and the Extended OpenDwarfs OpenCL benchmarks. The differences in the observed parallel spatial locality metric across implementations of matrix multiply reflect the optimizations performed. The new metric can be used to distinguish between the OpenDwarfs benchmarks based on the memory access patterns affecting their performance on various architectures. The improvements suggested to AIWC will help HPC developers better understand memory access patterns of complex codes and guide optimization of codes for arbitrary hardware targets.