title: Demonstration of a Tunable Antenna-Coupled Intersubband Terahertz (TACIT) Mixer

abstract: A fast, voltage-tunable terahertz mixer based on the intersubband transition of a high-mobility 2-dimensional electron gas (2DEG) has been fabricated from a single 40 nm GaAs-AlGaAs square quantum well heterostructure. The device is called a Tunable Antenna-Coupled Intersubband Terahertz (TACIT) mixer, and shows tunability of the detection frequency from 2.52 THz to 3.11 THz with small (< 1 V) top gate and back gate voltage biases. Mixing at 2.52 THz has been observed at 60 K with a -3dB intermediate frequency (IF) bandwidth exceeding 6 GHz.


title: Information based Deep Clustering: An experimental study

abstract: Recently, two methods have shown outstanding performance for clustering images and jointly learning the feature representation. The first, called Information Maximiz-ing Self-Augmented Training (IMSAT), maximizes the mutual information between input and clusters while using a regularization term based on virtual adversarial examples. The second, named Invariant Information Clustering (IIC), maximizes the mutual information between the clustering of a sample and its geometrically transformed version. These methods use mutual information in distinct ways and leverage different kinds of transformations. This work proposes a comprehensive analysis of transformation and losses for deep clustering, where we compare numerous combinations of these two components and evaluate how they interact with one another. Results suggest that mutual information between a sample and its transformed representation leads to state-of-the-art performance for deep clustering, especially when used jointly with geometrical and adversarial transformations.


title: Exploring Generative Physics Models with Scientific Priors in Inertial Confinement Fusion

abstract: There is significant interest in using modern neural networks for scientific applications due to their effectiveness in modeling highly complex, non-linear problems in a data-driven fashion. However, a common challenge is to verify the scientific plausibility or validity of outputs predicted by a neural network. This work advocates the use of known scientific constraints as a lens into evaluating, exploring, and understanding such predictions for the problem of inertial confinement fusion.


title: Design of a Multiple-Reflection Time-of-Flight Mass-Spectrometer for Barium-tagging

abstract: The search for neutrinoless double beta decay requires increasingly advanced methods of background reduction. A bold approach to solving this problem, in experiments using Xe-136, is to extract and identify the daughter Ba-136 ion produced by double beta decay. Tagging events in this manner allows for a virtually background-free verification of double beta decay signals. Various approaches are being pursued by the nEXO collaboration to achieve Ba-tagging. A Multi-Reflection Time-of-Flight Mass Spectrometer (MR TOF) has been designed and optimized as one of the ion-identification methods, where it will investigate the ion-extraction efficiency, as well as provide further identification of the Ba isotope. The envisioned mode of operation allows the MR TOF to achieve a quickly adjustable mass-range and resolution, with simulations suggesting that a mass-resolving power of 140,000 is within reach. This work will discuss the MR TOF design and the methods employed to simulate and optimize it.


title: Evolving Supernova Remnants in Multiphase Interstellar Media

abstract: We performed three-dimensional magnetohydrodynamic simulations to study the evolution of a supernova remnant (SNR) in a turbulent neutral atomic interstellar medium. The media used as background shares characteristics with the Solar neighbourhood and the SNR has mass and energy similar to those of a Type Ia object. Our initial conditions consist of dense clouds in a diluted medium, with the main difference between simulations being the average magnitude of the magnetic field. We measured amplifications of the magnetic energy of up to 34$\%$ and we generated synthetic maps that illustrate how the same object can show different apparent geometries and physical properties when observed through different lines of sight.


title: Elastic properties of hidden order in URu$_{\text2}$Si$_{\text2}$ are reproduced by a staggered nematic

abstract: We develop a phenomenological mean field theory describing the hidden order phase in URu$_{\text2}$Si$_{\text2}$ as a nematic of the $\text B_{\text{1g}}$ representation staggered along the $c$-axis. Several experimental features are reproduced by this theory: the topology of the temperature--pressure phase diagram, the response of the elastic modulus $(C_{11}-C_{12})/2$ above the transition at ambient pressure, and orthorhombic symmetry breaking in the high-pressure antiferromagnetic phase. In this scenario, hidden order is characterized by broken rotational symmetry that is modulated along the $c$-axis, the primary order of the high-pressure phase is an unmodulated nematic, and the triple point joining those two phases with the high-temperature paramagnetic phase is a Lifshitz point.


title: Micro-Computed Tomography Analysis of Damage in Notched Composite Laminates Under Multi-Axial Fatigue

abstract: The broad application of polymer composites in engineering demands the deep understanding of the main damage mechanisms under realistic loading conditions and the development of proper physics-based models. Towards this goal, this study presents a comprehensive characterization of the main damage mechanisms in a selection of notched composite structures under multiaxial fatigue loading. Thanks to a synergistic combination of X-ray micro-computed tomography ($\mu$-CT) and Digital Image Correlation (DIC), the main failure modes are identified while the crack volume associated to each mechanism is characterized. This study provides unprecedented quantitative data for the development and validation of computational models to capture the fatigue behavior of polymer composite structures.


title: Pure and Spurious Critical Points: a Geometric Study of Linear Networks

abstract: The critical locus of the loss function of a neural network is determined by the geometry of the functional space and by the parameterization of this space by the network's weights. We introduce a natural distinction between pure critical points, which only depend on the functional space, and spurious critical points, which arise from the parameterization. We apply this perspective to revisit and extend the literature on the loss function of linear neural networks. For this type of network, the functional space is either the set of all linear maps from input to output space, or a determinantal variety, i.e., a set of linear maps with bounded rank. We use geometric properties of determinantal varieties to derive new results on the landscape of linear networks with different loss functions and different parameterizations. Our analysis clearly illustrates that the absence of "bad" local minima in the loss landscape of linear networks is due to two distinct phenomena that apply in different settings: it is true for arbitrary smooth convex losses in the case of architectures that can express all linear maps ("filling architectures") but it holds only for the quadratic loss when the functional space is a determinantal variety ("non-filling architectures"). Without any assumption on the architecture, smooth convex losses may lead to landscapes with many bad minima.


title: Genus one cobordisms between torus knots

abstract: We determine the pairs of torus knots that have a genus one cobordism between them, with one notable exception. This is done by combining obstructions using $\nu^+$ from the Heegaard Floer knot complex and explicit constructions of cobordisms. As an application, we determine the pairs of torus knots related by a single crossing change. Also, we determine the pairs of Thurston-Bennequin number maximizing Legendrian torus knots that have a genus one exact Lagrangian cobordism, with one exception.


title: Planck-scale-deformed relativistic symmetries and diffeomorphisms in momentum space

abstract: We study the implications of a change of coordinatization of momentum space for theories with curved momentum space. We of course find that after a passive diffeomorphism the theory yields the same physical predictions, as one would expect considering that a simple reparametrization should not change physics. However, it appears that general momentum-space covariance (invariance under active diffeomorphisms of momentum space) cannot be enforced, and within a given set of prescriptions on how the theory should encode momentum-space metric and affine connection the physical predictions do depend on the momentum space background. These conclusions find support in some general arguments and in our quantitative analysis of a much-studied toy model with maximally-symmetric (curved) momentum space.


title: Betti numbers of Koszul algebras defined by four quadrics

abstract: Let $I$ be an ideal generated by quadrics in a standard graded polynomial ring $S$ over a field. A question of Avramov, Conca, and Iyengar asks whether the Betti numbers of $R = S/I$ over $S$ can be bounded above by binomial coefficients on the minimal number of generators of $I$ if $R$ is Koszul. This question has been answered affirmatively for Koszul algebras defined by three quadrics and Koszul almost complete intersections with any number of generators. We give a strong affirmative answer to the above question in the case of four quadrics by completely determining the Betti tables of height two ideals of four quadrics defining Koszul algebras.


title: Random Walk of a Cat in a Building

abstract: One usually thinks of a cat moving from one room to another in an apartment as random walk model. Imagine now that it also has the possibility to go from one apartment to another by crossing some corridors. That yields a new probabilistic model for which each corridor connects the entrance rooms of several apartments. This article shows that the determinants of the stochastic and the exponential distance matrices of that model have a nice factorization. Two examples involving indirectly acyclic digraphs and hyperplane arrangements are provided.


title: Quantum torus methods for Kauffman bracket skein modules

abstract: We investigate aspects of Kauffman bracket skein algebras of surfaces and modules of 3-manifolds using quantum torus methods. These methods come in two flavors: embedding the skein algebra into a quantum torus related to quantum Teichmuller space, or filtering the algebra and obtaining an associated graded algebra that is a monomial subalgebra of a quantum torus. We utilize the former method to generalize the Chebyshev homomorphism of Bonahon and Wong between skein algebras of surfaces to a Chebyshev-Frobenius homomorphism between skein modules of marked 3-manifolds, in the course of which we define a surgery theory, and whose image we show is either transparent or skew-transparent. The latter method is used to show that skein algebras of surfaces are maximal orders, which implies a refined unicity theorem, shows that $SL_2\mathbb{C}$-character varieties are normal, and suggests a conjecture on how this result may be utilized for topological quantum compiling.


title: Perverse sheaves over real hyperplane arrangements II

abstract: Let H be an arrangement of hyperplanes in R^n and Perv(C^n,H) be the category of perverse sheaves on C^n smooth with respect to the stratification given by complexified flats of H. We give a description of Perv(C^n,H) in terms of "matrix diagrams", i.e., diagrams formed by vector spaces E_{AB} labelled by pairs A,B of real faces of H (of all dimensions) or, equivalently, by the cells iA+B of a natural cell decomposition of C^n. A matrix diagram is formally similar to a datum describing a constructible (non-perverse) sheaf but with the direction of one half of the arrows reversed.


title: Critical Requirements Engineering in Practice

abstract: The design of software systems inevitably enacts normative boundaries around the site of intervention. These boundaries are, in part, a reflection of the values, ethics, power, and politics of the situation and the process of design itself. This paper argues that Requirements Engineering (RE) require more robust frameworks and techniques to navigate the values implicit in systems design work. To this end, we present the findings from a case of action research where we employed Critical Systems Heuristics (CSH), a framework from Critical Systems Thinking (CST) during requirements gathering for Homesound, a system to safeguard elderly people living alone while protecting their autonomy. We use categories from CSH to inform expert interviews and reflection, showing how CSH can be simply combined with RE techniques (such as the Volere template) to explore and reveal the value-judgements underlying requirements.


title: Type IIP Supernova Progenitors and their explodability I: Convective Overshoot, Blue Loops and Surface Composition

abstract: We present the evolution of massive star progenitors of supernovae of type IIP. We take the example of the nearby and well-studied SN 2013ej. We explore how convective overshoot affects the stellar structure, surface abundances, and effective temperature of massive stars, using the Modules for Experiments in Stellar Astrophysics (MESA). In particular models with moderate overshoot ($f$ = 0.02 to 0.031) show the presence of blue loops in the Hertzsprung-Russell diagram with a red to blue [$log_{10}(T_{eff}/\rm K)$ from $< 3.6$ to $> 4.0$] excursion and transition back to red, during core helium burning phase. Models with overshoot outside this range of $f$ values kept the star in the red supergiant state throughout the post helium ignition phases. The surface CNO abundance shows enrichment post-main-sequence and again around the time when helium is exhausted in core. These evolutionary changes in surface CNO abundance are indistinguishable in the currently available observations due to large observational uncertainties. However, these observations may distinguish between the ratios of surface nitrogen to oxygen at different evolutionary stages of the star. We also compare the effects of convective overshoot on various parameters related to likelihood of explosion of a star as opposed to collapse to a black hole. These parameters are the compactness parameter, M$_4$, and $\mu_4$. Combination $\mu_4 \times $M$_4$, and $\mu_4$ have similar variation with $f$ and both peak out at $f$ = 0.032. We find that all of our 13 M$_{\odot}$ models are likely to explode.


title: Data Analysis Implications of Moderately Eccentric Gravitational Waves

abstract: While the expectation is that the majority of gravitational wave events observable by ground-based detectors will be emitted by compact binaries in quasi-circular orbits, the growing number of detections suggests the possibility of detecting waves from binaries with non-negligible orbital eccentricity in the near future. Several gravitational wave models incorporate the effects of small orbital eccentricities ($e \lesssim 0.2$), but these models may not be sufficient to analyze waves from systems with moderate eccentricity. We recently developed a gravitational wave model that faithfully accounts for eccentric corrections in the moderate eccentricity regime ($e \lesssim 0.8$ for certain source masses) at 3rd post-Newtonian order. Here we consider the data analysis implications of this particular waveform model by producing and analyzing posteriors via Markov Chain Monte Carlo methods. We find that the accuracy to which eccentricity and source masses can be measured can increase by 2 orders of magnitude with increasing eccentricity of the signal. We also find that signals with low eccentricity can be confidently identified as eccentric as soon as their eccentricity exceeds 0.008 (0.05) for low (high) mass systems, suggesting eccentric detections are likely to come first from low-mass systems. We complete our analysis by investigating the systematic (mismodeling) error inherent in our post-Newtonian model, finding that for signals with a signal-to-noise ratio of 15, the systematic error is below the statistical error for eccentricities as high as 0.8 (0.5) for low (high) mass systems. We also investigate the systematic error that arises from using a model that neglects eccentricity when the signal is truly eccentric, finding that the systematic error exceeds the statistical error in mass for eccentricities as small as 0.02.


title: 1-point RANSAC for Circular Motion Estimation in Computed Tomography (CT)

abstract: This paper proposes a RANSAC-based algorithm for determining the axial rotation angle of an object from a pair of its tomographic projections. An equation is derived for calculating the rotation angle using one correct keypoints correspondence of two tomographic projections. The proposed algorithm consists of the following steps: keypoints detection and matching, rotation angle estimation for each correspondence, outliers filtering with the RANSAC algorithm, finally, calculation of the desired angle by minimizing the re-projection error from the remaining correspondences. To validate the proposed method an experimental comparison against methods based on analysis of the distribution of the angles computed from all correspondences is conducted.


title: Topology of symplectomorphism groups and ball-swappings

abstract: In this survey article, we summarize some recent progress and problems on the symplectomorphism groups, with an emphasis on the connection to the space of ball-packings.


title: A note on 1-planar graphs with minimum degree 7

abstract: It is well-known that 1-planar graphs have minimum degree at most 7, and not hard to see that some 1-planar graphs have minimum degree exactly 7. In this note we show that any such 1-planar graph has at least 24 vertices, and this is tight.


title: Time-Dependent Deep Image Prior for Dynamic MRI

abstract: We propose a novel unsupervised deep-learning-based algorithm for dynamic magnetic resonance imaging (MRI) reconstruction. Dynamic MRI requires rapid data acquisition for the study of moving organs such as the heart. Existing reconstruction methods suffer from restrictions either in the model design or in the absence of ground-truth data, resulting in low image quality. We introduce a generalized version of the deep-image-prior approach, which optimizes the network weights to fit a sequence of sparsely acquired dynamic MRI measurements. Our method needs neither prior training nor additional data. In particular, for cardiac images, it does not require the marking of heartbeats or the reordering of spokes. The key ingredients of our method are threefold: 1) a fixed low-dimensional manifold that encodes the temporal variations of images; 2) a network that maps the manifold into a more expressive latent space; and 3) a convolutional neural network that generates a dynamic series of MRI images from the latent variables and that favors their consistency with the measurements in k-space. Our method outperforms the state-of-the-art methods quantitatively and qualitatively in both retrospective and real fetal cardiac datasets. To the best of our knowledge, this is the first unsupervised deep-learning-based method that can reconstruct the continuous variation of dynamic MRI sequences with high spatial resolution.


title: First principles soft mode lattice dynamics of PbZr$_{0.5}$Ti$_{0.5}$O$_3$ and shortcomings of the virtual crystal approximation

abstract: A comparative study between PbTiO$_3$, PbZrO$_3$, and the solid solution PbZr$_{0.5}$Ti$_{0.5}$O$_3$ is performed on the soft mode lattice dynamics within the first Brillouin Zone. We consider the six unique B-site orderings for PbZr$_{0.5}$Ti$_{0.5}$O$_3$ representable within the 2$\times$2$\times$2 primitive perovskite supercell as well as the virtual crystal approximation (VCA) to extract the phonon dispersion relations of a high-symmetry cubic-constrained form using density functional perturbation theory. We find that the most unstable modes in the rock-salt ordered structure and the VCA, like pure PbZrO$_3$, are antiferrodistortive (AFD) whilst lower symmetry arrangements are dominated by $\Gamma$-point ferroelectric (FE) instabilities like pure PbTiO$_3$. Despite similarities in the phonon dispersion relations between the rock-salt ordered supercell and the VCA, the character of modes at high symmetry points are found to be different. In particular, the a$^{0}$a$^{0}$c$^{-}$ & a$^{0}$a$^{0}$c$^{+}$ AFD instabilities of the rock-salt ordering are replaced with a$^{-}$b$^{-}$c$^{-}$ & a$^{+}$b$^{+}$c$^{+}$ instabilities within the VCA. Such a rotation pattern is not seen in any of the supercell-based calculations thus serving as a quantitative example of the inability of the method to represent accurately local structural distortions. Single modes are found exhibiting dual order parameters. At the zone centre, some arrangements show mixed FE & antipolar soft modes (due to Pb motion tansverse to the polar axis) and at long wavelengths all arrangements have soft modes of a mixed antipolar & AFD character. These are described with direct analysis of the eigendisplacements.


title: Study of J/$\psi$ meson production inside jets in pp collisions at $\sqrt{s} =$ 8 TeV

abstract: A study of the production of prompt J/$\psi$ mesons contained in jets in proton-proton collisions at $\sqrt{s} =$ 8 TeV is presented. The analysis is based on data corresponding to an integrated luminosity of 19.1 fb$^{-1}$ collected with the CMS detector at the LHC. For events with at least one observed jet, the angular separation between the J/$\psi$ meson and the jet is used to test whether the J/$\psi$ meson is part of the jet. The analysis shows that most prompt J/$\psi$ mesons with energy above 15 GeV and rapidity $|y|<$ 1 are contained in jets with pseudorapidity $|\eta_{\text{jet}}|$ $<$ 1. The differential distributions of the probability to have a J/$\psi$ meson contained in a jet as a function of jet energy for a fixed J/$\psi$ energy fraction are compared to a theoretical model using the fragmenting jet function approach. The data agree best with fragmenting jet function calculations that use a long-distance matrix element parameter set in which prompt J/$\psi$ mesons are predicted to be unpolarized. This technique demonstrates a new way to test predictions for prompt J/$\psi$ production using nonrelativistic quantum chromodynamics.


title: A Likely Inclination Dependence in the Non-linear Variability of Quasi Periodic Oscillations from Black Hole Binaries

abstract: We present a systematic analysis of the effects of orbital inclination angle on the non-linear variability properties of type-B and type-C QPOs from black hole binaries. We use the bicoherence, a measure of phase coupling at different Fourier frequencies for our analysis. We find that there is a likely inclination dependent change in the non-linear properties of type-C QPOs as the source transitions from a hard intermediate state to a soft intermediate state. High inclination (edge-on) sources show a change from a `web' to a `cross' pattern, while the low inclination (face-on) sources show a change from a `web' to a `hypotenuse' pattern. We present a scenario of a moderate increase in the optical depth of the Comptonising region as a possible explanation of these effects. The bicoherence of type-B QPOs do not exhibit any measurable inclination dependence.


title: Bayesian Optimization for Materials Design with Mixed Quantitative and Qualitative Variables

abstract: Although Bayesian Optimization (BO) has been employed for accelerating materials design in computational materials engineering, existing works are restricted to problems with quantitative variables. However, real designs of materials systems involve both qualitative and quantitative design variables representing material compositions, microstructure morphology, and processing conditions. For mixed-variable problems, existing Bayesian Optimization (BO) approaches represent qualitative factors by dummy variables first and then fit a standard Gaussian process (GP) model with numerical variables as the surrogate model. This approach is restrictive theoretically and fails to capture complex correlations between qualitative levels. We present in this paper the integration of a novel latent-variable (LV) approach for mixed-variable GP modeling with the BO framework for materials design. LVGP is a fundamentally different approach that maps qualitative design variables to underlying numerical LV in GP, which has strong physical justification. It provides flexible parameterization and representation of qualitative factors and shows superior modeling accuracy compared to the existing methods. We demonstrate our approach through testing with numerical examples and materials design examples. It is found that in all test examples the mapped LVs provide intuitive visualization and substantial insight into the nature and effects of the qualitative factors. Though materials designs are used as examples, the method presented is generic and can be utilized for other mixed variable design optimization problems that involve expensive physics-based simulations.


title: Spike-based causal inference for weight alignment

abstract: In artificial neural networks trained with gradient descent, the weights used for processing stimuli are also used during backward passes to calculate gradients. For the real brain to approximate gradients, gradient information would have to be propagated separately, such that one set of synaptic weights is used for processing and another set is used for backward passes. This produces the so-called "weight transport problem" for biological models of learning, where the backward weights used to calculate gradients need to mirror the forward weights used to process stimuli. This weight transport problem has been considered so hard that popular proposals for biological learning assume that the backward weights are simply random, as in the feedback alignment algorithm. However, such random weights do not appear to work well for large networks. Here we show how the discontinuity introduced in a spiking system can lead to a solution to this problem. The resulting algorithm is a special case of an estimator used for causal inference in econometrics, regression discontinuity design. We show empirically that this algorithm rapidly makes the backward weights approximate the forward weights. As the backward weights become correct, this improves learning performance over feedback alignment on tasks such as Fashion-MNIST, SVHN, CIFAR-10 and VOC. Our results demonstrate that a simple learning rule in a spiking network can allow neurons to produce the right backward connections and thus solve the weight transport problem.


title: Thermalization in the D1D5 CFT

abstract: It is generally agreed that black hole formation in gravity corresponds to thermalization in the dual CFT. It is sometimes argued that if the CFT evolution shows evidence of large redshift in gravity, then we have seen black hole formation in the CFT. We argue that this is not the case: a clock falling towards the horizon increases its redshift but remains intact as a clock; thus it is not `thermalized'. Instead, thermalization should correspond to a new phase after the phase of large redshift, where the infalling object turns into fuzzballs on reaching within planck distance of the horizon. We compute simple examples of the scattering vertex in the D1D5 CFT which, after many iterations, would lead to thermalization. An initial state made of two left-moving and two right-moving excitations corresponds, in gravity, to two gravitons heading towards each other. The thermalization vertex in the CFT breaks these excitations into multiple excitations on the left and right sides; we compute the amplitudes for several of these processes. We find secular terms that grow as $t^2$ instead of oscillating with $t$; we conjecture that this may be a feature of processes leading to thermalization.


title: The Structure of Phase Diagrams in Matter-Radiation Systems

abstract: We present a study of the structure of phase diagrams for matter-radiation systems, based on the use of coherent states and the catastrophe formalism, that compares very well with the exact quantum solutions as well as providing analytical expressions. Emphasis is made on $2$- and $3$-level systems, but in general $n$-level systems in the presence of $\ell$ electromagnetic modes are described. Due to the infinite-dimensional nature of the Hilbert space, and using the results of the analyses and the behaviour of the solutions, we construct a sequence of ever-approximating reduced bases, which make possible the study of larger systems both, in the number of atoms and in the number of excitations. These studies are of importance in fundamental quantum optics, quantum information, and quantum cryptography scenarios.


title: Algebraic statistics, tables, and networks: The Fienberg advantage

abstract: Stephen Fienberg's affinity for contingency table problems and reinterpreting models with a fresh look gave rise to a new approach for hypothesis testing of network models that are linear exponential families. We outline his vision and influence in this fundamental problem, as well as generalizations to multigraphs and hypergraphs.


title: Behavior Mixing with Minimum Global and Subgroup Connectivity Maintenance for Large-Scale Multi-Robot Systems

abstract: In many cases the multi-robot systems are desired to execute simultaneously multiple behaviors with different controllers, and sequences of behaviors in real time, which we call \textit{behavior mixing}. Behavior mixing is accomplished when different subgroups of the overall robot team change their controllers to collectively achieve given tasks while maintaining connectivity within and across subgroups in one connected communication graph. In this paper, we present a provably minimum connectivity maintenance framework to ensure the subgroups and overall robot team stay connected at all times while providing the highest freedom for behavior mixing. In particular, we propose a real-time distributed Minimum Connectivity Constraint Spanning Tree (MCCST) algorithm to select the minimum inter-robot connectivity constraints preserving subgroup and global connectivity that are \textit{least likely to be violated} by the original controllers. With the employed safety and connectivity barrier certificates for the activated connectivity constraints and collision avoidance, the behavior mixing controllers are thus minimally modified from the original controllers. We demonstrate the effectiveness and scalability of our approach via simulations of up to 100 robots with multiple behaviors.


title: Fluid Flow Mass Transport for Generative Networks

abstract: Generative Adversarial Networks have been shown to be powerful in generating content. To this end, they have been studied intensively in the last few years. Nonetheless, training these networks requires solving a saddle point problem that is difficult to solve and slowly converging. Motivated from techniques in the registration of point clouds and by the fluid flow formulation of mass transport, we investigate a new formulation that is based on strict minimization, without the need for the maximization. The formulation views the problem as a matching problem rather than an adversarial one and thus allows us to quickly converge and obtain meaningful metrics in the optimization path.


title: Realization of 2D Crystalline Metal Nitrides via Selective Atomic Substitution

abstract: Two-dimensional (2D) transition metal nitrides (TMNs) are new members in the 2D materials family with a wide range of applications. Particularly, highly crystalline and large area thin films of TMNs are potentially promising for applications in electronic and optoelectronic devices; however, the synthesis of such TMNs has not yet been achieved. Here, we report the synthesis of few-nanometer thin Mo5N6 crystals with large area and high quality via in situ chemical conversion of layered MoS2 crystals. The structure and quality of the ultrathin Mo5N6 crystal are confirmed using transmission electron microscopy, Raman spectroscopy and X-ray photoelectron spectroscopy. The large lateral dimensions of Mo5N6 crystals are inherited from the MoS2 crystals that are used for the conversion. Atomic force microscopy characterization reveals the thickness of Mo5N6 crystals is reduced to about 1/3 of the MoS2 crystal. Electrical measurements show the obtained Mo5N6 samples are metallic with high electrical conductivity (~ 100 {\Omega} sq-1), which is comparable to graphene. The versatility of this general approach is demonstrated by expanding the method to synthesize W5N6 and TiN. Our strategy offers a new direction for preparing 2D TMNs with desirable characteristics, opening a door for studying fundamental physics and facilitating the development of next generation electronics.


title: Two-outcome synchronous correlation sets and Connes' embedding problem

abstract: We show that Connes' embedding problem is equivalent to the weak Tsirelson problem in the setting of two-outcome synchronous correlation sets. We further show that the extreme points of two-outcome synchronous correlation sets can be realized using a certain class of universal C*-algebras. We examine these algebras in the three-experiment case and verify that the strong and weak Tsirelson problems have affirmative answers in that setting.


title: A Henkin-style completeness proof for the modal logic S5

abstract: This paper presents a recent formalization of a Henkin-style completeness proof for the propositional modal logic S5 using the Lean theorem prover. The proof formalized is close to that of Hughes and Cresswell, but the system, based on a different choice of axioms, is better described as a Mendelson system augmented with axiom schemes for K, T, S4, and B, and the necessitation rule as a rule of inference. The language has the false and implication as the only primitive logical connectives and necessity as the only primitive modal operator. The full source code is available online at https://github.com/bbentzen/mpl/ and has been typechecked with Lean 3.4.2.


title: First inverse kinematics study of the $^{22}$Ne$(p,\gamma)^{23}$Na reaction and its role in AGB star and classical nova nucleosynthesis

abstract: The abundances of sodium and oxygen are observed to be anti-correlated in all well-studied globular clusters. Asymptotic giant branch (AGB) stars undergoing hot bottom burning (HBB) are thought to be prime candidates for producing sodium-rich oxygen-poor material and expelling it into the cluster ISM. The 22Ne(p,gamma)23Na reaction has been shown to strongly influence the amount of 23Na produced during HBB. This reaction is also important for classical novae nucleosynthesis, with sensitivity studies showing that the abundances of several isotopes in the Ne-Al region are significantly altered when varying the reaction rate between available compilations. Here we present the first inverse kinematics measurements of key resonances strengths as well as the direct capture S-factor. Together, this study represents the largest centre of mass energy range (149-1222 keV) over which this reaction has been measured in a single experiment. Our results for low-energy resonances at Ecm=149, 181 and 248 keV are in good agreement with recent forward kinematics results; we also find a direct capture S-factor consistent with the literature value of 62 keV.b. However, in the case of the important reference resonance at Ecm = 458 keV we find a strength value of wg=0.44 +/- 0.02 eV, which is significantly lower than recent results. Using our new recommended rate we explore the impact of these results on both AGB star and classical novae nucleosynthesis. In the case of AGB stars we see very little abundance changes with respect to the rate included in the STARLIB-2013. However, we observe changes of up to a factor of 2 in isotopes produced in both the carbon-oxygen (CO) and oxygen-neon (ONe) classical novae models considered here. The 22Ne(p,gamma)23Na reaction rate is now sufficiently well constrained to not significantly contribute toward abundance uncertainties from classical novae nucleosynthesis models.


title: Deformed general relativity

abstract: In this thesis, I investigate how to construct a self-consistent model of deformed general relativity using canonical methods and metric variables. The specific deformation of general covariance is predicted by some studies into loop quantum cosmology. I firstly find the minimally-deformed model for a scalar-tensor theory, thereby establishing a classical reference point, and investigate the cosmological effects of a non-minimal coupled scalar field. By treating the deformation perturbatively, I derive the deformed gravitational action which includes the nearest order of curvature corrections. Then working more generally, I derive the deformed scalar-tensor constraint to all orders and I find that the momenta and spatial derivatives from gravity and matter must combine in a very specific form. It suggests that the deformation should be equally affected by matter field derivatives as it is by gravitational curvature. Finally, I derive the deformed gravitational action to all orders, and find how intrinsic and extrinsic curvatures differently affect the deformation. The deformation seems to be required to satisfy a non-linear equation usually found in fluid mechanics.


title: Implementing Grover oracles for quantum key search on AES and LowMC

abstract: Grover's search algorithm gives a quantum attack against block ciphers by searching for a key that matches a small number of plaintext-ciphertext pairs. This attack uses $O(\sqrt{N})$ calls to the cipher to search a key space of size $N$. Previous work in the specific case of AES derived the full gate cost by analyzing quantum circuits for the cipher, but focused on minimizing the number of qubits. In contrast, we study the cost of quantum key search attacks under a depth restriction and introduce techniques that reduce the oracle depth, even if it requires more qubits. As cases in point, we design quantum circuits for the block ciphers AES and LowMC. Our circuits give a lower overall attack cost in both the gate count and depth-times-width cost models. In NIST's post-quantum cryptography standardization process, security categories are defined based on the concrete cost of quantum key search against AES. We present new, lower cost estimates for each category, so our work has immediate implications for the security assessment of post-quantum cryptography. As part of this work, we release Q# implementations of the full Grover oracle for AES-128, -192, -256 and for the three LowMC instantiations used in Picnic, including unit tests and code to reproduce our quantum resource estimates. To the best of our knowledge, these are the first two such full implementations and automatic resource estimations.


title: Low-cost LIDAR based Vehicle Pose Estimation and Tracking

abstract: Detecting surrounding vehicles by low-cost LIDAR has been drawing enormous attention. In low-cost LIDAR, vehicles present a multi-layer L-Shape. Based on our previous optimization/criteria-based L-Shape fitting algorithm, we here propose a data-driven and model-based method for robust vehicle segmentation and tracking. The new method uses T-linkage RANSAC to take a limited amount of noisy data and performs a robust segmentation for a moving car against noise. Compared with our previous method, T-Linkage RANSAC is more tolerant of observation uncertainties, i.e., the number of sides of the target being observed, and gets rid of the L-Shape assumption. In addition, a vehicle tracking system with Multi-Model Association (MMA) is built upon the segmentation result, which provides smooth trajectories of tracked objects. A manually labeled dataset from low-cost multi-layer LIDARs for validation will also be released with the paper. Experiments on the dataset show that the new approach outperforms previous ones based on multiple criteria. The new algorithm can also run in real-time.


title: Charge disproportionation and site-selective local magnetic moments in the post-perovskite-type Fe$_2$O$_3$ under ultra-high pressures

abstract: The archetypal $3d$ Mott insulator hematite, Fe$_2$O$_3$, is one of the basic oxide components playing an important role in mineralogy of Earth's lower mantle. Its high pressure-temperature behavior, such as the electronic properties, equation of state, and phase stability is of fundamental importance for understanding the properties and evolution of the Earth's interior. Here, we study the electronic structure, magnetic state, and lattice stability of Fe$_2$O$_3$ at ultra-high pressures using the density functional plus dynamical mean-field theory (DFT+DMFT) approach. In the vicinity of a Mott transition, Fe$_2$O$_3$ is found to exhibit a series of complex electronic, magnetic, and structural transformations. In particular, it makes a phase transition to a metal with a post-perovskite crystal structure and site-selective local moments upon compression above 75 GPa. We show that the site-selective phase transition is accompanied by a charge disproportionation of Fe ions, with Fe$^{3\pm \delta}$ and $\delta \sim 0.05$-$0.09$, implying a complex interplay between electronic correlations and the lattice. Our results suggest that site-selective local moments in Fe$_2$O$_3$ persist up to ultra-high pressures of $\sim$200-250 GPa, i.e., sufficiently above the core-mantle boundary. The latter can have important consequences for understanding of the velocity and density anomalies in the Earth's lower mantle.


title: Searches for Dark Matter at the LHC in forward proton mode

abstract: We analyze in detail the LHC prospects at the center-of-mass energy of 14 TeV for charged electroweakino searches, decaying to leptons, in compressed supersymmetry scenarios, via exclusive photon-initiated pair production. This provides a potentially increased sensitivity in comparison to inclusive channels, where the background is often overwhelming. We pay particular attention to the challenges that such searches would face in the hostile high pile-up environment of the LHC, giving close consideration to the backgrounds that will be present. The signal we focus on is the exclusive production of same-flavour muon and electron pairs, with missing energy in the final state, and with two outgoing intact protons registered by the dedicated forward proton detectors installed in association with ATLAS and CMS. We present results for slepton masses of 120--300 GeV and slepton-neutralino mass splitting of 10-20 GeV, and find that the relevant backgrounds can be controlled to the level of the expected signal yields. The most significant such backgrounds are due to semi-exclusive lepton pair production at lower masses, with a proton produced in the initial proton dissociation system registering in the forward detectors, and from the coincidence of forward protons produced in pile-up events with an inclusive central event that mimics the signal. We also outline a range of potential methods to further suppress these backgrounds as well as to enlarge the signal yields.


title: Shaping Magnetite Nanoparticles from First-principles

abstract: Iron oxide magnetic nanoparticles (NPs) are stimuli-responsive materials at the forefront of nanomedicine. Their realistic finite temperature simulations are a formidable challenge for first-principles methods. Here, we use density functional tight binding to open up the required time and length scales and obtain global minimum structures of Fe3O4 NPs of realistic size (1400 atoms, 2.5 nm) and of different shapes, which we then refine with hybrid density functional theory methods to accomplish proper electronic and magnetic properties, which have never been accurately described in simulations. On this basis, we develop a general empirical formula and prove its predictive power for the evaluation of the total magnetic moment of Fe3O4 NPs. By converting the total magnetic moment into the macroscopic saturation magnetization, we rationalize the experimentally observed dependence with shape. We also reveal interesting reconstruction mechanisms and unexpected patterns of charge ordering.


title: Is Fast Adaptation All You Need?

abstract: Gradient-based meta-learning has proven to be highly effective at learning model initializations, representations, and update rules that allow fast adaptation from a few samples. The core idea behind these approaches is to use fast adaptation and generalization -- two second-order metrics -- as training signals on a meta-training dataset. However, little attention has been given to other possible second-order metrics. In this paper, we investigate a different training signal -- robustness to catastrophic interference -- and demonstrate that representations learned by directing minimizing interference are more conducive to incremental learning than those learned by just maximizing fast adaptation.


title: Bounds for Approximate Regret-Matching Algorithms

abstract: A dominant approach to solving large imperfect-information games is Counterfactural Regret Minimization (CFR). In CFR, many regret minimization problems are combined to solve the game. For very large games, abstraction is typically needed to render CFR tractable. Abstractions are often manually tuned, possibly removing important strategic differences in the full game and harming performance. Function approximation provides a natural solution to finding good abstractions to approximate the full game. A common approach to incorporating function approximation is to learn the inputs needed for a regret minimizing algorithm, allowing for generalization across many regret minimization problems. This paper gives regret bounds when a regret minimizing algorithm uses estimates instead of true values. This form of analysis is the first to generalize to a larger class of $(\Phi, f)$-regret matching algorithms, and includes different forms of regret such as swap, internal, and external regret. We demonstrate how these results give a slightly tighter bound for Regression Regret-Matching (RRM), and present a novel bound for combining regression with Hedge.


title: Many-body collision contributions to electron momentum damping rates in a plasma influenced by electron strong coupling

abstract: Experimental studies of electron-ion collision rates in an ultracold neutral plasma (UNP) can be conducted through measuring the rate of electron plasma oscillation damping. For sufficiently cold and dense conditions where strong coupling influences are important, the measured damping rate was faster by 37\% than theoretical expectations [W. Chen, C. Witte, and J. Roberts, Phys. Rev. E \textbf{96}, 013203 (2017)]. We have conducted a series of numerical simulations to isolate the primary source of this difference. By analyzing the distribution of electron velocity changes due to collisions in a molecular dynamics simulation, examining the trajectory of electrons with high deflection angle in such simulations, and examining the oscillation damping rate while varying the ratio of two-body to three-body electron-ion collision rates, we have found that the difference is consistent with the effect due to many-body collisions leading to bound electrons. This has implications for other electron-ion collision related transport properties in addition to electron oscillation damping.


title: Benchmarking Batch Deep Reinforcement Learning Algorithms

abstract: Widely-used deep reinforcement learning algorithms have been shown to fail in the batch setting--learning from a fixed data set without interaction with the environment. Following this result, there have been several papers showing reasonable performances under a variety of environments and batch settings. In this paper, we benchmark the performance of recent off-policy and batch reinforcement learning algorithms under unified settings on the Atari domain, with data generated by a single partially-trained behavioral policy. We find that under these conditions, many of these algorithms underperform DQN trained online with the same amount of data, as well as the partially-trained behavioral policy. To introduce a strong baseline, we adapt the Batch-Constrained Q-learning algorithm to a discrete-action setting, and show it outperforms all existing algorithms at this task.


title: Semi-Supervised Generative Modeling for Controllable Speech Synthesis

abstract: We present a novel generative model that combines state-of-the-art neural text-to-speech (TTS) with semi-supervised probabilistic latent variable models. By providing partial supervision to some of the latent variables, we are able to force them to take on consistent and interpretable purposes, which previously hasn't been possible with purely unsupervised TTS models. We demonstrate that our model is able to reliably discover and control important but rarely labelled attributes of speech, such as affect and speaking rate, with as little as 1% (30 minutes) supervision. Even at such low supervision levels we do not observe a degradation of synthesis quality compared to a state-of-the-art baseline. Audio samples are available on the web.


title: F-theory superspace backgrounds

abstract: F-theory is the theory proposed to incorporate superstring theory in a way such that STU dualities are manifest. A useful description uses a current superalgebra on a higher-dimensional worldvolume, following from an action for a selfdual gauge field. Here the group "metric" appearing in the Schwinger (central charge) term of this current superalgebra is generalized to a tensor, in analogy to the usual generalization of the structure constants to the torsion (and curvature). This allows introduction of a massless background describing F-supergravity on the original bosonic worldvolume. The isotropy group is represented on superspace, while the (exceptional) symmetry is represented on the worldvolume. As an example, we solve off shell the linearized superspace constraints of the massless sector of the F-theory that generalizes the N=2 supergravity (+ matter) of 3D S(tring)-theory, the corresponding manifestly T-dual theory of T-theory, and the N=1 supergravity of 4D M-theory. The results for the prepotential, its gauge transformation, and action agree with those that were derived previously without reference to the current algebra of the full F-theory.


title: Understanding the Heart of the 5G Air Interface: An Overview of Physical Downlink Control Channel for 5G New Radio (NR)

abstract: New Radio (NR) is a new radio air interface developed by the 3rd Generation Partnership Project (3GPP) for the fifth generation (5G) mobile communications system. With great flexibility, scalability, and efficiency, 5G is expected to address a wide range of use-cases including enhanced mobile broadband (eMBB), ultra-reliable low-latency communications (URLLC), and massive machine type communications (mMTC). The physical downlink control channel (PDCCH) in NR carries Downlink Control Information (DCI). Understanding how PDCCH operates is key to developing a good understanding of how information is communicated over NR. This paper provides an overview of the 5G NR PDCCH by describing its physical layer structure, monitoring mechanisms, beamforming operation, and the carried information. We also share various design rationales that influence NR standardization.


title: 360-Indoor: Towards Learning Real-World Objects in 360{\deg} Indoor Equirectangular Images

abstract: While there are several widely used object detection datasets, current computer vision algorithms are still limited in conventional images. Such images narrow our vision in a restricted region. On the other hand, 360{\deg} images provide a thorough sight. In this paper, our goal is to provide a standard dataset to facilitate the vision and machine learning communities in 360{\deg} domain. To facilitate the research, we present a real-world 360{\deg} panoramic object detection dataset, 360-Indoor, which is a new benchmark for visual object detection and class recognition in 360{\deg} indoor images. It is achieved by gathering images of complex indoor scenes containing common objects and the intensive annotated bounding field-of-view. In addition, 360-Indoor has several distinct properties: (1) the largest category number (37 labels in total). (2) the most complete annotations on average (27 bounding boxes per image). The selected 37 objects are all common in indoor scene. With around 3k images and 90k labels in total, 360-Indoor achieves the largest dataset for detection in 360{\deg} images. In the end, extensive experiments on the state-of-the-art methods for both classification and detection are provided. We will release this dataset in the near future.


title: REDS: Rule Extraction for Discovering Scenarios

abstract: Scenario discovery is the process of finding areas of interest, known as scenarios, in data spaces resulting from simulations. For instance, one might search for conditions, i.e., inputs of the simulation model, where the system is unstable. Subgroup discovery methods are commonly used for scenario discovery. They find scenarios in the form of hyperboxes, which are easy to comprehend. Given a computational budget, results tend to get worse as the number of inputs of the simulation model and the cost of simulations increase. We propose a new procedure for scenario discovery from few simulations, dubbed REDS. A key ingredient is using an intermediate machine learning model to label data for subsequent use by conventional subgroup discovery methods. We provide statistical arguments why this is an improvement. In our experiments, REDS reduces the number of simulations required by 50--75\% on average, depending on the quality measure. It is also useful as a semi-supervised subgroup discovery method and for discovering better scenarios from third-party data, when a simulation model is not available.


title: Input-to-state stability of infinite-dimensional systems: recent results and open questions

abstract: In a pedagogical but exhaustive manner, this survey reviews the main results on input-to-state stability (ISS) for infinite-dimensional systems. This property allows estimating the impact of inputs and initial conditions on both the intermediate values and the asymptotic bound on the solutions. ISS has unified the input-output and Lyapunov stability theories and is a crucial property in the stability theory of control systems as well as for many applications whose dynamics depend on parameters, unknown perturbations, or other inputs. In this paper, starting from classic results for nonlinear ordinary differential equations, we motivate the study of ISS property for distributed parameter systems. Then fundamental properties are given, as an ISS superposition theorem and characterizations of (global and local) ISS in terms of Lyapunov functions. We explain in detail the functional-analytic approach to ISS theory of linear systems with unbounded input operators, with special attention devoted to ISS theory of boundary control systems. The Lyapunov method is shown to be very useful for both linear and nonlinear models, including parabolic and hyperbolic partial differential equations. Next, we show the efficiency of the ISS framework to study the stability of large-scale networks, coupled either via the boundary or via the interior of the spatial domain. ISS methodology allows reducing the stability analysis of complex networks, by considering the stability properties of its components and the interconnection structure between the subsystems. An extra section is devoted to ISS theory of time-delay systems with the emphasis on techniques, which are particularly suited for this class of systems. Finally, numerous applications are considered in this survey, where ISS properties play a crucial role in their study. This survey suggests many open problems throughout the paper.


title: Temperature-programmed reduction and dispersive X-ray absorption spectroscopy studies of CeO2-based nanopowders for intermediate-temperature Solid-Oxide Fuel Cell anodes

abstract: In this work, we study the influence of the average crystallite size and dopant oxide on the reducibility of CeO2-based nanomaterials. Samples were prepared from commercial Gd2O3-, Sm2O3- and Y2O3-doped CeO2 powders by calcination at different temperatures ranging between 400 and 900C and characterized by X-ray powder diffraction, transmission electron microscopy and BET specific surface area. The reducibility of the samples was analyzed by temperature-programmed reduction and in situ dispersive X-ray absorption spectroscopy techniques. Our results clearly demonstrate that samples treated at lower temperatures, of smallest average crystallite size and highest specific surface areas, exhibit the best performance, while Gd2O3-doped ceria materials display higher reducibility than Sm2O3- and Y2O3-doped CeO2.


title: False Data Injection Attacks in Internet of Things and Deep Learning enabled Predictive Analytics

abstract: Industry 4.0 is the latest industrial revolution primarily merging automation with advanced manufacturing to reduce direct human effort and resources. Predictive maintenance (PdM) is an industry 4.0 solution, which facilitates predicting faults in a component or a system powered by state-of-the-art machine learning (ML) algorithms and the Internet-of-Things (IoT) sensors. However, IoT sensors and deep learning (DL) algorithms, both are known for their vulnerabilities to cyber-attacks. In the context of PdM systems, such attacks can have catastrophic consequences as they are hard to detect due to the nature of the attack. To date, the majority of the published literature focuses on the accuracy of DL enabled PdM systems and often ignores the effect of such attacks. In this paper, we demonstrate the effect of IoT sensor attacks on a PdM system. At first, we use three state-of-the-art DL algorithms, specifically, Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Convolutional Neural Network (CNN) for predicting the Remaining Useful Life (RUL) of a turbofan engine using NASA's C-MAPSS dataset. The obtained results show that the GRU-based PdM model outperforms some of the recent literature on RUL prediction using the C-MAPSS dataset. Afterward, we model two different types of false data injection attacks (FDIA) on turbofan engine sensor data and evaluate their impact on CNN, LSTM, and GRU-based PdM systems. The obtained results demonstrate that FDI attacks on even a few IoT sensors can strongly defect the RUL prediction. However, the GRU-based PdM model performs better in terms of accuracy and resiliency. Lastly, we perform a study on the GRU-based PdM model using four different GRU networks with different sequence lengths. Our experiments reveal an interesting relationship between the accuracy, resiliency and sequence length for the GRU-based PdM models.


title: On the Detection of Digital Face Manipulation

abstract: Detecting manipulated facial images and videos is an increasingly important topic in digital media forensics. As advanced face synthesis and manipulation methods are made available, new types of fake face representations are being created which have raised significant concerns for their use in social media. Hence, it is crucial to detect manipulated face images and localize manipulated regions. Instead of simply using multi-task learning to simultaneously detect manipulated images and predict the manipulated mask (regions), we propose to utilize an attention mechanism to process and improve the feature maps for the classification task. The learned attention maps highlight the informative regions to further improve the binary classification (genuine face v. fake face), and also visualize the manipulated regions. To enable our study of manipulated face detection and localization, we collect a large-scale database that contains numerous types of facial forgeries. With this dataset, we perform a thorough analysis of data-driven fake face detection. We show that the use of an attention mechanism improves facial forgery detection and manipulated region localization.


title: Radiation from Global Topological Strings using Adaptive Mesh Refinement: Methodology and Massless Modes

abstract: We implement adaptive mesh refinement (AMR) simulations of global topological strings using the public numerical relativity code, GRChombo. We perform a quantitative investigation of the dynamics of single sinusoidally displaced string configurations, studying a wide range of string energy densities $\mu \propto \ln{\lambda}$, defined by the string width parameter $\lambda$ over two orders of magnitude. We investigate the resulting massless (Goldstone boson or axion) radiation signals, using quantitative diagnostic tools to determine the eigenmode decomposition. Given analytic radiation predictions, we compare the oscillating string trajectory with a backreaction model accounting for radiation energy losses, finding excellent agreement. We establish that backreaction decay is accurately characterised by the inverse square of the amplitude being proportional to the inverse tension $\mu$ for $3\lesssim \lambda \lesssim 100$. We conclude that analytic radiation modelling in the thin-string (Nambu-Goto) limit provides the appropriate cosmological limit for global strings. We contextualise these results with respect to axions and gravitational waves produced by cosmic string networks.


title: Digital Twin: Values, Challenges and Enablers

abstract: A digital twin can be defined as an adaptive model of a complex physical system. Recent advances in computational pipelines, multiphysics solvers, artificial intelligence, big data cybernetics, data processing and management tools bring the promise of digital twins and their impact on society closer to reality. Digital twinning is now an important and emerging trend in many applications. Also referred to as a computational megamodel, device shadow, mirrored system, avatar or a synchronized virtual prototype, there can be no doubt that a digital twin plays a transformative role not only in how we design and operate cyber-physical intelligent systems, but also in how we advance the modularity of multi-disciplinary systems to tackle fundamental barriers not addressed by the current, evolutionary modeling practices. In this work, we review the recent status of methodologies and techniques related to the construction of digital twins. Our aim is to provide a detailed coverage of the current challenges and enabling technologies along with recommendations and reflections for various stakeholders.


title: Bots, elections, and social media: a brief overview

abstract: Bots, software-controlled accounts that operate on social media, have been used to manipulate and deceive. We studied the characteristics and activity of bots around major political events, including elections in various countries. In this chapter, we summarize our findings of bot operations in the context of the 2016 and 2018 US Presidential and Midterm elections and the 2017 French Presidential election.


title: A Critical View on CIS Controls

abstract: CIS Controls is a set of 20 controls and 171 sub-controls that were created with an idea of having a list of something to implement so that organizations can increase their security. While good in theory, it is a big question of how viable this approach is in practice, and does it really help. There is only a minor number of critical views of CIS Controls and since CIS Controls are marketed by two very influential organizations they are very popular. Yet, there are alternatives published by ISO, NIST and even PCI consortium. In this paper we critically assess CIS Controls, assumptions on which they are based as well as validity of approach and claims made in its favor. The conclusion is that scientific community should be more active regarding this topic, but also that more material is necessary. This is something that CIS and SANS should support if they want to make CIS Controls viable alternative to other approaches.


title: Constant State of Change: Engagement Inequality in Temporal Dynamic Networks

abstract: The temporal changes in complex systems of interactions have excited the research community in recent years as they encompass understandings on their dynamics and evolution. From the collective dynamics of organizations and online communities to the spreading of information and fake news, to name a few, temporal dynamics are fundamental in the understanding of complex systems. In this work, we quantify the level of engagement in dynamic complex systems of interactions, modeled as networks. We focus on interaction networks for which the dynamics of the interactions are coupled with that of the topology, such as online messaging, forums, and emails. We define two indices to capture the temporal level of engagement: the Temporal Network (edge) Intensity index, and the Temporal Dominance Inequality index. Our surprising results are that these measures are stationary for most measured networks, regardless of vast fluctuations in the size of the networks in time. Moreover, more than 80% of weekly changes in the indices values are bounded by less than 10%. The indices are stable between the temporal evolution of a network but are different between networks, and a classifier can determine the network the temporal indices belong to with high success. We find an exception in the Enron management email exchange during the year before its disintegration, in which both indices show high volatility throughout the inspected period.


title: Using Logical Specifications of Objectives in Multi-Objective Reinforcement Learning

abstract: It is notoriously difficult to control the behavior of reinforcement learning agents. Agents often learn to exploit the environment or reward signal and need to be retrained multiple times. The multi-objective reinforcement learning (MORL) framework separates a reward function into several objectives. An ideal MORL agent learns to generalize to novel combinations of objectives allowing for better control of an agent's behavior without requiring retraining. Many MORL approaches use a weight vector to parameterize the importance of each objective. However, this approach suffers from lack of expressiveness and interpretability. We propose using propositional logic to specify the importance of multiple objectives. By using a logic where predicates correspond directly to objectives, specifications are inherently more interpretable. Additionally the set of specifications that can be expressed with formal languages is a superset of what can be expressed by weight vectors. In this paper, we define a formal language based on propositional logic with quantitative semantics. We encode logical specifications using a recurrent neural network and show that MORL agents parameterized by these encodings are able to generalize to novel specifications over objectives and achieve performance comparable to single objective baselines.


title: Sparse Identification of Contrast Gain Control in the Fruit Fly Photoreceptor and Amacrine Cell Layer

abstract: The fruit fly's natural visual environment is often characterized by light intensities ranging across several orders of magnitude and by rapidly varying contrast across space and time. Fruit fly photoreceptors robustly transduce and, in conjunction with amacrine cells, process visual scenes and provide the resulting signal to downstream targets. Here we model the first step of visual processing in the photoreceptor-amacrine cell layer. We propose a novel divisive normalization processor (DNP) for modeling the computation taking place in the photoreceptor-amacrine cell layer. The DNP explicitly models the photoreceptor feedforward and temporal feedback processing paths and the spatio-temporal feedback path of the amacrine cells. We then formally characterize the contrast gain control of the DNP and provide sparse identification algorithms that can efficiently identify each the feedforward and feedback DNP components. The algorithms presented here are the first demonstration of tractable and robust identification of the components of a divisive normalization processor. The sparse identification algorithms can be readily employed in experimental settings, and their effectiveness is demonstrated with several examples.


title: A hypersurface containing the support of a Radon transform must be an ellipsoid. I

abstract: If the Radon transform of a compactly supported distribution $f \ne 0$ in $\mathbb R^n$ is supported on the set of tangent planes to the boundary $\partial D$ of a bounded convex domain $D$, then $\partial D$ must be an ellipsoid. As a corollary of this result we get a new proof of a recent theorem of Koldobsky, Merkurjev, and Yaskin, which settled a special case of a conjecture of Arnold that was motivated by a famous lemma of Newton.


title: A machine learning method correlating pulse pressure wave data with pregnancy

abstract: Pulse feeling, representing the tactile arterial palpation of the heartbeat, has been widely used in traditional Chinese medicine (TCM) to diagnose various diseases. The quantitative relationship between the pulse wave and health conditions however has not been investigated in modern medicine. In this paper, we explored the correlation between pulse pressure wave (PPW), rather than the pulse key features in TCM, and pregnancy by using deep learning technology. This computational approach shows that the accuracy of pregnancy detection by the PPW is 84% with an AUC of 91%. Our study is a proof of concept of pulse diagnosis and will also motivate further sophisticated investigations on pulse waves.


title: Generalized Inner Loop Meta-Learning

abstract: Many (but not all) approaches self-qualifying as "meta-learning" in deep learning and reinforcement learning fit a common pattern of approximating the solution to a nested optimization problem. In this paper, we give a formalization of this shared pattern, which we call GIMLI, prove its general requirements, and derive a general-purpose algorithm for implementing similar approaches. Based on this analysis and algorithm, we describe a library of our design, higher, which we share with the community to assist and enable future research into these kinds of meta-learning approaches. We end the paper by showcasing the practical applications of this framework and library through illustrative experiments and ablation studies which they facilitate.


title: Machine learning strategies for path-planning microswimmers in turbulent flows

abstract: We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two (2D) and three dimensions (3D). We show that this scheme allows microswimmers to find non-trivial paths, which enable them to reach a target on average in less time than a naive microswimmer, which tries, at any instant of time and at a given position in space, to swim in the direction of the target. We use pseudospectral direct numerical simulations (DNSs) of the 2D and 3D (incompressible) Navier-Stokes equations to obtain the turbulent flows. We then introduce passive microswimmers that try to swim along a given direction in these flows; the microswimmers do not affect the flow, but they are advected by it.


title: Vertex Alternating-Pancyclism in 2-Edge-Colored Graphs

abstract: An alternating cycle in a 2-two-edge-colored graph is a cycle such that any two consecutive edges have different colors. Let $G_1, \ldots, G_k$ be a collection of pairwise vertex disjoint 2-edge-colored graphs. The colored generalized sum of $G_1, \ldots, G_k$, denoted by $ \oplus_{i=1}^k G_i$, is the set of all 2-edge-colored graphs $G$ such that: (i) $V(G)=\bigcup_{i=1}^k V(G_i)$, (ii) $G\langle V(G_i)\rangle\cong G_i$ for $i=1,\ldots, k$ as edge-colored graphs where $G\langle V(G_i)\rangle$ has the same coloring as $G_i$ and (iii) between each pair of vertices in different summands of $G$ there is exactly one edge, with an arbitrary but fixed color. A graph $G$ in $\oplus_{i=1}^k G_i$ will be called a colored generalized sum (c.g.s.) and we will say that $e\in E(G)$ is an exterior edge iff $e\in E(G)\setminus \left(\bigcup_{i=1}^k E(G_i)\right)$. The set of exterior edges will be denoted by $E_\oplus$. A colored graph $G$ is said to be a vertex alternating-pancyclic graph, whenever for each vertex $v$ in $G$, and for each $l\in\{3,\ldots, |V(G)|\}$, there exists in $G$ an alternating cycle of length $l$ passing through $v$. The topics of pancyclism and vertex-pancyclism are deeply and widely studied by several authors. The existence of alternating cycles in 2-edge-colored graphs has been studied because of its many applications. In this paper, we give sufficient conditions for a graph $G\in \oplus_{i=1}^k G_i$ to be a vertex alternating-pancyclic graph.


title: Twenty Female Mathematicians

abstract: In this explanatory work, we make an attempt to briefly discuss the work and technical achievements of twenty female mathematicians. The work may be useful as a historical resource, but there is very little biography or history, and the primary focus is on the mathematics. In fact, the main use will probably be for a student who is coming to a new area of mathematics for the first time and needs an overview of some of the key results and references viewed through the work of one of that area's main contributors. The work of the following mathematicians is discussed: Sofia Kovalevskaya, Emmy Noether, Mary Cartwright, Julia Robinson, Olga Ladyzhenska, Yvonne Choquet-Bruhat, Olga Oleinik, Charlotte Fischer, Karen Uhlenbeck, Krystyna Kuperberg, Nicole Tomczak-Jaegermann, Dusa McDuff, Karen Vogtmann, Carolyn Gordon, Frances Kirwan, Leila Schneps, Claire Voisin, Olga Holtz, Maryam Mirzakhani and Maryna Viazowska. There is a website based on this document (https://tusindfryd.github.io/twenty-female-mathematicians/) created by Dominika G\'oral. Changes, corrections, and additions can be suggested at the website, but the website is currently not being actively maintained, so any suggestions for corrections and changes will be made to the document instead. The research areas of the mathematicians in question can be found at the website.


title: Quantum aspects of Yukawa model with scalar and axial scalar fields in curved spacetime

abstract: We study the Yukawa model with one scalar and one axial scalar fields, coupled to $N$ copies of Dirac fermions, in curved spacetime background. The theory possesses a reach set of coupling constants, including the scalar terms with odd powers of scalar fields in the potential, and constants of non-minimal coupling of the scalar fields to gravity. Using the heat-kernel technique and dimensional regularization, we derive the one-loop divergences, describe the renormalization of the theory under consideration and calculate the full set of beta- and gamma-functions for all coupling constants and fields. As a next step, we construct the renormalized one-loop effective potential of the scalar fields up to the terms linear in scalar curvature. This calculation includes only the contributions from quantum scalar fields, and is performed using covariant cut-off regularization and local momentum representation. Some difficulties of the renormalization group approach to the effective potential in the case under consideration are discussed.


title: Site Frequency Spectrum of the Bolthausen-Sznitman Coalescent

abstract: We derive explicit formulas for the two first moments of he site frequency spectrum $(SFS_{n,b})_{1\leq b\leq n-1}$ of the Bolthausen-Sznitman coalescent along with some precise and efficient approximations, even for small sample sizes $n$. These results provide new $L_2$-asymptotics for some values of $b=o(n)$. We also study the length of internal branches carrying $b>n/2$ individuals. In this case we obtain the distribution function and a convergence in law. Our results rely on the random recursive tree construction of the Bolthausen-Sznitman coalescent.


title: Optimal Parseval frames: Total coherence and total volume

abstract: We introduce three quantities called total coherence, total volume, and nuclear energy, and we show that equiangular Parseval frames maximize all three of these quantities over the set of all Parseval frames. We then show that equiangular Parseval frames also maximize the total volume and nuclear energy over the set of equal norm frames. Along the way we derive a bound on the smallest k-dimensional volume in an equal norm frame which is a generalization of the Welch bound. We conclude with an extensive list of open questions.


title: SIMPLE: Statistical Inference on Membership Profiles in Large Networks

abstract: Network data is prevalent in many contemporary big data applications in which a common interest is to unveil important latent links between different pairs of nodes. Yet a simple fundamental question of how to precisely quantify the statistical uncertainty associated with the identification of latent links still remains largely unexplored. In this paper, we propose the method of statistical inference on membership profiles in large networks (SIMPLE) in the setting of degree-corrected mixed membership model, where the null hypothesis assumes that the pair of nodes share the same profile of community memberships. In the simpler case of no degree heterogeneity, the model reduces to the mixed membership model for which an alternative more robust test is also proposed. Both tests are of the Hotelling-type statistics based on the rows of empirical eigenvectors or their ratios, whose asymptotic covariance matrices are very challenging to derive and estimate. Nevertheless, their analytical expressions are unveiled and the unknown covariance matrices are consistently estimated. Under some mild regularity conditions, we establish the exact limiting distributions of the two forms of SIMPLE test statistics under the null hypothesis and contiguous alternative hypothesis. They are the chi-square distributions and the noncentral chi-square distributions, respectively, with degrees of freedom depending on whether the degrees are corrected or not. We also address the important issue of estimating the unknown number of communities and establish the asymptotic properties of the associated test statistics. The advantages and practical utility of our new procedures in terms of both size and power are demonstrated through several simulation examples and real network applications.


title: GmCN: Graph Mask Convolutional Network

abstract: Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by aggregating the feature representations of all its neighbors which is biased by its own representation. However, this fixed aggregation strategy is not guaranteed to be optimal for GCN based graph learning and also can be affected by some graph structure noises, such as incorrect or undesired edge connections. To address these issues, we propose a novel Graph mask Convolutional Network (GmCN) in which nodes can adaptively select the optimal neighbors in their feature aggregation to better serve GCN learning. GmCN can be theoretically interpreted by a regularization framework, based on which we derive a simple update algorithm to determine the optimal mask adaptively in GmCN training process. Experiments on several datasets validate the effectiveness of GmCN.


title: Context-Aware Graph Attention Networks

abstract: Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge (weight) representation. In this paper, we propose a novel unified GNN model, named Context-aware Adaptive Graph Attention Network (CaGAT). CaGAT aims to learn a context-aware attention representation for each graph edge by further exploiting the context relationships among different edges. In particular, CaGAT conducts context-aware learning on both node feature representation and edge (weight) representation simultaneously and cooperatively in a unified manner which can boost their respective performance in network training. We apply CaGAT on semi-supervised learning tasks. Promising experimental results on several benchmark datasets demonstrate the effectiveness and benefits of CaGAT.


title: An Efficient Framework for Computing Structure- And Semantics-Preserving Community in a Heterogeneous Multilayer Network

abstract: Multilayer networks or MLNs (also called multiplexes or network of networks) are being used extensively for modeling and analysis of data sets with multiple entity and feature types and associated relationships. Although the concept of community is widely-used for aggregate analysis, a structure- and semantics preserving definition for it is lacking for MLNs. Retention of original MLN structure and entity relationships is important for detailed drill-down analysis. In addition, efficient computation is also critical for large number of analysis. In this paper, we introduce a structure-preserving community definition for MLNs as well as a framework for its efficient computation using the decoupling approach. The proposed decoupling approach combines communities from individual layers to form a serial k-community for connected k layers in a MLN. We propose a new algorithm for pairing communities across layers and introduce several weight metrics for composing communities from two layers using participating community characteristics. In addition to the definition, our proposed approach has a number of desired characteristics. It: i) leverages extant single graph community detection algorithms, ii) introduces several weight metrics that are customized for the community concept, iii) is a new algorithm for pairing communities using bipartite graphs, and iv) experimentally validates the community computation and its efficiency on widely-used IMDb and DBLP data sets.


abstract: Robots could learn their own state and world representation from perception and experience without supervision. This desirable goal is the main focus of our field of interest, state representation learning (SRL). Indeed, a compact representation of such a state is beneficial to help robots grasp onto their environment for interacting. The properties of this representation have a strong impact on the adaptive capability of the agent. In this article we present an approach based on imitation learning. The idea is to train several policies that share the same representation to reproduce various demonstrations. To do so, we use a multi-head neural network with a shared state representation feeding a task-specific agent. If the demonstrations are diverse, the trained representation will eventually contain the information necessary for all tasks, while discarding irrelevant information. As such, it will potentially become a compact state representation useful for new tasks. We call this approach SRLfD (State Representation Learning from Demonstration). Our experiments confirm that when a controller takes SRLfD-based representations as input, it can achieve better performance than with other representation strategies and promote more efficient reinforcement learning (RL) than with an end-to-end RL strategy.


title: Scalable Global Optimization via Local Bayesian Optimization

abstract: Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains challenging, and on difficult problems Bayesian optimization is often not competitive with other paradigms. In this paper we take the view that this is due to the implicit homogeneity of the global probabilistic models and an overemphasized exploration that results from global acquisition. This motivates the design of a local probabilistic approach for global optimization of large-scale high-dimensional problems. We propose the $\texttt{TuRBO}$ algorithm that fits a collection of local models and performs a principled global allocation of samples across these models via an implicit bandit approach. A comprehensive evaluation demonstrates that $\texttt{TuRBO}$ outperforms state-of-the-art methods from machine learning and operations research on problems spanning reinforcement learning, robotics, and the natural sciences.


title: AntMan: Sparse Low-Rank Compression to Accelerate RNN inference

abstract: Wide adoption of complex RNN based models is hindered by their inference performance, cost and memory requirements. To address this issue, we develop AntMan, combining structured sparsity with low-rank decomposition synergistically, to reduce model computation, size and execution time of RNNs while attaining desired accuracy. AntMan extends knowledge distillation based training to learn the compressed models efficiently. Our evaluation shows that AntMan offers up to 100x computation reduction with less than 1pt accuracy drop for language and machine reading comprehension models. Our evaluation also shows that for a given accuracy target, AntMan produces 5x smaller models than the state-of-art. Lastly, we show that AntMan offers super-linear speed gains compared to theoretical speedup, demonstrating its practical value on commodity hardware.


title: Improving Sample Efficiency in Model-Free Reinforcement Learning from Images

abstract: Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a latent representation together with the control policy. However, fitting a high-capacity encoder using a scarce reward signal is sample inefficient and leads to poor performance. Prior work has shown that auxiliary losses, such as image reconstruction, can aid efficient representation learning. However, incorporating reconstruction loss into an off-policy learning algorithm often leads to training instability. We explore the underlying reasons and identify variational autoencoders, used by previous investigations, as the cause of the divergence. Following these findings, we propose effective techniques to improve training stability. This results in a simple approach capable of matching state-of-the-art model-free and model-based algorithms on MuJoCo control tasks. Furthermore, our approach demonstrates robustness to observational noise, surpassing existing approaches in this setting. Code, results, and videos are anonymously available at https://sites.google.com/view/sac-ae/home.


title: Cross-Layer Strategic Ensemble Defense Against Adversarial Examples

abstract: Deep neural network (DNN) has demonstrated its success in multiple domains. However, DNN models are inherently vulnerable to adversarial examples, which are generated by adding adversarial perturbations to benign inputs to fool the DNN model to misclassify. In this paper, we present a cross-layer strategic ensemble framework and a suite of robust defense algorithms, which are attack-independent, and capable of auto-repairing and auto-verifying the target model being attacked. Our strategic ensemble approach makes three original contributions. First, we employ input-transformation diversity to design the input-layer strategic transformation ensemble algorithms. Second, we utilize model-disagreement diversity to develop the output-layer strategic model ensemble algorithms. Finally, we create an input-output cross-layer strategic ensemble defense that strengthens the defensibility by combining diverse input transformation based model ensembles with diverse output verification model ensembles. Evaluated over 10 attacks on ImageNet dataset, we show that our strategic ensemble defense algorithms can achieve high defense success rates and are more robust with high attack prevention success rates and low benign false negative rates, compared to existing representative defense methods.


title: Graph Generation with Variational Recurrent Neural Network

abstract: Generating graph structures is a challenging problem due to the diverse representations and complex dependencies among nodes. In this paper, we introduce Graph Variational Recurrent Neural Network (GraphVRNN), a probabilistic autoregressive model for graph generation. Through modeling the latent variables of graph data, GraphVRNN can capture the joint distributions of graph structures and the underlying node attributes. We conduct experiments on the proposed GraphVRNN in both graph structure learning and attribute generation tasks. The evaluation results show that the variational component allows our network to model complicated distributions, as well as generate plausible structures and node attributes.


title: Microscopic foundations of the Second Law of Thermodynamics within Nonunitary Newtonian Gravity

abstract: The quest for a microscopic foundation of Thermodynamics is addressed within the Nonunitary Newtonian Gravity model through the study of a specific closed system, namely a three-dimensional harmonic nanocrystal. A numerical calculation of the nanocrystal von Neumann entropy as a function of time is performed, showing a sharp monotonic increase, followed by a stabilization at late times. This behavior is consistent with the emergence of a micro-canonical ensemble within the initial energy levels, signaling, in this way, the establishment of a non-unitary gravity-induced thermal equilibrium.


title: Sensitivity analysis of a galaxy formation model

abstract: We present the first application of a variance-based sensitivity analysis (SA) to a model that aims to predict the evolution and properties of the whole galaxy population. SA is a well-established technique in other quantitative sciences, but is a relatively novel tool for the evaluation of astrophysical models. We perform a multi-parameter exploration of the GALFORM semi-analytic galaxy formation model, to compute how sensitive the present-day K-band luminosity function is to varying different model parameters. The parameter space is scanned using a low-discrepancy sampling technique proposed by Saltelli. We first demonstrate the usefulness of the SA approach by varying just two model parameters, one which controls supernova feedback and the other the heating of gas by AGN. The SA analysis matches our physical intuition regarding how these parameters affect the predictions for different parts of the galaxy luminosity function. We then use SA to compute Sobol' sensitivity indices varying seven model parameters, connecting the variance in the model output to the variance in the input parameters. The sensitivity is computed in luminosity bins, allowing us to probe the origin of the model predictions in detail. We discover that the SA correctly identifies the least- and most important parameters. Moreover, the SA also captures the combined responses of varying multiple parameters at the same time. Our study marks a much needed step away from the traditional "one-at-a-time" parameter variation often used in this area and improves the transparency of multi-parameter models of galaxy formation.


title: Quantum Theory of Light in a Dispersive Structured Linear Dielectric: a Macroscopic Hamiltonian Tutorial Treatment

abstract: These notes, intended to be self contained and tutorial, present a direct, macroscopic approach to quantizing light inside a linear-response dielectric material when both spectral dispersion and spatial nonuniformity are present, but the spectral region of interest is optically transparent so that explicit treatment of the underlying physics of the medium is not needed. The approach taken is based on the macroscopic Maxwell equations and a corresponding Hamiltonian, without the use of Lagrangians or any dynamical model for the medium, and uses a standard mode-based quantization method. The treatment covers: energy density and flux in a dispersive dielectric; a summary of the inverse permittivity formalism; a new derivation of the mode normalization condition; a direct proof of the nonorthogonality of the modes; examples of quantized field expressions for the general case and various special cases; the relationship between group velocity and energy flux; the band approximation and the continuum limit; and quantum optical treatment of waveguide modes.


title: Br\"and\'en's $(p,q)$-Eulerian polynomials, Andr\'e permutations and continued fractions

abstract: In 2008 Br\"and\'en proved a $(p,q)$-analogue of the $\gamma$-expansion formula for Eulerian polynomials and conjectured the divisibility of the $\gamma$-coefficient $\gamma_{n,k}(p,q)$ by $(p+q)^k$. As a follow-up, in 2012 Shin and Zeng showed that the fraction $\gamma_{n,k}(p, q)/(p + q)^k$ is a polynomial in $\N[p,q]$. The aim of this paper is to give a combinatorial interpretation of the latter polynomial in terms of Andr\'e permutations, a class of objects first defined and studied by Foata, Sch\"utzenberger and Strehl in the 1970s. It turns out that our result provides an answer to a recent open problem of Han, which was the impetus of this paper.


title: Hybrid Zero Dynamics Inspired Feedback Control Policy Design for 3D Bipedal Locomotion using Reinforcement Learning

abstract: This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some reference joint trajectories. Different from these studies, we propose a novel policy structure that appropriately incorporates physical insights gained from the hybrid nature of the walking dynamics and the well-established hybrid zero dynamics approach for 3D bipedal walking. As a result, the overall RL framework has several key advantages, including lightweight network structure, short training time, and less dependence on prior knowledge. We demonstrate the effectiveness of the proposed method on Cassie, a challenging 3D bipedal robot. The proposed solution produces stable limit walking cycles that can track various walking speed in different directions. Surprisingly, without specifically trained with disturbances to achieve robustness, it also performs robustly against various adversarial forces applied to the torso towards both the forward and the backward directions.


title: Finding monotone patterns in sublinear time

abstract: We study the problem of finding monotone subsequences in an array from the viewpoint of sublinear algorithms. For fixed $k \in \mathbb{N}$ and $\varepsilon > 0$, we show that the non-adaptive query complexity of finding a length-$k$ monotone subsequence of $f \colon [n] \to \mathbb{R}$, assuming that $f$ is $\varepsilon$-far from free of such subsequences, is $\Theta((\log n)^{\lfloor \log_2 k \rfloor})$. Prior to our work, the best algorithm for this problem, due to Newman, Rabinovich, Rajendraprasad, and Sohler (2017), made $(\log n)^{O(k^2)}$ non-adaptive queries; and the only lower bound known, of $\Omega(\log n)$ queries for the case $k = 2$, followed from that on testing monotonicity due to Erg\"un, Kannan, Kumar, Rubinfeld, and Viswanathan (2000) and Fischer (2004).


title: PEXO: a global modeling framework for nanosecond timing, microsecond astrometry, and $\mu$m/s radial velocities

abstract: The ability to make independent detections of the signatures of exoplanets with complementary telescopes and instruments brings a new potential for robust identification of exoplanets and precision characterization. We introduce PEXO, a package for Precise EXOplanetology to facilitate the efficient modeling of timing, astrometry, and radial velocity data, which will benefit not only exoplanet science but also various astrophysical studies in general. PEXO is general enough to account for binary motion and stellar reflex motions induced by planetary companions and is precise enough to treat various relativistic effects both in the solar system and in the target system. We also model the post-Newtonian barycentric motion for future tests of general relativity in extrasolar systems. We benchmark PEXO with the pulsar timing package TEMPO2 and find that PEXO produces numerically similar results with timing precision of about 1 ns, space-based astrometry to a precision of 1 $\mu$as, and radial velocity of 1 $\mu$m/s and improves on TEMPO2 for decade-long timing data of nearby targets, due to its consideration of third-order terms of Roemer delay. PEXO is able to avoid the bias introduced by decoupling the target system and the solar system and to account for the atmospheric effects which set a practical limit for ground-based radial velocities close to 1 cm/s. Considering the various caveats in barycentric correction and ancillary data required to realize cm/s modeling, we recommend the preservation of original observational data. The PEXO modeling package is available at GitHub (https://github.com/phillippro/pexo).


title: Causal Induction from Visual Observations for Goal Directed Tasks

abstract: Causal reasoning has been an indispensable capability for humans and other intelligent animals to interact with the physical world. In this work, we propose to endow an artificial agent with the capability of causal reasoning for completing goal-directed tasks. We develop learning-based approaches to inducing causal knowledge in the form of directed acyclic graphs, which can be used to contextualize a learned goal-conditional policy to perform tasks in novel environments with latent causal structures. We leverage attention mechanisms in our causal induction model and goal-conditional policy, enabling us to incrementally generate the causal graph from the agent's visual observations and to selectively use the induced graph for determining actions. Our experiments show that our method effectively generalizes towards completing new tasks in novel environments with previously unseen causal structures.


title: The probability that two random points on the $n$-probability simplex are comparable with respect to the first order stochastic dominance and the monotone likelihood ratio partial orders

abstract: First order stochastic dominance and monotone likelihood ratio are two partial orders on the $n$-probability simplex that play an important role in the establishment of structural results for MDPs and POMDPs. We study the strength of those partial orders in terms of how likely it is for two random points on the $n$-probability simplex to be comparable with respect to each of the two partial orders.