title: Bekenstein-Hod Universal Bound on Information Emission Rate Is Obeyed by LIGO-Virgo Binary Black Hole Remnants

abstract: Causality and the generalized laws of black hole thermodynamics imply a bound, known as the \textit{Bekenstein--Hod universal bound}, on the information emission rate of a perturbed system. Using a time-domain ringdown analysis, we investigate whether remnant black holes produced by the coalescences observed by Advanced LIGO and Advanced Virgo obey this bound. We find that the bound is verified by the astrophysical black hole population with $94\%$ probability, providing a first confirmation of the Bekenstein--Hod bound from black hole systems.


title: Towards automated brain aneurysm detection in TOF-MRA: open data, weak labels, and anatomical knowledge

abstract: Brain aneurysm detection in Time-Of-Flight Magnetic Resonance Angiography (TOF-MRA) has undergone drastic improvements with the advent of Deep Learning (DL). However, performances of supervised DL models heavily rely on the quantity of labeled samples, which are extremely costly to obtain. Here, we present a DL model for aneurysm detection that overcomes the issue with ''weak'' labels: oversized annotations which are considerably faster to create. Our weak labels resulted to be four times faster to generate than their voxel-wise counterparts. In addition, our model leverages prior anatomical knowledge by focusing only on plausible locations for aneurysm occurrence. We frst train and evaluate our model through cross-validation on an in-house TOF-MRA dataset comprising 284 subjects (170 females / 127 healthy controls / 157 patients with 198 aneurysms). On this dataset, our best model achieved a sensitivity of 83%, with False Positive (FP) rate of 0.8 per patient. To assess model generalizability, we then participated in a challenge for aneurysm detection with TOF-MRA data (93 patients, 20 controls, 125 aneurysms). On the public challenge, sensitivity was 68% (FP rate=2.5), ranking 4th/18 on the open leaderboard. We found no signifcant diference in sensitivity between aneurysm risk-of-rupture groups (p=0.75), locations (p=0.72), or sizes (p=0.15). Data, code and model weights are released under permissive licenses. We demonstrate that weak labels and anatomical knowledge can alleviate the necessity for prohibitively expensive voxel-wise annotations.


title: On the primitivity of the AES-128 key-schedule

abstract: The key-scheduling algorithm in the AES is the component responsible for selecting from the master key the sequence of round keys to be xor-ed to the partially encrypted state at each iteration. We consider here the group $\Gamma$ generated by the action of the AES-128 key-scheduling operation, and we prove that the smallest group containing $\Gamma$ and all the translations of the message space is primitive. As a consequence, we obtain that no proper and non-trivial subspace can be invariant under its action.


title: Full-Resilient Memory-Optimum Multi-Party Non-Interactive Key Exchange

abstract: Multi-Party Non-Interactive Key Exchange (MP-NIKE) is a fundamental cryptographic primitive in which users register into a key generation centre and receive a public/private key pair each. After that, any subset of these users can compute a shared key without any interaction. Nowadays, IoT devices suffer from a high number and large size of messages exchanged in the Key Management Protocol (KMP). To overcome this, an MP-NIKE scheme can eliminate the airtime and latency of messages transferred between IoT devices. MP-NIKE schemes can be realized by using multilinear maps. There are several attempts for constructing multilinear maps based on indistinguishable obfuscation, lattices and the Chinese Remainder Theorem (CRT). Nevertheless, these schemes are inefficient in terms of computation cost and memory overhead. Besides, several attacks have been recently reported against CRT-based and lattice-based multilinear maps. There is only one modular exponentiation-based MP-NIKE scheme in the literature which has been claimed to be both secure and efficient. In this article, we present an attack on this scheme based on the Euclidean algorithm, in which two colluding users can obtain the shared key of any arbitrary subgroup of users. We also propose an efficient and secure MP-NIKE scheme. We show how our proposal is secure in the random oracle model assuming the hardness of the root extraction modulo a composite number.


title: OpenTera: A Microservice Architecture Solution for Rapid Prototyping of Robotic Solutions to COVID-19 Challenges in Care Facilities

abstract: As telecommunications technology progresses, telehealth frameworks are becoming more widely adopted in the context of long-term care (LTC) for older adults, both in care facilities and in homes. Today, robots could assist healthcare workers when they provide care to elderly patients, who constitute a particularly vulnerable population during the COVID-19 pandemic. Previous work on user-centered design of assistive technologies in LTC facilities for seniors has identified positive impacts. The need to deal with the effects of the COVID-19 pandemic emphasizes the benefits of this approach, but also highlights some new challenges for which robots could be interesting solutions to be deployed in LTC facilities. This requires customization of telecommunication and audio/video/data processing to address specific clinical requirements and needs. This paper presents OpenTera, an open source telehealth framework, aiming to facilitate prototyping of such solutions by software and robotic designers. Designed as a microservice-oriented platform, OpenTera is an end-to-end solution that employs a series of independent modules for tasks such as data and session management, telehealth, daily assistive tasks/actions, together with smart devices and environments, all connected through the framework. After explaining the framework, we illustrate how OpenTera can be used to implement robotic solutions for different applications identified in LTC facilities and homes, and we describe how we plan to validate them through field trials.


title: Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems

abstract: Many technical approaches have been proposed for ensuring that decisions made by machine learning systems are fair, but few of these proposals have been stress-tested in real-world systems. This paper presents an example of one team's approach to the challenge of applying algorithmic fairness approaches to complex production systems within the context of a large technology company. We discuss how we disentangle normative questions of product and policy design (like, "how should the system trade off between different stakeholders' interests and needs?") from empirical questions of system implementation (like, "is the system achieving the desired tradeoff in practice?"). We also present an approach for answering questions of the latter sort, which allows us to measure how machine learning systems and human labelers are making these tradeoffs across different relevant groups. We hope our experience integrating fairness tools and approaches into large-scale and complex production systems will be useful to other practitioners facing similar challenges, and illuminating to academics and researchers looking to better address the needs of practitioners.


title: Wavelength sensitivity of the speckle patterns produced by an integrating sphere

abstract: Speckle metrology is a powerful tool in the measurement of wavelength and spectra. Recently, speckle produced by multiple reflections inside an integrating sphere has been proposed and showed high performance. However, to our knowledge, a complete characterisation of speckle sensitivity to wavelength in that geometry has not been performed to date. In this work, we derive a general model predicting the variation in a speckle pattern as a result of a generic transformation. Applying this to a shift in the incident wavelength, we show that the speckle sensitivity is mainly governed by the radius and surface reflectivity of the sphere. We show that integrating spheres offer sensitivity three orders of magnitude above that of multimode fibres of a similar size, and discuss analogies with the transmission line of a Fabry-P\'erot interferometer.


title: Some matrix inequalities of log-majorization type

abstract: The purpose of this paper is two-fold: we present some matrix inequalities of log-majorization type for eigenvalues indexed by a sequence; we then apply our main theorem to generalize and improve the Hua-Marcus' inequalities. Our results are stronger and more general than the existing ones.


title: Regressive Domain Adaptation for Unsupervised Keypoint Detection

abstract: Domain adaptation (DA) aims at transferring knowledge from a labeled source domain to an unlabeled target domain. Though many DA theories and algorithms have been proposed, most of them are tailored into classification settings and may fail in regression tasks, especially in the practical keypoint detection task. To tackle this difficult but significant task, we present a method of regressive domain adaptation (RegDA) for unsupervised keypoint detection. Inspired by the latest theoretical work, we first utilize an adversarial regressor to maximize the disparity on the target domain and train a feature generator to minimize this disparity. However, due to the high dimension of the output space, this regressor fails to detect samples that deviate from the support of the source. To overcome this problem, we propose two important ideas. First, based on our observation that the probability density of the output space is sparse, we introduce a spatial probability distribution to describe this sparsity and then use it to guide the learning of the adversarial regressor. Second, to alleviate the optimization difficulty in the high-dimensional space, we innovatively convert the minimax game in the adversarial training to the minimization of two opposite goals. Extensive experiments show that our method brings large improvement by 8% to 11% in terms of PCK on different datasets.


title: Yule's "nonsense correlation" for Gaussian random walks

abstract: The purpose of this paper is to provide an exact formula for the second moment of the empirical correlation of two independent Gaussian random walks as well as implicit formulas for higher moments. The proofs are based on a symbolically tractable integro-differential representation formula for the moments of any order in a class of empirical correlations, first established by Ernst et al. (2019) and investigated previously in Ernst et al. (2017). We also provide rates of convergence of the empirical correlation of two independent Gaussian random walks to the empirical correlation of two independent Wiener processes, by exploiting the explicit nature of the computations used for the moments. At the level of distributions, in Wasserstein distance, the convergence rate is the inverse $n^{-1}$ of the number of data points $n$. This holds because we represent and couple the discrete and continuous correlations on a common probability space, where we establish convergence in $L^1$ at the rate $n^{-1}$.


title: Equilibria in Auctions With Ad Types

abstract: This paper studies equilibrium quality of semi-separable position auctions (known as the Ad Types setting) with greedy or optimal allocation combined with generalized second-price (GSP) or Vickrey-Clarke-Groves (VCG) pricing. We make three contributions: first, we give upper and lower bounds on the Price of Anarchy (PoA) for auctions which use greedy allocation with GSP pricing, greedy allocations with VCG pricing, and optimal allocation with GSP pricing. Second, we give Bayes-Nash equilibrium characterizations for two-player, two-slot instances (for all auction formats) and show that there exists both a revenue hierarchy and revenue equivalence across some formats. Finally, we use no-regret learning algorithms and bidding data from a large online advertising platform and no-regret learning algorithms to evaluate the performance of the mechanisms under semi-realistic conditions. For welfare, we find that the optimal-to-realized welfare ratio (an empirical PoA analogue) is broadly better than our upper bounds on PoA; For revenue, we find that the hierarchy in practice may sometimes agree with simple theory, but generally appears sensitive to the underlying distribution of bidder valuations.


title: Room temperature cavity electromechanics in the sideband-resolved regime

abstract: We demonstrate a sideband-resolved cavity electromechanical system operating at room temperature. The mechanical resonator, a strongly pre-stressed silicon nitride string, is dielectrically coupled to a three-dimensional microwave cavity made of copper. The electromechanical coupling is characterized by two measurements, the cavity-induced eigenfrequency shift of the mechanical resonator and the optomechanically induced transparency. While the former is dominated by dielectric effects, the latter reveals a clear signature of the dynamical backaction of the cavity field on the resonator. This unlocks the field of cavity electromechanics for room temperature applications.


title: Towards Learning an Unbiased Classifier from Biased Data via Conditional Adversarial Debiasing

abstract: Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset, frequently caused by the co-occurrence of relevant features and irrelevant ones. To mitigate this issue, we require learning algorithms that prevent the propagation of bias from the dataset into the classifier. We present a novel adversarial debiasing method, which addresses a feature that is spuriously connected to the labels of training images but statistically independent of the labels for test images. Thus, the automatic identification of relevant features during training is perturbed by irrelevant features. This is the case in a wide range of bias-related problems for many computer vision tasks, such as automatic skin cancer detection or driver assistance. We argue by a mathematical proof that our approach is superior to existing techniques for the abovementioned bias. Our experiments show that our approach performs better than state-of-the-art techniques on a well-known benchmark dataset with real-world images of cats and dogs.


title: Dynamical correlation energy of metals in large basis sets from downfolding and composite approaches

abstract: Coupled-cluster theory with single and double excitations (CCSD) is a promising ab initio method for the electronic structure of three-dimensional metals, for which second-order perturbation theory (MP2) diverges in the thermodynamic limit. However, due to the high cost and poor convergence of CCSD with respect to basis size, applying CCSD to periodic systems often leads to large basis set errors. In a common "composite" method, MP2 is used to recover the missing dynamical correlation energy through a focal-point correction, but the inadequacy of MP2 for metals raises questions about this approach. Here we describe how high-energy excitations treated by MP2 can be "downfolded" into a low-energy active space to be treated by CCSD. Comparing how the composite and downfolding approaches perform for the uniform electron gas, we find that the latter converges more quickly with respect to the basis set size. Nonetheless, the composite approach is surprisingly accurate because it removes the problematic MP2 treatment of double excitations near the Fermi surface. Using the method to estimate the CCSD correlation energy in the combined complete basis set and thermodynamic limits, we find CCSD recovers over 90% of the exact correlation energy at $r_s=4$. We also test the composite and downfolding approaches with the random-phase approximation used in place of MP2, yielding a method that is more effective but more expensive.


title: "This Browser is Lightning Fast": The Effects of Message Content on Perceived Performance

abstract: With technical performance being similar for various web browsers, improving user perceived performance is integral to optimizing browser quality. We investigated the importance of priming, which has a well-documented ability to affect people's beliefs, on users' perceptions of web browser performance. We studied 1495 participants who read either an article about performance improvements to Mozilla Firefox, an article about user interface updates to Firefox, or an article about self-driving cars, and then watched video clips of browser tasks. As the priming effect would suggest, we found that reading articles about Firefox increased participants' perceived performance of Firefox over the most widely used web browser, Google Chrome. In addition, we found that article content mattered, as the article about performance improvements led to higher performance ratings than the article about UI updates. Our findings demonstrate how perceived performance can be improved without making technical improvements and that designers and developers must consider a wider picture when trying to improve user attitudes about technology.


title: Dynamical Pose Estimation

abstract: We study the problem of aligning two sets of 3D geometric primitives given known correspondences. Our first contribution is to show that this primitive alignment framework unifies five perception problems including point cloud registration, primitive (mesh) registration, category-level 3D registration, absolution pose estimation (APE), and category-level APE. Our second contribution is to propose DynAMical Pose estimation (DAMP), the first general and practical algorithm to solve primitive alignment problem by simulating rigid body dynamics arising from virtual springs and damping, where the springs span the shortest distances between corresponding primitives. We evaluate DAMP in simulated and real datasets across all five problems, and demonstrate (i) DAMP always converges to the globally optimal solution in the first three problems with 3D-3D correspondences; (ii) although DAMP sometimes converges to suboptimal solutions in the last two problems with 2D-3D correspondences, using a scheme for escaping local minima, DAMP always succeeds. Our third contribution is to demystify the surprising empirical performance of DAMP and formally prove a global convergence result in the case of point cloud registration by charactering local stability of the equilibrium points of the underlying dynamical system.


title: A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equations

abstract: Within the framework of parameter dependent PDEs, we develop a constructive approach based on Deep Neural Networks for the efficient approximation of the parameter-to-solution map. The research is motivated by the limitations and drawbacks of state-of-the-art algorithms, such as the Reduced Basis method, when addressing problems that show a slow decay in the Kolmogorov n-width. Our work is based on the use of deep autoencoders, which we employ for encoding and decoding a high fidelity approximation of the solution manifold. To provide guidelines for the design of deep autoencoders, we consider a nonlinear version of the Kolmogorov n-width over which we base the concept of a minimal latent dimension. We show that the latter is intimately related to the topological properties of the solution manifold, and we provide theoretical results with particular emphasis on second order elliptic PDEs, characterizing the minimal dimension and the approximation errors of the proposed approach. The theory presented is further supported by numerical experiments, where we compare the proposed approach with classical POD-Galerkin reduced order models. In particular, we consider parametrized advection-diffusion PDEs, and we test the methodology in the presence of strong transport fields, singular terms and stochastic coefficients.


title: Anti-Counterfeiting for Polymer Banknotes Based on Polymer Substrate Fingerprinting

abstract: Polymer banknotes are the trend for printed currency and have been adopted by more than fifty countries worldwide. However, over the past years, the quantity of polymer counterfeits has been increasing, so has the quality of counterfeits. This shows that the initial advantage of bringing a new polymer technology to fight against counterfeiting is reducing. To maintain one step ahead of counterfeiters, we propose a novel anti-counterfeiting technique called Polymer Substrate Fingerprinting (PSF). Our technique is built based on the observation that the opacity coating, a critical step during the production of polymer notes, is a stochastic manufacturing process, leaving uneven thickness in the coating layer and the random dispersion of impurities from the ink. The imperfections in the coating layer result in random translucent patterns when a polymer banknote is back-lit by a light source. We show these patterns can be reliably captured by a commodity negative-film scanner and processed into a compact fingerprint to uniquely identify each banknote. Using an extensive dataset of 6,200 sample images collected from 340 UK banknotes, we show that our method can reliably authenticate banknotes, and is robust against rough daily handling of banknotes. Furthermore, we show the extracted fingerprints contain around 900 bits of entropy, which makes it extremely scalable to identify every polymer note circulated globally. As compared with previous or existing anti-counterfeiting mechanisms for banknotes, our method has a distinctive advantage: it ensures that even in the extreme case when counterfeiters have procured the same printing equipment and ink as used by a legitimate government, counterfeiting banknotes remains infeasible because of the difficulty to replicate a stochastic manufacturing process.


title: A Training Set Subsampling Strategy for the Reduced Basis Method

abstract: We present a subsampling strategy for the offline stage of the Reduced Basis Method. The approach is aimed at bringing down the considerable offline costs associated with using a finely-sampled training set. The proposed algorithm exploits the potential of the pivoted QR decomposition and the discrete empirical interpolation method to identify important parameter samples. It consists of two stages. In the first stage, we construct a low-fidelity approximation to the solution manifold over a fine training set. Then, for the available low-fidelity snapshots of the output variable, we apply the pivoted QR decomposition or the discrete empirical interpolation method to identify a set of sparse sampling locations in the parameter domain. These points reveal the structure of the parametric dependence of the output variable. The second stage proceeds with a subsampled training set containing a by far smaller number of parameters than the initial training set. Different subsampling strategies inspired from recent variants of the empirical interpolation method are also considered. Tests on benchmark examples justify the new approach and show its potential to substantially speed up the offline stage of the Reduced Basis Method, while generating reliable reduced-order models.


title: Jupiter's Dynamical Love Number

abstract: Recent observations by the {\it Juno} spacecraft have revealed that the tidal Love number $k_2$ of Jupiter is $4\%$ lower than the hydrostatic value. We present a simple calculation of the dynamical Love number of Jupiter that explains the observed "anomaly". The Love number is usually dominated by the response of the (rotation-modified) f-modes of the planet. Our method also allows for efficient computation of high-order dynamical Love numbers. While the inertial-mode contributions to the Love numbers are negligible, a sufficiently strong stratification in a large region of the planet's interior would induce significant g-mode responses and influence the measured Love numbers.


title: Search and Structural Featurization of Magnetically Frustrated Kagom\'e Lattices

abstract: We have searched nearly 40,000 inorganic solids in the Inorganic Crystal Structural Database to identify compounds containing a transition metal or rare earth kagom\'e sublattice, a geometrically magnetically frustrated lattice, ultimately identifying $\sim$500 materials. A broad analysis of the chemical and structural trends of these materials shows three types of kagom\'e sheet stacking and several classes of magnetic complexity. Following the search and classification, we rapidly screen the magnetic properties of a subset of the materials using density functional theory to eliminate those that are unlikely to exhibit magnetic frustration. From the results of our computational screening, we rediscover six materials that have previously been explored for their low temperature magnetic behavior, albeit showing symmetry breaking distortions, spin glass behavior, or magnetic ordering. However, all are materials with antiferromagnetic behavior, which we correctly predict. Finally, we also report three materials that appear to be unexplored for their magnetic properties.


title: Quasiparticle Interference of the van-Hove singularity in Sr$_2$RuO$_4$

abstract: The single-layered ruthenate Sr$_2$RuO$_4$ is one of the most enigmatic unconventional superconductors. While for many years it was thought to be the best candidate for a chiral $p$-wave superconducting ground state, desirable for topological quantum computations, recent experiments suggest a singlet state, ruling out the original $p$-wave scenario. The superconductivity as well as the properties of the multi-layered compounds of the ruthenate perovskites are strongly influenced by a van Hove singularity in proximity of the Fermi energy. Tiny structural distortions move the van Hove singularity across the Fermi energy with dramatic consequences for the physical properties. Here, we determine the electronic structure of the van Hove singularity in the surface layer of Sr$_2$RuO$_4$ by quasiparticle interference imaging. We trace its dispersion and demonstrate from a model calculation accounting for the full vacuum overlap of the wave functions that its detection is facilitated through the octahedral rotations in the surface layer.


title: Piecewise linear regression and classification

abstract: This paper proposes a method for solving multivariate regression and classification problems using piecewise linear predictors over a polyhedral partition of the feature space. The resulting algorithm that we call PARC (Piecewise Affine Regression and Classification) alternates between (i) solving ridge regression problems for numeric targets, softmax regression problems for categorical targets, and either softmax regression or cluster centroid computation for piecewise linear separation, and (ii) assigning the training points to different clusters on the basis of a criterion that balances prediction accuracy and piecewise-linear separability. We prove that PARC is a block-coordinate descent algorithm that optimizes a suitably constructed objective function, and that it converges in a finite number of steps to a local minimum of that function. The accuracy of the algorithm is extensively tested numerically on synthetic and real-world datasets, showing that the approach provides an extension of linear regression/classification that is particularly useful when the obtained predictor is used as part of an optimization model. A Python implementation of the algorithm described in this paper is available at http://cse.lab.imtlucca.it/~bemporad/parc .


title: Photoinduced multistage phase transitions in Ta2NiSe5

abstract: Utrafast control of material physical properties represents a rapid developing field in condensed matter physics. Yet, accessing to the long-lived photoinduced electronic states is still in its early stage, especially with respect to an insulator to metal phase transition. Here, by combing transport measurement with ultrashort photoexcitation and coherent phonon spectroscopy, we report on photoinduced multistage phase transitions in Ta2NiSe5. Upon excitation by weak pulse intensity, the system is triggered to a short-lived state accompanied by a structural change. Further increasing the excitation intensity beyond a threshold, a photoinduced steady new state is achieved where the resistivity drops by more than four orders at temperature 50 K. This new state is thermally stable up to at least 350 K and exhibits the lattice structure different from any of the thermally accessible equilibrium states. Transmission electron microscopy reveals an in-chain Ta atom displacement in the photoinduced new structure phase. We also found that nano-sheet samples with the thickness less than the optical penetration depth are required for attaining a complete transition.


title: A Study of Face Obfuscation in ImageNet

abstract: Face obfuscation (blurring, mosaicing, etc.) has been shown to be effective for privacy protection; nevertheless, object recognition research typically assumes access to complete, unobfuscated images. In this paper, we explore the effects of face obfuscation on the popular ImageNet challenge visual recognition benchmark. Most categories in the ImageNet challenge are not people categories; however, many incidental people appear in the images, and their privacy is a concern. We first annotate faces in the dataset. Then we demonstrate that face obfuscation has minimal impact on the accuracy of recognition models. Concretely, we benchmark multiple deep neural networks on obfuscated images and observe that the overall recognition accuracy drops only slightly (<= 1.0%). Further, we experiment with transfer learning to 4 downstream tasks (object recognition, scene recognition, face attribute classification, and object detection) and show that features learned on obfuscated images are equally transferable. Our work demonstrates the feasibility of privacy-aware visual recognition, improves the highly-used ImageNet challenge benchmark, and suggests an important path for future visual datasets. Data and code are available at https://github.com/princetonvisualai/imagenet-face-obfuscation.


title: Ranking Clarifying Questions Based on Predicted User Engagement

abstract: To improve online search results, clarification questions can be used to elucidate the information need of the user. This research aims to predict the user engagement with the clarification pane as an indicator of relevance based on the lexical information: query, question, and answers. Subsequently, the predicted user engagement can be used as a feature to rank the clarification panes. Regression and classification are applied for predicting user engagement and compared to naive heuristic baselines (e.g. mean) on the new MIMICS dataset [20]. An ablation study is carried out using a RankNet model to determine whether the predicted user engagement improves clarification pane ranking performance. The prediction models were able to improve significantly upon the naive baselines, and the predicted user engagement feature significantly improved the RankNet results in terms of NDCG and MRR. This research demonstrates the potential for ranking clarification panes based on lexical information only and can serve as a first neural baseline for future research to improve on. The code is available online.


title: Sparse Box-fitting Least Squares

abstract: We present a new implementation of the commonly used Box-fitting Least Squares (BLS) algorithm, for the detection of transiting exoplanets in photometric data. Unlike BLS, our new implementation - Sparse BLS (SBLS), does not use binning of the data into phase bins, nor does it use any kind of phase grid. Thus, its detection efficiency does not depend on the transit phase, and is therefore slightly better than that of BLS. For sparse data, it is also significantly faster than BLS. It is therefore perfectly suitable for large photometric surveys producing unevenly-sampled sparse light curves, such as Gaia.


title: Twin-Boundary Structural Phase Transitions in Elemental Titanium

abstract: Twinning in crystalline materials plays an important role in many transformation and deformation processes, where underlying mechanisms can be strongly influenced by the structural, energetic and kinetic properties of associated twin boundaries (TBs). While these properties are well characterized in common cases, the possibility that TBs can display multiple complexions with distinct properties, and phase transitions between them, has not been widely explored, even though such phenomena are established in a few more general grain boundaries. We report experimental findings that {11-24} TBs in titanium display a thick interfacial region with crystalline structure distinct from the bulk. First-principles calculations establish that this complexion is linked to a metastable polymorph of titanium, and exhibits behavior consistent with a solid-state wetting transition with compressive strain, and a first-order structural transition under tension. The findings document rich TB complexion behavior in an elemental metal, with important implications for mechanical behavior and phase-transformation pathways.


title: Evaluating Linear Functions to Symmetric Monoidal Categories

abstract: A number of domain specific languages, such as circuits or data-science workflows, are best expressed as diagrams of boxes connected by wires. Unfortunately, functional languages have traditionally been ill-equipped to embed this sort of languages. The Arrow abstraction is an approximation, but we argue that it does not capture the right properties. A faithful abstraction is Symmetric Monoidal Categories (SMCs), but,so far,it hasn't been convenient to use. We show how the advent of linear typing in Haskell lets us bridge this gap. We provide a library which lets us program in SMCs with linear functions instead of SMC combinators. This considerably lowers the syntactic overhead of the EDSL to be on par with that of monadic DSLs. A remarkable feature of our library is that, contrary to previously known methods for categories, it does not use any metaprogramming.


title: Convective core entrainment in 1D main sequence stellar models

abstract: 3D hydrodynamics models of deep stellar convection exhibit turbulent entrainment at the convective-radiative boundary which follows the entrainment law, varying with boundary penetrability. We implement the entrainment law in the 1D Geneva stellar evolution code. We then calculate models between 1.5 and 60 M$_{\odot}$ at solar metallicity ($Z=0.014$) and compare them to previous generations of models and observations on the main sequence. The boundary penetrability, quantified by the bulk Richardson number, $Ri_{\mathrm{B}}$, varies with mass and to a smaller extent with time. The variation of $Ri_{\mathrm{B}}$ with mass is due to the mass dependence of typical convective velocities in the core and hence the luminosity of the star. The chemical gradient above the convective core dominates the variation of $Ri_{\mathrm{B}}$ with time. An entrainment law method can therefore explain the apparent mass dependence of convective boundary mixing through $Ri_{\mathrm{B}}$. New models including entrainment can better reproduce the mass dependence of the main sequence width using entrainment law parameters $A \sim 2 \times 10^{-4}$ and $n=1$. We compare these empirically constrained values to the results of 3D hydrodynamics simulations and discuss implications.


title: Criticality Experiments with Fast 25 and 49 Metal and Hydride Systems During the Manhattan Project

abstract: Criticality experiments with $^{235}$U (metal and hydride) and $^{239}$Pu (metal) were performed during the Manhattan Project. Results from these experiments provided necessary information for the success of the Manhattan Project. These experiments have been previously described in compilations made after the Manhattan Project, but those works are either lacking in technical details or are not publicly available. This work aims to provide detailed information while showcasing the enduring impact of these experiments 75 years after they were performed. Furthermore, we use modern computational methods embodied in the MCNP6 code and ENDF data to analyze and interpret these historic measurements. The world's first four criticality accidents are also discussed, as lessons learned from these helped shape the field of criticality experiments.


title: Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modelling

abstract: Deep neural networks have become the dominant approach in natural language processing (NLP). However, in recent years, it has become apparent that there are shortcomings in systematicity that limit the performance and data efficiency of deep learning in NLP. These shortcomings can be clearly shown in lower-level artificial tasks, mostly on synthetic data. Abstract patterns are the best known examples of a hard problem for neural networks in terms of generalisation to unseen data. They are defined by relations between items, such as equality, rather than their values. It has been argued that these low-level problems demonstrate the inability of neural networks to learn systematically. In this study, we propose Embedded Relation Based Patterns (ERBP) as a novel way to create a relational inductive bias that encourages learning equality and distance-based relations for abstract patterns. ERBP is based on Relation Based Patterns (RBP), but modelled as a Bayesian prior on network weights and implemented as a regularisation term in otherwise standard network learning. ERBP is is easy to integrate into standard neural networks and does not affect their learning capacity. In our experiments, ERBP priors lead to almost perfect generalisation when learning abstract patterns from synthetic noise-free sequences. ERBP also improves natural language models on the word and character level and pitch prediction in melodies with RNN, GRU and LSTM networks. We also find improvements in in the more complex tasks of learning of graph edit distance and compositional sentence entailment. ERBP consistently improves over RBP and over standard networks, showing that it enables abstract pattern learning which contributes to performance in natural language tasks.


title: Poisoning Attacks against Data-Driven Control Methods

abstract: This paper investigates poisoning attacks against data-driven control methods. This work is motivated by recent trends showing that, in supervised learning, slightly modifying the data in a malicious manner can drastically deteriorate the prediction ability of the trained model. We extend these analyses to the case of data-driven control methods. Specifically, we investigate how a malicious adversary can poison the data so as to minimize the performance of a controller trained using this data. We show that identifying the most impactful attack boils down to solving a bi-level non-convex optimization problem, and provide theoretical insights on the attack. We present a generic algorithm finding a local optimum of this problem and illustrate our analysis in the case of a model-reference based approach, the Virtual Reference Feedback Tuning technique, and on data-driven methods based on Willems et al. lemma. Numerical experiments reveal that minimal but well-crafted changes in the dataset are sufficient to deteriorate the performance of data-driven control methods significantly, and even make the closed-loop system unstable.


title: Dc Electrical Current Generated by Upstream Neutral Modes

abstract: Quantum Hall phases are gapped in the bulk but support chiral edge modes, both charged and neutral. Here we consider a circuit where the path from the source of electric current to the drain necessarily passes through a segment consisting solely of neutral modes. We find that upon biasing the source, a dc electric current is detected at the drain, provided there is backscattering between counter-propagating modes under the contacts placed in certain locations. Thus, neutral modes carry information that can be used to nonlocally reconstruct a dc charge current. Our protocol can be used to detect any neutral mode that counterpropagates with respect to all charge modes. Our protocol applies not only to the edge modes of a quantum Hall system, but also to systems that have neutral modes of non-quantum Hall origin. We conclude with a possible experimental realization of this phenomenon.


title: Predicting spectral parameters in the backscattering dominated model for the prompt phase of GRBs

abstract: We present new results of the backscattering dominated prompt emission model in which the photons generated through pair annihilation at the centre of a gamma ray burst (GRB) are backscattered through Compton scattering by an outflowing stellar cork. %We show that the produced spectral features are capable of producing spectral features that are widely observed in GRBs. Using Comptonized pair annihilation spectrum accompanied by bremsstrahlung radiation for seed photons, we show that the obtained spectra produce low energy photon index in the range $\alpha \sim -1.95$ to $-1.1$, steeper high energy slopes $\beta \sim -3.5$ to $-2.4$ and spectral peak energies $\sim$ few KeV to few $10\times$ MeV. These findings are consistent with the values covered in GRB prompt phase observations.


title: The Origins of Blast Loaded Vessels

abstract: As the Manhattan Project shifted to the theory of implosion assembly in 1944, plutonium was extremely rare and large uncertainties surrounded the function of the Gadget. For these reasons, a team within the Manhattan Project began another ambitious experiment: to confine the effects of detonating two tons of high explosives and enable the recovery of precious plutonium! No data existed on the subject, and the team faced numerous challenges as they engineered what is believed to be the world's first blast-loaded confinement vessel.


title: The Relative Bogomolov Conjecture for Fibered Products of Elliptic Curves

abstract: We deduce an analogue of the Bogomolov conjecture for non-degenerate subvarieties in fibered products of families of elliptic curves from the author's recent theorem on equidistribution in families of abelian varieties. This generalizes results of DeMarco and Mavraki and improves certain results of Manin-Mumford type proven by Masser and Zannier to results of Bogomolov type, yielding the first results of this type for subvarieties of relative dimension $>1$ in families of abelian varieties with trivial trace.


title: A probabilistic finite element method based on random meshes: Error estimators and Bayesian inverse problems

abstract: We present a novel probabilistic finite element method (FEM) for the solution and uncertainty quantification of elliptic partial differential equations based on random meshes, which we call random mesh FEM (RM-FEM). Our methodology allows to introduce a probability measure on standard piecewise linear FEM. We present a posteriori error estimators based uniquely on probabilistic information. A series of numerical experiments illustrates the potential of the RM-FEM for error estimation and validates our analysis. We furthermore demonstrate how employing the RM-FEM enhances the quality of the solution of Bayesian inverse problems, thus allowing a better quantification of numerical errors in pipelines of computations.


title: Are we using appropriate segmentation metrics? Identifying correlates of human expert perception for CNN training beyond rolling the DICE coefficient

abstract: Metrics optimized in complex machine learning tasks are often selected in an ad-hoc manner. It is unknown how they align with human expert perception. We explore the correlations between established quantitative segmentation quality metrics and qualitative evaluations by professionally trained human raters. Therefore, we conduct psychophysical experiments for two complex biomedical semantic segmentation problems. We discover that current standard metrics and loss functions correlate only moderately with the segmentation quality assessment of experts. Importantly, this effect is particularly pronounced for clinically relevant structures, such as the enhancing tumor compartment of glioma in brain magnetic resonance and grey matter in ultrasound imaging. It is often unclear how to optimize abstract metrics, such as human expert perception, in convolutional neural network (CNN) training. To cope with this challenge, we propose a novel strategy employing techniques of classical statistics to create complementary compound loss functions to better approximate human expert perception. Across all rating experiments, human experts consistently scored computer-generated segmentations better than the human-curated reference labels. Our results, therefore, strongly question many current practices in medical image segmentation and provide meaningful cues for future research.


title: Reservoir Computing as a Tool for Climate Predictability Studies

abstract: Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate-models. In this context, the Linear-Inverse-Modeling (LIM) approach, by capturing a few essential interactions between dynamical components of the full system, has proven valuable in providing insights into predictability of the full system. We demonstrate that Reservoir Computing (RC), a form of learning suitable for systems with chaotic dynamics, provides an alternative nonlinear approach that improves on the predictive skill of the LIM approach. We do this in the example setting of predicting sea-surface-temperature in the North Atlantic in the pre-industrial control simulation of a popular earth system model, the Community-Earth-System-Model so that we can compare the performance of the new RC based approach with the traditional LIM approach both when learning data is plentiful and when such data is more limited. The improved predictive skill of the RC approach over a wide range of conditions -- larger number of retained EOF coefficients, extending well into the limited data regime, etc. -- suggests that this machine-learning technique may have a use in climate predictability studies. While the possibility of developing a climate emulator -- the ability to continue the evolution of the system on the attractor long after failing to be able to track the reference trajectory -- is demonstrated in the Lorenz-63 system, it is suggested that further development of the RC approach may permit such uses of the new approach in more realistic predictability studies.

categories: physics.geo-ph cs.LG nlin.CD physics.data-an stat.ML


title: On the mean-field equations for ferromagnetic spin systems

abstract: We derive mean-field equations for a general class of ferromagnetic spin systems with an explicit error bound in finite volumes. The proof is based on a link between the mean-field equation and the free convolution formalism of random matrix theory, which we exploit in terms of a dynamical method. We present three sample applications of our results to Ka\'{c} interactions, randomly diluted models, and models with an asymptotically vanishing external field.


title: Data-Driven Control and Data-Poisoning attacks in Buildings: the KTH Live-In Lab case study

abstract: This work investigates the feasibility of using input-output data-driven control techniques for building control and their susceptibility to data-poisoning techniques. The analysis is performed on a digital replica of the KTH Livein Lab, a non-linear validated model representing one of the KTH Live-in Lab building testbeds. This work is motivated by recent trends showing a surge of interest in using data-based techniques to control cyber-physical systems. We also analyze the susceptibility of these controllers to data-poisoning methods, a particular type of machine learning threat geared towards finding imperceptible attacks that can undermine the performance of the system under consideration. We consider the Virtual Reference Feedback Tuning (VRFT), a popular data-driven control technique, and show its performance on the KTH Live-In Lab digital replica. We then demonstrate how poisoning attacks can be crafted and illustrate the impact of such attacks. Numerical experiments reveal the feasibility of using data-driven control methods for finding efficient control laws. However, a subtle change in the datasets can significantly deteriorate the performance of VRFT.


title: Comparison between historic nuclear explosion yield formulas

abstract: During the Manhattan project a simple formula was developed by Bethe and Feynman in 1943 to estimate the yield of a fission-only nuclear explosion of a uniformly-dense bare-sphere of supercritical fissile material. We have not found any evidence that Bethe and Feynman knew of the first yield formula obtained by Frisch and Peierls contained within their famous March 1940 memorandum. Similarly, we have not found any technical documents that compare the Bethe-Feynman formula to the earlier works of Frisch and Peierls, or Serber. After adjusting for differences in the labeling of critical radii, we find that earlier formulas only differ by a scaling factor.


title: Fluid forces and vortex patterns of an oscillating cylinder pair in still water with both side-by-side and tandem configurations

abstract: Models of cylinders in the oscillatory flow can be found virtually everywhere in the marine industry, such as pump towers experiencing sloshing load in a LNG ship liquid tank. However, compared to the problem of a cylinder in the uniform flow, a cylinder in the oscillatory flow is less studied, let alone multiple cylinders. Therefore, we experimentally and numerically studied two identical circular cylinders oscillating in the still water with either a side-by-side or a tandem configuration for a wide range of Keulegan-Carpenter number and Stokes number $\beta$. The experiment result shows that the hydrodynamic performance of an oscillating cylinder pair in the still water is greatly altered due to the interference between the multiple structures with different configurations. In specific, compared to the single-cylinder case, the drag coefficient is greatly enhanced when two cylinders are placed side-by-side at a small gap ratio, while dual cylinders in a tandem configuration obtain a smaller drag coefficient and oscillating lift coefficient. In order to reveal the detailed flow physics that result in significant fluid forces alternations, the detailed flow visualization is provided by the numerical simulation: the small gap between two cylinders in a side-by-side configuration will result in a strong gap jet that enhances the energy dissipation and increase the drag, while due to the flow blocking effect for two cylinders in a tandem configuration, the drag coefficient decreases.


title: Trinity by the Numbers: The Computing Effort that Made Trinity Possible

abstract: This article addresses shortcomings in the existing secondary literature describing the nature and involvement of computing at the World War II Los Alamos Lab. Utilizing rarely used source materials, and identifying points of bias among more commonly used sources, this article provides a more complete representation of wartime Los Alamos' computing operations and personnel, including the Lab's typically under-represented human computers, and how they contributed to the success of the Trinity test. This article also identifies how the Lab's unusual wartime computing demands served as a formative experience among many Los Alamos personnel and consultants, who contributed significantly to the development and use of mechanized computing at and beyond Los Alamos after the war.


title: Real-Time Approximate Routing for Smart Transit Systems

abstract: We study real-time routing policies in smart transit systems, where the platform has a combination of cars and high-capacity vehicles (e.g., buses or shuttles) and seeks to serve a set of incoming trip requests. The platform can use its fleet of cars as a feeder to connect passengers to its high-capacity fleet, which operates on fixed routes. Our goal is to find the optimal set of (bus) routes and corresponding frequencies to maximize the social welfare of the system in a given time window. This generalizes the Line Planning Problem, a widely studied topic in the transportation literature, for which existing solutions are either heuristic (with no performance guarantees), or require extensive computation time (and hence are impractical for real-time use). To this end, we develop a $1-\frac{1}{e}-\varepsilon$ approximation algorithm for the Real-Time Line Planning Problem, using ideas from randomized rounding and the Generalized Assignment Problem. Our guarantee holds under two assumptions: $(i)$ no inter-bus transfers and $(ii)$ access to a pre-specified set of feasible bus lines. We moreover show that these two assumptions are crucial by proving that, if either assumption is relaxed, the Real-Time Line Planning Problem does not admit any constant-factor approximation. Finally, we demonstrate the practicality of our algorithm via numerical experiments on real-world and synthetic datasets, in which we show that, given a fixed time budget, our algorithm outperforms Integer Linear Programming-based exact methods.


title: The norm attainment problem for functions of projections

abstract: The paper is concerned with the problem of identifying the norm attaining operators in the von Neumann algebra generated by two orthogonal projections on a Hilbert space. This algebra contains every skew projection on that Hilbert space and hence the results of the paper also describe functions of skew projections and their adjoints that attain the norm.


title: The Existence of Linear Selection and the Quotient Lifting Property

abstract: Lifting properties for Banach spaces are studied. An alternate version of the lifting property due to Lindenstrass and Tzafriri is proposed and a characterization, up to isomorphism, is given. The quotient lifting property for pairs of Banach spaces $(X,J)$, with $J$ proximinal in $X$, is considered and several conditions for the property to hold are given.


title: Noncommutative resolutions and intersection cohomology for quotient singularities

abstract: For a large class of good moduli spaces $X$ of symmetric stacks $\mathcal{X}$, we define noncommutative motives $\mathbb{D}^{\text{nc}}(X)$ which can be regarded as categorifications of the intersection cohomology of $X$. These motives are summands of noncommutative resolutions of singularities $\mathbb{D}(X)\subset D^b(\mathcal{X})$ of $X$. The category $\mathbb{D}(X)$ is a global analogue of the noncommutative resolutions of singularities of $V//G$ for $V$ a symmetric representation of a reductive group $G$ constructed by \v{S}penko-Van den Bergh.


title: On the von Neumann algebra of class functions on a compact quantum group

abstract: We study analogues of the radial subalgebras in free group factors (called the algebras of class functions) in the setting of compact quantum groups. For the free orthogonal quantum groups we show that they are not MASAs, as soon as we are in a non-Kac situation. The most important notion to our present work is that of a (quasi-)split inclusion. We prove that the inclusion of the algebra of class functions is quasi-split for some unitary quantum groups; in this case the subalgebra is non-abelian and we also obtain a result concerning its relative commutant. In the positive direction, we construct certain bicrossed products from the quantum group $SU_q(2)$ for which the algebra of class functions is a MASA.


title: Local strict singular characteristics: Cauchy problem with smooth initial data

abstract: Main purpose of this paper is to study the local propagation of singularities of viscosity solution to contact type evolutionary Hamilton-Jacobi equation $$ D_tu(t,x)+H(t,x,D_xu(t,x),u(t,x))=0. $$ An important issue of this topic is the existence, uniqueness and regularity of the strict singular characteristic. We apply the recent existence and regularity results on the Herglotz' type variational problem to the aforementioned Hamilton-Jacobi equation with smooth initial data. We obtain some new results on the local structure of the cut set of the viscosity solution near non-conjugate singular points. Especially, we obtain an existence result of smooth strict singular characteristic from and to non-conjugate singular initial point based on the structure of the superdifferential of the solution, which is even new in the classical time-dependent case. We also get a global propagation result for the $C^1$ singular support in the contact case.


title: Bounds on half graph orders in powers of sparse graphs

abstract: Half graphs and their variants, such as ladders, semi-ladders and co-matchings, are combinatorial objects that encode total orders in graphs. Works by Adler and Adler (Eur. J. Comb.; 2014) and Fabia\'nski et al. (STACS; 2019) prove that in the powers of sparse graphs, one cannot find arbitrarily large objects of this kind. However, these proofs either are non-constructive, or provide only loose upper bounds on the orders of half graphs and semi-ladders. In this work we provide nearly tight asymptotic lower and upper bounds on the maximum order of half graphs, parameterized on the distance, in the following classes of sparse graphs: planar graphs, graphs with bounded maximum degree, graphs with bounded pathwidth or treewidth, and graphs excluding a fixed clique as a minor. The most significant part of our work is the upper bound for planar graphs. Here, we employ techniques of structural graph theory to analyze semi-ladders in planar graphs through the notion of cages, which expose a topological structure in semi-ladders. As an essential building block of this proof, we also state and prove a new structural result, yielding a fully polynomial bound on the neighborhood complexity in the class of planar graphs.


title: Why flatness does and does not correlate with generalization for deep neural networks

abstract: The intuition that local flatness of the loss landscape is correlated with better generalization for deep neural networks (DNNs) has been explored for decades, spawning many different flatness measures. Recently, this link with generalization has been called into question by a demonstration that many measures of flatness are vulnerable to parameter re-scaling which arbitrarily changes their value without changing neural network outputs. Here we show that, in addition, some popular variants of SGD such as Adam and Entropy-SGD, can also break the flatness-generalization correlation. As an alternative to flatness measures, we use a function based picture and propose using the log of Bayesian prior upon initialization, $\log P(f)$, as a predictor of the generalization when a DNN converges on function $f$ after training to zero error. The prior is directly proportional to the Bayesian posterior for functions that give zero error on a test set. For the case of image classification, we show that $\log P(f)$ is a significantly more robust predictor of generalization than flatness measures are. Whilst local flatness measures fail under parameter re-scaling, the prior/posterior, which is global quantity, remains invariant under re-scaling. Moreover, the correlation with generalization as a function of data complexity remains good for different variants of SGD.


title: A Relational-learning Perspective to Multi-label Chest X-ray Classification

abstract: Multi-label classification of chest X-ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels. Such approaches make it challenging to incorporate auxiliary information such as annotation uncertainty or a dependency among the labels. Building towards this, we propose a novel knowledge graph reformulation of multi-label classification, which not only readily increases predictive performance of an encoder but also serves as a general framework for introducing new domain knowledge. Specifically, we construct a multi-modal knowledge graph out of the chest X-ray images and its labels and pose multi-label classification as a link prediction problem. Incorporating auxiliary information can then simply be achieved by adding additional nodes and relations among them. When tested on a publicly-available radiograph dataset (CheXpert), our relational-reformulation using a naive knowledge graph outperforms the state-of-art by achieving an area-under-ROC curve of 83.5%, an improvement of "sim 1" over a purely discriminative approach.


title: Privacy-Preserving and Sustainable Contact Tracing Using Batteryless Bluetooth Low-Energy Beacons

abstract: Contact tracing is the techno-choice of reference to address the COVID-19 pandemic. Many of the current approaches have severe privacy and security issues and fail to offer a sustainable contact tracing infrastructure. We address these issues introducing an innovative, privacy-preserving, sustainable, and experimentally tested architecture that leverages batteryless BLE beacons.


title: Induced vacuum magnetic field in the cosmic string background

abstract: The relativistic charged spinor matter field is quantized in the background of a straight cosmic string with nonvanishing transverse size. The most general boundary conditions ensuring the impossibility for matter to penetrate through the edge of the string core are considered. The role of discrete symmetries is elucidated, and analytic expressions for the temporal and spatial components of the induced vacuum current are derived in the case of either $P$ or $CT$ invariant boundary condition with two parameters varying arbitrarily from point to point of the edge. The requirement of physical plausibility for the global induced vacuum characteristics is shown to remove completely an arbitrariness in boundary conditions. We find out that a magnetic field is induced in the vacuum and that a sheath in the form of a tube of the magnetic flux lines encloses a cosmic string. The dependence of the induced vacuum magnetic field strength on the string flux and tension, as well as on the transverse size of the string and on the distance from the string, is unambiguously determined.


title: Intersection K-theory

abstract: For a proper map $f:X\to S$ between varieties over $\mathbb{C}$ with $X$ smooth, we introduce increasing filtrations $\textbf{P}^{\leq \cdot}_f\subset P^{\leq \cdot}_f$ on $\text{gr}^\cdot K_\cdot(X)$, the associated graded on $K$-theory with respect to the codimension filtration, both sent by the cycle map to the perverse filtration on cohomology ${}^pH^{\leq \cdot}_f(X)$. The filtrations $P^{\leq \cdot}_f$ and $\textbf{P}^{\leq \cdot}_f$ are functorial with respect to proper pushforward; $P^{\leq \cdot}_f$ is functorial with respect to pullback. We use the above filtrations to propose two definitions of (graded) intersection $K$-theory $\text{gr}^\cdot IK_\cdot(S)$ and $\text{gr}^\cdot \textbf{I}K_\cdot(S)$. Both have cycle maps to intersection cohomology $IH^{\cdot}(S)$. We conjecture a version of the decomposition theorem for semismall surjective maps and prove it in some particular cases.


title: An Information-Theoretic Perspective on Credit Assignment in Reinforcement Learning

abstract: How do we formalize the challenge of credit assignment in reinforcement learning? Common intuition would draw attention to reward sparsity as a key contributor to difficult credit assignment and traditional heuristics would look to temporal recency for the solution, calling upon the classic eligibility trace. We posit that it is not the sparsity of the reward itself that causes difficulty in credit assignment, but rather the \emph{information sparsity}. We propose to use information theory to define this notion, which we then use to characterize when credit assignment is an obstacle to efficient learning. With this perspective, we outline several information-theoretic mechanisms for measuring credit under a fixed behavior policy, highlighting the potential of information theory as a key tool towards provably-efficient credit assignment.


title: Virtual corrections to $gg\to ZH$ via a transverse momentum expansion

abstract: We compute the next-to-leading virtual QCD corrections to the partonic cross section of the production of a Higgs boson in association with a $Z$ boson in gluon fusion. The calculation is based on the recently introduced method of evaluating the amplitude via an expansion in terms of a small transverse momentum. We generalize the method to the case of different masses in the final state and of a process not symmetric in the forward-backward direction exchange. Our analytic approach gives a very good approximation (better than percent) of the partonic cross section in the center of mass energy region up to $\sim 750 \,\textrm{GeV}$, where at the LHC $\sim 98\%$ of the total hadronic cross section is concentrated.


title: The Taming of Plutonium: Pu Metallurgy and the Manhattan Project

abstract: We describe the wartime challenges associated with the rapid developments in plutonium chemistry and metallurgy that were necessary to produce the core of the Trinity Device. Beginning with microgram quantities of plutonium metal late in 1943, initial measurements showed a wide and confusing variance in density and other properties. These confusing results were the first clues to the astounding complexity of plutonium. As this complexity was revealed, it introduced new challenges for the fabrication of kilogram-scale parts. In a remarkable period from January 1944 to June 1945, Manhattan Project scientists made rapid progress in understanding plutonium chemistry and metallurgy. By early 1945, they had discovered five of the six ambient-pressure phases of unalloyed plutonium and reported the density of these phases to within a value of 0.1 g/cm$^3$ of those accepted today. They solved the stability problem introduced by these phases with a rapid alloy development program that ultimately identified gallium as the preferred element to stabilize the delta-phase, producing a plutonium alloy still of scientific and technical interest today. We conclude with a description of post-war developments in these areas, including applications of wartime plutonium metallurgy to civilian applications in nuclear reactors. We dedicate this paper to the memory of Ed Hammel, the Manhattan Project plutonium metallurgist whose previous description and documentation of plutonium history during the war has been essential in our research.


title: Sensitivity analysis of an integrated climate-economic model

abstract: We conduct a sensitivity analysis of a new type of integrated climate-economic model recently proposed in the literature, where the core economic component is based on the Goodwin-Keen dynamics instead of a neoclassical growth model. Because these models can exhibit much richer behaviour, including multiple equilibria, runaway trajectories and unbounded oscillations, it is crucial to determine how sensitive they are to changes in underlying parameters. We focus on four economic parameters (markup rate, speed of price adjustments, coefficient of money illusion, growth rate of productivity) and two climate parameters (size of upper ocean reservoir, equilibrium climate sensitivity) and show how their relative effects on the outcomes of the model can be quantified by methods that can be applied to an arbitrary number of parameters.


title: Relaxing restrictions at the pace of vaccination increases freedom and guards against further COVID-19 waves

abstract: Mass vaccination offers a promising exit strategy for the COVID-19 pandemic. However, as vaccination progresses, demands to lift restrictions increase, despite most of the population remaining susceptible. Using our age-stratified SEIRD-ICU compartmental model and curated epidemiological and vaccination data, we quantified the rate (relative to vaccination progress) at which countries can lift non-pharmaceutical interventions without overwhelming their healthcare systems. We analyzed scenarios ranging from immediately lifting restrictions (accepting high mortality and morbidity) to reducing case numbers to a level where test-trace-and-isolate (TTI) programs efficiently compensate for local spreading events. In general, the age-dependent vaccination roll-out implies a transient decrease of more than ten years in the average age of ICU patients and deceased. The pace of vaccination determines the speed of lifting restrictions; Taking the European Union (EU) as an example case, all considered scenarios allow for steadily increasing contacts starting in May 2021 and relaxing most restrictions by autumn 2021. Throughout summer 2021, only mild contact restrictions will remain necessary. However, only high vaccine uptake can prevent further severe waves. Across EU countries, seroprevalence impacts the long-term success of vaccination campaigns more strongly than age demographics. In addition, we highlight the need for preventive measures to reduce contagion in school settings throughout the year 2021, where children might be drivers of contagion because of them remaining susceptible...


title: Trees with few leaves in tournaments

abstract: We prove that there exists $C>0$ such that any $(n+Ck)$-vertex tournament contains a copy of every $n$-vertex oriented tree with $k$ leaves, improving the previously best known bound of $n+O(k^2)$ vertices to give a result tight up to the value of $C$. Furthermore, we show that, for each $k$, there exists $n_0$, such that, whenever $n\geqslant n_0$, any $(n+k-2)$-vertex tournament contains a copy of every $n$-vertex oriented tree with at most $k$ leaves, confirming a conjecture of Dross and Havet.


title: Range-GAN: Range-Constrained Generative Adversarial Network for Conditioned Design Synthesis

abstract: Typical engineering design tasks require the effort to modify designs iteratively until they meet certain constraints, i.e., performance or attribute requirements. Past work has proposed ways to solve the inverse design problem, where desired designs are directly generated from specified requirements, thus avoid the trial and error process. Among those approaches, the conditional deep generative model shows great potential since 1) it works for complex high-dimensional designs and 2) it can generate multiple alternative designs given any condition. In this work, we propose a conditional deep generative model, Range-GAN, to achieve automatic design synthesis subject to range constraints. The proposed model addresses the sparse conditioning issue in data-driven inverse design problems by introducing a label-aware self-augmentation approach. We also propose a new uniformity loss to ensure generated designs evenly cover the given requirement range. Through a real-world example of constrained 3D shape generation, we show that the label-aware self-augmentation leads to an average improvement of 14% on the constraint satisfaction for generated 3D shapes, and the uniformity loss leads to a 125% average increase on the uniformity of generated shapes' attributes. This work laid the foundation for data-driven inverse design problems where we consider range constraints and there are sparse regions in the condition space.


title: Quantization-Guided Training for Compact TinyML Models

abstract: We propose a Quantization Guided Training (QGT) method to guide DNN training towards optimized low-bit-precision targets and reach extreme compression levels below 8-bit precision. Unlike standard quantization-aware training (QAT) approaches, QGT uses customized regularization to encourage weight values towards a distribution that maximizes accuracy while reducing quantization errors. One of the main benefits of this approach is the ability to identify compression bottlenecks. We validate QGT using state-of-the-art model architectures on vision datasets. We also demonstrate the effectiveness of QGT with an 81KB tiny model for person detection down to 2-bit precision (representing 17.7x size reduction), while maintaining an accuracy drop of only 3% compared to a floating-point baseline.


title: Quantum machine learning with differential privacy

abstract: Quantum machine learning (QML) can complement the growing trend of using learned models for a myriad of classification tasks, from image recognition to natural speech processing. A quantum advantage arises due to the intractability of quantum operations on a classical computer. Many datasets used in machine learning are crowd sourced or contain some private information. To the best of our knowledge, no current QML models are equipped with privacy-preserving features, which raises concerns as it is paramount that models do not expose sensitive information. Thus, privacy-preserving algorithms need to be implemented with QML. One solution is to make the machine learning algorithm differentially private, meaning the effect of a single data point on the training dataset is minimized. Differentially private machine learning models have been investigated, but differential privacy has yet to be studied in the context of QML. In this study, we develop a hybrid quantum-classical model that is trained to preserve privacy using differentially private optimization algorithm. This marks the first proof-of-principle demonstration of privacy-preserving QML. The experiments demonstrate that differentially private QML can protect user-sensitive information without diminishing model accuracy. Although the quantum model is simulated and tested on a classical computer, it demonstrates potential to be efficiently implemented on near-term quantum devices (noisy intermediate-scale quantum [NISQ]). The approach's success is illustrated via the classification of spatially classed two-dimensional datasets and a binary MNIST classification. This implementation of privacy-preserving QML will ensure confidentiality and accurate learning on NISQ technology.


title: Graph Neural Network for Object Reconstruction in Liquid Argon Time Projection Chambers

abstract: This paper presents a graph neural network (GNN) technique for low-level reconstruction of neutrino interactions in a Liquid Argon Time Projection Chamber (LArTPC). GNNs are still a relatively novel technique, and have shown great promise for similar reconstruction tasks in the LHC. In this paper, a multihead attention message passing network is used to classify the relationship between detector hits by labelling graph edges, determining whether hits were produced by the same underlying particle, and if so, the particle type. The trained model is 84% accurate overall, and performs best on the EM shower and muon track classes. The model's strengths and weaknesses are discussed, and plans for developing this technique further are summarised.


title: Symmetry Breaking in Symmetric Tensor Decomposition

abstract: In this note, we consider the highly nonconvex optimization problem associated with computing the rank decomposition of symmetric tensors. We formulate the invariance properties of the loss function and show that critical points detected by standard gradient based methods are \emph{symmetry breaking} with respect to the target tensor. The phenomena, seen for different choices of target tensors and norms, make possible the use of recently developed analytic and algebraic tools for studying nonconvex optimization landscapes exhibiting symmetry breaking phenomena of similar nature.


title: Uniqueness of meromorphic function sharing three small functions CM with its $n-$ exact difference

abstract: In this paper, we study the uniqueness of the difference of meromorphic functions. We prove the following result: Let $f$ be a non-constant meromorphic function of hyper-order less than $1$, let $\eta$ be a non-zero complex number, $n\geq1$, an integer, and let $a,b,c\in\hat{S}(f)$ be three distinct small functions and two of them be periodic small functions with period $\eta$. If $f$ and $\Delta_{\eta}^{n}f$ share $a,b,c$ CM, then $f\equiv\Delta_{\eta}^{n}f$.


title: Real-Time RGBD Odometry for Fused-State Navigation Systems

abstract: This article describes an algorithm that provides visual odometry estimates from sequential pairs of RGBD images. The key contribution of this article on RGBD odometry is that it provides both an odometry estimate and a covariance for the odometry parameters in real-time via a representative covariance matrix. Accurate, real-time parameter covariance is essential to effectively fuse odometry measurements into most navigation systems. To date, this topic has seen little treatment in research which limits the impact existing RGBD odometry approaches have for localization in these systems. Covariance estimates are obtained via a statistical perturbation approach motivated by real-world models of RGBD sensor measurement noise. Results discuss the accuracy of our RGBD odometry approach with respect to ground truth obtained from a motion capture system and characterizes the suitability of this approach for estimating the true RGBD odometry parameter uncertainty.


title: Bounding the log-derivative of the zeta-function

abstract: Assuming the Riemann hypothesis we establish explicit bounds for the modulus of the log-derivative of Riemann's zeta-function in the critical strip.


title: Architectural Visualization Using Virtual Reality: A User Experience in Simulating Buildings of a Community College in Bukidnon, Philippines

abstract: The study aims to design and develop a virtual structural design that simulates the campus and its buildings of a community college in Bukidnon, Philippines through Virtual Reality. With the immersion of technology, this project represents the architectural design of the establishment with the use of Virtual Reality Technology. The project uses a modified Iterative Development Model which is a guide for the design and development of the 3D Models and VR Application. TinkerCAD which is a web-based application has been used to design buildings on the other hand Unity is used to develop the structural designs of the buildings. The respondents of this study are the Grade 12 Senior High students from the 4 schools which are geographically near to the college. With this study, the researchers were able to showcase its VR Application to the students and later evaluated using a System Usability Scale, a 10 item questionnaire measuring usability with an overall average of 90% or Point Score of 4.5 which is interpreted as excellent in a Likert table for descriptive interpretation. With the use of the VR application potential students of the college will be able to visualize and experience the present structures of the college without being physically present in the area. In this paper, the buildings and structures of NBCC were designed and developed through a Virtual Reality Platform allowing students from different secondary schools that are geographically near to the college to experience the feeling to be in the school without being able to set a step in physically.


title: Partition Eisenstein series and semi-modular forms

abstract: We identify a class of "semi-modular" forms invariant on special subgroups of $GL_2(\mathbb Z)$, which includes classical modular forms together with complementary classes of functions that are also nice in a specific sense. We define an Eisenstein-like series summed over integer partitions, and use it to construct families of semi-modular forms.


title: Gamma and Decay Energy Spectroscopy Measurements of Trinitite

abstract: We report gamma ray spectroscopy measurements of trinitite samples and analogous samples obtained from detonation sites in Nevada and Semipalatinsk, as well as in situ measurements of topsoil at the Trinity site. We also report the first isotopic composition measurements of trinitite using the novel forensics technique of decay energy spectroscopy (DES) as a complement to traditional forensics techniques. Our measurements are compared to other published results.


title: Quasi-solid state microscopic dynamics in equilibrium classical liquids: Self-consisnent relaxation theory

abstract: In the framework of the concept of time correlation functions, we develop a self-consistent relaxation theory of the transverse collective particle dynamics in liquids. The theory agrees with well-known results in both the short-wave (free particle dynamics) and the long-wave (hydrodynamic) limits. We obtain a general expression for the spectral density~$C_T(k,\omega)$ of transverse particle current realized in the range of wave numbers $k$. In domain of microscopic spatial scales comparable to action scale of effective forces of interparticle interaction, the theory reproduces a transition from a regime with typical equilibrium liquid dynamics to a regime with collective particle dynamics where properties similar to solid-state properties appear: effective shear stiffness and transverse (shear) acoustic waves. In the framework of the corresponding approximations, we obtain expressions for the spectral density of transverse particle current for all characteristic regimes in equilibrium collective dynamics. We obtain expressions for dispersion law for transverse (shear) acoustic waves and also relations for the kinematic shear viscosity $\nu$, the transverse speed of sound $v^{(T)}$, and the corresponding sound damping coefficient $\Gamma^{(T)}$. We compare the theoretical results with the results of atomic dynamics simulations of liquid lithium near the melting point.

categories: cond-mat.soft cond-mat.stat-mech physics.chem-ph physics.comp-ph physics.flu-dyn


title: CreativeGAN: Editing Generative Adversarial Networks for Creative Design Synthesis

abstract: Modern machine learning techniques, such as deep neural networks, are transforming many disciplines ranging from image recognition to language understanding, by uncovering patterns in big data and making accurate predictions. They have also shown promising results for synthesizing new designs, which is crucial for creating products and enabling innovation. Generative models, including generative adversarial networks (GANs), have proven to be effective for design synthesis with applications ranging from product design to metamaterial design. These automated computational design methods can support human designers, who typically create designs by a time-consuming process of iteratively exploring ideas using experience and heuristics. However, there are still challenges remaining in automatically synthesizing `creative' designs. GAN models, however, are not capable of generating unique designs, a key to innovation and a major gap in AI-based design automation applications. This paper proposes an automated method, named CreativeGAN, for generating novel designs. It does so by identifying components that make a design unique and modifying a GAN model such that it becomes more likely to generate designs with identified unique components. The method combines state-of-art novelty detection, segmentation, novelty localization, rewriting, and generative models for creative design synthesis. Using a dataset of bicycle designs, we demonstrate that the method can create new bicycle designs with unique frames and handles, and generalize rare novelties to a broad set of designs. Our automated method requires no human intervention and demonstrates a way to rethink creative design synthesis and exploration.


title: Thermally Regenerative Flow Batteries with pH Neutral Electrolytes for Harvesting Low-Grade Heat

abstract: Harvesting waste heat with temperatures lower than 100 oC can improve system efficiency and reduce greenhouse gas emissions, yet it has been a longstanding and challenging task. Electrochemical methods for harvesting low-grade heat have attracted research interest in recent years due to the relatively high effective temperature coefficient of the electrolytes (> 1 mV/K) compared with the thermopower of traditional thermoelectric devices. Comparing with other electrochemical devices such as temperature-variation based thermally regenerative electrochemical cycle and temperature-difference based thermogalvanic cells, the thermally regenerative flow battery (TRFB) has the advantages of providing a continuous power output, decoupling the heat source and heat sink and recuperating heat, and compatible with stacking for scaling up. However, TRFB suffers from the issue of stable operation due to the challenge of pH matching between catholyte and anolyte solutions with desirable temperature coefficients. In this work, we demonstrate a PH-neutral TRFB based on KI/KI3 and K3Fe(CN)6/K4Fe(CN)6 as the catholyte and anolyte, respectively, with a cell temperature coefficient of 1.9 mV/K and a power density of 9 uW/cm2. This work also presents a comprehensive model with a coupled analysis of mass transfer and reaction kinetics in a porous electrode that can accurately capture the flow rate dependence of power density and energy conversion efficiency. We estimate that the efficiency of the pH-neutral TRFB can reach 11% of the Carnot efficiency at the maximum power output with a temperature difference of 37 K. Via analysis, we identify that the mass transfer overpotential inside the porous electrode and the resistance of the ion exchange membrane are the two major factors limiting the efficiency and power density, pointing to directions for future improvements.


title: Multi-Class Multiple Instance Learning for Predicting Precursors to Aviation Safety Events

abstract: In recent years, there has been a rapid growth in the application of machine learning techniques that leverage aviation data collected from commercial airline operations to improve safety. Anomaly detection and predictive maintenance have been the main targets for machine learning applications. However, this paper focuses on the identification of precursors, which is a relatively newer application. Precursors are events correlated with adverse events that happen prior to the adverse event itself. Therefore, precursor mining provides many benefits including understanding the reasons behind a safety incident and the ability to identify signatures, which can be tracked throughout a flight to alert the operators of the potential for an adverse event in the future. This work proposes using the multiple-instance learning (MIL) framework, a weakly supervised learning task, combined with carefully designed binary classifier leveraging a Multi-Head Convolutional Neural Network-Recurrent Neural Network (MHCNN-RNN) architecture. Multi-class classifiers are then created and compared, enabling the prediction of different adverse events for any given flight by combining binary classifiers, and by modifying the MHCNN-RNN to handle multiple outputs. Results obtained showed that the multiple binary classifiers perform better and are able to accurately forecast high speed and high path angle events during the approach phase. Multiple binary classifiers are also capable of determining the aircraft's parameters that are correlated to these events. The identified parameters can be considered precursors to the events and may be studied/tracked further to prevent these events in the future.


title: Re-Imagining Performance Reviews: Automated Dashboards for Continuous Visibility of Engineers Performance

abstract: Traditional methods for performance appraisal are not suitable for agile fast-paced software companies. This has been a realization in the software industry since the early adoption of agile methodologies. Nonetheless, software companies are still struggling to find a practical solution that fits the highly dynamic nature of their teams. In particular, high-growth companies, scaleups, need to be creative at how they approach performance appraisals. In this talk, we introduce automated review dashboards to support a seamless appraisal process and continuous visibility of software engineers' performance. The proposed dashboards leverage structure from existing growth frameworks while automating the aggregation of relevant qualitative and quantitative performance metrics. We reflect on our experience using the dashboards at Robusta, a medium-sized software scaleup company. The dashboards enabled a team of four managers to provide timely feedback to 56 engineers with a base for continuous visibility. We explore the design of the dashboards, the customizable metrics and the overall review experience from the perspectives of different stakeholders. We conclude with the lessons learned and practical advice for scaleups facing the same challenge.


title: Tuning of dipolar interactions and evaporative cooling in a three-dimensional molecular quantum gas

abstract: Ultracold polar molecules possess long-range, anisotropic, and tunable dipolar interactions, providing the opportunities to probe quantum phenomena inaccessible with existing cold gas platforms. However, experimental progress has been hindered by the dominance of two-body loss over elastic interactions, which prevents efficient evaporative cooling. Though recent work has demonstrated controlled interactions by confining molecules to a two-dimensional geometry, a general approach for tuning molecular interactions in a three-dimensional (3D), stable system has been lacking. Here, we demonstrate tunable elastic dipolar interactions in a bulk gas of ultracold 40K87Rb molecules in 3D, facilitated by an electric field-induced shielding resonance which suppresses the reactive loss by a factor of thirty. This improvement in the ratio of elastic to inelastic collisions enables direct thermalization. The thermalization rate depends on the angle between the collisional axis and the dipole orientation controlled by an external electric field, a direct manifestation of the anisotropic dipolar interaction. We achieve evaporative cooling mediated by the dipolar interactions in three dimensions. This work demonstrates full control of a long-lived bulk quantum gas system with tunable long-range interactions, paving the way for the study of collective quantum many-body physics.

categories: cond-mat.quant-gas physics.atom-ph physics.chem-ph quant-ph


title: Informational steady-states and conditional entropy production in continuously monitored systems

abstract: We put forth a unifying formalism for the description of the thermodynamics of continuously monitored systems, where measurements are only performed on the environment connected to a system. We show, in particular, that the conditional and unconditional entropy production, which quantify the degree of irreversibility of the open system's dynamics, are related to each other by the Holevo quantity. This, in turn, can be further split into an information gain rate and loss rate, which provide conditions for the existence of informational steady-states (ISSs), i.e. stationary states of a conditional dynamics that are maintained owing to the unbroken acquisition of information. We illustrate the applicability of our framework through several examples.


title: Bounded Invariant Checking for Stateflow Programs

abstract: Stateflow models are complex software models, often used as part of safety-critical software solutions designed with Matlab Simulink. They incorporate design principles that are typically very hard to verify formally. In particular, the standard exhaustive formal verification techniques are unlikely to scale well for the complex designs that are developed in industry. Furthermore, the Stateflow language lacks a formal semantics, which additionally hinders the formal analysis. To address these challenges, we lay here the foundations of a scalable technique for provably correct formal analysis of Stateflow models, with respect to invariant properties, based on bounded model checking (BMC) over symbolic executions. The crux of our technique is: i) a representation of the state space of Stateflow models as a symbolic transition system (STS) over the symbolic configurations of the model, as the basis for BMC, and ii) application of incremental BMC, to generate verification results after each unrolling of the next-state relation of the transition system. To this end, we develop a symbolic structural operational semantics (SSOS) for Stateflow, starting from an existing structural operational semantics (SOS), and show the preservation of invariant properties between the two. Next, we define bounded invariant checking for STS over symbolic configurations as a satisfiability problem. We develop an automated procedure for generating the initial and next-state predicates of the STS, and propose an encoding scheme of the bounded invariant checking problem as a set of constraints, ready for automated analysis with standard, off-the-shelf satisfiability solvers. Finally, we present preliminary performance results by applying our tool on an illustrative example.


title: On the origins of Lagrangian hydrodynamic methods

abstract: The intent of this paper is to discuss the history and origins of Lagrangian hydrodynamic methods for simulating shock driven flows. The majority of the pioneering research occurred within the Manhattan Project. A range of Lagrangian hydrodynamic schemes were created between 1943 and 1948 by John von Neumann, Rudolf Peierls, Tony Skyrme, and Robert Richtmyer. These schemes varied significantly from each other; however, they all used a staggered-grid and finite difference approximations of the derivatives in the governing equations, where the first scheme was by von Neumann. These ground-breaking schemes were principally published in Los Alamos laboratory reports that were eventually declassified many decades after authorship, which motivates us to document the work and describe the accompanying history in a paper that is accessible to the broader scientific community. Furthermore, we seek to correct historical omissions on the pivotal contributions made by Peierls and Skyrme to creating robust Lagrangian hydrodynamic methods for simulating shock driven flows. Understanding the history of Lagrangian hydrodynamic methods can help explain the origins of many modern schemes and may inspire the pursuit of new schemes.


title: Role of corner flow separation in unsteady dynamics of hypersonic flow over a double wedge geometry

abstract: This study investigates the origin and sustenance of self induced oscillations of shock structures in a hypersonic flow over a double wedge configuration. Previously, various researchers have considered the double wedge flow configuration for inviscid flow with variations of different inflows as well as geometric parameters such as inflow Mach number , wedge angles, and wedge lengths. Few recently published articles reveal an unsteady flow physics involved with the hypersonic viscous flow for double wedge configuration with large second wedge angles. However, the reason for such self sustained flow oscillations is not completely clear. The present work seeks out to investigate the origin of such oscillations in a low enthalpy hypersonic flow with different aft wedge angles and wedge length ratios.In the current study, viscous flow over a double wedge at Mach 7 and fore wedge angle of 30{\deg} is considered. An improved version of rhoCentralFoam solver in OpenFOAM is used to investigate the double wedge flow over different grid resolutions in the separation region and shock shock interaction region. This study corroborates the observation from the previous literature with an improvement in the range of parameters which results in a self sustained periodic oscillation. The present study also suggests that the unsteadiness becomes possible when the incidence shock is in the proximity of the aft wedge expansion corner as a consequence of different wedge length ratios(L1/L2) or aft wedge angles ({\theta}2). Flow can still be steady at a large aft wedge angle if the incidence shock is far ahead of the aft wedge expansion corner.


title: Dynamical properties of the Molniya satellite constellation: long-term evolution of the semi-major axis

abstract: We describe the phase space structures related to the semi-major axis of Molniya-like satellites subject to tesseral and lunisolar resonances. In particular, the questions answered in this contribution are: (i) we study the indirect interplay of the critical inclination resonance on the semi-geosynchronous resonance using a hierarchy of more realistic dynamical systems, thus discussing the dynamics beyond the integrable approximation. By introducing ad hoc tractable models averaged over fast angles, (ii) we numerically demarcate the hyperbolic structures organising the long-term dynamics via Fast Lyapunov Indicators cartography. Based on the publicly available two-line elements space orbital data, (iii) we identify two satellites, namely Molniya 1-69 and Molniya 1-87, displaying fingerprints consistent with the dynamics associated to the hyperbolic set. Finally, (iv) the computations of their associated dynamical maps highlight that the spacecraft are trapped within the hyperbolic tangle. This research therefore reports evidence of actual artificial satellites in the near-Earth environment whose dynamics are ruled by manifolds and resonant mechanisms. The tools, formalism and methodologies we present are exportable to other region of space subject to similar commensurabilities as the geosynchronous region.