title: Deep Learning of Dynamic Subsurface Flow via Theory-guided Generative Adversarial Network

abstract: Generative adversarial network (GAN) has been shown to be useful in various applications, such as image recognition, text processing and scientific computing, due its strong ability to learn complex data distributions. In this study, a theory-guided generative adversarial network (TgGAN) is proposed to solve dynamic partial differential equations (PDEs). Different from standard GANs, the training term is no longer the true data and the generated data, but rather their residuals. In addition, such theories as governing equations, other physical constraints and engineering controls, are encoded into the loss function of the generator to ensure that the prediction does not only honor the training data, but also obey these theories. TgGAN is proposed for dynamic subsurface flow with heterogeneous model parameters, and the data at each time step are treated as a two-dimensional image. In this study, several numerical cases are introduced to test the performance of the TgGAN. Predicting the future response, label-free learning and learning from noisy data can be realized easily by the TgGAN model. The effects of the number of training data and the collocation points are also discussed. In order to improve the efficiency of TgGAN, the transfer learning algorithm is also employed. Numerical results demonstrate that the TgGAN model is robust and reliable for deep learning of dynamic PDEs.


title: Fines Migration and Permeability Decline during Reservoir Depletion Coupled with Clay Swelling due to Low-Salinity Water Injection: An Analytical Study

abstract: Fines migration behavior can either promote or obstruct fluid flow within the reservoir and is crucial for productivity optimization that needs fundamental understanding. The present work focuses on the contributions from effective stress build-up due to reservoir depletion and decreases in brine salinity from low-salinity water injection. Particle detachment is studied analytically by using the critical retention concentration function modified with stress and salinity dependents. Increase in formation effective stress leads to deformations within the reservoir configurations due to micro-cracks and reduced pore dimensions. Decreased size of the travelling channels promotes particle detachment, while the critical retention concentration decreases. A sensitivity study reveals that, under influence of effective stress, particle size and fluid velocity are dominant parameters controlling the fines migration by influencing the particle detaching forces. With decreasing brine salinity (e.g. via low-salinity water injection), clay particles that are attached on the pore surface increasingly swell, leading to reduction in effective pore space and flow channel. Decreased pore space directly obstructs travelling of suspended particles and fluids which results in permeability decline. Initial clay particle size is found to be a critical factor controlling particle detachment behavior. Small initial particle sizes are not likely to detach from the pore surface as a result of weak detaching forces, hence the analysis finds the critical retention concentration unchanged resulting in negligible permeability decline as a function of brine salinity. Considering both effects, effective stress and brine salinity, stress-dependent effects dominate salinity-dependent effects at low effective stress while the two contribute equally at high effective stress.


title: LALR: Theoretical and Experimental validation of Lipschitz Adaptive Learning Rate in Regression and Neural Networks

abstract: We propose a theoretical framework for an adaptive learning rate policy for the Mean Absolute Error loss function and Quantile loss function and evaluate its effectiveness for regression tasks. The framework is based on the theory of Lipschitz continuity, specifically utilizing the relationship between learning rate and Lipschitz constant of the loss function. Based on experimentation, we have found that the adaptive learning rate policy enables up to 20x faster convergence compared to a constant learning rate policy.


title: Influence of Permeability Anisotropy and Layered Heterogeneity on Geothermal Energy Battery Storage

abstract: The Geothermal Battery Energy Storage concept has been proposed to provide large-scale heat storage when solar radiance is available, to be later recovered for economic benefit. The concept uses solar radiance to heat water on the surface which is then injected into a suitable subsurface formation. This hot water elevates the ambient formation temperature creating a high-temperature geothermal reservoir acceptable for geothermal electricity generation or direct heat applications. The process uses produced/injected, connate formation water and thus neither freshwater nor surface storage or disposal of water is required. This concept has been previously presented in several publications and presentations. Calculations of reservoir temperature and pressure profiles in isotropic and homogeneous reservoirs have been published previously by the authors. These calculations have shown that a small volume of rock mass is required for the heat storage reservoir, of the order of tens of meters radius from an injection well in a reservoir of one-hundred meters thickness. It was shown that over ninety percent of heat can be recovered for certain reservoirs. The previous calculations for the Geothermal Battery Energy Storage considered only isotropic and homogeneous reservoir formation properties. However, even in a small rock mass volume, considering sedimentary depositional environments and superimposed tectonics, the rock permeability may be anisotropic and heterogeneous with reservoir layers of different properties. Calculations are presented here considering anisotropic permeabilities, and layered heterogeneous permeabilities i.e., formations with horizontal layers of different permeabilities. Such reservoir properties create non-symmetrical temperature and pressure profiles away from a well, which is critical for well layout and planning for injection and production.


title: Fast Deep Mixtures of Gaussian Process Experts

abstract: Mixtures of experts have become an indispensable tool for flexible modelling in a supervised learning context, allowing not only the mean function but the entire density of the output to change with the inputs. Sparse Gaussian processes (GP) have shown promise as a leading candidate for the experts in such models, and in this article, we propose to design the gating network for selecting the experts from such mixtures of sparse GPs using a deep neural network (DNN). Furthermore, a fast one pass algorithm called Cluster-Classify-Regress (CCR) is leveraged to approximate the maximum a posteriori (MAP) estimator extremely quickly. This powerful combination of model and algorithm together delivers a novel method which is flexible, robust, and extremely efficient. In particular, the method is able to outperform competing methods in terms of accuracy and uncertainty quantification. The cost is competitive on low-dimensional and small data sets, but is significantly lower for higher-dimensional and big data sets. Iteratively maximizing the distribution of experts given allocations and allocations given experts does not provide significant improvement, which indicates that the algorithm achieves a good approximation to the local MAP estimator very fast. This insight can be useful also in the context of other mixture of experts models.


title: Bedrock reconstruction from free surface data for unidirectional glacier flow with basal slip

abstract: Glacier ice flow is shaped and defined by several properties, including the bedrock elevation profile and the basal slip distribution. The effect of these two basal properties can present in similar ways in the surface. For bedrock recovery this makes distinguishing between them an interesting and complex problem. The results of this paper show that in some synthetic test cases it is indeed possible to distinguish and recover both bedrock elevation and basal slip given free surface elevation and free surface velocity. The unidirectional shallow ice approximation is used to compute steady state surface data for a number of synthetic cases with different bedrock profiles and basal slip distributions. A simple inversion method based on Newton's method is applied to the known surface data to return the bedrock profile and basal slip distribution. In each synthetic test case, the inversion was successful in recovering both the bedrock elevation profile and the basal slip distribution variables. These results imply that there is a unique bedrock profile and basal slip which give rise to a unique combination of free surface velocity and free surface elevation.


title: 70 years of machine learning in geoscience in review

abstract: This review gives an overview of the development of machine learning in geoscience. A thorough analysis of the co-developments of machine learning applications throughout the last 70 years relates the recent enthusiasm for machine learning to developments in geoscience. I explore the shift of kriging towards a mainstream machine learning method and the historic application of neural networks in geoscience, following the general trend of machine learning enthusiasm through the decades. Furthermore, this chapter explores the shift from mathematical fundamentals and knowledge in software development towards skills in model validation, applied statistics, and integrated subject matter expertise. The review is interspersed with code examples to complement the theoretical foundations and illustrate model validation and machine learning explainability for science. The scope of this review includes various shallow machine learning methods, e.g. Decision Trees, Random Forests, Support-Vector Machines, and Gaussian Processes, as well as, deep neural networks, including feed-forward neural networks, convolutional neural networks, recurrent neural networks and generative adversarial networks. Regarding geoscience, the review has a bias towards geophysics but aims to strike a balance with geochemistry, geostatistics, and geology, however excludes remote sensing, as this would exceed the scope. In general, I aim to provide context for the recent enthusiasm surrounding deep learning with respect to research, hardware, and software developments that enable successful application of shallow and deep machine learning in all disciplines of Earth science.


title: Robust Gaussian Covariance Estimation in Nearly-Matrix Multiplication Time

abstract: Robust covariance estimation is the following, well-studied problem in high dimensional statistics: given $N$ samples from a $d$-dimensional Gaussian $\mathcal{N}(\boldsymbol{0}, \Sigma)$, but where an $\varepsilon$-fraction of the samples have been arbitrarily corrupted, output $\widehat{\Sigma}$ minimizing the total variation distance between $\mathcal{N}(\boldsymbol{0}, \Sigma)$ and $\mathcal{N}(\boldsymbol{0}, \widehat{\Sigma})$. This corresponds to learning $\Sigma$ in a natural affine-invariant variant of the Frobenius norm known as the \emph{Mahalanobis norm}. Previous work of Cheng et al demonstrated an algorithm that, given $N = \Omega (d^2 / \varepsilon^2)$ samples, achieved a near-optimal error of $O(\varepsilon \log 1 / \varepsilon)$, and moreover, their algorithm ran in time $\widetilde{O}(T(N, d) \log \kappa / \mathrm{poly} (\varepsilon))$, where $T(N, d)$ is the time it takes to multiply a $d \times N$ matrix by its transpose, and $\kappa$ is the condition number of $\Sigma$. When $\varepsilon$ is relatively small, their polynomial dependence on $1/\varepsilon$ in the runtime is prohibitively large. In this paper, we demonstrate a novel algorithm that achieves the same statistical guarantees, but which runs in time $\widetilde{O} (T(N, d) \log \kappa)$. In particular, our runtime has no dependence on $\varepsilon$. When $\Sigma$ is reasonably conditioned, our runtime matches that of the fastest algorithm for covariance estimation without outliers, up to poly-logarithmic factors, showing that we can get robustness essentially "for free."


title: Semi-analytic Expressions for the Isolation and Coupling of Mixed Modes

abstract: In the oscillation spectra of giant stars, nonradial modes may be seen to undergo avoided crossings, which produce a characteristic "mode bumping" of the otherwise uniform asymptotic p- and g-mode patterns in their respective echelle diagrams. Avoided crossings evolve very quickly relative to typical observational errors, and are therefore extremely useful in determining precise ages of stars, particularly in subgiants. This phenomenon is caused by coupling between modes in the p- and g-mode cavities that are near resonance with each other. Most theoretical analyses of the coupling between these mode cavities rely on the JWKB approach, which is strictly speaking inapplicable for the low-order g-modes observed in subgiants, or the low-order p-modes seen in very evolved red giants. We present both a nonasymptotic prescription for isolating the two mode cavities, as well as a perturbative (and also nonasymptotic) description of the coupling between them, which we show to hold good for the low-order g- and p-modes in these physical situations. Finally, we discuss how these results may be applied to modelling subgiant stars and determining their global properties from oscillation frequencies. We also make our code for all of these computations publicly available.


title: NASTransfer: Analyzing Architecture Transferability in Large Scale Neural Architecture Search

abstract: Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the architectures on large-scale tasks. The typical way of conducting large scale NAS is to search for an architectural building block on a small dataset (either using a proxy set from the large dataset or a completely different small scale dataset) and then transfer the block to a larger dataset. Despite a number of recent results that show the promise of transfer from proxy datasets, a comprehensive evaluation of different NAS methods studying the impact of different source datasets has not yet been addressed. In this work, we propose to analyze the architecture transferability of different NAS methods by performing a series of experiments on large scale benchmarks such as ImageNet1K and ImageNet22K. We find that: (i) The size and domain of the proxy set does not seem to influence architecture performance on the target dataset. On average, transfer performance of architectures searched using completely different small datasets (e.g., CIFAR10) perform similarly to the architectures searched directly on proxy target datasets. However, design of proxy sets has considerable impact on rankings of different NAS methods. (ii) While different NAS methods show similar performance on a source dataset (e.g., CIFAR10), they significantly differ on the transfer performance to a large dataset (e.g., ImageNet1K). (iii) Even on large datasets, random sampling baseline is very competitive, but the choice of the appropriate combination of proxy set and search strategy can provide significant improvement over it. We believe that our extensive empirical analysis will prove useful for future design of NAS algorithms.


title: 3D Smith chart constant quality factor semi-circles contours for positive and negative resistance circuits

abstract: The article proves first that the constant quality factor (Q) contours for passive circuits, while represented on a 2D Smith chart, form circle arcs on a coaxal circle family. Furthermore, these circle arcs represent semi-circles families in the north hemisphere while represented on a 3D Smith chart. On the contrary we show that the constant Q contours for active circuits with negative resistance form complementary circle arcs on the same family of coaxal circles in the exterior of the 2D Smith chart. Also, we find out that these constant Q contours represent complementary semi-circles in the south hemisphere while represented on the 3D Smith chart for negative resistance circuits. The constant Q - computer aided design (CAD) implementation of the Q semi-circles on the 3D Smith chart is then successfully used to evaluate the quality factor variations of newly fabricated Vanadium dioxide inductors first, directly from their reflection coefficient, as the temperature is increased from room temperature to 50 degrees Celsius ({\deg}C). Thus, a direct multi-parameter frequency dependent analysis is proposed including Q, inductance and reflection coefficient for inductors. Then, quality factor direct analysis is used for two tunnel diode small signal equivalent circuits analysis, allowing for the first time the Q and input impedance direct analysis on Smith chart representation of a circuit, including negative resistance


title: Extracting ice phases from liquid water: why a machine-learning water model generalizes so well

abstract: We investigate the structural similarities between liquid water and 53 ices, including 20 knowncrystalline phases. We base such similarity comparison on the local environments that consist of atoms within a certain cutoff radius of a central atom. We reveal that liquid water explores the localenvironments of the diverse ice phases, by directly comparing the environments in these phases using general atomic descriptors, and also by demonstrating that a machine-learning potential trained on liquid water alone can predict the densities, the lattice energies, and vibrational properties of theices. The finding that the local environments characterising the different ice phases are found in water sheds light on water phase behaviors, and rationalizes the transferability of water models between different phases.


title: Endpoint contributions to excited-state modular Hamiltonians

abstract: We compute modular Hamiltonians for excited states obtained by perturbing the vacuum with a unitary operator. We use operator methods and work to first order in the strength of the perturbation. For the most part we divide space in half and focus on perturbations generated by integrating a local operator $J$ over a null plane. Local operators with weight $n \geq 2$ under vacuum modular flow produce an additional endpoint contribution to the modular Hamiltonian. Intuitively this is because operators with weight $n \geq 2$ can move degrees of freedom from a region to its complement. The endpoint contribution is an integral of $J$ over a null plane. We show this in detail for stress tensor perturbations in two dimensions, where the result can be verified by a conformal transformation, and for scalar perturbations in a CFT. This lets us conjecture a general form for the endpoint contribution that applies to any field theory divided into half-spaces.


title: A Note on Over-Smoothing for Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have achieved a lot of success on graph-structured data. However, it is observed that the performance of graph neural networks does not improve as the number of layers increases. This effect, known as over-smoothing, has been analyzed mostly in linear cases. In this paper, we build upon previous results \cite{oono2019graph} to further analyze the over-smoothing effect in the general graph neural network architecture. We show when the weight matrix satisfies the conditions determined by the spectrum of augmented normalized Laplacian, the Dirichlet energy of embeddings will converge to zero, resulting in the loss of discriminative power. Using Dirichlet energy to measure "expressiveness" of embedding is conceptually clean; it leads to simpler proofs than \cite{oono2019graph} and can handle more non-linearities.


title: Classification Performance Metric for Imbalance Data Based on Recall and Selectivity Normalized in Class Labels

abstract: In the classification of a class imbalance dataset, the performance measure used for the model selection and comparison to competing methods is a major issue. In order to overcome this problem several performance measures are defined and analyzed in several perspectives regarding in particular the imbalance ratio. There is still no clear indication which metric is universal and can be used for any skewed data problem. In this paper we introduced a new performance measure based on the harmonic mean of Recall and Selectivity normalized in class labels. This paper shows that the proposed performance measure has the right properties for the imbalanced dataset. In particular, in the space defined by the majority class examples and imbalance ratio it is less sensitive to changes in the majority class and more sensitive to changes in the minority class compared with other existing single-value performance measures. Additionally, the identity of the other performance measures has been proven analytically.


title: Mesoscale modeling of near-contact interactions for complex flowing interfaces

abstract: We present a mesoscale kinetic model for multicomponent flows, augmented with a short range forcing term, aimed at describing the combined effect of surface tension and near-contact interactions operating at the fluid interface level. Such mesoscale approach is shown to i) accurately capture the complex dynamics of bouncing colliding droplets for different values of the main governing parameters, ii) predict quantitatively the effective viscosity of dense emulsions in micro-channels and iii) simulate the formation of the so-called soft flowing crystals in microfluidic focusers.


title: Introducing recalibrated academic performance indicators in the evaluation of individuals' research performance: A case study from Eastern Europe

abstract: In Hungary, the highest and most prestigious scientific qualification is considered to be the Doctor of Science (DSc) title being awarded by the Hungarian Academy of Sciences. The academic performance indicators of the DSc title are of high importance in the evaluation of individuals' research performance not only when a researcher applies for obtaining a DSc title, but also during promotions and appointments at universities, and in the case of the evaluation of applications for scientific titles and degrees, and the assessment of applications for funding. In the Section of Earth Sciences encompassing nine related disciplines, rather than carrying out a straightforward bibliometric analysis, the performance indicators were designed as a result of a consensual agreement between leading academicians, each of whom represented a particular discipline. Therefore, the minimum values of the indicators, required to be fulfilled if one is applying for a DSc title, do not adequately reflect the actual discipline-specific performance of researchers. This problem may generate tension between researchers during the evaluation process. The main goal of this paper is to recalibrate the minimum values of four major performance indicators by taking the actual discipline-specific distance ratios into account. In addition, each minimum value will be defined by employing integer and fractional counting methods as well. The research outcome of this study can provide impetus for the Section of Earth Sciences to optimize the minimum values of the DSc title performance indicators by taking the specifics of each discipline into account. Because academic performance indicators are also employed in other Eastern European countries in the evaluation of individuals' research performance, the methods used in that paper can be placed into a wider geographical context.


title: Realistic Adversarial Data Augmentation for MR Image Segmentation

abstract: Neural network-based approaches can achieve high accuracy in various medical image segmentation tasks. However, they generally require large labelled datasets for supervised learning. Acquiring and manually labelling a large medical dataset is expensive and sometimes impractical due to data sharing and privacy issues. In this work, we propose an adversarial data augmentation method for training neural networks for medical image segmentation. Instead of generating pixel-wise adversarial attacks, our model generates plausible and realistic signal corruptions, which models the intensity inhomogeneities caused by a common type of artefacts in MR imaging: bias field. The proposed method does not rely on generative networks, and can be used as a plug-in module for general segmentation networks in both supervised and semi-supervised learning. Using cardiac MR imaging we show that such an approach can improve the generalization ability and robustness of models as well as provide significant improvements in low-data scenarios.


title: Reciprocity formulas for Hall-Wilson-Zagier type Hardy-Berndt sums

abstract: In this paper, we introduce vast generalizations of the Hardy-Berndt sums. They involve higher-order Euler and/or Bernoulli functions, in which the variables are affected by certain linear shifts. By employing the Fourier series technique we derive linear relations for these sums. In particular, these relations yield reciprocity formulas for Carlitz, Rademacher, Mikol\'{a}s and Apostol type generalizations of the Hardy-Berndt sums, and give rise to generalizations for some Goldberg's three-term relations. We also present an elementary proof for the Mikol\'{a}s' linear relation and a reciprocity formula in terms of the generation function.


title: Analysis of HAT-P-23 b, Qatar-1 b, WASP-2 b, and WASP-33 b with an Optimized EXOplanet Transit Interpretation Code

abstract: The ability for citizen scientists to analyze image data and search for exoplanets using images from small telescopes has the potential to greatly accelerate the search for exoplanets. Recent work on the Exoplanet Transit Interpretation Code (EXOTIC) enables the generation of high-quality light curves of exoplanet transits given such image data. However, on large image datasets, the photometric analysis of the data and fitting light curves can be a time-consuming process. In this work, we first optimize portions of the EXOTIC codebase to enable faster image processing and curve fitting. Specifically, we limited repetitive computation on fitting centroids with various apertures and annuli. Moreover, this speedup is scaled linearly based on the number of FITS files. After testing on existing HAT-P-32 b data and newer HAT-P-23 b data, our best demonstration was approximately a 5x speedup, though that factor increases given a larger number of FITS files. Utilizing the accelerated code, we analyzed transits of HAT-P-23 b, Qatar-1 b, WASP-2 b, and WASP-33 b using data captured by the 16" SRO telescope operated by Boyce-Astro.


title: Backward and forward filtering under the weak H\"ormander condition

abstract: We derive the forward and backward filtering equations for a class of degenerate partially observable diffusions, satisfying the weak H\"ormander condition. Our approach is based on the H\"older theory for degenerate SPDEs that allows to pursue the direct approaches proposed by N. V. Krylov and A. Zatezalo, and A. Yu. Veretennikov, avoiding the use of general results from filtering theory. As a by-product we also provide existence, regularity and estimates for the filtering density.


title: Safe Learning under Uncertain Objectives and Constraints

abstract: In this paper, we consider non-convex optimization problems under \textit{unknown} yet safety-critical constraints. Such problems naturally arise in a variety of domains including robotics, manufacturing, and medical procedures, where it is infeasible to know or identify all the constraints. Therefore, the parameter space should be explored in a conservative way to ensure that none of the constraints are violated during the optimization process once we start from a safe initialization point. To this end, we develop an algorithm called Reliable Frank-Wolfe (Reliable-FW). Given a general non-convex function and an unknown polytope constraint, Reliable-FW simultaneously learns the landscape of the objective function and the boundary of the safety polytope. More precisely, by assuming that Reliable-FW has access to a (stochastic) gradient oracle of the objective function and a noisy feasibility oracle of the safety polytope, it finds an $\epsilon$-approximate first-order stationary point with the optimal ${\mathcal{O}}({1}/{\epsilon^2})$ gradient oracle complexity (resp. $\tilde{\mathcal{O}}({1}/{\epsilon^3})$ (also optimal) in the stochastic gradient setting), while ensuring the safety of all the iterates. Rather surprisingly, Reliable-FW only makes $\tilde{\mathcal{O}}(({d^2}/{\epsilon^2})\log 1/\delta)$ queries to the noisy feasibility oracle (resp. $\tilde{\mathcal{O}}(({d^2}/{\epsilon^4})\log 1/\delta)$ in the stochastic gradient setting) where $d$ is the dimension and $\delta$ is the reliability parameter, tightening the existing bounds even for safe minimization of convex functions. We further specialize our results to the case that the objective function is convex. A crucial component of our analysis is to introduce and apply a technique called geometric shrinkage in the context of safe optimization.


title: Classifying Referential and Non-referential It Using Gaze

abstract: When processing a text, humans and machines must disambiguate between different uses of the pronoun it, including non-referential, nominal anaphoric or clause anaphoric ones. In this paper, we use eye-tracking data to learn how humans perform this disambiguation. We use this knowledge to improve the automatic classification of it. We show that by using gaze data and a POS-tagger we are able to significantly outperform a common baseline and classify between three categories of it with an accuracy comparable to that of linguisticbased approaches. In addition, the discriminatory power of specific gaze features informs the way humans process the pronoun, which, to the best of our knowledge, has not been explored using data from a natural reading task.


title: Thermoelectric properties of tubular nanowires in the presence of a transverse magnetic field

abstract: We calculate the charge and heat current associate with electrons, generated by a temperature gradient and chemical potential difference between two ends of a tubular nanowire of 30 nm radius in the presence of an external magnetic field perpendicular to its axis. We consider a nanowire based on a semiconductor material, and use the Landauer-Bttiker approach to calculate the transport quantities. We obtain the variation of the Seebeck coefficient ($S$), thermal conductivity kappa, and the figure of merit ($ZT$), with respect to the temperature up to 20\,K, and with the magnetic field up to 3 T. In particular we show that the Seebeck coefficient can change sign in this domain of parameters. In addition $\kappa$ and $ZT$ have oscillations when the magnetic field increases. These oscillations are determined by the energy spectrum of the electrons.


title: Bach or Mock? A Grading Function for Chorales in the Style of J.S. Bach

abstract: Deep generative systems that learn probabilistic models from a corpus of existing music do not explicitly encode knowledge of a musical style, compared to traditional rule-based systems. Thus, it can be difficult to determine whether deep models generate stylistically correct output without expert evaluation, but this is expensive and time-consuming. Therefore, there is a need for automatic, interpretable, and musically-motivated evaluation measures of generated music. In this paper, we introduce a grading function that evaluates four-part chorales in the style of J.S. Bach along important musical features. We use the grading function to evaluate the output of a Transformer model, and show that the function is both interpretable and outperforms human experts at discriminating Bach chorales from model-generated ones.


title: A Mean-Field Theory for Learning the Sch\"{o}nberg Measure of Radial Basis Functions

abstract: We develop and analyze a projected particle Langevin optimization method to learn the distribution in the Sch\"{o}nberg integral representation of the radial basis functions from training samples. More specifically, we characterize a distributionally robust optimization method with respect to the Wasserstein distance to optimize the distribution in the Sch\"{o}nberg integral representation. To provide theoretical performance guarantees, we analyze the scaling limits of a projected particle online (stochastic) optimization method in the mean-field regime. In particular, we prove that in the scaling limits, the empirical measure of the Langevin particles converges to the law of a reflected It\^{o} diffusion-drift process. Moreover, the drift is also a function of the law of the underlying process. Using It\^{o} lemma for semi-martingales and Grisanov's change of measure for the Wiener processes, we then derive a Mckean-Vlasov type partial differential equation (PDE) with Robin boundary conditions that describes the evolution of the empirical measure of the projected Langevin particles in the mean-field regime. In addition, we establish the existence and uniqueness of the steady-state solutions of the derived PDE in the weak sense. We apply our learning approach to train radial kernels in the kernel locally sensitive hash (LSH) functions, where the training data-set is generated via a $k$-mean clustering method on a small subset of data-base. We subsequently apply our kernel LSH with a trained kernel for image retrieval task on MNIST data-set, and demonstrate the efficacy of our kernel learning approach. We also apply our kernel learning approach in conjunction with the kernel support vector machines (SVMs) for classification of benchmark data-sets.


title: Incorporating Music Knowledge in Continual Dataset Augmentation for Music Generation

abstract: Deep learning has rapidly become the state-of-the-art approach for music generation. However, training a deep model typically requires a large training set, which is often not available for specific musical styles. In this paper, we present augmentative generation (Aug-Gen), a method of dataset augmentation for any music generation system trained on a resource-constrained domain. The key intuition of this method is that the training data for a generative system can be augmented by examples the system produces during the course of training, provided these examples are of sufficiently high quality and variety. We apply Aug-Gen to Transformer-based chorale generation in the style of J.S. Bach, and show that this allows for longer training and results in better generative output.


title: Thalamocortical motor circuit insights for more robust hierarchical control of complex sequences

abstract: We study learning of recurrent neural networks that produce temporal sequences consisting of the concatenation of re-usable "motifs". In the context of neuroscience or robotics, these motifs would be the motor primitives from which complex behavior is generated. Given a known set of motifs, can a new motif be learned without affecting the performance of the known set and then used in new sequences without first explicitly learning every possible transition? Two requirements enable this: (i) parameter updates while learning a new motif do not interfere with the parameters used for the previously acquired ones; and (ii) a new motif can be robustly generated when starting from the network state reached at the end of any of the other motifs, even if that state was not present during training. We meet the first requirement by investigating artificial neural networks (ANNs) with specific architectures, and attempt to meet the second by training them to generate motifs from random initial states. We find that learning of single motifs succeeds but that sequence generation is not robust: transition failures are observed. We then compare these results with a model whose architecture and analytically-tractable dynamics are inspired by the motor thalamocortical circuit, and that includes a specific module used to implement motif transitions. The synaptic weights of this model can be adjusted without requiring stochastic gradient descent (SGD) on the simulated network outputs, and we have asymptotic guarantees that transitions will not fail. Indeed, in simulations, we achieve single-motif accuracy on par with the previously studied ANNs and have improved sequencing robustness with no transition failures. Finally, we show that insights obtained by studying the transition subnetwork of this model can also improve the robustness of transitioning in the traditional ANNs previously studied.


title: Balanced truncation of $k$-positive systems

abstract: This paper considers balanced truncation of discrete-time Hankel $k$-positive systems, characterized by Hankel matrices whose minors up to order $k$ are nonnegative. Our main result shows that if the truncated system has order $k$ or less, then it is Hankel totally positive ($\infty$-positive), meaning that it is a sum of first order lags. This result can be understood as a bridge between two known results: the property that the first-order truncation of a positive system is positive ($k=1$), and the property that balanced truncation preserves state-space symmetry. It provides a broad class of systems where balanced truncation is guaranteed to result in a minimal internally positive system.


title: Circuits with broken fibration symmetries perform core logic computations in biological networks

abstract: We show that logic computational circuits in gene regulatory networks arise from a fibration symmetry breaking in the network structure. From this idea we implement a constructive procedure that reveals a hierarchy of genetic circuits, ubiquitous across species, that are surprising analogues to the emblematic circuits of solid-state electronics: starting from the transistor and progressing to ring oscillators, current-mirror circuits to toggle switches and flip-flops. These canonical variants serve fundamental operations of synchronization and clocks (in their symmetric states) and memory storage (in their broken symmetry states). These conclusions introduce a theoretically principled strategy to search for computational building blocks in biological networks, and present a systematic route to design synthetic biological circuits.

categories: q-bio.GN math.GR physics.bio-ph physics.data-an


title: Non-Parametric Graph Learning for Bayesian Graph Neural Networks

abstract: Graphs are ubiquitous in modelling relational structures. Recent endeavours in machine learning for graph-structured data have led to many architectures and learning algorithms. However, the graph used by these algorithms is often constructed based on inaccurate modelling assumptions and/or noisy data. As a result, it fails to represent the true relationships between nodes. A Bayesian framework which targets posterior inference of the graph by considering it as a random quantity can be beneficial. In this paper, we propose a novel non-parametric graph model for constructing the posterior distribution of graph adjacency matrices. The proposed model is flexible in the sense that it can effectively take into account the output of graph-based learning algorithms that target specific tasks. In addition, model inference scales well to large graphs. We demonstrate the advantages of this model in three different problem settings: node classification, link prediction and recommendation.


title: On quantifying the topological charge in micromagnetics using a lattice-based approach

abstract: An implementation of a lattice-based approach for computing the topological skyrmion charge is provided for the open source micromagnetics code MuMax3. Its accuracy with respect to an existing method based on finite difference derivatives is compared for three different test cases. The lattice-based approach is found to be more robust for finite-temperature dynamics and for nucleation and annihilation processes in extended systems.


title: Diffraction of diatomic molecular beams: a model with applications to Talbot-Lau interferometry

abstract: In this article we formulate and solve the problem of molecular beam diffraction when each molecule consists of two interacting bodies. Then, using our results, we present the diffraction patterns for various molecular sizes employing the harmonic oscillator as interaction model between the two atoms. Lastly, we analyze the corrections produced by the internal structure of the molecule in applications that include beam focusing and Talbot carpets.


title: Capture of rod-like molecules by a nanopore: defining an "orientational capture radius"

abstract: Both the translational diffusion coefficient $D$ and the electrophoretic mobility $\mu$ of a short rod-like molecule (such as dsDNA) that is being pulled towards a nanopore by an electric field should depend on its orientation. Since a charged rod-like molecule tends to orient in the presence of an inhomogeneous electric field, $D$ and $\mu$ will change as the molecule approaches the nanopore, and this will impact the capture process. We present a simplified study of this problem using theoretical arguments and Langevin Dynamics simulations. In particular, we introduce a new \textit{orientational capture radius} which we compare to the capture radius for the equivalent point-like particle, and we discuss the different physical regimes of orientation during capture and the impact of initial orientations on the capture time.


title: Quantum Algorithm for Simulating Molecular Vibrational Excitations

abstract: The excitation of vibrational modes in molecules affects the outcome of chemical reactions, for example by providing molecules with sufficient energy to overcome activation barriers. In this work, we introduce a quantum algorithm for simulating molecular vibrational excitations during vibronic transitions. We discuss how a special-purpose quantum computer can be programmed with molecular data to optimize a vibronic process such that desired modes get excited during the transition. We investigate the effect of such excitations on selective bond dissociation in pyrrole and butane during photochemical and mechanochemical vibronic transitions. The results are discussed with respect to experimental observations and classical simulations. We also introduce quantum-inspired classical algorithms for simulating molecular vibrational excitations in special cases where only a limited number of modes are of interest.


title: Uniqueness and Optimality of Dynamical Extensions of Divergences

abstract: We introduce an axiomatic approach for channel divergences and channel relative entropies that is based on three information-theoretic axioms of monotonicity under superchannels (i.e. generalized data processing inequality), additivity under tensor products, and normalization, similar to the approach given recently for the state domain. We show that these axioms are sufficient to give enough structure also in the channel domain, leading to numerous properties that are applicable to all channel divergences. These include faithfulness, continuity, a type of triangle inequality, and boundedness between the min and max channel relative entropies. In addition, we prove a uniqueness theorem showing that the Kullback-Leibler divergence has only one extension to classical channels. For quantum channels, with the exception of the max relative entropy, this uniqueness does not hold. Instead we prove the optimality of the amortized channel extension of the Umegaki relative entropy, by showing that it provides a lower bound on all channel relative entropies that reduce to the Kullback-Leibler divergence on classical states. We also introduce the maximal channel extension of a given classical state divergence and study its properties.


title: Applying Lie Groups Approaches for Rigid Registration of Point Clouds

abstract: In the last decades, some literature appeared using the Lie groups theory to solve problems in computer vision. On the other hand, Lie algebraic representations of the transformations therein were introduced to overcome the difficulties behind group structure by mapping the transformation groups to linear spaces. In this paper we focus on application of Lie groups and Lie algebras to find the rigid transformation that best register two surfaces represented by point clouds. The so called pairwise rigid registration can be formulated by comparing intrinsic second-order orientation tensors that encode local geometry. These tensors can be (locally) represented by symmetric non-negative definite matrices. In this paper we interpret the obtained tensor field as a multivariate normal model. So, we start with the fact that the space of Gaussians can be equipped with a Lie group structure, that is isomorphic to a subgroup of the upper triangular matrices. Consequently, the associated Lie algebra structure enables us to handle Gaussians, and consequently, to compare orientation tensors, with Euclidean operations. We apply this methodology to variants of the Iterative Closest Point (ICP), a known technique for pairwise registration. We compare the obtained results with the original implementations that apply the comparative tensor shape factor (CTSF), which is a similarity notion based on the eigenvalues of the orientation tensors. We notice that the similarity measure in tensor spaces directly derived from Lie's approach is not invariant under rotations, which is a problem in terms of rigid registration. Despite of this, the performed computational experiments show promising results when embedding orientation tensor fields in Lie algebras.


title: Simultaneous compression and opacity data from time-series radiography with a Lagrangian marker

abstract: Time-resolved radiography can be used to obtain absolute shock Hugoniot states by simultaneously measuring at least two mechanical parameters of the shock, and this technique is particularly suitable for one-dimensional converging shocks where a single experiment probes a range of pressures as the converging shock strengthens. However, at sufficiently high pressures, the shocked material becomes hot enough that the x-ray opacity falls significantly. If the system includes a Lagrangian marker, such that the mass within the marker is known, this additional information can be used to constrain the opacity as well as the Hugoniot state. In the limit that the opacity changes only on shock heating, and not significantly on subsequent isentropic compression, the opacity of shocked material can be determined uniquely. More generally, it is necessary to assume the form of the variation of opacity with isentropic compression, or to introduce multiple marker layers. Alternatively, assuming either the equation of state or the opacity, the presence of a marker layer in such experiments enables the non-assumed property to be deduced more accurately than from the radiographic density reconstruction alone. An example analysis is shown for measurements of a converging shock wave in polystyrene, at the National Ignition Facility.


title: One Model to Pronounce Them All: Multilingual Grapheme-to-Phoneme Conversion With a Transformer Ensemble

abstract: The task of grapheme-to-phoneme (G2P) conversion is important for both speech recognition and synthesis. Similar to other speech and language processing tasks, in a scenario where only small-sized training data are available, learning G2P models is challenging. We describe a simple approach of exploiting model ensembles, based on multilingual Transformers and self-training, to develop a highly effective G2P solution for 15 languages. Our models are developed as part of our participation in the SIGMORPHON 2020 Shared Task 1 focused at G2P. Our best models achieve 14.99 word error rate (WER) and 3.30 phoneme error rate (PER), a sizeable improvement over the shared task competitive baselines.


title: JCR70: A Low-Complexity Millimeter-Wave Proof-of-Concept Platform for A Fully-Digital MIMO Joint Communication-Radar

abstract: A fully-digital wideband joint communication-radar (JCR) with a multiple-input-multiple-output (MIMO) architecture at the millimeter-wave (mmWave) band will enable high joint communication and radar performance with enhanced design flexibility. A quantized receiver with few-bit analog-to-digital converters (ADCs) will enable a practical JCR solution with reduced power consumption for futuristic portable devices and autonomous vehicles. In this paper, we present a joint communication-radar proof-of-concept platform, named JCR70, to evaluate and demonstrate the performance of these JCR systems using real channel measurements in the 71-76 GHz band. We develop this platform by extending a mmWave communication set-up with an additional full-duplex radar receiver and by capturing the MIMO JCR channel using a moving antenna on a sliding rail. To characterize the JCR performance of our developed tested, we conduct several indoor and outdoor experiments and apply traditional as well as advanced processing algorithms on the measured data. Additionally, we compare the performance of our JCR70 platform with the INRAS Radarbook, which is a state-of-the-art automotive radar evaluation platform at 77 GHz. The results demonstrate that a quantized receiver with 2-4 bit ADCs generally performed quite close to the high-resolution ADC for a signal-to-noise ratio of up to 5 dB. Our JCR70 platform with a fully digital JCR waveform at 73 GHz and 2 GHz bandwidth achieved higher resolution capability than the Radarbook due to higher bandwidth and larger synthesized antenna aperture.


title: Curious convergent series of integers with missing digits

abstract: A classical theorem of Kempner states that the sum of the reciprocals of positive integers with missing decimal digits converges. This result is extended to much larger families of "missing digits" sets of positive integers with both convergent and divergent harmonic series.


title: Learning Gradient Boosted Multi-label Classification Rules

abstract: In multi-label classification, where the evaluation of predictions is less straightforward than in single-label classification, various meaningful, though different, loss functions have been proposed. Ideally, the learning algorithm should be customizable towards a specific choice of the performance measure. Modern implementations of boosting, most prominently gradient boosted decision trees, appear to be appealing from this point of view. However, they are mostly limited to single-label classification, and hence not amenable to multi-label losses unless these are label-wise decomposable. In this work, we develop a generalization of the gradient boosting framework to multi-output problems and propose an algorithm for learning multi-label classification rules that is able to minimize decomposable as well as non-decomposable loss functions. Using the well-known Hamming loss and subset 0/1 loss as representatives, we analyze the abilities and limitations of our approach on synthetic data and evaluate its predictive performance on multi-label benchmarks.


title: Principal Component Networks: Parameter Reduction Early in Training

abstract: Recent works show that overparameterized networks contain small subnetworks that exhibit comparable accuracy to the full model when trained in isolation. These results highlight the potential to reduce training costs of deep neural networks without sacrificing generalization performance. However, existing approaches for finding these small networks rely on expensive multi-round train-and-prune procedures and are non-practical for large data sets and models. In this paper, we show how to find small networks that exhibit the same performance as their overparameterized counterparts after only a few training epochs. We find that hidden layer activations in overparameterized networks exist primarily in subspaces smaller than the actual model width. Building on this observation, we use PCA to find a basis of high variance for layer inputs and represent layer weights using these directions. We eliminate all weights not relevant to the found PCA basis and term these network architectures Principal Component Networks. On CIFAR-10 and ImageNet, we show that PCNs train faster and use less energy than overparameterized models, without accuracy loss. We find that our transformation leads to networks with up to 23.8x fewer parameters, with equal or higher end-model accuracy---in some cases we observe improvements up to 3%. We also show that ResNet-20 PCNs outperform deep ResNet-110 networks while training faster.


title: Equivariant nonabelian Poincar\'e duality and equivariant factorization homology of Thom spectra

abstract: In this paper, we study genuine equivariant factorization homology and its interaction with equivariant Thom spectra, which we construct using the language of parametrized higher category theory. We describe the genuine equivariant factorization homology of Thom spectra, and use this description to compute several examples of interest. A key ingredient for our computations is an equivariant nonabelian Poincar\'e duality theorem, in which we prove that factorization homology with coefficients in a $G$-space is given by a mapping space. We compute the Real topological Hochschild homology ($THR$) of the Real bordism spectrum $MU_\mathbb{R}$ and of the equivariant Eilenberg--MacLane spectra $H\underline{\mathbb{F}}_2$ and $H\underline{\mathbb{Z}}_{(2)}$, as well as factorization homology of the sphere $S^{2\sigma}$ with coefficients in these Eilenberg--MacLane spectra. In Appendix B, Jeremy Hahn and Dylan Wilson compute $THR(H\underline{\mathbb{Z}})$.


title: Control of Dendrites in Rechargeable Batteries using Smart Charging

abstract: In this paper we develop a feed-back control framework for the real-time minimization of microstructures grown within the rechargeable battery. Due to quickening nature of the branched evolution, we identify the critical ramified peaks in the early stages and based on the state we compute the relaxation time for the concentration in those branching fingers. The control parameter is a function of the maximum curvature (i.e. minimum radius) of the branched microstructure, where the higher rate dendritic evolution would lead to the more critical state to be controlled. The charging time is minimized for generating the most packed microstructures and obtained results correlate closely with those of considerably higher charging time periods. The developed framework could be utilized as a smart charging protocol for the safe and sustainable operation the rechargeable batteries, where the branching of the microstructures could be correlated to the sudden variation in the current/voltage.


title: Embodied Self-supervised Learning by Coordinated Sampling and Training

abstract: Self-supervised learning can significantly improve the performance of downstream tasks, however, the dimensions of learned representations normally lack explicit physical meanings. In this work, we propose a novel self-supervised approach to solve inverse problems by employing the corresponding physical forward process so that the learned representations can have explicit physical meanings. The proposed approach works in an analysis-by-synthesis manner to learn an inference network by iteratively sampling and training. At the sampling step, given observed data, the inference network is used to approximate the intractable posterior, from which we sample input parameters and feed them to a physical process to generate data in the observational space; At the training step, the same network is optimized with the sampled paired data. We prove the feasibility of the proposed method by tackling the acoustic-to-articulatory inversion problem to infer articulatory information from speech. Given an articulatory synthesizer, an inference model can be trained completely from scratch with random initialization. Our experiments demonstrate that the proposed method can converge steadily and the network learns to control the articulatory synthesizer to speak like a human. We also demonstrate that trained models can generalize well to unseen speakers or even new languages, and performance can be further improved through self-adaptation.


title: Estimation of angular sensitivity for X-ray interferometers with multiple phase gratings

abstract: Recently, X-ray interferometers with more than one phase grating have been developed for differential phase contrast (DPC) imaging. In this study, a novel framework is developed to predict such interferometers' angular sensitivity responses (the minimum detectable refraction angle). Experiments are performed on the dual and triple phase grating interferometers, separately. Measurements show strong consistency with the predicted sensitivity values. Using this new approach, the DPC imaging performance of X-ray interferometers with multiple phase gratings can be further optimized for future biomedical applications.


title: Rethinking Distributional Matching Based Domain Adaptation

abstract: Domain adaptation (DA) is a technique that transfers predictive models trained on a labeled source domain to an unlabeled target domain, with the core difficulty of resolving distributional shift between domains. Currently, most popular DA algorithms are based on distributional matching (DM). However in practice, realistic domain shifts (RDS) may violate their basic assumptions and as a result these methods will fail. In this paper, in order to devise robust DA algorithms, we first systematically analyze the limitations of DM based methods, and then build new benchmarks with more realistic domain shifts to evaluate the well-accepted DM methods. We further propose InstaPBM, a novel Instance-based Predictive Behavior Matching method for robust DA. Extensive experiments on both conventional and RDS benchmarks demonstrate both the limitations of DM methods and the efficacy of InstaPBM: Compared with the best baselines, InstaPBM improves the classification accuracy respectively by $4.5\%$, $3.9\%$ on Digits5, VisDA2017, and $2.2\%$, $2.9\%$, $3.6\%$ on DomainNet-LDS, DomainNet-ILDS, ID-TwO. We hope our intuitive yet effective method will serve as a useful new direction and increase the robustness of DA in real scenarios. Code will be available at anonymous link: https://github.com/pikachusocute/InstaPBM-RobustDA.


title: CacheOut: Leaking Data on Intel CPUs via Cache Evictions

abstract: Recent transient-execution attacks, such as RIDL, Fallout, and ZombieLoad, demonstrated that attackers can leak information while it transits through microarchitectural buffers. Named Microarchitectural Data Sampling (MDS) by Intel, these attacks are likened to "drinking from the firehose", as the attacker has little control over what data is observed and from what origin. Unable to prevent the buffers from leaking, Intel issued countermeasures via microcode updates that overwrite the buffers when the CPU changes security domains. In this work we present CacheOut, a new microarchitectural attack that is capable of bypassing Intel's buffer overwrite countermeasures. We observe that as data is being evicted from the CPU's L1 cache, it is often transferred back to the leaky CPU buffers where it can be recovered by the attacker. CacheOut improves over previous MDS attacks by allowing the attacker to choose which data to leak from the CPU's L1 cache, as well as which part of a cache line to leak. We demonstrate that CacheOut can leak information across multiple security boundaries, including those between processes, virtual machines, user and kernel space, and from SGX enclaves.


title: A First Look at Privacy Analysis of COVID-19 Contact Tracing Mobile Applications

abstract: Today's smartphones are equipped with a large number of powerful value-added sensors and features such as a low power Bluetooth sensor, powerful embedded sensors such as the digital compass, accelerometer, GPS sensors, Wi-Fi capabilities, microphone, humidity sensors, health tracking sensors, and a camera, etc. These value-added sensors have revolutionized the lives of the human being in many ways such, as tracking the health of the patients and movement of doctors, tracking employees movement in large manufacturing units, and monitoring the environment, etc. These embedded sensors could also be used for large-scale personal, group, and community sensing applications especially tracing the spread of certain diseases. Governments and regulators are turning to use these features to trace the people thought to have symptoms of certain diseases or virus e.g. COVID-19. The outbreak of COVID-19 in December 2019, has seen a surge of the mobile applications for tracing, tracking and isolating the persons showing COVID-19 symptoms to limit the spread of disease to the larger community. The use of embedded sensors could disclose private information of the users thus potentially bring threat to the privacy and security of users. In this paper, we analyzed a large set of smartphone applications that have been designed to contain the spread of the COVID-19 virus and bring the people back to normal life. Specifically, we have analyzed what type of permission these smartphone apps require, whether these permissions are necessary for the track and trace, how data from the user devices is transported to the analytic center, and analyzing the security measures these apps have deployed to ensure the privacy and security of users.


title: Prime Running Functions

abstract: We study arithmetic functions $\Phi(x;d,a)$, called prime running functions, whose value at $x$ sums the gaps between primes $p_k \equiv a\ (\text{mod}\ d)$ below $x$ and the next following prime $p_{k+1}$, up to $x$. (The following prime $p_{k+1}$ may be in any residue class $(\text{mod}\ d)$.) We empirically observe systematic biases of order $x / \log x$ in $\Phi(x;d,a) - \Phi(x;d,b)$ for different $a,b$. We formulate modified Cram\'er models for primes and show that the corresponding sum of prime gap statistics exhibits systematic biases of this order of magnitude. The predictions of such modified Cram\'er models are compared with the experimental data.


title: A note on the natural density of product sets

abstract: Given two sets of natural numbers $\mathcal{A}$ and $\mathcal{B}$ of natural density $1$ we prove that their product set $\mathcal{A}\cdot \mathcal{B}:=\{ab:a\in\mathcal{A},\,b\in\mathcal{B}\}$ also has natural density $1$. On the other hand, for any $\varepsilon>0$, we show there are sets $\mathcal{A}$ of density $>1-\varepsilon$ for which the product set $\mathcal{A}\cdot\mathcal{A}$ has density $<\varepsilon$. This answers two questions of Hegyv\'{a}ri, Hennecart and Pach.


title: Interpretation of the Galactic gamma-ray excess with the dark matter indicated by $^8$Be and $^4$He anomalous transitions

abstract: The long-standing Galactic center gamma-ray excess could be explained by GeV dark matter (DM) annihilation, while the DM interpretation seems in tension with recent joint limits from different astronomical scale observations, such as dwarf spheroidal galaxies, the Milky Way halo and galaxy groups/clusters. Motivated by $^8$Be and $^4$He anomalous transitions with possible new interactions mediated by a vector boson $X$, we consider a small fraction of DM mainly annihilating into a pair of on-shell vector boson $X X$ followed by $X \to e^+ e^-$ in this paper. The Galactic center gamma-ray excess is explained by this DM cascade annihilation. The gamma rays are mainly from Inverse Compton Scattering emission, and the DM cascade annihilation could be compatible with joint astrophysical limits and meanwhile be allowed by the AMS-02 positron observation. The direct detection of this model is also discussed.


title: Probing the structure of the initial state of heavy-ion collisions with $p_T$-dependent flow fluctuations

abstract: The connection between initial-state geometry and anisotropic flow can be quantified through a well-established mapping between $p_T$-integrated flow harmonics and cumulants of the initial transverse energy distribution. In this paper we successfully extend this mapping to also include $p_T$-differential flow. In doing so, we find that subleading principal components of anisotropic flow can reveal previously unobserved details of the hydrodynamic response, in both the linear and the nonlinear regimes. Most importantly, we show that they provide novel information on the small-scale structures present in the initial stage of relativistic heavy-ion collisions.


title: Pattern formation of the three-layer Saffman-Taylor problem in a radial Hele-Shaw cell

abstract: The three-layer Saffman-Taylor problem introduces two coupled moving interfaces separating the three fluids. A very recent weakly nonlinear analysis of this problem in a radial Hele-Shaw cell setup has shown that the morphologies of the emerging fingering patterns strongly depend on the initial thickness of the intermediate layer connecting the two interfaces. Here we go beyond the weakly nonlinear regime and explore full nonlinear interfacial dynamics using a spectrally accurate boundary integral method. We quantify the nonlinear instability of both interfaces as the relevant physical parameters (e.g., viscosities and surface tensions) are varied and show that our nonlinear computations are in good agreement with the experimental observations and the weakly nonlinear analysis. Nonlinear simulations reveal that due to the existence of a second interface, the classical highly branched morphologies are replaced by less unstable structures in which finger tip-splitting and finger competition phenomena are evidently restrained as the initial annulus' thickness is reduced. In addition, these novels patterns develop fingers with a series of low-amplitude bumps at their tips, associated with the enhanced growth of high-frequency modes promoted by the increasing coupling strength of interfaces.


title: Evaluation of Sampling Methods for Robotic Sediment Sampling Systems

abstract: Analysis of sediments from rivers, lakes, reservoirs, wetlands and other constructed surface water impoundments is an important tool to characterize the function and health of these systems, but is generally carried out manually. This is costly and can be hazardous and difficult for humans due to inaccessibility, contamination, or availability of required equipment. Robotic sampling systems can ease these burdens, but little work has examined the efficiency of such sampling means and no prior work has investigated the quality of the resulting samples. This paper presents an experimental study that evaluates and optimizes sediment sampling patterns applied to a robot sediment sampling system that allows collection of minimally-disturbed sediment cores from natural and man-made water bodies for various sediment types. To meet this need, we developed and tested a robotic sampling platform in the laboratory to test functionality under a range of sediment types and operating conditions. Specifically, we focused on three patterns by which a cylindrical coring device was driven into the sediment (linear, helical, and zig-zag) for three sediment types (coarse sand, medium sand, and silt). The results show that the optimal sampling pattern varies depending on the type of sediment and can be optimized based on the sampling objective. We examined two sampling objectives: maximizing the mass of minimally disturbed sediment and minimizing the power per mass of sample. This study provides valuable data to aid in the selection of optimal sediment coring methods for various applications and builds a solid foundation for future field testing under a range of environmental conditions.


title: On the local limit theorems for psi-mixing Markov chains

abstract: In this paper we investigate the local limit theorem for additive functionals of a nonstationary Markov chain with finite or infinite second moment. The moment conditions are imposed on the individual summands and the weak dependence structure is expressed in terms of some uniformly mixing coefficients.


title: ACOUSTIC-TURF: Acoustic-based Privacy-Preserving COVID-19 Contact Tracing

abstract: In this paper, we propose a new privacy-preserving, automated contact tracing system, ACOUSTIC-TURF, to fight COVID-19 using acoustic signals sent from ubiquitous mobile devices. At a high level, ACOUSTIC-TURF adaptively broadcasts inaudible ultrasonic signals with randomly generated IDs in the vicinity. Simultaneously, the system receives other ultrasonic signals sent from nearby (e.g., 6 feet) users. In such a system, individual user IDs are not disclosed to others and the system can accurately detect encounters in physical proximity with 6-foot granularity. We have implemented a prototype of ACOUSTIC-TURF on Android and evaluated its performance in terms of acoustic-signal-based encounter detection accuracy and power consumption at different ranges and under various occlusion scenarios. Experimental results show that ACOUSTIC-TURF can detect multiple contacts within a 6-foot range for mobile phones placed in pockets and outside pockets. Furthermore, our acoustic-signal-based system achieves greater precision than wireless-signal-based approaches when contact tracing is performed through walls. ACOUSTIC-TURF correctly determines that people on opposite sides of a wall are not in contact with one another, whereas the Bluetooth-based approaches detect nonexistent contacts among them.


title: Synergically enhanced viscoelastic behavior of binary nanocarbon based polyurethane hybrid nanocomposite foams

abstract: Carbon-nanofillers are known for improving the desired properties of polymers. The dispersion quality of nanofillers in the matrix is vital for the fabrication of high-performance nanocomposites. An effective approach for improving dispersion states of multi-walled carbon nanotubes (MWCNT) and graphene nanoplatelets (GNPs) was employed via hybrid inclusion of the nanofillers in polyurethane matrix to further enhancing viscoelastic properties. Nanocomposites based on MWCNTs, two groups of graphene and hybrid MWCNT/graphene with varied weight fractions and ratios were fabricated via a simple, quick and scalable approach. Dynamic mechanical analysis results indicated an improvement of up to 86% in storage modulus at 25C for hybrid MWCNT/GNP-S750 at only 0.25 wt% loading, whereas solely MWCNTs and graphene nanocomposites showed 9% and 15% enhancement at the same content, respectively. The glass transition temperature value was enhanced by about 9.5 C with 0.25 wt% inclusion of well-dispersed three-dimensional MWCNT/GNP-S750 structure, which disclosed a noticeable synergistic effect in thermomechanical properties.


title: A Privacy-preserving Mobile and Fog Computing Framework to Trace and Prevent COVID-19 Community Transmission

abstract: To slow down the spread of COVID-19, governments around the world are trying to identify infected people and to contain the virus by enforcing isolation and quarantine. However, it is difficult to trace people who came into contact with an infected person, which causes widespread community transmission and mass infection. To address this problem, we develop an e-government Privacy Preserving Mobile and Fog computing framework entitled PPMF that can trace infected and suspected cases nationwide. We use personal mobile devices with contact tracing app and two types of stationary fog nodes, named Automatic Risk Checkers (ARC) and Suspected User Data Uploader Node (SUDUN), to trace community transmission alongside maintaining user data privacy. Each user's mobile device receives a Unique Encrypted Reference Code (UERC) when registering on the central application. The mobile device and the central application both generate Rotational Unique Encrypted Reference Code (RUERC), which broadcasted using the Bluetooth Low Energy (BLE) technology. The ARCs are placed at the entry points of buildings, which can immediately detect if there are positive or suspected cases nearby. If any confirmed case is found, the ARCs broadcast pre-cautionary messages to nearby people without revealing the identity of the infected person. The SUDUNs are placed at the health centers that report test results to the central cloud application. The reported data is later used to map between infected and suspected cases. Therefore, using our proposed PPMF framework, governments can let organizations continue their economic activities without complete lockdown.


title: Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Framework

abstract: The heterogeneity in recently published knowledge graph embedding models' implementations, training, and evaluation has made fair and thorough comparisons difficult. In order to assess the reproducibility of previously published results, we re-implemented and evaluated 21 interaction models in the PyKEEN software package. Here, we outline which results could be reproduced with their reported hyper-parameters, which could only be reproduced with alternate hyper-parameters, and which could not be reproduced at all as well as provide insight as to why this might be the case. We then performed a large-scale benchmarking on four datasets with several thousands of experiments and 24,804 GPU hours of computation time. We present insights gained as to best practices, best configurations for each model, and where improvements could be made over previously published best configurations. Our results highlight that the combination of model architecture, training approach, loss function, and the explicit modeling of inverse relations is crucial for a model's performances, and not only determined by the model architecture. We provide evidence that several architectures can obtain results competitive to the state-of-the-art when configured carefully. We have made all code, experimental configurations, results, and analyses that lead to our interpretations available at https://github.com/pykeen/pykeen and https://github.com/pykeen/benchmarking


title: Nodal Sets for Broken Quasilinear Partial Differential Equations with Dini Coefficients

abstract: This paper is concerned with the nodal set of weak solutions to a broken quasilinear partial differential equation, \begin{equation*} \mbox{div} (a_+ \nabla u^+ - a_- \nabla u^-) = \mbox{div} f, \end{equation*} where $a_+$ and $a_-$ are uniformly elliptic, Dini continuous coefficient matrices, subject to a strong correlation that $a_+$ and $a_-$ are a multiple of some scalar function to each other. Under such a structural condition, we develop an iteration argument to achieve higher-order approximation of solutions at a singular point, which is also new for standard elliptic PDEs below H\"older regime, and as a result, we establish a structure theorem for singular sets. We also estimate the Hausdorff measure of nodal sets, provided that the vanishing order of given solution is bounded throughout its nodal set, via an approach that extends the classical argument to certain solutions with discontinuous gradient. Besides, we also prove Lipschitz regularity of solutions and continuous differentiability of their nodal set around regular points.


title: The reflection representation in the homology of subword order

abstract: We investigate the homology representation of the symmetric group on rank-selected subposets of subword order. We show that the homology module for words of bounded length, over an alphabet of size $n,$ decomposes into a sum of tensor powers of the $S_n$-irreducible $S_{(n-1,1)}$ indexed by the partition $(n-1,1),$ recovering, as a special case, a theorem of Bj\"orner and Stanley for words of length at most $k.$ For arbitrary ranks we show that the homology is an integer combination of positive tensor powers of the reflection representation $S_{(n-1,1)}$, and conjecture that this combination is nonnegative. We uncover a curious duality in homology in the case when one rank is deleted. We prove that the action on the rank-selected chains of subword order is a nonnegative integer combination of tensor powers of $S_{(n-1,1)}$, and show that its Frobenius characteristic is $h$-positive and supported on the set $T_{1}(n)=\{h_\lambda: \lambda=(n-r, 1^r), r\ge 1\}.$ Our most definitive result describes the Frobenius characteristic of the homology for an arbitrary set of ranks, plus or minus one copy of the Schur function $s_{(n-1,1)},$ as an integer combination of the set $T_{2}(n)=\{h_\lambda: \lambda=(n-r, 1^r), r\ge 2\}.$ We conjecture that this combination is nonnegative, establishing this fact for particular cases.


title: Impact of COVID-19 behavioral inertia on reopening strategies for New York City Transit

abstract: The COVID-19 pandemic has affected travel behaviors and transportation system operations, and cities are grappling with what policies can be effective for a phased reopening shaped by social distancing. A baseline model was previously developed and calibrated for pre-COVID conditions as MATSim-NYC. A new COVID model is calibrated that represents travel behavior during the COVID-19 pandemic by recalibrating the population agendas to include work-from-home and re-estimating the mode choice model for MATSim-NYC to fit observed traffic and transit ridership data. Assuming the change in behavior exhibits inertia during reopening, we analyze the increase in car traffic due to the phased reopen plan guided by the state government of New York. Four reopening phases and two reopening scenarios (with and without transit capacity restrictions) are analyzed. A Phase 4 reopening with 100% transit capacity may only see as much as 73% of pre-COVID ridership and an increase in the number of car trips by as much as 142% of pre-pandemic levels. Limiting transit capacity to 50% would decrease transit ridership further from 73% to 64% while increasing car trips to as much as 143% of pre-pandemic levels. While the increase appears small, the impact on consumer surplus is disproportionately large due to already increased traffic congestion. Many of the trips also get shifted to other modes like micromobility. The findings imply that a transit capacity restriction policy during reopening needs to be accompanied by (1) support for micromobility modes, particularly in non-Manhattan boroughs, and (2) congestion alleviation policies that focus on reducing traffic in Manhattan, such as cordon-based pricing.


title: A superconducting praseodymium nickelate with infinite layer structure

abstract: A variety of nickel oxide compounds have long been studied for their manifestation of various correlated electron phenomena. Recently, superconductivity was observed in nanoscale infinite layer nickelate thin films of Nd$_{0.8}$Sr$_{0.2}$NiO$_2$, epitaxially stabilized on SrTiO$_3$ substrates via topotactic reduction from the perovskite precursor phase. Here we present the synthesis and properties of PrNiO$_2$ thin films on SrTiO$_3$. Upon doping in Pr$_{0.8}$Sr$_{0.2}$NiO$_2$, we observe superconductivity with a transition temperature of 7-12 K, and robust critical current density at 2 K of 334 kA/cm$^2$. These findings indicate that superconductivity in the infinite layer nickelates is relatively insensitive to the details of the rare earth 4$f$ configuration. Furthermore, they motivate the exploration of a broader family of compounds based on two-dimensional NiO$_2$ planes, which will enable systematic investigation of the superconducting and normal state properties and their underlying mechanisms.


title: Quantum algorithmic differentiation

abstract: In this work we present an algorithm to perform algorithmic differentiation in the context of quantum computing. We present two versions of the algorithm, one which is fully quantum and one which employees a classical step (hybrid approach). Since the implementation of elementary functions is already possible on quantum computers, the scheme that we propose can be easily applied. Moreover, since some steps (such as the CNOT operator) can (or will be) faster on a quantum computer than on a classical one, our procedure may ultimately demonstrate that quantum algorithmic differentiation has an advantage relative to its classical counterpart.


title: The second best constant for the Hardy-Sobolev inequality on manifolds

abstract: We consider the second best constant in the Hardy-Sobolev inequality on a Riemannian manifold. More precisely, we are interested with the existence of extremal functions for this inequality. This problem was tackled by Djadli-Druet [5] for Sobolev inequalities. Here, we establish the corresponding result for the singular case. In addition, we perform a blow-up analysis of solutions Hardy-Sobolev equations of minimizing type. This yields informations on the value of the second best constant in the related Riemannian functional inequality.


title: Handling Spontaneous Traffic Variations in 5G+ via Offloading onto mmWave-Capable UAV `Bridges'

abstract: Unmanned aerial vehicles (UAVs) are increasingly employed for numerous public and civil applications, such as goods delivery, medicine, surveillance, and telecommunications. For the latter, UAVs with onboard communication equipment may help temporarily offload traffic onto the neighboring cells in fifth-generation networks and beyond (5G+). In this paper, we propose and evaluate the use of UAVs traveling over the area of interest to relieve congestion in 5G+ systems under spontaneous traffic fluctuations. To this end, we assess two inherently different offloading schemes, named routed and controlled UAV `bridging'. Using the tools of renewal theory and stochastic geometry, we analytically characterize these schemes in terms of the fraction of traffic demand that can be offloaded onto the UAV `bridge' as our parameter of interest. This framework accounts for the unique features of millimeter-wave (mmWave) radio propagation and city deployment types with potential line-of-sight (LoS) link blockage by buildings. We also introduce enhancements to the proposed schemes that significantly improve the offloading gains. Our findings offer evidence that the UAV `bridges' may be used for efficient traffic offloading in various urban scenarios.


title: Rigorous verification of Hopf bifurcations via desingularization and continuation

abstract: In this paper we present a general approach to rigorously validate Hopf bifurcations as well as saddle-node bifurcations of periodic orbits in systems of ODEs. By a combination of analytic estimates and computer-assisted calculations, we follow solution curves of cycles through folds, checking along the way that a single nondegenerate saddle-node bifurcation occurs. Similarly, we rigorously continue solution curves of cycles starting from their onset at a Hopf bifurcation. We use a blowup analysis to regularize the continuation problem near the Hopf bifurcation point. This extends the applicability of validated continuation methods to the mathematically rigorous computational study of bifurcation problems.


title: Multi-mode Trajectory Optimization for Impact-aware Manipulation

abstract: The transition from free motion to contact is a challenging problem in robotics, in part due to its hybrid nature. Additionally, disregarding the effects of impacts at the motion planning level often results in intractable impulsive contact forces. In this paper, we introduce an impact-aware multi-mode trajectory optimization (TO) method that combines hybrid dynamics and hybrid control in a coherent fashion. A key concept is the incorporation of an explicit contact force transmission model in the TO method. This allows the simultaneous optimization of the contact forces, contact timings, continuous motion trajectories and compliance, while satisfying task constraints. We compare our method against standard compliance control and an impact-agnostic TO method in physical simulations. Further, we experimentally validate the proposed method with a robot manipulator on the task of halting a large-momentum object.


title: Bundles on caudate curves

abstract: We study vector bundles on curves with rational tails and their smoothings and give a sufficient condition for the general fibre to be balanced.


title: Iteration theorems for subversions of forcing classes

abstract: We prove various iteration theorems for forcing classes related to subproper and subcomplete forcing, introduced by Jensen. In the first part, we use revised countable support iterations, and show that 1) the class of subproper, ${}^\omega\omega$-bounding forcing notions, 2) the class of subproper, $T$-preserving forcing notions (where $T$ is a fixed Souslin tree) and 3) the class of subproper, $[T]$-preserving forcing notions (where $T$ is an $\omega_1$-tree) are iterable with revised countable support. In the second part, we adopt Miyamoto's theory of nice iterations, rather than revised countable support. We show that this approach allows us to drop a technical condition in the definitions of subcompleteness and subproperness, still resulting in forcing classes that are iterable in this way, preserve $\omega_1$, and, in the case of subcompleteness, don't add reals. Further, we show that the analogs of the iteration theorems proved in the first part for RCS iterations hold for nice iterations as well.


title: Road surface detection and differentiation considering surface damages

abstract: A challenge still to be overcome in the field of visual perception for vehicle and robotic navigation on heavily damaged and unpaved roads is the task of reliable path and obstacle detection. The vast majority of the researches have as scenario roads in good condition, from developed countries. These works cope with few situations of variation on the road surface and even fewer situations presenting surface damages. In this paper we present an approach for road detection considering variation in surface types, identifying paved and unpaved surfaces and also detecting damage and other information on other road surface that may be relevant to driving safety. We also present a new Ground Truth with image segmentation, used in our approach and that allowed us to evaluate our results. Our results show that it is possible to use passive vision for these purposes, even using images captured with low cost cameras.


title: A Benchmarking Framework for Interactive 3D Applications in the Cloud

abstract: With the growing popularity of cloud gaming and cloud virtual reality (VR), interactive 3D applications have become a major type of workloads for the cloud. However, despite their growing importance, there is limited public research on how to design cloud systems to efficiently support these applications, due to the lack of an open and reliable research infrastructure, including benchmarks and performance analysis tools. The challenges of generating human-like inputs under various system/application randomness and dissecting the performance of complex graphics systems make it very difficult to design such an infrastructure. In this paper, we present the design of a novel cloud graphics rendering research infrastructure, Pictor. Pictor employs AI to mimic human interactions with complex 3D applications. It can also provide in-depth performance measurements for the complex software and hardware stack used for cloud 3D graphics rendering. With Pictor, we designed a benchmark suite with six interactive 3D applications. Performance analyses were conducted with these benchmarks to characterize 3D applications in the cloud and reveal new performance bottlenecks. To demonstrate the effectiveness of Pictor, we also implemented two optimizations to address two performance bottlenecks discovered in a state-of-the-art cloud 3D-graphics rendering system, which improved the frame rate by 57.7% on average.


title: Deep Generative Model-based Quality Control for Cardiac MRI Segmentation

abstract: In recent years, convolutional neural networks have demonstrated promising performance in a variety of medical image segmentation tasks. However, when a trained segmentation model is deployed into the real clinical world, the model may not perform optimally. A major challenge is the potential poor-quality segmentations generated due to degraded image quality or domain shift issues. There is a timely need to develop an automated quality control method that can detect poor segmentations and feedback to clinicians. Here we propose a novel deep generative model-based framework for quality control of cardiac MRI segmentation. It first learns a manifold of good-quality image-segmentation pairs using a generative model. The quality of a given test segmentation is then assessed by evaluating the difference from its projection onto the good-quality manifold. In particular, the projection is refined through iterative search in the latent space. The proposed method achieves high prediction accuracy on two publicly available cardiac MRI datasets. Moreover, it shows better generalisation ability than traditional regression-based methods. Our approach provides a real-time and model-agnostic quality control for cardiac MRI segmentation, which has the potential to be integrated into clinical image analysis workflows.


title: Physics-informed machine learning for sensor fault detection with flight test data

abstract: We develop data-driven algorithms to fully automate sensor fault detection in systems governed by underlying physics. The proposed machine learning method uses a time series of typical behavior to approximate the evolution of measurements of interest by a linear time-invariant system. Given additional data from related sensors, a Kalman observer is used to maintain a separate real-time estimate of the measurement of interest. Sustained deviation between the measurements and the estimate is used to detect anomalous behavior. A decision tree, informed by integrating other sensor measurement values, is used to determine the amount of deviation required to identify a sensor fault. We validate the method by applying it to three test systems exhibiting various types of sensor faults: commercial flight test data, an unsteady aerodynamics model with dynamic stall, and a model for longitudinal flight dynamics forced by atmospheric turbulence. In the latter two cases we test fault detection for several prototypical failure modes. The combination of a learned dynamical model with the automated decision tree accurately detects sensor faults in each case.


title: A finite-difference scheme for three-dimensional incompressible flows in spherical coordinates

abstract: In this study we have developed a flexible and efficient numerical scheme for the simulation of three-dimensional incompressible flows in spherical coordinates. The main idea, inspired by a similar strategy as (Verzicco, R., Orlandi, P., 1996, A Finite-Difference Scheme for Three-Dimensional Incompressible Flows in Cylindrical Coordinates) for cylindrical coordinates, consists of a change of variables combined with a discretization on a staggered mesh and the special treatment of few discrete terms that remove the singularities of the Navier-Stokes equations at the sphere centre and along the polar axis. This new method alleviates also the time step restrictions introduced by the discretization around the polar axis while the sphere centre still yields strong limitations, although only in very unfavourable flow configurations. The scheme is second-order accurate in space and is verified and validated by computing numerical examples that are compared with similar results produced by other codes or available from the literature. The method can cope with flows evolving in the whole sphere, in a spherical shell and in a sector without any change and, thanks to the flexibility of finite-differences, it can employ generic mesh stretching (in two of the three directions) and complex boundary conditions.


title: Spherical Perspective on Learning with Normalization Layers

abstract: Normalization Layers (NLs) are widely used in modern deep-learning architectures. Despite their apparent simplicity, their effect on optimization is not yet fully understood. This paper introduces a spherical framework to study the optimization of neural networks with NLs from a geometric perspective. Concretely, the radial invariance of groups of parameters, such as filters for convolutional neural networks, allows to translate the optimization steps on the $L_2$ unit hypersphere. This formulation and the associated geometric interpretation shed new light on the training dynamics. Firstly, the first effective learning rate expression of Adam is derived. Then the demonstration that, in the presence of NLs, performing Stochastic Gradient Descent (SGD) alone is actually equivalent to a variant of Adam constrained to the unit hypersphere, stems from the framework. Finally, this analysis outlines phenomena that previous variants of Adam act on and their importance in the optimization process are experimentally validated.


title: The effects of curvature on the propagation of undulatory waves in lower dimensional elastic materials

abstract: The mechanics of lower dimensional elastic structures depends strongly on the geometry of their stress-free state. Elastic deformations separate into in-plane stretching and lower energy out-of-plane bending deformations. For elastic structures with a curved stress-free state, these two elastic modes are coupled within linear elasticity. We investigate the effect of that curvature-induced coupling on wave propagation in lower dimensional elastic structures, focusing on the simplest example -- a curved elastic rod. We find that the dispersion relation of the waves becomes gapped in the presence of finite curvature; bending modes are absent below a frequency proportional to the curvature of the rod. By studying the scattering of undulatory waves off regions of uniform curvature, we find that undulatory waves with frequencies in the gap associated with the curved region tunnel through that curved region via conversion into compression waves. These results should be directly applicable to the spectrum and spatial distribution of phonon modes in a number of curved rod-like elastic solids, including carbon nanotubes and biopolymer filaments.


title: Atmospheric Regimes and Trends on Exoplanets and Brown Dwarfs

abstract: A planetary atmosphere is the outer gas layer of a planet. Besides its scientific significance among the first and most accessible planetary layers observed from space, it is closely connected with planetary formation and evolution, surface and interior processes, and habitability of planets. Current theories of the planetary atmosphere were primarily obtained through the studies of eight large planets, Pluto and three large moons (Io, Titan, and Triton) in the Solar System. Outside the Solar System, more than four thousand extra-solar planets (exoplanets) and two thousand brown dwarfs have been confirmed in our galaxy, and their population is rapidly growing. The rich information from these exotic bodies offers a database to test, in a statistical sense, the fundamental theories of planetary climates. Here we review the current knowledge of atmospheres of exoplanets and brown dwarfs from recent observations and theories. This review highlights important regimes and statistical trends in an ensemble of atmospheres as an initial step towards fully characterizing diverse substellar atmospheres, that illustrates the underlying principles and critical problems. Insights are obtained through analysis of the dependence of atmospheric characteristics on basic planetary parameters. Dominant processes that influence atmospheric stability, energy transport, temperature, composition, and flow pattern are discussed and elaborated with simple scaling laws. We dedicate this review to Dr. Adam P. Showman (1968-2020) in recognition of his fundamental contribution to the understanding of atmospheric dynamics on giant planets, exoplanets, and brown dwarfs.


title: LHC Constraints on Scalar Diquarks

abstract: A number of years ago, low-energy constraints on scalar diquarks, particles that couple to two quarks, were examined. It was found that the two most weakly-constrained diquarks are $D^u$ and $D^d$, colour antitriplets that couple to $u_{R}^{i} u_{R}^{j}$ and $d_{R}^{i} d_{R}^{j}$, respectively. These diquarks have not been observed at the LHC. In this paper, we add the LHC measurements to the low-energy analysis, and find that the constraints are significantly improved. As an example, denoting $x^u$ as the $D^u$ coupling to the first and second generations, for $M_{D^u} = 600$ GeV, the low-energy constraint is $|x^u| \leq 14.4$, while the addition of the LHC dijet measurement leads to $|x^u| \leq 0.13$--$0.15$. Further improvements are obtained by adding the measurement of single top production with a $p_T$ cut. These new constraints must be taken into account in making predictions for other low-energy indirect effects of diquarks.


title: Gender and Emotion Recognition from Implicit User Behavior Signals

abstract: This work explores the utility of implicit behavioral cues, namely, Electroencephalogram (EEG) signals and eye movements for gender recognition (GR) and emotion recognition (ER) from psychophysical behavior. Specifically, the examined cues are acquired via low-cost, off-the-shelf sensors. 28 users (14 male) recognized emotions from unoccluded (no mask) and partially occluded (eye or mouth masked) emotive faces; their EEG responses contained gender-specific differences, while their eye movements were characteristic of the perceived facial emotions. Experimental results reveal that (a) reliable GR and ER is achievable with EEG and eye features, (b) differential cognitive processing of negative emotions is observed for females and (c) eye gaze-based gender differences manifest under partial face occlusion, as typified by the eye and mouth mask conditions.