title: Effects of flares on solar high-degree helioseismic acoustic mode amplitudes

abstract: Several attempts have been made to observe whether solar flares excite acoustic modes since Charles Wolff suggested this possibility almost fifty years ago. We look for the impact of flares on the amplitude of solar acoustic modes and other effects that are also affecting the mode amplitude. Solar acoustic mode amplitudes are known to be sensitive to magnetic fields. As flares usually occur in the presence of strong magnetic fields and most likely are the by-product of magnetic reconnection, we show how the magnetic field in and around the flaring region affects the mode amplitude. The mode amplitudes were obtained using ring-diagram analysis, which was first applied to a single event, the largest flare in the space age (the `Halloween Flare', SOL2003-10-28T11:00), using MDI data. Then, using HMI data, the analysis was applied to the regions corresponding to the flares observed during the high activity phase of cycle 24 and that fall into two groups. These two groups consist of small (10-60 erg/cm^2/s) and large (>1200 erg/cm^2/s) peak-flux flares, based on the Heliophysics Event Knowledgebase (HEK). The first set is used as a comparison to the results of the strong flares in the second set. After applying several corrections in order to take into account several sources of bias, we did not find any amplification in the inferred mode amplitude due to flaring activity larger than a 10% uncertainty.


title: MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach

abstract: We propose a novel estimator of the mutual information between two ordinal vectors $x$ and $y$. Our approach is inductive (as opposed to deductive) in that it depends on the data generating distribution solely through some nonparametric properties revealing associations in the data, and does not require having enough data to fully characterize the true joint distributions $P_{x, y}$. Specifically, our approach consists of (i) noting that $I\left(y; x\right) = I\left(u_y; u_x\right)$ where $u_y$ and $u_x$ are the copula-uniform dual representations of $y$ and $x$ (i.e. their images under the probability integral transform), and (ii) estimating the copula entropies $h\left(u_y\right)$, $h\left(u_x\right)$ and $h\left(u_y, u_x\right)$ by solving a maximum-entropy problem over the space of copula densities under a constraint of the type $\alpha_m = E\left[\phi_m(u_y, u_x)\right]$. We prove that, so long as the constraint is feasible, this problem admits a unique solution, it is in the exponential family, and it can be learned by solving a convex optimization problem. The resulting estimator, which we denote MIND, is marginal-invariant, always non-negative, unbounded for any sample size $n$, consistent, has MSE rate $O(1/n)$, and is more data-efficient than competing approaches. Beyond mutual information estimation, we illustrate that our approach may be used to mitigate mode collapse in GANs by maximizing the entropy of the copula of fake samples, a model we refer to as Copula Entropy Regularized GAN (CER-GAN).


title: RbSyn: Type- and Effect-Guided Program Synthesis

abstract: In recent years, researchers have explored component-based synthesis, which aims to automatically construct programs that operate by composing calls to existing APIs. However, prior work has not considered efficient synthesis of methods with side effects, e.g., web app methods that update a database. In this paper, we introduce RbSyn, a novel type- and effect-guided synthesis tool for Ruby. An RbSyn synthesis goal is specified as the type for the target method and a series of test cases it must pass. RbSyn works by recursively generating well-typed candidate method bodies whose write effects match the read effects of the test case assertions. After finding a set of candidates that separately satisfy each test, RbSyn synthesizes a solution that branches to execute the correct candidate code under the appropriate conditions. We formalize RbSyn on a core, object-oriented language $\lambda_{syn}$ and describe how the key ideas of the model are scaled-up in our implementation for Ruby. We evaluated RbSyn on 19 benchmarks, 12 of which come from popular, open-source Ruby apps. We found that RbSyn synthesizes correct solutions for all benchmarks, with 15 benchmarks synthesizing in under 9 seconds, while the slowest benchmark takes 83 seconds. Using observed reads to guide synthesize is effective: using type-guidance alone times out on 10 of 12 app benchmarks. We also found that using less precise effect annotations leads to worse synthesis performance. In summary, we believe type- and effect-guided synthesis is an important step forward in synthesis of effectful methods from test cases.


title: Nonlinear Projection Based Gradient Estimation for Query Efficient Blackbox Attacks

abstract: Gradient estimation and vector space projection have been studied as two distinct topics. We aim to bridge the gap between the two by investigating how to efficiently estimate gradient based on a projected low-dimensional space. We first provide lower and upper bounds for gradient estimation under both linear and nonlinear projections, and outline checkable sufficient conditions under which one is better than the other. Moreover, we analyze the query complexity for the projection-based gradient estimation and present a sufficient condition for query-efficient estimators. Built upon our theoretic analysis, we propose a novel query-efficient Nonlinear Gradient Projection-based Boundary Blackbox Attack (NonLinear-BA). We conduct extensive experiments on four image datasets: ImageNet, CelebA, CIFAR-10, and MNIST, and show the superiority of the proposed methods compared with the state-of-the-art baselines. In particular, we show that the projection-based boundary blackbox attacks are able to achieve much smaller magnitude of perturbations with 100% attack success rate based on efficient queries. Both linear and nonlinear projections demonstrate their advantages under different conditions. We also evaluate NonLinear-BA against the commercial online API MEGVII Face++, and demonstrate the high blackbox attack performance both quantitatively and qualitatively. The code is publicly available at https://github.com/AI-secure/NonLinear-BA.


title: Off-Policy Imitation Learning from Observations

abstract: Learning from Observations (LfO) is a practical reinforcement learning scenario from which many applications can benefit through the reuse of incomplete resources. Compared to conventional imitation learning (IL), LfO is more challenging because of the lack of expert action guidance. In both conventional IL and LfO, distribution matching is at the heart of their foundation. Traditional distribution matching approaches are sample-costly which depend on on-policy transitions for policy learning. Towards sample-efficiency, some off-policy solutions have been proposed, which, however, either lack comprehensive theoretical justifications or depend on the guidance of expert actions. In this work, we propose a sample-efficient LfO approach that enables off-policy optimization in a principled manner. To further accelerate the learning procedure, we regulate the policy update with an inverse action model, which assists distribution matching from the perspective of mode-covering. Extensive empirical results on challenging locomotion tasks indicate that our approach is comparable with state-of-the-art in terms of both sample-efficiency and asymptotic performance.


title: Towards a Unified Framework for Fair and Stable Graph Representation Learning

abstract: As the representations output by Graph Neural Networks (GNNs) are increasingly employed in real-world applications, it becomes important to ensure that these representations are fair and stable. In this work, we establish a key connection between counterfactual fairness and stability and leverage it to propose a novel framework, NIFTY (uNIfying Fairness and stabiliTY), which can be used with any GNN to learn fair and stable representations. We introduce a novel objective function that simultaneously accounts for fairness and stability and develop a layer-wise weight normalization using the Lipschitz constant to enhance neural message passing in GNNs. In doing so, we enforce fairness and stability both in the objective function as well as in the GNN architecture. Further, we show theoretically that our layer-wise weight normalization promotes counterfactual fairness and stability in the resulting representations. We introduce three new graph datasets comprising of high-stakes decisions in criminal justice and financial lending domains. Extensive experimentation with the above datasets demonstrates the efficacy of our framework.


title: CollisionIK: A Per-Instant Pose Optimization Method for Generating Robot Motions with Environment Collision Avoidance

abstract: In this work, we present a per-instant pose optimization method that can generate configurations that achieve specified pose or motion objectives as best as possible over a sequence of solutions, while also simultaneously avoiding collisions with static or dynamic obstacles in the environment. We cast our method as a multi-objective, non-linear constrained optimization-based IK problem where each term in the objective function encodes a particular pose objective. We demonstrate how to effectively incorporate environment collision avoidance as a single term in this multi-objective, optimization-based IK structure, and provide solutions for how to spatially represent and organize external environments such that data can be efficiently passed to a real-time, performance-critical optimization loop. We demonstrate the effectiveness of our method by comparing it to various state-of-the-art methods in a testbed of simulation experiments and discuss the implications of our work based on our results.


title: A Framework For Pruning Deep Neural Networks Using Energy-Based Models

abstract: A typical deep neural network (DNN) has a large number of trainable parameters. Choosing a network with proper capacity is challenging and generally a larger network with excessive capacity is trained. Pruning is an established approach to reducing the number of parameters in a DNN. In this paper, we propose a framework for pruning DNNs based on a population-based global optimization method. This framework can use any pruning objective function. As a case study, we propose a simple but efficient objective function based on the concept of energy-based models. Our experiments on ResNets, AlexNet, and SqueezeNet for the CIFAR-10 and CIFAR-100 datasets show a pruning rate of more than $50\%$ of the trainable parameters with approximately $<5\%$ and $<1\%$ drop of Top-1 and Top-5 classification accuracy, respectively.


title: Rip van Winkle's Razor: A Simple Estimate of Overfit to Test Data

abstract: Traditional statistics forbids use of test data (a.k.a. holdout data) during training. Dwork et al. 2015 pointed out that current practices in machine learning, whereby researchers build upon each other's models, copying hyperparameters and even computer code -- amounts to implicitly training on the test set. Thus error rate on test data may not reflect the true population error. This observation initiated {\em adaptive data analysis}, which provides evaluation mechanisms with guaranteed upper bounds on this difference. With statistical query (i.e. test accuracy) feedbacks, the best upper bound is fairly pessimistic: the deviation can hit a practically vacuous value if the number of models tested is quadratic in the size of the test set. In this work, we present a simple new estimate, {\em Rip van Winkle's Razor}. It relies upon a new notion of \textquotedblleft information content\textquotedblright\ of a model: the amount of information that would have to be provided to an expert referee who is intimately familiar with the field and relevant science/math, and who has been just been woken up after falling asleep at the moment of the creation of the test data (like \textquotedblleft Rip van Winkle\textquotedblright\ of the famous fairy tale). This notion of information content is used to provide an estimate of the above deviation which is shown to be non-vacuous in many modern settings.


title: Machine Biometrics -- Towards Identifying Machines in a Smart City Environment

abstract: This paper deals with the identification of machines in a smart city environment. The concept of machine biometrics is proposed in this work for the first time, as a way to authenticate machine identities interacting with humans in everyday life. This definition is imposed in modern years where autonomous vehicles, social robots, etc. are considered active members of contemporary societies. In this context, the case of car identification from the engine behavioral biometrics is examined. For this purpose, 22 sound features were extracted and their discrimination capabilities were tested in combination with 9 different machine learning classifiers, towards identifying 5 car manufacturers. The experimental results revealed the ability of the proposed biometrics to identify cars with high accuracy up to 98% for the case of the Multilayer Perceptron (MLP) neural network model.


title: Q-VR: System-Level Design for Future Mobile Collaborative Virtual Reality

abstract: High Quality Mobile Virtual Reality (VR) is what the incoming graphics technology era demands: users around the world, regardless of their hardware and network conditions, can all enjoy the immersive virtual experience. However, the state-of-the-art software-based mobile VR designs cannot fully satisfy the realtime performance requirements due to the highly interactive nature of user's actions and complex environmental constraints during VR execution. Inspired by the unique human visual system effects and the strong correlation between VR motion features and realtime hardware-level information, we propose Q-VR, a novel dynamic collaborative rendering solution via software-hardware co-design for enabling future low-latency high-quality mobile VR. At software-level, Q-VR provides flexible high-level tuning interface to reduce network latency while maintaining user perception. At hardware-level, Q-VR accommodates a wide spectrum of hardware and network conditions across users by effectively leveraging the computing capability of the increasingly powerful VR hardware. Extensive evaluation on real-world games demonstrates that Q-VR can achieve an average end-to-end performance speedup of 3.4x (up to 6.7x) over the traditional local rendering design in commercial VR devices, and a 4.1x frame rate improvement over the state-of-the-art static collaborative rendering.


title: PlaceRAN: Optimal Placement of Virtualized Network Functions in the Next-generation Radio Access Networks

abstract: The fifth-generation mobile evolution enables several transformations on Next Generation Radio Access Networks (NG-RAN). The RAN protocol stack is splitting into eight possible disaggregated options combined into three network units, i.e., Central, Distributed, and Radio. Besides that, further advances allow the RAN software to be virtualized on top of general-purpose vendor-neutral hardware, dealing with the concept of virtualized RAN (vRAN). The disaggregated network units initiatives reach full interoperability based on the Open RAN (O-RAN). The combination of NG-RAN and vRAN results in vNG-RAN, enabling the management of disaggregated units and protocols as a set of radio functions. The placement of these functions is challenging since the best decision can be based on multiple constraints, such as the RAN protocol stack split, routing paths of transport networks with restricted bandwidth and latency requirements, different topologies and link capabilities, asymmetric computational resources, etc. This article proposes the first exact model for the placement optimization of radio functions for vNG-RAN planning, named PlaceRAN. The main objective is to minimize the computing resources and maximize the aggregation of radio functions. The PlaceRAN evaluation considered two realistic network topologies. Our results reveal that the PlaceRAN model achieves an optimized high-performance aggregation level, it is flexible for RAN deployment overcoming the network restrictions, and it is up to date with the most advanced vNG-RAN design and development.


title: Minimum Spanning Tree Cycle Intersection Problem

abstract: Consider a connected graph $G$ and let $T$ be a spanning tree of $G$. Every edge $e \in G-T$ induces a cycle in $T \cup \{e\}$. The intersection of two distinct such cycles is the set of edges of $T$ that belong to both cycles. We consider the problem of finding a spanning tree that has the least number of such non-empty intersections.


title: Finding best approximation pairs for two intersections of closed convex sets

abstract: The problem of finding a best approximation pair of two sets, which in turn generalizes the well known convex feasibility problem, has a long history that dates back to work by Cheney and Goldstein in 1959. In 2018, Aharoni, Censor, and Jiang revisited this problem and proposed an algorithm that can be used when the two sets are finite intersections of halfspaces. Motivated by their work, we present alternative algorithms that utilize projection and proximity operators. Numerical experiments indicate that these methods are competitive and sometimes superior to the one proposed by Aharoni et al.


title: Reinforcement Learning of Implicit and Explicit Control Flow in Instructions

abstract: Learning to flexibly follow task instructions in dynamic environments poses interesting challenges for reinforcement learning agents. We focus here on the problem of learning control flow that deviates from a strict step-by-step execution of instructions -- that is, control flow that may skip forward over parts of the instructions or return backward to previously completed or skipped steps. Demand for such flexible control arises in two fundamental ways: explicitly when control is specified in the instructions themselves (such as conditional branching and looping) and implicitly when stochastic environment dynamics require re-completion of instructions whose effects have been perturbed, or opportunistic skipping of instructions whose effects are already present. We formulate an attention-based architecture that meets these challenges by learning, from task reward only, to flexibly attend to and condition behavior on an internal encoding of the instructions. We test the architecture's ability to learn both explicit and implicit control in two illustrative domains -- one inspired by Minecraft and the other by StarCraft -- and show that the architecture exhibits zero-shot generalization to novel instructions of length greater than those in a training set, at a performance level unmatched by two baseline recurrent architectures and one ablation architecture.


title: Named Tensor Notation

abstract: We propose a notation for tensors with named axes, which relieves the author, reader, and future implementers of machine learning models from the burden of keeping track of the order of axes and the purpose of each. The notation makes it easy to lift operations on low-order tensors to higher order ones, for example, from images to minibatches of images, or from an attention mechanism to multiple attention heads. After a brief overview and formal definition of the notation, we illustrate it through several examples from modern machine learning, from building blocks like attention and convolution to full models like Transformers and LeNet. We then discuss differential calculus in our notation and compare with some alternative notations. Our proposals build on ideas from many previous papers and software libraries. We hope that our notation will encourage more authors to use named tensors, resulting in clearer papers and more precise implementations.


title: Tradeoffs between energy efficiency and mechanical response in fluid flow networks

abstract: Transport networks are typically optimized, either by evolutionary pressures in biological systems or by human design in engineered structures. In the case of systems such as the animal vasculature, the transport of fluids is hindered by the inherent viscous resistance to flow while being kept in a dynamic state by the pulsatile nature of the heart and elastic properties of the vessel walls. While this imparted pulsatility necessarily increases the dissipation of energy caused by the resistance, the vessel elasticity helps to reduce overall dissipation by attenuating the amplitude of the pulsatile components of the flow. However, we find that this reduction in energy loss comes at the price of increasing the time required to respond to changes in the flow boundary conditions for vessels longer than a critical size. In this regime, dissipation and response time are found to follow a simple power law scaling relation both in single vessels as well as hierarchically structured networks. We validate the model in human vasculature and apply biologically relevant parameters to show that response time has to be considered alongside dissipation as an important fitness cost function in the evolutionary optimization of animal vascular networks.


title: Contrast-independent partially explicit time discretizations for multiscale wave problems

abstract: In this work, we design and investigate contrast-independent partially explicit time discretizations for wave equations in heterogeneous high-contrast media. We consider multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In our previous work, we have introduced contrast-independent partially explicit time discretizations and applied to parabolic equations. The main idea of contrast-independent partially explicit time discretization is to split the spatial space into two components: contrast dependent (fast) and contrast independent (slow) spaces defined via multiscale space decomposition. Using this decomposition, our goal is further appropriately to introduce time splitting such that the resulting scheme is stable and can guarantee contrast-independent discretization under some suitable (reasonable) conditions. In this paper, we propose contrast-independent partially explicitly scheme for wave equations. The splitting requires a careful design. We prove that the proposed splitting is unconditionally stable under some suitable conditions formulated for the second space (slow). This condition requires some type of non-contrast dependent space and is easier to satisfy in the "slow" space. We present numerical results and show that the proposed methods provide results similar to implicit methods with the time step that is independent of the contrast.


title: Computation of infinite dilute activity coefficients for Ga-X (X= In, Tl) and thermodynamic activities of all components in liquid Ga-In-Tl alloys

abstract: The thermodynamic activities of all components in Ga-In-Tl system have been predicted at 1073, 1173 and 1273 K, using Molecular interaction volume model (MIVM). The infinite dilute activity coefficients for Ga-In and Ga-Tl binary subsystems, which were needed for the determination of thermodynamic activities of all components in Ga-In-Tl, have been predicted by using a method that is based on Complex formation model for liquid alloys. The computed thermodynamic activities of Ga in Ga-In-Tl were observed to satisfactorily agree with the available experimental data when the newly computed coefficients were applied in MIVM. The satisfactory prediction of the activity of Ga led to the prediction of the activities of the remaining two components (In and Tl). Iso-activities of all components (Ga, In and Tl) were plotted, and they reveal the dependence of the nature of chemical short range order in Ga-In-Tl system on composition.


title: Mie Resonance Enhancement of Laser Cooling in Rare-Earth Doped Materials

abstract: Laser cooling of solids keeps attracting attention owing to abroad range of its applications that extends from cm-sized all-optical cryocoolers for airborne and space-based applications to cooling on nanoparticles for biological and mesoscopic physics. Laser cooling of nanoparticles is a challenging task. We propose to use Mie resonances to enhance anti-Stokes fluorescence laser cooling in rare-earth (RE) doped nanoparticles made of low-phonon glasses or crystals. As an example, we consider an Yb3+:YAG nanosphere pumped at the long wavelength tail of the Yb3+ absorption spectrum at 1030 nm. We show that if the radius of the nanosphere is adjusted to the pump wavelength in such a manner that the pump excites some of its Mie resonant modes, the cooling power density generated in the sample is considerably enhanced and the temperature of the sample is consequently considerably (~ 63%) decreased. This concept can be extended to nanoparticles of different shapes and made from different low-phonon RE doped materials suitable for laser cooling by anti-Stokes fluorescence.


title: Learning Controller Gains on Bipedal Walking Robots via User Preferences

abstract: Experimental demonstration of complex robotic behaviors relies heavily on finding the correct controller gains. This painstaking process is often completed by a domain expert, requiring deep knowledge of the relationship between parameter values and the resulting behavior of the system. Even when such knowledge is possessed, it can take significant effort to navigate the nonintuitive landscape of possible parameter combinations. In this work, we explore the extent to which preference-based learning can be used to optimize controller gains online by repeatedly querying the user for their preferences. This general methodology is applied to two variants of control Lyapunov function based nonlinear controllers framed as quadratic programs, which provide theoretical guarantees but are challenging to realize in practice. These controllers are successfully demonstrated both on the planar underactuated biped, AMBER, and on the 3D underactuated biped, Cassie. We experimentally evaluate the performance of the learned controllers and show that the proposed method is repeatably able to learn gains that yield stable and robust locomotion.


title: Online Multi-Armed Bandits with Adaptive Inference

abstract: During online decision making in Multi-Armed Bandits (MAB), one needs to conduct inference on the true mean reward of each arm based on data collected so far at each step. However, since the arms are adaptively selected--thereby yielding non-iid data--conducting inference accurately is not straightforward. In particular, sample averaging, which is used in the family of UCB and Thompson sampling (TS) algorithms, does not provide a good choice as it suffers from bias and a lack of good statistical properties (e.g. asymptotic normality). Our thesis in this paper is that more sophisticated inference schemes that take into account the adaptive nature of the sequentially collected data can unlock further performance gains, even though both UCB and TS type algorithms are optimal in the worst case. In particular, we propose a variant of TS-style algorithms--which we call doubly adaptive TS--that leverages recent advances in causal inference and adaptively reweights the terms of a doubly robust estimator on the true mean reward of each arm. Through 20 synthetic domain experiments and a semi-synthetic experiment based on data from an A/B test of a web service, we demonstrate that using an adaptive inferential scheme (while still retaining the exploration efficacy of TS) provides clear benefits in online decision making: the proposed DATS algorithm has superior empirical performance to existing baselines (UCB and TS) in terms of regret and sample complexity in identifying the best arm. In addition, we also provide a finite-time regret bound of doubly adaptive TS that matches (up to log factors) those of UCB and TS algorithms, thereby establishing that its improved practical benefits do not come at the expense of worst-case suboptimality.


title: Recovery of regular ridge functions on the ball

abstract: We consider the problem of the uniform (in $L_\infty$) recovery of ridge functions $f(x)=\varphi(\langle a,x\rangle)$, $x\in B_2^n$, using noisy evaluations $y_1\approx f(x^1),\ldots,y_N\approx f(x^N)$. It is known that for classes of functions $\varphi$ of finite smoothness the problem suffers from the curse of dimensionality: in order to provide good accuracy for the recovery it is necessary to make exponential number of evaluations. We prove that if $\varphi$ is analytic in a neighborhood of $[-1,1]$ and the noise is very small, $\varepsilon\le\exp(-c\log^2n)$, then there is an efficient algorithm that recovers $f$ with good accuracy using $O(n\log^2n)$ function evaluations.


title: The Complex Korteweg-de Vries Equation: A Deeper Theory of Shallow Water Waves

abstract: Using Levi-Civita's theory of ideal fluids, we derive the complex Korteweg-de Vries (KdV) equation, describing the complex velocity of a shallow fluid up to first order. We use perturbation theory, and the long wave, slowly varying velocity approximations for shallow water. The complex KdV equation describes the nontrivial dynamics of all water particles from the surface to the bottom of the water layer. A crucial new step made in our work is the proof that a natural consequence of the complex KdV theory is that the wave elevation is described by the real KdV equation. The complex KdV approach in the theory of shallow fluids is thus more fundamental than the one based on the real KdV equation. We demonstrate how it allows direct calculation of the particle trajectories at any point of the fluid, and that these results agree well with numerical simulations of other authors.


title: Deep learning can differentiate IDH-mutant from IDH-wild type GBM

abstract: Background: Distinction of IDH mutant and wildtype GBMs is challenging on MRI, since conventional imaging shows considerable overlap. While few studies employed deep-learning in a mixed low/high grade glioma population, a GBM-specific model is still lacking in the literature. Our objective was to develop a deep-learning model for IDH prediction in GBM by using Convoluted Neural Networks (CNN) on multiparametric MRI. Methods: We included 100 adult patients with pathologically proven GBM and IDH testing. MRI data included: morphologic sequences, rCBV and ADC maps. Tumor area was obtained by a bounding box function on the axial slice with widest tumor extension on T2 images and was projected on every sequence. Data was split into training and test (80:20) sets. A 4 block 2D - CNN architecture was implemented for IDH prediction on every MRI sequence. IDH mutation probability was calculated with softmax activation function from the last dense layer. Highest performance was calculated accounting for model accuracy and categorical cross-entropy loss (CCEL) in the test cohort. Results: Our model achieved the following performance: T1 (accuracy 77%, CCEL 1.4), T2 (accuracy 67%, CCEL 2.41), FLAIR (accuracy 77%, CCEL 1.98), MPRAGE (accuracy 66%, CCEL 2.55), rCBV (accuracy 83%, CCEL 0.64). ADC achieved lower performance. Conclusion: We built a GBM-tailored deep-learning model for IDH mutation prediction, achieving accuracy of 83% with rCBV maps. High predictivity of perfusion images may reflect the known correlation between IDH, hypoxia inducible factor (HIF) and neoangiogenesis. This model may set a path for non-invasive evaluation of IDH mutation in GBM.


title: Neutron Interferometry and axion like particles

abstract: We propose a method to reveal axions and axion-like particles based on interferometric measurement of neutron beams. We consider an interferometer in which the neutron beam is split in two sub-beams propagating in regions with differently oriented magnetic fields. The beam paths and the strength of the magnetic fields are set in such a way that all the contributions to the phase difference but the one due to axion-induced interactions are removed. The resulting phase difference is directly related to the presence of axions. Our results show that such a phase is in principle detectable with neutron interferometry, possibly proving the existence of axions and axion-like particles.


title: A Step-by-Step Guide to 3D Print Motorized Rotation Mounts for Optical Applications

abstract: Motorized rotation mounts and stages are versatile instruments that introduce computer control to optical systems, enabling automation and scanning actions. They can be used for intensity control and position adjustments, etc. However, these rotation mounts come with a hefty price tag, and this limits their use. This work shows how to build two different types of motorized rotation mounts for 1" optics, using a 3D printer and off-the-shelf components. The first is intended for reflective elements, like mirrors and gratings, and the second for transmissive elements, like polarizers and retarders. We evaluate and compare their performance to commercial systems based on velocity, resolution, accuracy, backlash, and axis wobble. Also, we investigate the angular stability using Allan variance analysis. The results show that our mounts perform similar to systems costing more than 2000 Euro, while also being quick to build and costing less than 200 Euro. As a proof of concept, we show how to control lasers used in an optical tweezers and Raman spectroscopy setup. When used for this, the 3D printed motorized rotational mounts provide intensity control with a resolution of $0.03$ percentage points or better.


title: Combination anti-coronavirus therapies based on nonlinear mathematical models

abstract: Using nonlinear mathematical models and experimental data from laboratory and clinical studies, we have designed new combination therapies against COVID-19.


title: Wielding Occam's razor: Fast and frugal retail forecasting

abstract: The algorithms available for retail forecasting have increased in complexity. Newer methods, such as machine learning, are inherently complex. The more traditional families of forecasting models, such as exponential smoothing and autoregressive integrated moving averages, have expanded to contain multiple possible forms and forecasting profiles. We question complexity in forecasting and the need to consider such large families of models. Our argument is that parsimoniously identifying suitable subsets of models will not decrease forecasting accuracy nor will it reduce the ability to estimate forecast uncertainty. We propose a framework that balances forecasting performance versus computational cost, resulting in the consideration of only a reduced set of models. We empirically demonstrate that a reduced set performs well. Finally, we translate computational benefits to monetary cost savings and environmental impact and discuss the implications of our results in the context of large retailers.


title: Is Covid-19 severity associated with ACE2 degradation?

abstract: Covid-19 is particularly mild with children, and its severity escalates with age. Several theories have been proposed to explain these facts. In particular, it was proposed that the lower expression of the viral receptor ACE2 in children protects them from severe Covid. However, other works suggested an inverse relationship between ACE2 expression and disease severity. Here we try to reconcile seemingly contradicting observations noting that ACE2 is not monotonically related with age but it reaches a maximum at a young age that depends on the cell type and then decreases. This pattern is consistent with most existing data from humans and rodents and it is expected to be more marked for ACE2 cell protein than for mRNA because of the increase with age of the protease TACE/ADAM17 that sheds ACE2 from the cell membrane to the serum. The negative relation between ACE2 level and Covid-19 severity at old age is not paradoxical but it is consistent with a mathematical model of virus propagation that predicts that higher viral receptor does not necessarily favour virus propagation and it can even slow it down. More importantly, ACE2 is known to protect organs from chronic and acute inflammation, which are worsened by low ACE2 levels. Here we propose that ACE2 contributes essentially to reverse the inflammatory process by downregulating the pro-inflammatory peptides of the angiotensin and bradykinin system, and that failure to revert the inflammation triggered by SARS-COV-2 may underlie both severe CoViD-19 infection and its many post-infection manifestations, including the multi-inflammatory syndrome of children (MIS-C). Within this view, lower severity in children despite lower ACE2 expression may be consistent with their higher expression of the alternative angiotensin II receptor ATR2 and in general of the anti-inflammatory arm of the Renin-Angiotensin System (RAS) at young age.


title: Energy diffusion and absorption in chaotic systems with rapid periodic driving

abstract: When a chaotic, ergodic Hamiltonian system with $N$ degrees of freedom is subject to sufficiently rapid periodic driving, its energy evolves diffusively. We derive a Fokker-Planck equation that governs the evolution of the system's probability distribution in energy space, and we provide explicit expressions for the energy drift and diffusion rates. Our analysis suggests that the system generically relaxes to a long-lived "prethermal" state characterized by minimal energy absorption, eventually followed by more rapid heating. When $N\gg 1$, the system ultimately absorbs energy indefinitely from the drive, or at least until an infinite temperature state is reached.


title: Motion Planning for a Pair of Tethered Robots

abstract: Considering an environment containing polygonal obstacles, we address the problem of planning motions for a pair of planar robots connected to one another via a cable of limited length. Much like prior problems with a single robot connected via a cable to a fixed base, straight line-of-sight visibility plays an important role. The present paper shows how the reduced visibility graph provides a natural discretization and captures the essential topological considerations very effectively for the two robot case as well. Unlike the single robot case, however, the bounded cable length introduces considerations around coordination (or equivalently, when viewed from the point of view of a centralized planner, relative timing) that complicates the matter. Indeed, the paper has to introduce a rather more involved formalization than prior single-robot work in order to establish the core theoretical result -- a theorem permitting the problem to be cast as one of finding paths rather than trajectories. Once affirmed, the planning problem reduces to a straightforward graph search with an elegant representation of the connecting cable, demanding only a few extra ancillary checks that ensure sufficiency of cable to guarantee feasibility of the solution. We describe our implementation of A${}^\star$ search, and report experimental results. Lastly, we prescribe an optimal execution for the solutions provided by the algorithm.


title: Quantitative Hemodynamics in Aortic Dissection: Comparing in vitro MRI with FSI Simulation in a Compliant Model

abstract: The analysis of quantitative hemodynamics and luminal pressure may add valuable information to aid treatment strategies and prognosis for aortic dissections. This work directly compared in vitro 4D-flow magnetic resonance imaging (MRI), catheter-based pressure measurements, and computational fluid dynamics that integrated fluid-structure interaction (CFD FSI). Experimental data was acquired with a compliant 3D-printed model of a type-B aortic dissection (TBAD) that was embedded into a physiologically tuned flow circuit. In vitro flow and pressure information were used to tune the CFD FSI Windkessel boundary conditions. Results showed very good overall agreement of complex flow patterns, true to false lumen flow splits, and pressure distribution. This work demonstrates feasibility of a tunable experimental setup that integrates a patient-specific compliant model and provides a test bed for exploring critical imaging and modeling parameters that ultimately may improve the prognosis for patients with aortic dissections.


title: Miles' mechanism for generating surface water waves by wind, in finite water depth and subject to constant vorticity flow

abstract: The Miles theory of wave amplification by wind is extended to the case of finite depth h and a shear flow with (constant) vorticity {\Omega}. Vorticity is characterised through the non-dimensional parameter {\nu} = {\Omega} U_1 /g, where g the gravitational acceleration, U_1 a characteristic wind velocity and k the wavenumber. The notion of 'wave age' is generalised to account for the effect of vorticity. Several widely used growth rates are derived analytically from the dispersion relation of the wind/water interface, and their dependence on both water depth and vorticity is derived and discussed. Vorticity is seen to shift the maximum wave age, similar to what was previously known to be the effect of water depth. At the same time, a novel effect arises and the growth coefficients, at identical wave age and depth, are shown to experience a net increase or decrease according to the shear gradient in the water flow.


title: Many-body localization of 1D disordered impenetrable two-component fermions

abstract: We study effects of disorder on eigenstates of 1D two-component fermions with infinitely strong Hubbard repulsion. We demonstrate that the spin-independent (potential) disorder reduces the problem to the one-particle Anderson localization taking place at arbitrarily weak disorder. In contrast, a random magnetic field can cause reentrant many-body localization-delocalization transitions. Surprisingly weak magnetic field destroys one-particle localization caused by not too strong potential disorder, whereas at much stronger fields the states are many-body localized. We present numerical support of these conclusions.


title: Stable decompositions and rigidity for products of countable equivalence relations

abstract: We show that the stabilization of any countable ergodic p.m.p. equivalence relation which is not Schmidt, i.e. admits no central sequences in its full group, always gives rise to a stable equivalence relation with a unique stable decomposition, providing the first non-strongly ergodic such examples. In the proof, we moreover establish a new local characterization of the Schmidt property. We also prove some new structural results for product equivalence relations and orbit equivalence relations of diagonal product actions.


title: Regularity and stability of the semigroup associated with some interacting elastic systems I: A degenerate damping case

abstract: In this paper, we examine regularity and stability issues for two damped abstract elastic systems. The damping involves the average velocity and a fractional power $\theta$, with $\theta$ in $[-1,1]$, of the principal operator. The matrix operator defining the damping mechanism for the coupled system is degenerate. First, we prove that for $\theta$ in $(1/2,1]$, the underlying semigroup is not analytic, but is differentiable for $\theta$ in $(0,1)$; this is in sharp contrast with known results for a single similarly damped elastic system, where the semigroup is analytic for $\theta$ in $[1/2,1]$; this shows that the degeneracy dominates the dynamics of the interacting systems, preventing analyticity in that range. Next, we show that for $\theta$ in $(0,1/2]$, the semigroup is of certain Gevrey classes. Finally, we show that the semigroup decays exponentially for $\theta$ in $[0,1]$, and polynomially for $\theta$ in $[-1,0)$. To prove our results, we use the frequency domain method, which relies on resolvent estimates. Optimality of our resolvent estimates is also established. Several examples of application are provided.


title: Interpretable Sensitivity Analysis for Balancing Weights

abstract: Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis framework for balancing weights estimators, an increasingly popular approach that solves an optimization problem to obtain weights that directly minimizes covariate imbalance. In particular, we adapt a sensitivity analysis framework using the percentile bootstrap for a broad class of balancing weights estimators. We prove that the percentile bootstrap procedure can, with only minor modifications, yield valid confidence intervals for causal effects under restrictions on the level of unmeasured confounding. We also propose an amplification to allow for interpretable sensitivity parameters in the balancing weights framework. We illustrate our method through extensive real data examples.


title: Learning with invariances in random features and kernel models

abstract: A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of the images. Certain neural network architectures -- for instance, convolutional networks -- are believed to owe their success to the fact that they exploit such invariance properties. With the objective of quantifying the gain achieved by invariant architectures, we introduce two classes of models: invariant random features and invariant kernel methods. The latter includes, as a special case, the neural tangent kernel for convolutional networks with global average pooling. We consider uniform covariates distributions on the sphere and hypercube and a general invariant target function. We characterize the test error of invariant methods in a high-dimensional regime in which the sample size and number of hidden units scale as polynomials in the dimension, for a class of groups that we call `degeneracy $\alpha$', with $\alpha \leq 1$. We show that exploiting invariance in the architecture saves a $d^\alpha$ factor ($d$ stands for the dimension) in sample size and number of hidden units to achieve the same test error as for unstructured architectures. Finally, we show that output symmetrization of an unstructured kernel estimator does not give a significant statistical improvement; on the other hand, data augmentation with an unstructured kernel estimator is equivalent to an invariant kernel estimator and enjoys the same improvement in statistical efficiency.


title: Semidefinite Relaxations of Products of Nonnegative Forms on the Sphere

abstract: We study the problem of maximizing the geometric mean of $d$ low-degree non-negative forms on the real or complex sphere in $n$ variables. We show that this highly non-convex problem is NP-hard even when the forms are quadratic and is equivalent to optimizing a homogeneous polynomial of degree $O(d)$ on the sphere. The standard Sum-of-Squares based convex relaxation for this polynomial optimization problem requires solving a semidefinite program (SDP) of size $n^{O(d)}$, with multiplicative approximation guarantees of $\Omega(\frac{1}{n})$. We exploit the compact representation of this polynomial to introduce a SDP relaxation of size polynomial in $n$ and $d$, and prove that it achieves a constant factor multiplicative approximation when maximizing the geometric mean of non-negative quadratic forms. We also show that this analysis is asymptotically tight, with a sequence of instances where the gap between the relaxation and true optimum approaches this constant factor as $d \rightarrow \infty$. Next we propose a series of intermediate relaxations of increasing complexity that interpolate to the full Sum-of-Squares relaxation, as well as a rounding algorithm that finds an approximate solution from the solution of any intermediate relaxation. Finally we show that this approach can be generalized for relaxations of products of non-negative forms of any degree.


title: Power Series Expansion Neural Network

abstract: In this paper, we develop a new neural network family based on power series expansion, which is proved to achieve a better approximation accuracy in comparison with existing neural networks. This new set of neural networks embeds the power series expansion (PSE) into the neural network structure. Then it can improve the representation ability while preserving comparable computational cost by increasing the degree of PSE instead of increasing the depth or width. Both theoretical approximation and numerical results show the advantages of this new neural network.


title: Radio Resource Management for Cellular-Connected UAV: A Learning Approach

abstract: Integrating unmanned aerial vehicles (UAVs) into existing cellular networks encounters lots of challenges, among which one of the most striking concerns is how to achieve harmonious coexistence of aerial transceivers, inter alia, UAVs, and terrestrial user equipments (UEs). In this paper, a cellular-connected UAV network is focused, where multiple UAVs receive messages from base stations (BSs) in the down-link, while BSs are serving ground UEs in their cells. For effectively managing inter-cell interferences (ICIs) among UEs due to intense reuse of time-frequency resource block (RB) resource, a first $p$-tier based RB coordination criterion is proposed and adopted. Then, to enhance wireless transmission quality for UAVs while protecting terrestrial UEs from being interfered by ground-to-air (G2A) transmissions, a radio resource management (RRM) problem of joint dynamic RB coordination and time-varying beamforming design minimizing UAV's ergodic outage duration (EOD) is investigated. To cope with conventional optimization techniques' inefficiency in solving the formulated RRM problem, a deep reinforcement learning (DRL)-aided solution is initiated, where deep double duelling Q network (D3QN) and twin delayed deep deterministic policy gradient (TD3) are invoked to deal with RB coordination in discrete action domain and beamforming design in continuous action regime, respectively. The hybrid D3QN-TD3 solution is trained via interacting with the considered outer and inner environments in an online centralized manner so that it can then help achieve the suboptimal EOD minimization performance during its offline decentralized exploitation phase. Simulation results have illustrated the effectiveness of the proposed hybrid D3QN-TD3 algorithm, compared to several representative baselines.


title: Characterizing the Landscape of COVID-19 Themed Cyberattacks and Defenses

abstract: COVID-19 (Coronavirus) hit the global society and economy with a big surprise. In particular, work-from-home has become a new norm for employees. Despite the fact that COVID-19 can equally attack innocent people and cybercriminals, it is ironic to see surges in cyberattacks leveraging COVID-19 as a theme, dubbed COVID-19 themed cyberattacks or COVID-19 attacks for short, which represent a new phenomenon that has yet to be systematically understood. In this paper, we make the first step towards fully characterizing the landscape of these attacks, including their sophistication via the Cyber Kill Chain model. We also explore the solution space of defenses against these attacks.


title: Skewed Non-Fermi Liquids and the Seebeck Effect

abstract: We consider non-Fermi liquids in which the inelastic scattering rate has an intrinsic particle-hole asymmetry and obeys $\omega/T$ scaling. We show that, in contrast to Fermi liquids, this asymmetry influences the low-temperature behaviour of the thermopower even in the presence of impurity scattering. Implications for the unconventional sign and temperature dependence of the thermopower in cuprates in the strange metal (Planckian) regime are emphasized.


title: The game of Flipping Coins

abstract: We consider Flipping Coins, a partizan version of the impartial game Turning Turtles, played on lines of coins. We show the values of this game are numbers, and these are found by first applying a reduction, then decomposing the position into an iterated ordinal sum. This is unusual since moves in the middle of the line do not eliminate the rest of the line. Moreover, when $G$ is decomposed into lines $H$ and $K$, then $G=(H:K^R)$. This is in contrast to Hackenbush Strings where $G= (H:K)$.


title: Data-Driven Characterization and Detection of COVID-19 Themed Malicious Websites

abstract: COVID-19 has hit hard on the global community, and organizations are working diligently to cope with the new norm of "work from home". However, the volume of remote work is unprecedented and creates opportunities for cyber attackers to penetrate home computers. Attackers have been leveraging websites with COVID-19 related names, dubbed COVID-19 themed malicious websites. These websites mostly contain false information, fake forms, fraudulent payments, scams, or malicious payloads to steal sensitive information or infect victims' computers. In this paper, we present a data-driven study on characterizing and detecting COVID-19 themed malicious websites. Our characterization study shows that attackers are agile and are deceptively crafty in designing geolocation targeted websites, often leveraging popular domain registrars and top-level domains. Our detection study shows that the Random Forest classifier can detect COVID-19 themed malicious websites based on the lexical and WHOIS features defined in this paper, achieving a 98% accuracy and 2.7% false-positive rate.


title: The Bell inequality, inviolable by data used consistently with its derivation, leads to quantum correlations that satisfy it, and probabilities that satisfy the Wigner inequality

abstract: It is not generally known, that the inequality that Bell derived using three random variables must be identically satisfied by any three corresponding data sets of plus and minus 1s that are writable on paper.This surprising fact is not immediately obvious from Bell's inequality derivation based on causal random variables, but follows immediately if the same mathematical operations are applied to finite data sets.For laboratory data, the inequality is identically satisfied as a fact of pure algebra, and its satisfaction is independent of whether the processes generating the data are local, nonlocal, deterministic, random, or nonsensical.It follows that if predicted correlations violate the inequality, they represent no three cross correlated data sets that experimentally exist or can be generated from valid probability models. Reported data that violate the inequality consist of probabilistically independent data pairs and are thus inconsistent with inequality derivation.In the case of random variables as Bell assumed, the correlations in the inequality may be expressed in terms of the probabilities that give rise to them.A new inequality results, the Wigner inequality that must be satisfied by quantum mechanical probabilities in the case of Bell experiments.If that were not the case, predicted quantum probabilities and correlations would be inconsistent with basic algebra.


title: A High-Throughput Multi-Mode LDPC Decoder for 5G NR

abstract: This paper presents a partially parallel low-density parity-check (LDPC) decoder designed for the 5G New Radio (NR) standard. The design is using a multi-block parallel architecture with a flooding schedule. The decoder can support any code rates and code lengths up to the lifting size Zmax= 96. To compensate for the dropped throughput associated with the smaller Z values, the design can double and quadruple its parallelism when lifting sizes Z<= 48 and Z<= 24 are selected respectively. Therefore, the decoder can process up to eight frames and restore the throughput to the maximum. To simplify the design's architecture, a new variable node for decoding the extended parity bits present in the lower code rates is proposed. The FPGA implementation of the decoder results in a throughput of 2.1 Gbps decoding the 11/12 code rate. Additionally, the synthesized decoder using the 28 nm TSMC technology, achieves a maximum clock frequency of 526 MHz and a throughput of 13.46 Gbps. The core decoder occupies 1.03 mm2, and the power consumption is 229 mW.


title: Consistent Sparse Deep Learning: Theory and Computation

abstract: Deep learning has been the engine powering many successes of data science. However, the deep neural network (DNN), as the basic model of deep learning, is often excessively over-parameterized, causing many difficulties in training, prediction and interpretation. We propose a frequentist-like method for learning sparse DNNs and justify its consistency under the Bayesian framework: the proposed method could learn a sparse DNN with at most $O(n/\log(n))$ connections and nice theoretical guarantees such as posterior consistency, variable selection consistency and asymptotically optimal generalization bounds. In particular, we establish posterior consistency for the sparse DNN with a mixture Gaussian prior, show that the structure of the sparse DNN can be consistently determined using a Laplace approximation-based marginal posterior inclusion probability approach, and use Bayesian evidence to elicit sparse DNNs learned by an optimization method such as stochastic gradient descent in multiple runs with different initializations. The proposed method is computationally more efficient than standard Bayesian methods for large-scale sparse DNNs. The numerical results indicate that the proposed method can perform very well for large-scale network compression and high-dimensional nonlinear variable selection, both advancing interpretable machine learning.


title: Reconstructing triangulations of 3-manifolds from their intersection matrix

abstract: The intersection matrix of a simplicial complex has entries equal to the rank of the intersection of its facets. In [1] the authors prove the intersection matrix is enough to determine a triangulation of a surface up to isomorphism. In this work we show the intersection matrix is enough to determine the triangulation of a 3-manifold up to isomorphism.


title: A Quantitative Kinetic Theory of Flocking with Three-Particle-Closure

abstract: We consider aligning self-propelled particles in two dimensions. Their motion is given by generalized Langevin equations and includes non-additive N-particle interactions. The qualitative behavior is as for the famous Vicsek model. We develop a kinetic theory of flocking beyond mean field. In particular, we self-consistently take into account the full pair correlation function. We find excellent quantitative agreement of the pair correlations with direct agent-based simulations within the disordered regime. Furthermore we use a closure relation to incorporate spatial correlations of three particles. In that way we achieve good quantitative agreement of the onset of flocking with direct simulations. Compared to mean field theory, the flocking transition is shifted significantly towards lower noise because directional correlations favor disorder. We compare our theory with a recently developed Landau-kinetic theory.


title: Semiparametric empirical likelihood inference with estimating equations under density ratio models

abstract: The density ratio model (DRM) provides a flexible and useful platform for combining information from multiple sources. In this paper, we consider statistical inference under two-sample DRMs with additional parameters defined through and/or additional auxiliary information expressed as estimating equations. We examine the asymptotic properties of the maximum empirical likelihood estimators (MELEs) of the unknown parameters in the DRMs and/or defined through estimating equations, and establish the chi-square limiting distributions for the empirical likelihood ratio (ELR) statistics. We show that the asymptotic variance of the MELEs of the unknown parameters does not decrease if one estimating equation is dropped. Similar properties are obtained for inferences on the cumulative distribution function and quantiles of each of the populations involved. We also propose an ELR test for the validity and usefulness of the auxiliary information. Simulation studies show that correctly specified estimating equations for the auxiliary information result in more efficient estimators and shorter confidence intervals. Two real-data examples are used for illustrations.


title: Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations

abstract: In this paper, it is shown theoretically that spurious local minima are common for deep fully-connected networks and convolutional neural networks (CNNs) with piecewise linear activation functions and datasets that cannot be fitted by linear models. A motivating example is given to explain the reason for the existence of spurious local minima: each output neuron of deep fully-connected networks and CNNs with piecewise linear activations produces a continuous piecewise linear (CPWL) output, and different pieces of CPWL output can fit disjoint groups of data samples when minimizing the empirical risk. Fitting data samples with different CPWL functions usually results in different levels of empirical risk, leading to prevalence of spurious local minima. This result is proved in general settings with any continuous loss function. The main proof technique is to represent a CPWL function as a maximization over minimization of linear pieces. Deep ReLU networks are then constructed to produce these linear pieces and implement maximization and minimization operations.


title: Learning Discriminative Features using Multi-label Dual Space

abstract: Multi-label learning handles instances associated with multiple class labels. The original label space is a logical matrix with entries from the Boolean domain $\in \left \{ 0,1 \right \}$. Logical labels are not able to show the relative importance of each semantic label to the instances. The vast majority of existing methods map the input features to the label space using linear projections with taking into consideration the label dependencies using logical label matrix. However, the discriminative features are learned using one-way projection from the feature representation of an instance into a logical label space. Given that there is no manifold in the learning space of logical labels, which limits the potential of learned models. In this work, inspired from a real-world example in image annotation to reconstruct an image from the label importance and feature weights. We propose a novel method in multi-label learning to learn the projection matrix from the feature space to semantic label space and projects it back to the original feature space using encoder-decoder deep learning architecture. The key intuition which guides our method is that the discriminative features are identified due to map the features back and forth using two linear projections. To the best of our knowledge, this is one of the first attempts to study the ability to reconstruct the original features from the label manifold in multi-label learning. We show that the learned projection matrix identifies a subset of discriminative features across multiple semantic labels. Extensive experiments on real-world datasets show the superiority of the proposed method.


title: Adaptable Hamiltonian neural networks

abstract: The rapid growth of research in exploiting machine learning to predict chaotic systems has revived a recent interest in Hamiltonian Neural Networks (HNNs) with physical constraints defined by the Hamilton's equations of motion, which represent a major class of physics-enhanced neural networks. We introduce a class of HNNs capable of adaptable prediction of nonlinear physical systems: by training the neural network based on time series from a small number of bifurcation-parameter values of the target Hamiltonian system, the HNN can predict the dynamical states at other parameter values, where the network has not been exposed to any information about the system at these parameter values. The architecture of the HNN differs from the previous ones in that we incorporate an input parameter channel, rendering the HNN parameter--cognizant. We demonstrate, using paradigmatic Hamiltonian systems, that training the HNN using time series from as few as four parameter values bestows the neural machine with the ability to predict the state of the target system in an entire parameter interval. Utilizing the ensemble maximum Lyapunov exponent and the alignment index as indicators, we show that our parameter-cognizant HNN can successfully predict the route of transition to chaos. Physics-enhanced machine learning is a forefront area of research, and our adaptable HNNs provide an approach to understanding machine learning with broad applications.


title: Dual View on Clear-Sky Top-of-Atmosphere Albedos from Meteosat Second Generation Satellites

abstract: Geostationary observations offer the unique opportunity to resolve the diurnal cycle of the Earth's Radiation Budget at the top of the atmosphere (TOA), crucial for climate-change studies. However, a drawback of the continuous temporal coverage of the geostationary orbit is the fixed viewing geometry. As a consequence, imperfections in the angular distribution models (ADMs) used in the radiance-to-flux conversion process or residual angular-dependent narrowband-to-broadband conversion errors can result in systematic errors of the estimated radiative fluxes. In this work, focusing on clear-sky reflected TOA observations, we compare the overlapping views from Meteosat Second Generation satellites at 0{\deg} and 41.5{\deg}E longitude which enable a quantification of viewing-angle-dependent differences. Using data derived from SEVIRI, we identify some of the main sources of discrepancies, and show that they can be significantly reduced at the level of one month. This is achieved, separately for each satellite, via a masking procedure followed by an empirical fit at the pixel-level that takes into account all the clear-sky data from that satellite, calculated separately per timeslot of the day, over the month of November 2016. The method is then applied to each month of 2017, and gives a quadratic mean of the albedo root-mean squared difference over the dual-view region which is comparable from month to month, with a 2017 average value of 0.01. Sources of discrepancies include the difficulty to estimate the flux over the sunglint ocean region close to the limbs, the fact that the data processing does not include dedicated angular distribution models for the aerosol-over-ocean case, and the existence of an observer-dependent diurnal-asymmetry artefact affecting the clear-sky-albedo dependence on the solar zenith angle particularly over land areas.


title: Graphs of Maximal Energy with Fixed Maximal Degree

abstract: We give a bound for the graph energy with given maximal degree in terms of the second and fourth moments of a graph. In the case in which the graph is $d$-regular we obtain the bound that is given in Van Dam, E. et al. (2014). through elementary methods.


title: Markov chain Monte Carlo analyses of the flux ratios of B, Be and Li with the DRAGON2 code

abstract: Recent cosmic-ray measurements are challenging our models of propagation in the Galaxy. A good characterization of the secondary cosmic rays (B, Be, Li and sub-iron species) is crucial to constrain these models and exploit the precision of modern CR experiments. In this work, a Markov chain Monte Carlo analysis has been implemented to fit the experimental flux ratios between B, Be and Li and their flux ratios to the primary nuclei C and O. We have fitted the data using two different parametrizations for the spallation cross sections. The uncertainties in the evaluation of the spectra of these secondary cosmic rays, due to spallation cross sections, have been considered by introducing scale factors as nuisance parameters. We have also tested two different formulations for the diffusion coefficient, which differ in the origin of the high energy hardening of cosmic rays. Additionally, two different approaches are used to scale the cross sections, one based on a combined analysis of all the species ("combined" analysis) and the other reproducing the high energy spectra of the secondary-to-secondary flux ratios of Be/B, Li/B, Li/Be ("scaled" analysis). This allows us to make a better comparison between the propagation parameters inferred from the cross sections parametrizations tested in this work. This novel analysis has been successfully implemented using the numerical code DRAGON2 to reproduce the cosmic-ray nuclei data up to $Z=14$ from the AMS-02 experiment. It is found that the ratios of Li favor a harder spectral index of the diffusion coefficient, but compatible with the other ratios inside the observed $2\sigma$ uncertainties. In addition, it is shown that, including these scale factors, the secondary-to-primary flux ratios can be simultaneously reproduced.


title: On a necessary condition for unitary categorification of fusion rings

abstract: In arXiv:1910.12059 Liu, Palcoux and Wu proved a remarkable necessary condition for a fusion ring to admit a unitary categorification, by constructing invariants of the fusion ring that have to be positive if it is unitarily categorifiable. The main goal of this note is to provide a somewhat more direct proof of this result. In the last subsection we discuss integrality properties of the Liu-Palcoux-Wu invariants.


title: Adapting to Misspecification in Contextual Bandits with Offline Regression Oracles

abstract: Computationally efficient contextual bandits are often based on estimating a predictive model of rewards given contexts and arms using past data. However, when the reward model is not well-specified, the bandit algorithm may incur unexpected regret, so recent work has focused on algorithms that are robust to misspecification. We propose a simple family of contextual bandit algorithms that adapt to misspecification error by reverting to a good safe policy when there is evidence that misspecification is causing a regret increase. Our algorithm requires only an offline regression oracle to ensure regret guarantees that gracefully degrade in terms of a measure of the average misspecification level. Compared to prior work, we attain similar regret guarantees, but we do no rely on a master algorithm, and do not require more robust oracles like online or constrained regression oracles (e.g., Foster et al. (2020a); Krishnamurthy et al. (2020)). This allows us to design algorithms for more general function approximation classes.


title: Exploring the Effect of Resolution on the Usability of Locimetric Authentication

abstract: Locimetric authentication is a form of graphical authentication in which users validate their identity by selecting predetermined points on a predetermined image. Its primary advantage over the ubiquitous text-based approach stems from users' superior ability to remember visual information over textual information, coupled with the authentication process being transformed to one requiring recognition (instead of recall). Ideally, these differentiations enable users to create more complex passwords, which theoretically are more secure. Yet locimetric authentication has one significant weakness: hot-spots. This term refers to areas of an image that users gravitate towards, and which consequently have a higher probability of being selected. Although many strategies have been proposed to counter the hot-spot problem, one area that has received little attention is that of resolution. The hypothesis here is that high-resolution images would afford the user a larger password space, and consequently any hot-spots would dissipate. We employ an experimental approach, where users generate a series of locimetric passwords on either low- or high-resolution images. Our research reveals the presence of hot-spots even in high-resolution images, albeit at a lower level than that exhibited with low-resolution images. We conclude by reinforcing that other techniques - such as existing or new software controls or training - need to be utilized to mitigate the emergence of hot-spots with the locimetric scheme.


title: On Register Linearizability and Termination

abstract: In a seminal work, Golab et al. showed that a randomized algorithm that works with atomic objects may lose some of its properties if we replace the atomic objects that it uses with linearizable objects. It was not known whether the properties that can be lost include the important property of termination (with probability 1). In this paper, we first show that, for randomized algorithms, termination can indeed be lost. Golab et al. also introduced strong linearizability, and proved that strongly linearizable objects can be used as if they were atomic objects, even for randomized algorithms: they preserve the algorithm's correctness properties, including termination. Unfortunately, there are important cases where strong linearizability is impossible to achieve. In particular, Helmi et al. MWMR registers do not have strongly linearizable implementations from SWMR registers. So we propose a new type of register linearizability, called write strong-linearizability, that is strictly stronger than linearizability but strictly weaker than strong linearizability. We prove that some randomized algorithms that fail to terminate with linearizable registers, work with write strongly-linearizable ones. In other words, there are cases where linearizability is not sufficient but write strong-linearizability is. In contrast to the impossibility result mentioned above, we prove that write strongly-linearizable MWMR registers are implementable from SWMR registers. Achieving write strong-linearizability, however, is harder than achieving just linearizability: we give a simple implementation of MWMR registers from SWMR registers and we prove that this implementation is linearizable but not write strongly-linearizable. Finally, we prove that any linearizable implementation of SWMR registers is necessarily write strongly-linearizable; this holds for shared-memory, message-passing, and hybrid systems.


title: Swift for TensorFlow: A portable, flexible platform for deep learning

abstract: Swift for TensorFlow is a deep learning platform that scales from mobile devices to clusters of hardware accelerators in data centers. It combines a language-integrated automatic differentiation system and multiple Tensor implementations within a modern ahead-of-time compiled language oriented around mutable value semantics. The resulting platform has been validated through use in over 30 deep learning models and has been employed across data center and mobile applications.


title: Cyclic Coordinate Dual Averaging with Extrapolation

abstract: Cyclic block coordinate methods are a fundamental class of optimization methods widely used in practice and implemented as part of standard software packages for statistical learning. Nevertheless, their convergence is generally not well understood and so far their good practical performance has not been explained by existing convergence analyses. In this work, we introduce a new block coordinate method that applies to the general class of variational inequality (VI) problems with monotone operators. This class includes composite convex optimization problems and convex-concave min-max optimization problems as special cases and has not been addressed by the existing work. The resulting convergence bounds match the optimal convergence bounds of full gradient methods, but are provided in terms of a novel gradient Lipschitz condition w.r.t.~a Mahalanobis norm. For $m$ coordinate blocks, the resulting gradient Lipschitz constant in our bounds is never larger than a factor $\sqrt{m}$ compared to the traditional Euclidean Lipschitz constant, while it is possible for it to be much smaller. Further, for the case when the operator in the VI has finite-sum structure, we propose a variance reduced variant of our method which further decreases the per-iteration cost and has better convergence rates in certain regimes. To obtain these results, we use a gradient extrapolation strategy that allows us to view a cyclic collection of block coordinate-wise gradients as one implicit gradient.


title: Data-Free Likelihood-Informed Dimension Reduction of Bayesian Inverse Problems

abstract: Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based dimension reduction method in which the informed subspace does not depend on the data. This permits an online-offline computational strategy where the expensive low-dimensional structure of the problem is detected in an offline phase, meaning before observing the data. This strategy is particularly relevant for multiple inversion problems as the same informed subspace can be reused. The proposed approach allows controlling the approximation error (in expectation over the data) of the posterior distribution. We also present sampling strategies that exploit the informed subspace to draw efficiently samples from the exact posterior distribution. The method is successfully illustrated on two numerical examples: a PDE-based inverse problem with a Gaussian process prior and a tomography problem with Poisson data and a Besov-$\mathcal{B}^2_{11}$ prior.


title: Multiplicative equivariant $K$-theory and the Barratt-Priddy-Quillen theorem

abstract: We prove a multiplicative version of the equivariant Barratt-Priddy-Quillen theorem, starting from the additive version proven in arXiv:1207.3459. The proof uses a multiplicative elaboration of an additive equivariant infinite loop space machine that manufactures orthogonal $G$-spectra from symmetric monoidal $G$-categories. The new machine produces highly structured associative ring and module $G$-spectra from appropriate multiplicative input. It relies on new operadic multicategories that are of considerable independent interest and are defined in a general, not necessarily equivariant or topological, context. Most of our work is focused on constructing and comparing them. We construct a multifunctor from the multicategory of symmetric monoidal $G$-categories to the multicategory of orthogonal $G$-spectra. With this machinery in place, we prove that the equivariant BPQ theorem can be lifted to a multiplicative equivalence. That is the heart of what is needed for the presheaf reconstruction of the category of $G$-spectra in arXiv:1110.3571.


title: DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections

abstract: This paper explores learning rich self-supervised entity representations from large amounts of the associated text. Once pre-trained, these models become applicable to multiple entity-centric tasks such as ranked retrieval, knowledge base completion, question answering, and more. Unlike other methods that harvest self-supervision signals based merely on a local context within a sentence, we radically expand the notion of context to include any available text related to an entity. This enables a new class of powerful, high-capacity representations that can ultimately distill much of the useful information about an entity from multiple text sources, without any human supervision. We present several training strategies that, unlike prior approaches, learn to jointly predict words and entities -- strategies we compare experimentally on downstream tasks in the TV-Movies domain, such as MovieLens tag prediction from user reviews and natural language movie search. As evidenced by results, our models match or outperform competitive baselines, sometimes with little or no fine-tuning, and can scale to very large corpora. Finally, we make our datasets and pre-trained models publicly available. This includes Reviews2Movielens (see https://goo.gle/research-docent ), mapping the up to 1B word corpus of Amazon movie reviews (He and McAuley, 2016) to MovieLens tags (Harper and Konstan, 2016), as well as Reddit Movie Suggestions (see https://urikz.github.io/docent ) with natural language queries and corresponding community recommendations.


title: Quantum structured light: Non-classical spin texture of twisted single-photon pulses

abstract: Classical structured light with controlled polarization and orbital angular momentum (OAM) of electromagnetic waves has varied applications in optical trapping, bio-sensing, optical communications and quantum simulations. The classical electromagnetic theory of such structured light beams and pulses have advanced significantly over the last two decades. However, a framework for the quantum density of spin and OAM for single-photons remains elusive. Here, we develop a theoretical framework and put forth the concept of quantum structured light for space-time wavepackets at the single-photon level. Our work marks a paradigm shift beyond scalar-field theory as well as the paraxial approximation and can be utilized to study the quantum properties of the spin and OAM of all classes of twisted quantum light pulses. We capture the uncertainty in full three-dimensional (3D) projections of vector spin demonstrating their quantum behavior beyond the conventional concept of classical polarization. Even in laser beams with high OAM along the propagation direction, we predict the existence of large OAM quantum fluctuations in the transverse plane which can be verified experimentally. We show that the spin density generates modulated helical texture beyond the paraxial limit and exhibits distinct statistics for Fock-state vs. coherent-state twisted pulses. We introduce the quantum correlator of photon spin density to characterize the nonlocal spin noise providing a rigorous parallel with fermionic spin noise operators. Our work paves the way for quantum spin-OAM physics in twisted single photon pulses and also opens explorations for new phases of light with long-range spin order.


title: Chess as a Testbed for Language Model State Tracking

abstract: Transformer language models have made tremendous strides in natural language understanding tasks. However, the complexity of natural language makes it challenging to ascertain how accurately these models are tracking the world state underlying the text. Motivated by this issue, we consider the task of language modeling for the game of chess. Unlike natural language, chess notations describe a simple, constrained, and deterministic domain. Moreover, we observe that the appropriate choice of chess notation allows for directly probing the world state, without requiring any additional probing-related machinery. We find that: (a) With enough training data, transformer language models can learn to track pieces and predict legal moves with high accuracy when trained solely on move sequences. (b) For small training sets providing access to board state information during training can yield significant improvements. (c) The success of transformer language models is dependent on access to the entire game history i.e. "full attention". Approximating this full attention results in a significant performance drop. We propose this testbed as a benchmark for future work on the development and analysis of transformer language models.


title: Crossover from itinerant to localized states in the thermoelectric oxide [Ca$_2$CoO$_3$]$_{0.62}$[CoO$_2$]

abstract: The layered cobaltite [Ca$_2$CoO$_3$]$_{0.62}$[CoO$_2$], often expressed as the approximate formula Ca$_3$Co$_4$O$_9$, is a promising candidate for efficient oxide thermoelectrics but an origin of its unusual thermoelectric transport is still in debate. Here we investigate \textit{in-plane} anisotropy of the transport properties in a broad temperature range to examine the detailed conduction mechanism. The in-plane anisotropy between $a$ and $b$ axes is clearly observed both in the resistivity and the thermopower, which is qualitatively understood with a simple band structure of the triangular lattice of Co ions derived from the angle-resolved photoemission spectroscopy experiments. On the other hand, at high temperatures, the anisotropy becomes smaller and the resistivity shows a temperature-independent behavior, both of which indicate a hopping conduction of localized carriers. Thus the present observations reveal a crossover from low-temperature itinerant to high-temperature localized states, signifying both characters for the enhanced thermopower.


title: Robust Kalman filter-based dynamic state estimation of natural gas pipeline networks

abstract: To obtain the accurate transient states of the big scale natural gas pipeline networks under the bad data and non-zero mean noises conditions, a robust Kalman filter-based dynamic state estimation method is proposed using the linearized gas pipeline transient flow equations in this paper. Firstly, the dynamic state estimation model is built. Since the gas pipeline transient flow equations are less than the states, the boundary conditions are used as supplementary constraints to predict the transient states. To increase the measurement redundancy, the zero mass flow rate constraints at the sink nodes are taken as virtual measurements. Secondly, to ensure the stability under bad data condition, the robust Kalman filter algorithm is proposed by introducing a time-varying scalar matrix to regulate the measurement error variances correctly according to the innovation vector at every time step. At last, the proposed method is applied to a 30-node gas pipeline networks in several kinds of measurement conditions. The simulation shows that the proposed robust dynamic state estimation can decrease the effects of bad data and achieve better estimating results.


title: A multistate approach for mediation analysis in the presence of semi-competing risks with application in cancer survival disparities

abstract: We propose a novel methodology to quantify the effect of stochastic interventions on non-terminal time-to-events that lie on the pathway between an exposure and a terminal time-to-event outcome. Investigating these effects is particularly important in health disparities research when we seek to quantify inequities in timely delivery of treatment and its impact on patients survival time. Current approaches fail to account for semi-competing risks arising in this setting. Under the potential outcome framework, we define and provide identifiability conditions for causal estimands for stochastic direct and indirect effects. Causal contrasts are estimated in continuous time within a multistate modeling framework and analytic formulae for the estimators of the causal contrasts are developed. We show via simulations that ignoring censoring in mediator and or outcome time-to-event processes, or ignoring competing risks may give misleading results. This work demonstrates that rigorous definition of the direct and indirect effects and joint estimation of the outcome and mediator time-to-event distributions in the presence of semi-competing risks are crucial for valid investigation of mechanisms in continuous time. We employ this novel methodology to investigate the role of delaying treatment uptake in explaining racial disparities in cancer survival in a cohort study of colon cancer patients.


title: On the Visual-based Safe Landing of UAVs in Populated Areas: a Crucial Aspect for Urban Deployment

abstract: Autonomous landing of Unmanned Aerial Vehicles (UAVs) in crowded scenarios is crucial for successful deployment of UAVs in populated areas, particularly in emergency landing situations where the highest priority is to avoid hurting people. In this work, a new visual-based algorithm for identifying Safe Landing Zones (SLZ) in crowded scenarios is proposed, considering a camera mounted on an UAV, where the people in the scene move with unknown dynamics. To do so, a density map is generated for each image frame using a Deep Neural Network, from where a binary occupancy map is obtained aiming to overestimate the people's location for security reasons. Then, the occupancy map is projected to the head's plane, and the SLZ candidates are obtained as circular regions in the head's plane with a minimum security radius. Finally, to keep track of the SLZ candidates, a multiple instance tracking algorithm is implemented using Kalman Filters along with the Hungarian algorithm for data association. Several scenarios were studied to prove the validity of the proposed strategy, including public datasets and real uncontrolled scenarios with people moving in public squares, taken from an UAV in flight. The study showed promising results in the search of preventing the UAV from hurting people during emergency landing.


title: Tensors Fitting Perfectly

abstract: Multidimensional arrays (NDArrays) are a central abstraction in modern scientific computing environments. Unfortunately, they can make reasoning about programs harder as the number of different array shapes used in an execution of a program is usually very large, and they rarely appear explicitly in program text. To make things worse, many operators make implicit assumptions about the shapes of their inputs: array addition is commonly enriched with broadcasting semantics, while matrix multiplication assumes that the lengths of contracted dimensions are equal. Because precise reasoning about shapes is crucial to write correct programs using NDArrays, and because shapes are often hard to infer from a quick glance at the program, we developed Tensors Fitting Perfectly, a static analysis tool that reasons about NDArray shapes in Swift for TensorFlow programs by synthesizing a set of shape constraints from an abstract interpretation of the program. It can both (1) check for possible inconsistencies, and (2) provide direct insights about the shapes of intermediate values appearing in the program, including via a mechanism called shape holes. The static analysis works in concert with optional runtime assertions to improve the productivity of program authors.


title: On the conservation of the angular momentum in ultrafast spin dynamics

abstract: The total angular momentum of a close system is a conserved quantity, which should remain constant in time for any excitation experiment once the pumping signal has extinguished. Such conservation, however, is never satisfied in practice in any real-time first principles description of the demagnetization process. Furthermore, there is a growing experimental evidence that the same takes place in experiments. The missing angular momentum is usually associated to lattice vibrations, which are not measured experimentally and are never considered in real-time simulations. Here we critically analyse the issue and conclude that current state-of-the-art simulations violate angular momentum conservation already at the electronic level of description. This shortcoming originates from an oversimplified description of the spin-orbit coupling, which includes atomic contributions but neglects completely that of itinerant electrons. We corroborate our findings with time-dependent simulations using model tight-binding Hamiltonians, and show that indeed such conservation can be re-introduced by an appropriate choice of spin-orbit coupling. The consequences of our findings on recent experiments are also discussed.


title: Cybersecurity Threats in Connected and Automated Vehicles based Federated Learning Systems

abstract: Federated learning (FL) is a machine learning technique that aims at training an algorithm across decentralized entities holding their local data private. Wireless mobile networks allow users to communicate with other fixed or mobile users. The road traffic network represents an infrastructure-based configuration of a wireless mobile network where the Connected and Automated Vehicles (CAV) represent the communicating entities. Applying FL in a wireless mobile network setting gives rise to a new threat in the mobile environment that is very different from the traditional fixed networks. The threat is due to the intrinsic characteristics of the wireless medium and is caused by the characteristics of the vehicular networks such as high node-mobility and rapidly changing topology. Most cyber defense techniques depend on highly reliable and connected networks. This paper explores falsified information attacks, which target the FL process that is ongoing at the RSU. We identified a number of attack strategies conducted by the malicious CAVs to disrupt the training of the global model in vehicular networks. We show that the attacks were able to increase the convergence time and decrease the accuracy the model. We demonstrate that our attacks bypass FL defense strategies in their primary form and highlight the need for novel poisoning resilience defense mechanisms in the wireless mobile setting of the future road networks.


title: Two dimensional subsonic and subsonic-sonic spiral flows outside a porous body

abstract: In this paper, we investigate two dimensional subsonic and subsonic-sonic spiral flows outside a porous body. The existence and uniqueness of the subsonic spiral flow are obtained via variational formulation. The optimal decay rate at far fields is also derived by the Kelvin's transformation and some elliptic estimates. By extracting spiral subsonic solutions as the approximate sequences, we obtain the spiral subsonic-sonic limit solution. The main ingredients of our analysis are methods of calculus of variations, the theory of second-order quasilinear equations and the compactness framework.


title: Boundary-induced and scene-aggregated network for monocular depth prediction

abstract: Monocular depth prediction is an important task in scene understanding. It aims to predict the dense depth of a single RGB image. With the development of deep learning, the performance of this task has made great improvements. However, two issues remain unresolved: (1) The deep feature encodes the wrong farthest region in a scene, which leads to a distorted 3D structure of the predicted depth; (2) The low-level features are insufficient utilized, which makes it even harder to estimate the depth near the edge with sudden depth change. To tackle these two issues, we propose the Boundary-induced and Scene-aggregated network (BS-Net). In this network, the Depth Correlation Encoder (DCE) is first designed to obtain the contextual correlations between the regions in an image, and perceive the farthest region by considering the correlations. Meanwhile, the Bottom-Up Boundary Fusion (BUBF) module is designed to extract accurate boundary that indicates depth change. Finally, the Stripe Refinement module (SRM) is designed to refine the dense depth induced by the boundary cue, which improves the boundary accuracy of the predicted depth. Several experimental results on the NYUD v2 dataset and \xff{the iBims-1 dataset} illustrate the state-of-the-art performance of the proposed approach. And the SUN-RGBD dataset is employed to evaluate the generalization of our method. Code is available at https://github.com/XuefengBUPT/BS-Net.


title: The numerical range of a periodic tridiagonal operator reduces to the numerical range of a finite matrix

abstract: In this paper we show that the closure of the numerical range of an $n+1$-periodic tridiagonal operator is equal to the numerical range of a $2(n+1)\times 2(n+1)$ complex matrix.


title: A Fast Proximal Gradient Method and Convergence Analysis for Dynamic Mean Field Planning

abstract: In this paper, we propose an efficient and flexible algorithm to solve dynamic mean-field planning problems based on an accelerated proximal gradient method. Besides an easy-to-implement gradient descent step in this algorithm, a crucial projection step becomes solving an elliptic equation whose solution can be obtained by conventional methods efficiently. By induction on iterations used in the algorithm, we theoretically show that the proposed discrete solution converges to the underlying continuous solution as the grid size increases. Furthermore, we generalize our algorithm to mean-field game problems and accelerate it using multilevel and multigrid strategies. We conduct comprehensive numerical experiments to confirm the convergence analysis of the proposed algorithm, to show its efficiency and mass preservation property by comparing it with state-of-the-art methods, and to illustrates its flexibility for handling various mean-field variational problems.


title: Data Analytics Approach to Predict High-Temperature Cyclic Oxidation Kinetics of NiCr-based Alloys

abstract: Although of practical importance, there is no established modeling framework to accurately predict high-temperature cyclic oxidation kinetics of multi-component alloys due to the inherent complexity. We present a data analytics approach to predict the oxidation rate constant of NiCr-based alloys as a function of composition and temperature with a highly consistent and well-curated experimental dataset. Two characteristic oxidation models, i.e., a simple parabolic law and a statistical cyclic-oxidation model, have been chosen to numerically represent the high-temperature oxidation kinetics of commercial and model NiCr-based alloys. We have successfully trained machine learning (ML) models using highly ranked key input features identified by correlation analysis to accurately predict experimental parabolic rate constants (kp). This study demonstrates the potential of ML approaches to predict oxidation kinetics of alloys over a wide composition and temperature ranges. This approach can also serve as a basis for introducing more physically meaningful ML input features to predict the comprehensive cyclic oxidation behavior of multi-component high-temperature alloys with proper constraints based on the known underlying mechanisms.