title: Interpretable Data-Based Explanations for Fairness Debugging

abstract: A wide variety of fairness metrics and eXplainable Artificial Intelligence (XAI) approaches have been proposed in the literature to identify bias in machine learning models that are used in critical real-life contexts. However, merely reporting on a model's bias, or generating explanations using existing XAI techniques is insufficient to locate and eventually mitigate sources of bias. We introduce Gopher, a system that produces compact, interpretable and causal explanations for bias or unexpected model behavior by identifying coherent subsets of the training data that are root-causes for this behavior. Specifically, we introduce the concept of causal responsibility that quantifies the extent to which intervening on training data by removing or updating subsets of it can resolve the bias. Building on this concept, we develop an efficient approach for generating the top-k patterns that explain model bias that utilizes techniques from the machine learning (ML) community to approximate causal responsibility and uses pruning rules to manage the large search space for patterns. Our experimental evaluation demonstrates the effectiveness of Gopher in generating interpretable explanations for identifying and debugging sources of bias.


title: Supervised Multivariate Learning with Simultaneous Feature Auto-grouping and Dimension Reduction

abstract: Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel clustered reduced-rank learning (CRL) framework that imposes two joint matrix regularizations to automatically group the features in constructing predictive factors. CRL is more interpretable than low-rank modeling and relaxes the stringent sparsity assumption in variable selection. In this paper, new information-theoretical limits are presented to reveal the intrinsic cost of seeking for clusters, as well as the blessing from dimensionality in multivariate learning. Moreover, an efficient optimization algorithm is developed, which performs subspace learning and clustering with guaranteed convergence. The obtained fixed-point estimators, though not necessarily globally optimal, enjoy the desired statistical accuracy beyond the standard likelihood setup under some regularity conditions. Moreover, a new kind of information criterion, as well as its scale-free form, is proposed for cluster and rank selection, and has a rigorous theoretical support without assuming an infinite sample size. Extensive simulations and real-data experiments demonstrate the statistical accuracy and interpretability of the proposed method.


title: A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation

abstract: This work presents a simple vision transformer design as a strong baseline for object localization and instance segmentation tasks. Transformers recently demonstrate competitive performance in image classification tasks. To adopt ViT to object detection and dense prediction tasks, many works inherit the multistage design from convolutional networks and highly customized ViT architectures. Behind this design, the goal is to pursue a better trade-off between computational cost and effective aggregation of multiscale global contexts. However, existing works adopt the multistage architectural design as a black-box solution without a clear understanding of its true benefits. In this paper, we comprehensively study three architecture design choices on ViT -- spatial reduction, doubled channels, and multiscale features -- and demonstrate that a vanilla ViT architecture can fulfill this goal without handcrafting multiscale features, maintaining the original ViT design philosophy. We further complete a scaling rule to optimize our model's trade-off on accuracy and computation cost / model size. By leveraging a constant feature resolution and hidden size throughout the encoder blocks, we propose a simple and compact ViT architecture called Universal Vision Transformer (UViT) that achieves strong performance on COCO object detection and instance segmentation tasks.


title: Two parameter scaling in the crossover from symmetry class BDI to AI

abstract: The transport statistics of the 1D chain and metallic armchair graphene nanoribbons with hopping disorder are studied, with a focus on understanding the cross-over between the zero-energy critical point and the localized regime at large energy. In this cross-over region, transport is found to be described by a 2-parameter scaling with the ratio $s$ of system size to mean-free-path, and the product $r$ of energy and scattering time. This 2-parameter scaling shows excellent data collapse across a wide a variety of system sizes, energies, and disorder strengths. The numerically obtained transport distributions in this regime are found to be well-described by a Nakagami distribution, whose form is controlled up to an overall scaling by the ratio $s / |\ln r|^2$. For sufficiently small values of this parameter, transport appears virtually identical to that of the zero-energy critical point, while at large values, a localized, Gaussian distribution is recovered. For intermediate values, the distribution interpolates smoothly between these two limits.


title: Superconducting proximity effect in $d$-wave cuprate/ graphene heterostructures

abstract: Superconducting proximity effects in graphene have received a great deal of attention for over a decade now. This has unveiled a plethora of exotic effects linked to the specificities of graphene's electronic properties. The vast majority of the related studies are based on conventional, low-temperature superconducting metals with isotropic $s$-wave pairing. Here we review recent advances made on the less studied case of unconventional high-temperature superconducting cuprates. These are characterized by an anisotropic $d$-wave pairing, whose interplay with Dirac electrons yields very rich physics and novel proximity behaviours. We provide a theoretical analysis and summarize the experiments reported so far. These unveil hints of proximity-induced unconventional pairing and demonstrate the gate-tunable, long-range propagation of high-temperature superconducting correlations in graphene. Finally, the fundamental and technological opportunities brought by the theoretical and experimental advances are discussed, together with the interest in extending similar studies to other Dirac materials.


title: Arbitrary-order pressure-robust DDR and VEM methods for the Stokes problem on polyhedral meshes

abstract: This paper contains two major contributions. First we derive, following the discrete de Rham (DDR) and Virtual Element (VEM) paradigms, pressure-robust methods for the Stokes equations that support arbitrary orders and polyhedral meshes. Unlike other methods presented in the literature, pressure-robustness is achieved here without resorting to an $\boldsymbol{H}({\rm div})$-conforming construction on a submesh, but rather projecting the volumetric force onto the discrete $\boldsymbol{H}({\bf curl})$ space. The cancellation of the pressure error contribution stems from key commutation properties of the underlying DDR and VEM complexes. The pressure-robust error estimates in $h^{k+1}$ (with $h$ denoting the meshsize and $k\ge 0$ the polynomial degree of the DDR or VEM complex) are proven theoretically and supported by a panel of three-dimensional numerical tests. The second major contribution of the paper is an in-depth study of the relations between the DDR and VEM approaches. We show, in particular, that a complex developed following one paradigm admits a reformulation in the other, and that couples of related DDR and VEM complexes satisfy commuting diagram properties with the degrees of freedom maps.


title: Isotope tuning of the superconducting dome of strontium titanate

abstract: Doped strontium titanate SrTiO$_3$ (STO) is one of the most dilute superconductors known today. The fact that superconductivity occurs at very low carrier concentrations is one of the two reasons that the pairing mechanism is not yet understood, the other is the role played by the proximity to a ferroelectric instability. In undoped STO, ferroelectric order can in fact be stabilized by substituting $^{16}$O with its heavier isotope $^{18}$O. Here we explore the superconducting properties of doped and isotope-substituted SrTi$(^{18}$O$_{y}^{16}$O$_{1-y})_{3-\delta}$ for $0\le y \le 0.81$ and carrier concentrations between $6\times 10^{17}$ and $2\times 10^{20}$ cm$^{-3}$ ($\delta<0.02$). We show that the superconducting $T_c$ increases when the $^{18}$O concentration is increased. For carrier concentrations around $5\times 10^{19}$~cm$^{-3}$ this $T_c$ increase amounts to almost a factor $3$, with $T_c$ as high as 580~mK for $y=0.74$. When approaching SrTi$^{18}$O$_3$ the maximum $T_c$ occurs at a much smaller carrier densities than for pure SrTi$^{16}$O$_3$. Our observations agree qualitatively with a scenario where superconducting pairing is mediated by fluctuations of the ferroelectric soft mode.


title: Set Twister for Single-hop Node Classification

abstract: Node classification is a central task in relational learning, with the current state-of-the-art hinging on two key principles: (i) predictions are permutation-invariant to the ordering of a node's neighbors, and (ii) predictions are a function of the node's $r$-hop neighborhood topology and attributes, $r \geq 2$. Both graph neural networks and collective inference methods (e.g., belief propagation) rely on information from up to $r$-hops away. In this work, we study if the use of more powerful permutation-invariant functions can sometimes avoid the need for classifiers to collect information beyond $1$-hop. Towards this, we introduce a new architecture, the Set Twister, which generalizes DeepSets (Zaheer et al., 2017), a simple and widely-used permutation-invariant representation. Set Twister theoretically increases expressiveness of DeepSets, allowing it to capture higher-order dependencies, while keeping its simplicity and low computational cost. Empirically, we see accuracy improvements of Set Twister over DeepSets as well as a variety of graph neural networks and collective inference schemes in several tasks, while showcasing its implementation simplicity and computational efficiency.


title: Pebbling in Powers of Paths

abstract: The $t$-fold pebbling number, $\pi_t(G)$, of a graph $G$ is defined to be the minimum number $m$ so that, from any given configuration of $m$ pebbles on the vertices of $G$, it is possible to place at least $t$ pebbles on any specified vertex via pebbling moves. It has been conjectured that the pebbling numbers of pyramid-free chordal graphs can be calculated in polynomial time. The $k^{\rm th}$ power $G^{(k)}$ of the graph $G$ is obtained from $G$ by adding an edge between any two vertices of distance at most $k$ from each other. The $k^{\rm th}$ power of the path $P_n$ on $n$ is an important class of pyramid-free chordal graphs. Pachter, Snevily, and Voxman (1995), Kim (2004), and Kim and Kim (2010) calculated $\pi(P_n^{(k)})$ for $2\le k\le 4$, respectively. In this paper we calculate $\pi_t(P_n^{(k)})$ for all $n$, $k$, and $t$. For a function $D:V(G)\rightarrow{\mathbb N}$, the $D$-pebbling number, $\pi(G,D)$, of a graph $G$ is defined to be the minimum number $m$ so that, from any given configuration of $m$ pebbles on the vertices of $G$, it is possible to place at least $D(v)$ pebbles on each vertex $v$ via pebbling moves. We make the conjecture that every $G$ and $D$ satisfies $\pi(G,D)\le \pi_{|D|}(G)-(s(D)-1)$, where $s(D)$ counts the number of vertices $v$ with $D(v)>0$. We prove this for trees and $P_n^{(k)}$, for all $n$ and $k$. The pebbling exponent $e_\pi(G)$ of a graph $G$ was defined by Pachter, et al., to be the minimum $k$ for which $\pi(G^{(k)})=n(G^{(k)})$. Of course, $e_\pi(G)\le {\rm diameter}(G)$, and Czygrinow, Hurlbert, Kierstead, and Trotter (2002) proved that almost all graphs $G$ have $e_\pi(G)=1$. Lourdusamy and Mathivanan (2015) proved several results on $\pi_t(C_n^2)$, and Hurlbert (2017) proved an asymptotically tight formula for $e_\pi(C_n)$. Our formula for $\pi_t(P_n^{(k)})$ allows us us to compute $e_\pi(P_n)$ asymptotically tightly.


title: Discrete Probabilistic Inverse Optimal Transport

abstract: Optimal transport (OT) formalizes the problem of finding an optimal coupling between probability measures given a cost matrix. The inverse problem of inferring the cost given a coupling is Inverse Optimal Transport (IOT). IOT is less well understood than OT. We formalize and systematically analyze the properties of IOT using tools from the study of entropy-regularized OT. Theoretical contributions include characterization of the manifold of cross-ratio equivalent costs, the implications of model priors, and derivation of an MCMC sampler. Empirical contributions include visualizations of cross-ratio equivalent effect on basic examples and simulations validating theoretical results.


title: SimPlot++: a Python application for representing sequence similarity and detecting recombination

abstract: Motivation: Accurate detection of sequence similarity and homologous recombination are essential parts of many evolutionary analyses. Results: We have developed SimPlot++, an open-source multiplatform application implemented in Python, which can be used to produce publication quality sequence similarity plots using 63 nucleotide and 20 amino acid distance models, to detect intergenic and intragenic recombination events using Phi, Max-X2, NSS or proportion tests, and to generate and analyze interactive sequence similarity networks. SimPlot++ supports multicore data processing and provides useful distance calculability diagnostics. Availability: SimPlot++ is freely available on GitHub at: https://github.com/Stephane-S/Simplot_PlusPlus, as both an executable file (for Windows) and Python scripts (for Windows/Linux/MacOS).


title: Towards Harmonious Decentralization of Energy Systems: A Vision of Interoperable Peer-to-Peer Energy Markets

abstract: We present a hierarchical framework aimed at decentralizing the distribution systems market operations using localized peer-to-peer energy markets. Hierarchically designed decision-making algorithm approaches the power systems market operations from a bottom-up perspective. The three layers of the hierarchical framework operate in orchestration to enable prosumers (the grass-root actors) to maximize their revenues - hence, a prosumer-centric framework. The design of the framework incorporates existing smart grid technologies (Virtual Power Plants, Microgrids, Distributed Energy Resources) and redefine their functional objectives to align them with the decentralization paradigm focused on empowering bottom-up grid operations approach. On one hand, the framework is enabling prosumers with simultaneous access to the buy-sell choices that help them maximize their cost savings while ensuring their consumption patterns and preferences are not being tradeoff as a result of top-down operational decisions. On the other hand, it is designed to operate in harmony with the existing top-down grid operations mechanisms - thereby reducing the potential friction in its adaptation. This marriage of the top-down and bottom-up operational approaches is facilitated through meticulous orchestration of operational timescales. Framework's novel design also incorporates scalability and interoperability considerations, thereby tackling the challenge of decentralization holistically.


title: Risk-Averse Stochastic Optimal Control: an efficiently computable statistical upper bound

abstract: In this paper, we discuss an application of the SDDP type algorithm to nested risk-averse formulations of Stochastic Optimal Control (SOC) problems. We propose a construction of a statistical upper bound for the optimal value of risk-averse SOC problems. This outlines an approach to a solution of a long standing problem in that area of research. The bound holds for a large class of convex and monotone conditional risk mappings. Finally, we show the validity of the statistical upper bound to solve a real-life stochastic hydro-thermal planning problem.


title: On the Finiteness of Perfect Powers in Elliptic Divisibility Sequences

abstract: We prove that there are finitely many perfect powers in elliptic divisibility sequences generated by a non-integral point on elliptic curves of the from $y^2=x(x^2+b)$, where $b$ is any positive integer. We achieve this by using the modularity of elliptic curves over real quadratic number fields.


title: Stable Singularity Formation for the Inviscid Primitive Equations

abstract: The primitive equations (PEs) model large scale dynamics of the oceans and the atmosphere. While it is by now well-known that the three-dimensional viscous PEs is globally well-posed in Sobolev spaces, and that there are solutions to the inviscid PEs (also called the hydrostatic Euler equations) that develop singularities in finite time, the qualitative description of the blowup still remains undiscovered. In this paper, we provide a full description of two blowup mechanisms, for a reduced PDE that is satisfied by a class of particular solutions to the PEs. In the first one a shock forms, and pressure effects are subleading, but in a critical way: they localize the singularity closer and closer to the boundary near the blow-up time (with a logarithmic in time law). This first mechanism involves a smooth blow-up profile and is stable among smooth enough solutions. In the second one the pressure effects are fully negligible; this dynamics involves a two-parameters family of non-smooth profiles, and is stable only by smoother perturbations.


title: Learned Half-Quadratic Splitting Network for MR Image Reconstruction

abstract: Magnetic Resonance (MR) image reconstruction from highly undersampled $k$-space data is critical in accelerated MR imaging (MRI) techniques. In recent years, deep learning-based methods have shown great potential in this task. This paper proposes a learned half-quadratic splitting algorithm for MR image reconstruction and implements the algorithm in an unrolled deep learning network architecture. We compare the performance of our proposed method on a public cardiac MR dataset against DC-CNN and LPDNet, and our method outperforms other methods in both quantitative results and qualitative results with fewer model parameters and faster reconstruction speed. Finally, we enlarge our model to achieve superior reconstruction quality, and the improvement is $1.76$ dB and $2.74$ dB over LPDNet in peak signal-to-noise ratio on $5\times$ and $10\times$ acceleration, respectively. Code for our method is publicly available at https://github.com/hellopipu/HQS-Net.


title: Efficient and Scalable Graph Pattern Mining on GPUs

abstract: Graph Pattern Mining (GPM) extracts higher-order information in a large graph by searching for small patterns of interest. GPM applications are computationally expensive, and thus attractive for GPU acceleration. Unfortunately, due to the complexity of GPM algorithms and parallel hardware, hand optimizing GPM applications suffers programming complexity, while existing GPM frameworks sacrifice efficiency for programmability. Moreover, little work has been done on GPU to scale GPM computation to large problem sizes. We describe G2Miner, the first Graph Pattern Mining (GPM) framework that runs on multiple GPUs. G2Miner uses pattern-aware, input-aware and architecture-aware search strategies to achieve high efficiency on GPUs. To simplify programming, it provides a code generator that automatically generates pattern-aware CUDA code. G2Miner flexibly supports both breadth-first search (BFS) and depth-first search (DFS) to maximize memory utilization and generate sufficient parallelism for GPUs. For the scalability of G2Miner, we use a customized scheduling policy to balance work among multiple GPUs. Experiments on a V100 GPU show that G2Miner achieves average speedups of 5.4x and 7.2x over two state-of-the-art single-GPU systems, Pangolin and PBE, respectively. In the multi-GPU setting, G2Miner achieves linear speedups from 1 to 8 GPUs, for various patterns and data graphs. We also show that G2Miner on a V100 GPU is 48.3x and 15.2x faster than the state-of-the-art CPU-based system, Peregrine and GraphZero, on a 56-core CPU machine.


title: Reproducible and Portable Big Data Analytics in the Cloud

abstract: Cloud computing has become a major approach to help reproduce computational experiments. Yet there are still two main difficulties in reproducing batch based big data analytics (including descriptive and predictive analytics) in the cloud. The first is how to automate end-to-end scalable execution of analytics including distributed environment provisioning, analytics pipeline description, parallel execution, and resource termination. The second is that an application developed for one cloud is difficult to be reproduced in another cloud, a.k.a. vendor lock-in problem. To tackle these problems, we leverage serverless computing and containerization techniques for automated scalable execution and reproducibility, and utilize the adapter design pattern to enable application portability and reproducibility across different clouds. We propose and develop an open-source toolkit that supports 1) fully automated end-to-end execution and reproduction via a single command, 2) automated data and configuration storage for each execution, 3) flexible client modes based on user preferences, 4) execution history query, and 5) simple reproduction of existing executions in the same environment or a different environment. We did extensive experiments on both AWS and Azure using four big data analytics applications that run on virtual CPU/GPU clusters. The experiments show our toolkit can achieve good execution performance, scalability, and efficient reproducibility for cloud-based big data analytics.


title: News-sharing on Twitter reveals emergent fragmentation of media agenda and persistent polarization

abstract: News sharing on social networks reveals how information disseminates among users. This process, constrained by user preferences and social ties, plays a key role in the formation of public opinion. In this work we study news sharing of main Argentinian media outlets in Twitter, using bipartite news-user networks, in order to understand if the emergence of affinity groups is driven by the underlying political polarization. We compare the results between an electoral and non-electoral year and between a set of politically active users and a control group. We found that users' behavior produces well differentiated communities of news articles identified by a unique distribution of media outlets in all analyzed datasets. In particular, these communities split into two groups which reflect the dominant ideological polarization in Argentina. We also found that users form two well differentiated groups identified by their preferences in media outlets consumption. These two groups of media outlets display a bias towards the two main political parties that rule the political life in Argentina. These results reveal consistently that ideological polarization is the main driving force shaping the Argentinian news sharing in Twitter.


title: Reflections on the future of machine learning for materials research

abstract: Applied machine learning (ML) has rapidly spread throughout the physical sciences; in fact, ML-based data analysis and experimental decision-making has become commonplace. We suggest a shift in the conversation from proving that ML can be used to evaluating how to equitably and effectively implement ML for science.We advocate a shift from a "more data, more compute" mentality to a model-oriented approach that prioritizes using machine learning to support the ecosystem of computational models and experimental measurements.We also recommend an open conversation about dataset bias to stabilize productive research through careful model interrogation and deliberate exploitation of known biases. Further, we encourage the community to develop ML methods that connect experiments with theoretical models to increase scientific understanding rather than incrementally optimizing materials. Moreover we envision a future of radical materials innovations enabled by computational creativity tools combined with online visualization and analysis tools that support active outside-the-box thinking inside the scientific knowledge feedback loop. Finally, as a community we must acknowledge ethical issues that can arise from blindly following machine learning predictions and the issues of social equity that will arise if data, code, and computational resources are not readily available to all.


title: SiGe quantum wells with oscillating Ge concentrations for quantum dot qubits

abstract: Large-scale arrays of quantum-dot spin qubits in Si/SiGe quantum wells require large or tunable energy splittings of the valley states associated with degenerate conduction band minima. Existing proposals to deterministically enhance the valley splitting rely on sharp interfaces or modifications in the quantum well barriers that can be difficult to grow. Here, we propose and demonstrate a new heterostructure, the "Wiggle Well," whose key feature is Ge concentration oscillations inside the quantum well. Experimentally, we show that placing Ge in the quantum well does not significantly impact our ability to form and manipulate single-electron quantum dots. We further observe large and widely tunable valley splittings, from 54 to 239 ueV. Tight-binding calculations, and the tunability of the valley splitting, indicate that these results can mainly be attributed to random concentration fluctuations that are amplified by the presence of Ge alloy in the heterostructure, as opposed to a deterministic enhancement due to the concentration oscillations. Quantitative predictions for several other heterostructures point to the Wiggle Well as a robust method for reliably enhancing the valley splitting in future qubit devices.


title: Certain properties and applications of shallow bosonic circuits

abstract: We introduce a novel approach to solve optimization problems on a boson sampling device assisted by classical machine-learning techniques. By virtue of the parity function, we map all measurement patterns, which label the basis spanning an $M$-mode bosonic Hilbert space, to the Hilbert space of $M$ qubits. As a result, the sampled probability function can be interpreted as a result of sampling a multiqubit circuit. The method is presented on several instances of a QUBO/Ising problem as well as portfolio optimization problems. Among many demonstrated properties of the parity function is the ability to chart the entire qubit Hilbert space no matter how shallow the initial bosonic circuits is. In order to show this we link boson sampling circuits to a class of finite Young's lattices (a special poset with the so-called Ferrers diagrams ordered by inclusion), Boolean lattices and the properties of Dyck/staircase paths on integer lattices. Our results and methods can be applied to a large variety of photonic circuits, including the deep ones of essentially any geometry, but our main focus is on shallow circuits as they are less affected by photon loss and relatively easy to implement in the form of a time-bin interferometer.

categories: quant-ph math-ph math.CO math.MP physics.optics


title: Know Your Customer: Balancing Innovation and Regulation for Financial Inclusion

abstract: Financial inclusion depends on providing adjusted services for citizens with disclosed vulnerabilities. At the same time, the financial industry needs to adhere to a strict regulatory framework, which is often in conflict with the desire for inclusive, adaptive, and privacy-preserving services. In this article we study how this tension impacts the deployment of privacy-sensitive technologies aimed at financial inclusion. We conduct a qualitative study with banking experts to understand their perspectives on service development for financial inclusion. We build and demonstrate a prototype solution based on open source decentralized identifiers and verifiable credentials software and report on feedback from the banking experts on this system. The technology is promising thanks to its selective disclosure of vulnerabilities to the full control of the individual. This supports GDPR requirements, but at the same time, there is a clear tension between introducing these technologies and fulfilling other regulatory requirements, particularly with respect to 'Know Your Customer.' We consider the policy implications stemming from these tensions and provide guidelines for the further design of related technologies.


title: Anisotropic thermal characterisation of large-format lithium-ion pouch cells

abstract: Temperature strongly impacts battery performance, safety and durability, but modelling heat transfer requires accurately measured thermal properties. Herein we propose new approaches to characterise the heat capacity and anisotropic thermal-conductivity components for lithium-ion pouch cells. Heat capacity was estimated by applying Newton's law of cooling to an insulated container within which the cell was submerged in warmed dielectric fluid. Thermal conductivity was quantified by heating one side of the cell and measuring the opposing temperature distribution with infra-red thermography, then inverse modelling with the anisotropic heat equation. Experiments were performed on commercial 20 Ah lithium iron phosphate (LFP) pouch cells. At 100% state-of-charge (SOC), the heat capacity of a 489 g, 224 mL pouch cell was 541 J/K. The through-plane and in-plane thermal conductivities were respectively 0.52 and 26.6 W/(mK). Capturing anisotropies in conductivity is important for accurate thermal simulations. State-of-charge dependence was also probed by testing at 50% SOC: the heat capacity dropped by 6% and thermal conductivity did not significantly change.


title: Hybrid Self-Organizing Networks: Evolution, Standardization Trends, and a 6G Architecture Vision

abstract: Self-organizing networks (SONs) need to be endowed with self-coordination capabilities to manage the complex relations between their internal components and to avoid their destructive interactions. Existing communication technologies commonly implement responsive self-coordination mechanisms that can be very slow in dynamic situations. The sixth generation (6G) networks, being in their early stages of research and standardization activities, open new opportunities to opt for a design-driven approach when developing self-coordination capabilities. This can be achieved through the use of hybrid SON designs. A hybrid architecture combines the centralized and distributed management and control. In this article, we review the history of SONs including the inherent self-coordination feature. We then delve into the concept of hybrid SONs (H-SONs), and we summarize the challenges, opportunities, and future trends for H-SON development. We provide a comprehensive collection of standardization activities and recommendations, discussing the key contributions and potential work to continue the evolution and push for a wide adoption of the H-SON paradigm. More importantly, as a key 6G architectural feature we propose that H-SONs should be loosely coupled networks. Loose coupling refers to the weak interaction of different layers and weak interaction between users in the same layer, i.e., the various feedback loops must be almost isolated from each other to improve the stability and to avoid chaotic situations. We finally conclude the paper with the key hints about the future landscape and the key drivers of 6G H-SONs.


title: Controlling the dewetting morphologies of thin liquid films by switchable substrates

abstract: Switchable and adaptive substrates emerged as valuable tools for the control of wetting and actuation of droplet motion. Here we report a computational study of the dynamics of an unstable thin liquid film deposited on a switchable substrate, modelled with a space and time varying contact angle. With a static pattern, all the fluid is drained into droplets located around contact angle minima, whereas for a sufficiently large rate of wettability variation a state consisting of metastable rivulets is observed. A criterion discriminating whether rivulets can be observed or not is identified in terms of a single dimensionless parameter. Finally, we show and explain theoretically how the film rupture times, droplet shape and rivulet life time depend on the pattern wavelength and speed.

categories: physics.flu-dyn cond-mat.soft physics.chem-ph physics.comp-ph


title: Privacy Leakage over Dependent Attributes in One-Sided Differential Privacy

abstract: Providing a provable privacy guarantees while maintaining the utility of data is a challenging task in many real-world applications. Recently, a new framework called One-Sided Differential Privacy (OSDP) was introduced that extends existing differential privacy approaches. OSDP increases the utility of the data by taking advantage of the fact that not all records are sensitive. However, the previous work assumed that all records are statistically independent from each other. Motivated by occupancy data in building management systems, this paper extends the existing one-sided differential privacy framework. In this paper, we quantify the overall privacy leakage when the adversary is given dependency information between the records. In addition, we show how an optimization problem can be constructed that efficiently trades off between the utility and privacy.


title: The weak-gravity bound in asymptotically safe gravity-gauge systems

abstract: The weak-gravity bound has been discovered in asymptotically safe gravity-matter systems, where it limits the maximum strength of gravitational fluctuations. In the present paper, we explore it for the first time in systems with more than one gauge field, to discover whether systems with 12 gauge fields (like the Standard Model) exhibit a weak-gravity bound and whether the gravitational fixed point evades it. Further, we test the robustness of the present and previous results on the weak-gravity bound by exploring their dependence on a gravitational gauge parameter. Finally, the existence of the weak-gravity bound also has important phenomenological consequences: it is key to a proposed mechanism that bounds the spacetime dimensionality from above to four or five dimensions. In this paper, we strengthen the evidence for this mechanism. Thus, the predictive power of the asymptotic safety paradigm could extend to parameters of the spacetime geometry, such that the four-dimensionality of our universe could be explained from first principles.


title: Electromagnetic Signatures from Supermassive Binary Black Holes Approaching Merger

abstract: We present fully relativistic predictions for the electromagnetic emission produced by accretion disks surrounding spinning and nonspinning supermassive binary black holes on the verge of merging. We use the code Bothros to post-process data from 3D general relativistic magnetohydrodynamic simulations via ray-tracing calculations. These simulations model the dynamics of a circumbinary disk and the mini-disks that form around two equal-mass black holes orbiting each other at an initial separation of 20 gravitational radii, and evolve the system for more than 10 orbits in the inspiral regime. We model the emission as the sum of thermal blackbody radiation emitted by an optically thick accretion disk and a power-law spectrum extending to hard X-rays emitted by a hot optically thin corona. We generate time-dependent spectra, images, and light curves at various frequencies to investigate intrinsic periodic signals in the emission, as well as the effects of the black hole spin. We find that prograde black hole spin makes mini-disks brighter since the smaller innermost stable circular orbit angular momentum demands more dissipation before matter plunges to the horizon. However, compared to mini-disks in larger separation binaries with spinning black holes, our mini-disks are less luminous: unlike those systems, their mass accretion rate is lower than in the circumbinary disk, and they radiate with lower efficiency because their inflow times are shorter. Compared to a single black hole system matched in mass and accretion rate, these binaries have spectra noticeably weaker and softer in the UV. Finally, we discuss the implications of our findings for the potential observability of these systems.


title: Comparative Analysis of Radar Cross Section Based UAV Classification Techniques

abstract: This work investigates the problem of unmanned aerial vehicles (UAVs) identification using their radar crosssection (RCS) signature. The RCS of six commercial UAVs are measured at 15 GHz and 25 GHz in an anechoic chamber, for both vertical-vertical and horizontal-horizontal polarization. The RCS signatures are used to train 15 different classification algorithms, each belonging to one of three different categories: statistical learning (SL), machine learning (ML), and deep learning (DL). The study shows that while the classification accuracy of all the algorithms increases with the signal-to-noise ratio (SNR), the ML algorithm achieved better accuracy than the SL and DL algorithms. For example, the classification tree ML achieves an accuracy of 98.66% at 3 dB SNR using the 15 GHz VV-polarized RCS test data from the UAVs. We investigate the classification accuracy using Monte Carlo analysis with the aid of boxplots, confusion matrices, and classification plots. On average, the accuracy of the classification tree ML model performed better than the other algorithms, followed by the Peter Swerling statistical models and the discriminant analysis ML model. In general, the classification accuracy of the ML and SL algorithms outperformed the DL algorithms (Squeezenet, Googlenet, Nasnet, and Resnet 101) considered in the study. Furthermore, the computational time of each algorithm is analyzed. The study concludes that while the SL algorithms achieved good classification accuracy, the computational time was relatively long when compared to the ML and DL algorithms. Also, the study shows that the classification tree achieved the fastest average classification time of about 0.46 ms.


title: Adaptive Subsampling for ROI-based Visual Tracking: Algorithms and FPGA Implementation

abstract: There is tremendous scope for improving the energy efficiency of embedded vision systems by incorporating programmable region-of-interest (ROI) readout in the image sensor design. In this work, we study how ROI programmability can be leveraged for tracking applications by anticipating where the ROI will be located in future frames and switching pixels off outside of this region. We refer to this process of ROI prediction and corresponding sensor configuration as adaptive subsampling. Our adaptive subsampling algorithms comprise an object detector and an ROI predictor (Kalman filter) which operate in conjunction to optimize the energy efficiency of the vision pipeline with the end task being object tracking. To further facilitate the implementation of our adaptive algorithms in real life, we select a candidate algorithm and map it onto an FPGA. Leveraging Xilinx Vitis AI tools, we designed and accelerated a YOLO object detector-based adaptive subsampling algorithm. In order to further improve the algorithm post-deployment, we evaluated several competing baselines on the OTB100 and LaSOT datasets. We found that coupling the ECO tracker with the Kalman filter has a competitive AUC score of 0.4568 and 0.3471 on the OTB100 and LaSOT datasets respectively. Further, the power efficiency of this algorithm is on par with, and in a couple of instances superior to, the other baselines. The ECO-based algorithm incurs a power consumption of approximately 4 W averaged across both datasets while the YOLO-based approach requires power consumption of approximately 6 W (as per our power consumption model). In terms of accuracy-latency tradeoff, the ECO-based algorithm provides near-real-time performance (19.23 FPS) while managing to attain competitive tracking precision.


title: New Infinities of Soft Charges

abstract: Recent results on the infrared structure of gravity and electromagnetism have suggested that the deep infrared is much richer than previously appreciated. This article presents a generalisation of these findings within the context of abelian and nonabelian soft (i.e. zero-energy) gauge charges. As a warm up, we describe the emergence of an infinity of soft magnetic charges even in the absence of magnetic monopoles. We show that two infinite sets of soft charges arise in the nonabelian theory as well. In light of the concomitant conservation laws associated with the soft charges, we revisit the black hole information paradox and the no-hair theorems, and argue that a generic black hole carries an infinite amount of gravitational, electromagnetic and chromodynamic soft hair.


title: HHO methods for the incompressible Navier-Stokes and the incompressible Euler equations

abstract: We propose two Hybrid High-Order (HHO) methods for the incompressible Navier-Stokes equations and investigate their robustness with respect to the Reynolds number. While both methods rely on a HHO formulation of the viscous term, the pressure-velocity coupling is fundamentally different, up to the point that the two approaches can be considered antithetical. The first method is kinetic energy preserving, meaning that the skew-symmetric discretization of the convective term is guaranteed not to alter the kinetic energy balance. The approximated velocity fields exactly satisfy the divergence free constraint and continuity of the normal component of the velocity is weakly enforced on the mesh skeleton, leading to H-div conformity. The second scheme relies on Godunov fluxes for pressure-velocity coupling: a Harten, Lax and van Leer (HLL) approximated Riemann Solver designed for cell centered formulations is adapted to hybrid face centered formulations. The resulting numerical scheme is robust up to the inviscid limit, meaning that it can be applied for seeking approximate solutions of the incompressible Euler equations. The schemes are numerically validated performing steady and unsteady two dimensional test cases and evaluating the convergence rates on h-refined mesh sequences. In addition to standard benchmark flow problems, specifically conceived test cases are conducted for studying the error behaviour when approaching the inviscid limit.


title: Anxiety profiles and protective factors: A latent profile analysis in children

abstract: The current study investigated the presence of different anxiety profiles in schoolchildren in order to understand whether Mathematics and Test Anxiety are a manifestation of a general form of anxiety, or the expression of specific forms of anxiety. Moreover, we also examined the influence of personal protective factors. The results of a latent profile analysis, conducted on 664 children attending grades 3 to 6, clearly identified three different profiles distinguished on the basis of the level of general, test and mathematics anxiety. Protective factors, such as self concept and resilience, were differently related to anxiety: The former was clearly lower when the risk profile was higher, whereas students were able to maintain a certain level of resilience up to an average risk of developing forms of anxiety. The implications of these findings may lead to the development of specific intervention programs aimed at reducing students' anxiety and fostering self concept and resilience.


title: Conformal Isometries and Curvature Collineations of an Impulsive Plane Wave: a distributional approach

abstract: By extending the notion of Lie derivative to distribution-valued tensor fields of order $m$, Lie derivatives with respect to $C^k$ vector fields, $k\geqslant m+1$, can be shown to be well defined. Geometric symmetries, definable in terms of these Lie derivatives, can then be considered. In particular, for spacetimes of low regularity, geometric symmetries generated by vector fields of regularity as low as $C^1$ are definable. We find that the conformal algebra of the impulsive plane wave spacetime (with $+$ polarization) described by the continuous Baldwin-Jeffery-Rosen form of the metric has the maximal dimension seven. The curvature of this metric is well defined as a distribution and since this spacetime is Ricci-flat, we show that all the vector fields in the conformal algebra are special curvature collineations. We find also the general form of these last ones. Finally, we find the conformal Killing vector fields of this spacetime when using the distributional Brinkmann form of the metric.


title: Exploring the Impact of Virtualization on the Usability of the Deep Learning Applications

abstract: Deep Learning-based (DL) applications are becoming increasingly popular and advancing at an unprecedented pace. While many research works are being undertaken to enhance Deep Neural Networks (DNN) -- the centerpiece of DL applications -- practical deployment challenges of these applications in the Cloud and Edge systems, and their impact on the usability of the applications have not been sufficiently investigated. In particular, the impact of deploying different virtualization platforms, offered by the Cloud and Edge, on the usability of DL applications (in terms of the End-to-End (E2E) inference time) has remained an open question. Importantly, resource elasticity (by means of scale-up), CPU pinning, and processor type (CPU vs GPU) configurations have shown to be influential on the virtualization overhead. Accordingly, the goal of this research is to study the impact of these potentially decisive deployment options on the E2E performance, thus, usability of the DL applications. To that end, we measure the impact of four popular execution platforms (namely, bare-metal, virtual machine (VM), container, and container in VM) on the E2E inference time of four types of DL applications, upon changing processor configuration (scale-up, CPU pinning) and processor types. This study reveals a set of interesting and sometimes counter-intuitive findings that can be used as best practices by Cloud solution architects to efficiently deploy DL applications in various systems. The notable finding is that the solution architects must be aware of the DL application characteristics, particularly, their pre- and post-processing requirements, to be able to optimally choose and configure an execution platform, determine the use of GPU, and decide the efficient scale-up range.


title: Information Geometry, Jordan Algebras, and a Coadjoint Orbit-Like Construction

abstract: Jordan algebras arise naturally in (quantum) information geometry, and we want to understand their role and their structure within that framework. Inspired by Kirillov's discussion of the symplectic structure on coadjoint orbits, we provide a similar construction in the case of real Jordan algebras. Given a real, finite-dimensional, formally real Jordan algebra ${\mathcal J}$, we exploit the generalized distribution determined by the Jordan product on the dual ${\mathcal J}^{\star}$ to induce a pseudo-Riemannian metric tensor on the leaves of the distribution. In particular, these leaves are the orbits of a Lie group, which is the structure group of ${\mathcal J}$, in clear analogy with what happens for coadjoint orbits. However, this time in contrast with the Lie-algebraic case, we prove that not all points in ${\mathcal J}^{*}$ lie on a leaf of the canonical Jordan distribution. When the leaves are contained in the cone of positive linear functionals on ${\mathcal J}$, the pseudo-Riemannian structure becomes Riemannian and, for appropriate choices of ${\mathcal J}$, it coincides with the Fisher-Rao metric on non-normalized probability distributions on a finite sample space, or with the Bures-Helstrom metric for non-normalized, faithful quantum states of a finite-level quantum system, thus showing a direct link between the mathematics of Jordan algebras and both classical and quantum information geometry.


title: Sudden discharge of young charged magnetars as a new model for FRBs

abstract: We propose a new model for Fast Radio Bursts (FRBs) based on a sudden discharge of a charged young magnetar, caused by the short falling timescale of oppositely charged particles onto the magnetar. In this scenario, curvature radiation is emitted by particles accelerated at relativistic by the strong electric fields produced by the disconnection and the subsequent reconnection of the magnetic field lines, a process triggered by the sudden discharge. We modeled the magnetars as charged neutron stars in the static approximation using the exterior metric by the Reissner-Nordstr\"om. We also adopted an electrical charge distribution proportional to the mass-energy density, although our results are not strongly sensitive to the specific star charge distribution, only to the total charge. Our calculations show that the discharge and emission timescales are several milliseconds, compatible with the FRB phenomena for magnetars with a total charge of $\sim 10^{20}~\mathrm{C}$ and mass and radius in the range of 1.5 to 3.0 $\mathrm{M_{\odot}}$ and 10 to 45 km, respectively. Furthermore, the calculated total emitted power of a coherent pulse is $P_{tot}\sim 10^{42-43} erg/s$, and the frequency range and time scale are also consistent with FRBs astronomical observations. Finally, if the magnetar does not collapse after the discharge, the existence of FRB repeater sources can not rule out the existence of a blast repetition after the time needed to magnetosphere recharges and produce a new discharge.


title: More Reviews May Not Help: Evidence from Incentivized First Reviews on Airbnb

abstract: Online reviews are typically written by volunteers and, as a consequence, information about seller quality may be under-provided in digital marketplaces. We study the extent of this under-provision in a large-scale randomized experiment conducted by Airbnb. In this experiment, buyers are offered a coupon to review listings that have no prior reviews. The treatment induces additional reviews and these reviews tend to be more negative than reviews in the control group, consistent with selection bias in reviewing. Reviews induced by the treatment result in a temporary increase in transactions but these transactions are for fewer nights, on average. The effects on transactions and nights per transaction cancel out so that there is no detectable effect on total nights sold and revenue. Measures of transaction quality in the treatment group fall, suggesting that incentivized reviews do not improve matching. We show how market conditions and the design of the reputation system can explain our findings.


title: Functional Linear Regression for Partially Observed Functional Data

abstract: In the functional linear regression model, many methods have been proposed and studied to estimate the slope function while the functional predictor was observed in the entire domain. However, works on functional linear regression models with partially observed trajectories have received less attention. In this paper, to fill the literature gap we consider the scenario where individual functional predictor may be observed only on part of the domain. Depending on whether measurement error is presented in functional predictors, two methods are developed, one is based on linear functionals of the observed part of the trajectory and the other one uses conditional principal component scores. We establish the asymptotic properties of the two proposed methods. Finite sample simulations are conducted to verify their performance. Diffusion tensor imaging (DTI) data from Alzheimer's Disease Neuroimaging Initiative (ADNI) study is analyzed.


title: Frequency-tunable Kerr-free three-wave mixing with a gradiometric SNAIL

abstract: Three-wave mixing is a key process in superconducting quantum information processing, being involved in quantum-limited amplification and parametric coupling between superconducting cavities. These operations can be implemented by SNAIL-based devices that present a Kerr-free flux-bias point where unwanted parasitic effects such as Stark shift are suppressed. However, with a single flux-bias parameter, these circuits can only host one Kerr-free point, limiting the range of their applications. In this Letter, we demonstrate how to overcome this constraint with a gradiometric SNAIL, a doubly-flux biased superconducting circuit for which both effective inductance and Kerr coefficient can be independently tuned. Experimental data show the capability of the gradiometric SNAIL to suppress Kerr effect in a three-wave mixing parametric amplifier over a continuum of flux bias points corresponding to a 1.7 GHz range of operating frequencies.


title: Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillation

abstract: Face recognition networks generally demonstrate bias with respect to sensitive attributes like gender, skintone etc. For gender and skintone, we observe that the regions of the face that a network attends to vary by the category of an attribute. This might contribute to bias. Building on this intuition, we propose a novel distillation-based approach called Distill and De-bias (D&D) to enforce a network to attend to similar face regions, irrespective of the attribute category. In D&D, we train a teacher network on images from one category of an attribute; e.g. light skintone. Then distilling information from the teacher, we train a student network on images of the remaining category; e.g., dark skintone. A feature-level distillation loss constrains the student network to generate teacher-like representations. This allows the student network to attend to similar face regions for all attribute categories and enables it to reduce bias. We also propose a second distillation step on top of D&D, called D&D++. Here, we distill the `un-biasedness' of the D&D network into a new student network, the D&D++ network, while training this new network on all attribute categories; e.g., both light and dark skintones. This helps us train a network that is less biased for an attribute, while obtaining higher face verification performance than D&D. We show that D&D++ outperforms existing baselines in reducing gender and skintone bias on the IJB-C dataset, while obtaining higher face verification performance than existing adversarial de-biasing methods. We evaluate the effectiveness of our proposed methods on two state-of-the-art face recognition networks: ArcFace and Crystalface.


title: Topological transitions with continuously monitored free fermions

abstract: We study a free fermion model where two sets of non-commuting non-projective measurements stabilize area-law entanglement scaling phases of distinct topological order. We show the presence of a topological phase transition that is of a different universality class than that observed in stroboscopic projective circuits. In the presence of unitary dynamics, the two topologically distinct phases are separated by a region with sub-volume scaling of the entanglement entropy. We find that this entanglement transition is well identified by a combination of the bipartite entanglement entropy and the topological entanglement entropy. We further show that the phase diagram is qualitatively captured by an analytically tractable non-Hermitian model obtained via post-selecting the measurement outcome. Finally we introduce a partial-post-selection continuous mapping, that uniquely associates topological indices of the non-Hermitian Hamiltonian to the distinct phases of the stochastic measurement-induced dynamics.


title: Heavy-tailed denoising score matching

abstract: Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations, motivating a more concrete route toward even higher dimension PDF estimation in future. We outline this limitation, before extending the theory to a broader family of noising distributions -- namely, the generalised normal distribution. To theoretically ground this, we relax a key assumption in (denoising) score matching theory, demonstrating that distributions which are differentiable almost everywhere permit the same objective simplification as Gaussians. For noise vector norm distributions, we demonstrate favourable concentration of measure in the high-dimensional spaces prevalent in deep learning. In the process, we uncover a skewed noise vector norm distribution and develop an iterative noise scaling algorithm to consistently initialise the multiple levels of noise in annealed Langevin dynamics (LD). On the practical side, our use of heavy-tailed DSM leads to improved score estimation, controllable sampling convergence, and more balanced unconditional generative performance for imbalanced datasets.


title: A central limit theorem for cycles of Mallows permutations

abstract: Fix $q\neq 1$, and sample $w\in S_n$ from the Mallows measure. We study the distribution of $C_i(w)$, the number of $i$-cycles, as $n$ grows large. When $q<1$, they are jointly Gaussian, and this more or less follows from known ideas, but the regime $q>1$ behaves quite differently. In particular, we show that the even cycles $C_{2i}(w)$ have a mean and variance of order $n$, and jointly converge to Gaussian random variables, while the odd cycles $C_{2i+1}(w)$ have a bounded mean and variance, and converge to $C_{2i+1}(w^{even})$ or $C_{2i+1}(w^{odd})$ for some explicit random permutations $w^{even}$ and $w^{odd}$, depending on whether $n$ is even or odd. An extension to a larger class of functions is also given. The proof utilizes a two-sided stationary regenerative process associated to Mallows permutations constructed by Gnedin and Olshanski, extending the ideas of Basu and Bhatnagar.


title: Precision identified-hadron spectrum analysis for 5 TeV $\bf p$-$\bf Pb$ collisions -- Part I

abstract: The $p$-Pb collision system occupies a unique position regarding physical interpretation of high-energy particle data. More-peripheral $p$-Pb is indistinguishable from $p$-$p$ collision while more-central $p$-Pb overlaps an interval of Pb-Pb centrality wherein it has been claimed that quark-gluon plasma (QGP) formation is achieved. One basis for such claims is certain features and centrality trends of identified-hadron (PID) $p_t$ spectra, including similarities between $p$-Pb and Pb-Pb spectra. In order to verify or falsify such claims it is essential that PID spectra for $p$-Pb collisions (as a control experiment) be understood in terms of fundamental QCD principles. This article (Part I of a two-part report) presents application of a two-component (soft + hard) model (TCM) to PID spectra from 5 TeV $p$-Pb collisions. Certain issues remaining from a preliminary PID TCM analysis (e.g. proton detection inefficiency) are resolved. Coefficients for TCM model functions previously assumed independent of $p$-Pb centrality are obtained directly from spectra. Jet-related spectrum hard components are precisely isolated and their shape evolution with centrality determined relative to a fixed TCM as reference. In Part II the TCM is further elaborated to describe varying spectrum hard components (and therefore entire spectra) within data statistical uncertainties. The completed PID TCM is then used to investigate properties of spectrum and yield ratios (e.g. $p/\pi$) and $\bar p_t$ data.


title: Query Adaptive Few-Shot Object Detection with Heterogeneous Graph Convolutional Networks

abstract: Few-shot object detection (FSOD) aims to detect never-seen objects using few examples. This field sees recent improvement owing to the meta-learning techniques by learning how to match between the query image and few-shot class examples, such that the learned model can generalize to few-shot novel classes. However, currently, most of the meta-learning-based methods perform pairwise matching between query image regions (usually proposals) and novel classes separately, therefore failing to take into account multiple relationships among them. In this paper, we propose a novel FSOD model using heterogeneous graph convolutional networks. Through efficient message passing among all the proposal and class nodes with three different types of edges, we could obtain context-aware proposal features and query-adaptive, multiclass-enhanced prototype representations for each class, which could help promote the pairwise matching and improve final FSOD accuracy. Extensive experimental results show that our proposed model, denoted as QA-FewDet, outperforms the current state-of-the-art approaches on the PASCAL VOC and MSCOCO FSOD benchmarks under different shots and evaluation metrics.


title: A data-centric weak supervised learning for highway traffic incident detection

abstract: Using the data from loop detector sensors for near-real-time detection of traffic incidents in highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models -- random forest, k-nearest neighbors, and a support vector machine ensemble -- and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Overall, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08).


title: Assessing m-Learning Adoption in Higher Education

abstract: New mobile platforms, connected seamlessly to the Internet via wireless access have become increasingly more powerful and have found usage in a diverse set of application areas, including the education sector. The educational institutions are becoming more open to embracing new learning platforms, which in turn has sparked the interest in developing new assessment frameworks. This paper has used the framework of the Capability Maturity Model (CMM) to design a model for M-learning within educational institutions. The framework has been validated with studies cases from higher education institutions.


title: Robust Distributed Bayesian Learning with Stragglers via Consensus Monte Carlo

abstract: This paper studies distributed Bayesian learning in a setting encompassing a central server and multiple workers by focusing on the problem of mitigating the impact of stragglers. The standard one-shot, or embarrassingly parallel, Bayesian learning protocol known as consensus Monte Carlo (CMC) is generalized by proposing two straggler-resilient solutions based on grouping and coding. Two main challenges in designing straggler-resilient algorithms for CMC are the need to estimate the statistics of the workers' outputs across multiple shots, and the joint non-linear post-processing of the outputs of the workers carried out at the server. This is in stark contrast to other distributed settings like gradient coding, which only require the per-shot sum of the workers' outputs. The proposed methods, referred to as Group-based CMC (G-CMC) and Coded CMC (C-CMC), leverage redundant computing at the workers in order to enable the estimation of global posterior samples at the server based on partial outputs from the workers. Simulation results show that C-CMC may outperform G-CMC for a small number of workers, while G-CMC is generally preferable for a larger number of workers.


title: Mixed-anion mixed-cation perovskite (FAPbI$_3$)$_{0.875}$(MAPbBr$_3$)$_{0.125}$: an ab-initio molecular dynamics study

abstract: Mixed-anion mixed-cation perovskites with (FAPbI$_3$)$_{1-x}$(MAPbBr$_3$)$_x$ composition have allowed record efficiencies in photovoltaic solar cells, but their atomic-scale behaviour is not well understood yet, in part because their theoretical modelling requires consideration of complex and interrelated dynamic and disordering effects. We present here an ab initio molecular dynamics investigation of the structural, thermodynamic, and electronic properties of the (FAPbI$_3$)$_{0.875}$(MAPbBr$_3$)$_{0.125}$ perovskite. A special quasi-random structure is proposed to mimic the disorder of both the molecular cations and the halide anions, in a stoichiometry that is close to that of one of today's most efficient perovskite solar cells. We show that the rotation of the organic cations is more strongly hindered in the mixed structure in comparison with the pure compounds. Our analysis suggests that this mixed perovskite is thermodynamically stable against phase separation despite the endothermic mixing enthalpy, due to the large configurational entropy. The electronic properties are investigated by hybrid density functional calculations including spin-orbit coupling in carefully selected representative configurations extracted from the molecular dynamics. Our model, that is validated here against experimental information, provides a more sophisticated understanding of the interplay between dynamic and disordering effects in this important family of photovoltaic materials.


title: AutoTransfer: Subject Transfer Learning with Censored Representations on Biosignals Data

abstract: We provide a regularization framework for subject transfer learning in which we seek to train an encoder and classifier to minimize classification loss, subject to a penalty measuring independence between the latent representation and the subject label. We introduce three notions of independence and corresponding penalty terms using mutual information or divergence as a proxy for independence. For each penalty term, we provide several concrete estimation algorithms, using analytic methods as well as neural critic functions. We provide a hands-off strategy for applying this diverse family of regularization algorithms to a new dataset, which we call "AutoTransfer". We evaluate the performance of these individual regularization strategies and our AutoTransfer method on EEG, EMG, and ECoG datasets, showing that these approaches can improve subject transfer learning for challenging real-world datasets.


title: Nested Bayesian Optimization for Computer Experiments

abstract: Computer experiments can emulate the physical systems, help computational investigations, and yield analytic solutions. They have been widely employed with many engineering applications (e.g., aerospace, automotive, energy systems. Conventional Bayesian optimization did not incorporate the nested structures in computer experiments. This paper proposes a novel nested Bayesian optimization for complex computer experiments with multi-step or hierarchical characteristics. We prove the theoretical properties of nested outputs given two cases: Gaussian or non-Gaussian. The closed forms of nested expected improvement are derived. We also propose the computational algorithms for nested Bayesian optimization. Three numerical studies show that the proposed nested Bayesian optimization outperforms the five benchmark Bayesian optimization methods ignoring the intermediate outputs of the inner computer code. The case study shows that the nested Bayesian optimization can efficiently minimize the residual stress during composite structures assembly and avoid convergence to the local optimum.


title: Macdonald Duality and the proof of the Quantum Q-system conjecture

abstract: The $SL(2,\mathbb Z)$-symmetry of Cherednik's spherical double affine Hecke algebras in Macdonald theory includes a distinguished generator which acts as a discrete time evolution of Macdonald operators, which can also be interpreted as a torus Dehn twist in type $A$. We prove for all twisted and untwisted affine algebras of type $ABCD$ that the time-evolved $q$-difference Macdonald operators, in the $t\to\infty$ $q$-Whittaker limit, form a representation of the associated discrete integrable quantum Q-systems, which are obtained, in all but one case, via the canonical quantization of suitable cluster algebras. The proof relies strongly on the duality property of Macdonald and Koornwinder polynomials, which allows, in the $q$-Whittaker limit, for a unified description of the quantum Q-system variables and the conserved quantities as limits of the time-evolved Macdonald operators and the Pieri operators, respectively. The latter are identified with relativistic $q$-difference Toda Hamiltonians. A crucial ingredient in the proof is the use of the "Fourier transformed" picture, in which we compute time-translation operators and prove that they commute with the Pieri operators or Hamiltonians. We also discuss the universal solutions of Koornwinder-Macdonald eigenvalue and Pieri equations, for which we prove a duality relation, which simplifies the proofs further.


title: Symmetric Functions and Rectangular Catalan Combinatorics

abstract: Symmetric functions provide one of the most efficient tools for combinatorial enumeration, in the context of objects that may be acted upon by permutations. Only assuming a basic knowledge of linear algebra, we introduce and describe the classical toolbox of symmetric functions, and give many examples of their uses. In particular, we present how classical formulas of enumerative combinatorics afford a natural generalization in terms of symmetric functions. We then rapidly present Macdonald symmetric functions and associated operators, to go on with the description of their relations to rectangular Catalan combinatorics. We also discuss the link with a realization of the elliptic Hall algebra, as an algebra of operators on symmetric functions.


title: Macdonald polynomials and operators and Catalan Combinatorics

abstract: Our main aim with these notes is to introduce the combinatorial and symmetric function tools that relate to the description of the Poincare polynomial of the triply graded Khovanov-Rozansky homology of torus links, a.k.a. the (reduced) superpolynomial of these links.


title: Fast and high-fidelity state preparation and measurement in triple-quantum-dot spin qubits

abstract: We demonstrate rapid, high-fidelity state preparation and measurement in exchange-only Si/SiGe triple-quantum-dot qubits. Fast measurement integration ($980$ ns) and initialization ($\approx 300$ ns) operations are performed with all-electrical, baseband control. We emphasize a leakage-sensitive joint initialization and measurement metric, developed in the context of exchange-only qubits but applicable more broadly, and report an infidelity of $2.5\pm0.5\times 10^{-3}$. This result is enabled by a high-valley-splitting heterostructure, initialization at the 2-to-3 electron charge boundary, and careful assessment and mitigation of $T_1$ during spin-to-charge conversion. The ultimate fidelity is limited by a number of comparably-important factors, and we identify clear paths towards further improved fidelity and speed. Along with an observed single-qubit randomized benchmarking error rate of $1.7\times 10^{-3}$, this work demonstrates initialization, control, and measurement of Si/SiGe triple-dot qubits at fidelities and durations which are promising for scalable quantum information processing.


title: Automated Domain Discovery from Multiple Sources to Improve Zero-Shot Generalization

abstract: Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the challenging problem of multi-source zero shot DG (MDG), where labeled training data from multiple source domains is available but with no access to data from the target domain. A wide range of solutions have been proposed for this problem, including the state-of-the-art multi-domain ensembling approaches. Despite these advances, the na\"ive ERM solution of pooling all source data together and training a single classifier is surprisingly effective on standard benchmarks. In this paper, we hypothesize that, it is important to elucidate the link between pre-specified domain labels and MDG performance, in order to explain this behavior. More specifically, we consider two popular classes of MDG algorithms -- distributional robust optimization (DRO) and multi-domain ensembles, in order to demonstrate how inferring custom domain groups can lead to consistent improvements over the original domain labels that come with the dataset. To this end, we propose (i) Group-DRO++, which incorporates an explicit clustering step to identify custom domains in an existing DRO technique; and (ii) DReaME, which produces effective multi-domain ensembles through implicit domain re-labeling with a novel meta-optimization algorithm. Using empirical studies on multiple standard benchmarks, we show that our variants consistently outperform ERM by significant margins (1.5% - 9%), and produce state-of-the-art MDG performance. Our code can be found at https://github.com/kowshikthopalli/DREAME


title: Optimization Study of Hydraulic Power Take-off System for an Ocean Wave Energy Converter

abstract: Ocean wave renewable energy is fast becoming a key part of renewable energy industries over the recent decades. By developing wave energy converters as the main converter technology in this process, their power take-off (PTO) systems have been investigated. Adjusting PTO parameters is a challenging optimization problem because there is a complex and nonlinear relationship between these parameters and the absorbed power output. In this regard, this study aims to optimize the PTO system parameters of a point absorber wave energy converter in the wave scenario in Perth, on Western Australian coasts. The converter is numerically designed to oscillate against irregular and multi-dimensional waves and sensitivity analysis for PTO settings is performed. Then, to find the optimal PTO system parameters which lead to the highest power output, ten optimization algorithms are incorporated to solve the non-linear problem, Including Nelder-Mead search method, Active-set method, Sequential quadratic Programming method (SQP), Multi-Verse Optimizer (MVO), and six modified combination of Genetic, Surrogate and fminsearch algorithms. After a feasibility landscape analysis, the optimization outcome is carried out and gives us the best answer in terms of PTO system settings. Finally, the investigation shows that the modified combinations of Genetic, Surrogate, and fminsearch algorithms can outperform the others in the studied wave scenario, as well as the interaction between PTO system variables.


title: $K \pi$ scattering at physical pion mass using distillation

abstract: Scattering at physical pion mass is still an exploratory field in lattice QCD. This generally involves the extraction of excited states through multi-particle correlators on systems with resonances. In that context, distillation has been demonstrated to be effective both as a smearing kernel and a computational tool. Motivated by the study of the smearing profile of the distillation operator, we compare stochastic and exact distillation cases for different numbers of Laplacian eigenvectors using an RBC-UKQCD $N_f=2+1$ domain-wall fermion lattice with a physical pion mass.


title: $m$th roots of the identity operator and the geometry conjecture

abstract: In this paper, we give three different new proofs of the validity of the geometry conjecture about cycles of projections onto nonempty closed, convex subsets of a Hilbert space. The first uses a simple minimax theorem, which depends on the finite dimensional Hahn-Banach theorem. The second uses Fan's inequality, which has found many applications in optimization and mathematical economics. The third uses three results on maximally monotone operators on a Hilbert space.


title: Untangling the brain web: from the early days of complex functional networks to the non-linear dynamical directed functional connectivity measures

abstract: Already two decades passed since the first applications of graph theory to brain neuroimaging. Since that early description, the characterization of the brain as a very large interacting complex network has evolved in several directions. In this brief review we discuss our contributions to this topic and discuss some perspective for future work.


title: Dollar Cost Averaging Returns Estimation

abstract: Given a geometric Brownian motion wealth process, a log-Normal lower bound is constructed for the returns of a regular investing schedule. The distribution parameters of this bound are computed recursively. For dollar cost averaging (equal amounts in equal time intervals), parameters are computed in closed form. A lump sum (single amount at time 0) investing schedule is described which achieves a terminal wealth distribution that matches the wealth distribution indicated by the lower bound. Results are applied to annual returns of the S&P Composite Index from the last 150 years. Among data analysis results, the probability of negative returns is less than 2.5% when annual dollar cost averaging lasts over 40 years.


title: Direct simple computation of middle surface between 3D point clouds and/or discrete surfaces by tracking sources in distance function calculation algorithms

abstract: In this paper, we introduce novel methods for computing middle surfaces between various 3D data sets such as point clouds and/or discrete surfaces. Traditionally the middle surface is obtained by detecting singularities in computed distance function such as ridges, triple junctions, etc. It requires to compute second order differential characteristics and also some kinds of heuristics must be applied. Opposite to that, we determine the middle surface just from computing the distance function itself which is a fast and simple approach. We present and compare the results of the fast sweeping method, the vector distance transform algorithm, the fast marching method, and the Dijkstra-Pythagoras method in finding the middle surface between 3D data sets.


title: A Streaming Volumetric Image Generation Framework for Development and Evaluation of Out-of-Core Methods

abstract: Advances in 3D imaging technology in recent years have allowed for increasingly high resolution volumetric images of large specimen. The resulting datasets of hundreds of Gigabytes in size call for new scalable and memory efficient approaches in the field of image processing, where some progress has been made already. At the same time, quantitative evaluation of these new methods is difficult both in terms of the availability of specific data sizes and in the generation of associated ground truth data. In this paper we present an algorithmic framework that can be used to efficiently generate test (and ground truth) volume data, optionally even in a streaming fashion. As the proposed nested sweeps algorithm is fast, it can be used to generate test data on demand. We analyze the asymptotic run time of the presented algorithm and compare it experimentally to alternative approaches as well as a hypothetical best-case baseline method. In a case study, the framework is applied to the popular VascuSynth software for vascular image generation, making it capable of efficiently producing larger-than-main memory volumes which is demonstrated by generating a trillion voxel (1TB) image. Implementations of the presented framework are available online in the form of the modified version of Vascusynth and the code used for the experimental evaluation. In addition, the test data generation procedure has been integrated into the popular volume rendering and processing framework Voreen.


title: Meta Propagation Networks for Graph Few-shot Semi-supervised Learning

abstract: Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors predominately focus on the conventional semi-supervised setting where relatively abundant gold-labeled nodes are provided. While it is often impractical due to the fact that data labeling is unbearably laborious and requires intensive domain knowledge, especially when considering the heterogeneity of graph-structured data. Under the few-shot semi-supervised setting, the performance of most of the existing GNNs is inevitably undermined by the overfitting and oversmoothing issues, largely owing to the shortage of labeled data. In this paper, we propose a decoupled network architecture equipped with a novel meta-learning algorithm to solve this problem. In essence, our framework Meta-PN infers high-quality pseudo labels on unlabeled nodes via a meta-learned label propagation strategy, which effectively augments the scarce labeled data while enabling large receptive fields during training. Extensive experiments demonstrate that our approach offers easy and substantial performance gains compared to existing techniques on various benchmark datasets.


title: Playing Against Fair Adversaries in Stochastic Games with Total Rewards

abstract: We investigate zero-sum turn-based two-player stochastic games in which the objective of one player is to maximize the amount of rewards obtained during a play, while the other aims at minimizing it. We focus on games in which the minimizer plays in a fair way. We believe that these kinds of games enjoy interesting applications in software verification, where the maximizer plays the role of a system intending to maximize the number of "milestones" achieved, and the minimizer represents the behavior of some uncooperative but yet fair environment. Normally, to study total reward properties, games are requested to be stopping (i.e., they reach a terminal state with probability 1). We relax the property to request that the game is stopping only under a fair minimizing player. We prove that these games are determined, i.e., each state of the game has a value defined. Furthermore, we show that both players have memoryless and deterministic optimal strategies, and the game value can be computed by approximating the greatest-fixed point of a set of functional equations. We implemented our approach in a prototype tool, and evaluated it on an illustrating example and an Unmanned Aerial Vehicle case study.


title: Evacuation schemes on Cayley graphs and non-amenability of groups

abstract: In this paper we introduce a concept of an evacuation scheme on the Cayley graph of an infinite finitely generated group. This is a collection of infinite simple paths bringing all vertices to infinity. We impose a restriction that every edge can be used a uniformly bounded number of times in this scheme. An easy observation shows that existing of such a scheme is equivalent to non-amenability of the group. A special case happens if every edge can be used only once. These scheme are called pure. We obtain a criterion for existing of such a scheme in terms of isoperimetric constant of the graph. We analyze R.\,Thompson's group $F$, for which the amenability property is a famous open problem. We show that pure evacuation schemes do not exist for the set of generators $\{x_0,x_1,\bar{x}_1\}$, where $\bar{x}_1=x_1x_0^{-1}$. However, the question becomes open if edges with labels $x_0^{\pm1}$ can be used twice. Existing of pure evacuation scheme for this version is implied by some natural conjectures.


title: A Bayesian hierarchical small-area population model accounting for data source specific methodologies from American Community Survey, Population Estimates Program, and Decennial Census data

abstract: Small area estimates of population are necessary for many epidemiological studies, yet their quality and accuracy are often not assessed. In the United States, small area estimates of population counts are published by the United States Census Bureau (USCB) in the form of the Decennial census counts, Intercensal population projections (PEP), and American Community Survey (ACS) estimates. Although there are significant relationships between these data sources, there are important contrasts in data collection and processing methodologies, such that each set of estimates may be subject to different sources and magnitudes of error. Additionally, these data sources do not report identical small area population counts due to post-survey adjustments specific to each data source. Resulting small area disease/mortality rates may differ depending on which data source is used for population counts (denominator data). To accurately capture annual small area population counts, and associated uncertainties, we present a Bayesian population model (B-Pop), which fuses information from all three USCB sources, accounting for data source specific methodologies and associated errors. The main features of our framework are: 1) a single model integrating multiple data sources, 2) accounting for data source specific data generating mechanisms, and specifically accounting for data source specific errors, and 3) prediction of estimates for years without USCB reported data. We focus our study on the 159 counties of Georgia, and produce estimates for years 2005-2021.


title: Axion-like Particle Searches at DarkQuest

abstract: Axion-like particles (ALPs) interacting with the Standard Model can be abundantly produced in proton beam fixed-target experiments. Looking for their displaced decays is therefore an effective search strategy for ALPs with a mass in the MeV to GeV range. Focusing on the benchmark models where the ALP interacts dominantly with photons or gluons, we show that the proposed DarkQuest experiment at Fermilab will be able to test parameter space which has been previously inaccessible. We pay particular attention to the self-consistency of gluon-coupled ALP production and decay calculations, which has been recently shown to be a problem in many existing predictions. We also apply these results to explore existing constraints in the ALP parameter space.


title: Gradient-based Novelty Detection Boosted by Self-supervised Binary Classification

abstract: Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data: (1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data. (2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.


title: Potential utilization of Battery Energy Storage Systems (BESS) in the major European electricity markets

abstract: Given the declining cost of battery technology in the last decade, nowadays BESS becomes a more attractive solution in electrical power systems. The objective of this work is to analyze the potential utilization of BESS in the major European electricity markets. A general payoff model for BESS operation is proposed to correctly address the operational flexibility of battery systems. Utilization factors such as potentially profitable utilization time and rate are calculated for common applications including energy arbitrage and frequency support services using real market information. The result shows that under the current empirical estimation of the battery cost and lifetime, BESS is not feasible for energy arbitrage in most of the European electricity markets. However, BESS shows clearly and significantly higher potential in providing frequency support services. The result suggests that, when the frequency containment reserve is remunerable, the potentially profitable utilization of BESS has become already accretive in most of the European countries. For example from January to September 2021, the potentially profitable utilization rate has reached almost 100% for the FCR-N service in the Danish market. Comparing the regional electricity markets in Europe, BESS has shown significant potential in becoming a feasible solution in Central Western Europe and parts of Northern Europe by providing frequency regulation services. Meanwhile, in the British Isles and some other islanded local markets, a remarkable level of scarcity of flexibility has been revealed by the investigation, and the potential of BESS would also be considerably encouraging.


title: Handing off the outcome of binary neutron star mergers for accurate and long-term post-merger simulations

abstract: We perform binary neutron star (BNS) merger simulations in full dynamical general relativity with IllinoisGRMHD, on a Cartesian grid with adaptive-mesh refinement. After the remnant black hole has become nearly stationary, the evolution of the surrounding accretion disk on Cartesian grids over long timescales (1s) is suboptimal, as Cartesian coordinates over-resolve the angular coordinates at large distances, and the accreting plasma flows obliquely across coordinate lines dissipating angular momentum artificially from the disk. To address this, we present the Handoff, a set of computational tools that enables the transfer of general relativistic magnetohydrodynamic (GRMHD) and spacetime data from IllinoisGRMHD to HARM3D, a GRMHD code that specializes in modeling black hole accretion disks in static spacetimes over long timescales, making use of general coordinate systems with spherical topology. We demonstrate that the Handoff allows for a smooth and reliable transition of GRMHD fields and spacetime data, enabling us to efficiently and reliably evolve BNS dynamics well beyond merger. We also discuss future plans, which involve incorporating advanced equations of state and neutrino physics into BNS simulations using the \handoff approach.


title: Lattice equations and their solutions with complexity of polynomial class

abstract: We discuss initial value problems for time evolution equations in one dimensional space which are expressed by the lattice operators and propose some new equations to which complexity of solutions is of polynomial class. Novel type of expressions using shift operators and binary trees are applied for the derivation of solution.


title: Ramanujan and Koshliakov Meet Abel and Plana

abstract: The neglected Russian mathematician, N.~S.~Koshliakov, derived beautiful generalizations of the classical Abel--Plana summation formula through a setting arising from a boundary value problem in heat conduction. When we let the parameter $p$ in this setting tend to infinity, his formulas reduce to the classical Abel--Plana summation formula. Rigorous formulations and proofs of these summation formulas are given. In his notebooks, Ramanujan derived different analogues of the Abel--Plana summation formula. One particular example provides a vast new generalization of the classical transformation formula for Eisenstein series, which we generalize in Koshliakov's setting.


title: GPEX, A Framework For Interpreting Artificial Neural Networks

abstract: The analogy between Gaussian processes (GPs) and deep artificial neural networks (ANNs) has received a lot of interest, and has shown promise to unbox the blackbox of deep ANNs. Existing theoretical works put strict assumptions on the ANN (e.g. requiring all intermediate layers to be wide, or using specific activation functions). Accommodating those theoretical assumptions is hard in recent deep architectures, and those theoretical conditions need refinement as new deep architectures emerge. In this paper we derive an evidence lower-bound that encourages the GP's posterior to match the ANN's output without any requirement on the ANN. Using our method we find out that on 5 datasets, only a subset of those theoretical assumptions are sufficient. Indeed, in our experiments we used a normal ResNet-18 or feed-forward backbone with a single wide layer in the end. One limitation of training GPs is the lack of scalability with respect to the number of inducing points. We use novel computational techniques that allow us to train GPs with hundreds of thousands of inducing points and with GPU acceleration. As shown in our experiments, doing so has been essential to get a close match between the GPs and the ANNs on 5 datasets. We implement our method as a publicly available tool called GPEX: https://github.com/amirakbarnejad/gpex. On 5 datasets (4 image datasets, and 1 biological dataset) and ANNs with 2 types of functionality (classifier or attention-mechanism) we were able to find GPs whose outputs closely match those of the corresponding ANNs. After matching the GPs to the ANNs, we used the GPs' kernel functions to explain the ANNs' decisions. We provide more than 200 explanations (around 30 explanations in the paper and the rest in the supplementary) which are highly interpretable by humans and show the ability of the obtained GPs to unbox the ANNs' decisions.


title: Fermi acceleration in rotating drums

abstract: Consider hard balls in a bounded rotating drum. If there is no gravitation then there is no Fermi acceleration, i.e., the energy of the balls remains bounded forever. If there is gravitation, Fermi acceleration may arise. A number of explicit formulas for the system without gravitation are given. Some of these are based on an explicit realization, which we derive, of the well-known microcanonical ensemble measure.


title: Multimeasurement Generative Models

abstract: We formally map the problem of sampling from an unknown distribution with a density in $\mathbb{R}^d$ to the problem of learning and sampling a smoother density in $\mathbb{R}^{Md}$ obtained by convolution with a fixed factorial kernel: the new density is referred to as M-density and the kernel as multimeasurement noise model (MNM). The M-density in $\mathbb{R}^{Md}$ is smoother than the original density in $\mathbb{R}^d$, easier to learn and sample from, yet for large $M$ the two problems are mathematically equivalent since clean data can be estimated exactly given a multimeasurement noisy observation using the Bayes estimator. To formulate the problem, we derive the Bayes estimator for Poisson and Gaussian MNMs in closed form in terms of the unnormalized M-density. This leads to a simple least-squares objective for learning parametric energy and score functions. We present various parametrization schemes of interest including one in which studying Gaussian M-densities directly leads to multidenoising autoencoders--this is the first theoretical connection made between denoising autoencoders and empirical Bayes in the literature. Samples in $\mathbb{R}^d$ are obtained by walk-jump sampling (Saremi & Hyvarinen, 2019) via underdamped Langevin MCMC (walk) to sample from M-density and the multimeasurement Bayes estimation (jump). We study permutation invariant Gaussian M-densities on MNIST, CIFAR-10, and FFHQ-256 datasets, and demonstrate the effectiveness of this framework for realizing fast-mixing stable Markov chains in high dimensions.


title: Variational multiscale modeling with discretely divergence-free subscales: Non-divergence-conforming discretizations

abstract: A recent paper [J. A. Evans, D. Kamensky, Y. Bazilevs, "Variational multiscale modeling with discretely divergence-free subscales", Computers & Mathematics with Applications, 80 (2020) 2517-2537] introduced a novel stabilized finite element method for the incompressible Navier-Stokes equations, which combined residual-based stabilization of advection, energetic stability, and satisfaction of a discrete incompressibility condition. However, the convergence analysis and numerical tests of the cited work were subject to the restrictive assumption of a divergence-conforming choice of velocity and pressure spaces, where the pressure space must contain the divergence of every velocity function. The present work extends the convergence analysis to arbitrary inf-sup-stable velocity-pressure pairs (while maintaining robustness in the advection-dominated regime) and demonstrates the convergence of the method numerically, using both the traditional and isogeometric Taylor-Hood elements.