title: How Expressive are Transformers in Spectral Domain for Graphs?

abstract: The recent works proposing transformer-based models for graphs have proven the inadequacy of Vanilla Transformer for graph representation learning. To understand this inadequacy, there is a need to investigate if spectral analysis of the transformer will reveal insights into its expressive power. Similar studies already established that spectral analysis of Graph neural networks (GNNs) provides extra perspectives on their expressiveness. In this work, we systematically study and establish the link between the spatial and spectral domain in the realm of the transformer. We further provide a theoretical analysis and prove that the spatial attention mechanism in the transformer cannot effectively capture the desired frequency response, thus, inherently limiting its expressiveness in spectral space. Therefore, we propose FeTA, a framework that aims to perform attention over the entire graph spectrum (i.e., actual frequency components of the graphs) analogous to the attention in spatial space. Empirical results suggest that FeTA provides homogeneous performance gain against vanilla transformer across all tasks on standard benchmarks and can easily be extended to GNN-based models with low-pass characteristics (e.g., GAT).


title: MUSE spectroscopy of the ULX NGC 1313 X-1: a shock-ionised bubble, an X-ray photoionised nebula, and two supernova remnants

abstract: The presence of large ionised gaseous nebulae found around some ultraluminous X-ray sources (ULXs) provides the means to assess the mechanical and radiative feedback of the central source, and hence constrain the efficiency and impact on the surroundings of the super-Eddington regime powering most of these sources. NGC 1313 X--1 is an archetypal ULX which has been reported to be surrounded by abnormally high [O I]$\lambda$6300/H$\alpha >$ 0.1 ratios and for which high-resolution spectroscopy in X-rays has hinted the presence of powerful outflows. We report observations taken with the Multi-Unit Spectroscopic Explorer of NGC 1313 X--1 in order to confirm the presence of a nebula inflated by the winds, investigate its main sources of ionisation and estimate the mechanical output of the source. We detect a bubble of 452 $\times$ 266\,pc in size, roughly centred around the ULX, which shows clear evidence for shock ionisation in the outer edges. We estimate shock velocities to be in the $\approx160-180$\,km/s range based on the line ratios. This suggests that an average and continuous outflow power of $\sim(2-4.5) \times 10^{40}$ erg/s over a timescale of $(4.5-7.8) \times10^5$\,yr is required to inflate the bubble. In the interior of the bubble and closer to the ULX we detect an extended ($\sim$140\,pc) X-ray ionised region. Additionally, we detect two supernova remnants coincidentally close to the bubble of which we also report age and explosion energy estimates. The elongated morphology and the kinematics of the bubble strongly suggest that the bubble is being inflated by winds and/or jets emanating from the central source, supporting the presence of winds found through X-ray spectroscopy. The estimated mechanical power is comparable or higher than the X-ray luminosity of the source, providing additional evidence in support of NGC 1313 X--1 harbouring a super-Eddington accretor.


title: Transdimensional 2D Full-Waveform Inversion and Uncertainty Estimation

abstract: Full-Waveform Inversion (FWI) has now become a widely accepted tool to obtain high-resolution velocity models from seismic data. Typically, the velocity model in its discrete form is represented on a rectangular grid, and we solve for the elastic properties at these grid points. FWI is mostly solved employing a local optimization method, where one obtains a velocity update by minimizing the misfit between the observed and the calculated seismograms. Note also that FWI is a highly non-linear problem which is known to be prone to non-uniqueness. The convergence to a globally optimum solution is not guaranteed; it depends on the choice of the starting model. Thus, a Bayesian formulation of the inverse problem with subsequent sampling of the posterior distribution is a preferred choice, since it enables uncertainty quantification. However, with the increase in the dimension of a model, sampling search space becomes computationally expensive. We employ a recently developed trans-dimensional sampling method called Reversible Jump Hamiltonian Monte Carlo (RJHMC), to the 2D full waveform inversion problem. We represent our velocity model using Voronoi cells, determined from the distribution of certain nuclei points in the model space. This method offers two advantages. First, it solves for a variable dimensional velocity updates by using a trans-dimensional reversible jump Markov Chain Monte Carlo (RJMCMC) step and thus tries to achieve an optimum number of nuclei to represent the model and minimize the misfit. A smaller number of parameters helps in an efficient sampling of the model search space. Second, it applies the gradient-based Hamiltonian Monte Carlo (HMC) step, which further improves the sampling by allowing the algorithm to take a large step guided by the gradient. This two-step algorithm proves to be a useful tool for model exploration and uncertainty quantification in FWI.


title: On the throughput of the common target area for robotic swarm strategies -- extended version

abstract: A robotic swarm may encounter traffic congestion when many robots simultaneously attempt to reach the same area. For solving that efficiently, robots must execute decentralised traffic control algorithms. In this work, we propose a measure for evaluating the access efficiency of a common target area as the number of robots in the swarm rises: the common target area throughput. We also employ here the target area asymptotic throughput -- that is, the throughput of a target region with a limited area as the time tends to infinity -- because it is always finite as the number of robots grows, opposed to the relation arrival time at the target per number of robots that tends to infinity. Using this measure, we can analytically compare the effectiveness of different algorithms. In particular, we propose and formally evaluate three different theoretical strategies for getting to a circular target area: (i) forming parallel queues towards the target area, (ii) forming a hexagonal packing through a corridor going to the target, and (iii) making multiple curved trajectories towards the boundary of the target area. We calculate the throughput for a fixed time and the asymptotic throughput for these strategies. Additionally, we corroborate these results by simulations, showing that when a strategy has higher throughput, its arrival time per number of robots is lower. Thus, we conclude that using throughput is well suited for comparing congestion algorithms for a common target area in robotic swarms even if we do not have their closed asymptotic equation.


title: Three-dimensional dynamics of a pair of deformable bubbles rising initially in line. Part 2: Highly inertial regimes

abstract: The buoyancy-driven dynamics of a pair of gas bubbles released in line is investigated numerically, focusing on highly inertial conditions under which isolated bubbles follow non-straight paths. In an early stage, the second bubble always drifts out of the wake of the leading one. Then, depending on the ratios of the buoyancy, viscous and capillary forces which define the Galilei ($Ga$) and Bond ($Bo$) numbers of the system, five distinct regimes specific to such conditions are identified, in which the two bubbles may rise independently or continue to interact and possibly collide in the end. In the former case, they usually perform large-amplitude planar zigzags within the same plane or within two distinct planes, depending on the oblateness of the leading bubble. However, for large enough $Ga$ and low enough $Bo$, they follow nearly vertical paths with small-amplitude erratic horizontal deviations. Increasing $Bo$ makes the wake-induced attraction toward the leading bubble stronger, forcing the two bubbles to realign vertically one or more times along their ascent. During such sequences, wake vortices may hit the trailing bubble, deflecting its path and, depending on the case, promoting or hindering further possibilities of interaction. In some regimes, varying the initial distance separating the two bubbles modifies their lateral separation beyond the initial stage. Similarly, minute initial angular deviations favour the selection of a single vertical plane of rise common to both bubbles. These changes may dramatically affect the fate of the tandem as, depending on $Bo$, they promote or prevent future vertical realignments.


title: Congestion control algorithms for robotic swarms with a common target based on the throughput of the target area

abstract: When a large number of robots try to reach a common area, congestions happen, causing severe delays. To minimise congestion in a robotic swarm system, traffic control algorithms must be employed in a decentralised manner. Based on strategies aimed to maximise the throughput of the common target area, we developed two novel algorithms for robots using artificial potential fields for obstacle avoidance and navigation. One algorithm is inspired by creating a queue to get to the target area (Single Queue Former -- SQF), while the other makes the robots touch the boundary of the circular area by using vector fields (Touch and Run Vector Fields -- TRVF). We performed simulation experiments to show that the proposed algorithms are bounded by the throughput of their inspired theoretical strategies and compare the two novel algorithms with state-of-art algorithms for the same problem (PCC, EE and PCC-EE). The SQF algorithm significantly outperforms all other algorithms for a large number of robots or when the circular target region radius is small. TRVF, on the other hand, is better than SQF only for a limited number of robots and outperforms only PCC for numerous robots. However, it allows us to analyse the potential impacts on the throughput when transferring an idea from a theoretical strategy to a concrete algorithm that considers changing linear speeds and distances between robots.


title: Building a Privacy-Preserving Smart Camera System

abstract: Millions of consumers depend on smart camera systems to remotely monitor their homes and businesses. However, the architecture and design of popular commercial systems require users to relinquish control of their data to untrusted third parties, such as service providers (e.g., the cloud). Third parties therefore can (and in some instances have) access the video footage without the users' knowledge or consent -- violating the core tenet of user privacy. In this paper, we present CaCTUs, a privacy-preserving smart Camera system Controlled Totally by Users. CaCTUs returns control to the user; the root of trust begins with the user and is maintained through a series of cryptographic protocols, designed to support popular features, such as sharing, deleting, and viewing videos live. We show that the system can support live streaming with a latency of 2s at a frame rate of 10fps and a resolution of 480p. In so doing, we demonstrate that it is feasible to implement a performant smart-camera system that leverages the convenience of a cloud-based model while retaining the ability to control access to (private) data.


title: Effects of electronic correlation on the high harmonic generation in helium: a time-dependent configuration interaction singles vs time-dependent full configuration interaction study

abstract: In this paper, we investigate the effects of full electronic correlation on the high harmonic generation in the helium atom subjected to laser pulses of extremely high intensity. To do this, we perform real-time propagations of the helium atom wavefunction using quantum chemistry methods coupled to Gaussian basis sets. The calculations are done within the real-time time-dependent configuration interaction framework, at two levels of theory: time-dependent configuration interation with single excitations (TD-CIS, uncorrelated method) and time-dependent full configuration interaction (TD-FCI, fully correlated method), and analyse obtained HHG spectra. The electronic wavefunction is expanded in Dunning basis sets supplemented with functions adapted to describing highly excited continuum states. We also compare the TD-CI results with grid-based propagations of the helium atom within the single-active-electron approximation. Our results show when including the dynamical electron correlation, a noticeable improvement to the description of HHG can be achieved, in terms of e.g. a more constant intensity in the lower energy part of the harmonic plateau. However, such effects can be captured only if the basis set used suffices to reproduce the most basic features, such as the HHG cutoff position, at the uncorrelated level of theory.


title: Bounding generalized coloring numbers of planar graphs using coin models

abstract: We study Koebe orderings of planar graphs: vertex orderings obtained by modelling the graph as the intersection graph of pairwise internally-disjoint discs in the plane, and ordering the vertices by non-increasing radii of the associated discs. We prove that for every $d\in \mathbb{N}$, any such ordering has $d$-admissibility bounded by $O(d/\ln d)$ and weak $d$-coloring number bounded by $O(d^4 \ln d)$. This in particular shows that the $d$-admissibility of planar graphs is bounded by $O(d/\ln d)$, which asymptotically matches a known lower bound due to Dvo\v{r}\'ak and Siebertz.


title: Scaling and Statistics of Bottom-Up Synthesized Armchair Graphene Nanoribbon Transistors

abstract: Bottom-up assembled nanomaterials and nanostructures allow for the studies of rich and unprecedented quantum-related and mesoscopic transport phenomena. However, it can be difficult to quantify the correlations between the geometrical or structural parameters obtained from advanced microscopy and measured electrical characteristics when they are made into macroscopic devices. Here, we propose a strategy to connect the nanomaterial morphologies and the device performance through a Monte Carlo device model and apply it to understand the scaling trends of bottom-up synthesized armchair graphene nanoribbon (GNR) transistors. A new nanofabrication process is developed for GNR transistors with channel length down to 7 nm. The impacts of the GNR spatial distributions and the device geometries on the device performance are investigated systematically through comparison of experimental data with the model. Through this study, challenges and opportunities of transistor technologies based on bottom-up synthesized GNRs are pinpointed, paving the way to the further improvement of the GNR device performance for future transistor technology nodes.


title: Induced vacuum current and magnetic flux in quantum scalar matter in the background of a vortex defect with the Neumann boundary condition

abstract: A topological defect in the form of the Abrikosov-Nielsen-Olesen vortex in a space of arbitrary dimension is considered as a gauge-flux-carrying tube that is impenetrable for quantum matter. Charged scalar matter field is quantized in the vortex background with the perfectly rigid (Neumann) boundary condition imposed at the side surface of the vortex. We show that a current circulating around the vortex is induced in the vacuum, if the Compton wavelength of the matter field exceeds the transverse size of the vortex considerably. The vacuum current is periodic in the value of the gauge flux of the vortex, providing a quantum-field-theoretical manifestation of the Aharonov-Bohm effect. The vacuum current leads to the appearance of an induced vacuum magnetic flux that for some values of the tube thickness exceeds the vacuum magnetic flux induced by a singular vortex filament. The results were compared to the results obtained earlier in the case of the perfectly reflecting (Dirichlet) boundary condition imposed at the side surface of the vortex. It is shown that the absolute value of the induced vacuum current and the induced vacuum magnetic flux in the case of the Neumann boundary condition is greater than in the case of the Dirichlet boundary condition.


title: Sharp Interface Limit for a Navier-Stokes/Allen-Cahn System with Different Viscosities

abstract: We discuss the sharp interface limit of a coupled Navier-Stokes/Allen-Cahn system in a two dimensional, bounded and smooth domain, when a parameter $\varepsilon>0$ that is proportional to the thickness of the diffuse interface tends to zero rigorously. We prove convergence of the solutions of the Navier-Stokes/Allen-Cahn system to solutions of a sharp interface model, where the interface evolution is given by the mean curvature flow with an additional convection term coupled to a two-phase Navier-Stokes system with surface tension. This is done by constructing an approximate solution from the limiting system via matched asymptotic expansions together with a novel Ansatz for the highest order term, and then estimating its difference with the real solution with the aid of a refined spectral estimate of the linearized Allen-Cahn operator near the approximate solution.


title: Quantum-phase two-dimensional materials

abstract: The modification of electronic band structures and the subsequent tuning of electrical, optical, and thermal material properties is a central theme in the engineering and fundamental understanding of solid-state systems. In this scenario, atomically thin materials offer an appealing platform because they are extremely susceptible to electric and magnetic gating, as well as to interlayer hybridization in stacked configurations, providing the means to customize and actively modulate their response functions. Here, we introduce a radically different approach to material engineering relying on the self-interaction that electrons in a two-dimensional material experience when an electrically neutral structure is placed in its vicinity. Employing rigorous theoretical methods, we show that electrons in a semiconductor atomic monolayer acquire a quantum phase resulting from the image potential induced by the presence of a neighboring periodic array of conducting ribbons, which in turn produces strong modifications in the optical, electrical, and thermal properties of the monolayer, specifically giving rise to the emergence of interband optical absorption, plasmon hybridization, and metal-insulator transitions. Beyond its fundamental interest, material engineering based on the quantum phase induced by noncontact neighboring structures represents a disruptive approach to tailor the properties of atomic layers for application in nanodevices.


title: Machine Learning Symmetry

abstract: We review recent work in machine learning aspects of conformal field theory and Lie algebra representation theory using neural networks.


title: Time-varying first-order autoregressive processes with irregular innovations

abstract: We consider a time-varying first-order autoregressive model with irregular innovations, where we assume that the coefficient function is H\"{o}lder continuous. To estimate this function, we use a quasi-maximum likelihood based approach. A precise control of this method demands a delicate analysis of extremes of certain weakly dependent processes, our main result being a concentration inequality for such quantities. Based on our analysis, upper and matching minimax lower bounds are derived, showing the optimality of our estimators. Unlike the regular case, the information theoretic complexity depends both on the smoothness and an additional shape parameter, characterizing the irregularity of the underlying distribution. The results and ideas for the proofs are very different from classical and more recent methods in connection with statistics and inference for locally stationary processes.


title: Metasurface-dressed two-dimensional on-chip waveguide for free-space light field manipulation

abstract: We show that a metasurface-coated two-dimensional (2D) slab waveguide enables the generation of arbitrary complex light fields by combining the extreme versatility and freedom on wavefront control of optical metasurfaces with the compactness of photonic integrated circuits. We demonstrated off-chip 2D focusing and holographic projection with our metasurface-dressed photonic integrated devices. This technology holds the potential for many other optical applications requiring 2D light field manipulation with full on-chip integration, such as solid-state LiDAR and near-eye AR/VR displays.


title: H$_2$O and CO$_2$ Surface Contamination of the Lithium-Stuffed Garnet

abstract: Understanding the reactivity of ubiquitous molecules on complex oxides has broad impacts in energy applications and catalysis. The garnet-type Li$_7$La$_3$Zr$_2$O$_{12}$ is a promising solid-state electrolyte for lithium(Li)-ion batteries, and it readily reacts with H$_2$O and CO$_2$ when exposed to ambient air. Such reactions form a contamination layer on Li$_7$La$_3$Zr$_2$O$_{12}$ that is detrimental to the battery operations. The strong interactions of Li$_7$La$_3$Zr$_2$O$_{12}$ with H$_2$O and CO$_2$, however, make Li$_7$La$_3$Zr$_2$O$_{12}$ a promising support to catalyze H$_2$O dissociation and CO$_2$ adsorption. Here, using first-principles calculations, we investigate the adsorption and reactions of H$_2$O and CO$_2$ on a Li$_7$La$_3$Zr$_2$O$_{12}$ surface. We show that H$_2$O reacts through the exchange of proton and Li$^{+}$ and produces metal hydroxide species. At high H$_2$O coverage, half of the H$_2$O molecules dissociate while the other half remain intact. CO$_2$ reacts with the Li$_7$La$_3$Zr$_2$O$_{12}$ surface directly to produce carbonate species. We clarify that the individual reactions of H$_2$O and CO$_2$ with Li$_7$La$_3$Zr$_2$O$_{12}$ are more thermodynamically favorable than the co-adsorption of H$_2$O and CO$_2$. Finally, we demonstrate that low temperature and high partial pressure promote the reactions of H$_2$O and CO$_2$ with Li$_7$La$_3$Zr$_2$O$_{12}$. For energy storage application of Li$_7$La$_3$Zr$_2$O$_{12}$, our study guides processing conditions to minimize surface contamination. From a catalysis point of view, our findings reveal the potential of using complex oxides, such as Li$_7$La$_3$Zr$_2$O$_{12}$ as a support for reactions requiring H$_2$O dissociation and strong CO$_2$ adsorption.


title: Large Impacts onto the Early Earth: Planetary Sterilization and Iron Delivery

abstract: Late accretion onto the Hadean Earth included large impacts that could have influenced early habitability, either by sterilizing the planet or alternatively catalyzing the origin of life by delivering iron required to create a reducing environment/atmosphere. We present 3D numerical simulations of 1500-3400 km diameter impacts on the early Earth in order to quantify their effects on planetary habitability. We find sterilizing impact events require larger projectiles than previously assumed, with a 2000-2700 km diameter impactor required to completely melt Earth's surface and an extrapolated >700 km diameter impactor required for ocean-vaporization. We also find that reducing environments are less likely to arise following large impacts than previously suggested, because >70% of the projectile iron is deposited in the crust and upper mantle where it is not immediately available to reduce surface water and contribute to forming a reducing atmosphere. Although the largest expected late accretion impacts (~1 lunar mass) delivered sufficient iron to the atmosphere to have reduced an entire ocean mass of water, such impacts would also have melted the entire surface, potentially sequestering condensing iron that is not oxidized quickly. The hypothesis that life emerged in the aftermath of large impacts requires an efficient mechanism of harnessing the reducing power of iron sequestered in the crust/mantle, or an origin of life pathway that operates in more weakly-reducing post-impact environments that require smaller quantities of impact-delivered iron.


title: Elementary proofs of several results on false discovery rate

abstract: We collect self-contained elementary proofs of four results in the literature on the false discovery rate of the Benjamini-Hochberg (BH) procedure for independent or positive-regression dependent p-values, the Benjamini-Yekutieli correction for arbitrarily dependent p-values, and the e-BH procedure for arbitrarily dependent e-values. As a corollary, the above proofs also lead to some inequalities of Simes and Hommel.


title: The risk of bias in denoising methods

abstract: Experimental datasets are growing rapidly in size, scope, and detail, but the value of these datasets is limited by unwanted measurement noise. It is therefore tempting to apply analysis techniques that attempt to reduce noise and enhance signals of interest. In this paper, we draw attention to the possibility that denoising methods may introduce bias and lead to incorrect scientific inferences. To present our case, we first review the basic statistical concepts of bias and variance. Denoising techniques typically reduce variance observed across repeated measurements, but this can come at the expense of introducing bias to the average expected outcome. We then conduct three simple simulations that provide concrete examples of how bias may manifest in everyday situations. These simulations reveal several findings that may be surprising and counterintuitive: (i) different methods can be equally effective at reducing variance but some incur bias while others do not, (ii) identifying methods that better recover ground truth does not guarantee the absence of bias, (iii) bias can arise even if one has specific knowledge of properties of the signal of interest. We suggest that researchers should consider and possibly quantify bias before deploying denoising methods on important research data.


title: Out of Distribution Detection on ImageNet-O

abstract: Out of distribution (OOD) detection is a crucial part of making machine learning systems robust. The ImageNet-O dataset is an important tool in testing the robustness of ImageNet trained deep neural networks that are widely used across a variety of systems and applications. We aim to perform a comparative analysis of OOD detection methods on ImageNet-O, a first of its kind dataset with a label distribution different than that of ImageNet, that has been created to aid research in OOD detection for ImageNet models. As this dataset is fairly new, we aim to provide a comprehensive benchmarking of some of the current state of the art OOD detection methods on this novel dataset. This benchmarking covers a variety of model architectures, settings where we haves prior access to the OOD data versus when we don't, predictive score based approaches, deep generative approaches to OOD detection, and more.


title: Distributed Bandits with Heterogeneous Agents

abstract: This paper tackles a multi-agent bandit setting where $M$ agents cooperate together to solve the same instance of a $K$-armed stochastic bandit problem. The agents are \textit{heterogeneous}: each agent has limited access to a local subset of arms and the agents are asynchronous with different gaps between decision-making rounds. The goal for each agent is to find its optimal local arm, and agents can cooperate by sharing their observations with others. While cooperation between agents improves the performance of learning, it comes with an additional complexity of communication between agents. For this heterogeneous multi-agent setting, we propose two learning algorithms, \ucbo and \AAE. We prove that both algorithms achieve order-optimal regret, which is $O\left(\sum_{i:\tilde{\Delta}_i>0} \log T/\tilde{\Delta}_i\right)$, where $\tilde{\Delta}_i$ is the minimum suboptimality gap between the reward mean of arm $i$ and any local optimal arm. In addition, a careful selection of the valuable information for cooperation, \AAE achieves a low communication complexity of $O(\log T)$. Last, numerical experiments verify the efficiency of both algorithms.


title: Survey and Systematization of 3D Object Detection Models and Methods

abstract: Strong demand for autonomous vehicles and the wide availability of 3D sensors are continuously fueling the proposal of novel methods for 3D object detection. In this paper, we provide a comprehensive survey of recent developments from 2012-2021 in 3D object detection covering the full pipeline from input data, over data representation and feature extraction to the actual detection modules. We introduce fundamental concepts, focus on a broad range of different approaches that have emerged over the past decade, and propose a systematization that provides a practical framework for comparing these approaches with the goal of guiding future development, evaluation and application activities. Specifically, our survey and systematization of 3D object detection models and methods can help researchers and practitioners to get a quick overview of the field by decomposing 3DOD solutions into more manageable pieces.


title: Transformer-based SAR Image Despeckling

abstract: Synthetic Aperture Radar (SAR) images are usually degraded by a multiplicative noise known as speckle which makes processing and interpretation of SAR images difficult. In this paper, we introduce a transformer-based network for SAR image despeckling. The proposed despeckling network comprises of a transformer-based encoder which allows the network to learn global dependencies between different image regions - aiding in better despeckling. The network is trained end-to-end with synthetically generated speckled images using a composite loss function. Experiments show that the proposed method achieves significant improvements over traditional and convolutional neural network-based despeckling methods on both synthetic and real SAR images.


title: SToN: A New Fundamental Trade-off for Distributed Data Storage Systems

abstract: Locating data efficiently is a key process in every distributed data storage solution and particularly those deployed in multi-site environments, such as found in Cloud and Fog computing. Nevertheless, the existing protocols dedicated to this task are not compatible with the requirements of the infrastructures that underlie such computing paradigms. In this paper, we initially review three fundamental mechanisms from which the existing protocols are used to locate data. We will demonstrate that these mechanisms all face the same set of limitations and seem to have a trade-off in three distinct domains of interest, namely, i) the scalability, ii) the ability to deal with the network topology changes and iii) the constraints on the data naming process. After laying out our motivation and identifying the related trade-offs in existing systems, we finally propose a conjecture (and provide a proof for this conjecture) stating that these three properties cannot be met simultaneously, which we believe is a new fundamental trade-off the distributed storage systems using the three fundamental mechanisms have to face. We conclude by discussing some of the implications of this novel result.


title: User Pairing and Outage Analysis in Multi-Carrier NOMA-THz Networks

abstract: This paper provides a comprehensive framework to analyze the performance of non-orthogonal multiple access (NOMA) in the downlink transmission of a single-carrier and multi-carrier terahertz (THz) network. Specifically, we first develop a novel user pairing scheme for the THz-NOMA network which ensures the performance gains of NOMA over orthogonal multiple access (OMA) for each individual user in the NOMA pair and adapts according to the molecular absorption. Then, we characterize novel outage probability expressions considering a single-carrier and multi-carrier THz-NOMA network in the presence of various user pairing schemes, Nakagami-m channel fading, and molecular absorption noise. We propose a moment-generating-function (MGF) based approach to analyze the outage probability of users in a multi-carrier THz network. Furthermore, for negligible thermal noise, we provide simplified single-integral expressions to compute the outage probability in a multi-carrier network. Numerical results demonstrate the performance of the proposed user-pairing scheme and validate the accuracy of the derived expressions.


title: Uncovering diffusive states of the yeast proton pump, Pma1, and how labeling method can change diffusive behavior

abstract: We present and analyze video-microscopy-based single-particle-tracking measurements of the budding yeast (Saccharomyces cerevisiae) membrane protein, Pma1, fluorescently-labeled either by direct fusion to the switchable fluorescent protein, mEos3.2, or by a novel, light-touch, labeling scheme, in which a 5 amino acid tag is directly fused to the C-terminus of Pma1, which then binds mEos3.2. The diffusivity distributions of these two populations of single particle tracks differ significantly, demonstrating that labeling method can be an important determinant of diffusive behavior. We also applied perturbation expectation maximization (pEMv2) [Physical Review E 94, 052412 (2016)], which sorts trajectories into the statistically-optimum number of diffusive states. For both TRAP-labeled Pma1 and Pma1-mEos3.2, pEMv2 sorts the tracks into two diffusive states: an essentially immobile state and a more mobile state. However, the mobile fraction of Pma1-mEos3.2 tracks is much smaller (0.1) than the mobile fraction of TRAP-labeled Pma1 tracks (0.5). In addition, the diffusivity of Pma1-mEos3.2's mobile state is several times smaller than the diffusivity of TRAP-labeled Pma1's mobile state. To critically assess pEMv2's performance, we compare the diffusivity and covariance distributions of the experimental pEMv2-sorted populations to corresponding theoretical distributions, assuming that Pma1 displacements realize a Gaussian random process. The experiment-theory comparisons for both the TRAP-labeled Pma1 and Pma1-mEos3.2 reveal good agreement, bolstering the pEMv2 approach.


title: Imposing Connectome-Derived Topology on an Echo State Network

abstract: Can connectome-derived constraints inform computation? In this paper we investigate the contribution of a fruit fly connectome's topology on the performance of an Echo State Network (ESN) -- a subset of Reservoir Computing which is state of the art in chaotic time series prediction. Specifically, we replace the reservoir layer of a classical ESN -- normally a fixed, random graph represented as a 2-d matrix -- with a particular (female) fruit fly connectome-derived connectivity matrix. We refer to this experimental class of models (with connectome-derived reservoirs) as "Fruit Fly ESNs" (FFESNs). We train and validate the FFESN on a chaotic time series prediction task; here we consider four sets of trials with different training input sizes (small, large) and train-validate splits (two variants). We compare the validation performance (Mean-Squared Error) of all of the best FFESN models to a class of control model ESNs (simply referred to as "ESNs"). Overall, for all four sets of trials we find that the FFESN either significantly outperforms (and has lower variance than) the ESN; or simply has lower variance than the ESN.


title: POTHER: Patch-Voted Deep Learning-Based Chest X-ray Bias Analysis for COVID-19 Detection

abstract: A critical step in the fight against COVID-19, which continues to have a catastrophic impact on peoples lives, is the effective screening of patients presented in the clinics with severe COVID-19 symptoms. Chest radiography is one of the promising screening approaches. Many studies reported detecting COVID-19 in chest X-rays accurately using deep learning. A serious limitation of many published approaches is insufficient attention paid to explaining decisions made by deep learning models. Using explainable artificial intelligence methods, we demonstrate that model decisions may rely on confounding factors rather than medical pathology. After an analysis of potential confounding factors found on chest X-ray images, we propose a novel method to minimise their negative impact. We show that our proposed method is more robust than previous attempts to counter confounding factors such as ECG leads in chest X-rays that often influence model classification decisions. In addition to being robust, our method achieves results comparable to the state-of-the-art. The source code and pre-trained weights are publicly available at (https://github.com/tomek1911/POTHER).


title: Quantum Expectation Transformers for Cost Analysis

abstract: We introduce a new kind of expectation transformer for a mixed classical-quantum programming language. Our semantic approach relies on a new notion of a cost structure, which we introduce and which can be seen as a specialisation of the Kegelspitzen of Keimel and Plotkin. We show that our weakest precondition analysis is both sound and adequate with respect to the operational semantics of the language. Using the induced expectation transformer, we provide formal analysis methods for the expected cost analysis and expected value analysis of classical-quantum programs. We illustrate the usefulness of our techniques by computing the expected cost of several well-known quantum algorithms and protocols, such as coin tossing, repeat until success, entangled state preparation, and quantum walks.


title: Asymptotically holomorphic theory for symplectic orbifolds

abstract: We extend Donaldson's asymptotically holomorphic techniques to symplectic orbifolds. More precisely, given a symplectic orbifold such that the symplectic form defines an integer cohomology class, we prove that there exist sections of large tensor powers of the prequantizable line bundle such that their zero sets are symplectic suborbifolds. We then derive a Lefschetz hyperplane theorem for these suborbifolds, that computes their real cohomology up to middle dimension. We also get the hard Lefschetz and formality properties for them, when the ambient manifold satisfies those properties.


title: Sticky diffusions on graphs

abstract: We consider diffusion processes on metric graphs with semipermeable sticky membranes in each vertex. We prove that the process is governed by a Feller semigroup and find its asymptotic behavior as diffusion's speed increases to infinity with the same rate as permeability coefficients decreases to zero.


title: Heterotic Kerr-Schild Double Field Theory and its double Yang-Mills formulation

abstract: We present a formulation of heterotic Double Field Theory (DFT), where the fundamental fields are in $O(D,D)$ representations. The theory is obtained splitting an $O(D,D+K)$ duality invariant DFT. This procedure produces a Green-Schwarz mechanism for the generalized metric, and a fundamental gauge field which transforms as a gauge connection only to leading order. After parametrization, the former induces a non-covariant transformation on the metric tensor, which can be removed considering field redefinitions, and an ordinary Green-Schwarz mechanism on the b-field. Within this framework we explore perturbative properties of heterotic DFT. We use a relaxed version of the generalized Kerr-Schild ansatz (GKSA), where the generalized background metric is perturbed up to quadratic order considering a single null vector and the gauge field is linearly perturbed before parametrization. Finally we compare the dynamics of the gauge field and the generalized metric in order to inspect the behavior of the classical double copy correspondence at the DFT level.


title: On the Homomorphism Order of Oriented Paths and Trees

abstract: A partial order is universal if it contains every countable partial order as a suborder. In 2017, Fiala, Hubi\v{c}ka, Long and Ne\v{s}et\v{r}il showed that every interval in the homomorphism order of graphs is universal, with the only exception being the trivial gap $[K_1,K_2]$. We consider the homomorphism order restricted to the class of oriented paths and trees. We show that every interval between two oriented paths or oriented trees of height at least 4 is universal. The exceptional intervals coincide for oriented paths and trees and are contained in the class of oriented paths of height at most 3, which forms a chain.


title: Optimal transport for causal discovery

abstract: To determine causal relationships between two variables, approaches based on Functional Causal Models (FCMs) have been proposed by properly restricting model classes; however, the performance is sensitive to the model assumptions, which makes it difficult to use. In this paper, we provide a novel dynamical-system view of FCMs and propose a new framework for identifying causal direction in the bivariate case. We first show the connection between FCMs and optimal transport, and then study optimal transport under the constraints of FCMs. Furthermore, by exploiting the dynamical interpretation of optimal transport under the FCM constraints, we determine the corresponding underlying dynamical process of the static cause-effect pair data. It provides a new dimension for describing static causal discovery tasks while enjoying more freedom for modeling the quantitative causal influences. In particular, we show that Additive Noise Models (ANMs) correspond to volume-preserving pressureless flows. Consequently, based on their velocity field divergence, we introduce a criterion for determining causal direction. With this criterion, we propose a novel optimal transport-based algorithm for ANMs which is robust to the choice of models and extend it to post-nonlinear models. Our method demonstrated state-of-the-art results on both synthetic and causal discovery benchmark datasets.


title: Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketch

abstract: The freeform architectural modeling process often involves two important stages: concept design and digital modeling. In the first stage, architects usually sketch the overall 3D shape and the panel layout on a physical or digital paper briefly. In the second stage, a digital 3D model is created using the sketch as a reference. The digital model needs to incorporate geometric requirements for its components, such as the planarity of panels due to consideration of construction costs, which can make the modeling process more challenging. In this work, we present a novel sketch-based system to bridge the concept design and digital modeling of freeform roof-like shapes represented as planar quadrilateral (PQ) meshes. Our system allows the user to sketch the surface boundary and contour lines under axonometric projection and supports the sketching of occluded regions. In addition, the user can sketch feature lines to provide directional guidance to the PQ mesh layout. Given the 2D sketch input, we propose a deep neural network to infer in real-time the underlying surface shape along with a dense conjugate direction field, both of which are used to extract the final PQ mesh. To train and validate our network, we generate a large synthetic dataset that mimics architect sketching of freeform quadrilateral patches. The effectiveness and usability of our system are demonstrated with quantitative and qualitative evaluation as well as user studies.


title: Evaluating the accuracy of the actuator line model against blade element momentum theory in uniform inflow

abstract: We evaluate the accuracy of the actuator line model (ALM) approach by performing simulations for the NREL~5~MW wind turbine in uniform inflow using three large eddy simulation codes. The power and thrust coefficients obtained using the three codes agrees within $1\%$ when the grid spacing $\Delta_{\rm grid} \le 5.25$~m, and are cross-validated against blade element momentum (BEM) theory. We find that the results of ALM converge towards BEM theory without the need for tip correction when the numerical resolution is increased. For $\Delta_{\rm grid}=0.98$~m the difference between the power and thrust coefficient obtained using ALM and BEM is $4.5\%$ and $2.1\%$, respectively, although we note that no absolute convergence between ALM and BEM can be obtained as both models use different assumptions, such as the use of a force projection method in the ALM. The difference in the local axial and tangential forces along the blades obtained from ALM simulations using $\Delta_{\rm grid} = 1.97$~m and $\Delta_{\rm grid} = 0.98$~m can be as large as $10\%$. The effect of the number of actuator points on the obtained turbine power and thrust coefficients is limited as the results converge when the spacing between the actuator points is about three times the grid spacing. This insight on the required number of blade points can be used to improve the efficiency of actuator line simulations.


title: Efficient and Robust Classification for Sparse Attacks

abstract: In the past two decades we have seen the popularity of neural networks increase in conjunction with their classification accuracy. Parallel to this, we have also witnessed how fragile the very same prediction models are: tiny perturbations to the inputs can cause misclassification errors throughout entire datasets. In this paper, we consider perturbations bounded by the $\ell_0$--norm, which have been shown as effective attacks in the domains of image-recognition, natural language processing, and malware-detection. To this end, we propose a novel defense method that consists of "truncation" and "adversarial training". We then theoretically study the Gaussian mixture setting and prove the asymptotic optimality of our proposed classifier. Motivated by the insights we obtain, we extend these components to neural network classifiers. We conduct numerical experiments in the domain of computer vision using the MNIST and CIFAR datasets, demonstrating significant improvement for the robust classification error of neural networks.


title: Are Your Sensitive Attributes Private? Novel Model Inversion Attribute Inference Attacks on Classification Models

abstract: Increasing use of machine learning (ML) technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing leakage of sensitive and proprietary training data. In this paper, we focus on model inversion attacks where the adversary knows non-sensitive attributes about records in the training data and aims to infer the value of a sensitive attribute unknown to the adversary, using only black-box access to the target classification model. We first devise a novel confidence score-based model inversion attribute inference attack that significantly outperforms the state-of-the-art. We then introduce a label-only model inversion attack that relies only on the model's predicted labels but still matches our confidence score-based attack in terms of attack effectiveness. We also extend our attacks to the scenario where some of the other (non-sensitive) attributes of a target record are unknown to the adversary. We evaluate our attacks on two types of machine learning models, decision tree and deep neural network, trained on three real datasets. Moreover, we empirically demonstrate the disparate vulnerability of model inversion attacks, i.e., specific groups in the training dataset (grouped by gender, race, etc.) could be more vulnerable to model inversion attacks.


title: Probabilistic Learning of Treatment Trees in Cancer

abstract: Accurate identification of synergistic treatment combinations and their underlying biological mechanisms is critical across many disease domains, especially cancer. In translational oncology research, preclinical systems such as patient-derived xenografts (PDX) have emerged as a unique study design evaluating multiple treatments administered to samples from the same human tumor implanted into genetically identical mice. In this paper, we propose a novel Bayesian probabilistic tree-based framework for PDX data to investigate the hierarchical relationships between treatments by inferring treatment cluster trees, referred to as treatment trees (Rx-tree). The framework motivates a new metric of mechanistic similarity between two or more treatments accounting for inherent uncertainty in tree estimation; treatments with a high estimated similarity have potentially high mechanistic synergy. Building upon Dirichlet Diffusion Trees, we derive a closed-form marginal likelihood encoding the tree structure, which facilitates computationally efficient posterior inference via a new two-stage algorithm. Simulation studies demonstrate superior performance of the proposed method in recovering the tree structure and treatment similarities. Our analyses of a recently collated PDX dataset produce treatment similarity estimates that show a high degree of concordance with known biological mechanisms across treatments in five different cancers. More importantly, we uncover new and potentially effective combination therapies that confer synergistic regulation of specific downstream biological pathways for future clinical investigations. Our accompanying code, data, and shiny application for visualization of results are available at: https://github.com/bayesrx/RxTree.


title: Prioritizing municipal lead mitigation projects as a relaxed knapsack optimization: a method and case study

abstract: Lead pipe remediation budgets are limited and ought to maximize public health impact. This goal implies a non-trivial optimization problem; lead service lines connect water mains to individual houses, but any realistic replacement strategy must batch replacements at a larger scale. Additionally, planners typically lack a principled method for comparing the relative public health value of potential interventions and often plan projects based on non-health factors. This paper describes a simple process for estimating child health impact at a parcel level by cleaning and synthesizing municipal datasets that are commonly available but seldom joined due to data quality issues. Using geocoding as the core record linkage mechanism, parcel-level toxicity data can be combined with school enrollment records to indicate where young children and lead lines coexist. A harm metric of estimated exposure-years is described at the parcel level, which can then be aggregated to the project level and minimized globally by posing project selection as a 0/1 knapsack problem. Simplifying further for use by non-experts, the implied linear programming relaxation is solved intuitively with the greedy algorithm; ordering projects by benefit cost ratio produces a priority list which planners can then consider holistically alongside harder to quantify factors. A case study demonstrates the successful application of this framework to a small U.S. city's existing data to prioritize federal infrastructure funding. While this paper focuses on lead in drinking water, the approach readily generalizes to other sources of residential toxicity with disproportionate impact on children.


title: Unsupervised Severely Deformed Mesh Reconstruction (DMR) from a Single-View Image

abstract: Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an unsupervised manner. Although training-based methods, such as specific category-level training, have been shown to successfully reconstruct rigid objects and slightly deformed objects like birds from a single-view image, they cannot effectively handle severely deformed objects and neither can be applied to some downstream tasks in the real world due to the inconsistent semantic meaning of vertices, which are crucial in defining the adopted 3D templates of objects to be reconstructed. In this work, we introduce a template-based method to infer 3D shapes from a single-view image and apply the reconstructed mesh to a downstream task, i.e., absolute length measurement. Without using 3D ground truth, our method faithfully reconstructs 3D meshes and achieves state-of-the-art accuracy in a length measurement task on a severely deformed fish dataset.


title: Scalable High-Performance Fluxonium Quantum Processor

abstract: The technological development of hardware heading toward universal fault-tolerant quantum computation requires a large-scale processing unit with high performance. While fluxonium qubits are promising with high coherence and large anharmonicity, their scalability has not been systematically explored. In this work, we propose a superconducting quantum information processor based on compact high-coherence fluxoniums with suppressed crosstalk, reduced design complexity, improved operational efficiency, high-fidelity gates, and resistance to parameter fluctuations. In this architecture, the qubits are readout dispersively using individual resonators connected to a common bus and manipulated via combined on-chip RF and DC control lines, both of which can be designed to have low crosstalk. A multi-path coupling approach enables exchange interactions between the high-coherence computational states and at the same time suppresses the spurious static ZZ rate, leading to fast and high-fidelity entangling gates. We numerically investigate the cross resonance controlled-NOT and the differential AC-Stark controlled-Z operations, revealing low gate error for qubit-qubit detuning bandwidth of up to 1 GHz. Our study on frequency crowding indicates high fabrication yield for quantum processors consisting of over thousands of qubits. In addition, we estimate low resource overhead to suppress logical error rate using the XZZX surface code. These results promise a scalable quantum architecture with high performance for the pursuit of universal quantum computation.


title: Deep Unrolling for Magnetic Resonance Fingerprinting

abstract: Magnetic Resonance Fingerprinting (MRF) has emerged as a promising quantitative MR imaging approach. Deep learning methods have been proposed for MRF and demonstrated improved performance over classical compressed sensing algorithms. However many of these end-to-end models are physics-free, while consistency of the predictions with respect to the physical forward model is crucial for reliably solving inverse problems. To address this, recently [1] proposed a proximal gradient descent framework that directly incorporates the forward acquisition and Bloch dynamic models within an unrolled learning mechanism. However, [1] only evaluated the unrolled model on synthetic data using Cartesian sampling trajectories. In this paper, as a complementary to [1], we investigate other choices of encoders to build the proximal neural network, and evaluate the deep unrolling algorithm on real accelerated MRF scans with non-Cartesian k-space sampling trajectories.


title: ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

abstract: Accelerating magnetic resonance image (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent transformer model, namely ReconFormer, for MRI reconstruction which can iteratively reconstruct high fertility magnetic resonance images from highly under-sampled k-space data. In particular, the proposed architecture is built upon Recurrent Pyramid Transformer Layers (RPTL), which jointly exploits intrinsic multi-scale information at every architecture unit as well as the dependencies of the deep feature correlation through recurrent states. Moreover, the proposed ReconFormer is lightweight since it employs the recurrent structure for its parameter efficiency. We validate the effectiveness of ReconFormer on multiple datasets with different magnetic resonance sequences and show that it achieves significant improvements over the state-of-the-art methods with better parameter efficiency. Implementation code will be available in https://github.com/guopengf/ReconFormer.


title: An Application of Pseudo-Log-Likelihoods to Natural Language Scoring

abstract: Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understanding. In this paper we apply a zero-shot approach independently developed by a number of researchers now gaining recognition as a significant alternative to fine-tuning for evaluation on common sense tasks. A language model with relatively few parameters and training steps compared to a more recent language model (T5) can outperform it on a recent large data set (TimeDial), while displaying robustness in its performance across a similar class of language tasks. Surprisingly, this result is achieved by using a hyperparameter-free zero-shot method with the smaller model, compared to fine-tuning to the larger model. We argue that robustness of the smaller model ought to be understood in terms of compositionality, in a sense that we draw from recent literature on a class of similar models. We identify a practical cost for our method and model: high GPU-time for natural language evaluation. The zero-shot measurement technique that produces remarkable stability, both for ALBERT and other BERT variants, is an application of pseudo-log-likelihoods to masked language models for the relative measurement of probability for substitution alternatives in forced choice language tasks such as the Winograd Schema Challenge, Winogrande, and others. One contribution of this paper is to bring together a number of similar, but independent strands of research. We produce some absolute state-of-the-art results for common sense reasoning in binary choice tasks, performing better than any published result in the literature, including fine-tuned efforts. We show a remarkable consistency of the model's performance under adversarial settings, which we argue is best explained by the model's compositionality of representations.


title: Application of an RBF-FD solver for the Helmholtz equation to full-waveform inversion

abstract: Full waveform inversion (FWI) is one of a family of methods that allows the reconstruction of earth subsurface parameters from measurements of waves at or near the surface. This is a numerical optimization problem that uses the whole waveform information of all arrivals to update the subsurface parameters that govern seismic wave propagation. We apply FWI in the multi-scale approach on two well-known benchmarks: Marmousi and 2004 BP velocity model. For the forward modeling, we use an RBF-FD solver on hexagonal grids and quasi-optimal shape parameters.


title: Network Dynamics with Higher-Order Interactions: Coupled Cell Hypernetworks for Identical Cells and Synchrony

abstract: Network interactions that are nonlinear in the state of more than two nodes - also known as higher-order interactions - can have a profound impact on the collective network dynamics. Here we develop a coupled cell hypernetwork formalism to elucidate the existence and stability of (cluster) synchronization patterns in network dynamical systems with higher-order interactions. More specifically, we define robust synchrony subspace for coupled cell hypernetworks whose coupling structure is determined by an underlying hypergraph and describe those spaces for general such hypernetworks. Since a hypergraph can be equivalently represented as a bipartite graph between its nodes and hyperedges, we relate the synchrony subspaces of a hypernetwork to balanced colorings of the corresponding incidence digraph.


title: Degenerate J-flow on compact K\"ahler manifolds

abstract: In this note, we study a degenerate twisted J-flow on compact K\"ahler manifolds. We show that it exists for all time, it is unique and converges to a weak solution of a degenerate twisted J-equation. In particular, this confirms an expectation formulated by Song-Weinkove for the J-flow. As a consequence, we establish the properness of the Mabuchi K-energy twisted by a certain semi-positive closed (1,1)-form for K\"ahler classes in a certain subcone.


title: vCLIMB: A Novel Video Class Incremental Learning Benchmark

abstract: Continual learning (CL) is under-explored in the video domain. The few existing works contain splits with imbalanced class distributions over the tasks, or study the problem in unsuitable datasets. We introduce vCLIMB, a novel video continual learning benchmark. vCLIMB is a standardized test-bed to analyze catastrophic forgetting of deep models in video continual learning. In contrast to previous work, we focus on class incremental continual learning with models trained on a sequence of disjoint tasks, and distribute the number of classes uniformly across the tasks. We perform in-depth evaluations of existing CL methods in vCLIMB, and observe two unique challenges in video data. The selection of instances to store in episodic memory is performed at the frame level. Second, untrimmed training data influences the effectiveness of frame sampling strategies. We address these two challenges by proposing a temporal consistency regularization that can be applied on top of memory-based continual learning methods. Our approach significantly improves the baseline, by up to 24% on the untrimmed continual learning task.


title: Iterative Joint Parameters Estimation and Decoding in a Distributed Receiver for Satellite Applications and Relevant Cramer-Rao Bounds

abstract: This paper presents an algorithm for iterative joint channel parameter (carrier phase, Doppler shift and Doppler rate) estimation and decoding of transmission over channels affected by Doppler shift and Doppler rate using a distributed receiver. This algorithm is derived by applying the sum-product algorithm (SPA) to a factor graph representing the joint a posteriori distribution of the information symbols and channel parameters given the channel output. In this paper, we present two methods for dealing with intractable messages of the sum-product algorithm. In the first approach, we use particle filtering with sequential importance sampling (SIS) for the estimation of the unknown parameters. We also propose a method for fine-tuning of particles for improved convergence. In the second approach, we approximate our model with a random walk phase model, followed by a phase tracking algorithm and polynomial regression algorithm to estimate the unknown parameters. We derive the Weighted Bayesian Cramer-Rao Bounds (WBCRBs) for joint carrier phase, Doppler shift and Doppler rate estimation, which take into account the prior distribution of the estimation parameters and are accurate lower bounds for all considered Signal to Noise Ratio (SNR) values. Numerical results (of bit error rate (BER) and the mean-square error (MSE) of parameter estimation) suggest that phase tracking with the random walk model slightly outperforms particle filtering. However, particle filtering has a lower computational cost than the random walk model based method.


title: Extending the time of coherent optical response in ensemble of singly-charged InGaAs quantum dots

abstract: The ability to extend the time scale of the coherent optical response from large ensembles of quantum emitters is highly appealing for applications in quantum information devices. In semiconductor nanostructures, spin degrees of freedom can be used as auxiliary, powerful tools to modify the coherent optical dynamics. Here, we apply this approach to negatively charged (In,Ga)As/GaAs self-assembled quantum dots which are considered as excellent quantum emitters with robust optical coherence and high bandwidth. We study 3-pulse spin-dependent photon echoes subject to moderate transverse magnetic fields up to 1 T. We demonstrate that the timescale of coherent optical response can be extended by at least an order of magnitude by the field. Without magnetic field, the photon echo decays with $T_ 2$ = 0.45 ns which is determined by the radiative lifetime of trions $T_1$ = 0.27 ns. In the presence of the transverse magnetic field, the decay of the photon echo signal is given by spin dephasing time of the ensemble of resident electrons $T_{2,e}$ ~ 4 ns. We demonstrate that the non-zero transverse g-factor of the heavy holes in the trion state plays a crucial role in the temporal evolution and magnetic field dependence of the long-lived photon echo signal.


title: A Comprehensive Survey on Federated Learning: Concept and Applications

abstract: This paper provides a comprehensive study of Federated Learning (FL) with an emphasis on components, challenges, applications and FL environment. FL can be applicable in multiple fields and domains in real-life models. in the medical system, the privacy of patients records and their medical condition is critical data, therefore collaborative learning or federated learning comes into the picture. On other hand build an intelligent system assist the medical staff without sharing the data lead into the FL concept and one of the applications that are used is a brain tumor diagnosis intelligent system based on AI methods that can efficiently work in a collaborative environment.this paper will introduce some of the applications and related work in the medical field and work under the FL concept then summarize them to introduce the main limitations of their work.


title: Classical Multidimensional Scaling on Metric Measure Spaces

abstract: We generalize the classical Multidimensional Scaling procedure to the setting of general metric measure spaces. We develop a related spectral theory for the generalized cMDS operator, which provides a more natural and rigorous mathematical background for cMDS. Also, we show that the sum of all negative eigenvalues of the cMDS operator is a new invariant measuring non-flatness of a metric measure space. Furthermore, the cMDS output of several non-finite exemplar metric measures spaces, in particular the cMDS for spheres S^{d-1} and subsets of Euclidean space, are studied. Finally, we prove the stability of the generalized cMDS process with respect to the Gromov-Wasserstein distance.


title: Impact of Non-Hermiticity and Nonlinear Interactions on Disordered-Induced Localized Modes

abstract: If disorder-induced Anderson localized states have been observed experimentally in optics, their study remains challenging leaving a number of open questions unsolved. Among them, the impact on Anderson localization of non-Hermiticity, optical gain and loss, and more generally, nonlinearities has been the subject of numerous theoretical debates, without yet any conclusive experimental demonstration. Indeed, in systems where localized modes have reasonable spatial extension to be observed and investigated, their mutual interaction and coupling to the sample boundaries make it extremely difficult to isolate them spectrally and investigate them alone. Recently, we successfully exhibited localized lasing modes individually in an active disordered medium, using pump-shaping optimization technique. However, a one-to-one identification of the lasing modes with the eigenmodes of the passive system was not possible, as the impact of non-Hermiticity and nonlinear gain on these localized states was unknown. Here, we apply the pump-shaping method to fully control the non-Hermiticity of an active scattering medium. Direct imaging of the light distribution within the random laser allows us to demonstrate unequivocally that the localized lasing modes are indeed the modes of the passive system. This opens the way to investigate the robustness of localized states in the presence of nonlinear gain and nonlinear modal interactions. We show that, surprisingly, gain saturation and mode competition for gain does not affect the spatial distribution of the modes.


title: Canonical surgeries in rotationally invariant Ricci flow

abstract: We construct a rotationally invariant Ricci flow through surgery starting at any closed rotationally invariant Riemannian manifold. We demonstrate that a sequence of such Ricci flows with surgery converges to a Ricci flow spacetime in the sense of [32]. Results of Bamler-Kleiner [8] and Haslhofer [29] then guarantee the uniqueness and stability of these spacetimes given initial data. We simplify aspects of this proof in our setting, and show that for rotationally invariant Ricci flows, the closeness of spacetimes can be measured by equivariant comparison maps. Finally we show that the blowup rate of the curvature near a singular time for these Ricci flows is bounded by the inverse of remaining time squared.


title: A Survey on Patients Privacy Protection with Stganography and Visual Encryption

abstract: In this survey, thirty models for steganography and visual encryption methods have been discussed to provide patients privacy protection.


title: Quickest Detection of Deception Attacks on Cyber-Physical Systems with a Parsimonious Watermarking Policy

abstract: The addition of a physical watermarking signal to the control input increases the detection probability of data deception attacks at the expense of increased control cost. In this paper, we propose a parsimonious policy to reduce the average number of watermarking events when the attack is not present, which in turn reduces the control cost. We model the system as a stochastic optimal control problem and apply the dynamic programming to minimize the average detection delay (ADD) for fixed upper bounds on false alarm rate (FAR) and increased control cost. The optimal solution results in a two threshold policy on the posterior probability of attack, which is derived from the Shiryaev statistics for sequential change detection assuming the change point is a random variable with a geometric distribution. We derive approximate expressions of ADD and FAR applying the non-linear renewal theory. The relationship between the average number of watermarking added before the attack and the increase in control cost is also derived. We design the optimal watermarking that maximizes the Kullback-Leibler divergence for a fixed increase in the control cost. Simulation studies are performed to illustrate and validate the theoretical results.


title: AttentionHTR: Handwritten Text Recognition Based on Attention Encoder-Decoder Networks

abstract: This work proposes an attention-based sequence-to-sequence model for handwritten word recognition and explores transfer learning for data-efficient training of HTR systems. To overcome training data scarcity, this work leverages models pre-trained on scene text images as a starting point towards tailoring the handwriting recognition models. ResNet feature extraction and bidirectional LSTM-based sequence modeling stages together form an encoder. The prediction stage consists of a decoder and a content-based attention mechanism. The effectiveness of the proposed end-to-end HTR system has been empirically evaluated on a novel multi-writer dataset Imgur5K and the IAM dataset. The experimental results evaluate the performance of the HTR framework, further supported by an in-depth analysis of the error cases. Source code and pre-trained models are available at https://github.com/dmitrijsk/AttentionHTR.


title: Partition-Based Active Learning for Graph Neural Networks

abstract: We study the problem of semi-supervised learning with Graph Neural Networks (GNNs) in an active learning setup. We propose GraphPart, a novel partition-based active learning approach for GNNs. GraphPart first splits the graph into disjoint partitions and then selects representative nodes within each partition to query. The proposed method is motivated by a novel analysis of the classification error under realistic smoothness assumptions over the graph and the node features. Extensive experiments on multiple benchmark datasets demonstrate that the proposed method outperforms existing active learning methods for GNNs under a wide range of annotation budget constraints. In addition, the proposed method does not introduce additional hyperparameters, which is crucial for model training, especially in the active learning setting where a labeled validation set may not be available.


title: Perceptual Effects of Hierarchy in Art Historical Social Networks

abstract: Network representation is a crucial topic in historical social network analysis. The debate around their value and connotations, led by humanist scholars, is today more relevant than ever, seeing how common these representations are as support for historical analysis. Force-directed networks, in particular, are popular as they can be developed relatively quickly, and reveal patterns and structures in data. The underlying algorithms, although powerful in revealing hidden patterns, do not retain meaningful structure and existing hierarchies within historical social networks. In this article, we question the foreign aspect of this structure that force-directed layout create in historical datasets. We explore the importance of hierarchy in social networks, and investigate whether hierarchies -- strongly present within our models of social structure -- affect our perception of social network data. Results from our user evaluation indicate that hierarchical network representations reduce cognitive load and leads to more frequent and deeper insights into historical social networks. We also find that users report a preference for the hierarchical graph representation. We analyse these findings in light of the broader discussion on the value of force-directed network representations within humanistic research, and introduce open questions for future work in this line of research.


title: Understanding $J/\psi$ and $\psi '$ production using a modified version of Non-Relativistic Quantum Chromodynamics

abstract: There is serious disagreement between the predictions of Non-Relativistic Quantum Chromodynamics (NRQCD) and the data on $J/\psi$ polarisation which has persisted for almost a quarter of a century. We find that if we account for the effect of perturbative soft gluons on the intermediate charm-anticharm octet states in NRQCD then the polarisation problem can be resolved. In addition, this model, when used to fit the Run 1 data on $J/\psi$ and $\psi '$ production from the CDF experiment at Tevatron, gives good fits and yields values of (energy-independent) non-perturbative parameters. These, in turn, can be used to make parameter-free predictions for $J/\psi$ and $\psi '$ data from the CMS experiment at the Large Hadron Collider and the predictions are in excellent agreement with the CMS data.


title: An integrated recurrent neural network and regression model with spatial and climatic couplings for vector-borne disease dynamics

abstract: We developed an integrated recurrent neural network and nonlinear regression spatio-temporal model for vector-borne disease evolution. We take into account climate data and seasonality as external factors that correlate with disease transmitting insects (e.g. flies), also spill-over infections from neighboring regions surrounding a region of interest. The climate data is encoded to the model through a quadratic embedding scheme motivated by recommendation systems. The neighboring regions' influence is modeled by a long short-term memory neural network. The integrated model is trained by stochastic gradient descent and tested on leish-maniasis data in Sri Lanka from 2013-2018 where infection outbreaks occurred. Our model outperformed ARIMA models across a number of regions with high infections, and an associated ablation study renders support to our modeling hypothesis and ideas.


title: MISeval: a Metric Library for Medical Image Segmentation Evaluation

abstract: Correct performance assessment is crucial for evaluating modern artificial intelligence algorithms in medicine like deep-learning based medical image segmentation models. However, there is no universal metric library in Python for standardized and reproducible evaluation. Thus, we propose our open-source publicly available Python package MISeval: a metric library for Medical Image Segmentation Evaluation. The implemented metrics can be intuitively used and easily integrated into any performance assessment pipeline. The package utilizes modern CI/CD strategies to ensure functionality and stability. MISeval is available from PyPI (miseval) and GitHub: https://github.com/frankkramer-lab/miseval.


title: Dynamic Label Assignment for Object Detection by Combining Predicted IoUs and Anchor IoUs

abstract: Label assignment plays a significant role in modern object detection models. Detection models may yield totally different performances with different label assignment strategies. For anchor-based detection models, the IoU (Intersection over Union) threshold between the anchors and their corresponding ground truth bounding boxes is the key element since the positive samples and negative samples are divided by the IoU threshold. Early object detectors simply utilize the fixed threshold for all training samples, while recent detection algorithms focus on adaptive thresholds based on the distribution of the IoUs to the ground truth boxes. In this paper, we introduce a simple while effective approach to perform label assignment dynamically based on the training status with predictions. By introducing the predictions in label assignment, more high-quality samples with higher IoUs to the ground truth objects are selected as the positive samples, which could reduce the discrepancy between the classification scores and the IoU scores, and generate more high-quality boundary boxes. Our approach shows improvements in the performance of the detection models with the adaptive label assignment algorithm and lower bounding box losses for those positive samples, indicating more samples with higher-quality predicted boxes are selected as positives.


title: Lie groups and Lie algebras

abstract: These are expanded notes of a two-semester course on Lie groups and Lie algebras given by the author at MIT in 2020/2021.


title: Towards Private Learning on Decentralized Graphs with Local Differential Privacy

abstract: Many real-world networks are inherently decentralized. For example, in social networks, each user maintains a local view of a social graph, such as a list of friends and her profile. It is typical to collect these local views of social graphs and conduct graph learning tasks. However, learning over graphs can raise privacy concerns as these local views often contain sensitive information. In this paper, we seek to ensure private graph learning on a decentralized network graph. Towards this objective, we propose {\em Solitude}, a new privacy-preserving learning framework based on graph neural networks (GNNs), with formal privacy guarantees based on edge local differential privacy. The crux of {\em Solitude} is a set of new delicate mechanisms that can calibrate the introduced noise in the decentralized graph collected from the users. The principle behind the calibration is the intrinsic properties shared by many real-world graphs, such as sparsity. Unlike existing work on locally private GNNs, our new framework can simultaneously protect node feature privacy and edge privacy, and can seamlessly incorporate with any GNN with privacy-utility guarantees. Extensive experiments on benchmarking datasets show that {\em Solitude} can retain the generalization capability of the learned GNN while preserving the users' data privacy under given privacy budgets.


title: Fault-tolerant Locating-Dominating Sets on the Infinite King Grid

abstract: Let $G$ be a graph of a network system with vertices, $V(G)$, representing physical locations and edges, $E(G)$, representing informational connectivity. A \emph{locating-dominating (LD)} set $S$ is a subset of vertices representing detectors capable of sensing an "intruder" at precisely their location or somewhere in their open-neighborhood -- an LD set must be capable of locating an intruder anywhere in the graph. We explore three types of fault-tolerant LD sets: \emph{redundant LD} sets, which allow a detector to be removed, \emph{error-detecting LD} sets, which allow at most one false negative, and \emph{error-correcting LD} sets, which allow at most one error (false positive or negative). In particular, we determine lower and upper bounds for the minimum density of fault-tolerant locating-dominating sets in the \emph{infinite king grid}; to prove the lower bounds, we introduce a new share-discharging strategy.


title: Fast MRI Reconstruction: How Powerful Transformers Are?

abstract: Magnetic resonance imaging (MRI) is a widely used non-radiative and non-invasive method for clinical interrogation of organ structures and metabolism, with an inherently long scanning time. Methods by k-space undersampling and deep learning based reconstruction have been popularised to accelerate the scanning process. This work focuses on investigating how powerful transformers are for fast MRI by exploiting and comparing different novel network architectures. In particular, a generative adversarial network (GAN) based Swin transformer (ST-GAN) was introduced for the fast MRI reconstruction. To further preserve the edge and texture information, edge enhanced GAN based Swin transformer (EES-GAN) and texture enhanced GAN based Swin transformer (TES-GAN) were also developed, where a dual-discriminator GAN structure was applied. We compared our proposed GAN based transformers, standalone Swin transformer and other convolutional neural networks based GAN model in terms of the evaluation metrics PSNR, SSIM and FID. We showed that transformers work well for the MRI reconstruction from different undersampling conditions. The utilisation of GAN's adversarial structure improves the quality of images reconstructed when undersampled for 30% or higher. The code is publicly available at https://github.com/ayanglab/SwinGANMR.


title: Hochschild Cohomology, Monoid Objects and Monoidal Categories

abstract: This paper expands further on a category theoretical formulation of Hochschild cohomology for monoid objects in monoidal categories enriched over abelian groups, which has been studied in arXiv:1605.00842. This topic was also presented at ISCRA, Isfahan, Iran, April 2019. The present paper aims to provide a more intuitive formulation of the Hochschild cochain complex and extend the definition to Hochschild cohomology with values in a bimodule object. In addition, an equivalent formulation of the Hochschild cochain complex in terms of a cosimplicial object in the category of abelian groups is provided.


title: Limit Points of Commuting Probabilities of Finite Groups

abstract: The commuting probability of a finite group $G$ is the probability that two randomly chosen elements commute. Let $S\subseteq(0,1]$ denote the set of all possible commuting probabilities of finite groups. We prove that $S\cup\{0\}$ is closed, which was conjectured by Keith Joseph in 1977.


title: A Comprehensive Study of the Spectral Variation and the Brightness Profile of Young Pulsar Wind Nebulae

abstract: We present a systematic study of particle transport by diffusion in young pulsar wind nebulae (PWNe). We selected nine bright sources that are well resolved with the Chandra X-ray Observatory. We analyzed archival data to obtain their radial profiles of photon index ($\Gamma$) and surface brightness ($\Sigma$) in a consistent way. These profiles were then fit with a pure diffusion model that was tested on Crab, 3C 58 and G21.5$-$0.9 before. In addition to the spectral softening due to the diffusion, we calculated the synchrotron power and built up the theoretical surface brightness profile. For each source, we performed separate fits to the $\Gamma$ and the $\Sigma$ profiles. We found these two profiles of most PWNe are similar, except for Crab and Vela. Both profiles can be well described by our model, suggesting that diffusion dominates the particle transport in most sampled PWNe. The discrepancy of parameters between the $\Gamma$ profile and $\Sigma$ profiles is relatively large for 3C 58 and G54.1+0.3. This difference could be attributed to the elongated shape, reflecting boundary, and the non-uniform magnetic field. Finally, we found no significant correlations between diffusion parameters and physical parameters of PWN and pulsar.


title: Mirror Coating Thermal Noise Mitigation Using Multi-Spatial Mode Cavity Readout

abstract: We present an approach to mitigate coating thermal noise in optical cavities by using multiple TEM spatial modes to readout and stabilize laser frequency. With optimal weightings we synthesize a wider sampling of the mirror surface, improving averaging of Brownian thermal fluctuation. We show thermal noise improvement factors of 1.57, comparable to a MESA beam of a nominal 12 m prototype cavity, and a factor 1.61 improvement over the $\textrm{TEM}_{00}$ using three modes in a 0.1 m cavity for a practical laboratory experiment: equivalent to cooling mirrors to 120 K from room temperature.


title: Improving Chest X-Ray Report Generation by Leveraging Warm Starting

abstract: Automatically generating a report from a patient's Chest X-Rays (CXRs) is a promising solution to reducing clinical workload and improving patient care. However, current CXR report generators -- which are predominantly encoder-to-decoder models -- lack the diagnostic accuracy to be deployed in a clinical setting. To improve CXR report generation, we investigate warm starting the encoder and decoder with recent open-source computer vision and natural language processing checkpoints, such as the Vision Transformer (ViT) and PubMedBERT. To this end, each checkpoint is evaluated on the MIMIC-CXR and IU X-Ray datasets. Our experimental investigation demonstrates that the Convolutional vision Transformer (CvT) ImageNet-21K and the Distilled Generative Pre-trained Transformer 2 (DistilGPT2) checkpoints are best for warm starting the encoder and decoder, respectively. Compared to the state-of-the-art ($\mathcal{M}^2$ Transformer Progressive), CvT2DistilGPT2 attained an improvement of 8.3\% for CE F-1, 1.8\% for BLEU-4, 1.6\% for ROUGE-L, and 1.0\% for METEOR. The reports generated by CvT2DistilGPT2 have a higher similarity to radiologist reports than previous approaches. This indicates that leveraging warm starting improves CXR report generation. Code and checkpoints for CvT2DistilGPT2 are available at https://github.com/aehrc/cvt2distilgpt2.


title: Power Forward Performance in Semimartingale Markets with Stochastic Integrated Factors

abstract: We study the forward investment performance process (FIPP) in an incomplete semimartingale market model with closed and convex portfolio constraints, when the investor's risk preferences are of the power form. We provide necessary and sufficient conditions for the existence of such FIPP. In a semimartingale factor model, we show that the FIPP can be recovered as a triplet of processes which admit an integral representation with respect to semimartingales. Using an integrated stochastic factor model, we relate the factor representation of the triplet of processes to the smooth solution of an ill-posed partial integro-differential Hamilton-Jacobi-Bellman (HJB) equation. We develop explicit constructions for the class of time-monotone FIPPs, generalizing existing results from Brownian to semimartingale market models.


title: Cross-Domain Document Layout Analysis via Unsupervised Document Style Guide

abstract: The document layout analysis (DLA) aims to decompose document images into high-level semantic areas (i.e., figures, tables, texts, and background). Creating a DLA framework with strong generalization capabilities is a challenge due to document objects are diversity in layout, size, aspect ratio, texture, etc. Many researchers devoted this challenge by synthesizing data to build large training sets. However, the synthetic training data has different styles and erratic quality. Besides, there is a large gap between the source data and the target data. In this paper, we propose an unsupervised cross-domain DLA framework based on document style guidance. We integrated the document quality assessment and the document cross-domain analysis into a unified framework. Our framework is composed of three components, Document Layout Generator (GLD), Document Elements Decorator(GED), and Document Style Discriminator(DSD). The GLD is used to document layout generates, the GED is used to document layout elements fill, and the DSD is used to document quality assessment and cross-domain guidance. First, we apply GLD to predict the positions of the generated document. Then, we design a novel algorithm based on aesthetic guidance to fill the document positions. Finally, we use contrastive learning to evaluate the quality assessment of the document. Besides, we design a new strategy to change the document quality assessment component into a document cross-domain style guide component. Our framework is an unsupervised document layout analysis framework. We have proved through numerous experiments that our proposed method has achieved remarkable performance.


title: Scattering For three waves Nonlinear Schr\"odinger System with mass-resonance in 5D

abstract: In this paper, we study the dynamics behavior of the NLS system with three waves interaction in the energy space $H^1(\mathbb{R}^5) \times H^1(\mathbb{R}^5)\times H^1(\mathbb{R}^5) $. Inspired by B. Dodson and J. Murphy in \cite{Dodson2018}, we establish an interaction Morawetz estimate for the NLS system, together with the criterion which proved by Tao-Dodson--Murphy we can get the scattering under the ground state in energy space with mass-resonance. Under the radial assumption, we can remove the mass-resonance condition.


title: Chain sequences and Zeros of a perturbed $R_{II}$ type recurrence relation

abstract: In this manuscript, new algebraic and analytic aspects of the orthogonal polynomials satisfying $R_{II}$ type recurrence relation given by \begin{align*} \mathcal{P}_{n+1}(x) = (x-c_n)\mathcal{P}_n(x)-\lambda_n (x-a_n)(x-b_n)\mathcal{P}_{n-1}(x), \quad n \geq 0, \end{align*} where $\lambda_n$ is a positive chain sequence and $a_n$, $b_n$, $c_n$ are sequences of real or complex numbers with $\mathcal{P}_{-1}(x) = 0$ and $\mathcal{P}_0(x) = 1$ are investigated when the recurrence coefficients are perturbed. Specifically, representation of new perturbed polynomials (co-polynomials of $R_{II}$ type) in terms of original ones with the interlacing and monotonicity properties of zeros are given. For finite perturbations, a transfer matrix approach is used to obtain new structural relations. Effect of co-dilation in the corresponding chain sequences and their consequences onto the unit circle are analysed. A particular perturbation in the corresponding chain sequence called complementary chain sequences and its effect on the corresponding Verblunsky coefficients is also studied.


title: Map-Assisted Material Identification at 100 GHz and Above Using Radio Access Technology

abstract: The inclusion of material identification in wireless communication system is an emerging area that offers many opportunities for 6G systems. By using reflected radio wave to determine the material of reflecting surface, not only the performance of 6G networks can be improved, but also some exciting applications can be developed. In this paper, we recap a few prior methods for material identification, then analyze the impact of thickness of reflecting surface on reflection coefficient and present a new concept "settling thickness", which indicates the minimum thickness of reflecting surface to induce steady reflection coefficient. Finally, we propose a novel material identification method based on ray-tracing and 3D-map. Compared to some prior methods that can be implemented in single-bounce-reflection scenario only, we extend the capability of the method to multiple-bounce-reflection scenarios.


title: Stochastic asymptotical regularization for linear inverse problems

abstract: We introduce Stochastic Asymptotical Regularization (SAR) methods for the uncertainty quantification of the stable approximate solution of ill-posed linear-operator equations, which are deterministic models for numerous inverse problems in science and engineering. We prove the regularizing properties of SAR with regard to mean-square convergence. We also show that SAR is an optimal-order regularization method for linear ill-posed problems provided that the terminating time of SAR is chosen according to the smoothness of the solution. This result is proven for both a priori and a posteriori stopping rules under general range-type source conditions. Furthermore, some converse results of SAR are verified. Two iterative schemes are developed for the numerical realization of SAR, and the convergence analyses of these two numerical schemes are also provided. A toy example and a real-world problem of biosensor tomography are studied to show the accuracy and the advantages of SAR: compared with the conventional deterministic regularization approaches for deterministic inverse problems, SAR can provide the uncertainty quantification of the quantity of interest, which can in turn be used to reveal and explicate the hidden information about real-world problems, usually obscured by the incomplete mathematical modeling and the ascendence of complex-structured noise.


title: Analytic torsion for graphs

abstract: Analytic torsion is a functional on graphs which only needs linear algebra to be defined. In the continuum it corresponds to the Ray-Singer analytic torsion. We have formulas for analytic torsion if the graph is contractible or if it is a discrete sphere. A key insight is that analytic torsion is the super determinant of the Dirac operator of the graph.


title: Construction-free median quasi-Monte Carlo rules for function spaces with unspecified smoothness and general weights

abstract: We study quasi-Monte Carlo (QMC) integration of smooth functions defined over the multi-dimensional unit cube. Inspired by a recent work of Pan and Owen, we study a new construction-free median QMC rule which can exploit the smoothness and the weights of function spaces adaptively. For weighted Korobov spaces, we draw a sample of $r$ independent generating vectors of rank-1 lattice rules, compute the integral estimate for each, and approximate the true integral by the median of these $r$ estimates. For weighted Sobolev spaces, we use the same approach but with the rank-1 lattice rules replaced by high-order polynomial lattice rules. A major advantage over the existing approaches is that we do not need to construct good generating vectors by a computer search algorithm, while our median QMC rule achieves almost the optimal worst-case error rate for the respective function space with any smoothness and weights, with a probability that converges to 1 exponentially fast as $r$ increases. Numerical experiments illustrate and support our theoretical findings.


title: Generalized Spatially-Coupled Parallel Concatenated Codes With Partial Repetition

abstract: A new class of spatially-coupled turbo-like codes (SC-TCs), dubbed generalized spatially coupled parallel concatenated codes (GSC-PCCs), is introduced. These codes are constructed by applying spatial coupling on parallel concatenated codes (PCCs) with a fraction of information bits repeated $q$ times. GSC-PCCs can be seen as a generalization of the original spatially-coupled parallel concatenated codes proposed by Moloudi et al. [2]. To characterize the asymptotic performance of GSC-PCCs, we derive the corresponding density evolution equations and compute their decoding thresholds. The threshold saturation effect is observed and proven. Most importantly, we rigorously prove that any rate-$R$ GSC-PCC ensemble with 2-state convolutional component codes achieves at least a fraction $1-\frac{R}{R+q}$ of the capacity of the binary erasure channel (BEC) for repetition factor $q\geq2$ and this multiplicative gap vanishes as $q$ tends to infinity. To the best of our knowledge, this is the first class of SC-TCs that are proven to be capacity-achieving. Further, the connection between the strength of the component codes, the decoding thresholds of GSC-PCCs, and the repetition factor are established. The superiority of the proposed codes with finite blocklength is exemplified by comparing their error performance with that of existing SC-TCs via computer simulations.


title: Sub-Block Rearranged Staircase Codes

abstract: We propose a new family of spatially coupled product codes, called sub-block rearranged staircase (SR-staircase) codes. Each code block of SR-staircase codes is obtained by encoding rearranged preceding code blocks and new information block, where the rearrangement involves sub-blocks decomposition and transposition. The proposed codes can be constructed to have each code block size of $1/q$ to that of the conventional staircase codes while having the same rate and component codes, for any positive integer $q$. In this regard, we can use strong algebraic component codes to construct SR-staircase codes with a similar or the same code block size and rate as staircase codes with weak component codes. We characterize the decoding threshold of the proposed codes under iterative bounded distance decoding (iBDD) by using density evolution. We also derive the conditions under which they achieve a better decoding threshold than that of staircase codes. Further, we investigate the error floor performance by analyzing the contributing error patterns and their multiplicities. Both theoretical and simulation results show that the designed SR-staircase codes outperform staircase codes in terms of waterfall and error floor while the performance can be further improved by using a large coupling width.