title: Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks

abstract: Knowledge distillation which learns a lightweight student model by distilling knowledge from a cumbersome teacher model is an attractive approach for learning compact deep neural networks (DNNs). Recent works further improve student network performance by leveraging multiple teacher networks. However, most of the existing knowledge distillation-based multi-teacher methods use separately pretrained teachers. This limits the collaborative learning between teachers and the mutual learning between teachers and student. Network quantization is another attractive approach for learning compact DNNs. However, most existing network quantization methods are developed and evaluated without considering multi-teacher support to enhance the performance of quantized student model. In this paper, we propose a novel framework that leverages both multi-teacher knowledge distillation and network quantization for learning low bit-width DNNs. The proposed method encourages both collaborative learning between quantized teachers and mutual learning between quantized teachers and quantized student. During learning process, at corresponding layers, knowledge from teachers will form an importance-aware shared knowledge which will be used as input for teachers at subsequent layers and also be used to guide student. Our experimental results on CIFAR100 and ImageNet datasets show that the compact quantized student models trained with our method achieve competitive results compared to other state-of-the-art methods, and in some cases, indeed surpass the full precision models.


title: Three-Dimensional Propagation of Kink Wave Trains in Solar Coronal Slabs

abstract: Impulsively excited wave trains are of considerable interest in solar coronal seismology. To our knowledge, however, it remains to examine the three-dimensional (3D) dispersive propagation of impulsive kink waves in straight, field-aligned, symmetric, low-beta, slab equilibria that are structured only in one transverse direction. We offer a study here, starting with an analysis of linear oblique kink modes from an eigenvalue problem perspective. Two features are numerically found for continuous and step structuring alike, one being that the group and phase velocities may lie on opposite sides of the equilibrium magnetic field ($\vec{B}_0$), and the other being that the group trajectories extend only to a limited angle from $\vec{B}_0$. We justify these features by making analytical progress for the step structuring. More importantly, we demonstrate by a 3D time-dependent simulation that these features show up in the intricate interference patterns of kink wave trains that arise from a localized initial perturbation. In a plane perpendicular to the direction of inhomogeneity, the large-time slab-guided patterns are confined to a narrow sector about $\vec{B}_0$, with some wavefronts propagating toward $\vec{B}_0$. We conclude that the phase and group diagrams lay the necessary framework for understanding the complicated time-dependent behavior of impulsive waves.


title: Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout

abstract: Asynchronous learning protocols have regained attention lately, especially in the Federated Learning (FL) setup, where slower clients can severely impede the learning process. Herein, we propose \texttt{AsyncDrop}, a novel asynchronous FL framework that utilizes dropout regularization to handle device heterogeneity in distributed settings. Overall, \texttt{AsyncDrop} achieves better performance compared to state of the art asynchronous methodologies, while resulting in less communication and training time overheads. The key idea revolves around creating ``submodels'' out of the global model, and distributing their training to workers, based on device heterogeneity. We rigorously justify that such an approach can be theoretically characterized. We implement our approach and compare it against other asynchronous baselines, both by design and by adapting existing synchronous FL algorithms to asynchronous scenarios. Empirically, \texttt{AsyncDrop} reduces the communication cost and training time, while matching or improving the final test accuracy in diverse non-i.i.d. FL scenarios.


title: Motion Planning using Reactive Circular Fields: A 2D Analysis of Collision Avoidance and Goal Convergence

abstract: Recently, many reactive trajectory planning approaches were suggested in the literature because of their inherent immediate adaption in the ever more demanding cluttered and unpredictable environments of robotic systems. However, typically those approaches are only locally reactive without considering global path planning and no guarantees for simultaneous collision avoidance and goal convergence can be given. In this paper, we study a recently developed circular field (CF)-based motion planner that combines local reactive control with global trajectory generation by adapting an artificial magnetic field such that multiple trajectories around obstacles can be evaluated. In particular, we provide a mathematically rigorous analysis of this planner in a planar environment to ensure safe motion of the controlled robot. Contrary to existing results, the derived collision avoidance analysis covers the entire CF motion planning algorithm including attractive forces for goal convergence and is not limited to a specific choice of the rotation field, i.e., our guarantees are not limited to a specific potentially suboptimal trajectory. Our Lyapunov-type collision avoidance analysis is based on the definition of an (equivalent) two-dimensional auxiliary system, which enables us to provide tight, if and only if conditions for the case of a collision with point obstacles. Furthermore, we show how this analysis naturally extends to multiple obstacles and we specify sufficient conditions for goal convergence. Finally, we provide a challenging simulation scenario with multiple non-convex point cloud obstacles and demonstrate collision avoidance and goal convergence.


title: SeaDroneSim: Simulation of Aerial Images for Detection of Objects Above Water

abstract: Unmanned Aerial Vehicles (UAVs) are known for their fast and versatile applicability. With UAVs' growth in availability and applications, they are now of vital importance in serving as technological support in search-and-rescue(SAR) operations in marine environments. High-resolution cameras and GPUs can be equipped on the UAVs to provide effective and efficient aid to emergency rescue operations. With modern computer vision algorithms, we can detect objects for aiming such rescue missions. However, these modern computer vision algorithms are dependent on numerous amounts of training data from UAVs, which is time-consuming and labor-intensive for maritime environments. To this end, we present a new benchmark suite, SeaDroneSim, that can be used to create photo-realistic aerial image datasets with the ground truth for segmentation masks of any given object. Utilizing only the synthetic data generated from SeaDroneSim, we obtain 71 mAP on real aerial images for detecting BlueROV as a feasibility study. This result from the new simulation suit also serves as a baseline for the detection of BlueROV.


title: Spin and charge modulations of a half-filled extended Hubbard model

abstract: We introduce and analyze an extended Hubbard model, in which intersite Coulomb interaction as well as a staggered local potential (SLP) are considered, on the square lattice at half band filling, in the thermodynamic limit. Using both Hartree-Fock approximation and Kotliar and Ruckenstein slave boson formalism, we show that the model harbors charge order (CO) as well as joint spin and charge modulations (SCO) at finite values of the SLP, while the spin density wave (SDW) is stabilized for vanishing SLP, only. We determine their phase boundaries and the variations of the order parameters in dependence on the SLP, as well as on the on-site and nearest-neighbor interactions. Domains of coexistence of CO and SCO phases, suitable for resistive switching experiments, are unraveled. We show that the novel SCO systematically turns into the more conventional SDW phase when the zero-SLP limit is taken. We also discuss the nature of the different phase transitions, both at zero and finite temperature. In the former case, no continuous CO to SDW (or SCO) phase transition occurs. In contrast, a paramagnetic phase (PM), which is accompanied with continuous phase transitions towards both spin or charge ordered phases, sets in at finite temperature. A good quantitative agreement with numerical simulations is demonstrated, and a comparison between the two used approaches is performed.


title: Electron-hole asymmetry of quantum collective excitations in high-$T_c$ copper oxides

abstract: We carry out a systematic study of collective spin- and charge excitations for the canonical single-band Hubbard, $t$-$J$-$U$, and $t$-$J$ models of high-temperature copper-oxide superconductors, both on electron- and hole-doped side of the phase diagram. Recently developed variational wave function approach, combined with the expansion in inverse number of fermionic flavors, is employed. All three models exhibit a substantial electron-hole asymmetry of magnetic excitations, with a robust paramagnon emerging for hole-doping, in agreement with available resonant inelastic $x$-ray scattering data for the cuprates. The $t$-$J$ model yields additional high-energy peak in the magnetic spectrum that is not unambiguously identified in spectroscopy. For all considered Hamiltonians, the dynamical charge susceptibility contains a coherent mode for both hole- and electron doping, with overall bandwidth renormalization controlled by the on-site Coulomb repulsion. Away from the strong-coupling limit, the antiferromagnetic ordering tendency is more pronounced on electron-doped side of the phase diagram.


title: Towards prediction of turbulent flows at high Reynolds numbers using high performance computing data and deep learning

abstract: In this paper, deep learning (DL) methods are evaluated in the context of turbulent flows. Various generative adversarial networks (GANs) are discussed with respect to their suitability for understanding and modeling turbulence. Wasserstein GANs (WGANs) are then chosen to generate small-scale turbulence. Highly resolved direct numerical simulation (DNS) turbulent data is used for training the WGANs and the effect of network parameters, such as learning rate and loss function, is studied. Qualitatively good agreement between DNS input data and generated turbulent structures is shown. A quantitative statistical assessment of the predicted turbulent fields is performed.


title: Assessment of global warming in Al Buraimi, sultanate of Oman based on statistical analysis of NASA POWER data over 39 years, and testing the reliability of NASA POWER against meteorological measurements

abstract: We performed a number of statistical analysis methods on the historical data for the air temperature at 2 m above the ground and its range, as reported by the database of NASA known as POWER, which stands for Prediction Of Worldwide Energy Resources. The point of analysis is the University of Buraimi, located in Al Buraimi Governate, in the Northwest of the Sultanate of Oman, near its border with United Arab Emirates (UAE). The data is in the form of a value per day, for every day in the year. The data analyzed span the period from January 3rd, 1981 (earliest day available) to December 31st, 2019 (latest end-of-year available). The statistical analysis methods include: simple linear regression, F-test: two-sample for variances, analysis of variance (ANOVA): single factor, and t-test: two-sample assuming equal variances (pooled). The results show that the mean of the local 2-meter air temperature is increasing at a rate of about 0.039 {\deg}C per year, starting from an estimated value of 27.4 {\deg}C in 1980. For the standard deviation of the 2-meter air temperature, and the mean and standard deviation of its range; although a linear regression analysis suggests a decline over time, the regression coefficient is not significant. On the other hand, the analysis of variance for the 9 years 1981, 1985, 1990, 1995, 2000, 2005, 2010, 2015, 2019 suggests existence of statistical difference among them collectively, for the 2-meter air temperature and its range. In the second part of this work, NASA POWER data for the air temperature at 2 m above the ground, the atmospheric pressure, the relative humidity at 2 m above the ground, and the daily precipitation were compared with recorded sensor measurements at Manah meteorological station, located in Al Dakhiliyah Governate, in the Northeast of the Sultanate of Oman over all days of years 2011, 2012, 2015, and 2016.


title: Red riding on hood: Exploring how galaxy colour depends on environment

abstract: Galaxy populations are known to exhibit a strong colour bimodality, corresponding to blue star-forming and red quiescent subpopulations. The relative abundance of the two populations has been found to vary with stellar mass and environment. In this paper, we explore the effect of environment considering different types of measurements. We choose a sample of $49, 911$ galaxies with $0.05 < z < 0.18$ from the Galaxy And Mass Assembly survey. We study the dependence of the fraction of red galaxies on different measures of the local environment as well as the large-scale "geometric" environment defined by density gradients in the surround- ing cosmic web. We find that the red galaxy fraction varies with the environment at fixed stellar mass. The red fraction depends more strongly on local environmental measures than on large-scale geometric environment measures. By comparing the different environmental densities, we show that no density measurement fully explains the observed environmental red fraction variation, suggesting the different measures of environmental density contain different information. We test whether the local environmental measures, when combined together, can explain all the observed environmental red fraction variation. The geometric environment has a small residual effect, and this effect is larger for voids than any other type of geometric environment. This could provide a test of the physics applied to cosmological-scale galaxy evolution simulations as it combines large-scale effects with local environmental impact.


title: Intelligence and Global Bias in the Stock Market

abstract: Trade is one of the essential feature of human intelligence. The securities market is the ultimate expression of it. The fundamental indicators of stocks include information as well as the effects of noise and bias on the stock prices; however, identifying the effects of noise and bias is generally difficult. In this article, I present the true fundamentals hypothesis based on rational expectations and detect the global bias components from the actual fundamental indicators by using a log-normal distribution model based on the true fundamentals hypothesis. The analysis results show that biases generally exhibit the same characteristics, strongly supporting the true fundamentals hypothesis. Notably, the positive price-to-cash flows from the investing activities ratio is a proxy for the true fundamentals. Where do these biases come from? The answer is extremely simple: ``Cash is a fact, profit is an opinion.'' Namely, opinions of management and accounting are added to true fundamentals. As a result, Kesten process is realized and the Pareto distribution is to be obtained. This means that the market knows it and represents as a stable global bias in the stock market.


title: Towards Reliable Neural Specifications

abstract: Having reliable specifications is an unavoidable challenge in achieving verifiable correctness, robustness, and interpretability of AI systems. Existing specifications for neural networks are in the paradigm of data as specification. That is, the local neighborhood centering around a reference input is considered to be correct (or robust). While existing specifications contribute to verifying adversarial robustness, a significant problem in many research domains, our empirical study shows that those verified regions are somewhat tight, and thus fail to allow verification of test set inputs, making them impractical for some real-world applications. To this end, we propose a new family of specifications called neural representation as specification, which uses the intrinsic information of neural networks - neural activation patterns (NAPs), rather than input data to specify the correctness and/or robustness of neural network predictions. We present a simple statistical approach to mining neural activation patterns. To show the effectiveness of discovered NAPs, we formally verify several important properties, such as various types of misclassifications will never happen for a given NAP, and there is no ambiguity between different NAPs. We show that by using NAP, we can verify a significant region of the input space, while still recalling 84% of the data on MNIST. Moreover, we can push the verifiable bound to 10 times larger on the CIFAR10 benchmark. Thus, we argue that NAPs can potentially be used as a more reliable and extensible specification for neural network verification.


title: A new blow-up criterion for the 2D full compressible Navier-Stokes equations without heat conduction in a bounded domain

abstract: This paper is to derive a new blow-up criterion for the 2D full compressible Navier-Stokes equations without heat conduction in terms of the density $\rho$ and the pressure $P$. More precisely, it indicates that in a bounded domain the strong solution exists globally if the norm $\|\rho||_{{L^\infty(0,t;L^{\infty})}}+||P||_{L^{p_0}(0,t;L^\infty)}<\infty$ for some constant $p_0$ satisfying $1<p_0\leq 2$. The boundary condition is imposed as a Navier-slip boundary one and the initial vacuum is permitted. Our result extends previous one which is stated as $\|\rho||_{{L^\infty(0,t;L^{\infty})}}+||P||_{L^{\infty}(0,t;L^\infty)}<\infty$.


title: Adiabatic processes like isothermal processes

abstract: The objective of this work is to show that adiabatic processes can be very similar to isothermal ones. First, we show that the criteria for the compatibility of linear-response theory with the Second Law of Thermodynamics for thermally isolated systems are the same as those for systems performing isothermal processes. Motivated by such a result, we explore the thermodynamic consequences of the time-average excess work, observing an unexpected existence of a well-defined relaxation time for thermally isolated systems that obeys the Second Law of Thermodynamics. This is justified by recognizing that such systems, in the usual sense, present random relaxation time, which can be ``averaged'' by taking the time average of the relaxation function. Such a procedure is very similar to what happens in isothermal processes, where a stochastic average must be done on the relaxation function to have a well-defined relaxation time. In the end, we analyze the Landau-Zener model from this new point of view, discussing the construction of slowly-varying processes from linear-response theory and observing negative entropy production rates for non-monotonic and rapid protocols.


title: Improving the Transferability of Adversarial Attacks on Face Recognition with Beneficial Perturbation Feature Augmentation

abstract: Face recognition (FR) models can be easily fooled by adversarial examples, which are crafted by adding imperceptible perturbations on benign face images. The existence of adversarial face examples poses a great threat to the security of society. In order to build a more sustainable digital nation, in this paper, we improve the transferability of adversarial face examples to expose more blind spots of existing FR models. Though generating hard samples has shown its effectiveness in improving the generalization of models in training tasks, the effectiveness of utilizing this idea to improve the transferability of adversarial face examples remains unexplored. To this end, based on the property of hard samples and the symmetry between training tasks and adversarial attack tasks, we propose the concept of hard models, which have similar effects as hard samples for adversarial attack tasks. Utilizing the concept of hard models, we propose a novel attack method called Beneficial Perturbation Feature Augmentation Attack (BPFA), which reduces the overfitting of adversarial examples to surrogate FR models by constantly generating new hard models to craft the adversarial examples. Specifically, in the backpropagation, BPFA records the gradients on pre-selected feature maps and uses the gradient on the input image to craft the adversarial example. In the next forward propagation, BPFA leverages the recorded gradients to add beneficial perturbations on their corresponding feature maps to increase the loss. Extensive experiments demonstrate that BPFA can significantly boost the transferability of adversarial attacks on FR.


title: Imitation Learning-based Implicit Semantic-aware Communication Networks: Multi-layer Representation and Collaborative Reasoning

abstract: Semantic communication has recently attracted significant interest from both industry and academia due to its potential to transform the existing data-focused communication architecture towards a more generally intelligent and goal-oriented semantic-aware networking system. Despite its promising potential, semantic communications and semantic-aware networking are still at their infancy. Most existing works focus on transporting and delivering the explicit semantic information, e.g., labels or features of objects, that can be directly identified from the source signal. The original definition of semantics as well as recent results in cognitive neuroscience suggest that it is the implicit semantic information, in particular the hidden relations connecting different concepts and feature items that plays the fundamental role in recognizing, communicating, and delivering the real semantic meanings of messages. Motivated by this observation, we propose a novel reasoning-based implicit semantic-aware communication network architecture that allows multiple tiers of CDC and edge servers to collaborate and support efficient semantic encoding, decoding, and interpretation for end-users. We introduce a new multi-layer representation of semantic information taking into consideration both the hierarchical structure of implicit semantics as well as the personalized inference preference of individual users. We model the semantic reasoning process as a reinforcement learning process and then propose an imitation-based semantic reasoning mechanism learning (iRML) solution for the edge servers to leaning a reasoning policy that imitates the inference behavior of the source user. A federated GCN-based collaborative reasoning solution is proposed to allow multiple edge servers to jointly construct a shared semantic interpretation model based on decentralized knowledge datasets.


title: Quantification of CO2 generation in sedimentary basins through Carbonate Clays Reactions with uncertain thermodynamic parameters

abstract: We develop a methodological framework and mathematical formulation which yields estimates of the uncertainty associated with the amounts of CO2 generated by carbonate-clays reactions (CCR) in large-scale subsurface systems to assist characterization of the main features of this geochemical process. Our approach couples a one-dimensional compaction model, providing the dynamics of the evolution of porosity, temperature and pressure along the vertical direction, with a chemical model able to quantify the partial pressure of CO2 resulting from minerals and pore water interaction. The modeling framework we propose allows (i) estimating the depth at which the source of gases is located and (ii) quantifying the amount of CO2 generated, based on the mineralogy of the sediments involved in the basin formation process. A distinctive objective of the study is the quantification of the way the uncertainty affecting chemical equilibrium constants propagates to model outputs, i.e., the flux of CO2. These parameters are considered as key sources of uncertainty in our modeling approach because temperature and pressure distributions associated with deep burial depths typically fall outside the range of validity of commonly employed geochemical databases and typically used geochemical software. We also analyze the impact of the relative abundancy of primary phases in the sediments on the activation of CCR processes. As a test bed, we consider a computational study where pressure and temperature conditions are representative of those observed in real sedimentary formation. Our results are conducive to the probabilistic assessment of (i) the characteristic pressure and temperature at which CCR leads to generation of CO2 in sedimentary systems, (ii) the order of magnitude of the CO2 generation rate that can be associated with CCR processes.


title: Decay estimates for the time-fractional evolution equations with time-dependent coefficients

abstract: In this paper, the initial-boundary value problems for the time-fractional degenerate evolution equations are considered. Firstly, in the linear case, we obtain the optimal rates of decay estimates of the solutions. The decay estimates are also established for the time-fractional evolution equations with nonlinear operators such as: p-Laplacian, the porous medium operator, degenerate operator, mean curvature operator, and Kirchhoff operator. At the end, some applications of the obtained results are given to derive the decay estimates of global solutions for the time-fractional Fisher-KPP-type equation and the time-fractional porous medium equation with the nonlinear source.


abstract: A weakly distance-regular digraph is $P$-polynomial if its attached scheme is $P$-polynomial. In this paper, we characterize all $P$-polynomial weakly distance-regular digraphs.


title: Hyperbolicity and non-conservativity of a hydrodynamic model of swarming rigid bodies

abstract: In this paper, we study a nonlinear system of first order partial differential equations describing the macroscopic behavior of an ensemble of interacting self-propelled rigid bodies. Such system may be relevant for the modelling of bird flocks, fish schools or fleets of drones. We show that the system is hyperbolic and can be approximated by a conservative system through relaxation. We also derive viscous corrections to the model from the hydrodynamic limit of a kinetic model. This analysis prepares the future development of numerical approximations of this system.


title: On the Dehn functions of a class of monadic one-relation monoids

abstract: We give an infinite family of monoids $\Pi_N$ (for $N=2, 3, \dots$), each with a single defining relation of the form $bUa = a$, such that the Dehn function of $\Pi_N$ is at least exponential. More precisely, we prove that the Dehn function $\partial_N(n)$ of $\Pi_N$ satisfies $\partial_N(n) \succeq N^{n/4}$. This answers negatively a question posed by Cain & Maltcev in 2013 on whether every monoid defined by a single relation of the form $bUa=a$ has quadratic Dehn function. Finally, by using the decidability of the rational subset membership problem in the metabelian Baumslag--Solitar groups $\operatorname{BS}(1,n)$ for all $n \geq 2$, proved recently by Cadilhac, Chistikov & Zetzsche, we show that each $\Pi_N$ has decidable word problem.


title: Local Dirac Synchronization on Networks

abstract: We propose Local Dirac Synchronization which uses the Dirac operator to capture the dynamics of coupled nodes and link signals on an arbitrary network. In Local Dirac Synchronization, the harmonic modes of the dynamics oscillate freely while the other modes are interacting non-linearly, leading to a collectively synchronized state when the coupling constant of the model is increased. Local Dirac Synchronization is characterized by discontinuous transitions and the emergence of a rhythmic coherent phase. In this rhythmic phase, one of the two complex order parameters oscillates in the complex plane at a slow frequency (called emergent frequency) in the frame in which the intrinsic frequencies have zero average. Our theoretical results obtained within the annealed approximation are validated by extensive numerical results on fully connected networks and sparse Poisson and scale-free networks. Local Dirac Synchronization on both random and real networks, such as the connectome of Caenorhabditis Elegans, reveals the interplay between topology (Betti numbers and harmonic modes) and non-linear dynamics. This unveils how topology might play a role in the onset of brain rhythms.


title: BRATsynthetic: Text De-identification using a Markov Chain Replacement Strategy for Surrogate Personal Identifying Information

abstract: Objective: Implement and assess personal health identifying information (PHI) substitution strategies and quantify their privacy preserving benefits. Materials and Methods: We implement and assess 3 different `Hiding in Plain Sight` (HIPS) strategies for PHI replacement including a standard Consistent replacement strategy, a Random replacement strategy and a novel Markov model-based strategy. We evaluate the privacy preserving benefits of these strategies on a synthetic PHI distribution and real clinical corpora from 2 different institutions using a range of false negative error rates (FNER). Results: Using FNER ranging from 0.1% to 5% PHI leakage at the document level could be reduced from 27.1% to 0.1% (0.1% FNER) and from 94.2% to 57.7% (5% FNER) utilizing the Markov chain strategy versus the Consistent strategy on a corpus containing a diverse set of notes from the University of Alabama at Birmingham (UAB). The Markov chain substitution strategy also consistently outperformed the Consistent and Random substitution strategies in a MIMIC corpus of discharge summaries and on a range of synthetic clinical PHI distributions. Discussion: We demonstrate that a Markov chain surrogate generation strategy substantially reduces the chance of inadvertent PHI release across a range of assumed PHI FNER and release our implementation `BRATsynthetic` on Github. Conclusion: The Markov chain replacement strategy allows for the release of larger de-identified corpora at the same risk level relative to corpora released using a consistent HIPS strategy.


title: Fast Single Photon Detectors and real-time Key Distillation: Enabling High Secret Key Rate QKD Systems

abstract: Quantum Key Distribution has made continuous progress over the last 20 years and is now commercially available. However, the secret key rates (SKR) are still limited to a few Mbps. Here, we present a custom multipixel superconducting nanowire single-photon detectors and fast acquisition and real-time key distillation electronics, removing two roadblocks and allowing an increase of the SKR of more than an order of magnitude. In combination with a simple 2.5 GHz clocked time-bin quantum key distribution system, we can generate secret keys at a rate of 64 Mbps over a distance of 10.0 km and at a rate of 3.0 Mbps over a distance of 102.4 km with real-time key distillation.


title: Target-Speaker Voice Activity Detection via Sequence-to-Sequence Prediction

abstract: Target-speaker voice activity detection is currently a promising approach for speaker diarization in complex acoustic environments. This paper presents a novel Sequence-to-Sequence Target-Speaker Voice Activity Detection (Seq2Seq-TSVAD) method that can efficiently address the joint modeling of large-scale speakers and predict high-resolution voice activities. Experimental results show that larger speaker capacity and higher output resolution can significantly reduce the diarization error rate (DER), which achieves the new state-of-the-art performance of 4.55% on the VoxConverse test set and 10.77% on Track 1 of the DIHARD-III evaluation set under the widely-used evaluation metrics.


title: Branes wrapped on orbifolds and their gravitational blocks

abstract: We construct new supersymmetric $\mathrm{AdS}_2\times \mathbb{M}_4$ solutions of $D=6$ gauged supergravity, where $\mathbb{M}_4$ are certain four-dimensional orbifolds. After uplifting to massive type IIA supergravity these correspond to the near-horizon limit of a system of $N$ D4-branes and $N_f$ D8-branes wrapped on $\mathbb{M}_4$. In one class of solutions $\mathbb{M}_4 = \Sigma_{\mathrm{g}}\ltimes\Sigma$ is a spindle fibred over a smooth Riemann surface of genus $\mathrm{g}>1$, while in another class $\mathbb{M}_4 = \Sigma\ltimes\Sigma$ is a spindle fibred over another spindle. Both classes can be thought of as orbifold generalizations of Hirzebruch surfaces and, in the second case, we describe the solutions in terms of toric geometry. We show that the entropy associated with these solutions is reproduced by extremizing an entropy function obtained by gluing gravitational blocks, using a general recipe for orbifolds that we propose. We also discuss how our prescription can be used to define an off-shell central charge whose extremization reproduces the gravitational central charge of analogous $\mathrm{AdS}_3\times \mathbb{M}_4$ solutions of $D=7$ gauged supergravity, arising from wrapping M5-branes on $\mathbb{M}_4$.


title: Coherent Control of Trapped Ion Qubits with Localized Electric Fields

abstract: We present a new method for coherent control of trapped ion qubits in separate interaction regions of a multi-zone trap by simultaneously applying an electric field and a spin-dependent gradient. Both the phase and amplitude of the effective single-qubit rotation depend on the electric field, which can be localised to each zone. We demonstrate this interaction on a single ion using both laser-based and magnetic field gradients in a surface-electrode ion trap, and measure the localisation of the electric field.


title: Prospects for Constraining the Yukawa Gravity with Pulsars around Sagittarius A*

abstract: The discovery of radio pulsars (PSRs) around the supermassive black hole (SMBH) in our Galactic Center (GC), Sagittarius A* (Sgr A*), will have significant implications for tests of gravity. In this paper, we predict restrictions on the parameters of the Yukawa gravity by timing a pulsar around Sgr A* with a variety of orbital parameters. Based on a realistic timing accuracy of the times of arrival (TOAs), $\sigma_{\rm TOA}=100\,\mu{\rm s}$, and using a number of 960 TOAs in a 20-yr observation, our numerical simulations show that the PSR-SMBH system will improve current tests of the Yukawa gravity when the range of the Yukawa interaction varies between $10^{1}$-$10^{4}\,{\rm AU}$, and it can limit the graviton mass to be $m_g \lesssim 10^{-24}\,{\rm eV}/c^2$.


title: The eternal naked singularity formation in the case of gravitational collapse of generalized Vaydia spacetime

abstract: In this paper, we consider the gravitational collapse of generalized Vaidya space-time when the matter satisfies the equation of the state either $P=0$ or $P=-\alpha \rho$, where $0 < \alpha < 1$. We show that in the case when type I of matter field is dust, then the apparent horizon will never appear, but there is now a family of null radial future-directed geodesics which terminated at the central singularity in the past. Also, we show that in the case of negative pressure, the result of the gravitational collapse might be the naked singularity and the apparent horizon appears and in very short time disappears again. In the case of the negative pressure, we show that the result of the gravitational collapse might be the eternal naked singularity.


title: Spectral stability of weak dispersive shock profiles for quantum hydrodynamics with nonlinear viscosity

abstract: This paper studies the stability of weak dispersive shock profiles for a quantum hydrodynamics system in one space dimension with nonlinear viscosity and dispersive (quantum) effects due to a Bohm potential. It is shown that, if the shock amplitude is sufficiently small, then the profiles are spectrally stable. This analytical result is consistent with numerical estimations of the location of the spectrum (Lattanzio, Zhelyazov, Math. Models Methods Appl. Sci. 31, 2021). The proof is based on energy estimates at the spectral level, on the choice of an appropriate weighted energy function for the perturbations involving both the dispersive potential and the nonlinear viscosity, and on the montonicity of the dispersive profiles in the small-amplitude regime.


title: Stop Measuring Calibration When Humans Disagree

abstract: Calibration is a popular framework to evaluate whether a classifier knows when it does not know - i.e., its predictive probabilities are a good indication of how likely a prediction is to be correct. Correctness is commonly estimated against the human majority class. Recently, calibration to human majority has been measured on tasks where humans inherently disagree about which class applies. We show that measuring calibration to human majority given inherent disagreements is theoretically problematic, demonstrate this empirically on the ChaosNLI dataset, and derive several instance-level measures of calibration that capture key statistical properties of human judgements - class frequency, ranking and entropy.


title: Study of the Klein--Gordon equation for a hydrogenic model of dyons

abstract: This article presents the generalization of a zero spin hydrogen atom to a relativistic atomic model of hydrogen with dyons using the Klein--Gordon equation. The derivation of the Klein--Gordon equation for the particle of relative motion is shown. In addition, the analytical solutions of the equation are calculated in terms of Whittaker functions and Jacobi weighted polynomials. The discrete spectrum of energy, and the charge density of the orbiting dyon are presented. For a system of positive magnetic and electric charges in the nucleus and negative charges for the orbiting particle, and considering the first allowed values of $N$ and $l$, it was found that the dyon atom acts with a greater force of interaction between the charges of the nucleus and the secondary particle compared to the standard atom. It was obtained by comparing the distance between the nucleus and charge density concentrations from the dyon atom with the relativistic pionic atom.


title: History of two mass loss processes in VY CMa. Fast outflows carving older ejecta

abstract: Red supergiant stars (RSGs, Minit = 10-40Msun) are known to eject large amounts of material, as much as half of their initial mass during this evolutionary phase. However, the processes powering the mass ejection in low- and intermediate-mass stars do not work for RSGs and the mechanism that drives the ejection remains unknown. Different mechanisms have been proposed as responsible for this mass ejection but so far little is known about the actual processes taking place in these objects. Here we present high angular resolution interferometric ALMA maps of VY CMa continuum and molecular emission, which resolve the structure of the ejecta with unprecedented detail. The study of the molecular emission from the ejecta around evolved stars has been shown to be an essential tool in determining the characteristics of the mass loss ejections. Our aim is thus to use the information provided by these observations to understand the ejections undergone by VY CMa and to determine their possible origins. We inspected the kinematics of molecular emission observed. We obtained position-velocity diagrams and reconstructed the 3D structure of the gas traced by the different species. It allowed us to study the morphology and kinematics of the gas traced by the different species surrounding VY CMa. Two types of ejecta are clearly observed: extended, irregular, and vast ejecta surrounding the star that are carved by localized fast outflows. The structure of the outflows is found to be particularly flat. We present a 3D reconstruction of these outflows and proof of the carving. This indicates that two different mass loss processes take place in this massive star. We tentatively propose the physical cause for the formation of both types of structures. These results provide essential information on the mass loss processes of RSGs and thus of their further evolution.


title: Ultrasonic study and molecular simulation of propylene glycol at pressure up to 1.4 GPa

abstract: We report an ulsrasonic measurements of density and bulk modulus of propylene glycol at room temperature and at the temperature of liquid nitrogen combined with molecular dynamics simulations with two different force fields. We find that experimental density of propylene glycol at room temperature is well described within COMPASS force fields simulations, while the bulk modulus from simulation deviates from the experimental one. Number of hydrogen bonds in propylene glycol is also evaluated.


title: Topological Effects in Two-Dimensional Quantum Emitter Systems

abstract: In this work we discuss particular effects that take place in systems of quantum emitters coupled to two-dimensional bosonic topological insulators. For a single emitter coupled to the Haldane model, we find a "fragile" quasibound state that makes the emitter dynamics very sensitive to the model's parameters, and gives rise to effective long-range interactions that break time-reversal symmetry. We then discuss one-dimensional arrangements of emitters, emitter line defects, and how the topology of the bath affects the effective polariton models that appear in the weak-coupling regime when the emitters are spectrally tuned to a bandgap. In the Harper-Hofstadter model we link the non-monotonic character of the effective interactions to the Chern numbers of the surrounding energy bands, while in the Haldane model we show that the effective models are either gapless or not depending on the topology of the bath. Last, we discuss how the presence of emitters forming an ordered array, an emitter superlattice, can produce polariton models with non-trivial Chern numbers, and also modify the topology of the photonic states in the bath.


title: Gelfand--Graev functor and quantum affine Schur--Weyl duality

abstract: We explicate relations among the Gelfand--Graev modules for central covers, the Euler--Poincar\'e polynomial of the Arnold--Brieskorn manifold, and the quantum affine Schur--Weyl duality. These three objects and their relations are dictated by a permutation representation of the Weyl group. Specifically, our main result shows that for certain covers of $\mathrm{GL}(r)$ the Gelfand--Graev functor is related to quantum affine Schur--Weyl duality. Consequently, the commuting algebra of the Iwahori-fixed part of the Gelfand--Graev representation is the quotient of a quantum group.


title: Azimuthal correlations in Z+jets events in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The production of Z bosons associated with jets is measured in pp collisions at $\sqrt{s}$ = 13 TeV with data recorded with the CMS experiment at the LHC corresponding to an integrated luminosity of 36.3 fb$^{-1}$. The multiplicity of jets with transverse momentum $p_\mathrm{T}$ $\gt$ 30 GeV is measured for different regions of the Z boson's $p_\mathrm{T}$(Z), from lower than 10 GeV to higher than 100 GeV. The azimuthal correlation $\Delta \phi$ between the Z boson and the leading jet, as well as the correlations between the two leading jets are measured in three regions of $p_\mathrm{T}$(Z). The measurements are compared with several predictions at leading and next-to-leading orders, interfaced with parton showers. Predictions based on transverse-momentum dependent parton distributions and corresponding parton showers give a good description of the measurement in the regions where multiple parton interactions and higher jet multiplicities are not important. The effects of multiple parton interactions are shown to be important to correctly describe the measured spectra in the low $p_\mathrm{T}$(Z) regions.


title: Localized Randomized Smoothing for Collective Robustness Certification

abstract: Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g. misclassify several pixels). Collective robustness certification is the task of provably bounding the number of robust predictions under this threat model. The only dedicated method that goes beyond certifying each output independently is limited to strictly local models, where each prediction is associated with a small receptive field. We propose a more general collective robustness certificate for all types of models. We further show that this approach is beneficial for the larger class of softly local models, where each output is dependent on the entire input but assigns different levels of importance to different input regions (e.g. based on their proximity in the image). The certificate is based on our novel localized randomized smoothing approach, where the random perturbation strength for different input regions is proportional to their importance for the outputs. Localized smoothing Pareto-dominates existing certificates on both image segmentation and node classification tasks, simultaneously offering higher accuracy and stronger certificates.


title: Role of substrate clamping on anisotropy and domain structure in the canted antiferromagnet $\alpha$-Fe$_2$O$_3$

abstract: Antiferromagnets have recently been propelled to the forefront of spintronics by their high potential for revolutionizing memory technologies. For this, understanding the formation and driving mechanisms of the domain structure is paramount. In this work, we investigate the domain structure in a thin-film canted antiferromagnet $\alpha$-Fe$_2$O$_3$. We find that the internal destressing fields driving the formation of domains do not follow the crystal symmetry of $\alpha$-Fe$_2$O$_3$, but fluctuate due to substrate clamping. This leads to an overall isotropic distribution of the N\'eel order with locally varying effective anisotropy in antiferromagnetic thin films. Furthermore, we show that the weak ferromagnetic nature of $\alpha$-Fe$_2$O$_3$ leads to a qualitatively different dependence on magnetic field compared to collinear antiferromagnets such as NiO. The insights gained from our work serve as a foundation for further studies of electrical and optical manipulation of the domain structure of antiferromagnetic thin films.


title: Federated Learning for Chronic Obstructive Pulmonary Disease Classification with Partial Personalized Attention Mechanism

abstract: Chronic Obstructive Pulmonary Disease (COPD) is the fourth leading cause of death worldwide. Yet, COPD diagnosis heavily relies on spirometric examination as well as functional airway limitation, which may cause a considerable portion of COPD patients underdiagnosed especially at the early stage. Recent advance in deep learning (DL) has shown their promising potential in COPD identification from CT images. However, with heterogeneous syndromes and distinct phenotypes, DL models trained with CTs from one data center fail to generalize on images from another center. Due to privacy regularizations, a collaboration of distributed CT images into one centralized center is not feasible. Federated learning (FL) approaches enable us to train with distributed private data. Yet, routine FL solutions suffer from performance degradation in the case where COPD CTs are not independent and identically distributed (Non-IID). To address this issue, we propose a novel personalized federated learning (PFL) method based on vision transformer (ViT) for distributed and heterogeneous COPD CTs. To be more specific, we partially personalize some heads in multiheaded self-attention layers to learn the personalized attention for local data and retain the other heads shared to extract the common attention. To the best of our knowledge, this is the first proposal of a PFL framework specifically for ViT to identify COPD. Our evaluation of a dataset set curated from six medical centers shows our method outperforms the PFL approaches for convolutional neural networks.


title: Overlap reduction functions for a polarized stochastic gravitational-wave background in the Einstein Telescope-Cosmic Explorer and the LISA-Taiji networks

abstract: The detection of gravitational waves from the coalescences of binary compact stars by current interferometry experiments has opened up a new era of gravitational-wave astrophysics and cosmology. The search for a stochastic gravitational-wave background is underway by correlating signals from a pair of detectors in the detector network formed by the LIGO, Virgo, and KAGRA. In a previous work, we have developed a method based on spherical harmonic expansion to calculate the overlap reduction functions of the LIGO-Virgo-KAGRA network for a polarized stochastic gravitational-wave background. In this work, we will apply the method to calculate the overlap reduction functions of third-generation detectors such as a ground-based network linking the Einstein Telescope, the Cosmic Explorer, and the LISA-Taiji joint space mission.


title: Towards trustworthy multi-modal motion prediction: Holistic evaluation and interpretability of outputs

abstract: Predicting the motion of other road agents enables autonomous vehicles to perform safe and efficient path planning. This task is very complex, as the behaviour of road agents depends on many factors and the number of possible future trajectories can be considerable (multi-modal). Most prior approaches proposed to address multi-modal motion prediction are based on complex machine learning systems that have limited interpretability. Moreover, the metrics used in current benchmarks do not evaluate all aspects of the problem, such as the diversity and admissibility of the output. In this work, we aim to advance towards the design of trustworthy motion prediction systems, based on some of the requirements for the design of Trustworthy Artificial Intelligence. We focus on evaluation criteria, robustness, and interpretability of outputs. First, we comprehensively analyse the evaluation metrics, identify the main gaps of current benchmarks, and propose a new holistic evaluation framework. We then introduce a method for the assessment of spatial and temporal robustness by simulating noise in the perception system. To enhance the interpretability of the outputs and generate more balanced results in the proposed evaluation framework, we propose an intent prediction layer that can be attached to multi-modal motion prediction models. The effectiveness of this approach is assessed through a survey that explores different elements in the visualization of the multi-modal trajectories and intentions. The proposed approach and findings make a significant contribution to the development of trustworthy motion prediction systems for autonomous vehicles, advancing the field towards greater safety and reliability.


title: Anisotropic optics and gravitational lensing of tilted Weyl fermions

abstract: We show that tilted Weyl semimetals with a spatially varying tilt of the Weyl cones provide a platform for studying analogues to problems in anisotropic optics as well as curved spacetime. Considering particular tilting profiles, we numerically evaluate the time evolution of electronic wave packets and their current densities. We demonstrate that electron trajectories in such systems can be obtained from Fermat's principle in the presence of an inhomogeneous, anisotropic effective refractive index. On the other hand, we show how the electrons dynamics reveal gravitational features and use them to simulate gravitational lensing around a synthetic black hole. These results bridge optical and gravitational analogies in Weyl semimetals, suggesting novel pathways for experimental solid-state electron optics.


title: Wave-Scattering processes: path-integrals designed for the numerical handling of complex geometries

abstract: Relying on Feynman-Kac path-integral methodology, we present a new statistical perspective on wave single-scattering by complex three-dimensional objects. The approach is implemented on three models -- Schiff approximation, Born approximation and rigorous Born series -- and usual interpretative difficulties such as the analysis of moments over scatterer distributions (size, orientation, shape...) are addressed. In terms of computational contribution, we show that commonly recognized features of Monte Carlo method with respect to geometric complexity can now be available when solving electromagnetic scattering.

categories: physics.bio-ph physics.comp-ph physics.data-an physics.optics


title: Modeling structure-building in the brain with CCG parsing and large language models

abstract: To model behavioral and neural correlates of language comprehension in naturalistic environments researchers have turned to broad-coverage tools from natural-language processing and machine learning. Where syntactic structure is explicitly modeled, prior work has relied predominantly on context-free grammars (CFG), yet such formalisms are not sufficiently expressive for human languages. Combinatory Categorial Grammars (CCGs) are sufficiently expressive directly compositional models of grammar with flexible constituency that affords incremental interpretation. In this work we evaluate whether a more expressive CCG provides a better model than a CFG for human neural signals collected with fMRI while participants listen to an audiobook story. We further test between variants of CCG that differ in how they handle optional adjuncts. These evaluations are carried out against a baseline that includes estimates of next-word predictability from a Transformer neural network language model. Such a comparison reveals unique contributions of CCG structure-building predominantly in the left posterior temporal lobe: CCG-derived measures offer a superior fit to neural signals compared to those derived from a CFG. These effects are spatially distinct from bilateral superior temporal effects that are unique to predictability. Neural effects for structure-building are thus separable from predictability during naturalistic listening, and those effects are best characterized by a grammar whose expressive power is motivated on independent linguistic grounds.


title: Mixing across stable density interfaces in forced stratified turbulence

abstract: Understanding how turbulence enhances irreversible scalar mixing in density-stratified fluids is a central problem in geophysical fluid dynamics. While isotropic overturning regions are commonly the focus of mixing analyses, we here investigate whether significant mixing may arise in anisotropic statically-stable regions of the flow. Focusing on a single forced direct numerical simulation of stratified turbulence, we analyze spatial correlations between the vertical density gradient $\partial\rho/\partial z$ and the dissipation rates of kinetic energy $\epsilon$ and scalar variance $\chi$, the latter quantifying scalar mixing. The domain is characterized by relatively well-mixed density layers separated by sharp stable interfaces that are correlated with high vertical shear. While static instability is most prevalent within the mixed layers, much of the scalar mixing is localized to the intervening interfaces, a phenomenon not apparent if considering local static instability or $\epsilon$ alone. While the majority of the domain is characterized by the canonical flux coefficient $\Gamma\equiv\chi/\epsilon=0.2$, often assumed in ocean mixing parameterizations, extreme values of $\chi$ within the statically-stable interfaces, associated with elevated $\Gamma$, strongly skew the bulk statistics. Our findings suggest that current parameterizations of turbulent mixing may be biased by undersampling, such that the most common, but not necessarily the most significant, mixing events are overweighted. Having focused here on a single simulation of stratified turbulence, it is hoped that our results motivate a broader investigation into the role played by stable density interfaces in mixing, across a wider range of parameters and forcing schemes representative of ocean turbulence.


title: Evaporation of water and urea solution in a magnetic field; the role of nuclear isomers

abstract: Hypothesis. Ortho and para water are the two nuclear isomers where the hydrogen protons align to give a total nuclear spin of 0 or 1.The equilibrium ratio of 3:1 is established slowly in freshly evaporated water vapour and the isomers then behave distinct gasses, with their own partial pressures. Magnetic-field-induced ortho to para transformations are expected to alter the evaporation rate. Experiment. Evaporation from beakers of deionized water and a 6 M solution of urea is monitored simultaneously for periods from 1 to 60 hours with and without a 500 mT magnetic field, while logging the ambient temperature and humidity. The balances with the two beakers are shielded in the same Perspex container. Many runs have been conducted over a two-year period. Findings. The evaporation rate of water is found to increase by 12 % of in the field but that of water in urea solution decreases by 28 6 %. Two effects are at play. One is dephasing of the Larmor precession of adjacent protons on a water molecule in a field gradient, which tends to equalize the isomer populations. The other is Lorentz stress on the moving charge dipole, which can increase the proportion of the ortho isomer. From analysis of the time and field dependence of the evaporation, we infer an ortho fraction of 39 % in fresh vapour from water and 60 % in fresh vapour from urea.


title: The centroid Banach-Mazur distance between the parallelogram and the triangle

abstract: Let $C$ and $D$ be convex bodies in the Euclidean space $E^d$. We define the centroid Banach-Mazur distance $\delta_{BM}^{\rm cen} (C, D)$ similarly to the classic Banach-Mazur distance $\delta_{BM} (C, D)$, but with the extra requirement that the centroids of $C$ and an affine image of $D$ coincide. We prove that for the parallelogram $P$ and the triangle $T$ in $E^2$ we have $\delta_{BM}^{\rm cen} (P, T) = \frac{5}{2}$.


title: An approach for projecting the timing of abrupt winter Arctic sea ice loss

abstract: Abrupt and irreversible winter Arctic sea-ice loss may occur under anthropogenic warming due to the collapse of a sea-ice equilibrium at a threshold value of CO$_2$, commonly referred to as a tipping point. Previous work has been unable to conclusively identify whether a tipping point in Arctic sea ice exists because fully-coupled climate models are too computationally expensive to run to equilibrium for many CO$_2$ values. Here, we explore the deviation of sea ice from its equilibrium state under realistic rates of CO$_2$ increase to demonstrate how a few time-dependent CO$_2$ experiments can be used to predict the existence and timing of sea-ice tipping points without running the model to steady-state. This study highlights the inefficacy of using a single experiment with slow-changing CO$_2$ to discover changes in the sea-ice steady-state, and provides an alternate method that can be developed for the identification of tipping points in realistic climate models.


title: Limit laws for functionals of self-intersection symmetric alpha-stable processes

abstract: In this paper, we prove two limit laws for functionals of self-intersection symmetric alpha-stable processes with alpha\in(1,2). The results are obtained based on the method of moments, the sample configuration and the chaining argument introduced in (Nualart and Xu 2013) are employed.


title: The MacWilliams Identity for the Skew Rank Metric

abstract: The weight distribution of an error correcting code is a crucial statistic in determining it's performance. One key tool for relating the weight of a code to that of it's dual is the MacWilliams Identity, first developed for the Hamming metric. This identity has two forms: one is a functional transformation of the weight enumerators, while the other is a direct relation of the weight distributions via (generalised) Krawtchouk polynomials. The functional transformation form can in particular be used to derive important moment identities for the weight distribution of codes. In this paper, we focus on codes in the skew rank metric. In these codes, the codewords are skew-symmetric matrices, and the distance between two matrices is the skew rank metric, which is half the rank of their difference. This paper develops a $q$-analog MacWilliams Identity in the form of a functional transformation for codes based on skew-symmetric matrices under their associated skew rank metric. The method introduces a skew-$q$ algebra and uses generalised Krawtchouk polynomials. Based on this new MacWilliams Identity, we then derive several moments of the skew rank distribution for these codes.


title: Chirality-induced intrinsic charge rectification in a tellurium-based field-effect transistor

abstract: We report gate-induced enhancement of intrinsic charge rectification without p-n junctions in chiral semiconductor Te under magnetic field B. As gating shifts the chemical potential to the valence band maximum of Te, the charge rectification efficiency is enhanced hundredfold. By integrating model calculations, we attribute the charge rectification to the B-induced asymmetry of the chiral band structure. We also show that the carrier density subject to this asymmetry is augmented by a saddle-point structure near the valence band maximum, which further enhances the gate-tunable charge rectification together with its improved switchability and thermal robustness.


title: "Rust Belt" Across America: An Application of a Nationwide, Block-Group-Level Deprivation Index

abstract: In the United States, large post-industrial cites such as Detroit are well-known for high levels of socioeconomic deprivation. But while Detroit is an exceptional case, similar levels of deprivation can still be found in other large cities, as well as in smaller towns and rural areas. This study calculates a standardized measure for all block groups in the lower 48 states and DC, before isolating "high-deprivation" areas that exceed Detroit's median value. These block groups are investigated and mapped for the 83 cities with populations above 250,000, as well as at the state level and for places of all sizes. Detroit is shown to indeed be unique not only for its levels of deprivation (which are higher than 95 percent of the country), but also for the dispersion of highly-deprived block groups throughout the city. Smaller, more concentrated pockets of high deprivation can be found in nearly every large city, and some cities below 20,000 residents have an even larger share of high-deprivation areas. Cities' percentages of high-deprivation areas are positively related to overall poverty, population density, and the percentage of White residents, and negatively related to the share of Black residents.


title: Reliability of CKA as a Similarity Measure in Deep Learning

abstract: Comparing learned neural representations in neural networks is a challenging but important problem, which has been approached in different ways. The Centered Kernel Alignment (CKA) similarity metric, particularly its linear variant, has recently become a popular approach and has been widely used to compare representations of a network's different layers, of architecturally similar networks trained differently, or of models with different architectures trained on the same data. A wide variety of conclusions about similarity and dissimilarity of these various representations have been made using CKA. In this work we present analysis that formally characterizes CKA sensitivity to a large class of simple transformations, which can naturally occur in the context of modern machine learning. This provides a concrete explanation of CKA sensitivity to outliers, which has been observed in past works, and to transformations that preserve the linear separability of the data, an important generalization attribute. We empirically investigate several weaknesses of the CKA similarity metric, demonstrating situations in which it gives unexpected or counter-intuitive results. Finally we study approaches for modifying representations to maintain functional behaviour while changing the CKA value. Our results illustrate that, in many cases, the CKA value can be easily manipulated without substantial changes to the functional behaviour of the models, and call for caution when leveraging activation alignment metrics.


title: A Quantum Repeater Platform based on Single SiV$^-$ Centers in Diamond with Cavity-Assisted, All-Optical Spin Access and Fast Coherent Driving

abstract: Quantum key distribution enables secure communication based on the principles of quantum mechanics. The distance in fiber-based quantum communication is limited to about a hundred kilometers due to signal attenuation. Thus, quantum repeaters are required to establish large-scale quantum networks. Ideal quantum repeater nodes possess a quantum memory which is efficiently connected to photons, the carrier of quantum information. Color centers in diamond and, in particular, the negatively-charged silicon-vacancy centers are promising candidates to establish such nodes. The major obstacle is an inefficient connection between the color centers spin to the Gaussian optics of fiber networks. Here, we present an efficient spin-photon interface. Individual silicon-vacancy centers coupled to the mode of a hemispherical Fabry-P\'erot microcavity show Purcell-factors larger than 1 when operated in a bath of liquid Helium. We demonstrate coherent optical driving with a Rabi frequency of $290\,\mathrm{MHz}$ and all-optical access to the electron spin in strong magnetic fields of up to $3.2\,\mathrm{T}$. Spin initialization within $67\,\mathrm{ns}$ with a fidelity of $80\,\%$ and a lifetime of $350\,\mathrm{ns}$ are reached inside the cavity. The spin-photon interface is passively stable, enabled by placing a color center containing nanodiamond in the hemispherical Fabry-P\'erot mirror structure and by choosing short cavity lengths. Therefore, our demonstration opens the way to realize quantum repeater applications.


title: A trajectorial approach to entropy dissipation for degenerate parabolic equations

abstract: We consider degenerate diffusion equations of the form $\partial_tp_t = \Delta f(p_t)$ on a bounded domain and subject to no-flux boundary conditions, for a class of nonlinearities $f$ that includes the porous medium equation. We derive for them a trajectorial analogue of the entropy dissipation identity, which describes the rate of entropy dissipation along every path of the diffusion. Our approach is based on applying stochastic calculus to the underlying probabilistic representations, which in our context are stochastic differential equations with normal reflection on the boundary. This trajectorial approach also leads to a new derivation of the Wasserstein gradient flow property for nonlinear diffusions, as well as to a simple proof of the HWI inequality in the present context.


title: Power-Yang-Mills black holes and black branes in quartic quasi-topological gravity

abstract: We study higher dimensional quartic quasi-topological black holes in the framework of non-abelian power-Yang-Mills theory. It is shown that real solutions of the gravitational field equations exist only for positive values of quartic quasi-topological coefficient. Depending on the values of the mass parameter and Yang-Mills charge, they can be interpreted as black holes with one horizon, two horizons and naked singularity. It is also shown that the solution associated with these black holes has an essential curvature singularity at the centre $r=0$. Thermodynamic and conserved quantities for these black holes are computed and we show that the first law has been verified. We also check thermodynamic stability in both canonical and grand canonical ensembles. In addition to this, we also formulate new power-Yang-Mills black hole solutions in pure quasi-topological gravity. The physical and thermodynamic properties of these black holes are discussed as well. It is concluded that unlike Yang-Mills black holes there exist stability regions for smaller power-Yang-Mills black holes in grand canonical ensemble. Finally, we discuss the thermodynamics of horizon flat power-Yang-Mills rotating black branes and analyze their thermodynamic and conserved quantities by using the counter-term method inspired by AdS/CFT correspondence.


title: Some Remarks on Counting Propositional Logic

abstract: Counting propositional logic was recently introduced in relation to randomized computation and shown able to logically characterize the full counting hierarchy. In this paper we aim to clarify the intuitive meaning and expressive power of its univariate fragment. On the one hand, we provide an effective procedure to measure the probability of counting formulas. On the other, we make the connection between this logic and stochastic experiments explicit, proving that the counting language can simulate any (and only) event associated with dyadic distributions.


title: GermanIum Array for Non-destructive Testing (GIANT) setup for Muon Induced X-ray Emission (MIXE) at the Paul Scherrer Institute

abstract: The usage of muonic X-rays to study elemental properties like nuclear radii ranges back to the seventies. This triggered the pioneering work at the Paul Scherrer Institute (PSI), during the eighties, on the Muon Induced X-ray Emission (MIXE) technique for a non-destructive assessment of elemental compositions. In the recent years, this method has seen a rebirth, improvement and adoption at most muon facilities around the world. Hereby, the PSI offers unique capabilities with its high-rate continuous muon beam at the Swiss Muon Source (S$\mu$S). We report here the decision making, construction and commissioning of a dedicated MIXE spectrometer at PSI, the GermanIum Array for Non-destructive Testing (GIANT) setup. Multiple campaigns highlighted the outstanding capabilities of MIXE at PSI, e.g. resolving down to 1 at% elemental concentrations with as little as 1 h data taking, measuring isotopic ratios for elements from iron to lead, and characterizing gamma rays induced by muon nuclear capture. On-target beamspots were characterized with a dedicated charged particle tracker to be 22.06$\pm$0.18 and 14.45$\pm$0.06 mm for 25 and 45 MeV/c, respectively. Advanced analysis of the High Purity Germanium (HPGe) signals further allows to improve energy and timing resolutions to ~1 keV and 20 ns at 1 MeV, respectively. Within the GIANT setup, an average detector has a photopeak efficiency of $\overline{\epsilon_E}$ =0.11% and an energy resolution of $\overline{\sigma_E}$ = 0.8 keV at E=1000 keV. The overall performance of the GIANT setup at S$\mu$S allowed to start a rich user program with archaeological samples, Li-ion battery research, and collaboration with industry. Future improvements will include a simulation based analysis and a higher degree of automation, e.g. automatic scans of a series of muon momenta and automatic sample changing.


title: Are Neural Topic Models Broken?

abstract: Recently, the relationship between automated and human evaluation of topic models has been called into question. Method developers have staked the efficacy of new topic model variants on automated measures, and their failure to approximate human preferences places these models on uncertain ground. Moreover, existing evaluation paradigms are often divorced from real-world use. Motivated by content analysis as a dominant real-world use case for topic modeling, we analyze two related aspects of topic models that affect their effectiveness and trustworthiness in practice for that purpose: the stability of their estimates and the extent to which the model's discovered categories align with human-determined categories in the data. We find that neural topic models fare worse in both respects compared to an established classical method. We take a step toward addressing both issues in tandem by demonstrating that a straightforward ensembling method can reliably outperform the members of the ensemble.


title: Scalar curvature under the collapse of metric

abstract: We prove a formula involving the scalar curvature of a Riemannian manifold endowed with a distribution in terms of an adapted orthonormal frame for its tangent bundle. Using the formula, we then investigate the effect of collapsing the metric along the distribution on the scalar curvature. This result contributes to the question of finding a positive scalar curvature metric on a Riemannian manifold.


title: Phase space localizing operators

abstract: We construct phase space localizing operators in all dimensions. These are frequency localized variants of the conditional expectation operator related to a dyadic stopping time. Our construction is an improvement over the so-called phase plane projections of Muscalu, Tao and the third author in one dimension. The motivation for such operators comes from time-frequency analysis. They are used in particular to prove uniform estimates for multilinear modulation invariant operators.


title: On Modular Gray Map

abstract: This paper introduces an isometry between the modular rings $\Z_{2^s}$ and $\Z_{2^{s-1}}$ with respect to the homogeneous weights. Certain product of these maps gives Carlet's generalised Gray map and also Vega's Gray map. For $s=2$ this reduces to popular Gray map. Several interesting properties of these maps are studied. Towards the end we list several interesting problems to work on.


title: CMB power spectrum in the emergent universe with k-essence

abstract: The emergent universe provides a possible method to avoid the big bang singularity by considering that the universe stems from an stable Einstein static universe rather than the singularity. Since the Einstein static universe exists before inflation, it may leave some relics in the CMB power spectrum. In this paper, we analyze the stability condition for the Einstein static universe in general relativity with k-essence against both the scalar and tensor perturbations. And we find the emergent universe can be successfully realized by constructing a scalar potential and an equation of state parameter. Solving the curved Mukhanov-Sasaki equation, we obtain the analytical approximation for the primordial power spectrum, and then depict the TT-spectrum of the emergent universe. The results show that both the primordial power spectrum and CMB TT-spectrum are suppressed on large scales.


title: Structural ensembles of disordered proteins from hierarchical chain growth and simulation

abstract: Disordered proteins and nucleic acids play key roles in cellular function and disease. Here we review recent advances in the computational exploration of the conformational dynamics of flexible biomolecules. We focus on hierarchical chain growth (HCG) from fragment libraries built with atomistic molecular dynamics simulations. HCG combines chain fragments in a statistically reproducible manner into ensembles of full-length atomically detailed biomolecular structures. The input fragment structures are typically collected from molecular dynamics simulations, but could also come from structural databases. Experimental data can be integrated during and after chain assembly. Applications to the neurodegeneration-linked proteins $\alpha$-synuclein, tau, and TDP-43, including as condensate, illustrate the use of HCG. We conclude by highlighting the emerging connections to AI-based structural modeling.


title: Feature Engineering vs BERT on Twitter Data

abstract: In this paper, we compare the performances of traditional machine learning models using feature engineering and word vectors and the state-of-the-art language model BERT using word embeddings on three datasets. We also consider the time and cost efficiency of feature engineering compared to BERT. From our results we conclude that the use of the BERT model was only worth the time and cost trade-off for one of the three datasets we used for comparison, where the BERT model significantly outperformed any kind of traditional classifier that uses feature vectors, instead of embeddings. Using the BERT model for the other datasets only achieved an increase of 0.03 and 0.05 of accuracy and F1 score respectively, which could be argued makes its use not worth the time and cost of GPU.


title: LOFT: Finding Lottery Tickets through Filter-wise Training

abstract: Recent work on the Lottery Ticket Hypothesis (LTH) shows that there exist ``\textit{winning tickets}'' in large neural networks. These tickets represent ``sparse'' versions of the full model that can be trained independently to achieve comparable accuracy with respect to the full model. However, finding the winning tickets requires one to \emph{pretrain} the large model for at least a number of epochs, which can be a burdensome task, especially when the original neural network gets larger. In this paper, we explore how one can efficiently identify the emergence of such winning tickets, and use this observation to design efficient pretraining algorithms. For clarity of exposition, our focus is on convolutional neural networks (CNNs). To identify good filters, we propose a novel filter distance metric that well-represents the model convergence. As our theory dictates, our filter analysis behaves consistently with recent findings of neural network learning dynamics. Motivated by these observations, we present the \emph{LOttery ticket through Filter-wise Training} algorithm, dubbed as \textsc{LoFT}. \textsc{LoFT} is a model-parallel pretraining algorithm that partitions convolutional layers by filters to train them independently in a distributed setting, resulting in reduced memory and communication costs during pretraining. Experiments show that \textsc{LoFT} $i)$ preserves and finds good lottery tickets, while $ii)$ it achieves non-trivial computation and communication savings, and maintains comparable or even better accuracy than other pretraining methods.


title: A new sensing paradigm for the vibroacoustic detection of pedicle screw loosening

abstract: There is an unmet clinical need for developing novel methods to complement and replace the current radiation-emitting imaging-based methods for the detection of loose pedicle screws as a complication after spinal fusion surgery which fail to identify a substantial amount of loose implants. In this work, we propose a new methodology and paradigm for the radiation-free, non-destructive, and easy-to-integrate detection of pedicle screw loosening based on vibroacoustic sensing. Furthermore, we propose a novel simulation technique for pedicle screw loosening, which is biomechanically validated. For the detection of a loose implant, we excite the vertebra of interest with a sine sweep vibration at the spinous process and attach a custom highly-sensitive piezo contact microphone to the screw head to capture the propagated vibration characteristics which are analyzed using a detection pipeline based on spectrogram features and a SE-ResNet-18. To validate the proposed approach, we conducted experiments using four human cadaveric lumbar spine specimens and evaluate our algorithm in a cross validation experiment. Our method reaches a sensitivity of 91.50 +- 6.58% and a specificity of 91.10 +- 2.27%. The proposed system shows great potentials for the development of alternative assessment methods for implant loosening based on vibroacoustic sensing.


title: Vanishing Component Analysis with Contrastive Normalization

abstract: Vanishing component analysis (VCA) computes approximate generators of vanishing ideals of samples, which are further used for extracting nonlinear features of the samples. Recent studies have shown that normalization of approximate generators plays an important role and different normalization leads to generators of different properties. In this paper, inspired by recent self-supervised frameworks, we propose a contrastive normalization method for VCA, where we impose the generators to vanish on the target samples and to be normalized on the transformed samples. We theoretically show that a contrastive normalization enhances the discriminative power of VCA, and provide the algebraic interpretation of VCA under our normalization. Numerical experiments demonstrate the effectiveness of our method. This is the first study to tailor the normalization of approximate generators of vanishing ideals to obtain discriminative features.


title: Violation Probabilities of AoI and PAoI and Optimal Arrival Rate Allocation for the IoT-based Multi-Source Status Update System

abstract: Lots of real-time applications over Internet of things (IoT)-based status update systems have imperative demands on information freshness, which is usually evaluated by age of information (AoI). Compared to the average AoI and peak AoI (PAoI), violation probabilities and distributions of AoI and PAoI characterize the timeliness in more details. This paper studies the timeliness of the IoT-based multi-source status update system. By modeling the system as a multi-source M/G/1/1 bufferless preemptive queue, general formulas of violation probabilities and probability density functions (p.d.f.s) of AoI and PAoI are derived with a time-domain approach. For the case with negativeexponentially distributed service time, the violation probabilities and p.d.f.s are obtained in closed form. Moreover, the maximal violation probabilities of AoI and PAoI are proposed to characterize the overall timeliness. To improve the overall timeliness under the resource constraint of IoT-device, the arrival rate allocation scheme is used to minimize the maximal violation probabilities. It is proved that the optimal arrival rates can be found by convex optimization algorithms. In addition, it is obtained that the minimum of maximal violation probability of AoI (or PAoI) is achieved only if all violation probabilities of AoI (or PAoI) are equal. Finally, numerical results verify the theoretical analysis and show the effectiveness of the arrival rate allocation scheme.


title: Deep Learning Object Detection Approaches to Signal Identification

abstract: Traditionally source identification is solved using threshold based energy detection algorithms. These algorithms frequently sum up the activity in regions, and consider regions above a specific activity threshold to be sources. While these algorithms work for the majority of cases, they often fail to detect signals that occupy small frequency bands, fail to distinguish sources with overlapping frequency bands, and cannot detect any signals under a specified signal to noise ratio. Through the conversion of raw signal data to spectrogram, source identification can be framed as an object detection problem. By leveraging modern advancements in deep learning based object detection, we propose a system that manages to alleviate the failure cases encountered when using traditional source identification algorithms. Our contributions include framing source identification as an object detection problem, the publication of a spectrogram object detection dataset, and evaluation of the RetinaNet and YOLOv5 object detection models trained on the dataset. Our final models achieve Mean Average Precisions of up to 0.906. With such a high Mean Average Precision, these models are sufficiently robust for use in real world applications.


title: Multimodal Transformer for Parallel Concatenated Variational Autoencoders

abstract: In this paper, we propose a multimodal transformer using parallel concatenated architecture. Instead of using patches, we use column stripes for images in R, G, B channels as the transformer input. The column stripes keep the spatial relations of original image. We incorporate the multimodal transformer with variational autoencoder for synthetic cross-modal data generation. The multimodal transformer is designed using multiple compression matrices, and it serves as encoders for Parallel Concatenated Variational AutoEncoders (PC-VAE). The PC-VAE consists of multiple encoders, one latent space, and two decoders. The encoders are based on random Gaussian matrices and don't need any training. We propose a new loss function based on the interaction information from partial information decomposition. The interaction information evaluates the input cross-modal information and decoder output. The PC-VAE are trained via minimizing the loss function. Experiments are performed to validate the proposed multimodal transformer for PC-VAE.


title: Game-Theoretical Perspectives on Active Equilibria: A Preferred Solution Concept over Nash Equilibria

abstract: Multiagent learning settings are inherently more difficult than single-agent learning because each agent interacts with other simultaneously learning agents in a shared environment. An effective approach in multiagent reinforcement learning is to consider the learning process of agents and influence their future policies toward desirable behaviors from each agent's perspective. Importantly, if each agent maximizes its long-term rewards by accounting for the impact of its behavior on the set of convergence policies, the resulting multiagent system reaches an active equilibrium. While this new solution concept is general such that standard solution concepts, such as a Nash equilibrium, are special cases of active equilibria, it is unclear when an active equilibrium is a preferred equilibrium over other solution concepts. In this paper, we analyze active equilibria from a game-theoretic perspective by closely studying examples where Nash equilibria are known. By directly comparing active equilibria to Nash equilibria in these examples, we find that active equilibria find more effective solutions than Nash equilibria, concluding that an active equilibrium is the desired solution for multiagent learning settings.


title: A Novel Sparse Bayesian Learning and Its Application to Fault Diagnosis for Multistation Assembly Systems

abstract: This paper addresses the problem of fault diagnosis in multistation assembly systems. Fault diagnosis is to identify process faults that cause the excessive dimensional variation of the product using dimensional measurements. For such problems, the challenge is solving an underdetermined system caused by a common phenomenon in practice; namely, the number of measurements is less than that of the process errors. To address this challenge, this paper attempts to solve the following two problems: (1) how to utilize the temporal correlation in the time series data of each process error and (2) how to apply prior knowledge regarding which process errors are more likely to be process faults. A novel sparse Bayesian learning method is proposed to achieve the above objectives. The method consists of three hierarchical layers. The first layer has parameterized prior distribution that exploits the temporal correlation of each process error. Furthermore, the second and third layers achieve the prior distribution representing the prior knowledge of process faults. Then, these prior distributions are updated with the likelihood function of the measurement samples from the process, resulting in the accurate posterior distribution of process faults from an underdetermined system. Since posterior distributions of process faults are intractable, this paper derives approximate posterior distributions via Variational Bayes inference. Numerical and simulation case studies using an actual autobody assembly process are performed to demonstrate the effectiveness of the proposed method.


title: Are Leptons as elementary as Quarks?

abstract: Nucleons and electrons were once considered elementary particles, a role nowadays taken by quarks and leptons. Here, mainly at the group theoretical level, we examine the unorthodox idea that nucleons and electrons share the same level of compositeness after all. We do it by first trading color $SU(3)_C$ for color/leptocolor $SU(3)_C\times SU(3)_{\ell C}$ confining gauge symmetry. Standard model leptons, equipped with inherited Yukawa couplings, make then their appearance at the intermediate (gauge protected) $SU(3)_C\times SU(3)_L\times SU(3)_R$ trinification stage as three pre-lepton composites. The addition of an exclusively prescribed (on anomaly free and Pauli exclusion grounds) spontaneously broken $SU(3)_F$ horizontal link to the unification chain, in the spirit of "One three to rule them all", strikingly preserves the anti-symmetric structure of the single family fermionic wave function. The threefold quark/lepton (spectators + composites) flavor chiral representation is then necessarily supplemented by a trinification singlet composite Majorana neutrino. The scheme serendipitously predicts a novel anomaly free lepto/dark portal.


title: Vertex operators for imaginary $\mathfrak{gl}_2$ subalgebras in the Monster Lie Algebra

abstract: The Monster Lie algebra $\mathfrak m$ is a quotient of the physical space of the vertex algebra $V=V^\natural\otimes V_{1,1}$, where $V^\natural$ is the Moonshine module vertex operator algebra of Frenkel, Lepowsky, and Meurman, and $V_{1,1}$ is the vertex algebra corresponding to the rank 2 even unimodular lattice $\textrm{II}_{1,1}$. We construct vertex algebra elements that project to bases for subalgebras of $\mathfrak m$ isomorphic to $\mathfrak{gl}_{2}$, corresponding to each imaginary simple root, denoted $(1,j)$ for $j>0$. Our method requires the existence of pairs of primary vectors in $V^{\natural}$ satisfying some natural conditions, which we prove. We show that the action of the Monster finite simple group $\mathbb{M}$ on the subspace of primary vectors in $V^\natural$ induces an $\mathbb{M}$-action on the set of $\mathfrak{gl}_2$ subalgebras corresponding to a fixed imaginary simple root. We use the generating function for dimensions of subspaces of primary vectors of $V^\natural$ to prove that this action is non-trivial for small values of $j$.


title: A Population Dynamics Approach to the Distribution of Space Debris in Low Earth Orbit

abstract: The presence of debris in Earth's orbit poses a significant risk to human activity in outer space. This debris population continues to grow due to ground launches, loss of external parts from space ships, and uncontrollable collisions between objects. A computationally feasible continuum model for the growth of the debris population and its spatial distribution is therefore critical. Here we propose a diffusion-collision model for the evolution of debris density in Low-Earth Orbit (LEO) and its dependence on ground-launch policy. We parametrize this model and test it against data from publicly available object catalogs to examine timescales for uncontrolled growth. Finally, we consider sensible launch policies and cleanup strategies and how they reduce the future risk of collisions with active satellites or space ships.


title: Entanglement-Enhanced Optomechanical Sensing

abstract: Optomechanical systems have been exploited in ultrasensitive measurements of force, acceleration, and magnetic fields. The fundamental limits for optomechanical sensing have been extensively studied and now well understood -- the intrinsic uncertainties of the bosonic optical and mechanical modes, together with the backaction noise arising from the interactions between the two, dictate the Standard Quantum Limit (SQL). Advanced techniques based on nonclassical probes, in-situ pondermotive squeezed light, and backaction-evading measurements have been developed to overcome the SQL for individual optomechanical sensors. An alternative, conceptually simpler approach to enhance optomechanical sensing rests upon joint measurements taken by multiple sensors. In this configuration, a pathway toward overcoming the fundamental limits in joint measurements has not been explored. Here, we demonstrate that joint force measurements taken with entangled probes on multiple optomechanical sensors can improve the bandwidth in the thermal-noise-dominant regime or the sensitivity in shot-noise-dominant regime. Moreover, we quantify the overall performance of entangled probes with the sensitivity-bandwidth product and observe a 25% increase compared to that of the classical probes. The demonstrated entanglement-enhanced optomechanical sensing could enable new capabilities for inertial navigation, acoustic imaging, and searches for new physics.


title: Aggregation in the Mirror Space (AIMS): Fast, Accurate Distributed Machine Learning in Military Settings

abstract: Distributed machine learning (DML) can be an important capability for modern military to take advantage of data and devices distributed at multiple vantage points to adapt and learn. The existing distributed machine learning frameworks, however, cannot realize the full benefits of DML, because they are all based on the simple linear aggregation framework, but linear aggregation cannot handle the $\textit{divergence challenges}$ arising in military settings: the learning data at different devices can be heterogeneous ($\textit{i.e.}$, Non-IID data), leading to model divergence, but the ability for devices to communicate is substantially limited ($\textit{i.e.}$, weak connectivity due to sparse and dynamic communications), reducing the ability for devices to reconcile model divergence. In this paper, we introduce a novel DML framework called aggregation in the mirror space (AIMS) that allows a DML system to introduce a general mirror function to map a model into a mirror space to conduct aggregation and gradient descent. Adapting the convexity of the mirror function according to the divergence force, AIMS allows automatic optimization of DML. We conduct both rigorous analysis and extensive experimental evaluations to demonstrate the benefits of AIMS. For example, we prove that AIMS achieves a loss of $O\left((\frac{m^{r+1}}{T})^{\frac1r}\right)$ after $T$ network-wide updates, where $m$ is the number of devices and $r$ the convexity of the mirror function, with existing linear aggregation frameworks being a special case with $r=2$. Our experimental evaluations using EMANE (Extendable Mobile Ad-hoc Network Emulator) for military communications settings show similar results: AIMS can improve DML convergence rate by up to 57\% and scale well to more devices with weak connectivity, all with little additional computation overhead compared to traditional linear aggregation.


title: Tensor Algebra and its Applications to Data Science and Statistics

abstract: This survey provides an overview of common applications, both implicit and explicit, of "tensors" and "tensor products" in the fields of data science and statistics. One goal is to reconcile seemingly distinct usages of the term "tensor" in the literature, and to explain how these usages are manifestations of a common concept. Not all relevant topics are discussed in detail, but the attempt is made to briefly describe and give references for some of the most important topics not included in the main survey. Particular attention is given to tensor decompositions.


title: Infrared Divergence and Low Energy Theorem in Non-Abelian Gauge Theory

abstract: In the thesis, first, the cancellation of infrared divergences in QED is reviewed. Next, two examples in QCD, the quark-quark scattering and the quark-gluon scattering are examined at one loop, from which the importance of Ward-Takahashi identities becomes manifest for the cancellation to occur. The factorization of infrared divergences in QCD is proved at all orders, by full usage of the Ward-Takahashi identities. In these proofs, the axial gauge condition is used. The cancellation of infrared divergences in QCD occurs among the gauge invariant set of graphs. In this way, the low energy theorem of F. E. Low, for emission of one or two soft gluons, are proved at all orders. From this, the differential equation controlling the infrared divergences in QCD is derived. In QCD, the coupling constant renormalization introduces the other infrared divergence, which is governed by the beta-function in the pure Yang-Mills theory. In the Epilogue 2022, a motivation for recently translating the thesis in English is briefly stated.


title: Optimal probabilistic quantum control theory

abstract: There is a fundamental limit to what is knowable about atomic and molecular scale systems. This fuzziness is not always due to the act of measurement. Other contributing factors include system parameter uncertainty, functional uncertainty that originates from input functions, and sensors noises to mention a few. This indeterminism has led to major challenges in the development of accurate control methods for atomic scale systems. To address the probabilistic and uncertain nature of these systems, this work proposes a novel control framework that considers the representation of the system quantum states and the quantification of its physical properties following a probabilistic approach. Our framework is fully probabilistic. It uses the Shannon relative entropy from information theory to design optimal randomised controllers that can achieve a desired outcome of an atomic scale system. Several experiments are carried out to illustrate the applicability and effectiveness of the proposed approach.


title: Adaptive importance sampling based on fault tree analysis for piecewise deterministic Markov process

abstract: Piecewise deterministic Markov processes (PDMPs) can be used to model complex dynamical industrial systems. The counterpart of this modeling capability is their simulation cost, which makes reliability assessment untractable with standard Monte Carlo methods. A significant variance reduction can be obtained with an adaptive importance sampling (AIS) method based on a cross-entropy (CE) procedure. The success of this method relies on the selection of a good family of approximations of the committor function of the PDMP. In this paper original families are proposed. They are well adapted to high-dimensional industrial systems. Their forms are based on reliability concepts related to fault tree analysis: minimal path sets and minimal cut sets. The proposed method is discussed in detail and applied to academic systems and to a realistic system from the nuclear industry.