title: Decompositions for Sum-of-Power Statistics and the Sample Central Moments

abstract: We give some useful decompositions of sum-of-powers statistics, leading to decompositions for the sample mean, sample variance, sample skewness and sample kurtosis. We solve two related problems: computing these sample moments for a pooled sample composed of subgroups with known moments; and computing these sample moments for a subgroup using known moments from other subgroups and the overall pooled sample. Each task is accomplished via decompositions of the sums-of-squares, sums-of-cubes and sums-of-quads from which the sample central moments (up to fourth order) are formed. We give decomposition results and we implement these in a user-friendly R function.


title: PyProD: A Machine Learning-Friendly Platform for Protection Analytics in Distribution Systems

abstract: This paper introduces PyProD, a Python-based machine learning (ML)-compatible test-bed for evaluating the efficacy of protection schemes in electric distribution grids. This testbed is designed to bridge the gap between conventional power distribution grid analysis and growing capability of ML-based decision making algorithms, in particular in the context of protection system design and configuration. PyProD is shown to be capable of facilitating efficient design and evaluation of ML-based decision making algorithms for protection devices in the future electric distribution grid, in which many distributed energy resources and pro-sumers permeate the system.


title: Fully self-consistent optimization of the Jastrow-Slater-type wave function using a similarity-transformed Hamiltonian

abstract: It has been well established that the Jastrow correlation factor can effectively capture the electron correlation effects, and thus, the efficient optimization of the many-body wave function including the Jastrow correlation factor is of great importance. For this purpose, the transcorrelated $+$ variational Monte Carlo (TC$+$VMC) method is one of the promising methods, where the one-electron orbitals in the Slater determinant and the Jastrow factor are self-consistently optimized in the TC and VMC methods, respectively. In particular, the TC method is based on similarity-transformation of the Hamitonian by the Jastrow factor, which enables the efficient optimization of the one-electron orbitals under the effective interaction. Through test calculations of some closed-shell atoms, He, Be, and Ne, we find that the total energy is in many cases systematically improved by using better Jastrow functions. We find that even a one-shot TC$+$VMC calculation, where the Jastrow parameters are optimized at the Hartree-Fock$+$VMC level, can yield partial benefits from orbital optimization. It is also suggested that one-shot TC$+$VMC can be a good alternative way for complex systems. Our study provides important insights for optimizing many-body wave function including the Jastrow correlation factor, which would be of great help for development of highly accurate electronic structure calculations.


title: MLFW: A Database for Face Recognition on Masked Faces

abstract: As more and more people begin to wear masks due to current COVID-19 pandemic, existing face recognition systems may encounter severe performance degradation when recognizing masked faces. To figure out the impact of masks on face recognition model, we build a simple but effective tool to generate masked faces from unmasked faces automatically, and construct a new database called Masked LFW (MLFW) based on Cross-Age LFW (CALFW) database. The mask on the masked face generated by our method has good visual consistency with the original face. Moreover, we collect various mask templates, covering most of the common styles appeared in the daily life, to achieve diverse generation effects. Considering realistic scenarios, we design three kinds of combinations of face pairs. The recognition accuracy of SOTA models declines 5%-16% on MLFW database compared with the accuracy on the original images. MLFW database can be viewed and downloaded at \url{http://whdeng.cn/mlfw}.


title: Rectangle-based Approximation for Rendering Glossy Interreflections

abstract: This study introduces an approximation for rendering one bounce glossy interreflection in real time. The solution is based on the most representative point (MRP) and extends to a sampling disk near the MRP. Our algorithm represents geometry as rectangle proxies and specular reflections using a spherical Gaussian. The reflected radiance from the disk was efficiently approximated by selecting a representative attenuation axis in the sampling disk. We provide an efficient approximation of the glossy interreflection and can efficiently perform the approximation at runtime. Our method uses forward rendering (without using GBuffer), which is more suitable for platforms that favor forward rendering, such as mobile applications and virtual reality.


title: On the equivalence of two post-quantum cryptographic families

abstract: The Maximum Likelihood Decoding Problem (MLD) is known to be NP-hard and its complexity is strictly related to the security of some post-quantum cryptosystems, that is, the so-called code-based primitives. Analogously, the Multivariate Quadratic System Problem (MQ) is NP-hard and its complexity is necessary for the security of the so-called multivariate-based primitives. In this paper we present a closed formula for a polynomial-time reduction from any instance of MLD to an instance of MQ, and viceversa. We also show a polynomial-time isomorphism between MQ and MLD, thus demonstrating the direct link between the two post-quantum cryptographic families.


title: Incompatibility measures in multi-parameter quantum estimation under hierarchical quantum measurements

abstract: The incompatibility of the measurements constraints the achievable precisions in multi-parameter quantum estimation. Understanding the tradeoff induced by such incompatibility is a central topic in quantum metrology. Here we provide an approach to study the incompatibility under general $p$-local measurements, which are the measurements that can be performed collectively on at most $p$ copies of quantum states. We demonstrate the power of the approach by presenting a hierarchy of analytical bounds on the tradeoff among the precision limits of different parameters. These bounds lead to a necessary condition for the saturation of the quantum Cram\'er-Rao bound under $p$-local measurements, which recovers the partial commutative condition at p=1 and the weak commutative condition at $p=\infty$. As a further demonstration of the power of the framework, we present another set of tradeoff relations with the right logarithmic operators(RLD).


title: Expanding End-to-End Question Answering on Differentiable Knowledge Graphs with Intersection

abstract: End-to-end question answering using a differentiable knowledge graph is a promising technique that requires only weak supervision, produces interpretable results, and is fully differentiable. Previous implementations of this technique (Cohen et al., 2020) have focused on single-entity questions using a relation following operation. In this paper, we propose a model that explicitly handles multiple-entity questions by implementing a new intersection operation, which identifies the shared elements between two sets of entities. We find that introducing intersection improves performance over a baseline model on two datasets, WebQuestionsSP (69.6% to 73.3% Hits@1) and ComplexWebQuestions (39.8% to 48.7% Hits@1), and in particular, improves performance on questions with multiple entities by over 14% on WebQuestionsSP and by 19% on ComplexWebQuestions.


title: Reconstruction of stereoscopic CTA events using deep learning with CTLearn

abstract: The Cherenkov Telescope Array (CTA), conceived as an array of tens of imaging atmospheric Cherenkov telescopes (IACTs), is an international project for a next-generation ground-based gamma-ray observatory, aiming to improve on the sensitivity of current-generation instruments a factor of five to ten and provide energy coverage from 20 GeV to more than 300 TeV. Arrays of IACTs probe the very-high-energy gamma-ray sky. Their working principle consists of the simultaneous observation of air showers initiated by the interaction of very-high-energy gamma rays and cosmic rays with the atmosphere. Cherenkov photons induced by a given shower are focused onto the camera plane of the telescopes in the array, producing a multi-stereoscopic record of the event. This image contains the longitudinal development of the air shower, together with its spatial, temporal, and calorimetric information. The properties of the originating very-high-energy particle (type, energy, and incoming direction) can be inferred from those images by reconstructing the full event using machine learning techniques. In this contribution, we present a purely deep-learning driven, full-event reconstruction of simulated, stereoscopic IACT events using CTLearn. CTLearn is a package that includes modules for loading and manipulating IACT data and for running deep learning models, using pixel-wise camera data as input.


title: Truthful and Fair Mechanisms for Matroid-Rank Valuations

abstract: We study the problem of allocating indivisible goods among strategic agents. We focus on settings wherein monetary transfers are not available and each agent's private valuation is a submodular function with binary marginals, i.e., the agents' valuations are matroid-rank functions. In this setup, we establish a notable dichotomy between two of the most well-studied fairness notions in discrete fair division; specifically, between envy-freeness up to one good (EF1) and maximin shares (MMS). First, we show that a Pareto-efficient mechanism of Babaioff et al. (2021) is group strategy-proof for finding EF1 allocations, under matroid-rank valuations. The group strategy-proofness guarantee strengthens the result of Babaioff et al. (2021), that establishes truthfulness (individually for each agent) in the same context. Our result also generalizes a work of Halpern et al. (2020), from binary additive valuations to the matroid-rank case. Next, we establish that an analogous positive result cannot be achieved for MMS, even when considering truthfulness on an individual level. Specifically, we prove that, for matroid-rank valuations, there does not exist a truthful mechanism that is index oblivious, Pareto efficient, and maximin fair. For establishing our results, we develop a characterization of truthful mechanisms for matroid-rank functions. This characterization in fact holds for a broader class of valuations (specifically, holds for binary XOS functions) and might be of independent interest.


title: New Decay Results for a Partially Dissipative Viscoelastic Timoshenko System with Infinite Memory

abstract: In this paper, we consider the following dissipative viscoelastic with memory-type Timoshenko system \begin{equation*} \begin{gathered} \begin{cases} \rho_1 \phi_{tt} - \kappa ( \phi _{x} + \psi) _x + \kappa \int_0^\infty g(s) (\phi_x +\psi)_x(t-s) ~ds =0 & \text{in}~ \left( {0,L} \right) \times \mathbb{R}^+ , \\ \rho_2 \psi_{tt} - b \psi_{xx} + \kappa ( \phi _{x} + \psi)-\kappa \int_0^\infty g(s) (\phi_x +\psi)(t-s)~ ds=0 & \text{in}~ \left( {0,L} \right) \times \mathbb{R}^+ , \\ \end{cases} \end{gathered} \end{equation*} with Dirichlet boundary conditions, where $g$ is a positive non-increasing function satisfying, for some nonnegative functions $\xi$ and $H$, \[g'(t)\leq-\xi(t)H(g(t)),\qquad\forall~ t\geq0.\] Under appropriate conditions on $\xi$ and $H$, we establish some new decay results for the case of equal-speeds of propagation that generalize and improve many earlier results in the literature.


title: UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

abstract: With the rapid increase of multimedia data, a large body of literature has emerged to work on multimodal summarization, the majority of which target at refining salient information from textual and visual modalities to output a pictorial summary with the most relevant images. Existing methods mostly focus on either extractive or abstractive summarization and rely on qualified image captions to build image references. We are the first to propose a Unified framework for Multimodal Summarization grounding on BART, UniMS, that integrates extractive and abstractive objectives, as well as selecting the image output. Specially, we adopt knowledge distillation from a vision-language pretrained model to improve image selection, which avoids any requirement on the existence and quality of image captions. Besides, we introduce a visual guided decoder to better integrate textual and visual modalities in guiding abstractive text generation. Results show that our best model achieves a new state-of-the-art result on a large-scale benchmark dataset. The newly involved extractive objective as well as the knowledge distillation technique are proven to bring a noticeable improvement to the multimodal summarization task.


title: Turbulence in electromagnetically-driven Keplerian flows

abstract: The flow of an electrically conducting fluid in a thin disc under the action of an azimuthal Lorentz force is studied experimentally. At small forcing, the Lorentz force is balanced by either viscosity or inertia, yielding quasi-Keplerian velocity profiles. For very large current and moderate magnetic field, we observe a new regime, fully turbulent, which exhibits large fluctuations and a Keplerian mean rotation profile $\Omega\sim \frac{\sqrt{IB}}{r^{3/2}}$. In this turbulent regime, the dynamics is typical of thin layer turbulence, characterized by a direct cascade of energy towards the small scales and an inverse cascade to large scale. Finally, at very large magnetic field, this turbulent flow bifurcates to a quasi-bidimensional turbulent flow involving the formation of a large scale condensate in the horizontal plane. These results are well understood as resulting from an instability of the B\"odewadt-Hartmann layers at large Reynolds number and discussed in the framework of similar astrophysical flows.

categories: physics.flu-dyn astro-ph.EP astro-ph.GA astro-ph.SR


title: The Double-Constant Matrix, Centering Matrix and Equicorrelation Matrix: Theory and Applications

abstract: This paper examines the properties of real symmetric square matrices with a constant value for the main diagonal elements and another constant value for all off-diagonal elements. This matrix form is a simple subclass of circulant matrices, which is a subclass of Toeplitz matrices. It encompasses other useful matrices such as the centering matrix and the equicorrelation matrix, which arise in statistical applications. We examine the general form of this class of matrices and derive its eigendecomposition and other important properties. We use this as a basis to look at the properties of the centering matrix and the equicorrelation matrix, and various statistics that use these matrices.


title: Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Media

abstract: Adverse Events (AE) are harmful events resulting from the use of medical products. Although social media may be crucial for early AE detection, the sheer scale of this data makes it logistically intractable to analyze using human agents, with NLP representing the only low-cost and scalable alternative. In this paper, we frame AE Detection and Extraction as a sequence-to-sequence problem using the T5 model architecture and achieve strong performance improvements over competitive baselines on several English benchmarks (F1 = 0.71, 12.7% relative improvement for AE Detection; Strict F1 = 0.713, 12.4% relative improvement for AE Extraction). Motivated by the strong commonalities between AE-related tasks, the class imbalance in AE benchmarks and the linguistic and structural variety typical of social media posts, we propose a new strategy for multi-task training that accounts, at the same time, for task and dataset characteristics. Our multi-task approach increases model robustness, leading to further performance gains. Finally, our framework shows some language transfer capabilities, obtaining higher performance than Multilingual BERT in zero-shot learning on French data.


title: Leveraging Clinical Characteristics for Improved Deep Learning-Based Kidney Tumor Segmentation on CT

abstract: This paper assesses whether using clinical characteristics in addition to imaging can improve automated segmentation of kidney cancer on contrast-enhanced computed tomography (CT). A total of 300 kidney cancer patients with contrast-enhanced CT scans and clinical characteristics were included. A baseline segmentation of the kidney cancer was performed using a 3D U-Net. Input to the U-Net were the contrast-enhanced CT images, output were segmentations of kidney, kidney tumors, and kidney cysts. A cognizant sampling strategy was used to leverage clinical characteristics for improved segmentation. To this end, a Least Absolute Shrinkage and Selection Operator (LASSO) was used. Segmentations were evaluated using Dice and Surface Dice. Improvement in segmentation was assessed using Wilcoxon signed rank test. The baseline 3D U-Net showed a segmentation performance of 0.90 for kidney and kidney masses, i.e., kidney, tumor, and cyst, 0.29 for kidney masses, and 0.28 for kidney tumor, while the 3D U-Net trained with cognizant sampling enhanced the segmentation performance and reached Dice scores of 0.90, 0.39, and 0.38 respectively. To conclude, the cognizant sampling strategy leveraging the clinical characteristics significantly improved kidney cancer segmentation.


title: End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphs

abstract: Recently, end-to-end (E2E) trained models for question answering over knowledge graphs (KGQA) have delivered promising results using only a weakly supervised dataset. However, these models are trained and evaluated in a setting where hand-annotated question entities are supplied to the model, leaving the important and non-trivial task of entity resolution (ER) outside the scope of E2E learning. In this work, we extend the boundaries of E2E learning for KGQA to include the training of an ER component. Our model only needs the question text and the answer entities to train, and delivers a stand-alone QA model that does not require an additional ER component to be supplied during runtime. Our approach is fully differentiable, thanks to its reliance on a recent method for building differentiable KGs (Cohen et al., 2020). We evaluate our E2E trained model on two public datasets and show that it comes close to baseline models that use hand-annotated entities.


title: Search for multi-flare neutrino emissions in 10 years of IceCube data from a catalog of sources

abstract: A recent time-integrated analysis of a catalog of 110 candidate neutrino sources revealed a cumulative neutrino excess in the data collected by IceCube between April 6, 2008 and July 10, 2018. This excess, inconsistent with the background hypothesis in the Northern hemisphere at the $3.3~\sigma$ level, is associated with four sources: NGC 1068, TXS 0506+056, PKS 1424+240 and GB6 J1542+6129. This letter presents two time-dependent neutrino emission searches on the same data sample and catalog: a point-source search that looks for the most significant time-dependent source of the catalog by combining space, energy and time information of the events, and a population test based on binomial statistics that looks for a cumulative time-dependent neutrino excess from a subset of sources. Compared to previous time-dependent searches, these analyses enable a feature to possibly find multiple flares from a single direction with an unbinned maximum-likelihood method. M87 is found to be the most significant time-dependent source of this catalog at the level of $1.7~\sigma$ post-trial, and TXS 0506+056 is the only source for which two flares are reconstructed. The binomial test reports a cumulative time-dependent neutrino excess in the Northern hemisphere at the level of $3.0~\sigma$ associated with four sources: M87, TXS 0506+056, GB6 J1542+6129 and NGC 1068.


title: Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers

abstract: Microsatellite instability (MSI) is a tumor phenotype whose diagnosis largely impacts patient care in colorectal cancers (CRC), and is associated with response to immunotherapy in all solid tumors. Deep learning models detecting MSI tumors directly from H&E stained slides have shown promise in improving diagnosis of MSI patients. Prior deep learning models for MSI detection have relied on neural networks pretrained on ImageNet dataset, which does not contain any medical image. In this study, we leverage recent advances in self-supervised learning by training neural networks on histology images from the TCGA dataset using MoCo V2. We show that these networks consistently outperform their counterparts pretrained using ImageNet and obtain state-of-the-art results for MSI detection with AUCs of 0.92 and 0.83 for CRC and gastric tumors, respectively. These models generalize well on an external CRC cohort (0.97 AUC on PAIP) and improve transfer from one organ to another. Finally we show that predictive image regions exhibit meaningful histological patterns, and that the use of MoCo features highlighted more relevant patterns according to an expert pathologist.


title: Improving the Robustness of Adversarial Attacks Using an Affine-Invariant Gradient Estimator

abstract: As designers of artificial intelligence try to outwit hackers, both sides continue to hone in on AI's inherent vulnerabilities. Designed and trained from certain statistical distributions of data, AI's deep neural networks (DNNs) remain vulnerable to deceptive inputs that violate a DNN's statistical, predictive assumptions. Before being fed into a neural network, however, most existing adversarial examples cannot maintain malicious functionality when applied to an affine transformation. For practical purposes, maintaining that malicious functionality serves as an important measure of the robustness of adversarial attacks. To help DNNs learn to defend themselves more thoroughly against attacks, we propose an affine-invariant adversarial attack, which can consistently produce more robust adversarial examples over affine transformations. For efficiency, we propose to disentangle current affine-transformation strategies from the Euclidean geometry coordinate plane with its geometric translations, rotations and dilations; we reformulate the latter two in polar coordinates. Afterwards, we construct an affine-invariant gradient estimator by convolving the gradient at the original image with derived kernels, which can be integrated with any gradient-based attack methods. Extensive experiments on ImageNet, including some experiments under physical condition, demonstrate that our method can significantly improve the affine invariance of adversarial examples and, as a byproduct, improve the transferability of adversarial examples, compared with alternative state-of-the-art methods.


title: Cyber-Security in the Emerging World of Smart Everything

abstract: The fourth industrial revolution (4IR) is a revolution many authors believe have come to stay. It is a revolution that has been fast blurring the line between physical, digital and biological technologies. These disruptive technologies largely rely on high-speed internet connectivity, Cloud technologies, Augmented Reality, Additive Manufacturing, Data science and Artificial Intelligence. Most developed economies have embraced the it while the developing economies are struggling to adopt 4IR because they lack the requisite skills, knowledge and technology. Thus, this study investigates Nigeria as one of the developing economies to understand her readiness for 4IR and the level of preparedness to mitigate the sophisticated cyber-attacks that comes with it. The investigation adopted quantitative research approach and developed an online questionnaire that was shared amongst the population of interest that includes academic, industry experts and relevant stakeholders. The questionnaire returned 116 valid responses which were analysed with descriptive statistical tools in SPSS. Results suggest that 60 of the respondents opined that Nigerian government at are not showing enough evidence to demonstrate her preparedness to leverage these promised potentials by developing 4IR relevant laws, strong institutional frameworks and policies. They lack significant development capacity to mitigate risks associated with digital ecosystem and cyber ecosystem that are ushered in by the 4IR. In the universities, 52 of the courses offered at the undergraduate and 42 at the post-graduate levels are relevant in the development of skills required in the revolution. The study recommends that the government at all levels make adequate efforts in developing the countrys intangible assets. In all, this paper posits that successful implementation of these could equip Nigeria to embrace the 4IR in all its aspects.


title: A meshfree arbitrary Lagrangian-Eulerian method for the BGK model of the Boltzmann equation with moving boundaries

abstract: In this paper we present a novel technique for the simulation of moving boundaries and moving rigid bodies immersed in a rarefied gas using an Eulerian-Lagrangian formulation based on least square method. The rarefied gas is simulated by solving the Bhatnagar-Gross-Krook (BGK) model for the Boltzmann equation of rarefied gas dynamics. The BGK model is solved by an Arbitrary Lagrangian-Eulerian (ALE) method, where grid-points/particles are moved with the mean velocity of the gas. The computational domain for the rarefied gas changes with time due to the motion of the boundaries. To allow a simpler handling of the interface motion we have used a meshfree method based on a least-square approximation for the reconstruction procedures required for the scheme. We have considered a one way, as well as a two-way coupling of boundaries/rigid bodies and gas flow. The numerical results are compared with analytical as well as with Direct Simulation Monte Carlo (DSMC) solutions of the Boltzmann equation. Convergence studies are performed for one-dimensional and two-dimensional test-cases. Several further test problems and applications illustrate the versatility of the approach.


title: Universal protoplanetary disk size under complete non-ideal magnetohydrodynamics: The interplay between ion-neutral friction, Hall effect, and the Ohmic dissipation

abstract: The role of non-ideal magnetohydrodynamics has been proven critical during the formation of the protoplanetary disk, particularly in regulating its size. We provide a simple model to predict the disk size under the interplay among the ambipolar diffusion, the Hall effect, and the Ohmic dissipation. The model predicts a small disk size of around 20 AU, that depends only sub-linearly on disk parameters, for a wide range of initial conditions of sub-Solar mass and moderate magnetization. It is able to explain phenomena manifested in existing numerical simulations, including the bimodal disk behavior under parallel and anti-parallel alignment between the rotation and magnetic field. In the parallel configuration, the disk size decreases and eventually disappears. In the anti-parallel configuration, and the disk has an outer partition (or pseudo-disk) that is flat, shrinking , and short-lived, as well as a inner partition that grows slowly with mass and is long-lived. Even with significant initial magnetization, the vertical field in the disk can only dominate at the early stage when the mass is low, and the toroidal field eventually dominates in all disks.


title: Holographic bottomonium formation in a cooling strong-interaction medium at finite baryon density

abstract: The shrinking of the bottomonium spectral function towards narrow quasi-particle states in a cooling strong-interaction medium at finite baryon density is followed within a holographic bottom-up model. The 5-dimensional Einstein-dilaton-Maxwell background is adjusted to lattice-QCD results of sound velocity and susceptibilities. The zero-temperature bottomonium spectral function is adjusted to experimental $\Upsilon$ ground-state mass and first radial excitations. At baryo-chemical potential $\mu_B = 0$, these two pillars let emerge the narrow quasi-particle state of the $\Upsilon$ ground state at a temperature of about 150 MeV. Excited states are consecutively formed at lower temperatures by about 10 (20) MeV for the $2S$ ($3S$) vector states. The baryon density, i.e. $\mu_B > 0$, pulls that formation pattern to lower temperatures. At $\mu_B =$ 200 MeV, we find a shift by about 15 MeV.


title: Error performance analysis of different modulations over TWDP fading channel

abstract: Two-wave with diffuse power (TWDP) is one of the most promising distribution for description of a small-scale fading in the emerging mmWave band. However, traditional error performance analysis in these channels faces two fundamental issues. It is mostly based on conventional TWDP parameterization which is not in accordance with the model's underlying physical mechanisms and which hinders accurate observation of the impact of a model parameters on a system's performance metrics. In addition, the existing average bit/symbol error probability (ABEP/ASEP) expressions for most modulations and diversity schemes are available as approximations, which are accurate only for specific combinations of TWDP parameters. Accordingly, in this paper, the exact ASEP expressions are derived for M-ary rectangular quadrature amplitude modulation (RQAM) with coherent detection and for M-ary DPSK modulation, and are given in terms of physically justified parameters. Besides, in order to relax computational complexity of proposed exact ASEPs in high signal-to-noise ratio (SNR) region, their asymptotic counterparts are derived as the simple closed-form expressions, matching the exact ones for SNR>30dB. Results are verified by Monte-Carlo simulation.


title: Variational Disentanglement for Domain Generalization

abstract: Domain generalization aims to learn an invariant model that can generalize well to the unseen target domain. In this paper, we propose to tackle the problem of domain generalization by delivering an effective framework named Variational Disentanglement Network (VDN), which is capable of disentangling the domain-specific features and task-specific features, where the task-specific features are expected to be better generalized to unseen but related test data. We further show the rationale of our proposed method by proving that our proposed framework is equivalent to minimize the evidence upper bound of the divergence between the distribution of task-specific features and its invariant ground truth derived from variational inference. We conduct extensive experiments to verify our method on three benchmarks, and both quantitative and qualitative results illustrate the effectiveness of our method.


title: Model of the low temperature magnetic phases of gadolinium gallium garnet

abstract: The magnetic behaviour of gadolinium gallium garnet in an external magnetic field at zero temperature is considered. For high fields a classical spin model of the gadolinium ions predicts a spin configuration that is periodic at the level of the smallest repeating unit cell. The quantum version of the model is treated via a truncated Holstein-Primakoff transformation with axes defined by the classical spin configuration, and the magnon excitation bands are calculated. The model predicts a transition in the field range of $1.9$ -- $2.1\mathrm{T}$, sensitive to the direction of the applied field, which is caused by one or more magnon modes becoming soft as the field is decreased. In general the soft modes occur at incommensurate wavevectors and therefore break the periodicity of the spin configuration below the transition. One exception occurs when the field aligns with one of the principle crystal axes, in which case periodicity of the spin configuration is found to be maintained on a larger crystallographic cubic cell even below the transition. This simple case is studied in more detail. Comparisons are drawn with existing experimental data, and further experimental tests of the model are suggested.


title: The Gravitational Bending of Acoustic Schwarzschild Black Hole

abstract: Acoustic black hole is becoming an attractive topic in recent years, for it open-up new direction for experimental / observational explorations of black holes. In this work, the gravitational bending of acoustic Schwarzschild black hole is investigated. The gravitational deflection angle of particles traveling along null geodesics, weak gravitational lensing and Einstein ring for acoustic Schwarzschild black hole are carefully studied and analyzed. Particularly, in the calculation of gravitational deflection angle, we resort to two approaches -- the Gauss-Bonnet theorem and the geodesic method. The results show that the gravitational bending effect in acoustic Schwarzschild black hole is enhanced, compared with conventional Schwarzschild black hole. This result indicates that the acoustic black holes may be more easily detectable in gravitational bending effects and weak gravitational lensing observations.


title: Zeroth-order non-convex learning via hierarchical dual averaging

abstract: We propose a hierarchical version of dual averaging for zeroth-order online non-convex optimization - i.e., learning processes where, at each stage, the optimizer is facing an unknown non-convex loss function and only receives the incurred loss as feedback. The proposed class of policies relies on the construction of an online model that aggregates loss information as it arrives, and it consists of two principal components: (a) a regularizer adapted to the Fisher information metric (as opposed to the metric norm of the ambient space); and (b) a principled exploration of the problem's state space based on an adapted hierarchical schedule. This construction enables sharper control of the model's bias and variance, and allows us to derive tight bounds for both the learner's static and dynamic regret - i.e., the regret incurred against the best dynamic policy in hindsight over the horizon of play.


title: Adversarial Bone Length Attack on Action Recognition

abstract: Skeleton-based action recognition models have recently been shown to be vulnerable to adversarial attacks. Compared to adversarial attacks on images, perturbations to skeletons are typically bounded to a lower dimension of approximately 100 per frame. This lower-dimensional setting makes it more difficult to generate imperceptible perturbations. Existing attacks resolve this by exploiting the temporal structure of the skeleton motion so that the perturbation dimension increases to thousands. In this paper, we show that adversarial attacks can be performed on skeleton-based action recognition models, even in a significantly low-dimensional setting without any temporal manipulation. Specifically, we restrict the perturbations to the lengths of the skeleton's bones, which allows an adversary to manipulate only approximately 30 effective dimensions. We conducted experiments on the NTU RGB+D and HDM05 datasets and demonstrate that the proposed attack successfully deceived models with sometimes greater than 90% success rate by small perturbations. Furthermore, we discovered an interesting phenomenon: in our low-dimensional setting, the adversarial training with the bone length attack shares a similar property with data augmentation, and it not only improves the adversarial robustness but also improves the classification accuracy on the original data. This is an interesting counterexample of the trade-off between adversarial robustness and clean accuracy, which has been widely observed in studies on adversarial training in the high-dimensional regime.


title: Study of kinetic freeze-out parameters as function of rapidity in pp collisions at CERN SPS energies

abstract: We used the blast wave model with Boltzmann Gibbs statistics and analyzed the experimental data measured by NA61/SHINE Collaboration in inelastic (INEL) proton-proton collisions at different rapidity slices at different center-of-mass energies. The particles used in this study are pion, kaon, proton and anti-proton. We extracted kinetic freeze-out temperature, transverse flow velocity and kinetic freeze-out volume from the transverse momentum spectra of the particles. We observed that the kinetic freeze-out temperature is rapidity and energy dependent, while transverse flow velocity does not depend on them. Furthermore, we observed that the kinetic freeze-out volume is energy dependent but it remains constant with changing the rapidity. We also observed that all these three parameters are mass dependent. In addition, with the increase of mass, the kinetic freeze-out temperature increases, and the transverse flow velocity as well as kinetic freeze-out volume decreases.


title: Boolean complexes of involutions

abstract: Let (W,S) be a Coxeter system. We introduce the boolean complex of involutions of W which is an analogue of the boolean complex of W studied by Ragnarsson and Tenner. By applying discrete Morse theory, we determine the homotopy type of the boolean complex of involutions for a large class of (W,S), including all finite Coxeter groups, finding that the homotopy type is that of a wedge of spheres of dimension |S| - 1. In addition, we find simple recurrence formulas for the number of spheres in the wedge.


title: Rate of coalescence of pairs of lineages in the spatial {\lambda}-Fleming-Viot process

abstract: We revisit the spatial ${\lambda}$-Fleming-Viot process introduced in [1]. Particularly, we are interested in the time $T_0$ to the most recent common ancestor for two lineages. We distinguish between the case where the process acts on the entire two-dimensional plane, and on a finite rectangle. Utilizing a differential equation linking $T_0$ with the physical distance between the lineages, we arrive at simple and reasonably accurate approximation schemes for both cases. Furthermore, our analysis enables us to address the question of whether the genealogical process of the model "comes down from infinity", which has been partly answered before in [2].


title: Projective differential geometry and asymptotic analysis in General Relativity

abstract: In this text, we explore the tools that Projective Differential Geometry can provide for the asymptotic analysis of classical fields on projectively compact manifolds. We emphasise on the case of order 2-compactifications and develop, in this case, a projective exterior differential tractor calculus that is analogous to that existing for conformally compact manifolds.


title: Process Discovery Using Graph Neural Networks

abstract: Automatically discovering a process model from an event log is the prime problem in process mining. This task is so far approached as an unsupervised learning problem through graph synthesis algorithms. Algorithmic design decisions and heuristics allow for efficiently finding models in a reduced search space. However, design decisions and heuristics are derived from assumptions about how a given behavioral description - an event log - translates into a process model and were not learned from actual models which introduce biases in the solutions. In this paper, we explore the problem of supervised learning of a process discovery technique D. We introduce a technique for training an ML-based model D using graph convolutional neural networks; D translates a given input event log into a sound Petri net. We show that training D on synthetically generated pairs of input logs and output models allows D to translate previously unseen synthetic and several real-life event logs into sound, arbitrarily structured models of comparable accuracy and simplicity as existing state of the art techniques for discovering imperative process models. We analyze the limitations of the proposed technique and outline alleys for future work.


title: Stochastic gravitational-wave background as a tool to investigate multi-channel astrophysical and primordial black-hole mergers

abstract: The formation of merging binary black holes can occur through multiple astrophysical channels such as, e.g., isolated binary evolution and dynamical formation or, alternatively, have a primordial origin. Increasingly large gravitational-wave catalogs of binary black-hole mergers have allowed for the first model selection studies between different theoretical predictions to constrain some of their model uncertainties and branching ratios. In this work, we show how one could add an additional and independent constraint to model selection by using the stochastic gravitational-wave background. In contrast to model selection analyses that have discriminating power only up to the gravitational-wave detector horizons (currently at redshifts $z\lesssim 1$ for LIGO-Virgo), the stochastic gravitational-wave background accounts for the redshift integration of all gravitational-wave signals in the Universe. As a working example, we consider the branching ratio results from a model selection study that includes potential contribution from astrophysical and primordial channels. We renormalize the relative contribution of each channel to the detected event rate to compute the total stochastic gravitational-wave background energy density. The predicted amplitude lies below the current observational upper limits of GWTC-2 by LIGO-Virgo, indicating that the results of the model selection analysis are not ruled out by current background limits. Furthermore, given the set of population models and inferred branching ratios, we find that, even though the predicted background will not be detectable by current generation gravitational-wave detectors, it will be accessible by third-generation detectors such as the Einstein Telescope and space-based detectors such as LISA.


title: Categorical Semantics of Reversible Pattern-Matching

abstract: This paper is concerned with categorical structures for reversible computation. In particular, we focus on a typed, functional reversible language based on Theseus. We discuss how join inverse rig categories do not in general capture pattern-matching, the core construct Theseus uses to enforce reversibility. We then derive a categorical structure to add to join inverse rig categories in order to capture pattern-matching. We show how such a structure makes an adequate model for reversible pattern-matching.


title: IceNet for Interactive Contrast Enhancement

abstract: A CNN-based interactive contrast enhancement algorithm, called IceNet, is proposed in this work, which enables a user to adjust image contrast easily according to his or her preference. Specifically, a user provides a parameter for controlling the global brightness and two types of scribbles to darken or brighten local regions in an image. Then, given these annotations, IceNet estimates a gamma map for the pixel-wise gamma correction. Finally, through color restoration, an enhanced image is obtained. The user may provide annotations iteratively to obtain a satisfactory image. IceNet is also capable of producing a personalized enhanced image automatically, which can serve as a basis for further adjustment if so desired. Moreover, to train IceNet effectively and reliably, we propose three differentiable losses. Extensive experiments show that IceNet can provide users with satisfactorily enhanced images.


title: Mutual Information in Molecular and Macromolecular Systems

abstract: The relaxation properties of viscous liquids close to their glass transition (GT) have been widely characterised by the statistical tool of time correlation functions. However, the strong influence of ubiquitous non-linearities calls for new, alternative tools of analysis. In this respect, information theory-based observables and, more specifically, mutual information (MI) are gaining increasing interest. Here, we report on novel, deeper insight provided by MI-based analysis of molecular dynamics simulations of molecular and macromolecular glass-formers on two distinct aspects of transport and relaxation close to GT, namely dynamical heterogeneity (DH) and secondary Johari--Goldstein (JG) relaxation processes. In a model molecular liquid with significant DH, MI reveals two populations of particles organised in clusters having either filamentous or compact globular structures that exhibit different mobility and relaxation properties. In a model polymer melt, MI provides clearer evidence of JG secondary relaxation and sharper insight into its DH. It is found that both DH and MI between the orientation and the displacement of the bonds reach (local) maxima at the time scales of the primary and JG secondary relaxation. This suggests that, in (macro)molecular systems, the mechanistic explanation of both DH and relaxation must involve rotation/translation coupling.


title: Iterating the cofinality-$\omega$ constructible model

abstract: We investigate iterating the construction of $C^{*}$, the $L$-like inner model constructed using first order logic augmented with the "cofinality $\omega$" quantifier. We first show that $\left(C^{*}\right)^{C^{*}}=C^{*}\ne L$ is equiconsistent with ZFC, as well as having finite strictly decreasing sequences of iterated $C^{*}$s. We then show that in models of the form $L^{\mu}$ we get infinite decreasing sequences of length $\omega$, and that an inner model with a measurable cardinal is required for that.


title: System size synchronization

abstract: In this work we bring out the existence of a novel kind of synchronization associated to the size of a complex system. A dichotomic random jump process associated to the dynamics of an externally driven stochastic system with $N$ coupled units is constructed. We define an output frequency and phase diffusion coefficient. System size synchronization occurs when the average output frequency is locked to the external one and the average phase diffusion coefficient shows a very deep minimum for a range of system sizes. Analytical and numerical procedures are introduced to study the phenomenon, and the results describe successfully the existence of system size synchronization.


title: Aluminium-26 from massive binary stars II. Rotating single stars up to core-collapse and their impact on the early Solar System

abstract: Radioactive nuclei were present in the early Solar System, as inferred from analysis of meteorites. Many are produced in massive stars, either during their lives or their final explosions. In the first paper in this series (Brinkman et al. 2019), we focused on the production of $^{26}$Al in massive binaries. Here, we focus on the production of another two short-lived radioactive nuclei, $^{36}$Cl and $^{41}$Ca, and the comparison to the early Solar System data. We used the MESA stellar evolution code with an extended nuclear network and computed massive (10-80 M$ _{\odot} $), rotating (with initial velocities of 150 and 300 km/s) and non-rotating single stars at solar metallicity (Z=0.014) up to the onset of core collapse. We present the wind yields for the radioactive isotopes $^{26}$Al, $^{36}$Cl, and $^{41}$Ca, and the stable isotopes $^{19}$F and $^{20}$Ne. In relation to the stable isotopes, we find that only the most massive models, $\geq$ 60M$_{\odot}$ and $\geq$ 40M$_{\odot}$ give positive $^{19}$F and $^{20}$Ne yields, respectively, depending on the initial rotation rate. In relation to the radioactive isotopes, we find that the early Solar System abundances of $^{26}$Al and $^{41}$Ca can be matched with by models with initial masses $\geq$40M$_{\odot}$, while $^{36}$Cl is matched only by our most massive models, $\geq$60M$_{\odot}$. $^{60}$Fe is not significantly produced by any wind model, as required by the observations. Therefore, massive star winds are a favoured candidate for the origin of the very short-lived $^{26}$Al, $^{36}$Cl, and $^{41}$Ca in the early Solar System.


title: OSS effort estimation using software features similarity and developer activity-based metrics

abstract: Software development effort estimation (SDEE) generally involves leveraging the information about the effort spent in developing similar software in the past. Most organizations do not have access to sufficient and reliable forms of such data from past projects. As such, the existing SDEE methods suffer from low usage and accuracy. We propose an efficient SDEE method for open source software, which provides accurate and fast effort estimates. The significant contributions of our paper are i) Novel SDEE software metrics derived from developer activity information of various software repositories, ii) SDEE dataset comprising the SDEE metrics' values derived from $\approx13,000$ GitHub repositories from 150 different software categories, iii) an effort estimation tool based on SDEE metrics and a software description similarity model. Our software description similarity model is basically a machine learning model trained using the Paragraph Vectors algorithm on the software product descriptions of GitHub repositories. Given the software description of a newly-envisioned software, our tool yields an effort estimate for developing it. Our method achieves the highest Standard Accuracy score of 87.26% (with cliff's $\delta$=0.88 at 99.999% confidence level) and 42.7% with the Automatic Transformed Linear Baseline model. Our software artifacts are available at https://doi.org/10.5281/zenodo.5095723.


title: Reconstructing solar irradiance from historical Ca II K observations. I. Method and its validation

abstract: Knowledge of solar irradiance variability is critical to Earth's climate models and understanding the solar influence on Earth's climate. Direct solar irradiance measurements are only available since 1978. Reconstructions of past variability typically rely on sunspot data. These provide only indirect information on the facular and network regions, which are decisive contributors to irradiance variability on timescales of the solar cycle and longer. Our ultimate goal is to reconstruct past solar irradiance variations using historical full-disc Ca II K observations to describe the facular contribution independently of sunspot observations. Here, we develop the method and test it extensively by using modern CCD-based Ca II K observations and carry out initial tests on two photographic archives. We employ carefully reduced and calibrated Ca II K images from 13 datasets, such as those from the Meudon, Mt Wilson, and Rome observatories. We convert them to unsigned magnetograms and then use them as input to the adapted SATIRE model to reconstruct TSI variations over the period 1978-2019, for which direct irradiance measurements are available. The reconstructed TSI from the analysed Ca II K archives agrees well with direct TSI measurements and existing reconstructions. The model also returns good results on data taken with different bandpasses and images with low spatial resolution. Historical Ca II K archives suffer from numerous inconsistencies, but we show that these archives can still be used to reconstruct TSI with reasonable accuracy provided the observations are accurately processed. By using the unsigned magnetograms of the Sun reconstructed from high-quality Ca II K observations as input into the SATIRE model, we can reconstruct solar irradiance variations nearly as accurately as from directly recorded magnetograms.


title: Spacetime Entanglement Entropy of de Sitter and Black Hole Horizons

abstract: We calculate Sorkin's manifestly covariant entanglement entropy $\mathcal{S}$ for a massive and massless minimally coupled free Gaussian scalar field for the de Sitter horizon and Schwarzschild de Sitter horizons respectively in $d > 2$. In de Sitter spacetime we restrict the Bunch-Davies vacuum in the conformal patch to the static patch to obtain a mixed state. The finiteness of the spatial $\mathcal{L}^2$ norm in the static patch implies that $\mathcal{S}$ is well defined for each mode. We find that $\mathcal{S}$ for this mixed state is independent of the effective mass of the scalar field, and matches that of Higuchi and Yamamoto, where, a spatial density matrix was used to calculate the horizon entanglement entropy. Using a cut-off in the angular modes we show that $\mathcal{S} \propto A_{c}$, where $A_c$ is the area of the de Sitter cosmological horizon. Our analysis can be carried over to the black hole and cosmological horizon in Schwarzschild de Sitter spacetime, which also has finite spatial $\mathcal{L}^2$ norm in the static regions. Although the explicit form of the modes is not known in this case, we use appropriate boundary conditions for a massless minimally coupled scalar field to find the mode-wise $\mathcal{S}_{b,c}$, where $b,c$ denote the black hole and de Sitter cosmological horizons, respectively. As in the de Sitter calculation we see that $\mathcal{S}_{b,c} \propto A_{b,c}$ after taking a cut-off in the angular modes.


title: Principal-Axis Analysis of the Eddington Tensor for the Early Post-Bounce Phase of Rotational Core-Collapse Supernovae

abstract: Using full Boltzmann neutrino transport, we performed two-dimensional (2D) core-collapse supernova simulations in axisymmetry for two progenitor models with 11.2M and 15.0M both rotational and non-rotational. We employed the results obtained in the early post-bounce phase (t < 20 ms) to assess performance under rapid rotation of some closure relations commonly employed in the truncated moment method. We first made a comparison in 1D under spherical symmetry, though, of the Eddington factor p defined in the fluid rest frame (FR). We confirmed that the maximum entropy closure for the Fermionic distribution (MEFD) performs better than others near the proto-neutron star surface, where p < 1/3 occurs, but does not work well even in 1D when the phase space occupancy satisfies e < 0.5 together with p < 1/3, the condition known to be not represented by MEFD. For the 2D models with the rapid rotation, we employed the principal-axis analysis of the Eddington tensor. We paid particular attention to the direction of the longest principal axis. We observed in FR that it is aligned neither with the radial direction nor with the neutrino flux in 2D, particularly so in convective and/or rapidly rotating regions, the fact not accommodated in the moment method. We repeated the same analysis in the laboratory frame (LB) and found again that the direction of the longest principal axis is not well reproduced by MEFD because the interpolation between the optically thick and thin limits is not very accurate in this frame.


title: Baryon decays $J/\psi\rightarrow B\bar{B}$ within the QCD factorisation framework

abstract: We investigate $J/\psi$ decays into octet baryon-antibaryons pairs. The decay amplitudes are computed within the collinear QCD factorisation framework. The subleading amplitude, which describes the decay of longitudinally polarised charmonium, is computed using twist-4 three-quark distribution amplitudes. The obtained results are used for a qualitative analysis of the experimental data. It is found that the polarisation parameter $\alpha_B$ can be described with an accuracy $10-30\%$, which may indicate that the pQCD contribution dominates this observable.


title: Closed-Loop Neural Prostheses with On-Chip Intelligence: A Review and A Low-Latency Machine Learning Model for Brain State Detection

abstract: The application of closed-loop approaches in systems neuroscience and therapeutic stimulation holds great promise for revolutionizing our understanding of the brain and for developing novel neuromodulation therapies to restore lost functions. Neural prostheses capable of multi-channel neural recording, on-site signal processing, rapid symptom detection, and closed-loop stimulation are critical to enabling such novel treatments. However, the existing closed-loop neuromodulation devices are too simplistic and lack sufficient on-chip processing and intelligence. In this paper, we first discuss both commercial and investigational closed-loop neuromodulation devices for brain disorders. Next, we review state-of-the-art neural prostheses with on-chip machine learning, focusing on application-specific integrated circuits (ASIC). System requirements, performance and hardware comparisons, design trade-offs, and hardware optimization techniques are discussed. To facilitate a fair comparison and guide design choices among various on-chip classifiers, we propose a new energy-area (E-A) efficiency figure of merit that evaluates hardware efficiency and multi-channel scalability. Finally, we present several techniques to improve the key design metrics of tree-based on-chip classifiers, both in the context of ensemble methods and oblique structures.


title: Prediction of gene expression time series and structural analysis of gene regulatory networks using recurrent neural networks

abstract: Methods for time series prediction and classification of gene regulatory networks (GRNs) from gene expression data have been treated separately so far. The recent emergence of attention-based recurrent neural networks (RNN) models boosted the interpretability of RNN parameters, making them appealing for the understanding of gene interactions. In this work, we generated synthetic time series gene expression data from a range of archetypal GRNs and we relied on a dual attention RNN to predict the gene temporal dynamics. We show that the prediction is extremely accurate for GRNs with different architectures. Next, we focused on the attention mechanism of the RNN and, using tools from graph theory, we found that its graph properties allow to hierarchically distinguish different architectures of the GRN. We show that the GRNs respond differently to the addition of noise in the prediction by the RNN and we relate the noise response to the analysis of the attention mechanism. In conclusion, this work provides a a way to understand and exploit the attention mechanism of RNN and it paves the way to RNN-based methods for time series prediction and inference of GRNs from gene expression data.

categories: physics.bio-ph cs.LG physics.data-an q-bio.MN q-bio.QM


title: Period-Age-Metallicity and Period-Age-Color-Metallicity relations for Classical Cepheids: an application to the Gaia EDR3 sample

abstract: Based on updated pulsation models for Classical Cepheids, computed for various assumptions about the metallicity and helium abundance, roughly representative of pulsators in the Small Magellanic Cloud ($Z$=$0.004$ and $Y$=$0.25$), Large Magellanic Cloud ($Z$=$0.008$ and $Y$=$0.25$), and M31 ($Z$=$0.03$ and $Y$=$0.28$), and self-consistent updated evolutionary predictions, we derived Period-Age and multi-band Period-Age-Color relations that also take into account variations in the Mass-Luminosity relation. These results, combined with those previously derived for Galactic Cepheids, were used to investigate the metallicity effect when using these variables as age indicators. In particular, we found that a variation in the metal abundance affects both the slope and the zero point of the above-mentioned relations. The new relations were applied to a sample of Gaia Early Data Release 3 Classical Cepheids. The retrieved distribution of the individual ages confirms that a brighter Mass-Luminosity relation produces older ages and that First Overtone pulsators are found to be concentrated towards older ages with respect to the Fundamental ones at a fixed Mass-Luminosity relation. Moreover, the inclusion of a metallicity term in the Period-Age and Period-Age-Color relations slightly modifies the predicted ages. In particular, the age distribution of the selected sample of Galactic Cepheids is found to be shifted towards slightly older values, when the F-mode canonical relations are considered, with respect to the case at a fixed solar chemical composition. A marginally opposite dependence can be found in the noncanonical F-mode and canonical FO-mode cases.


title: A Review of Electronic Transport in Superconducting Sr$_2$RuO$_4$ Junctions

abstract: We review electronic transport in superconducting junctions with Sr$_2$RuO$_4$. Transport measurements provide evidence for chiral domain walls and, therefore, chiral superconductivity in superconducting Sr$_2$RuO$_4$, but so far, the symmetry of the underlying superconducting state remains inconclusive. Further studies involving density of states measurements and spin-polarised transport in local/non--local Sr$_2$RuO$_4$ junctions with magnetic materials could lead to fundamental discoveries and a better understanding of the superconducting state.


title: The Two-Loop $\phi^4$ Kink Mass

abstract: At one loop, quantum kinks are described by a free theory. The nonlinearity and so the interesting phenomenology arrives at two loops, where, for example, internal excitations couple to continuum excitations. We calculate the two-loop mass of a scalar kink. Unlike previous calculations, we include a counterterm which cancels the vacuum energy density at this order, so that our result for the kink mass is finite even when the vacuum energy density is nonzero. This allows us to apply our result to the $\phi^4$ kink, for which we obtain a two-loop mass contribution of $0.0126\lambda/m$ in terms of the coupling $\lambda$ and the meson mass $m$ evaluated at the minimum of the potential.


title: Attention Weights in Transformer NMT Fail Aligning Words Between Sequences but Largely Explain Model Predictions

abstract: This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we prove that attention weights systematically make alignment errors by relying mainly on uninformative tokens from the source sequence. However, we observe that NMT models assign attention to these tokens to regulate the contribution in the prediction of the two contexts, the source and the prefix of the target sequence. We provide evidence about the influence of wrong alignments on the model behavior, demonstrating that the encoder-decoder attention mechanism is well suited as an interpretability method for NMT. Finally, based on our analysis, we propose methods that largely reduce the word alignment error rate compared to standard induced alignments from attention weights.


title: Dark Matter in Astrophysics/Cosmology

abstract: These lecture notes aim to provide an introduction to dark matter from the perspective of astrophysics/cosmology. We start with a rapid overview of cosmology, including the evolution of the Universe, its thermal history and structure formation. Then we look at the observational evidence for dark matter, from observations of galaxies, galaxy clusters, the anisotropies in the cosmic microwave background radiation and large scale structure. To detect dark matter we need to know how it's distributed, in particular in the Milky Way, so next we overview relevant results from numerical simulations and observations. Finally, we conclude by looking at what astrophysical and cosmological observations can tell us about the nature of dark matter, focusing on two particular cases: warm and self-interacting dark matter.


title: Higgs triplet extension of GRACE

abstract: Much theoretical effort and automatization are required to confront new physics models with experimental data for many types of particle reactions at future colliders. In this context, we extend GRACE, an automatic calculation system for invariant amplitudes, to incorporate particles and interactions in the Georgi-Machacek model. With the extended GRACE system, we study fermiophobic Higgs boson production processes at $e^+ e^-$ and $e^- e^-$ colliders in the model. The results show some advantages of $e^- e^-$ colliders over $e^+ e^-$ colliders for new physics search and thus its complementary role.


title: Creation and Verification of Digital Twins in Cloud Production

abstract: This article discusses the use of digital twins for products made of polymer composite materials. The design of new products from polymer composite materials, both within the framework of the traditional and new direction of cloud production, requires the need to calculate the physical and mechanical characteristics of the product at the design stage. Carrying out full-scale tests increases greatly the cost and slows down the production. It requires the manufacture of a prototype of the product. The use of existing development tools does not always provide the required characteristics. To solve this problem, it is proposed to use a digital twin, which will not only solve the problem, but will also help to move to cloud production and the development of the Industry 4.0 direction. Thus, a new problem arises - how to create digital twins of products from polymer composite materials. The analysis makes it possible to conclude that the traditional methods of mathematical physics are not suitable for the solution of this problem, since the twins obtained with their help do not have any properties of adaptability. To solve the problem, it is proposed to use deep neural networks one of the most powerful methods of machine learning. This will make it possible to obtain digital twins of products made of polymer composite materials that can adapt to changes in the model, environmental conditions and adapt to changes in the indicators of sensors and transducers installed on the product.


title: Federating Scholarly Infrastructures with GraphQL

abstract: A plethora of scholarly knowledge is being published on distributed scholarly infrastructures. Querying a single infrastructure is no longer sufficient for researchers to satisfy information needs. We present a GraphQL-based federated query service for executing distributed queries on numerous, heterogeneous scholarly infrastructures (currently, ORKG, DataCite and GeoNames), thus enabling the integrated retrieval of scholarly content from these infrastructures. Furthermore, we present the methods that enable cross-walks between artefact metadata and artefact content across scholarly infrastructures, specifically DOI-based persistent identification of ORKG artefacts (e.g., ORKG comparisons) and linking ORKG content to third-party semantic resources (e.g., taxonomies, thesauri, ontologies). This type of linking increases interoperability, facilitates the reuse of scholarly knowledge, and enables finding machine actionable scholarly knowledge published by ORKG in global scholarly infrastructures. In summary, we suggest applying the established linked data principles to scholarly knowledge to improve its findability, interoperability, and ultimately reusability, i.e., improve scholarly knowledge FAIR-ness.


title: Impact of xenon doping in the scintillation light in a large liquid-argon TPC

abstract: The use of xenon-doped liquid argon is a promising alternative for large pure liquid-argon TPCs. Not only xenon-doped liquid argon enhances the light production, mitigating the possible suppression due to impurities, but also it increases the wavelength of the scintillation light, enlarging the effective Rayleigh scattering length and improving the detection uniformity. ProtoDUNE Dual-Phase is a 300-ton active volume LAr TPC, a prototype for the Deep Underground Neutrino Experiment (DUNE), a dual-site experiment for long-baseline neutrino oscillation studies, neutrino astrophysics and nucleon decay searches. ProtoDUNE Dual-Phase took cosmic muon data at CERN with pure liquid argon and with xenon-doped liquid argon for over a year. The impact of the presence of xenon in the scintillation light and its comparison with the pure liquid argon data will be presented. These results are of interest to any future large LAr TPCs.


title: Giant effective Zeeman splitting in a monolayer semiconductor realized by spin-selective strong light-matter coupling

abstract: Strong coupling between light and the fundamental excitations of a two-dimensional electron gas (2DEG) are of foundational importance both to pure physics and to the understanding and development of future photonic nanotechnologies. Here we study the relationship between spin polarization of a 2DEG in a monolayer semiconductor, MoSe$_2$, and light-matter interactions modified by a zero-dimensional optical microcavity. We find robust spin-susceptibility of the 2DEG to simultaneously enhance and suppress trion-polariton formation in opposite photon helicities. This leads to observation of a giant effective valley Zeeman splitting for trion-polaritons (g-factor >20), exceeding the purely trionic splitting by over five times. Going further, we observe robust effective optical non-linearity arising from the highly non-linear behaviour of the valley-specific strong light-matter coupling regime, and allowing all-optical tuning of the polaritonic Zeeman splitting from 4 to >10 meV. Our experiments lay the groundwork for engineering quantum-Hall-like phases with true unidirectionality in monolayer semiconductors, accompanied by giant effective photonic non-linearities rooted in many-body exciton-electron correlations.


title: On the prime graph of a finite group with unique nonabelian composition factor

abstract: We say that finite groups are isospectral if they have the same sets of orders of elements. It is known that every nonsolvable finite group $G$ isospectral to a finite simple group has a unique nonabelian composition factor, that is, the quotient of $G$ by the solvable radical of $G$ is an almost simple group. The main goal of this paper is prove that this almost simple group is a cyclic extension of its socle. To this end, we consider a general situation when $G$ is an arbitrary group with unique nonabelian composition factor, not necessarily isospectral to a simple group, and study the prime graph of $G$, where the prime graph of $G$ is the graph whose vertices are the prime numbers dividing the order of $G$ and two such numbers $r$ and $s$ are adjacent if and only if $r\neq s$ and $G$ has an element of order $rs$. Namely, we establish some sufficient conditions for the prime graph of such a group to have a vertex adjacent to all other vertices. Besides proving the main result, this allows us to refine a recent result by P. Cameron and N. Maslova concerning finite groups almost recognizable by prime graph.


title: Applied Regression Analysis of Correlations for Correlated Data

abstract: Correlated data are ubiquitous in today's data-driven society. While regression models for analyzing means and variances of responses of interest are relatively well-developed, the development of these models for analyzing the correlations is largely confined to longitudinal data, a special form of sequentially correlated data. This paper proposes a new method for the analysis of correlations to fully exploit the use of covariates for general correlated data. In a renewed analysis of the Classroom data, a highly unbalanced multilevel clustered data with within-class and within-school correlations, our method reveals informative insights on these structures not previously known. In another analysis of the malaria immune response data in Benin, a longitudinal study with time-dependent covariates where the exact times of the observations are not available, our approach again provides promising new results. At the heart of our approach is a new generalized z-transformation that converts correlation matrices constrained to be positive definite to vectors with unrestricted support, and is order-invariant. These two properties enable us to develop regression analysis incorporating covariates for the modelling of correlations via the use of maximum likelihood.


title: Random-time quantum measurements

abstract: The analysis of a continuous measurement record $z(t)$ poses a fundamental challenge in quantum measurement theory. Different approaches have been used in the past as records can, e.g., exhibit predominantly Gaussian noise, telegraph noise, or clicks at random times. The last case may appear as photon clicks in an optical spin noise measurement at very low probe laser power. Here we show that such random-time quantum measurements can similarly to the first two cases be analyzed in terms of higher-order temporal correlations of the detector output $z(t)$ and be related to the Liouvillian of the measured quantum system. Our analysis in terms of up to fourth-order spectra (quantum polyspectra) shows that this new type of spectra reveals the same valuable information as previously studied higher-order spectra in case of usual continuous quantum measurements. Surprisingly, broad-band system dynamics is revealed even for deliberately low average measurement rates. Many applications are envisioned in high-resolution spectroscopy, single-photon microscopy, circuit quantum electrodynamics, quantum sensing, and quantum measurements in general.


title: REST-for-Physics, a ROOT-based framework for event oriented data analysis and combined Monte Carlo response

abstract: The REST-for-Physics (Rare Event Searches Toolkit for Physics) framework is a ROOT-based solution providing the means to process and analyze experimental or Monte Carlo event data. Special care has been taken on the traceability of the code and the validation of the results produced within the framework, together with the connectivity between code and data stored registered through specific version metadata members. The framework development was originally motivated to cover the needs at Rare Event Searches experiments (experiments looking for phenomena having extremely low occurrence probability like dark matter or neutrino interactions or rare nuclear decays), and its components naturally implement tools to address the challenges in these kinds of experiments; the integration of a detector physics response, the implementation of signal processing routines, or topological algorithms for physical event identification are some examples. Despite this specialization, the framework was conceived thinking in scalability, and other event-oriented applications could benefit from the data processing routines and/or metadata description implemented in REST, being the generic framework tools completely decoupled from dedicated libraries. REST-for-Physics is a consolidated piece of software already serving the needs of different physics experiments - using gaseous Time Projection Chambers (TPCs) as detection technology - for background data analysis and detector characterization, as well as generic detector R\&D. Even though REST has been exploited mainly with gaseous TPCs, the code could be easily applied or adapted to other detection technologies. We present in this work an overview of REST-for-Physics, providing a broad perspective to the infrastructure and organization of the project as a whole. The framework and its different components will be described in the text.


title: Conditional MoCoGAN for Zero-Shot Video Generation

abstract: We propose a conditional generative adversarial network (GAN) model for zero-shot video generation. In this study, we have explored zero-shot conditional generation setting. In other words, we generate unseen videos from training samples with missing classes. The task is an extension of conditional data generation. The key idea is to learn disentangled representations in the latent space of a GAN. To realize this objective, we base our model on the motion and content decomposed GAN and conditional GAN for image generation. We build the model to find better-disentangled representations and to generate good-quality videos. We demonstrate the effectiveness of our proposed model through experiments on the Weizmann action database and the MUG facial expression database.


title: The local exterior square and Asai $L$-functions for $GL(n)$ in odd characteristic

abstract: Let $F$ be a non-archimedean local field of odd characteristic $p > 0$. In this paper, we consider local exterior square $L$-functions $L(s,\pi,\wedge^2)$, Bump-Friedberg $L$-functions $L(s,\pi,BF)$, and Asai $L$-functions $L(s,\pi,As)$ of an irreducible admissible representation $\pi$ of $GL_m(F)$. In particular, we establish that those $L$-functions, via the theory of integral representations, are equal to their corresponding Artin $L$-functions $L(s,\wedge^2(\phi(\pi)))$, $L(s+1/2,\phi(\pi))L(s,\wedge^2(\phi(\pi)))$, and $L(s,As(\phi(\pi)))$ of the associated Langlands parameter $\phi(\pi)$ under the local Langlands correspondence. These are achieved by proving the identity for irreducible supercuspidal representations, exploiting the local to global argument due to Henniart and Lomeli.


title: On Solving a Stochastic Shortest-Path Markov Decision Process as Probabilistic Inference

abstract: Previous work on planning as active inference addresses finite horizon problems and solutions valid for online planning. We propose solving the general Stochastic Shortest-Path Markov Decision Process (SSP MDP) as probabilistic inference. Furthermore, we discuss online and offline methods for planning under uncertainty. In an SSP MDP, the horizon is indefinite and unknown a priori. SSP MDPs generalize finite and infinite horizon MDPs and are widely used in the artificial intelligence community. Additionally, we highlight some of the differences between solving an MDP using dynamic programming approaches widely used in the artificial intelligence community and approaches used in the active inference community.


title: Quantized Vortices Mediated Annealing

abstract: The complex matter-field lattice model is a ubiquitous and universal physics model that directly links to many universal spin models. However, finding the ground state of such a model for the most general interactions between the lattice sites is an NP-hard problem. The knowledge of the ground state is crucially essential for the range of applications from quantum annealing to predicting new materials and understanding the behaviour of spin glasses. Here we show how letting the quantised quasi-3D vortex loops pass through the system during the dissipative quench dynamics helps it find its ground state. Such quantized vortices mediated annealing (QVMA) is achieved by introducing and dynamically changing selected couplings between the lattice sites that either affect the local dimensionality of the medium or change the local mobility of the defects. Analysing the performance of QVMA on strongly glassy systems, we demonstrate that QVMA represents a highly efficient mode of physics enhanced computation.

categories: cond-mat.dis-nn cond-mat.other cond-mat.quant-gas cond-mat.soft


title: Relativistic jet acceleration region in a black hole magnetosphere

abstract: We discuss stationary and axisymmetric trans-magnetosonic outflows in the magnetosphere of a rotating black hole (BH). Ejected plasma from the plasma source located near the BH is accelerated far away to form a relativistic jet. In this study, the plasma acceleration efficiency and conversion of fluid energy from electromagnetic energy are considered by employing the trans-fast magnetosonic flow solution derived by Takahashi & Tomimatsu (2008). Considering the parameter dependence of magnetohydrodynamical flows, we search for the parameters of the trans-magnetosonic outflow solution to the recent M87 jet observations and obtain the angular velocity values of the magnetic field line and angular momentum of the outflow in the magnetized jet flow. Therefore, we estimate the locations of the outer light surface, Alfv\'en surface, and separation surface of the flow. We also discuss the electromagnetic energy flux from the rotating BH (i.e., the Blandford-Znajek process), which suggests that the energy extraction mechanism is effective for the M87 relativistic jet.


title: Whittle Index Based Scheduling Policy for Minimizing the Cost of Age of Information

abstract: We design a new scheduling policy to minimize the general non-decreasing cost function of age of information (AoI) in a multiuser system. In this system, the base station stochastically generates time-sensitive packets and transmits them to corresponding user equipments via an unreliable channel. We first formulate the transmission scheduling problem as an average cost constrained Markov decision process problem. Through introducing the service charge, we derive the closed-form expression for the Whittle index, based on which we design the scheduling policy. Using numerical results, we demonstrate the performance gain of our designed scheduling policy compared to the existing policies, such as the optimal policy, the on-demand Whittle index policy, and the age greedy policy.


title: Towards Stochastic Fault-tolerant Control using Precision Learning and Active Inference

abstract: This work presents a fault-tolerant control scheme for sensory faults in robotic manipulators based on active inference. In the majority of existing schemes, a binary decision of whether a sensor is healthy (functional) or faulty is made based on measured data. The decision boundary is called a threshold and it is usually deterministic. Following a faulty decision, fault recovery is obtained by excluding the malfunctioning sensor. We propose a stochastic fault-tolerant scheme based on active inference and precision learning which does not require a priori threshold definitions to trigger fault recovery. Instead, the sensor precision, which represents its health status, is learned online in a model-free way allowing the system to gradually, and not abruptly exclude a failing unit. Experiments on a robotic manipulator show promising results and directions for future work are discussed.


title: CHIPS: Complete History of Interaction-Powered Supernovae

abstract: We present the public release of the Complete History of Interaction-Powered Supernovae (CHIPS) code, suited to model a variety of transients that arise from interaction with a dense circumstellar medium (CSM). Contrary to existing modellings which mostly attach the CSM by hand, CHIPS self-consistently simulates both the creation of the CSM from mass eruption of massive stars prior to core-collapse, and the subsequent supernova light curve. We demonstrate the performance of CHIPS by presenting examples of the density profiles of the CSM and the light curves. We show that the gross light curve properties of putative interaction-powered transients, such as Type IIn supernovae, rapidly evolving transients and recently discovered fast blue optical transients, can be comprehensively explained with the output of CHIPS.


title: Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filtering

abstract: Gradient-based training in federated learning is known to be vulnerable to faulty/malicious clients, which are often modeled as Byzantine clients. To this end, previous work either makes use of auxiliary data at parameter server to verify the received gradients (e.g., by computing validation error rate) or leverages statistic-based methods (e.g. median and Krum) to identify and remove malicious gradients from Byzantine clients. In this paper, we remark that auxiliary data may not always be available in practice and focus on the statistic-based approach. However, recent work on model poisoning attacks has shown that well-crafted attacks can circumvent most of median- and distance-based statistical defense methods, making malicious gradients indistinguishable from honest ones. To tackle this challenge, we show that the element-wise sign of gradient vector can provide valuable insight in detecting model poisoning attacks. Based on our theoretical analysis of the \textit{Little is Enough} attack, we propose a novel approach called \textit{SignGuard} to enable Byzantine-robust federated learning through collaborative malicious gradient filtering. More precisely, the received gradients are first processed to generate relevant magnitude, sign, and similarity statistics, which are then collaboratively utilized by multiple filters to eliminate malicious gradients before final aggregation. Finally, extensive experiments of image and text classification tasks are conducted under recently proposed attacks and defense strategies. The numerical results demonstrate the effectiveness and superiority of our proposed approach. The code is available at \textit{\url{https://github.com/JianXu95/SignGuard}}


title: Construction of Grid Operators for Multilevel Solvers: a Neural Network Approach

abstract: In this paper, we investigate the combination of multigrid methods and neural networks, starting from a Finite Element discretization of an elliptic PDE. Multigrid methods use interpolation operators to transfer information between different levels of approximation. These operators are crucial for fast convergence of multigrid, but they are generally unknown. We propose Deep Neural Network models for learning interpolation operators and we build a multilevel hierarchy based on the output of the network. We investigate the accuracy of the interpolation operator predicted by the Neural Network, testing it with different network architectures. This Neural Network approach for the construction of grid operators can then be extended for an automatic definition of multilevel solvers, allowing a portable solution in scientific computing


title: Function-on-function partial quantile regression

abstract: In this paper, a functional partial quantile regression approach, a quantile regression analog of the functional partial least squares regression, is proposed to estimate the function-on-function linear quantile regression model. A partial quantile covariance function is first used to extract the functional partial quantile regression basis functions. The extracted basis functions are then used to obtain the functional partial quantile regression components and estimate the final model. In our proposal, the functional forms of the discretely observed random variables are first constructed via a finite-dimensional basis function expansion method. The functional partial quantile regression constructed using the functional random variables is approximated via the partial quantile regression constructed using the basis expansion coefficients. The proposed method uses an iterative procedure to extract the partial quantile regression components. A Bayesian information criterion is used to determine the optimum number of retained components. The proposed functional partial quantile regression model allows for more than one functional predictor in the model. However, the true form of the proposed model is unspecified, as the relevant predictors for the model are unknown in practice. Thus, a forward variable selection procedure is used to determine the significant predictors for the proposed model. Moreover, a case-sampling-based bootstrap procedure is used to construct pointwise prediction intervals for the functional response. The predictive performance of the proposed method is evaluated using several Monte Carlo experiments under different data generation processes and error distributions. Through an empirical data example, air quality data are analyzed to demonstrate the effectiveness of the proposed method.


title: Observation of roton-like dispersion relations in acoustic metamaterials

abstract: Roton dispersion relations, displaying a pronounced "roton" minimum at finite momentum, were firstly predicted by Landau and have been extensively explored in correlated quantum systems at low temperatures. Recently, the roton-like dispersion relations were theoretically extended to classical acoustics, which, however, have remained elusive in reality. Here, we report the experimental observation of roton-like dispersions in acoustic metamaterials with beyond-nearest-neighbour interactions at ambient temperatures. The resulting metamaterial supports multiple coexisting modes with different wavevectors and group velocities at the same frequency and broadband backward waves, analogous to the "return flow" termed by Feynman in the context of rotons. Moreover, by increasing the order of long-range interaction, we observe multiple rotons on a single dispersion band, which have never appeared in Landau's prediction or any other condensed matter study. The realization of roton-like dispersions in metamaterials could pave the way to explore novel physics and applications on quantum-inspired phenomena in classical systems.


title: Dirac clouds around dilatonic black holes

abstract: Dirac cloud is in absence in general relativity since the superradiance mechanism fails to work for Dirac fields. For the first time we find a novel mechanism to support Dirac clouds, which is independent on superradiance mechanism. We study quasi bound states of Dirac particles around a charged spherical black hole in dilatonic gravity. We find that the quasi bound states become real bound states when the central black hole becomes extremal. We make an intensive study of the energy spectrum of the stationary clouds for different fine structure constant $\mu M$, and reveal the existence condition of these clouds. Our result strongly implies that extreme dilatonic black holes behave as elementary particles.


title: Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation

abstract: Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed with outstanding estimation accuracy and inference latency. However, there exists no study that systematically evaluates the quality of these methods and answer the fundamental problem: to what extent can these methods improve the performance of query optimizer in real-world settings, which is the ultimate goal of a CardEst method. In this paper, we comprehensively and systematically compare the effectiveness of CardEst methods in a real DBMS. We establish a new benchmark for CardEst, which contains a new complex real-world dataset STATS and a diverse query workload STATS-CEB. We integrate multiple most representative CardEst methods into an open-source database system PostgreSQL, and comprehensively evaluate their true effectiveness in improving query plan quality, and other important aspects affecting their applicability, ranging from inference latency, model size, and training time, to update efficiency and accuracy. We obtain a number of key findings for the CardEst methods, under different data and query settings. Furthermore, we find that the widely used estimation accuracy metric(Q-Error) cannot distinguish the importance of different sub-plan queries during query optimization and thus cannot truly reflect the query plan quality generated by CardEst methods. Therefore, we propose a new metric P-Error to evaluate the performance of CardEst methods, which overcomes the limitation of Q-Error and is able to reflect the overall end-to-end performance of CardEst methods. We have made all of the benchmark data and evaluation code publicly available at https://github.com/Nathaniel-Han/End-to-End-CardEst-Benchmark.


title: Sub-angstrom Non-invasive Imaging of Atomic Arrangement in 2D Hybrid Perovskites

abstract: Non-invasive imaging of the atomic arrangement in two-dimensional (2D) Ruddlesden-Popper hybrid Perovskites (RPPs), as well as understanding the related effects is challenging, due to the insulating nature and softness of the organic layers which also obscure the underlying inorganic lattice. Here, we demonstrate a sub-angstrom resolution imaging of both soft organic layers and inorganic framework in a prototypical 2D lead-halide RPP crystal via combined tip-functionalized Scanning Tunneling Microscopy (STM) and non-contact Atomic Force Microscope (ncAFM) corroborated by theoretical simulations. STM measurements unveil the atomic reconstruction of the inorganic lead-halide lattice and overall twin-domain composition of the RPP crystal, while ncAFM measurements with a CO-tip enable non-perturbative visualization of the cooperative reordering of surface organic cations driven by their hydrogen bonding interactions with the inorganic lattice. Moreover, such a joint technique also allows for the atomic-scale imaging of the electrostatic potential variation across the twin-domain walls, revealing alternating quasi-one-dimensional (1D) electron and hole-channels at neighboring twin-boundaries, which may influence in-plane exciton transport and dissociation.


title: Translation-invariant operators in reproducing kernel Hilbert spaces

abstract: Let $G$ be a locally compact abelian group with a Haar measure, and $Y$ be a measure space. Suppose that $H$ is a reproducing kernel Hilbert space of functions on $G\times Y$, such that $H$ is naturally embedded into $L^2(G\times Y)$ and is invariant under the translations associated with the elements of $G$. Under some additional technical assumptions, we study the W*-algebra $\mathcal{V}$ of translation-invariant bounded linear operators acting on $H$. First, we decompose $\mathcal{V}$ into the direct integral of the W*-algebras of bounded operators acting on the reproducing kernel Hilbert spaces $\widehat{H}_\xi$, $\xi\in\widehat{G}$, generated by the Fourier transform of the reproducing kernel. Second, we give a constructive criterion for the commutativity of $\mathcal{V}$. Third, in the commutative case, we construct a unitary operator that simultaneously diagonalizes all operators belonging to $\mathcal{V}$, i.e., converts them into some multiplication operators. Our scheme generalizes many examples previously studied by Nikolai Vasilevski and other authors.


title: Explaining Deep Learning Representations by Tracing the Training Process

abstract: We propose a novel explanation method that explains the decisions of a deep neural network by investigating how the intermediate representations at each layer of the deep network were refined during the training process. This way we can a) find the most influential training examples during training and b) analyze which classes attributed most to the final representation. Our method is general: it can be wrapped around any iterative optimization procedure and covers a variety of neural network architectures, including feed-forward networks and convolutional neural networks. We first propose a method for stochastic training with single training instances, but continue to also derive a variant for the common mini-batch training. In experimental evaluations, we show that our method identifies highly representative training instances that can be used as an explanation. Additionally, we propose a visualization that provides explanations in the form of aggregated statistics over the whole training process.


title: Data-Centric and Data-Aware Frameworks for Fundamentally Efficient Data Handling in Modern Computing Systems

abstract: There is an explosive growth in the size of the input and/or intermediate data used and generated by modern and emerging applications. Unfortunately, modern computing systems are not capable of handling large amounts of data efficiently. Major concepts and components (e.g., the virtual memory system) and predominant execution models (e.g., the processor-centric execution model) used in almost all computing systems are designed without having modern applications' overwhelming data demand in mind. As a result, accessing, moving, and processing large amounts of data faces important challenges in today's systems, making data a first-class concern and a prime performance and energy bottleneck in such systems. This thesis studies the root cause of inefficiency in modern computing systems when handling modern applications' data demand, and aims to fundamentally address such inefficiencies, with a focus on two directions. First, we design SIMDRAM, an end-to-end processing-using-DRAM framework that aids the widespread adoption of processing-using-DRAM, a data-centric computation paradigm that improves the overall performance and efficiency of the system when computing large amounts of data by minimizing the cost of data movement and enabling computation where the data resides. Second, we introduce the Virtual Block Interface (VBI), a novel virtual memory framework that 1) eliminates the inefficiencies of the conventional virtual memory frameworks when handling the high memory demand in modern applications, and 2) is built from the ground up to understand, convey, and exploit data properties, to create opportunities for performance and efficiency improvements.


title: The Energy-Dissipation Principle for stochastic parabolic equations

abstract: The Energy-Dissipation Principle provides a variational tool for the analysis of parabolic evolution problems: solutions are characterized as so-called null-minimizers of a global functional on entire trajectories. This variational technique allows for applying the general results of the calculus of variations to the underlying differential problem and has been successfully applied in a variety of deterministic cases, ranging from doubly nonlinear flows to curves of maximal slope in metric spaces. The aim of this note is to extend the Energy-Dissipation Principle to stochastic parabolic evolution equations. Applications to stability and optimal control are also presented.


title: Dependability-Aware Routing and Scheduling for Time-Sensitive Networking

abstract: Time-Sensitive Networking (TSN) extends IEEE 802.1 Ethernet for safety-critical and real-time applications in several areas, e.g., automotive, aerospace or industrial automation. However, many of these systems also have stringent security requirements, and security attacks may impair safety. Given a TSN-based distributed architecture, a set of applications with tasks and messages, as well as a set of security and redundancy requirements, we are interested to synthesize a system configuration such that the real-time, safety and security requirements are upheld. We use the Timed Efficient Stream Loss-Tolerant Authentication (TESLA) low-resource multicast authentication protocol to guarantee the security requirements, and redundant disjunct message routes to tolerate link failures. We consider that tasks are dispatched using a static cyclic schedule table and that the messages use the time-sensitive traffic class in TSN, which relies on schedule tables (called Gate Control Lists, GCLs) in the network switches. A configuration consists of the schedule tables for tasks as well as the disjoint routes and GCLs for messages. We propose a Constraint Programming-based formulation which can be used to find an optimal solution with respect to our cost function. Additionally, we propose a Simulated Annealing based metaheuristic, which can find good solution for large test cases. We evaluate both approaches on several test cases.