title: Harmonic analysis on inhomogeneous amenable networks and the Bose--Einstein condensation

abstract: We study in detail relevant spectral properties of the adjacency matrix of inhomogeneous amenable networks, and in particular those arising by negligible additive perturbations of periodic lattices. The obtained results are deeply connected to the systematic investigation of the Bose--Einstein condensation for the so called Pure Hopping model describing the thermodynamics of Bardeen--Cooper pairs of Bosons in arrays of Josephson junctions.


title: AI4D -- African Language Program

abstract: Advances in speech and language technologies enable tools such as voice-search, text-to-speech, speech recognition and machine translation. These are however only available for high resource languages like English, French or Chinese. Without foundational digital resources for African languages, which are considered low-resource in the digital context, these advanced tools remain out of reach. This work details the AI4D - African Language Program, a 3-part project that 1) incentivised the crowd-sourcing, collection and curation of language datasets through an online quantitative and qualitative challenge, 2) supported research fellows for a period of 3-4 months to create datasets annotated for NLP tasks, and 3) hosted competitive Machine Learning challenges on the basis of these datasets. Key outcomes of the work so far include 1) the creation of 9+ open source, African language datasets annotated for a variety of ML tasks, and 2) the creation of baseline models for these datasets through hosting of competitive ML challenges.


title: A new perspective on the competent programmer hypothesis through the reproduction of bugs with repeated mutations

abstract: The competent programmer hypothesis states that most programmers are competent enough to create correct or almost correct source code. Because this implies that bugs should usually manifest through small variations of the correct code, the competent programmer hypothesis is one of the fundamental assumptions of mutation testing. Unfortunately, it is still unclear if the competent programmer hypothesis holds and past research presents contradictory claims. Within this article, we provide a new perspective on the competent programmer hypothesis and its relation to mutation testing. We try to re-create real-world bugs through chains of mutations to understand if there is a direct link between mutation testing and bugs. The lengths of these paths help us to understand if the source code is really almost correct, or if large variations are required. Our results indicate that while the competent programmer hypothesis seems to be true, mutation testing is missing important operators to generate representative real-world bugs.


title: An Initial Investigation for Detecting Partially Spoofed Audio

abstract: All existing databases of spoofed speech contain attack data that is spoofed in its entirety. In practice, it is entirely plausible that successful attacks can be mounted with utterances that are only partially spoofed. By definition, partially-spoofed utterances contain a mix of both spoofed and bona fide segments, which will likely degrade the performance of countermeasures trained with entirely spoofed utterances. This hypothesis raises the obvious question: 'Can we detect partially-spoofed audio?' This paper introduces a new database of partially-spoofed data, named PartialSpoof, to help address this question. This new database enables us to investigate and compare the performance of countermeasures on both utterance- and segmental- level labels. Experimental results using the utterance-level labels reveal that the reliability of countermeasures trained to detect fully-spoofed data is found to degrade substantially when tested with partially-spoofed data, whereas training on partially-spoofed data performs reliably in the case of both fully- and partially-spoofed utterances. Additional experiments using segmental-level labels show that spotting injected spoofed segments included in an utterance is a much more challenging task even if the latest countermeasure models are used.


title: The Impact of Noise on Evaluation Complexity: The Deterministic Trust-Region Case

abstract: Intrinsic noise in objective function and derivatives evaluations may cause premature termination of optimization algorithms. Evaluation complexity bounds taking this situation into account are presented in the framework of a deterministic trust-region method. The results show that the presence of intrinsic noise may dominate these bounds, in contrast with what is known for methods in which the inexactness in function and derivatives' evaluations is fully controllable. Moreover, the new analysis provides estimates of the optimality level achievable, should noise cause early termination. It finally sheds some light on the impact of inexact computer arithmetic on evaluation complexity.


title: $\mathbb Q\setminus\mathbb Z$ is diophantine over $\mathbb Q$ with 32 unknowns

abstract: In 2016 J. Koenigsmann refined a celebrated theorem of J. Robinson by proving that $\mathbb Q\setminus\mathbb Z$ is diophantine over $\mathbb Q$, i.e., there is a polynomial $P(t,x_1,\ldots,x_{n})\in\mathbb Z[t,x_1,\ldots,x_{n}]$ such that for any rational number $t$ we have $$t\not\in\mathbb Z\iff \exists x_1\cdots\exists x_{n}[P(t,x_1,\ldots,x_{n})=0]$$ where variables range over $\mathbb Q$, equivalently $$t\in\mathbb Z\iff \forall x_1\cdots\forall x_{n}[P(t,x_1,\ldots,x_{n})\not=0].$$ In this paper we prove that we may take $n=32$. Combining this with a result of Z.-W. Sun, we show that there is no algorithm to decide for any $f(x_1,\ldots,x_{41})\in\mathbb Z[x_1,\ldots,x_{41}]$ whether $$\forall x_1\cdots\forall x_9\exists y_1\cdots\exists y_{32}[f(x_1,\ldots,x_9,y_1,\ldots,y_{32})=0],$$ where variables range over $\mathbb Q$.


title: Perturbations and the Future Conformal Boundary

abstract: The concordance model of cosmology predicts a universe which finishes in a finite amount of conformal time at a future conformal boundary. We show that for particular cases we study, the background variables and perturbations may be analytically continued beyond this boundary and that the "end of the universe" is not necessarily the end of their physical development. Remarkably, these theoretical considerations of the end of the universe might have observable consequences today: perturbation modes consistent with these boundary conditions have a quantised power spectrum which may be relevant to features seen in the large scale cosmic microwave background. Mathematically these cosmological models may either be interpreted as a palindromic universe mirrored in time, a reflecting boundary condition, or a double cover, but are identical with respect to their observational predictions and stand in contrast to the predictions of conformal cyclic cosmologies.


title: Secant non-defectivity via collisions of fat points

abstract: Secant defectivity of projective varieties is classically approached via dimensions of linear systems with multiple base points in general position. The latter can be studied via degenerations. We exploit a technique that allows some of the base points to collapse together. We deduce a general result which we apply to prove a conjecture by Abo and Brambilla: for $c \geq 3$ and $d \geq 3$, the Segre-Veronese embedding of $\mathbb{P}^m\times\mathbb{P}^n$ in bidegree $(c,d)$ is non-defective.


title: An Analysis of State-of-the-art Activation Functions For Supervised Deep Neural Network

abstract: This paper provides an analysis of state-of-the-art activation functions with respect to supervised classification of deep neural network. These activation functions comprise of Rectified Linear Units (ReLU), Exponential Linear Unit (ELU), Scaled Exponential Linear Unit (SELU), Gaussian Error Linear Unit (GELU), and the Inverse Square Root Linear Unit (ISRLU). To evaluate, experiments over two deep learning network architectures integrating these activation functions are conducted. The first model, basing on Multilayer Perceptron (MLP), is evaluated with MNIST dataset to perform these activation functions. Meanwhile, the second model, likely VGGish-based architecture, is applied for Acoustic Scene Classification (ASC) Task 1A in DCASE 2018 challenge, thus evaluate whether these activation functions work well in different datasets as well as different network architectures.


title: Trigonometric multiplicative chaos and Application to random distributions

abstract: The random trigonometric series $\sum_{n=1}^\infty \rho_n \cos (nt +\omega_n)$ on the circle $\mathbb{T}$ are studied under the conditions $\sum |\rho_n|^2=\infty$ and $\rho_n\to 0$, where $\{\omega_n\}$ are iid and uniformly distributed on $\mathbb{T}$. They are almost surely not Fourier-Stieljes series but define pseudo-functions. This leads us to develop the theory of trigonometric multiplicative chaos, which are the limits of the exponentiations of partials sums. which produces a class of random measures. The behaviors of the partial sums of the above series are proved to be multifractal. Our theory holds on the torus $\mathbb{T}^d$ of dimension $d\ge 1$.


title: Searching Efficient Model-guided Deep Network for Image Denoising

abstract: Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with highly competent denoising performance. However, the optimization gap between the super-network and the sub-architectures has remained an open issue in both low-level and high-level vision. In this paper, we present a novel approach to filling in this gap by connecting model-guided design with NAS (MoD-NAS) and demonstrate its application into image denoising. Specifically, we propose to construct a new search space under model-guided framework and develop more stable and efficient differential search strategies. MoD-NAS employs a highly reusable width search strategy and a densely connected search block to automatically select the operations of each layer as well as network width and depth via gradient descent. During the search process, the proposed MoG-NAS is capable of avoiding mode collapse due to the smoother search space designed under the model-guided framework. Experimental results on several popular datasets show that our MoD-NAS has achieved even better PSNR performance than current state-of-the-art methods with fewer parameters, lower number of flops, and less amount of testing time.


title: LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

abstract: Neural network-based language models are commonly used in rescoring approaches to improve the quality of modern automatic speech recognition (ASR) systems. Most of the existing methods are computationally expensive since they use autoregressive language models. We propose a novel rescoring approach, which processes the entire lattice in a single call to the model. The key feature of our rescoring policy is a novel non-autoregressive Lattice Transformer Language Model (LT-LM). This model takes the whole lattice as an input and predicts a new language score for each arc. Additionally, we propose the artificial lattices generation approach to incorporate a large amount of text data in the LT-LM training process. Our single-shot rescoring performs orders of magnitude faster than other rescoring methods in our experiments. It is more than 300 times faster than pruned RNNLM lattice rescoring and N-best rescoring while slightly inferior in terms of WER.


title: Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Voting

abstract: We propose a novel keypoint voting scheme based on intersecting spheres, that is more accurate than existing schemes and allows for fewer, more disperse keypoints. The scheme is based upon the distance between points, which as a 1D quantity can be regressed more accurately than the 2D and 3D vector and offset quantities regressed in previous work, yielding more accurate keypoint localization. The scheme forms the basis of the proposed RCVPose method for 6 DoF pose estimation of 3D objects in RGB-D data, which is particularly effective at handling occlusions. A CNN is trained to estimate the distance between the 3D point corresponding to the depth mode of each RGB pixel, and a set of 3 disperse keypoints defined in the object frame. At inference, a sphere centered at each 3D point is generated, of radius equal to this estimated distance. The surfaces of these spheres vote to increment a 3D accumulator space, the peaks of which indicate keypoint locations. The proposed radial voting scheme is more accurate than previous vector or offset schemes, and is robust to disperse keypoints. Experiments demonstrate RCVPose to be highly accurate and competitive, achieving state-of-the-art results on the LINEMOD 99.7% and YCB-Video 97.2% datasets, notably scoring +4.9% higher 71.1% than previous methods on the challenging Occlusion LINEMOD dataset, and on average outperforming all other published results from the BOP benchmark for these 3 datasets. Our code is available at http://www.github.com/aaronwool/rcvpose.


title: Poisson approximation with applications to stochastic geometry

abstract: This article compares the distributions of integer-valued random variables and Poisson random variables. It considers the total variation and the Wasserstein distance and provides, in particular, explicit bounds on the pointwise difference between the cumulative distribution functions. Special attention is dedicated to estimating the difference when the cumulative distribution functions are evaluated at 0. This permits to approximate the minimum (or maximum) of a collection of random variables by a suitable random variable in the Kolmogorov distance. The main theoretical results are obtained by combining the Chen-Stein method with size-bias coupling and a generalization of size-bias coupling for integer-valued random variables developed herein. A wide variety of applications are then discussed with a focus on stochastic geometry.


title: Active learning and element embedding approach in neural networks for infinite-layer versus perovskite oxides

abstract: Combining density functional theory simulations and active learning of neural networks, we explore formation energies of oxygen vacancy layers, lattice parameters, and their correlations in infinite-layer versus perovskite oxides across the periodic table, and place the superconducting nickelate and cuprate families in a comprehensive statistical context. We show that neural networks predict these observables with high precision, using only 30-50% of the data for training. Element embedding autonomously identifies concepts of chemical similarity between the individual elements in line with human knowledge. Based on the fundamental concepts of entropy and information, active learning composes the training set by an optimal strategy without a priori knowledge and provides systematic control over the prediction accuracy. This offers key ingredients to considerably accelerate scans of large parameter spaces and exemplifies how artificial intelligence may assist on the quantum scale in finding novel materials with optimized properties.


title: Transition to chaos in a reduced-order model of a shear layer

abstract: The present work studies the non-linear dynamics of a shear layer, driven by a body force and confined between parallel walls, a simplified setting to study transitional and turbulent shear layers. It was introduced by Nogueira \& Cavalieri (J. Fluid Mech. 907, A32, 2021), and is here studied using a reduced-order model based on a Galerkin projection of the Navier-Stokes system. By considering a confined shear layer with free-slip boundary conditions on the walls, periodic boundary conditions in streamwise and spanwise directions may be used, simplifying the system and enabling the use of methods of dynamical systems theory. A basis of eight modes is used in the Galerkin projection, representing the mean flow, Kelvin-Helmholtz vortices, rolls, streaks and oblique waves, structures observed in the cited work, and also present in shear layers and jets. A dynamical system is obtained, and its transition to chaos is studied. Increasing Reynolds number $Re$ leads to pitchfork and Hopf bifurcations, and the latter leads to a limit cycle with amplitude modulation of vortices, as in the DNS by Nogueira \& Cavalieri. Further increase of $Re$ leads to the appearance of a chaotic saddle, followed by the emergence of quasi-periodic and chaotic attractors. The chaotic attractors suffer a merging crisis for higher $Re$, leading to chaotic dynamics with amplitude modulation and phase jumps of vortices. This is reminiscent of observations of coherent structures in turbulent jets, suggesting that the model represents dynamics consistent with features of shear layers and jets.


title: Resolution-enhanced OCT and expanded framework of information capacity and resolution in coherent imaging

abstract: Spatial resolution in optical microscopy has traditionally been treated as a fixed parameter of the optical system. Here, we present an approach to enhance transverse resolution in beam-scanned optical coherence tomography (OCT) beyond its aberration-free resolution limit, without any modification to the optical system. Based on the theorem of invariance of information capacity, resolution-enhanced (RE)-OCT navigates the exchange of information between resolution and signal-to-noise ratio (SNR) by exploiting efficient noise suppression via coherent averaging and a simple computational bandwidth expansion procedure. We demonstrate a resolution enhancement of 1.5 times relative to the aberration-free limit while maintaining comparable SNR in silicone phantom. We show that RE-OCT can significantly enhance the visualization of fine microstructural features in collagen gel and ex vivo mouse brain. Beyond RE-OCT, our analysis in the spatial-frequency domain leads to an expanded framework of information capacity and resolution in coherent imaging that contributes new implications to the theory of coherent imaging. RE-OCT can be readily implemented on most OCT systems worldwide, immediately unlocking information that is beyond their current imaging capabilities, and so has the potential for widespread impact in the numerous areas in which OCT is utilized, including the basic sciences and translational medicine.


title: End-To-End Bias Mitigation: Removing Gender Bias in Deep Learning

abstract: Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat groups or individuals unfairly based on protected attributes such as gender. In this paper, we introduce several examples of machine learning gender bias in practice followed by formalizations of fairness. We provide a survey of fairness research by detailing influential pre-processing, in-processing, and post-processing bias mitigation algorithms. We then propose an end-to-end bias mitigation framework, which employs a fusion of pre-, in-, and post-processing methods to leverage the strengths of each individual technique. We test this method, along with the standard techniques we review, on a deep neural network to analyze bias mitigation in a deep learning setting. We find that our end-to-end bias mitigation framework outperforms the baselines with respect to several fairness metrics, suggesting its promise as a method for improving fairness. As society increasingly relies on artificial intelligence to help in decision-making, addressing gender biases present in deep learning models is imperative. To provide readers with the tools to assess the fairness of machine learning models and mitigate the biases present in them, we discuss multiple open source packages for fairness in AI.


title: DCANet: Dense Context-Aware Network for Semantic Segmentation

abstract: As the superiority of context information gradually manifests in advanced semantic segmentation, learning to capture the compact context relationship can help to understand the complex scenes. In contrast to some previous works utilizing the multi-scale context fusion, we propose a novel module, named Dense Context-Aware (DCA) module, to adaptively integrate local detail information with global dependencies. Driven by the contextual relationship, the DCA module can better achieve the aggregation of context information to generate more powerful features. Furthermore, we deliberately design two extended structures based on the DCA modules to further capture the long-range contextual dependency information. By combining the DCA modules in cascade or parallel, our networks use a progressive strategy to improve multi-scale feature representations for robust segmentation. We empirically demonstrate the promising performance of our approach (DCANet) with extensive experiments on three challenging datasets, including PASCAL VOC 2012, Cityscapes, and ADE20K.


title: Notes on planar semimodular lattices. IX. $\mathcal{C}_1$-diagrams

abstract: A planar semimodular lattice $L$ is \emph{slim} if $\mathbf{M}_3$ is not a sublattice of $L$. In a recent paper, G. Cz\'edli introduced a very powerful diagram type for slim, planar, semimodular lattices. This short note proves the existence of such diagrams.


title: Optimal Transport-based Adaptation in Dysarthric Speech Tasks

abstract: In many real-world applications, the mismatch between distributions of training data (source) and test data (target) significantly degrades the performance of machine learning algorithms. In speech data, causes of this mismatch include different acoustic environments or speaker characteristics. In this paper, we address this issue in the challenging context of dysarthric speech, by multi-source domain/speaker adaptation (MSDA/MSSA). Specifically, we propose the use of an optimal-transport based approach, called MSDA via Weighted Joint Optimal Transport (MSDA-WDJOT). We confront the mismatch problem in dysarthria detection for which the proposed approach outperforms both the Baseline and the state-of-the-art MSDA models, improving the detection accuracy of 0.9% over the best competitor method. We then employ MSDA-WJDOT for dysarthric speaker adaptation in command speech recognition. This provides a Command Error Rate relative reduction of 16% and 7% over the baseline and the best competitor model, respectively. Interestingly, MSDA-WJDOT provides a similarity score between the source and the target, i.e. between speakers in this case. We leverage this similarity measure to define a Dysarthric and Healthy score of the target speaker and diagnose the dysarthria with an accuracy of 95%.


title: Extraction of a computer-certified ODE solver

abstract: Reliably determining system trajectories is essential in many analysis and control design approaches. To this end, an initial value problem has to be usually solved via numerical algorithms which rely on a certain software realization. Because software realizations can be error-prone, proof assistants may be used to verify the underlying mathematical concepts and corresponding algorithms. In this work we present a computer-certified formalization of the solution of the initial value problem of ordinary differential equations. The concepts are performed in the framework of constructive analysis and the proofs are written in the \texttt{Minlog} proof system. We show the extraction of a program, which solves an ODE numerically and provide some possible optimization regarding the efficiency. Finally, we provide numerical experiments to demonstrate how programs of a certain high level of abstraction can be obtained efficiently. The presented concepts may also be viewed as a part of preliminary work for the development of formalized nonlinear control theory, hence offering the possibility of computer-assisted controller design and program extraction for the controller implementation.


title: Explicit and implicit network connectivity: Analytical formulation and application to transport processes

abstract: Connectivity is a fundamental structural feature of a network that determines the outcome of any dynamics that happens on top of it. However, an analytical approach to obtain connection probabilities between nodes associated to paths of different lengths is still missing. Here, we derive exact expressions for random-walk connectivity probabilities across any range of numbers of steps in a generic temporal, directed and weighted network. This allows characterizing explicit connectivity realized by causal paths as well as implicit connectivity related to motifs of three nodes and two links called here pitchforks. We directly link such probabilities to the processes of tagging and sampling any quantity exchanged across the network, hence providing a natural framework to assess transport dynamics. Finally, we apply our theoretical framework to study ocean transport features in the Mediterranean Sea. We find that relevant transport structures, such as fluid barriers and corridors, can generate contrasting and counter-intuitive connectivity patterns bringing novel insights into how ocean currents drive seascape connectivity.


title: Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervision

abstract: Visual re-localization means using a single image as input to estimate the camera's location and orientation relative to a pre-recorded environment. The highest-scoring methods are "structure based," and need the query camera's intrinsics as an input to the model, with careful geometric optimization. When intrinsics are absent, methods vie for accuracy by making various other assumptions. This yields fairly good localization scores, but the models are "narrow" in some way, eg., requiring costly test-time computations, or depth sensors, or multiple query frames. In contrast, our proposed method makes few special assumptions, and is fairly lightweight in training and testing. Our pose regression network learns from only relative poses of training scenes. For inference, it builds a graph connecting the query image to training counterparts and uses a graph neural network (GNN) with image representations on nodes and image-pair representations on edges. By efficiently passing messages between them, both representation types are refined to produce a consistent camera pose estimate. We validate the effectiveness of our approach on both standard indoor (7-Scenes) and outdoor (Cambridge Landmarks) camera re-localization benchmarks. Our relative pose regression method matches the accuracy of absolute pose regression networks, while retaining the relative-pose models' test-time speed and ability to generalize to non-training scenes.


title: Morita equivalences and the inductive blockwise Alperin weight condition for type $\mathsf A$

abstract: As a step to establish the blockwise Alperin weight conjecture for all finite groups, we verify the inductive blockwise Alperin weight condition introduced by Navarro--Tiep and Sp\"ath for simple groups of Lie type $\mathsf A$, split or twisted. Key to the proofs is to reduce the verification of the inductive condition to the isolated (that means unipotent) blocks, using the Jordan decomposition for blocks of finite reductive groups given by Bonnaf\'e, Dat and Rouquier.


title: Proton energization by phase-steepening of parallel propagating Alfv\'enic fluctuations

abstract: Proton energization at magnetic discontinuities generated by phase-steepened fronts of parallel propagating, large-amplitude Alfv\'enic fluctuation is studied using hybrid simulations. We find that dispersive effects yield to the collapse of the wave via phase steepening and the subsequent generation of compressible fluctuations that mediate an efficient local energy transfer from the wave to the protons. Proton scattering at the steepened edges causes non-adiabatic proton perpendicular heating. Furthermore, the parallel electric field at the propagating fronts mediates the acceleration of protons along the mean field. A steady-state is achieved where proton distribution function displays a field-aligned beam at the Alfv\'en speed, and compressible fluctuations are largely damped. We discuss the implications of our results in the context of Alfv\'enic solar wind.


title: Instantaneous Stereo Depth Estimation of Real-World Stimuli with a Neuromorphic Stereo-Vision Setup

abstract: The stereo-matching problem, i.e., matching corresponding features in two different views to reconstruct depth, is efficiently solved in biology. Yet, it remains the computational bottleneck for classical machine vision approaches. By exploiting the properties of event cameras, recently proposed Spiking Neural Network (SNN) architectures for stereo vision have the potential of simplifying the stereo-matching problem. Several solutions that combine event cameras with spike-based neuromorphic processors already exist. However, they are either simulated on digital hardware or tested on simplified stimuli. In this work, we use the Dynamic Vision Sensor 3D Human Pose Dataset (DHP19) to validate a brain-inspired event-based stereo-matching architecture implemented on a mixed-signal neuromorphic processor with real-world data. Our experiments show that this SNN architecture, composed of coincidence detectors and disparity sensitive neurons, is able to provide a coarse estimate of the input disparity instantaneously, thereby detecting the presence of a stimulus moving in depth in real-time.


title: EasyCall corpus: a dysarthric speech dataset

abstract: This paper introduces a new dysarthric speech command dataset in Italian, called EasyCall corpus. The dataset consists of 21386 audio recordings from 24 healthy and 31 dysarthric speakers, whose individual degree of speech impairment was assessed by neurologists through the Therapy Outcome Measure. The corpus aims at providing a resource for the development of ASR-based assistive technologies for patients with dysarthria. In particular, it may be exploited to develop a voice-controlled contact application for commercial smartphones, aiming at improving dysarthric patients' ability to communicate with their family and caregivers. Before recording the dataset, participants were administered a survey to evaluate which commands are more likely to be employed by dysarthric individuals in a voice-controlled contact application. In addition, the dataset includes a list of non-commands (i.e., words near/inside commands or phonetically close to commands) that can be leveraged to build a more robust command recognition system. At present commercial ASR systems perform poorly on the EasyCall Corpus as we report in this paper. This result corroborates the need for dysarthric speech corpora for developing effective assistive technologies. To the best of our knowledge, this database represents the richest corpus of dysarthric speech to date.


title: Computing quivers for two and higher loops for the colored planar $\phi^3$ theory

abstract: We introduce Feynman-like rules to compute quivers for two loops and higher for the coloured planar $\phi^3$ theory for winding number zero. We demonstrate this for a few cases.


title: Driving Factors Behind the Social Role of Retail Centers on Recreational Activities

abstract: Retail centers can be considered as places for interactional and recreational activities and such social roles of retail centers contribute to the popularity of the retail centers. Therefore, the main objective of this study was to identify effective factors encouraging customers to engage with interactional activities and measure how these factors affect customer behavior. Accordingly, two hypotheses were raised illustrating that the travel time (i.e., the time it takes for a customer to reach the retail center) and the variety of shops (in a retail center) increase the percentage of people who spend their leisure time and recreational activities retail centers. Two case studies were conducted in two analogous retail centers, one in Tehran, Iran, and the other in Madrid, Spain. According to the results, there is an interaction between the travel time and the motivation for the presence of people in the retail center. Furthermore, the results revealed that half of both retail center goers who spend more than 10 minutes to reach the retail centers prefer to do leisure activities and browsing than shopping. In other words, the longer it takes a person to get to the center, the more likely he/she is to spend more time in the mall and do more leisure activities. It is also found that there is a significant relationship between the variety of shops in a retail center and the motivation of customers attending a retail center that encourages people to spend their leisure time in retail centers.


title: Data-driven Design of Context-aware Monitors for Hazard Prediction in Artificial Pancreas Systems

abstract: Medical Cyber-physical Systems (MCPS) are vulnerable to accidental or malicious faults that can target their controllers and cause safety hazards and harm to patients. This paper proposes a combined model and data-driven approach for designing context-aware monitors that can detect early signs of hazards and mitigate them in MCPS. We present a framework for formal specification of unsafe system context using Signal Temporal Logic (STL) combined with an optimization method for patient-specific refinement of STL formulas based on real or simulated faulty data from the closed-loop system for the generation of monitor logic. We evaluate our approach in simulation using two state-of-the-art closed-loop Artificial Pancreas Systems (APS). The results show the context-aware monitor achieves up to 1.4 times increase in average hazard prediction accuracy (F1-score) over several baseline monitors, reduces false-positive and false-negative rates, and enables hazard mitigation with a 54% success rate while decreasing the average risk for patients.


title: Subsubleading soft graviton symmetry and MHV graviton scattering amplitudes

abstract: In arXiv:2008.04330 it was shown that supertranslation and $\overline{SL(2,\mathbb C)}$ current algebra symmetries, corresponding to leading and subleading soft graviton theorems, are enough to determine the tree level MHV graviton scattering amplitudes. In this note we clarify the role of subsubleading soft graviton theorem in this context.


title: Temporal-Logic-Based Intermittent, Optimal, and Safe Continuous-Time Learning for Trajectory Tracking

abstract: In this paper, we develop safe reinforcement-learning-based controllers for systems tasked with accomplishing complex missions that can be expressed as linear temporal logic specifications, similar to those required by search-and-rescue missions. We decompose the original mission into a sequence of tracking sub-problems under safety constraints. We impose the safety conditions by utilizing barrier functions to map the constrained optimal tracking problem in the physical space to an unconstrained one in the transformed space. Furthermore, we develop policies that intermittently update the control signal to solve the tracking sub-problems with reduced burden in the communication and computation resources. Subsequently, an actor-critic algorithm is utilized to solve the underlying Hamilton-Jacobi-Bellman equations. Finally, we support our proposed framework with stability proofs and showcase its efficacy via simulation results.


title: White Box Methods for Explanations of Convolutional Neural Networks in Image Classification Tasks

abstract: In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However, the decisions made by these networks are not transparent and cannot be directly interpreted by a human. Several approaches have been proposed to explain to understand the reasoning behind a prediction made by a network. In this paper, we propose a topology of grouping these methods based on their assumptions and implementations. We focus primarily on white box methods that leverage the information of the internal architecture of a network to explain its decision. Given the task of image classification and a trained CNN, this work aims to provide a comprehensive and detailed overview of a set of methods that can be used to create explanation maps for a particular image, that assign an importance score to each pixel of the image based on its contribution to the decision of the network. We also propose a further classification of the white box methods based on their implementations to enable better comparisons and help researchers find methods best suited for different scenarios.


title: Connecting Constructive Notions of Ordinals in Homotopy Type Theory

abstract: In classical set theory, there are many equivalent ways to introduce ordinals. In a constructive setting, however, the different notions split apart, with different advantages and disadvantages for each. We consider three different notions of ordinals in homotopy type theory, and show how they relate to each other: A notation system based on Cantor normal forms, a refined notion of Brouwer trees (inductively generated by zero, successor and countable limits), and wellfounded extensional orders. For Cantor normal forms, most properties are decidable, whereas for wellfounded extensional transitive orders, most are undecidable. Formulations for Brouwer trees are usually partially decidable. We demonstrate that all three notions have properties expected of ordinals: their order relations, although defined differently in each case, are all extensional and wellfounded, and the usual arithmetic operations can be defined in each case. We connect these notions by constructing structure preserving embeddings of Cantor normal forms into Brouwer trees, and of these in turn into wellfounded extensional orders. We have formalised most of our results in cubical Agda.


title: Deep learning for prediction of complex geology ahead of drilling

abstract: During a geosteering operation the well path is intentionally adjusted in response to the new data acquired while drilling. To achieve consistent high-quality decisions, especially when drilling in complex environments, decision support systems can help cope with high volumes of data and interpretation complexities. They can assimilate the real-time measurements into a probabilistic earth model and use the updated model for decision recommendations. Recently, machine learning (ML) techniques have enabled a wide range of methods that redistribute computational cost from on-line to off-line calculations. In this paper, we introduce two ML techniques into the geosteering decision support framework. Firstly, a complex earth model representation is generated using a Generative Adversarial Network (GAN). Secondly, a commercial extra-deep electromagnetic simulator is represented using a Forward Deep Neural Network (FDNN). The numerical experiments demonstrate that the combination of the GAN and the FDNN in an ensemble randomized maximum likelihood data assimilation scheme provides real-time estimates of complex geological uncertainty. This yields reduction of geological uncertainty ahead of the drill-bit from the measurements gathered behind and around the well bore.


title: RFQuack: A Universal Hardware-Software Toolkit for Wireless Protocol (Security) Analysis and Research

abstract: Software-defined radios (SDRs) are indispensable for signal reconnaissance and physical-layer dissection, but despite we have advanced tools like Universal Radio Hacker, SDR-based approaches require substantial effort. Contrarily, RF dongles such as the popular Yard Stick One are easy to use and guarantee a deterministic physical-layer implementation. However, they're not very flexible, as each dongle is a static hardware system with a monolithic firmware. We present RFquack, an open-source tool and library firmware that combines the flexibility of a software-based approach with the determinism and performance of embedded RF frontends. RFquack is based on a multi-radio hardware system with swappable RF frontends, and a firmware that exposes a uniform, hardware-agnostic API. RFquack focuses on a structured firmware architecture that allows high- and low-level interaction with the RF frontends. It facilitates the development of host-side scripts and firmware plug-ins, to implement efficient data-processing pipelines or interactive protocols, thanks to the multi-radio support. RFquack has an IPython shell and 9 firmware modules for: spectrum scanning, automatic carrier detection and bitrate estimation, headless operation with remote management, in-flight packet filtering and manipulation, MouseJack, and RollJam (as examples). We used RFquack to setup RF hacking contests, analyze industrial-grade devices and key fobs, on which we found and reported 11 vulnerabilities in their RF protocols.


title: Causal evolution of probability measures and continuity equation

abstract: We study the notion of a causal time-evolution of a conserved nonlocal physical quantity in a globally hyperbolic spacetime $\mathcal{M}$. The role of the `global time' is played by a chosen Cauchy temporal function $\mathcal{T}$, whereas the instantaneous configurations of the nonlocal quantity are modeled by probability measures $\mu_t$ supported on the corresponding time slices $\mathcal{T}^{-1}(t)$. We show that the causality of such an evolution can be expressed in three equivalent ways: (i) via the causal precedence relation $\preceq$ extended to probability measures, (ii) with the help of a probability measure $\sigma$ on the space of future-directed continuous causal curves endowed with the compact-open topology and (iii) through a causal vector field $X$ of $L^\infty_{\textrm{loc}}$-regularity, with which the map $t \mapsto \mu_t$ satisfies the continuity equation in the distributional sense. In the course of the proof we find that the compact-open topology is sensitive to the differential properties of the causal curves, being equal to the topology induced from a suitable $H^1_{\textrm{loc}}$-Sobolev space. This enables us to construct $X$ as a vector field in a sense `tangent' to $\sigma$. In addition, we discuss the general covariance of descriptions (i)-(iii), unraveling the geometrical, observer-independent notions behind them.


title: Large-scale Sustainable Search on Unconventional Computing Hardware

abstract: Since the advent of the Internet, quantifying the relative importance of web pages is at the core of search engine methods. According to one algorithm, PageRank, the worldwide web structure is represented by the Google matrix, whose principal eigenvector components assign a numerical value to web pages for their ranking. Finding such a dominant eigenvector on an ever-growing number of web pages becomes a computationally intensive task incompatible with Moore's Law. We demonstrate that special-purpose optical machines such as networks of optical parametric oscillators, lasers, and gain-dissipative condensates, may aid in accelerating the reliable reconstruction of principal eigenvectors of real-life web graphs. We discuss the feasibility of simulating the PageRank algorithm on large Google matrices using such unconventional hardware. We offer alternative rankings based on the minimisation of spin Hamiltonians. Our estimates show that special-purpose optical machines may provide dramatic improvements in power consumption over classical computing architectures.

categories: cond-mat.dis-nn cs.ET cs.IR physics.comp-ph physics.optics


title: Delayed buckling of spherical shells due to viscoelastic knockdown of the critical load

abstract: We performed dynamic pressure buckling experiments on defect-seeded spherical shells made of a common silicone elastomer. Unlike in quasi-static experiments, shells buckled at ostensibly subcritical pressures (i.e. below the experimentally-determined load at which buckling occurs elastically), often following a significant time delay. While emphasizing the close connections to elastic shell buckling, we rely on viscoelasticity to explain our observations. In particular, we demonstrate that the lower critical load may be determined from the material properties, which is rationalized by a simple analogy to elastic spherical shell buckling. We then introduce a model centered on empirical quantities to show that viscoelastic creep deformation lowers the critical load in the same predictable, quantifiable way that a growing defect would in an elastic shell. This allows us to capture how both the critical deflection and the delay time depend on the applied pressure, material properties, and defect geometry. These quantities are straightforward to measure in experiments. Thus, our work not only provides intuition for viscoelastic behavior from an elastic shell buckling perspective, but also offers an accessible pathway to introduce tunable, time-controlled actuation to existing mechanical actuators, e.g. pneumatic grippers.


title: Fourier Image Transformer

abstract: Transformer architectures show spectacular performance on NLP tasks and have recently also been used for tasks such as image completion or image classification. Here we propose to use a sequential image representation, where each prefix of the complete sequence describes the whole image at reduced resolution. Using such Fourier Domain Encodings (FDEs), an auto-regressive image completion task is equivalent to predicting a higher resolution output given a low-resolution input. Additionally, we show that an encoder-decoder setup can be used to query arbitrary Fourier coefficients given a set of Fourier domain observations. We demonstrate the practicality of this approach in the context of computed tomography (CT) image reconstruction. In summary, we show that Fourier Image Transformer (FIT) can be used to solve relevant image analysis tasks in Fourier space, a domain inherently inaccessible to convolutional architectures.


title: Physics-Informed Neural Nets for Control of Dynamical Systems

abstract: Physics-informed neural networks (PINNs) impose known physical laws into the learning of deep neural networks, making sure they respect the physics of the process while decreasing the demand of labeled data. For systems represented by Ordinary Differential Equations (ODEs), the conventional PINN has a continuous time input variable and outputs the solution of the corresponding ODE. In their original form, PINNs do not allow control inputs, neither can they simulate for variable long-range intervals without serious degradation in their predictions. In this context, this work presents a new framework called Physics-Informed Neural Nets for Control (PINC), which proposes a novel PINN-based architecture that is amenable to control problems and able to simulate for longer-range time horizons that are not fixed beforehand, making it a very flexible framework when compared to traditional PINNs. Furthermore, this long-range time simulation of differential equations is faster than numerical methods since it relies only on signal propagation through the network, making it less computationally costly and, thus, a better alternative for simulation of models in Model Predictive Control. We showcase our proposal in the control of two nonlinear dynamic systems: the Van der Pol oscillator and the four-tank system.


title: Discrimination between quarry blasts and micro-earthquakes using spectral analysis, applied to local Israeli events

abstract: This study presents the concept of spectral modulation and a time-frequency analysis, applied to broadband local ($5<\Delta<200$ km) seismic data from quarry blasts and micro-earthquakes, kindly supplied by the Institute for Petroleum Research and Geophysics (IPRG), Holon, Israel, from the so-called GIF-array. The aim of this research is verification of ripple-firing by recognition of scalloping trends in amplitude-spectra and hence discriminating quarry blasts from other events. Most quarry blasts are ripple-fired, in northern Israel open pit blasts; consequently the event discrimination method based on the recognition of ripple-firing patterns in the signal was chosen. The methods presented in this dissertation might also be applicable for deconvolution and dereverberation purposes in exploration seismology.


title: Comparing CTC and LFMMI for out-of-domain adaptation of wav2vec 2.0 acoustic model

abstract: In this work, we investigate if the wav2vec 2.0 self-supervised pretraining helps mitigate the overfitting issues with connectionist temporal classification (CTC) training to reduce its performance gap with flat-start lattice-free MMI (E2E-LFMMI) for automatic speech recognition with limited training data. Towards that objective, we use the pretrained wav2vec 2.0 BASE model and fine-tune it on three different datasets including out-of-domain (Switchboard) and cross-lingual (Babel) scenarios. Our results show that for supervised adaptation of the wav2vec 2.0 model, both E2E-LFMMI and CTC achieve similar results; significantly outperforming the baselines trained only with supervised data. Fine-tuning the wav2vec 2.0 model with E2E-LFMMI and CTC we obtain the following relative WER improvements over the supervised baseline trained with E2E-LFMMI. We get relative improvements of 40% and 44% on the clean-set and 64% and 58% on the test set of Librispeech (100h) respectively. On Switchboard (300h) we obtain relative improvements of 33% and 35% respectively. Finally, for Babel languages, we obtain relative improvements of 26% and 23% on Swahili (38h) and 18% and 17% on Tagalog (84h) respectively.


title: The Tangent Search Algorithm for Solving Optimization Problems

abstract: This article proposes a new population-based optimization algorithm called the Tangent Search Algorithm (TSA) to solve optimization problems. The TSA uses a mathematical model based on the tangent function to move a given solution toward a better solution. The tangent flight function has the advantage to balance between the exploitation and the exploration search. Moreover, a novel escape procedure is used to avoid to be trapped in local minima. Besides, an adaptive variable step size is also integrated in this algorithm to enhance the convergence capacity. The performance of TSA is assessed in three classes of tests: classical tests, CEC benchmarks, and engineering optimization problems. Moreover, several studies and metrics have been used to observe the behavior of the proposed TSA. The experimental results show that TSA algorithm is capable to provide very promising and competitive results on most benchmark functions thanks to better balance between exploration and exploitation of the search space. The main characteristics of this new optimization algorithm is its simplicity and efficiency and it requires only a small number of user-defined parameters.


title: Exponentially selective molecular sieving through angstrom pores

abstract: Two-dimensional crystals with angstrom-scale pores are widely considered as candidates for a next generation of molecular separation technologies aiming to provide extreme, exponentially large selectivity combined with high flow rates. No such pores have been demonstrated experimentally. Here we study gas transport through individual graphene pores created by low intensity exposure to low kV electrons. Helium and hydrogen permeate easily through these pores whereas larger species such as xenon and methane are practically blocked. Permeating gases experience activation barriers that increase quadratically with molecules' kinetic diameter, and the effective diameter of the created pores is estimated as ~2 angstroms, about one missing carbon ring. Our work reveals stringent conditions for achieving the long sought-after exponential selectivity using porous two-dimensional membranes and suggests limits on their possible performance.


title: Self Calibration of Scalar and Vector Sensor Arrays

abstract: In this work, we consider the problem of joint calibration and direction-of-arrival (DOA) estimation using sensor arrays. This joint estimation problem is referred to as self calibration. Unlike many previous iterative approaches, we propose geometry independent convex optimization algorithms for jointly estimating the sensor gain and phase errors as well as the source DOAs. We derive these algorithms based on both the conventional element-space data model and the covariance data model. We focus on sparse and regular arrays formed using scalar sensors as well as vector sensors. The developed algorithms are obtained by transforming the underlying bilinear calibration model into a linear model, and subsequently by using standard convex relaxation techniques to estimate the unknown parameters. Prior to the algorithm discussion, we also derive identifiability conditions for the existence of a unique solution to the self calibration problem. To demonstrate the effectiveness of the developed techniques, numerical experiments and comparisons to the state-of-the-art methods are provided. Finally, the results from an experiment that was performed in an anechoic chamber using an acoustic vector sensor array are presented to demonstrate the usefulness of the proposed self calibration techniques.


title: Structured Citation Trend Prediction Using Graph Neural Networks

abstract: Academic citation graphs represent citation relationships between publications across the full range of academic fields. Top cited papers typically reveal future trends in their corresponding domains which is of importance to both researchers and practitioners. Prior citation prediction methods often require initial citation trends to be established and do not take advantage of the recent advancements in graph neural networks (GNNs). We present GNN-based architecture that predicts the top set of papers at the time of publication. For experiments, we curate a set of academic citation graphs for a variety of conferences and show that the proposed model outperforms other classic machine learning models in terms of the F1-score.


title: Proof Complexity of Symbolic QBF Reasoning

abstract: We introduce and investigate symbolic proof systems for Quantified Boolean Formulas (QBF) operating on Ordered Binary Decision Diagrams (OBDDs). These systems capture QBF solvers that perform symbolic quantifier elimination, and as such admit short proofs of formulas of bounded path-width and quantifier complexity. As a consequence, we obtain exponential separations from standard clausal proof systems, specifically (long-distance) QU-Resolution and IR-Calc. We further develop a lower bound technique for symbolic QBF proof systems based on strategy extraction that lifts known lower bounds from communication complexity. This allows us to derive strong lower bounds against symbolic QBF proof systems that are independent of the variable ordering of the underlying OBDDs, and that hold even if the proof system is allowed access to an NP-oracle.


title: H\"older Gradient Descent and Adaptive Regularization Methods in Banach Spaces for First-Order Points

abstract: This paper considers optimization of smooth nonconvex functionals in smooth infinite dimensional spaces. A H\"older gradient descent algorithm is first proposed for finding approximate first-order points of regularized polynomial functionals. This method is then applied to analyze the evaluation complexity of an adaptive regularization method which searches for approximate first-order points of functionals with $\beta$-H\"older continuous derivatives. It is shown that finding an $\epsilon$-approximate first-order point requires at most $O(\epsilon^{-\frac{p+\beta}{p+\beta-1}})$ evaluations of the functional and its first $p$ derivatives.


title: JUNO Physics and Detector

abstract: The Jiangmen Underground Neutrino Observatory (JUNO) is a 20 kton LS detector at 700-m underground. An excellent energy resolution and a large fiducial volume offer exciting opportunities for addressing many important topics in neutrino and astro-particle physics. With 6 years of data, the neutrino mass ordering can be determined at 3-4 sigma and three oscillation parameters can be measured to a precision of 0.6% or better by detecting reactor antineutrinos. With 10 years of data, DSNB could be observed at 3-sigma; a lower limit of the proton lifetime of 8.34e33 years (90% C.L.) can be set by searching for p->nu_bar K^+; detection of solar neutrinos would shed new light on the solar metallicity problem and examine the vacuum-matter transition region. A core-collapse supernova at 10 kpc would lead to ~5000 IBD and ~2000 (300) all-flavor neutrino-proton (electron) scattering events. Geo-neutrinos can be detected with a rate of ~400 events/year. We also summarize the final design of the JUNO detector and the key R&D achievements. All 20-inch PMTs have been tested. The average photon detection efficiency is 28.9% for the 15,000 MCP PMTs and 28.1% for the 5,000 dynode PMTs, higher than the JUNO requirement of 27%. Together with the >20 m attenuation length of LS, we expect a yield of 1345 p.e. per MeV and an effective energy resolution of 3.02%/\sqrt{E (MeV)}$ in simulations. The underwater electronics is designed to have a loss rate <0.5% in 6 years. With degassing membranes and a micro-bubble system, the radon concentration in the 35-kton water pool could be lowered to <10 mBq/m^3. Acrylic panels of radiopurity <0.5 ppt U/Th are produced. The 20-kton LS will be purified onsite. Singles in the fiducial volume can be controlled to ~10 Hz. The JUNO experiment also features a double calorimeter system with 25,600 3-inch PMTs, a LS testing facility OSIRIS, and a near detector TAO.


title: Black Hole Mass Function of Coalescing Binary Black Hole Systems: Is There a Pulsational Pair Instability Mass Cutoff?

abstract: We analyze the LIGO/Virgo GWTC-2 catalog to study the primary mass distribution of the merging black holes. We perform hierarchical Bayesian analysis, and examine whether the mass distribution has a sharp cutoff for primary black hole masses below $65 M_\odot$, as predicted in pulsational pair instability supernova model. We construct two empirical mass functions. One is a piece-wise function with two power-law segments jointed by a sudden drop. The other consists of a main truncated power-law component, a Gaussian component, and a third very massive component. Both models can reasonably fit the data and a sharp drop of the mass distribution is found at $\sim 50M_\odot$, suggesting that the majority of the observed black holes can be explained by the stellar evolution scenarios in which the pulsational pair-instability process takes place. On the other hand, the very massive sub-population, which accounts for at most several percents of the total, may be formed through hierarchical mergers or other processes.


title: The Farthest Point Map on the Regular Dodecahedron

abstract: Let $X$ be the regular dodecahedron, equipped with its intrinsic path metric. Given $p \in X$ let $G(p)=-q$ where $q$ is the point on $X$ which maximizes the distance to $p$. (Generically, $G$ is single-valued.) We give a complete description of the map $G$ and as a consequence show that the $\omega$-limit set of $G$ is the $1$-skeleton of a subdivision of $X$ into $180$ convex quadrilaterals. $G$ is a piecewise bi-quadratic map, and each algebraic piece is defined by a straight line construction involving a rhombus. The rhombi involved have the same shapes as the ones in the Penrose tiling. Our proof is computer-assisted but rigorous.


title: Spin-orbit enabled quantum transport channels in a two-hole double quantum dot

abstract: We analyze experimentally and theoretically the transport spectra of a gated lateral GaAs double quantum dot containing two holes. The strong spin-orbit interaction present in the hole subband lifts the Pauli spin blockade and allows to map out the complete spectra of the two-hole system. By performing measurements in both source-drain voltage directions, at different detunings and magnetic fields, we carry out quantitative fitting to a Hubbard two-site model accounting for the tunnel coupling to the leads and the spin-flip relaxation process. We extract the singlet-triplet gap and the magnetic field corresponding to the singlet-triplet transition in the double-hole ground state. Additionally, at the singlet-triplet transition we find a resonant enhancement (in the blockaded direction) and suppression of current (in the conduction direction). The current enhancement stems from the multiple resonance of two-hole levels, opening several conduction channels at once. The current suppression arises from the quantum interference of spin-conserving and spin flipping tunneling processes.


title: Rational points on non-linear horocycles and pigeonhole statistics for the fractional parts of $\sqrt{n}$

abstract: In this paper we investigate \textit{pigeonhole statistics} for the fractional parts of the sequence $\sqrt{n}$. Namely, we partition the unit circle $ \mathbb{T} = \mathbb{R}/\mathbb{Z}$ into $N$ intervals and show that the proportion of intervals containing exactly $j$ points of the sequence $(\sqrt{n} + \mathbb{Z})_{n=1}^N$ converges in the limit as $N \to \infty$. More generally, we investigate how the limiting distribution of the first $sN$ points of the sequence varies with the parameter $s \geq 0$. A natural way to examine this is via point processes - random measures on $[0,\infty)$ which represent the arrival times of the points of our sequence to a random interval from our partition. We show that the sequence of point processes we obtain converges in distribution and give an explicit description of the limiting process in terms of random affine unimodular lattices. Our work uses ergodic theory in the space of affine unimodular lattices, building upon work of Elkies and McMullen. We prove a generalisation of equidistribution of rational points on expanding horocycles in the modular surface, working instead on non-linear horocycle sections.


title: Learning from Noisy Labels via Dynamic Loss Thresholding

abstract: Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually memorize the data, moving from correct data to mislabeled data. Inspired by this finding, we propose a novel method named Dynamic Loss Thresholding (DLT). During the training process, DLT records the loss value of each sample and calculates dynamic loss thresholds. Specifically, DLT compares the loss value of each sample with the current loss threshold. Samples with smaller losses can be considered as clean samples with higher probability and vice versa. Then, DLT discards the potentially corrupted labels and further leverages supervised learning techniques. Experiments on CIFAR-10/100 and Clothing1M demonstrate substantial improvements over recent state-of-the-art methods. In addition, we investigate two real-world problems for the first time. Firstly, we propose a novel approach to estimate the noise rates of datasets based on the loss difference between the early and late training stages of DNNs. Secondly, we explore the effect of hard samples (which are difficult to be distinguished) on the process of learning from noisy labels.


title: Speaker embeddings by modeling channel-wise correlations

abstract: Speaker embeddings extracted with deep 2D convolutional neural networks are typically modeled as projections of first and second order statistics of channel-frequency pairs onto a linear layer, using either average or attentive pooling along the time axis. In this paper we examine an alternative pooling method, where pairwise correlations between channels for given frequencies are used as statistics. The method is inspired by style-transfer methods in computer vision, where the style of an image, modeled by the matrix of channel-wise correlations, is transferred to another image, in order to produce a new image having the style of the first and the content of the second. By drawing analogies between image style and speaker characteristics, and between image content and phonetic sequence, we explore the use of such channel-wise correlations features to train a ResNet architecture in an end-to-end fashion. Our experiments on VoxCeleb demonstrate the effectiveness of the proposed pooling method in speaker recognition.


title: Missing level statistics in a dissipative microwave resonator with partially violated time-reversal invariance

abstract: We report on the experimental investigation of the fluctuation properties in the resonance frequency spectra of a flat resonator simulating a dissipative quantum billiard subject to partial time-reversal invariance violation (TIV) which is induced by two magnetized ferrites. The cavity has the shape of a quarter bowtie billiard of which the corresponding classical dynamics is chaotic. Due to dissipation it is impossible to identify a complete list of resonance frequencies. Based on a random-matrix theory approach we derive analytical expressions for statistical measures of short- and long-range correlations in such incomplete spectra interpolating between the cases of preserved time-reversal invariance and complete TIV and demonstrate their applicability to the experimental spectra.


title: Prediction of Solar Radiation Using Artificial Neural Network

abstract: Most solar applications and systems can be reliably used to generate electricity and power in many homes and offices. Recently, there is an increase in many solar required systems that can be found not only in electricity generation but other applications such as solar distillation, water heating, heating of buildings, meteorology and producing solar conversion energy. Prediction of solar radiation is very significant in order to accomplish the previously mentioned objectives. In this paper, the main target is to present an algorithm that can be used to predict an hourly activity of solar radiation. Using a dataset that consists of temperature of air, time, humidity, wind speed, atmospheric pressure, direction of wind and solar radiation data, an Artificial Neural Network (ANN) model is constructed to effectively forecast solar radiation using the available weather forecast data. Two models are created to efficiently create a system capable of interpreting patterns through supervised learning data and predict the correct amount of radiation present in the atmosphere. The results of the two statistical indicators: Mean Absolute Error (MAE) and Mean Squared Error (MSE) are performed and compared with observed and predicted data. These two models were able to generate efficient predictions with sufficient performance accuracy.


title: Photophilic hadronic axion from heavy magnetic monopoles

abstract: We propose a model for the QCD axion which is realized through a coupling of the Peccei-Quinn scalar field to magnetically charged fermions at high energies. We show that the axion of this model solves the strong CP problem and then integrate out heavy magnetic monopoles using the Schwinger proper time method. We find that the model discussed yields axion couplings to the Standard Model which are drastically different from the ones calculated within the KSVZ/DFSZ-type models, so that large part of the corresponding parameter space can be probed by various projected experiments. Moreover, the axion we introduce is consistent with the astrophysical hints suggested both by anomalous TeV-transparency of the Universe and by excessive cooling of horizontal branch stars in globular clusters. We argue that the leading term for the cosmic axion abundance is not changed compared to the conventional pre-inflationary QCD axion case for axion decay constant $f_a > 10^{12}~\text{GeV}$.


title: Functional integral method for potential scattering amplitude in quantum mechanics

abstract: The functional integral method can be used in quantum mechanics to find the scattering amplitude for particles in the external field. We will obtain the potential scattering amplitude form the complete Green function in the corresponding external field through solving the Schrodinger equation, after being separated from the poles on the mass shell, which takes the form of an eikonal (Glauber) representation in the high energy region and the small scattering angles. Consider specific external potentials such as the Yukawa or Gaussian potential, we will find the corresponding differential scattering cross-sections.


title: Attentional Graph Neural Network for Parking-slot Detection

abstract: Deep learning has recently demonstrated its promising performance for vision-based parking-slot detection. However, very few existing methods explicitly take into account learning the link information of the marking-points, resulting in complex post-processing and erroneous detection. In this paper, we propose an attentional graph neural network based parking-slot detection method, which refers the marking-points in an around-view image as graph-structured data and utilize graph neural network to aggregate the neighboring information between marking-points. Without any manually designed post-processing, the proposed method is end-to-end trainable. Extensive experiments have been conducted on public benchmark dataset, where the proposed method achieves state-of-the-art accuracy. Code is publicly available at \url{https://github.com/Jiaolong/gcn-parking-slot}.


title: Learnable Dynamic Temporal Pooling for Time Series Classification

abstract: With the increase of available time series data, predicting their class labels has been one of the most important challenges in a wide range of disciplines. Recent studies on time series classification show that convolutional neural networks (CNN) achieved the state-of-the-art performance as a single classifier. In this work, pointing out that the global pooling layer that is usually adopted by existing CNN classifiers discards the temporal information of high-level features, we present a dynamic temporal pooling (DTP) technique that reduces the temporal size of hidden representations by aggregating the features at the segment-level. For the partition of a whole series into multiple segments, we utilize dynamic time warping (DTW) to align each time point in a temporal order with the prototypical features of the segments, which can be optimized simultaneously with the network parameters of CNN classifiers. The DTP layer combined with a fully-connected layer helps to extract further discriminative features considering their temporal position within an input time series. Extensive experiments on both univariate and multivariate time series datasets show that our proposed pooling significantly improves the classification performance.


title: Neurons learn slower than they think

abstract: Recent studies revealed complex convergence dynamics in gradient-based methods, which has been little understood so far. Changing the step size to balance between high convergence rate and small generalization error may not be sufficient: maximizing the test accuracy usually requires a larger learning rate than minimizing the training loss. To explore the dynamic bounds of convergence rate, this study introduces \textit{differential capability} into an optimization process, which measures whether the test accuracy increases as fast as a model approaches the decision boundary in a classification problem. The convergence analysis showed that: 1) a higher convergence rate leads to slower capability growth; 2) a lower convergence rate results in faster capability growth and decay; 3) regulating a convergence rate in either direction reduces differential capability.


title: The Automatic Calibration Unit in JUNO

abstract: This paper describes the design and construction of the automatic calibration unit (ACU) for the JUNO experiment. The ACU is a fully automated mechanical system. It is capable of deploying multiple radioactive sources, an ultraviolet (UV) laser source, or an auxiliary sensor such as a temperature sensor, one at a time, into the central detector of JUNO along the central axis. It is designed as a primary tool to precisely calibrate the energy scale of detector, aligning timing for the photosensors, and partially monitoring the position-dependent energy scale variations.


title: Future of work: ethics

abstract: Work must be reshaped in the upcoming new era characterized by new challenges and the presence of new technologies and computational tools. Over-automation seems to be the driver of the digitalization process. Substitution is the paradigm leading Artificial Intelligence and robotics development against human cognition. Digital technology should be designed to enhance human skills and make more productive use of human cognition and capacities. Digital technology is characterized also by scalability because of its easy and inexpensive deployment. Thus, automation can lead to the absence of jobs and scalable negative impact in human development and the performance of business. A look at digitalization from the lens of Sustainable Development Goals can tell us how digitalization impact in different sectors and areas considering society as a complex interconnected system. Here, reflections on how AI and Data impact future of work and sustainable development are provided grounded on an ethical core that comprises human-level principles and also systemic principles.


title: WhONet: Wheel Odometry Neural Network for Vehicular Localisation in GNSS-Deprived Environments

abstract: In this paper, a deep learning approach is proposed to accurately position wheeled vehicles in Global Navigation Satellite Systems (GNSS) deprived environments. In the absence of GNSS signals, information on the speed of the wheels of a vehicle (or other robots alike), recorded from the wheel encoder, can be used to provide continuous positioning information for the vehicle, through the integration of the vehicle's linear velocity to displacement. However, the displacement estimation from the wheel speed measurements are characterised by uncertainties, which could be manifested as wheel slips or/and changes to the tyre size or pressure, from wet and muddy road drives or tyres wearing out. As such, we exploit recent advances in deep learning to propose the Wheel Odometry neural Network (WhONet) to learn the uncertainties in the wheel speed measurements needed for correction and accurate positioning. The performance of the proposed WhONet is first evaluated on several challenging driving scenarios, such as on roundabouts, sharp cornering, hard-brake and wet roads (drifts). WhONet's performance is then further and extensively evaluated on longer-term GNSS outage scenarios of 30s, 60s, 120s and 180s duration, respectively over a total distance of 493 km. The experimental results obtained show that the proposed method is able to accurately position the vehicle with up to 93% reduction in the positioning error of its original counterpart after any 180s of travel. WhONet's implementation can be found at https://github.com/onyekpeu/WhONet.


title: Minimal Mahler Measure in Cubic Number Fields

abstract: The minimal integral Mahler measure of a number field $K$, $M(\mathcal{O}_K)$, is the minimal Mahler measure of a non-torsion primitive element of $\mathcal{O}_K$. Upper and lower bounds, which depend on the discriminant, are known. We show that for cubics, the lower bounds are sharp with respect to its growth as a function of discriminant. We construct an algorithm to compute $M(\mathcal{O}_K)$ for all cubics with absolute value of the discriminant bounded by $N$.


title: Limitations and Improvements of the Intelligent Driver Model (IDM)

abstract: This contribution analyzes the widely used and well-known "intelligent driver model (briefly IDM), which is a second order car-following model governed by a system of ordinary differential equations. Although this model was intensively studied in recent years for properly capturing traffic phenomena and driver braking behavior, a rigorous study of the well-posedness has, to our knowledge, never been performed. First it is shown that, for a specific class of initial data, the vehicles' velocities become negative or even diverge to $-\infty$ in finite time, both undesirable properties for a car-following model. Various modifications of the IDM are then proposed in order to avoid such ill-posedness. The theoretical remediation of the model, rather than post facto by ad-hoc modification of code implementations, allows a more sound numerical implementation and preservation of the model features. Indeed, to avoid inconsistencies and ensure dynamics close to the one of the original model, one may need to inspect and clean large input data, which may result in practically impossible scenarios for large-scale simulations. Although well-posedness issues occur only for specific initial data, this may happen frequently when different traffic scenarios are analyzed, and especially in presence of lane-changing, on ramps and other network components as it is the case for most commonly used micro-simulators. On the other side, it is shown that well-posedness can be guaranteed by straight-forward improvements, such as those obtained by slightly changing the acceleration to prevent the velocity from becoming negative.


title: Real spectra of large real asymmetric random matrices

abstract: When a randomness is introduced at the level of real matrix elements, depending on its particular realization, a pair of eigenvalues can appear as real or form a complex conjugate pair. We show that in the limit of large matrix size the density of such real eigenvalues is proportional to the square root of the asymptotic density of complex eigenvalues continuated to the real line. This relation allows one to calculate the real densities up to a normalization constant, which is then applied to various examples, including heavy-tailed ensembles and adjacency matrices of sparse random regular graphs.

categories: math-ph cond-mat.dis-nn cond-mat.stat-mech math.MP math.PR


title: Safety-Critical Control of Stochastic Systems using Stochastic Control Barrier Functions

abstract: Control barrier functions have been widely used for synthesizing safety-critical controls, often via solving quadratic programs. However, the existence of Gaussian-type noise may lead to unsafe actions and result in severe consequences. In this paper, we study systems modeled by stochastic differential equations (SDEs) driven by Brownian motions. We propose a notion of stochastic control barrier functions (SCBFs)and show that SCBFs can significantly reduce the control efforts, especially in the presence of noise, compared to stochastic reciprocal control barrier functions (SRCBFs), and offer a less conservative estimation of safety probability, compared to stochastic zeroing control barrier functions (SZCBFs). Based on this less conservative probabilistic estimation for the proposed notion of SCBFs, we further extend the results to handle high relative degree safety constraints using high-order SCBFs. We demonstrate that the proposed SCBFs achieve good trade-offs of performance and control efforts, both through theoretical analysis and numerical simulations.


title: $V_{ud}$ radiative corrections with lattice input

abstract: We will describe several pioneering efforts in the study of electromagnetic radiative corrections to semileptonic decay processes, with particular emphasis on the role of lattice QCD. These studies are essential for the precise extraction of the matrix element $V_{ud}$ from beta decays of pion, free neutron and $J^P=0^+$ nuclei, and are crucial to address several recently-emerged anomalies involving $V_{ud}$ and $V_{us}$, which may provide hints for physics beyond the Standard Model.


title: Orbital Optimization in Selected Configuration Interaction Methods

abstract: We study several approaches to orbital optimization in selected configuration interaction plus perturbation theory (SCI+PT) methods, and test them on the ground and excited states of three molecules using the semistochastic heatbath configuration interaction (SHCI) method. We discuss the ways in which the orbital optimization problem in SCI resembles and differs from that in complete active space self-consistent field (CASSCF). Starting from natural orbitals, these approaches divide into three classes of optimization methods according to how they treat coupling between configuration interaction (CI) coefficients and orbital parameters, namely uncoupled, fully coupled, and quasi-fully coupled methods. We demonstrate that taking the coupling into account is crucial for fast convergence and recommend two quasi-fully coupled methods for such applications: accelerated diagonal Newton and Broyden-Fletcher-Goldfarb-Shanno (BFGS).


title: Principal Component Analysis Applied to Gradient Fields in Band Gap Optimization Problems for Metamaterials

abstract: A promising technique for the spectral design of acoustic metamaterials is based on the formulation of suitable constrained nonlinear optimization problems. Unfortunately, the straightforward application of classical gradient-based iterative optimization algorithms to the numerical solution of such problems is typically highly demanding, due to the complexity of the underlying physical models. Nevertheless, supervised machine learning techniques can reduce such a computational effort, e.g., by replacing the original objective functions of such optimization problems with more-easily computable approximations. In this framework, the present article describes the application of a related unsupervised machine learning technique, namely, principal component analysis, to approximate the gradient of the objective function of a band gap optimization problem for an acoustic metamaterial, with the aim of making the successive application of a gradient-based iterative optimization algorithm faster. Numerical results show the effectiveness of the proposed method.


title: Radiative corrections in the Yukawa model within the null-plane causal perturbation theory framework

abstract: Practical calculations in light-front dynamics are, as a general rule, complicated, since there is no consensus about how to treat the poles which come from the instantaneous parts of Feynman's propagators of the fields. An alternative to solve this difficulty is null-plane causal perturbation theory, a recent developed framework which prevents the appearance of the mentioned poles by avoiding the usage of Feynman's propagators in "loop distributions", requiring no regularization of the amplitudes. In this study, we treat the radiative corrections in the neutral Yukawa's model in that framework. Particularly, we explicitly calculate the boson and fermion self-energies and show that the results obtained with this approach are equivalent to that of the instant dynamics.


title: Fractional quantum Hall effect energy gap: role of electron layer thickness

abstract: The fractional quantum Hall effect (FQHE) stands as a quintessential manifestation of an interacting two-dimensional electron system. One of FQHE's most fundamental characteristics is the energy gap separating the incompressible ground state from its excitations. Yet, despite nearly four decades of investigations, a quantitative agreement between the theoretically calculated and experimentally measured energy gaps is lacking. Here we report a quantitative comparison between the measured energy gaps and the available theoretical calculations that take into account the role of finite layer thickness and Landau level mixing. Our systematic experimental study of the FQHE energy gaps uses very high-quality two-dimensional electron systems confined to GaAs quantum wells with varying well widths. All the measured energy gaps fall bellow the calculations, but as the electron layer thickness increases, the results of experiments and calculations come closer. Accounting for the role of disorder in a phenomenological manner, we find the measured energy gaps to be in reasonable quantitative agreement with calculations, although some discrepancies remain.


title: Corrigendum to "Hardy Spaces $H_{\mathcal L}^1({\mathbb R}^n)$ Associated to Schr\"odinger Type Operators $(-\Delta)^2+V^2$" [Houston J. Math 36 (4) (2010), 1067-1095]

abstract: We rectify an incorrect citation of the reference in obtaining the Gaussian upper bound for heat kernels of the Schr\"odinger type operators $(-\Delta)^2+V^2$.


title: Global Software Engineering in the Age of GitHub and Zoom

abstract: Much has changed since the inaugural ICGSE conference in 2006. Tools have improved, awareness of cultural differences is widespread, and developments such as the foregrounding of open source have all enhanced our ability to work across geographic divides. But the pervasive and profound impact of software in the world -- especially for societal scale systems such as social media -- forces new and deeply challenging responsibilities on both developers and academics. We must find better ways of incorporating ethics into our development practices and pay far more attention to harmful unintended consequences as deployed systems interact with and often disrupt crucial social systems.


title: Spectrally multiplexed heralded single photon source at telecom-band

abstract: Heralded single photon source (HSPS) is an important way in generating genuine single photon, having advantages of experimental simplicity and versatility. However, HSPS intrinsically suffers from the trade-off between the heralded single photon rate and the single photon purity. To overcome this, one can apply multiplexing technology in different degrees of freedom to enhance the performance of HSPS. Here, by employing spectral multiplexing and active feed-forward spectral manipulating, we demonstrate a HSPS at 1.5 {\mu}m telecom-band. Our experimental results show that the spectral multiplexing effectively erases the frequency correlation of pair source and significantly improves the heralded single photon rate while keeping the g{^(^2^)}(0) as low as 0.0006{\pm}0.0001. The Hong-Ou-Mandel interference between the heralded single photons and photons from an independent weak coherent source indicates a high indistinguishability. Our results pave a way for scalable HSPS by spectral multiplexing towards deterministic single photon emission.


title: Relationship between fitness and heterogeneity in exponentially growing microbial populations

abstract: Despite major environmental and genetic differences, microbial metabolic networks are known to generate consistent physiological outcomes across vastly different organisms. This remarkable robustness suggests that, at least in bacteria, metabolic activity may be guided by universal principles. The constrained optimization of evolutionarily-motivated objective functions like the growth rate has emerged as the key theoretical assumption for the study of bacterial metabolism. While conceptually and practically useful in many situations, the idea that certain functions are optimized is hard to validate in data. Moreover, it is not always clear how optimality can be reconciled with the high degree of single-cell variability observed in experiments within microbial populations. To shed light on these issues, we develop an inverse modeling framework that connects the fitness of a population of cells (represented by the mean single-cell growth rate) to the underlying metabolic variability through the Maximum-Entropy inference of the distribution of metabolic phenotypes from data. While no clear objective function emerges, we find that, as the medium gets richer, the fitness and inferred variability for Escherichia coli populations follow and slowly approach the theoretically optimal bound defined by minimal reduction of variability at given fitness. These results suggest that bacterial metabolism may be crucially shaped by a population-level trade-off between growth and heterogeneity.

categories: q-bio.MN cond-mat.dis-nn cond-mat.stat-mech physics.bio-ph q-bio.QM


title: Coherent deflection of elliptic bunches colliding at crossing angle

abstract: The coherent deflection of elliptic bunch with the Gaussian charge distribution in the field of an opposite bunch with the Gaussian bunch distribution is considered. The generalization of Bassetti-Erskine formulae is derived taking into account the angle between momenta of bunches.


title: Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization

abstract: Decentralized optimization over time-varying graphs has been increasingly common in modern machine learning with massive data stored on millions of mobile devices, such as in federated learning. This paper revisits the widely used accelerated gradient tracking and extends it to time-varying graphs. We prove the $O((\frac{\gamma}{1-\sigma_{\gamma}})^2\sqrt{\frac{L}{\epsilon}})$ and $O((\frac{\gamma}{1-\sigma_{\gamma}})^{1.5}\sqrt{\frac{L}{\mu}}\log\frac{1}{\epsilon})$ complexities for the practical single loop accelerated gradient tracking over time-varying graphs when the problems are nonstrongly convex and strongly convex, respectively, where $\gamma$ and $\sigma_{\gamma}$ are two common constants charactering the network connectivity, $\epsilon$ is the desired precision, and $L$ and $\mu$ are the smoothness and strong convexity constants, respectively. Our complexities improve significantly over the ones of $O(\frac{1}{\epsilon^{5/7}})$ and $O((\frac{L}{\mu})^{5/7}\frac{1}{(1-\sigma)^{1.5}}\log\frac{1}{\epsilon})$, respectively, which were proved in the original literature only for static graphs, where $\frac{1}{1-\sigma}$ equals $\frac{\gamma}{1-\sigma_{\gamma}}$ when the network is time-invariant. When combining with a multiple consensus subroutine, the dependence on the network connectivity constants can be further improved to $O(1)$ and $O(\frac{\gamma}{1-\sigma_{\gamma}})$ for the computation and communication complexities, respectively. When the network is static, by employing the Chebyshev acceleration, our complexities exactly match the lower bounds without hiding any poly-logarithmic factor for both nonstrongly convex and strongly convex problems.


title: Magnetic Properties of Star-Forming Dense Cores

abstract: Magnetic and energetic properties are presented for 17 dense cores within a few hundred pc of the Sun. Their plane-of-sky field strengths are estimated from the dispersion of polarization directions, following Davis, Chandrasekhar and Fermi (DCF). Their ratio of mass to magnetic critical mass is 0.5-3, indicating nearly critical field strengths. The field strength B_pos is correlated with column density N as B_pos~N^p, where p=1.05+-0.08, and with density n as B_pos~n^q, where q=0.66+-0.05. These magnetic properties are consistent with those derived from Zeeman studies (Crutcher et al. 2010), with less scatter. Relations between virial mass M_V, magnetic critical mass M_B, and Alfven amplitude sigma_B/B match the observed range of M/M_B for cores observed to be nearly virial, with M/M_V=0.5-2, with moderate Alfven amplitudes, and with sigma_B/B=0.1-0.4. The B-N and B-n correlations in the DCF and Zeeman samples can be explained when such bound, Alfvenic, and nearly-critical cores have central concentration and spheroidal shape. For these properties, B~N because M/M_B is nearly constant compared to the range of N, and B~n^(2/3) because M^(1/3) is nearly constant compared to the range of n^(2/3). The observed core fields which follow B~n^(2/3) need not be much weaker than gravity, in contrast to core fields which follow B~n^(2/3) due to spherical contraction at constant mass (Mestel 1966). Instead, the nearly critical values of M/M_B suggest that the observed core fields are nearly as strong as possible, among values which allow gravitational contraction.


title: Automatic Large Scale Detection of Red Palm Weevil Infestation using Aerial and Street View Images

abstract: The spread of the Red Palm Weevil has dramatically affected date growers, homeowners and governments, forcing them to deal with a constant threat to their palm trees. Early detection of palm tree infestation has been proven to be critical in order to allow treatment that may save trees from irreversible damage, and is most commonly performed by local physical access for individual tree monitoring. Here, we present a novel method for surveillance of Red Palm Weevil infested palm trees utilizing state-of-the-art deep learning algorithms, with aerial and street-level imagery data. To detect infested palm trees we analyzed over 100,000 aerial and street-images, mapping the location of palm trees in urban areas. Using this procedure, we discovered and verified infested palm trees at various locations.


title: A Survey for Real-Time Network Performance Measurement via Machine Learning

abstract: Real-Time Networks (RTNs) provide latency guarantees for time-critical applications and it aims to support different traffic categories via various scheduling mechanisms. Those scheduling mechanisms rely on a precise network performance measurement to dynamically adjust the scheduling strategies. Machine Learning (ML) offers an iterative procedure to measure network performance. Network Calculus (NC) can calculate the bounds for the main performance indexes such as latencies and throughputs in an RTN for ML. Thus, the ML and NC integration improve overall calculation efficiency. This paper will provide a survey for different approaches of Real-Time Network performance measurement via NC as well as ML and present their results, dependencies, and application scenarios.


title: Noise Estimation for Generative Diffusion Models

abstract: Generative diffusion models have emerged as leading models in speech and image generation. However, in order to perform well with a small number of denoising steps, a costly tuning of the set of noise parameters is needed. In this work, we present a simple and versatile learning scheme that can step-by-step adjust those noise parameters, for any given number of steps, while the previous work needs to retune for each number separately. Furthermore, without modifying the weights of the diffusion model, we are able to significantly improve the synthesis results, for a small number of steps. Our approach comes at a negligible computation cost.


title: A Wave Trapping Dispersive Delay Structure Based on Substrate Integrated Waveguide (SIW)

abstract: A dispersive delay structure (DDS) is a device that creates a specified group delay function over frequency bandwidth. In this paper, the idea of trapping the electromagnetic waves in a feedback loop is proposed to achieve higher group delay swing. The proposed structure includes two transmission lines and two junctions that act as power divider/combiner. The transmission lines can be either dispersive or non-dispersive. The group delay in the proposed configuration is proportional to the injected power into the feedback loop. So, an increase in the group delay swing can be done by improving the junctions or by adding more feedback loops to the structure. Based on this configuration, a novel DDS, using the substrate integrated waveguide (SIW) transmission line, is introduced. According to the experimental results, the proposed device with a relatively compact size creates high group delay swings (9 ns), and its insertion loss is about 7 dB.


title: Pathological Image Segmentation with Noisy Labels

abstract: Segmentation of pathological images is essential for accurate disease diagnosis. The quality of manual labels plays a critical role in segmentation accuracy; yet, in practice, the labels between pathologists could be inconsistent, thus confusing the training process. In this work, we propose a novel label re-weighting framework to account for the reliability of different experts' labels on each pixel according to its surrounding features. We further devise a new attention heatmap, which takes roughness as prior knowledge to guide the model to focus on important regions. Our approach is evaluated on the public Gleason 2019 datasets. The results show that our approach effectively improves the model's robustness against noisy labels and outperforms state-of-the-art approaches.


title: Data-driven deep learning algorithms for time-varying infection rates of COVID-19 and mitigation measures

abstract: Epidemiological models with constant parameters may not capture satisfactory infection patterns in the presence of pharmaceutical and non-pharmaceutical mitigation measures during a pandemic, since infectiousness is a function of time. In this paper, an Epidemiology-Informed Neural Network algorithm is introduced to learn the time-varying transmission rate for the COVID-19 pandemic in the presence of various mitigation scenarios. There are asymptomatic infectives, mostly unreported, and the proposed algorithm learns the proportion of the total infective individuals that are asymptomatic infectives. Using cumulative and daily reported cases of the symptomatic infectives, we simulate the impact of non-pharmaceutical mitigation measures such as early detection of infectives, contact tracing, and social distancing on the basic reproduction number. We demonstrate the effectiveness of vaccination on the transmission of COVID-19. The accuracy of the proposed algorithm is demonstrated using error metrics in the data-driven simulation for COVID-19 data of Italy, South Korea, the United Kingdom, and the United States.