title: Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning

abstract: How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These questions involve both the optimization and statistical aspects of deep learning, but can hardly be answered by analyzing supervised learning, where the target functions are the highest pursuit. Indeed, in self-supervised learning, it is inevitable to relate to the optimization/generalization of neural networks to how they can encode the latent structures in the data, which we refer to as the feature learning process. In this work, we formally study how contrastive learning learns the feature representations for neural networks by analyzing its feature learning process. We consider the case where our data are comprised of two types of features: the more semantically aligned sparse features which we want to learn from, and the other dense features we want to avoid. Theoretically, we prove that contrastive learning using $\mathbf{ReLU}$ networks provably learns the desired sparse features if proper augmentations are adopted. We present an underlying principle called $\textbf{feature decoupling}$ to explain the effects of augmentations, where we theoretically characterize how augmentations can reduce the correlations of dense features between positive samples while keeping the correlations of sparse features intact, thereby forcing the neural networks to learn from the self-supervision of sparse features. Empirically, we verified that the feature decoupling principle matches the underlying mechanism of contrastive learning in practice.


title: Reputation Bootstrapping for Composite Services using CP-nets

abstract: We propose a novel framework to bootstrap the reputation of on-demand service compositions. On-demand compositions are usually context-aware and have little or no direct consumer feedback. The reputation bootstrapping of single or atomic services does not consider the topology of the composition and relationships among reputation-related factors. We apply Conditional Preference Networks (CP-nets) of reputation-related factors for component services in a composition. The reputation of a composite service is bootstrapped by the composition of CP-nets. We consider the history of invocation among component services to determine reputation-interdependence in a composition. The composition rules are constructed using the composition topology and four types of reputation-influence among component services. A heuristic-based Q-learning approach is proposed to select the optimal set of reputation-related CP-nets. Experimental results prove the efficiency of the proposed approach.


title: Students Programming Competitions as an Educational Tool and a Motivational Incentive to Students

abstract: In this short paper we report on student programming competition results by students from the Computer Science Department (COSC) of Okanagan College (OC) and discuss the achieved results from an educational point of view. We found that some freshmen and sophomore students in diploma and degree programs are very capable and eager to be involved in applied research projects as early as the second semester, and into local and international programming competitions as well. Our observation is based on the last 2 educational years, beginning 2015 when we introduced programming competitions to COSC students. Students reported that participation in competitions give them motivation to effectively learn in their programming courses, inspire them to learn deeper and more thoroughly, and help them achieve better results in their classes.


title: Asteroseismic analysis of variable hot subdwarf stars observed with TESS I. The mean g-mode period spacings in hot subdwarf B stars

abstract: We present photometric and spectroscopic analyses of gravity (g-mode) long-period pulsating hot subdwarf B (sdB) stars. We perform a detailed asteroseismic and spectroscopic analysis of five pulsating sdB stars observed with {\it TESS} aiming at the global comparison of the observations with the model predictions based on our stellar evolution computations coupled with the adiabatic pulsation computations. We apply standard seismic tools for mode identification, including asymptotic period spacings and rotational frequency multiplets. We calculate the mean period spacing for $l = 1$ and $l = 2$ modes and estimate the errors by means of a statistical resampling analysis. For all stars, atmospheric parameters were derived by fitting synthetic spectra to the newly obtained low-resolution spectra. We have computed stellar evolution models using {\tt LPCODE} stellar evolution code, and computed $l = 1$ g-mode frequencies with the adiabatic non-radial pulsation code {\tt LP-PUL}. Derived observational mean period spacings are then compared to the mean period spacings from detailed stellar evolution computations coupled with the adiabatic pulsation computations of g-modes. The atmospheric parameters derived from spectroscopic data are typical of long-period pulsating sdB stars with the effective temperature ranging from 23\,700\,K to 27\,600\,K and surface gravity spanning from 5.3\,dex to 5.5\,dex. In agreement with the expectations from theoretical arguments and previous asteroseismological works, we find that the mean period spacings obtained for models with small convective cores, as predicted by a pure Schwarzschild criterion, are incompatible with the observations. We find that models with a standard/modest convective boundary mixing at the boundary of the convective core are in better agreement with the observed mean period spacings and are therefore more realistic.


title: Bi-Hamiltonian recursion, Liu-Pandharipande relations, and vanishing terms of the second Dubrovin-Zhang bracket

abstract: The Dubrovin-Zhang hierarchy is a Hamiltonian infinite-dimensional integrable system associated to a semi-simple cohomological field theory or, alternatively, to a semi-simple Dubrovin-Frobenius manifold. Under an extra assumption of homogeneity, Dubrovin and Zhang conjectured that there exists a second Poisson bracket that endows their hierarchy with a bi-Hamiltonian structure. More precisely, they gave a construction for the second bracket, but the polynomiality of its coefficients in the dispersion parameter expansion is yet to be proved. In this paper we use the bi-Hamiltonian recursion and a set of relations in the tautological rings of the moduli spaces of curves derived by Liu and Pandharipande in order to analyze the second Poisson bracket of Dubrovin and Zhang. We give a new proof of a theorem of Dubrovin and Zhang that the coefficients of the dispersion parameter expansion of the second bracket are rational functions with prescribed singularities. We also prove that all terms in the expansion of the second bracket in the dispersion parameter that cannot be realized by polynomials because they have negative degree do vanish, thus partly confirming the conjecture of Dubrovin and Zhang.

categories: math-ph hep-th math.AG math.DG math.MP nlin.SI


title: Towards an Integrated Conceptual Modelling Kernel for Business Transaction Workflows

abstract: The workflow concept, proliferated through the recently emergent computer supported cooperative work (CSCW) systems and workflow systems, advances information systems (IS) implementation models by incorporating aspects of collaboration and coordination in business processes. Under traditional implementation models, applications are partitioned into discrete units of functionality, with (typically) operational procedures used to describe how human and computerised actions of business processes combine to deliver business services. In this paper, a number of essential modelling concepts and features for business transaction workflows are developed.


title: Impact of fluctuations in social contacts on the spread of epidemics

abstract: The mathematical model of the spread of the epidemic is developed, which considers fluctuations in the number of human social contacts. The model is based on the logistic equation. The oscillation in the number of social contacts within one week is considered as the main source of fluctuations. The time-fluctuating variable of the number of contacts is represented as the sum of the first two terms of the Fourier series expansion of number of contacts. It is shown that the largest fluctuation amplitudes occur near the maximum rate of the epidemic spread. After that, the effect of fluctuations decreases until the end of the epidemic.


title: On the Excess Entropy Scaling Law: a Potential Energy Landscape View

abstract: The relationship between excess entropy and diffusion is revisited by means of large-scale computer simulation combined to supervised learning approach to determine the excess entropy for the Lennard-Jones potential. Results reveal that it finds its roots in the properties of the potential energy landscape (PEL). In particular the exponential law holding in the liquid is seen to be correlated with the landscape-influenced regime of the PEL while the fluid-like power-law corresponds to the free diffusion regime.


title: Revealing Chern number from quantum metric

abstract: Chern number is usually characterized by Berry curvature. Here, by investigating the Dirac model of even-dimensional Chern insulator, we give the general relation between Berry curvature and quantum metric, which indicates that the Chern number can be encoded in quantum metric as well as the surface area of the Brillouin zone on the hypersphere embedded in Euclidean parameter space. We find that there is a corresponding relationship between the quantum metric and the metric on such hypersphere. We show the geometrical property of quantum metric. Besides, we give a protocol to measure the quantum metric in the degenerate system.


title: Strange star with Krori-Barua potential in presence of anisotropy

abstract: In present paper a well-behaved new model of anisotropic compact star in (3+1)-dimensional spacetime has been investigated in the background of Einstein's general theory of relativity. The model has been developed by choosing $g_rr$ component as Krori-Barua (KB) ansatz [Krori and Barua in J. Phys. A, Math. Gen. 8:508, 1975]. The field equations have been solved by a proper choice of the anisotropy factor which is physically reasonable and well behaved inside the stellar interior. Interior spacetime has been matched smoothly to the exterior Schwarzschild vacuum solution and it has also been depicted graphically. Model is free from all types of singularities and is in static equilibrium under different forces acting on the system. The stability of the model has been tested with the help of various conditions available in literature. The solution is compatible with observed masses and radii of a few compact stars.


title: Charged strange star with Krori-Barua potential in $f(R,T)$ gravity admitting Chaplygin equation of state

abstract: In present paper a new compact star model in f(R,T) gravity is obtained where R and T denote the Ricci scalar and the trace of energy-momentum tensor $T_{\mu \nu}$ respectively. To develop the model we consider the spherically symmetric space-time along with anisotropic fluid distribution in presence of electric field with $f(R,T) = R + 2\gamma T$ where $\gamma$ is a small positive constant. We have used the Chaplygin equation of state to explore the stellar model. The field equations for $f(R,T)$ gravity have been solved by employing the Krori-Barua ansatz already reported in literature [J. Phys. A, Math. Gen. 8:508, 1975]. The exterior spacetime is described by Reissner-Nordstrom line element for smooth matching at the boundary. It is worthwhile to mention here that the values of all the constants involved with this model have been calculated for the strange stars 4U 1538-52 for different values of {\gamma} with the help of matching conditions. The acceptability of the model is discussed in details both analytically and graphically by studying the physical attributes of matter density, pressures, anisotropy factor, stability etc. We have also obtained the numerical values in tabular form for central density, surface density, central pressure and central adiabatic index for different values of $\gamma$. The solutions of the field equations in Einstein gravity can be regained by simply putting $\gamma = 0$ to our solution. Moreover, the proposed model is shown to be physically admissible and corroborate with experimental observations on strange star candidates such as 4U 1538-52.


title: A polynomial composites and monoid domains as algebraic structures and their applications

abstract: This paper contains the results collected so far on polynomial composites in terms of many basic algebraic properties. Since it is a polynomial structure, results for monoid domains come in here and there. The second part of the paper contains the results of the relationship between the theory of polynomial composites, the Galois theory and the theory of nilpotents. The third part of this paper shows us some cryptosystems. We find generalizations of known ciphers taking into account the infinite alphabet and using simple algebraic methods. We also find two cryptosystems in which the structure of Dedekind rings resides, namely certain elements are equivalent to fractional ideals. Finally, we find the use of polynomial composites and monoid domains in cryptology.


title: Gravity Cannot Cure Quantum Mechanics of its Malady of the Collapse of the Wavefunction

abstract: The speculation that gravity is the key to solving the quantum measurement problem has been alive for decades, without any convincing demonstration of a solution. One necessary factor in the relevant proposals is that the gravitational energy of mutual interaction, which scales quadratically with the mass, facilitates the spontaneous collapse of the wavefunctions in spatially separated superpositions. Relying on a simple physical input from electrodynamics, supported by robust first principle calculations, we show that the speculations connecting gravity and the hypothetical spontaneous collapse of the wavefunction are inconsistent and not tenable. The result suggests that the gravitational solution to the problem of the collapse of the wavefunction be put to rest.


title: Comparing Two Different Approaches in Big Data and Business Analysis for Churn Prediction with the Focus on How Apache Spark Employed

abstract: Due to the significant importance of Big Data analysis, especially in business-related topics such as improving services, finding potential customers, and selecting practical approaches to manage income and expenses, many companies attempt to collaborate with scientists to find how, why, and what they should analysis. In this work, we would like to compare and discuss two different approaches that employed in business analysis topic in Big Data with more consideration on how they utilized Spark. Both studies have investigated Churn Prediction as their case study for their proposed approaches since it is an essential topic in business analysis for companies to recognize a customer intends to leave or stop using their services. Here, we focus on Apache Spark since it has provided several solutions to handle a massive amount of data in recent years efficiently. This feature in Spark makes it one of the most robust candidate tools to upfront with a Big Data problem, particularly time and resource are concerns.


title: Optical lattice with spin-dependent sub-wavelength barriers

abstract: We analyze a tripod atom light coupling scheme characterized by two dark states playing the role of quasi-spin states. It is demonstrated that by properly configuring the coupling laser fields, one can create a lattice with spin-dependent sub-wavelength barriers. This allows to flexibly alter the atomic motion ranging from atomic dynamics in the effective brick-wall type lattice to free motion of atoms in one dark state and a tight binding lattice with a twice smaller periodicity for atoms in the other dark state. Between the two regimes, the spectrum undergoes significant changes controlled by the laser fields. The tripod lattice can be produced using current experimental techniques. The use of the tripod scheme to create a lattice of degenerate dark states opens new possibilities for spin ordering and symmetry breaking.

categories: quant-ph cond-mat.mes-hall cond-mat.quant-gas physics.atom-ph


title: On the convergence of sequences in $\mathbb{R}^+$ through weighted geometric means via multiplicative calculus and application to intuitionistic fuzzy numbers

abstract: We define weighted geometric mean method of convergence for sequences in $\mathbb{R}^+$ by using multiplicative calculus and obtain necessary and sufficient conditions under which convergence of sequences in $\mathbb{R}^+$ follows from convergence of their weighted geometric means. We also obtain multiplicative analogues of Schmidt type slow oscillation condition and Landau type two-sided condition for the convergence in particular. Besides, we introduce the concepts of $^{\oplus}$convergence, $^{\otimes}$convergence, $(\bar{N},p)-^{\oplus}$convergence, $(\bar{G},p)-^{\otimes}$convergence for sequences of intuitionistic fuzzy numbers (IFNs) and apply the aforementioned conditions to achieve convergence in intuitionistic fuzzy number space. Examples of sequences are also given to illustrate the proposed methods of convergence.


title: One-point distribution of the geodesic in directed last passage percolation

abstract: We consider the geodesic of the directed last passage percolation with iid exponential weights. We find the explicit one-point distribution of the geodesic location joint with the last passage times, and its limit as the parameters go to infinity under the KPZ scaling.


title: Towards the 0-statement of the Kohayakawa-Kreuter conjecture

abstract: In this paper, we study asymmetric Ramsey properties of the random graph $G_{n,p}$. Let $r \in \mathbb{N}$ and $H_1, \ldots, H_r$ be graphs. We write $G_{n,p} \to (H_1, \ldots, H_r)$ to denote the property that whenever we colour the edges of $G_{n,p}$ with colours from the set $[r] := \{1, \ldots, r\}$ there exists $i \in [r]$ and a copy of $H_i$ in $G_{n,p}$ monochromatic in colour $i$. There has been much interest in determining the asymptotic threshold function for this property. R\"{o}dl and Ruci\'{n}ski determined the threshold function for the general symmetric case; that is, when $H_1 = \cdots = H_r$. A conjecture of Kohayakawa and Kreuter, if true, would fully resolve the asymmetric problem. Recently, the 1-statement of this conjecture was confirmed by Mousset, Nenadov and Samotij. Building on work of Marciniszyn, Skokan, Sp\"{o}hel and Steger, we reduce the 0-statement of Kohayakawa and Kreuter's conjecture to a certain deterministic subproblem. To demonstrate the potential of this approach, we show this subproblem can be resolved for almost all pairs of regular graphs. This therefore resolves the 0-statement for all such pairs of graphs.


title: UML Sequence Diagram: An Alternative Model

abstract: The general acceptance of sequence diagrams can be attributed to their relatively intuitive nature and ability to describe partial behaviors (as opposed to such diagrams as state charts). However, studies have shown that over 80 percent of graduating students were unable to create a software design or even a partial design, and many students had no idea how sequence diagrams were constrained by other models. Many students exhibited difficulties in identifying valid interacting objects and constructing messages with appropriate arguments. Additionally, according to authorities, even though many different semantics have been proposed for sequence diagrams (e.g., translations to state machines), there exists no suitable semantic basis refinement of required sequence diagram behavior because direct style semantics do not precisely capture required sequence diagram behaviors; translations to other formalisms disregard essential features of sequence diagrams such as guard conditions and critical regions. This paper proposes an alternative to sequence diagrams, a generalized model that provides further understanding of sequence diagrams to assimilate them into a new modeling language called thinging machine (TM). The sequence diagram is extended horizontally by removing the superficial vertical-only dimensional limitation of expansion to preserve the logical chronology of events. TM diagramming is spread nonlinearly in terms of actions. Events and their chronology are constructed on a second plane of description that is superimposed on the initial static description. The result is a more refined representation that would simplify the modeling process. This is demonstrated through remodeling sequence diagram cases from the literature.


title: Mid-depth Ocean Stratification: Southern Ocean eddies vs interior vertical diffusivity

abstract: The mid-depth ocean stratification was fitted by Munk (1966) to an exponential profile and shown to be consistent with a vertical advective-diffusive balance. However, tracer release experiments show that vertical diffusivity in the mid-depth ocean is an order of magnitude too small to explain the observed 1 km exponential scale. Alternative mechanisms suggested that the overturning is mostly adiabatic, that interior diapycnal upwelling is negligible, and that nearly all mid-depth water upwells adiabatically in the Southern Ocean (SO). In this picture, SO eddies and wind set isopycnal slopes in the SO and therefore determine a non-vanishing mid-depth interior stratification even in the adiabatic limit. The effect of SO eddies on SO isopycnal slopes can be understood via either a marginal criticality condition or via a near-vanishing residual overturning conditions in the adiabatic limit. We examine the role of SO eddies vs interior mixing in setting the mid-depth stratification by using eddy-permitting numerical simulations, in which we artificially change the diapycnal mixing only away from the SO. We find that SO isopycnal slopes change in response to changes of the interior diapycnal mixing even when the wind forcing is constant, consistent with previous studies. However, in the limit of small interior mixing, the interior stratification is far from exponential, suggesting that SO processes alone do not lead to the observed stratification. The results suggest that while SO eddies contribute to the non-vanishing mid-depth interior stratification, the exponential shape of the stratification must also involve interior diapycnal mixing. Both SO eddies and interior diapycnal mixing are therefore important in determining the interior mid-depth exponential stratification.


title: CO2-driven diffusiophoresis and water cleaning: Similarity solutions for predicting the exclusion zone in a channel flow

abstract: We investigate experimentally and theoretically diffusiophoretic separation of negatively charged particles in a rectangular channel flow, driven by CO2 dissolution from one side-wall. Since the negatively charged particles create an exclusion zone near the boundary where CO2 is introduced, we model the problem by applying a shear flow approximation in a two-dimensional configuration. From the form of the equations we define a similarity variable to transform the reaction-diffusion equations for CO2 and ions and the advection-diffusion equation for the particle distribution to ordinary differential equations. The definition of the similarity variable suggests a characteristic length scale for the particle exclusion zone. We consider height-averaged flow behaviors in rectangular channels to rationalize and connect our experimental observations with the model, by calculating the wall shear rate as functions of channel dimensions. Our observations and the theoretical model provide the design parameters such as flow speed, channel dimensions and CO2 pressure for the in-flow water cleaning systems.


title: Polynomial Matrices, Splitting Subspaces and Krylov Subspaces over Finite Fields

abstract: Let $T$ be a linear operator on an $\mathbb{F}_q$-vector space $V$ of dimension $n$. For any divisor $m$ of $n$, an $m$-dimensional subspace $W$ of $V$ is $T$-splitting if $$ V =W\oplus TW\oplus \cdots \oplus T^{d-1}W, $$ where $d=n/m$. Let $\sigma(m,d;T)$ denote the number of $m$-dimensional $T$-splitting subspaces. Determining $\sigma(m,d;T)$ for an arbitrary operator $T$ is an open problem. This problem is closely related to another open problem on Krylov spaces. We discuss this connection and give explicit formulae for $\sigma(m,d;T)$ in the case where the invariant factors of $T$ satisfy certain degree conditions. A connection with another enumeration problem on polynomial matrices is also discussed.


title: A randomized algorithm for the stabilization of switched nonlinear systems under restricted switching

abstract: This paper deals with input/output-to-state stability (IOSS) of switched nonlinear systems in the discrete-time setting. We present an algorithm to construct periodic switching signals that obey pre-specified restrictions on admissible switches between the subsystems and admissible dwell times on the subsystems, and identify sufficient conditions on the individual subsystems, the admissible switches and admissible dwell times under which a switching signal obtained from our algorithm preserves stability of a switched system with overwhelming probability. We recover our earlier result on probabilistic techniques for the design of switching signals that preserve global asymptotic stability of switched linear systems under sufficient conditions on the properties of the individual subsystems and the admissible dwell times on the subsystems.


title: Adaptive Feature Alignment for Adversarial Training

abstract: Recent studies reveal that Convolutional Neural Networks (CNNs) are typically vulnerable to adversarial attacks, which pose a threat to security-sensitive applications. Many adversarial defense methods improve robustness at the cost of accuracy, raising the contradiction between standard and adversarial accuracies. In this paper, we observe an interesting phenomenon that feature statistics change monotonically and smoothly w.r.t the rising of attacking strength. Based on this observation, we propose the adaptive feature alignment (AFA) to generate features of arbitrary attacking strengths. Our method is trained to automatically align features of arbitrary attacking strength. This is done by predicting a fusing weight in a dual-BN architecture. Unlike previous works that need to either retrain the model or manually tune a hyper-parameters for different attacking strengths, our method can deal with arbitrary attacking strengths with a single model without introducing any hyper-parameter. Importantly, our method improves the model robustness against adversarial samples without incurring much loss in standard accuracy. Experiments on CIFAR-10, SVHN, and tiny-ImageNet datasets demonstrate that our method outperforms the state-of-the-art under a wide range of attacking strengths.


title: Isogeometric shape optimization for scaffold structures

abstract: The development of materials with specific structural properties is of huge practical interest, for example, for medical applications or for the development of light weight structures in aeronautics. In this article, we combine shape optimization and homogenization for the optimal design of the microstructure in scaffolds. Given the current microstructure, we apply the isogeometric boundary element method to compute the effective tensor and to update the microstructure by using the shape gradient in order to match the desired effective tensor. Extensive numerical studies are presented to demonstrate the applicability and feasibility of the approach.


title: On maximizing a monotone $k$-submodular function under a knapsack constraint

abstract: We study the problem of maximizing a non-negative monotone $k$-submodular function $f$ under a knapsack constraint, where a $k$-submodular function is a natural generalization of a submodular function to $k$ dimensions. We present a deterministic $(\frac12-\frac{1}{2e})\approx 0.316$-approximation algorithm that evaluates $f$ $O(n^4k^3)$ times, based on the result of Sviridenko (2004) on submodular knapsack maximization.


title: An Epimorphism between Fine and Ferguson's Matrices for Angell's AC

abstract: Angell's logic of analytic containment AC has been shown to be characterized by a 9-valued matrix NC by Ferguson, and by a 16-valued matrix by Fine. It is shown that the former is the image of a surjective homomorphism from the latter, i.e., an epimorphic image. Some candidate 7-valued matrices are ruled out as characteristic of AC. Whether matrices with fewer than 9 values exist remains an open question. The results were obtained with the help of the MUltlog system for investigating finite-valued logics; the results serve as an example of the usefulness of techniques from computational algebra in logic. A tableau proof system for NC is also provided.


title: Energy Efficiency Optimization for Multi-cell Massive MIMO: Centralized and Distributed Power Allocation Algorithms

abstract: This paper investigates the energy efficiency (EE) optimization in downlink multi-cell massive multiple-input multiple-output (MIMO). In our research, the statistical channel state information (CSI) is exploited to reduce the signaling overhead. To maximize the minimum EE among the neighbouring cells, we design the transmit covariance matrices for each base station (BS). Specifically, optimization schemes for this max-min EE problem are developed, in the centralized and distributed ways, respectively. To obtain the transmit covariance matrices, we first find out the closed-form optimal transmit eigenmatrices for the BS in each cell, and convert the original transmit covariance matrices designing problem into a power allocation one. Then, to lower the computational complexity, we utilize an asymptotic approximation expression for the problem objective. Moreover, for the power allocation design, we adopt the minorization maximization method to address the non-convexity of the ergodic rate, and use Dinkelbach's transform to convert the max-min fractional problem into a series of convex optimization subproblems. To tackle the transformed subproblems, we propose a centralized iterative water-filling scheme. For reducing the backhaul burden, we further develop a distributed algorithm for the power allocation problem, which requires limited inter-cell information sharing. Finally, the performance of the proposed algorithms are demonstrated by extensive numerical results.


title: Automatic audiovisual synchronisation for ultrasound tongue imaging

abstract: Ultrasound tongue imaging is used to visualise the intra-oral articulators during speech production. It is utilised in a range of applications, including speech and language therapy and phonetics research. Ultrasound and speech audio are recorded simultaneously, and in order to correctly use this data, the two modalities should be correctly synchronised. Synchronisation is achieved using specialised hardware at recording time, but this approach can fail in practice resulting in data of limited usability. In this paper, we address the problem of automatically synchronising ultrasound and audio after data collection. We first investigate the tolerance of expert ultrasound users to synchronisation errors in order to find the thresholds for error detection. We use these thresholds to define accuracy scoring boundaries for evaluating our system. We then describe our approach for automatic synchronisation, which is driven by a self-supervised neural network, exploiting the correlation between the two signals to synchronise them. We train our model on data from multiple domains with different speaker characteristics, different equipment, and different recording environments, and achieve an accuracy >92.4% on held-out in-domain data. Finally, we introduce a novel resource, the Cleft dataset, which we gathered with a new clinical subgroup and for which hardware synchronisation proved unreliable. We apply our model to this out-of-domain data, and evaluate its performance subjectively with expert users. Results show that users prefer our model's output over the original hardware output 79.3% of the time. Our results demonstrate the strength of our approach and its ability to generalise to data from new domains.


title: Critical transition to a non-chaotic regime in isotropic turbulence

abstract: We study the properties of homogeneous and isotropic turbulence in higher spatial dimensions through the lens of chaos and predictability using numerical simulations. We employ both direct numerical simulations (DNS) and numerical calculations of the Eddy Damped Quasi Normal Markovian (EDQNM) closure approximation. Our closure results show a remarkable transition to a non-chaotic regime above critical dimension $d_c\approx 5.88$. We relate these results to the properties of the energy cascade as a function of spatial dimension in the context of the idea of a critical dimension for turbulence where Kolmogorov's 1941 theory becomes exact.


title: DISSECT: Disentangled Simultaneous Explanations via Concept Traversals

abstract: Explaining deep learning model inferences is a promising venue for scientific understanding, improving safety, uncovering hidden biases, evaluating fairness, and beyond, as argued by many scholars. One of the principal benefits of counterfactual explanations is allowing users to explore "what-if" scenarios through what does not and cannot exist in the data, a quality that many other forms of explanation such as heatmaps and influence functions are inherently incapable of doing. However, most previous work on generative explainability cannot disentangle important concepts effectively, produces unrealistic examples, or fails to retain relevant information. We propose a novel approach, DISSECT, that jointly trains a generator, a discriminator, and a concept disentangler to overcome such challenges using little supervision. DISSECT generates Concept Traversals (CTs), defined as a sequence of generated examples with increasing degrees of concepts that influence a classifier's decision. By training a generative model from a classifier's signal, DISSECT offers a way to discover a classifier's inherent "notion" of distinct concepts automatically rather than rely on user-predefined concepts. We show that DISSECT produces CTs that (1) disentangle several concepts, (2) are influential to a classifier's decision and are coupled to its reasoning due to joint training (3), are realistic, (4) preserve relevant information, and (5) are stable across similar inputs. We validate DISSECT on several challenging synthetic and realistic datasets where previous methods fall short of satisfying desirable criteria for interpretability and show that it performs consistently well and better than existing methods. Finally, we present experiments showing applications of DISSECT for detecting potential biases of a classifier and identifying spurious artifacts that impact predictions.


title: Multimodal Detection of Information Disorder from Social Media

abstract: Social media is accompanied by an increasing proportion of content that provides fake information or misleading content, known as information disorder. In this paper, we study the problem of multimodal fake news detection on a largescale multimodal dataset. We propose a multimodal network architecture that enables different levels and types of information fusion. In addition to the textual and visual content of a posting, we further leverage secondary information, i.e. user comments and metadata. We fuse information at multiple levels to account for the specific intrinsic structure of the modalities. Our results show that multimodal analysis is highly effective for the task and all modalities contribute positively when fused properly.


title: Comment on `Local available quantum correlations for Bell Diagonal states and markovian decoherence'

abstract: In this brief paper, we complete the analysis presented previously in [RMF 64 (2018) 662-670, arXiv:1803.02426] regarding the quantifiers of the classical correlations and the so-called local available quantum correlations for Bell Diagonal states. A correction is introduced in their previous expressions once two cases within the optimizations are included.


title: Minimal nondegenerate extensions

abstract: We prove that every slightly degenerate braided fusion category admits a minimal nondegenerate extension, and hence that every pseudo-unitary super modular tensor category admits a minimal modular extension. This completes the program of characterizing minimal nondegenerate extensions of braided fusion categories. Our proof relies on the new subject of fusion 2-categories. We study in detail the Drinfel'd centre Z(Mod-B) of the fusion 2-category Mod-B of module categories of a braided fusion 1-category B. We show that minimal nondegenerate extensions of B correspond to certain trivializations of Z(Mod-B). In the slightly degenerate case, such trivializations are obstructed by a class in $\mathrm{H}^5(K(\mathbb{Z}_2, 2); k^\times)$ and we use a numerical invariant -- defined by evaluating a certain two-dimensional topological field theory on a Klein bottle -- to prove that this obstruction always vanishes. Along the way, we develop techniques to explicitly compute in braided fusion 2-categories which we expect will be of independent interest. In addition to the model of Z(Mod-B) in terms of braided B-module categories, we develop a computationally useful model in terms of certain algebra objects in B. We construct an S-matrix pairing for any braided fusion 2-category, and show that it is nondegenerate for Z(Mod-B). As a corollary, we identify components of Z(Mod-B) with blocks in the annular category of B and with the homomorphisms from the Grothendieck ring of the M\"uger centre of B to the ground field.


title: MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens

abstract: Transformers have offered a new methodology of designing neural networks for visual recognition. Compared to convolutional networks, Transformers enjoy the ability of referring to global features at each stage, yet the attention module brings higher computational overhead that obstructs the application of Transformers to process high-resolution visual data. This paper aims to alleviate the conflict between efficiency and flexibility, for which we propose a specialized token for each region that serves as a messenger (MSG). Hence, by manipulating these MSG tokens, one can flexibly exchange visual information across regions and the computational complexity is reduced. We then integrate the MSG token into a multi-scale architecture named MSG-Transformer. In standard image classification and object detection, MSG-Transformer achieves competitive performance and the inference on both GPU and CPU is accelerated. Code is available at https://github.com/hustvl/MSG-Transformer.


title: On (self-) reciprocal Appell polynomials: Symmetry and Faulhaber-type polynomials

abstract: The main purpose of this paper is to study generalized (self-) reciprocal Appell polynomials, which play a certain role in connection with Faulhaber-type polynomials. More precisely, we show for any Appell sequence when satisfying a reflection relation that the Appell polynomials can be described by Faulhaber-type polynomials, which arise from a quadratic variable substitution. Furthermore, the coefficients of the latter polynomials are given by values of derivatives of generalized reciprocal Appell polynomials. Subsequently, we show some applications to the Bernoulli and Euler polynomials. In the context of power sums the results transfer to the classical Faulhaber polynomials.


title: Harmonic Persistent Homology

abstract: We introduce harmonic persistent homology spaces for filtrations of finite simplicial complexes. As a result we can associate concrete subspaces of cycles to each bar of the barcode of the filtration. We prove stability of the harmonic persistent homology subspaces under small perturbations of functions defining them. We relate the notion of "essential simplices" introduced in an earlier work to identify simplices which play a significant role in the birth of a bar, with that of harmonic persistent homology. We prove that the harmonic representatives of simple bars maximizes the "relative essential content" amongst all representatives of the bar, where the relative essential content is the weight a particular cycle puts on the set of essential simplices.


title: Learning from Perturbations: Diverse and Informative Dialogue Generation with Inverse Adversarial Training

abstract: In this paper, we propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems to avoid generic responses and model dialogue history better. In contrast to standard adversarial training algorithms, IAT encourages the model to be sensitive to the perturbation in the dialogue history and therefore learning from perturbations. By giving higher rewards for responses whose output probability reduces more significantly when dialogue history is perturbed, the model is encouraged to generate more diverse and consistent responses. By penalizing the model when generating the same response given perturbed dialogue history, the model is forced to better capture dialogue history and generate more informative responses. Experimental results on two benchmark datasets show that our approach can better model dialogue history and generate more diverse and consistent responses. In addition, we point out a problem of the widely used maximum mutual information (MMI) based methods for improving the diversity of dialogue response generation models and demonstrate it empirically.


title: Assessing disinformation through the dynamics of supply and demand in the news ecosystem

abstract: Social dialogue, the foundation of our democracies, is currently threatened by disinformation and partisanship, with their disrupting role on individual and collective awareness and detrimental effects on decision-making processes. Despite a great deal of attention to the news sphere itself, little is known about the subtle interplay between the offer and the demand for information. Still, a broader perspective on the news ecosystem, including both the producers and the consumers of information, is needed to build new tools to assess the health of the infosphere. Here, we combine in the same framework news supply, as mirrored by a fairly complete Italian news database - partially annotated for fake news, and news demand, as captured through the Google Trends data for Italy. Our investigation focuses on the temporal and semantic interplay of news, fake news, and searches in several domains, including the virus SARS-CoV-2 pandemic. Two main results emerge. First, disinformation is extremely reactive to people's interests and tends to thrive, especially when there is a mismatch between what people are interested in and what news outlets provide. Second, a suitably defined index can assess the level of disinformation only based on the available volumes of news and searches. Although our results mainly concern the Coronavirus subject, we provide hints that the same findings can have more general applications. We contend these results can be a powerful asset in informing campaigns against disinformation and providing news outlets and institutions with potentially relevant strategies.


title: Calculating a function of a matrix with a real spectrum

abstract: Let $T$ be a square matrix with a real spectrum, and let $f$ be an analytic function. The problem of the approximate calculation of $f(T)$ is discussed. Applying the Schur triangular decomposition and the reordering, one can assume that $T$ is triangular and its diagonal entries $t_{ii}$ are arranged in increasing order. To avoid calculations using the differences $t_{ii}-t_{jj}$ with close (including equal) $t_{ii}$ and $t_{jj}$, it is proposed to represent $T$ in a block form and calculate the two main block diagonals using interpolating polynomials. The rest of the $f(T)$ entries can be calculated using the Parlett recurrence algorithm. It is also proposed to perform scalar operations (such as the building of interpolating polynomials) with an enlarged number of decimal digits.


title: Energy-Efficient Precoding in Electromagnetic Exposure-Constrained Uplink Multiuser MIMO

abstract: User electromagnetic (EM) exposure is continuously being exacerbated by the evolution of multi-antenna portable devices. To mitigate the effects of EM radiation, portable devices must satisfy tight regulations on user exposure level, generally measured by specific absorption rate (SAR). To this end, we investigate the SAR-aware uplink precoder design for the energy efficiency (EE) maximization in multiuser multiple-input multiple-output transmission exploiting statistical channel state information (CSI). As the objective function of the design problem is computationally demanding in the absence of closed form, we present an asymptotic approximation of the objective to facilitate the precoder design. An iterative algorithm based on Dinkelbach's method and sequential optimization is proposed to obtain an optimal solution of the asymptotic EE optimization problem. Based on the transformed problem, an iterative SAR-aware water-filing scheme is further conceived for the EE optimization precoding design with statistical CSI. Numerical results illustrate substantial performance improvements provided by our proposed SAR-aware energy-efficient transmission scheme over the traditional baseline schemes.


title: An algebraic approach to revealed preferences

abstract: We propose and develop an algebraic approach to revealed preference. Our approach dispenses with non algebraic structure, such as topological assumptions. We provide algebraic axioms of revealed preference that subsume previous, classical revealed preference axioms, as well as generate new axioms for behavioral theories, and show that a data set is rationalizable if and only if it is consistent with an algebraic axiom.


title: Reinforced Generative Adversarial Network for Abstractive Text Summarization

abstract: Sequence-to-sequence models provide a viable new approach to generative summarization, allowing models that are no longer limited to simply selecting and recombining sentences from the original text. However, these models have three drawbacks: their grasp of the details of the original text is often inaccurate, and the text generated by such models often has repetitions, while it is difficult to handle words that are beyond the word list. In this paper, we propose a new architecture that combines reinforcement learning and adversarial generative networks to enhance the sequence-to-sequence attention model. First, we use a hybrid pointer-generator network that copies words directly from the source text, contributing to accurate reproduction of information without sacrificing the ability of generators to generate new words. Second, we use both intra-temporal and intra-decoder attention to penalize summarized content and thus discourage repetition. We apply our model to our own proposed COVID-19 paper title summarization task and achieve close approximations to the current model on ROUEG, while bringing better readability.


title: Bidemocratic bases and their connections with other greedy-type bases

abstract: In nonlinear greedy approximation theory, bidemocratic bases have traditionally played the role of dualizing democratic, greedy, quasi-greedy, or almost greedy bases. In this article we shift the viewpoint and study them for their own sake, just as we would with any other kind of greedy-type bases. In particular we show that bidemocratic bases need not be quasi-greedy, despite the fact that they retain a strong unconditionality flavor which brings them very close to being quasi-greedy. Our constructive approach gives that for each $1<p<\infty$ the space $\ell_p$ has a bidemocratic basis which is not quasi-greedy. We also present a novel method for constructing conditional quasi-greedy bases which are bidemocratic, and provide a characterization of bidemocratic bases in terms of the new concepts of truncation quasi-greediness and partially democratic bases.


title: Steady state of the KPZ equation on an interval and Liouville quantum mechanics

abstract: We obtain a simple formula for the stationary measure of the height field evolving according to the Kardar-Parisi-Zhang equation on the interval $[0,L]$ with general Neumann type boundary conditions and any interval size. This is achieved using the recent results of Corwin and Knizel (arXiv:2103.12253) together with Liouville quantum mechanics. Our formula allows to easily determine the stationary measure in various limits: KPZ fixed point on an interval, half-line KPZ equation, KPZ fixed point on a half-line, as well as the Edwards-Wilkinson equation on an interval.

categories: math-ph cond-mat.dis-nn cond-mat.stat-mech math.MP math.PR nlin.SI


title: How transfer learning impacts linguistic knowledge in deep NLP models?

abstract: Transfer learning from pre-trained neural language models towards downstream tasks has been a predominant theme in NLP recently. Several researchers have shown that deep NLP models learn non-trivial amount of linguistic knowledge, captured at different layers of the model. We investigate how fine-tuning towards downstream NLP tasks impacts the learned linguistic knowledge. We carry out a study across popular pre-trained models BERT, RoBERTa and XLNet using layer and neuron-level diagnostic classifiers. We found that for some GLUE tasks, the network relies on the core linguistic information and preserve it deeper in the network, while for others it forgets. Linguistic information is distributed in the pre-trained language models but becomes localized to the lower layers post fine-tuning, reserving higher layers for the task specific knowledge. The pattern varies across architectures, with BERT retaining linguistic information relatively deeper in the network compared to RoBERTa and XLNet, where it is predominantly delegated to the lower layers.


title: Sound emission and annihilations in a programmable quantum vortex collider

abstract: In quantum fluids, the quantisation of circulation forbids the diffusion of a vortex swirling flow seen in classical viscous fluids. Yet, a quantum vortex accelerating in a superfluid may lose its energy into acoustic radiation, in a similar way an electric charge decelerates upon emitting photons. The dissipation of vortex energy underlies central problems in quantum hydrodynamics, such as the decay of quantum turbulence, highly relevant to systems as varied as neutron stars, superfluid helium and atomic condensates. A deep understanding of the elementary mechanisms behind irreversible vortex dynamics has been a goal for decades, but it is complicated by the shortage of conclusive experimental signatures. Here, we address this challenge by realising a programmable quantum vortex collider in a planar, homogeneous atomic Fermi superfluid with tunable inter-particle interactions. We create on-demand vortex configurations and monitor their evolution, taking advantage of the accessible time and length scales of our ultracold Fermi gas. Engineering collisions within and between vortex-antivortex pairs allows us to decouple relaxation of the vortex energy due to sound emission and interactions with normal fluid, i.e. mutual friction. We directly visualise how the annihilation of vortex dipoles radiates a sound pulse in the superfluid. Further, our few-vortex experiments extending across different superfluid regimes suggest that fermionic quasiparticles localised inside the vortex core contribute significantly to dissipation, opening the route to exploring new pathways for quantum turbulence decay, vortex by vortex.

categories: cond-mat.quant-gas cond-mat.other physics.atom-ph physics.flu-dyn


title: Extending higher Bruhat orders to non-longest words in $S_n$

abstract: In this paper, we extend Manin and Schechtman's higher Bruhat orders for the symmetric group to higher Bruhat orders for non-longest words $w$ in $S_n$. We prove that the higher Bruhat orders of non-longest words are ranked posets with unique minimal and maximal elements. As in Manin and Schechtman's original paper, the $k$-th Bruhat order for $w$ is created out of equivalence classes of maximal chains in its $(k-1)$-st Bruhat order. We also define the second and third Bruhat orders for arbitrary realizable k-sets, and prove that the second Bruhat order has a unique minimal and maximal element. Lastly, we also outline how this extension may guide future research into developing higher Bruhat orders for affine type A Weyl groups.


title: Model Mis-specification and Algorithmic Bias

abstract: Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure bias as the difference between mean prediction errors across groups. We show that even with unbiased input data, when a model is mis-specified: (1) population-level mean prediction error can still be negligible, but group-level mean prediction errors can be large; (2) such errors are not equal across groups; and (3) the difference between errors, i.e., bias, can take the worst-case realization. That is, when there are two groups of the same size, mean prediction errors for these two groups have the same magnitude but opposite signs. In closed form, we show such errors and bias are functions of the first and second moments of the joint distribution of features (for linear and probit regressions). We also conduct numerical experiments to show similar results in more general settings. Our work provides a first step for decoupling the impact of different causes of bias.


title: Efficient and Modular Implicit Differentiation

abstract: Automatic differentiation (autodiff) has revolutionized machine learning. It allows to express complex computations by composing elementary ones in creative ways and removes the burden of computing their derivatives by hand. More recently, differentiation of optimization problem solutions has attracted widespread attention with applications such as optimization layers, and in bi-level problems such as hyper-parameter optimization and meta-learning. However, so far, implicit differentiation remained difficult to use for practitioners, as it often required case-by-case tedious mathematical derivations and implementations. In this paper, we propose automatic implicit differentiation, an efficient and modular approach for implicit differentiation of optimization problems. In our approach, the user defines directly in Python a function $F$ capturing the optimality conditions of the problem to be differentiated. Once this is done, we leverage autodiff of $F$ and the implicit function theorem to automatically differentiate the optimization problem. Our approach thus combines the benefits of implicit differentiation and autodiff. It is efficient as it can be added on top of any state-of-the-art solver and modular as the optimality condition specification is decoupled from the implicit differentiation mechanism. We show that seemingly simple principles allow to recover many existing implicit differentiation methods and create new ones easily. We demonstrate the ease of formulating and solving bi-level optimization problems using our framework. We also showcase an application to the sensitivity analysis of molecular dynamics.


title: Unified Extended Irreversible Thermodynamics and the stability of relativistic theories for dissipation

abstract: In a relativistic context, the main purpose of Extended Irreversible Thermodynamics (EIT) is to generalize the principles of non-equilibrium thermodynamics to the domain of fluid dynamics. In particular, the theory aims at modelling any diffusion-type process (like heat as diffusion of energy, viscosity as diffusion of momentum, charge-conductivity as diffusion of particles) directly from thermodynamic laws. Although in Newtonian physics this task can be achieved with a first-order approach to dissipation (i.e. Navier-Stokes-Fourier like equations), in a relativistic framework the relativity of simultaneity poses serious challenges to the first-order methodology, originating instabilities which are, instead, naturally eliminated within EIT. The first part of this work is dedicated to reviewing the most recent progress made in understanding the mathematical origin of this instability problem. In the second part, we present the formalism that arises by promoting non-equilibrium thermodynamics to a classical effective field theory. We call this approach Unified Extended Irreversible Thermodynamics (UEIT), because it contains, as particular cases, EIT itself, in particular the Israel-Stewart theory and the divergence-type theories, plus Carter's approach and most branches of non-equilibrium thermodynamics, such as relativistic chemistry and radiation hydrodynamics. We use this formalism to explain why all these theories are stable by construction (provided that the microscopic input is correct), showing that their (Lyapunov) stability is a direct consequence of the second law of thermodynamics.


title: Optimization strategies of human mobility during the COVID-19 pandemic: A review

abstract: The impact of the ongoing COVID-19 pandemic is being felt in all spheres of our lives -- cutting across the boundaries of nation, wealth, religions or race. From the time of the first detection of infection among the public, the virus spread though almost all the countries in the world in a short period of time. With humans as the carrier of the virus, the spreading process necessarily depends on the their mobility after being infected. Not only in the primary spreading process, but also in the subsequent spreading of the mutant variants, human mobility plays a central role in the dynamics. Therefore, on one hand travel restrictions of varying degree were imposed and are still being imposed, by various countries both nationally and internationally. On the other hand, these restrictions have severe fall outs in businesses and livelihood in general. Therefore, it is an optimization process, exercised on a global scale, with multiple changing variables. Here we review the techniques and their effects on optimization or proposed optimizations of human mobility in different scales, carried out by data driven, machine learning and model approaches.


title: Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization

abstract: This paper investigates the problem of computing the equilibrium of competitive games, which is often modeled as a constrained saddle-point optimization problem with probability simplex constraints. Despite recent efforts in understanding the last-iterate convergence of extragradient methods in the unconstrained setting, the theoretical underpinnings of these methods in the constrained settings, especially those using multiplicative updates, remain highly inadequate, even when the objective function is bilinear. Motivated by the algorithmic role of entropy regularization in single-agent reinforcement learning and game theory, we develop provably efficient extragradient methods to find the quantal response equilibrium (QRE) -- which are solutions to zero-sum two-player matrix games with entropy regularization -- at a linear rate. The proposed algorithms can be implemented in a decentralized manner, where each player executes symmetric and multiplicative updates iteratively using its own payoff without observing the opponent's actions directly. In addition, by controlling the knob of entropy regularization, the proposed algorithms can locate an approximate Nash equilibrium of the unregularized matrix game at a sublinear rate without assuming the Nash equilibrium to be unique. Our methods also lead to efficient policy extragradient algorithms for solving (entropy-regularized) zero-sum Markov games at similar rates. All of our convergence rates are nearly dimension-free, which are independent of the size of the state and action spaces up to logarithm factors, highlighting the positive role of entropy regularization for accelerating convergence.


title: A Quasipolynomial $(2+\varepsilon)$-Approximation for Planar Sparsest Cut

abstract: The (non-uniform) sparsest cut problem is the following graph-partitioning problem: given a "supply" graph, and demands on pairs of vertices, delete some subset of supply edges to minimize the ratio of the supply edges cut to the total demand of the pairs separated by this deletion. Despite much effort, there are only a handful of nontrivial classes of supply graphs for which constant-factor approximations are known. We consider the problem for planar graphs, and give a $(2+\varepsilon)$-approximation algorithm that runs in quasipolynomial time. Our approach defines a new structural decomposition of an optimal solution using a "patching" primitive. We combine this decomposition with a Sherali-Adams-style linear programming relaxation of the problem, which we then round. This should be compared with the polynomial-time approximation algorithm of Rao (1999), which uses the metric linear programming relaxation and $\ell_1$-embeddings, and achieves an $O(\sqrt{\log n})$-approximation in polynomial time.


title: Resonant self-force effects in extreme-mass-ratio binaries: A scalar model

abstract: Extreme-mass ratio inspirals (EMRIs), compact binaries with small mass ratios $\epsilon\ll 1$, will be important sources for low-frequency gravitational wave detectors. Almost all EMRIs will evolve through important transient orbital $r\theta$ resonances, which will enhance or diminish their gravitational wave flux, thereby affecting the phase evolution of the waveforms at $O(\epsilon^{1/2})$ relative to leading order. While modeling the local gravitational self-force (GSF) during resonances is essential for generating accurate EMRI waveforms, so far the full GSF has not been calculated for an $r\theta$-resonant orbit owing to computational demands of the problem. As a first step we employ a simpler model, calculating the scalar self-force (SSF) along $r\theta$-resonant geodesics in Kerr spacetime. We demonstrate two ways of calculating the $r\theta$-resonant SSF (and likely GSF), with one method leaving the radial and polar motions initially independent as if the geodesic is nonresonant. We illustrate results by calculating the SSF along geodesics defined by three $r\theta$-resonant ratios (1:3, 1:2, 2:3). We show how the SSF and averaged evolution of the orbital constants vary with the initial phase at which an EMRI enters resonance. We then use our SSF data to test a previously proposed integrability conjecture, which argues that conservative effects vanish at adiabatic order during resonances. We find prominent contributions from the conservative SSF to the secular evolution of the Carter constant, $\langle \dot{\mathcal{Q}}\rangle$, but these nonvanishing contributions are on the order of, or less than, the estimated uncertainties of our self-force results. The uncertainties come from residual, incomplete removal of the singular field in the regularization process. Higher order regularization parameters, once available, will allow definitive tests of the integrability conjecture.


title: CVaR-based Flight Energy Risk Assessment for Multirotor UAVs using a Deep Energy Model

abstract: Energy management is a critical aspect of risk assessment for Uncrewed Aerial Vehicle (UAV) flights, as a depleted battery during a flight brings almost guaranteed vehicle damage and a high risk of human injuries or property damage. Predicting the amount of energy a flight will consume is challenging as routing, weather, obstacles, and other factors affect the overall consumption. We develop a deep energy model for a UAV that uses Temporal Convolutional Networks to capture the time varying features while incorporating static contextual information. Our energy model is trained on a real world dataset and does not require segregating flights into regimes. We illustrate an improvement in power predictions by $29\%$ on test flights when compared to a state-of-the-art analytical method. Using the energy model, we can predict the energy usage for a given trajectory and evaluate the risk of running out of battery during flight. We propose using Conditional Value-at-Risk (CVaR) as a metric for quantifying this risk. We show that CVaR captures the risk associated with worst-case energy consumption on a nominal path by transforming the output distribution of Monte Carlo forward simulations into a risk space. Computing the CVaR on the risk-space distribution provides a metric that can evaluate the overall risk of a flight before take-off. Our energy model and risk evaluation method can improve flight safety and evaluate the coverage area from a proposed takeoff location. The video and codebase are available at https://youtu.be/PHXGigqilOA and https://git.io/cvar-risk .


title: Prediction of Ultraslow Magnetic Solitons via Plasmon-induced Transparency by Artificial Neural Networks

abstract: Plasmon-induced transparency (PIT) in advanced materials has attracted extensive attention for both theoretical and applied physics. Here, we considered a scheme that can produce PIT and studied the characteristics of ultraslow low-power magnetic solitons. The PIT metamaterial is constructed as an array of unit cells that consist of two coupled varactor-loaded split-ring resonators. Simulations verified that ultraslow magnetic solitons can be generated in this type of metamaterial. To solve nonlinear equations, various types of numerical methods can be applied by virtue of exact solutions, which are always difficult to acquire. However, the initial conditions and propagation distance impact the ultimate results. In this article, an artificial neural network (ANN) was used as a supervised learning model to predict the evolution and final mathematical expressions through training based on samples with disparate initial conditions. Specifically, the influences of the number of hidden layers were discussed. Additionally, the learning results obtained by employing several training algorithms were analyzed and compared. Our research opens a route for employing machine learning algorithms to save time in both physical and engineering applications of Schr\"odinger-type systems.


title: Unifying Distillation with Personalization in Federated Learning

abstract: Federated learning (FL) is a decentralized privacy-preserving learning technique in which clients learn a joint collaborative model through a central aggregator without sharing their data. In this setting, all clients learn a single common predictor (FedAvg), which does not generalize well on each client's local data due to the statistical data heterogeneity among clients. In this paper, we address this problem with PersFL, a discrete two-stage personalized learning algorithm. In the first stage, PersFL finds the optimal teacher model of each client during the FL training phase. In the second stage, PersFL distills the useful knowledge from optimal teachers into each user's local model. The teacher model provides each client with some rich, high-level representation that a client can easily adapt to its local model, which overcomes the statistical heterogeneity present at different clients. We evaluate PersFL on CIFAR-10 and MNIST datasets using three data-splitting strategies to control the diversity between clients' data distributions. We empirically show that PersFL outperforms FedAvg and three state-of-the-art personalization methods, pFedMe, Per-FedAvg, and FedPer on majority data-splits with minimal communication cost. Further, we study the performance of PersFL on different distillation objectives, how this performance is affected by the equitable notion of fairness among clients, and the number of required communication rounds. PersFL code is available at https://tinyurl.com/hdh5zhxs for public use and validation.


title: Balanced photodetectors nonlinearity for short-pulse regime

abstract: Short pulse lasers are used to characterize the nonlinear response of amplified photodetectors. Two widely used balanced detectors are characterized in terms of amplitude, area, broadening, and balancing the mismatch of their impulse response. The dynamic impact of pulses on the detector is also discussed. It is demonstrated that using photodetectors with short pulses triggers nonlinearities even when the source average power is well below the detector continuous power saturation threshold.


title: Artificial neural network states for non-additive systems

abstract: Methods inspired from machine learning have recently attracted great interest in the computational study of quantum many-particle systems. So far, however, it has proven challenging to deal with microscopic models in which the total number of particles is not conserved. To address this issue, we propose a new variant of neural network states, which we term neural coherent states. Taking the Fr\"ohlich impurity model as a case study, we show that neural coherent states can learn the ground state of non-additive systems very well. In particular, we observe substantial improvement over the standard coherent state estimates in the most challenging intermediate coupling regime. Our approach is generic and does not assume specific details of the system, suggesting wide applications.

categories: cond-mat.str-el cond-mat.dis-nn physics.comp-ph quant-ph


title: Very Large Array imaging rules out precessing radio jets in three DES$-$SDSS-selected candidate periodic quasars

abstract: Periodic quasars have been suggested as candidates for hosting binary supermassive black holes (SMBHs), although alternative scenarios remain possible to explain the optical light curve periodicity. To test the alternative hypothesis of precessing radio jet, we present deep 6 GHz radio imaging conducted with NSF's Karl G. Jansky Very Large Array (VLA) in its C configuration for the three candidate periodic quasars, DES J024703.24$-$010032.0, DES J024944.66$-$000036.8, and DES J025214.67$-$002813.7. Our targets were selected based on their optical variability using 20-yr long multi-color light curves from the Dark Energy Survey (DES) and the Sloan Digital Sky Survey (SDSS). The new VLA observations show that all three periodic quasars are radio-quiet with the radio loudness parameters measured to be $R\equiv f_{6\,{\rm cm}}/f_{{\rm 2500}}$ of $\lesssim$1.0$-$1.5 and the $k$-corrected luminosities $\nu L_\nu$[6 GHz] of $\lesssim$5$-$21 $\times$ 10$^{39}$ erg s$^{-1}$. They are in stark contrast to previously known periodic quasars proposed as binary SMBH candidates such as the blazar OJ 287 and PG1302$-$102. Our results rule out optical emission contributed from precessing radio jets as the origin of the optical periodicity in the three DES$-$SDSS-selected candidate periodic quasars. Future continued optical monitoring and complementary multi-wavelength observations are still needed to further test the binary SMBH hypothesis as well as other competing scenarios to explain the optical periodicity.


title: The upper logarithmic density of monochromatic subset sums

abstract: We show that in any two-coloring of the positive integers there is a color for which the set of positive integers that can be represented as a sum of distinct elements with this color has upper logarithmic density at least $(2+\sqrt{3})/4$ and this is best possible. This answers a forty-year-old question of Erd\H{o}s.


title: A novel second-order nonstandard finite difference method for solving one-dimensional autonomous dynamical systems

abstract: In this work, a novel second-order nonstandard finite difference (NSFD) method that preserves simultaneously the positivity and local asymptotic stability of one-dimensional autonomous dynamical systems is introduced and analyzed. This method is based on novel non-local approximations for right-hand side functions of differential equations in combination with nonstandard denominator functions. The obtained results not only resolve the contradiction between the dynamic consistency and high-order accuracy of NSFD methods but also improve and extend some well-known results that have been published recently in [Applied Mathematics Letters 112(2021) 106775], [AIP Conference Proceedings 2302(2020) 110003] and [Applied Mathematics Letters 50(2015) 78-82]. Furthermore, as a simple but important application, we apply the constructed NSFD method for solving the logistic, sine, cubic, and Monod equations; consequently, the NSFD schemes constructed in the earlier work [Journal of Computational and Applied Mathematics 110(1999) 181-185] are improved significantly. Finally, we report some numerical experiments to support and illustrate the theoretical assertions as well as advantages of the constructed NSFD method.


title: A Simple and General Debiased Machine Learning Theorem with Finite Sample Guarantees

abstract: Debiased machine learning is a meta algorithm based on bias correction and sample splitting to calculate confidence intervals for functionals, i.e. scalar summaries, of machine learning algorithms. For example, an analyst may desire the confidence interval for a treatment effect estimated with a neural network. We provide a nonasymptotic debiased machine learning theorem that encompasses any global or local functional of any machine learning algorithm that satisfies a few simple, interpretable conditions. Formally, we prove consistency, Gaussian approximation, and semiparametric efficiency by finite sample arguments. The rate of convergence is $n^{-1/2}$ for global functionals, and it degrades gracefully for local functionals. Our results culminate in a simple set of conditions that an analyst can use to translate modern learning theory rates into traditional statistical inference. The conditions reveal a general double robustness property for ill posed inverse problems.


title: Macroscopic turbulent flow via hard sphere potential

abstract: In recent works, we proposed a hypothesis that the turbulence in gases could be produced by particles interacting via a potential, and examined the proposed mechanics of turbulence formation in a simple model of two particles for a variety of different potentials. In this work, we use the same hypothesis to develop new fluid mechanics equations which model turbulent gas flow on a macroscopic scale. The main difference between our approach and the conventional formalism is that we avoid replacing the potential interaction between particles with the Boltzmann collision integral. Due to this difference, the velocity moment closure, which we implement for the shear stress and heat flux, relies upon the high Reynolds number condition, rather than the Newton law of viscosity and the Fourier law of heat conduction. The resulting system of equations of fluid mechanics differs considerably from the standard Euler and Navier-Stokes equations. A numerical simulation of our system shows that a laminar Bernoulli jet of an argon-like hard sphere gas in a straight pipe rapidly becomes a turbulent flow. The time-averaged Fourier spectra of the kinetic energy of this flow exhibit Kolmogorov's negative five-thirds power decay rate.


title: Rotational Coherence Times of Polar Molecules in Optical Tweezers

abstract: Qubit coherence times are critical to the performance of any robust quantum computing platform. For quantum information processing using arrays of polar molecules, a key performance parameter is the molecular rotational coherence time. We report a 93(7) ms coherence time for rotational state qubits of laser cooled CaF molecules in optical tweezer traps, over an order of magnitude longer than previous systems. Inhomogeneous broadening due to the differential polarizability between the qubit states is suppressed by tuning the tweezer polarization and applied magnetic field to a "magic" angle. The coherence time is limited by the residual differential polarizability, implying improvement with further cooling. A single spin-echo pulse is able to extend the coherence time to nearly half a second. The measured coherence times demonstrate the potential of polar molecules as high fidelity qubits.


title: Theory of defect-mediated morphogenesis

abstract: Growing experimental evidence indicates that topological defects could serve as organizing centers in the morphogenesis of tissues. Here, we provide a quantitative explanation for this phenomenon, rooted in the buckling theory of deformable active polar liquid crystals. Using a combination of linear stability analysis and computational fluid dynamics, we demonstrate that active layers, such as confined cell monolayers, are unstable to the formation of protrusions in the presence of disclinations. The instability originates from an interplay between the focusing of the elastic forces, mediated by defects, and the renormalization of the system's surface tension by the active flow. The posttransitional regime is also characterized by several complex morphodynamical processes, such as oscillatory deformations, droplet nucleation, and active turbulence. Our findings offer an explanation of recent observations on tissue morphogenesis and shed light on the dynamics of active surfaces in general.


title: Dynamics of superconducting qubit relaxation times

abstract: Superconducting qubits are a leading candidate for quantum computing but display temporal fluctuations in their energy relaxation times T1. This introduces instabilities in multi-qubit device performance. Furthermore, autocorrelation in these time fluctuations introduces challenges for obtaining representative measures of T1 for process optimization and device screening. These T1 fluctuations are often attributed to time varying coupling of the qubit to defects, putative two level systems (TLSs). In this work, we develop a technique to probe the spectral and temporal dynamics of T1 in single junction transmons by repeated T1 measurements in the frequency vicinity of the bare qubit transition, via the AC-Stark effect. Across 10 qubits, we observe strong correlations between the mean T1 averaged over approximately nine months and a snapshot of an equally weighted T1 average over the Stark shifted frequency range. These observations are suggestive of an ergodic-like spectral diffusion of TLSs dominating T1, and offer a promising path to more rapid T1 characterization for device screening and process optimization.


title: On the diameter of the stopped spider process

abstract: We consider the Brownian ``spider process'', also known as Walsh Brownian motion, first introduced in the epilogue of Walsh 1978. The paper provides the best constant $C_n$ for the inequality $$ E D_\tau\leq C_n \sqrt{E \tau},$$ where $\tau$ is the class of all adapted and integrable stopping times and $D$ denotes the diameter of the spider process measured in terms of the British rail metric. The proof relies on the explicit identification of the value function for the associated optimal stopping problem.


title: SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers

abstract: We present SegFormer, a simple, efficient yet powerful semantic segmentation framework which unifies Transformers with lightweight multilayer perception (MLP) decoders. SegFormer has two appealing features: 1) SegFormer comprises a novel hierarchically structured Transformer encoder which outputs multiscale features. It does not need positional encoding, thereby avoiding the interpolation of positional codes which leads to decreased performance when the testing resolution differs from training. 2) SegFormer avoids complex decoders. The proposed MLP decoder aggregates information from different layers, and thus combining both local attention and global attention to render powerful representations. We show that this simple and lightweight design is the key to efficient segmentation on Transformers. We scale our approach up to obtain a series of models from SegFormer-B0 to SegFormer-B5, reaching significantly better performance and efficiency than previous counterparts. For example, SegFormer-B4 achieves 50.3% mIoU on ADE20K with 64M parameters, being 5x smaller and 2.2% better than the previous best method. Our best model, SegFormer-B5, achieves 84.0% mIoU on Cityscapes validation set and shows excellent zero-shot robustness on Cityscapes-C. Code will be released at: github.com/NVlabs/SegFormer.


title: Electron correlations and $T$-breaking density wave order in a $\mathbb{Z}_2$ kagome metal

abstract: There have been extensive recent developments on kagome metals, such as T$_m$X$_n$ (T= Fe, Co and X= Sn, Ge) and $A$V$_3$Sb$_5$ ($A=$ Cs, K, Rb). An emerging issue is the nature of correlated phases when topologically \textit{non-trivial} bands cross the Fermi level. Here, we consider an extended Hubbard model on the kagome lattice in the presence of spin-orbit couplings, involving a Kramer's pair of bands that have opposite Chern numbers and are isolated in the band structure. We construct an effective model in a time-reversal (T) symmetric lattice description. We determine the correlated phases of this model and identify a density-wave order in the phase diagram. We show that this order is T-breaking, which originates from the Wannier orbitals lacking a common Wannier center -- a fingerprint of the underlying $Z_2$ topology. Implications of our results for the correlation physics of the kagome metals are discussed.


title: Dilute magnetic moments in an exactly solvable interacting host

abstract: Despite concerted efforts, the problem of dilute local moments embedded in a correlated conduction electron host such as Nd$_{1-x}$Ce$_x$CuO$_2$ persists due to lack of analytically controllable models. Here, we address the question: how do local moments couple to correlated but integrable hosts? We describe the conduction electrons by the model of Hatsugai-Kohmoto (HK) which has undergone a recent resurgence arising from its exact solvability, existence of Luttinger surfaces, and connections to Sachdev-Ye-Kitaev (SYK) thermodynamics. We derive an exact low energy "Kondo-HK" Hamiltonian and show the existence of additional spin-exchange coupling that is relevant in the renormalization group (RG) sense. This term is ferromagnetic and does not vanish at low energies yielding an algebraic enhancement of the Kondo temperature. "Poor man's" scaling of couplings exhibits an exotic step-like RG flow between UV-IR fixed points attributed to severely restricted scattering phase space. This phenomenon is analogous to the flow of central charge in Zamolodchikov's diagonal resonance scattering in integrable quantum field theories.


title: Privately Learning Subspaces

abstract: Private data analysis suffers a costly curse of dimensionality. However, the data often has an underlying low-dimensional structure. For example, when optimizing via gradient descent, the gradients often lie in or near a low-dimensional subspace. If that low-dimensional structure can be identified, then we can avoid paying (in terms of privacy or accuracy) for the high ambient dimension. We present differentially private algorithms that take input data sampled from a low-dimensional linear subspace (possibly with a small amount of error) and output that subspace (or an approximation to it). These algorithms can serve as a pre-processing step for other procedures.


title: Analysis and classification of main risk factors causing stroke in Shanxi Province

abstract: In China, stroke is the first leading cause of death in recent years. It is a major cause of long-term physical and cognitive impairment, which bring great pressure on the National Public Health System. Evaluation of the risk of getting stroke is important for the prevention and treatment of stroke in China. A data set with 2000 hospitalized stroke patients in 2018 and 27583 residents during the year 2017 to 2020 is analyzed in this study. Due to data incompleteness, inconsistency, and non-structured formats, missing values in the raw data are filled with -1 as an abnormal class. With the cleaned features, three models on risk levels of getting stroke are built by using machine learning methods. The importance of "8+2" factors from China National Stroke Prevention Project (CSPP) is evaluated via decision tree and random forest models. Except for "8+2" factors the importance of features and SHAP1 values for lifestyle information, demographic information, and medical measurement are evaluated and ranked via a random forest model. Furthermore, a logistic regression model is applied to evaluate the probability of getting stroke for different risk levels. Based on the census data in both communities and hospitals from Shanxi Province, we investigate different risk factors of getting stroke and their ranking with interpretable machine learning models. The results show that Hypertension (Systolic blood pressure, Diastolic blood pressure), Physical Inactivity (Lack of sports), and Overweight (BMI) are ranked as the top three high-risk factors of getting stroke in Shanxi province. The probability of getting stroke for a person can also be predicted via our machine learning model.


title: Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices

abstract: We present a methodology for parallel acceleration of learning in the presence of matrix orthogonality and unitarity constraints of interest in several branches of machine learning. We show how an apparently sequential elementary rotation parametrization can be restructured into blocks of commutative operations using a well-known tool for coloring the edges of complete graphs, in turn widely applied to schedule round-robin (all-against-all) sports tournaments. The resulting decomposition admits an algorithm to compute a fully-parametrized orthogonal matrix from its rotation parameters in $O(n)$ sequential steps and one to compute the gradient of a training loss with respect to its parameters in $O(n\log n)$ steps. We discuss parametric restrictions of interest to generative modeling and present promising performance results with a prototype GPU implementation.


title: A note ON MONOGENEITY of pure number fields

abstract: Gassert's paper "A NOTE ON THE MONOGENEITY OF POWER MAPS" is cited at least by $17$ papers in the context of monogeneity of pure number fields despite some errors that it contains and remarks on it. In this note, we point out some of these errors, and make some improvements on it.


title: Quantum Federated Learning with Quantum Data

abstract: Quantum machine learning (QML) has emerged as a promising field that leans on the developments in quantum computing to explore large complex machine learning problems. Recently, some purely quantum machine learning models were proposed such as the quantum convolutional neural networks (QCNN) to perform classification on quantum data. However, all of the existing QML models rely on centralized solutions that cannot scale well for large-scale and distributed quantum networks. Hence, it is apropos to consider more practical quantum federated learning (QFL) solutions tailored towards emerging quantum network architectures. Indeed, developing QFL frameworks for quantum networks is critical given the fragile nature of computing qubits and the difficulty of transferring them. On top of its practical momentousness, QFL allows for distributed quantum learning by leveraging existing wireless communication infrastructure. This paper proposes the first fully quantum federated learning framework that can operate over quantum data and, thus, share the learning of quantum circuit parameters in a decentralized manner. First, given the lack of existing quantum federated datasets in the literature, the proposed framework begins by generating the first quantum federated dataset, with a hierarchical data format, for distributed quantum networks. Then, clients sharing QCNN models are fed with the quantum data to perform a classification task. Subsequently, the server aggregates the learnable quantum circuit parameters from clients and performs federated averaging. Extensive experiments are conducted to evaluate and validate the effectiveness of the proposed QFL solution. This work is the first to combine Google's TensorFlow Federated and TensorFlow Quantum in a practical implementation.


title: Review of Low Voltage Load Forecasting: Methods, Applications, and Recommendations

abstract: The increased digitalisation and monitoring of the energy system opens up numerous opportunities to decarbonise the energy system. Applications on low voltage, local networks, such as community energy markets and smart storage will facilitate decarbonisation, but they will require advanced control and management. Reliable forecasting will be a necessary component of many of these systems to anticipate key features and uncertainties. Despite this urgent need, there has not yet been an extensive investigation into the current state-of-the-art of low voltage level forecasts, other than at the smart meter level. This paper aims to provide a comprehensive overview of the landscape, current approaches, core applications, challenges and recommendations. Another aim of this paper is to facilitate the continued improvement and advancement in this area. To this end, the paper also surveys some of the most relevant and promising trends. It establishes an open, community-driven list of the known low voltage level open datasets to encourage further research and development.


title: DikpolaSat Mission: Improvement of Space Flight Performance and Optimal Control Using Trained Deep Neural Network -- Trajectory Controller for Space Objects Collision Avoidance

abstract: This paper introduced the space mission DikpolaSat Mission, how this research fits into the mission, and the importance of having a trained DNN model instead of the usual GN&C functionality. This paper shows how the controller demonstration is carried out by having the spacecraft follow a desired path, specified in the referenced model. Increases can be made by examining the route used to construct a DNN and understanding the effects of various activating functions on system efficiency. The obstacle avoidance algorithm is built into the control features to respond spontaneously using inputs from the neural network for collision avoidance while optimizing the modified trajectory. The action of a neural network to control the adaptive nature of the nonlinear mechanisms in the controller will make the control system capable of handling multiple nonlinear events and also uncertainties that have not been induced in the control algorithm. Multiple algorithms for optimizing flight controls and fuel consumption can be implemented using knowledge of flight dynamics in trajectory and also in the event of obstacle avoidance. This paper also explains how a DNN can learn to control the flight path and make the system more reliable with each launch, thereby improving the chances of predicting collisions of space objects. The data released from this research is used to design more advanced DNN model capable of predicting other orbital events as well.


title: Robust discovery of partial differential equations in complex situations

abstract: Data-driven discovery of partial differential equations (PDEs) has achieved considerable development in recent years. Several aspects of problems have been resolved by sparse regression-based and neural network-based methods. However, the performances of existing methods lack stability when dealing with complex situations, including sparse data with high noise, high-order derivatives and shock waves, which bring obstacles to calculating derivatives accurately. Therefore, a robust PDE discovery framework, called the robust deep learning-genetic algorithm (R-DLGA), that incorporates the physics-informed neural network (PINN), is proposed in this work. In the framework, a preliminary result of potential terms provided by the deep learning-genetic algorithm is added into the loss function of the PINN as physical constraints to improve the accuracy of derivative calculation. It assists to optimize the preliminary result and obtain the ultimately discovered PDE by eliminating the error compensation terms. The stability and accuracy of the proposed R-DLGA in several complex situations are examined for proof-and-concept, and the results prove that the proposed framework is able to calculate derivatives accurately with the optimization of PINN and possesses surprising robustness to complex situations, including sparse data with high noise, high-order derivatives, and shock waves.


title: Deep-Learning Discovers Macroscopic Governing Equations for Viscous Gravity Currents from Microscopic Simulation Data

abstract: Although deep-learning has been successfully applied in a variety of science and engineering problems owing to its strong high-dimensional nonlinear mapping capability, it is of limited use in scientific knowledge discovery. In this work, we propose a deep-learning based framework to discover the macroscopic governing equation of viscous gravity current based on high-resolution microscopic simulation data without the need for prior knowledge of underlying terms. For two typical scenarios with different viscosity ratios, the deep-learning based equations exactly capture the same dominated terms as the theoretically derived equations for describing long-term asymptotic behaviors, which validates the proposed framework. Unknown macroscopic equations are then obtained for describing short-term behaviors, and additional deep-learned compensation terms are eventually discovered. Comparison of posterior tests shows that the deep-learning based PDEs actually perform better than the theoretically derived PDEs in predicting evolving viscous gravity currents for both long-term and short-term regimes. Moreover, the proposed framework is proven to be very robust against non-biased data noise for training, which is up to 20%. Consequently, the presented deep-learning framework shows considerable potential for discovering unrevealed intrinsic laws in scientific semantic space from raw experimental or simulation results in data space.

categories: physics.comp-ph cs.AI cs.LG physics.data-an


title: Multi-Scale Attention Neural Network for Acoustic Echo Cancellation

abstract: Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Since the performance of linear adaptive filter (AF) would degrade severely due to nonlinear distortions, background noises, and microphone clipping in real scenarios, deep learning has been employed for AEC for its good nonlinear modelling ability. In this paper, we constructed an end-to-end multi-scale attention neural network for AEC. Temporal convolution is first used to transform waveform into spectrogram. The spectrograms of the far-end reference and the near-end mixture are concatenated, and fed to a temporal convolution network (TCN) with stacked dilated convolution layers. Attention mechanism is performed among these representations from different layers to adaptively extract relevant features by referring to the previous hidden state in the encoder long short-term memory (LSTM) unit. The representations are weighted averaged and fed to the encoder LSTM for the near-end speech estimation. Experiments show the superiority of our method in terms of the echo return loss enhancement (ERLE) for single-talk periods and the perceptual evaluation of speech quality (PESQ) score for double-talk periods in background noise and nonlinear distortion scenarios.


title: Constrained Deep Reinforcement Based Functional Split Optimization in Virtualized RANs

abstract: In virtualized radio access network (vRAN), the base station (BS) functions are decomposed into virtualized components that can be hosted at the centralized unit or distributed units through functional splits. Such flexibility has many benefits; however, it also requires solving the problem of finding the optimal splits of functions of the BSs in such a way that minimizes the total network cost. The underlying vRAN system is complex and precise modelling of it is not trivial. Formulating the functional split problem to minimize the cost results in a combinatorial problem that is provably NP-hard, and solving it is computationally expensive. In this paper, a constrained deep reinforcement learning (RL) approach is proposed to solve the problem with minimal assumptions about the underlying system. Since in deep RL, the action selection is the outcome of inference of a neural network, it can be done in real-time while training to update the neural networks can be done in the background. However, since the problem is combinatorial, even for a small number of functions, the action space of the RL problem becomes large. Therefore, to deal with such a large action space, a chain rule-based stochastic policy is exploited in which a long short-term memory (LSTM) network-based sequence-to-sequence model is applied to estimate the policy that is selecting the functional split actions. However, the utilized policy is still limited to an unconstrained problem, and each split decision is bounded by vRAN's constraint requirements. Hence, a constrained policy gradient method is leveraged to train and guide the policy toward constraint satisfaction. Further, a search strategy by greedy decoding or temperature sampling is utilized to improve the optimality performance at the test time. Simulations are performed to evaluate the performance of the proposed solution using synthetic and real network datasets.