title: Linearizing Combinators

abstract: In 2017, Bauer, Johnson, Osborne, Riehl, and Tebbe (BJORT) showed that the Abelian functor calculus provides an example of a Cartesian differential category. The definition of a Cartesian differential category is based on a differential combinator which directly formalizes the total derivative from multivariable calculus. However, in the aforementioned work the authors used techniques from Goodwillie's functor calculus to establish a linearization process from which they then derived a differential combinator. This raised the question of what the precise relationship between linearization and having a differential combinator might be. In this paper, we introduce the notion of a linearizing combinator which abstracts linearization in the Abelian functor calculus. We then use it to provide an alternative axiomatization of a Cartesian differential category. Every Cartesian differential category comes equipped with a canonical linearizing combinator obtained by differentiation at zero. Conversely, a differential combinator can be constructed \`a la BJORT when one has a system of partial linearizing combinators in each context. Thus, while linearizing combinators do provide an alternative axiomatization of Cartesian differential categories, an explicit notion of partial linearization is required. This is in contrast to the situation for differential combinators where partial differentiation is automatic in the presence of total differentiation. The ability to form a system of partial linearizing combinators from a total linearizing combinator, while not being possible in general, is possible when the setting is Cartesian closed.


title: A Novel Fast 3D Single Image Super-Resolution Algorithm

abstract: This paper introduces a novel computationally efficient method of solving the 3D single image super-resolution (SR) problem, i.e., reconstruction of a high-resolution volume from its low-resolution counterpart. The main contribution lies in the original way of handling simultaneously the associated decimation and blurring operators, based on their underlying properties in the frequency domain. In particular, the proposed decomposition technique of the 3D decimation operator allows a straightforward implementation for Tikhonov regularization, and can be further used to take into consideration other regularization functions such as the total variation, enabling the computational cost of state-of-the-art algorithms to be considerably decreased. Numerical experiments carried out showed that the proposed approach outperforms existing 3D SR methods.


title: "What, not how": Solving an under-actuated insertion task from scratch

abstract: Robot manipulation requires a complex set of skills that need to be carefully combined and coordinated to solve a task. Yet, most ReinforcementLearning (RL) approaches in robotics study tasks which actually consist only of a single manipulation skill, such as grasping an object or inserting a pre-grasped object. As a result the skill ('how' to solve the task) but not the actual goal of a complete manipulation ('what' to solve) is specified. In contrast, we study a complex manipulation goal that requires an agent to learn and combine diverse manipulation skills. We propose a challenging, highly under-actuated peg-in-hole task with a free, rotational asymmetrical peg, requiring a broad range of manipulation skills. While correct peg (re-)orientation is a requirement for successful insertion, there is no reward associated with it. Hence an agent needs to understand this pre-condition and learn the skill to fulfil it. The final insertion reward is sparse, allowing freedom in the solution and leading to complex emerging behaviour not envisioned during the task design. We tackle the problem in a multi-task RL framework using Scheduled Auxiliary Control (SAC-X) combined with Regularized Hierarchical Policy Optimization (RHPO) which successfully solves the task in simulation and from scratch on a single robot where data is severely limited.


title: An introduction to the mathematical modelling of iPSCs

abstract: The aim of this chapter is to convey the importance and usefulness of mathematical modelling as a tool to achieve a deeper understanding of stem cell biology. We introduce key mathematical concepts (random walk theory, differential equations and agent-based modelling) which form the basis of current descriptions of induced pluripotent stem cells. We hope to encourage a meaningful dialogue between biologists and mathematicians and highlight the value of such an interdisciplinary approach.


title: Effective estimation of some oscillatory integrals related to infinitely divisible distributions

abstract: We present a practical framework to prove, in a simple way, two-terms asymptotic expansions for Fourier integrals $$ {\mathcal I}(t) = \int_{\mathbb R}({\rm e}^{it\phi(x)}-1) {\rm d} \mu(x) $$ where $\mu$ is a probability measure on $\mathbb{R}$ and $\phi$ is measurable. This applies to many basic cases, in link with Levy's continuity theorem. We present applications to limit laws related to rational continued fractions coefficients.


title: Roots of maps between spheres and projective spaces in codimension one

abstract: For maps from $S^3$ and $\RP^3$ into $S^2$ and $\RP^2$, we study the problem of minimizing the root set by deforming the maps through homotopies. After presenting the classification of the homotopy classes of such maps, we prove that the minimal root set for a non null-homotopic map is either a circle or the disjoint union of two circle, according its range is $S^2$ or $\RP^2$, respectively.


title: Experimental validation of MDL emulation and estimation techniques for SDM transmission systems

abstract: We experimentally validate a mode-dependent loss (MDL) estimation technique employing acorrection factor to remove the MDL estimation dependence on the SNR when using a minimum meansquare error (MMSE) equalizer. A reduction of the MDL estimation error is observed for both transmitter-side and in-span MDL emulation.


title: An optically-heated atomic source for compact ion trap vacuum systems

abstract: We present a design for an atomic oven suitable for loading ion traps, which is operated via optical heating with a continuous-wave multimode diode laser. The absence of the low-resistance electrical connections necessary for Joule heating allows the oven to be extremely well thermally isolated from the rest of the vacuum system, and for an oven filled with calcium we achieve a number density suitable for rapid ion loading in the target region with ~200 mW of laser power, limited by radiative losses. With simple feedforward to the laser power, the turn-on time for the oven is less than 20 s, while the oven contains enough calcium to operate continuously for many thousands of years without replenishment.


title: 1 Tbit/s/$\lambda$ Transmission Over a 130 km Link Consisting of Graded-Index 50 $\mu$m Core Multi-Mode Fiber and 6LP Few-Mode Fiber

abstract: We demonstrate 1 Tbit/s/$\lambda$ single-span transmission over a heterogeneous link consisting of graded-index 50 $\mu$m core multi-mode fiber and 6LP few-mode fiber using a Kramers-Kronig receiver structure. Furthermore, the link budget increase by transmitting only three modes while employing more than three receivers is investigated.


title: Stationary fully nonlinear mean-field games

abstract: In this paper we examine fully nonlinear mean-field games associated with a minimization problem. The variational setting is driven by a functional depending on its argument through its Hessian matrix. We work under fairly natural conditions and establish improved (sharp) regularity for the solutions in Sobolev spaces. Then, we prove the existence of minimizers for the variational problem and the existence of solutions to the mean-field games system. We also investigate a unidimensional example and unveil new information on the explicit solutions. Our findings can be generalized to a larger class of operators, yielding information on a broader range of examples.


title: Magnetic and electronic phases of U$_\mathbf{2}$Rh$_\mathbf{3}$Si$_\mathbf{5}$

abstract: We present a detailed study of the magnetic and electronic properties of U$_2$Rh$_3$Si$_5$, a material that has been demonstrated to exhibit a first order antiferromagnetic phase transition. From a high magnetic field study, together with extensive experiments in moderate fields, we establish the magnetic phase diagrams for all crystallographic directions. The possibility of an electronic phase in a narrow interval above the N\'eel temperature as a precursor of a magnetic phase is discussed.


title: Higher order cumulants of electric charge and strangeness fluctuations on the crossover line

abstract: We present lattice QCD calculations of higher order cumulants of electric charge distributions for small baryon chemical potentials $\mu_B$ by using up to NNNLO Taylor expansions. Ratios of these cumulants are evaluated on the pseudo-critical line, $T_{pc}(\mu_B)$, of the chiral transition and compared to corresponding measurements in heavy ion collision experiments by the STAR and PHENIX Collaborations. We demonstrate that these comparisons give strong constraints on freeze-out parameters. Furthermore, we use strangeness fluctuation observables to compute the ratio $\mu_S/\mu_B$ on the crossover line and compare it to $\mu_S/\mu_B$ at freeze-out stemming from fits to strange baryon yields measured by the STAR Collaboration.


title: Enhancing Vulnerable Road User Safety: A Survey of Existing Practices and Consideration for Using Mobile Devices for V2X Connections

abstract: Vulnerable road users (VRUs) such as pedestrians, cyclists and motorcyclists are at the highest risk in the road traffic environment. Globally, over half of road traffic deaths are vulnerable road users. Although substantial efforts are being made to improve VRU safety from engineering solutions to law enforcement, the death toll of VRUs' continues to rise. The emerging technology, Cooperative Intelligent Transportation System (C-ITS), has the proven potential to enhance road safety by enabling wireless communication to exchange information among road users. Such exchanged information is utilized for creating situational awareness and detecting any potential collisions in advance to take necessary measures to avoid any possible road casualties. The current state-of-the-art solutions of C-ITS for VRU safety, however, are limited to unidirectional communication where VRUs are only responsible for alerting their presence to drivers with the intention of avoiding collisions. This one-way interaction is substantially limiting the enormous potential of C-ITS which otherwise can be employed to devise a more effective solution for the VRU safety where VRU can be equipped with bidirectional communication with full C-ITS functionalities. To address such problems and to explore better C-ITS solution suggestions for VRU, this paper reviewed and evaluated the current technologies and safety methods proposed for VRU safety over the period 2007-2020. Later, it presents the design considerations for a cellular-based Vehicle-to-VRU (V2VRU) communication system along with potential challenges of a cellular-based approach to provide necessary recommendations.


title: Overview of the QCD phase diagram -- Recent progress from the lattice

abstract: In recent years there has been much progress on the investigation of the QCD phase diagram with lattice QCD simulations. In this review I focus on the developments in the last two years. Especially the addition of external influences or new parameter ranges yield an increasing number of interesting results. I discuss the progress for small, finite densities from both analytical continuation and Complex Langevin simulations, for heavy quark bound states (quarkonium), the dependence on the quark masses (Columbia plot) and the influence of a magnetic field. Many of these conditions are relevant for the understanding of both the QCD transition in the early universe and heavy ion collision experiments which are conducted for example at the LHC and RHIC.


title: A stochastic $\theta$-SEIHRD model: adding randomness to the COVID-19 spread

abstract: In this article we mainly extend the deterministic model developed in [10] to a stochastic setting. More precisely, we incorporated randomness in some coefficients by assuming that they follow a prescribed stochastic dynamics. In this way, the model variables are now represented by stochastic process, that can be simulated by appropriately solve the system of stochastic differential equations. Thus, the model becomes more complete and flexible than the deterministic analogous, as it incorporates additional uncertainties which are present in more realistic situations. In particular, confidence intervals for the main variables and worst case scenarios can be computed.


title: Full Addition Formulae of Genus Two Hyperelliptic Functions by the Duplication Method

abstract: We have given full algebraic addition formulae of genus two hyperelliptic functions by the duplication method. This full addition formulae according to the duplication method give some hints of Lie group structure in addition formulae of genus two hyperelliptic functions.


title: Dynamic Formation Reshaping Based on Point Set Registration in a Swarm of Drones

abstract: This work focuses on the formation reshaping in an optimized manner in autonomous swarm of drones. Here, the two main problems are: 1) how to break and reshape the initial formation in an optimal manner, and 2) how to do such reformation while minimizing the overall deviation of the drones and the overall time, i.e., without slowing down. To address the first problem, we introduce a set of routines for the drones/agents to follow while reshaping to a secondary formation shape. And the second problem is resolved by utilizing the temperature function reduction technique, originally used in the point set registration process. The goal is to be able to dynamically reform the shape of multi-agent based swarm in near-optimal manner while going through narrow openings between, for instance obstacles, and then bringing the agents back to their original shape after passing through the narrow passage using point set registration technique.


title: Dynamic Resource-aware Corner Detection for Bio-inspired Vision Sensors

abstract: Event-based cameras are vision devices that transmit only brightness changes with low latency and ultra-low power consumption. Such characteristics make event-based cameras attractive in the field of localization and object tracking in resource-constrained systems. Since the number of generated events in such cameras is huge, the selection and filtering of the incoming events are beneficial from both increasing the accuracy of the features and reducing the computational load. In this paper, we present an algorithm to detect asynchronous corners from a stream of events in real-time on embedded systems. The algorithm is called the Three Layer Filtering-Harris or TLF-Harris algorithm. The algorithm is based on an events' filtering strategy whose purpose is 1) to increase the accuracy by deliberately eliminating some incoming events, i.e., noise, and 2) to improve the real-time performance of the system, i.e., preserving a constant throughput in terms of input events per second, by discarding unnecessary events with a limited accuracy loss. An approximation of the Harris algorithm, in turn, is used to exploit its high-quality detection capability with a low-complexity implementation to enable seamless real-time performance on embedded computing platforms. The proposed algorithm is capable of selecting the best corner candidate among neighbors and achieves an average execution time savings of 59 % compared with the conventional Harris score. Moreover, our approach outperforms the competing methods, such as eFAST, eHarris, and FA-Harris, in terms of real-time performance, and surpasses Arc* in terms of accuracy.


title: FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement

abstract: This paper proposes a full-band and sub-band fusion model, named as FullSubNet, for single-channel real-time speech enhancement. Full-band and sub-band refer to the models that input full-band and sub-band noisy spectral feature, output full-band and sub-band speech target, respectively. The sub-band model processes each frequency independently. Its input consists of one frequency and several context frequencies. The output is the prediction of the clean speech target for the corresponding frequency. These two types of models have distinct characteristics. The full-band model can capture the global spectral context and the long-distance cross-band dependencies. However, it lacks the ability to modeling signal stationarity and attending the local spectral pattern. The sub-band model is just the opposite. In our proposed FullSubNet, we connect a pure full-band model and a pure sub-band model sequentially and use practical joint training to integrate these two types of models' advantages. We conducted experiments on the DNS challenge (INTERSPEECH 2020) dataset to evaluate the proposed method. Experimental results show that full-band and sub-band information are complementary, and the FullSubNet can effectively integrate them. Besides, the performance of the FullSubNet also exceeds that of the top-ranked methods in the DNS Challenge (INTERSPEECH 2020).


title: Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors

abstract: Moving towards autonomy, unmanned vehicles rely heavily on state-of-the-art collision avoidance systems (CAS). However, the detection of obstacles especially during night-time is still a challenging task since the lighting conditions are not sufficient for traditional cameras to function properly. Therefore, we exploit the powerful attributes of event-based cameras to perform obstacle detection in low lighting conditions. Event cameras trigger events asynchronously at high output temporal rate with high dynamic range of up to 120 $dB$. The algorithm filters background activity noise and extracts objects using robust Hough transform technique. The depth of each detected object is computed by triangulating 2D features extracted utilising LC-Harris. Finally, asynchronous adaptive collision avoidance (AACA) algorithm is applied for effective avoidance. Qualitative evaluation is compared using event-camera and traditional camera.


title: Asynchronous Corner Tracking Algorithm based on Lifetime of Events for DAVIS Cameras

abstract: Event cameras, i.e., the Dynamic and Active-pixel Vision Sensor (DAVIS) ones, capture the intensity changes in the scene and generates a stream of events in an asynchronous fashion. The output rate of such cameras can reach up to 10 million events per second in high dynamic environments. DAVIS cameras use novel vision sensors that mimic human eyes. Their attractive attributes, such as high output rate, High Dynamic Range (HDR), and high pixel bandwidth, make them an ideal solution for applications that require high-frequency tracking. Moreover, applications that operate in challenging lighting scenarios can exploit the high HDR of event cameras, i.e., 140 dB compared to 60 dB of traditional cameras. In this paper, a novel asynchronous corner tracking method is proposed that uses both events and intensity images captured by a DAVIS camera. The Harris algorithm is used to extract features, i.e., frame-corners from keyframes, i.e., intensity images. Afterward, a matching algorithm is used to extract event-corners from the stream of events. Events are solely used to perform asynchronous tracking until the next keyframe is captured. Neighboring events, within a window size of 5x5 pixels around the event-corner, are used to calculate the velocity and direction of extracted event-corners by fitting the 2D planar using a randomized Hough transform algorithm. Experimental evaluation showed that our approach is able to update the location of the extracted corners up to 100 times during the blind time of traditional cameras, i.e., between two consecutive intensity images.


title: An Exact Solution Path Algorithm for SLOPE and Quasi-Spherical OSCAR

abstract: Sorted $L_1$ penalization estimator (SLOPE) is a regularization technique for sorted absolute coefficients in high-dimensional regression. By arbitrarily setting its regularization weights $\lambda$ under the monotonicity constraint, SLOPE can have various feature selection and clustering properties. On weight tuning, the selected features and their clusters are very sensitive to the tuning parameters. Moreover, the exhaustive tracking of their changes is difficult using grid search methods. This study presents a solution path algorithm that provides the complete and exact path of solutions for SLOPE in fine-tuning regularization weights. A simple optimality condition for SLOPE is derived and used to specify the next splitting point of the solution path. This study also proposes a new design of a regularization sequence $\lambda$ for feature clustering, which is called the quasi-spherical and octagonal shrinkage and clustering algorithm for regression (QS-OSCAR). QS-OSCAR is designed with a contour surface of the regularization terms most similar to a sphere. Among several regularization sequence designs, sparsity and clustering performance are compared through simulation studies. The numerical observations show that QS-OSCAR performs feature clustering more efficiently than other designs.


title: Tweaking Ramanujan's Approximation of n!

abstract: In 1730 James Stirling, building on the work of Abraham de Moivre, published what is known as Stirling's approximation of $n!$. He gave a good formula which is asymptotic to $n!$. Since then hundreds of papers have given alternative proofs of his result and improved upon it, including notably by Burside, Gosper, and Mortici. However Srinivasa Ramanujan gave a remarkably better asymptotic formula. Hirschhorn and Villarino gave a nice proof of Ramanujan's result and an error estimate for the approximation. In recent years there have been several improvements of Stirling's formula including by Nemes, Windschitl, and Chen. Here it is shown (i) how all these asymptotic results can be easily verified; (ii) how Hirschhorn and Villarino's argument allows a tweaking of Ramanujan's result to give a better approximation; (iii) that a new asymptotic formula can be obtained by further tweaking of Ramanujan's result; (iv) that Chen's asymptotic formula is better than the others mentioned here, and the new asymptotic formula is comparable with Chen's.


title: Nature of native atomic defects in ZrTe$_5$ and their impact on the low-energy electronic structure

abstract: Over the past decades, investigations of the anomalous low-energy electronic properties of ZrTe$_5$ have reached a wide array of conclusions. An open question is the growth method's impact on the stoichiometry of ZrTe$_5$ samples, especially given the very small density of states near its chemical potential. Here we report on high resolution scanning tunneling microscopy and spectroscopy measurements performed on samples grown via different methods. Using density functional theory calculations, we identify the most prevalent types of atomic defects on the surface of ZrTe$_5$, namely Te vacancies and intercalated Zr atoms. Finally, we precisely quantify their density and outline their role as ionized defects in the anomalous resistivity of this material.


title: An interesting track for the Brachistochrone

abstract: If a particle has to fall first vertically 1 m from A and then move horizontally 1 m to B, it takes a time $t(=\tau_1+\tau_2=\tau_3=3/\sqrt{2g})=0.67$ s. Under gravity and without friction, if it sides down on a linear track inclined at $45^0$ between two points A and B of 1 m height, it takes time $t(=\tau_4=2/\sqrt{g})=0.63$ s. Between these two extremes, historically, Bernoulli (1718) proved that the fastest track between these points A and B is cycloid with the least time of descent $t=\tau_B=0.58$ s. Apart from other interesting cases, here we study the frictionless motion of a particle/bead on an interesting track/wire between A and B given by $y(x)=(1-x^{\nu})^{1/\nu}.$ For $\nu > 1$ the track becomes convex and $t>>\tau_4$, and when $\nu >1.22$, the motion with zero initial speed is not possible. We find that when $\nu \in (0.09653, 0.31749), \tau_4<t <\tau_3$ and when $\nu \in ( 0.31749, 1),\tau_B < t < \tau_4$. But most remarkably, the concave curve becomes very steep/deep if $\nu \in (0, \nu_c=0.09653)$, then $t=0.2258$ s $< \tau_B$, this is as though a particle would travel 1 meter horizontally with a speed equal $\sqrt{2g}$ m/sec to take the time ($=1/\sqrt{2g}=\tau_2) < \tau_B$. The function $t(\nu$) suffers a jump discontinuity at $\nu=\nu_c$, we offer some resolution.


title: The curved exponential family of a staged tree

abstract: Staged tree models are a discrete generalization of Bayesian networks. We show that these form curved exponential families and derive their natural parameters, sufficient statistic, and cumulant-generating function as functions of their graphical representation. We give necessary and sufficient graphical criteria for classifying regular subfamilies and discuss implications for model selection.


title: Prediction of pseudogap formation due to $d$-wave bond-order in organic superconductor $\kappa$-(BEDT-TTF)$_2$X

abstract: Rich hidden unconventional orders with pseudogap formation, such as the inter-site bond-order (BO), attract increasing attention in condensed matter physics. Here, we investigate the hidden order formation in organic unconventional superconductor $\kappa$-(BEDT-TTF)$_2$X. We predict the formation of $d$-wave BO at wavelength $q=Q_B=(\delta,\delta)$ ($\delta=0.38\pi$) for the first time, based on both the functional renormalization group (fRG) and the density-wave equation theories. The origin of the BO is the quantum interference among antiferromagnetic spin fluctuations. This prediction leads to distinct pseudogap-like reduction in the NMR $1/T_1$ relaxation rate and in the density-of-states, consistently with essential experimental reports. The present theory would be applicable for other strongly correlated metals with pseudogap formation.


title: Pathwise Regularisation of Singular Interacting Particle Systems and their Mean Field Limits

abstract: We investigate the regularizing effect of certain perturbations by noise in singular interacting particle systems under the mean field scaling. In particular, we show that the addition of a suitably irregular path can regularise these dynamics and we recover the McKean--Vlasov limit under very broad assumptions on the interaction kernel; only requiring it to be controlled in a possibly distributional Besov space. In the particle system we include two sources of randomness, a common noise path $Z$ which regularises the dynamics and a family of idiosyncratic noises, which we only assume to converge in mean field scaling to a representative noise in the McKean--Vlasov equation.


title: Bosonic and fermionic Gaussian states from K\"ahler structures

abstract: We show that bosonic and fermionic Gaussian states (also known as "squeezed coherent states") can be uniquely characterized by their linear complex structure $J$ which is a linear map on the classical phase space. This extends conventional Gaussian methods based on covariance matrices and provides a unified framework to treat bosons and fermions simultaneously. Pure Gaussian states can be identified with the triple $(G,\Omega,J)$ of compatible K\"ahler structures, consisting of a positive definite metric $G$, a symplectic form $\Omega$ and a linear complex structure $J$ with $J^2=-1\!\!1$. Mixed Gaussian states can also be identified with such a triple, but with $J^2\neq -1\!\!1$. We apply these methods to show how computations involving Gaussian states can be reduced to algebraic operations of these objects, leading to many known and some unknown identities. We apply these methods to the study of (A) entanglement and complexity, (B) dynamics of stable systems, (C) dynamics of driven systems. From this, we compile a comprehensive list of mathematical structures and formulas to compare bosonic and fermionic Gaussian states side-by-side.


title: Spanning trees at the connectivity threshold

abstract: We present an explicit connected spanning structure that appears in a random graph just above the connectivity threshold with high probability.


title: A Primitive Variable Discrete Exterior Calculus Discretization of Incompressible Navier-Stokes Equations over Surface Simplicial Meshes

abstract: A conservative primitive variable discrete exterior calculus (DEC) discretization of the Navier-Stokes equations is performed. An existing DEC method (Mohamed, M. S., Hirani, A. N., Samtaney, R. (2016). Discrete exterior calculus discretization of incompressible Navier-Stokes equations over surface simplicial meshes. Journal of Computational Physics, 312, 175-191) is modified to this end, and is extended to include the energy-preserving time integration and the Coriolis force to enhance its applicability to investigate the late time behavior of flows on rotating surfaces, i.e., that of the planetary flows. The simulation experiments show second order accuracy of the scheme for the structured-triangular meshes, and first order accuracy for the otherwise unstructured meshes. The method exhibits second order kinetic energy relative error convergence rate with mesh size for inviscid flows. The test case of flow on a rotating sphere demonstrates that the method preserves the stationary state, and conserves the inviscid invariants over an extended period of time.


title: UNetGAN: A Robust Speech Enhancement Approach in Time Domain for Extremely Low Signal-to-noise Ratio Condition

abstract: Speech enhancement at extremely low signal-to-noise ratio (SNR) condition is a very challenging problem and rarely investigated in previous works. This paper proposes a robust speech enhancement approach (UNetGAN) based on U-Net and generative adversarial learning to deal with this problem. This approach consists of a generator network and a discriminator network, which operate directly in the time domain. The generator network adopts a U-Net like structure and employs dilated convolution in the bottleneck of it. We evaluate the performance of the UNetGAN at low SNR conditions (up to -20dB) on the public benchmark. The result demonstrates that it significantly improves the speech quality and substantially outperforms the representative deep learning models, including SEGAN, cGAN fo SE, Bidirectional LSTM using phase-sensitive spectrum approximation cost function (PSA-BLSTM) and Wave-U-Net regarding Short-Time Objective Intelligibility (STOI) and Perceptual evaluation of speech quality (PESQ).


title: On the maximum mean subtree order of trees

abstract: A subtree of a tree is any induced subgraph that is again a tree (i.e., connected). The mean subtree order of a tree is the average number of vertices of its subtrees. This invariant was first analyzed in the 1980s by Jamison. An intriguing open question raised by Jamison asks whether the maximum of the mean subtree order, given the order of the tree, is always attained by some caterpillar. While we do not completely resolve this conjecture, we find some evidence in its favor by proving different features of trees that attain the maximum. For example, we show that the diameter of a tree of order $n$ with maximum mean subtree order must be very close to $n$. Moreover, we show that the maximum mean subtree order is equal to $n - 2\log_2 n + O(1)$. For the local mean subtree order, which is the average order of all subtrees containing a fixed vertex, we can be even more precise: we show that its maximum is always attained by a broom and that it is equal to $n - \log_2 n + O(1)$.


title: Information-disturbance trade-off in generalized entanglement swapping

abstract: We study information-disturbance trade-off in generalized entanglement swapping protocols wherein starting from Bell pairs $\left(1,2\right)$ and $\left(3,4\right)$, one performs an arbitrary joint measurement on $\left(2,3\right)$, so that $\left(1,4\right)$ now becomes correlated. We obtain trade-off inequalities between information gain in correlations of $\left(1,4\right)$ and residual information in correlations of $\left(1,2\right)$ and $\left(3,4\right)$ respectively and argue that information contained in correlations (information) is conserved if each inequality is an equality. We show that information is conserved for a maximally entangled measurement but is not conserved for any other complete orthogonal measurement and Bell measurement mixed with white noise. However, rather surprisingly, we find that information is conserved for rank-two Bell diagonal measurements, although such measurements do not conserve entanglement. We also show that a separable measurement on $\left(2,3\right)$ can conserve information, even if, as in our example, the post-measurement states of all three pairs $\left(1,2\right)$, $\left(3,4\right)$, and $\left(1,4\right)$ become separable. This implies correlations from an entangled pair can be transferred to separable pairs in nontrivial ways so that no $information$ is lost in the process.


title: A brief overview of swarm intelligence-based algorithms for numerical association rule mining

abstract: Numerical Association Rule Mining is a popular variant of Association Rule Mining, where numerical attributes are handled without discretization. This means that the algorithms for dealing with this problem can operate directly, not only with categorical, but also with numerical attributes. Until recently, a big portion of these algorithms were based on a stochastic nature-inspired population-based paradigm. As a result, evolutionary and swarm intelligence-based algorithms showed big efficiency for dealing with the problem. In line with this, the main mission of this chapter is to make a historical overview of swarm intelligence-based algorithms for Numerical Association Rule Mining, as well as to present the main features of these algorithms for the observed problem. A taxonomy of the algorithms was proposed on the basis of the applied features found in this overview. Challenges, waiting in the future, finish this paper.


title: Self-Learning Threshold-Based Load Balancing

abstract: We consider a large-scale service system where incoming tasks have to be instantaneously dispatched to one out of many parallel server pools. The user-perceived performance degrades with the number of concurrent tasks and the dispatcher aims at maximizing the overall quality-of-service by balancing the load through a simple threshold policy. We demonstrate that such a policy is optimal on the fluid and diffusion scales, while only involving a small communication overhead, which is crucial for large-scale deployments. In order to set the threshold optimally, it is important, however, to learn the load of the system, which may be unknown. For that purpose, we design a control rule for tuning the threshold in an online manner. We derive conditions which guarantee that this adaptive threshold settles at the optimal value, along with estimates for the time until this happens. In addition, we provide numerical experiments which support the theoretical results and further indicate that our policy copes effectively with time-varying demand patterns.


title: An automatic multi-tissue human fetal brain segmentation benchmark using the Fetal Tissue Annotation Dataset

abstract: It is critical to quantitatively analyse the developing human fetal brain in order to fully understand neurodevelopment in both normal fetuses and those with congenital disorders. To facilitate this analysis, automatic multi-tissue fetal brain segmentation algorithms are needed, which in turn requires open databases of segmented fetal brains. Here we introduce a publicly available database of 50 manually segmented pathological and non-pathological fetal magnetic resonance brain volume reconstructions across a range of gestational ages (20 to 33 weeks) into 7 different tissue categories (external cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, deep grey matter, brainstem/spinal cord). In addition, we quantitatively evaluate the accuracy of several automatic multi-tissue segmentation algorithms of the developing human fetal brain. Four research groups participated, submitting a total of 10 algorithms, demonstrating the benefits the database for the development of automatic algorithms.


title: On the robustness of kernel-based pairwise learning

abstract: It is shown that many results on the statistical robustness of kernel-based pairwise learning can be derived under basically no assumptions on the input and output spaces. In particular neither moment conditions on the conditional distribution of Y given X = x nor the boundedness of the output space is needed. We obtain results on the existence and boundedness of the influence function and show qualitative robustness of the kernel-based estimator. The present paper generalizes results by Christmann and Zhou (2016) by allowing the prediction function to take two arguments and can thus be applied in a variety of situations such as ranking.


title: An End to End Network Architecture for Fundamental Matrix Estimation

abstract: In this paper, we present a novel end-to-end network architecture to estimate fundamental matrix directly from stereo images. To establish a complete working pipeline, different deep neural networks in charge of finding correspondences in images, performing outlier rejection and calculating fundamental matrix, are integrated into an end-to-end network architecture. To well train the network and preserve geometry properties of fundamental matrix, a new loss function is introduced. To evaluate the accuracy of estimated fundamental matrix more reasonably, we design a new evaluation metric which is highly consistent with visualization result. Experiments conducted on both outdoor and indoor data-sets show that this network outperforms traditional methods as well as previous deep learning based methods on various metrics and achieves significant performance improvements.


title: Discrete and continuous Muttalib--Borodin processes I: the hard edge

abstract: In this note we study a natural measure on plane partitions giving rise to a certain discrete-time Muttalib-Borodin process (MBP): each time-slice is a discrete version of a Muttalib-Borodin ensemble (MBE). The process is determinantal with explicit time-dependent correlation kernel. Moreover, in the $q \to 1$ limit, it converges to a continuous Jacobi-like MBP with Muttalib-Borodin marginals supported on the unit interval. This continuous process is also determinantal with explicit correlation kernel. We study its hard-edge scaling limit (around 0) to obtain a discrete-time-dependent generalization of the classical continuous Bessel kernel of random matrix theory (and, in fact, of the Meijer $G$-kernel as well). We lastly discuss two related applications: random sampling from such processes, and their interpretations as models of directed last passage percolation (LPP). In doing so, we introduce a corner growth model naturally associated to Jacobi processes, a version of which is the "usual" corner growth of Forrester-Rains in logarithmic coordinates. The aforementioned hard edge limits for our MBPs lead to interesting asymptotics for these LPP models. In particular, a special cases of our LPP asymptotics give rise (via the random matrix Bessel kernel and following Johansson's lead) to an extremal statistics distribution interpolating between the Tracy-Widom GUE and the Gumbel distributions.


title: Probabilistic interval predictor based on dissimilarity functions

abstract: This work presents a new methodology to obtain probabilistic interval predictions of a dynamical system. The proposed strategy uses stored past system measurements to estimate the future evolution of the system. The method relies on the use of dissimilarity functions to estimate the conditional probability density function of the outputs. A family of empirical probability density functions, parameterized by means of two scalars, is introduced. It is shown that the proposed family encompasses the multivariable normal probability density function as a particular case. We show that the presented approach constitutes a generalization of classical estimation methods. A validation scheme is used to tune the two parameters on which the methodology relies. In order to prove the effectiveness of the presented methodology, some numerical examples and comparisons are provided.


title: Coordinated Formation Control for Intelligent and Connected Vehicles in Multiple Traffic Scenarios

abstract: In this paper, a unified multi-vehicle formation control framework for Intelligent and Connected Vehicles (ICVs) that can apply to multiple traffic scenarios is proposed. In the one-dimensional scenario, different formation geometries are analyzed and the interlaced structure is mathematically modelized to improve driving safety while making full use of the lane capacity. The assignment problem for vehicles and target positions is solved using Hungarian Algorithm to improve the flexibility of the method in multiple scenarios. In the two-dimensional scenario, an improved virtual platoon method is proposed to transfer the complex two-dimensional passing problem to the one-dimensional formation control problem based on the idea of rotation projection. Besides, the vehicle regrouping method is proposed to connect the two scenarios. Simulation results prove that the proposed multi-vehicle formation control framework can apply to multiple typical scenarios and have better performance than existing methods.


title: A compactness theorem for frozen planets

abstract: We study the moduli space of frozen planet orbits in the Helium atom for an interpolation between instantaneous and mean interactions and show that this moduli space is compact.


title: How do Offline Measures for Exploration in Reinforcement Learning behave?

abstract: Sufficient exploration is paramount for the success of a reinforcement learning agent. Yet, exploration is rarely assessed in an algorithm-independent way. We compare the behavior of three data-based, offline exploration metrics described in the literature on intuitive simple distributions and highlight problems to be aware of when using them. We propose a fourth metric,uniform relative entropy, and implement it using either a k-nearest-neighbor or a nearest-neighbor-ratio estimator, highlighting that the implementation choices have a profound impact on these measures.


title: Poster: Benchmarking Financial Data Feed Systems

abstract: Data-driven solutions for the investment industry require event-based backend systems to process high-volume financial data feeds with low latency, high throughput, and guaranteed delivery modes. At vwd we process an average of 18 billion incoming event notifications from 500+ data sources for 30 million symbols per day and peak rates of 1+ million notifications per second using custom-built platforms that keep audit logs of every event. We currently assess modern open source event-processing platforms such as Kafka, NATS, Redis, Flink or Storm for the use in our ticker plant to reduce the maintenance effort for cross-cutting concerns and leverage hybrid deployment models. For comparability and repeatability we benchmark candidates with a standardized workload we derived from our real data feeds. We have enhanced an existing light-weight open source benchmarking tool in its processing, logging, and reporting capabilities to cope with our workloads. The resulting tool wrench can simulate workloads or replay snapshots in volume and dynamics like those we process in our ticker plant. We provide the tool as open source. As part of ongoing work we contribute details on (a) our workload and requirements for benchmarking candidate platforms for financial feed processing; (b) the current state of the tool wrench.


title: Unbabel's Participation in the WMT20 Metrics Shared Task

abstract: We present the contribution of the Unbabel team to the WMT 2020 Shared Task on Metrics. We intend to participate on the segment-level, document-level and system-level tracks on all language pairs, as well as the 'QE as a Metric' track. Accordingly, we illustrate results of our models in these tracks with reference to test sets from the previous year. Our submissions build upon the recently proposed COMET framework: We train several estimator models to regress on different human-generated quality scores and a novel ranking model trained on relative ranks obtained from Direct Assessments. We also propose a simple technique for converting segment-level predictions into a document-level score. Overall, our systems achieve strong results for all language pairs on previous test sets and in many cases set a new state-of-the-art.


title: Quantum signatures of chaos in a cavity-QED-based stimulated Raman adiabatic passage

abstract: A nonlinear stimulated Raman adiabatic passage (STIRAP) is a fascinating physical process that dynamically explores chaotic and non-chaotic phases. In a recent paper Phys. Rev. Res. 2, 042004 (R) (2020), such a phenomenon is realized in a cavity-QED platform. There, the emergence of chaos and its impact on STIRAP efficiency are mainly demonstrated in the semiclassical limit. In the present paper I treat the problem in a fully quantum many-body framework. With the aim of extracting quantum signatures of a classically chaotic system, it is shown that an out-of-time-ordered correlator (OTOC) measure precisely captures chaotic/non-chaotic features of the system. The prediction by OTOC is in precise matching with classical chaos quantified by Lyapunov exponent (LE). Furthermore, it is shown that the quantum route corresponding to the semiclassical followed state encounters a dip in single-particle purity within the chaotic phase, depicting a consequence of chaos. A dynamics through the chaotic phase is associated with spreading of many-body quantum state and an irreversible increase in the number of participating adiabatic eigenstates.


title: Competition between fractional quantum Hall liquid and Wigner solid at small fillings: Role of layer thickness and Landau level mixing

abstract: What is the fate of the ground state of a two-dimensional electron system (2DES) at very low Landau level filling factors ($\nu$) where interaction reigns supreme? An ordered array of electrons, the so-called Wigner crystal, has long been believed to be the answer. It was in fact the search for the elusive Wigner crystal that led to the discovery of an unexpected, incompressible liquid state, namely the fractional quantum Hall state at $\nu=1/3$. Understanding the competition between the liquid and solid ground states has since remained an active field of fundamental research. Here we report experimental data for a new two-dimensional system where the electrons are confined to an AlAs quantum well. The exceptionally high quality of the samples and the large electron effective mass allow us to determine the liquid-solid phase diagram for the two-dimensional electrons in a large range of filling factors near $\simeq 1/3$ and $\simeq 1/5$. The data and their comparison with an available theoretical phase diagram reveal the crucial role of Landau level mixing and finite electron layer thickness in determining the prevailing ground states.


title: Mat\'ern Gaussian Processes on Graphs

abstract: Gaussian processes are a versatile framework for learning unknown functions in a manner that permits one to utilize prior information about their properties. Although many different Gaussian process models are readily available when the input space is Euclidean, the choice is much more limited for Gaussian processes whose input space is an undirected graph. In this work, we leverage the stochastic partial differential equation characterization of Mat\'ern Gaussian processes - a widely-used model class in the Euclidean setting - to study their analog for undirected graphs. We show that the resulting Gaussian processes inherit various attractive properties of their Euclidean and Riemannian analogs and provide techniques that allow them to be trained using standard methods, such as inducing points. This enables graph Mat\'ern Gaussian processes to be employed in mini-batch and non-conjugate settings, thereby making them more accessible to practitioners and easier to deploy within larger learning frameworks.


title: Rates of convergence for Gibbs sampling in the analysis of almost exchangeable data

abstract: Motivated by de Finetti's representation theorem for almost exchangeable arrays, we want to sample $\mathbf p \in [0,1]^d$ from a distribution with density proportional to $\exp(-A^2\sum_{i<j}c_{ij}(p_i-p_j)^2)$, where $A$ is large and $c_{ij}$'s are non-negative weights. We analyze the rate of convergence of a coordinate Gibbs sampler used to simulate from these measures. We show that for every non-zero fixed matrix $C=(c_{ij})$, and large enough $A$, mixing happens in $\Theta(A^2)$ steps in a suitable Wasserstein distance. The upper and lower bounds are explicit and depend on the matrix $C$ through few relevant spectral parameters.


title: Relativistic rank-one separable kernel for helium-3 charge form factor

abstract: Elastic electron-helium-3 scattering is studied in the relativistic impulse approximation. The amplitudes for the three-nucleon system are obtained by solving the relativistic generalization of the Faddeev equations with a separable rank-one kernel of the nucleon-nucleon interaction. The contribution of partial-wave states with nonzero orbital moment of a nucleon pair is investigated. The static approximation and additional relativistic corrections for the 3He charge form factor are calculated for the momentum transfer squared up to 100 fm^-2. The contribution of the 3D1 partial-wave state and relativistic corrections are found to be sizable at high energies.


title: Micromagnetics of thin films in the presence of Dzyaloshinskii-Moriya interaction

abstract: In this paper, we study the thin-film limit of the micromagnetic energy functional in the presence of bulk Dzyaloshinskii-Moriya interaction (DMI). Our analysis includes both a stationary $\Gamma$-convergence result for the micromagnetic energy, as well as the identification of the asymptotic behavior of the associated Landau-Lifshitz-Gilbert equation. In particular, we prove that, in the limiting model, part of the DMI term behaves like the projection of the magnetic moment onto the normal to the film, contributing this way to an increase in the shape anisotropy arising from the magnetostatic self-energy. Finally, we discuss a convergent finite element approach for the approximation of the time-dependent case and use it to numerically compare the original three-dimensional model with the two-dimensional thin-film limit.


title: Large deviations and a phase transition in the Block Spin Potts models

abstract: We introduce and analyze a generalization of the blocks spin Ising (Curie-Weiss) models that were discussed in a number of recent articles. In these block spin models each spin in one of $s$ blocks can take one of a finite number of $q \ge 3$ values, hence the name block spin Potts model. The values a spin can take are called colors. We prove a large deviation principle for the percentage of spins of a certain color in a certain block. These values are represented in an $s \times q$ matrix. We show that for uniform block sizes and appropriately chosen interaction strength there is a phase transition. In some regime the only equilibrium is the uniform distribution of all colors in all blocks, while in other parameter regimes there is one predominant color, and this is the same color with the same frequency for all blocks. Finally, we establish log-Sobolev-type inequalities for the block spin Potts model.


title: The group structure of elliptic curves over Z/NZ

abstract: We characterize the possible groups $E(\mathbb{Z}/N\mathbb{Z})$ arising from elliptic curves over $\mathbb{Z}/N\mathbb{Z}$ in terms of the groups $E(\mathbb{F}_p)$, with $p$ varying among the prime divisors of $N$. This classification is achieved by showing that the infinity part of any elliptic curve over $\mathbb{Z}/p^e\mathbb{Z}$ is a $\mathbb{Z}/p^e\mathbb{Z}$-torsor, of which a generator is exhibited. As a first consequence, when $E(\mathbb{Z}/N\mathbb{Z})$ is a $p$-group, we provide an explicit and sharp bound on its rank. As a second consequence, when $N = p^e$ is a prime power and the projected curve $E(\mathbb{F}_p)$ has trace one, we provide an isomorphism attack to the ECDLP, which works only by means of finite rings arithmetic.


title: Algorithm for TDI numerical simulation and sensitivity investigation

abstract: We introduce a generic algorithm to determine the time delays and spacecraft (S/C) positions to compose any time-delay interferometry (TDI) channel in the dynamical case and evaluate its sensitivity by using a full numerical method. We select 11 second-generation TDI channels constructed from four approaches and investigate their gravitational wave responses, noise levels, and averaged sensitivities under a numerical LISA orbit. The sensitivities of selected channels are various especially for frequencies lower than 20 mHz. The optimal channel A$_2$ (or equivalently E$_2$) combined from second-generation Michelson TDI channels (X$_1$, X$_2$, and X$_3$) achieves the best sensitivity among the channels, while the Sagnac $\alpha_1$ channel shows the worse sensitivity. Multiple channels show better sensitivities at some characteristic frequencies compared to the fiducial X$_1$ channel. The joint $\mathrm{A_2+E_2+T_2}$ observation not only enhances the sensitivity of the X$_1$ channel by a factor of $\sqrt{2}$ to 2 but also improves the capacity of sky coverage.


title: Systematic literature review protocol Identification and classification of feature modeling errors

abstract: Context: The importance of feature modeling languages for software product lines and the planning stage for a systematic literature review. Objective: A protocol for carrying out a systematic literature review about the evidence for identifying and classifying the errors in feature modeling languages. Method: The definition of a protocol to conduct a systematic literature review according to the guidelines of B. Kitchenham. Results: A validated protocol to conduct a systematic literature review. Conclusions: A proposal for the protocol definition of a systematic literature review about the identification and classification of errors in feature modeling was built. Initial results show that the effects and results for solving these errors should be carried out.


title: Nuclear scattering configurations of onia in different frames

abstract: In the scattering of a small onium off a large nucleus at high center-of-mass energies, when the parameters are set in such a way that the cross section at fixed impact parameter is small, events are triggered by rare partonic fluctuations of the onium, which are very deformed with respect to typical configurations. Using the color dipole picture of high-energy interactions in quantum chromodynamics, in which the quantum states of the onium are represented by sets of dipoles generated by a branching process, we describe the typical scattering configurations as seen from different reference frames, from the restframe of the nucleus to frames in which the rapidity is shared between the projectile onium and the nucleus. We show that taking advantage of the freedom to select a frame in the latter class makes possible to derive complete asymptotic expressions for some boost-invariant quantities, beyond the total cross section, from a procedure which leverages the limited available knowledge on the properties of the solutions to the Balitsky-Kovchegov equation that governs the rapidity-dependence of total cross sections. We obtain in this way an analytic expression for the rapidity-distribution of the first branching of the slowest parent dipole of the set of those which scatter. This distribution provides an estimator of the correlations of the interacting dipoles, and is also known to be related to the rapidity-gap distribution in diffractive dissociation, an observable measurable at a future electron-ion collider. Furthermore, our result may be formulated as a more general conjecture, that we expect to hold true for any one-dimensional branching random walk model, on the branching time of the most recent common ancestor of all the particles that end up to the right of a given position.


title: Wavelength Controllable Forward Prediction and Inverse Design of Nanophotonic Devices Using Deep Learning

abstract: A deep learning-based wavelength controllable forward prediction and inverse design model of nanophotonic devices is proposed. Both the target time-domain and wavelength-domain information can be utilized simultaneously, which enables multiple functions, including power splitter and wavelength demultiplexer, to be implemented efficiently and flexibly.


title: Localized dynamics following a quantum quench in a non-integrable system: An example on the sawtooth ladder

abstract: Motivated by the recent discovery of ergodicity breaking in geometrically frustrated systems, we study the quench dynamics of interacting hardcore bosons on a sawtooth ladder. We identify a set of initial states for which this system exhibits characteristic signatures of localization like initial state memory retention and slow growth of entanglement entropy for a wide parameter regime. Remarkably, this localization persists even when the many-body spectrum is thermalizing. We argue that the localized dynamics originates from an interaction induced quantum interference. Our results show that the sawtooth ladder can be a fertile platform for realizing non-equilibrium quantum states of matter.


title: Multi-Constitutive Neural Network for Large Deformation Poromechanics Problem

abstract: In this paper, we study the problem of large-strain consolidation in poromechanics with deep neural networks (DNN). Given different material properties and different loading conditions, the goal is to predict pore pressure and settlement. We propose a novel method "multi-constitutive neural network" (MCNN) such that one model can solve several different constitutive laws. We introduce a one-hot encoding vector as an additional input vector, which is used to label the constitutive law we wish to solve. Then we build a DNN which takes $(\hat{X}, \hat{t})$ as input along with a constitutive law label and outputs the corresponding solution. It is the first time, to our knowledge, that we can evaluate multi-constitutive laws through only one training process while still obtaining good accuracies. We found that MCNN trained to solve multiple PDEs outperforms individual neural network solvers trained with PDE in some cases.


title: ADABOOK & MULTIBOOK: Adaptive Boosting with Chance Correction

abstract: There has been considerable interest in boosting and bagging, including the combination of the adaptive techniques of AdaBoost with the random selection with replacement techniques of Bagging. At the same time there has been a revisiting of the way we evaluate, with chance-corrected measures like Kappa, Informedness, Correlation or ROC AUC being advocated. This leads to the question of whether learning algorithms can do better by optimizing an appropriate chance corrected measure. Indeed, it is possible for a weak learner to optimize Accuracy to the detriment of the more reaslistic chance-corrected measures, and when this happens the booster can give up too early. This phenomenon is known to occur with conventional Accuracy-based AdaBoost, and the MultiBoost algorithm has been developed to overcome such problems using restart techniques based on bagging. This paper thus complements the theoretical work showing the necessity of using chance-corrected measures for evaluation, with empirical work showing how use of a chance-corrected measure can improve boosting. We show that the early surrender problem occurs in MultiBoost too, in multiclass situations, so that chance-corrected AdaBook and Multibook can beat standard Multiboost or AdaBoost, and we further identify which chance-corrected measures to use when.


title: Investigating the Robustness of Artificial Intelligent Algorithms with Mixture Experiments

abstract: Artificial intelligent (AI) algorithms, such as deep learning and XGboost, are used in numerous applications including computer vision, autonomous driving, and medical diagnostics. The robustness of these AI algorithms is of great interest as inaccurate prediction could result in safety concerns and limit the adoption of AI systems. In this paper, we propose a framework based on design of experiments to systematically investigate the robustness of AI classification algorithms. A robust classification algorithm is expected to have high accuracy and low variability under different application scenarios. The robustness can be affected by a wide range of factors such as the imbalance of class labels in the training dataset, the chosen prediction algorithm, the chosen dataset of the application, and a change of distribution in the training and test datasets. To investigate the robustness of AI classification algorithms, we conduct a comprehensive set of mixture experiments to collect prediction performance results. Then statistical analyses are conducted to understand how various factors affect the robustness of AI classification algorithms. We summarize our findings and provide suggestions to practitioners in AI applications.


title: Successive Halving Top-k Operator

abstract: We propose a differentiable successive halving method of relaxing the top-k operator, rendering gradient-based optimization possible. The need to perform softmax iteratively on the entire vector of scores is avoided by using a tournament-style selection. As a result, a much better approximation of top-k with lower computational cost is achieved compared to the previous approach.


title: MUMUG: a fast Monte Carlo generator for radiative muon pair production (a pedagogical tutorial)

abstract: A fast leading-order Monte Carlo generator for the process $e^+e^-\to\mu^+\mu^-\gamma$ is described. In fact, using the $e^+e^-\to\mu^+\mu^-\gamma $ process as an example, we provide a pedagogical demonstration of how a Monte Carlo generator can be created from scratch. The $e^+ e^- \to \mu^+ \mu^- \gamma$ process was chosen, since in this case we are not faced with either too trivial or too difficult a task. Matrix elements are calculated using the helicity amplitude method. Monte Carlo algorithm uses the acceptance-rejection method with an appropriately chosen simplified distribution that can be generated using an efficient algorithm. We provide a detailed pedagogical exposition of both the helicity amplitude method and the Monte Carlo technique, which we hope will be useful for high energy physics students.


title: Investigation of the PPT Squared Conjecture for High Dimensions

abstract: We present the positive-partial-transpose squared conjecture introduced by M. Christandl at Banff International Research Station Workshop: Operator Structures in Quantum Information Theory (Banff International Research Station, Alberta, 2012). We investigate the conjecture in higher dimensions and offer two novel approaches (decomposition and composition of quantum channels) and correspondingly, several schemes for finding counterexamples to this conjecture. One of the schemes involving the composition of PPT quantum channels in unsolved dimensions yields a potential counterexample.


title: Chiral edge currents in confined fibrosarcoma cells

abstract: During metastatic dissemination, streams of cells collectively migrate through a network of narrow channels within the extracellular matrix, before entering into the blood stream. This strategy is believed to outperform other migration modes, based on the observation that individual cancer cells can take advantage of confinement to switch to an adhesion-independent form of locomotion. Yet, the physical origin of this behaviour has remained elusive and the mechanisms behind the emergence of coherent flows in populations of invading cells under confinement are presently unknown. Here we demonstrate that human fibrosarcoma cells (HT1080) confined in narrow stripe-shaped regions undergo collective migration by virtue of a novel type of topological edge currents, resulting from the interplay between liquid crystalline (nematic) order, microscopic chirality and topological defects. Thanks to a combination of in vitro experiments and theory of active hydrodynamics, we show that, while heterogeneous and chaotic in the bulk of the channel, the spontaneous flow arising in confined populations of HT1080 cells is rectified along the edges, leading to long-ranged collective cell migration, with broken chiral symmetry. These edge currents are fuelled by layers of +1/2 topological defects, orthogonally anchored at the channel walls and acting as local sources of chiral active stress. Our work highlights the profound correlation between confinement and collective migration in multicellular systems and suggests a possible mechanism for the emergence of directed motion in metastatic cancer.


title: Modulation Pattern Detection Using Complex Convolutions in Deep Learning

abstract: Transceivers used for telecommunications transmit and receive specific modulation patterns that are represented as sequences of complex numbers. Classifying modulation patterns is challenging because noise and channel impairments affect the signals in complicated ways such that the received signal bears little resemblance to the transmitted signal. Although deep learning approaches have shown great promise over statistical methods in this problem space, deep learning frameworks continue to lag in support for complex-valued data. To address this gap, we study the implementation and use of complex convolutions in a series of convolutional neural network architectures. Replacement of data structure and convolution operations by their complex generalization in an architecture improves performance, with statistical significance, at recognizing modulation patterns in complex-valued signals with high SNR after being trained on low SNR signals. This suggests complex-valued convolutions enables networks to learn more meaningful representations. We investigate this hypothesis by comparing the features learned in each experiment by visualizing the inputs that results in one-hot modulation pattern classification for each network.


title: Biological effects of low power nonionizing radiation: A Narrative Review

abstract: Background and controlled electromagnetic radiation (EMR) on biological cells and tissues induces thermal, non-thermal, and dielectric property change. After EMR interaction with cells/tissues the resulting signal is used for imaging, bio-molecular response, and photo-biomodulation studies at infrared regime, and for therapeutic use. We attempt to present a review of current literature with a focus to present compilation of published experimental results for each regime viz. microwave (extremely low frequency, ELF to 3 GHz), to cellular communication frequencies (100 KHz to 300 GHz), millimeter wave (300 GHz- 1 THz), and the infra-red band extending up to 461 THz. A unique graphical representation of frequency effects and their relevant significance in detection of direct biological effects, therapeutic applications and biophysical interpretation is presented. A total of seventy research papers from peer-reviewed journals were used to compile a mixture of useful information, all presented in a narrative style. Out of the Journal articles used for this paper, 63 journal articles were published between 2000 to 2020. Physical, biological, and therapeutic mechanisms of thermal, non-thermal and complex dielectric effects of EMR on cells are all explained in relevant sections of this paper. A broad up to date review for the EMR range KHz-NIR (kilohertz to near infra-red) is prepared. Published reports indicate that number of biological cell irradiation impact studies fall off rapidly beyond a few THz EMR, leading to relatively a smaller number of studies in FIR and NIR bands covering most of the thermal effects and microthermal effects, and rotation-vibration effects.


title: The ground state of polaron in an ultracold dipolar Fermi gas

abstract: An impurity atom immersed in an ultracold atomic Fermi gas can form a quasiparticle, so-called Fermi polaron, due to impurity-fermion interaction. We consider a three-dimensional homogeneous dipolar Fermi gas as a medium, where the interatomic dipole-dipole interaction (DDI) makes the Fermi surface deformed into a spheroidal shape, and, using a Chevy-type variational method, investigate the ground-state properties of the Fermi polaron: the effective mass, the momentum distribution of a particle-hole (p-h) excitation, the drag parameter, and the medium density modification around the impurity. These quantities are shown to exhibit spatial anisotropies in such a way as to reflect the momentum anisotropy of the background dipolar Fermi gas. We have also given numerical results for the polaron properties at the unitarity limit of the impurity-fermion interaction in the case in which the impurity and fermion masses are equal. It has been found that the transverse effective mass and the transverse momentum drag parameter of the polaron both tend to decrease by $ \sim 10\%$ when the DDI strength is raised from $0$ up to around its critical value, while the longitudinal ones exhibit a very weak dependence on the DDI.


title: Quantum Computing: A Taxonomy, Systematic Review and Future Directions

abstract: Quantum computing is an emerging paradigm with the potential to offer significant computational advantage over conventional classical computing by exploiting quantum-mechanical principles such as entanglement and superposition. It is anticipated that this computational advantage of quantum computing will help to solve many complex and computationally intractable problems in several areas such as drug design, data science, clean energy, finance, industrial chemical development, secure communications, and quantum chemistry. In recent years, tremendous progress in both quantum hardware development and quantum software/algorithm have brought quantum computing much closer to reality. Indeed, the demonstration of quantum supremacy marks a significant milestone in the Noisy Intermediate Scale Quantum (NISQ) era - the next logical step being the quantum advantage whereby quantum computers solve a real-world problem much more efficiently than classical computing. As the quantum devices are expected to steadily scale up in the next few years, quantum decoherence and qubit interconnectivity are two of the major challenges to achieve quantum advantage in the NISQ era. Quantum computing is a highly topical and fast-moving field of research with significant ongoing progress in all facets. This article presents a comprehensive review of quantum computing literature, and taxonomy of quantum computing. Further, the proposed taxonomy is used to map various related studies to identify the research gaps. A detailed overview of quantum software tools and technologies, post-quantum cryptography and quantum computer hardware development to document the current state-of-the-art in the respective areas. We finish the article by highlighting various open challenges and promising future directions for research.


title: Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm

abstract: Recently, many methods based on hand-designed convolutional neural networks (CNNs) have achieved promising results in automatic retinal vessel segmentation. However, these CNNs remain constrained in capturing retinal vessels in complex fundus images. To improve their segmentation performance, these CNNs tend to have many parameters, which may lead to overfitting and high computational complexity. Moreover, the manual design of competitive CNNs is time-consuming and requires extensive empirical knowledge. Herein, a novel automated design method, called Genetic U-Net, is proposed to generate a U-shaped CNN that can achieve better retinal vessel segmentation but with fewer architecture-based parameters, thereby addressing the above issues. First, we devised a condensed but flexible search space based on a U-shaped encoder-decoder. Then, we used an improved genetic algorithm to identify better-performing architectures in the search space and investigated the possibility of finding a superior network architecture with fewer parameters. The experimental results show that the architecture obtained using the proposed method offered a superior performance with less than 1% of the number of the original U-Net parameters in particular and with significantly fewer parameters than other state-of-the-art models. Furthermore, through in-depth investigation of the experimental results, several effective operations and patterns of networks to generate superior retinal vessel segmentations were identified.


title: Federated Transfer Learning: concept and applications

abstract: Development of Artificial Intelligence (AI) is inherently tied to the development of data. However, in most industries data exists in form of isolated islands, with limited scope of sharing between different organizations. This is an hindrance to the further development of AI. Federated learning has emerged as a possible solution to this problem in the last few years without compromising user privacy. Among different variants of the federated learning, noteworthy is federated transfer learning (FTL) that allows knowledge to be transferred across domains that do not have many overlapping features and users. In this work we provide a comprehensive survey of the existing works on this topic. In more details, we study the background of FTL and its different existing applications. We further analyze FTL from privacy and machine learning perspective.


title: Limitations of the recall capabilities in delay based reservoir computing systems

abstract: We analyze the memory capacity of a delay based reservoir computer with a Hopf normal form as nonlinearity and numerically compute the linear as well as the higher order recall capabilities. A possible physical realisation could be a laser with external cavity, for which the information is fed via electrical injection. A task independent quantification of the computational capability of the reservoir system is done via a complete orthonormal set of basis functions. Our results suggest that even for constant readout dimension the total memory capacity is dependent on the ratio between the information input period, also called the clock cycle, and the time delay in the system. Optimal performance is found for a time delay about 1.6 times the clock cycle

categories: cs.ET cs.LG nlin.AO nlin.CD physics.optics


title: Quantitative experimental observation of weak inertial-wave turbulence

abstract: We report the quantitative experimental observation of the weak inertial-wave turbulence regime of rotating turbulence. We produce a statistically steady homogeneous turbulent flow that consists of nonlinearly interacting inertial waves, using rough top and bottom boundaries to prevent the emergence of a geostrophic flow. As the forcing amplitude increases, the temporal spectrum evolves from a discrete set of peaks to a continuous spectrum. Maps of the bicoherence of the velocity field confirm such a gradual transition between discrete wave interactions at weak forcing amplitude, and the regime described by weak turbulence theory (WTT) for stronger forcing. In the former regime, the bicoherence maps display a near-zero background level, together with sharp localized peaks associated with discrete resonances. By contrast, in the latter regime the bicoherence is a smooth function that takes values of the order of the Rossby number, in line with the infinite-domain and random-phase assumptions of WTT. The spatial spectra then display a power-law behavior, both the spectral exponent and the spectral level being accurately predicted by WTT at high Reynolds number and low Rossby number.


title: Informativity of noisy data for structural properties of linear systems

abstract: This paper deals with developing tests for checking whether an unknown system has certain structural properties. The tests that we are aiming at are in terms of noisy input-state-output data obtained from the unknown system. Since, in general, the data do not determine the unknown system uniquely, many systems are compatible with the same set of data. Therefore we can not apply system identification and apply existing, model based, tests. Instead, we will use the concept of informativity, and establish tests for informativity of the given noisy data. We will do this for a range of system properties, among which strong observability and detectability and strong controllability and stabilizability. These informativity tests will be in terms of rank tests on polynomial matrices that can be constructed from the noisy data. We will also set up a geometric framework for informativity analysis. Within that framework we will give geometric tests for informativity for strong observability, observability, and left-invertibilty.


title: Mode Conversion and Period Doubling at Plasma-$\beta$ Unity in an Alfv\'en-Wave Experiment with Liquid Rubidium

abstract: We report Alfv\'en-wave experiments with liquid rubidium at the Dresden High Magnetic Field Laboratory (HLD). Reaching up to 63 T, the pulsed magnetic field exceeds the critical value of 54 T at which the Alfv\'en speed becomes equal to the sound speed (plasma-$\beta$ unity). At this threshold we observe a period doubling of an applied 8 kHz CW excitation, a clear footprint for a parametric resonance between magnetosonic waves and Alfv\'en waves.

categories: physics.plasm-ph astro-ph.SR physics.flu-dyn physics.space-ph


title: Luminous Type II Short-Plateau Supernovae 2006Y, 2006ai, and 2016egz: A Transitional Class from Stripped Massive Red Supergiants

abstract: The diversity of Type II supernovae (SNe II) is thought to be driven mainly by differences in their progenitor's hydrogen-rich (H-rich) envelope mass, with SNe IIP having long plateaus ($\sim100$ days) and the most massive H-rich envelopes. However, it is an ongoing mystery why SNe II with short plateaus (tens of days) are rarely seen. Here, we present optical/near-infrared photometric and spectroscopic observations of luminous Type II short-plateau SNe 2006Y, 2006ai, and 2016egz. Their plateaus of about $50$-$70$ days and luminous optical peaks ($\lesssim-18.4$ mag) indicate significant pre-explosion mass loss resulting in partially stripped H-rich envelopes and early circumstellar material (CSM) interaction. We compute a large grid of MESA+STELLA single-star progenitor and light-curve models with various progenitor zero-age main-sequence (ZAMS) masses, mass-loss efficiencies, explosion energies, $^{56}$Ni masses, and CSM densities. Our model grid shows a continuous population of SNe IIP-IIL-IIb-like light-curve morphology in descending order of H-rich envelope mass. With large $^{56}$Ni masses ($\gtrsim0.05\,M_\odot$), short-plateau SNe II lie in a confined parameter space as a transitional class between SNe IIL and IIb. For SNe 2006Y, 2006ai, and 2016egz, our findings suggest high-mass red supergiant (RSG) progenitors ($M_{\rm ZAMS} \simeq 18$-$22\,M_{\odot}$) with small H-rich envelope masses ($M_{\rm H_{\rm env}} \simeq 1.7\,M_{\odot}$) that have experienced enhanced mass loss ($\dot{M} \simeq 10^{-2}\,M_{\odot}\,{\rm yr}^{-1}$) for the last few decades before the explosion. If high-mass RSGs result in rare short-plateau SNe II, then these events might ease some of the apparent underrepresentation of higher-luminosity RSGs in observed SN II progenitor samples.


title: On explicit realization of algebra of complex powers of generators of $U_{q}(\mathfrak{sl}(3))$

abstract: In this note we prove an integral identity involving complex powers of generators of quantum group $U_{q}(\mathfrak{sl}(3))$ considered as certain positive operators in the setting of positive principal series representations. This identity represents a continuous analog of one of the Lusztig's relations between divided powers of generators of quantum groups, which play an important role in the study of irreducible modules \cite{Lu 1}. We also give definitions of arbitrary functions of $U_{q}(\mathfrak{sl}(3))$ generators and give another proofs for some of the known results concerning positive principal series representations of $U_{q}(\mathfrak{sl}(3))$.


title: On Duality for Lyapunov Functions of Nonstrict Convex Processes

abstract: This paper provides a novel definition for Lyapunov functions for difference inclusions defined by convex processes. It is shown that this definition reflects stability properties of nonstrict convex processes better than previously used definitions. In addition the paper presents conditions under which a weak Lyapunov function for a convex process yields a strong Lyapunov function for the dual of the convex process.


title: Energy-balance for the incompressible Euler equations with stochastic forcing

abstract: We establish energy-balance for weak solutions of the stochastically forced incompressible Euler equations, enjoying H\"older regularity $C^{\alpha}$, $\alpha>1/3$. It is well known as the Onsager's conjecture for the deterministic incompressible Euler equations, which describes the energy conservation of weak solutions having H\"older regularity $C^{\alpha}$, $\alpha>1/3$. Additionally, we obtain energy-balance for the inhomogeneous incompressible Euler system driven by a cylindrical Wiener process.


title: Mirror symmetry for Berglund-H\"ubsch Milnor fibers

abstract: We explain how to calculate the Fukaya category of the Milnor fiber of a Berglund-H\"ubsch invertible polynomial, mostly proving a conjecture of Yank{\i} Lekili and Kazushi Ueda on homological mirror symmetry. As usual, we begin by calculating the "very affine" Fukaya category; afterwards, we deform it, generalizing an earlier calculation of David Nadler. The main step of our calculation may be understood as determining a certain canonical extension of a perverse schober.


title: Learning Sub-Patterns in Piecewise Continuous Functions

abstract: Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits the neural network model's uniform approximation capacity to continuous functions. This paper focuses on the case where the discontinuities arise from distinct sub-patterns, each defined on different parts of the input space. We propose a new discontinuous deep neural network model trainable via a decoupled two-step procedure that avoids passing gradient updates through the network's only and strategically placed, discontinuous unit. We provide approximation guarantees for our architecture in the space of bounded continuous functions and universal approximation guarantees in the space of piecewise continuous functions which we introduced herein. We present a novel semi-supervised two-step training procedure for our discontinuous deep learning model, tailored to its structure, and we provide theoretical support for its effectiveness. The performance of our model and trained with the propose procedure is evaluated experimentally on both real-world financial datasets and synthetic datasets.


title: Experimental Analysis of Communication Relaying Delay in Low-Energy Ad-hoc Networks

abstract: In recent years, more and more applications use ad-hoc networks for local M2M communications, but in some cases such as when using WSNs, the software processing delay induced by packets relaying may not be negligible. In this paper, we planned and carried out a delay measurement experiment using Raspberry Pi Zero W. The results demonstrated that, in low-energy ad-hoc networks, processing delay of the application is always too large to ignore; it is at least ten times greater than the kernel routing and corresponds to 30% of the transmission delay. Furthermore, if the task is CPU-intensive, such as packet encryption, the processing delay can be greater than the transmission delay and its behavior is represented by a simple linear model. Our findings indicate that the key factor for achieving QoS in ad-hoc networks is an appropriate node-to-node load balancing that takes into account the CPU performance and the amount of traffic passing through each node.


title: Quantum-like modeling in biology with open quantum systems and instruments

abstract: We present the novel approach to mathematical modeling of information processes in biosystems. It explores the mathematical formalism and methodology of quantum theory, especially quantum measurement theory. This approach is known as {\it quantum-like} and it should be distinguished from study of genuine quantum physical processes in biosystems (quantum biophysics, quantum cognition). It is based on quantum information representation of biosystem's state and modeling its dynamics in the framework of theory of open quantum systems. This paper starts with the non-physicist friendly presentation of quantum measurement theory, from the original von Neumann formulation to modern theory of quantum instruments. Then, latter is applied to model combinations of cognitive effects and gene regulation of glucose/lactose metabolism in Escherichia coli bacterium. The most general construction of quantum instruments is based on the scheme of indirect measurement, in that measurement apparatus plays the role of the environment for a biosystem. The biological essence of this scheme is illustrated by quantum formalization of Helmholtz sensation-perception theory. Then we move to open systems dynamics and consider quantum master equation, with concentrating on quantum Markov processes. In this framework, we model functioning of biological functions such as psychological functions and epigenetic mutation.


title: Gravitational waves from mountains in newly born millisecond magnetars

abstract: In this paper we study the spin-evolution and gravitational-wave luminosity of a newly born millisecond magnetar, formed either after the collapse of a massive star or after the merger of two neutron stars. In both cases we consider the effect of fallback accretion, and consider the evolution of the system due to the different torques acting on the star, namely the spin up torque due to accretion and spin-down torques due to magnetic dipole radiation, neutrino emission, and gravitational wave emission linked to the formation of a `mountain' on the accretion poles. Initially the spin period is mostly affected by the dipole radiation, but at later times accretion spin the star up rapidly. We find that a magnetar formed after the collapse of a massive star can accrete up to 1 M_{\odot} , and survive on the order of 50 s before collapsing to a black hole. The gravitational wave strain, for an object located at 1 Mpc, is h_c \sim 10^{-23} at kHz frequencies, making this a potential target for next generation ground based detectors. A magnetar formed after a binary neutron star merger, on the other hand, accretes at the most 0.2 M_{\odot}, and emits gravitational waves with a lower maximum strain of the order of h_c \sim 10^{-24} , but also survives for much longer times, and may possibly be associated with the X-ray plateau observed in the light curve of a number of short gamma-ray burst.


title: Towards Lefschetz thimbles in Sigma models, I

abstract: We study two dimensional path integral Lefschetz thimbles, i.e. the possible path integration contours. Specifically, in the examples of the $O(N)$ and ${\bf CP}^{N-1}$ models, we find a large class of complex critical points of the sigma model actions which are relevant for the theory in finite volume at finite temperature, with various chemical potentials corresponding to the symmetries of the models. In this paper we discuss the case of the $O(2m)$ and the ${\bf CP}^{N-1}$ models in the sector of zero instanton charge, as well as some solutions of the $O(2m+1)$ model. The ${\bf CP}^{N-1}$-model for all instanton charges and a more general class of solutions of the $O(N)$-model with odd $N$ will be discussed in the forthcoming paper.


title: Methodological investigation into the noise influence on nanolasers' large signal modulation

abstract: Nanolasers are considered ideal candidates for communications and data processing at chip-level thanks to their extremely reduced footprint, low thermal load and potentially outstanding modulation bandwidth, which in some case has been numerically estimated to exceed hundreds of GHz. The few experimental implementations reported to date, however, have so-far fallen very short of such predictions, whether because of technical difficulties or of overoptimistic numerical results. We propose a methodology to study the physical characteristics which determine the system's robustness and apply it to a general model, using numerical simulations of large-signal modulation. Changing the DC pump values and modulation frequencies, we further investigate the influence of intrinsic noise, considering, in addition, the role of cavity losses. Our results confirm that significant modulation bandwidths can be achieved, at the expense of large pump values, while the often targeted low bias operation is strongly noise- and bandwidth-limited. This fundamental investigation suggests that technological efforts should be oriented towards enabling large pump rates in nanolasers, whose performance promises to surpass microdevices in the same range of photon flux and input energy.


title: Import test questions into Moodle LMS

abstract: The purpose of the study is to highlight the theoretical and methodological aspects of preparing the test questions of the most common types in the form of text files for further import into learning management system (LMS) Moodle. The subject of the research is the automated filling of the Moodle LMS test database. The objectives of the study: to analyze the import files of test questions, their advantages and disadvantages; to develop guidelines for the preparation of test questions of common types in the form of text files for further import into Moodle LMS. The action algorithms for importing questions and instructions for submitting question files in such formats as Aiken, GIFT, Moodle XML, "True/False" questions, "Multiple Choice" (one of many and many of many), "Matching", with an open answer - "Numerical" or "Short answer" and "Essay" are offered in this article. The formats for submitting questions, examples of its designing and developed questions were demonstrated in view mode in Moodle LMS.


title: Exploring the Nuances of Designing (with/for) Artificial Intelligence

abstract: Solutions relying on artificial intelligence are devised to predict data patterns and answer questions that are clearly defined, involve an enumerable set of solutions, clear rules, and inherently binary decision mechanisms. Yet, as they become exponentially implemented in our daily activities, they begin to transcend these initial boundaries and to affect the larger sociotechnical system in which they are situated. In this arrangement, a solution is under pressure to surpass true or false criteria and move to an ethical evaluation of right and wrong. Neither algorithmic solutions, nor purely humanistic ones will be enough to fully mitigate undesirable outcomes in the narrow state of AI or its future incarnations. We must take a holistic view. In this paper we explore the construct of infrastructure as a means to simultaneously address algorithmic and societal issues when designing AI.


title: A semi-supervised autoencoder framework for joint generation and classification of breathing

abstract: One of the main problems with biomedical signals is the limited amount of patient-specific data and the significant amount of time needed to record the sufficient number of samples needed for diagnostic and treatment purposes. In this study, we present a framework to simultaneously generate and classify biomedical time series based on a modified Adversarial Autoencoder (AAE) algorithm and one-dimensional convolutions. Our work is based on breathing time series, with specific motivation to capture breathing motion during radiotherapy lung cancer treatments. First, we explore the potential in using the Variational Autoencoder (VAE) and AAE algorithms to model breathing from individual patients. We extend the AAE algorithm to allow joint semi-supervised classification and generation of different types of signals. To simplify the modeling task, we introduce a pre-processing and post-processing compressing algorithm that transforms the multi-dimensional time series into vectors containing time and position values, which are transformed back into time series through an additional neural network. By incorporating few labeled samples during training, our model outperforms other purely discriminative networks in classifying breathing baseline shift irregularities from a dataset completely different from the training set. To our knowledge, the presented framework is the first approach that unifies generation and classification within a single model for this type of biomedical data, enabling both computer aided diagnosis and augmentation of labeled samples within a single framework.


title: Every integer can be written as a square plus a squarefree

abstract: In the paper we can prove that every integer can be written as the sum of two integers, one perfect square and one squarefree. We also establish the asympotic formula for the number of representations of an integer in this form. The result is deeply related with the divisor function. In the course of our study we get an independent result about it. Concretely we are able to deduce a new upper bound for the divisor function valid for any integer and fully explicit.


title: The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Research

abstract: Increasingly, modern Artificial Intelligence (AI) research has become more computationally intensive. However, a growing concern is that due to unequal access to computing power, only certain firms and elite universities have advantages in modern AI research. Using a novel dataset of 171394 papers from 57 prestigious computer science conferences, we document that firms, in particular, large technology firms and elite universities have increased participation in major AI conferences since deep learning's unanticipated rise in 2012. The effect is concentrated among elite universities, which are ranked 1-50 in the QS World University Rankings. Further, we find two strategies through which firms increased their presence in AI research: first, they have increased firm-only publications; and second, firms are collaborating primarily with elite universities. Consequently, this increased presence of firms and elite universities in AI research has crowded out mid-tier (QS ranked 201-300) and lower-tier (QS ranked 301-500) universities. To provide causal evidence that deep learning's unanticipated rise resulted in this divergence, we leverage the generalized synthetic control method, a data-driven counterfactual estimator. Using machine learning based text analysis methods, we provide additional evidence that the divergence between these two groups - large firms and non-elite universities - is driven by access to computing power or compute, which we term as the "compute divide". This compute divide between large firms and non-elite universities increases concerns around bias and fairness within AI technology, and presents an obstacle towards "democratizing" AI. These results suggest that a lack of access to specialized equipment such as compute can de-democratize knowledge production.


title: Improving Accuracy of Federated Learning in Non-IID Settings

abstract: Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy is desired. However, it has been observed that the performance of FL is closely tied with the local data distributions of agents. Particularly, in settings where local data distributions vastly differ among agents, FL performs rather poorly with respect to the centralized training. To address this problem, we hypothesize the reasons behind the performance degradation, and develop some techniques to address these reasons accordingly. In this work, we identify four simple techniques that can improve the performance of trained models without incurring any additional communication overhead to FL, but rather, some light computation overhead either on the client, or the server-side. In our experimental analysis, combination of our techniques improved the validation accuracy of a model trained via FL by more than 12% with respect to our baseline. This is about 5% less than the accuracy of the model trained on centralized data.


title: Probabilistic Transformers

abstract: We show that Transformers are Maximum Posterior Probability estimators for Mixtures of Gaussian Models. This brings a probabilistic point of view to Transformers and suggests extensions to other probabilistic cases.