title: Does it matter who pays back Technical Debt? An empirical study of self-fixed TD

abstract: Context: Technical Debt (TD) can be paid back either by those that incurred it or by others. We call the former self-fixed TD, and it can be particularly effective, as developers are experts in their own code and are well-suited to fix the corresponding TD issues. Objective: The goal of our study is to investigate self-fixed technical debt, especially the extent in which TD is self-fixed, which types of TD are more likely to be self-fixed, whether the remediation time of self-fixed TD is shorter than non-self-fixed TD and how development behaviors are related to self-fixed TD. Method: We report on an empirical study that analyzes the self-fixed issues of five types of TD (i.e., Code, Defect, Design, Documentation and Test), captured via static analysis, in more than 44,000 commits obtained from 20 Python and 16 Java projects of the Apache Software Foundation. Results: The results show that about half of the fixed issues are self-fixed and that the likelihood of contained TD issues being self-fixed is negatively correlated with project size, the number of developers and total issues. Moreover, there is no significant difference of the survival time between self-fixed and non-self-fixed issues. Furthermore, developers are more keen to pay back their own TD when it is related to lower code level issues, e.g., Defect Debt and Code Debt. Finally, developers who are more dedicated to or knowledgeable about the project contribute to a higher chance of self-fixing TD. Conclusions: These results can benefit both researchers and practitioners by aiding the prioritization of TD remediation activities and refining strategies within development teams, and by informing the development of TD management tools.


title: One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latency

abstract: Spiking Neural Networks (SNNs) are energy efficient alternatives to commonly used deep neural networks (DNNs). Through event-driven information processing, SNNs can reduce the expensive compute requirements of DNNs considerably, while achieving comparable performance. However, high inference latency is a significant hindrance to the edge deployment of deep SNNs. Computation over multiple timesteps not only increases latency as well as overall energy budget due to higher number of operations, but also incurs memory access overhead of fetching membrane potentials, both of which lessen the energy benefits of SNNs. To overcome this bottleneck and leverage the full potential of SNNs, we propose an Iterative Initialization and Retraining method for SNNs (IIR-SNN) to perform single shot inference in the temporal axis. The method starts with an SNN trained with T timesteps (T>1). Then at each stage of latency reduction, the network trained at previous stage with higher timestep is utilized as initialization for subsequent training with lower timestep. This acts as a compression method, as the network is gradually shrunk in the temporal domain. In this paper, we use direct input encoding and choose T=5, since as per literature, it is the minimum required latency to achieve satisfactory performance on ImageNet. The proposed scheme allows us to obtain SNNs with up to unit latency, requiring a single forward pass during inference. We achieve top-1 accuracy of 93.05%, 70.15% and 67.71% on CIFAR-10, CIFAR-100 and ImageNet, respectively using VGG16, with just 1 timestep. In addition, IIR-SNNs perform inference with 5-2500X reduced latency compared to other state-of-the-art SNNs, maintaining comparable or even better accuracy. Furthermore, in comparison with standard DNNs, the proposed IIR-SNNs provide25-33X higher energy efficiency, while being comparable to them in classification performance.


title: Qualitative analysis of optimisation problems with respect to non-constant Robin coefficients

abstract: Following recent interest in the qualitative analysis of some optimal control and shape optimisation problems, we provide in this article a detailed study of the optimisation of Robin boundary conditions in PDE constrained calculus of variations. Our main model consists of an elliptic PDE of the form $-\Delta u_\beta=f(x,u_\beta)$ endowed with the Robin boundary conditions $\partial_\nu u_\beta+\beta(x)u_\beta=0$. The optimisation variable is the function $\beta$, which is assumed to take values between 0 and 1 and to have a fixed integral. Two types of criteria are under consideration: the first one is non-energetic criteria. In other words, we aim at optimising functionals of the form $\mathcal J(\beta)=\int_{\Omega\text{ or }\partial \Omega}j(u_\beta)$. We prove that, depending on the monotonicity of the function $j$, the optimisers may be of \emph{bang-bang} type (in other words, the optimisers write $1_\Gamma$ for some measurable subset $\Gamma$ of $\partial \ Omega $) or, on the contrary, that they may only take values strictly between 0 and 1. This has consequence for a related shape optimisation problem, in which one tries to find where on the boundary Neumann ($\partial_\nu u=0$ ) and constant Robin conditions ($\partial_\nu u+u=0$) should be placed in order to optimise criteria. The proofs for this first case rely on new fine oscillatory techniques, used in combination with optimality conditions. We then investigate the case of compliance-type functionals. For such energetic functionals, we give an in-depth analysis and even some explicit characterisation of optimal $\beta^*$.


title: Atomic configuration in cuprates at the closing of the pseudogap

abstract: Doped holes in cuprates reside pairwise at lattice-defect O atoms but at different sites in the two cuprate families. In the Sr-doped lanthanum cuprates, the O atoms occupy anion lattice sites and spread due to Coulomb repulsion (relative to the host lattice). In the oxygenated cuprates, the O atoms occupy interstitial sites, hybridize to ozone complexes, and aggregate to strings or (at high oxygenation) to nematic patches, always with spacing of ~ 3.25a_0. At the closing of the pseudogap at hole doping p*, a highly symmetric configuration of the O atoms appears in each family. In the first family it consists of interlaced superlattices in the CuO_2 plane and each of the bracketing LaO layers, with spacing A_0^{LaO}(p*) = 2A_0^{CuO_2}(p*). In the second family it consists in the completion of a 2D superlattice of ozone complexes, with spacing A_0(p*) ~ 3.25a_0. Both cases are visualized. Implications for the bandstructure and strange-metal phase are considered.


title: Why and whence the Hilbert space in quantum theory?

abstract: We explain why and how the Hilbert space comes about in quantum theory. The axiomatic structures of vector space, of scalar product, of orthogonality, and of the linear functional are derivable from the statistical description of quantum micro-events and from Hilbertian sum of squares $|\mathfrak{a}_1|^2+|\mathfrak{a}_2|^2+\cdots$. The latter leads (non-axiomatically) to the standard writing of the Born formula $\mathtt{f} = |\langle\psi|\varphi\rangle|^2$. As a corollary, the status of Pythagorean theorem, the concept of a length, and the 6-th Hilbert problem undergo a quantum `revision'. An issue of deriving the norm topology may no have a short-length solution (too many abstract math-axioms) but is likely solvable in the affirmative; the problem is reformulated as a mathematical one.


title: A Deployment Model to Extend Ethically Aligned AI Implementation Method ECCOLA

abstract: There is a struggle in Artificial intelligence (AI) ethics to gain ground in actionable methods and models to be utilized by practitioners while developing and implementing ethically sound AI systems. AI ethics is a vague concept without a consensus of definition or theoretical grounding and bearing little connection to practice. Practice involving primarily technical tasks like software development is not aptly equipped to process and decide upon ethical considerations. Efforts to create tools and guidelines to help people working with AI development have been concentrating almost solely on the technical aspects of AI. A few exceptions do apply, such as the ECCOLA method for creating ethically aligned AI -systems. ECCOLA has proven results in terms of increased ethical considerations in AI systems development. Yet, it is a novel innovation, and room for development still exists. This study aims to extend ECCOLA with a deployment model to drive the adoption of ECCOLA, as any method, no matter how good, is of no value without adoption and use. The model includes simple metrics to facilitate the communication of ethical gaps or outcomes of ethical AI development. It offers the opportunity to assess any AI system at any given lifecycle phase, e.g., opening possibilities like analyzing the ethicality of an AI system under acquisition.


title: DNA Mutations via Chern-Simons Currents

abstract: We test the validity of a possible schematization of DNA structure and dynamics based on the Chern-Simons theory, that is a topological field theory mostly considered in the context of effective gravity theories. By means of the expectation value of the Wilson Loop, derived from this analogue gravity approach, we find the point-like curvature of genomic strings in KRAS human gene and COVID-19 sequences, correlating this curvature with the genetic mutations. The point-like curvature profile, obtained by means of the Chern-Simons currents, can be used to infer the position of the given mutations within the genetic string. Generally, mutations take place in the highest Chern-Simons current gradient locations and subsequent mutated sequences appear to have a smoother curvature than the initial ones, in agreement with a free energy minimization argument.


title: Tully-Fisher Relations and Retardation Theory for Galaxies

abstract: Galaxies are huge physical systems having dimensions of many tens of thousands of light years. Thus any change at the galactic center will be noticed at the rim only tens of thousands of years later. Those retardation effects seem to be neglected in present day galactic modelling used to calculate rotational velocities of matter in the rims of the galaxy. The significant differences between the predictions of Newtonian theory and observed velocities are usually explained by either assuming dark matter or by modifying the laws of gravity (MOND). In this essay we will show that taking retardation effects into account one can explain the azimuthal velocities of galactic matter and the well known Tully-Fisher relations of galaxies.


title: On the linear transformation between inertial frames

abstract: In the derivation of Lorentz transformation, linear transformation between inertial frames is one of the most important steps. In teaching special relativity, we usually use the homogeneity and isotropy of spacetime to argue that the transformation must be linear transformation without providing any rigorous detail. Here in the first time we provide a solid mathematical proof of the argument that the transformation between two inertial frames must be linear because of the homogeneity and isotropy of spacetime.


title: Kolmogorov complexity of unitary transformations in quantum computing

abstract: We introduce a notion of Kolmogorov complexity of unitary transformation, which can (roughly) be understood as the least possible amount of information required to fully describe and reconstruct a given finite unitary transformation. In the context of quantum computing, it corresponds to the least possible amount of data to define and describe a quantum circuit or quantum computer program. Our Kolmogorov complexity of unitary transformation is built upon Kolmogorov "qubit complexity" of Berthiaume, W. Van Dam and S. Laplante via mapping from unitary transformations to positive operators, which are subsequently "purified". We discuss the optimality of our notion of Kolmogorov complexity in a broad sense and obtain a simple complexity bound.


title: Infall time in the Eddington-Finkelstein metric, with application to Einstein-Rosen bridges

abstract: The Eddington-Finkelstein metric is obtained from the Schwarzschild metric by a change of the time variable. It is well known that a test mass falling into a black hole does not reach the event horizon for any finite value of the Schwarzschild time variable $t$. By contrast, we show that the event horizon is reached for a finite value of the Eddington-Finkelstein time variable $t'$. Then we study in Eddington-Finkelstein time the fate of a massive particle traversing an Einstein-Rosen bridge and obtain a different conclusion than recent proposals in the literature: we show that the particle reaches the wormhole throat for a finite value $t'_1$ of the time marker $t'$, and continues its trajectory across the throat for $t'>t'_1$. Such a behavior does not make sense in Schwarzschild time since it would amount to continuing the trajectory of the particle "beyond the end of time."


title: Intelligent Players in a Fictitious Play Framework

abstract: Fictitious play is a popular learning algorithm in which players that utilize the history of actions played by the players and the knowledge of their own payoff matrix can converge to the Nash equilibrium under certain conditions on the game. We consider the presence of an intelligent player that has access to the entire payoff matrix for the game. We show that by not conforming to fictitious play, such a player can achieve a better payoff than the one at the Nash Equilibrium. This result can be viewed both as a fragility of the fictitious play algorithm to a strategic intelligent player and an indication that players should not throw away additional information they may have, as suggested by classical fictitious play.


title: Cycle-tree guided attack of random K-core: Spin glass model and efficient message-passing algorithm

abstract: The K-core of a graph is the maximal subgraph within which each vertex is connected to at least K other vertices. It is a fundamental network concept for understanding threshold cascading processes with a discontinuous percolation transition. A minimum attack set contains the smallest number of vertices whose removal induces complete collapse of the K-core. Here we tackle this prototypical optimal initial-condition problem from the spin-glass perspective of cycle-tree maximum packing and propose a cycle-tree guided attack (CTGA) message-passing algorithm. The good performance and time efficiency of CTGA are verified on the regular random and Erd\"os-R\'enyi random graph ensembles. Our central idea of transforming a long-range correlated dynamical process to static structural patterns may also be instructive to other hard optimization and control problems.

categories: cond-mat.dis-nn cond-mat.stat-mech cs.CY physics.soc-ph


title: Rank-based loss for learning hierarchical representations

abstract: Hierarchical taxonomies are common in many contexts, and they are a very natural structure humans use to organise information. In machine learning, the family of methods that use the 'extra' information is called hierarchical classification. However, applied to audio classification, this remains relatively unexplored. Here we focus on how to integrate the hierarchical information of a problem to learn embeddings representative of the hierarchical relationships. Previously, triplet loss has been proposed to address this problem, however it presents some issues like requiring the careful construction of the triplets, and being limited in the extent of hierarchical information it uses at each iteration. In this work we propose a rank based loss function that uses hierarchical information and translates this into a rank ordering of target distances between the examples. We show that rank based loss is suitable to learn hierarchical representations of the data. By testing on unseen fine level classes we show that this method is also capable of learning hierarchically correct representations of the new classes. Rank based loss has two promising aspects, it is generalisable to hierarchies with any number of levels, and is capable of dealing with data with incomplete hierarchical labels.


title: Resolution of The Linear-Bounded Automata Question

abstract: This paper resolves a famous and longstanding open question in automata theory, i.e., the {\it linear-bounded automata question} (or shortly, LBA question), which can also be phrased succinctly in the language of computational complexity theory as $$ {\rm NSPACE}[n]\overset{?}{=}{\rm DSPACE}[n]. $$ In fact, we prove a more general result that $$ {\rm DSPACE}[S(n)]\subsetneqq {\rm NSPACE}[S(n)] $$ where $S(n)\geq n$ is a space-constructible function. Our proof technique is based on diagonalization against deterministic $S(n)$ space-bounded Turing machines with a universal nondeterministic Turing machine, and on other novel and interesting new technique. Our proof also implies the following consequences, which resolve some famous open questions in complexity theory: (1). ${\rm DSPACE}[n]\subsetneqq {\rm NSPACE}[n]$; (2). $L\subsetneqq NL$; (3). $L\subsetneqq P$; (4). There exists no deterministic Turing machine working in $O(\log n)$ space deciding the $st$-connectivity question (STCON).


title: Numerical simulations of convection heat transfer in porous media using a cascaded lattice Boltzmann method

abstract: Convection heat transfer in porous media is a universal phenomenon in nature, and it is also frequently encountered in scientific and engineering fields. An in-depth understanding of the fundamental mechanism of convection heat transfer in porous media requires efficient and powerful numerical tools. In this paper, a cascaded lattice Boltzmann (CLB) method for convection heat transfer in porous media at the representative elementary volume (REV) scale is presented. In the CLB method, the flow field is solved by an isothermal CLB model with the D2Q9 lattice based on the generalized non-Darcy model, while the temperature field is solved by a temperature-based CLB model with the D2Q5 lattice. The key point is to incorporate the influence of the porous media into the CLB method by introducing the porosity and heat capacity ratio into the shift matrices. The effectiveness and practicability of the present method are validated by numerical simulations of several heat transfer problems in porous media at the REV scale. It is shown that the present method for convection heat transfer in porous media is second-order accurate in space. Moreover, in comparison with the Bhatnagar-Gross-Krook lattice Boltzmann method, the present method has sufficient tunable parameters and possesses better numerical stability.


title: QSNET, a network of clocks for measuring the stability of fundamental constants

abstract: The QSNET consortium is building a UK network of next-generation atomic and molecular clocks that will achieve unprecedented sensitivity in testing variations of the fine structure constant, $\alpha$, and the electron-to-proton mass ratio, $\mu$. This in turn will provide more stringent constraints on a wide range of fundamental and phenomenological theories beyond the Standard Model and on dark matter models.

categories: hep-ph astro-ph.CO gr-qc hep-ex physics.atom-ph


title: Multi-condition multi-objective optimization using deep reinforcement learning

abstract: A multi-condition multi-objective optimization method that can find Pareto front over a defined condition space is developed for the first time using deep reinforcement learning. Unlike the conventional methods which perform optimization at a single condition, the present method learns the correlations between conditions and optimal solutions. The exclusive capability of the developed method is examined in the solutions of a novel modified Kursawe benchmark problem and an airfoil shape optimization problem which include nonlinear characteristics which are difficult to resolve using conventional optimization methods. Pareto front with high resolution over a defined condition space is successfully determined in each problem. Compared with multiple operations of a single-condition optimization method for multiple conditions, the present multi-condition optimization method based on deep reinforcement learning shows a greatly accelerated search of Pareto front by reducing the number of required function evaluations. An analysis of aerodynamics performance of airfoils with optimally designed shapes confirms that multi-condition optimization is indispensable to avoid significant degradation of target performance for varying flow conditions.


title: Upper bounds of orders of automorphism groups of leafless metric graphs

abstract: We prove a tropical analogue of the theorem of Hurwitz: a leafless metric graph of genus $g \ge 2$ has at most $12$ automorphisms when $g = 2$; $2^g g!$ automorphisms when $g \ge 3$. These inequalities are optimal; for each genus, we give all metric graphs which have the maximum numbers of automorphisms. The proof is written in terms of graph theory.


title: C3PU: Cross-Coupling Capacitor Processing Unit Using Analog-Mixed Signal In-Memory Computing for AI Inference

abstract: This paper presents a novel cross-coupling capacitor processing unit (C3PU) that supports analog-mixed signal in memory computing to perform multiply-and-accumulate (MAC) operations. The C3PU consists of a capacitive unit, a CMOS transistor, and a voltage-to-time converter (VTC). The capacitive unit serves as a computational element that holds the multiplier operand and performs multiplication once the multiplicand is applied at the terminal. The multiplicand is the input voltage that is converted to a pulse width signal using a low power VTC. The transistor transfers this multiplication where a voltage level is generated. A demonstrator of 5x4 C3PU array that is capable of implementing 4 MAC units is presented. The design has been verified using Monte Carlo simulation in 65 nm technology. The 5x4 C3PU consumed energy of 66.4 fJ/MAC at 0.3 V voltage supply with an error of 5.7%. The proposed unit achieves lower energy and occupies a smaller area by 3.4x and 3.6x, respectively, with similar error value when compared to a digital-based 8x4-bit fixed point MAC unit. The C3PU has been utilized through an iris fower classification utilizing an artificial neural network which achieved a 90% classification accuracy compared to ideal accuracy of 96.67% using MATLAB.


title: Denoising Diffusion Gamma Models

abstract: Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with more degrees of freedom could improve the performance of such generative models. In this work, we investigate other types of noise distribution for the diffusion process. Specifically, we introduce the Denoising Diffusion Gamma Model (DDGM) and show that noise from Gamma distribution provides improved results for image and speech generation. Our approach preserves the ability to efficiently sample state in the training diffusion process while using Gamma noise.

categories: eess.SP cs.AI cs.CV cs.GR cs.LG cs.SD eess.AS eess.IV


title: Securing music sharing platforms: A Blockchain-Based Approach

abstract: From online education and trading, all aspects of our lives are affected by digital technology. Among them, the storage of music has also entered the digital era. Music productions created by artists have brought great joy to people. However, when artists upload their works, they are most downloaded and reprinted by others, and copyright information and the issue associated with the sharing of music arise. This will have a significant negative impact on the enthusiasm and motivation of artists. This paper provides an internet database platform for artists, which uses the distributed and tamper-proof technology of the Ethereum blockchain to store music works, and protect the copyright information of each album or music produced by artists in the music industry. Design and implementation of the system model and data storage are proposed and data storage processes based on the Ethereum smart contract are demonstrated in detail. The system stores music information on the blockchain network, using the smart contract to provide artists with a fast and efficient royalty payment. Node.js is applied to carry out the experiments of our system, and we test Remote Procedure Calls (RPC) with available account and private keys for contract development and use block explorer to track music information on the blockchain. Our system enables copyright revenue to be attributed to music creators that will help to eliminate the illegal uploading of music on other websites.


title: An epidemic model in inhomogeneous environment

abstract: The current work deals with an epidemic model on the complete graph K_n on n vertices in a non-homogeneous setting, where the vertices may have distinct types. Different types differ in the probability of getting infected, and/or in the capacity of infecting other vertices. This generalizes previous models where vertices are all of the same type and have equal probabilities of being infected. We prove laws of large numbers and central limit theorems for the the total duration of the process and for the number of infected vertices, respectively, when n goes to infinity. By coupling the epidemic model with a Poisson process, we also obtain continuous-time counterparts of the above-mentioned limit results. Moreover, we also prove that when all individuals have the same spread capacity, then a population with inhomogeneous susceptibility is less affected by the epidemics than a homogeneous population.


title: Evolving Evolutionary Algorithms with Patterns

abstract: A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for generating the individuals of a new generation. The evolved pattern is embedded into a standard evolutionary scheme that is used for solving a particular problem. Several evolutionary algorithms for function optimization are evolved by using the considered model. The evolved evolutionary algorithms are compared with a human-designed Genetic Algorithm. Numerical experiments show that the evolved evolutionary algorithms can compete with standard approaches for several well-known benchmarking problems.


title: Solving Major Problems Using Vector Affine Quantization

abstract: Affine quantization is a parallel procedure to canonical quantization, which is ideally suited to deal with special problems. Vector affine quantization introduces multiple degrees of freedom which find that working together create novel tools suitable to eliminate typical difficulties encountered in more conventional approaches.


title: Complex, Lorentzian, and Euclidean simplicial quantum gravity: numerical methods and physical prospects

abstract: Evaluating gravitational path integrals in the Lorentzian has been a long-standing challenge due to the numerical sign problem. We show that this challenge can be overcome in simplicial quantum gravity. By deforming the integration contour into the complex, the sign fluctuations can be suppressed, for instance using the holomorphic gradient flow algorithm. Working through simple models, we show that this algorithm enables efficient Monte Carlo simulations for Lorentzian simplicial quantum gravity. In order to allow complex deformations of the integration contour, we provide a manifestly holomorphic formula for Lorentzian simplicial gravity. This leads to a complex version of simplicial gravity that generalizes the Euclidean and Lorentzian cases. Outside the context of numerical computation, complex simplicial gravity is also relevant to studies of singularity resolving processes with complex semi-classical solutions. Along the way, we prove a complex version of the Gauss-Bonnet theorem, which may be of independent interest.


title: Mining the Weights Knowledge for Optimizing Neural Network Structures

abstract: Knowledge embedded in the weights of the artificial neural network can be used to improve the network structure, such as in network compression. However, the knowledge is set up by hand, which may not be very accurate, and relevant information may be overlooked. Inspired by how learning works in the mammalian brain, we mine the knowledge contained in the weights of the neural network toward automatic architecture learning in this paper. We introduce a switcher neural network (SNN) that uses as inputs the weights of a task-specific neural network (called TNN for short). By mining the knowledge contained in the weights, the SNN outputs scaling factors for turning off and weighting neurons in the TNN. To optimize the structure and the parameters of TNN simultaneously, the SNN and TNN are learned alternately under the same performance evaluation of TNN using stochastic gradient descent. We test our method on widely used datasets and popular networks in classification applications. In terms of accuracy, we outperform baseline networks and other structure learning methods stably and significantly. At the same time, we compress the baseline networks without introducing any sparse induction mechanism, and our method, in particular, leads to a lower compression rate when dealing with simpler baselines or more difficult tasks. These results demonstrate that our method can produce a more reasonable structure.


title: Developing a Lecture Video Recording System Using Augmented Reality

abstract: Assistive technology is a prerequisite for making a high-quality lecture video. It is therefore imperative to edit the lecture video after recording. In this study, we aim to reduce the cumbersome task of lecture video editing by developing a system that enables the addition of visual effects in the video while recording. In particular, we use augmented reality (AR) technology to digitize and display in real-time lecture materials, assistant agents, and other recording contents used by the lecturer. Our system realizes such a mechanism as a lecture recording environment. In addition, our system based on AR technology can support the work of the lecturer, which is difficult to do by oneself while conducting the lecture, using the information of the lecturer's position and the progress of the lecture. We evaluated the system functionality and performance, and verified the system's correct behavior. If the burden of making lecture videos can be reduced, the lecturer will be able to devote more time to improving the quality of lecture contents, which is expected to contribute to the improvement of lectures.


title: Z_{c,b}-like states from QCD Laplace sum rules at NLO

abstract: We review our results on $Z_{c}$-like states[1] which we complete with the ones on $Z_{b}$-like states by using relativistic QCD Laplace Sum Rules (LSR) within stability criteria and including Factorized Next-to-Leading Order (FNLO) Perturbative (PT) corrections and Lowest Order (LO) QCD condensates up to $\langle G^3 \rangle$. We emphasize the importance of PT radiative corrections for heavy quark sum rules in order to justify the use of the running heavy quark mass in the analysis. Our estimates are compiled in Tables 3 and 4. From our results, the observed $Z_{cs}(3983)$ state are good candidate for being ${\mathcal T}_{cs}$ tetramole (superposition of nearly degenerated molecules and tetraquark states having the same quatum numbers $J^{PC}$ and with almost the same couplings to the currents). The $Z_{cs}$ bump around 4100 MeV can be interpreted as a combination of $D^{*}_{0}D_{s1}$ and $D^{*}_{s0}D_{1}$ molecules. The physical states $Z_{cs}(4000)$ and $Z_{cs}(4220)$ found by LHCb are too low to be considered as the first radial excitations of $Z_{cs}(3983)$. For the future $Z_{b}$, $Z_{bs}$ and $Z_{bss}$, we suggest to scan the region around $(10.3 \sim 10.9)$ GeV while the 1st radial excitations are about 2.4 GeV above the ground states.


title: A fast and light tool for partially-coherent beamline simulations in fourth generation storage rings based on coherent mode decomposition

abstract: A new algorithm to perform coherent mode decomposition of the undulator radiation is proposed. It is based in separating the horizontal and vertical directions, reducing the problem by working with one-dimension wavefronts. The validity conditions of this approximation are discussed. Simulations require low computer resources, and run interactively in a laptop. We study the focusing with lenses of the radiation emitted by an undulator in a fourth-generation storage ring (EBS-ESRF). Results are compared against multiple optics packages implementing a variety of methods for dealing with partial coherence: full 2D coherent mode decomposition, Monte-Carlo combination of wavefronts from electrons entering the undulator with different initial conditions, and hybrid ray-tracing correcting geometrical optics with wave optics.


title: From Neutrino Masses to the Full Size of the Universe

abstract: Our universe is a 3-dimensional elastic substrate which once has condensed and now is expanding within some higher dimensional space. The elastic substrate is built from tiny invisible constituents, called tetrons, with bond length about the Planck length and binding energy the Planck energy. All ordinary matter particles are quasiparticle excitations of the tetrons gliding on the elastic medium. Since the quasiparticles fulfill Lorentz covariant wave equations, they perceive the universe as a 3+1 dimensional spacetime continuum lacking a preferred rest system. Any type of mass/energy induces curvature on the spacetime continuum as determined by the Einstein equations. The 24 known quarks and leptons arise as eigenmode excitations of a tetrahedral fiber structure, which is made up from 4 tetrons and extends into 3 additional dimensions. While the laws of gravity are due to the elastic properties of the tetron bonds, particle physics interactions take place within the fibers. I will concentrate on three of the most intriguing features of the model: (i) Understanding small neutrino masses from the conservation of isospin, and, more in general, calculating the spectrum of quark and lepton masses. This is obtained from the tetron model's interpretation of the Higgs mechanism. As a byproduct, the connection between the large top mass and the electroweak symmetry breaking becomes apparent. (ii) The possibility to determine the full size of the universe from future dark energy measurements. This is obtained from the tetron model's interpretation of the dark energy effect. (iii) Finally, the origin of the big bang `Hubble tension' within the tetron scheme will be elucidated, and deviations from the standard picture such as a varying Newton constant are discussed.


title: The Variance and Correlations of the Divisor Function in $\mathbb{F}_q [T]$, and Hankel Matrices

abstract: We prove an exact formula for the variance of the divisor function over short intervals in $\mathcal{A} := \mathbb{F}_q [T]$, where $q$ is a prime power. A slight adaption of the proof allows us to obtain an exact formula for correlations of the form $d(A) d(A+B)$, where we average both $A$ and $B$ over certain intervals in $\mathcal{A}$. We also consider correlations of the form $d(KQ+N) d (N)$, where $Q$ is prime and $K$ and $N$ are averaged over certain intervals. If $\mathrm{deg } K < \mathrm{deg } Q -1$, then these correlations appear in the off-diagonal terms for the fourth moment of Dirichlet $L$-functions. We consider the case $\mathrm{deg } K \geq \mathrm{deg }Q -1$ and obtain an exact formula for the correlations. Further, we demonstrate that $d(KQ+N)$ and $d (N)$ are uncorrelated for the given ranges of $K$ and $N$. Our approach to these problems is to use the orthogonality relations of additive characters on $\mathbb{F}_q$ to translate the problems to ones involving the ranks of Hankel matrices over $\mathbb{F}_q$. Most of the paper is dedicated to proving several results regarding the rank and kernel structure of these matrices, and thus demonstrating their number-theoretic properties. We briefly discuss extending our method to moments higher than the second (the variance) over intervals; to the $k$-th divisor function; and to correlations of the divisor function with applications to moments of Dirichlet $L$-functions in function fields.


title: Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

abstract: Understanding the training dynamics of deep learning models is perhaps a necessary step toward demystifying the effectiveness of these models. In particular, how do data from different classes gradually become separable in their feature spaces when training neural networks using stochastic gradient descent? In this study, we model the evolution of features during deep learning training using a set of stochastic differential equations (SDEs) that each corresponds to a training sample. As a crucial ingredient in our modeling strategy, each SDE contains a drift term that reflects the impact of backpropagation at an input on the features of all samples. Our main finding uncovers a sharp phase transition phenomenon regarding the {intra-class impact: if the SDEs are locally elastic in the sense that the impact is more significant on samples from the same class as the input, the features of the training data become linearly separable, meaning vanishing training loss; otherwise, the features are not separable, regardless of how long the training time is. Moreover, in the presence of local elasticity, an analysis of our SDEs shows that the emergence of a simple geometric structure called the neural collapse of the features. Taken together, our results shed light on the decisive role of local elasticity in the training dynamics of neural networks. We corroborate our theoretical analysis with experiments on a synthesized dataset of geometric shapes and CIFAR-10.


title: Orbital and physical parameters of eclipsing binaries from the ASAS catalogue -- XII. A sample of systems with $K2$ photometry

abstract: We present results of the analysis of light and radial velocity (RV) curves of eight detached eclipsing binaries observed by the All-Sky Automated Survey, which we have followed up with high-resolution spectroscopy, and were later observed by the $Kepler$ satellite as part of the $K2$ mission. The RV measurements came from spectra obtained with OAO-188/HIDES, MPG-2.2m/FEROS, SMARTS 1.5m/CHIRON, Euler/CORALIE, ESO-3.6m/HARPS, and OHP-1.93/ELODIE instruments. The $K2$ time-series photometry was analyzed with the JKTEBOP code, with out-of-eclipse modulations of different origin taken into account. Individual component spectra were retrieved with the FD3 code, and analyzed with the code iSpec in order to determine effective temperatures and metallicities. Absolute values of masses, radii, and other stellar parameters are calculated, as well as ages, found through isochrone fitting. For five systems such analysis has been done for the first time. The presented sample consists of a variety of stars, from low-mass dwarfs, through G and F-type Main Sequence objects, to evolved active sub-giants, one of which is found to be crossing the Hertzsprung gap. One target may contain a $\gamma$ Dor-type pulsator, two more are parts of higher-order multiples, and spectra of their tertiaries were also retrieved and used to constrain the properties of these systems.


title: Scalar resonances in the hadronic light-by-light contribution to the muon $(g-2)$

abstract: We evaluate the contribution of scalar mesons to the hadronic light-by-light piece of the muon anomalous magnetic moment, using a warped five-dimensional model and holographic methods. We assess the contribution of the lightest, sub-GeV scalars $\sigma(500)$, $a_0(980)$ and $f_0(980)$ together with their associated towers of excited states, which the model generates automatically. Our results point at a clearly negative contribution, overwhelmingly dominated by the $\sigma(500)$ meson, that we estimate at $a_\mu^{\rm{HLbL,S}}=-9(2)\cdot 10^{-11}$. This number is in very good agreement with the most recent determinations from dispersive analyses.


title: On the construction of quotient spaces by algebraic foliations

abstract: Given a variety defined over a field of characteristic zero and an algebraically integrable foliation of corank less than or equal to two, we show the existence of a categorical quotient, defined on the non-empty open set of stable points, through which every invariant morphism factors uniquely.


title: Disentangling soft and collinear effects in QCD parton showers

abstract: We introduce a method for the separation of soft and collinear logarithms in QCD parton evolution at $\mathcal{O}(\alpha_s^2)$ and at leading color. Using an implementation of the technique in the Dire parton shower, we analyze the numerical impact of genuine triple-collinear corrections from quark pair emission in $e^+e^-\to$ hadrons.


title: Flexural wave energy harvesting by the topological interface state of a phononic crystal beam

abstract: In this study, we design the 3D-printed phononic crystal (PnC) beam with the topological interface state for harvesting the mechanical energy of flexural waves. The PnC beam is formed by arranging periodic grooves on its surface. The PnC beam with either topologically trivial or non-trivial phase can be achieved via changing the distance between the grooves. The topological interface state is then generated by combining two PnCs with distinct topological phases. The existence of the interface state of the PnC beam is verified both numerically and experimentally. To convert the mechanical energy into the electricity, a piezoelectric disc is attached at the interface of the proposed PnC beam. Compared to the reference beam harvester, the measured output power is significantly amplified by the PnC harvester at the frequency corresponding to the interface state. Furthermore, the PnC beam energy harvester based on the topological state exhibits robustness against geometrical disorders.


title: Multi-channel Narrow-band Deep Speech Separation with Full-band Permutation Invariant Training

abstract: This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the multi-channel mixture signals of one frequency, and outputs the separated signals of this frequency. In narrow-band, the spatial information (or inter-channel difference) can well discriminate between speakers at different positions. This information is intensively used in many narrow-band speech separation methods, such as beamforming and clustering of spatial vectors. The proposed network is trained to learn a rule to automatically exploit this information and perform speech separation. Such a rule should be valid for any frequency, thence the network is shared by all frequencies. In addition, a full-band permutation invariant training criterion is proposed to solve the frequency permutation problem encountered by most narrow-band methods. Experiments show that, by focusing on deeply learning the narrow-band information, the proposed method outperforms the oracle beamforming method and the state-of-the-art deep learning based method.


title: Observation of anyonic Bloch oscillations

abstract: Bloch oscillations are exotic phenomena describing the periodic motion of a wave packet subjected to the external force in a lattice, where the system possessing single- or multipleparticles could exhibit distinct oscillation behaviors. In particular, it has been pointed out that quantum statistics could dramatically affected the Bloch oscillation even in the absence of particle interactions, where the oscillation frequency of two pseudofermions with the anyonic statistical angle being pi becomes half of that for two bosons. However, these statisticdependent Bloch oscillations have never been observed in experiments up to now. Here, we report the first experimental simulation of anyonic Bloch oscillations using electric circuits. By mapping eigenstates of two anyons to modes of designed circuit simulators, the Bloch oscillation of two bosons and two pseudofermions are verified by measuring the voltage dynamics. It is found that the oscillation period in the two-boson simulator is almost twice of that in the two-pseudofermion simulator, which is consistent with the theoretical prediction. Our proposal provides a flexible platform to investigate and visualize many interesting phenomena related to particle statistics, and could have potential applications in the field of the novelty signal control.


title: Improving Character Error Rate Is Not Equal to Having Clean Speech: Speech Enhancement for ASR Systems with Black-box Acoustic Models

abstract: A deep neural network (DNN)-based speech enhancement (SE) aiming to maximize the performance of an automatic speech recognition (ASR) system is proposed in this paper. In order to optimize the DNN-based SE model in terms of the character error rate (CER), which is one of the metric to evaluate the ASR system and generally non-differentiable, our method uses two DNNs: one for speech processing and one for mimicking the output CERs derived through an acoustic model (AM). Then both of DNNs are alternately optimized in the training phase. Even if the AM is a black-box, e.g., like one provided by a third-party, the proposed method enables the DNN-based SE model to be optimized in terms of the CER since the DNN mimicking the AM is differentiable. Consequently, it becomes feasible to build CER-centric SE model that has no negative effect, e.g., additional calculation cost and changing network architecture, on the inference phase since our method is merely a training scheme for the existing DNN-based methods. Experimental results show that our method improved CER by 8.8% relative derived through a black-box AM although certain noise levels are kept.


title: Identification of time-Varying frequency of noiseless sinusoidal signal

abstract: A new algorithm for estimating the time-varying frequency of a noiseless sinusoidal signal is considered. It is assumed that the amplitude and frequency of the sinusoidal signal are unknown functions of time, but are solutions of linear stationary differential equations with known parameters. The problem is solved using gradient tuning algorithms based on a linear regression equation obtained by parameterizing the original nonlinear sinusoidal signal. The example presented in the article and the results of computer modeling illustrate the efficiency of the proposed algorithm, as well as explain the procedure for its synthesis.


title: Localization and slow-thermalization in a cluster spin model

abstract: Novel cluster spin model with interactions and disorder is introduced and studied. In specific type of interactions, we find an extensive number of local integrals of motion (LIOMs), which are a modified version of the stabilizers in quantum information, i.e., mutually commuting operators specifying all quantum states in the system. These LIOMs can be defined for any strength of the interactions and disorder, and are of compact-support instead of exponentially-decaying tail. Hence, even under the presence of interactions, integrability is held, and all energy eigenstates are labeled by these LIOMs and can be explicitly obtained. Integrable dynamics is, then, expected to occur. The compact-support nature of the LIOMs crucially prevents the thermalization and entanglement spreading. We numerically investigate dynamics of the system governed by the existence of the compact-support LIOMs, and clarify the effects of additional interactions, which break the compact-support nature of the LIOMs. There, we find that the ordinary MBL behaviors emerge, such as the logarithmic growth of the entanglement entropy in the time evolution. Besides the ergodicity breaking dynamic, we find that symmetry-protected-topological order preserves for specific states even in the presence of the interactions.


title: Application of the Shannon entropy in the planar (non-restricted) four-body problem: the long-term stability of the Kepler-60 exoplanetary system

abstract: In this paper, we present an application of the Shannon entropy in the case of the planar (non-restricted) four-body problem. Specifically, the Kepler-60 extrasolar system is being investigated with a primary interest in the resonant configuration of the planets that exhibit a chain of mean-motion commensurabilities with the ratios 5:4:3. In the dynamical maps provided, the Shannon entropy is utilized to explore the general structure of the phase space, while, based on the time evolution of the entropy, we determine also the extent and rate of the chaotic diffusion as well as the characteristic times of stability for the planets. Two cases are considered: (i) the pure Laplace resonance when the critical angles of the 2-body resonances circulate and that of the 3-body resonance librates; and (ii) the chain of two 2-body resonances when all the critical angles librate. Our results suggest that case (ii) is the more favourable configuration but we state too that, in either case, the relevant resonance plays an important role to stabilize the system. The derived stability times are no shorter than $10^8$ yrs in the central parts of the resonances.


title: Dynamics of Spin Helices in the One-Dimensional $XX$ Model

abstract: Motivated by cold-atom experiments and a desire to understand far-from-equilibrium quantum transport, we analytically study the dynamics of spin helices in the one-dimensional $XX$ model. We use a Jordan-Wigner transformation to map the spin chain onto a non-interacting Fermi gas with simple equations of motion. The resulting dynamics are nontrivial, however, as the spin-helix initial condition corresponds to a highly nonequilibrium distribution of the fermions. We find a separation of timescales between the in-plane and out-of-plane spin dynamics. We gain insights from analyzing the case of a uniform spin chain and from a semiclassical model. One of our key findings is that the spin correlation functions decay as $t^{-1/2}$ at long time, in contrast to the experimentally observed exponential decay.


title: Can machines learn to see without visual databases?

abstract: This paper sustains the position that the time has come for thinking of learning machines that conquer visual skills in a truly human-like context, where a few human-like object supervisions are given by vocal interactions and pointing aids only. This likely requires new foundations on computational processes of vision with the final purpose of involving machines in tasks of visual description by living in their own visual environment under simple man-machine linguistic interactions. The challenge consists of developing machines that learn to see without needing to handle visual databases. This might open the doors to a truly orthogonal competitive track concerning deep learning technologies for vision which does not rely on the accumulation of huge visual databases.


title: An extended analysis for a generalized Chaplygin gas model

abstract: In this work, we have extended the analysis on the generalized Chaplygin gas (GCG) model as the unification of dark energy and dark matter. Specifically, we have shown that the model of our consideration known as the new generalized Chaplygin gas (NGCG) model, admits a scalar field description, which means that there exist a minimally coupled scalar field for a given scalar field potential where the equation of state is that of the NGCG. With the use of the later property we can construct the slow-roll parameters and derive the corresponding values for the spectral indices for the tensor to scalar perturbation and for the density perturbations. We have also studied the growth rate of matter perturbations in the NGCG scenario. Finally, we have studied the viability of the generalized second law of thermodynamics by assuming that the dynamical apparent horizon in a NGCG universe is endowed with Hawking temperature and Bekenstein entropy.


title: Multi-Channel Far-Field Speaker Verification with Large-Scale Ad-hoc Microphone Arrays

abstract: Speaker verification based on ad-hoc microphone arrays has the potential of reducing the error significantly in adverse acoustic environments. However, existing approaches extract utterance-level speaker embeddings from each channel of an ad-hoc microphone array, which does not consider fully the spatial-temporal information across the devices. In this paper, we propose to aggregate the multichannel signals of the ad-hoc microphone array at the frame-level by exploring the cross-channel information deeply with two attention mechanisms. The first one is a self-attention method. It consists of a cross-frame self-attention layer and a cross-channel self-attention layer successively, both working at the frame level. The second one learns the cross-frame and cross-channel information via two graph attention layers. Experimental results demonstrate that the proposed methods reach the state-of-the-art performance. Moreover, the graph-attention method is better than the self-attention method in most cases.


title: Early Melanoma Diagnosis with Sequential Dermoscopic Images

abstract: Dermatologists often diagnose or rule out early melanoma by evaluating the follow-up dermoscopic images of skin lesions. However, existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions. Ignoring the temporal, morphological changes of lesions can lead to misdiagnosis in borderline cases. In this study, we propose a framework for automated early melanoma diagnosis using sequential dermoscopic images. To this end, we construct our method in three steps. First, we align sequential dermoscopic images of skin lesions using estimated Euclidean transformations, extract the lesion growth region by computing image differences among the consecutive images, and then propose a spatio-temporal network to capture the dermoscopic changes from aligned lesion images and the corresponding difference images. Finally, we develop an early diagnosis module to compute probability scores of malignancy for lesion images over time. We collected 179 serial dermoscopic imaging data from 122 patients to verify our method. Extensive experiments show that the proposed model outperforms other commonly used sequence models. We also compared the diagnostic results of our model with those of seven experienced dermatologists and five registrars. Our model achieved higher diagnostic accuracy than clinicians (63.69% vs. 54.33%, respectively) and provided an earlier diagnosis of melanoma (60.7% vs. 32.7% of melanoma correctly diagnosed on the first follow-up images). These results demonstrate that our model can be used to identify melanocytic lesions that are at high-risk of malignant transformation earlier in the disease process and thereby redefine what is possible in the early detection of melanoma.


title: Datasets are not Enough: Challenges in Labeling Network Traffic

abstract: In contrast to previous surveys, the present work is not focused on reviewing the datasets used in the network security field. The fact is that many of the available public labeled datasets represent the network behavior just for a particular time period. Given the rate of change in malicious behavior and the serious challenge to label, and maintain these datasets, they become quickly obsolete. Therefore, this work is focused on the analysis of current labeling methodologies applied to network-based data. In the field of network security, the process of labeling a representative network traffic dataset is particularly challenging and costly since very specialized knowledge is required to classify network traces. Consequently, most of the current traffic labeling methods are based on the automatic generation of synthetic network traces, which hides many of the essential aspects necessary for a correct differentiation between normal and malicious behavior. Alternatively, a few other methods incorporate non-experts users in the labeling process of real traffic with the help of visual and statistical tools. However, after conducting an in-depth analysis, it seems that all current methods for labeling suffer from fundamental drawbacks regarding the quality, volume, and speed of the resulting dataset. This lack of consistent methods for continuously generating a representative dataset with an accurate and validated methodology must be addressed by the network security research community. Moreover, a consistent label methodology is a fundamental condition for helping in the acceptance of novel detection approaches based on statistical and machine learning techniques.


title: A remark on the quaternionic Monge-Amp\`ere equation on foliated manifolds

abstract: We study the quaternionic Monge-Amp\`ere equation on HKT manifolds admitting an HKT foliation having corank 4. We show that in this setting the quaternionic Monge-Amp\`ere equation has always a unique solution for every basic datum. This approach includes the study of the equation on SU(3).


title: Gaia May Detect Hundreds of Well-characterised Stellar Black Holes

abstract: Detection of black holes (BHs) with detached luminous companions (LCs) can be instrumental in connecting the BH properties with their progenitors' since the latter can be inferred from the observable properties of the LC. Past studies showed the promise of Gaia astrometry in detecting BH-LC binaries. We build upon these studies by: 1) initialising the zero-age binary properties based on realistic, metallicity-dependent star-formation history in the Milky Way (MW), 2) evolving these binaries to current epoch to generate realistic MW populations of BH-LC binaries, 3) distributing these binaries in the MW preserving the complex age-metallicity-Galactic position correlations, 4) accounting for extinction and reddening using three-dimensional dust maps, 5) examining the extended Gaia mission's ability to resolve BH-LC binaries. We restrict ourselves to detached BH-LC binaries with orbital period <10 yr such that Gaia can observe at least one full orbit. We find: 1) the extended Gaia mission can astrometrically resolve 30-300 detached BH-LC binaries depending on our assumptions of supernova physics and astrometric detection threshold; 2) Gaia's astrometry alone can indicate BH candidates for 10-100 BH-LC binaries by constraining the dark primary mass >3 Msun; 3) distributions of observables including orbital periods, eccentricities, and component masses are sensitive to the adopted binary evolution model, hence can directly inform binary evolution models. Finally, we comment on the potential to further characterise these BH binaries through radial velocity measurements and observation of X-ray counterparts.


title: On the asymptotic behaviour of the fractional Sobolev seminorms in metric measure spaces: Bourgain-Brezis-Mironescu's theorem revisited

abstract: We generalize Bourgain-Brezis-Mironescu's asymptotic formula for fractional Sobolev functions, in the setting of abstract metric measure spaces, under the assumption that at almost every point the tangent space in the measured Gromov-Hausdorff sense is a finite dimensional Banach space or a Carnot group. Our result not only covers the known results concerning Euclidean spaces, weighted Riemannian manifolds and finite dimensional Banach spaces, but also extends Bourgain-Brezis-Mironescu's formula to $\rcdkn$ spaces and sub-Riemannian manifolds.


title: Cavities with Non-Spherical Mirrors for Enhanced Quantum Emitter-Cavity Photon Interaction

abstract: We propose a procedure for the significant enhancement of the strong coupling rate between photons in an optical cavity and a single quantum emitter, such as an atom, quantum dot or trapped ion. We show that specially designed, non-spherical mirrors can lead to cavity eigenmodes that exhibit a large field enhancement at the center of the cavity while inducing significantly less beam divergence, and therefore smaller round trip losses and higher cooperativity, than can be achieved by operating a spherical-mirror cavity in the near-concentric regime. We verify our designs using mode matching theory and discuss their robustness relative to different kinds of manufacturing deviations.


title: Primordial black hole formation for an anisotropic perfect fluid: Initial conditions and estimation of the threshold

abstract: This work investigates the formation of primordial black holes within a radiation fluid with an anisotropic pressure. We focus our attention on the initial conditions describing cosmological perturbations in the super horizon regime, using a covariant form of the equation of state in terms of pressure and energy density gradients. The effect of the anisotropy is to modify the initial shape of the cosmological perturbations with respect to the isotropic case. Using the dependence of the threshold $\delta_\mathrm{c}$ for primordial black holes with respect to the shape of cosmological perturbations, we estimate here how the threshold is varying with respect to the amplitude of the anisotropy. If this variation is large enough it could lead to a significant variation of the abundance of PBHs.


title: Network-Aware Flexibility Requests for Distribution-Level Flexibility Markets

abstract: This paper proposes a method to design network-aware flexibility requests for local flexibility markets. These markets are becoming increasingly important for distribution system operators (DSOs) to ensure grid safety while minimizing costs and public opposition to new network investments. Despite extended recent literature on local flexibility markets, little attention has been paid to quantifying the flexibility required at each location, considering physical network constraints (e.g. line and voltage limits). The method introduced uses a chance-constrained optimization model and a LinDistFlow approximation to consider both physical network constraints and uncertainty caused by renewable production or demand fluctuations. Unlike other methods, it avoids sharing sensitive grid data with the market operator. We compare our approach against a stochastic market-clearing mechanism which serves as a benchmark, and we derive analytical conditions for the performance of our method to determine flexibility requests. We show on two case studies that our method outperforms the stochastic market-clearing benchmark in terms of computation time while achieving comparable social welfare and costs for the DSOs. One of the case studies is conducted on an actual German distribution grid, showing that the proposed method can scale well to real-sized networks.


title: Low cycle fatigue of a nickel based superalloy at high temperature: deformation microstructures

abstract: The microstructural characteristics of a single crystalline nickel based superalloy (AM1) tested under high temperature fatigue at 950$^\circ$C are reported. For repeated fatigue (R$_\varepsilon$=0) through a range of cycle numbers N with imposed total strain amplitude $\Delta\varepsilon^t$, two main types of behaviour are found depending on N and $\Delta\varepsilon^t$. This allows a map of microstructures versus the number of cycles N and $\Delta\varepsilon^t$ to be constructed. A domain called A presents anisotropic microstructures due either to a partition of the plasticity throughout the k channels, or to an oriented coarsening of the k% precipitates of the so-called type N (rafts perpendicular to the loading axis). The domain called H shows homogeneous deformation microstructures. The coarsening observed in repeated fatigue is accounted for on the basis of a model proposed earlier in the literature by V\'eron. Alternate fatigue (R$_\varepsilon$ = -1) also leads to the same type of coarsening, even for a very low number of cycles (N=113). The microstructures observed are ascribed to internal stress effects and are related to the possible shearing of the precipitates and to different diffusion processes.


title: A Categorical Semantics of Fuzzy Concepts in Conceptual Spaces

abstract: We define a symmetric monoidal category modelling fuzzy concepts and fuzzy conceptual reasoning within G\"ardenfors' framework of conceptual (convex) spaces. We propose log-concave functions as models of fuzzy concepts, showing that these are the most general choice satisfying a criterion due to G\"ardenfors and which are well-behaved compositionally. We then generalise these to define the category of log-concave probabilistic channels between convex spaces, which allows one to model fuzzy reasoning with noisy inputs, and provides a novel example of a Markov category.


title: Exponential stabilization of waves for the Zaremba boundary condition

abstract: In this article we prove, under some geometrical condition on geodesic flow, exponential stabilization of wave equation with Zaremba boundary condition. We prove an estimate on the resolvent of semigroup associated with wave equation on the imaginary axis and we deduce the stabilization result. To prove this estimate we apply semiclassical measure technics. The main difficulties are to prove that support of measure is in characteristic set in a neighborhood of the jump in the boundary condition and to prove results of propagation in a neighborhood of a boundary point where Neumann boundary condition is imposed. In fact if a lot of results applied here are proved in previous articles, these two points are new.


title: Getting Genetic Ancestry Right for Science and Society

abstract: There is a scientific and ethical imperative to embrace a multidimensional, continuous view of ancestry and move away from continental ancestry categories


title: System-Level Performance and Robustness of the Grid-Forming Hybrid Angle Control

abstract: This paper investigates the implementation and application of the multi-variable grid-forming hybrid angle control (HAC) for high-power converters in transmission grids. We explore the system-level performance and robustness of the HAC concept in contrast to other grid-forming schemes i.e., power-frequency droop and matching controls. Our findings suggest that similar to the ac-based droop control, \ac{hac} enhances the small-signal frequency stability in low-inertia power grids, and akin to the dc-based matching control, HAC exhibits robustness when accounting for the practical limits of the converter systems. Thus, HAC combines the aforementioned complementary advantages. Furthermore, we show how retuning certain control parameters of the grid-forming controls improve the frequency performance. Last, as separate contributions, we introduce an alternative control augmentation that enhances the robustness and provides theoretical guidelines on extending the stability certificates of \ac{hac} to multi-converter systems.


title: Furstenberg's Times 2, Times 3 Conjecture (a Short Survey)

abstract: The following is a concise exposition on the conjecture and three of its proofs for the case of positive entropy, by D. Rudolph [22] , by B. Host [14] and by W. Parry [21]. A simpler theorem of R. Lyons [19] - preceding them - is also presented and proved. This is a survey, no new results are introduced.


title: Phase Noise Resilient Three-Level Continuous-Phase Modulation for DFT-Spread OFDM

abstract: A novel OFDM-based waveform with low peak-to-average power ratio (PAPR) and high robustness against phase noise (PN) is presented. It follows the discrete Fourier transform spread orthogonal frequency division multiplexing (DFT-s-OFDM) signal model. 3MSK, is inspired by continuous-phase frequency shift keying (FSK), but it uses three frequencies in the baseband model -- specifically, 0 and $\pm f_{symbol}/4$, where $f_{symbol}$ is the symbol rate -- which effectively constrains the phase transitions between consecutive symbols to 0 and $\pm \pi/2$ rad. Motivated by the phase controlled model of modulation, different degrees of phase continuity can be achieved, while supporting receiver processing with low complexity. The signal characteristics are improved by generating an initial time-domain nearly constant envelope signal at higher than the symbol rate. This helps to reach smooth phase transitions between 3MSK symbols. Also the possibility of using excess bandwidth is investigated by transmitting additional non-zero subcarriers outside active subcarriers of the basic DFT-s-OFDM model, which provides the capability to greatly reduce the PAPR. Due to the fact that the information is encoded in the phase transitions, a receiver model that tracks the phase variations without needing reference signals is developed. To this end, it is shown that this new modulation is well-suited for non-coherent receivers, even under strong phase noise (PN) conditions, thus allowing to reduce the overhead of reference signals. Evaluations of this physical-layer modulation and waveform scheme are performed in terms of transmitter metrics such as PAPR, OOB emissions and achievable output power after the power amplifier (PA). Finally, coded radio link evaluations are also shown and provided, demonstrating that 3MSK has a similar BER performance as that of traditional QPSK.


title: A totally disconnected invitation to locally compact groups

abstract: We present a selection of results contributing to a structure theory of totally disconnected locally compact groups.


title: Weighted Model Counting in FO2 with Cardinality Constraints and Counting Quantifiers: A Closed Form Formula

abstract: Weighted First-Order Model Counting (WFOMC) computes the weighted sum of the models of a first-order logic theory on a given finite domain. First-Order Logic theories that admit polynomial-time WFOMC w.r.t domain cardinality are called domain liftable. We introduce the concept of lifted interpretations as a tool for formulating closed-forms for WFOMC. Using lifted interpretations, we reconstruct the closed-form formula for polynomial-time FOMC in the universally quantified fragment of FO2, earlier proposed by Beame et al. We then expand this closed-form to incorporate cardinality constraints, existential quantifiers, and counting quantifiers (a.k.a C2) without losing domain-liftability. Finally, we show that the obtained closed-form motivates a natural definition of a family of weight functions strictly larger than symmetric weight functions.


title: Norm tori of etale algebras and unramified Brauer groups

abstract: Let $k$ be a field, and let $L$ be an \'etale k-algebra of finite rank. If $a$ is a nonzero element in $k$, let $X_a$ be the affine variety defined by the norm equation $N_{L/k}(x) = a$. Assuming that $L$ has at least one factor that is a cyclic field extension of $k$, we give a combinatorial description of the unramified Brauer group of $X_a$.


title: Word Order Does Not Matter For Speech Recognition

abstract: In this paper, we study training of automatic speech recognition system in a weakly supervised setting where the order of words in transcript labels of the audio training data is not known. We train a word-level acoustic model which aggregates the distribution of all output frames using LogSumExp operation and uses a cross-entropy loss to match with the ground-truth words distribution. Using the pseudo-labels generated from this model on the training set, we then train a letter-based acoustic model using Connectionist Temporal Classification loss. Our system achieves 2.3%/4.6% on test-clean/test-other subsets of LibriSpeech, which closely matches with the supervised baseline's performance.


title: Evolutionary dynamics on sequential temporal networks

abstract: It is well-known that population structure is a catalyst for the evolution of cooperation since individuals can reciprocate with their neighbors through local interactions defined by network structures. Previous research typically relies on the assumption that population size is fixed and the structure is time-invariant, which is represented by a static network. However, real-world populations are often evolving with the successive growth of nodes and links in time, resulting in time-varying population structures. Here we model such growing networked populations by sequential temporal networks with an increasing number of nodes and edges and develop the theory of evolutionary dynamics on sequential temporal networks. We derive explicit conditions under which sequential temporal networks promote the evolution of cooperation relative to their static counterparts. In particular, even if natural selection disfavours cooperative behaviours on static networks, sequential temporal networks can surprisingly rescue cooperation. Furthermore, we demonstrate empirically that sequential temporal networks assembled from synthetic and empirical datasets present such promotion in the evolution of cooperation. Our results advance the study of evolutionary dynamics on temporal networks and open the avenue for investigating the evolution of prosocial and other behaviours.


title: Intersection Bodies of Polytopes

abstract: We investigate the intersection body of a convex polytope using tools from combinatorics and real algebraic geometry. In particular, we show that the intersection body of a polytope is always a semialgebraic set and provide an algorithm for its computation. Moreover, we compute the irreducible components of the algebraic boundary and provide an upper bound for the degree of these components.


title: Tensor decompositions and algorithms, with applications to tensor learning

abstract: A new algorithm of the canonical polyadic decomposition (CPD) presented here. It features lower computational complexity and memory usage than the available state of the art implementations. We begin with some examples of CPD applications to real world problems. A short summary of the main contributions in this work follows. In chapter 1 we review classical tensor algebra and geometry, with focus on the CPD. Chapter 2 focuses on tensor compression, which is considered (in this work) to be one of the most important parts of the CPD algorithm. In chapter 3 we talk about the Gauss-Newton method, which is a nonlinear least squares method used to minimize nonlinear functions. Chapter 4 is the longest one of this thesis. In this chapter we introduce the main character of this thesis: Tensor Fox. Basically it is a tensor package which includes a CPD solver. After introducing Tensor Fox we will conduct lots of computational experiments comparing this solver with several others. At the end of this chapter we introduce the Tensor Train decomposition and show how to use it to compute higher order CPDs. We also discuss some important details such as regularization, preconditioning, conditioning, parallelism, etc. In chapter 5 we consider the intersection between tensor decompositions and machine learning. A novel model is introduced, which works as a tensor version of neural networks. Finally, in chapter 6 we reach the final conclusions and introduce our expectations for future developments.


title: Algebraic and differential-geometric constructions of set-theoretical solutions to the Zamolodchikov tetrahedron equation

abstract: We present several algebraic and differential-geometric constructions of tetrahedron maps, which are set-theoretical solutions to the Zamolodchikov tetrahedron equation. In particular, we obtain a family of new (nonlinear) polynomial tetrahedron maps on the space of square matrices of arbitrary size, using a matrix refactorisation equation, which does not coincide with the standard local Yang--Baxter equation. Liouville integrability is established for some of these maps. Also, we show how to derive linear tetrahedron maps as linear approximations of nonlinear ones, using Lax representations and the differentials of nonlinear tetrahedron maps on manifolds. We apply this construction to two nonlinear maps: a tetrahedron map obtained in [arXiv:1708.05694] in a study of soliton solutions of vector KP equations and a tetrahedron map obtained in [arXiv:2005.13574] in a study of a matrix trifactorisation problem related to a Darboux matrix associated with a Lax operator for the NLS equation. We derive parametric families of new linear tetrahedron maps (with nonlinear dependence on parameters), which are linear approximations for these nonlinear ones. Furthermore, we present (nonlinear) matrix generalisations of a tetrahedron map from Sergeev's classification [arXiv:solv-int/9709006]. These matrix generalisations can be regarded as tetrahedron maps in noncommutative variables. Besides, several tetrahedron maps on arbitrary groups are constructed.


title: DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer

abstract: Despite the recent advances in applying pre-trained language models to generate high-quality texts, generating long passages that maintain long-range coherence is yet challenging for these models. In this paper, we propose DiscoDVT, a discourse-aware discrete variational Transformer to tackle the incoherence issue. DiscoDVT learns a discrete variable sequence that summarizes the global structure of the text and then applies it to guide the generation process at each decoding step. To further embed discourse-aware information into the discrete latent representations, we introduce an auxiliary objective to model the discourse relations within the text. We conduct extensive experiments on two open story generation datasets and demonstrate that the latent codes learn meaningful correspondence to the discourse structures that guide the model to generate long texts with better long-range coherence.


title: Time evolution of magnetic activity cycles in young suns: The curious case of kappa Ceti

abstract: A detailed investigation of the magnetic properties of young Sun-like stars can provide valuable information on our Sun's magnetic past and its impact on the early Earth. We determine the properties of the moderately rotating young Sun-like star kappa Ceti's magnetic and activity cycles using 50 years of chromospheric activity data and six epochs of spectropolarimetric observations. The chromospheric activity was determined by measuring the flux in the Ca II H and K lines. A generalised Lomb-Scargle periodogram and a wavelet decomposition were used on the chromospheric activity data to establish the associated periodicities. The vector magnetic field of the star was reconstructed using the technique of Zeeman Doppler imaging on the spectropolarimetric observations. Our period analysis algorithms detect a 3.1 year chromospheric cycle in addition to the star's well-known ~6 year cycle period. Although the two cycle periods have an approximate 1:2 ratio, they exhibit an unusual temporal evolution. Additionally, the spectropolarimetric data analysis shows polarity reversals of the star's large-scale magnetic field, suggesting a ~10 year magnetic or Hale cycle. The unusual evolution of the star's chromospheric cycles and their lack of a direct correlation with the magnetic cycle establishes kappa Ceti as a curious young Sun. Such complex evolution of magnetic activity could be synonymous with moderately active young Suns, which is an evolutionary path that our own Sun could have taken.


title: Strongly divisible lattices and crystalline cohomology in the imperfect residue field case

abstract: Let $k$ be a perfect field of characteristic $p \geq 3$, and let $K$ be a finite totally ramified extension of $K_0 = W(k)[p^{-1}]$. Let $L_0$ be a complete discrete valuation field over $K_0$ whose residue field has a finite $p$-basis, and let $L = L_0\otimes_{K_0} K$. For $0 \leq r \leq p-2$, we classify $\mathbf{Z}_p$-lattices of semistable representations of $\mathrm{Gal}(\overline{L}/L)$ with Hodge-Tate weights in $[0, r]$ by strongly divisible lattices. This generalizes the result of Liu. Moreover, if $\mathcal{X}$ is a proper smooth formal scheme over $\mathcal{O}_L$, we give a cohomological description of the strongly divisible lattice associated to $H^i_{\text{\'et}}(\mathcal{X}_{\overline{L}}, \mathbf{Z}_p)$ for $i \leq p-2$, under the assumption that the crystalline cohomology of the special fiber of $\mathcal{X}$ is torsion-free in degrees $i$ and $i+1$. This generalizes a result in Cais-Liu.


title: Optimisation of Region of Attraction Estimates for the Exponential Stabilisation of the Intrinsic Geometrically Exact Beam Model

abstract: A systematic approach to maximise estimates on the region of attraction in the exponential stabilisation of geometrically exact (nonlinear) beam models via boundary feedback is presented. Starting from recently established stability results based on Lyapunov arguments, the main contribution of the presented work is to maximise the analytically found bounds on the initial datum, for which local exponential stability is guaranteed, via search of (optimal) polynomial Lyapunov functionals using an iterative semi-definite programming approach.


title: Impact of delay classes on the data structure in IOTA

abstract: In distributed ledger technologies (DLTs) with a directed acyclic graph (DAG) data structure, a message-issuing node can decide where to append that message and, consequently, how to grow the DAG. This DAG data structure can typically be decomposed into two pools of messages: referenced messages and unreferenced messages (tips). The selection of the parent messages to which a node appends the messages it issues, depends on which messages it considers as tips. However, the exact time that a message enters the tip pool of a node depends on the delay of that message. In previous works, it was considered that messages have the same or similar delay; however, this generally may not be the case. We introduce the concept of classes of delays, where messages belonging to a certain class have a specific delay, and where these classes coexist in the DAG. We provide a general model that predicts the tip pool size for any finite number of different classes. This categorisation and model is applied to the first iteration of the IOTA 2.0 protocol (a.k.a. Coordicide), where two distinct classes, namely value and data messages, coexist. We show that the tip pool size depends strongly on the dominating class that is present. Finally, we provide a methodology for controlling the tip pool size by dynamically adjusting the number of references a message creates.


title: Searching for Dark Matter with circularly polarised photons from the Galactic Centre

abstract: Conventional indirect dark matter (DM) searches look for an excess in the electromagnetic emission from the sky that cannot be attributed to known astrophysical sources, but its polarisation has not been explored to date. In this proceeding, we argue that photon polarisation is an important feature to understand new physics interactions. In particular, circular polarisation can be generated from Beyond the Standard Model interactions if they violate parity and there is an asymmetry in the number density of the initial state particles which participate in the interaction. We consider a simplified model for fermionic (Majorana) DM and study the circularly polarised gamma rays below 10 GeV from DM cosmic ray electron interactions. We study the differential flux of positive and negative polarised photons from the Galactic Centre and show that the degree of circular polarization can reach up to 90%. Finally, we discuss the detection prospects of this signal in future experiments.


title: Comparison results for solutions of Poisson equations with Robin boundary on complete Riemannian manifolds

abstract: In this paper, by using Schwarz rearrangement and isoperimetric inequalities, we prove comparison results for the solutions of Poisson equations on complete Riemannian manifolds with $Ric\geq (n-1)\kappa$, $\, \kappa\geq 0$, which extends the results in \cite{ANT-Talenti-a}. Furthermore, as applications of our comparison results, we obtain the Saint-Venant inequality and Bossel-Daners inequality for Robin Laplacian.


title: Robust Glare Detection: Review, Analysis, and Dataset Release

abstract: Sun Glare widely exists in the images captured by unmanned ground and aerial vehicles performing in outdoor environments. The existence of such artifacts in images will result in wrong feature extraction and failure of autonomous systems. Humans will try to adapt their view once they observe a glare (especially when driving), and this behavior is an essential requirement for the next generation of autonomous vehicles. The source of glare is not limited to the sun, and glare can be seen in the images captured during the nighttime and in indoor environments, which is due to the presence of different light sources; reflective surfaces also influence the generation of such artifacts. The glare's visual characteristics are different on images captured by various cameras and depend on several factors such as the camera's shutter speed and exposure level. Hence, it is challenging to introduce a general - robust and accurate - algorithm for glare detection that can perform well in various captured images. This research aims to introduce the first dataset for glare detection, which includes images captured by different cameras. Besides, the effect of multiple image representations and their combination in glare detection is examined using the proposed deep network architecture. The released dataset is available at https://github.com/maesfahani/glaredetection


title: Reaction-diffusion on a time-dependent interval: refining the notion of 'critical length'

abstract: A reaction-diffusion equation is studied in a time-dependent interval whose length varies with time. The reaction term is either linear or of KPP type. On a fixed interval, it is well-known that if the length is less than a certain critical value then the solution tends to zero. When the domain length may vary with time, we prove conditions under which the solution does and does not converge to zero in long time. We show that, even with the length always strictly less than the 'critical length', either outcome may occur. Examples are given. The proof is based on upper and lower estimates for the solution, which are derived in this paper for a general time-dependent interval.


title: A variational principle for Gaussian lattice sums

abstract: We consider a two-dimensional analogue of Jacobi theta functions and prove that, among all lattices $\Lambda \subset \mathbb{R}^2$ with fixed density, the minimal value is maximized by the hexagonal lattice. This result can be interpreted as the dual of a 1988 result of Montgomery who proved that the hexagonal lattice minimizes the maximal values. Our inequality resolves a conjecture of Strohmer and Beaver about the operator norm of a certain type of frame in $L^2(\mathbb{R})$. It has implications for minimal energies of ionic crystals studied by Born, the geometry of completely monotone functions and a connection to the elusive Landau constant.


title: Dynamics of scientific collaboration networks due to academic migrations

abstract: Academic migration is the change of host institution by a researcher, typically aimed at achieving a stronger research profile. Scientific features such as the number of collaborations, the productivity and its research impact tend to be directly affected by such movements. In this paper, we analyse the dynamics of the collaboration network of researchers as they move from an institution to the next one. We specifically highlight cases where they increase and when they shrink, and quantify the dependency between the collaboration networks before and after such a movement. Finally, we drill down the analysis by dividing movements depending on the career stage of the researchers. The analysis shows a remarkable dynamism of collaboration networks across migrations. Interestingly, not always movements result in larger collaboration networks, while the overall similarity between networks across movements is quite limited on average. Qualitatively, the same effects can be found at all career stages, while, clearly, the magnitude of them might vary. These results are based on a dataset extracted from Scopus, containing detailed scientific information for the publications of 84,141 researchers.


title: Ab initio Calculation of Binding Energies of Interstellar Sulphur-Containing Species on Crystalline Water Ice Models

abstract: There are different environments in the interstellar medium (ISM), depending on the density, temperature and chemical composition. Among them, molecular clouds, often referred to as the cradle of stars, are paradigmatic environments relative to the chemical diversity and complexity in space. Indeed, there, radio to far-infrared observations revealed the presence of several molecules in the gas phase, while near-infrared spectroscopy detected the existence of submicron sized dust grains covered by H2O -dominated ice mantles. The interaction between gas-phase species and the surfaces of water ices is measured by the binding energy (BE), a crucial parameter in astrochemical modelling. In this work, the BEs of a set of sulphur-containing species on water ice mantles have been computed by adopting a periodic ab initio approach using a crystalline surface model. The Density Functional Theory (DFT)-based B3LYP-D3(BJ) functional was used for the prediction of the structures and energetics. DFT BEs were refined by adopting an ONIOM-like procedure to estimate them at CCSD(T) level toward complete basis set extrapolation, in which a very good correlation between values has been found. Moreover, we show that geometry optimization with the computationally cheaper HF-3c method followed by single point energy calculations at DFT to compute the BEs is a suitable cost-effective recipe to arrive at BE values of the same quality as those computed at full DFT level. Finally, computed data were compared with the available literature data.


title: A Modeling Framework for Efficient Reduced Order Simulations of Parametrized Lithium-Ion Battery Cells

abstract: In this contribution we present a new modeling and simulation framework for parametrized Lithium-ion battery cells. We first derive a new continuum model for a rather general intercalation battery cell on the basis of non-equilibrium thermodynamics. In order to efficiently evaluate the resulting parameterized non-linear system of partial differential equations the reduced basis method is employed. The reduced basis method is a model order reduction technique on the basis of an incremental hierarchical approximate proper orthogonal decomposition approach and empirical operator interpolation. The modeling framework is particularly well suited to investigate and quantify degradation effects of battery cells. Several numerical experiments are given to demonstrate the scope and efficiency of the modeling framework.


title: Anisotropically large anomalous and topological Hall effect in a kagome magnet

abstract: Recently, kagome materials have become an engrossing platform to study the interplay among symmetry, magnetism, topology, and electron correlation. The latest works on RMn6Sn6 (R = rare earth metal) compounds have illustrated that this family could be intriguing to investigate various physical phenomena due to large spin-orbit coupling and strong magnetic ordering. However, combined transport and spectroscopic studies in RMn6Sn6 materials are still limited. Here, we report magnetic, magneto-transport, and angle-resolved photoemission spectroscopy measurements of a kagome magnet ErMn6Sn6 that undergoes antiferromagnetic (TN = 345 K) to ferrimagnetic (TC = 68 K) phase transitions in the presence of field. We observe large anomalous and topological Hall effects serving as transport signatures of the nontrivial Berry curvature. The isothermal magnetization exhibits strong anisotropic nature and the topological Hall effect of the compound depends on the critical field of metamagnetic transition. Our spectroscopic results complemented by theoretical calculations show the multi-orbital kagome fermiology. This work provides new insight into the tunability and interplay of topology and magnetism in a kagome magnet.


title: On Wave-Based Majority Gates with Cellular Automata

abstract: We demonstrate a discrete implementation of a wave-based majority gate in a chaotic Life-like cellular automaton. The gate functions via controlling of patterns' propagation into stationary channels. The gate presented is realisable in many living and non-living substrates that show wave-like activity of its space-time dynamics or pattern propagation. In the gate a symmetric pattern represents a binary value 0 while a non-symmetric pattern represents a binary value 1. Origination of the patterns and their symmetry type are encoded by the particle reactions at the beginning of computation. The patterns propagate in channels of the gate and compete for the space at the intersection of the channels. We implement 3-inputs majority gates using a W topology showing additional implementations of 5-inputs majority gates and one tree (cascade) majority gate.


title: Rethinking Supervised Pre-training for Better Downstream Transferring

abstract: The pretrain-finetune paradigm has shown outstanding performance on many applications of deep learning, where a model is pre-trained on a upstream large dataset (e.g. ImageNet), and is then fine-tuned to different downstream tasks. Though for most cases, the pre-training stage is conducted based on supervised methods, recent works on self-supervised pre-training have shown powerful transferability and even outperform supervised pre-training on multiple downstream tasks. It thus remains an open question how to better generalize supervised pre-training model to downstream tasks. In this paper, we argue that the worse transferability of existing supervised pre-training methods arise from the negligence of valuable intra-class semantic difference. This is because these methods tend to push images from the same class close to each other despite of the large diversity in their visual contents, a problem to which referred as "overfit of upstream tasks". To alleviate this problem, we propose a new supervised pre-training method based on Leave-One-Out K-Nearest-Neighbor, or LOOK for short. It relieves the problem of overfitting upstream tasks by only requiring each image to share its class label with most of its k nearest neighbors, thus allowing each class to exhibit a multi-mode distribution and consequentially preserving part of intra-class difference for better transferring to downstream tasks. We developed efficient implementation of the proposed method that scales well to large datasets. Experimental studies on multiple downstream tasks show that LOOK outperforms other state-of-the-art methods for supervised and self-supervised pre-training.


title: Structural invariants in individuals language use: the "ego network" of words

abstract: The cognitive constraints that humans exhibit in their social interactions have been extensively studied by anthropologists, who have highlighted their regularities across different types of social networks. We postulate that similar regularities can be found in other cognitive processes, such as those involving language production. In order to provide preliminary evidence for this claim, we analyse a dataset containing tweets of a heterogeneous group of Twitter users (regular users and professional writers). Leveraging a methodology similar to the one used to uncover the well-established social cognitive constraints, we find that a concentric layered structure (which we call ego network of words, in analogy to the ego network of social relationships) very well captures how individuals organise the words they use. The size of the layers in this structure regularly grows (approximately 2-3 times with respect to the previous one) when moving outwards, and the two penultimate external layers consistently account for approximately 60% and 30% of the used words (the outermost layer contains 100% of the words), irrespective of the number of the total number of layers of the user.


title: Hamilton-Jacobi scaling limits of Pareto peeling in 2D

abstract: Pareto hull peeling is a discrete algorithm, generalizing convex hull peeling, for sorting points in Euclidean space. We prove that Pareto peeling of a random point set in two dimensions has a scaling limit described by a first-order Hamilton-Jacobi equation and give an explicit formula for the limiting Hamiltonian, which is both non-coercive and non-convex. This contrasts with convex peeling, which converges to curvature flow. The proof involves direct geometric manipulations in the same spirit as Calder (2016).


title: Emerging Directions in Geophysical Inversion

abstract: In this chapter, we survey some recent developments in the field of geophysical inversion. We aim to provide an accessible general introduction to the breadth of current research, rather than focussing in depth on particular topics. In particular, we hope to give the reader an appreciation for the similarities and connections between different approaches, and their relative strengths and weaknesses.


title: On the Security Risks of AutoML

abstract: Neural Architecture Search (NAS) represents an emerging machine learning (ML) paradigm that automatically searches for models tailored to given tasks, which greatly simplifies the development of ML systems and propels the trend of ML democratization. Yet, little is known about the potential security risks incurred by NAS, which is concerning given the increasing use of NAS-generated models in critical domains. This work represents a solid initial step towards bridging the gap. Through an extensive empirical study of 10 popular NAS methods, we show that compared with their manually designed counterparts, NAS-generated models tend to suffer greater vulnerability to various malicious attacks (e.g., adversarial evasion, model poisoning, and functionality stealing). Further, with both empirical and analytical evidence, we provide possible explanations for such phenomena: given the prohibitive search space and training cost, most NAS methods favor models that converge fast at early training stages; this preference results in architectural properties associated with attack vulnerability (e.g., high loss smoothness and low gradient variance). Our findings not only reveal the relationships between model characteristics and attack vulnerability but also suggest the inherent connections underlying different attacks. Finally, we discuss potential remedies to mitigate such drawbacks, including increasing cell depth and suppressing skip connects, which lead to several promising research directions.