title: Analytic conformal bootstrap and Virasoro primary fields in the Ashkin-Teller model

abstract: We revisit the critical two-dimensional Ashkin-Teller model, i.e. the $\mathbb{Z}_2$ orbifold of the compactified free boson CFT at $c=1$. We solve the model on the plane by computing its three-point structure constants and proving crossing symmetry of four-point correlation functions. We do this not only for affine primary fields, but also for Virasoro primary fields, i.e. higher twist fields and degenerate fields. This leads us to clarify the analytic properties of Virasoro conformal blocks and fusion kernels at $c=1$. We show that blocks with a degenerate channel field should be computed by taking limits in the central charge, rather than in the conformal dimension. In particular, Al. Zamolodchikov's simple explicit expression for the blocks that appear in four-twist correlation functions is only valid in the non-degenerate case: degenerate blocks, starting with the identity block, are more complicated generalized theta functions.


title: Meta-learning for Matrix Factorization without Shared Rows or Columns

abstract: We propose a method that meta-learns a knowledge on matrix factorization from various matrices, and uses the knowledge for factorizing unseen matrices. The proposed method uses a neural network that takes a matrix as input, and generates prior distributions of factorized matrices of the given matrix. The neural network is meta-learned such that the expected imputation error is minimized when the factorized matrices are adapted to each matrix by a maximum a posteriori (MAP) estimation. We use a gradient descent method for the MAP estimation, which enables us to backpropagate the expected imputation error through the gradient descent steps for updating neural network parameters since each gradient descent step is written in a closed form and is differentiable. The proposed method can meta-learn from matrices even when their rows and columns are not shared, and their sizes are different from each other. In our experiments with three user-item rating datasets, we demonstrate that our proposed method can impute the missing values from a limited number of observations in unseen matrices after being trained with different matrices.


title: Analysis and Control of a Planar Quadrotor

abstract: In this paper, we model the planar motion of a quadcopter, and develop a linear model of the same. We perform stability analysis of the open loop system and develop a PD controller for its position control. We compare the closed loop response between the linear and non linear systems using the controller developed for the linear system. We also perform stability analysis for the linear and non linear systems, and compare the PD controller with modern deep neural methods based on reinforcement learning actor-critic networks.


title: TWAG: A Topic-Guided Wikipedia Abstract Generator

abstract: Wikipedia abstract generation aims to distill a Wikipedia abstract from web sources and has met significant success by adopting multi-document summarization techniques. However, previous works generally view the abstract as plain text, ignoring the fact that it is a description of a certain entity and can be decomposed into different topics. In this paper, we propose a two-stage model TWAG that guides the abstract generation with topical information. First, we detect the topic of each input paragraph with a classifier trained on existing Wikipedia articles to divide input documents into different topics. Then, we predict the topic distribution of each abstract sentence, and decode the sentence from topic-aware representations with a Pointer-Generator network. We evaluate our model on the WikiCatSum dataset, and the results show that \modelnames outperforms various existing baselines and is capable of generating comprehensive abstracts. Our code and dataset can be accessed at \url{https://github.com/THU-KEG/TWAG}


title: Steps towards a Dislocation Ontology for Crystalline Materials

abstract: The field of Materials Science is concerned with, e.g., properties and performance of materials. An important class of materials are crystalline materials that usually contain ``dislocations'' -- a line-like defect type. Dislocation decisively determine many important materials properties. Over the past decades, significant effort was put into understanding dislocation behavior across different length scales both with experimental characterization techniques as well as with simulations. However, for describing such dislocation structures there is still a lack of a common standard to represent and to connect dislocation domain knowledge across different but related communities. An ontology offers a common foundation to enable knowledge representation and data interoperability, which are important components to establish a ``digital twin''. This paper outlines the first steps towards the design of an ontology in the dislocation domain and shows a connection with the already existing ontologies in the materials science and engineering domain.


title: Diffusive relaxation to equilibria for an extended reaction-diffusion system on the real line

abstract: We study the long-time behavior of the solutions of a two-component reaction-diffusion system on the real line, which describes the basic chemical reaction $A <=> 2 B$. Assuming that the initial densities of the species $A, B$ are bounded and nonnegative, we prove that the solution converges uniformly on compact sets to the manifold $E$ of all spatially homogeneous chemical equilibria. The result holds even if the species diffuse at very different rates, but the proof is substantially simpler for equal diffusivities. In the spirit of our previous work on extended dissipative systems [18], our approach relies on localized energy estimates, and provides an explicit bound for the time needed to reach a neighborhood of the manifold $E$ starting from arbitrary initial data. The solutions we consider typically do not converge to a single equilibrium as $t \to +\infty$, but they are always quasiconvergent in the sense that their omega-limit sets consist of chemical equilibria.


title: Spherically Symmetric Gravitational Collapse Of Inhomogeneous Dust Cloud In The Background Of Dark Energy

abstract: The present paper deals with the gravitational collapse of an inhomogeneous spherical star consisting of dust fluid in the background of dark energy components with linear equation of state. We discussed the development of apparent horizon to investigate the black-hole formation in gravitational collapsing process. The collapsing process is examined first separately for dust cloud and dark energy and then under the combined effect of dust interacting with dark energy. It is obtained that when only dust cloud or dark energy is present the collapse leads to the formation of black-hole under certain conditions. When both of them are present, collapsing star does not form black-hole. However when dark energy is considered as cosmological constant, the collapse leads to black hole formation.


title: Covariant Decomposition of The Non-Linear Galaxy Number Counts and Their Monopole

abstract: We present a fully non-linear and relativistically covariant expression for the observed galaxy density contrast. Building on a null tetrad tailored to the cosmological observer's past light cone, we find a decomposition of the non-linear galaxy over-density into manifestly gauge-invariant quantities, each of which has a clear physical interpretation as a cosmological observable. This ensures that the monopole of the galaxy over-density field (the mean galaxy density as a function of observed redshift) is properly accounted for. We anticipate that this decomposition will be useful for future work on non-linearities in galaxy number counts, for example, deriving the relativistic expression for the galaxy bispectrum. We then specialise our results to conformal Newtonian gauge, with a Hubble parameter either defined globally or measured locally, illustrating the significance of the different contributions to the observed monopole of the galaxy density.


title: From ESPRIT to ESPIRA: Estimation of Signal Parameters by Iterative Rational Approximation

abstract: We introduce a new method for Estimation of Signal Parameters based on Iterative Rational Approximation (ESPIRA) for sparse exponential sums. Our algorithm uses the AAA algorithm for rational approximation of the discrete Fourier transform of the given equidistant signal values. We show that ESPIRA can be interpreted as a matrix pencil method applied to Loewner matrices. These Loewner matrices are closely connected with the Hankel matrices which are usually employed for signal recovery. Due to the construction of the Loewner matrices via an adaptive selection of index sets, the matrix pencil method is stabilized. ESPIRA achieves similar recovery results for exact data as ESPRIT and the matrix pencil method but with less computational effort. Moreover, ESPIRA strongly outperforms ESPRIT and the matrix pencil method for noisy data and for signal approximation by short exponential sums.


title: Maxima of log-correlated fields: some recent developments

abstract: We review recent progress relating to the extreme value statistics of the characteristic polynomials of random matrices associated with the classical compact groups, and of the Riemann zeta-function and other $L$-functions, in the context of the general theory of logarithmically-correlated Gaussian fields. In particular, we focus on developments related to the conjectures of Fyodorov \& Keating concerning the extreme value statistics, moments of moments, connections to Gaussian Multiplicative Chaos, and explicit formulae derived from the theory of symmetric functions.


title: Topic-to-Essay Generation with Comprehensive Knowledge Enhancement

abstract: Generating high-quality and diverse essays with a set of topics is a challenging task in natural language generation. Since several given topics only provide limited source information, utilizing various topic-related knowledge is essential for improving essay generation performance. However, previous works cannot sufficiently use that knowledge to facilitate the generation procedure. This paper aims to improve essay generation by extracting information from both internal and external knowledge. Thus, a topic-to-essay generation model with comprehensive knowledge enhancement, named TEGKE, is proposed. For internal knowledge enhancement, both topics and related essays are fed to a teacher network as source information. Then, informative features would be obtained from the teacher network and transferred to a student network which only takes topics as input but provides comparable information compared with the teacher network. For external knowledge enhancement, a topic knowledge graph encoder is proposed. Unlike the previous works only using the nearest neighbors of topics in the commonsense base, our topic knowledge graph encoder could exploit more structural and semantic information of the commonsense knowledge graph to facilitate essay generation. Moreover, the adversarial training based on the Wasserstein distance is proposed to improve generation quality. Experimental results demonstrate that TEGKE could achieve state-of-the-art performance on both automatic and human evaluation.


title: Exploring the inner-disk region of the atoll source 4U 1705-44 using AstroSat's SXT and LAXPC observations

abstract: For the first time, simultaneous broadband spectral and timing study of the atoll source 4U 1705-44 was performed using AstroSat Soft X-ray Telescope (SXT) and Large Area X-ray Proportional Counter (LAXPC) data (0.8-70 keV). Based on the HID, the source was in the soft banana state during these observations. Spectral modeling was performed using the full reflection framework and an inner disk radii of 14 Rg was obtained. A hard powerlaw tail was noticed in the soft state and hot component fluxes and varying powerlaw indices point towards a varying corona/sub-keplerian flow. Based on the spectral fits the boundary layer radius and magnetospheric radius were constrained to be $\sim$ 14-18 km and $\sim$ 9-19 km respectively. Cross- Correlation Function studies were performed between the 0.8-3 keV soft SXT lightcurve and 10-20 keV hard LAXPC lightcurve and correlated and anticorrelated lags were found, which was used to constrain the coronal height to 0.6-20 km (\b{eta}=0.1). Since the inner disk radius is not varying during the observations, we conclude that the detected lags are possibly caused by a varying structure of corona/boundary layer in the inner region of the accretion disk. Based on the observations, a geometrical model is proposed for explaining the detected lags in the atoll source 4U 1705-44.


title: Hierarchical Context-Aware Transformers for Non-Autoregressive Text to Speech

abstract: In this paper, we propose methods for improving the modeling performance of a Transformer-based non-autoregressive text-to-speech (TNA-TTS) model. Although the text encoder and audio decoder handle different types and lengths of data (i.e., text and audio), the TNA-TTS models are not designed considering these variations. Therefore, to improve the modeling performance of the TNA-TTS model we propose a hierarchical Transformer structure-based text encoder and audio decoder that are designed to accommodate the characteristics of each module. For the text encoder, we constrain each self-attention layer so the encoder focuses on a text sequence from the local to the global scope. Conversely, the audio decoder constrains its self-attention layers to focus in the reverse direction, i.e., from global to local scope. Additionally, we further improve the pitch modeling accuracy of the audio decoder by providing sentence and word-level pitch as conditions. Various objective and subjective evaluations verified that the proposed method outperformed the baseline TNA-TTS.


title: Consistency testing for invariance of the speed of light at different redshifts: the newest results from strong lensing and type Ia supernovae observations

abstract: The invariance of the speed of light in the distant universe has profound significance for fundamental physics. In this paper, we propose a new model-independent method to test the invariance of the speed of light $c$ at different redshifts by combining the strong gravitational lensing (SGL) systems and the observations of type-Ia supernovae (SNe Ia). All the quantities used to test the deviation of $c$ come from the direct observations, and the absolute magnitudes of SNe Ia need not to be calibrated. Our results show that the speed of light in the distant universe is no obvious deviation from the constant value $c_0$ within the uncertainty based on current observations. Moreover, we conclude that the currently compiled SGL and SNe Ia Pantheon samples may achieve much higher precision $\Delta c/c\sim10^{-2}$ for the deviation of $c$ than all previously considered approaches. The forthcoming data from the Legacy Survey of Space and Time and Wide-Field InfraRed Space Telescope will achieve more stringent testing for deviation of the SOL (at the level of $\Delta c/c \sim10^{-3}$) by using our model-independent method. Finally, we discuss the potential ways in which our technique might be improved, focusing on the treatment of possible sources of systematic uncertainties.


title: Learning from Multiple Annotators by Incorporating Instance Features

abstract: Learning from multiple annotators aims to induce a high-quality classifier from training instances, where each of them is associated with a set of possibly noisy labels provided by multiple annotators under the influence of their varying abilities and own biases. In modeling the probability transition process from latent true labels to observed labels, most existing methods adopt class-level confusion matrices of annotators that observed labels do not depend on the instance features, just determined by the true labels. It may limit the performance that the classifier can achieve. In this work, we propose the noise transition matrix, which incorporates the influence of instance features on annotators' performance based on confusion matrices. Furthermore, we propose a simple yet effective learning framework, which consists of a classifier module and a noise transition matrix module in a unified neural network architecture. Experimental results demonstrate the superiority of our method in comparison with state-of-the-art methods.


title: SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption

abstract: Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are domain-specific and little has been done to leverage this technique on real-world tabular datasets. We propose SCARF, a simple, widely-applicable technique for contrastive learning, where views are formed by corrupting a random subset of features. When applied to pre-train deep neural networks on the 69 real-world, tabular classification datasets from the OpenML-CC18 benchmark, SCARF not only improves classification accuracy in the fully-supervised setting but does so also in the presence of label noise and in the semi-supervised setting where only a fraction of the available training data is labeled. We show that SCARF complements existing strategies and outperforms alternatives like autoencoders. We conduct comprehensive ablations, detailing the importance of a range of factors.


title: GTMD model predictions for diffractive dijet production at EIC

abstract: In this paper we consider a small-$x$ model for gluon GTMDs that we fit to data on diffractive dijet production in electron-proton collisions obtained by HERA's H1 Collaboration. Assuming a small number of free parameters, each with a physical motivation, we are able to describe those data fairly well and with this model we obtain predictions for the EIC for both electroproduction and photoproduction which may allow to further test the underlying GTMD description. In the general discussion of the impact parameter dependence we recall some subtle issues related to localization of states, choice of frames, and discuss what these aspects imply for the range of applicability of the model.


title: Proposal for suppressing ac Stark shift in the He($2\,^3S_1\rightarrow 3\,^3S_1$) two-photon transition using magic wavelengths

abstract: Motivated by recent direct measurement of the forbidden $2\,^3S_1\rightarrow3\,^3S_1$ transition in helium [K. F. Thomas et al., Phys. Rev. Lett. 125, 013002(2020)], where the ac Stark shift is one of the main systematic uncertainties, we propose a dichroic two-photon transition measurement for $2\,^3S_1\rightarrow3\,^3S_1$ which could effectively suppress the ac Stark shift by utilizing magic wavelengths: one magic wavelength is used to realize state-insensitive optical trapping, the other magic wavelength is used as one of the two lasers driving the two-photon transition. Carrying out calculations based on the no-pair Dirac-Coulomb-Breit Hamiltonian with mass shift operator included, we report the magic wavelength of 1265.615 9(4) nm for $^4$He [or 1265.683 9(2) nm for $^3$He] can be used to design an optical dipole trap; the magic wavelength of 934.234 5(2) nm for $^4$He [or 934.255 4(4) nm for $^3$He] can be as one excitation laser in the two-photon process, and the ac Stark shift can be reduced to less than 100 kHz, as long as the intensity of the other excitation laser does not exceed $1\times10^4~W/cm^2$. Alternatively, by selecting detuning frequencies relative to the $2\,^3P$ state in the region of 82$\sim$103 THz, as well as adjusting the intensity ratios of the two lasers, the ac Stark shift in the $2\,^3S_1\rightarrow3\,^3S_1$ two-photon transition can be cancelled.


title: The Price of Selfishness: Conjunctive Query Entailment for ALCSelf is 2ExpTime-hard

abstract: In logic-based knowledge representation, query answering has essentially replaced mere satisfiability checking as the inferencing problem of primary interest. For knowledge bases in the basic description logic ALC, the computational complexity of conjunctive query (CQ) answering is well known to be ExpTime-complete and hence not harder than satisfiability. This does not change when the logic is extended by certain features (such as counting or role hierarchies), whereas adding others (inverses, nominals or transitivity together with role-hierarchies) turns CQ answering exponentially harder. We contribute to this line of results by showing the surprising fact that even extending ALC by just the Self operator - which proved innocuous in many other contexts - increases the complexity of CQ entailment to 2ExpTime. As common for this type of problem, our proof establishes a reduction from alternating Turing machines running in exponential space, but several novel ideas and encoding tricks are required to make the approach work in that specific, restricted setting.


title: Scalable Traffic Predictive Analysis using GPU in Big Data

abstract: The paper adopts parallel computing systems for predictive analysis in both CPU and GPU leveraging Spark Big Data platform. The traffic dataset is adopted to predict the traffic jams in Los Angeles County. It is collected from a popular platform in the USA for tracking information on the road using the device information and reports shared by the users. Large-scale traffic data set can be stored and processed using both GPU and CPU in this Scalable Big Data systems. The major contribution of this paper is to improve the performance of machine learning in distributed parallel computing systems with GPU to predict the traffic congestion. We show that the parallel computing can be achieve using both GPU and CPU with the existing Apache Spark platform. Our method can be applicable to other large scale datasets in different domains. The process modeling, as well as results, are interpreted using computing time and metrics: AUC, Precision and Recall. It should help the traffic management in Smart City.


title: Three-dimensional lattice SU($N_c$) gauge theories with multiflavor scalar fields in the adjoint representation

abstract: We consider three-dimensional lattice SU($N_c$) gauge theories with multiflavor ($N_f>1$) scalar fields in the adjoint representation. We investigate their phase diagram, identify the different Higgs phases with their gauge-symmetry pattern, and determine the nature of the transition lines. In particular, we study the role played by the quartic scalar potential and by the gauge-group representation in determining the Higgs phases and the global and gauge symmetry-breaking patterns characterizing the different transitions. The general arguments are confirmed by numerical analyses of Monte Carlo results for two representative models that are expected to have qualitatively different phase diagrams and Higgs phases. We consider the model with $N_c = 3$, $N_f=2$ and with $N_c=2$, $N_f= 4$. This second case is interesting phenomenologically to describe some features of cuprate superconductors.


title: GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesis

abstract: Recent advances in neural multi-speaker text-to-speech (TTS) models have enabled the generation of reasonably good speech quality with a single model and made it possible to synthesize the speech of a speaker with limited training data. Fine-tuning to the target speaker data with the multi-speaker model can achieve better quality, however, there still exists a gap compared to the real speech sample and the model depends on the speaker. In this work, we propose GANSpeech, which is a high-fidelity multi-speaker TTS model that adopts the adversarial training method to a non-autoregressive multi-speaker TTS model. In addition, we propose simple but efficient automatic scaling methods for feature matching loss used in adversarial training. In the subjective listening tests, GANSpeech significantly outperformed the baseline multi-speaker FastSpeech and FastSpeech2 models, and showed a better MOS score than the speaker-specific fine-tuned FastSpeech2.


title: Free boundary methods and non-scattering phenomena

abstract: We study a question arising in inverse scattering theory: given a penetrable obstacle, does there exist an incident wave that does not scatter? We show that every penetrable obstacle with real-analytic boundary admits such an incident wave. At zero frequency, we use quadrature domains to show that there are also obstacles with inward cusps having this property. In the converse direction, under a nonvanishing condition for the incident wave, we show that there is a dichotomy for boundary points of any penetrable obstacle having this property: either the boundary is regular, or the complement of the obstacle has to be very thin near the point. These facts are proved by invoking results from the theory of free boundary problems.


title: Multilayer spherical stellar cluster with uniform density

abstract: Various solutions of the kinetic equation for the equilibrium of a gravitating sphere of uniform density with a quadratic gravitational potential and a linear dependence of gravitational force on radius are examined. New analytic solutions are obtained for a uniform sphere with a hollow spherical volume and central mass inside the sphere. Solutions are also obtained for an arbitrary number of spherical layers with the same density, but with different equilibrium distribution functions.


title: Magneto-optical detection of topological contributions to the anomalous Hall effect in a kagome ferromagnet

abstract: A single ferromagnetic kagome layer is predicted to realize a Chern insulator with quantized Hall conductance, which upon stacking can become a Weyl-semimetal with large anomalous Hall effect (AHE) and magneto-optical activity. Indeed, in the kagome bilayer material Fe$_3$Sn$_2$, a large AHE was detected, however, it still awaits the direct probing of the responsible band structure features by bulk sensitive methods. We measure the optical, both diagonal and Hall, conductivity spectra over a broad spectral range and identify the origin of the intrinsic AHE with the help of momentum- and band-decomposed first-principles calculations. We find that low-energy transitions, tracing "helical volumes" in momentum space reminiscent of the formerly predicted helical nodal lines, substantially contribute to the AHE, which is further increased by contributions from multiple higher-energy interband transitions. Our study also reveals that local Coulomb interactions lead to band reconstructions near the Fermi level.


title: Benchmark computations for the polarization tensor of small conducting objects

abstract: The characterisation of small low conducting inclusions in an otherwise uniform background from low-frequency electrical field measurements has important applications in medical imaging using electrical impedance tomography as well as in geological imaging using electrical resistivity tomography. It is known that such objects can be characterised by a P\'oyla-Szeg\"o (polarizability) tensor. Such characterisations have attracted interest as they can provide object features in a machine learning classification algorithm and provide an alternative imaging solution. However, to be able train machine learning algorithms, large dictionaries are required and it is essential that the characterisations are accurate. In this work, we obtain accurate numerical approximations to the tensor coefficients, by applying an adaptive boundary element method. The goal being to provide a sequence of benchmark {computations} for the tensor coefficients to allow other software developers check the accuracy of their codes.


title: End-to-end Waveform Learning Through Joint Optimization of Pulse and Constellation Shaping

abstract: As communication systems are foreseen to enable new services such as joint communication and sensing and utilize parts of the sub-THz spectrum, the design of novel waveforms that can support these emerging applications becomes increasingly challenging. We present in this work an end-to-end learning approach to design waveforms through joint learning of pulse shaping and constellation geometry, together with a neural network (NN)-based receiver. Optimization is performed to maximize an achievable information rate, while satisfying constraints on out-of-band emission and power envelope. Our results show that the proposed approach enables up to orders of magnitude smaller adjacent channel leakage ratios (ACLRs) with peak-to-average power ratios (PAPRs) competitive with traditional filters, without significant loss of information rate on an additive white Gaussian noise (AWGN) channel, and no additional complexity at the transmitter.


title: Machine learning for plant microRNA prediction: A systematic review

abstract: MicroRNAs (miRNAs) are endogenous small non-coding RNAs that play an important role in post-transcriptional gene regulation. However, the experimental determination of miRNA sequence and structure is both expensive and time-consuming. Therefore, computational and machine learning-based approaches have been adopted to predict novel microRNAs. With the involvement of data science and machine learning in biology, multiple research studies have been conducted to find microRNAs with different computational methods and different miRNA features. Multiple approaches are discussed in detail considering the learning algorithm/s used, features considered, dataset/s used and the criteria used in evaluations. This systematic review focuses on the machine learning methods developed for miRNA identification in plants. This will help researchers to gain a detailed idea about past studies and identify novel paths that solve drawbacks occurred in past studies. Our findings highlight the need for plant-specific computational methods for miRNA identification.


title: Role of intermetallic phases in initiation and propagation of intergranular corrosion of an Al-Li-Cu-Mg alloy

abstract: Intermetallic phases in a recently developed Al-Li-Cu-Mg alloy have been investigated to understand their roles in the initiation and propagation processes of intergranular corrosion. Corrosion initiation involves trenching formation in the Al matrix adjacent to the large particles of Al7Cu2(Fe, Mn) phases. These phases containing Li are electrochemically active and susceptible to self-dissolution via a de-alloying mechanism during corrosion process. The subsurface particles of Al7Cu2(Fe, Mn) and Al20Cu2Mn3 phases act as the internal cathodes for continuous corrosion propagation along the particle-matrix interface and the associated grain boundaries. Corrosion propagation along the particle-matrix interface was facilitated by the anodic dissolution of the surrounding Al matrix due to the micro-galvanic interaction with the cathodic intermetallic phases. In addition, T1 (Al2CuLi) precipitates and the isolated particles of Al7Cu2(Fe, Mn) and Al20Cu2Mn3 phases were dissolved along the path of corrosion propagation. The dissolved metal ions were redeposited through the network of crevice.


title: Non-Point Visible Light Transmitter Localization based on Monocular Camera

abstract: Many algorithms for visible light positioning (VLP) localization do not consider the shapes of the transmitters, which leads to the impracticality of the algorithm and the low localization accuracy. Therefore, this paper proposes a novel VLP algorithm and addresses the problems in terms of practicality and complexity by using one non-point transmitter based on a monocular. Because the shape of the transmitter is considered, the proposed algorithm is easy for practice and has wide applicability. Besides, it decreases the computation for simple geometric model and expands the coverage for there is a greater chance of receiving signals from one light than that of receiving signals from multiple lights.


title: Location of the Zeros of Certain Complex-Valued Harmonic Polynomials

abstract: Finding an approximate region containing all the zeros of analytic polynomials is a well-studied problem. But the numb er of the zeros and regions containing all the zeros of complex-valued harmonic polynomials is relatively a fresh research area. It is well known that all the zeros of analytic trinomials are enclosed in some annular sectors that take into account the magnitude of the coefficients. Following Kennedy and Dehmer, we provide the zero inclusion regions of all the zeros of complex-valued harmonic polynomials in general, and in particular, we bound all the zeros of some families of harmonic trinomials in a certain annular region.


title: Observation of gravitational waves from two neutron star-black hole coalescences

abstract: We report the observation of gravitational waves from two compact binary coalescences in LIGO's and Virgo's third observing run with properties consistent with neutron star-black hole (NSBH) binaries. The two events are named GW200105_162426 and GW200115_042309, abbreviated as GW200105 and GW200115; the first was observed by LIGO Livingston and Virgo, and the second by all three LIGO-Virgo detectors. The source of GW200105 has component masses $8.9^{+1.2}_{-1.5}\,M_\odot$ and $1.9^{+0.3}_{-0.2}\,M_\odot$, whereas the source of GW200115 has component masses $5.7^{+1.8}_{-2.1}\,M_\odot$ and $1.5^{+0.7}_{-0.3}\,M_\odot$ (all measurements quoted at the 90% credible level). The probability that the secondary's mass is below the maximal mass of a neutron star is 89%-96% and 87%-98%, respectively, for GW200105 and GW200115, with the ranges arising from different astrophysical assumptions. The source luminosity distances are $280^{+110}_{-110}$ Mpc and $300^{+150}_{-100}$ Mpc, respectively. The magnitude of the primary spin of GW200105 is less than 0.23 at the 90% credible level, and its orientation is unconstrained. For GW200115, the primary spin has a negative spin projection onto the orbital angular momentum at 88% probability. We are unable to constrain spin or tidal deformation of the secondary component for either event. We infer a NSBH merger rate density of $45^{+75}_{-33}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ when assuming GW200105 and GW200115 are representative of the NSBH population, or $130^{+112}_{-69}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ under the assumption of a broader distribution of component masses.


title: Constraining the number of fundamental quantum degrees of freedom using gravity

abstract: We consider the effect of gravity on extended quantum systems (EQS) in the low energy regime. We model the gravitational effect due to a nearby source mass as a redshift in the internal Hamiltonian of the EQS. Due to the dependence of the energy spectrum of the EQS on the position of the massive particle (via the redshift) at zero temperature, our model predicts gravitational decoherence of the massive particle in the position basis. We show that the decoherence effect is multiplicative, in the sense that the increase in number of EQS gravitationally interacting with a single massive particle leads to an increase in its decoherence. If the considered model of gravitational redshift holds alongside the linearity of quantum mechanics (as an appropriate limit of an accepted theory for coupling quantum matter with gravity) to allow for a spatial superposition of the source mass, we propose that the same methodology can be applied to continuous fields, which are essentially EQS. This could provide an upper limit on the number of undiscovered fields by observing coherent superpositions of masses, e.g., in a matter wave interferometer. Besides, by taking a spin chain as a toy model of an EQS, we analyse the dependence of the new effect on relevant system parameters and identify the number of independent spin chains that can cause a detectable effect.


title: Symplectic Novikov Lie Algebra

abstract: It is well known that a symplectic Lie algebra admit a left symmetric product. In this work, we study the case where this product is Novikov, we show that the left-symmetric product associated to the symplectic Lie algrbra is Novikov if and only if it is associative. In this case the symplectic Lie algebra is called symplectic Novikov Lie algebra(SNLA). We show that any SNLA is completely reducible two-step solvable. The classification of $4$-dimensional and nilpotent $6$-dimensional, also some methods for building large classes of examples are presented. Finally, we give a geometric study of the affine connection associated with an SNLA.


title: Disturbance of questionable publishing to academia

abstract: Questionable publications have been accused of "greedy" practices; however, their influence on academia has not been gauged. Here, we probe the impact of questionable publications through a systematic and comprehensive analysis with various participants from academia and compare the results with those of their unaccused counterparts using billions of citation records, including liaisons, i.e., journals and publishers, and prosumers, i.e., authors. Questionable publications attribute publisher-level self-citations to their journals while limiting journal-level self-citations; yet, conventional journal-level metrics are unable to detect these publisher-level self-citations. We propose a hybrid journal-publisher metric for detecting self-favouring citations among QJs from publishers. Additionally, we demonstrate that the questionable publications were less disruptive and influential than their counterparts. Our findings indicate an inflated citation impact of suspicious academic publishers. The findings provide a basis for actionable policy-making against questionable publications.


title: Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition

abstract: Few-shot Named Entity Recognition (NER) exploits only a handful of annotations to identify and classify named entity mentions. Prototypical network shows superior performance on few-shot NER. However, existing prototypical methods fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario. To address the issue, we propose a novel model, Mining Undefined Classes from Other-class (MUCO), that can automatically induce different undefined classes from the other class to improve few-shot NER. With these extra-labeled undefined classes, our method will improve the discriminative ability of NER classifier and enhance the understanding of predefined classes with stand-by semantic knowledge. Experimental results demonstrate that our model outperforms five state-of-the-art models in both 1-shot and 5-shots settings on four NER benchmarks. We will release the code upon acceptance. The source code is released on https: //github.com/shuaiwa16/OtherClassNER.git.


title: Local field reconstruction from rotating coil measurements in particle accelerator magnets

abstract: In this paper a general approach to reconstruct three dimensional field solutions in particle accelerator magnets from distributed magnetic measurements is presented. To exploit the locality of the measurement operation a special discretization of the Laplace equation is used. Extracting the coefficients of the field representations yields an inverse problem which is solved by Bayesian inversion. This allows not only to pave the way for uncertainty quantification, but also to derive a suitable regularization. The approach is applied to rotating coil measurements and can be extended to any other measurement procedure.


title: A level line of the Gaussian free field with measure-valued boundary conditions

abstract: In this article, we construct samples of SLE-like curves out of samples of CLE and Poisson point process of Brownian excursions. We show that the law of these curves depends continuously on the intensity measure of the Brownian excursions. Using such construction of curves, we extend the notion of level lines of GFF to the case when the boundary condition is measure-valued.


title: A laser-plasma platform for photon-photon physics

abstract: We describe a laser-plasma platform for photon-photon collision experiments to measure fundamental quantum electrodynamic processes such as the linear Breit-Wheeler process with real photons. The platform has been developed using the Gemini laser facility at the Rutherford Appleton Laboratory. A laser wakefield accelerator and a bremsstrahlung convertor are used to generate a collimated beam of photons with energies of hundreds of MeV, that collide with keV x-ray photons generated by a laser heated plasma target. To detect the pairs generated by the photon-photon collisions, a magnetic transport system has been developed which directs the pairs onto scintillation-based and hybrid silicon pixel single particle detectors. We present commissioning results from an experimental campaign using this laser-plasma platform for photon-photon physics, demonstrating successful generation of both photon sources, characterisation of the magnetic transport system and calibration of the single particle detectors, and discuss the feasibility of this platform for the observation of the Breit-Wheeler process. The design of the platform will also serve as the basis for the investigation of strong-field quantum electrodynamic processes such as the nonlinear Breit-Wheeler and the Trident process, or eventually, photon-photon scattering.


title: Spatio-Temporal Context for Action Detection

abstract: Research in action detection has grown in the recentyears, as it plays a key role in video understanding. Modelling the interactions (either spatial or temporal) between actors and their context has proven to be essential for this task. While recent works use spatial features with aggregated temporal information, this work proposes to use non-aggregated temporal information. This is done by adding an attention based method that leverages spatio-temporal interactions between elements in the scene along the clip.The main contribution of this work is the introduction of two cross attention blocks to effectively model the spatial relations and capture short range temporal interactions.Experiments on the AVA dataset show the advantages of the proposed approach that models spatio-temporal relations between relevant elements in the scene, outperforming other methods that model actor interactions with their context by +0.31 mAP.


title: Uncovering structural diversity in commuting networks. Global and local entropy

abstract: In this paper we revisit the concept of mobility entropy. Over time, the structure of spatial interactions among urban centres tends to become more complex and evolves from centralised models to more scattered origin and destination patterns. Entropy measures can be used to explore this complexity, and to quantify the degree of structural diversity of in- and out-flows at different scales and across the system. We use toy models of commuting networks to examine global and local measures, allowing the comparison to occur between different parts of the system. We show that entropy at the link and node level give different insights on the characteristics of the systems, enabling us to identify employment hubs and interdependencies between and within different parts of the system. We discuss how these can be used to inform planning and policy decisions oriented towards decentralisation and resilience.


title: Random embeddings with an almost Gaussian distortion

abstract: Let $X$ be a symmetric, isotropic random vector in $\mathbb{R}^m$ and let $X_1...,X_n$ be independent copies of $X$. We show that under mild assumptions on $\|X\|_2$ (a suitable thin-shell bound) and on the tail-decay of the marginals $\langle X,u\rangle$, the random matrix $A$, whose columns are $X_i/\sqrt{m}$ exhibits a Gaussian-like behaviour in the following sense: for an arbitrary subset of $T\subset \mathbb{R}^n$, the distortion $\sup_{t \in T} | \|At\|_2^2 - \|t\|_2^2 |$ is almost the same as if $A$ were a Gaussian matrix. A simple outcome of our result is that if $X$ is a symmetric, isotropic, log-concave random vector and $n \leq m \leq c_1(\alpha)n^\alpha$ for some $\alpha>1$, then with high probability, the extremal singular values of $A$ satisfy the optimal estimate: $1-c_2(\alpha) \sqrt{n/m} \leq \lambda_{\rm min} \leq \lambda_{\rm max} \leq 1+c_2(\alpha) \sqrt{n/m}$.


title: Fluctuations and non-Gaussianity in de Sitter spacetime from holographic entanglement entropy

abstract: Using entanglement in dS/CFT correspondence, we show that a 4-dimensional de Sitter spacetime in the bulk fluctuates. We calculated the fluctuations of the entanglement entropy, which backreacts with the geometry of the bulk spacetime indicated by the fluctuations of the horizon radius. The variance of the fluctuations is suppressed by $G_N$ and multiplied by $H_{dS}^2$. Therefore, it will be more significant during the primordial era where it is also well described by de Sitter geometry. We also show that the distribution of the fluctuations is also skewed with the local non-linearity parameter is in the order of $f_{NL}\sim\mathcal{O}(1)$ and we present the probability density function with corrections up to $\sigma_\Phi^3$.


title: Graphs of low average degree without independent transversals

abstract: An independent transversal of a graph $G$ with a vertex partition $\mathcal P$ is an independent set of $G$ intersecting each block of $\mathcal P$ in a single vertex. Wanless and Wood proved that if each block of $\mathcal P$ has size at least $t$ and the average degree of vertices in each block is at most $t/4$, then an independent transversal of $\mathcal P$ exists. We present a construction showing that this result is optimal: for any $\varepsilon > 0$ and sufficiently large $t$, there is a family of forests with vertex partitions whose block size is at least $t$, average degree of vertices in each block is at most $(\frac14+\varepsilon)t$, and there is no independent transversal. This unexpectedly shows that methods related to entropy compression such as the Rosenfeld-Wanless-Wood scheme or the Local Cut Lemma are tight for this problem. Further constructions are given for variants of the problem, including the hypergraph version.


title: TUCaN: Progressively Teaching Colourisation to Capsules

abstract: Automatic image colourisation is the computer vision research path that studies how to colourise greyscale images (for restoration). Deep learning techniques improved image colourisation yielding astonishing results. These differ by various factors, such as structural differences, input types, user assistance, etc. Most of them, base the architectural structure on convolutional layers with no emphasis on layers specialised in object features extraction. We introduce a novel downsampling upsampling architecture named TUCaN (Tiny UCapsNet) that exploits the collaboration of convolutional layers and capsule layers to obtain a neat colourisation of entities present in every single image. This is obtained by enforcing collaboration among such layers by skip and residual connections. We pose the problem as a per pixel colour classification task that identifies colours as a bin in a quantized space. To train the network, in contrast with the standard end to end learning method, we propose the progressive learning scheme to extract the context of objects by only manipulating the learning process without changing the model. In this scheme, the upsampling starts from the reconstruction of low resolution images and progressively grows to high resolution images throughout the training phase. Experimental results on three benchmark datasets show that our approach with ImageNet10k dataset outperforms existing methods on standard quality metrics and achieves state of the art performances on image colourisation. We performed a user study to quantify the perceptual realism of the colourisation results demonstrating: that progressive learning let the TUCaN achieve better colours than the end to end scheme; and pointing out the limitations of the existing evaluation metrics.


title: Structural engineering from an inverse problems perspective

abstract: The field of structural engineering is vast, spanning areas from the design of new infrastructure to the assessment of existing infrastructure. From the onset, traditional entry-level university courses teach students to analyse structural response given data including external forces, geometry, member sizes, restraint, etc. -- characterising a forward problem (structural causalities $\to$ structural response). Shortly thereafter, junior engineers are introduced to structural design where they aim to, for example, select an appropriate structural form for members based on design criteria, which is the inverse of what they previously learned. Similar inverse realisations also hold true in structural health monitoring and a number of structural engineering sub-fields (response $\to$ structural causalities). In this light, we aim to demonstrate that many structural engineering sub-fields may be fundamentally or partially viewed as inverse problems and thus benefit via the rich and established methodologies from the inverse problems community. To this end, we conclude that the future of inverse problems in structural engineering is inexorably linked to engineering education and machine learning developments.


title: Deep Inertial Navigation using Continuous Domain Adaptation and Optimal Transport

abstract: In this paper, we propose a new strategy for learning inertial robotic navigation models. The proposed strategy enhances the generalisability of end-to-end inertial modelling, and is aimed at wheeled robotic deployments. Concretely, the paper describes the following. (1) Using precision robotics, we empirically characterise the effect of changing the sensor position during navigation on the distribution of raw inertial signals, as well as the corresponding impact on learnt latent spaces. (2) We propose neural architectures and algorithms to assimilate knowledge from an indexed set of sensor positions in order to enhance the robustness and generalisability of robotic inertial tracking in the field. Our scheme of choice uses continuous domain adaptation (DA) and optimal transport (OT). (3) In our evaluation, continuous OT DA outperforms a continuous adversarial DA baseline, while also showing quantifiable learning benefits over simple data augmentation. We will release our dataset to help foster future research.


title: Wrong Colored Vermeer: Color-Symmetric Image Distortion

abstract: Color symmetry implies that the colors of geometrical objects are assigned according to their symmetry properties. It is defined by associating the elements of the symmetry group with a color permutation. I use this concept for generative art and apply symmetry-consistent color distortions to images of paintings by Johannes Vermeer. The color permutations are realized as mappings of the HSV color space onto itself.


title: Decomposition of locally compact coset spaces

abstract: In a previous article by the author and P. Wesolek, it was shown that a compactly generated locally compact group $G$ admits a finite normal series $(G_i)$ in which the factors are compact, discrete or irreducible in the sense that no closed normal subgroup of $G$ lies properly between $G_{i-1}$ and $G_{i}$. In the present article, we generalize this series to an analogous decomposition of the coset space $G/H$ with respect to closed subgroups, where $G$ is locally compact and $H$ is compactly generated. This time, the irreducible factors are coset spaces $G_{i}/G_{i-1}$ where $G_{i}$ is compactly generated and there is no closed subgroup properly between $G_{i-1}$ and $G_{i}$. Such irreducible coset spaces can be thought of as a generalization of primitive actions of compactly generated locally compact groups; we establish some basic properties and discuss some sources of examples.


title: A Dyson Sphere around a black hole

abstract: The search for extraterrestrial intelligence (SETI) has been conducted for nearly 60 years. A Dyson Sphere, a spherical structure that surrounds a star and transports its radiative energy outward as an energy source for an advanced civilisation, is one of the main targets of SETI. In this study, we discuss whether building a Dyson Sphere around a black hole is effective. We consider six energy sources: (i) the cosmic microwave background, (ii) the Hawking radiation, (iii) an accretion disk, (iv) Bondi accretion, (v) a corona, and (vi) relativistic jets. To develop future civilisations (for example, a Type II civilisation), $4\times10^{26}\,{\rm W}$($1\,{\rm L_{\odot}}$) is expected to be needed. Among (iii) to (vi), the largest luminosity can be collected from an accretion disk, reaching $10^{5}\,{\rm L_{\odot}}$, enough to maintain a Type II civilisation. Moreover, if a Dyson Sphere collects not only the electromagnetic radiation but also other types of energy (e.g., kinetic energy) from the jets, the total collected energy would be approximately 5 times larger. Considering the emission from a Dyson Sphere, our results show that the Dyson Sphere around a stellar-mass black hole in the Milky Way ($10\,\rm kpc$ away from us) is detectable in the ultraviolet$(\rm 10-400\,{\rm nm)}$, optical$(\rm 400-760\,{\rm nm)}$, near-infrared($\rm 760\,{\rm nm}-5\,{\rm \mu m}$), and mid-infrared($\rm 5-40\,{\rm \mu m}$) wavelengths via the waste heat radiation using current telescopes such as Galaxy Evolution Explorer Ultraviolet Sky Surveys. Performing model fitting to observed spectral energy distributions and measuring the variability of radial velocity may help us to identify these possible artificial structures.


title: Enhancing the Analysis of Software Failures in Cloud Computing Systems with Deep Learning

abstract: Identifying the failure modes of cloud computing systems is a difficult and time-consuming task, due to the growing complexity of such systems, and the large volume and noisiness of failure data. This paper presents a novel approach for analyzing failure data from cloud systems, in order to relieve human analysts from manually fine-tuning the data for feature engineering. The approach leverages Deep Embedded Clustering (DEC), a family of unsupervised clustering algorithms based on deep learning, which uses an autoencoder to optimize data dimensionality and inter-cluster variance. We applied the approach in the context of the OpenStack cloud computing platform, both on the raw failure data and in combination with an anomaly detection pre-processing algorithm. The results show that the performance of the proposed approach, in terms of purity of clusters, is comparable to, or in some cases even better than manually fine-tuned clustering, thus avoiding the need for deep domain knowledge and reducing the effort to perform the analysis. In all cases, the proposed approach provides better performance than unsupervised clustering when no feature engineering is applied to the data. Moreover, the distribution of failure modes from the proposed approach is closer to the actual frequency of the failure modes.


title: Multi-Exit Vision Transformer for Dynamic Inference

abstract: Deep neural networks can be converted to multi-exit architectures by inserting early exit branches after some of their intermediate layers. This allows their inference process to become dynamic, which is useful for time critical IoT applications with stringent latency requirements, but with time-variant communication and computation resources. In particular, in edge computing systems and IoT networks where the exact computation time budget is variable and not known beforehand. Vision Transformer is a recently proposed architecture which has since found many applications across various domains of computer vision. In this work, we propose seven different architectures for early exit branches that can be used for dynamic inference in Vision Transformer backbones. Through extensive experiments involving both classification and regression problems, we show that each one of our proposed architectures could prove useful in the trade-off between accuracy and speed.


title: Aspects of compactification on a linear dilaton background

abstract: We consider the most general Kaluza-Klein (KK) compactification on $S^1/\mathbb{Z}_2$ of a five dimensional ($5D$) graviton-dilaton system, with a non-vanishing dilaton background varying linearly along the fifth dimension. We show that this background produces a Higgs mechanism for the KK vector coming from the $5D$ metric, which becomes massive by absorbing the string frame radion. The $\mathcal{N}=2$ minimal supersymmetric extension of this model, recently built as the holographic dual of Little String Theory, is then re-investigated. An analogous mechanism can be considered for the $4D$ vector coming from the (universal) $5D$ Kalb-Ramond two-form. Packaging the two massive vectors into a spin-$3/2$ massive multiplet, it is shown that the massless spectrum arranges into a $\mathcal{N}=1$, $D=4$ supersymmetric theory. This projection is compatible with an orbifold which preserves half of the original supersymmetries already preserved by the background. The description of the partial breaking $\mathcal{N}=2\rightarrow\mathcal{N}=1$ in this framework, with only vector multiplets and no hypermultiplets, remains an interesting open question which deserves further investigation.


title: INN: A Method Identifying Clean-annotated Samples via Consistency Effect in Deep Neural Networks

abstract: In many classification problems, collecting massive clean-annotated data is not easy, and thus a lot of researches have been done to handle data with noisy labels. Most recent state-of-art solutions for noisy label problems are built on the small-loss strategy which exploits the memorization effect. While it is a powerful tool, the memorization effect has several drawbacks. The performances are sensitive to the choice of a training epoch required for utilizing the memorization effect. In addition, when the labels are heavily contaminated or imbalanced, the memorization effect may not occur in which case the methods based on the small-loss strategy fail to identify clean labeled data. We introduce a new method called INN(Integration with the Nearest Neighborhoods) to refine clean labeled data from training data with noisy labels. The proposed method is based on a new discovery that a prediction pattern at neighbor regions of clean labeled data is consistently different from that of noisy labeled data regardless of training epochs. The INN method requires more computation but is much stable and powerful than the small-loss strategy. By carrying out various experiments, we demonstrate that the INN method resolves the shortcomings in the memorization effect successfully and thus is helpful to construct more accurate deep prediction models with training data with noisy labels.


title: Modulation and amplitude equations on bounded domains for nonlinear SPDEs driven by cylindrical {\alpha}-stable L\'evy processes

abstract: In the present work, we establish the approximation of nonlinear stochastic partial differential equation (SPDE) driven by cylindrical {\alpha}-stable L\'evy processes via modulation or amplitude equations. We study SPDEs with a cubic nonlinearity, where the deterministic equation is close to a change of stability of the trivial solution. The natural separation of time-scales close to this bifurcation allows us to obtain an amplitude equation describing the essential dynamics of the bifurcating pattern, thus reducing the original infinite dimensional dynamics to a simpler finite-dimensional effective dynamics. In the presence of a multiplicative stable L\'evy noise that preserves the constant trivial solution we study the impact of noise on the approximation. In contrast to Gaussian noise, where non-dominant pattern are uniformly small in time due to averaging effects, large jumps in the L\'evy noise might lead to large error terms, and thus new estimates are needed to take this into account.


title: Spin pumping in noncollinear antiferromagnets

abstract: The ac spin pumping of noncollinear antiferromagnets is theoretically investigated. Starting from an effective action description of the spin system, we derive the Onsager coefficients connecting the spin pumping and spin-transfer torque associated with the dynamics of the SO(3)-valued antiferromagnetic order parameter. Our theory is applied to a kagome antiferromagnet resonantly driven by a uniform external magnetic field. We demonstrate that the reactive (dissipative) spin-transfer torque parameter can be extracted from the pumped ac spin current in-phase (in quadrature) with the driving field. Furthermore, we find that the three spin-wave bands of the kagome AF generate spin currents with mutually orthogonal polarization directions. This offers a unique way of controlling the spin orientation of the pumped spin current by exciting different spin-wave modes.


title: Tensor-train approximation of the chemical master equation and its application for parameter inference

abstract: In this work, we perform Bayesian inference tasks for the chemical master equation in the tensor-train format. The tensor-train approximation has been proven to be very efficient in representing high dimensional data arising from the explicit representation of the chemical master equation solution. An additional advantage of representing the probability mass function in the tensor train format is that parametric dependency can be easily incorporated by introducing a tensor product basis expansion in the parameter space. Time is treated as an additional dimension of the tensor and a linear system is derived to solve the chemical master equation in time. We exemplify the tensor-train method by performing inference tasks such as smoothing and parameter inference using the tensor-train framework. A very high compression ratio is observed for storing the probability mass function of the solution. Since all linear algebra operations are performed in the tensor-train format, a significant reduction of the computational time is observed as well.


title: A Kirchhoff-like theory for hard magnetic rods under geometrically nonlinear deformation in three dimensions

abstract: Magneto-rheological elastomers (MREs) are functional materials that can be actuated by applying an external magnetic field. MREs comprise a composite of hard magnetic particles dispersed into a nonmagnetic elastomeric matrix. By applying a strong magnetic field, one can magnetize the structure to program its deformation under the subsequent application of an external field. Hard MREs, whose coercivities are large, have been receiving particular attention because the programmed magnetization remains unchanged upon actuation. Hence, once a structure made of a hard MRE is magnetized, it can be regarded as magnetized permanently. Motivated by a new realm of applications, there have been significant theoretical developments in the continuum description of hard MREs. By reducing the 3D description into 1D or 2D via dimensional reduction, several theories of hard magnetic slender structures such as linear beams, elastica, and shells have been recently proposed. In this paper, we derive an effective theory for MRE rods under geometrically nonlinear 3D deformation. Our theory is based on reducing the 3D magneto-elastic energy functional for the hard MREs into a 1D Kirchhoff-like description. Restricting the theory to 2D, we reproduce previous works on planar deformations. For further validation in the general case of 3D deformation, we perform precision experiments with both naturally straight and curved rods under either constant or constant-gradient magnetic fields. Our theoretical predictions are in excellent agreement with both discrete simulations and precision-model experiments. Finally, we discuss some limitations of our framework, as highlighted by the experiments, where long-range dipole interactions, which are neglected in the theory, can play a role.


title: DCASE 2021 Task 3: Spectrotemporally-aligned Features for Polyphonic Sound Event Localization and Detection

abstract: Sound event localization and detection consists of two subtasks which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound classes, direction-of-arrival estimation uses magnitude or phase differences between microphones to estimate source directions. Therefore, it is often difficult to jointly train these two subtasks simultaneously. We propose a novel feature called spatial cue-augmented log-spectrogram (SALSA) with exact time-frequency mapping between the signal power and the source direction-of-arrival. The feature includes multichannel log-spectrograms stacked along with the estimated direct-to-reverberant ratio and a normalized version of the principal eigenvector of the spatial covariance matrix at each time-frequency bin on the spectrograms. Experimental results on the DCASE 2021 dataset for sound event localization and detection with directional interference showed that the deep learning-based models trained on this new feature outperformed the DCASE challenge baseline by a large margin. We combined several models with slightly different architectures that were trained on the new feature to further improve the system performances for the DCASE sound event localization and detection challenge.


title: Predictive Control based on Equivalent Dynamic Linearization Model

abstract: Based on equivalent-dynamic-linearization model (EDLM), we propose a kind of model predictive control (MPC) for single-input and single-output (SISO) nonlinear or linear systems. After compensating the EDLM with disturbance for multiple-input and multiple-output nonlinear or linear systems, the MPC compensated with disturbance is proposed to address the disturbance rejection problem. The system performance analysis results are much clear compared with the system stability analyses on MPC in current works. And this may help the engineers understand how to design, analyze and apply the controller in practical.


title: Completeness in topological vector spaces and filters on N

abstract: We study completeness of a topological vector space with respect to different filters on the set N of all naturals. In the metrizable case all these kinds of completeness are the same, but in non-metrizable case the situation changes. For example, a space may be complete with respect to one ultrafilter on N, but incomplete with respect to another. Our study was motivated by [Aizpuru, List\'an-Garc\'ia and Rambla-Barreno; Quaest. Math., 2014] and [List\'an-Garc\'ia; Bull. Belg. Math. Soc. Simon Stevin, 2016] where for normed spaces the equivalence of the ordinary completeness and completeness with respect to f-statistical convergence was established.


title: Dynamic phase-field fracture with a first-order discontinuous Galerkin method for elastic waves

abstract: We present a new numerical approach for wave induced dynamic fracture. The method is based on a discontinuous Galerkin approximation of the first-order hyperbolic system for elastic waves and a phase-field approximation of brittle fracture driven by the maximum tension. The algorithm is staggered in time and combines an implicit midpoint rule for the wave propagation followed by an implicit Euler step for the phase-field evolution. At fracture, the material is degraded, and the waves are reflected at the diffusive interfaces. Two and three-dimensional examples demonstrate the advantages of the proposed method for the computation of crack growth and spalling initiated by reflected and superposed waves.


title: A case study of intersections on blowups of the moduli of curves

abstract: We explain how logarithmic structures select principal components in an intersection of schemes. These manifest in Chow homology and can be understood using strict transforms under logarithmic blowups. Our motivation comes from Gromov--Witten theory. The \textit{toric contact cycles} in the moduli space of curves parameterize curves that admit a map to a fixed toric variety with prescribed contact orders. We show that they are intersections of virtual strict transforms of double ramification cycles in blowups of the moduli space of curves. We supply a calculation scheme for the virtual strict transforms, and deduce that toric contact cycles lie in the tautological ring of the moduli space of curves. This is a higher dimensional analogue of a result of Faber--Pandharipande. The operational Chow rings of Artin fans play a basic role, and are shown to be isomorphic to rings of piecewise polynomials on associated cone complexes. The ingredients in our analysis are Fulton's blowup formula, Aluffi's formulas for Segre classes of monomial schemes, piecewise polynomials, and degeneration methods. A model calculation in toric intersection theory is treated without logarithmic methods and may be read independently.


title: Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers

abstract: This paper presents the first large-scale meta-evaluation of machine translation (MT). We annotated MT evaluations conducted in 769 research papers published from 2010 to 2020. Our study shows that practices for automatic MT evaluation have dramatically changed during the past decade and follow concerning trends. An increasing number of MT evaluations exclusively rely on differences between BLEU scores to draw conclusions, without performing any kind of statistical significance testing nor human evaluation, while at least 108 metrics claiming to be better than BLEU have been proposed. MT evaluations in recent papers tend to copy and compare automatic metric scores from previous work to claim the superiority of a method or an algorithm without confirming neither exactly the same training, validating, and testing data have been used nor the metric scores are comparable. Furthermore, tools for reporting standardized metric scores are still far from being widely adopted by the MT community. After showing how the accumulation of these pitfalls leads to dubious evaluation, we propose a guideline to encourage better automatic MT evaluation along with a simple meta-evaluation scoring method to assess its credibility.


title: Multi-interacting dark energy and its cosmological implications

abstract: In the effort to define the main features a successful solution to the Hubble tension should have, growing evidence has emerged pointing to the need for models able to modify the expansion (and possibly thermal) history of the universe both prior and after recombination, and that could thereby restore the overall concordance between early- and late-time observations without introducing nor worsening other cosmological tensions in the process. In precisely this spirit, here we consider a multi-interacting dark energy model with two complementary interaction channels: one with the dark matter and one with the photons. The former most significantly affects the matter dominated epoch as well as the very late universe, and has been shown to be able to significantly resolve the $S_8$ tension. The latter has been introduced in this work to allow for a larger and natural time dependence of the evolution of the universe since it mostly impacts the radiation dominated epoch as well as the temperature scaling of the photons, as extensively explained in the text. As a result, considering data from Planck+BAO+Pantheon+KV450+DES (which can be combined since the $S_8$ value is lowered even neglecting the weak lensing data) we find that the significance of the $H_0$ tension only reduces to about 3.5$\sigma$, while that of the $S_8$ tension falls below the 2$\sigma$ level. Also, the statistical analysis we perform strongly favors $\Lambda$CDM in all considered cases. Overall, we conclude that the specific multi-interacting dark energy model considered here, despite its broad generality and very rich cosmological phenomenology, cannot successfully restore the aforementioned overall concordance between early- and late-time observations.


title: Symbiotic Sensing and Communications Towards 6G: Vision, Applications, and Technology Trends

abstract: Driven by the vision of intelligent connection of everything and digital twin towards 6G, a myriad of new applications, such as immersive extended reality, autonomous driving, holographic communications, intelligent industrial internet, will emerge in the near future, holding the promise to revolutionize the way we live and work. These trends inspire a novel technical design principle that seamlessly integrates two originally decoupled functionalities, i.e., wireless communication and sensing, into one system in a symbiotic way, which is dubbed symbiotic sensing and communications (SSaC), to endow the wireless network with the capability to "see" and "talk" to the physical world simultaneously. Noting that the term SSaC is used instead of ISAC (integrated sensing and communications) because the word ``symbiotic/symbiosis" is more inclusive and can better accommodate different integration levels and evolution stages of sensing and communications. Aligned with this understanding, this article makes the first attempts to clarify the concept of SSaC, illustrate its vision, envision the three-stage evolution roadmap, namely neutralism, commensalism, and mutualism of SaC. Then, three categories of applications of SSaC are introduced, followed by detailed description of typical use cases in each category. Finally, we summarize the major performance metrics and key enabling technologies for SSaC.


title: Exploring the trilemma of cost-efficient, equitable and publicly acceptable onshore wind expansion planning

abstract: Onshore wind development has historically focused on cost-efficiency, which may lead to inequitable turbine distributions and public resistance due to landscape impacts. Using a multi-criteria planning approach, we show how onshore wind capacity targets can be achieved by 2050 in a cost-efficient, equitable and publicly acceptable way. For the case study of Germany, we build on the existing turbine stock and use open data on technically feasible turbine locations and scenicness of landscapes to plan the optimal expansion. The analysis shows that while the trade-off between cost-efficiency and public acceptance is rather weak with about 15% higher costs or scenicness, an equitable distribution has a large impact on these criteria. Although the onshore wind capacity per inhabitant could be distributed about 220% more equitably through the expansion, equity would severely limit planning flexibility by 2050. Our analysis assists stakeholders in resolving the onshore wind expansion trilemma.


title: Model selection for $K^+\Sigma^-$ photoproduction within isobar model

abstract: We utilise an isobar model to investigate the $K^+ \Sigma^-$ photoproduction off a neutron in the resonance region. Except for the Born terms, we include high-spin (spin-3/2 and spin-5/2) nucleon resonances in the consistent formalism together with a few $\Delta$ and kaon resonances to achieve an acceptable agreement with data. Interestingly, we reveal that no hyperon resonances are needed to achieve a reasonable description of data. On the other hand the $N(1720)3/2^+$ resonance was found to be very important for correct description of data. The free parameters of the model were fitted to experimental data from the LEPS and CLAS Collaborations on either differential cross sections or photon beam asymmetry. The novel feature of the fitting procedure is the use of a regularization method, the Least Absolute Shrinkage Selection Operator, and information criteria in order to choose the best fit.


title: Action Set Based Policy Optimization for Safe Power Grid Management

abstract: Maintaining the stability of the modern power grid is becoming increasingly difficult due to fluctuating power consumption, unstable power supply coming from renewable energies, and unpredictable accidents such as man-made and natural disasters. As the operation on the power grid must consider its impact on future stability, reinforcement learning (RL) has been employed to provide sequential decision-making in power grid management. However, existing methods have not considered the environmental constraints. As a result, the learned policy has risk of selecting actions that violate the constraints in emergencies, which will escalate the issue of overloaded power lines and lead to large-scale blackouts. In this work, we propose a novel method for this problem, which builds on top of the search-based planning algorithm. At the planning stage, the search space is limited to the action set produced by the policy. The selected action strictly follows the constraints by testing its outcome with the simulation function provided by the system. At the learning stage, to address the problem that gradients cannot be propagated to the policy, we introduce Evolutionary Strategies (ES) with black-box policy optimization to improve the policy directly, maximizing the returns of the long run. In NeurIPS 2020 Learning to Run Power Network (L2RPN) competition, our solution safely managed the power grid and ranked first in both tracks.


title: Asymptotic Log-Det Sum-of-Ranks Minimization via Tensor (Alternating) Iteratively Reweighted Least Squares

abstract: Affine sum-of-ranks minimization (ASRM) generalizes the affine rank minimization (ARM) problem from matrices to tensors. Here, the interest lies in the ranks of a family $\mathcal{K}$ of different matricizations. Transferring our priorly discussed results on asymptotic log-det rank minimization, we show that iteratively reweighted least squares with weight strength $p = 0$ remains a, theoretically and practically, particularly viable method denoted as $\mathrm{IRLS}$-$0\mathcal{K}$. As in the matrix case, we prove global convergence of asymptotic minimizers of the log-det sum-of-ranks function to desired solutions. Further, we show local convergence of $\mathrm{IRLS}$-$0\mathcal{K}$ in dependence of the rate of decline of the therein appearing regularization parameter $\gamma \searrow 0$. For hierarchical families $\mathcal{K}$, we show how an alternating version ($\mathrm{AIRLS}$-$0\mathcal{K}$, related to prior work under the name $\mathrm{SALSA}$) can be evaluated solely through tensor tree network based operations. The method can thereby be applied to high dimensions through the avoidance of exponential computational complexity. Further, the otherwise crucial rank adaption process becomes essentially superfluous even for completion problems. In numerical experiments, we show that the therefor required subspace restrictions and relaxation of the affine constraint cause only a marginal loss of approximation quality. On the other hand, we demonstrate that $\mathrm{IRLS}$-$0\mathcal{K}$ allows to observe the theoretical phase transition also for generic tensor recoverability in practice. Concludingly, we apply $\mathrm{AIRLS}$-$0\mathcal{K}$ to larger scale problems.


title: Inconspicuous Adversarial Patches for Fooling Image Recognition Systems on Mobile Devices

abstract: Deep learning based image recognition systems have been widely deployed on mobile devices in today's world. In recent studies, however, deep learning models are shown vulnerable to adversarial examples. One variant of adversarial examples, called adversarial patch, draws researchers' attention due to its strong attack abilities. Though adversarial patches achieve high attack success rates, they are easily being detected because of the visual inconsistency between the patches and the original images. Besides, it usually requires a large amount of data for adversarial patch generation in the literature, which is computationally expensive and time-consuming. To tackle these challenges, we propose an approach to generate inconspicuous adversarial patches with one single image. In our approach, we first decide the patch locations basing on the perceptual sensitivity of victim models, then produce adversarial patches in a coarse-to-fine way by utilizing multiple-scale generators and discriminators. The patches are encouraged to be consistent with the background images with adversarial training while preserving strong attack abilities. Our approach shows the strong attack abilities in white-box settings and the excellent transferability in black-box settings through extensive experiments on various models with different architectures and training methods. Compared to other adversarial patches, our adversarial patches hold the most negligible risks to be detected and can evade human observations, which is supported by the illustrations of saliency maps and results of user evaluations. Lastly, we show that our adversarial patches can be applied in the physical world.


title: Line shape and the experimental determination of the $J/\psi \to \gamma\eta_c$ branching fraction

abstract: We study the photon spectrum line-shape of the $J/\psi \to \gamma\eta_c\to \gamma X$ decay process in a nonrelativistic effective field theory (EFT) framework of quantum chromodynamics (QCD). We take into account the finite width of the $\eta_c$ and include $\mathcal{O}(v^2)$ corrections. We observe that the photon spectrum line-shape is divergent at large energies due to polynomially and logarithmically divergent terms, that upon integration over the photon energies in Dimensional Regularization (DR) produce no contribution or can be renormalized. We propose to subtract these divergences at the line-shape level in a manner consistent with the calculation of the width in DR and $\overline{\hbox{MS}}$ scheme. We analyze CLEO's data with the proposed subtracted line-shape and find good agreement between the theoretical prediction and the experimental result.


title: Coulomb electron drag mechanism of terahertz plasma instability in n+-i-n-n+ graphene FETs with ballistic injection

abstract: We predict the self-excitation of terahertz (THz) oscillations due to the plasma instability in the lateral n+-i-n-n+$ graphene field-effect transistors (G-FET). The instability is associated with the Coulomb drag of the quasi-equilibrium electrons in the gated channel by the injected ballistic electrons resulting in a positive feedback between the amplified dragged electrons current and the injected current. The plasma excitations arise when the drag effect is sufficiently strong. The drag efficiency and the plasma frequency are determined by the quasi-equilibrium electrons Fermi energy (i.e., by their density). The conditions of the terahertz plasma oscillation self-excitation can be realized in the G-FETs with realistic structural parameters at room temperature enabling the potential G-FET-based radiation sources for the THz applications.


title: N-Singer: A Non-Autoregressive Korean Singing Voice Synthesis System for Pronunciation Enhancement

abstract: Recently, end-to-end Korean singing voice systems have been designed to generate realistic singing voices. However, these systems still suffer from a lack of robustness in terms of pronunciation accuracy. In this paper, we propose N-Singer, a non-autoregressive Korean singing voice system, to synthesize accurate and pronounced Korean singing voices in parallel. N-Singer consists of a Transformer-based mel-generator, a convolutional network-based postnet, and voicing-aware discriminators. It can contribute in the following ways. First, for accurate pronunciation, N-Singer separately models linguistic and pitch information without other acoustic features. Second, to achieve improved mel-spectrograms, N-Singer uses a combination of Transformer-based modules and convolutional network-based modules. Third, in adversarial training, voicing-aware conditional discriminators are used to capture the harmonic features of voiced segments and noise components of unvoiced segments. The experimental results prove that N-Singer can synthesize a natural singing voice in parallel with a more accurate pronunciation than the baseline model.


title: Domain-Class Correlation Decomposition for Generalizable Person Re-Identification

abstract: Domain generalization in person re-identification is a highly important meaningful and practical task in which a model trained with data from several source domains is expected to generalize well to unseen target domains. Domain adversarial learning is a promising domain generalization method that aims to remove domain information in the latent representation through adversarial training. However, in person re-identification, the domain and class are correlated, and we theoretically show that domain adversarial learning will lose certain information about class due to this domain-class correlation. Inspired by casual inference, we propose to perform interventions to the domain factor $d$, aiming to decompose the domain-class correlation. To achieve this goal, we proposed estimating the resulting representation $z^{*}$ caused by the intervention through first- and second-order statistical characteristic matching. Specifically, we build a memory bank to restore the statistical characteristics of each domain. Then, we use the newly generated samples $\{z^{*},y,d^{*}\}$ to compute the loss function. These samples are domain-class correlation decomposed; thus, we can learn a domain-invariant representation that can capture more class-related features. Extensive experiments show that our model outperforms the state-of-the-art methods on the large-scale domain generalization Re-ID benchmark.


title: Optimal Rates for Random Order Online Optimization

abstract: We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random order. Focusing on the scenario where the cumulative loss function is (strongly) convex, yet individual loss functions are smooth but might be non-convex, we give algorithms that achieve the optimal bounds and significantly outperform the results of \citet{garber2020online}, completely removing the dimension dependence and improving their scaling with respect to the strong convexity parameter. Our analysis relies on novel connections between algorithmic stability and generalization for sampling without-replacement analogous to those studied in the with-replacement i.i.d.~setting, as well as on a refined average stability analysis of stochastic gradient descent.


title: The insider problem in the trinomial model: a discrete-time jump process approach

abstract: In an incomplete market underpinned by the trinomial model, we consider two investors : an ordinary agent whose decisions are driven by public information and an insider who possesses from the beginning a surplus of information encoded through a random variable for which he or she knows the outcome. Through the definition of an auxiliary model based on a marked binomial process, we handle the trinomial model as a volatility one, and use the stochastic analysis and Malliavin calculus toolboxes available in that context. In particular, we connect the information drift, the drift to eliminate in order to preserve the martingale property within an initial enlargement of filtration in terms of the Malliavin derivative. We solve explicitly the agent and the insider expected logarithmic utility maximisation problems and provide a hedging formula for replicable claims. We identify the insider expected additional utility with the Shannon entropy of the extra information, and examine then the existence of arbitrage opportunities for the insider.


title: Making the most of small Software Engineering datasets with modern machine learning

abstract: This paper provides a starting point for Software Engineering (SE) researchers and practitioners faced with the problem of training machine learning models on small datasets. Due to the high costs associated with labeling data, in Software Engineering,there exist many small (< 1 000 samples) and medium-sized (< 100 000 samples) datasets. While deep learning has set the state of the art in many machine learning tasks, it is only recently that it has proven effective on small-sized datasets, primarily thanks to pre-training, a semi-supervised learning technique that leverages abundant unlabelled data alongside scarce labelled data.In this work, we evaluate pre-trained Transformer models on a selection of 13 smaller datasets from the SE literature, covering both,source code and natural language. Our results suggest that pre-trained Transformers are competitive and in some cases superior to previous models, especially for tasks involving natural language; whereas for source code tasks, in particular for very small datasets,traditional machine learning methods often has the edge.In addition, we experiment with several techniques that ought to aid training on small datasets, including active learning, data augmentation, soft labels, self-training and intermediate-task fine-tuning, and issue recommendations on when they are effective. We also release all the data, scripts, and most importantly pre-trained models for the community to reuse on their own datasets.


title: Circuit-Depth Reduction of Unitary-Coupled-Cluster Ansatz by Energy Sorting

abstract: Quantum computation represents a revolutionary approach for solving problems in quantum chemistry. However, due to the limited quantum resources in the current noisy intermediate-scale quantum (NISQ) devices, quantum algorithms for large chemical systems remains a major task. In this work, we demonstrate that the circuit depth of the unitary coupled cluster (UCC) and UCC-based ansatzes in the algorithm of variational quantum eigensolver can be significantly reduced by an energy-sorting strategy. Specifically, subsets of excitation operators are first pre-screened from the operator pool according to its contribution to the total energy. The quantum circuit ansatz is then iteratively constructed until the convergence of the final energy to a typical accuracy. For demonstration, this method has been successfully applied to molecular and periodic systems. Particularly, a reduction of 50\%$\sim$98\% in the number of operators is observed while retaining the accuracy of the origin UCCSD operator pools. This method can be straightforwardly extended to general parametric variational ansatzes.


title: A Toolchain to Design, Execute, and Monitor Robots Behaviors

abstract: In this paper, we present a toolchain to design, execute, and verify robot behaviors. The toolchain follows the guidelines defined by the EU H2020 project RobMoSys and encodes the robot deliberation as a Behavior Tree (BT), a directed tree where the internal nodes model behavior composition and leaf nodes model action or measurement operations. Such leaf nodes take the form of a statechart (SC), which runs in separate threads, whose states perform basic arithmetic operations and send commands to the robot. The toolchain provides the ability to define a runtime monitor for a given system specification that warns the user whenever a given specification is violated. We validated the toolchain in a simulated experiment that we made reproducible in an OS-virtualization environment.


title: Counterfactual Explanations for Arbitrary Regression Models

abstract: We present a new method for counterfactual explanations (CFEs) based on Bayesian optimisation that applies to both classification and regression models. Our method is a globally convergent search algorithm with support for arbitrary regression models and constraints like feature sparsity and actionable recourse, and furthermore can answer multiple counterfactual questions in parallel while learning from previous queries. We formulate CFE search for regression models in a rigorous mathematical framework using differentiable potentials, which resolves robustness issues in threshold-based objectives. We prove that in this framework, (a) verifying the existence of counterfactuals is NP-complete; and (b) that finding instances using such potentials is CLS-complete. We describe a unified algorithm for CFEs using a specialised acquisition function that composes both expected improvement and an exponential-polynomial (EP) family with desirable properties. Our evaluation on real-world benchmark domains demonstrate high sample-efficiency and precision.


title: Values of Inhomogeneous Forms at S-integral points

abstract: We prove effective versions of Oppenheim's conjecture for generic inhomogeneous forms in the S-arithmetic setting. We prove an effective result for fixed rational shifts and generic forms and we also prove a result where both the quadratic form and the shift are allowed to vary. In order to do so, we prove analogues of Rogers' moment formulae for $S$-arithmetic congruence quotients as well as for the space of affine lattices. We believe the latter results to be of independent interest.


title: Joint Majorization-Minimization for Nonnegative Matrix Factorization with the $\beta$-divergence

abstract: This article proposes new multiplicative updates for nonnegative matrix factorization (NMF) with the $\beta$-divergence objective function. Our new updates are derived from a joint majorization-minimization (MM) scheme, in which an auxiliary function (a tight upper bound of the objective function) is built for the two factors jointly and minimized at each iteration. This is in contrast with the classic approach in which a majorizer is derived for each factor separately. Like that classic approach, our joint MM algorithm also results in multiplicative updates that are simple to implement. They however yield a significant drop of computation time (for equally good solutions), in particular for some $\beta$-divergences of important applicative interest, such as the squared Euclidean distance and the Kullback-Leibler or Itakura-Saito divergences. We report experimental results using diverse datasets: face images, an audio spectrogram, hyperspectral data and song play counts. Depending on the value of $\beta$ and on the dataset, our joint MM approach can yield CPU time reductions from about $13\%$ to $78\%$ in comparison to the classic alternating scheme.


title: Maximal displacement of branching symmetric stable processes

abstract: We determine the limiting distribution and the explicit tail behavior for the maximal displacement of a branching symmetric stable process with spatially inhomogeneous branching structure. Here the branching rate is a Kato class measure with compact support and can be singular with respect to the Lebesgue measure.


title: A Non-parametric View of FedAvg and FedProx: Beyond Stationary Points

abstract: Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted FL algorithms - fail to reach the stationary points of the global optimization objective even for homogeneous linear regression problems. Further, it is concerned that the common model learned might not generalize well locally at all in the presence of heterogeneity. In this paper, we analyze the convergence and statistical efficiency of FedAvg and FedProx, addressing the above two concerns. Our analysis is based on the standard non-parametric regression in a reproducing kernel Hilbert space (RKHS), and allows for heterogeneous local data distributions and unbalanced local datasets. We prove that the estimation errors, measured in either the empirical norm or the RKHS norm, decay with a rate of 1/t in general and exponentially for finite-rank kernels. In certain heterogeneous settings, these upper bounds also imply that both FedAvg and FedProx achieve the optimal error rate. To further analytically quantify the impact of the heterogeneity at each client, we propose and characterize a novel notion-federation gain, defined as the reduction of the estimation error for a client to join the FL. We discover that when the data heterogeneity is moderate, a client with limited local data can benefit from a common model with a large federation gain. Numerical experiments further corroborate our theoretical findings.


title: Digging Errors in NMT: Evaluating and Understanding Model Errors from Partial Hypothesis Space

abstract: Solid evaluation of neural machine translation (NMT) is key to its understanding and improvement. Current evaluation of an NMT system is usually built upon a heuristic decoding algorithm (e.g., beam search) and an evaluation metric assessing similarity between the translation and golden reference. However, this system-level evaluation framework is limited by evaluating only one best hypothesis and search errors brought by heuristic decoding algorithms. To better understand NMT models, we propose a novel evaluation protocol, which defines model errors with model's ranking capability over hypothesis space. To tackle the problem of exponentially large space, we propose two approximation methods, top region evaluation along with an exact top-$k$ decoding algorithm, which finds top-ranked hypotheses in the whole hypothesis space, and Monte Carlo sampling evaluation, which simulates hypothesis space from a broader perspective. To quantify errors, we define our NMT model errors by measuring distance between the hypothesis array ranked by the model and the ideally ranked hypothesis array. After confirming the strong correlation with human judgment, we apply our evaluation to various NMT benchmarks and model architectures. We show that the state-of-the-art Transformer models face serious ranking issues and only perform at the random chance level in the top region. We further analyze model errors on architectures with different depths and widths, as well as different data-augmentation techniques, showing how these factors affect model errors. Finally, we connect model errors with the search algorithms and provide interesting findings of beam search inductive bias and correlation with Minimum Bayes Risk (MBR) decoding.