title: Wormholes with a warped extra dimension?

abstract: We investigate the role of a specifically warped extra dimension in constructing examples of higher dimensional spacetimes representing Lorentzian wormholes. The warping chosen is largely inspired by the well-known non-static Witten bubble of nothing, though our spacetimes are static and geometrically different. Vacuum solutions in $D\geq 5$ dimensions and others (non-asymptotically flat) with `perfectly normal' matter stress energy are interpreted as possible Lorentzian wormholes. Asymptotically flat wormholes in $D\geq 5$ with `exotic matter' and within this class of spacetimes also appear to exist in all dimensions. A wormhole-black hole correspondence via double Wick rotation is revisited and discussed. Finally, geodesic motion as well as the behaviour of geodesic congruences, in the sub-class of five dimensional, warped, vacuum wormhole spacetimes is also briefly analysed, with the aim of obtaining characteristic properties and specific signatures which may help improve our understanding of these geometries.


title: Isomorphic Cross-lingual Embeddings for Low-Resource Languages

abstract: Cross-Lingual Word Embeddings (CLWEs) are a key component to transfer linguistic information learnt from higher-resource settings into lower-resource ones. Recent research in cross-lingual representation learning has focused on offline mapping approaches due to their simplicity, computational efficacy, and ability to work with minimal parallel resources. However, they crucially depend on the assumption of embedding spaces being approximately isomorphic i.e. sharing similar geometric structure, which does not hold in practice, leading to poorer performance on low-resource and distant language pairs. In this paper, we introduce a framework to learn CLWEs, without assuming isometry, for low-resource pairs via joint exploitation of a related higher-resource language. In our work, we first pre-align the low-resource and related language embedding spaces using offline methods to mitigate the assumption of isometry. Following this, we use joint training methods to develops CLWEs for the related language and the target embed-ding space. Finally, we remap the pre-aligned low-resource space and the target space to generate the final CLWEs. We show consistent gains over current methods in both quality and degree of isomorphism, as measured by bilingual lexicon induction (BLI) and eigenvalue similarity respectively, across several language pairs: {Nepali, Finnish, Romanian, Gujarati, Hungarian}-English. Lastly, our analysis also points to the relatedness as well as the amount of related language data available as being key factors in determining the quality of embeddings achieved.


title: An Effective Framework of Private Ethereum Blockchain Networks for Smart Grid

abstract: A smart grid is an important application in Industry 4.0 with a lot of new technologies and equipment working together. Hence, sensitive data stored in the smart grid is vulnerable to malicious modification and theft. This paper proposes a framework to build a smart grid based on a highly effective private Ethereum network. Our framework provides a real smart grid that includes modern hardware and a smart contract to secure data in the blockchain network. To obtain high throughput but a low uncle rate, the difficulty calculation method used in the mining process of the Ethereum consensus mechanism is modified to adapt to the practical smart grid setup. The performance in terms of throughput and latency are evaluated by simulation and verified by the real smart grid setup. The enhanced private Ethereum-based smart grid has significantly better performance than the public one. Moreover, this framework can be applied to any system used to store data in the Ethereum network.


title: Lindblad evolutions, Born rule, Heralding and cloning

abstract: We discuss an apparent difficulty in computing the radiation emitted by a system undergoing Lindblad evolution. The difficulty is resolved by viewing the problem as Born rule for conserved currents defined by the appropriate terms in the adjoint Lindbladian. In Heralding Alice prepares Bob's system in a state that mirrors her test. We show that heralding is consistent with no-cloning. This follows from the observation that heralding is not a completely positive map.


title: Embedding short-range correlations in relativistic density functionals through quasi-deuterons

abstract: The formation of clusters at sub-saturation densities constitutes an essential feature for a reliable modelization of the nuclear matter equation of state (EoS). Phenomenological models that make use of energy density functionals (EDFs) offer a convenient approach to account for the presence of these bound states of nucleons when introduced as additional degrees of freedom. However, in these models clusters dissolve, by construction, when the nuclear saturation density is approached from below, revealing inconsistencies with recent findings that evidence the existence of short-range correlations (SRCs) even at larger densities. In this work, within the EDF framework, a novel approach is proposed to embed SRCs within a relativistic mean-field model with density dependent couplings. This is realized through the introduction of suitable in-medium modifications of the cluster binding energy shifts, which are responsible for describing the cluster dissolution. As a first exploratory step, the example of a quasi-deuteron within the generalized relativistic density functional approach is investigated. For the first time, suitable parameterizations of the cluster mass shift at zero temperature are derived for all baryon densities. They are constrained by experimental results for the effective deuteron fraction in nuclear matter near saturation and by microscopic many-body calculations in the low-density limit. The strength of the deuteron-meson couplings is assessed to be of crucial importance. The findings of the present study represent a first step to improve the description of nuclear matter and its EoS at supra-saturation densities in EDFs by considering correlations in an effective way. Novel effects on some thermodynamic quantities, such as the matter incompressibility, the symmetry energy and its slope, are finally discerned and discussed.


title: A 3D Positioning-based Channel Estimation Method for RIS-aided mmWave Communications

abstract: A fundamental challenge in millimeter-wave (mmWave) communication is the susceptibility to blocking objects. One way to alleviate this problem is the use of reconfigurable intelligent surfaces (RIS). Nevertheless, due to the large number of passive reflecting elements on RIS, channel estimation turns out to be a challenging task. In this paper, we address the channel estimation for RIS-aided mmWave communication systems based on a localization method. The proposed idea consists of exploiting the sparsity of the mmWave channel and the topology of the RIS. In particular, we first propose the concept of reflecting unit set (RUS) to improve the flexibility of RIS. We then propose a novel coplanar maximum likelihood-based (CML) 3D positioning method based on the RUS, and derive the Cramer-Rao lower bound (CRLB) for the positioning method. Furthermore, we develop an efficient positioning-based channel estimation scheme with low computational complexity. Compared to state-of-the-art methods, our proposed method requires less time-frequency resources in channel acquisition as the complexity is independent to the total size of the RIS but depends on the size of the RUSs, which is only a small portion of the RIS. Large performance gains are confirmed in simulations, which proves the effectiveness of the proposed method.


title: On the helicity of radiative electromagnetic fields

abstract: A relativistically invariant expression for the magnetic and electric helicities of free electromagnetic field through the currents, which created those field, are derived. It is demonstrated that for radiative fields (e.g. laser pulses) the both helicities are conserved and equal to each other. Moreover the conservation of the helicity means that in radiative electromagnetic fields the electric and magnetic vectors are always orthogonal to each other. Proceeding to the quantum theory, it is shown that the corresponding quantum helicity field operator is equal to the sum of projections of spins of all photons onto their momentums. Finally, as an example, the expressions for the total helicity, number of photons and the total spin momentum of the field of a dipole electromagnetic pulse are obtained and discussed.


title: Tomography-based observational measurements of the halo mass function via the submillimeter magnification bias

abstract: Aims. The main goal of this paper is to derive observational constraints on the halo mass fuction (HMF) by performing a tomographic analysis of the magnification bias signal on a sample of background submillimeter galaxies. The results can then be compared with those from a non-tomographic study. Methods. We measure the cross-correlation function between a sample of foreground GAMA galaxies with spectroscopic redshifts in the range $0.1 < z < 0.8$ (and divided up into four bins) and a sample of background submillimeter galaxies from H-ATLAS with photometric redshifts in the range $1.2 < z < 4.0$. We model the weak lensing signal within the halo model formalism and carry out a Markov chain Monte Carlo algorithm to obtain the posterior distribution of all HMF parameters, which we assume to follow the Sheth and Tormen (ST) three-parameter and two-parameter fits. Results. While the observational constraints on the HMF from the non-tomographic analysis are not stringent, there is a remarkable improvement in terms of uncertainty reduction when tomography is adopted. Moreover, with respect to the traditional ST triple of values from numerical simulations, the results from the three-parameter fit predict a higher number density of halos at masses below $10^{12}M_{\odot}/h$ at 95% credibility. The two-parameter fit yields even more restricting results, with a larger number density of halos below $10^{13}M_{\odot}/h$ and a lower one above $10^{14}M_{\odot}/h$, this time at more than 3$\sigma$ credibility. Our results are therefore in disagreement with the standard N-body values for the ST fit at 2$\sigma$ and 3$\sigma$, respectively.


title: SyncNet: Using Causal Convolutions and Correlating Objective for Time Delay Estimation in Audio Signals

abstract: This paper addresses the task of performing robust and reliable time-delay estimation in audio-signals in noisy and reverberating environments. In contrast to the popular signal processing based methods, this paper proposes machine learning based method, i.e., a semi-causal convolutional neural network consisting of a set of causal and anti-causal layers with a novel correlation-based objective function. The causality in the network ensures non-leakage of representations from future time-intervals and the proposed loss function makes the network generate sequences with high correlation at the actual time delay. The proposed approach is also intrinsically interpretable as it does not lose time information. Even a shallow convolution network is able to capture local patterns in sequences, while also correlating them globally. SyncNet outperforms other classical approaches in estimating mutual time delays for different types of audio signals including pulse, speech and musical beats.


title: Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE

abstract: This paper presents an analysis of speech synthesis quality achieved by simultaneously performing voice conversion and language code-switching using multilingual VQ-VAE speech synthesis in German, French, English and Italian. In this paper, we utilize VQ code indices representing phone information from VQ-VAE to perform code-switching and a VQ speaker code to perform voice conversion in a single system with a neural vocoder. Our analysis examines several aspects of code-switching including the number of language switches and the number of words involved in each switch. We found that speech synthesis quality degrades after increasing the number of language switches within an utterance and decreasing the number of words. We also found some evidence of accent transfer when performing voice conversion across languages as observed when a speaker's original language differs from the language of a synthetic target utterance. We present results from our listening tests and discuss the inherent difficulties of assessing accent transfer in speech synthesis. Our work highlights some of the limitations and strengths of using a semi-supervised end-to-end system like VQ-VAE for handling multilingual synthesis. Our work provides insight into why multilingual speech synthesis is challenging and we suggest some directions for expanding work in this area.


title: Subjective Evaluation of Deep Learning Models for Symbolic Music Composition

abstract: Deep learning models are typically evaluated to measure and compare their performance on a given task. The metrics that are commonly used to evaluate these models are standard metrics that are used for different tasks. In the field of music composition or generation, the standard metrics used in other fields have no clear meaning in terms of music theory. In this paper, we propose a subjective method to evaluate AI-based music composition systems by asking questions related to basic music principles to different levels of users based on their musical experience and knowledge. We use this method to compare state-of-the-art models for music composition with deep learning. We give the results of this evaluation method and we compare the responses of each user level for each evaluated model.


title: SPIQ: Data-Free Per-Channel Static Input Quantization

abstract: Computationally expensive neural networks are ubiquitous in computer vision and solutions for efficient inference have drawn a growing attention in the machine learning community. Examples of such solutions comprise quantization, i.e. converting the processing values (weights and inputs) from floating point into integers e.g. int8 or int4. Concurrently, the rise of privacy concerns motivated the study of less invasive acceleration methods, such as data-free quantization of pre-trained models weights and activations. Previous approaches either exploit statistical information to deduce scalar ranges and scaling factors for the activations in a static manner, or dynamically adapt this range on-the-fly for each input of each layers (also referred to as activations): the latter generally being more accurate at the expanse of significantly slower inference. In this work, we argue that static input quantization can reach the accuracy levels of dynamic methods by means of a per-channel input quantization scheme that allows one to more finely preserve cross-channel dynamics. We show through a thorough empirical evaluation on multiple computer vision problems (e.g. ImageNet classification, Pascal VOC object detection as well as CityScapes semantic segmentation) that the proposed method, dubbed SPIQ, achieves accuracies rivalling dynamic approaches with static-level inference speed, significantly outperforming state-of-the-art quantization methods on every benchmark.


title: Space-time formulation, discretization, and computational performance studies for phase-field fracture optimal control problems

abstract: The purpose of this work is the development of space-time discretization schemes for phase-field optimal control problems. Specifically in the optimal control minimization problem, a tracking-type cost functional is minimized to steer the crack via the phase-field variable into a desired pattern. To achieve such optimal solutions, Neumann type boundary conditions need to be determined. First, a time discretization of the forward problem is derived using a discontinuous Galerkin formulation. Here, a challenge is to include regularization terms and the crack irreversibility constraint. The optimal control setting is formulated by means of the Lagrangian approach from which the primal part, adjoint, tangent and adjoint Hessian are derived. Herein the overall Newton algorithm is based on a reduced approach by eliminating the state constraint, namely the displacement and phase-field unknowns, but keeping the control variable as the only unknown. From the low-order discontinuous Galerkin discretization, adjoint time-stepping schemes are finally obtained. Both our formulation and algorithmic developments are substantiated and illustrated with six numerical experiments.


title: High-harmonic generation enhancement with graphene heterostructures

abstract: We investigate high-harmonic generation in graphene heterostructures consisting of metallic nanoribbons separated from a graphene sheet by either a few-nanometer layer of aluminum oxide or an atomic monolayer of hexagonal boron nitride. The nanoribbons amplify the near-field at the graphene layer relative to the externally applied pumping, thus allowing us to observe third- and fifth-harmonic generation in the carbon monolayer at modest pump powers in the mid-infrared. We study the dependence of the nonlinear signals on the ribbon width and spacer thickness, as well as pump power and polarization, and demonstrate enhancement factors relative to bare graphene reaching 1600 and 4100 for third- and fifth-harmonic generation, respectively. Our work supports the use of graphene heterostructures to selectively enhance specific nonlinear processes of interest, an essential capability for the design of nanoscale nonlinear devices.


title: REx: Data-Free Residual Quantization Error Expansion

abstract: Deep neural networks (DNNs) are ubiquitous in computer vision and natural language processing, but suffer from high inference cost. This problem can be addressed by quantization, which consists in converting floating point operations into a lower bit-width format. With the growing concerns on privacy rights, we focus our efforts on data-free methods. However, such techniques suffer from their lack of adaptability to the target devices, as a hardware typically only support specific bit widths. Thus, to adapt to a variety of devices, a quantization method shall be flexible enough to find good accuracy v.s. speed trade-offs for every bit width and target device. To achieve this, we propose REx, a quantization method that leverages residual error expansion, along with group sparsity and an ensemble approximation for better parallelization. REx is backed off by strong theoretical guarantees and achieves superior performance on every benchmarked application (from vision to NLP tasks), architecture (ConvNets, transformers) and bit-width (from int8 to ternary quantization).


title: To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding

abstract: Batch-Normalization (BN) layers have become fundamental components in the evermore complex deep neural network architectures. Such models require acceleration processes for deployment on edge devices. However, BN layers add computation bottlenecks due to the sequential operation processing: thus, a key, yet often overlooked component of the acceleration process is BN layers folding. In this paper, we demonstrate that the current BN folding approaches are suboptimal in terms of how many layers can be removed. We therefore provide a necessary and sufficient condition for BN folding and a corresponding optimal algorithm. The proposed approach systematically outperforms existing baselines and allows to dramatically reduce the inference time of deep neural networks.


title: Automatic Debate Evaluation with Argumentation Semantics and Natural Language Argument Graph Networks

abstract: The lack of annotated data on professional argumentation and complete argumentative debates has led to the oversimplification and the inability of approaching more complex natural language processing tasks. Such is the case of the automatic debate evaluation. In this paper, we propose an original hybrid method to automatically evaluate argumentative debates. For that purpose, we combine concepts from argumentation theory such as argumentation frameworks and semantics, with Transformer-based architectures and neural graph networks. Furthermore, we obtain promising results that lay the basis on an unexplored new instance of the automatic analysis of natural language arguments.


title: Renormalization and a-priori bounds for Leray self-similar solutions to the generalized mild Navier-Stokes equations

abstract: We demonstrate that the problem of existence of Leray self-similar blow up solutions in a generalized mild Navier-Stokes system with the fractional Laplacian $(-\Delta)^{\gamma/2}$ can be stated as a fixed point problem for a "renormalization" operator. We proceed to construct {\it a-priori} bounds, that is a renormalization invariant precompact set in an appropriate weighted $L^p$-space. As a consequence of a-priori bounds, we prove existence of renormalization fixed points for $d \ge 2$ and $d<\gamma <2 d+2$, and existence of non-trivial Leray self-similar mild solutions in $C^\infty([0,T),(H^k)^d \cap (L^p)^d)$, $k>0, p \ge 2$, whose $(L^p)^d$-norm becomes unbounded in finite time $T$.


title: Knowledge Distillation: Bad Models Can Be Good Role Models

abstract: Large neural networks trained in the overparameterized regime are able to fit noise to zero train error. Recent work \citep{nakkiran2020distributional} has empirically observed that such networks behave as "conditional samplers" from the noisy distribution. That is, they replicate the noise in the train data to unseen examples. We give a theoretical framework for studying this conditional sampling behavior in the context of learning theory. We relate the notion of such samplers to knowledge distillation, where a student network imitates the outputs of a teacher on unlabeled data. We show that samplers, while being bad classifiers, can be good teachers. Concretely, we prove that distillation from samplers is guaranteed to produce a student which approximates the Bayes optimal classifier. Finally, we show that some common learning algorithms (e.g., Nearest-Neighbours and Kernel Machines) can generate samplers when applied in the overparameterized regime.


title: Large $|k|$ behavior for the reflection coefficient for Davey-Stewartson II equations

abstract: The study of complex geometric optics solutions to a system of d-bar equations appearing in the context of electrical impedance tomography and the scattering theory of the integrable Davey-Stewartson II equations for large values of the spectral parameter $k$ in \cite{KlSjSt20} is extended to the reflection coefficient. For the case of potentials $q$ with compact support on some domain $\Omega$ with smooth strictly convex boundary, improved asymptotic relations are provided.


title: Renormalization and existence of the finite-time blow up solutions for a one-dimensional analogue of the Navier-Stokes equations

abstract: The one-dimensional quasi-geostrophic equation is the one-dimensional Fourier-space analogue of the famous Navier-Stokes equations. In their work Li and Sinai have proposed a renormalization approach to the problem of existence of finite-time blow up solutions of this equation. In this setting, existence of finite time blow ups is a consequence of existence of a fixed point for a certain renormalization operator on an appropriate functional space. They have provided a proof of existence of complex-valued finite time blow up solutions of the quasi-geostrophic equation. In this paper we revisit the renormalization problem for the quasi-geostrophic blow ups, prove existence of a family of renormalization fixed points, and deduce existence of real $C^\infty([0,T),C^\infty(\mathbb{R}) \cap L^2(\mathbb{R}))$ solutions to the quasi-geostrophic equation whose energy and enstrophy become unbounded in finite time, different from those found in the previous work of Li and Sinai.


title: Penguin Effects in $B_d^0\to J/\psi K^0_S$ and $B_s^0\to J/\psi\phi$

abstract: Controlling the contributions from doubly Cabibbo-suppressed penguin topologies in the decays $B_d^0\to J/\psi K^0_S$ and $B_s^0\to J/\psi\phi$ is mandatory to reach the highest possible precision in the measurement of the $B^0_q$--$\bar B^0_q$ ($q=d,s$) mixing phases $\phi_d$ and $\phi_s$. The penguin contributions can be determined using a strategy based on the $SU(3)$ flavour symmetry of QCD. Using the latest experimental data, we update our combined analysis of the decays $B_d^0\to J/\psi K^0_S$, $B_s^0\to J/\psi\phi$ and their control channels $B_s^0\to J/\psi K^0_S$, $B_d^0\to J/\psi \pi^0$ and $B_d^0\to J/\psi \rho^0$. This allows us to simultaneously determine the penguin parameters and both mixing phases. We discuss how the branching fractions of these decays can be used to probe the size of non-factorisable $SU(3)$-breaking effects, which form the main theoretical uncertainty associated with our $SU(3)$-based strategy, and provide new insights into the factorisation approach.


title: Digital quantum simulation of non-perturbative dynamics of open systems with orthogonal polynomials

abstract: Classical non-perturbative simulations of open quantum systems' dynamics face several scalability problems, namely, exponential scaling of the computational effort as a function of either the time length of the simulation or the size of the open system. In this work, we propose the use of the Time Evolving Density operator with Orthogonal Polynomials Algorithm (TEDOPA) on a quantum computer, which we term as Quantum TEDOPA (Q-TEDOPA), to simulate non-perturbative dynamics of open quantum systems linearly coupled to a bosonic environment (continuous phonon bath). By performing a change of basis of the Hamiltonian, the TEDOPA yields a chain of harmonic oscillators with only local nearest-neighbour interactions, making this algorithm suitable for implementation on quantum devices with limited qubit connectivity such as superconducting quantum processors. We analyse in detail the implementation of the TEDOPA on a quantum device and show that exponential scalings of computational resources can potentially be avoided for time-evolution simulations of the systems considered in this work. We applied the proposed method to the simulation of the exciton transport between two light-harvesting molecules in the regime of moderate coupling strength to a non-Markovian harmonic oscillator environment on an IBMQ device. Applications of the Q-TEDOPA span problems which can not be solved by perturbation techniques belonging to different areas, such as the dynamics of quantum biological systems and strongly correlated condensed matter systems.


title: Mean-Field Type FBSDEs under Domination-Monotonicity Conditions and Application to LQ Problems

abstract: This paper is concerned with a class of mean-field type coupled forward-backward stochastic differential equations (MF-FBSDEs, for short), in which the coupling appears in integral terms, terminal terms, and initial terms. Inspired by various mean-field type linear-quadratic (MF-LQ,for short) optimal control problems, we proposed a type of randomized domination-monotonicity conditions, under which and the usual Lipschitz condition, we obtain a well-posedness result on MF-FBSDEs in the sense of square integrability including the unique solvability, an estimate of the solution, and the related continuous dependence property of the solution on the coefficients.The result of MF-FBSDEs in turn extends MF-LQ problems in the literature to a general situation where the initial states or the terminal states are also controlled at the same time, and gives explicit expressions of the related unique optimal controls.


title: Few-Shot Learning with Siamese Networks and Label Tuning

abstract: We study the problem of building text classifiers with little or no training data, commonly known as zero and few-shot text classification. In recent years, an approach based on neural textual entailment models has been found to give strong results on a diverse range of tasks. In this work, we show that with proper pre-training, Siamese Networks that embed texts and labels offer a competitive alternative. These models allow for a large reduction in inference cost: constant in the number of labels rather than linear. Furthermore, we introduce label tuning, a simple and computationally efficient approach that allows to adapt the models in a few-shot setup by only changing the label embeddings. While giving lower performance than model fine-tuning, this approach has the architectural advantage that a single encoder can be shared by many different tasks.


title: Stability of Yang Mills Vacuum State

abstract: We examine the phenomena of the chromomagnetic gluon condensation in the Yang-Mills theory and the problem of stability of the chromomagnetic vacuum fields. The apparent instability of the chromomagnetic vacuum fields is a result of quadratic approximation. The stability is restored when the nonlinear interaction of negative/unstable modes is taken into account in the case of chromomagnetic vacuum fields and the interaction of the zero modes in the case of (anti)self-dual covariantly-constant vacuum fields. All these vacuum fields are stable and indicate that the Yang-Mills vacuum is highly degenerate quantum state.


title: Continuous-variable measurement device independent quantum conferencing with post-selection

abstract: A continuous variable (CV), measurement device independent (MDI) quantum key distribution (QKD) protocol is analyzed, enabling three parties to connect for quantum conferencing. We utilise a generalised Bell detection at an untrusted relay and a postselection procedure, in which distant parties reconcile on the signs of the displacements of the quadratures of their prepared coherent states. We derive the rate of the protocol under a collective pure-loss attack, demonstrating improved rate-distance performance compared to the equivalent non-post-selected protocol. In the symmetric configuration in which all the parties lie the same distance from the relay, we find a positive key rate over 6 km. Such postselection techniques can be used to improve the rate of multi-party quantum conferencing protocols at longer distances at the cost of reduced performance at shorter distances.


title: Absolute efficiency of a two-stage microchannel plate for electrons in the 30 - 900 eV energy range

abstract: We report on an apparatus able to measure the absolute detection efficiency of a detector for electrons in the 30 - 900 eV range. In particular, we discuss the characterisation of a two-stage chevron microchannel plate (MCP). The measurements have been performed in the LASEC laboratory at Roma Tre University, whit a custom-made electron gun. The very good stability of the beam current in the fA range, together with the picoammeter nominal resolution of 0.01 fA, allowed the measurement of the MCP absolute efficiency $\epsilon$. We found an $\epsilon$ = (0.489 $\pm$ 0.003) with no evident energy dependence. We fully characterised the MCP pulse shape distribution, which is quasi-Gaussian with a well visible peak above the noise level. We measured a 68% variation of the average pulse height between 30 and 500 eV. Furthermore, with a deeper analysis of the pulse shape, and in particular of the correlation between pulse height, area and width, we found a method to discriminate single- and multi- electron events occurring within a 10 ns time window.


title: Injection testing backed refactoring

abstract: Injection-based testing while refactoring is a pattern that minimizes the need for manual editing when altering the behaviour of a code base. Neither does it rely on a compilation or a linking process nor does it make assumptions on the structure of the code. Thus, it can be particularly useful for refactoring code that has been written in scripting languages, and specifically targets the research and engineering context. We describe the pattern and propose a set of functions for its application. The applicability of code injection for refactoring is highlighted via specific examples for deriving unit and integration tests. Finally, we comment on the customizing of the pattern and give practical advice for its implementation.


title: Revisiting Model-based Value Expansion

abstract: Model-based value expansion methods promise to improve the quality of value function targets and, thereby, the effectiveness of value function learning. However, to date, these methods are being outperformed by Dyna-style algorithms with conceptually simpler 1-step value function targets. This shows that in practice, the theoretical justification of value expansion does not seem to hold. We provide a thorough empirical study to shed light on the causes of failure of value expansion methods in practice which is believed to be the compounding model error. By leveraging GPU based physics simulators, we are able to efficiently use the true dynamics for analysis inside the model-based reinforcement learning loop. Performing extensive comparisons between true and learned dynamics sheds light into this black box. This paper provides a better understanding of the actual problems in value expansion. We provide future directions of research by empirically testing the maximum theoretical performance of current approaches.


title: Random matrix analysis of deep neural network weight matrices

abstract: Neural networks have been used successfully in a variety of fields, which has led to a great deal of interest in developing a theoretical understanding of how they store the information needed to perform a particular task. We study the weight matrices of trained deep neural networks using methods from random matrix theory (RMT) and show that the statistics of most of the singular values follow universal RMT predictions. This suggests that they are random and do not contain system specific information, which we investigate further by comparing the statistics of eigenvector entries to the universal Porter-Thomas distribution. We find that for most eigenvectors the hypothesis of randomness cannot be rejected, and that only eigenvectors belonging to the largest singular values deviate from the RMT prediction, indicating that they may encode learned information. In addition, a comparison with RMT predictions also allows to distinguish networks trained in different learning regimes - from lazy to rich learning. We analyze the spectral distribution of the large singular values using the Hill estimator and find that the distribution cannot in general be characterized by a tail index, i.e. is not of power law type.


title: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation

abstract: This paper studies the 3D instance segmentation problem, which has a variety of real-world applications such as robotics and augmented reality. Since the surroundings of 3D objects are of high complexity, the separating of different objects is very difficult. To address this challenging problem, we propose a novel framework to group and refine the 3D instances. In practice, we first learn an offset vector for each point and shift it to its predicted instance center. To better group these points, we propose a Hierarchical Point Grouping algorithm to merge the centrally aggregated points progressively. All points are grouped into small clusters, which further gradually undergo another clustering procedure to merge into larger groups. These multi-scale groups are exploited for instance prediction, which is beneficial for predicting instances with different scales. In addition, a novel MaskScoreNet is developed to produce binary point masks of these groups for further refining the segmentation results. Extensive experiments conducted on the ScanNetV2 and S3DIS benchmarks demonstrate the effectiveness of the proposed method. For instance, our approach achieves a 66.4\% mAP with the 0.5 IoU threshold on the ScanNetV2 test set, which is 1.9\% higher than the state-of-the-art method.


title: Clusters in an epidemic model with long-range dispersal

abstract: In presence of long range dispersal, epidemics spread in spatially disconnected regions known as clusters. Here, we characterize exactly their statistical properties in a solvable model, in both the supercritical (outbreak) and critical regimes. We identify two diverging length scales, corresponding to the bulk and the outskirt of the epidemic. We reveal a nontrivial critical exponent that governs the cluster number, the distribution of their sizes and of the distances between them. We also discuss applications to depinning avalanches with long range elasticity.

categories: cond-mat.stat-mech cond-mat.dis-nn math-ph math.MP


title: Four-Vector Optical Dirac Equation and Spin-Orbit Interaction of Structured Light

abstract: The spin-orbit interaction of light is a crucial concept for understanding the electromagnetic properties of a material and realizing the spin-controlled manipulation of optical fields. Achieving these goals requires a complete description of spin-dependent optical phenomena in the context of vector-wave mechanics. We develop an extended Dirac theory for optical fields in generic media, which was found to be akin to a non-Hermitian chiral-extension of massive fermions with anomalous magnetic momenta moving in an external pseudo-magnetic field. This similarity allows us to investigate the optical behaviors of a material by effective field theory methods and can find wide applications in metamaterials, photonic topological insulators, etc. We demonstrate this method by studying the spin-orbit interaction of structured light in a spin-degenerate medium and inhomogeneous isotropic medium, which leads to both spin-orbital-Hall effects and spin-to-orbital angular momentum conversion. Of importance, our approach provides simple and clear physical insight into the spin-orbit interaction of light in generic media, and could potentially bridge our understanding of topological insulators between electronic and photonic systems.


title: Quantized function algebras at $q=0$: type $A_{n}$ case

abstract: We define the notion of quantised function algebras at $q=0$ for the $q$ deformations of the type $A_{n}$ compact Lie groups at the $C^*$-algebra level. The $C^{*}$-algebra $A_{n}(0)$ is defined as a universal $C^*$-algebra given by a finite set of generators and relations. We obtain these relations by looking at the irreducible representations of the quantised function algebras for $q>0$ and taking limit as $q\to 0+$ after rescaling the generating elements appropriately. We then focus on the case $n=2$ and prove that irreducible representations $A_{2}(0)$ are precisely the $q\to 0+$ limits of the irreducible representations of the $C^*$-algebras $A_{2}(q)$.


title: Federated Learning with Position-Aware Neurons

abstract: Federated Learning (FL) fuses collaborative models from local nodes without centralizing users' data. The permutation invariance property of neural networks and the non-i.i.d. data across clients make the locally updated parameters imprecisely aligned, disabling the coordinate-based parameter averaging. Traditional neurons do not explicitly consider position information. Hence, we propose Position-Aware Neurons (PANs) as an alternative, fusing position-related values (i.e., position encodings) into neuron outputs. PANs couple themselves to their positions and minimize the possibility of dislocation, even updating on heterogeneous data. We turn on/off PANs to disable/enable the permutation invariance property of neural networks. PANs are tightly coupled with positions when applied to FL, making parameters across clients pre-aligned and facilitating coordinate-based parameter averaging. PANs are algorithm-agnostic and could universally improve existing FL algorithms. Furthermore, "FL with PANs" is simple to implement and computationally friendly.


title: Modular symmetry of soft supersymmetry breaking terms

abstract: We study the modular symmetry of soft supersymmetry breaking terms. Soft scalar masses and $A$-term coefficients are invariant under the modular symmetry when we regard $F$-term as a spurion with the modular weight $-2$. Their flavor structure is determined by the same symmetry as Yukawa couplings, i.e., fermion masses. The modular symmetric behavior of $\mu$-term and $B$-term depends on how the $\mu$-term is generated.


title: Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creation

abstract: We address the problem of generating a 360-degree image from a single image with a narrow field of view by estimating its surroundings. Previous methods suffered from overfitting to the training resolution and deterministic generation. This paper proposes a completion method using a transformer for scene modeling and novel methods to improve the properties of a 360-degree image on the output image. Specifically, we use CompletionNets with a transformer to perform diverse completions and AdjustmentNet to match color, stitching, and resolution with an input image, enabling inference at any resolution. To improve the properties of a 360-degree image on an output image, we also propose WS-perceptual loss and circular inference. Thorough experiments show that our method outperforms state-of-the-art (SOTA) methods both qualitatively and quantitatively. For example, compared to SOTA methods, our method completes images 16 times larger in resolution and achieves 1.7 times lower Frechet inception distance (FID). Furthermore, we propose a pipeline that uses the completion results for lighting and background of 3DCG scenes. Our plausible background completion enables perceptually natural results in the application of inserting virtual objects with specular surfaces.


title: Dynamic Structure in Four-strategy Game: Theory and Experiment

abstract: Game dynamics theory, as a field of science, the consistency of theory and experiment is essential. In the past 10 years, important progress has been made in the merging of the theory and experiment in this field, in which dynamics cycle is the presentation. However, the merging works have not got rid of the constraints of Euclidean two-dimensional cycle so far. This paper uses a classic four-strategy game to study the dynamic structure (non-Euclidean superplane cycle). The consistency is in significant between the three ways: (1) the analytical results from evolutionary dynamics equations, (2) agent-based simulation results from learning models and (3) laboratory results from human subjects game experiments. The consistency suggests that, game dynamic structure could be quantitatively predictable, observable and controllable in general.


title: On the third problem of Halmos on Banach spaces

abstract: Assume that $X$ is a complex separable infinite dimensional Banach space and $\mathcal{B}(X)$ denotes the Banach algebra of all bounded linear operators from $X$ to itself. In 1970, P.R. Halmos raised ten open problems in Hilbert spaces. The third one is the following: If an intransitive operator $T$ has an inverse, is its inverse also intransitive? This question is closely related to the invariant subspace problem. Ever since Enflo's celebrated counterexample on $\ell_1$ answered the invariant subspace problem in negative, the Banach space setting of the third question of Halmos has become more interesting. In this paper, we give an affirmative answer to this problem under certain spectral conditions. As an application, we show that for an invertible operator $T$ with Dunford's Property ($C$), if $T^{-1}$ is intransitive and there exists a connected component $\Omega$ of $int\sigma(T^{-1})^\land$ which is off the origin such that $\Omega\cap\rho_F(T^{-1})\neq \emptyset$, then $T$ is also intransitive. In the end of the paper, we show that a sufficient and necessary condition for that there exists a bounded linear operator without non-trivial invariant subspaces on the infinite dimensional space $L_1(\Omega,\sum,\mu)$ (resp., $C(K)$, the space of bounded continuous functions on a complete metric space $K$) is that $(\Omega,\sum,\mu)$ is $\sigma$-finite (resp., $K$ is compact).


title: Non-Markovian thermal operations boosting the performance of quantum heat engines

abstract: It is investigated whether non-Markovianity, i.e., the memory effects resulting from the coupling of the system to its environment, can be beneficial for the performance of quantum heat engines. Specifically, two physical models are considered. The first one is a well known single-qubit Otto engine; the non-Markovian behaviour is there implemented by replacing standard thermalization strokes with so-called extremal thermal operations which cannot be realized without the memory effects. The second one is a three-stroke engine in which the cycle consists of two extremal thermal operations and a single qubit rotation. It is shown that the non-Markovian Otto engine can generate more work-per-cycle for a given efficiency than its Markovian counterpart, whereas performance of both setups is superior to the three-stroke engine. Furthermore, both the non-Markovian Otto engine and the three-stroke engine can reduce the work fluctuations in comparison with the Markovian Otto engine, with their relative advantage depending on the performance target. This demonstrates the beneficial influence of non-Markovianity on both the average performance and the stability of operation of quantum heat engines.


title: Are High-Resolution Event Cameras Really Needed?

abstract: Due to their outstanding properties in challenging conditions, event cameras have become indispensable in a wide range of applications, ranging from automotive, computational photography, and SLAM. However, as further improvements are made to the sensor design, modern event cameras are trending toward higher and higher sensor resolutions, which result in higher bandwidth and computational requirements on downstream tasks. Despite this trend, the benefits of using high-resolution event cameras to solve standard computer vision tasks are still not clear. In this work, we report the surprising discovery that, in low-illumination conditions and at high speeds, low-resolution cameras can outperform high-resolution ones, while requiring a significantly lower bandwidth. We provide both empirical and theoretical evidence for this claim, which indicates that high-resolution event cameras exhibit higher per-pixel event rates, leading to higher temporal noise in low-illumination conditions and at high speeds. As a result, in most cases, high-resolution event cameras show a lower task performance, compared to lower resolution sensors in these conditions. We empirically validate our findings across several tasks, namely image reconstruction, optical flow estimation, and camera pose tracking, both on synthetic and real data. We believe that these findings will provide important guidelines for future trends in event camera development.


title: Using Machine Learning to generate an open-access cropland map from satellite images time series in the Indian Himalayan Region

abstract: Crop maps are crucial for agricultural monitoring and food management and can additionally support domain-specific applications, such as setting cold supply chain infrastructure in developing countries. Machine learning (ML) models, combined with freely-available satellite imagery, can be used to produce cost-effective and high spatial-resolution crop maps. However, accessing ground truth data for supervised learning is especially challenging in developing countries due to factors such as smallholding and fragmented geography, which often results in a lack of crop type maps or even reliable cropland maps. Our area of interest for this study lies in Himachal Pradesh, India, where we aim at producing an open-access binary cropland map at 10-meter resolution for the Kullu, Shimla, and Mandi districts. To this end, we developed an ML pipeline that relies on Sentinel-2 satellite images time series. We investigated two pixel-based supervised classifiers, support vector machines (SVM) and random forest (RF), which are used to classify per-pixel time series for binary cropland mapping. The ground truth data used for training, validation and testing was manually annotated from a combination of field survey reference points and visual interpretation of very high resolution (VHR) imagery. We trained and validated the models via spatial cross-validation to account for local spatial autocorrelation and selected the RF model due to overall robustness and lower computational cost. We tested the generalization capability of the chosen model at the pixel level by computing the accuracy, recall, precision, and F1-score on hold-out test sets of each district, achieving an average accuracy for the RF (our best model) of 87%. We used this model to generate a cropland map for three districts of Himachal Pradesh, spanning 14,600 km2, which improves the resolution and quality of existing public maps.


title: Exploring the circular polarisation of low-frequency solar radio bursts with LOFAR

abstract: The Sun is an active star that often produces numerous bursts of electromagnetic radiation at radio wavelengths. Low frequency radio bursts have recently been brought back to light with the advancement of novel radio interferometers. However, their polarisation properties have not yet been explored in detail, especially with the Low Frequency Array (LOFAR), due to difficulties in calibrating the data and accounting for instrumental leakage. Here, using a unique method to correct the polarisation observations, we explore the circular polarisation of different sub-types of solar type III radio bursts and a type I noise storm observed with LOFAR, which occurred during March-April 2019. We analysed six individual radio bursts from two different dates. We present the first Stokes V low frequency images of the Sun with LOFAR in tied-array mode observations. We find that the degree of circular polarisation for each of the selected bursts increases with frequency for fundamental emission, while this trend is either not clear or absent for harmonic emission. The type III bursts studied, that are part of a long--lasting type III storm, can have different senses of circular polarisation, occur at different locations and have different propagation directions. This indicates that the type III bursts forming a classical type III storm do not necessarily have a common origin but instead they indicate the existence of multiple, possibly unrelated, acceleration processes originating from solar minimum active regions.


title: Part-based Pseudo Label Refinement for Unsupervised Person Re-identification

abstract: Unsupervised person re-identification (re-ID) aims at learning discriminative representations for person retrieval from unlabeled data. Recent techniques accomplish this task by using pseudo-labels, but these labels are inherently noisy and deteriorate the accuracy. To overcome this problem, several pseudo-label refinement methods have been proposed, but they neglect the fine-grained local context essential for person re-ID. In this paper, we propose a novel Part-based Pseudo Label Refinement (PPLR) framework that reduces the label noise by employing the complementary relationship between global and part features. Specifically, we design a cross agreement score as the similarity of k-nearest neighbors between feature spaces to exploit the reliable complementary relationship. Based on the cross agreement, we refine pseudo-labels of global features by ensembling the predictions of part features, which collectively alleviate the noise in global feature clustering. We further refine pseudo-labels of part features by applying label smoothing according to the suitability of given labels for each part. Thanks to the reliable complementary information provided by the cross agreement score, our PPLR effectively reduces the influence of noisy labels and learns discriminative representations with rich local contexts. Extensive experimental results on Market-1501 and MSMT17 demonstrate the effectiveness of the proposed method over the state-of-the-art performance. The code is available at https://github.com/yoonkicho/PPLR.


title: Using Malliavin calculus to solve a chemical diffusion master equation

abstract: We propose a novel method to solve a chemical diffusion master equation of birth and death type. This is an infinite system of Fokker-Planck equations where the different components are coupled by reaction dynamics similar in form to a chemical master equation. This system was proposed in [3] for modelling the probabilistic evolution of chemical reaction kinetics associated with spatial diffusion of individual particles. Using some basic tools and ideas from infinite dimensional Gaussian analysis we are able to reformulate the aforementioned infinite system of Fokker-Planck equations as a single evolution equation solved by a generalized stochastic process and written in terms of Malliavin derivatives and differential second quantization operators. Via this alternative representation we link certain finite dimensional projections of the solution of the original problem to the solution of a single partial differential equations of Ornstein-Uhlenbeck type containing as many variables as the dimension of the aforementioned projection space.


title: Noncommutative numerable principal bundles from group actions on C*-algebras

abstract: We introduce a definition of the locally trivial $G$-C*-algebra, which is a noncommutative counterpart of the total space of a locally compact Hausdorff numerable principal $G$-bundle. To obtain this generalization, we have to go beyond the Gelfand-Naimark duality and use the multipliers of the Pedersen ideal. Our new concept enables us to investigate local triviality of noncommutative principal bundles coming from group actions on non-unital C*-algebras, which we illustrate through examples coming from $C_0(Y)$-algebras and graph C*-algebras. In the case of an action of a compact Hausdorff group on a unital C*-algebra, local triviality in our sense is implied by the finiteness of the local-triviality dimension of the action. Furthermore, we prove that if $A$ is a locally trivial $G$-C*-algebra, then the $G$-action on $A$ is free in a certain sense, which in many cases coincides with the known notions of freeness due to Rieffel and Ellwood.


title: Universal sums of generalized heptagonal numbers

abstract: In this paper, we consider representations of integers as sums of generalized heptagonal numbers with a prescribed number of repeats of each heptagonal number appearing in the sum. In particular, we investigate the classification of such sums which are universal, i.e., those that represent every positive integer. We prove an explicit finite bound such that a given sum is universal if and only if it represents positive integer up to the given bound.


title: Brain-inspired Multilayer Perceptron with Spiking Neurons

abstract: Recently, Multilayer Perceptron (MLP) becomes the hotspot in the field of computer vision tasks. Without inductive bias, MLPs perform well on feature extraction and achieve amazing results. However, due to the simplicity of their structures, the performance highly depends on the local features communication machenism. To further improve the performance of MLP, we introduce information communication mechanisms from brain-inspired neural networks. Spiking Neural Network (SNN) is the most famous brain-inspired neural network, and achieve great success on dealing with sparse data. Leaky Integrate and Fire (LIF) neurons in SNNs are used to communicate between different time steps. In this paper, we incorporate the machanism of LIF neurons into the MLP models, to achieve better accuracy without extra FLOPs. We propose a full-precision LIF operation to communicate between patches, including horizontal LIF and vertical LIF in different directions. We also propose to use group LIF to extract better local features. With LIF modules, our SNN-MLP model achieves 81.9%, 83.3% and 83.5% top-1 accuracy on ImageNet dataset with only 4.4G, 8.5G and 15.2G FLOPs, respectively, which are state-of-the-art results as far as we know.


title: Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space

abstract: Transformer-based language models (LMs) are at the core of modern NLP, but their internal prediction construction process is opaque and largely not understood. In this work, we make a substantial step towards unveiling this underlying prediction process, by reverse-engineering the operation of the feed-forward network (FFN) layers, one of the building blocks of transformer models. We view the token representation as a changing distribution over the vocabulary, and the output from each FFN layer as an additive update to that distribution. Then, we analyze the FFN updates in the vocabulary space, showing that each update can be decomposed to sub-updates corresponding to single FFN parameter vectors, each promoting concepts that are often human-interpretable. We then leverage these findings for controlling LM predictions, where we reduce the toxicity of GPT2 by almost 50%, and for improving computation efficiency with a simple early exit rule, saving 20% of computation on average.


title: ObjectFormer for Image Manipulation Detection and Localization

abstract: Recent advances in image editing techniques have posed serious challenges to the trustworthiness of multimedia data, which drives the research of image tampering detection. In this paper, we propose ObjectFormer to detect and localize image manipulations. To capture subtle manipulation traces that are no longer visible in the RGB domain, we extract high-frequency features of the images and combine them with RGB features as multimodal patch embeddings. Additionally, we use a set of learnable object prototypes as mid-level representations to model the object-level consistencies among different regions, which are further used to refine patch embeddings to capture the patch-level consistencies. We conduct extensive experiments on various datasets and the results verify the effectiveness of the proposed method, outperforming state-of-the-art tampering detection and localization methods.


title: Probing the anomalous tqgamma couplings in photon-proton collisions

abstract: The top quark flavor changing neutral current processes are extremely suppressed within the Standard Model. Nevertheless, they could be enhanced in a new physics model beyond the Standard Model. Investigating the top quark's flavor changing neutral current interactions at colliders would be an important test in terms of new physics. In this work, we examine the potentials of the processes ${e^{-}} {p} {\rightarrow} {e^{-}} {\gamma}^{*} {p} {\rightarrow} {e^{-}} W^{+} b {\gamma}^{*}{\rightarrow} {e^{-}} {j} {\bar{j}} b {\gamma}^{*} $ and ${e^{-}} {p} {\rightarrow} {e^{-}} {\gamma}^{*} {p} {\rightarrow} {e^{-}} W^{+} b {\gamma}^{*}{\rightarrow} {e^{-}} \textit{l} {\nu}_\textit{l} b {\gamma}^{*} $ at the FCC-eh with $\sqrt{s} = 7.08 $ and $ 10.0 TeV $ to study anomalous $tq\gamma$ couplings via effective Lagrangians. We obtain $95{\%}$ confidence level sensitivities on the anomalous coupling parameters at the three FCC-eh energies and various integrated luminosities. We find that our limits are at least two orders of magnitude better than the current LHC experimental results.


title: AMCAD: Adaptive Mixed-Curvature Representation based Advertisement Retrieval System

abstract: Graph embedding based retrieval has become one of the most popular techniques in the information retrieval community and search engine industry. The classical paradigm mainly relies on the flat Euclidean geometry. In recent years, hyperbolic (negative curvature) and spherical (positive curvature) representation methods have shown their superiority to capture hierarchical and cyclic data structures respectively. However, in industrial scenarios such as e-commerce sponsored search platforms, the large-scale heterogeneous query-item-advertisement interaction graphs often have multiple structures coexisting. Existing methods either only consider a single geometry space, or combine several spaces manually, which are incapable and inflexible to model the complexity and heterogeneity in the real scenario. To tackle this challenge, we present a web-scale Adaptive Mixed-Curvature ADvertisement retrieval system (AMCAD) to automatically capture the complex and heterogeneous graph structures in non-Euclidean spaces. Specifically, entities are represented in adaptive mixed-curvature spaces, where the types and curvatures of the subspaces are trained to be optimal combinations. Besides, an attentive edge-wise space projector is designed to model the similarities between heterogeneous nodes according to local graph structures and the relation types. Moreover, to deploy AMCAD in Taobao, one of the largest ecommerce platforms with hundreds of million users, we design an efficient two-layer online retrieval framework for the task of graph based advertisement retrieval. Extensive evaluations on real-world datasets and A/B tests on online traffic are conducted to illustrate the effectiveness of the proposed system.


title: Investigating transactions in cryptocurrencies

abstract: This thesis presents techniques to investigate transactions in uncharted cryptocurrencies and services. Cryptocurrencies are used to securely send payments online. Payments via the first cryptocurrency, Bitcoin, use pseudonymous addresses that have limited privacy and anonymity guarantees. Research has shown that this pseudonymity can be broken, allowing users to be tracked using clustering and tagging heuristics. Such tracking allows crimes to be investigated. If a user has coins stolen, investigators can track addresses to identify the destination of the coins. This, combined with an explosion in the popularity of blockchain, has led to a vast increase in new coins and services. These offer new features ranging from coins focused on increased anonymity to scams shrouded as smart contracts. In this study, we investigated the extent to which transaction privacy has improved and whether users can still be tracked in these new ecosystems. We began by analysing the privacy-focused coin Zcash, a Bitcoin-forked cryptocurrency, that is considered to have strong anonymity properties due to its background in cryptographic research. We revealed that the user anonymity set can be considerably reduced using heuristics based on usage patterns. Next, we analysed cross-chain transactions collected from the exchange ShapeShift, revealing that users can be tracked as they move across different ledgers. Finally, we present a measurement study on the smart-contract pyramid scheme Forsage, a scam that cycled $267 million USD (of Ethereum) within its first year, showing that at least 88% of the participants in the scheme suffered a loss. The significance of this study is the revelation that users can be tracked in newer cryptocurrencies and services by using our new heuristics, which informs those conducting investigations and developing these technologies.


title: HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System

abstract: As giant dense models advance quality but require large amounts of GPU budgets for training, the sparsely gated Mixture-of-Experts (MoE), a kind of conditional computation architecture, is proposed to scale models while keeping their computation constant. Specifically, the input tokens are routed by the gate network and only activates part of the expert network. Existing MoE training systems only support part of mainstream MoE models (e.g. Top k) training under expensive high-bandwidth GPU clusters. In this paper, we present HetuMoE, a high-performance large-scale sparse MoE training system built on Hetu. HetuMoE provides multiple gating strategies and efficient GPU kernel implementations. To further improve the training efficiency on commodity GPU clusters (e.g, with only 1 NiC), we introduce the hierarchical AllToAll communication that combines hierarchical networks and aggregating messages. Compared with existing state-of-the-art MoE systems, HetuMoE obtains at least 15% speedup. Specifically, HetuMoE outperforms DeepSpeed-MoE up to 8.1x under the switch gate with a batch size of 32. Our code is available at: https://github.com/PKU-DAIR/Hetu.


title: REPTILE: A Proactive Real-Time Deep Reinforcement Learning Self-adaptive Framework

abstract: In this work a general framework is proposed to support the development of software systems that are able to adapt their behaviour according to the operating environment changes. The proposed approach, named REPTILE, works in a complete proactive manner and relies on Deep Reinforcement Learning-based agents to react to events, referred as novelties, that can affect the expected behaviour of the system. In our framework, two types of novelties are taken into account: those related to the context/environment and those related to the physical architecture itself. The framework, predicting those novelties before their occurrence, extracts time-changing models of the environment and uses a suitable Markov Decision Process to deal with the real-time setting. Moreover, the architecture of our RL agent evolves based on the possible actions that can be taken.


title: On the classification of low-degree ovoids of Q(4,q)

abstract: Ovoids of the non-degenerate quadric Q(4,q) of PG(4,q) have been studied since the end of the '80s. They are rare objects and, beside the classical example given by an elliptic quadric, only three classes are known for q odd, one class for $q$ even, and a sporadic example for $\`iq=3^5. It is well known that to any ovoid of Q(4,q) a bivariate polynomial f(x,y) can be associated. In this paper we classify ovoids of Q(4,q) whose corresponding polynomial f(x,y) has 'low degree' compared with q, in particular deg(f)<(q/6.3)^(3/13)-1. Finally, as an application, {two classes} of permutation polynomials in characteristic 3 are obtained.


title: Training speaker recognition systems with limited data

abstract: This work considers training neural networks for speaker recognition with a much smaller dataset size compared to contemporary work. We artificially restrict the amount of data by proposing three subsets of the popular VoxCeleb2 dataset. These subsets are restricted to 50\,k audio files (versus over 1\,M files available), and vary on the axis of number of speakers and session variability. We train three speaker recognition systems on these subsets; the X-vector, ECAPA-TDNN, and wav2vec2 network architectures. We show that the self-supervised, pre-trained weights of wav2vec2 substantially improve performance when training data is limited. Code and data subsets are available at https://github.com/nikvaessen/w2v2-speaker-few-samples.


title: Extensions of the fundamental theorem of algebra

abstract: In this paper motivated by the celebrated fundamental theorem of algebra and its standard proof utilizing Liouville's Theorem, we prove the fundamental theorem of algebra type results for both commutative and noncommutative polynomials in the setting of left (resp. right) alternative topological complex algebras whose topological duals separates their elements and that of such real algebras whose centers contain certain copies of complex numbers. An application of one of the main results of the paper is the existence of eigenvalues for matrices with entries from arbitrary finite-dimensional complex algebras. We also prove the existence of right eigenvalues for matrices with entries from finite-dimensional associative real algebras that contain copies of the complex numbers.


title: The incompressible $\alpha$--Euler equations in the exterior of a vanishing disk

abstract: In this article we consider the $\alpha$--Euler equations in the exterior of a small fixed disk of radius $\epsilon$. We assume that the initial potential vorticity is compactly supported and independent of $\epsilon$, and that the circulation of the unfiltered velocity on the boundary of the disk does not depend on $\epsilon$. We prove that the solution of this problem converges, as $\epsilon \to 0$, to the solution of a modified $\alpha$--Euler equation in the full plane where an additional Dirac located at the center of the disk is imposed in the potential vorticity.


title: Sketch3T: Test-Time Training for Zero-Shot SBIR

abstract: Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and subjective nature of sketches, i.e., the model might transfer well to new categories, but will not understand sketches existing in different test-time distribution as a result. We thus extend ZS-SBIR asking it to transfer to both categories and sketch distributions. Our key contribution is a test-time training paradigm that can adapt using just one sketch. Since there is no paired photo, we make use of a sketch raster-vector reconstruction module as a self-supervised auxiliary task. To maintain the fidelity of the trained cross-modal joint embedding during test-time update, we design a novel meta-learning based training paradigm to learn a separation between model updates incurred by this auxiliary task from those off the primary objective of discriminative learning. Extensive experiments show our model to outperform state of-the-arts, thanks to the proposed test-time adaption that not only transfers to new categories but also accommodates to new sketching styles.


title: HypeR: Hypothetical Reasoning With What-If and How-To Queries Using a Probabilistic Causal Approach

abstract: What-if (provisioning for an update to a database) and how-to (how to modify the database to achieve a goal) analyses provide insights to users who wish to examine hypothetical scenarios without making actual changes to a database and thereby help plan strategies in their fields. Typically, such analyses are done by testing the effect of an update in the existing database on a specific view created by a query of interest. In real-world scenarios, however, an update to a particular part of the database may affect tuples and attributes in a completely different part due to implicit semantic dependencies. To allow for hypothetical reasoning while accommodating such dependencies, we develop HypeR, a framework that supports what-if and how-to queries accounting for probabilistic dependencies among attributes captured by a probabilistic causal model. We extend the SQL syntax to include the necessary operators for expressing these hypothetical queries, define their semantics, devise efficient algorithms and optimizations to compute their results using concepts from causality and probabilistic databases, and evaluate the effectiveness of our approach experimentally.


title: Supersymmetric Quantum Mechanics: Light at the End of the (Quantum) Tunnel

abstract: In this project, we will develop the foundations of quantum mechanics using the methods of supersymmetry. We will discuss the use of the superpotential to derive the supersymmetric partner of a potential in one dimension, and explore several key examples with an emphasis on shape invariant potentials. We will then discuss the modeling of supersymmetric quantum systems using matrices and operators, and how it relates to the eigenstate thermalization hypothesis.


title: Facial Action Unit Recognition Based on Transfer Learning

abstract: Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective behavior analysis in-the-wild (ABAW) has provided large amount of facial images with facial action unit annotations. In this paper, we introduce a facial action unit recognition method based on transfer learning. We first use available facial images with expression labels to train the feature extraction network. Then we fine-tune the network for facial action unit recognition.


title: Recruiting Software Engineers on Prolific

abstract: Recruiting participants for software engineering research has been a primary concern of the human factors community. This is particularly true for quantitative investigations that require a minimum sample size not to be statistically underpowered. Traditional data collection techniques, such as mailing lists, are highly doubtful due to self-selection biases. The introduction of crowdsourcing platforms allows researchers to select informants with the exact requirements foreseen by the study design, gather data in a concise time frame, compensate their work with fair hourly pay, and most importantly, have a high degree of control over the entire data collection process. This experience report discusses our experience conducting sample studies using Prolific, an academic crowdsourcing platform. Topics discussed are the type of studies, selection processes, and power computation.


title: Entropy of Kerr--Newman--AdS black holes with torsion

abstract: The canonical approach to black hole entropy in Poincar\'e gauge theory without matter is extended to include Maxwell field as a matter source. The new formalism is used to calculate asymptotic charges and entropy of Kerr--Newmann--AdS black holes with torsion. The result implies that the first law, with a nontrivial contribution of the Maxwell field, takes the same form as in general relativity.


title: Mechanically Tunable Radiative Cooling for Adaptive Thermal Control

abstract: Passive radiative cooling is currently the frontier technology in renewable-energy research. In terms of extraterrestrial applications, radiative cooling is a critical component to the thermal management system of a spacecraft, where the extreme environment of space can cause large temperature variations that can break and damage equipment. For terrestrial applications, nocturnal or daytime radiative cooling is expected to lead to cost-effective passive heat management without the need of inefficient and costly artificial refrigeration technologies. However, most currently available radiative cooling systems cannot be changed dynamically and radiate a constant static amount of thermal power. Dynamically tunable adaptive radiative cooling systems will be a critical development to prolong the lifetime of spacecraft or improve the efficiency of terrestrial cooling systems. Here we propose stretchable radiative cooling designs that can be substantially tuned by using the simple physical mechanism of mechanical strain. When their structure is stretched, the radiated power is significantly reduced. We develop a modeling method that can simulate mechanical stretching combined with electromagnetic response to compute the tunable thermal emission of these new adaptive radiative cooling systems. The presented photonically engineered structures can be used as coatings to achieve efficient adaptive thermal control of various objects in a cost-effective and environmentally friendly way. The proposed designs are much simpler to be realized than others found in the literature and the best design achieves a high thermal emission power with a tunable range on the order of 132 W/m2.


title: LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Clouds

abstract: Existing motion capture datasets are largely short-range and cannot yet fit the need of long-range applications. We propose LiDARHuman26M, a new human motion capture dataset captured by LiDAR at a much longer range to overcome this limitation. Our dataset also includes the ground truth human motions acquired by the IMU system and the synchronous RGB images. We further present a strong baseline method, LiDARCap, for LiDAR point cloud human motion capture. Specifically, we first utilize PointNet++ to encode features of points and then employ the inverse kinematics solver and SMPL optimizer to regress the pose through aggregating the temporally encoded features hierarchically. Quantitative and qualitative experiments show that our method outperforms the techniques based only on RGB images. Ablation experiments demonstrate that our dataset is challenging and worthy of further research. Finally, the experiments on the KITTI Dataset and the Waymo Open Dataset show that our method can be generalized to different LiDAR sensor settings.


title: Towards Stable Interstellar Flight: Levitation of a Laser-Propelled Sailcraft*

abstract: Exploring and traveling to distant stars has long fascinated humanity but has been limited due to the vast distances. The Breakthrough Starshot Program aims at eliminating this limitation by traveling to Alpha Centauri, which is 4.37 light-years away. Thus, it is only possible if a vehicle travels at a substantial fraction of the speed of light. The Breakthrough Starshot Program initiatives to develop a proof-of-concept that is accelerating a sail to relativistic speeds using a laser beam aimed at the sail. At this high speed, while a stable beam riding is one of the crucial concerns of this concept, the dynamic stability analysis of a sail is hardly present in the previous literature. Furthermore, it is important to investigate the dynamic stability in the experiment before driving the sail to relativistic speeds. As a proof of concept, we study the dynamic stability of the sail levitated at a certain height by a laser beam. The sail's dynamics are modeled as a rigid body whose shape is parameterized by a sweep function. We estimate the region of attraction (ROA) for dynamic stability analysis using Lyapunov theory and Sum-of-square (SOS) programming. The ROA confirms how much a levitated sail can tolerate the transverse and angular perturbations. We also conclude on some of the important parameters of the sail that affects the dynamic stability. Simulation results validate our theoretical analysis.


title: Xenon-Doped Liquid Argon TPCs as a Neutrinoless Double Beta Decay Platform

abstract: Searches for neutrinoless double-beta decay continue to expand our understanding of the lepton sector, with experiments now pursuing ton-scale target masses with sensitivity to $m_{\beta\beta}$ covering the allowed parameter space for the inverted neutrino mass ordering. Continued searches for this rare decay will require scalable detector technologies to achieve significant increases in the target mass beyond the ton scale, in order to probe the normal ordering region. This work explores the concept of searching for neutrinoless double-beta decay in a 10 kton scale liquid argon time projection chamber (LArTPC) located deep underground and doped with percent-level quantities of xenon. We discuss the design requirements, background mitigation and detector R&D needs, and considerations for deployment in a modified DUNE far detector module. We find that such a detector could reach $m_{\beta\beta}$ sensitivity at the 2-4 meV range with xenon doping at 2% if significant background reductions can be achieved.


title: On Weakly S-primary Submodules

abstract: Let $R$ be a commutative ring with a non-zero identity, $S$ be a multiplicatively closed subset of $R$ and $M$ be a unital $R$-module. In this paper, we define a submodule $N$ of $M$ with $(N:_{R}M)\cap S=\emptyset$ to be weakly $S$-primary if there exists $s\in S$ such that whenever $a\in R$ and $m\in M$ with $0\neq am\in N$, then either $sa\in\sqrt{(N:_{R}M)}$ or $sm\in N$. We present various properties and characterizations of this concept (especially in finitely generated faithful multiplication modules). Moreover, the behavior of this structure under module homomorphisms, localizations, quotient modules, cartesian product and idealizations is investigated. Finally, we determine some conditions under which two kinds of submodules of the amalgamation module along an ideal are weakly $S$-primary.


title: Bi-level Doubly Variational Learning for Energy-based Latent Variable Models

abstract: Energy-based latent variable models (EBLVMs) are more expressive than conventional energy-based models. However, its potential on visual tasks are limited by its training process based on maximum likelihood estimate that requires sampling from two intractable distributions. In this paper, we propose Bi-level doubly variational learning (BiDVL), which is based on a new bi-level optimization framework and two tractable variational distributions to facilitate learning EBLVMs. Particularly, we lead a decoupled EBLVM consisting of a marginal energy-based distribution and a structural posterior to handle the difficulties when learning deep EBLVMs on images. By choosing a symmetric KL divergence in the lower level of our framework, a compact BiDVL for visual tasks can be obtained. Our model achieves impressive image generation performance over related works. It also demonstrates the significant capacity of testing image reconstruction and out-of-distribution detection.


title: Chemical Composition of a Palomar 12 Blue Straggler

abstract: With the equivalent area of a 16m telescope, ESPRESSO in 4UT mode allows to inaugurate high resolution spectroscopy for solar-type stars belonging to extragalactic globular clusters. We determine the chemical composition of an extragalactic blue straggler. The star has a G magnitude of 19.01 and belongs to the globular cluster Pal12, that is associated to the Sagittarius dwarf galaxy. Abundances are computed by using high resolution spectroscopy and LTE analysis. Two 50 minutes ESPRESSO spectra, co-added, provide a Signal to Noise Ratio of 25 with a resolving power R=70000. This allows us to measure with good precision abundance of several (13) elements. Li could help to distinguish between formation models of Blue Stragglers; we are able to set a 3 sigma upper limit of Li=3.1, which is still too high to discriminate between competing models. The abundances we retrieve for the BS are compatible with those of giant stars of Pal 12 published in literature, re-analyzed by us using the same procedure and line list. Small differences are present, that can be ascribed to NLTE effects, but for Mg the BS shows a large under-abundance. The most likely explanation is that the BS atmosphere is dominated by gas processed through the Mg-Al cycle, but we have no suitable Al or Na lines to confirm this hypothesis. We show that ESPRESSO with 4UT can be used to derive precise abundances for solar-type stars fainter than magnitude 19. At these magnitudes a proper sky subtraction is needed and in crowded field the targets must be chosen with outmost care, to avoid contamination of the sky fibre from nearby stars.


title: Spin Physics Detector at NICA

abstract: The Spin Physics Detector is one of two large setups at the NICA collider under construction at JINR (Dubna). The ultimate goal of the studies at SPD is the measurement of different spin observables in polarized proton-proton and deuteron-deuteron collisions sensitive to the polarized gluon structure of the nucleon at the luminosity up to 10$^{32}$ $cm^{-2}\cdot s^{-1}$ and $\sqrt{s}$ up to 27 GeV. SPD will consist of the superconducting magnetic system, silicon tracker, straw mini-drift tubes tracker, time-of-flight system, electromagnetic "shashlyk"- type calorimeter, muon (range) and local-polarimetry systems. The high performance free-streaming DAQ system will be able to operate at the collision rate up to 4 MHz.


title: Walking droplets as a damped-driven system

abstract: We consider the dynamics of a droplet on a vibrating fluid bath. This hydrodynamic quantum analog system is shown to elicit the canonical behavior of damped-driven systems, including a period doubling route to chaos. By approximating the system as a compositional map between the gain and loss dynamics, the underlying nonlinear dynamics can be shown to be driven by energy balances in the systems. The gain-loss iterative mapping is similar to a normal form encoding for the pattern forming instabilities generated in such spatially-extended system. Similar to mode-locked lasers and rotating detonation engines, the underlying bifurcations persist for general forms of the loss and gain, both of which admit explicit representations in our approximation. Moreover, the resulting geometrical description of the particle-wave interaction completely characterizes the instabilities observed in experiments.


title: Application-driven engagement with universities, synergies with other funding agencies

abstract: In this whitepaper, we argue that nurturing HEP Lab-Engineering cooperation through established collaboration and support mechanisms will advance the scientific mission of the labs significantly, while at the same time giving the laboratories a stronger position in influencing the next generation workforce of engineers that will provide their services towards the unique computing and technology needs of the HEP community. The authors of this whitepaper are electronics and computer engineers and so, naturally, the arguments herein are made from their perspective. However, these arguments are only strengthened by the simple fact that they could also have been made from the perspective of mechanical engineers, civil engineers or numerous other technologists. At the same time, this document serves as a summary of discussions that occurred during the Joint Instrumentation Frontier & Community Engagement Frontier Townhall meeting on November 10, 2020


title: The Constructor-Blocker Game

abstract: We study the following game version of the generalized graph Tur\'an problem. For two fixed graphs $F$ and $H$, two players, Constructor and Blocker, alternately claim unclaimed edges of the complete graph $K_n$. Constructor can only claim edges so that he never claims all edges of any copy of $F$, i.e. his graph must remain $F$-free, while Blocker can claim unclaimed edges without restrictions. The game ends when Constructor cannot claim further edges or when all edges have been claimed. The score of the game is the number of copies of $H$ with all edges claimed by Constructor. Constructor's aim is to maximize the score, while Blocker tries to keep the score as low as possible. We denote by $g(n,H,F)$ the score of the game when both players play optimally and Constructor starts the game. In this paper, we obtain the exact value of $g(n,H,F)$ when both $F$ and $H$ are stars and when $F=P_4$, $H=P_3$. We determine the asymptotics of $g(n,H,F)$ when $F$ is a star and $H$ is a tree and when $F=P_5$, $H=K_3$, and we derive upper and lower bounds on $g(n,P_4,P_5)$.


title: Object Memory Transformer for Object Goal Navigation

abstract: This paper presents a reinforcement learning method for object goal navigation (ObjNav) where an agent navigates in 3D indoor environments to reach a target object based on long-term observations of objects and scenes. To this end, we propose Object Memory Transformer (OMT) that consists of two key ideas: 1) Object-Scene Memory (OSM) that enables to store long-term scenes and object semantics, and 2) Transformer that attends to salient objects in the sequence of previously observed scenes and objects stored in OSM. This mechanism allows the agent to efficiently navigate in the indoor environment without prior knowledge about the environments, such as topological maps or 3D meshes. To the best of our knowledge, this is the first work that uses a long-term memory of object semantics in a goal-oriented navigation task. Experimental results conducted on the AI2-THOR dataset show that OMT outperforms previous approaches in navigating in unknown environments. In particular, we show that utilizing the long-term object semantics information improves the efficiency of navigation.


title: MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection

abstract: Human-Object Interaction (HOI) detection is the task of identifying a set of <human, object, interaction> triplets from an image. Recent work proposed transformer encoder-decoder architectures that successfully eliminated the need for many hand-designed components in HOI detection through end-to-end training. However, they are limited to single-scale feature resolution, providing suboptimal performance in scenes containing humans, objects and their interactions with vastly different scales and distances. To tackle this problem, we propose a Multi-Scale TRansformer (MSTR) for HOI detection powered by two novel HOI-aware deformable attention modules called Dual-Entity attention and Entity-conditioned Context attention. While existing deformable attention comes at a huge cost in HOI detection performance, our proposed attention modules of MSTR learn to effectively attend to sampling points that are essential to identify interactions. In experiments, we achieve the new state-of-the-art performance on two HOI detection benchmarks.


title: Hierarchical Transformer Model for Scientific Named Entity Recognition

abstract: The task of Named Entity Recognition (NER) is an important component of many natural language processing systems, such as relation extraction and knowledge graph construction. In this work, we present a simple and effective approach for Named Entity Recognition. The main idea of our approach is to encode the input subword sequence with a pre-trained transformer such as BERT, and then, instead of directly classifying the word labels, another layer of transformer is added to the subword representation to better encode the word-level interaction. We evaluate our approach on three benchmark datasets for scientific NER, particularly in the computer science and biomedical domains. Experimental results show that our model outperforms the current state-of-the-art on SciERC and TDM datasets without requiring external resources or specific data augmentation. Code is available at \url{https://github.com/urchade/HNER}.


title: Towards Formal Verification of HotStuff-based Byzantine Fault Tolerant Consensus in Agda: Extended Version

abstract: LibraBFT is a Byzantine Fault Tolerant (BFT) consensus protocol based on HotStuff. We present an abstract model of the protocol underlying HotStuff / LibraBFT, and formal, machine-checked proofs of their core correctness (safety) property and an extended condition that enables non-participating parties to verify committed results. (Liveness properties would be proved for specific implementations, not for the abstract model presented in this paper.) A key contribution is precisely defining assumptions about the behavior of honest peers, in an abstract way, independent of any particular implementation. Therefore, our work is an important step towards proving correctness of an entire class of concrete implementations, without repeating the hard work of proving correctness of the underlying protocol. The abstract proofs are for a single configuration (epoch); extending these proofs across configuration changes is future work. Our models and proofs are expressed in Agda, and are available in open source.


title: Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities

abstract: Assembly101 is a new procedural activity dataset featuring 4321 videos of people assembling and disassembling 101 "take-apart" toy vehicles. Participants work without fixed instructions, and the sequences feature rich and natural variations in action ordering, mistakes, and corrections. Assembly101 is the first multi-view action dataset, with simultaneous static (8) and egocentric (4) recordings. Sequences are annotated with more than 100K coarse and 1M fine-grained action segments, and 18M 3D hand poses. We benchmark on three action understanding tasks: recognition, anticipation and temporal segmentation. Additionally, we propose a novel task of detecting mistakes. The unique recording format and rich set of annotations allow us to investigate generalization to new toys, cross-view transfer, long-tailed distributions, and pose vs. appearance. We envision that Assembly101 will serve as a new challenge to investigate various activity understanding problems.


title: Image-text Retrieval: A Survey on Recent Research and Development

abstract: In the past few years, cross-modal image-text retrieval (ITR) has experienced increased interest in the research community due to its excellent research value and broad real-world application. It is designed for the scenarios where the queries are from one modality and the retrieval galleries from another modality. This paper presents a comprehensive and up-to-date survey on the ITR approaches from four perspectives. By dissecting an ITR system into two processes: feature extraction and feature alignment, we summarize the recent advance of the ITR approaches from these two perspectives. On top of this, the efficiency-focused study on the ITR system is introduced as the third perspective. To keep pace with the times, we also provide a pioneering overview of the cross-modal pre-training ITR approaches as the fourth perspective. Finally, we outline the common benchmark datasets and valuation metric for ITR, and conduct the accuracy comparison among the representative ITR approaches. Some critical yet less studied issues are discussed at the end of the paper.


title: Primitive-based Shape Abstraction via Nonparametric Bayesian Inference

abstract: 3D shape abstraction has drawn great interest over the years. Apart from low-level representations such as meshes and voxels, researchers also seek to semantically abstract complex objects with basic geometric primitives. Recent deep learning methods rely heavily on datasets, with limited generality to unseen categories. Furthermore, abstracting an object accurately yet with a small number of primitives still remains a challenge. In this paper, we propose a novel non-parametric Bayesian statistical method to infer an abstraction, consisting of an unknown number of geometric primitives, from a point cloud. We model the generation of points as observations sampled from an infinite mixture of Gaussian Superquadric Taper Models (GSTM). Our approach formulates the abstraction as a clustering problem, in which: 1) each point is assigned to a cluster via the Chinese Restaurant Process (CRP); 2) a primitive representation is optimized for each cluster, and 3) a merging post-process is incorporated to provide a concise representation. We conduct extensive experiments on two datasets. The results indicate that our method outperforms the state-of-the-art in terms of accuracy and is generalizable to various types of objects.


title: Tunable bilayer dielectric metasurface via stacking magnetic mirrors

abstract: Functional tunability, environmental adaptability, and easy fabrication are highly desired properties in metasurfaces. Here we provide a tunable bilayer metasurface composed of two stacked identical dielectric magnetic mirrors, which are excited by the dominant electric dipole and other magnetic multipoles, exhibiting nonlocal electric field enhancement near the interface and high reflection. Differ from the tunability through the direct superposition of two structures with different functionalities, we achieve the reversible conversion between high reflection and high transmission by manipulating the interlayer coupling near the interface between the two magnetic mirrors. The magnetic mirror effect boosts the interlayer coupling when the interlayer spacing is small. Decreasing the interlayer spacing of the bilayer metasurface leads to stronger interlayer coupling and scattering suppression of the meta-atom, which results in high transmission. On the contrary, increasing the spacing leads to weaker interlayer coupling and scattering enhancement, which results in high reflection. The high transmission of the bilayer metasurface has good robustness due to that the meta-atom with interlayer coupling can maintain the scattering suppression against adjacent meta-atom movement and disordered position perturbation. This work provides a straightforward method (i.e. stacking magnetic mirrors) to design tunable metasurface, shed new light on high-performance optical switches applied in communication and sensing.


title: Walsh's conformal map onto lemniscatic domains for polynomial pre-images I

abstract: We consider Walsh's conformal map from the exterior of a compact set $E \subseteq \mathbb{C}$ onto a lemniscatic domain. If $E$ is simply connected, the lemniscatic domain is the exterior of a circle, while if $E$ has several components, the lemniscatic domain is the exterior of a generalized lemniscate and is determined by the logarithmic capacity of $E$ and by the exponents and centers of the generalized lemniscate. For general $E$, we characterize the exponents in terms of the Green's function of $E^c$. Under additional symmetry conditions on $E$, we also locate the centers of the lemniscatic domain. For polynomial pre-images $E = P^{-1}(\Omega)$ of a simply-connected infinite compact set $\Omega$, we explicitly determine the exponents in the lemniscatic domain and derive a set of equations to determine the centers of the lemniscatic domain. Finally, we present several examples where we explicitly obtain the exponents and centers of the lemniscatic domain, as well as the conformal map.


title: A novel evolutionary-based neuro-fuzzy task scheduling approach to jointly optimize the main design challenges of heterogeneous MPSoCs

abstract: In this paper, an online task scheduling and mapping method based on a fuzzy neural network (FNN) learned by an evolutionary multi-objective algorithm (NSGA-II) to jointly optimize the main design challenges of heterogeneous MPSoCs is proposed. In this approach, first, the FNN parameters are trained using an NSGA-II-based optimization engine by considering the main design challenges of MPSoCs including temperature, power consumption, failure rate, and execution time on a training dataset consisting of different application graphs of various sizes. Next, the trained FNN is employed as an online task scheduler to jointly optimize the main design challenges in heterogeneous MPSoCs. Due to the uncertainty in sensor measurements and the difference between computational models and reality, applying the fuzzy neural network is advantageous in online scheduling procedures. The performance of the method is compared with some previous heuristic, meta-heuristic, and rule-based approaches in several experiments. Based on these experiments our proposed method outperforms the related studies in optimizing all design criteria. Its improvement over related heuristic and meta-heuristic approaches are estimated 10.58% in temperature, 9.22% in power consumption, 39.14% in failure rate, and 12.06% in execution time, averagely. Moreover, considering the interpretable nature of the FNN, the frequently fired extracted fuzzy rules of the proposed approach are demonstrated.