title: Meta-Learning for Symbolic Hyperparameter Defaults

abstract: Hyperparameter optimization in machine learning (ML) deals with the problem of empirically learning an optimal algorithm configuration from data, usually formulated as a black-box optimization problem. In this work, we propose a zero-shot method to meta-learn symbolic default hyperparameter configurations that are expressed in terms of the properties of the dataset. This enables a much faster, but still data-dependent, configuration of the ML algorithm, compared to standard hyperparameter optimization approaches. In the past, symbolic and static default values have usually been obtained as hand-crafted heuristics. We propose an approach of learning such symbolic configurations as formulas of dataset properties from a large set of prior evaluations on multiple datasets by optimizing over a grammar of expressions using an evolutionary algorithm. We evaluate our method on surrogate empirical performance models as well as on real data across 6 ML algorithms on more than 100 datasets and demonstrate that our method indeed finds viable symbolic defaults.


title: Linguistically Informed Masking for Representation Learning in the Patent Domain

abstract: Domain-specific contextualized language models have demonstrated substantial effectiveness gains for domain-specific downstream tasks, like similarity matching, entity recognition or information retrieval. However successfully applying such models in highly specific language domains requires domain adaptation of the pre-trained models. In this paper we propose the empirically motivated Linguistically Informed Masking (LIM) method to focus domain-adaptative pre-training on the linguistic patterns of patents, which use a highly technical sublanguage. We quantify the relevant differences between patent, scientific and general-purpose language and demonstrate for two different language models (BERT and SciBERT) that domain adaptation with LIM leads to systematically improved representations by evaluating the performance of the domain-adapted representations of patent language on two independent downstream tasks, the IPC classification and similarity matching. We demonstrate the impact of balancing the learning from different information sources during domain adaptation for the patent domain. We make the source code as well as the domain-adaptive pre-trained patent language models publicly available at https://github.com/sophiaalthammer/patent-lim.


title: End-to-End Transmission Analysis of Simultaneous Wireless Information and Power Transfer using Resonant Beam

abstract: Integrating the wireless power transfer (WPT) technology into the wireless communication system has been important for operational cost saving and power-hungry problem solving of electronic devices. In this paper, we propose a resonant beam simultaneous wireless information and power transfer (RB-SWIPT) system, which utilizes a gain medium and two retro-reflecting surfaces to enhance and retro-reflect energy, and allows devices to recharge their batteries and exchange information from the resonant beam wirelessly. To reveal the SWIPT mechanism and evaluate the SWIPT performance, we establish an analytical end-to-end (E2E) transmission model based on a modular approach and the electromagnetic field propagation. Then, the intra-cavity power intensity distribution, transmission loss, output power, and E2E efficiency can be obtained. The numerical evaluation illustrates that the exemplary RB-SWIPT system can provide about 4.20W electric power and 12.41bps/Hz spectral efficiency, and shorter transmission distance or larger retro-reflecting surface size can lead to higher E2E efficiency. The RB-SWIPT presents a new way for high-power, long-range WPT, and high-rate communication.


title: On algebraic dependencies between Poincar\'e functions

abstract: Let $A$ be a rational function of one complex variable, and $z_0$ its repelling fixed point with the multiplier $\lambda.$ Then a Poincar\'e function associated with $z_0$ is a function $\mathcal{P}_{A,z_0,\lambda}$ meromorphic on $\mathbb C$ such that $\mathcal{P}_{A,z_0,\lambda}(0)=z_0$, $\mathcal{P}_{A,z_0,\lambda}'(0)\neq 0,$ and $\mathcal{P}_{A,z_0,\lambda}(\lambda z)=A\circ \mathcal{P}_{A,z_0,\lambda}(z).$ In this paper, we investigate the following problem: given Poincar\'e functions $\mathcal{P}_{A_1,z_1,\lambda_1}$ and $\mathcal{P}_{A_2,z_2,\lambda_2}$, find out if there is an algebraic relation $f(\mathcal{P}_{A_1,z_1,\lambda_1},\mathcal{P}_{A_2,z_2,\lambda_2})=0$ between them and, if such a relation exists, describe the corresponding algebraic curve. We provide a solution, which can be viewed as a refinement of the classical theorem of Ritt about commuting rational functions. We also reprove and extend previous results concerning algebraic dependencies between B\"ottcher functions.


title: Topological van Hove singularities at phase transitions in Weyl metals

abstract: We show that in three-dimensional (3D) topological metals, a subset of the van Hove singularities of the density of states sits exactly at the transitions between topological and trivial gapless phases. We may refer to these as topological van Hove singularities. By investigating two minimal models, we show that they originate from energy saddle points located between Weyl points with opposite chiralities, and we illustrate their topological nature through their magnetotransport properties in the ballistic regime. We exemplify the relation between van Hove singularities and topological phase transitions in Weyl systems by analyzing the 3D Hofstadter model, which offers a simple and interesting playground to consider different kinds of Weyl metals and to understand the features of their density of states. In this model, as a function of the magnetic flux, the occurrence of topological van Hove singularities can be explicitly checked.


title: Slingshot prominences: a hidden mass loss mechanism

abstract: Whilst ``slingshot'' prominences have been observed on M-dwarfs, most if not all theoretical studies have focused on solar-like stars. We present an investigation into stellar prominences around rapidly rotating young M-dwarfs. We have extrapolated the magnetic field in the corona from Zeeman-Doppler maps and determined the sites of mechanical stability where prominences may form. We analyse the prominence mass that could be supported and the latitude range over which this material is distributed. We find that for these maps, much of this prominence mass may be invisible to observation - typically <1\% transits the stellar disc. On the rapidly-rotating M-dwarf V374 Peg (P$_{\rm rot}$ = 0.45 days) where prominences have been observed, we find the visible prominence mass to be around only 10\% of the total mass supported. The mass loss rate per unit area for prominences scales with the X-ray surface flux as $\dot{M}/A \propto$ $F_X^{1.32}$ which is very close to the observationally-derived value for stellar winds. This suggests that prominence ejection may contribute significantly to the overall stellar wind loss and spin down. A planet in an equatorial orbit in the habitable zone of these stars may experience intermittent enhancements of the stellar wind due to prominence ejections. On some stars, this may occur throughout 20\% of the orbit.


title: 4D Optically Reconfigurable Volumetric Metamaterials

abstract: Metamaterials are artificially created media, which allow introducing additional degrees of freedom into electromagnetic design by controlling constitutive material parameters. Reconfigurable time-dependent metamaterials can further enlarge those capabilities by introducing a temporal variable as an additional controllable parameter. Here we demonstrate a first-of-its-kind reconfigurable volumetric metamaterial-based scatterer, wherein the electromagnetic properties are controlled dynamically with light. In particular, hybridized resonances in arrays of split ring resonators give rise to a collective mode that presents properties of artificial high-frequency magnetism for centimeter waves. Resonant behavior of each individual ring is controlled with a photocurrent, which allows the fast tuning of macroscopic effective permeability. Thus, the artificial gigahertz magnon resonant excitation within a subwavelength spherical scatterer is governed by light intensity. Four-dimensional control over electromagnetic scattering in both space and time opens new venues for modern applications, including wireless communications and automotive radars to name just a few.


title: Understanding the First Order Inhomogeneous Linear Elasticity through Local Gauge Transformations

abstract: It is well-known that classical linear elasticity equations are not form-invariant under local transformations. This is intrinsically related to the inhomogeneity of elastic media. However, the reported new linear elasticity equations for inhomogeneous media may appear in different forms. This paper tries to clarify this issue by investigating the form-invariance of the Lagrangian under local temporal or spatial gauge transformations. In this way, these new equations in different forms can be easily understood as the results from different choices of gauge fixing schemes. It recommends to choose appropriate gauges with clear physical meanings to simplify calculations.


title: The Demailly system for a direct sum of ample line bundles on Riemann surfaces

abstract: We prove that a system of equations introduced by Demailly (to attack a conjecture of Griffiths) has a smooth solution for a direct sum of ample line bundles on a Riemann surface. We also reduce the problem for general vector bundles to an a priori estimate using Leray-Schauder degree theory.


title: Intermediate Times Dilemma for Open Quantum System: Filtered Approximation to The Refined Weak Coupling Limit

abstract: The famous Davies-GKSL secular Markovian master equation is tremendously successful in approximating the evolution of open quantum systems in terms of just a few parameters. However, the fully-secular Davies-GKSL equation fails to accurately describe time scales short enough, i.e., comparable to the inverse of differences of frequencies present in the system of interest. A complementary approach that works well for short times but is not suitable after this short interval is known as the quasi-secular master equation. Still, both approaches fail to have any faithful dynamics in the intermediate time interval. Simultaneously, descriptions of dynamics that apply to the aforementioned "grey zone" often are computationally much more complex than master equations or are mathematically not well-structured. The filtered approximation (FA) to the refined weak coupling limit has the simplistic spirit of the Davies-GKSL equation and allows capturing the dynamics in the intermediate time regime. At the same time, our non-Markovian equation yields completely positive dynamics. We exemplify the performance of the FA equation in the cases of the spin-boson system and qutrit-boson system in which two distant time scales appear.


title: Homogeneous spaces of real simple Lie groups with proper actions of non virtually abelian discrete subgroups: a calculational approach

abstract: Let G be a simple non-compact linear connected Lie group and H be a closed non-compact semisimple subgroup. We are interested in finding classes of homogeneous spaces G/H admitting proper actions of discrete non virtually abelian subgroups of G. We develop an algorithm for finding such homogeneous spaces. As a testing example we obtain a list of all non-compact homogeneous spaces G/H admitting proper action of a discrete and non virtually abelian subgroup of G in the case when G has rank at most 8, and H is a maximal proper semisimple subgroup.


title: Experimental observation of intrinsic light localization in photonic icosahedral quasicrystals

abstract: One of the most intriguing problems of light transport in solids is the localization that has been observed in various disordered photonic structures1-11. The light localization in defect-free icosahedral quasicrystals has recently been predicted theoretically without experimental verification10. Here we report on the fabrication of submicron-size dielectric icosahedral quasicrystals and demonstrate the results of detailed studies of the photonic properties of these structures. Here, we present the first direct experimental observation of intrinsic light localization in defect-free quasicrystals. This result was obtained in time-resolved measurements at different laser wavelengths in the visible. We linked localization with the aperiodicity of the icosahedral structure, which led to uncompensated scattering of light from an individual structural element over the entire sphere, providing multiple scattering inside the sample and, as a result, the intrinsic localization of light.


title: Deep Implicit Surface Point Prediction Networks

abstract: Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most such approaches focus on representing closed shapes. Unsigned distance function (UDF) based approaches have been proposed recently as a promising alternative to represent both open and closed shapes. However, since the gradients of UDFs vanish on the surface, it is challenging to estimate local (differential) geometric properties like the normals and tangent planes which are needed for many downstream applications in vision and graphics. There are additional challenges in computing these properties efficiently with a low-memory footprint. This paper presents a novel approach that models such surfaces using a new class of implicit representations called the closest surface-point (CSP) representation. We show that CSP allows us to represent complex surfaces of any topology (open or closed) with high fidelity. It also allows for accurate and efficient computation of local geometric properties. We further demonstrate that it leads to efficient implementation of downstream algorithms like sphere-tracing for rendering the 3D surface as well as to create explicit mesh-based representations. Extensive experimental evaluation on the ShapeNet dataset validate the above contributions with results surpassing the state-of-the-art.


title: Higher-order spectral shift for pairs of contractions via multiplicative path

abstract: In \cite{Mor}, Marcantognini and Mor\'{a}n obtained Koplienko-Neidhardt trace formula for pairs of contractions and pairs of maximal dissipative operators via multiplicative path. In this article, we prove the existence of higher-order spectral shift functions for pairs of contractions and pairs of maximal dissipative operators via multiplicative path by adapting the argument employed in \cite{Mor}.


title: $^{50}$Ti($d$,$p$)$^{51}$Ti, single neutron energies in the $N=29$ isotones and the $N=32$ subshell closure

abstract: A measurement of the $^{50}$Ti($d$,$p$)$^{51}$Ti reaction at 16 MeV was performed using a Super Enge Split Pole Spectrograph to measure the magnitude of the $N=32$ subshell gap in Ti. Seven states were observed that had not been observed in previous ($d$,$p$) measurements, and the \textit{L} transfer values for six previously measured states were either changed or measured for the first time. The results were used to determine single neutron energies for the $p_{3/2}$, $p_{1/2}$ and $f_{5/2}$ orbitals. The resulting single neutron energies in $^{51}$Ti confirm the existence of the $N=32$ gap in Ti. These single neutron energies and those from previous measurements in $^{49}$Ca, $^{53}$Cr and $^{55}$Fe are compared to values from a covariant density functional theory calculation.


title: A Quantum Inspired Approach to Exploit Turbulence Structures

abstract: Understanding turbulence is the key to our comprehension of many natural and technological flow processes. At the heart of this phenomenon lies its intricate multi-scale nature, describing the coupling between different-sized eddies in space and time. Here we introduce a new paradigm for analyzing the structure of turbulent flows by quantifying correlations between different length scales using methods inspired from quantum many-body physics. We present results for interscale correlations of two paradigmatic flow examples, and use these insights along with tensor network theory to design a structure-resolving algorithm for simulating turbulent flows. With this algorithm, we find that the incompressible Navier-Stokes equations can be accurately solved within a computational space reduced by over an order of magnitude compared to direct numerical simulation. Our quantum-inspired approach provides a pathway towards conducting computational fluid dynamics on quantum computers.


title: Feedforward and feedback influences through distinct frequency bands between two spiking-neuron networks

abstract: Several studies with brain signals suggested that bottom-up and top-down influences are exerted through distinct frequency bands among visual cortical areas. It has been recently shown that theta and gamma rhythms subserve feedforward, whereas the feedback influence is dominated by the alpha-beta rhythm in primates. A few theoretical models for reproducing these effects have been proposed so far. Here we show that a simple but biophysically plausible two-network motif composed of spiking-neuron models and chemical synapses can exhibit feedforward and feedback influences through distinct frequency bands. Differently from previous studies, this kind of model allows us to study directed influences not only at the population level, by using a proxy for the local field potential, but also at the cellular level, by using the neuronal spiking series.


title: Programming Puzzles

abstract: We introduce a new type of programming challenge called programming puzzles, as an objective and comprehensive evaluation of program synthesis, and release an open-source dataset of Python Programming Puzzles (P3). Each puzzle is defined by a short Python program $f$, and the goal is to find an input which makes $f$ return True. The puzzles are objective in that each one is specified entirely by the source code of its verifier $f$, so evaluating $f$ is all that is needed to test a candidate solution. They do not require an answer key or input/output examples, nor do they depend on natural language understanding. The dataset is comprehensive in that it spans problems of a range of difficulties and domains, ranging from trivial string manipulation problems, to classic programming puzzles (e.g., Tower of Hanoi), to interview/competitive-programming problems (e.g., dynamic programming), to longstanding open problems in algorithms and mathematics (e.g., factoring). We develop baseline enumerative program synthesis, GPT-3 and Codex solvers that are capable of solving puzzles -- even without access to any reference solutions -- by learning from their own past solutions. Codex performs best, solving up to 18% of 397 test problems with a single try and 80% of the problems with 1,000 tries per problem. In a small user study, we find a positive correlation between puzzle-solving performance and coding experience, and between the puzzle difficulty for humans and AI solvers. Therefore, further improvements on P3 could have a significant impact on many program synthesis areas.


title: Efficient Recovery of a Shared Secret via Cooperation: Applications to SDMM and PIR

abstract: This work considers the problem of privately outsourcing the computation of a matrix product over a finite field $\mathbb{F}_q$ to $N$ helper servers. These servers are considered to be honest but curious, i.e., they behave according to the protocol but will try to deduce information about the user's data. Furthermore, any set of up to $X$ servers is allowed to share their data. Previous works considered this collusion a hindrance and the download cost of the schemes increases with growing $X$. We propose to utilize such linkage between servers to the user's advantage by allowing servers to cooperate in the computational task. This leads to a significant gain in the download cost for the proposed schemes. The gain naturally comes at the cost of increased communication load between the servers. Hence, the proposed cooperative schemes can be understood as outsourcing both computational cost and communication cost. Both information--theoretically secure and computationally secure schemes are considered, showing that allowing information leakage that is computationally hard to utilize will lead to further gains. The proposed server cooperation is then exemplified for specific secure distributed matrix multiplication (SDMM) schemes and linear private information retrieval (PIR). Similar ideas naturally apply to many other use cases as well, but not necessarily always with lowered costs.


title: CAT: Cross Attention in Vision Transformer

abstract: Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer after the tokenization of the image is vast(e.g., ViT), which bottlenecks model training and inference. In this paper, we propose a new attention mechanism in Transformer termed Cross Attention, which alternates attention inner the image patch instead of the whole image to capture local information and apply attention between image patches which are divided from single-channel feature maps capture global information. Both operations have less computation than standard self-attention in Transformer. By alternately applying attention inner patch and between patches, we implement cross attention to maintain the performance with lower computational cost and build a hierarchical network called Cross Attention Transformer(CAT) for other vision tasks. Our base model achieves state-of-the-arts on ImageNet-1K, and improves the performance of other methods on COCO and ADE20K, illustrating that our network has the potential to serve as general backbones. The code and models are available at \url{https://github.com/linhezheng19/CAT}.


title: Investigation of the particle-particle interaction effects in the cosmic Zevatron based on cyclotron auto-resonance by particle-in-cell simulations

abstract: Cyclotron autoresonance acceleration has been recently advanced as a potential mechanism for accelerating nuclei to ZeV energies (1 ZeV = $10^{21}$ eV). All results have been based on single- and many-particle calculations employing analytic solutions to the relativistic equations of motion in the combined magnetic and radiation fields, excluding effects related to the particle-particle interactions. Here, results from many-particle calculations and Particle-In-Cell (PIC) simulations, are presented which lend support to the single-particle investigations. Each single-particle result is found to lie well within one standard deviation about the ensemble average obtained from the corresponding many-particle calculation. The PIC simulations show that, even for number densities far exceeding those employed in the non-interacting case, the energy gain drops markedly due to the particle-particle interactions, over the first $\sim 8~ mm$ of the acceleration length. Together with the substantial attenuation, this finding supports the conclusion that the particle-particle interaction effects can be negligibly small over acceleration lengths of typically many kilometers.


title: An Empirical Calibration of the Helium Abundance in HII Regions based in Literature and CALIFA Survey data

abstract: Helium is the second most common chemical species in the Universe. The study of helium abundance has the potential to unravel the chemical evolution of and within galaxies. In this study, we provide an empirical calibration for the singly ionized helium abundance: $12+\log_{10}({\rm He}^+/{\rm H}^+)$, based on the emission line flux ratio He$_{\lambda5876}$/H$\alpha$ from Galactic and extragalactic HII regions compiled from the literature. Based on this calibrator, we explore for the first time the helium abundance in a large sample of HII regions located in galaxies representative of the nearby Universe from the CALIFA survey. Furthermore, this calibrator allows us to explore the variations of the helium abundance with respect to the oxygen abundance. The observed trends are in agreement with a change in the chemical enrichment with mass/oxygen abundance similar to the one observed due to the inside-out model in a MW-galaxy (highlighting the connection between resolved and global trends in galaxies). Our calibrator provides an empirical proxy to estimate the helium abundance at kpc scales as well as to constrain chemical evolutionary models.


title: Enabling Full Mutualism for Symbiotic Radio with Massive Backscatter Devices

abstract: Symbiotic radio is a promising technology to achieve spectrum- and energy-efficient wireless communications, where the secondary backscatter device (BD) leverages not only the spectrum but also the power of the primary signals for its own information transmission. In return, the primary communication link can be enhanced by the additional multipaths created by the BD. This is known as the mutualism relationship of symbiotic radio. However, as the backscattering link is much weaker than the direct link due to double attenuations, the improvement of the primary link brought by one single BD is extremely limited. To address this issue and enable full mutualism of symbiotic radio, in this paper, we study symbiotic radio with massive number of BDs. For symbiotic radio multiple access channel (MAC) with successive interference cancellation (SIC), we first derive the achievable rate of both the primary and secondary communications, based on which a receive beamforming optimization problem is formulated and solved. Furthermore, considering the asymptotic regime of massive number of BDs, closed-form expressions are derived for the primary and the secondary communication rates, both of which are shown to be increasing functions of the number of BDs. This thus demonstrates that the mutualism relationship of symbiotic radio can be fully exploited with massive BD access.


title: Theoretical stiffness limits of 4D printed self-folding metamaterials

abstract: 4D printing of flat sheets that self-fold into architected 3D structures is a powerful origami-inspired approach for the fabrication of multi-functional devices and metamaterials. The possibility to endow the initially flat sheet with a variety of surface-related functionalities provides the means to simultaneously achieve multi-functional performance and a complex 3D architecture. One intrinsic limitation of such a production strategy is the contradictory stiffness requirements for the folding and for subsequent load-bearing steps: while a low stiffness is required to allow for the successful completion of the intended self-folding process, a high stiffness is needed for the subsequent application of the folded structure as a load-bearing mechanical metamaterial. The competition between these two requirements determines the theoretical limits of 4D printed self-folding mechanical metamaterials, which have not been determined before. Here, we present a nonlinear analytical model of self-folding bilayer constructs composed of an active and a passive layer. This finite deformation theoretical model predicts the curvature of activated bilayers, establishes their stability limits, and estimates the stiffness of folded bilayers. Combining the three abovementioned aspects allows for establishing the theoretical stiffness limits of self-folding bilayers. The optimal combinations of geometrical and mechanical properties that result in the highest possible stiffness of folded constructs can then be determined. We compare the predictions of our analytical models with computational as well as experimental results. Finally, we evaluate the theoretical stiffness limits of bilayer constructs made using the most common types of stimuli-responsive materials. Our analysis shows that a maximum effective modulus of ~1.5 GPa can be achieved using the currently available shape-memory polymers.


title: Duffin-Kemmer-Petiau particles in the presence of the spiral dislocation

abstract: In this study, we investigated the influence of the topological defects space-time with a spiral dislocation on a spin-zero boson field by using the Duffin-Kemmer-Petiau (DKP) equation. To be more specific, we solved the generalized spin-zero DKP equation in the presence of a spiral dislocation exactly. We derived the wave function and corresponding energy eigenvalues for two cases, in the absence and presence of a static potential by using analytical methods. We numerically demonstrated the effect of the spiral dislocation on the solutions.


title: Speaker-conversation factorial designs for diarization error analysis

abstract: Speaker diarization accuracy can be affected by both acoustics and conversation characteristics. Determining the cause of diarization errors is difficult because speaker voice acoustics and conversation structure co-vary, and the interactions between acoustics, conversational structure, and diarization accuracy are complex. This paper proposes a methodology that can distinguish independent marginal effects of acoustic and conversation characteristics on diarization accuracy by remixing conversations in a factorial design. As an illustration, this approach is used to investigate gender-related and language-related accuracy differences with three diarization systems: a baseline system using subsegment x-vector clustering, a variant of it with shorter subsegments, and a third system based on a Bayesian hidden Markov model. Our analysis shows large accuracy disparities for the baseline system primarily due to conversational structure, which are partially mitigated in the other two systems. The illustration thus demonstrates how the methodology can be used to identify and guide diarization model improvements.


title: Cohomology vanishing theorems for free boundary submanifolds

abstract: In this paper, via a new Hardy type inequality, we establish some cohomology vanishing theorems for free boundary compact submanifolds $M^n$ with $n\geq2$ immersed in the Euclidean unit ball $\mathbb{B}^{n+k}$ under one of the pinching conditions $|\Phi|^2\leq C$, $|A|^2\leq \widetilde{C}$, or $|\Phi|\leq R(p,|H|)$, where $A$ $(\Phi)$ is the (traceless) second fundamental form, $H$ is the mean curvature, $C,\widetilde{C}$ are positive constants and $R(p,|H|)$ is a positive function. In particular, we remove the condition on the flatness of the normal bundle, solving the first question, and partially answer the second question on optimal pinching constants proposed by Cavalcante, Mendes and Vit\'{o}rio.


title: On the Hierarchy of Natural Theories

abstract: It is a well-known empirical phenomenon that natural axiomatic theories are pre-well-ordered by consistency strength. Without a precise mathematical definition of "natural," it is unclear how to study this phenomenon mathematically. We will discuss the significance of this problem and survey some strategies that have recently been developed for addressing it. These strategies emphasize the role of reflection principles and ordinal analysis and draw on analogies with research in recursion theory. We will conclude with a discussion of open problems and directions for future research.


title: Transformed CNNs: recasting pre-trained convolutional layers with self-attention

abstract: Vision Transformers (ViT) have recently emerged as a powerful alternative to convolutional networks (CNNs). Although hybrid models attempt to bridge the gap between these two architectures, the self-attention layers they rely on induce a strong computational bottleneck, especially at large spatial resolutions. In this work, we explore the idea of reducing the time spent training these layers by initializing them as convolutional layers. This enables us to transition smoothly from any pre-trained CNN to its functionally identical hybrid model, called Transformed CNN (T-CNN). With only 50 epochs of fine-tuning, the resulting T-CNNs demonstrate significant performance gains over the CNN (+2.2% top-1 on ImageNet-1k for a ResNet50-RS) as well as substantially improved robustness (+11% top-1 on ImageNet-C). We analyze the representations learnt by the T-CNN, providing deeper insights into the fruitful interplay between convolutions and self-attention. Finally, we experiment initializing the T-CNN from a partially trained CNN, and find that it reaches better performance than the corresponding hybrid model trained from scratch, while reducing training time.


title: Measurement-device-independent nonlinear entanglement witnesses

abstract: Entanglement witnesses are one of the most effective methods to detect entanglement. It is known that nonlinear entanglement witnesses provide better entanglement detection than their linear counterparts, in that the former detect a strictly larger subset of entangled states than the latter. Whether linear or nonlinear, the method is measurement-device dependent, so that imperfect measurements may cause false certification of entanglement in a shared state. Measurement-device-independent entanglement witnesses provide an escape from such measurement dependence of the entanglement detection for linear entanglement witnesses. Here we present measurement-device-independent nonlinear entanglement witnesses for non-positive partial transpose entangled states as well as for bound entangled states with positive partial transpose. The constructed measurement-device-independent nonlinear entanglement witnesses certify the entanglement of the same sets of entangled states as their device-dependent parents do, and therefore are better than the linear entanglement witnesses, device-independent or otherwise.


title: Linear Classifiers Under Infinite Imbalance

abstract: We study the behavior of linear discriminant functions for binary classification in the infinite-imbalance limit, where the sample size of one class grows without bound while the sample size of the other remains fixed. The coefficients of the classifier minimize an empirical loss specified through a weight function. We show that for a broad class of weight functions, the intercept diverges but the rest of the coefficient vector has a finite almost sure limit under infinite imbalance, extending prior work on logistic regression. The limit depends on the left-tail growth rate of the weight function, for which we distinguish two cases: subexponential and exponential. The limiting coefficient vectors reflect robustness or conservatism properties in the sense that they optimize against certain worst-case alternatives. In the subexponential case, the limit is equivalent to an implicit choice of upsampling distribution for the minority class. We apply these ideas in a credit risk setting, with particular emphasis on performance in the high-sensitivity and high-specificity regions.


title: Indecomposable objects in Khovanov-Sazdanovic's generalizations of Deligne's interpolation categories

abstract: Khovanov and Sazdanovic recently introduced symmetric monoidal categories parameterized by rational functions and given by quotients of categories of two-dimensional cobordisms. These categories generalize Deligne's interpolation categories of representations of symmetric groups. In this paper, we classify indecomposable objects and identify the associated graded Grothendieck rings of Khovanov-Sazdanovic's categories through sums of representation categories over crossed products of polynomial rings over a general field. To obtain these results, we introduce associated graded categories for Krull-Schmidt categories with filtrations as a categorification of the associated graded Grothendieck ring, and study field extensions and Galois descent for Krull-Schmidt categories.


title: Hybrid Machine Learning Forecasts for the UEFA EURO 2020

abstract: Three state-of-the-art statistical ranking methods for forecasting football matches are combined with several other predictors in a hybrid machine learning model. Namely an ability estimate for every team based on historic matches; an ability estimate for every team based on bookmaker consensus; average plus-minus player ratings based on their individual performances in their home clubs and national teams; and further team covariates (e.g., market value, team structure) and country-specific socio-economic factors (population, GDP). The proposed combined approach is used for learning the number of goals scored in the matches from the four previous UEFA EUROs 2004-2016 and then applied to current information to forecast the upcoming UEFA EURO 2020. Based on the resulting estimates, the tournament is simulated repeatedly and winning probabilities are obtained for all teams. A random forest model favors the current World Champion France with a winning probability of 14.8% before England (13.5%) and Spain (12.3%). Additionally, we provide survival probabilities for all teams and at all tournament stages.


title: Qubit Readout Error Mitigation with Bit-flip Averaging

abstract: Quantum computers are becoming increasingly accessible, and may soon outperform classical computers for useful tasks. However, qubit readout errors remain a significant hurdle to running quantum algorithms on current devices. We present a scheme to more efficiently mitigate these errors on quantum hardware and numerically show that our method consistently gives advantage over previous mitigation schemes. Our scheme removes biases in the readout errors allowing a general error model to be built with far fewer calibration measurements. Specifically, for reading out $n$-qubits we show a factor of $2^n$ reduction in the number of calibration measurements without sacrificing the ability to compensate for correlated errors. Our approach can be combined with, and simplify, other mitigation methods allowing tractable mitigation even for large numbers of qubits.


title: Semianalytical modeling of the mass transfer in microfluidic electrochemical chips

abstract: This paper reports a mass transfer model of a reactant flowing in a large aspect ratio microfluidic chip made of a channel with electrodes on the side walls. A semi-analytical solution to the two-dimensional Fickian diffusion of a reactant in a microchannel, including the electrochemical reaction at the electrode interface, and the velocity profile obtained from the Navier-Stokes equations in a fully developed laminar regime is found . The solution is written in the Laplace domain in terms of transfer functions. The proposed solution is an extension of the Leveque approximation describing the reactant diffusion from the electrode to the middle of the microfluidic channel. The main applications of this work are the use of the obtained transfer functions for the measurement of the Faradic current density or the chemical concentration at the electrode interface. The study can also be extended to the heat transfer in microfluidic electrochemical chips (temperature or heat flux measurements at the electrode interface).


title: Metric Policy Representations for Opponent Modeling

abstract: In multi-agent reinforcement learning, the inherent non-stationarity of the environment caused by other agents' actions posed significant difficulties for an agent to learn a good policy independently. One way to deal with non-stationarity is opponent modeling, by which the agent takes into consideration the influence of other agents' policies. Most existing work relies on predicting other agents' actions or goals, or discriminating between different policies. However, such modeling fails to capture the similarities and differences between policies simultaneously and thus cannot provide enough useful information when generalizing to unseen agents. To address this, we propose a general method to learn representations of other agents' policies, such that the distance between policies is deliberately reflected by the distance between representations, while the policy distance is inferred from the sampled joint action distributions during training. We empirically show that the agent conditioned on the learned policy representation can well generalize to unseen agents in three multi-agent tasks.


title: Pure Lorentz spin connection theories and uniqueness of General Relativity

abstract: General Relativity can be reformulated as a diffeomorphism invariant gauge theory of the Lorentz group, with Lagrangian of the type $f(F\wedge F)$, where $F$ is the curvature 2-form of the spin connection. A theory from this class with a generic $f$ is known to propagate eight degrees of freedom: a massless graviton, a massive graviton and a scalar. General Relativity in this formalism avoids extra degrees of freedom because the function $f$ is special and leads to the appearance of six extra primary constraints on the phase space variables. Our main new result is that there are other theories of the type $f(F\wedge F)$ that lead to six extra primary constraints. However, only in the case of GR the dynamics is such that these six primary constraints get supplemented by six secondary constraints, which gives the end result of two propagating degrees of freedom. This is how uniqueness of GR manifests itself in this ``pure spin connection" formalism. The other theories we discover are shown to give examples of irregular dynamical systems. At the linear level around (anti-)de Sitter space they have two degrees of freedom, as General Relativity, with the extra ones manifesting themselves only non-linearly.


title: Topological energy release from collision of relativistic antiferromagnetic solitons

abstract: Magnetic solitons offer functionalities as information carriers in multiple spintronic and magnonic applications. However, their potential for nanoscale energy transport has not been revealed. Here we demonstrate that antiferromagnetic solitons, e.g. domain walls, can uptake, transport and release energy. The key for this functionality resides in their relativistic kinematics; their self-energy increases with velocity due to Lorentz contraction of the soliton and their dynamics can be accelerated up to the effective speed of light of the magnetic medium. Furthermore, their classification in robust topological classes allows to selectively release this energy back into the medium by colliding solitons with opposite topology. Our work uncovers important energy-related aspects of the physics of antiferromagnetic solitons and opens up the attractive possibility for spin-based nanoscale and ultra-fast energy transport devices.


title: Discriminating same-mass Neutron Stars and Black Holes gravitational wave-forms

abstract: Gravitational wave-forms from coalescences of binary black hole systems and binary neutron star systems with low tidal effects can hardly be distinguished if the two systems have similar masses. In the absence of discriminating power based on the gravitational wave-forms, the classification of sources into binary neutron stars, binary black holes and mixed systems containing a black hole and a neutron star can only be unambiguous when assuming the standard model of stellar evolution and using the fact that there exists a mass gap between neutron stars and black holes. This approach is however limited by its own assumptions: for instance the 2.6 solar mass object detected in the GW190814 event remains unclassified, and models of new physics can introduce new compact objects, like primordial black holes, which may have masses in the same range as neutron stars. Then, without an electromagnetic counterpart (kilonova), classifying mergers of compact objects without mass gap criteria remains a difficult task, unless the source is close enough. In what follows we investigate a procedure to discriminate a model between binary neutron star merger and primordial binary black hole merger by using a Bayes factor in simulated wave-forms that we superimpose to realistic detector noise.


title: Crystal Field Effect and Electric Field Screening in Multilayer Graphene with and without Twist

abstract: We address the intrinsic polarisation and screening of external electric field in a broad range of ordered and twisted configurations of multilayer graphene, using an ab initio approach combining density functional theory and the Wannier function formalism. We show that multilayer graphene is intrinsically polarized due to the crystal field effect, an effect that is often neglected in tight-binding models of twisted bilayer graphene and similar systems. This intrinsic polarization of the order of up to few tens of meVs has different out-of-plane alignments in ordered and twisted graphene multilayers, while the in-plane potential modulation is found to be much stronger in twisted systems. We further investigate the dielectric permittivity $\varepsilon$ in same multilayer graphene configurations at different electric field strengths. Our findings establish a deep insight into intrinsic and extrinsic polarization in graphene multilayers and provide parameters necessary for building accurate models of these systems.


title: Quantum Speedup of Natural Gradient for Variational Bayes

abstract: Variational Bayes (VB) is a critical method in machine learning and statistics, underpinning the recent success of Bayesian deep learning. The natural gradient is an essential component of efficient VB estimation, but it is prohibitively computationally expensive in high dimensions. We propose a computationally efficient regression-based method for natural gradient estimation, with convergence guarantees under standard assumptions. The method enables the use of quantum matrix inversion to further speed up VB. We demonstrate that the problem setup fulfills the conditions required for quantum matrix inversion to deliver computational efficiency. The method works with a broad range of statistical models and does not require special-purpose or simplified variational distributions.


title: Edge Domination Number and the Number of Minimum Edge Dominating Sets in Pseudofractal Scale-Free Web and Sierpi\'nski Gasket

abstract: As a fundamental research object, the minimum edge dominating set (MEDS) problem is of both theoretical and practical interest. However, determining the size of a MEDS and the number of all MEDSs in a general graph is NP-hard, and it thus makes sense to find special graphs for which the MEDS problem can be exactly solved. In this paper, we study analytically the MEDS problem in the pseudofractal scale-free web and the Sierpi\'nski gasket with the same number of vertices and edges. For both graphs, we obtain exact expressions for the edge domination number, as well as recursive solutions to the number of distinct MEDSs. In the pseudofractal scale-free web, the edge domination number is one-ninth of the number of edges, which is three-fifths of the edge domination number of the Sierpi\'nski gasket. Moreover, the number of all MEDSs in the pseudofractal scale-free web is also less than that corresponding to the Sierpi\'nski gasket. We argue that the difference of the size and number of MEDSs between the two studied graphs lies in the scale-free topology.


title: Simple Graph Convolutional Networks

abstract: Many neural networks for graphs are based on the graph convolution operator, proposed more than a decade ago. Since then, many alternative definitions have been proposed, that tend to add complexity (and non-linearity) to the model. In this paper, we follow the opposite direction by proposing simple graph convolution operators, that can be implemented in single-layer graph convolutional networks. We show that our convolution operators are more theoretically grounded than many proposals in literature, and exhibit state-of-the-art predictive performance on the considered benchmark datasets.


title: On the overlooked issue of defining explanation objectives for local-surrogate explainers

abstract: Local surrogate approaches for explaining machine learning model predictions have appealing properties, such as being model-agnostic and flexible in their modelling. Several methods exist that fit this description and share this goal. However, despite their shared overall procedure, they set out different objectives, extract different information from the black-box, and consequently produce diverse explanations, that are -- in general -- incomparable. In this work we review the similarities and differences amongst multiple methods, with a particular focus on what information they extract from the model, as this has large impact on the output: the explanation. We discuss the implications of the lack of agreement, and clarity, amongst the methods' objectives on the research and practice of explainability.


title: Existence of Strong Solution for the Complexified Non-linear Poisson Boltzmann Equation

abstract: We prove the existence and uniqueness of the complexified Nonlinear Poisson-Boltzmann Equation (nPBE) in a bounded domain in $\mathbb{R}^3$. The nPBE is a model equation in nonlinear electrostatics. The standard convex optimization argument to the complexified nPBE no longer applies, but instead, a contraction mapping argument is developed. Furthermore, we show that uniqueness can be lost if the hypotheses given are not satisfied. The complixified nPBE is highly relevant to regularity analysis of the solution of the real nPBE with respect to the dielectric (diffusion) and Debye-H\"uckel coefficients. This approach is also well-suited to investigate the existence and uniqueness problem for a wide class of semi-linear elliptic Partial Differential Equations (PDEs).


title: Field excitation in fuzzy dark matter near a strong gravitational wave source

abstract: The axion-like particles with ultralight mass ($\sim10^{-22}$eV) can be a possible candidate of dark matter, known as the fuzzy dark matter (FDM). These particles form Bose-Einstein condensate in the early Universe which can explain the dark matter density distribution in galaxies at the present time. We study the time evolution of ultralight axion-like field in the near region of a strong gravitational wave (GW) source, such as binary black hole merger. We show that GWs can lead to the generation of field excitations in a spherical shell about the source that eventually propagate out of the shell to minimize the energy density of the field configuration. These excitations are generated toward the end of the merger and in some cases even in the ringdown phase of the merger, therefore it can provide a qualitatively distinct prediction for changes in the GW waveform due to the presence of FDM. This would be helpful in investigating the existence of FDM in galaxies.


title: Performance of the MICE diagnostic system

abstract: Muon beams of low emittance provide the basis for the intense, well-characterised neutrino beams of a neutrino factory and for multi-TeV lepton-antilepton collisions at a muon collider. The international Muon Ionization Cooling Experiment (MICE) has demonstrated the principle of ionization cooling, the technique by which it is proposed to reduce the phase-space volume occupied by the muon beam at such facilities. This paper documents the performance of the detectors used in MICE to measure the muon-beam parameters, and the physical properties of the liquid hydrogen energy absorber during running.


title: A concise method for feature selection via normalized frequencies

abstract: Feature selection is an important part of building a machine learning model. By eliminating redundant or misleading features from data, the machine learning model can achieve better performance while reducing the demand on com-puting resources. Metaheuristic algorithms are mostly used to implement feature selection such as swarm intelligence algorithms and evolutionary algorithms. However, they suffer from the disadvantage of relative complexity and slowness. In this paper, a concise method is proposed for universal feature selection. The proposed method uses a fusion of the filter method and the wrapper method, rather than a combination of them. In the method, one-hoting encoding is used to preprocess the dataset, and random forest is utilized as the classifier. The proposed method uses normalized frequencies to assign a value to each feature, which will be used to find the optimal feature subset. Furthermore, we propose a novel approach to exploit the outputs of mutual information, which allows for a better starting point for the experiments. Two real-world dataset in the field of intrusion detection were used to evaluate the proposed method. The evaluation results show that the proposed method outperformed several state-of-the-art related works in terms of accuracy, precision, recall, F-score and AUC.


title: Italian Twitter semantic network during the Covid-19 epidemic

abstract: The Covid-19 pandemic has had a deep impact on the lives of the entire world population, inducing a participated societal debate. As in other contexts, the debate has been the subject of several d/misinformation campaigns; in a quite unprecedented fashion, however, the presence of false information has seriously put at risk the public health. In this sense, detecting the presence of malicious narratives and identifying the kinds of users that are more prone to spread them represent the first step to limit the persistence of the former ones. In the present paper we analyse the semantic network observed on Twitter during the first Italian lockdown (induced by the hashtags contained in approximately 1.5 millions tweets published between the 23rd of March 2020 and the 23rd of April 2020) and study the extent to which various discursive communities are exposed to d/misinformation arguments. As observed in other studies, the recovered discursive communities largely overlap with traditional political parties, even if the debated topics concern different facets of the management of the pandemic. Although the themes directly related to d/misinformation are a minority of those discussed within our semantic networks, their popularity is unevenly distributed among the various discursive communities.


title: Precision axion physics with running axion couplings

abstract: We study the renormalization group running of axion couplings while taking into account that the Standard Model can be extended to its supersymmetric extension at a certain energy scale below the axion decay constant. We then apply our results to three different classes of axion models, i.e. KSVZ-like, DFSZ-like, and string-theoretic axions, and examine if string-theoretic axions can be distinguished from others by having a different pattern of low energy couplings to the photon, nucleons and electron. We find that the low energy couplings of string-theoretic axions have a similar pattern as those of KSVZ-like axions but yet reveal a sizable difference which might be testable in future axion search experiments. We also note that the coupling of KSVZ-like QCD axions to the electron is dominated by a three-loop contribution involving the exotic heavy quark, gluons, top quark and Higgs field.


title: Symmetry operators of the asymmetric two-photon quantum Rabi model

abstract: The true level crossings in a subspace of the asymmetric two-photon quantum Rabi model (tpQRM) have been observed when the bias parameter of qubit is an even multiple of the renormalized cavity frequency. Generally, such level crossings imply the existence of the hidden symmetry because the bias term breaks the obvious symmetry exactly. In this work, we propose a Bogoliubov operator approach (BOA) for the asymmetric tpQRM to derive the symmetry operators associated with the hidden symmetry hierarchically. The explicit symmetry operators consisting of Lie algebra at low biases can be easily obtained in our general scheme. We believe the present approach can be extended for other asymmetric Rabi models to find the relevant hidden symmetry.


title: Unrepresentative Big Surveys Significantly Overestimate US Vaccine Uptake

abstract: Surveys are a crucial tool for understanding public opinion and behavior, and their accuracy depends on maintaining statistical representativeness of their target populations by minimizing biases from all sources. Increasing data size shrinks confidence intervals but magnifies the impact of survey bias, an instance of the Big Data Paradox (Meng 2018). Here we demonstrate this paradox in estimates of first-dose COVID-19 vaccine uptake in US adults: Delphi-Facebook (about 250,000 responses per week) and Census Household Pulse (about 75,000 per week). By May 2021, Delphi-Facebook overestimated uptake by 17 percentage points and Census Household Pulse by 14, compared to a benchmark from the Centers for Disease Control and Prevention (CDC). Moreover, their large data sizes led to minuscule margins of error on the incorrect estimates. In contrast, an Axios-Ipsos online panel with about 1,000 responses following survey research best practices (AAPOR) provided reliable estimates and uncertainty. We decompose observed error using a recent analytic framework to explain the inaccuracy in the three surveys. We then analyze the implications for vaccine hesitancy and willingness. We show how a survey of 250,000 respondents can produce an estimate of the population mean that is no more accurate than an estimate from a simple random sample of size 10. Our central message is that data quality matters far more than data quantity, and compensating the former with the latter is a mathematically provable losing proposition.


title: Adversarial Graph Augmentation to Improve Graph Contrastive Learning

abstract: Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence between the representations of the same graph in its different augmented forms, may yield robust and transferable GNNs even without using labels. However, GNNs trained by traditional GCL often risk capturing redundant graph features and thus may be brittle and provide sub-par performance in downstream tasks. Here, we propose a novel principle, termed adversarial-GCL (AD-GCL), which enables GNNs to avoid capturing redundant information during the training by optimizing adversarial graph augmentation strategies used in GCL. We pair AD-GCL with theoretical explanations and design a practical instantiation based on trainable edge-dropping graph augmentation. We experimentally validate AD-GCL by comparing with the state-of-the-art GCL methods and achieve performance gains of up-to $14\%$ in unsupervised, $6\%$ in transfer, and $3\%$ in semi-supervised learning settings overall with 18 different benchmark datasets for the tasks of molecule property regression and classification, and social network classification.


title: Flexible Bayesian inference for diffusion processes using splines

abstract: We introduce a flexible method to simultaneously infer both the drift and volatility functions of a discretely observed scalar diffusion. We introduce spline bases to represent these functions and develop a Markov chain Monte Carlo algorithm to infer, a posteriori, the coefficients of these functions in the spline basis. A key innovation is that we use spline bases to model transformed versions of the drift and volatility functions rather than the functions themselves. The output of the algorithm is a posterior sample of plausible drift and volatility functions that are not constrained to any particular parametric family. The flexibility of this approach provides practitioners a powerful investigative tool, allowing them to posit a variety of parametric models to better capture the underlying dynamics of their processes of interest. We illustrate the versatility of our method by applying it to challenging datasets from finance, paleoclimatology, and astrophysics. In view of the parametric diffusion models widely employed in the literature for those examples, some of our results are surprising since they call into question some aspects of these models.


title: An analogue of the strengthened Hanna Neumann conjecture for virtually free groups and virtually free products

abstract: The Friedman--Mineyev theorem, earlier known as the (strengthened) Hanna Neumann conjecture, gives a sharp estimate for the rank of the intersection of two subgroups in a free group. We obtain an analogue of this inequality for any two subgroups in a virtually free group (or, more generally, in a group containing a free product of left-orderable groups as a finite-index subgroup).


title: GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures

abstract: Attention based language models have become a critical component in state-of-the-art natural language processing systems. However, these models have significant computational requirements, due to long training times, dense operations and large parameter count. In this work we demonstrate a set of modifications to the structure of a Transformer layer, producing a more efficient architecture. First, we add a convolutional module to complement the self-attention module, decoupling the learning of local and global interactions. Secondly, we rely on grouped transformations to reduce the computational cost of dense feed-forward layers and convolutions, while preserving the expressivity of the model. We apply the resulting architecture to language representation learning and demonstrate its superior performance compared to BERT models of different scales. We further highlight its improved efficiency, both in terms of floating-point operations (FLOPs) and time-to-train.


title: Neural Text Classification and Stacked Heterogeneous Embeddings for Named Entity Recognition in SMM4H 2021

abstract: This paper presents our findings from participating in the SMM4H Shared Task 2021. We addressed Named Entity Recognition (NER) and Text Classification. To address NER we explored BiLSTM-CRF with Stacked Heterogeneous Embeddings and linguistic features. We investigated various machine learning algorithms (logistic regression, Support Vector Machine (SVM) and Neural Networks) to address text classification. Our proposed approaches can be generalized to different languages and we have shown its effectiveness for English and Spanish. Our text classification submissions (team:MIC-NLP) have achieved competitive performance with F1-score of $0.46$ and $0.90$ on ADE Classification (Task 1a) and Profession Classification (Task 7a) respectively. In the case of NER, our submissions scored F1-score of $0.50$ and $0.82$ on ADE Span Detection (Task 1b) and Profession Span detection (Task 7b) respectively.


title: Rare event estimation using stochastic spectral embedding

abstract: Estimating the probability of rare failure events is an essential step in the reliability assessment of engineering systems. Computing this failure probability for complex non-linear systems is challenging, and has recently spurred the development of active-learning reliability methods. These methods approximate the limit-state function (LSF) using surrogate models trained with a sequentially enriched set of model evaluations. A recently proposed method called stochastic spectral embedding (SSE) aims to improve the local approximation accuracy of global, spectral surrogate modelling techniques by sequentially embedding local residual expansions in subdomains of the input space. In this work we apply SSE to the LSF, giving rise to a stochastic spectral embedding-based reliability (SSER) method. The resulting partition of the input space decomposes the failure probability into a set of easy-to-compute \rev{conditional} failure probabilities. We propose a set of modifications that tailor the algorithm to efficiently solve rare event estimation problems. These modifications include specialized refinement domain selection, partitioning and enrichment strategies. We showcase the algorithm performance on four benchmark problems of various dimensionality and complexity in the LSF.


title: HASI: Hardware-Accelerated Stochastic Inference, A Defense Against Adversarial Machine Learning Attacks

abstract: Deep Neural Networks (DNNs) are employed in an increasing number of applications, some of which are safety critical. Unfortunately, DNNs are known to be vulnerable to so-called adversarial attacks that manipulate inputs to cause incorrect results that can be beneficial to an attacker or damaging to the victim. Multiple defenses have been proposed to increase the robustness of DNNs. In general, these defenses have high overhead, some require attack-specific re-training of the model or careful tuning to adapt to different attacks. This paper presents HASI, a hardware-accelerated defense that uses a process we call stochastic inference to detect adversarial inputs. We show that by carefully injecting noise into the model at inference time, we can differentiate adversarial inputs from benign ones. HASI uses the output distribution characteristics of noisy inference compared to a non-noisy reference to detect adversarial inputs. We show an adversarial detection rate of 86% when applied to VGG16 and 93% when applied to ResNet50, which exceeds the detection rate of the state of the art approaches, with a much lower overhead. We demonstrate two software/hardware-accelerated co-designs, which reduces the performance impact of stochastic inference to 1.58X-2X relative to the unprotected baseline, compared to 15X-20X overhead for a software-only GPU implementation.


title: High-precision Time-Frequency Signal Simultaneous Transfer System via a WDM-based Fiber Link

abstract: In this paper, we demonstrate a wavelength division multiplexing (WDM) based system for simultaneously delivering ultrastable optical frequency reference, 10 GHz microwave frequency reference, and one pulse per second (1 PPS) time signal via a 50 km fiber network. For each signal, a unique noise cancellation technique is used to maintain the precision of them. After being compensated, the transfer frequency instability in terms of overlapping Allan deviation (OADEV) for the optical frequency achieves 2E-17/s and scales down to 2E-20/10000 s, which for the 10 GHz microwave reference approaches 4E-15/s and decreases to 1.4E-17/10000 s, and the time uncertainty of the 1 PPS time signal along the system is 2.08 ps. In this scheme, specific channels of WDM are respectively occupied for different signals to avoid the possible crosstalk interference effect between the transmitted reference signals. To estimate the performance of the above scheme, independent of these signals is also demonstrated in this 50 km link, the results are similar to that in the case of simultaneous delivery. This work shows that the WDM-based system is a promising method for building a nationwide time and frequency fiber transfer system with a communication optical network.


title: Bohmian Zitterbewegung

abstract: A new Bohmian quantum-relativistic model, in which from the Klein-Gordon equation a generalization of the standard Zitterbewegung arises, is explored. It is obtained by introducing a new independent time parameter, whose relative motions are not directly observable but cause the quantum uncertainties of the observables. Unlike Bohm's original theory, the quantum potential does not affect the observable motion, as for a normal external potential, but it only determines that one relative to the new time variable, of which the Zitterbewegung of a free particle is an example. The model also involves a relativistic revision of the uncertainty principle.


title: A Variational View on Statistical Multiscale Estimation

abstract: We present a unifying view on various statistical estimation techniques including penalization, variational and thresholding methods. These estimators will be analyzed in the context of statistical linear inverse problems including nonparametric and change point regression, and high dimensional linear models as examples. Our approach reveals many seemingly unrelated estimation schemes as special instances of a general class of variational multiscale estimators, named MIND (MultIscale Nemirovskii--Dantzig). These estimators result from minimizing certain regularization functionals under convex constraints that can be seen as multiple statistical tests for local hypotheses. For computational purposes, we recast MIND in terms of simpler unconstraint optimization problems via Lagrangian penalization as well as Fenchel duality. Performance of several MINDs is demonstrated on numerical examples.


title: Example of cross-polarized standing gravitational waves

abstract: We use a cosmological counterpart of the cylindrical Halilsoy solution to illustrate properties of cross-polarized standing gravitational waves.


title: A Template-guided Hybrid Pointer Network for Knowledge-basedTask-oriented Dialogue Systems

abstract: Most existing neural network based task-oriented dialogue systems follow encoder-decoder paradigm, where the decoder purely depends on the source texts to generate a sequence of words, usually suffering from instability and poor readability. Inspired by the traditional template-based generation approaches, we propose a template-guided hybrid pointer network for the knowledge-based task-oriented dialogue system, which retrieves several potentially relevant answers from a pre-constructed domain-specific conversational repository as guidance answers, and incorporates the guidance answers into both the encoding and decoding processes. Specifically, we design a memory pointer network model with a gating mechanism to fully exploit the semantic correlation between the retrieved answers and the ground-truth response. We evaluate our model on four widely used task-oriented datasets, including one simulated and three manually created datasets. The experimental results demonstrate that the proposed model achieves significantly better performance than the state-of-the-art methods over different automatic evaluation metrics.


title: Scaling up Search Engine Audits: Practical Insights for Algorithm Auditing

abstract: Algorithm audits have increased in recent years due to a growing need to independently assess the performance of automatically curated services that process, filter, and rank the large and dynamic amount of information available on the internet. Among several methodologies to perform such audits, virtual agents stand out because they offer the ability to perform systematic experiments, simulating human behaviour without the associated costs of recruiting participants. Motivated by the importance of research transparency and replicability of results, this paper focuses on the challenges of such an approach. It provides methodological details, recommendations, lessons learned, and limitations based on our experience of setting up experiments for eight search engines (including main, news, image and video sections) with hundreds of virtual agents placed in different regions. We demonstrate the successful performance of our research infrastructure across multiple data collections, with diverse experimental designs, and point to different changes and strategies that improve the quality of the method. We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time, and we hope that this paper can serve as a basis for further research in this area.


title: Construction of Differential-Cascaded Structures for Control of Robot Manipulators

abstract: This paper focuses on the construction of differential-cascaded structures for control of nonlinear robot manipulators subjected to disturbances and unavailability of partial information of the desired trajectory. The proposed differential-cascaded structures rely on infinite differential series to handle the robustness with respect to time-varying disturbances and the partial knowledge of the desired trajectories for nonlinear robot manipulators. The long-standing problem of reliable adaptation in the presence of sustaining disturbances is solved by the proposed forwardstepping control with forwardstepping adaptation, and stacked reference dynamics yielding adaptive differential-cascaded structures have been proposed to facilitate the forwardstepping adaptation to both the uncertainty of robot dynamics and that of the frequencies of disturbances. A distinctive point of the proposed differential-cascaded approach is that the reference dynamics for design and analysis involve high-order quantities, but via degree-reduction implementation of the reference dynamics, the control typically involves only the low-order quantities, thus facilitating its applications to control of most physical systems. Our result relies on neither the explicit estimation of the disturbances or derivative and second derivative of the desired position nor the solutions to linear/nonlinear regulator equations, and the employed essential element is a differential-cascaded structure governing robot dynamics.


title: Incremental space-filling design based on coverings and spacings: improving upon low discrepancy sequences

abstract: The paper addresses the problem of defining families of ordered sequences $\{x_i\}_{i\in N}$ of elements of a compact subset $X$ of $R^d$ whose prefixes $X_n=\{x_i\}_{i=1}^{n}$, for all orders $n$, have good space-filling properties as measured by the dispersion (covering radius) criterion. Our ultimate aim is the definition of incremental algorithms that generate sequences $X_n$ with small optimality gap, i.e., with a small increase in the maximum distance between points of $X$ and the elements of $X_n$ with respect to the optimal solution $X_n^\star$. The paper is a first step in this direction, presenting incremental design algorithms with proven optimality bound for one-parameter families of criteria based on coverings and spacings that both converge to dispersion for large values of their parameter. The examples presented show that the covering-based method outperforms state-of-the-art competitors, including coffee-house, suggesting that it inherits from its guaranteed 50\% optimality gap.


title: Online Bayesian inference for multiple changepoints and risk assessment

abstract: The aim of the present study is to detect abrupt trend changes in the mean of a multidimensional sequential signal. Directly inspired by papers of Fernhead and Liu ([4] and [5]), this work describes the signal in a hierarchical manner : the change dates of a time segmentation process trigger the renewal of a piece-wise constant emission law. Bayesian posterior information on the change dates and emission parameters is obtained. These estimations can be revised online, i.e. as new data arrive. This paper proposes explicit formulations corresponding to various emission laws, as well as a generalization to the case where only partially observed data are available. Practical applications include the returns of partially observed multi-asset investment strategies, when only scant prior knowledge of the movers of the returns is at hand, limited to some statistical assumptions. This situation is different from the study of trend changes in the returns of individual assets, where fundamental exogenous information (news, earnings announcements, controversies, etc.) can be used.


title: On the ocean beach -- why elliptic pebbles do not become spherical

abstract: Among pebbles strewn across a sandy ocean beach one can find relatively many with a nearly perfect elliptical (ellipsoidal) shape, and one wonders how this shape was attained and whether, during abrasion, the pebbles would remain elliptical or eventually become spherical. Mainly the latter question was addressed in a previous publication which identified frictional sliding and rotation of an elliptic pebble as main abrasion processes in the surf waves. In particular, it was predicted that the ellipticity $\epsilon$ converges to a common equilibrium value for elliptic-like pebbles. Unfortunately, the derivation was based on an invalid force expression and a dimensionally unsuitable curvature. In this paper, not only force and curvature but also the contact duration with the sand surface during rotations is taken into account by fairly simple physical arguments, and it is shown that elliptic pebbles neither approach the same ellipticity and nor become more spherical nor more disk-like but rather that the ellipticity $\epsilon$ increases.


title: EventDrop: data augmentation for event-based learning

abstract: The advantages of event-sensing over conventional sensors (e.g., higher dynamic range, lower time latency, and lower power consumption) have spurred research into machine learning for event data. Unsurprisingly, deep learning has emerged as a competitive methodology for learning with event sensors; in typical setups, discrete and asynchronous events are first converted into frame-like tensors on which standard deep networks can be applied. However, over-fitting remains a challenge, particularly since event datasets remain small relative to conventional datasets (e.g., ImageNet). In this paper, we introduce EventDrop, a new method for augmenting asynchronous event data to improve the generalization of deep models. By dropping events selected with various strategies, we are able to increase the diversity of training data (e.g., to simulate various levels of occlusion). From a practical perspective, EventDrop is simple to implement and computationally low-cost. Experiments on two event datasets (N-Caltech101 and N-Cars) demonstrate that EventDrop can significantly improve the generalization performance across a variety of deep networks.


title: Niche to normality -- an interdisciplinary review of Vehicle-to-Grid

abstract: Vehicle-to-Grid (V2G) capabilities, which enable electric vehicles to discharge power from their batteries for external uses, epitomise the coupling of the electricity and transport sectors. To thrive at the nexus of these large and well-established sectors V2G services must deliver technical, economic and social values to many stakeholders. In this Review we present a holistic and interdisciplinary examination of V2G services, highlighting the wide range of potential benefits as well as the challenges slowing the technology's evolution from niche trials to mainstream adoption. We find that benefits tend to be siloed by value proposition and stakeholder while the challenges tend to stem from stacking multiple values and connecting multiple stakeholders. Consequently, we identify key areas for future research, industry and policy activities that will accelerate and smoothen the realisation of V2G's potential as an essential pillar of clean transport-electricity systems.


title: Large-scale optimal transport map estimation using projection pursuit

abstract: This paper studies the estimation of large-scale optimal transport maps (OTM), which is a well-known challenging problem owing to the curse of dimensionality. Existing literature approximates the large-scale OTM by a series of one-dimensional OTM problems through iterative random projection. Such methods, however, suffer from slow or none convergence in practice due to the nature of randomly selected projection directions. Instead, we propose an estimation method of large-scale OTM by combining the idea of projection pursuit regression and sufficient dimension reduction. The proposed method, named projection pursuit Monge map (PPMM), adaptively selects the most ``informative'' projection direction in each iteration. We theoretically show the proposed dimension reduction method can consistently estimate the most ``informative'' projection direction in each iteration. Furthermore, the PPMM algorithm weakly convergences to the target large-scale OTM in a reasonable number of steps. Empirically, PPMM is computationally easy and converges fast. We assess its finite sample performance through the applications of Wasserstein distance estimation and generative models.


title: Global conformal gauge in string theory

abstract: It was supposed for fifty years that the conformal gauge in string theory exists globally on the whole string world sheet. In fact, almost all results were obtained under this assumption. However, this statement was proved only locally in some neighbourhood of an arbitrary point on the worldsheet, and its extension is far from being obvious. In the present paper we prove that the conformal gauge does exists globally on the string worldsheet represented by an infinite strip with straight parallel boundaries.


title: A Bagging and Boosting Based Convexly Combined Optimum Mixture Probabilistic Model

abstract: Unlike previous studies on mixture distributions, a bagging and boosting based convexly combined mixture probabilistic model has been suggested. This model is a result of iteratively searching for obtaining the optimum probabilistic model that provides the maximum p value.

categories: cs.LG math.ST stat.AP stat.CO stat.ME stat.TH


title: Hybrid gene selection approach using XGBoost and multi-objective genetic algorithm for cancer classification

abstract: Microarray gene expression data are often accompanied by a large number of genes and a small number of samples. However, only a few of these genes are relevant to cancer, resulting in signigicant gene selection challenges. Hence, we propose a two-stage gene selection approach by combining extreme gradient boosting (XGBoost) and a multi-objective optimization genetic algorithm (XGBoost-MOGA) for cancer classification in microarray datasets. In the first stage, the genes are ranked use an ensemble-based feature selection using XGBoost. This stage can effectively remove irrelevant genes and yield a group comprising the most relevant genes related to the class. In the second stage, XGBoost-MOGA searches for an optimal gene subset based on the most relevant genes's group using a multi-objective optimization genetic algorithm. We performed comprehensive experiments to compare XGBoost-MOGA with other state-of-the-art feature selection methods using two well-known learning classifiers on 13 publicly available microarray expression datasets. The experimental results show that XGBoost-MOGA yields significantly better results than previous state-of-the-art algorithms in terms of various evaluation criteria, such as accuracy, F-score, precision, and recall.


title: Causality in Neural Networks -- An Extended Abstract

abstract: Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine learning helps in providing better learning and explainable models. Explainability, causal disentanglement are some important aspects of any machine learning model. Causal explanations are required to believe in a model's decision and causal disentanglement learning is important for transfer learning applications. We exploit the ideas of causality to be used in deep learning models to achieve better and causally explainable models that are useful in fairness, disentangled representation, etc.


title: Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images

abstract: Cell instance segmentation in fluorescence microscopy images is becoming essential for cancer dynamics and prognosis. Data extracted from cancer dynamics allows to understand and accurately model different metabolic processes such as proliferation. This enables customized and more precise cancer treatments. However, accurate cell instance segmentation, necessary for further cell tracking and behavior analysis, is still challenging in scenarios with high cell concentration and overlapping edges. Within this framework, we propose a novel cell instance segmentation approach based on the well-known U-Net architecture. To enforce the learning of morphological information per pixel, a deep distance transformer (DDT) acts as a back-bone model. The DDT output is subsequently used to train a top-model. The following top-models are considered: a three-class (\emph{e.g.,} foreground, background and cell border) U-net, and a watershed transform. The obtained results suggest a performance boost over traditional U-Net architectures. This opens an interesting research line around the idea of injecting morphological information into a fully convolutional model.


title: SemSegLoss: A python package of loss functions for semantic segmentation

abstract: Image Segmentation has been an active field of research as it has a wide range of applications, ranging from automated disease detection to self-driving cars. In recent years, various research papers proposed different loss functions used in case of biased data, sparse segmentation, and unbalanced dataset. In this paper, we introduce SemSegLoss, a python package consisting of some of the well-known loss functions widely used for image segmentation. It is developed with the intent to help researchers in the development of novel loss functions and perform an extensive set of experiments on model architectures for various applications. The ease-of-use and flexibility of the presented package have allowed reducing the development time and increased evaluation strategies of machine learning models for semantic segmentation. Furthermore, different applications that use image segmentation can use SemSegLoss because of the generality of its functions. This wide range of applications will lead to the development and growth of AI across all industries.


title: The Real Characterization of $H_{\lambda}^p(\mathbb R_+^2)$ for $\frac{2\lambda}{2\lambda+1}<p\leq1$

abstract: For $p>p_0=\frac{2\lambda}{2\lambda+1}$ with $\lambda>0$, the Hardy space $H_{\lambda}^p(\mathbb R_+^2)$ associated with the Dunkl transform $\mathcal{F}_\lambda$ and the Dunkl operator $D$ on the real line $\mathbb R$, where $D_xf(x)=f'(x)+\frac{\lambda}{x}[f(x)-f(-x)]$, is the set of functions $F=u+iv$ on the upper half plane $\mathbb R^2_+=\left\{(x, y): x\in\mathbb R, y>0\right\}$, satisfying $\lambda$-Cauchy-Riemann equations: $ D_xu-\partial_y v=0$, $\partial_y u +D_xv=0$, and $\sup\limits_{y>0}\int_{\mathbb R}|F(x+iy)|^p|x|^{2\lambda}dx<\infty$. In this paper, we will give a further characterization of $H_{\lambda}^p(\mathbb R_+^2)$ in \cite{ZhongKai Li 3}. We prove the inequality $\|F\|_{H_{\lambda}^p(\mathbb R_+^2)}\leq c\|u_{\nabla}^*\|_{L^p_{\lambda}}$, which gives a Real Characterization of the class $H_{\lambda}^p(\mathbb R_+^2)$ for $\frac{2\lambda}{2\lambda+1}<p\leq1$ as a main result.


title: Latent Space Arc Therapy Optimization

abstract: Volumetric modulated arc therapy planning is a challenging problem in high-dimensional, non-convex optimization. Traditionally, heuristics such as fluence-map-optimization-informed segment initialization use locally optimal solutions to begin the search of the full arc therapy plan space from a reasonable starting point. These routines facilitate arc therapy optimization such that clinically satisfactory radiation treatment plans can be created in about 10 minutes. However, current optimization algorithms favor solutions near their initialization point and are slower than necessary due to plan overparameterization. In this work, arc therapy overparameterization is addressed by reducing the effective dimension of treatment plans with unsupervised deep learning. An optimization engine is then built based on low-dimensional arc representations which facilitates faster planning times.


title: Unfolding the multiscale structure of networks with dynamical Ollivier-Ricci curvature

abstract: Describing networks geometrically through low-dimensional latent metric spaces has helped design efficient learning algorithms, unveil network symmetries and study dynamical network processes. However, latent space embeddings are limited to specific classes of networks because incompatible metric spaces generally result in information loss. Here, we study arbitrary networks geometrically by defining a dynamic edge curvature measuring the similarity between pairs of dynamical network processes seeded at nearby nodes. We show that the evolution of the curvature distribution exhibits gaps at characteristic timescales indicating bottleneck-edges that limit information spreading. Importantly, curvature gaps are robust to large fluctuations in node degrees, encoding communities until the phase transition of detectability, where spectral and node-clustering methods fail. Using this insight, we derive geometric modularity to find multiscale communities based on deviations from constant network curvature in generative and real-world networks, significantly outperforming most previous methods. Our work suggests using network geometry for studying and controlling the structure of and information spreading on networks.


title: Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems

abstract: The demand of probabilistic time series forecasting has been recently raised in various dynamic system scenarios, for example, system identification and prognostic and health management of machines. To this end, we combine the advances in both deep generative models and state space model (SSM) to come up with a novel, data-driven deep probabilistic sequence model. Specifically, we follow the popular encoder-decoder generative structure to build the recurrent neural networks (RNN) assisted variational sequence model on an augmented recurrent input space, which could induce rich stochastic sequence dependency. Besides, in order to alleviate the inconsistency issue of the posterior between training and predicting as well as improving the mining of dynamic patterns, we (i) propose using a lagged hybrid output as input for the posterior at next time step, which brings training and predicting into alignment; and (ii) further devise a generalized auto-regressive strategy that encodes all the historical dependencies for the posterior. Thereafter, we first investigate the methodological characteristics of the proposed deep probabilistic sequence model on toy cases, and then comprehensively demonstrate the superiority of our model against existing deep probabilistic SSM models through extensive numerical experiments on eight system identification benchmarks from various dynamic systems. Finally, we apply our sequence model to a real-world centrifugal compressor forecasting problem, and again verify its outstanding performance by quantifying the time series predictive distribution.


title: Gravitational interaction mediated by Classical Zero Point Field

abstract: By modeling the particle as a two-dimensional oscillator with the natural angular frequency equal to the Zitterbewegung frequency, the expression of the gravitational force between two particles is obtained. Gravitational force is the effect of the absorption-scattering of the CZPF background by the oscillators. The connection between the gravitational and the electrostatic interaction is obtained.


title: Matrix Completion with Model-free Weighting

abstract: In this paper, we propose a novel method for matrix completion under general non-uniform missing structures. By controlling an upper bound of a novel balancing error, we construct weights that can actively adjust for the non-uniformity in the empirical risk without explicitly modeling the observation probabilities, and can be computed efficiently via convex optimization. The recovered matrix based on the proposed weighted empirical risk enjoys appealing theoretical guarantees. In particular, the proposed method achieves a stronger guarantee than existing work in terms of the scaling with respect to the observation probabilities, under asymptotically heterogeneous missing settings (where entry-wise observation probabilities can be of different orders). These settings can be regarded as a better theoretical model of missing patterns with highly varying probabilities. We also provide a new minimax lower bound under a class of heterogeneous settings. Numerical experiments are also provided to demonstrate the effectiveness of the proposed method.


title: Electromagnetic Fields Simulating a Rotating Sphere and its Exterior

abstract: Vector displacements expressed in spherical coordinates are proposed. They correspond to electromagnetic fields in vacuum that globally rotate about an axis and display many circular patterns on the surface of a sphere. The fields basically satisfy the set of Maxwell's equations, but enjoy further properties that allow them to be suitably interpreted as solutions of a plasma model that combines electrodynamics with the Euler's equation for fluids. Connection with magnetohydrodynamics can also be established. The fields are extended with continuity outside the sphere in a very peculiar manner. In order to avoid peripheral velocities of arbitrary magnitude, as it may happen for a rigid rotating body, they are organized to form successive encapsulated shells, with substructures recalling successive ball-bearing assemblies. A recipe for the construction of these solutions is provided by playing with the eigenfunctions of the vector Laplace operator. Some applications relative to astronomy are finally discussed.


title: Automatic Speech Recognition in Sanskrit: A New Speech Corpus and Modelling Insights

abstract: Automatic speech recognition (ASR) in Sanskrit is interesting, owing to the various linguistic peculiarities present in the language. The Sanskrit language is lexically productive, undergoes euphonic assimilation of phones at the word boundaries and exhibits variations in spelling conventions and in pronunciations. In this work, we propose the first large scale study of automatic speech recognition (ASR) in Sanskrit, with an emphasis on the impact of unit selection in Sanskrit ASR. In this work, we release a 78 hour ASR dataset for Sanskrit, which faithfully captures several of the linguistic characteristics expressed by the language. We investigate the role of different acoustic model and language model units in ASR systems for Sanskrit. We also propose a new modelling unit, inspired by the syllable level unit selection, that captures character sequences from one vowel in the word to the next vowel. We also highlight the importance of choosing graphemic representations for Sanskrit and show the impact of this choice on word error rates (WER). Finally, we extend these insights from Sanskrit ASR for building ASR systems in two other Indic languages, Gujarati and Telugu. For both these languages, our experimental results show that the use of phonetic based graphemic representations in ASR results in performance improvements as compared to ASR systems that use native scripts.


title: PRECISE Photonic hybRid EleCtromagnetIc SolvEr

abstract: The Photonic hybRid EleCtromagnetic SolvEr (PRECISE) is a Matlab based library to model large and complex photonics integrated circuits. Each circuit is modularly described in terms of waveguide segments connected through multiport nodes. Linear, nonlinear, and dynamical phenomena are simulated by solving the system of differential equations describing the effect to be considered. By exploiting the steady state approximation of the electromagnetic field within each node device, the library can handle large and complex circuits even on desktop PC. We show that the steady state assumption is fulfilled in a broad number of applications and we compare its accuracy with analytical model (coupled mode theory) and experimental results. PRECISE is highly modular and easily extensible to handle equations different from those already implemented and is, thus, a flexible tool to model the increasingly complex photonic circuits.


title: Do you feel safe with your robot? Factors Influencing Perceived Safety in Human-Robot Interaction based on Subjective and Objective Measures

abstract: Safety in human-robot interaction can be divided into physical safety and perceived safety, where the latter is still under-addressed in the literature. Investigating perceived safety in human-robot interaction requires a multidisciplinary perspective. Indeed, perceived safety is often considered as being associated with several common factors studied in other disciplines, i.e., comfort, predictability, sense of control, and trust. In this paper, we investigated the relationship between these factors and perceived safety in human-robot interaction using subjective and objective measures. We conducted a two-by-five mixed-subjects design experiment. The five within-subjects conditions correspond to (1) baseline, and the manipulations of robot behaviors to stimulate: (2) discomfort, (3) decreased perceived safety, (4) decreased sense of control and (5) distrust. Twenty-seven young adult participants took part in the experiments. Participants were asked to answer questionnaires that measure the manipulated factors after within-subjects conditions. Besides questionnaire data, we collected objective measures such as videos and physiological data. The questionnaire results show a correlation between comfort, sense of control, trust, and perceived safety. We also discuss the effect of individual human characteristics (such as personality and gender) that they could be predictors of perceived safety. We used the physiological signal data and facial affect from videos for estimating perceived safety where participants' subjective ratings were utilized as labels. The data from objective measures revealed that the prediction rate was higher from physiological signal data. This paper can play an important role in the goal of better understanding perceived safety in human-robot interaction.