title: Exploration Based Language Learning for Text-Based Games

abstract: This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natural language and expect the player to interact with the game using text. These games are of interest as they can be seen as a testbed for language understanding, problem-solving, and language generation by artificial agents. Moreover, they provide a learning environment in which these skills can be acquired through interactions with an environment rather than using fixed corpora. One aspect that makes these games particularly challenging for learning agents is the combinatorially large action space. Existing methods for solving text-based games are limited to games that are either very simple or have an action space restricted to a predetermined set of admissible actions. In this work, we propose to use the exploration approach of Go-Explore for solving text-based games. More specifically, in an initial exploration phase, we first extract trajectories with high rewards, after which we train a policy to solve the game by imitating these trajectories. Our experiments show that this approach outperforms existing solutions in solving text-based games, and it is more sample efficient in terms of the number of interactions with the environment. Moreover, we show that the learned policy can generalize better than existing solutions to unseen games without using any restriction on the action space.


title: Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation

abstract: Hand pose estimation is more challenging than body pose estimation due to severe articulation, self-occlusion and high dexterity of the hand. Current approaches often rely on a popular body pose algorithm, such as the Convolutional Pose Machine (CPM), to learn 2D keypoint features. These algorithms cannot adequately address the unique challenges of hand pose estimation, because they are trained solely based on keypoint positions without seeking to explicitly model structural relationship between them. We propose a novel Nonparametric Structure Regularization Machine (NSRM) for 2D hand pose estimation, adopting a cascade multi-task architecture to learn hand structure and keypoint representations jointly. The structure learning is guided by synthetic hand mask representations, which are directly computed from keypoint positions, and is further strengthened by a novel probabilistic representation of hand limbs and an anatomically inspired composition strategy of mask synthesis. We conduct extensive studies on two public datasets - OneHand 10k and CMU Panoptic Hand. Experimental results demonstrate that explicitly enforcing structure learning consistently improves pose estimation accuracy of CPM baseline models, by 1.17% on the first dataset and 4.01% on the second one. The implementation and experiment code is freely available online. Our proposal of incorporating structural learning to hand pose estimation requires no additional training information, and can be a generic add-on module to other pose estimation models.


title: Chandra Observations of Candidate Sub-Parsec Binary Supermassive Black Holes

abstract: We present analysis of Chandra X-ray observations of seven quasars that were identified as candidate sub-parsec binary supermassive black hole (SMBH) systems in the Catalina Real-Time Transient Survey (CRTS) based on apparent periodicity in their optical light curves. Simulations predict close-separation accreting SMBH binaries will have different X-ray spectra than single accreting SMBHs, including harder or softer X-ray spectra, ripple-like profiles in the Fe K-$\alpha$ line, and distinct peaks in the spectrum due to the separation of the accretion disk into a circumbinary disk and mini-disks around each SMBH. We obtained Chandra observations to test these models and assess whether these quasars could contain binary SMBHs. We instead find that the quasar spectra are all well fit by simple absorbed power law models, with the rest frame 2-10 keV photon indices, $\Gamma$, and the X-ray-to-optical power slopes, $\alpha_{\rm OX}$, indistinguishable from the larger quasar population. This may indicate that these seven quasars are not truly sub-parsec binary SMBH systems, or it may simply reflect that our sample size was too small to robustly detect any differences. Alternatively, the X-ray spectral changes might only be evident at higher energies than probed by Chandra. Given the available models and current data, no firm conclusions are drawn. These observations will help motivate and direct further work on theoretical models of binary SMBH systems, such as modeling systems with thinner accretion disks and larger binary separations.


title: Rough basin boundaries in high dimension: Can we classify them experimentally?

abstract: We show that a known condition for having rough basin boundaries in bistable 2D maps holds for high-dimensional bistable systems that possess a unique nonattracting chaotic set embedded in their basin boundaries. The condition for roughness is that the cross-boundary Lyapunov exponent $\lambda_x$ {\bfac on the nonattracting set} is not the maximal one. Furthermore, we provide a formula for the generally noninteger co-dimension of the rough basin boundary, which can be viewed as a generalization of the Kantz-Grassberger formula. This co-dimension that can be at most unity can be thought of as a partial co-dimension, and, so, it can be matched with a Lyapunov exponent. We show {\bfac in 2D noninvertible- and 3D invertible minimal models,} that, formally, it cannot be matched with $\lambda_x$. Rather, the partial dimension $D_0^{(x)}$ that $\lambda_x$ is associated with in the case of rough boundaries is trivially unity. Further results hint that the latter holds also in higher dimensions. This is a peculiar feature of rough fractals. Yet, $D_0^{(x)}$ cannot be measured via the uncertainty exponent along a line that traverses the boundary. Indeed, one cannot determine whether the boundary is a rough or a filamentary fractal by measuring fractal dimensions. Instead, one needs to measure both the maximal and cross-boundary Lyapunov exponents numerically or experimentally.

categories: nlin.CD cond-mat.stat-mech math.DS physics.data-an


title: Irreducible cone spherical metrics and stable extensions of two line bundles

abstract: A cone spherical metric is called irreducible if any developing map of the metric does not have monodromy in ${\rm U(1)}$. By using the theory of indigenous bundles, we construct on a compact Riemann surface $X$ of genus $g_X \geq 1$ a canonical surjective map from the moduli space of stable extensions of two line bundles to that of irreducible metrics with cone angles in $2 \pi \mathbb{Z}_{>1}$, which is generically injective in the algebro-geometric sense as $g_X \geq 2$. As an application, we prove the following two results about irreducible metrics: $\bullet$ as $g_X \geq 2$ and $d$ is even and greater than $12g_X - 7$, the effective divisors of degree $d$ which could be represented by irreducible metrics form an arcwise connected Borel subset of Hausdorff dimension $\geq 2(d+3-3g_X)$ in ${\rm Sym}^d(X)$; $\bullet$ as $g_X \geq 1$, for almost every effective divisor $D$ of degree odd and greater than $2g_X-2$ on $X$, there exist finitely many cone spherical metrics representing $D$.


title: Simple and Effective Prevention of Mode Collapse in Deep One-Class Classification

abstract: Anomaly detection algorithms find extensive use in various fields. This area of research has recently made great advances thanks to deep learning. A recent method, the deep Support Vector Data Description (deep SVDD), which is inspired by the classic kernel-based Support Vector Data Description (SVDD), is capable of simultaneously learning a feature representation of the data and a data-enclosing hypersphere. The method has shown promising results in both unsupervised and semi-supervised settings. However, deep SVDD suffers from hypersphere collapse -- also known as mode collapse, if the architecture of the model does not comply with certain architectural constraints, e.g. the removal of bias terms. These constraints limit the adaptability of the model and in some cases, may affect the model performance due to learning sub-optimal features. In this work, we consider two regularizers to prevent hypersphere collapse in deep SVDD. The first regularizer is based on injecting random noise via the standard cross-entropy loss. The second regularizer penalizes the minibatch variance when it becomes too small. Moreover, we introduce an adaptive weighting scheme to control the amount of penalization between the SVDD loss and the respective regularizer. Our proposed regularized variants of deep SVDD show encouraging results and outperform a prominent state-of-the-art method on a setup where the anomalies have no apparent geometrical structure.


title: Goal-Oriented Adaptive THB-Spline Schemes for PDE-Based Planar Parameterization

abstract: This paper presents a PDE-based planar parameterization framework with support for Truncated Hierarchical B-Splines (THB-splines). For this, we adopt the a posteriori refinement strategy of Dual Weighted Residual and present several adaptive numerical schemes for the purpose of approximating an inversely harmonic geometry parameterization. Hereby, the combination of goal-oriented a posteriori strategies and THB-enabled local refinement avoids over-refinement, in particular in geometries with complex boundaries. To control the parametric properties of the outcome, we introduce the concept of domain refinement. Hereby, the properties of the domain into which the mapping maps inversely harmonically, are optimized in order to fine-tune the parametric properties of the recomputed geometry parameterization.


title: Weight distributions and weight hierarchies of two classes of binary linear codes

abstract: Linear codes with a few weights can be applied to communication, consumer electronics and data storage system. In addition, the weight hierarchy of linear codes has many applications such as on the type II wire-tap channel, dealing with $t$-resilient functions and trellis or branch complexity of linear codes and so on. In this paper, we first present a formula for computing the weight hierarchies of linear codes constructed by the generalized method of defining sets. Then, we construct two classes of binary linear codes with a few weights and determine their weight distributions and weight hierarchies completely. Some codes of them can be used in secret sharing schemes.


title: From Nesterov's Estimate Sequence to Riemannian Acceleration

abstract: We propose the first global accelerated gradient method for Riemannian manifolds. Toward establishing our result we revisit Nesterov's estimate sequence technique and develop an alternative analysis for it that may also be of independent interest. Then, we extend this analysis to the Riemannian setting, localizing the key difficulty due to non-Euclidean structure into a certain ``metric distortion.'' We control this distortion by developing a novel geometric inequality, which permits us to propose and analyze a Riemannian counterpart to Nesterov's accelerated gradient method.


title: Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms

abstract: We study distributed estimation of a Gaussian mean under communication constraints in a decision theoretical framework. Minimax rates of convergence, which characterize the tradeoff between the communication costs and statistical accuracy, are established in both the univariate and multivariate settings. Communication-efficient and statistically optimal procedures are developed. In the univariate case, the optimal rate depends only on the total communication budget, so long as each local machine has at least one bit. However, in the multivariate case, the minimax rate depends on the specific allocations of the communication budgets among the local machines. Although optimal estimation of a Gaussian mean is relatively simple in the conventional setting, it is quite involved under the communication constraints, both in terms of the optimal procedure design and lower bound argument. The techniques developed in this paper can be of independent interest. An essential step is the decomposition of the minimax estimation problem into two stages, localization and refinement. This critical decomposition provides a framework for both the lower bound analysis and optimal procedure design.

categories: math.ST cs.DC cs.IT cs.LG math.IT stat.ML stat.TH


title: Progressive Local Filter Pruning for Image Retrieval Acceleration

abstract: This paper focuses on network pruning for image retrieval acceleration. Prevailing image retrieval works target at the discriminative feature learning, while little attention is paid to how to accelerate the model inference, which should be taken into consideration in real-world practice. The challenge of pruning image retrieval models is that the middle-level feature should be preserved as much as possible. Such different requirements of the retrieval and classification model make the traditional pruning methods not that suitable for our task. To solve the problem, we propose a new Progressive Local Filter Pruning (PLFP) method for image retrieval acceleration. Specifically, layer by layer, we analyze the local geometric properties of each filter and select the one that can be replaced by the neighbors. Then we progressively prune the filter by gradually changing the filter weights. In this way, the representation ability of the model is preserved. To verify this, we evaluate our method on two widely-used image retrieval datasets,i.e., Oxford5k and Paris6K, and one person re-identification dataset,i.e., Market-1501. The proposed method arrives with superior performance to the conventional pruning methods, suggesting the effectiveness of the proposed method for image retrieval.


title: Broken symmetries and Kohn's theorem in graphene cyclotron resonance

abstract: The magnetoplasmon spectrum of Landau level transitions in hexagonal boron nitride-encapsulated graphene is explored via infrared transmission magnetospectroscopy, as a function of the filling factor at fixed magnetic field. As the lowest Landau level occupancy is increased from half-filling, a non-monotonic progression of multiple cyclotron resonance peaks is observed, with a single peak evolving into four peaks and back to two, all with linewidths of order 0.5 meV. This provides a novel window on the interplay of electron interactions with broken spin and valley symmetries in the quantum Hall regime. Analysis of the peak energies shows an indirect enhancement of spin gaps below the Fermi energy, a Dirac mass at half-filling that is nearly 50\% larger than when the lowest Landau level is completely full, and a small but clear particle-hole asymmetry. We suggest a key role is played by the boron nitride in enabling interaction-enhanced broken symmetries to be observed in graphene cyclotron resonance.


title: Renormalization of bilinear and four-fermion operators through temporal moments

abstract: We propose a renormalization scheme that can be simply implemented on the lattice. It consists of the temporal moments of two-point and three-point functions calculated with finite valence quark mass. The scheme is confirmed to yield a consistent result with another renormalization scheme in the continuum limit for the bilinear operators. We apply a similar renormalization scheme for the non-perturbative renormalization of four-fermion operators appearing in the weak effective Hamiltonian.


title: A note on purely imaginary independence roots

abstract: The independence polynomial of a graph is the generating polynomial for the number of independent sets of each cardinality and its roots are called independence roots. We investigate here purely imaginary independence roots. We show that there are infinitely many connected graphs with purely imaginary independence roots and that every graph is a subgraph of such a graph. We also classify every rational purely imaginary number that is an independence root.


title: Single $\Lambda_c^+$ hypernuclei within quark mean-field model

abstract: The quark mean-field (QMF) model is applied to study the single $\Lambda^+_c$ hypernuclei. The charm baryon, $\Lambda^+_c$, is constructed by three constituent quarks, $u, ~d$, and $c$, confined by central harmonic oscillator potentials. The confinement potential strength of charm quark is determined by fitting the experimental masses of charm baryons, $\Lambda^+_c,~\Sigma^+_c$, and $\Xi^{++}_{cc}$. The effects of pions and gluons are also considered to describe the baryons at the quark level. The baryons in $\Lambda^+_c$ hypernuclei interact with each other through exchanging the $\sigma,~\omega$, and $\rho$ mesons between the quarks confined in different baryons. The $\Lambda^+_c N$ potential in the QMF model is strongly dependent on the coupling constant between $\omega$ meson and $\Lambda^+_c$, $g_{\omega\Lambda^+_c}$. When the conventional quark counting rule is used, i. e., $g_{\omega\Lambda^+_c}=2/3g_{\omega N}$, the massive $\Lambda^+_c$ hypernucleus can exist, whose single $\Lambda^+_c$ binding energy is smaller with the mass number increasing due to the strong Coulomb repulsion between $\Lambda^+_c$ and protons. When $g_{\omega\Lambda^+_c}$ is fixed by the latest lattice $\Lambda^+_c N$ potential, the $\Lambda^+_c$ hypernuclei only can exist up to $A\sim 50$.


title: When Wireless Security Meets Machine Learning: Motivation, Challenges, and Research Directions

abstract: Wireless systems are vulnerable to various attacks such as jamming and eavesdropping due to the shared and broadcast nature of wireless medium. To support both attack and defense strategies, machine learning (ML) provides automated means to learn from and adapt to wireless communication characteristics that are hard to capture by hand-crafted features and models. This article discusses motivation, background, and scope of research efforts that bridge ML and wireless security. Motivated by research directions surveyed in the context of ML for wireless security, ML-based attack and defense solutions and emerging adversarial ML techniques in the wireless domain are identified along with a roadmap to foster research efforts in bridging ML and wireless security.


title: Solstice and Solar Position observations in Australian Aboriginal and Torres Strait Islander traditions

abstract: A major focus of the archaeoastronomical research conducted around the world focuses on understanding how ancient cultures observed sunrise and sunset points along the horizon, particularly at the solstices and equinoxes. Scholars argue that observations of these solar points are useful for developing calendars, informing ritual/ceremonial practices, and predicting seasonal change. This is the foundation of the Eurocentric four-season Julian (and later Gregorian) calendar. Famous examples include Stonehenge, Newgrange, Chichen Itza, and Chankillo. Studies at these and other sites tend to focus on solar point observations through alignments in stone arrangements, and the orientations of monuments. Despite the ongoing study of Indigenous Knowledge in Australia revealing a wealth of information about Aboriginal and Torres Strait Islander observations and interpretations of solar, lunar, and stellar properties and motions, very little has been published about the importance and use of solar point observations. The authors examine this topic through four case studies, based on methodological frameworks and approaches in ethnography, ethnohistory, archaeology, and statistics. Our findings show that Aboriginal and Torres Strait Islander people observe the solstices and other significant sunrise/sunset points along the horizon for timekeeping and indicating seasonal change - but in ways that are rather different to the four-season model developed in Western Europe.


title: Low-rank Gradient Approximation For Memory-Efficient On-device Training of Deep Neural Network

abstract: Training machine learning models on mobile devices has the potential of improving both privacy and accuracy of the models. However, one of the major obstacles to achieving this goal is the memory limitation of mobile devices. Reducing training memory enables models with high-dimensional weight matrices, like automatic speech recognition (ASR) models, to be trained on-device. In this paper, we propose approximating the gradient matrices of deep neural networks using a low-rank parameterization as an avenue to save training memory. The low-rank gradient approximation enables more advanced, memory-intensive optimization techniques to be run on device. Our experimental results show that we can reduce the training memory by about 33.0% for Adam optimization. It uses comparable memory to momentum optimization and achieves a 4.5% relative lower word error rate on an ASR personalization task.


title: PairNets: Novel Fast Shallow Artificial Neural Networks on Partitioned Subspaces

abstract: Traditionally, an artificial neural network (ANN) is trained slowly by a gradient descent algorithm such as the backpropagation algorithm since a large number of hyperparameters of the ANN need to be fine-tuned with many training epochs. To highly speed up training, we created a novel shallow 4-layer ANN called "Pairwise Neural Network" ("PairNet") with high-speed hyperparameter optimization. In addition, a value of each input is partitioned into multiple intervals, and then an n-dimensional space is partitioned into M n-dimensional subspaces. M local PairNets are built in M partitioned local n-dimensional subspaces. A local PairNet is trained very quickly with only one epoch since its hyperparameters are directly optimized one-time via simply solving a system of linear equations by using the multivariate least squares fitting method. Simulation results for three regression problems indicated that the PairNet achieved much higher speeds and lower average testing mean squared errors (MSEs) for the three cases, and lower average training MSEs for two cases than the traditional ANNs. A significant future work is to develop better and faster optimization algorithms based on intelligent methods and parallel computing methods to optimize both partitioned subspaces and hyperparameters to build the fast and effective PairNets for applications in big data mining and real-time machine learning.


title: Thermal Kinetic Inductance Detectors for millimeter-wave detection

abstract: Thermal Kinetic Inductance Detectors (TKIDs) combine the excellent noise performance of traditional bolometers with a radio frequency multiplexing architecture that enables the large detector counts needed for the next generation of millimeter-wave instruments. In this paper, we first discuss the expected noise sources in TKIDs and derive the limits where the phonon noise contribution dominates over the other detector noise terms: generation-recombination, amplifier, and two-level system (TLS) noise. Second, we characterize aluminum TKIDs in a dark environment. We present measurements of TKID resonators with quality factors of about $10^5$ at 80 mK. We also discuss the bolometer thermal conductance, heat capacity, and time constants. These were measured by the use of a resistor on the thermal island to excite the bolometers. These dark aluminum TKIDs demonstrate a noise equivalent power NEP = $2 \times 10^{-17} \mathrm{W}/\mathrm{\sqrt{Hz}} $, with a $1/f$ knee at 0.1 Hz, which provides background noise limited performance for ground-based telescopes observing at 150 GHz.


title: Drag force in immersed granular materials

abstract: We investigate the drag forces acting on large objects moving through a granular packing immersed in water. In this aim, we conducted uplift experiments involving pulling out horizontal plates at a prescribed velocity vertically. During these tests, we observed that the drag force reaches to peak at a low displacement and then decays. Results show that the peak drag force strongly increases with the velocity and depends on the plate size and grain diameter. We identify empirical scaling laws for these properties and introduce a Darcy-flow mechanism that can explain them. Furthermore, we conducted tests involving suddenly stopping the motion of the plate, which evidenced a progressive relaxation of the drag force in time. We discuss how a visco-elasto-plastic mechanical analogue can reproduce these dynamics. These results and analyses highlight fundamental differences in drag force between dry and immersed granular materials.


title: Determination of Glass Transition Temperature of Polyimides from Atomistic Molecular Dynamics Simulations and Machine-Learning Algorithms

abstract: Glass transition temperature ($T_{\text{g}}$) plays an important role in controlling the mechanical and thermal properties of a polymer. Polyimides are an important category of polymers with wide applications because of their superior heat resistance and mechanical strength. The capability of predicting $T_{\text{g}}$ for a polyimide $a~priori$ is therefore highly desirable in order to expedite the design and discovery of new polyimide polymers with targeted properties and applications. Here we explore three different approaches to either compute $T_{\text{g}}$ for a polyimide via all-atom molecular dynamics (MD) simulations or predict $T_{\text{g}}$ via a mathematical model generated by using machine-learning algorithms to analyze existing data collected from literature. Our simulations reveal that $T_{\text{g}}$ can be determined from examining the diffusion coefficient of simple gas molecules in a polyimide as a function of temperature and the results are comparable to those derived from data on polymer density versus temperature and actually closer to the available experimental data. Furthermore, the predictive model of $T_{\text{g}}$ derived with machine-learning algorithms can be used to estimate $T_{\text{g}}$ successfully within an uncertainty of about 20 degrees, even for polyimides yet to be synthesized experimentally.


title: Sporadic and intense accretion in a 1 Myr-old brown dwarf candidate

abstract: Studying the accretion process in very low-mass objects has important implications for understanding their formation mechanism. Many nearby late-M dwarfs that have previously been identified in the field are in fact young brown dwarf members of nearby young associations. Some of them are still accreting. They are therefore excellent targets for further studies of the accretion process in the very low-mass regime at different stages. We aim to search for accreting young brown dwarf candidates in a sample of 85 nearby late-M dwarfs. Using photometric data from DENIS, 2MASS, and WISE, we constructed the spectral energy distribution of the late-M dwarfs based on BT-Settl models to detect infrared excesses. We then searched for lithium and H$\alpha$ emission in candidates that exhibit infrared excesses to confirm their youth and the presence of accretion. Among the 85 late-M dwarfs, only DENIS-P J1538317$-$103850 (M5.5) shows strong infrared excesses in WISE bands. The detection of lithium absorption in the M5.5 dwarf and its Gaia trigonometric parallax indicate an age of $\sim$1 Myr and a mass of 47 $M_{\rm J}$. The H$\alpha$ emission line in the brown dwarf shows significant variability that indicates sporadic accretion. This 1 Myr-old brown dwarf also exhibits intense accretion bursts with accretion rates of up to $10^{-7.9}$$M_{\odot}$ yr$^{-1}$. Our detection of sporadic accretion in one of the youngest brown dwarfs might imply that sporadic accretion at early stages could play an important role in the formation of brown dwarfs. Very low-mass cores would not be able to accrete enough material to become stars, and thus they end up as brown dwarfs.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Quantum Seiberg-Witten periods for $\mathcal{N}=2$ $SU(N_c)$ SQCD around the superconformal point

abstract: We study the quantum Seiberg-Witten periods of ${\cal N}=2$ superconformal field theories which are obtained by taking the scaling limit of ${\cal N}=2$ $SU(N_c)$ SQCD around the superconformal fixed point. The quantum Seiberg-Witten curves of these superconformal field theories are shown to be classified into the Schr\"odinger type and the SQCD type, which depend on flavor symmetry at the fixed point. We study the quantum periods and compute the differential operators which relate the quantum periods to the classical ones up to the fourth-order in the deformation parameter.


title: Variable stars in the Sh 2-170 HII region

abstract: We present multi-epoch deep ($\sim$20 mag) $I_{c}$~band photometric monitoring of the Sh 2-170 star-forming region to understand the variability properties of pre-main-sequence (PMS) stars. We report identification of 47 periodic and 24 non-periodic variable stars with periods and amplitudes ranging from $\sim$4 hrs to 18 days and from $\sim$0.1 to 2.0 mag, respectively. We have further classified 49 variables as PMS stars (17 Class\,{\sc ii} and 32 Class\,{\sc iii}) and 17 as main-sequence (MS)/field star variables. A larger fraction of MS/field variables (88\%) show periodic variability as compared to the PMS variables (59\%). The ages and masses of the PMS variable stars are found to be comparable with those of T-Tauri stars. Their variability amplitudes show an increasing trend with the near-IR/mid-IR excess. The period distribution of the PMS variables shows two peaks, one near $\sim$1.5 days and the other near $\sim$4.5 days. It is found that the younger stars with thicker discs and envelopes seem to rotate slower than their older counterparts. These properties of the PMS variables support the disc-locking mechanism. Both the period and amplitude of PMS stars show decrease with increasing mass probably due to the effective dispersal of circumstellar discs in massive stars. Our results favour the notion that cool spots on weak line T-Tauri stars are responsible for most of their variations, while hot spots on classical T-Tauri stars resulting from variable mass accretion from an inner disc contribute to their larger amplitudes and irregular behaviours.


title: Character-independent font identification

abstract: There are a countless number of fonts with various shapes and styles. In addition, there are many fonts that only have subtle differences in features. Due to this, font identification is a difficult task. In this paper, we propose a method of determining if any two characters are from the same font or not. This is difficult due to the difference between fonts typically being smaller than the difference between alphabet classes. Additionally, the proposed method can be used with fonts regardless of whether they exist in the training or not. In order to accomplish this, we use a Convolutional Neural Network (CNN) trained with various font image pairs. In the experiment, the network is trained on image pairs of various fonts. We then evaluate the model on a different set of fonts that are unseen by the network. The evaluation is performed with an accuracy of 92.27%. Moreover, we analyzed the relationship between character classes and font identification accuracy.


title: Families of Multidimensional Arrays with Good Autocorrelation and Asymptotically Optimal Cross-correlation

abstract: We introduce a construction for families of 2n-dimensional arrays with asymptotically optimal pairwise cross-correlation. These arrays are constructed using a circulant array of n-dimensional Legendre arrays. We also introduce an application of these higher-dimensional arrays to high-capacity digital watermarking of images and video.


title: Small, Accurate, and Fast Vehicle Re-ID on the Edge: the SAFR Approach

abstract: We propose a Small, Accurate, and Fast Re-ID (SAFR) design for flexible vehicle re-id under a variety of compute environments such as cloud, mobile, edge, or embedded devices by only changing the re-id model backbone. Through best-fit design choices, feature extraction, training tricks, global attention, and local attention, we create a reid model design that optimizes multi-dimensionally along model size, speed, & accuracy for deployment under various memory and compute constraints. We present several variations of our flexible SAFR model: SAFR-Large for cloud-type environments with large compute resources, SAFR-Small for mobile devices with some compute constraints, and SAFR-Micro for edge devices with severe memory & compute constraints. SAFR-Large delivers state-of-the-art results with mAP 81.34 on the VeRi-776 vehicle re-id dataset (15% better than related work). SAFR-Small trades a 5.2% drop in performance (mAP 77.14 on VeRi-776) for over 60% model compression and 150% speedup. SAFR-Micro, at only 6MB and 130MFLOPS, trades 6.8% drop in accuracy (mAP 75.80 on VeRi-776) for 95% compression and 33x speedup compared to SAFR-Large.


title: Compressing Language Models using Doped Kronecker Products

abstract: Kronecker Products (KP) have been used to compress IoT RNN Applications by 15-38x compression factors, achieving better results than traditional compression methods. However when KP is applied to large Natural Language Processing tasks, it leads to significant accuracy loss (approx 26%). This paper proposes a way to recover accuracy otherwise lost when applying KP to large NLP tasks, by allowing additional degrees of freedom in the KP matrix. More formally, we propose doping, a process of adding an extremely sparse overlay matrix on top of the pre-defined KP structure. We call this compression method doped kronecker product compression. To train these models, we present a new solution to the phenomenon of co-matrix adaption (CMA), which uses a new regularization scheme called co matrix dropout regularization (CMR). We present experimental results that demonstrate compression of a large language model with LSTM layers of size 25 MB by 25x with 1.4% loss in perplexity score. At 25x compression, an equivalent pruned network leads to 7.9% loss in perplexity score, while HMD and LMF lead to 15% and 27% loss in perplexity score respectively.


title: On the Injection of Relativistic Electrons in the Jet of 3C 279

abstract: The acceleration of electrons in 3C 279 is investigated through analyzing the injected electron energy distribution (EED) in a time-dependent synchrotron self-Compton + external Compton emission model. In this model, it is assumed that relativistic electrons are continuously injected into the emission region, and the injected EED [$Q_e^\prime(\gamma^\prime)$] follows a single power-law form with low- and high-energy cutoffs $\rm \gamma_{min}'$ and $\rm \gamma_{max}'$, respectively, and the spectral index $n$, i.e, $Q_e^\prime(\gamma^\prime)\propto\gamma^{\prime-n}$. This model is applied to 14 quasi-simultaneous spectral energy distributions (SEDs) of 3C 279. The Markov Chain Monte Carlo fitting technique is performed to obtain the best-fitting parameters and the uncertainties on the parameters. The results show that the injected EED is well constrained in each state. The value of $n$ is in the range of 2.5 to 3.8, which is larger than that expected by the classic non-relativistic shock acceleration. However, the large value of $n$ can be explained by the relativistic oblique shock acceleration. The flaring activity seems to be related to an increased acceleration efficiency, reflected in an increased $\gamma'_{\rm min}$ and electron injection power.


title: Resonances in Exotic $^7$He Nucleus within the No-Core Shell Model

abstract: We present results of calculations of $n{-}{^6\rm He}$ elastic scattering phase shifts and resonances in ${^7\rm He}$. The calculations utilize the SS-HORSE method combined with ab initio no-core shell model calculations of the ${^7\rm He}$ and ${^6\rm He}$ nuclei with Daejeon16 and the JISP16 $NN$ interactions.


title: Compiling Crossing-free Geometric Graphs with Connectivity Constraint for Fast Enumeration, Random Sampling, and Optimization

abstract: Given $n$ points in the plane, we propose algorithms to compile connected crossing-free geometric graphs into directed acyclic graphs (DAGs). The DAGs allow efficient counting, enumeration, random sampling, and optimization. Our algorithms rely on Wettstein's framework to compile several crossing-free geometric graphs. One of the remarkable contributions of Wettstein is to allow dealing with geometric graphs with connectivity, since it is known to be difficult to efficiently represent geometric graphs with such global property. To achieve this, Wettstein proposed specialized techniques for crossing-free spanning trees and crossing-free spanning cycles and invented compiling algorithms running in $\mathrm{O}(7.044^n)$ time and $\mathrm{O}(5.619^n)$ time, respectively. Our first contribution is to propose a technique to deal with the connectivity constraint more simply and efficiently. It makes the design and analysis of algorithms easier, and yields improved time complexity. Our algorithms achieve $\mathrm{O}(6^n)$ time and $\mathrm{O}(4^n)$ time for compiling crossing-free spanning trees and crossing-free spanning cycles, respectively. As the second contribution, we propose an algorithm to optimize the area surrounded by crossing-free spanning cycles. To achieve this, we modify the DAG so that it has additional information. Our algorithm runs in $\mathrm{O}(4.829^n)$ time to find an area-minimized (or maximized) crossing-free spanning cycle of a given point set. Although the problem was shown to be NP-complete in 2000, as far as we know, there were no known algorithms faster than the obvious $\mathrm{O}(n!)$ time algorithm for 20 years.


title: The relationship between X-ray and optical absorbers in active galactic nuclei

abstract: We present a large compilation of reddening estimates from broad-line Balmer decrements for active galactic nuclei (AGNs) with measured X-ray column densities. The median reddening is E(B-V) ~ 0.77 +/- 0.10 for type-1 to type-1.9 AGNs with reported column densities. This is notably higher than the median reddening of AGNs from the SDSS. We attribute this to the selection bias of the SDSS towards blue AGNs. For other AGNs we find evidence of a publication bias against reporting low column densities. We find a significant correlation between N_H and E(B-V) but with a large scatter of +/- 1 dex (without accounting for uncertainties in measurements). On average the X-ray columns are consistent with those predicted from E(B-V) for a solar neighbourhood dust-to-gas ratio. We argue that the large scatter of column densities and reddenings can be explained by X-ray column-density variability. For AGNs with detectable broad-line regions (BLRs) that have undergone significant changes of Seyfert type (changing-look AGNs) we do not find any statistically significant differences in N_H or E(B-V) compared to standard type-1 to type-1.9 AGNs. There is no evidence for any type-1 AGNs being Compton-thick. We also analyze type-2 AGNs and find no significant correlation between N_H and narrow-line region reddening. The median column density of LINERs is 22.68 +/- 0.75 compared to a column density of 22.90 +/- 0.28 for type-2s. We find the majority of low column density type-2s are LINERs, but N_H is probably underestimated because of scattered X-ray light diluting the photoelectric edge.


title: K-resolver: Towards Decentralizing Encrypted DNS Resolution

abstract: Centralized DNS over HTTPS/TLS (DoH/DoT) resolution, which has started being deployed by major hosting providers and web browsers, has sparked controversy among Internet activists and privacy advocates due to several privacy concerns. This design decision causes the trace of all DNS resolutions to be exposed to a third-party resolver, different than the one specified by the user's access network. In this work we propose K-resolver, a DNS resolution mechanism that disperses DNS queries across multiple DoH resolvers, reducing the amount of information about a user's browsing activity exposed to each individual resolver. As a result, none of the resolvers can learn a user's entire web browsing history. We have implemented a prototype of our approach for Mozilla Firefox, and used it to evaluate the performance of web page load time compared to the default centralized DoH approach. While our K-resolver mechanism has some effect on DNS resolution time and web page load time, we show that this is mainly due to the geographical location of the selected DoH servers. When more well-provisioned anycast servers are available, our approach incurs negligible overhead while improving user privacy.


title: Distance problems for dissipative Hamiltonian systems and related matrix polynomials

abstract: We study the characterization of several distance problems for linear differential-algebraic systems with dissipative Hamiltonian structure. Since all models are only approximations of reality and data are always inaccurate, it is an important question whether a given model is close to a 'bad' model that could be considered as ill-posed or singular. This is usually done by computing a distance to the nearest model with such properties. We will discuss the distance to singularity and the distance to the nearest high index problem for dissipative Hamiltonian systems. While for general unstructured differential-algebraic systems the characterization of these distances are partially open problems, we will show that for dissipative Hamiltonian systems and related matrix polynomials there exist explicit characterizations that can be implemented numerically.


title: Runtime Performances of Randomized Search Heuristics for the Dynamic Weighted Vertex Cover Problem

abstract: Randomized search heuristics such as evolutionary algorithms are frequently applied to dynamic combinatorial optimization problems. Within this paper, we present a dynamic model of the classic Weighted Vertex Cover problem and analyze the runtime performances of the well-studied algorithms Randomized Local Search and (1+1) EA adapted to it, to contribute to the theoretical understanding of evolutionary computing for problems with dynamic changes. In our investigations, we use an edge-based representation based on the dual form of the Linear Programming formulation for the problem and study the expected runtime that the adapted algorithms require to maintain a 2-approximate solution when the given weighted graph is modified by an edge-editing or weight-editing operation. Considering the weights on the vertices may be exponentially large with respect to the size of the graph, the step size adaption strategy is incorporated, with or without the 1/5-th rule that is employed to control the increasing/decreasing rate of the step size. Our results show that three of the four algorithms presented in the paper can recompute 2-approximate solutions for the studied dynamic changes in polynomial expected runtime, but the (1+1) EA with 1/5-th Rule requires pseudo-polynomial expected runtime.


title: MT-BioNER: Multi-task Learning for Biomedical Named Entity Recognition using Deep Bidirectional Transformers

abstract: Conversational agents such as Cortana, Alexa and Siri are continuously working on increasing their capabilities by adding new domains. The support of a new domain includes the design and development of a number of NLU components for domain classification, intents classification and slots tagging (including named entity recognition). Each component only performs well when trained on a large amount of labeled data. Second, these components are deployed on limited-memory devices which requires some model compression. Third, for some domains such as the health domain, it is hard to find a single training data set that covers all the required slot types. To overcome these mentioned problems, we present a multi-task transformer-based neural architecture for slot tagging. We consider the training of a slot tagger using multiple data sets covering different slot types as a multi-task learning problem. The experimental results on the biomedical domain have shown that the proposed approach outperforms the previous state-of-the-art systems for slot tagging on the different benchmark biomedical datasets in terms of (time and memory) efficiency and effectiveness. The output slot tagger can be used by the conversational agent to better identify entities in the input utterances.


title: Every finite abelian group is a subgroup of the additive group of a finite simple left brace

abstract: Left braces, introduced by Rump, have turned out to provide an important tool in the study of set theoretic solutions of the quantum Yang-Baxter equation. In particular, they have allowed to construct several new families of solutions. A left brace $(B,+,\cdot )$ is a structure determined by two group structures on a set $B$: an abelian group $(B,+)$ and a group $(B,\cdot)$, satisfying certain compatibility conditions. The main result of this paper shows that every finite abelian group $A$ is a subgroup of the additive group of a finite simple left brace $B$ with metabelian multiplicative group with abelian Sylow subgroups. This result complements earlier unexpected results of the authors on an abundance of finite simple left braces.


title: Pricing commodity swing options

abstract: In commodity and energy markets swing options allow the buyer to hedge against futures price fluctuations and to select its preferred delivery strategy within daily or periodic constraints, possibly fixed by observing quoted futures contracts. In this paper we focus on the natural gas market and we present a dynamical model for commodity futures prices able to calibrate liquid market quotes and to imply the volatility smile for futures contracts with different delivery periods. We implement the numerical problem by means of a least-square Monte Carlo simulation and we investigate alternative approaches based on reinforcement learning algorithms.


title: Weights of Semiregular Nilpotents in Simple Lie Algebras of D Type

abstract: We compute the weights of the adjoint action of semiregular $sl_2$-triples in simple Lie algebras of type $D_n$ using mathematical induction.


title: From latent ferroelectricity to hyperferroelectricity in alkali lead halide perovskites

abstract: Using first principles calculations we show that several alkali lead halides potentially present collective ferroelectric polarization. This should occur at least at the nanoscale; it could be detected macroscopically provided it is not concealed by lattice vibrations in the temperature range of stability of the cubic perovskite phase. For potassium lead halides and for alkali lead fluorides, remarkably, the ferroelectric behavior turns hyper-ferroelectric, suggesting a more robust ferroelectric polarization in spite of depolarization potentials induced by charge accumulation on surfaces or interfaces.


title: Intelligent Reflecting Surface-Assisted Multiple Access with User Pairing: NOMA or OMA?

abstract: The integration of intelligent reflecting surface (IRS) to multiple access networks is a cost-effective solution for boosting spectrum/energy efficiency and enlarging network coverage/connections. However, due to the new capability of IRS in reconfiguring the wireless propagation channels, it is fundamentally unknown which multiple access scheme is superior in the IRS-assisted wireless network. In this letter, we pursue a theoretical performance comparison between non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA) in the IRS-assisted downlink communication, for which the transmit power minimization problems are formulated under the discrete unit-modulus reflection constraint on each IRS element. We analyze the minimum transmit powers required by different multiple access schemes and compare them numerically, which turn out to not fully comply with the stereotyped superiority of NOMA over OMA in conventional systems without IRS. Moreover, to avoid the exponential complexity of the brute-force search for the optimal discrete IRS phase shifts, we propose a low-complexity solution to achieve near-optimal performance.


title: Projected sensitivity to sub-GeV dark matter of next-generation semiconductor detectors

abstract: We compute the projected sensitivity to dark matter (DM) particles in the sub-GeV mass range of future direct detection experiments using germanium and silicon semiconductor targets. We perform this calculation within the dark photon model for DM-electron interactions using the likelihood ratio as a test statistic, Monte Carlo simulations, and background models that we extract from recent experimental data. We present our results in terms of DM-electron scattering cross section values required to reject the background only hypothesis in favour of the background plus DM signal hypothesis with a statistical significance, $\mathcal{Z}$, corresponding to 3 or 5 standard deviations. We also test the stability of our conclusions under changes in the astrophysical parameters governing the local space and velocity distribution of DM in the Milky Way. In the best-case scenario, when a high-voltage germanium detector with an exposure of $50$ kg-year and a CCD silicon detector with an exposure of $1$ kg-year and a dark current rate of $1\times10^{-7}$ counts/pixel/day have simultaneously reported a DM signal, we find that the smallest cross section value compatible with $\mathcal{Z}=3$ ($\mathcal{Z}=5$) is about $8\times10^{-42}$ cm$^2$ ($1\times10^{-41}$ cm$^2$) for contact interactions, and $4\times10^{-41}$ cm$^2$ ($7\times10^{-41}$ cm$^2$) for long-range interactions. Our sensitivity study extends and refine previous works in terms of background models, statistical methods, and treatment of the underlying astrophysical uncertainties.


title: Refined model of the covariance/correlation matrix between securities

abstract: A new methodology has been introduced to clean the correlation matrix of single stocks returns based on a constrained principal component analysis using financial data. Portfolios were introduced, namely "Fundamental Maximum Variance Portfolios", to capture in an optimal way the risks defined by financial criteria ("Book", "Capitalization", etc.). The constrained eigenvectors of the correlation matrix, which are the linear combination of these portfolios, are then analyzed. Thanks to this methodology, several stylized patterns of the matrix were identified: i) the increase of the first eigenvalue with a time scale from 1 minute to several months seems to follow the same law for all the significant eigenvalues with 2 regimes; ii) a universal law seems to govern the weights of all the "Maximum variance" portfolios, so according to that law, the optimal weights should be proportional to the ranking based on the financial studied criteria; iii) the volatility of the volatility of the "Maximum Variance" portfolios, which are not orthogonal, could be enough to explain a large part of the diffusion of the correlation matrix; iv) the leverage effect (increase of the first eigenvalue with the decline of the stock market) occurs only for the first mode and cannot be generalized for other factors of risk. The leverage effect on the beta, which is the sensitivity of stocks with the market mode, makes variable the weights of the first eigenvector.


title: Flexible models for overdispersed and underdispersed count data

abstract: Within the framework of probability models for overdispersed count data, we propose the generalized fractional Poisson distribution (gfPd), which is a natural generalization of the fractional Poisson distribution (fPd), and the standard Poisson distribution. We derive some properties of gfPd and more specifically we study moments, limiting behavior and other features of fPd. The skewness suggests that fPd can be left-skewed, right-skewed or symmetric; this makes the model flexible and appealing in practice. We apply the model to real big count data and estimate the model parameters using maximum likelihood. Then, we turn to the very general class of weighted Poisson distributions (WPD's) to allow both overdispersion and underdispersion. Similarly to Kemp's generalized hypergeometric probability distribution, which is based on hypergeometric functions, we analyze a class of WPD's related to a generalization of Mittag--Leffler functions. The proposed class of distributions includes the well-known COM-Poisson and the hyper-Poisson models. We characterize conditions on the parameters allowing for overdispersion and underdispersion, and analyze two special cases of interest which have not yet appeared in the literature.


title: First-principle calculation of Chern number in gyrotropic photonic crystals

abstract: As an important figure of merit for characterizing the quantized collective behaviors of the wavefunction, Chern number is the topological invariant of quantum Hall insulators. Chern number also identifies the topological properties of the photonic topological insulators (PTIs), thus it is of crucial importance in PTI design. In this paper, we develop a first principle computatioal method for the Chern number of 2D gyrotropic photonic crystals (PCs), starting from the Maxwell's equations. Firstly, we solve the Hermitian generalized eigenvalue equation reformulated from the Maxwell's equations by using the full-wave finite-difference frequency-domain (FDFD) method. Then the Chern number is obtained by calculating the integral of Berry curvature over the first Brillouin zone. Numerical examples of both transverse-electric (TE) and transverse-magnetic (TM) modes are demonstrated, where convergent Chern numbers can be obtained using rather coarse grids, thus validating the efficiency and accuracy of the proposed method.


title: Controlling interlayer excitons in MoS2 layers grown by chemical vapor deposition

abstract: Combining MoS$_2$ monolayers to form multilayers allows to access new functionalities. In this work, we examine the correlation between the stacking order and the interlayer coupling of valence states in MoS$_2$ homobilayer samples grown by chemical vapor deposition (CVD) and artificially stacked bilayers from CVD monolayers. We show that hole delocalization over the bilayer is allowed in 2H stacking and results in strong interlayer exciton absorption and also in a larger A-B exciton separation as compared to 3R bilayers, where both holes and electrons are confined to the individual layers. Comparing 2H and 3R reflectivity spectra allows to extract an interlayer coupling energy of about $t_\perp=49$ meV. Obtaining very similar results for as-grown and artificially stacked bilayers is promising for assembling large area van der Waals structures with CVD material, using interlayer exciton absorption and A-B exciton separation as indicators for interlayer coupling. Beyond DFT calculations including excitonic effects confirm signatures of efficient interlayer coupling for 2H stacking in agreement with our experiments.


title: Permutations of N generated by left-right filling algorithms

abstract: We give an in depth analysis of an algorithm that generates permutations of the natural numbers introduced by Clark Kimberling in the On Line Encyclopedia of Integer Sequences. It turns out that the examples of such permutations in OEIS are completely determined by 3-automatic sequences.


title: Normal-normal resonances in a double Hopf bifurcation

abstract: We investigate the stability loss of invariant n-dimensional quasi-periodic tori during a double Hopf bifurcation, where at bifurcation the two normal frequencies are in normal-normal resonance. Invariants are used to analyse the normal form approximations in a unified manner. The corresponding dynamics form a skeleton for the dynamics of the original system. Here both normal hyperbolicity and KAM theory are being used.


title: Measurability of nonequilibrium thermodynamics in terms of the Hamiltonian of mean force

abstract: The nonequilibrium thermodynamics of an open (classical or quantum) system in strong contact with a single heat bath can be conveniently described in terms of the Hamiltonian of mean force. However, the conventional formulation is limited by the necessity to measure differences in equilibrium properties of the system-bath composite. We make use of the freedom involved in defining thermodynamic quantities, which leaves the thermodynamics unchanged, to show that the Hamiltonian of mean force can be inferred from measurements on the system alone, up to that irrelevant freedom. In doing so, we refute a key criticism expressed in Phys. Rev. E 94, 022143 and arXiv:1911.11660. We also discuss the remaining part of the criticism.


title: Efficient molecule discrimination in electron microcopy through an optimized orbital angular momentum sorter

abstract: We consider the problem of discriminating macromolecular structures in an electron microscope, through a specific beam shaping technique. Our approach is based on maximizing the which-molecule information extracted from the state of each electron. To this aim, the optimal observables are derived within the framework of quantum state discrimination, which allows one to fully account from the quantum character of the probe. We simulate the implementation of such optimal observable on a generalized orbital angular momentum (OAM) sorter and benchmark its performance against the best known real space approach.


title: Homogenization of ferromagnetic energies on Poisson random sets in the plane

abstract: We prove that by scaling nearest-neighbour ferromagnetic energies defined on Poisson random sets in the plane we obtain an isotropic perimeter energy with a surface tension characterised by an asymptotic formula. The result relies on proving that cells with `very long' or `very short' edges of the corresponding Voronoi tessellation can be neglected. In this way we may apply Geometry Measure Theory tools to define a compact convergence, and a characterisation of metric properties of clusters of Voronoi cells using limit theorems for subadditive processes.


title: G279.0+1.1: a new extended source of high-energy gamma rays

abstract: G279.0+1.1 is a supernova remnant (SNR) with poorly known parameters, first detected as a dim radio source and classified as an evolved system. An analysis of data from the Fermi-LAT revealing for the first time an extended source of gamma rays in the region is presented. The diameter of the GeV region found is ~2.8$^{\circ}$, larger than the latest estimate of the SNR size from radio data. The gamma-ray emission covers most of the known shell and extends further to the north and east of the bulk of the radio emission. The photon spectrum in the 0.5--500 GeV range can be described by a simple power law, $\frac{dN}{dE} \propto E^{-\Gamma}$, with a spectral index of $\Gamma = 1.86\pm 0.03_{stat} \pm 0.06_{sys}$. In the leptonic scenario, a steep particle spectrum is required and a distance lower than the previously estimated value of 3 kpc is favored. The possibility that the high-energy emission results from electrons that already escaped the SNR is also investigated. A hadronic scenario for the gamma rays yields a particle spectral index of $\sim2.0$ and no significant constraints on the distance. The production of gamma rays in old SNRs is discussed. More observations of this source are encouraged to probe the true extent of the shell and its age.


title: Floquet topological phase of nondriven $p$-wave nonequilibrium excitonic insulators

abstract: The nontrivial topology of {\it p}-wave superfluids make these systems attractive candidate in information technology. In this work we report on the topological state of a {\it p}-wave nonequilibrium excitonic insulator (NEQ-EI) and show how to steer a nontopological band-insulator with bright $p$-excitons toward this state by a suitable laser pulse, thus achieving a dynamical topological phase transition. The underlying mechanism behind the transition is the broken gauge-symmetry of the NEQ-EI which causes self-sustained persistent oscillations of the excitonic condensate and hence a Floquet topological state for high enough exciton densities. We show the formation of Floquet Majorana modes at the boundaries of the open system and discuss topological spectral signatures for ARPES experiments. We emphasize that the topological properties of a {\it p}-wave NEQ-EI arise exclusively from the electron-hole Coulomb interaction as the system is not driven by external fields.


title: RePAD: Real-time Proactive Anomaly Detection for Time Series

abstract: During the past decade, many anomaly detection approaches have been introduced in different fields such as network monitoring, fraud detection, and intrusion detection. However, they require understanding of data pattern and often need a long off-line period to build a model or network for the target data. Providing real-time and proactive anomaly detection for streaming time series without human intervention and domain knowledge is highly valuable since it greatly reduces human effort and enables appropriate countermeasures to be undertaken before a disastrous damage, failure, or other harmful event occurs. However, this issue has not been well studied yet. To address it, this paper proposes RePAD, which is a Real-time Proactive Anomaly Detection algorithm for streaming time series based on Long Short-Term Memory (LSTM). RePAD utilizes short-term historic data points to predict and determine whether or not the upcoming data point is a sign that an anomaly is likely to happen in the near future. By dynamically adjusting the detection threshold over time, RePAD is able to tolerate minor pattern change in time series and detect anomalies either proactively or on time. Experiments based on two time series datasets collected from the Numenta Anomaly Benchmark demonstrate that RePAD is able to proactively detect anomalies and provide early warnings in real time without human intervention and domain knowledge.


title: On accumulation points of $F$-pure thresholds on regular local rings

abstract: Blickle, Musta\c{t}\u{a} and Smith proposed two conjectures on the limits of $F$-pure thresholds. One conjecture asks whether or not the limit of a sequence of $F$-pure thresholds of principal ideals on regular local rings of fixed dimension can be written as an $F$-pure threshold in lower dimension. Another conjecture predicts that any $F$-pure threshold of a formal power series can be written as the $F$-pure threshold of a polynomial. In this paper, we prove that the first conjecture has a counterexample but a weaker statement still holds. We also give a partial affirmative answer to the second conjecture.


title: Radiomics and artificial intelligence analysis of CT data for the identification of prognostic features in multiple myeloma

abstract: Multiple Myeloma (MM) is a blood cancer implying bone marrow involvement, renal damages and osteolytic lesions. The skeleton involvement of MM is at the core of the present paper, exploiting radiomics and artificial intelligence to identify image-based biomarkers for MM. Preliminary results show that MM is associated to an extension of the intrabone volume for the whole body and that machine learning can identify CT image features mostly correlating with the disease evolution. This computational approach allows an automatic stratification of MM patients relying of these biomarkers and the formulation of a prognostic procedure for determining the disease follow-up.


title: Three-dimensional electronic structure in ferromagnetic $\textrm{Fe}_3\textrm{Sn}_2$ with breathing kagome bilayers

abstract: A large anomalous Hall effect (AHE) has been observed in ferromagnetic $\textrm{Fe}_3\textrm{Sn}_2$ with breathing kagome bilayers. To understand the underlying mechanism for this, we investigate the electronic structure of $\textrm{Fe}_3\textrm{Sn}_2$ by angle-resolved photoemission spectroscopy (ARPES). In particular, we use both vacuum ultraviolet light (VUV) and soft x ray (SX), which allow surface-sensitive and relatively bulk-sensitive measurements, respectively, and distinguish bulk states from surface states, which should be unlikely related to the AHE. While VUV-ARPES observes two-dimensional bands mostly due to surface states, SX-ARPES reveals three-dimensional band dispersions with a periodicity of the rhombohedral unit cell in the bulk. Our data show a good consistency with a theoretical calculation based on density functional theory, suggesting a possibility that $\textrm{Fe}_3\textrm{Sn}_2$ is a magnetic Weyl semimetal.


title: Big Data based Research on Mechanisms of Sharing Economy Restructuring the World

abstract: Many researches have discussed the phenomenon and definition of sharing economy, but an understanding of sharing economy's reconstructions of the world remains elusive. We illustrate the mechanism of sharing economy's reconstructions of the world in detail based on big data including the mechanism of sharing economy's reconstructions of society, time and space, users, industry, and self-reconstruction in the future, which is very important for society to make full use of the reconstruction opportunity to upgrade our world through sharing economy. On the one hand, we established the mechanisms for sharing economy rebuilding society, industry, space-time, and users through qualitative analyses, and on the other hand, we demonstrated the rationality of the mechanisms through quantitative analyses of big data.


title: The Impact of Content Commenting on User Continuance in Online Q&A Communities: An Affordance Perspective

abstract: Online question-and-answer (Q&A) communities provide convenient and innovative ways for participants to share information and collaboratively solve problems with others. A growing challenge for those Q&A communities is to encourage and maintain ongoing user participation. From the perspective of motivational affordances, this study proposes a research framework to explain the effect of content commenting on user continuance behavior in online Q&A communities. The moderating role of participant's tenure in the relationship between content commenting and user continuance is also explored. Using a longitudinal panel dataset collected from a large online Q&A community, this research empirically tests the effect of content commenting on continued user participation in the Q&A community. The results show that both comment receipt and comment provisioning are important motivating factors for user continuance in the community. Specifically, received comments on questions submitted by a participant have a positive effect on the participant's continuance of posting questions, while answer comments both received and posted by a participant have positive impact on user continuance of posting answers in the community. In addition, tenure in the community is indeed found to have a significant negative moderating effect on the relationship between content commenting and user continuance. This research not only offers a more nuanced theoretical understanding of how content commenting affects continued user involvement and how participants' tenure in the community moderates the impact of content commenting, but also provides implications for improving user continuance in online Q&A communities.


title: On the Performance of Metaheuristics: A Different Perspective

abstract: Nowadays, we are immersed in tens of newly-proposed evolutionary and swam-intelligence metaheuristics, which makes it very difficult to choose a proper one to be applied on a specific optimization problem at hand. On the other hand, most of these metaheuristics are nothing but slightly modified variants of the basic metaheuristics. For example, Differential Evolution (DE) or Shuffled Frog Leaping (SFL) are just Genetic Algorithms (GA) with a specialized operator or an extra local search, respectively. Therefore, what comes to the mind is whether the behavior of such newly-proposed metaheuristics can be investigated on the basis of studying the specifications and characteristics of their ancestors. In this paper, a comprehensive evaluation study on some basic metaheuristics i.e. Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Artificial Bee Colony (ABC), Teaching-Learning-Based Optimization (TLBO), and Cuckoo Optimization algorithm (COA) is conducted, which give us a deeper insight into the performance of them so that we will be able to better estimate the performance and applicability of all other variations originated from them. A large number of experiments have been conducted on 20 different combinatorial optimization benchmark functions with different characteristics, and the results reveal to us some fundamental conclusions besides the following ranking order among these metaheuristics, {ABC, PSO, TLBO, GA, COA} i.e. ABC and COA are the best and the worst methods from the performance point of view, respectively. In addition, from the convergence perspective, PSO and ABC have significant better convergence for unimodal and multimodal functions, respectively, while GA and COA have premature convergence to local optima in many cases needing alternative mutation mechanisms to enhance diversification and global search.


title: Jumptime unraveling of Markovian open quantum systems

abstract: We introduce jumptime unraveling as a distinct description of open quantum systems. As our starting point, we consider quantum jump trajectories, which emerge, physically, from continuous quantum measurements, or, formally, from the unraveling of Markovian quantum master equations. If the stochastically evolving quantum trajectories are ensemble-averaged at specific times, the resulting quantum states are solutions to the associated quantum master equation. We demonstrate that quantum trajectories can also be ensemble-averaged at specific jump counts. The resulting jumptime-averaged quantum states are then solutions to a discrete, deterministic evolution equation, with time replaced by the jump count. This jumptime evolution represents a trace-preserving quantum dynamical map if and only if the associated open system does not exhibit dark states. In the presence of dark states, on the other hand, jumptime-averaged states may decay into the dark states and the jumptime evolution may eventually terminate. Jumptime-averaged quantum states and the associated jumptime evolution are operationally accessible in continuous measurement schemes, when quantum jumps are detected and used to trigger the readout measurements. We illustrate the jumptime evolution with the examples of a two-level system undergoing relaxation or dephasing, a damped harmonic oscillator, and a free particle exposed to collisional decoherence.


title: Machine Understandable Policies and GDPR Compliance Checking

abstract: The European General Data Protection Regulation (GDPR) calls for technical and organizational measures to support its implementation. Towards this end, the SPECIAL H2020 project aims to provide a set of tools that can be used by data controllers and processors to automatically check if personal data processing and sharing complies with the obligations set forth in the GDPR. The primary contributions of the project include: (i) a policy language that can be used to express consent, business policies, and regulatory obligations; and (ii) two different approaches to automated compliance checking that can be used to demonstrate that data processing performed by data controllers / processors complies with consent provided by data subjects, and business processes comply with regulatory obligations set forth in the GDPR.


title: Distribution of missing differences in diffsets

abstract: Lazarev, Miller and O'Bryant investigated the distribution of $|S+S|$ for $S$ chosen uniformly at random from $\{0, 1, \dots, n-1\}$, and proved the existence of a divot at missing 7 sums (the probability of missing exactly 7 sums is less than missing 6 or missing 8 sums). We study related questions for $|S-S|$, and shows some divots from one end of the probability distribution, $P(|S-S|=k)$, as well as a peak at $k=4$ from the other end, $P(2n-1-|S-S|=k)$. A corollary of our results is an asymptotic bound for the number of complete rulers of length $n$.


title: On the enhanced power graph of a group

abstract: The enhanced power graph $\mathcal{P}_e(G)$ of a group $G$ is a graph with vertex set $G$ and two vertices are adjacent if they belong to the same cyclic subgroup. In this paper, we consider the minimum degree, independence number and matching number of enhanced power graphs of finite groups. We first study these graph invariants for $\mathcal{P}_e(G)$ when $G$ is any finite group, and then determine them when $G$ is a finite abelian $p$-group, $U_{6n} = \langle a, b : a^{2n} = b^3 = e, ba =ab^{-1} \rangle$, the dihedral group $D_{2n}$, or the semidihedral group $SD_{8n}$. If $G$ is any of these groups, we prove that $\mathcal{P}_e(G)$ is perfect and then obtain its strong metric dimension. Additionally, we give an expression for the independence number of $\mathcal{P}_e(G)$ for any finite abelian group $G$. These results along with certain known equalities yield the edge connectivity, vertex covering number and edge covering number of enhanced power graphs of the respective groups as well.


title: Adaptive hard and tough mechanical response in single-crystal B1 VNx ceramics via control of anion vacancies

abstract: High hardness and toughness are generally considered mutually exclusive properties for single-crystal ceramics. Combining experiments and ab initio molecular dynamics (AIMD) atomistic simulations at room temperature, we demonstrate that both the hardness and toughness of single-crystal NaCl-structure VNx/MgO(001) thin films are simultaneously enhanced through the incorporation of anion vacancies. Nanoindentation results show that VN0.8, here considered as representative understoichiometric VNx system, is ~20% harder, as well as more resistant to fracture than stoichiometric VN samples. AIMD modeling of VN and VN0.8 supercells subjected to [001] and [110] elongation reveal that the tensile strengths of the two materials are similar. Nevertheless, while the stoichiometric VN phase systematically cleaves in a brittle manner at tensile yield points, the understoichiometric compound activates transformation-toughening mechanisms that dissipate accumulated stresses. AIMD simulations also show that VN0.8 exhibits an initially greater resistance to both {110}<1-10> and {111}<1-10> shear deformation than VN. However, for progressively increasing shear strains, the VN0.8 mechanical behavior gradually evolves from harder to more ductile than VN. The transition is mediated by anion vacancies, which facilitate {110}<1-10> and {111}<1-10> lattice slip by reducing activation shear stresses by as much as 35%. Electronic-structure analyses show that the two-regime hard/tough mechanical response of VN0.8 primarily stems from its intrinsic ability to transfer d electrons between 2nd-neighbor and 4th-neighbor (i.e., across vacancy sites) V-V metallic states. Our work offers a route for electronic-structure design of hard materials in which a plastic mechanical response is triggered with loading.


title: Study of space charge in the ICARUS T600 detector

abstract: The accumulation of positive ions, produced by ionizing particles crossing Liquid Argon Time Projection Chambers (LAr-TPCs), may generate distortions of the electric drift field affecting the track reconstruction of the ionizing events. These effects could become relevant for large LAr-TPCs operating at surface or at shallow depth, where the detectors are exposed to a copious flux of cosmic rays. A detailed study of such possible field distortions in the ICARUS T600 LAr-TPC has been performed analyzing a sample of cosmic muon tracks recorded with one T600 module operated at surface in 2001. The maximum track distortion turns out to be of few mm in good agreement with the prediction by a numerical calculation. As a cross-check, the same analysis has been performed on a cosmic muon sample recorded during the ICARUS T600 run at the LNGS underground laboratory, where the cosmic ray flux was suppressed by a factor $\sim 10^6$ by 3400 m water equivalent shielding. No appreciable distortion has been observed, confirming that the effects measured on surface are actually due to ion space charge.


title: Social Cost of Carbon: What Do the Numbers Really Mean?

abstract: Social cost of carbon (SCC) is estimated by integrated assessment models (IAM) and is widely used by government agencies to value climate policy impacts. While there is an ongoing debate about obtained numerical estimates and related uncertainties, little attention has been paid so far to the SCC calculation method itself. This work attempts to fill the gap by providing theoretical background and economic interpretation of the SCC calculation approach implemented in the open-source IAM DICE (Dynamic Integrated model of Climate and the Economy). Our analysis indicates that the present calculation method provides an approximation that might work pretty well in some cases, while in the other cases the estimated value substantially (by the factor of four) deviates from the "true" value. This deviation stems from the inability of the present calculation method to catch the linkages between two key IAM's components -- complex interconnected systems -- climate and economy, both influenced by emission abatement policies. Within the modeling framework of DICE, the presently estimated SCC valuates policy-uncontrolled emissions against economically unjustified consumption, which makes it irrelevant for application in climate-economic policies and, therefore, calls for a replacement by a more appropriate indicator. An apparent SCC alternative, which can be employed for policy formulation is the direct output of the DICE model -- the socially optimal marginal abatement cost (SMAC), which corresponds to technological possibilities at optimal level of carbon emissions abatement. In policy making, because of the previously employed implicit approximation, great attention needs to be paid to the use of SCC estimates obtained earlier.


title: Clustering Methods Assessment for Investment in Zero Emission Neighborhoods Energy System

abstract: This paper investigates the use of clustering in the context of designing the energy system of Zero Emission Neighborhoods (ZEN). ZENs are neighborhoods who aim to have net zero emissions during their lifetime. While previous work has used and studied clustering for designing the energy system of neighborhoods, no article dealt with neighborhoods such as ZEN, which have high requirements for the solar irradiance time series, include a CO2 factor time series and have a zero emission balance limiting the possibilities. To this end several methods are used and their results compared. The results are on the one hand the performances of the clustering itself and on the other hand, the performances of each method in the optimization model where the data is used. Various aspects related to the clustering methods are tested. The different aspects studied are: the goal (clustering to obtain days or hours), the algorithm (k-means or k-medoids), the normalization method (based on the standard deviation or range of values) and the use of heuristic. The results highlight that k-means offers better results than k-medoids and that k-means was systematically underestimating the objective value while k-medoids was constantly overestimating it. When the choice between clustering days and hours is possible, it appears that clustering days offers the best precision and solving time. The choice depends on the formulation used for the optimization model and the need to model seasonal storage. The choice of the normalization method has the least impact, but the range of values method show some advantages in terms of solving time. When a good representation of the solar irradiance time series is needed, a higher number of days or using hours is necessary. The choice depends on what solving time is acceptable.


title: Unveiling the Fractal Structure of Julia Sets with Lagrangian Descriptors

abstract: In this paper we explore by means of the method of Lagrangian descriptors the Julia sets arising from complex maps, and we analyze their underlying dynamics. In particular, we take a look at two classical examples: the quadratic mapping $z_{n+1} = z^2_n + c$, and the maps generated by applying Newton's method to find the roots of complex polynomials. To achieve this goal, we provide an extension of this scalar diagnostic that is capable of revealing the phase space of open maps in the complex plane, allowing us to avoid potential issues of orbits escaping to infinity at an increasing rate. The simple idea is to compute the p-norm version of Lagrangian descriptors, not for the points on the complex plane, but for their projections on the Riemann sphere in the extended complex plane. We demonstrate with several examples that this technique successfully reveals the rich and intricate dynamical features of Julia sets and their fractal structure.


title: Work function, deformation potential, and collapse of Landau levels in strained graphene and silicene

abstract: We perform a systematic {\it ab initio} study of the work function and its uniform strain dependence for graphene and silicene for both tensile and compressive strains. The Poisson ratios associated with armchair and zigzag strains are also computed. Based on these results, we obtain the deformation potential, crucial for straintronics, as a function of the applied strain. Further, we propose a particular experimental setup with a special strain configuration that generates only the electric field, while the pseudomagnetic field is absent. Then, applying a real magnetic field, one should be able to realize experimentally the spectacular phenomenon of the collapse of Landau levels in graphene or related two-dimensional materials.


title: Anisotropic magnetoresistance in spin-orbit semimetal SrIrO3

abstract: SrIrO3, the three-dimensional member of the Ruddlesden-Popper iridates, is a paramagnetic semimetal characterised by a the delicate interplay between spin-orbit coupling and Coulomb repulsion. In this work, we study the anisotropic magnetoresistance (AMR) of SrIrO3 thin films, which is closely linked to spin-orbit coupling and probes correlations between electronic transport, magnetic order and orbital states. We show that the low-temperature negative magnetoresistance is anisotropic with respect to the magnetic field orientation, and its angular dependence reveals the appearance of a fourfold symmetric component above a critical magnetic field. We show that this AMR component is of magnetocrystalline origin, and attribute the observed transition to a field-induced magnetic state in SrIrO3.


title: Axion search with a quantum-limited ferromagnetic haloscope

abstract: A ferromagnetic axion haloscope searches for Dark Matter in the form of axions by exploiting their interaction with electronic spins. It is composed of an axion-to-electromagnetic field transducer coupled to a sensitive rf detector. The former is a photon-magnon hybrid system, and the latter is based on a quantum-limited Josephson parametric amplifier. The hybrid system consists of ten 2.1 mm diameter YIG spheres coupled to a single microwave cavity mode by means of a static magnetic field. Our setup is the most sensitive rf spin-magnetometer ever realized. The minimum detectable field is $5.5\times10^{-19}\,$T with 9 h integration time, corresponding to a limit on the axion-electron coupling constant $g_{aee}\le1.7\times10^{-11}$ at 95% CL. The scientific run of our haloscope resulted in the best limit on DM-axions to electron coupling constant in a frequency span of about 120 MHz, corresponding to the axion mass range $42.4$-$43.1\,\mu$eV. This is also the first apparatus to perform an axion mass scanning by changing the static magnetic field.


title: Symmetries and periodic orbits in simple hybrid Routhian systems

abstract: Symmetries are ubiquitous in a wide range of nonlinear systems. Particularly in systems whose dynamics are determined by a Lagrangian or Hamiltonian function. For hybrid systems which possess a continuous-time dynamics determined by a Lagrangian function, with a cyclic variable, the degrees of freedom for the corresponding hybrid Lagrangian system can be reduced by means of a method known as \textit{hybrid Routhian reduction}. In this paper we study sufficient conditions for the existence of periodic orbits in hybrid Routhian systems which also exhibit time-reversal symmetry. Likewise, we explore some stability aspects of such orbits through the characterization of the eigenvalues for the corresponding linearized Poincar\'e map. Finally, we apply the results to find periodic solutions in underactuated hybrid Routhian control systems.


title: 6D Object Pose Regression via Supervised Learning on Point Clouds

abstract: This paper addresses the task of estimating the 6 degrees of freedom pose of a known 3D object from depth information represented by a point cloud. Deep features learned by convolutional neural networks from color information have been the dominant features to be used for inferring object poses, while depth information receives much less attention. However, depth information contains rich geometric information of the object shape, which is important for inferring the object pose. We use depth information represented by point clouds as the input to both deep networks and geometry-based pose refinement and use separate networks for rotation and translation regression. We argue that the axis-angle representation is a suitable rotation representation for deep learning, and use a geodesic loss function for rotation regression. Ablation studies show that these design choices outperform alternatives such as the quaternion representation and L2 loss, or regressing translation and rotation with the same network. Our simple yet effective approach clearly outperforms state-of-the-art methods on the YCB-video dataset. The implementation and trained model are avaliable at: https://github.com/GeeeG/CloudPose.


title: Active Learning for Entity Alignment

abstract: In this work, we propose a novel framework for the labeling of entity alignments in knowledge graph datasets. Different strategies to select informative instances for the human labeler build the core of our framework. We illustrate how the labeling of entity alignments is different from assigning class labels to single instances and how these differences affect the labeling efficiency. Based on these considerations we propose and evaluate different active and passive learning strategies. One of our main findings is that passive learning approaches, which can be efficiently precomputed and deployed more easily, achieve performance comparable to the active learning strategies.


title: Up-to Techniques for Branching Bisimilarity

abstract: Ever since the introduction of behavioral equivalences on processes one has been searching for efficient proof techniques that accompany those equivalences. Both strong bisimilarity and weak bisimilarity are accompanied by an arsenal of up-to techniques: enhancements of their proof methods. For branching bisimilarity, these results have not been established yet. We show that a powerful proof technique is sound for branching bisimilarity by combining the three techniques of up to union, up to expansion and up to context for Bloom's BB cool format. We then make an initial proposal for casting the correctness proof of the up to context technique in an abstract coalgebraic setting, covering branching but also {\eta}, delay and weak bisimilarity.


title: Investigation of the cellular response to bone fractures: evidence for flexoelectricity

abstract: The recent discovery of bone flexoelectricity (electrical polarization induced by strain gradient) suggests that flexoelectricity could have physiological effects in bones, and specifically near bone fractures, where flexoelectricity is theoretically highest. Here, we report a cytological study of the interaction between crack stress and bone cells. We have cultured MC3T3-E1 mouse osteoblastic cells in biomimetic microcracked hydroxyapatite substrates, differentiated into osteocytes and applied a strain gradient to the samples. The results show a strong apoptotic cellular response, whereby mechanical stimulation causes those cells near the crack to die, as indicated by live-dead and caspase staining. In addition, analysis two weeks after stimulation shows increased cell attachment and mineralization around microcracks and a higher expression of osteocalcin, an osteogenic protein known to be promoted by physical exercise. The results are consistent with flexoelectricity playing at least two different roles in bone remodelling: apoptotic trigger of the repair protocol, and electrostimulant of the bone-building activity of osteoblasts.


title: Effect of vegetation on the temperatures of Trappist-1 planets

abstract: TRAPPIST-1 is an ultra-cool dwarf hosting a system consisting of seven planets. While orbital properties, radii and masses of the planets are nowadays well constrained, one of the open fascinating issues is the possibility that an environment hospitable to life could develop on some of these planets. Here we use a simple formulation of an energy balance model that includes the vegetation coverage to investigate the possibility of life affecting the climate of the planets in the TRAPPIST-1 system. Results confirm that planet T-e has the best chance for a habitable world and indicate that vegetation coverage significantly affects the resulting temperatures and habitability properties. The influence of vegetation has been evaluated in different scenarios characterized by different vegetation types, land-sea distributions and levels of greenhouse effect. While changes in vegetation type produce small changes, about $0.1\%$, in the habitable surface fraction, different land-sea distributions, by also affecting the vegetation growth, produce different temperature distributions. Finally at latitudes where vegetation grows, the lowering of local albedo still represents a relevant contribution in settling the planetary temperature profiles even when levels of greenhouse effect higher than the Earth-like case are considered.


title: First Characterization of a Superconducting Filter-bank Spectrometer for Hyper-spectral Microwave Atmospheric Sounding with Transition Edge Sensors

abstract: We describe the design, fabrication, integration and characterization of a prototype superconducting filter bank with transition edge sensor readout designed to explore millimetre-wave detection at frequencies in the range 40 to 65 GHz. Results indicate highly uniform filter channel placement in frequency and high overall detection efficiency. The route to a full atmospheric sounding instrument in this frequency range is discussed.


title: Trapped-ion Fock state preparation by potential deformation

abstract: We propose protocols to prepare highly excited energy eigenstates of a trapped ion in a harmonic trap which do not require laser pulses to induce transitions among internal levels. Instead the protocols rely on smoothly deforming the trapping potential between single and double well configurations. The speed of the changes is set to minimize non-adiabatic transitions by keeping the adiabaticity parameter constant. High fidelities are found for times more than two orders of magnitude smaller than with linear ramps of the control parameter. Deformation protocols are also devised to prepare superpositions to optimize interferometric sensitivity, combining the ground state and a highly excited state.


title: Teaching Performance Modeling in the era of millennials

abstract: Performance Modeling (PM) teaching started in the early 70s and reached its peak in the 80s. From those years and until today computing systems have deeply changed. Moreover, in the last two decades an economical crisis has involved the educational system, while the new generations show new learning modes. In this time, new literature has developed about learning and teaching. Rarely highlighting the critical issues. Higher learning is changing its role maybe unawares. In this paper, the author starts from a close examination of the state of the art of PM courses in Universities around the world and tries to highlight the main critical issues of teaching nowadays. The paper has not the aim to give answers but mainly that to open the way to reflections and discussions.


title: PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination

abstract: We develop a novel method, called PoWER-BERT, for improving the inference time of the popular BERT model, while maintaining the accuracy. It works by: a) exploiting redundancy pertaining to word-vectors (intermediate encoder outputs) and eliminating the redundant vectors. b) determining which word-vectors to eliminate by developing a strategy for measuring their significance, based on the self-attention mechanism. c) learning how many word-vectors to eliminate by augmenting the BERT model and the loss function. Experiments on the standard GLUE benchmark shows that PoWER-BERT achieves up to 4.5x reduction in inference time over BERT with <1% loss in accuracy. We show that PoWER-BERT offers significantly better trade-off between accuracy and inference time compared to prior methods. We demonstrate that our method attains up to 6.8x reduction in inference time with <1% loss in accuracy when applied over ALBERT, a highly compressed version of BERT. The code for PoWER-BERT is publicly available at https://github.com/IBM/PoWER-BERT.


title: A universal formula for the relativistic correction to the mutual friction coupling time-scale in neutron stars

abstract: Vortex-mediated mutual friction governs the coupling between the superfluid and normal components in neutron star interiors. By, for example, comparing precise timing observations of pulsar glitches with theoretical predictions it is possible to constrain the physics in the interior of the star, but to do so an accurate model of the mutual friction coupling in general relativity is needed. We derive such a model directly from Carter's multifluid formalism, and study the vortex structure and coupling time-scale between the components in a relativistic star. We calculate how general relativity modifies the shape and the density of the quantized vortices and show that, in the quasi-Schwarzschild coordinates, they can be approximated as straight lines for realistic neutron star configurations. Finally, we present a simple universal formula (given as a function of the stellar compactness alone) for the relativistic correction to the glitch rise-time, which is valid under the assumption that the superfluid reservoir is in a thin shell in the crust or in the outer core. This universal relation can be easily employed to correct, a posteriori, any Newtonian estimate for the coupling time-scale, without any additional computational expense.


title: Field-effect induced superconductivity in surfaces of tetrahedrally coordinated semiconductors: the case of (111) hydrogenated silicon

abstract: We show the possibility of inducing a superconductive phase transition in tetrahedrally coordinated semiconductors via field-effect (FET) doping by taking as an example the hydrogenated (111) silicon surface. We perform density functional theory computations of the electronic and vibrational properties of the system in the proper FET geometry, by taking into account the applied electric field and the induced charge density. Using a simplified superconductive model at $q=\Gamma$ and the McMillan/Allen-Dynes formula, we get an estimate of the superconductive critical temperature. We observe that, by heavily doping with holes at $n_{dop}=6\cdot10^{14}$ cm$^{-2}$, we get an electron-phonon coupling constant of $\lambda_{Si}=0.98$ and a superconductive phase transition at $T_{\text{c}}\in[8.94;10.91]$ K, with $\mu^*\in[0.08;0.12]$.


title: Impact of surface roughness in nanogap plasmonic systems

abstract: Recent results have shown unprecedented control over separation distances between two metallic elements hundreds of nanometers in size, underlying the effects of free-electron nonlocal response also at mid-infrared wavelengths. Most of metallic systems however, still suffer from some degree of inhomogeneity due to fabrication-induced surface roughness. Nanoscale roughness in such systems might hinder the understanding of the role of microscopic interactions. Here we investigate the effect of surface roughness in coaxial nanoapertures resonating at mid-infrared frequencies. We show that although random roughness shifts the resonances in an unpredictable way, the impact of nonlocal effects can still be clearly observed. Roughness-induced perturbation on the peak resonance of the system shows a strong correlation with the effective gap size of the individual samples. Fluctuations due to fabrication imperfections then can be suppressed by performing measurements on structure ensembles in which averaging over a large number of samples provides a precise measure of the ideal system's optical properties.


title: Atomic structures and orbital energies of 61,489 crystal-forming organic molecules

abstract: Data science and machine learning in materials science require large datasets of technologically relevant molecules or materials. Currently, publicly available molecular datasets with realistic molecular geometries and spectral properties are rare. We here supply a diverse benchmark spectroscopy dataset of 61,489 molecules extracted from organic crystals in the Cambridge Structural Database (CSD), denoted OE62. Molecular equilibrium geometries are reported at the Perdew-Burke-Ernzerhof (PBE) level of density functional theory (DFT) including van der Waals corrections for all 62k molecules. For these geometries, OE62 supplies total energies and orbital eigenvalues at the PBE and the PBE hybrid (PBE0) functional level of DFT for all 62k molecules in vacuum as well as at the PBE0 level for a subset of 30,876 molecules in (implicit) water. For 5,239 molecules in vacuum, the dataset provides quasiparticle energies computed with many-body perturbation theory in the $G_0W_0$ approximation with a PBE0 starting point (denoted GW5000 in analogy to the GW100 benchmark set (M. van Setten et al. J. Chem. Theory Comput. 12, 5076 (2016))).