title: Darknet Data Mining -- A Canadian Cyber-crime Perspective

abstract: Exploring the darknet can be a daunting task; this paper explores the application of data mining the darknet within a Canadian cybercrime perspective. Measuring activity through marketplace analysis and vendor attribution has proven difficult in the past. Observing different aspects of the darknet and implementing methods of monitoring and collecting data in the hopes of connecting contributions to the darknet marketplaces to and from Canada. The significant findings include a small Canadian presence, measured the product categories, and attribution of one cross-marketplace vendor through data visualization. The results were made possible through a multi-stage processing pipeline, including data crawling, scraping, and parsing. The primary future works include enhancing the pipeline to include other media, such as web forums, chatrooms, and emails. Applying machine learning models like natural language processing or sentiment analysis could prove beneficial during investigations.


title: Effects of Nuclear Equation of State on Type-I X-ray Bursts: Interpretation of the X-ray Bursts from GS 1826-24

abstract: Type I X-ray bursts are thermonuclear explosions on the neutron star (NS) surface caused by mass accretion from a companion star. Observations of X-ray bursts provide valuable information on X-ray binary systems, e.g., binary parameters, the chemical composition of accreted matter, and the nuclear equation of state (EOS) of NSs. There have been several theoretical studies to constrain the physics of X-ray bursters. However, they have mainly focused on the burning layers above the solid crust of the NS, which brings up issues of the treatment of NS gravitation and internal energy. In this study, focusing on the microphysics inside NSs, we calculate a series of X-ray bursts using a general-relativistic stellar-evolution code with several NS EOSs. We compare the X-ray-burst models with the burst parameters of a clocked burster associated with GS 1826-24. We find a monotonic correlation between the NS radius and the light-curve profile. A larger radius shows a higher recurrence time and a large peak luminosity. In contrast, the dependence of light curves on the NS mass becomes more complicated, where the neutrino cooling suppresses the efficiency of nuclear ignition. We also constrain the EOS and mass of GS 1826-24, i.e., stiffer EOSs, corresponding to larger NS radii, are not preferred due to too-high peak luminosity. The EOS and the cooling and heating of NSs are important to discuss the theoretical and observational properties of X-ray bursts.


title: Cisco at SemEval-2021 Task 5: What's Toxic?: Leveraging Transformers for Multiple Toxic Span Extraction from Online Comments

abstract: Social network platforms are generally used to share positive, constructive, and insightful content. However, in recent times, people often get exposed to objectionable content like threat, identity attacks, hate speech, insults, obscene texts, offensive remarks or bullying. Existing work on toxic speech detection focuses on binary classification or on differentiating toxic speech among a small set of categories. This paper describes the system proposed by team Cisco for SemEval-2021 Task 5: Toxic Spans Detection, the first shared task focusing on detecting the spans in the text that attribute to its toxicity, in English language. We approach this problem primarily in two ways: a sequence tagging approach and a dependency parsing approach. In our sequence tagging approach we tag each token in a sentence under a particular tagging scheme. Our best performing architecture in this approach also proved to be our best performing architecture overall with an F1 score of 0.6922, thereby placing us 7th on the final evaluation phase leaderboard. We also explore a dependency parsing approach where we extract spans from the input sentence under the supervision of target span boundaries and rank our spans using a biaffine model. Finally, we also provide a detailed analysis of our results and model performance in our paper.


title: TEM analyses of unusual presolar silicon carbide: Insights into the range of circumstellar dust condensation conditions

abstract: Presolar silicon carbide (SiC) grains in meteoritic samples can help constrain circumstellar condensation processes and conditions in C-rich stars and core-collapse supernovae. This study presents our findings on eight presolar SiC grains from AGB stars (four mainstream and one Y grain) and core-collapse supernovae (three X grains), chosen on the basis of {\mu}-Raman spectral features that were indicative of their having unusual non-3C polytypes and/or high degrees of crystal disorder. Analytical transmission electron microscopy (TEM), which provides elemental compositional and structural information, shows evidence for complex histories for the grains. Our TEM results confirm the presence of non-3C,2H crystal domains. Minor element heterogeneities and/or subgrains were observed in all grains analyzed for their compositions. The C/O ratios inferred for the parent stars varied from 0.98 to greater than or equal to 1.03. Our data show that SiC condensation can occur under a wide range of conditions, in which environmental factors other than temperature (e.g., pressure, gas composition, heterogeneous nucleation on pre-condensed phases) play a significant role. Based on previous {\mu}-Raman studies, about 10% of SiC grains may have infrared (IR) spectral features that are influenced by crystal defects, porosity, and/or subgrains. Future sub-diffraction limited IR measurements of complex SiC grains might shed further light on the relative contributions of each of these features to the shape and position of the characteristic IR 11-{\mu}m SiC feature and thus improve the interpretation of IR spectra of AGB stars like those that produced the presolar SiC grains.


title: A Study about the Knowledge and Use of Requirements Engineering Standards in Industry

abstract: Context: The use of standards is considered a vital part of any engineering discipline. So one could expect that standards play an important role in Requirements Engineering (RE) as well. However, little is known about the actual knowledge and use of RE-related standards in industry. Objective: In this article, we investigate to which extent standards and related artifacts such as templates or guidelines are known and used by RE practitioners. Method: To this end, we have conducted a questionnaire-based online survey. We could analyze the replies from 90 RE practitioners using a combination of closed and open-text questions. Results: Our results indicate that the knowledge and use of standards and related artifacts in RE is less widespread than one might expect from an engineering perspective. For example, about 47% of the respondents working as requirements engineers or business analysts do not know the core standard in RE, ISO/IEC/IEEE 29148. Participants in our study mostly use standards by personal decision rather than being imposed by their respective company, customer, or regulator. Beyond insufficient knowledge, we also found cultural and organizational factors impeding the widespread adoption of standards in RE. Conclusions: Overall, our results provide empirically informed insights into the actual use of standards and related artifacts in RE practice and - indirectly - about the value that the current standards create for RE practitioners.


title: NViSII: A Scriptable Tool for Photorealistic Image Generation

abstract: We present a Python-based renderer built on NVIDIA's OptiX ray tracing engine and the OptiX AI denoiser, designed to generate high-quality synthetic images for research in computer vision and deep learning. Our tool enables the description and manipulation of complex dynamic 3D scenes containing object meshes, materials, textures, lighting, volumetric data (e.g., smoke), and backgrounds. Metadata, such as 2D/3D bounding boxes, segmentation masks, depth maps, normal maps, material properties, and optical flow vectors, can also be generated. In this work, we discuss design goals, architecture, and performance. We demonstrate the use of data generated by path tracing for training an object detector and pose estimator, showing improved performance in sim-to-real transfer in situations that are difficult for traditional raster-based renderers. We offer this tool as an easy-to-use, performant, high-quality renderer for advancing research in synthetic data generation and deep learning.


title: First Constraints on Nuclear Coupling of Axionlike Particles from the Binary Neutron Star Gravitational Wave Event GW170817

abstract: Light axion fields, if they exist, can be sourced by neutron stars due to their coupling to nuclear matter, and play a role in binary neutron star mergers. We report on a search for such axions by analysing the gravitational waves from the binary neutron star inspiral GW170817. We find no evidence of axions in the sampled parameter space. The null result allows us to impose constraints on axions with masses below $10^{-11} {\rm eV}$ by excluding the ones with decay constants ranging from $1.6\times10^{16} {\rm GeV}$ to $10^{18} {\rm GeV}$ at $3\sigma$ confidence level. Our analysis provides the first constraints on axions from neutron star inspirals, and rules out a large region in parameter space that has not been probed by the existing experiments.


title: A Review of Network Evolution Towards a Smart Connected World

abstract: With the rapid innovations in technology, wireless internet-connected devices are more ubiquitous than ever and can be found in virtually every aspect of both our personal and professional lives. In this paper, we propose a comprehensive literature review that focuses on various network components that create connectivity among different devices, specifically Wireless Sensor Networks (WSNs), Radio-Frequency Identification (RFID) tags, Internet of Things (IoT) devices, and how these devices helped usher in the 4th Industrial Revolution, or Industry 4.0. This paper focuses on the protocols, architecture, uses, security concerns, and solutions used in these network technologies, as well as their differences and similarities.


title: Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation

abstract: We propose a novel sparse constrained formulation and from it derive a real-time optimization method for 3D human pose and shape estimation. Our optimization method, SCOPE (Sparse Constrained Optimization for 3D human Pose and shapE estimation), is orders of magnitude faster (avg. 4 ms convergence) than existing optimization methods, while being mathematically equivalent to their dense unconstrained formulation under mild assumptions. We achieve this by exploiting the underlying sparsity and constraints of our formulation to efficiently compute the Gauss-Newton direction. We show that this computation scales linearly with the number of joints and measurements of a complex 3D human model, in contrast to prior work where it scales cubically due to their dense unconstrained formulation. Based on our optimization method, we present a real-time motion capture framework that estimates 3D human poses and shapes from a single image at over 30 FPS. In benchmarks against state-of-the-art methods on multiple public datasets, our framework outperforms other optimization methods and achieves competitive accuracy against regression methods. Project page with code and videos: https://sites.google.com/view/scope-human/.


title: Differential Chaos Shift Keying-based Wireless Power Transfer with Nonlinearities

abstract: In this paper, we investigate conventional communication-based chaotic waveforms in the context of wireless power transfer (WPT). Particularly, we present a differential chaos shift keying (DCSK)-based WPT architecture, that employs an analog correlator at the receiver, in order to boost the energy harvesting (EH) performance. We take into account the nonlinearities of the EH process and derive closed-form analytical expressions for the harvested direct current (DC) under a generalized Nakagami-m block fading model. We show that, in this framework, both the peak-to-average-power-ratio of the received signal and the harvested DC, depend on the parameters of the transmitted waveform. Furthermore, we investigate the case of deterministic unmodulated chaotic waveforms and demonstrate that, in the absence of a correlator, modulation does not affect the achieved harvested DC. On the other hand, it is shown that for scenarios with a correlator-aided receiver, DCSK significantly outperforms the unmodulated case. Based on this observation, we propose a novel DCSK-based signal design, which further enhances the WPT capability of the proposed architecture; corresponding analytical expressions for the harvested DC are also derived. Our results demonstrate that the proposed architecture and the associated signal design, can achieve significant EH gains in DCSK-based WPT systems. Furthermore, we also show that, even by taking into account the nonlinearities at the transmitter amplifier, the proposed chaotic waveform performs significantly better in terms of EH, when compared with the existing multisine signals.


title: Bridging Data Center AI Systems with Edge Computing for Actionable Information Retrieval

abstract: Extremely high data rates at modern synchrotron and X-ray free-electron laser light source beamlines motivate the use of machine learning methods for data reduction, feature detection, and other purposes. Regardless of the application, the basic concept is the same: data collected in early stages of an experiment, data from past similar experiments, and/or data simulated for the upcoming experiment are used to train machine learning models that, in effect, learn specific characteristics of those data; these models are then used to process subsequent data more efficiently than would general-purpose models that lack knowledge of the specific dataset or data class. Thus, a key challenge is to be able to train models with sufficient rapidity that they can be deployed and used within useful timescales. We describe here how specialized data center AI (DCAI) systems can be used for this purpose through a geographically distributed workflow. Experiments show that although there are data movement cost and service overhead to use remote DCAI systems for DNN training, the turnaround time is still less than 1/30 of using a locally deploy-able GPU.


title: Observation of Anomalous Josephson Effect in Nonequilibrium Andreev Interferometers

abstract: The first evidence of anomalous Josephson effect is reported in mesoscopic superconductor-normal metal-superconductor (SNS) junctions forming a crosslike Andreev Interferometer in the absence of magnetic and spin-orbit interactions normally required to break time-reversal and inversion symmetries. From conductance measurements of the out-of-equilibrium weak link, we determine a voltage-controlled spontaneous phase that resembles a $\varphi_0$-junction. The temperature and voltage dependences together with a dissipative term in the current-phase relation strongly suggest that the mechanism underlying the observed phenomenon relies on electron-hole asymmetries.


title: Extensions of Nilpotent Algebras

abstract: Given a pair of nilpotent Lie algebras $A$ and $B$, an extension $0\xrightarrow{} A\xrightarrow{} L\xrightarrow{} B\xrightarrow{} 0$ is not necessarily nilpotent. However, if $L_1$ and $L_2$ are extensions which correspond to lifts of a map $\Phi:B\xrightarrow{} \text{Out}(A)$, it has been shown that $L_1$ is nilpotent if and only if $L_2$ is nilpotent. In the present paper, we prove analogues of this result for the algebras of Loday. As an important consequence, we thereby gain its associative analogue as a special case of diassociative algebras.


title: Pull Request Decision Explained: An Empirical Overview

abstract: Context: Pull-based development model is widely used in open source, leading the trends in distributed software development. One aspect which has garnered significant attention is studies on pull request decision - identifying factors for explanation. Objective: This study builds on a decade long research on pull request decision to explain it. We empirically investigate how factors influence pull request decision and scenarios that change the influence of factors. Method: We identify factors influencing pull request decision on GitHub through a systematic literature review and infer it by mining archival data. We collect a total of 3,347,937 pull requests with 95 features from 11,230 diverse projects on GitHub. Using this data, we explore the relations of the factors to each other and build mixed-effect logistic regression models to empirically explain pull request decision. Results: Our study shows that a small number of factors explain pull request decision with the integrator same or different from the submitter as the most important factor. We also noted that some factors are important only in special cases e.g., the percentage of failed builds is important for pull request decision when continuous integration is used.


title: Artificial life: sustainable self-replicating systems

abstract: Nature has found one method of organizing living matter, but maybe other options exist -- not yet discovered -- on how to create life. To study the life "as it could be" is the objective of an interdisciplinary field called Artificial Life (commonly abbreviated as ALife). The word "artificial" refers to the fact that humans are involved in the creation process. The artificial life forms might be completely unlike natural forms of life, with different chemical compositions, and even computer programs exhibiting life-like behaviours.


title: Post-Newtonian Gravitational and Scalar Waves in Scalar-Gauss-Bonnet Gravity

abstract: Gravitational waves emitted by black hole binary inspiral and mergers enable unprecedented strong-field tests of gravity, requiring accurate theoretical modelling of the expected signals in extensions of General Relativity. In this paper we model the gravitational wave emission of inspiraling binaries in scalar Gauss-Bonnet gravity theories. Going beyond the weak-coupling approximation, we derive the gravitational waveform to first post-Newtonian order beyond the quadrupole approximation and calculate new contributions from nonlinear curvature terms. We quantify the effect of these terms and provide ready-to-implement gravitational wave and scalar waveforms as well as the Fourier domain phase for quasi-circular binaries. We also perform a parameter space study, which indicates that the values of black hole scalar charges play a crucial role in the detectability of deviation from General Relativity. We also compare the scalar waveforms to numerical relativity simulations to assess the impact of the relativistic corrections to the scalar radiation. Our results provide important foundations for future precision tests of gravity.


title: Slow growth of magnetic domains helps fast evolution routes for out-of-equilibrium dynamics

abstract: Cooling and heating faster a system is a crucial problem in science, technology and industry. Indeed, choosing the best thermal protocol to reach a desired temperature or energy is not a trivial task. Noticeably, we find that the phase transitions may speed up thermalization in systems where there are no conserved quantities. In particular, we show that the slow growth of magnetic domains shortens the overall time that the system takes to reach a final desired state. To prove that statement, we use intensive numerical simulations of a prototypical many-body system, namely the 2D Ising model.


title: Giant component for the supercritical level-set percolation of the Gaussian free field on regular expander graphs

abstract: We consider the zero-average Gaussian free field on a certain class of finite $d$-regular graphs for fixed $d\ge 3$. This class includes $d$-regular expanders of large girth and typical realisations of random $d$-regular graphs. We show that the level set of the zero-average Gaussian free field above level $h$ has a giant component in the whole supercritical phase, that is for all $h<h_\star$, with probability tending to one as the size of the graphs tends to infinity. In addition, we show that this component is unique. This significantly improves the result of [AC20b], where it was shown that a linear fraction of vertices is in mesoscopic components if $h<h_\star$.


title: Relation Matters in Sampling: A Scalable Multi-Relational Graph Neural Network for Drug-Drug Interaction Prediction

abstract: Sampling is an established technique to scale graph neural networks to large graphs. Current approaches however assume the graphs to be homogeneous in terms of relations and ignore relation types, critically important in biomedical graphs. Multi-relational graphs contain various types of relations that usually come with variable frequency and have different importance for the problem at hand. We propose an approach to modeling the importance of relation types for neighborhood sampling in graph neural networks and show that we can learn the right balance: relation-type probabilities that reflect both frequency and importance. Our experiments on drug-drug interaction prediction show that state-of-the-art graph neural networks profit from relation-dependent sampling in terms of both accuracy and efficiency.


title: Computation of Weighted Bergman Inner Products on Bounded Symmetric Domains and Restriction to Subgroups

abstract: Let $(G,G_1)$ be a symmetric pair of holomorphic type, and we consider a pair of Hermitian symmetric spaces $D_1=G_1/K_1\subset D=G/K$, realized as bounded symmetric domains in complex vector spaces $\mathfrak{p}^+_1\subset\mathfrak{p}^+$ respectively. Then the universal covering group $\widetilde{G}$ of $G$ acts unitarily on the weighted Bergman space $\mathcal{H}_\lambda(D)\subset\mathcal{O}(D)$ on $D$. Its restriction to the subgroup $\widetilde{G}_1$ decomposes discretely and multiplicity-freely, and its branching law is given explicitly by Hua-Kostant-Schmid-Kobayashi's formula in terms of the $K_1$-decomposition of the space $\mathcal{P}(\mathfrak{p}^+_2)$ of polynomials on the orthogonal complement $\mathfrak{p}^+_2$ of $\mathfrak{p}^+_1$ in $\mathfrak{p}^+$. The object of this article is to compute explicitly the inner product $\big\langle f(x_2),{\rm e}^{(x|\overline{z})_{\mathfrak{p}^+}}\big\rangle_\lambda$ for $f(x_2)\in\mathcal{P}(\mathfrak{p}^+_2)$, $x=(x_1,x_2)$, $z\in\mathfrak{p}^+=\mathfrak{p}^+_1\oplus\mathfrak{p}^+_2$. For example, when $\mathfrak{p}^+$, $\mathfrak{p}^+_2$ are of tube type and $f(x_2)=\det(x_2)^k$, we compute this inner product explicitly by introducing a multivariate generalization of Gauss' hypergeometric polynomials ${}_2F_1$. Also, as an application, we construct explicitly $\widetilde{G}_1$-intertwining operators (symmetry breaking operators) $\mathcal{H}_\lambda(D)|_{\widetilde{G}_1}\to\mathcal{H}_\mu(D_1)$ from holomorphic discrete series representations of $\widetilde{G}$ to those of $\widetilde{G}_1$, which are unique up to constant multiple for sufficiently large $\lambda$.


title: Perturbation Theory for the Information Bottleneck

abstract: Extracting relevant information from data is crucial for all forms of learning. The information bottleneck (IB) method formalizes this, offering a mathematically precise and conceptually appealing framework for understanding learning phenomena. However the nonlinearity of the IB problem makes it computationally expensive and analytically intractable in general. Here we derive a perturbation theory for the IB method and report the first complete characterization of the learning onset, the limit of maximum relevant information per bit extracted from data. We test our results on synthetic probability distributions, finding good agreement with the exact numerical solution near the onset of learning. We explore the difference and subtleties in our derivation and previous attempts at deriving a perturbation theory for the learning onset and attribute the discrepancy to a flawed assumption. Our work also provides a fresh perspective on the intimate relationship between the IB method and the strong data processing inequality.

categories: cs.LG cond-mat.dis-nn cond-mat.stat-mech cs.IT math.IT physics.data-an


title: What Is Considered Complete for Visual Recognition?

abstract: This is an opinion paper. We hope to deliver a key message that current visual recognition systems are far from complete, i.e., recognizing everything that human can recognize, yet it is very unlikely that the gap can be bridged by continuously increasing human annotations. Based on the observation, we advocate for a new type of pre-training task named learning-by-compression. The computational models (e.g., a deep network) are optimized to represent the visual data using compact features, and the features preserve the ability to recover the original data. Semantic annotations, when available, play the role of weak supervision. An important yet challenging issue is the evaluation of image recovery, where we suggest some design principles and future research directions. We hope our proposal can inspire the community to pursue the compression-recovery tradeoff rather than the accuracy-complexity tradeoff.


title: EDEN: Deep Feature Distribution Pooling for Saimaa Ringed Seals Pattern Matching

abstract: In this paper, pelage pattern matching is considered to solve the individual re-identification of the Saimaa ringed seals. Animal re-identification together with the access to large amount of image material through camera traps and crowd-sourcing provide novel possibilities for animal monitoring and conservation. We propose a novel feature pooling approach that allow aggregating the local pattern features to get a fixed size embedding vector that incorporate global features by taking into account the spatial distribution of features. This is obtained by eigen decomposition of covariances computed for probability mass functions representing feature maps. Embedding vectors can then be used to find the best match in the database of known individuals allowing animal re-identification. The results show that the proposed pooling method outperforms the existing methods on the challenging Saimaa ringed seal image data.


title: Coloring Trees in Massively Parallel Computation

abstract: We present $O(\log^2 \log n)$ time 3-coloring, maximal independent set and maximal matching algorithms for trees in the Massively Parallel Computation (MPC) model. Our algorithms are deterministic, apply to arbitrary-degree trees and work in the low-space MPC model, where local memory is $O(n^\delta)$ for $\delta \in (0,1)$ and global memory is $O(m)$. Our main result is the 3-coloring algorithm, which contrasts the randomized, state-of-the-art 4-coloring algorithm of Ghaffari, Grunau and Jin [DISC'20]. The maximal independent set and maximal matching algorithms follow in $O(1)$ time after obtaining the coloring. The key ingredient of our 3-coloring algorithm is an $O(\log^2 \log n)$ time adaptation of the rake-and-compress tree decomposition used by Chang and Pettie [FOCS'17], and established by Miller and Reif. When restricting our attention to trees of constant degree, we bring the runtime down to $O(\log \log n)$.


title: What is the scale of new physics behind the muon $g-2$?

abstract: We study the constraints imposed by perturbative unitarity on the new physics interpretation of the muon $g-2$ anomaly. Within a Standard Model Effective Field Theory (SMEFT) approach, we find that scattering amplitudes sourced by effective operators saturate perturbative unitarity at about 1 PeV. This corresponds to the highest energy scale that needs to be probed in order to resolve the new physics origin of the muon $g-2$ anomaly. On the other hand, simplified models (e.g.~scalar-fermion Yukawa theories) in which renormalizable couplings are pushed to the boundary of perturbativity still imply new on-shell states below 200 TeV. We finally suggest that the highest new physics scale responsible for the anomalous effect can be reached in non-renormalizable models at the PeV scale.


title: Branch Point Twist Field Form Factors in the sine-Gordon Model II: Composite Twist Fields and Symmetry Resolved Entanglement

abstract: In this paper we continue the programme initiated in Part I, that is the study of entanglement measures in the sine-Gordon model. In both parts, we have focussed on one specific technique, that is the well-known connection between branch point twist field correlators and measures of entanglement in 1+1D integrable quantum field theory. Our papers apply this technique for the first time to a non-diagonal theory with an involved particle spectrum, the sine-Gordon model. In this Part II we focus on a different entanglement measure, the symmetry resolved entanglement, and develop its associated twist field description, exploiting the underlying U(1) symmetry of the theory. In this context, conventional branch point twist fields are no longer the fields required, but instead we must work with one of their composite generalisations, which can be understood as the field resulting from the fusion of a standard branch point twist field and the sine-Gordon exponential field associated with U(1) symmetry. The resulting composite twist field has correlators which as usual admit a form factor expansion. In this paper we write the associated form factor equations and solve them for various examples in the breather sector by using the method of angular quantisation. We show that, in the attractive regime, this is the sector which provides the leading contribution to the symmetry resolved entropies, both Renyi and von Neumann. We compute the latter in the limit of a large region size and show that they satisfy the property of equipartition, that is the leading contribution to the symmetry resolved entanglement is independent of the symmetry sector.


title: Characterizing the observation bias in gravitational-wave detections and finding structured population properties

abstract: The observed distributions of the source properties from gravitational-wave detections are biased due to the selection effects and detection criteria in the detections, analogous to the Malmquist bias. In this work, this observation bias is investigated through its fundamental statistical and physical origins. An efficient semi-analytical formulation for its estimation is derived which is as accurate as the standard method of numerical simulations, with only a millionth of the computational cost. Then, the estimated bias is used for unmodelled inferences on the binary black hole population. These inferences show additional structures, specifically two peaks in the joint mass distribution around binary masses $\sim10$ M$_\odot$ and $\sim30$ M$_\odot$. Example ready-to-use scripts and some produced datasets for this method are shared in an online repository.


title: Confident in the Crowd: Bayesian Inference to Improve Data Labelling in Crowdsourcing

abstract: With the increased interest in machine learning and big data problems, the need for large amounts of labelled data has also grown. However, it is often infeasible to get experts to label all of this data, which leads many practitioners to crowdsourcing solutions. In this paper, we present new techniques to improve the quality of the labels while attempting to reduce the cost. The naive approach to assigning labels is to adopt a majority vote method, however, in the context of data labelling, this is not always ideal as data labellers are not equally reliable. One might, instead, give higher priority to certain labellers through some kind of weighted vote based on past performance. This paper investigates the use of more sophisticated methods, such as Bayesian inference, to measure the performance of the labellers as well as the confidence of each label. The methods we propose follow an iterative improvement algorithm which attempts to use the least amount of workers necessary to achieve the desired confidence in the inferred label. This paper explores simulated binary classification problems with simulated workers and questions to test the proposed methods. Our methods outperform the standard voting methods in both cost and accuracy while maintaining higher reliability when there is disagreement within the crowd.


title: LDPC Codes with Soft Interference Cancellation for Uncoordinated Unsourced Multiple Access

abstract: This article presents a novel enhancement to the random spreading based coding scheme developed by Pradhan et al.\ for the unsourced multiple access channel. The original coding scheme features a polar outer code in conjunction with a successive cancellation list decoder (SCLD) and a hard-input soft-output MMSE estimator. In contrast, the proposed scheme employs a soft-input soft-output MMSE estimator for multi-user detection. This is accomplished by replacing the SCLD based polar code with an LDPC code amenable to belief propagation decoding. This novel framework is leveraged to successfully pass pertinent soft information between the MMSE estimator and the outer code. LDPC codes are carefully designed using density evolution techniques to match the iterative process. This enhanced architecture exhibits significant performance improvements and represents the state-of-the-art over a wide range of system parameters.


title: Improving Generalization in Mountain Car Through the Partitioned Parameterized Policy Approach via Quasi-Stochastic Gradient Descent

abstract: The reinforcement learning problem of finding a control policy that minimizes the minimum time objective for the Mountain Car environment is considered. Particularly, a class of parameterized nonlinear feedback policies is optimized over to reach the top of the highest mountain peak in minimum time. The optimization is carried out using quasi-Stochastic Gradient Descent (qSGD) methods. In attempting to find the optimal minimum time policy, a new parameterized policy approach is considered that seeks to learn an optimal policy parameter for different regions of the state space, rather than rely on a single macroscopic policy parameter for the entire state space. This partitioned parameterized policy approach is shown to outperform the uniform parameterized policy approach and lead to greater generalization than prior methods, where the Mountain Car became trapped in circular trajectories in the state space.


title: ScalingNet: extracting features from raw EEG data for emotion recognition

abstract: Convolutional Neural Networks(CNNs) has achieved remarkable performance breakthrough in a variety of tasks. Recently, CNNs based methods that are fed with hand-extracted EEG features gradually produce a powerful performance on the EEG data based emotion recognition task. In this paper, we propose a novel convolutional layer allowing to adaptively extract effective data-driven spectrogram-like features from raw EEG signals, which we reference as scaling layer. Further, it leverages convolutional kernels scaled from one data-driven pattern to exposed a frequency-like dimension to address the shortcomings of prior methods requiring hand-extracted features or their approximations. The proposed neural network architecture based on the scaling layer, references as ScalingNet, has achieved the state-of-the-art result across the established DEAP benchmark dataset.


title: An Explainable Probabilistic Classifier for Categorical Data Inspired to Quantum Physics

abstract: This paper presents Sparse Tensor Classifier (STC), a supervised classification algorithm for categorical data inspired by the notion of superposition of states in quantum physics. By regarding an observation as a superposition of features, we introduce the concept of wave-particle duality in machine learning and propose a generalized framework that unifies the classical and the quantum probability. We show that STC possesses a wide range of desirable properties not available in most other machine learning methods but it is at the same time exceptionally easy to comprehend and use. Empirical evaluation of STC on structured data and text classification demonstrates that our methodology achieves state-of-the-art performances compared to both standard classifiers and deep learning, at the additional benefit of requiring minimal data pre-processing and hyper-parameter tuning. Moreover, STC provides a native explanation of its predictions both for single instances and for each target label globally.


title: Lucas, Fibonacci, and Chebyshev polynomials from matrices

abstract: A simple matrix formulation of the Fibonacci, Lucas, Chebyshev, and Dixon polynomials polynomials is presented. It utilizes the powers and the symmetric tensor powers of a certain matrix.


title: An empirical mean-field model of symmetry-breaking in a turbulent wake

abstract: This work develops a low-dimensional nonlinear stochastic model of symmetry-breaking coherent structures from experimental measurements of a turbulent axisymmetric bluff body wake. Traditional model reduction methods decompose the field into a set of modes with fixed spatial support but time-varying amplitudes. However, this fixed basis cannot resolve the mean flow deformation due to variable Reynolds stresses, a central feature of Stuart's nonlinear stability mechanism, without the further assumption of weakly nonlinear interactions. Here, we introduce a parametric modal basis that depends on the instantaneous value of the unsteady aerodynamic center of pressure, which quantifies the degree to which the rotational symmetry of the wake is broken. Thus, the modes naturally interpolate between the unstable symmetric state and the nonlinear equilibrium. We estimate the modes from experimental measurements of the base pressure distribution by reducing the symmetry via phase alignment and averaging conditioned on the center of pressure. The amplitude dependence of the symmetric mode deviates significantly from the polynomial scaling predicted by weakly nonlinear analysis, confirming that the parametric basis is crucial for capturing the effect of strongly nonlinear interactions. We also introduce a second model term capturing axisymmetric fluctuations associated with the mean-field deformation. We then apply the Langevin regression system identification method to construct a stochastically forced nonlinear model for these two generalized mode coefficients. The resulting model reproduces empirical power spectra and probability distributions, suggesting a path towards developing interpretable low-dimensional models of globally unstable turbulent flows from experimental measurements.


title: Non-linear regimes of tsunami waves generated by a granular collapse

abstract: Tsunami waves induced by landslides are a threat to human activities and safety along coastal areas. In this paper, we characterize experimentally the waves generated by the gravity-driven collapse of a dry granular column into water. Three nonlinear wave regimes are identified depending on the Froude number $\mathrm{Fr}_f$ based on the ratio of the velocity of the advancing granular front and the velocity of linear gravity waves in shallow water: transient bores for large $\mathrm{Fr}_f$, solitary waves for intermediate values of $\mathrm{Fr}_f$, and non-linear transition waves at small $\mathrm{Fr}_f$. The wave amplitude relative to the water depth increases with $\mathrm{Fr}_f$ in the three regimes but with different non-linear scalings, and the relative wavelength is an increasing or decreasing function of $\mathrm{Fr}_f$. Two of these wave regimes are rationalized by considering that the advancing granular front acts as a vertical piston pushing the water, while the last one is found to be a transition from shallow to deep water conditions. The present modeling contributes to a better understanding of the rich hydrodynamics of the generated waves, with coastal risk assessment as practical applications.


title: Kinetic screening in nonlinear stellar oscillations and gravitational collapse

abstract: We consider k-essence, a scalar-tensor theory with first-order derivative self-interactions that can screen local scales from scalar fifth forces, while allowing for sizeable deviations from General Relativity on cosmological scales. We construct fully nonlinear static stellar solutions that show the presence of this screening mechanism, and we use them as initial data for simulations of stellar oscillations and gravitational collapse in spherical symmetry. We find that for k-essence theories of relevance for cosmology, the screening mechanism works in the case of stellar oscillation and suppresses the monopole scalar emission to undetectable levels. In collapsing stars, we find that the Cauchy problem, although locally well posed, can lead to diverging characteristic speeds for the scalar field. By introducing a ''fixing equation'' in the spirit of J. Cayuso, N. Ortiz, and L. Lehner [Phys. Rev. D 96, 084043 (2017)], inspired in turn by dissipative relativistic hydrodynamics, we manage to evolve collapsing neutron stars past the divergence of the characteristic speeds. We show that, in these systems, the screening mechanism is less efficient than for oscillating and static stars, because the collapsing star must shed away all of its scalar hair before forming a black hole. For k-essence theories of relevance for cosmology, the characteristic frequency of the resulting scalar monopole signal is too low for terrestrial detectors, but we conjecture that space-borne interferometers such as LISA might detect it if a supernova explodes in the Galaxy.


title: PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer

abstract: Magnetic resonance imaging (MRI) noninvasively provides critical information about how human brain structures develop across stages of life. Developmental scientists are particularly interested in the first few years of neurodevelopment. Despite the success of MRI collection and analysis for adults, it is a challenge for researchers to collect high-quality multimodal MRIs from developing infants mainly because of their irregular sleep pattern, limited attention, inability to follow instructions to stay still, and a lack of analysis approaches. These challenges often lead to a significant reduction of usable data. To address this issue, researchers have explored various solutions to replace corrupted scans through synthesizing realistic MRIs. Among them, the convolution neural network (CNN) based generative adversarial network has demonstrated promising results and achieves state-of-the-art performance. However, adversarial training is unstable and may need careful tuning of regularization terms to stabilize the training. In this study, we introduced a novel MRI synthesis framework - Pyramid Transformer Net (PTNet). PTNet consists of transformer layers, skip-connections, and multi-scale pyramid representation. Compared with the most widely used CNN-based conditional GAN models (namely pix2pix and pix2pixHD), our model PTNet shows superior performance in terms of synthesis accuracy and model size. Notably, PTNet does not require any type of adversarial training and can be easily trained using the simple mean squared error loss.


title: Linguistic Structures as Weak Supervision for Visual Scene Graph Generation

abstract: Prior work in scene graph generation requires categorical supervision at the level of triplets - subjects and objects, and predicates that relate them, either with or without bounding box information. However, scene graph generation is a holistic task: thus holistic, contextual supervision should intuitively improve performance. In this work, we explore how linguistic structures in captions can benefit scene graph generation. Our method captures the information provided in captions about relations between individual triplets, and context for subjects and objects (e.g. visual properties are mentioned). Captions are a weaker type of supervision than triplets since the alignment between the exhaustive list of human-annotated subjects and objects in triplets, and the nouns in captions, is weak. However, given the large and diverse sources of multimodal data on the web (e.g. blog posts with images and captions), linguistic supervision is more scalable than crowdsourced triplets. We show extensive experimental comparisons against prior methods which leverage instance- and image-level supervision, and ablate our method to show the impact of leveraging phrasal and sequential context, and techniques to improve localization of subjects and objects.


title: SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)

abstract: Understanding tables is an important and relevant task that involves understanding table structure as well as being able to compare and contrast information within cells. In this paper, we address this challenge by presenting a new dataset and tasks that addresses this goal in a shared task in SemEval 2020 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS). Our dataset contains 981 manually-generated tables and an auto-generated dataset of 1980 tables providing over 180K statement and over 16M evidence annotations. SEM-TAB-FACTS featured two sub-tasks. In sub-task A, the goal was to determine if a statement is supported, refuted or unknown in relation to a table. In sub-task B, the focus was on identifying the specific cells of a table that provide evidence for the statement. 69 teams signed up to participate in the task with 19 successful submissions to subtask A and 12 successful submissions to subtask B. We present our results and main findings from the competition.


title: On the Unconditional Validity of J. von Neumann's Proof of the Impossibility of Hidden Variables in Quantum Mechanics

abstract: The impossibility of theories with hidden variables as an alternative and replacement for quantum mechanics was discussed by J. von Neumann in 1932. His proof was criticized as being logically circular, by Grete Hermann soon after, and as fundamentally flawed, by John Bell in 1964. Bell's severe criticism of Neumann's proof and the explicit (counter) example of a hidden variable model for the measurement of a quantum spin are considered by most researchers, though not all, as the definitive demonstration that Neumann's proof is inadequate. Despite being an argument of mathematical physics, an ambiguity of decision remains to this day. I show that Neumann's assumption of the linear additivity of the expectation values, even for incompatible (noncommuting) observables, is a necessary constraint related to the nature of observable physical variables and to the conservation laws. Therefore, any theory should necessarily obey it to qualify as a physically valid theory. Then, obviously, the hidden variable theories with dispersion-free ensembles that violate this assumption are ruled out. I show that it is Bell's counter-example that is fundamentally flawed, being inconsistent with the factual mechanics. Further, it is shown that the local hidden variable theories, for which the Bell's inequalities were derived, are grossly incompatible with the fundamental conservation laws. I identify the intrinsic uncertainty in the action as the reason for the irreducible dispersion, which implies that there are no dispersion-free ensembles at any scale of mechanics. With the unconditional validity of its central assumption shown, Neumann's proof is fully resurrected.


title: On Hamilton-Jacobi PDEs and image denoising models with certain non-additive noise

abstract: We consider image denoising problems formulated as variational problems. It is known that Hamilton-Jacobi PDEs govern the solution of such optimization problems when the noise model is additive. In this work, we address certain non-additive noise models and show that they are also related to Hamilton-Jacobi PDEs. These findings allow us to establish new connections between additive and non-additive noise imaging models. Specifically, we study how the solutions to these optimization problems depend on the parameters and the observed images. We show that the optimal values are ruled by some Hamilton-Jacobi PDEs, while the optimizers are characterized by the spatial gradient of the solution to the Hamilton-Jacobi PDEs. Moreover, we use these relations to investigate the asymptotic behavior of the variational model as the parameter goes to infinity, that is, when the influence of the noise vanishes. With these connections, some non-convex models for non-additive noise can be solved by applying convex optimization algorithms to the equivalent convex models for additive noise. Several numerical results are provided for denoising problems with Poisson noise or multiplicative noise.


title: Ion-laser-like interaction in optomechanical systems with Kerr nonlinearities

abstract: Introducing a Kerr medium in a cavity coupled to a harmonically moving mirror, we reproduce known and solvable interactions such as two-coupled harmonic oscillators and ion-laser like interactions for specific conditions. This is achieved by a unitary transformation allowing us to tune off the Kerr medium in order to simplify the Hamiltonian.


title: The Cosmic Large-Scale Structure in X-rays (CLASSIX) Cluster Survey II: Unveiling a pancake structure with a 100 Mpc radius in the local Universe

abstract: Previous studies of the galaxy and galaxy cluster distribution in the local Universe found indications for a large extension of the Local Supercluster up to a radius of 190 h_70^-1 Mpc. We are using our large and highly complete CLASSIX survey of X-ray luminous galaxy clusters detected in the ROSAT All Sky Survey to trace the matter distribution in the local Universe and to explore the size of the flattened local density structure associated with the Local Supercluster. The Local Supercluster is oriented almost perpendicular to the Galactic plane. Since Galactic extinction increases towards the Galactic plane, objects are on average more easily visible perpendicular to the plane than close to it, also producing an apparent concentration of objects along the Local Supercluster. We can correct for this bias by a careful treatment of the survey selection function. We find a significant overdensity of clusters in a flattened structure along the Supergalactic plane with a thickness of about 50 Mpc and an extent of about 100 Mpc radius. Structures at a distance larger than 100 Mpc are not correlated to the Local Supercluster any more. The matter density contrast of the local superstructure to the surroundings is about a factor of 1.3 - 2.3. Within the Supergalactic plane the matter is concentrated mostly in two superclusters, the Perseus-Pisces Chain and Hydra-Centaurus supercluster. We have shown in our earlier work that the local Universe in a region with a radius of 100 - 170 Mpc has a lower density than the cosmic mean. For this reason, the Local Supercluster is not overdense with respect to the cosmic mean density. Therefore this local superstructure will not collapse as a whole in the future, but rather fragment.


title: Interaction of the massive cluster system Abell 3016/3017 embedded in a cosmic filament

abstract: The galaxy cluster system RXCJ0225.9-4154 with the two sub-clusters A3016 and A3017 is embedded in a large-scale structure filament with signatures of filamentary accretion. A Chandra observation of this system shows the two clusters as well as a filament of X-ray emission connecting them and a galaxy group therein. The main cluster, A3017, shows indications of shocks most probably from a recent interaction with cluster components along the filament axis as well as a cold front. The filament between the two clusters is likely to be heated by the accretion shocks of the clusters and we discuss two scenarios for the origin of this X-ray filament. The paper describes many properties of the components of the cluster merger system that are used to assist the interpretation of the observed configuration.


title: Influence of Apophis' spin axis variations on a spacecraft during the 2029 close approach with Earth

abstract: Tumbling asteroids belong to a small group of objects, whose angular velocity vector is unaligned with any of its principal axes of inertia. This leads to challenging efforts to model the trajectory of any spacecraft designed to orbit these bodies. In this work, we deepen a previous study on this topic, concerning the asteroid (99942) Apophis during its close encounter with the Earth in 2029. We analyze the orbital behaviour of a spacecraft orbiting the asteroid during this event, by including the effects of the changes of orientation of the spin axis of the asteroid, depending on two sets of initial conditions. The global dynamics of the spacecraft around the target are analyzed using three approaches, MEGNO, PMap, and Time-Series prediction. We confirm that no spacecraft with natural orbits could survive the high perturbations caused by the close encounter with our planet.


title: What if This Modified That? Syntactic Interventions via Counterfactual Embeddings

abstract: Neural language models exhibit impressive performance on a variety of tasks, but their internal reasoning may be difficult to understand. Prior art aims to uncover meaningful properties within model representations via probes, but it is unclear how faithfully such probes portray information that the models actually use. To overcome such limitations, we propose a technique, inspired by causal analysis, for generating counterfactual embeddings within models. In experiments testing our technique, we produce evidence that suggests some BERT-based models use a tree-distance-like representation of syntax in downstream prediction tasks.


title: Environmental Radiation Impact on Lifetimes and Quasiparticle Tunneling Rates of Fixed-Frequency Transmon Qubits

abstract: Quantum computing relies on the operation of qubits in an environment as free of noise as possible. This work reports on measuring the impact of environmental radiation on lifetimes of fixed frequency transmon qubits with various capacitor pad geometries by varying the amount of shielding used in the measurement space. It was found that the qubit lifetimes are robust against these shielding changes until the most extreme limit was tested without a mixing chamber shield in the refrigerator. In contrast, the quasiparticle tunneling rates were found to be extremely sensitive to all configurations tested, indicating these devices are not yet limited by losses related to superconducting quasiparticles.


title: Distributed adaptive stabilization

abstract: In this paper we consider distributed adaptive stabilization for uncertain multivariable linear systems with a time-varying diagonal matrix gain. We show that uncertain multivariable linear systems are stabilizable by diagonal matrix high gains if the system matrix is an H-matrix with positive diagonal entries. Based on matrix measure and stability theory for diagonally dominant systems, we consider two classes of uncertain linear systems, and derive a threshold condition to ensure their exponential stability by a monotonically increasing diagonal gain matrix. When each individual gain function in the matrix gain is updated by state-dependent functions using only local state information, the boundedness and convergence of both system states and adaptive matrix gains are guaranteed. We apply the adaptive distributed stabilization approach to adaptive synchronization control for large-scale complex networks consisting of nonlinear node dynamics and time-varying coupling weights. A unified framework for adaptive synchronization is proposed that includes several general design approaches for adaptive coupling weights to guarantee network synchronization.

categories: eess.SY cs.DC cs.MA cs.SY math.OC nlin.AO


title: Online Hate: Behavioural Dynamics and Relationship with Misinformation

abstract: Online debates are often characterised by extreme polarisation and heated discussions among users. The presence of hate speech online is becoming increasingly problematic, making necessary the development of appropriate countermeasures. In this work, we perform hate speech detection on a corpus of more than one million comments on YouTube videos through a machine learning model fine-tuned on a large set of hand-annotated data. Our analysis shows that there is no evidence of the presence of "serial haters", intended as active users posting exclusively hateful comments. Moreover, coherently with the echo chamber hypothesis, we find that users skewed towards one of the two categories of video channels (questionable, reliable) are more prone to use inappropriate, violent, or hateful language within their opponents community. Interestingly, users loyal to reliable sources use on average a more toxic language than their counterpart. Finally, we find that the overall toxicity of the discussion increases with its length, measured both in terms of number of comments and time. Our results show that, coherently with Godwin's law, online debates tend to degenerate towards increasingly toxic exchanges of views.


title: Casimir effect in Very Special Relativity at finite temperature

abstract: Recently a great deal of interest in field theories formulated in a Lorentz violating framework has been developed. Here the Very Special Relativity (VSR) is considered. The main aspect in the VSR proposal is that laws of physics are invariant under the subgroups of the Poincar\'e group preserving the basic elements of special relativity. An important point is that the photon acquires a mass. In this context, the energy-momentum tensor for the electromagnetic field is calculated. From this, the Stefan-Boltzmann law and Casimir effect at finite temperature in VSR are obtained. The effects of temperature are introduced using the Thermo Field Dynamics (TFD) formalism. A comparative analysis with the Casimir effect for the standard electromagnetic case is developed.


title: Branching fraction measurements of the rare $B^0_s\rightarrow\phi\mu^+\mu^-$ and $B^0_s\rightarrow f_2^\prime(1525)\mu^+\mu^-$ decays

abstract: The branching fraction of the rare $B^0_s\rightarrow\phi\mu^+\mu^-$ decay is measured using data collected by the LHCb experiment at center-of-mass energies of $7$, $8$ and $13\,\rm{TeV}$, corresponding to integrated luminosities of $1$, $2$ and $6\,{\rm fb}^{-1}$, respectively. The branching fraction is reported in intervals of $q^2$, the square of the dimuon invariant mass. In the $q^2$ region between $1.1$ and $6.0\,{\rm Ge\kern -0.1em V}^2\!/c^4$, the measurement is found to lie $3.6$ standard deviations below a Standard Model prediction based on a combination of Light Cone Sum Rule and Lattice QCD calculations. In addition, the first observation of the rare $B^0_s\rightarrow f_2^\prime(1525)\mu^+\mu^-$ decay is reported with a statistical significance of nine standard deviations and its branching fraction is determined.


title: Designing a Plasma Lens as a Matching Device for the ILC Positron Source

abstract: To realise a planned high-luminosity and high-energy $e^+e^-$-collider, as the ILC, a large amount of positrons have to be produced and the accelerated particles have to be captured and matched according to the damping ring acceptances. %There exist several technical possibilities. In this contribution a new promising alternative method for capturing positrons will be presented, the application of the plasma lens as an optical matching device. It will be compared with the current matching device proposed for the ILC, namely the quarter wave transformer. An advantage of the plasma lens is the different magnetic field component, which focuses the divergent beam in a more effective manner. Therefore it will be shown in this paper that the yield requirements could be achieved more easily. The plasma lens can actually be a promising alternative for focusing beams as soon as the technical feasibility has been approved.\\ In the simulation, a tapered active plasma lens has been optimized using the approximation of a homogeneous electric current density constant in time. The optimization process led to a plasma lens design that improves on the ILC's currently proposed optical matching device, namely the quarter wave transformer, by approximately $50-100\%$. Furthermore the design has been shown to guarantee a stable captured positron yield within $\pm1.5\%$ for single, independent parameter deviations of about $\pm10\%$.


title: Iris Liveness Detection using a Cascade of Dedicated Deep Learning Networks

abstract: Iris pattern recognition has significantly improved the biometric authentication field due to its high stability and uniqueness. Such physical characteristics have played an essential role in security and other related areas. However, presentation attacks, also known as spoofing techniques, can bypass biometric authentication systems using artefacts such as printed images, artificial eyes, textured contact lenses, etc. Many liveness detection methods that improve the security of these systems have been proposed. The first International Iris Liveness Detection competition, where the effectiveness of liveness detection methods is evaluated, was first launched in 2013, and its latest iteration was held in 2020. This paper proposes a serial architecture based on a MobileNetV2 modification, trained from scratch to classify bona fide iris images versus presentation attack images. The bona fide class consists of live iris images, whereas the attack presentation instrument classes are comprised of cadaver, printed, and contact lenses images, for a total of four scenarios. All the images were pre-processed and weighted per class to present a fair evaluation. This proposal won the LivDet-Iris 2020 competition using two-class scenarios. Additionally, we present new three-class and four-class scenarios that further improve the competition results. This approach is primarily focused in detecting the bona fide class over improving the detection of presentation attack instruments. For the two, three, and four classes scenarios, an Equal Error Rate (EER) of 4.04\%, 0.33\%, and 4,53\% was obtained respectively. Overall, the best serial model proposed, using three scenarios, reached an ERR of 0.33\% with an Attack Presentation Classification Error Rate (APCER) of 0.0100 and a Bona Fide Classification Error Rate (BPCER) of 0.000. This work outperforms the LivDet-Iris 2020 competition results.


title: Hierarchical microphase separation in non-conserved active mixtures

abstract: Non-equilibrium phase separating systems with reactions can break time-reversal symmetry (TRS) in two distinct ways. Firstly, the conservative and non-conservative sectors of the dynamics can be governed by incompatible free energies; when both sectors are present, this is the leading-order TRS violation, captured in its simplest form by 'Model AB'. Second, the diffusive dynamics can break TRS in its own right. This happens only at higher order in the gradient expansion (but is the leading behaviour without reactions present) and is captured by 'Active Model B+' (AMB+). Each of the two mechanisms can lead to microphase separation, by quite different routes. Here we introduce Model AB+, for which both mechanisms are simultaneously present, and show that for slow reaction rates the system can undergo a new type of hierarchical microphase separation, whereby a continuous phase of fluid 1 contains large droplets of fluid 2 within which small droplets of fluid 1 are continuously created and then absorbed into the surrounding fluid-1 phase. In this state of 'bubbly microphase separation' the small-scale 1-in-2 droplets arise by the conservative diffusive dynamics with the larger scale 2-in-1 structure governed by the nonconservative reactions.


title: Autonomous dissipative Maxwell's demon in a diamond spin qutrit

abstract: Engineered dynamical maps combining coherent and dissipative transformations of quantum states with quantum measurements, have demonstrated a number of technological applications, and promise to be a crucial tool in quantum thermodynamic processes. Here, we exploit the control on the effective open spin qutrit dynamics of an NV center, to experimentally realize an autonomous feedback process (Maxwell demon) with tunable dissipative strength. The feedback is enabled by random measurement events that condition the subsequent dissipative evolution of the qutrit. The efficacy of the autonomous Maxwell demon is quantified by experimentally characterizing the fluctuations of the energy exchanged by the system with the environment by means of a generalized Sagawa-Ueda-Tasaki relation for dissipative dynamics. This opens the way to the implementation of a new class of Maxwell demons, which could be useful for quantum sensing and quantum thermodynamic devices.


title: Note on Artin's Conjecture on Primitive Roots

abstract: E. Artin conjectured that any integer $a >1$ which is not a perfect square is a primitive root modulo $p$ for infinitely many primes $p.$ Let $f_a(p)$ be the multiplicative order of the non-square integer $a$ modulo the prime $p.$ M. R. Murty and S. Srinivasan [10] showed that if $\sum_{p<x} \frac 1 {f_a(p)}= O(x^{1/4})$ then Artin's conjecture is true for $a.$ We relate the Murty-Srinivasan condition to sums involving the cyclotomic periods from the subfields of $\mathbb Q(e^{2{\pi}i/p})$ corresponding to the subgroups $<a> \subseteq \mathbb F*_p.$


title: Feature extraction and evaluation for BioMedical Question Answering

abstract: In this paper, we present our work on the BioASQ pipeline. The goal is to answer four types of questions: summary, yes/no, factoids, and list. Our goal is to empirically evaluate different modules involved: the feature extractor and the sentence selection block. We used our pipeline to test the effectiveness of each module for all kinds of question types and perform error analysis. We defined metrics that are useful for future research related to the BioASQ pipeline critical to improve the performance of the training pipeline.


title: Unraveling the Excitonic Transition and Associated Dynamics in Confined Long Linear Carbon-chains with Time-Resolved Resonance Raman Scattering

abstract: Long linear carbon-chains have been attracting intense interest arising from the remarkable properties predicted and their potential applications in future nanotechnology. Here we comprehensively interrogate the excitonic transitions and the associated relaxation dynamics of nanotube confined long linear carbon-chains by using steady state and time-resolved Raman spectroscopies. The exciton relaxation dynamics on the confined carbon-chains occurs on a hundreds of picoseconds timescale, in strong contrast to the host dynamics that occurs on a few picosecond timescale. A prominent time-resolved Raman response is observed over a broad energy range extending from 1.2 to 2.8 eV, which includes the strong Raman resonance region around 2.2 eV. Evidence for a strong coupling between the chain and the nanotube host is found from the dynamics at high excitation energies which provides a clear evidence for an efficient energy transfer from the host carbon nanotube to the chain. Our experimental study presents the first unique characterization of the long linear carbon-chain exciton dynamics, providing indispensable knowledge for the understanding of the interactions between different carbon allotropes.


title: Generic monodromy group of Riemann surfaces for inverses to entire functions of finite order

abstract: We consider the vector space $E_{\rho,p}$ of entire functions of finite order, whose types are not more than $p>0$, endowed with Frechet topology, which is generated by a sequence of weighted norms. We call a function $f\in E_{\rho,p}$ {\it typical} if it is surjective and has an infinite number critical points such that each of them is non-degenerate and all the values of $f$ at these points are pairwise different. We prove that the set of all typical functions contains a set which is $G_\delta$ and dense in $E_{\rho,p}$. Furthermore, we show that inverse to any typical function has Riemann surface whose monodromy group coincides with finitary symmetric group of permutations of naturals, which is unsolvable in the following strong sense: it does not have a normal tower of subgroups, whose factor groups are or abelian or finite. As a consequence from these facts and Topological Galois Theory, we obtain that generically (in the above sense) for $f\in E_{\rho,p}$ the solution of equation $f(w)=z$ cannot be represented via $z$ and complex constants by a finite number of the following actions: algebraic operations (i.e., rational ones and solutions of polynomial equations) and quadratures (in particular, superpositions with elementary functions).


title: Sample-Efficient Reinforcement Learning for Linearly-Parameterized MDPs with a Generative Model

abstract: The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with sampling access to a generative model, the minimax optimal sample complexity scales linearly with $|\mathcal{S}|\times|\mathcal{A}|$, which can be prohibitively large when $\mathcal{S}$ or $\mathcal{A}$ is large. This paper considers a Markov decision process (MDP) that admits a set of state-action features, which can linearly express (or approximate) its probability transition kernel. We show that a model-based approach (resp.$~$Q-learning) provably learns an $\varepsilon$-optimal policy (resp.$~$Q-function) with high probability as soon as the sample size exceeds the order of $\frac{K}{(1-\gamma)^{3}\varepsilon^{2}}$ (resp.$~$$\frac{K}{(1-\gamma)^{4}\varepsilon^{2}}$), up to some logarithmic factor. Here $K$ is the feature dimension and $\gamma\in(0,1)$ is the discount factor of the MDP. Both sample complexity bounds are provably tight, and our result for the model-based approach matches the minimax lower bound. Our results show that for arbitrarily large-scale MDP, both the model-based approach and Q-learning are sample-efficient when $K$ is relatively small, and hence the title of this paper.

categories: cs.LG cs.IT math.IT math.OC math.ST stat.ML stat.TH


title: Einselection, Equilibrium and Cosmology

abstract: Our observed Universe has a very strong arrow of time rooted in its low entropy starting point. This low entropy start can be related to various "tuning puzzles" about the early state of the Universe. Here we explore the relationship between the arrow of time and the emergence of classical from quantum in the hopes of ultimately gaining insights into cosmological initial conditions. Our focus is on einselection, the process whereby interactions with an environment select preferred states for a quantum system. This process plays an essential role in the emergence of classical from quantum. Studies of einselection have so far been limited to cases that exhibit an arrow of time. Here we study the ability of equilibrium systems to exhibit einselection -- and investigate whether detailed balance prevents this -- motivated by the question of whether classicality requires an arrow of time. We present calculations in the adapted Caldeira-Leggett model which demonstrate that einselection can indeed take place in equilibrium systems, and show how this phenomenon is tied to histories which express an arrow of time, despite the global equilibrium. We discuss some interesting implications of our results for cosmology and cosmological initial conditions. We are intrigued and a bit surprised by the role the consistent histories formalism has ended up playing in our analysis.


title: Structural Origins of Cartilage Shear Mechanics

abstract: Healthy cartilage is a remarkable tissue, able to withstand tens of millions of loading cycles with minimal damage. While much is known about the structural origins of its compressive mechanics, how composition determines its mechanical behavior in shear, a major mode of failure, is poorly understood. Through a combination of microscale structure-function experiments and modeling, we develop a rigidity percolation framework to explain the structural origins of cartilage shear mechanics. This framework provides a new quantitative understanding for how the known degradative events in osteoarthritis determine the mechanical changes that are a hallmark of this disease. As such, this work provides a road map for understanding disease progression and in combination with non-invasive techniques such as MRI will enable more effective diagnosis and treatment.


title: Semileptonic form factors for $B \to D^\ast\ell\nu$ at nonzero recoil from 2 + 1-flavor lattice QCD

abstract: We present the first unquenched lattice-QCD calculation of the form factors for the decay $B\rightarrow D^\ast\ell\nu$ at nonzero recoil. Our analysis includes 15 MILC ensembles with $N_f=2+1$ flavors of asqtad sea quarks, with a strange quark mass close to its physical mass. The lattice spacings range from $a\approx 0.15$ fm down to $0.045$ fm, while the ratio between the light- and the strange-quark masses ranges from 0.05 to 0.4. The valence $b$ and $c$ quarks are treated using the Wilson-clover action with the Fermilab interpretation, whereas the light sector employs asqtad staggered fermions. We extrapolate our results to the physical point in the continuum limit using rooted staggered heavy-light meson chiral perturbation theory. Then we apply a model-independent parametrization to extend the form factors to the full kinematic range. With this parametrization we perform a joint lattice-QCD/experiment fit using several experimental datasets to determine the CKM matrix element $|V_{cb}|$. We obtain $\left|V_{cb}\right| = (38.40 \pm 0.68_{\textrm{th}} \pm 0.34_{\textrm{exp}} \pm 0.18_{\textrm{EM}})\times 10^{-3}$. The first error is theoretical, the second comes from experiment and the last one includes electromagnetic and electroweak uncertainties, with an overall $\chi^2\text{/dof} = 126/84$, which illustrates the tensions between the experimental data sets, and between theory and experiment. This result is in agreement with previous exclusive determinations, but the tension with the inclusive determination remains. Finally, we integrate the differential decay rate obtained solely from lattice data to predict $R(D^\ast) = 0.265 \pm 0.013$, which confirms the current tension between theory and experiment.


title: First Dark Matter Search Results From Coherent CAPTAIN-Mills

abstract: This paper describes the operation of the Coherent CAPTAIN-Mills (CCM) detector located at the Lujan Neutron Science Center (LANSCE) at Los Alamos National Laboratory (LANL). CCM is a 10-ton liquid argon (LAr) detector located 20 meters from a high flux neutron/neutrino source and is designed to search for sterile neutrinos ($\nu_s$) and light dark matter (LDM). An engineering run was performed in Fall 2019 to study the characteristics of the CCM120 detector by searching for coherent scattering signals consistent with $\nu_s$'s and LDM resulting from $\pi^+$ and $\pi^0$ decays in the tungsten target. New parameter space in a leptophobic dark matter model was excluded for DM masses between $\sim2.0$ and 30 MeV. The lessons learned from this run have guided the development and construction of the new CCM200 detector that will begin operations in 2021 and significantly improve on these searches.


title: Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Merging

abstract: Neural networks have shown great abilities in estimating depth from a single image. However, the inferred depth maps are well below one-megapixel resolution and often lack fine-grained details, which limits their practicality. Our method builds on our analysis on how the input resolution and the scene structure affects depth estimation performance. We demonstrate that there is a trade-off between a consistent scene structure and the high-frequency details, and merge low- and high-resolution estimations to take advantage of this duality using a simple depth merging network. We present a double estimation method that improves the whole-image depth estimation and a patch selection method that adds local details to the final result. We demonstrate that by merging estimations at different resolutions with changing context, we can generate multi-megapixel depth maps with a high level of detail using a pre-trained model.


title: Transition, intermittency and phase interference effects in airfoil secondary tones and acoustic feedback loop

abstract: A large eddy simulation is performed to study secondary tones generated by a NACA0012 airfoil at angle of attack of $\alpha = 3^{\circ}$ with freestream Mach number of $M_{\infty} = 0.3$ and Reynolds number of $Re = 5 \times 10^4$. Laminar separation bubbles are observed over the suction side and near the trailing edge, on the pressure side. Flow visualization and spectral analysis are employed to investigate vortex shedding aft of the suction side separation bubble. Vortex interaction results in merging or bursting such that coherent structures or turbulent packets are advected towards the trailing edge leading to different levels of noise emission. Despite the intermittent occurrence of laminar-turbulent transition, the noise spectrum depicts a main tone with multiple equidistant secondary tones. To understand the role of flow instabilities on the tones, the linearized Navier-Stokes equations are examined in its operator form through bi-global stability and resolvent analyses, and by time evolution of disturbances using a matrix-free method. These linear global analyses reveal amplification of disturbances over the suction side separation bubble. Non-normality of the linear operator leads to further transient amplification due to modal interaction among eigenvectors. Two-point, one time autocovariance calculations of pressure along the spanwise direction elucidate aspects of the acoustic feedback loop mechanism in the non-linear solutions. This feedback process is self-sustained by acoustic waves radiated from the trailing edge, which reach the most sensitive flow location between the leading edge and the separation bubble, as identified by the resolvent analysis. Leading edge disturbances arising from secondary diffraction and phase interference among the most unstable frequencies computed in the eigenspectrum are also shown to have an important role in the feedback loop.


title: Z-portal Continuum Dark Matter

abstract: We examine the possibility that dark matter (DM) consists of a gapped continuum, rather than ordinary particles. A Weakly-Interacting Continuum (WIC) model, coupled to the Standard Model via a Z-portal, provides an explicit realization of this idea. The thermal DM relic density in this model is naturally consistent with observations, providing a continuum counterpart of the "WIMP miracle". Direct detection cross sections are strongly suppressed compared to ordinary Z-portal WIMP, thanks to a unique effect of the continuum kinematics. Continuum DM states decay throughout the history of the universe, and observations of cosmic microwave background place constraints on potential late decays. Production of WICs at colliders can provide a striking cascade-decay signature. We show that a simple Z-portal WIC model provides a fully viable DM candidate consistent with all current experimental constraints.


title: Near-Optimal Multi-Perturbation Experimental Design for Causal Structure Learning

abstract: Causal structure learning is a key problem in many domains. Causal structures can be learnt by performing experiments on the system of interest. We address the largely unexplored problem of designing a batch of experiments that each simultaneously intervene on multiple variables. While potentially more informative than the commonly considered single-variable interventions, selecting such interventions is algorithmically much more challenging, due to the doubly-exponential combinatorial search space over sets of composite interventions. In this paper, we develop efficient algorithms for optimizing different objective functions quantifying the informativeness of a budget-constrained batch of experiments. By establishing novel submodularity properties of these objectives, we provide approximation guarantees for our algorithms. Our algorithms empirically perform superior to both random interventions and algorithms that only select single-variable interventions.


title: Discovery of a radio halo (and relic) in a $M_{500} < 2 \times 10^{14}$ M$_\odot$ cluster

abstract: Radio halos are diffuse synchrotron sources observed in dynamically unrelaxed galaxy clusters. Current observations and models suggest that halos trace turbulent regions in the intra-cluster medium where mildly relativistic particles are re-accelerated during cluster mergers. Due to the higher luminosities and detection rates with increasing cluster mass, radio halos have been mainly observed in massive systems ($M_{500} \gtrsim 5 \times10^{14}$ M$_\odot$). Here, we report the discovery of a radio halo with a largest linear scale of $\simeq$750 kpc in PSZ2G145.92-12.53 ($z=0.03$) using LOFAR observations at 120$-$168 MHz. With a mass of $M_{500} = (1.9\pm0.2) \times 10^{14}$ M$_\odot$ and a radio power at 150 MHz of $P_{150} = (3.5 \pm 0.7) \times 10^{23}$ W/Hz, this is the least powerful radio halo in the least massive cluster discovered to date. Additionally, we discover a radio relic with a mildly convex morphology at $\sim$1.7 Mpc from the cluster center. Our results demonstrate that LOFAR has the potential to detect radio halos even in low-mass clusters, where the expectation to form them is very low ($\sim$5%) based on turbulent re-acceleration models. Together with the observation of large samples of clusters, this opens the possibility to constrain the low end of the power-mass relation of radio halos.


title: Energetic Explosions from Collisions of Stars at Relativistic Speeds in Galactic Nuclei

abstract: We consider collisions between stars moving near the speed of light around supermassive black holes (SMBHs), with mass $M_{\bullet}\gtrsim10^8\,M_{\odot}$, without being tidally disrupted. The overall rate for collisions taking place in the inner $\sim1$ pc of galaxies with $M_{\bullet}=10^8,10^9,10^{10}\,M_{\odot}$ are $\Gamma\sim5,0.07,0.02$ yr$^{-1}$, respectively. We further calculate the differential collision rate as a function of total energy released, energy released per unit mass lost, and galactocentric radius. The most common collisions will release energies on the order of $\sim10^{49}-10^{51}$ erg, with the energy distribution peaking at higher energies in galaxies with more massive SMBHs. Depending on the host galaxy mass and the depletion timescale, the overall rate of collisions in a galaxy ranges from a small percentage to several times larger than that of core-collapse supernovae (CCSNe) for the same host galaxy. In addition, we show example light curves for collisions with varying parameters, and find that the peak luminosity could reach or even exceed that of superluminous supernovae (SLSNe), although with light curves with much shorter duration. Weaker events could initially be mistaken for low-luminosity supernovae. In addition, we note that these events will likely create streams of debris that will accrete onto the SMBH and create accretion flares that may resemble tidal disruption events (TDEs).


title: The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

abstract: We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 Billion simulated LHC events corresponding to $10~\rm{fb}^{-1}$ of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.


title: Eclipsing White Dwarf Binaries in Gaia and the Zwicky Transient Facility

abstract: Gaia provided the largest-ever catalogue of white dwarf stars. We use this catalogue, along with the third public data release of the Zwicky Transient Facility (ZTF), to identify new eclipsing white dwarf binaries. Our method exploits light curve statistics and the Box Least Squares algorithm to detect periodic light curve variability. The search revealed 18 new binaries, of which 17 are eclipsing. We use the position in the Gaia H-R diagram to classify these binaries and find that the majority of these white dwarfs have main sequence companions. We identify one system as a candidate eclipsing white dwarf--brown dwarf binary and a further two as extremely low mass (ELM) white dwarf binaries. We also provide identification spectroscopy for 17 of our 18 binaries. Running our search method on mock light curves with real ZTF sampling, we estimate our efficiency of detecting objects with light curves similar to the ones of the newly discovered binaries. Many more binaries are to be found in the ZTF footprint as the data releases grow, so our survey is ongoing.


title: Scalar Leptoquarks, Baryon Number Violation and Pati-Salam Symmetry

abstract: One or more scalar leptoquarks with masses around a few TeV may provide a solution to some of the flavor anomalies that have been observed. We discuss the impact of such new degrees on baryon number violation when the theory is embedded in a Pati-Salam model. The Pati-Salam embedding can suppress renormalizable and dimension-five baryon number violation in some cases. Our work extends the results of Assad, Grinstein, and Fornal who considered the same issue for vector leptoquarks.


title: Weighing the Galactic disk using phase-space spirals II. Most stringent constraints to a thin dark disk using Gaia EDR3

abstract: Using the method that was developed in the first paper of this series, we measure the vertical gravitational potential of the Galactic disk from the time-varying structure of the phase-space spiral, using data from Gaia as well as supplementary radial velocity information from legacy spectroscopic surveys. For eleven independent data samples, we inferred gravitational potentials that were in good agreement, despite the data samples' varied and substantial selection effects. Using a model for the baryonic matter densities, we inferred a local halo dark matter density of $0.0085 \pm 0.0039$ M$_\odot$/pc$^3 = 0.32 \pm 0.15$ GeV/cm$^3$. We were also able to place the most stringent constraint to the surface density of a thin dark disk with a scale height $\leq 50$ pc: an upper 95 % confidence limit of roughly 5 M$_\odot$/pc$^2$ (compared to previous limit of roughly 10 M$_\odot$/pc$^2$, given the same scale height). For the inferred halo dark matter density and thin dark disk surface density, the uncertainties are dominated by the baryonic model. With this level of precision, our method is highly competitive with traditional methods that rely on the assumption of a steady state. In a general sense, this illustrates that time-varying dynamical structures are not solely obstacles to dynamical mass measurements, but can also be regarded as assets containing useful information.


title: Where Do Obscured AGN Fit in A Galaxy's Timeline?

abstract: Many X-ray bright active galactic nuclei (AGN) are predicted to follow an extended stage of obscured black hole growth. In support of this picture we examine the X-ray undetected AGNs in the COSMOS field and compare their host galaxies with X-ray bright AGNs. We examine galaxies with M_\ast>10^{9.5}M_\odot for the presence of AGNs at redshifts $z=0.5-3$. We select AGNs in the infrared using \textit{Spitzer} and \textit{Herschel} detections and use color selection techniques to select AGNs within strongly star forming hosts. We stack \textit{Chandra} X-ray data of galaxies with an IR detection but lacking an X-ray detection to obtain soft and hard fluxes, allowing us to measure the energetics of these AGNs. We find a clear correlation between X-ray luminosity and IR AGN luminosity in the stacked galaxies. We also find that X-ray undetected AGNs all lie on the main sequence -- the tight correlation between SFR and $M_\ast$ that holds for the majority of galaxies, regardless of mass or redshift. This work demonstrates that there is a higher population of obscured AGNs than previously thought.


title: Copycat process in the early stages of einselection

abstract: We identify and describe unique early time behavior of a quantum system initially in a superposition, interacting with its environment. This behavior -- the copycat process -- occurs after the system begins to decohere, but before complete einselection. To illustrate this behavior analytic solutions for the system density matrix, its eigenvalues, and eigenstates a short time after system-environment interactions begin are provided. Features of the solutions and their connection to observables are discussed, including predictions for the continued evolution of the eigenstates towards einselection, time dependence of spin expectation values, and an estimate of the system's decoherence time. In particular we explore which aspects of the early stages of decoherence exhibit quadratic evolution to leading order, and which aspects exhibit more rapid linear behavior. Many features of our early time perturbative solutions are agnostic of the spectrum of the environment. We also extend our work beyond short time perturbation theory to compare with numerical work from a companion paper.


title: An Inexact Projected Gradient Method with Rounding and Lifting by Nonlinear Programming for Solving Rank-One Semidefinite Relaxation of Polynomial Optimization

abstract: We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new algorithmic framework that blends local search using the nonconvex POP into global descent using the convex SDP. In particular, we first design a globally convergent inexact projected gradient method (iPGM) for solving the SDP that serves as the backbone of our framework. We then accelerate iPGM by taking long, but safeguarded, rank-one steps generated by fast nonlinear programming algorithms. We prove that the new framework is still globally convergent for solving the SDP. To solve the iPGM subproblem of projecting a given point onto the feasible set of the SDP, we design a two-phase algorithm with phase one using a symmetric Gauss-Seidel based accelerated proximal gradient method (sGS-APG) to generate a good initial point, and phase two using a modified limited-memory BFGS (L-BFGS) method to obtain an accurate solution. We analyze the convergence for both phases and establish a novel global convergence result for the modified L-BFGS that does not require the objective function to be twice continuously differentiable. We conduct numerical experiments for solving second-order SDP relaxations arising from a diverse set of POPs. Our framework demonstrates state-of-the-art efficiency, scalability, and robustness in solving degenerate rank-one SDPs to high accuracy, even in the presence of millions of equality constraints.


title: Signatures of Weyl fermion annihilation in a correlated kagome magnet

abstract: The manipulation of topological states in quantum matter is an essential pursuit of fundamental physics and next-generation quantum technology. Here we report the magnetic manipulation of Weyl fermions in the kagome spin-orbit semimetal Co$_3$Sn$_2$S$_2$, observed by high-resolution photoemission spectroscopy. We demonstrate the exchange collapse of spin-orbit-gapped ferromagnetic Weyl loops into paramagnetic Dirac loops under suppression of the magnetic order. We further observe that topological Fermi arcs disappear in the paramagnetic phase, suggesting the annihilation of exchange-split Weyl points. Our findings indicate that magnetic exchange collapse naturally drives Weyl fermion annihilation, opening new opportunities for engineering topology under correlated order parameters.


title: DeepMoM: Robust Deep Learning With Median-of-Means

abstract: Data used in deep learning is notoriously problematic. For example, data are usually combined from diverse sources, rarely cleaned and vetted thoroughly, and sometimes corrupted on purpose. Intentional corruption that targets the weak spots of algorithms has been studied extensively under the label of "adversarial attacks." In contrast, the arguably much more common case of corruption that reflects the limited quality of data has been studied much less. Such "random" corruptions are due to measurement errors, unreliable sources, convenience sampling, and so forth. These kinds of corruption are common in deep learning, because data are rarely collected according to strict protocols -- in strong contrast to the formalized data collection in some parts of classical statistics. This paper concerns such corruption. We introduce an approach motivated by very recent insights into median-of-means and Le Cam's principle, we show that the approach can be readily implemented, and we demonstrate that it performs very well in practice. In conclusion, we believe that our approach is a very promising alternative to standard parameter training based on least-squares and cross-entropy loss.


title: On multivariable matrix spectral factorization method

abstract: Spectral factorization is a prominent tool with several important applications in various areas of applied science. Wiener and Masani proved the existence of matrix spectral factorization. Their theorem has been extended to the multivariable case by Helson and Lowdenslager. Solving the problem numerically is challenging in both situations, and also important due to its practical applications. Therefore, several authors have developed algorithms for factorization. The Janashia-Lagvilava algorithm is a relatively new method for matrix spectral factorization which has proved to be useful in several applications. In this paper, we extend this method to the multivariable case. Consequently, a new numerical algorithm for multivariable matrix spectral factorization is constructed.


title: Existence and regularity for a system of porous medium equations with small cross-diffusion and nonlocal drifts

abstract: We prove existence and Sobolev regularity of solutions of a nonlinear system of degenerate-parabolic PDEs with self- and cross-diffusion, transport/confinement and nonlocal interaction terms. The macroscopic system of PDEs is formally derived from a large particle system and models the evolution of an arbitrary number of species with quadratic porous-medium interactions in a bounded domain $\Omega$ in any spatial dimension. The cross interactions between different species are scaled by a parameter $\delta<1$, with the $\delta= 0$ case corresponding to no interactions across species. A smallness condition on $\delta$ ensures existence of solutions up to an arbitrary time $T>0$ in a subspace of $L^2(0,T;H^1(\Omega))$. This is shown via a Schauder fixed point argument for a regularised system combined with a vanishing diffusivity approach. The behaviour of solutions for extreme values of $\delta$ is studied numerically.


title: Learning to Extend Program Graphs to Work-in-Progress Code

abstract: Source code spends most of its time in a broken or incomplete state during software development. This presents a challenge to machine learning for code, since high-performing models typically rely on graph structured representations of programs derived from traditional program analyses. Such analyses may be undefined for broken or incomplete code. We extend the notion of program graphs to work-in-progress code by learning to predict edge relations between tokens, training on well-formed code before transferring to work-in-progress code. We consider the tasks of code completion and localizing and repairing variable misuse in a work-in-process scenario. We demonstrate that training relation-aware models with fine-tuned edges consistently leads to improved performance on both tasks.


title: Towards mental time travel: a hierarchical memory for reinforcement learning agents

abstract: Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to recall the details of a single timestep that is followed by distractor tasks. To address these limitations, we propose a Hierarchical Chunk Attention Memory (HCAM), which helps agents to remember the past in detail. HCAM stores memories by dividing the past into chunks, and recalls by first performing high-level attention over coarse summaries of the chunks, and then performing detailed attention within only the most relevant chunks. An agent with HCAM can therefore "mentally time-travel" -- remember past events in detail without attending to all intervening events. We show that agents with HCAM substantially outperform agents with other memory architectures at tasks requiring long-term recall, retention, or reasoning over memory. These include recalling where an object is hidden in a 3D environment, rapidly learning to navigate efficiently in a new neighborhood, and rapidly learning and retaining new object names. Agents with HCAM can extrapolate to task sequences much longer than they were trained on, and can even generalize zero-shot from a meta-learning setting to maintaining knowledge across episodes. HCAM improves agent sample efficiency, generalization, and generality (by solving tasks that previously required specialized architectures). Our work is a step towards agents that can learn, interact, and adapt in complex and temporally-extended environments.