title: Measurement and Simulation of the Neutron Propagation Time Distribution inside a Neutron Monitor

abstract: Using a setup for testing a prototype for a satellite-borne cosmic-ray ion detector, we have operated a stack of scintillator and silicon detectors on top of the Princess Sirindhorn Neutron Monitor (PSNM), an NM64 detector at 2560-m altitude at Doi Inthanon, Thailand (18.59 N, 98.49 E). Monte Carlo simulations have indicated that about 15% of the neutron counts by PSNM are due to interactions (mostly in the lead producer) of GeV-range protons among the atmospheric secondary particles from cosmic ray showers, which can be detected by the scintillator and silicon detectors. Those detectors can provide a timing trigger for measurement of the propagation time distribution of such neutrons as they scatter and propagate through the NM64, processes that are similar whether the interaction was initiated by an energetic proton (for 15% of the count rate) or neutron (for 80% of the count rate). This propagation time distribution underlies the time delay distribution between successive neutron counts, from which we can determine the leader fraction (inverse multiplicity), which has been used to monitor Galactic cosmic ray spectral variations over $\sim$1-40 GV. Here we have measured and characterized the propagation time distribution from both the experimental setup and Monte Carlo simulations of atmospheric secondary particle detection. We confirm a known propagation time distribution with a peak (at $\approx$70 microseconds) and tail over a few ms, dominated by neutron counts. We fit this distribution using an analytic model of neutron diffusion and absorption, for both experimental and Monte Carlo results. In addition we identify a group of prompt neutron monitor pulses that arrive within 20 microseconds of the charged-particle trigger, of which a substantial fraction can be attributed to charged-particle ionization in a proportional counter, according to both experimental and Monte Carlo ...


title: A Molecular Hyper-message Passing Network with Functional Group Information

abstract: We proposed the molecular hyper-message passing network (MolHMPN) that predicts the properties of a molecule with prior knowledge-guided subgraph. Modeling higher-order connectivities in molecules is necessary as changes in both the pair-wise and higher-order interactions among atoms results in the change of molecular properties. Many approaches have attempted to model the higher-order connectivities. However, those methods relied heavily on data-driven approaches, and it is difficult to determine if the utilized subgraphs contain any properties of interest or have any significance on the molecular properties. Hence, we propose MolHMPN to utilize the functional group prior knowledge and model the pair-wise and higher-order connectivities among the atoms in a molecule. Molecules can contain many types of functional groups, which affect the properties the molecules. For example, the toxicity of a molecule is associated with toxicophores, such as nitroaromatic groups and thiourea. MolHMPN uses functional groups to construct hypergraphs, modifies the hypergraph using domain knowledge-guided modification scheme, embeds the graph and hypergraph inputs using a hypergraph message passing (HyperMP) layer, and uses the updated graph and hypergraph embeddings to predict the properties of the molecules. Our model provides a way to utilize prior knowledge in chemistry for molecular properties prediction tasks, and balance between the usage of prior knowledge and data-driven modification adaptively. We show that our model is able to outperform the other baseline methods for most of the dataset, and show that using domain knowledge-guided data-learning iseffective.


title: Polarization doping ab initio verification of the concept charge conservation and nonlocality

abstract: In this work, we study the emergence of polarization doping in AlxGa1-xN layers with graded composition from a theoretical viewpoint. We demonstrate that the charge conservation law applies for fixed and mobile charges separately, leading to nonlocal compensation phenomena involving bulk fixed and mobile charge and polarization sheet charge at the heterointerfaces. The magnitude of the effect allows obtaining technically viable mobile charge density for optoelectronic devices without impurity doping (donors or acceptors). Therefore, it provides an additional tool for the device designer, with the potential to attain high conductivities: high carrier concentrations can be obtained even in materials with high dopant ionization energies, and the mobility is not limited by scattering at ionized impurities.


title: Some Complexity Results for Stateful Network Verification

abstract: In modern networks, forwarding of packets often depends on the history of previously transmitted traffic. Such networks contain stateful middleboxes, whose forwarding behaviour depends on a mutable internal state. Firewalls and load balancers are typical examples of stateful middleboxes. This work addresses the complexity of verifying safety properties, such as isolation, in networks with finite-state middleboxes. Unfortunately, we show that even in the absence of forwarding loops, reasoning about such networks is undecidable due to interactions between middleboxes connected by unbounded ordered channels. We therefore abstract away channel ordering. This abstraction is sound for safety, and makes the problem decidable. Specifically, safety checking becomes EXPSPACE-complete in the number of hosts and middleboxes in the network. To tackle the high complexity, we identify two useful subclasses of finite-state middleboxes which admit better complexities. The simplest class includes, e.g., firewalls and permits polynomial-time verification. The second class includes, e.g., cache servers and learning switches, and makes the safety problem coNP-complete. Finally, we implement a tool for verifying the correctness of stateful networks.


title: Topology Inference for Network Systems: Causality Perspective and Non-asymptotic Performance

abstract: Topology inference for network systems (NSs) plays a crucial role in many areas. This paper advocates a causality-based method based on noisy observations from a single trajectory of a NS, which is represented by the state-space model with general directed topology. Specifically, we first prove its close relationships with the ideal Granger estimator for multiple trajectories and the traditional ordinary least squares (OLS) estimator for a single trajectory. Along with this line, we analyze the non-asymptotic inference performance of the proposed method by taking the OLS estimator as a reference, covering both asymptotically and marginally stable systems. The derived convergence rates and accuracy results suggest the proposed method has better performance in addressing potentially correlated observations and achieves zero inference error asymptotically. Besides, an online/recursive version of our method is established for efficient computation or time-varying cases. Extensions on NSs with nonlinear dynamics are also discussed. Comprehensive tests corroborate the theoretical findings and comparisons with other algorithms highlight the superiority of the proposed method.


title: Overview of the Micro-bunching Instability in Electron Storage Rings and Evolving Diagnostics

abstract: The micro-bunching instability is a longitudinal instability that leads to dynamical deformations of the charge distribution in the longitudinal phase space. It affects the longitudinal charge distribution, and thus the emitted coherent synchrotron radiation spectra, as well as the energy distribution of the electron bunch. Not only the threshold in the bunch current above which the instability occurs, but also the dynamics above the instability threshold strongly depends on machine parameters, e.g. accelerating voltage, momentum compaction factor, and beam energy. All this makes the understanding and potential mitigation or control of the micro-bunching instability an important topic for the next generation of light sources and circular $e^+e^-$ colliders. This contribution will give an overview of the micro-bunching instability and discuss how technological advances in the turn-by-turn and bunch-by-bunch diagnostics are leading to a deeper understanding of this intriguing phenomenon.


title: Who Blames or Endorses Whom? Entity-to-Entity Directed Sentiment Extraction in News Text

abstract: Understanding who blames or supports whom in news text is a critical research question in computational social science. Traditional methods and datasets for sentiment analysis are, however, not suitable for the domain of political text as they do not consider the direction of sentiments expressed between entities. In this paper, we propose a novel NLP task of identifying directed sentiment relationship between political entities from a given news document, which we call directed sentiment extraction. From a million-scale news corpus, we construct a dataset of news sentences where sentiment relations of political entities are manually annotated. We present a simple but effective approach for utilizing a pretrained transformer, which infers the target class by predicting multiple question-answering tasks and combining the outcomes. We demonstrate the utility of our proposed method for social science research questions by analyzing positive and negative opinions between political entities in two major events: 2016 U.S. presidential election and COVID-19. The newly proposed problem, data, and method will facilitate future studies on interdisciplinary NLP methods and applications.


title: Deficit Round-Robin: A Second Network Calculus Analysis

abstract: Deficit Round-Robin (DRR) is a widespread scheduling algorithm that provides fair queueing with variable-length packets. Bounds on worst-case delays for DRR were found by Boyer et al., who used a rigorous network calculus approach and characterized the service obtained by one flow of interest by means of a convex strict service curve. These bounds do not make any assumptions on the interfering traffic hence are pessimistic when the interfering traffic is constrained by some arrival curves. For such cases, two improvements were proposed. The former, by Soni et al., uses a correction term derived from a semi-rigorous heuristic; unfortunately, these bounds are incorrect, as we show by exhibiting a counter-example. The latter, by Bouillard, rigorously derive convex strict service curves for DRR that account for the arrival curve constraints of the interfering traffic. In this paper, we improve on these results in two ways. First, we derive a non-convex strict service curve for DRR that improves on Boyer et al. when there is no arrival constraint on the interfering traffic. Second, we provide an iterative method to improve any strict service curve (including Bouillard's) when there are arrival constraints for the interfering traffic. As of today, our results provide the best-known worst-case delay bounds for DRR. They are obtained by using the method of the pseudo-inverse.


title: Towards Unified Surgical Skill Assessment

abstract: Surgical skills have a great influence on surgical safety and patients' well-being. Traditional assessment of surgical skills involves strenuous manual efforts, which lacks efficiency and repeatability. Therefore, we attempt to automatically predict how well the surgery is performed using the surgical video. In this paper, a unified multi-path framework for automatic surgical skill assessment is proposed, which takes care of multiple composing aspects of surgical skills, including surgical tool usage, intraoperative event pattern, and other skill proxies. The dependency relationships among these different aspects are specially modeled by a path dependency module in the framework. We conduct extensive experiments on the JIGSAWS dataset of simulated surgical tasks, and a new clinical dataset of real laparoscopic surgeries. The proposed framework achieves promising results on both datasets, with the state-of-the-art on the simulated dataset advanced from 0.71 Spearman's correlation to 0.80. It is also shown that combining multiple skill aspects yields better performance than relying on a single aspect.


title: Ultra-Sparse Near-Additive Emulators

abstract: Near-additive (aka $(1+\epsilon,\beta)$-) emulators and spanners are a fundamental graph-algorithmic construct, with numerous applications for computing approximate shortest paths and related problems in distributed, streaming and dynamic settings. Known constructions of near-additive emulators enable one to trade between their sparsity (i.e., number of edges) and the additive stretch $\beta$. Specifically, for any pair of parameters $\epsilon >0$, $ \kappa=1,2,\dots$, one can have a $(1+\epsilon,\beta)$-emulator with $O(n^{1+1/\kappa})$ edges, with $\beta = \left(\frac{\log \kappa}{\epsilon}\right)^{\log \kappa}$. At their sparsest, these emulators employ $c\cdot n$ edges, for some constant $c\geq 2$. We tighten this bound, and show that in fact precisely $n^{1+1/\kappa}$ edges suffice. In particular, our emulators can be \emph{ultra-sparse}, i.e., we can have an emulator with $n+o(n)$ edges and $\beta = \left(\frac{\log {\log n}}{\epsilon }\right)^{{\log {\log n}}(1+o(1))}$. We also devise a distributed deterministic algorithm in the CONGEST model that builds these emulators in low polynomial time (i.e., in $O(n^\rho)$ time, for an arbitrarily small constant parameter $\rho >0$). Finally, we also improve the state-of-the-art distributed deterministic \congest-model construction of $(1+\epsilon,\beta)$-spanners devised in the PODC'19 paper [ElkinM19]. Specifically, the spanners of [ElkinM19] have $O(\beta\cdot n^{1+1/\kappa})$ edges, i.e., at their sparsest they employ $ O\left(\frac{\log {\log n}}{\epsilon }\right)^{{\log {\log n}}}\cdot n$ edges. In this paper, we devise an efficient distributed deterministic CONGEST-model algorithm that builds such spanners with $O(n^{1+1/\kappa})$ edges for $\kappa = O\left(\frac{\log n}{\log ^{(3)}n}\right)$. At their sparsest, these spanners employ only $O(n\cdot {\log {\log n}})$ edges.


title: Note on $4$-coloring $6$-regular triangulations on the torus

abstract: In 1973, Altshuler characterized the $6$-regular triangulations on the torus to be precisely those that are obtained from a regular triangulation of the $r \times s$ toroidal grid where the vertices in the first and last column are connected by a shift of $t$ vertices. Such a graph is denoted $T(r, s, t)$. In 1999, Collins and Hutchinson classified the $4$-colorable graphs $T(r, s, t)$ with $r, s \geq 3$. In this paper, we point out a gap in their classification and show how it can be fixed. Combined with the classification of the $4$-colorable graphs $T(1, s, t)$ by Yeh and Zhu in 2003, this completes the characterization of the colorability of all the $6$-regular triangulations on the torus.


title: Background Independence and Quantum Causal Structure

abstract: One of the key ways in which quantum mechanics differs from relativity is that it requires a fixed background reference frame for spacetime. In fact, this appears to be one of the main conceptual obstacles to uniting the two theories. Additionally, a combination of the two theories is expected to yield non-classical, or "indefinite", causal structures. In this paper, we present a background-independent formulation of the process matrix formalism - a form of quantum mechanics that allows for indefinite causal structure - while retaining operationally well-defined measurement statistics. We do this by postulating an arbitrary probability distribution of measurement outcomes across discrete "chunks" of spacetime, which we think of as physical laboratories, and then requiring that this distribution be invariant under any permutation of laboratories. We find (a) that one still obtains nontrivial, indefinite causal structures with background independence, (b) that we lose the idea of local operations in distinct laboratories, but can recover it by encoding a reference frame into the physical states of our system, and (c) that permutation invariance imposes surprising symmetry constraints that, although formally similar to a superselection rule, cannot be interpreted as such.


title: Classification of OGLE eclipsing binary stars based on their morphology type with Locally Linear Embedding

abstract: The Optical Gravitational Lensing Experiment (OGLE) continuously monitors hundreds of thousands of eclipsing binaries in the field of galactic bulge and the Magellanic Clouds. These objects have been classified into main morphological sub-classes, such as contact, non-contact, ellipsoidal and cataclysmic variables, both by matching the light curves with predefined templates and visual inspections. Here we present the result of a machine learned automatic classification based on the morphology of light curves inspired by the classification of eclipsing binaries observed by the original Kepler mission. We similarly use a dimensionality reduction technique, the locally linear embedding to map the high dimension of the data set into a low dimensional embedding parameter space, while keeping the local geometry and the similarities of the neighbouring data points. After three consecutive steps, we assign one parameter to each binary star, which well scales with the "detachness", i.e. the sum of the relative radii of the components. This value is in good agreement with the morphology types listed in the OGLE catalog and, along with the orbital periods, can be used to filter any morphological sub-types based on the similarity of light curves. Our open-source pipeline can be applied in a fully automatic way to any other large data set to classify binary stars.


title: Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling

abstract: Transformer is important for text modeling. However, it has difficulty in handling long documents due to the quadratic complexity with input text length. In order to handle this problem, we propose a hierarchical interactive Transformer (Hi-Transformer) for efficient and effective long document modeling. Hi-Transformer models documents in a hierarchical way, i.e., first learns sentence representations and then learns document representations. It can effectively reduce the complexity and meanwhile capture global document context in the modeling of each sentence. More specifically, we first use a sentence Transformer to learn the representations of each sentence. Then we use a document Transformer to model the global document context from these sentence representations. Next, we use another sentence Transformer to enhance sentence modeling using the global document context. Finally, we use hierarchical pooling method to obtain document embedding. Extensive experiments on three benchmark datasets validate the efficiency and effectiveness of Hi-Transformer in long document modeling.


title: Modelling of SN2013dx associated with the low-redshift GRB130702A points to diversity in GRB/SN properties

abstract: The properties of the broad-lined type Ic supernova (SN) 2013dx, associated with the long gamma-ray burst GRB130702A at a redshift z = 0.145, are derived via spectral modelling. SN2013dx was similar in luminosity to other GRB/SNe, with a derived value of the mass of 56Nickel ejected in the explosion of ~0.4 Msun. However, its spectral properties suggest a smaller explosion kinetic energy. Radiation transport models were used to derive a plausible mass and density distribution of the SN ejecta in a one-dimensional approximation. While the mass ejected in the explosion that is obtained from the modelling (Mej ~ 9 Msun) is similar to that of all other well-studied GRB/SNe, the kinetic energy is significantly smaller (KE ~ 10^{52}erg). This leads to a smaller KE/Mej ratio, ~ 10^{51} erg/Msun, which is reflected in the narrower appearance of the spectral lines. While the low KE does not represent a problem for the scenario in which magnetar energy aids powering the explosion and the nucleosynthesis, it is nevertheless highly unusual. SNe Ic with similar KE have never been seen in coincidence with a GRB, and no well-observed GRB/SN has shown similarly low KE and KE/Mej.


title: On a class of q-orthogonal polynomials and the q-Riemann Hilbert Problem

abstract: We give an explicit solution of a q-Riemann Hilbert problem which arises in the theory of orthogonal polynomials, prove that it is unique, and deduce several properties. Our new results include the asymptotic behaviour of zeroes in the limit as the degree of the polynomial approaches infinity.


title: Causal Discovery in Knowledge Graphs by Exploiting Asymmetric Properties of Non-Gaussian Distributions

abstract: In recent years, causal modelling has been used widely to improve generalization and to provide interpretability in machine learning models. To determine cause-effect relationships in the absence of a randomized trial, we can model causal systems with counterfactuals and interventions given enough domain knowledge. However, there are several cases where domain knowledge is almost absent and the only recourse is using a statistical method to estimate causal relationships. While there have been several works done in estimating causal relationships in unstructured data, we are yet to find a well-defined framework for estimating causal relationships in Knowledge Graphs (KG). It is commonly used to provide a semantic framework for data with complex inter-domain relationships. In this work, we define a hybrid approach that allows us to discover cause-effect relationships in KG. The proposed approach is based around the finding of the instantaneous causal structure of a non-experimental matrix using a non-Gaussian model, i.e; finding the causal ordering of the variables in a non-Gaussian setting. The non-experimental matrix is a low-dimensional tensor projection obtained by decomposing the adjacency tensor of a KG. We use two different pre-existing algorithms, one for the causal discovery and the other for decomposing the KG and combining them to get the causal structure in a KG.


title: Examining the Inductive Bias of Neural Language Models with Artificial Languages

abstract: Since language models are used to model a wide variety of languages, it is natural to ask whether the neural architectures used for the task have inductive biases towards modeling particular types of languages. Investigation of these biases has proved complicated due to the many variables that appear in the experimental setup. Languages vary in many typological dimensions, and it is difficult to single out one or two to investigate without the others acting as confounders. We propose a novel method for investigating the inductive biases of language models using artificial languages. These languages are constructed to allow us to create parallel corpora across languages that differ only in the typological feature being investigated, such as word order. We then use them to train and test language models. This constitutes a fully controlled causal framework, and demonstrates how grammar engineering can serve as a useful tool for analyzing neural models. Using this method, we find that commonly used neural architectures exhibit different inductive biases: LSTMs display little preference with respect to word ordering, while transformers display a clear preference for some orderings over others. Further, we find that neither the inductive bias of the LSTM nor that of the transformer appears to reflect any tendencies that we see in attested natural languages.


title: Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?

abstract: Five years after the first published proofs of concept, direct approaches to speech translation (ST) are now competing with traditional cascade solutions. In light of this steady progress, can we claim that the performance gap between the two is closed? Starting from this question, we present a systematic comparison between state-of-the-art systems representative of the two paradigms. Focusing on three language directions (English-German/Italian/Spanish), we conduct automatic and manual evaluations, exploiting high-quality professional post-edits and annotations. Our multi-faceted analysis on one of the few publicly available ST benchmarks attests for the first time that: i) the gap between the two paradigms is now closed, and ii) the subtle differences observed in their behavior are not sufficient for humans neither to distinguish them nor to prefer one over the other.


title: Enhanced spin-orbit coupling and orbital moment in ferromagnets by electron correlations

abstract: In atomic physics, the Hund rule says that the largest spin and orbital state is realized due to the interplay of the spin-orbit coupling (SOC) and the Coulomb interactions. Here, we show that in ferromagnetic solids the effective SOC and the orbital magnetic moment can be dramatically enhanced by a factor of $1/[1-(2U^\prime-U-J_H)\rho_0]$, where $U$ and $U^\prime$ are the on-site Coulomb interaction within the same oribtals and between different orbitals, respectively, $J_H$ is the Hund coupling, and $\rho_0$ is the average density of states. This factor is obtained by using the two-orbital as well as five-orbital Hubbard models with SOC. We also find that the spin polarization is more favorable than the orbital polarization, being consistent with experimental observations. This present work provides a fundamental basis for understanding the enhancements of SOC and orbital moment by Coulomb interactions in ferromagnets, which would have wide applications in spintronics.


title: Tschebyshev-Pad\'e approximations for multivalued functions

abstract: We discuss the relation between the linear Tschebyshev-Pad\'e approximations to analytic function $f$ and the diagonal type I Hermite-Pad\'e polynomials for the tuple of functions $[1,f_1,f_2]$ where the pair of functions $f_1,f_2$ forms certain Nikishin system. An approach is proposed of how to extend the seminal Stahl's Theory for Pad\'e approximations for multivalued analytic functions to the Tschebyshev-Pad\'e approximations. The approach is based on the relation between Tschebyshev-Pad\'e approximations and Hermite-Pad\'e polynomials and also on a connection of Hermite-Pad\'e polynomials and multipoint Pad\'e approximants.


title: Expected Scalarised Returns Dominance: A New Solution Concept for Multi-Objective Decision Making

abstract: In many real-world scenarios, the utility of a user is derived from the single execution of a policy. In this case, to apply multi-objective reinforcement learning, the expected utility of the returns must be optimised. Various scenarios exist where a user's preferences over objectives (also known as the utility function) are unknown or difficult to specify. In such scenarios, a set of optimal policies must be learned. However, settings where the expected utility must be maximised have been largely overlooked by the multi-objective reinforcement learning community and, as a consequence, a set of optimal solutions has yet to be defined. In this paper we address this challenge by proposing first-order stochastic dominance as a criterion to build solution sets to maximise expected utility. We also propose a new dominance criterion, known as expected scalarised returns (ESR) dominance, that extends first-order stochastic dominance to allow a set of optimal policies to be learned in practice. We then define a new solution concept called the ESR set, which is a set of policies that are ESR dominant. Finally, we define a new multi-objective distributional tabular reinforcement learning (MOT-DRL) algorithm to learn the ESR set in a multi-objective multi-armed bandit setting.


title: Spectral features of Pb-related color centers in diamond

abstract: We report on the systematic characterization of the optical properties of diamond color centers based on Pb impurities. An ensemble photoluminescence analysis of their spectral emission was performed at different excitation wavelengths in the 405-520 nm range and at different temperatures in the 4-300 K range. The series of observed spectral features consist of different emission lines associated with Pb-related defects. Finally, a room-temperature investigation of single-photon emitters under 490.5 nm laser excitation is reported, revealing different spectral signatures with respect to those already reported under 514 nm excitation. This work represents a substantial progress with respect to previous studies on Pb-related color centers, both in the attribution of an articulated series of spectral features and in the understanding of the formation process of this type of defect, thus clarifying the potential of this system for high-impact applications in quantum technologies.


title: The two higher Stasheff-Tamari orders are equal

abstract: The set of triangulations of a cyclic polytope possesses two a priori different partial orders, known as the higher Stasheff-Tamari orders. The first of these orders was introduced by Kapranov and Voevodsky, while the second order was introduced by Edelman and Reiner, who also conjectured the two to coincide in 1996. In this paper we prove their conjecture, thereby substantially increasing our understanding of these orders. This result also has ramifications in the representation theory of algebras, as established in previous work of the author. Indeed, it means that the two corresponding orders on tilting modules, cluster-tilting objects and their maximal chains are equal for the higher Auslander algebras of type $A$.


title: Minimax and Neyman-Pearson Meta-Learning for Outlier Languages

abstract: Model-agnostic meta-learning (MAML) has been recently put forth as a strategy to learn resource-poor languages in a sample-efficient fashion. Nevertheless, the properties of these languages are often not well represented by those available during training. Hence, we argue that the i.i.d. assumption ingrained in MAML makes it ill-suited for cross-lingual NLP. In fact, under a decision-theoretic framework, MAML can be interpreted as minimising the expected risk across training languages (with a uniform prior), which is known as Bayes criterion. To increase its robustness to outlier languages, we create two variants of MAML based on alternative criteria: Minimax MAML reduces the maximum risk across languages, while Neyman-Pearson MAML constrains the risk in each language to a maximum threshold. Both criteria constitute fully differentiable two-player games. In light of this, we propose a new adaptive optimiser solving for a local approximation to their Nash equilibrium. We evaluate both model variants on two popular NLP tasks, part-of-speech tagging and question answering. We report gains for their average and minimum performance across low-resource languages in zero- and few-shot settings, compared to joint multi-source transfer and vanilla MAML.


title: Experimental investigation of the relation between measurement uncertainties and non-local quantum correlations

abstract: Bell's inequalities are defined by sums of correlations involving non-commuting observables in each of the two systems. Violations of Bell's inequalities are only possible because the precision of any joint measurement of these observables will be limited by quantum mechanical uncertainty relations. In this paper we explore the relation between the local measurement uncertainties and the magnitude of the correlations by preparing polarization entangled photon pairs and performing joint measurements of non-commuting polarization components at different uncertainty trade-offs. The change in measurement visibility reveals the existence of a non-trivial balance between the measurement uncertainties where the probabilities of a specific pair of measurement outcomes approaches zero because of the particular combination of enhancement and suppression of the experimentally observed correlations. The occurrence of these high-contrast results shows that the quantum correlations between the photons are close to their maximal value, confirming that the Cirel'son bound of Bell's inequality violations is defined by the minimal uncertainties that limit the precision of joint measurements.


title: The Seventh International Olympiad in Cryptography: problems and solutions

abstract: The International Olympiad in Cryptography NSUCRYPTO is the unique Olympiad containing scientific mathematical problems for professionals, school and university students from any country. Its aim is to involve young researchers in solving curious and tough scientific problems of modern cryptography. In 2020, it was held for the seventh time. Prizes and diplomas were awarded to 84 participants in the first round and 49 teams in the second round from 32 countries. In this paper, problems and their solutions of NSUCRYPTO'2020 are presented. We consider problems related to attacks on ciphers and hash functions, protocols, permutations, primality tests, etc. We discuss several open problems on JPEG encoding, Miller -- Rabin primality test, special bases in the vector space, AES-GCM. The problem of a modified Miller -- Rabin primality test was solved during the Olympiad. The problem for finding special bases was partially solved.


title: Interplay of voltage control of magnetic anisotropy, spin transfer torque, and heat in the spin-orbit torque switching in three-terminal magnetic tunnel junctions

abstract: We use three-terminal magnetic tunnel junctions (MTJs) designed for field-free switching by spin-orbit torques (SOTs) to systematically study the impact of dual voltage pulses on the switching performances. We show that the concurrent action of an SOT pulse and an MTJ bias pulse allows for reducing the critical switching energy below the level typical of spin transfer torque while preserving the ability to switch the MTJ on the sub-ns time scale. By performing dc and real-time electrical measurements, we discriminate and quantify three effects arising from the MTJ bias: the voltage-controlled change of the perpendicular magnetic anisotropy, current-induced heating, and the spin transfer torque. The experimental results are supported by micromagnetic modeling. We observe that, depending on the pulse duration and the MTJ diameter, different effects take a lead in assisting the SOTs in the magnetization reversal process. Finally, we present a compact model that allows for evaluating the impact of each effect due to the MTJ bias on the critical switching parameters. Our results provide input to optimize the switching of three-terminal devices as a function of time, size, and material parameters.


title: A Novel Edge Detection Operator for Identifying Buildings in Augmented Reality Applications

abstract: Augmented Reality is an environment-enhancing technology, widely applied in many domains, such as tourism and culture. One of the major challenges in this field is precise detection and extraction of building information through Computer Vision techniques. Edge detection is one of the building blocks operations for many feature extraction solutions in Computer Vision. AR systems use edge detection for building extraction or for extraction of facade details from buildings. In this paper, we propose a novel filter operator for edge detection that aims to extract building contours or facade features better. The proposed filter gives more weight for finding vertical and horizontal edges that is an important feature for our aim.


title: Comparison of Random Sampling and Heuristic Optimization-Based Methods for Determining the Flexibility Potential at Vertical System Interconnections

abstract: In order to prevent conflicting or counteracting use of flexibility options, the coordination between distribution system operator and transmission system operator has to be strengthened. For this purpose, methods for the standardized description and identification of the aggregated flexibility potential of distribution grids are developed. Approaches for identifying the feasible operation region (FOR) of distribution grids can be categorized into two main classes: Random sampling/stochastic approaches and optimization-based approaches. While the latter have the advantage of working in real-world scenarios where no full grid models exist, when relying on naive sampling strategies, they suffer from poor coverage of the edges of the FOR due to convoluted distributions. In this paper, we tackle the problem from two different angles. First, we present a random sampling approach which mitigates the convolution problem by drawing sample values from a multivariate Dirichlet distribution. Second, we come up with a hybrid approach which solves the underlying optimal power flow problems of the optimization-based approach by means of a stochastic evolutionary optimization algorithm codenamed REvol. By means of synthetic feeders, we compare the two proposed FOR identification methods with regard to how well the FOR is covered and number of power flow calculations required.


title: Unramified cohomology, algebraic cycles and rationality

abstract: This is a survey on unramified cohomology with a view towards its applications to rationality problems.


title: Decomposition of multicorrelation sequences and joint ergodicity

abstract: We show that, under finitely many ergodicity assumptions, any multicorrelation sequence defined by invertible measure preserving $\mathbb{Z}^d$-actions with multivariable integer polynomial iterates is the sum of a nilsequence and a null sequence, extending a recent result of the second author. To this end, we develop a new seminorm bound estimate for multiple averages by improving the results in a previous work of the first, third and fourth authors. We also use this approach to obtain new criteria for joint ergodicity of multiple averages with multivariable polynomial iterates on $\mathbb{Z}^{d}$-systems.


title: Gold nanodoughnut as an outstanding nanoheater for photothermal applications

abstract: Photoinduced hyperthermia is a cancer therapy technique that induces death to cancerous cells via heat generated by plasmonic nanoparticles. While previous studies have shown that some nanoparticles can be effective at killing cancer cells under certain conditions, there is still a necessity (or the need) to improve its heating efficiency. In this work, we perform a detailed thermoplasmonic study comparing the most effective nanoparticle geometries up to now with a doughnut-shaped nanoparticle, demonstrating that the latter exhibits a superior tunable photothermal response in practical illumination conditions, i.e., unpolarized light. Furthermore, we show that nanoparticle heating in fluidic environments, i.e., nanoparticles undergoing Brownian rotations, strongly depends on the particle orientation with respect to the illumination source. We conclude that the heating performance of nanodoughnuts is outstanding, with a temperature increment 35% higher than the second best nanoheater (nanodisks). Furthermore, nanodoughnuts feature a weak dependence on orientation, being therefore, ideal candidates for photothermal therapy applications. Finally, we present a designing guide, covering a wide range of toroid designs, which can help on its experimental implementation.


title: John praised Mary because he? Implicit Causality Bias and Its Interaction with Explicit Cues in LMs

abstract: Some interpersonal verbs can implicitly attribute causality to either their subject or their object and are therefore said to carry an implicit causality (IC) bias. Through this bias, causal links can be inferred from a narrative, aiding language comprehension. We investigate whether pre-trained language models (PLMs) encode IC bias and use it at inference time. We find that to be the case, albeit to different degrees, for three distinct PLM architectures. However, causes do not always need to be implicit -- when a cause is explicitly stated in a subordinate clause, an incongruent IC bias associated with the verb in the main clause leads to a delay in human processing. We hypothesize that the temporary challenge humans face in integrating the two contradicting signals, one from the lexical semantics of the verb, one from the sentence-level semantics, would be reflected in higher error rates for models on tasks dependent on causal links. The results of our study lend support to this hypothesis, suggesting that PLMs tend to prioritize lexical patterns over higher-order signals.


title: Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation

abstract: Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly grounding linguistic reference over the image lattice. Such bottom-up strategy fails to explore object-level cues, easily leading to inferior results. In this work, we instead put forward a two-stage, top-down RVOS solution. First, an exhaustive set of object tracklets is constructed by propagating object masks detected from several sampled frames to the entire video. Second, a Transformer-based tracklet-language grounding module is proposed, which models instance-level visual relations and cross-modal interactions simultaneously and efficiently. Our model ranks first place on CVPR2021 Referring Youtube-VOS challenge.


title: Hilbert's spacefilling curve described by automatic, regular, and synchronized sequences

abstract: We describe Hilbert's spacefilling curve in several different ways: as an automatic sequence of directions,as a regular and synchronized sequence of coordinates of lattice points encountered, and as an automatic bitmap image.


title: Tolerance in Model-Driven Engineering: A Systematic Literature Review with Model-Driven Tool Support

abstract: Managing models in a consistent manner is an important task in the field of Model-Driven Engineering (MDE). Although restoring and maintaining consistency is desired in general, recent work has pointed out that always strictly enforcing consistency at any point of time is often not feasible in real-world scenarios, and sometimes even contrary to what a user expects from a trustworthy MDE tool. The challenge of tolerating inconsistencies has been discussed from different viewpoints within and outside the modelling community, but there exists no structured overview of existing and current work in this regard. In this paper, we provide such an overview to help join forces tackling the unresolved problems of tolerating inconsistencies in MDE. We follow the standard process of a Systematic Literature Review (SLR) to point out what tolerance means, how it relates to uncertainty, which examples for tolerant software systems have already been discussed, and which benefits and drawbacks tolerating inconsistencies entails. Furthermore, we propose a tool-chain that helps conducting SLRs in computer science and also eases the reproduction of results. Relevant meta-data of the collected sources is uniformly described in a textual modelling language and exported to the graph database Neo4j to query aggregated information.


title: Generating Informative Conclusions for Argumentative Texts

abstract: The purpose of an argumentative text is to support a certain conclusion. Yet, they are often omitted, expecting readers to infer them rather. While appropriate when reading an individual text, this rhetorical device limits accessibility when browsing many texts (e.g., on a search engine or on social media). In these scenarios, an explicit conclusion makes for a good candidate summary of an argumentative text. This is especially true if the conclusion is informative, emphasizing specific concepts from the text. With this paper we introduce the task of generating informative conclusions: First, Webis-ConcluGen-21 is compiled, a large-scale corpus of 136,996 samples of argumentative texts and their conclusions. Second, two paradigms for conclusion generation are investigated; one extractive, the other abstractive in nature. The latter exploits argumentative knowledge that augment the data via control codes and finetuning the BART model on several subsets of the corpus. Third, insights are provided into the suitability of our corpus for the task, the differences between the two generation paradigms, the trade-off between informativeness and conciseness, and the impact of encoding argumentative knowledge. The corpus, code, and the trained models are publicly available.


title: Towards Robustness of Text-to-SQL Models against Synonym Substitution

abstract: Recently, there has been significant progress in studying neural networks to translate text descriptions into SQL queries. Despite achieving good performance on some public benchmarks, existing text-to-SQL models typically rely on the lexical matching between words in natural language (NL) questions and tokens in table schemas, which may render the models vulnerable to attacks that break the schema linking mechanism. In this work, we investigate the robustness of text-to-SQL models to synonym substitution. In particular, we introduce Spider-Syn, a human-curated dataset based on the Spider benchmark for text-to-SQL translation. NL questions in Spider-Syn are modified from Spider, by replacing their schema-related words with manually selected synonyms that reflect real-world question paraphrases. We observe that the accuracy dramatically drops by eliminating such explicit correspondence between NL questions and table schemas, even if the synonyms are not adversarially selected to conduct worst-case adversarial attacks. Finally, we present two categories of approaches to improve the model robustness. The first category of approaches utilizes additional synonym annotations for table schemas by modifying the model input, while the second category is based on adversarial training. We demonstrate that both categories of approaches significantly outperform their counterparts without the defense, and the first category of approaches are more effective.


title: Effective exchange interaction for terahertz spin waves in iron layers

abstract: The exchange stiffness is a central material parameter of all ferromagnetic materials. Its value controls the Curie temperature as well as the dynamic properties of spin waves to a large extend. Using ultrashort spin current pulses we excite perpendicular standing spin waves (PSSW) in ultrathin epitaxial iron layers at frequencies of up to 2.4 THz. Our analysis shows that for the PSSWs the observed exchange stiffness of iron is about 20% smaller compared to the established iron bulk value. In addition, we find an interface-related reduction of the effective exchange stiffness for layers with the thickness below 10 nm. To understand and discuss the possible mechanisms of the exchange stiffness reduction we develop an analytical 1D-model. In doing so we find that the interface induced reduction of the exchange stiffness is mode-dependent.


title: Topological Field Theories induced by twisted R-Poisson structure in any dimension

abstract: We construct a class of topological field theories with Wess-Zumino term in spacetime dimensions $\ge 2$ whose target space has a geometrical structure that suitably generalizes Poisson or twisted Poisson manifolds. Assuming a field content comprising a set of scalar fields accompanied by gauge fields of degree $(1,p-1,p)$ we determine a generic Wess-Zumino topological field theory in $p+1$ dimensions with background data consisting of a Poisson 2-vector, a $(p+1)$-vector $R$ and a $(p+2)$-form $H$ satisfying a specific geometrical condition that defines a $H$-twisted $R$-Poisson structure of order $p+1$. For this class of theories we demonstrate how a target space covariant formulation can be found by means of an auxiliary connection without torsion. Furthermore, we study admissible deformations of the generic class in special spacetime dimensions and find that they exist in dimensions 2, 3 and 4. The two-dimensional deformed field theory includes the twisted Poisson sigma model, whereas in three dimensions we find a more general structure that we call bi-twisted $R$-Poisson. This extends the twisted $R$-Poisson structure of order 3 by a non-closed 3-form and gives rise to a topological field theory whose covariant formulation requires a connection with torsion and includes a twisted Poisson sigma model in three dimensions as a special case. The relation of the corresponding structures to differential graded Q-manifolds based on the degree shifted cotangent bundle $T^{\ast}[p]T^{\ast}[1]M$ is discussed, as well as the obstruction to them being QP-manifolds due to the Wess-Zumino term.


title: Phase Transitions of Repulsive Two-Component Fermi Gases in Two Dimensions

abstract: We predict the phase separations of two-dimensional Fermi gases with repulsive contact-type interactions between two spin components. Using density-potential functional theory with systematic semiclassical approximations, we address the long-standing problem of itinerant ferromagnetism in realistic settings. We reveal a universal transition from the paramagnetic state at small repulsive interactions towards ferromagnetic density profiles at large interaction strengths, with intricate particle-number dependent phases in between. Building on quantum Monte Carlo results for uniform systems, we benchmark our simulations against Hartree-Fock calculations for a small number of trapped fermions. We thereby demonstrate that our employed corrections to the mean-field interaction energy and especially to the Thomas-Fermi kinetic energy functional are necessary for reliably predicting properties of trapped mesoscopic Fermi gases. The density patterns of the ground state survive at low finite temperatures and confirm the Stoner-type polarization behavior across a universal interaction parameter, albeit with substantial quantitative differences that originate in the trapping potential and the quantum-corrected kinetic energy. We also uncover a zoo of metastable configurations that are energetically comparable to the ground-state density profiles and are thus likely to be observed in experiments. We argue that our density-functional approach can be easily applied to interacting multi-component Fermi gases in general.


title: No Cauchy Horizon Theorem for Nonlinear Electrodynamics Black Holes with Charged Scalar Hairs

abstract: We prove a no Cauchy horizon theorem for general nonlinear electrodynamics black holes with charged scalar hairs. By constructing a radially conserved charged, we show that there is no inner Cauchy horizon for both spherical and planar symmetric cases, independent of the form of scalar potential and nonlinear electrodynamics. After imposing the null energy condition, we are also able to rule out the existence of the Cauchy horizon for the hyperbolic black holes. We take the Born-Infeld black hole as a concrete example to study the interior dynamics beyond the event horizon. When the contribution from the scalar potential can be neglected, the asymptotic near-singularity takes a universal Kasner form. We also confirm that the intricate interior dynamics is closely associated with the instability of the inner Cauchy horizon triggered by scalar hairs.


title: Testing Group Fairness via Optimal Transport Projections

abstract: We present a statistical testing framework to detect if a given machine learning classifier fails to satisfy a wide range of group fairness notions. The proposed test is a flexible, interpretable, and statistically rigorous tool for auditing whether exhibited biases are intrinsic to the algorithm or due to the randomness in the data. The statistical challenges, which may arise from multiple impact criteria that define group fairness and which are discontinuous on model parameters, are conveniently tackled by projecting the empirical measure onto the set of group-fair probability models using optimal transport. This statistic is efficiently computed using linear programming and its asymptotic distribution is explicitly obtained. The proposed framework can also be used to test for testing composite fairness hypotheses and fairness with multiple sensitive attributes. The optimal transport testing formulation improves interpretability by characterizing the minimal covariate perturbations that eliminate the bias observed in the audit.


title: Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection

abstract: Emotion detection in dialogues is challenging as it often requires the identification of thematic topics underlying a conversation, the relevant commonsense knowledge, and the intricate transition patterns between the affective states. In this paper, we propose a Topic-Driven Knowledge-Aware Transformer to handle the challenges above. We firstly design a topic-augmented language model (LM) with an additional layer specialized for topic detection. The topic-augmented LM is then combined with commonsense statements derived from a knowledge base based on the dialogue contextual information. Finally, a transformer-based encoder-decoder architecture fuses the topical and commonsense information, and performs the emotion label sequence prediction. The model has been experimented on four datasets in dialogue emotion detection, demonstrating its superiority empirically over the existing state-of-the-art approaches. Quantitative and qualitative results show that the model can discover topics which help in distinguishing emotion categories.


title: Evidence-based Factual Error Correction

abstract: This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to correct written texts that are refuted or only partially supported by evidence. We demonstrate that it is feasible to train factual error correction systems from existing fact checking datasets which only contain labeled claims accompanied by evidence, but not the correction. We achieve this by employing a two-stage distant supervision approach that incorporates evidence into masked claims when generating corrections. Our approach, based on the T5 transformer and using retrieved evidence, achieved better results than existing work which used a pointer copy network and gold evidence, producing accurate factual error corrections for 5x more instances in human evaluation and a .125 increase in SARI score. The evaluation is conducted on a dataset of 65,000 instances based on a recent fact verification shared task and we release it to enable further work on the task.


title: Progress on the calibration of surface brightness-color relations for early- and late-type stars

abstract: Surface brightness-color relations (SBCRs) are used for estimating angular diameters and deriving stellar properties. They are critical to derive extragalactic distances of early-type and late-type eclipsing binaries or, potentially, for extracting planetary parameters of late-type stars hosting planets. Various SBCRs have been implemented so far, but strong discrepancies in terms of precision and accuracy still exist in the literature. We aim to develop a precise SBCR for early-type B and A stars using selection criteria, based on stellar characteristics, and combined with homogeneous interferometric angular diameter measurements. We also improve SBCRs for late-type stars, in particular in the Gaia photometric band. We observed 18 early-type stars with the VEGA interferometric instrument, installed on the CHARA array. We then applied additional criteria on the photometric measurements, together with stellar characteristics diagnostics in order to build the SBCRs. We calibrated a SBCR for subgiant and dwarf early-type stars. The RMS of the relation is $\sigma_{F_{V_{0}}} = 0.0051\,$mag, leading to an average precision of 2.3% on the estimation of angular diameters, with 3.1% for $V-K < -0.2\,$mag and 1.8% for $V-K > -0.2\,$mag. We found that the conversion between Johnson-$K$ and 2MASS-$K_s$ photometries is a key issue for early-type stars. Following this result, we have revisited our previous SBCRs for late-type stars by calibrating them with either converted Johnson-$K$ or 2MASS-$K_s$ photometries. We also improve the calibration of these SBCRs based on the Gaia photometry. The expected precision on the angular diameter using our SBCRs for late-type stars ranges from 1.0% to 2.7%. By reaching a precision of 2.3% on the estimation of angular diameters for early-type stars, significant progress has been made to determine extragalactic distances using early-type eclipsing binaries.


title: Database Reasoning Over Text

abstract: Neural models have shown impressive performance gains in answering queries from natural language text. However, existing works are unable to support database queries, such as "List/Count all female athletes who were born in 20th century", which require reasoning over sets of relevant facts with operations such as join, filtering and aggregation. We show that while state-of-the-art transformer models perform very well for small databases, they exhibit limitations in processing noisy data, numerical operations, and queries that aggregate facts. We propose a modular architecture to answer these database-style queries over multiple spans from text and aggregating these at scale. We evaluate the architecture using WikiNLDB, a novel dataset for exploring such queries. Our architecture scales to databases containing thousands of facts whereas contemporary models are limited by how many facts can be encoded. In direct comparison on small databases, our approach increases overall answer accuracy from 85% to 90%. On larger databases, our approach retains its accuracy whereas transformer baselines could not encode the context.


title: Plasma Properties, Switchback Patches and Low $\alpha$-Particle Abundance in Slow Alfv\'enic Coronal Hole Wind at 0.13 au

abstract: The Parker Solar Probe (PSP) mission presents a unique opportunity to study the near-Sun solar wind closer than any previous spacecraft. During its fourth and fifth solar encounters, PSP had the same orbital trajectory, meaning that solar wind was measured at the same latitudes and radial distances. We identify two streams measured at the same heliocentric distance ($\sim$0.13au) and latitude ($\sim$-3.5$^{\circ}$) across these encounters to reduce spatial evolution effects. By comparing the plasma of each stream, we confirm that they are not dominated by variable transient events, despite PSP's proximity to the heliospheric current sheet. Both streams are consistent with a previous slow Alfv\'enic solar wind study once radial effects are considered, and appear to originate at the Southern polar coronal hole boundary. We also show that the switchback properties are not distinctly different between these two streams. Low $\alpha$-particle abundance ($\sim$ 0.6 %) is observed in the encounter 5 stream, suggesting that some physical mechanism must act on coronal hole boundary wind to cause $\alpha$-particle depletion. Possible explanations for our observations are discussed, but it remains unclear whether the depletion occurs during the release or the acceleration of the wind. Using a flux tube argument, we note that an $\alpha$-particle abundance of $\sim$ 0.6 % in this low velocity wind could correspond to an abundance of $\sim$ 0.9 % at 1 au. Finally, as the two streams roughly correspond to the spatial extent of a switchback patch, we suggest that patches are distinct features of coronal hole wind.


title: Jet-induced feedback in the [O III] lines of early evolution stage active galactic nuclei

abstract: It is well known that active galactic nuclei (AGN) show various forms of interaction with their host galaxy, in a number of phenomena generally called AGN feedback. In particular, the relativistic plasma jets launched by a fraction of AGN can strongly affect their environment. We present here a study of the [O III] $\lambda\lambda$4959,5007 lines in a diverse sample of early evolution stage AGN -- specifically narrow-line Seyfert 1 galaxies. Radio imaging observations of all of the sources enable a division to jetted and non-jetted sources, and exploiting this we show that the ionized gas properties are significantly influenced by the presence of the jets, as we often find the [O III] lines (blue-)shifted with respect to their restframe wavelength. We also show how the radio morphology and the radio spectral index do not seem to play a role in the origin of the [O III] shifts, thus suggesting that the source inclination is not relevant to the lines displacement. We do not find a strong relation between the [O III] line properties and the bolometric luminosity, suggesting that within our sample radiatively driven outflows do not seem to have a significant contribution to the [O III] line kinematics. We finally suggest that [O~ III] shifts may be a good proxy to identify the presence of relativistic jets. Additional studies, especially with integral-field spectroscopy, will provide a deeper insight into the relation between jets and their environment in early evolution stage AGN.


title: SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics

abstract: Recently, deep neural networks (DNNs) have achieved great success in semantically challenging NLP tasks, yet it remains unclear whether DNN models can capture compositional meanings, those aspects of meaning that have been long studied in formal semantics. To investigate this issue, we propose a Systematic Generalization testbed based on Natural language Semantics (SyGNS), whose challenge is to map natural language sentences to multiple forms of scoped meaning representations, designed to account for various semantic phenomena. Using SyGNS, we test whether neural networks can systematically parse sentences involving novel combinations of logical expressions such as quantifiers and negation. Experiments show that Transformer and GRU models can generalize to unseen combinations of quantifiers, negations, and modifiers that are similar to given training instances in form, but not to the others. We also find that the generalization performance to unseen combinations is better when the form of meaning representations is simpler. The data and code for SyGNS are publicly available at https://github.com/verypluming/SyGNS.


title: Physics-Guided Discovery of Highly Nonlinear Parametric Partial Differential Equations

abstract: Partial differential equations (PDEs) that fit scientific data can represent physical laws with explainable mechanisms for various mathematically-oriented subjects, such as physics and finance. The data-driven discovery of PDEs from scientific data thrives as a new attempt to model complex phenomena in nature, but the effectiveness of current practice is typically limited by the scarcity of data and the complexity of phenomena. Especially, the discovery of PDEs with highly nonlinear coefficients from low-quality data remains largely under-addressed. To deal with this challenge, we propose a novel physics-guided learning method, which can not only encode observation knowledge such as initial and boundary conditions but also incorporate the basic physical principles and laws to guide the model optimization. We theoretically show that our proposed method strictly reduces the coefficient estimation error of existing baselines, and is also robust against noise. Extensive experiments show that the proposed method is more robust against data noise, and can reduce the estimation error by a large margin. Moreover, all the PDEs in the experiments are correctly discovered, and for the first time we are able to discover three-dimensional PDEs with highly nonlinear coefficients.


title: Using Predicted Weights for Ad Delivery

abstract: We study the performance of a proportional weights algorithm for online capacitated bipartite matching modeling the delivery of impression ads. The algorithm uses predictions on the advertiser nodes to match arriving impression nodes fractionally in proportion to the weights of its neighbors. This paper gives a thorough empirical study of the performance of the algorithm on a data-set of ad impressions from Yahoo! and shows its superior performance compared to natural baselines such as a greedy water-filling algorithm and the ranking algorithm. The proportional weights algorithm has recently received interest in the theoretical literature where it was shown to have strong guarantees beyond the worst-case model of algorithms augmented with predictions. We extend these results to the case where the advertisers' capacities are no longer stationary over time. Additionally, we show the algorithm has near optimal performance in the random-order arrival model when the number of impressions and the optimal matching are sufficiently large.


title: Comparison of Convexificated SQCQP and PSO for the Optimal Transmission System Operation based on Incremental In-Phase and Quadrature Voltage Controlled Transformers

abstract: The optimal operation of electrical energy systems by solving a security constrained optimal power flow (SCOPF) problem is still a challenging research aspect. Especially, for conventional optimization methods like sequential quadratic constrained quadratic programming (SQCQP) the formulation of the incremental control variables like in-phase and quadrature voltage controlled transformers in a solver suitable way is complex. Compared to this, the implementation of these control variables within heuristic approaches like the particle swarm optimization (PSO) is simple but problem specific adaptations of the classic PSO algorithm are necessary to avoid an unfortunate swarm behavior and local convergence in bad results. The objective of this paper is to introduce a SQCQP and a modified PSO approach in detail to solve the SCOPF problem adequately under consideration of flexible incremental in-phase and quadrature transformers tap sets and to compare and benchmark the results of both approaches for an adapted IEEE 118-bus system. The casestudy shows that both approaches lead to suitable results of the SCOPF with individual advantages of the SQCQP concerning the quality and the reproducibility of the results while the PSO lead to faster solutions when the complexity of the investigation scenario increases.


title: Observation of bottom-up formation for charged grain aggregates related to pre-planetary evolution beyond the bouncing barrier

abstract: Context. Particles in protoplanetary disks go through a number of phases that are dominated by collisions. In each of these events, grains exchange electrical charge via triboelectric effects. This enhances the stability of particle aggregates. Aim. Dielectric grains are easily charged by collisions. Here, we investigate whether a charge is capable of inducing an aggregation of particles and we consider how collision properties, such as ticking velocities and collisional cross-sections, are altered. Methods. We explored aggregation in microgravity experiments based on the observation of the motion of submillimeter (submm) grains following many collisions. In the process, grains attract each other, collide, stick, and ultimately form small aggregates. Results. We observed a bottom-up formation of irregular aggregates from submm grains. While some of the observed trajectories during the approach of grains reflect the presence of a pure Coulomb potential, the motion is not always in agreement with pure Kepler motion. Higher-order potentials of multipole charge distributions stand as a plausible explanation for this behavior. An immediate consequence of charging is that the particles continue to stick to each other at velocities of $\sim 10 \, \rm cm/s,$ while surface forces of neutral grains are only expected to allow sticking below $\sim 1 \, \rm mm/s$. No bouncing collision was observed among hundreds of collisions in the given parameter range. Applied to early phases of planet formation, the forming aggregates are therefore the first steps in a new growth phase beyond the traditional bouncing barrier in planet formation.


title: Frustrated tunneling dynamics in ultrashort laser pulses

abstract: We study a model for frustrated tunneling ionization using ultrashort laser pulses. The model is based on the strong field approximation and it employs the saddle point approximation to predict quasiclassical trajectories that are captured on Rydberg states. We present a classification of the saddle-point solutions and explore their behavior as functions of angular momentum of the final state, as well as the carrier--envelope phase (CEP) of the laser pulse. We compare the final state population computed by the model to results obtained by numerical propagation of the time-dependent Schr\"odinger equation (TDSE) for the hydrogen atom. While we find qualitative agreement in the CEP dependence of the populations in principal quantum numbers, $n$, the populations to individual angular momentum channels, $\ell$, are found to be inconsistent between model and TDSE. Thus, our results show that improvements of the quasiclassical trajectories are in order for a quantitative model of frustrated tunneling ionizaiton.


title: The data paper as a socio-linguistic epistemic object: A content analysis on the rhetorical moves used in data paper abstracts

abstract: The data paper is an emerging academic genre that focuses on the description of research data objects. However, there is a lack of empirical knowledge about this rising genre in quantitative science studies, particularly from the perspective of its linguistic features. To fill this gap, this research aims to offer a first quantitative examination of which rhetorical moves-rhetorical units performing a coherent narrative function-are used in data paper abstracts, as well as how these moves are used. To this end, we developed a new classification scheme for rhetorical moves in data paper abstracts by expanding a well-received system that focuses on English-language research article abstracts. We used this expanded scheme to classify and analyze rhetorical moves used in two flagship data journals, Scientific Data and Data in Brief. We found that data papers exhibit a combination of IMRaD- and data-oriented moves and that the usage differences between the journals can be largely explained by journal policies concerning abstract and paper structure. This research offers a novel examination of how the data paper, a novel data-oriented knowledge representation, is composed, which greatly contributes to a deeper understanding of data and data publication in the scholarly communication system.


title: Asymptotic Characterisation of Regularised Zero-Forcing Receiver for Imperfect and Correlated Massive MIMO Systems with Optimal Power Allocation

abstract: In this paper, we present asymptotic high dimensional analysis of the regularised zero-forcing (RZF) receiver in terms of its mean squared error (MSE) and bit error rate (BER) when used for the recovery of binary phase shift keying (BPSK) modulated signals in a massive multiple-input multiple-output (MIMO) communication system. We assume that the channel matrix is spatially correlated and not perfectly known. We use the linear minimum mean squared error (LMMSE) method to estimate the channel matrix. The asymptotic approximations of the MSE and BER enable us to solve various practical optimisation problems. Under MSE/BER minimisation, we derive 1) the optimal regularisation factor for RZF; 2) the optimal power allocation scheme. Numerical simulations show a close match to the derived asymptotic results even for a few dozens of the problem dimensions.


title: Online Coreset Selection for Rehearsal-based Continual Learning

abstract: A dataset is a shred of crucial evidence to describe a task. However, each data point in the dataset does not have the same potential, as some of the data points can be more representative or informative than others. This unequal importance among the data points may have a large impact in rehearsal-based continual learning, where we store a subset of the training examples (coreset) to be replayed later to alleviate catastrophic forgetting. In continual learning, the quality of the samples stored in the coreset directly affects the model's effectiveness and efficiency. The coreset selection problem becomes even more important under realistic settings, such as imbalanced continual learning or noisy data scenarios. To tackle this problem, we propose Online Coreset Selection (OCS), a simple yet effective method that selects the most representative and informative coreset at each iteration and trains them in an online manner. Our proposed method maximizes the model's adaptation to a current dataset while selecting high-affinity samples to past tasks, which directly inhibits catastrophic forgetting. We validate the effectiveness of our coreset selection mechanism over various standard, imbalanced, and noisy datasets against strong continual learning baselines, demonstrating that it improves task adaptation and prevents catastrophic forgetting in a sample-efficient manner.


title: Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learning

abstract: We propose a framework to learn to schedule a job-shop problem (JSSP) using a graph neural network (GNN) and reinforcement learning (RL). We formulate the scheduling process of JSSP as a sequential decision-making problem with graph representation of the state to consider the structure of JSSP. In solving the formulated problem, the proposed framework employs a GNN to learn that node features that embed the spatial structure of the JSSP represented as a graph (representation learning) and derive the optimum scheduling policy that maps the embedded node features to the best scheduling action (policy learning). We employ Proximal Policy Optimization (PPO) based RL strategy to train these two modules in an end-to-end fashion. We empirically demonstrate that the GNN scheduler, due to its superb generalization capability, outperforms practically favored dispatching rules and RL-based schedulers on various benchmark JSSP. We also confirmed that the proposed framework learns a transferable scheduling policy that can be employed to schedule a completely new JSSP (in terms of size and parameters) without further training.


title: Is Sparse Attention more Interpretable?

abstract: Sparse attention has been claimed to increase model interpretability under the assumption that it highlights influential inputs. Yet the attention distribution is typically over representations internal to the model rather than the inputs themselves, suggesting this assumption may not have merit. We build on the recent work exploring the interpretability of attention; we design a set of experiments to help us understand how sparsity affects our ability to use attention as an explainability tool. On three text classification tasks, we verify that only a weak relationship between inputs and co-indexed intermediate representations exists -- under sparse attention and otherwise. Further, we do not find any plausible mappings from sparse attention distributions to a sparse set of influential inputs through other avenues. Rather, we observe in this setting that inducing sparsity may make it less plausible that attention can be used as a tool for understanding model behavior.


title: TSI: Temporal Saliency Integration for Video Action Recognition

abstract: Efficient spatiotemporal modeling is an important yet challenging problem for video action recognition. Existing state-of-the-art methods exploit neighboring feature differences to obtain motion clues for short-term temporal modeling with a simple convolution. However, only one local convolution is incapable of handling various kinds of actions because of the limited receptive field. Besides, action-irrelated noises brought by camera movement will also harm the quality of extracted motion features. In this paper, we propose a Temporal Saliency Integration (TSI) block, which mainly contains a Salient Motion Excitation (SME) module and a Cross-perception Temporal Integration (CTI) module. Specifically, SME aims to highlight the motion-sensitive area through spatial-level local-global motion modeling, where the saliency alignment and pyramidal motion modeling are conducted successively between adjacent frames to capture motion dynamics with fewer noises caused by misaligned background. CTI is designed to perform multi-perception temporal modeling through a group of separate 1D convolutions respectively. Meanwhile, temporal interactions across different perceptions are integrated with the attention mechanism. Through these two modules, long short-term temporal relationships can be encoded efficiently by introducing limited additional parameters. Extensive experiments are conducted on several popular benchmarks (i.e., Something-Something V1 & V2, Kinetics-400, UCF-101, and HMDB-51), which demonstrate the effectiveness of our proposed method.


title: Testing the magnetic flux paradigm for AGN radio loudness with a radio intermediate quasar

abstract: For understanding the diversity of jetted active galactic nuclei (AGN) and especially the puzzling wide range in their radio-loudness, it is important to understand what role the magnetic fields play in setting the power of relativistic jets in AGN. We have performed multi-frequency (4-24 GHz) VLBA phase-referencing observations of the radio-intermediate quasar III Zw 2 using three nearby calibrators as reference sources to estimate jet magnetic flux by measuring the core-shift effect. By combining the self-referencing core-shift of each calibrator with the phase-referencing core-shifts, we obtained an upper limit of 0.16 mas for the core-shift between 4 and 24 GHz in III Zw 2. By assuming equipartition between magnetic and particle energy densities and adopting the flux-freezing approximation, we further estimated the upper limit for both magnetic field strength and poloidal magnetic flux threading the black hole. We find that the upper limit to the measured magnetic flux is smaller by at least a factor of five compared to the value predicted by the magnetically arrested disk (MAD) model. An alternative way to derive the jet magnetic field strength from the turnover of the synchrotron spectrum leads to an even smaller upper limit. Hence, the central engine of III Zw 2 has not reached the MAD state, which could explain why it has failed to develop a powerful jet, even though the source harbours a fast-spinning black hole. However, it generates an intermittent jet, which is possibly triggered by small scale magnetic field fluctuations as predicted by the magnetic flux paradigm of Sikora & Begelman (2013). We propose here that combining black hole spin measurements with magnetic field measurements from the VLBI core-shift observations of AGN over a range of jet powers could provide a strong test for the dominant factor setting the jet power relative to the accretion power available.


title: Minimal residual space-time discretizations of parabolic equations: Asymmetric spatial operators

abstract: We consider a minimal residual discretization of a simultaneous space-time variational formulation of parabolic evolution equations. Under the usual `LBB' stability condition on pairs of trial- and test spaces we show quasi-optimality of the numerical approximations without assuming symmetry of the spatial part of the differential operator. Under a stronger LBB condition we show error estimates in an energy-norm which are independent of this spatial differential operator.


title: belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification

abstract: Natural language processing (NLP) is becoming an important means for automatic recognition of human traits and states, such as intoxication, presence of psychiatric disorders, presence of airway disorders and states of stress. Such applications have the potential to be an important pillar for online help lines, and may gradually be introduced into eHealth modules. However, NLP is language specific and for languages such as Dutch, NLP models are scarce. As a result, recent Dutch NLP models have a low capture of long range semantic dependencies over sentences. To overcome this, here we present belabBERT, a new Dutch language model extending the RoBERTa architecture. belabBERT is trained on a large Dutch corpus (+32 GB) of web crawled texts. We applied belabBERT to the classification of psychiatric illnesses. First, we evaluated the strength of text-based classification using belabBERT, and compared the results to the existing RobBERT model. Then, we compared the performance of belabBERT to audio classification for psychiatric disorders. Finally, a brief exploration was performed, extending the framework to a hybrid text- and audio-based classification. Our results show that belabBERT outperformed the current best text classification network for Dutch, RobBERT. belabBERT also outperformed classification based on audio alone.


title: Statistical optimality conditions for compressive ensembles

abstract: We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent upper-bound on the excess risk, framed in terms of a natural notion of compressibility. This bound is independent of the dimension of the original data representation, and explains the in-built regularisation effect of the compressive approach. We then instantiate this general bound to classification and regression tasks, considering Johnson-Lindenstrauss mappings as the compression scheme. For each of these tasks, our strategy is to develop a tight upper bound on the compressibility function, and by doing so we discover distributional conditions of geometric nature under which the compressive algorithm attains minimax-optimal rates up to at most poly-logarithmic factors. In the case of compressive classification, this is achieved with a mild geometric margin condition along with a flexible moment condition that is significantly more general than the assumption of bounded domain. In the case of regression with strongly convex smooth loss functions we find that compressive regression is capable of exploiting spectral decay with near-optimal guarantees. In addition, a key ingredient for our central upper bound is a high probability uniform upper bound on the integrated deviation of dependent empirical processes, which may be of independent interest.


title: LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations

abstract: This work aims to tackle the challenging heterogeneous graph encoding problem in the text-to-SQL task. Previous methods are typically node-centric and merely utilize different weight matrices to parameterize edge types, which 1) ignore the rich semantics embedded in the topological structure of edges, and 2) fail to distinguish local and non-local relations for each node. To this end, we propose a Line Graph Enhanced Text-to-SQL (LGESQL) model to mine the underlying relational features without constructing meta-paths. By virtue of the line graph, messages propagate more efficiently through not only connections between nodes, but also the topology of directed edges. Furthermore, both local and non-local relations are integrated distinctively during the graph iteration. We also design an auxiliary task called graph pruning to improve the discriminative capability of the encoder. Our framework achieves state-of-the-art results (62.8% with Glove, 72.0% with Electra) on the cross-domain text-to-SQL benchmark Spider at the time of writing.


title: Double field theory, twistors, and integrability in 4-manifolds

abstract: The search for a geometrical understanding of dualities in string theory, in particular T-duality, has led to the development of modern T-duality covariant frameworks such as Double Field Theory, whose mathematical structure can be understood in terms of generalized geometry and, more recently, para-Hermitian geometry. In this work we apply techniques associated to this doubled geometry to four-dimensional manifolds, and we show that they are particularly well-suited to the analysis of integrability in special spacetimes, especially in connection with Penrose's twistor theory and its applications to general relativity. This shows a close relationship between some of the geometrical structures in the para-Hermitian approach to double field theory and those in algebraically special solutions to the Einstein equations. Particular results include the classification of four-dimensional, possibly complex-valued, (para-)Hermitian structures in different signatures, the Lie and Courant algebroid structures of special spacetimes, and the analysis of deformations of (para-)complex structures. We also discuss a notion of "weighted algebroids" in relation to a natural gauge freedom in the framework. Finally, we analyse the connection with two- and three-dimensional (real and complex) twistor spaces, and how the former can be understood in terms of the latter, in particular in terms of twistor families.


title: Lieb type convexity for positive operator monotone decreasing functions

abstract: We prove Lieb type convexity and concavity results for trace functionals associated with positive operator monotone (decreasing) functions and certain monotone concave functions. This gives a partial generalization of Hiai's recent work on trace functionals associated with power functions.


title: Learning to Rehearse in Long Sequence Memorization

abstract: Existing reasoning tasks often have an important assumption that the input contents can be always accessed while reasoning, requiring unlimited storage resources and suffering from severe time delay on long sequences. To achieve efficient reasoning on long sequences with limited storage resources, memory augmented neural networks introduce a human-like write-read memory to compress and memorize the long input sequence in one pass, trying to answer subsequent queries only based on the memory. But they have two serious drawbacks: 1) they continually update the memory from current information and inevitably forget the early contents; 2) they do not distinguish what information is important and treat all contents equally. In this paper, we propose the Rehearsal Memory (RM) to enhance long-sequence memorization by self-supervised rehearsal with a history sampler. To alleviate the gradual forgetting of early information, we design self-supervised rehearsal training with recollection and familiarity tasks. Further, we design a history sampler to select informative fragments for rehearsal training, making the memory focus on the crucial information. We evaluate the performance of our rehearsal memory by the synthetic bAbI task and several downstream tasks, including text/video question answering and recommendation on long sequences.


title: T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT

abstract: Sentiment analysis (SA) has become an extensive research area in recent years impacting diverse fields including ecommerce, consumer business, and politics, driven by increasing adoption and usage of social media platforms. It is challenging to extract topics and sentiments from unsupervised short texts emerging in such contexts, as they may contain figurative words, strident data, and co-existence of many possible meanings for a single word or phrase, all contributing to obtaining incorrect topics. Most prior research is based on a specific theme/rhetoric/focused-content on a clean dataset. In the work reported here, the effectiveness of BERT(Bidirectional Encoder Representations from Transformers) in sentiment classification tasks from a raw live dataset taken from a popular microblogging platform is demonstrated. A novel T-BERT framework is proposed to show the enhanced performance obtainable by combining latent topics with contextual BERT embeddings. Numerical experiments were conducted on an ensemble with about 42000 datasets using NimbleBox.ai platform with a hardware configuration consisting of Nvidia Tesla K80(CUDA), 4 core CPU, 15GB RAM running on an isolated Google Cloud Platform instance. The empirical results show that the model improves in performance while adding topics to BERT and an accuracy rate of 90.81% on sentiment classification using BERT with the proposed approach.


title: Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions

abstract: Graph generative models are a highly active branch of machine learning. Given the steady development of new models of ever-increasing complexity, it is necessary to provide a principled way to evaluate and compare them. In this paper, we enumerate the desirable criteria for such a comparison metric and provide an overview of the status quo of graph generative model comparison in use today, which predominantly relies on the maximum mean discrepancy (MMD). We perform a systematic evaluation of MMD in the context of graph generative model comparison, highlighting some of the challenges and pitfalls researchers inadvertently may encounter. After conducting a thorough analysis of the behaviour of MMD on synthetically-generated perturbed graphs as well as on recently-proposed graph generative models, we are able to provide a suitable procedure to mitigate these challenges and pitfalls. We aggregate our findings into a list of practical recommendations for researchers to use when evaluating graph generative models.


title: Handling Non-Unitaries in Quantum Circuit Equivalence Checking

abstract: Quantum computers are reaching a level where interactions between classical and quantum computations can happen in real-time. This marks the advent of a new, broader class of quantum circuits: dynamic quantum circuits. They offer a broader range of available computing primitives that lead to new challenges for design tasks such as simulation, compilation, and verification. Due to the non-unitary nature of dynamic circuit primitives, most existing techniques and tools for these tasks are no longer applicable in an out-of-the-box fashion. In this work, we discuss the resulting consequences for quantum circuit verification, specifically equivalence checking, and propose two different schemes that eventually allow to treat the involved circuits as if they did not contain non-unitaries at all. As a result, we demonstrate methodically, as well as, experimentally that existing techniques for verifying the equivalence of quantum circuits can be kept applicable for this broader class of circuits.


title: Prediction of the Position of External Markers Using a Recurrent Neural Network Trained With Unbiased Online Recurrent Optimization for Safe Lung Cancer Radiotherapy

abstract: During lung radiotherapy, the position of infrared reflective objects on the chest can be recorded to estimate the tumor location. However, radiotherapy systems have a latency inherent to robot control limitations that impedes the radiation delivery precision. Prediction with online learning of recurrent neural networks (RNN) allows for adaptation to non-stationary respiratory signals, but classical methods such as RTRL and truncated BPTT are respectively slow and biased. This study investigates the capabilities of unbiased online recurrent optimization (UORO) to forecast respiratory motion and enhance safety in lung radiotherapy. We used 9 observation records of the 3D position of 3 external markers on the chest and abdomen of healthy individuals breathing during intervals from 73s to 222s. The sampling frequency was 10Hz, and the amplitudes of the recorded trajectories range from 6mm to 40mm in the superior-inferior direction. We forecast the 3D location of each marker simultaneously with a horizon value between 0.1s and 2.0s, using an RNN trained with UORO. We compare its performance with an RNN trained with RTRL, LMS, and offline linear regression. We provide closed-form expressions for quantities involved in the loss gradient calculation in UORO, thereby making its implementation efficient. Training and cross-validation were performed during the first minute of each sequence. On average over the horizon values considered and the 9 sequences, UORO achieves the lowest root-mean-square (RMS) error and maximum error among the compared algorithms. These errors are respectively equal to 1.3mm and 8.8mm, and the prediction time per time step was lower than 2.8ms (Dell Intel core i9-9900K 3.60 GHz). Linear regression has the lowest RMS error for the horizon values 0.1s and 0.2s, followed by LMS for horizon values between 0.3s and 0.5s, and UORO for horizon values greater than 0.6s.


title: Learning a Single Neuron with Bias Using Gradient Descent

abstract: We theoretically study the fundamental problem of learning a single neuron with a bias term ($\mathbf{x} \mapsto \sigma(<\mathbf{w},\mathbf{x}> + b)$) in the realizable setting with the ReLU activation, using gradient descent. Perhaps surprisingly, we show that this is a significantly different and more challenging problem than the bias-less case (which was the focus of previous works on single neurons), both in terms of the optimization geometry as well as the ability of gradient methods to succeed in some scenarios. We provide a detailed study of this problem, characterizing the critical points of the objective, demonstrating failure cases, and providing positive convergence guarantees under different sets of assumptions. To prove our results, we develop some tools which may be of independent interest, and improve previous results on learning single neurons.


title: Global solvability and convergence to stationary solutions in singular quasilinear stochastic PDEs

abstract: We consider singular quasilinear stochastic partial differential equations (SPDEs) studied in \cite{FHSX}, which are defined in paracontrolled sense. The main aim of the present article is to establish the global-in-time solvability for a particular class of SPDEs with origin in particle systems and, under a certain additional condition on the noise, prove the convergence of the solutions to stationary solutions as $t\to\infty$. We apply the method of energy inequality and Poincar\'e inequality. It is essential that the Poincar\'e constant can be taken uniformly in an approximating sequence of the noise. We also use the continuity of the solutions in the enhanced noise, initial values and coefficients of the equation, which we prove in this article for general SPDEs discussed in \cite{FHSX} except that in the enhanced noise. Moreover, we apply the initial layer property of improving regularity of the solutions in a short time.


title: Coherent soliton states hidden in phase-space and stabilized by gravitational incoherent structures

abstract: We consider the problem of the formation of soliton states from a modulationally unstable initial condition in the framework of the Schr\"odinger-Poisson (or Newton-Schr\"odinger) equation accounting for gravitational interactions. We unveil a previously unrecognized regime: By increasing the nonlinearity, the system self-organizes into an incoherent localized structure that contains "hidden" coherent soliton states. The solitons are "hidden" in the sense that they are fully immersed in random wave fluctuations: The radius of the soliton is much larger than the correlation radius of the incoherent fluctuations while its peak amplitude is of the same order of such fluctuations. Accordingly, the solitons can hardly be identified in the usual spatial or spectral domains, while their existence is clearly unveiled in the phase-space representation. Our multi-scale theory based on coupled coherent-incoherent wave turbulence formalisms reveals that the hidden solitons are stabilized and trapped by the incoherent localized structure. Furthermore, hidden binary soliton systems are identified numerically and described theoretically. The regime of hidden solitons is of potential interest for self-gravitating Boson models of "fuzzy" dark matter. It also sheds new light on the quantum-to-classical correspondence with gravitational interactions. The hidden solitons can be observed in nonlocal nonlinear optics experiments through the measurement of the spatial spectrogram.


title: Filtrated Common Functional Principal Components for Multivariate Functional data

abstract: Local field potentials (LFPs) are signals that measure electrical activity in localized cortical regions from implanted tetrodes in the human or animal brain. The LFP signals are curves observed at multiple tetrodes which are implanted across a patch on the surface of the cortex. Hence, they can be treated as multi-group functional data, where the trajectories collected across temporal epochs from one tetrode are viewed as a group of functions. In many cases, multi-tetrode LFP trajectories contain both global variation patterns (which are shared in common to all groups, due to signal synchrony) and isolated variation patterns (common only to a small subset of groups), and such structure is very informative to the analysis of such data. Therefore, one goal in this paper is to develop an efficient procedure that is able to capture and quantify both global and isolated features. We propose a novel tree-structured functional principal components (filt-fPC) analysis through finite-dimensional functional representation - specifically via filtration. A major advantage of the proposed filt-fPC method is the ability to extract the components that are common to multiple groups (or tetrodes) in a flexible "multi-resolution" manner and simultaneously preserve the idiosyncratic individual components of different tetrodes. The proposed filt-fPC approach is highly data-driven and no "ground-truth" model pre-specification is needed, making it a suitable approach for analyzing multi-group functional data that is complex. In addition, the filt-fPC method is able to produce a parsimonious, interpretable, and efficient low dimensional representation of multi-group functional data with orthonormal basis functions. Here, the proposed filt-fPCA method is employed to study the impact of a shock (induced stroke) on the synchrony structure of the rat brain.