title: Attentional Prototype Inference for Few-Shot Segmentation

abstract: This paper aims to address few-shot segmentation. While existing prototype-based methods have achieved considerable success, they suffer from uncertainty and ambiguity caused by limited labeled examples. In this work, we propose attentional prototype inference (API), a probabilistic latent variable framework for few-shot segmentation. We define a global latent variable to represent the prototype of each object category, which we model as a probabilistic distribution. The probabilistic modeling of the prototype enhances the model's generalization ability by handling the inherent uncertainty caused by limited data and intra-class variations of objects. To further enhance the model, we introduce a local latent variable to represent the attention map of each query image, which enables the model to attend to foreground objects while suppressing the background. The optimization of the proposed model is formulated as a variational Bayesian inference problem, which is established by amortized inference networks. We conduct extensive experiments on four benchmarks, where our proposal obtains at least competitive and often better performance than state-of-the-art prototype-based methods. We also provide comprehensive analyses and ablation studies to gain insight into the effectiveness of our method for few-shot segmentation.


title: Keep Your Distance: Land Division With Separation

abstract: This paper is part of an ongoing endeavor to bring the theory of fair division closer to practice by handling requirements from real-life applications. We focus on two requirements originating from the division of land estates: (1) each agent should receive a plot of a usable geometric shape, and (2) plots of different agents must be physically separated. With these requirements, the classic fairness notion of \emph{proportionality} is impractical, since it may be impossible to attain any multiplicative approximation of it. In contrast, the \emph{ordinal maximin share approximation}, introduced by Budish in 2011, provides meaningful fairness guarantees. We prove upper and lower bounds on achievable maximin share guarantees when the usable shapes are squares, fat rectangles, or arbitrary axis-aligned rectangles, and explore the algorithmic and query complexity of finding fair partitions in this setting. Our work makes use of tools and concepts from computational geometry such as independent sets of rectangles and guillotine partitions.


title: On the dual relation in the Hawking--Page phase transition of the black holes in a cavity

abstract: The Hawking--Page phase transitions of the $d$-dimensional Schwarzschild and charged black holes are explored in a cavity. The phase transition temperature $T_{\rm HP}$, the minimum black hole temperature $T_0$, and the Gibbs free energy $G$ are systematically calculated. A dual relation for the Schwarzschild black holes in the anti-de Sitter space, $T_{\rm HP}(d)=T_0(d+1)$, is found to be also approximately valid in the cavity case to a high precision, and this relation can be further generalized to the charged black holes in a suitable form. Our work reveals the universal properties of the black holes in different extended phase spaces and motivates further studies on their thermodynamic behaviors that are sensitive to specific boundary conditions, like the terminal points in the $G$--$T$ curves.


title: A Viscoelastic Model for Human Myocardium

abstract: Understanding the biomechanics of the heart in health and disease plays an important role in the diagnosis and treatment of heart failure. The use of computational biomechanical models for therapy assessment is paving the way for personalized treatment, and relies on accurate constitutive equations mapping strain to stress. Current state-of-the art constitutive equations account for the nonlinear anisotropic stress-strain response of cardiac muscle using hyperelasticity theory. While providing a solid foundation for understanding the biomechanics of heart tissue, most current laws neglect viscoelastic phenomena observed experimentally. Utilizing experimental data from human myocardium and knowledge of the hierarchical structure of heart muscle, we present a fractional nonlinear anisotropic viscoelastic constitutive model. The model is shown to replicate biaxial stretch, triaxial cyclic shear and triaxial stress relaxation experiments (mean error ~7.65%), showing improvements compared to its hyperelastic (mean error ~25%) counterparts. Model sensitivity, fidelity and parameter uniqueness are demonstrated. The model is also compared to rate-dependent biaxial stretch as well as different modes of biaxial stretch, illustrating extensibility of the model to a range of loading phenomena.


title: N-jettiness in electroweak high-energy processes

abstract: We study $N$-jettiness in electroweak processes at extreme high energies. The description of the scattering process such as $e^- e^+ \rightarrow \mu^- \mu^+ +X$ is similar to QCD. At present, electroweak processes are prevailed by the processes induced by the strong interaction, but they will be relevant at future $e^- e^+$ colliders at high energy. The main difference between QCD and electroweak processes is that the initial- and final-state particles should appear in the form of hadrons, that is, color singlets in QCD, while there can be weak nonsinglets as well in electroweak interactions. We analyze the factorization theorems for the $N$-jettiness in $e^- e^+ \rightarrow \mu^- \mu^+ +X$, and compute the factorized parts to next-to-leading logarithmic accuracy. To simplify the comparison with QCD, we only consider the $SU(2)_W$ gauge interaction, and the extension to the Standard Model is straightforward. Put it in a different way, it corresponds to an imaginary world in which colored particles can be observed in QCD, and the richer structure of effective theories is probed. Various nonzero nonsinglet matrix elements are interwoven to produce the factorized results, in contrast to QCD in which there are only contributions from the singlets. Another distinct feature is that the rapidity divergence is prevalent in the contributions from weak nonsinglets due to the different group theory factors between the real and virtual corrections. We verify that the rapidity divergence cancels in all the contributions with a different number of nonsinglet channels. We also consider the renormalization group evolution of each factorized part to resum large logarithms, which are distinct from QCD.


title: Autonomous artificial intelligence discovers mechanisms of molecular self-organization in virtual experiments

abstract: Molecular self-organization driven by concerted many-body interactions produces the ordered structures that define both inanimate and living matter. Understanding the physical mechanisms that govern the formation of molecular complexes and crystals is key to controlling the assembly of nanomachines and new materials. We present an artificial intelligence (AI) agent that uses deep reinforcement learning and transition path theory to discover the mechanism of molecular self-organization phenomena from computer simulations. The agent adaptively learns how to sample complex molecular events and, on the fly, constructs quantitative mechanistic models. By using the mechanistic understanding for AI-driven sampling, the agent closes the learning cycle and overcomes time-scale gaps of many orders of magnitude. Symbolic regression condenses the mechanism into a human-interpretable form. Applied to ion association in solution, gas-hydrate crystal formation, and membrane-protein assembly, the AI agent identifies the many-body solvent motions governing the assembly process, discovers the variables of classical nucleation theory, and reveals competing assembly pathways. The mechanistic descriptions produced by the agent are predictive and transferable to close thermodynamic states and similar systems. Autonomous AI sampling has the power to discover assembly and reaction mechanisms from materials science to biology.


title: Indirect CP probes of the Higgs--top-quark interaction at the LHC

abstract: The precise determination of the Higgs boson CP properties is among the most important goals for existing and future colliders. In this work, we evaluate existing constraints on the CP nature of the Higgs interaction with top quarks taking into account all relevant inclusive and differential Higgs boson measurements. We study the model dependence of these constraints by allowing for deviations from the SM predictions also in the Higgs couplings to massive vector boson, photons, and gluons. Additionally, we evaluate the future prospects for constraining the CP nature of the top-Yukawa coupling by total rate measurements. In this context, we propose an analysis strategy for measuring tH production at the HL-LHC without relying on assumptions about the Higgs CP character.


title: The moment map on the space of symplectic 3D Monge-Amp\`ere equations

abstract: For any second-order scalar PDE $\mathcal{E}$ in one unknown function, that we interpret as a hypersurface of a second-order jet space $J^2$, we construct, by means of the characteristics of $\mathcal{E}$, a sub-bundle of the contact distribution of the underlying contact manifold $J^1$, consisting of conic varieties. We call it the contact cone structure associated with $\mathcal{E}$. We then focus on symplectic Monge-Amp\`ere equations in 3 independent variables, that are naturally parametrized by a 13-dimensional real projective space. If we pass to the field of complex numbers $\mathbb{C}$, this projective space turns out to be the projectivization of the 14-dimensional irreducible representation of the simple Lie group $\mathsf{Sp}(6,\mathbb{C})$: the associated moment map allows to define a rational map $\varpi$ from the space of symplectic 3D Monge-Amp\`ere equations to the projectivization of the space of quadratic forms on a $6$-dimensional symplectic vector space. We study in details the relationship between the zero locus of the image of $\varpi$, herewith called the cocharacteristic variety, and the contact cone structure of a 3D Monge-Amp\`ere equation $\mathcal{E}$: under the hypothesis of non-degenerate symbol, we prove that these two constructions coincide. A key tool in achieving such a result will be a complete list of mutually non-equivalent quadratic forms on a $6$-dimensional symplectic space, which has an interest on its own.


title: Fast Stencil Computations using Fast Fourier Transforms

abstract: Stencil computations are widely used to simulate the change of state of physical systems across a multidimensional grid over multiple timesteps. The state-of-the-art techniques in this area fall into three groups: cache-aware tiled looping algorithms, cache-oblivious divide-and-conquer trapezoidal algorithms, and Krylov subspace methods. In this paper, we present two efficient parallel algorithms for performing linear stencil computations. Current direct solvers in this domain are computationally inefficient, and Krylov methods require manual labor and mathematical training. We solve these problems for linear stencils by using DFT preconditioning on a Krylov method to achieve a direct solver which is both fast and general. Indeed, while all currently available algorithms for solving general linear stencils perform $\Theta(NT)$ work, where $N$ is the size of the spatial grid and $T$ is the number of timesteps, our algorithms perform $o(NT)$ work. To the best of our knowledge, we give the first algorithms that use fast Fourier transforms to compute final grid data by evolving the initial data for many timesteps at once. Our algorithms handle both periodic and aperiodic boundary conditions, and achieve polynomially better performance bounds (i.e., computational complexity and parallel runtime) than all other existing solutions. Initial experimental results show that implementations of our algorithms that evolve grids of roughly $10^7$ cells for around $10^5$ timesteps run orders of magnitude faster than state-of-the-art implementations for periodic stencil problems, and 1.3$\times$ to 8.5$\times$ faster for aperiodic stencil problems.


title: XAI Handbook: Towards a Unified Framework for Explainable AI

abstract: The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new contribution seems to rely on its own (and often intuitive) version of terms like "explanation" and "interpretation". Such disarray encumbers the consolidation of advances in the field towards the fulfillment of scientific and regulatory demands e.g., when comparing methods or establishing their compliance with respect to biases and fairness constraints. We propose a theoretical framework that not only provides concrete definitions for these terms, but it also outlines all steps necessary to produce explanations and interpretations. The framework also allows for existing contributions to be re-contextualized such that their scope can be measured, thus making them comparable to other methods. We show that this framework is compliant with desiderata on explanations, on interpretability and on evaluation metrics. We present a use-case showing how the framework can be used to compare LIME, SHAP and MDNet, establishing their advantages and shortcomings. Finally, we discuss relevant trends in XAI as well as recommendations for future work, all from the standpoint of our framework.


title: The Grothendieck and Picard groups of finite rank torsion free $\mathfrak{sl}(2)$-modules

abstract: The classification problem for simple $\mathfrak{sl}(2)$-modules leads in a natural way to the study of the category of finite rank torsion free $\mathfrak{sl}(2)$-modules and its subcategory of rational $\mathfrak{sl}(2)$-modules. We prove that the rationalization functor induces an identification between the isomorphism classes of simple modules of these categories. This raises the question of what is the precise relationship between other invariants associated with them. We give a complete solution to this problem for the Grothendieck and Picard groups, obtaining along theway several new results regarding these categories that are interesting in their own right.


title: Dynamic Multi-Branch Layers for On-Device Neural Machine Translation

abstract: With the rapid development of artificial intelligence (AI), there is a trend in moving AI applications, such as neural machine translation (NMT), from cloud to mobile devices. Constrained by limited hardware resources and battery, the performance of on-device NMT systems is far from satisfactory. Inspired by conditional computation, we propose to improve the performance of on-device NMT systems with dynamic multi-branch layers. Specifically, we design a layer-wise dynamic multi-branch network with only one branch activated during training and inference. As not all branches are activated during training, we propose shared-private reparameterization to ensure sufficient training for each branch. At almost the same computational cost, our method achieves improvements of up to 1.7 BLEU points on the WMT14 English-German translation task and 1.8 BLEU points on the WMT20 Chinese-English translation task over the Transformer model, respectively. Compared with a strong baseline that also uses multiple branches, the proposed method is up to 1.5 times faster with the same number of parameters.


title: Desperately seeking the impact of learning analytics in education at scale: Marrying data analysis with teaching and learning

abstract: Learning analytics (LA) is argued to be able to improve learning outcomes, learner support and teaching. However, despite an increasingly expanding amount of student (digital) data accessible from various online education and learning platforms and the growing interest in LA worldwide as well as considerable research efforts already made, there is still little empirical evidence of impact on practice that shows the effectiveness of LA in education settings. Based on a selection of theoretical and empirical research, this chapter provides a critical discussion about the possibilities of collecting and using student data as well as barriers and challenges to overcome in providing data-informed support to educators' everyday teaching practices. We argue that in order to increase the impact of data-driven decision-making aimed at students' improved learning in education at scale, we need to better understand educators' needs, their teaching practices and the context in which these practices occur, and how to support them in developing relevant knowledge, strategies and skills to facilitate the data-informed process of digitalization of education.


title: DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing

abstract: We present DaLAJ 1.0, a Dataset for Linguistic Acceptability Judgments for Swedish, comprising 9 596 sentences in its first version; and the initial experiment using it for the binary classification task. DaLAJ is based on the SweLL second language learner data, consisting of essays at different levels of proficiency. To make sure the dataset can be freely available despite the GDPR regulations, we have sentence-scrambled learner essays and removed part of the metadata about learners, keeping for each sentence only information about the mother tongue and the level of the course where the essay has been written. We use the normalized version of learner language as the basis for the DaLAJ sentences, and keep only one error per sentence. We repeat the same sentence for each individual correction tag used in the sentence. For DaLAJ 1.0 we have used four error categories (out of 35 available in SweLL), all connected to lexical or word-building choices. Our baseline results for the binary classification show an accuracy of 58% for DaLAJ 1.0 using BERT embeddings. The dataset is included in the SwedishGlue (Swe. SuperLim) benchmark. Below, we describe the format of the dataset, first experiments, our insights and the motivation for the chosen approach to data sharing.


title: Magnetic field and thermal radiation induced entropy generation in a multiphase non-isothermal plane Poiseuille flow

abstract: The effect of radiative heat transfer on the entropy generation in a two-phase non-isothermal fluid flow between two infinite horizontal parallel plates under the influence of a constant pressure gradient and transverse non-invasive magnetic field have been explored. Both the fluids are considered to be viscous, incompressible, immiscible, Newtonian, and electrically conducting. The governing equations in Cartesian coordinate are solved analytically with the help of appropriate boundary conditions to obtain the velocity and temperature profile inside the channel. Application of transverse magnetic field is found to reduce the throughput and the temperature distribution of the fluids in a pressure-driven flow. The temperature and fluid flow inside the channel can also be non-invasively altered by tuning the magnetic field intensity, the temperature difference between the channel walls and the fluids, and several intrinsic fluid properties. The entropy generation due to the heat transfer, magnetic field, and fluid flow irreversibilities can be controlled by altering the Hartmann number, radiation parameter, Brinkmann number, filling ratio, and the ratios of fluid viscosities, thermal and electrical conductivities. The surfaces of the channel wall are found to act as a strong source of entropy generation and heat transfer irreversibility. The rate of heat transfer at the channel walls can also be tweaked by the magnetic field intensity, temperature differences, and fluid properties. The proposed strategies in the present study can be of significance in the design and development of gen-next microscale reactors, micro heat exchangers, and energy harvesting devices.


title: Tether-cutting and Overlying Magnetic Reconnections in an MHD Simulation of Prominence-cavity System

abstract: We investigate the magnetic reconnection in an MHD simulation of a coronal magnetic flux rope (MFR) confined by a helmet streamer, where a prominence-cavity system forms. This system includes a hot cavity surrounding a prominence with prominence horns and a central hot core above the prominence. The evolution of the system from quasi-equilibrium to eruption can be divided into four phases: quasi-static, slow rise, fast rise, and propagation phases. The emerged MFR initially stays quasi-static and magnetic reconnection occurs at the overlying high-Q (squashing factor) apex region, which gradually evolves into a hyperbolic flux tube (HFT). The decrease of the integrated magnetic tension force (above the location of the overlying reconnection) is due to the removal of overlying confinement by the enhanced overlying reconnection between the MFR and the overlying fields at the apex HFT, thus engines the slow rise of the MFR with a nearly constant velocity. Once the MFR reaches the regime of torus instability, another HFT immediately forms at the dip region under the MFR, followed by the explosive flare reconnection. The integrated resultant force (above the location of the flare reconnection) exponentially increases, which drives the exponential fast rise of the MFR. The system enters the propagation phase, once its apex reaches the height of about one solar radius above the photosphere. The simulation reproduces the main processes of one group of prominence eruptions especially those occurring on the quiet Sun.


title: The derived dimensions of $(m,n)$-Igusa-Todorov algebras

abstract: We give an upper bound for the dimension of the bounded derived categories of $(m,n)$-Igusa-Todorov algebras which is a generalization of $n$-Igusa-Todorov algebras, where $m,n$ are two nonnegative integers. As an applications, we get a new upper bound for the dimension of bounded derived categories in terms of the projective dimensions of certain of simple modules as well as radical layer length of artin algebra $\Lambda$.


title: Basal pressure variations induced by a turbulent flow over a wavy surface

abstract: Turbulent flows over wavy surfaces give rise to the formation of ripples, dunes and other natural bedforms. To predict how much sediment these flows transport, research has focused mainly on basal shear stress, which peaks upstream of the highest topography, and has largely ignored the corresponding pressure variations. In this article, we reanalyze old literature data, as well as more recent wind tunnel results, to shed a new light on pressure induced by a turbulent flow on a sinusoidal surface. While the Bernoulli effect increases the velocity above crests and reduces it in troughs, pressure exhibits variations that lag behind the topography. We extract the in-phase and in-quadrature components from streamwise pressure profiles and compare them to hydrodynamic predictions calibrated on shear stress data.


title: Time Flies When Looking out of the Window: Timed Games with Window Parity Objectives

abstract: The window mechanism was introduced by Chatterjee et al. to reinforce mean-payoff and total-payoff objectives with time bounds in two-player turn-based games on graphs. It has since proved useful in a variety of settings, including parity objectives in games and both mean-payoff and parity objectives in Markov decision processes. We study window parity objectives in timed automata and timed games: given a bound on the window size, a path satisfies such an objective if, in all states along the path, we see a sufficiently small window in which the smallest priority is even. We show that checking that all time-divergent paths of a timed automaton satisfy such a window parity objective can be done in polynomial space, and that the corresponding timed games can be solved in exponential time. This matches the complexity class of timed parity games, while adding the ability to reason about time bounds. We also consider multi-dimensional objectives and show that the complexity class does not increase. To the best of our knowledge, this is the first study of the window mechanism in a real-time setting.


title: Dual communities in spatial networks

abstract: Both human-made and natural supply systems, such as power grids and leaf venation networks, are built to operate reliably under changing external conditions. Many of these spatial networks exhibit community structures. Here, we show that a relatively strong connectivity between the parts of a network can be used to define a different class of communities: dual communities. We demonstrate that traditional and dual communities emerge naturally as two different phases of optimized network structures that are shaped by fluctuations and that they suppress failure spreading, which underlines their importance in understanding the shape of real-world supply networks.


title: On factorisation schemes for the electron parton distribution functions in QED

abstract: The electron, positron, and photon Parton Distribution Functions (PDFs) of the unpolarised electron have recently been computed at the next-to-leading logarithmic accuracy in QED, by adopting the $\overline{\rm MS}$ factorisation scheme. We present here analogous results, obtained by working in a different framework that is inspired by the so-called DIS scheme. We derive analytical solutions relevant to the large-$z$ region, where we show that the behaviour of the PDFs depends in a dramatic way on whether running-$\alpha$ effects are included to all orders, as opposed to being truncated to some fixed order. By means of suitable initial and evolution conditions, next-to-leading logarithmic accurate PDFs are obtained whose large-$z$ functional forms are identical to those of their leading logarithmic counterparts.


title: Geography of minimal surfaces of general type with $\mathbb{Z}_2^2$-actions and the locus of Gorenstein stable surfaces

abstract: In this note the geography of minimal surfaces of general type admitting $\mathbb{Z}_2^2$-actions is studied. More precisely, it is shown that Gieseker's moduli space $\mathfrak{M}_{K^2,\chi}$ contains surfaces admitting a $\mathbb{Z}_2^2$-action for every admissible pair $(K^2, \chi)$ such that $2\chi-6\leq K^2\leq 8\chi-8$ or $K^2=8\chi$. The examples considered allow to prove that the locus of Gorenstein stable surfaces is not closed in the KSBA-compactification $\overline{\mathfrak{M}}_{K^2,\chi}$ of Gieseker's moduli space $\mathfrak{M}_{K^2,\chi}$ for every admissible pair $(K^2, \chi)$ such that $2\chi-6\leq K^2\leq 8\chi-8$.


title: On Bisimilarities for Closure Spaces - Preliminary Version

abstract: Closure spaces are a generalisation of topological spaces obtained by removing the idempotence requirement on the closure operator. We adapt the standard notion of bisimilarity for topological models, namely Topo-bisimilarity, to closure models -- we call the resulting equivalence CM-bisimilarity -- and refine it for quasi-discrete closure models. We also define two additional notions of bisimilarity that are based on paths on space, namely Path-bisimilarity and Compatible Path-bisimilarity, CoPa-bisimilarity for short. The former expresses (unconditional) reachability, the latter refines it in a way that is reminishent of Stuttering Equivalence on transition systems. For each bisimilarity we provide a logical characterisation, using variants of the Spatial Logic for Closure Spaces (SLCS). We also address the issue of (space) minimisation via the three equivalences.


title: Betweenness centrality of teams in social networks

abstract: Betweenness centrality (BC) was proposed as an indicator of the extent of an individual's influence in a social network. It is measured by counting how many times a vertex (i.e., an individual) appears on all the shortest paths between pairs of vertices. A question naturally arises as to how the influence of a team or group in a social network can be measured. Here, we propose a method of measuring this influence on a bipartite graph comprising vertices (individuals) and hyperedges (teams). When the hyperedge size varies, the number of shortest paths between two vertices in a hypergraph can be larger than that in a binary graph. Thus, the power-law behavior of the team BC distribution breaks down in scale-free hypergraphs. However, when the weight of each hyperedge, for example, the performance per team member, is counted, the team BC distribution is found to exhibit power-law behavior. We find that a team with a widely connected member is highly influential.


title: Fusion of Heterogeneous Friction Estimates for Traction Adaptive Motion Planning and Control

abstract: Traction adaptive motion planning and control has potential to improve an an automated vehicle's ability to avoid accident in a critical situation. However, such functionality require an accurate friction estimate for the road ahead of the vehicle that is updated in real time. Current state of the art friction estimation techniques include high accuracy local friction estimation in the presence of tire slip, as well as rough classification of the road surface ahead of the vehicle, based on forward looking camera. In this paper we show that neither of these techniques in isolation yield satisfactory behavior when deployed with traction adaptive motion planning and control functionality. However, fusion of the two provides sufficient accuracy, availability and foresight to yield near optimal behavior. To this end, we propose a fusion method based on heteroscedastic gaussian process regression, and present initial simulation based results.


title: Mechanical Response of Mesoporous Amorphous NiTi Alloy to External Deformations

abstract: The porous titanium nickelide is very popular in various industries due to unique combination of physical and mechanical properties such as shape memory effect, high corrosion resistance, and biocompatibility. The non-equilibrium molecular dynamics simulation was applied to study the influence of porosity degree on mechanical properties of porous amorphous titanium nickelide at uniaxial tension, uniaxial compression, and uniform shear. We have found that the porous amorphous alloy is characterized by a relatively large value of Young's modulus in comparison to its crystalline analogue. It has been found that the system with a percolated network of pores exhibits improved elastic characteristics associated with resistance to tensile and shear. The system contained isolated spherical pores is more resistant to compression and less resistant to tensile and shear. These results can be applied to develop and improve the methods for making amorphous metal foams.


title: Generalized splay states in phase oscillator networks

abstract: Networks of coupled phase oscillators play an important role in the analysis of emergent collective phenomena. In this article, we introduce generalized $m$-splay states constituting a special subclass of phase-locked states with vanishing $m$th order parameter. Such states typically manifest incoherent dynamics, and they often create high-dimensional families of solutions (splay manifolds). For a general class of phase oscillator networks, we provide explicit linear stability conditions for splay states and exemplify our results with the well-known Kuramoto-Sakaguchi model. Importantly, our stability conditions are expressed in terms of just a few observables such as the order parameter or the trace of the Jacobian. As a result, these conditions are simple and applicable to networks of arbitrary size. We generalize our findings to phase oscillators with inertia and adaptively coupled phase oscillator models.


title: Uniaxial strain control of bulk ferromagnetism in rare-earth titanates

abstract: The perovskite rare-earth titanates are model Mott insulators with magnetic ground states that are very sensitive to structural distortions. These distortions couple strongly to the orbital degrees of freedom and, in principle, it should be possible to tune the superexchange and the magnetic transition with strain. We investigate the representative system (Y,La,Ca)TiO$_3$, which exhibits low crystallographic symmetry and no structural instabilities. From magnetic susceptibility measurements of the Curie temperature, we demonstrate direct, reversible and continuous control of ferromagnetism by influencing the TiO$_6$ octahedral tilts and rotations with uniaxial strain. The relative change in $T_C$ as a function of strain is well described by ab initio calculations, which provides detailed understanding of the complex interactions among structural, orbital and magnetic properties in rare-earth titanates. The demonstrated manipulation of octahedral distortions opens up far-reaching possibilities for investigations of electron-lattice coupling, competing ground states, and magnetic quantum phase transitions in a wide range of quantum materials.


title: Non-decreasing Quantile Function Network with Efficient Exploration for Distributional Reinforcement Learning

abstract: Although distributional reinforcement learning (DRL) has been widely examined in the past few years, there are two open questions people are still trying to address. One is how to ensure the validity of the learned quantile function, the other is how to efficiently utilize the distribution information. This paper attempts to provide some new perspectives to encourage the future in-depth studies in these two fields. We first propose a non-decreasing quantile function network (NDQFN) to guarantee the monotonicity of the obtained quantile estimates and then design a general exploration framework called distributional prediction error (DPE) for DRL which utilizes the entire distribution of the quantile function. In this paper, we not only discuss the theoretical necessity of our method but also show the performance gain it achieves in practice by comparing with some competitors on Atari 2600 Games especially in some hard-explored games.


title: Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergence

abstract: Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This paper proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly convex optimization problems. By compressing innovation vectors, which are the differences between decision vectors and their estimates, COLD is able to achieve linear convergence for a class of $\delta$-contracted compressors. We explicitly quantify how the compression affects the convergence rate and show that COLD matches the same rate of its uncompressed version. To accommodate a wider class of compressors that includes the binary quantizer, we further design a novel dynamical scaling mechanism and obtain the linearly convergent Dyna-COLD. Importantly, our results strictly improve existing results for the quantized consensus problem. Numerical experiments demonstrate the advantages of both algorithms under different compressors.

categories: math.OC cs.DC cs.LG cs.SY eess.SP eess.SY


title: Unveiling the impact of the bias-dependent charge neutrality point on graphene-based multi-transistor applications

abstract: The Dirac voltage of a graphene field-effect transistor (GFET) stands for the gate bias that sets the charge neutrality condition in the channel, thus resulting in a minimum conductivity. Controlling its dependence on the terminal biases is crucial for the design and optimization of radio-frequency applications based on multiple GFETs. However, the previous analysis of such dependence carried out for a single device can lead to confusion and if not properly understood could result in circuit designs with poor performance. The control of the Dirac point shift (DPS) is particularly important for the deployment of graphene-based differential circuit topologies where keeping a strict symmetry between the electrical balanced branches is crucial for exploiting the advantages of such topologies. This note sheds light on the impact of terminal biases on the DPS in a real device and sets a rigorous methodology to control it so to eventually optimize and exploit the performance of radio-frequency applications based on GFETs.


title: Realization and characterization of a low intensity noise ultrafast Yb-doped fiber amplifier

abstract: We report on the design and whole characterization of low-noise and affordable-cost Yb-doped double-clad fiber amplifiers operating at room temperature in the near-infrared spectral region at pulse repetition rate of 160 MHz. Two different experimental configurations are discussed. In the first one, a broadband seed radiation with a transform limited pulse duration of 71 fs, an optical spectrum of 20 nm wide at around 1040 nm, and 20 mW average power is adopted. In the second configuration, the seed radiation is constituted by stretched pulses with a time duration as long as 170 ps, with a 5-nm narrow pulse spectrum centered at 1029 nm and 2 mW average input power. In both cases we obtained transform limited pulse trains with an amplified output power exceeding 2 W. Furthermore, relative intensity noise measurements show that no significant noise degradation occurs during the amplification process.


title: Nonuniform Sampling Rate Conversion: An Efficient Approach

abstract: We present a discrete-time algorithm for nonuniform sampling rate conversion that presents low computational complexity and memory requirements. It generalizes arbitrary sampling rate conversion by accommodating time-varying conversion ratios, i.e., it can efficiently adapt to instantaneous changes of the input and output sampling rates. This approach is based on appropriately factorizing the time-varying discrete-time filter used for the conversion. Common filters that satisfy this factorization property are those where the underlying continuous-time filter consists of linear combinations of exponentials, e.g., those described by linear constant-coefficient differential equations. This factorization separates the computation into two parts: one consisting of a factor solely depending on the output sampling instants and the other consists of a summation -- that can be computed recursively -- whose terms depend solely on the input sampling instants and its number of terms is given by a relationship between input and output sampling instants. Thus, nonuniform sampling rates can be accommodated by updating the factors involved and adjusting the number of terms added. When the impulse response consists of exponentials, computing the factors can be done recursively in an efficient manner.

categories: eess.SP cs.IT cs.SD eess.AS eess.IV math.IT


title: Measurement of the muon transfer rate from muonic hydrogen to oxygen in the range 70-336 K

abstract: The first measurement of the temperature dependence of the muon transfer rate from muonic hydrogen to oxygen was performed by the FAMU collaboration in 2016. The results provide evidence that the transfer rate rises with the temperature in the range 104-300 K. This paper presents the results of the experiment done in 2018 to extend the measurements towards lower (70 K) and higher (336 K) temperatures. The 2018 results confirm the temperature dependence of the muon transfer rate observed in 2016 and sets firm ground for comparison with the theoretical predictions.


title: Dispersal-based species pools as sources of connectivity area mismatches

abstract: Context - Prioritising is likely to differ depending on the species considered for connectivity assessments, leading to a lack of consensual decisions for territorial planning. Objectives - The objective was to assess the relevance of identifying priority areas for connectivity for groups of species based on common dispersal abilities. We aimed to assess the impact of target groups choices on predicted priority areas. Method - The study was located at the Thau Lagoon territory to demonstrate the methodological approach. Ecological niche modelling was used to quantify species resistance and to identify suitable habitat patches. We coupled the least-cost path methodology with circuit theory to assess species connectivity. We classified connectivity from high to low levels and averaged the results by dispersal groups. Results - We found important differences in identified priority areas between groups with dissimilar dispersal abilities, with little overlap between highly connected areas. We identified a gap between the level of protection of low dispersal species and highly connected areas. We found mismatches between existing corridors and connectivity in low dispersal species, and a greater impact in areas of expected urban sprawl projects on favourably connected areas for species with high dispersal capabilities. Conclusion - We have demonstrated that a diversity of dispersal capacity ranges must be accounted for in order to identify ecological corridors in programmes that aim to restore habitat connectivity at territorial levels. Our findings are oriented to support the decisions of planning initiatives, at both local and regional scale.


title: Substrate matters: Surface-polariton enhanced infrared nanospectroscopy of molecular vibrations

abstract: Infrared nanospectroscopy based on Fourier transform infrared near-field spectroscopy (nano-FTIR) is an emerging nanoanalytical tool with large application potential for label-free mapping and identification of organic and inorganic materials with nanoscale spatial resolution. However, the detection of thin molecular layers and nanostructures on standard substrates is still challenged by weak signals. Here, we demonstrate a significant enhancement of nano-FTIR signals of a thin organic layer by exploiting polariton-resonant tip-substrate coupling and surface polariton illumination of the probing tip. When the molecular vibration matches the tip-substrate resonance, we achieve up to nearly one order of magnitude signal enhancement on a phonon-polaritonic quartz (c-SiO2) substrate, as compared to nano-FTIR spectra obtained on metal (Au) substrates, and up to two orders of magnitude when compared to the standard infrared spectroscopy substrate CaF2. Our results will be of critical importance for boosting nano-FTIR spectroscopy towards the routine detection of monolayers and single molecules.


title: Direct evaluation of attachment and detachment rate factors of atoms in crystallizing supercooled liquids

abstract: Kinetic rate factors of crystallization have a direct effect on formation and growth of an ordered solid phase in supercooled liquids and glasses. Using crystallizing Lennard-Jones liquid as an example, in the present work we perform a \textit{direct} quantitative estimation of values of the key crystallization kinetic rate factors -- the rate $g^{+}$ of particle attachments to a crystalline nucleus and the rate $g^{-}$ of particle detachments from a nucleus. We propose a numerical approach, according to which a statistical treatment of the results of molecular dynamics simulations was performed without using any model functions and/or fitting parameters. This approach allows one to accurately estimate the critical nucleus size $n_{c}$. We find that for the growing nuclei, whose sizes are larger than the critical size $n_{c}$, the dependence of these kinetic rate factors on the nucleus size $n$ follows a power law. In the case of the subnucleation regime, when the nuclei are smaller than $n_{c}$, the $n$-dependence of the quantity $g^{+}$ is strongly determined by the inherent microscopic properties of a system and this dependence cannot be described in the framework of any universal law (for example, a power law). It has been established that the dependence of the growth rate of a crystalline nucleus on its size goes into the stationary regime at the sizes $n>3n_{c}$ particles.


title: Reconfigurable Plasmonic Chirality: Fundamentals and Applications

abstract: Molecular chirality is a geometric property that is of great importance in chemistry, biology, and medicine. Recently, plasmonic nanostructures that exhibit distinct chiroptical responses have attracted tremendous interest, given their ability to emulate the properties of chiral molecules with tailored and pronounced optical characteristics. However, the optical chirality of such human-made structures is in general static and cannot be manipulated postfabrication. Herein, different concepts to reconfigure the chiroptical responses of plasmonic nano- and micro-objects are outlined. Depending on the utilized strategies and stimuli, the chiroptical signature, the 3D structural conformation, or both can be reconfigured. Optical devices based on plasmonic nanostructures with reconfigurable chirality possess great potential in practical applications, ranging from polarization conversion elements to enantioselective analysis, chiral sensing, and catalysis.


title: Building Affordance Relations for Robotic Agents - A Review

abstract: Affordances describe the possibilities for an agent to perform actions with an object. While the significance of the affordance concept has been previously studied from varied perspectives, such as psychology and cognitive science, these approaches are not always sufficient to enable direct transfer, in the sense of implementations, to artificial intelligence (AI)-based systems and robotics. However, many efforts have been made to pragmatically employ the concept of affordances, as it represents great potential for AI agents to effectively bridge perception to action. In this survey, we review and find common ground amongst different strategies that use the concept of affordances within robotic tasks, and build on these methods to provide guidance for including affordances as a mechanism to improve autonomy. To this end, we outline common design choices for building representations of affordance relations, and their implications on the generalisation capabilities of an agent when facing previously unseen scenarios. Finally, we identify and discuss a range of interesting research directions involving affordances that have the potential to improve the capabilities of an AI agent.


title: Multiplexed quantum repeaters based on dual-species trapped-ion systems

abstract: Trapped ions form an advanced technology platform for quantum information processing with long qubit coherence times, high-fidelity quantum logic gates, optically active qubits, and a potential to scale up in size while preserving a high level of connectivity between qubits. These traits make them attractive not only for quantum computing but also for quantum networking. Dedicated, special-purpose trapped-ion processors in conjunction with suitable interconnecting hardware can be used to form quantum repeaters that enable high-rate quantum communications between distant trapped-ion quantum computers in a network. In this regard, hybrid traps with two distinct species of ions, where one ion species can generate ion-photon entanglement that is useful for optically interfacing with the network and the other has long memory lifetimes, useful for qubit storage, have been proposed for entanglement distribution. We consider an architecture for a repeater based on such dual-species trapped-ion systems. We propose and analyze a protocol based on spatial and temporal mode multiplexing for entanglement distribution across a line network of such repeaters. Our protocol offers enhanced rates compared to rates previously reported for such repeaters. We determine the ion resources required at the repeaters to attain the enhanced rates, and the best rates attainable when constraints are placed on the number of repeaters and the number of ions per repeater. Our results bolster the case for near-term trapped-ion systems as quantum repeaters for long-distance quantum communications.


title: BernoulliZip: a Compression Algorithm for Bernoulli Processes and Erdos-Renyi Graphs

abstract: A novel compression scheme for compressing the outcome of $n$ independent Bernoulli trials is introduced and analysed. The resulting algorithm, BernoulliZip, is a fast and near-optimal method to produce prefix codes for a Bernoulli process. BernoulliZip's main principle is to first represent the number of 1s in the sequence and then specify the sequence. The application of BernoulliZip on compressing Erdos-Renyi graphs is explored.


title: Learning Unknown from Correlations: Graph Neural Network for Inter-novel-protein Interaction Prediction

abstract: The study of multi-type Protein-Protein Interaction (PPI) is fundamental for understanding biological processes from a systematic perspective and revealing disease mechanisms. Existing methods suffer from significant performance degradation when tested in unseen dataset. In this paper, we investigate the problem and find that it is mainly attributed to the poor performance for inter-novel-protein interaction prediction. However, current evaluations overlook the inter-novel-protein interactions, and thus fail to give an instructive assessment. As a result, we propose to address the problem from both the evaluation and the methodology. Firstly, we design a new evaluation framework that fully respects the inter-novel-protein interactions and gives consistent assessment across datasets. Secondly, we argue that correlations between proteins must provide useful information for analysis of novel proteins, and based on this, we propose a graph neural network based method (GNN-PPI) for better inter-novel-protein interaction prediction. Experimental results on real-world datasets of different scales demonstrate that GNN-PPI significantly outperforms state-of-the-art PPI prediction methods, especially for the inter-novel-protein interaction prediction.


title: A new transport distance and its associated Ricci curvature of hypergraphs

abstract: The coarse Ricci curvature of graphs introduced by Ollivier as well as its modification by Lin-Lu-Yau have been studied from various aspects. In this paper, we propose a new transport distance appropriate for hypergraphs and study a generalization of Lin-Lu-Yau type curvature of hypergraphs. As an application, we derive a Bonnet-Myers type estimate for hypergraphs under a lower Ricci curvature bound associated with our transport distance. We remark that our transport distance is new even for graphs and worthy of further study.


title: REGINA - Reasoning Graph Convolutional Networks in Human Action Recognition

abstract: It is known that the kinematics of the human body skeleton reveals valuable information in action recognition. Recently, modeling skeletons as spatio-temporal graphs with Graph Convolutional Networks (GCNs) has been reported to solidly advance the state-of-the-art performance. However, GCN-based approaches exclusively learn from raw skeleton data, and are expected to extract the inherent structural information on their own. This paper describes REGINA, introducing a novel way to REasoning Graph convolutional networks IN Human Action recognition. The rationale is to provide to the GCNs additional knowledge about the skeleton data, obtained by handcrafted features, in order to facilitate the learning process, while guaranteeing that it remains fully trainable in an end-to-end manner. The challenge is to capture complementary information over the dynamics between consecutive frames, which is the key information extracted by state-of-the-art GCN techniques. Moreover, the proposed strategy can be easily integrated in the existing GCN-based methods, which we also regard positively. Our experiments were carried out in well known action recognition datasets and enabled to conclude that REGINA contributes for solid improvements in performance when incorporated to other GCN-based approaches, without any other adjustment regarding the original method. For reproducibility, the REGINA code and all the experiments carried out will be publicly available at https://github.com/DegardinBruno.


title: Efficient Parallel Self-Adjusting Computation

abstract: Self-adjusting computation is an approach for automatically producing dynamic algorithms from static ones. The approach works by tracking control and data dependencies, and propagating changes through the dependencies when making an update. Extensively studied in the sequential setting, some results on parallel self-adjusting computation exist, but are either only applicable to limited classes of computations, such as map-reduce, or are ad-hoc systems with no theoretical analysis of their performance. In this paper, we present the first system for parallel self-adjusting computation that applies to a wide class of nested parallel algorithms and provides theoretical bounds on the work and span of the resulting dynamic algorithms. As with bounds in the sequential setting, our bounds relate a "distance" measure between computations on different inputs to the cost of propagating an update. However, here we also consider parallelism in the propagation cost. The main innovation in the paper is in using Series-Parallel trees (SP trees) to track sequential and parallel control dependencies to allow propagation of changes to be applied safely in parallel. We show both theoretically and through experiments that our system allows algorithms to produce updated results over large datasets significantly faster than from-scratch execution. We demonstrate our system with several example applications, including algorithms for dynamic sequences and dynamic trees. In all cases studied, we show that parallel self-adjusting computation can provide a significant benefit in both work savings and parallel time.


title: ATHENA: Advanced Techniques for High Dimensional Parameter Spaces to Enhance Numerical Analysis

abstract: ATHENA is an open source Python package for reduction in parameter space. It implements several advanced numerical analysis techniques such as Active Subspaces (AS), Kernel-based Active Subspaces (KAS), and Nonlinear Level-set Learning (NLL) method. It is intended as a tool for regression, sensitivity analysis, and in general to enhance existing numerical simulations' pipelines tackling the curse of dimensionality. Source code, documentation, and several tutorials are available on GitHub at https://github.com/mathLab/ATHENA under the MIT license.


title: Confidence-guided Adaptive Gate and Dual Differential Enhancement for Video Salient Object Detection

abstract: Video salient object detection (VSOD) aims to locate and segment the most attractive object by exploiting both spatial cues and temporal cues hidden in video sequences. However, spatial and temporal cues are often unreliable in real-world scenarios, such as low-contrast foreground, fast motion, and multiple moving objects. To address these problems, we propose a new framework to adaptively capture available information from spatial and temporal cues, which contains Confidence-guided Adaptive Gate (CAG) modules and Dual Differential Enhancement (DDE) modules. For both RGB features and optical flow features, CAG estimates confidence scores supervised by the IoU between predictions and the ground truths to re-calibrate the information with a gate mechanism. DDE captures the differential feature representation to enrich the spatial and temporal information and generate the fused features. Experimental results on four widely used datasets demonstrate the effectiveness of the proposed method against thirteen state-of-the-art methods.


title: Maximizing Mutual Information Across Feature and Topology Views for Learning Graph Representations

abstract: Recently, maximizing mutual information has emerged as a powerful method for unsupervised graph representation learning. The existing methods are typically effective to capture information from the topology view but ignore the feature view. To circumvent this issue, we propose a novel approach by exploiting mutual information maximization across feature and topology views. Specifically, we first utilize a multi-view representation learning module to better capture both local and global information content across feature and topology views on graphs. To model the information shared by the feature and topology spaces, we then develop a common representation learning module using mutual information maximization and reconstruction loss minimization. To explicitly encourage diversity between graph representations from the same view, we also introduce a disagreement regularization to enlarge the distance between representations from the same view. Experiments on synthetic and real-world datasets demonstrate the effectiveness of integrating feature and topology views. In particular, compared with the previous supervised methods, our proposed method can achieve comparable or even better performance under the unsupervised representation and linear evaluation protocol.


title: Field- and current-driven magnetic domain-wall inverter and diode

abstract: We investigate the inversion process of magnetic domain walls (DWs) propagating through synthetic noncollinear magnetic textures, whereby an up/down DW can be transformed into a down/up DW and vice versa. We exploit the lateral coupling between out-of-plane and in-plane magnetic regions induced by the interfacial Dzyaloshinskii-Moriya interaction in Pt/Co/AlOx trilayers to realize both field-driven and current-driven magnetic DW inverters. The inverters consist of narrow in-plane magnetic regions embedded in out-of-plane DW racetracks. Magnetic imaging and micromagnetic simulations provide insight into the DW inversion mechanism, showing that DW inversion proceeds by annihilation of the incoming domain on one side of the in-plane region and nucleation of a reverse domain on the opposite side. By changing the shape of the in-plane magnetic region, we show that the DW inversion efficiency can be tuned by adjusting the ratio between the chiral coupling energy at the inverter boundary and the energy cost of nucleating a reverse domain. Finally, we realize an asymmetric DW inverter that has nonreciprocal inversion properties and demonstrate that such a device can operate as a DW diode. Our results provide input for the versatile manipulation of DWs in magnetic racetracks and the design of efficient DW devices for nonvolatile magnetic logic schemes.


title: Neural-Symbolic Commonsense Reasoner with Relation Predictors

abstract: Commonsense reasoning aims to incorporate sets of commonsense facts, retrieved from Commonsense Knowledge Graphs (CKG), to draw conclusion about ordinary situations. The dynamic nature of commonsense knowledge postulates models capable of performing multi-hop reasoning over new situations. This feature also results in having large-scale sparse Knowledge Graphs, where such reasoning process is needed to predict relations between new events. However, existing approaches in this area are limited by considering CKGs as a limited set of facts, thus rendering them unfit for reasoning over new unseen situations and events. In this paper, we present a neural-symbolic reasoner, which is capable of reasoning over large-scale dynamic CKGs. The logic rules for reasoning over CKGs are learned during training by our model. In addition to providing interpretable explanation, the learned logic rules help to generalise prediction to newly introduced events. Experimental results on the task of link prediction on CKGs prove the effectiveness of our model by outperforming the state-of-the-art models.


title: Modeling the interplay between epidemics and regional socio-economics

abstract: In this study we present a dynamical agent-based model to investigate the interplay between the socio-economy of and SEIRS-type epidemic spreading over a geographical area, divided to smaller area districts and further to smallest area cells. The model treats the populations of cells and authorities of districts as agents, such that the former can reduce their economic activity and the latter can recommend economic activity reduction both with the overall goal to slow down the epidemic spreading. The agents make decisions with the aim of attaining as high socio-economic standings as possible relative to other agents of the same type by evaluating their standings based on the local and regional infection rates, compliance to the authorities' regulations, regional drops in economic activity, and efforts to mitigate the spread of epidemic. We find that the willingness of population to comply with authorities' recommendations has the most drastic effect on the epidemic spreading: periodic waves spread almost unimpeded in non-compliant populations, while in compliant ones the spread is minimal with chaotic spreading pattern and significantly lower infection rates. Health and economic concerns of agents turn out to have lesser roles, the former increasing their efforts and the latter decreasing them.


title: Flexo-Sensitive Polarization Vortices in Thin Ferroelectric Films

abstract: We consider theoretically the influence of the flexoelectric coupling on the spatial distribution and temperature behavior of spontaneous polarization for several types of stable domain structure in thin ferroelectric films, such as stripe domains and vortices.Finite element modelling (FEM) for BaTiO3 films and analytical calculations within the Landau-Ginzburg-Devonshire approach reveals that an out-of-plane polarization component can be very sensitive to the flexoelectric coupling for periodic quasi-2D stripe domains and 3D vortex-antivortex structures.However, the influence is rather different for these structures. The flexoelectric coupling increases significantly the amplitude of a small out-of-plane polarization component in the stripe domains, and the "up" or "down" direction of the component is defined by the sign of the flexoelectric coefficients.Concerning the vortex-antivortex pairs, their antivortices with in-plane anti-circulation have smooth wide dipolar cores through the entire film, whose shape and other features are almost insensitive to the coupling.The vortices with in-plane vorticity have spike-like cores with an out-of-plane quadrupolar moment induced by the flexoelectric coupling. The cores are located near the film-dead layer interfaces.FEM results corroborated by analytical calculations prove that a change of the flexoelectric coefficient sign leads to a reorientation of the core axial polarization, making the flexo-sensitive 3D vortices similar to the recently introduced "flexons" in cylindrical nanoparticles.The relatively wide temperature range (from 200 to 400 K) of the flexo-sensitive vortices' existence gives us the hope that they can be observed experimentally in thin ferroelectric films by scanning probe and nonlinear optical microscopy methods.


title: Intershell Interactions in Correlated Materials: A Slave Rotor Approach

abstract: The treatment of intershell interactions remains a major challenge in the theoretical description of strongly correlated materials. Most previous approaches considered the influence of intershell interactions at best in a static fashion, neglecting dynamic effects. In this work, we propose a slave-rotor method that goes beyond this approximation by incorporating the effect of intershell interactions in a dynamic manner. Our method is derived and implemented as a quantum impurity solver in the context of dynamical mean field theory and benchmarked on a two-orbital model system. The results from our slave-rotor technique are found to be in good agreement with our reference calculations that include intershell interactions explicitly. We identify and analyze qualitative features emerging from the dynamic treatment. Our results thus provide qualitatively new insights, revealing the ambivalent effect of intershell interactions in strongly correlated materials.


title: One-particle spectral functions of the one-dimensional Fermionic Hubbard model with one fermion per site at zero and finite magnetic fields

abstract: Here the line shape of the up- and down-spin one-particle spectral functions at and in the (k,energy)-plane's vicinity of their cusp singularities is studied for the Mott-Hubbard insulator described by the 1D Hubbard model with one fermion per site at zero and finite magnetic fields. At zero field they can be accessed in terms of electrons by photoemission experiments. At finite field, such functions and corresponding interplay of correlations and magnetic-field effects refer to an involved non-perturbative many-particle problem that is poorly understood. The Mott-Hubbard gap that separates the addition and removal spectral functions is calculated for all spin densities and interaction values. The qualitative differences in the one-particle properties of the Mott-Hubbard insulator and corresponding doped insulator are also investigated. The relation of our theoretical results and predictions to both condensed-matter and ultracold spin-1/2 atom systems is discussed.


title: A light-driven three-dimensional plasmonic nanosystem that translates molecular motion into reversible chiroptical function

abstract: Nature has developed striking light-powered proteins such as bacteriorhodopsin, which can convert light energy into conformational changes for biological functions. Such natural machines are a great source of inspiration for creation of their synthetic analogues. However, synthetic molecular machines typically operate at the nanometre scale or below. Translating controlled operation of individual molecular machines to a larger dimension, for example, to 10-100 nm, which features many practical applications, is highly important but remains challenging. Here we demonstrate a light-driven plasmonic nanosystem that can amplify the molecular motion of azobenzene through the host nanostructure and consequently translate it into reversible chiroptical function with large amplitude modulation. Light is exploited as both energy source and information probe. Our plasmonic nanosystem bears unique features of optical addressability, reversibility and modulability, which are crucial for developing all-optical molecular devices with desired functionalities.


title: Bounded Reachability Problems are Decidable in FIFO Machines

abstract: The undecidability of basic decision problems for general FIFO machines such as reachability and unboundedness is well-known. In this paper, we provide an underapproximation for the general model by considering only runs that are input-bounded (i.e. the sequence of messages sent through a particular channel belongs to a given bounded language). We prove, by reducing this model to a counter machine with restricted zero tests, that the rational-reachability problem (and by extension, control-state reachability, unboundedness, deadlock, etc.) is decidable. This class of machines subsumes input-letter-bounded machines, flat machines, linear FIFO nets, and monogeneous machines, for which some of these problems were already shown to be decidable. These theoretical results can form the foundations to build a tool to verify general FIFO machines based on the analysis of input-bounded machines.


title: RC2020 Report: Learning De-biased Representations with Biased Representations

abstract: As part of the ML Reproducibility Challenge 2020, we investigated the ICML 2020 paper "Learning De-biased Representations with Biased Representations" by Bahng et al., where the authors formalize and attempt to tackle the so called "cross bias generalization" problem with a new approach they introduce called ReBias. This report contains results of our attempts at reproducing the work in the application area of Image Recognition, specifically on the datasets biased MNIST and ImageNet. We compare ReBias with other methods - Vanilla, Biased, RUBi (as implemented by the authors), and conclude with a discussion concerning the validity of the claims made by the paper. We were able to reproduce results reported for the biased MNIST dataset to within 1% of the original values reported in the paper. Like the authors, we report results averaged over 3 runs. However, in a later section, we provide some additional results that appear to weaken the central claim of the paper with regards to the biased MNIST dataset. We were not able to reproduce results for ImageNet as in the original paper, but based on communication with the authors, provide a discussion as to the reasons for the same. This work attempts to be useful to other researchers aiming to use ReBias for their own research purposes, advising on certain possible pitfalls that may be encountered in the process.


title: Meta-Inductive Node Classification across Graphs

abstract: Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce query graph. While traditional approaches are largely transductive, recent graph neural networks (GNNs) integrate node features with network structures, thus enabling inductive node classification models that can be applied to new nodes or even new graphs in the same feature space. However, inter-graph differences still exist across graphs within the same domain. Thus, training just one global model (e.g., a state-of-the-art GNN) to handle all new graphs, whilst ignoring the inter-graph differences, can lead to suboptimal performance. In this paper, we study the problem of inductive node classification across graphs. Unlike existing one-model-fits-all approaches, we propose a novel meta-inductive framework called MI-GNN to customize the inductive model to each graph under a meta-learning paradigm. That is, MI-GNN does not directly learn an inductive model; it learns the general knowledge of how to train a model for semi-supervised node classification on new graphs. To cope with the differences across graphs, MI-GNN employs a dual adaptation mechanism at both the graph and task levels. More specifically, we learn a graph prior to adapt for the graph-level differences, and a task prior to adapt for the task-level differences conditioned on a graph. Extensive experiments on five real-world graph collections demonstrate the effectiveness of our proposed model.


title: Positive solutions for singular double phase problems

abstract: We study the existence of positive solutions for a class of double phase Dirichlet equations which have the combined effects of a singular term and of a parametric superlinear term. The differential operator of the equation is the sum of a $p$-Laplacian and of a weighted $q$-Laplacian ($q<p$) with discontinuous weight. Using the Nehari method, we show that for all small values of the parameter $\lambda>0$, the equation has at least two positive solutions.


title: Verification of Size Invariance in DNN Activations using Concept Embeddings

abstract: The benefits of deep neural networks (DNNs) have become of interest for safety critical applications like medical ones or automated driving. Here, however, quantitative insights into the DNN inner representations are mandatory. One approach to this is concept analysis, which aims to establish a mapping between the internal representation of a DNN and intuitive semantic concepts. Such can be sub-objects like human body parts that are valuable for validation of pedestrian detection. To our knowledge, concept analysis has not yet been applied to large object detectors, specifically not for sub-parts. Therefore, this work first suggests a substantially improved version of the Net2Vec approach (arXiv:1801.03454) for post-hoc segmentation of sub-objects. Its practical applicability is then demonstrated on a new concept dataset by two exemplary assessments of three standard networks, including the larger Mask R-CNN model (arXiv:1703.06870): (1) the consistency of body part similarity, and (2) the invariance of internal representations of body parts with respect to the size in pixels of the depicted person. The findings show that the representation of body parts is mostly size invariant, which may suggest an early intelligent fusion of information in different size categories.


title: Signal extraction in atmospheric shower arrays designed for $\rm 200\,GeV-50\,TeV$ $\gamma$-ray astronomy

abstract: We present the SEMLA (Signal Extraction using Machine Learning for ALTO) analysis method, developed for the detection of $\rm E>200\,GeV$ $\gamma$ rays in the context of the ALTO wide-field-of-view atmospheric shower array R&D project. The scientific focus of ALTO is extragalactic $\gamma$-ray astronomy, so primarily the detection of soft-spectrum $\gamma$-ray sources such as Active Galactic Nuclei and Gamma Ray Bursts. The current phase of the ALTO R&D project is the optimization of sensitivity for such sources and includes a number of ideas which are tested and evaluated through the analysis of dedicated Monte Carlo simulations and hardware testing. In this context, it is important to clarify how data are analysed and how results are being obtained. SEMLA takes advantage of machine learning and comprises four stages: initial event cleaning (stage A), filtering out of poorly reconstructed $\gamma$-ray events (stage B), followed by $\gamma$-ray signal extraction from proton background events (stage C) and finally reconstructing the energy of the events (stage D). The performance achieved through SEMLA is evaluated in terms of the angular, shower core position, and energy resolution, together with the effective detection area, and background suppression. Our methodology can be easily generalized to any experiment, provided that the signal extraction variables for the specific analysis project are considered.


title: Nonequilibrium dark space phase transition

abstract: We introduce the concept of dark space phase transition, which may occur in open many-body quantum systems where irreversible decay, interactions and quantum interference compete. Our study is based on a quantum many-body model, that is inspired by classical nonequilibrium processes which feature phase transitions into an absorbing state, such as epidemic spreading. The possibility for different dynamical paths to interfere quantum mechanically results in collective dynamical behavior without classical counterpart. We identify two competing dark states, a trivial one corresponding to a classical absorbing state and an emergent one which is quantum coherent. We establish a nonequilibrium phase transition within this dark space that features a phenomenology which cannot be encountered in classical systems. Such emergent two-dimensional dark space may find technological applications, e.g. for the collective encoding of a quantum information.


title: Simulating Social Acceptability With Agent-based Modeling

abstract: Social acceptability is an important consideration for HCI designers who develop technologies for social contexts. However, the current theoretical foundations of social acceptability research do not account for the complex interactions among the actors in social situations and the specific role of technology. In order to improve the understanding of how context shapes and is shaped by situated technology interactions, we suggest to reframe the social space as a dynamic bundle of social practices and explore it with simulation studies using agent-based modeling. We outline possible research directions that focus on specific interactions among practices as well as regularities in emerging patterns.


title: On the Soundness of Infrastructure Adversaries

abstract: Companies and network operators perform risk assessment to inform policy-making, guide infrastructure investments or to comply with security standards such as ISO 27001. Due to the size and complexity of these networks, risk assessment techniques such as attack graphs or trees describe the attacker with a finite set of rules. This characterization of the attacker can easily miss attack vectors or overstate them, potentially leading to incorrect risk estimation. In this work, we propose the first methodology to justify a rule-based attacker model. Conceptually, we add another layer of abstraction on top of the symbolic model of cryptography, which reasons about protocols and abstracts cryptographic primitives. This new layer reasons about Internet-scale networks and abstracts protocols. We show, in general, how the soundness and completeness of a rule-based model can be ensured by verifying trace properties, linking soundness to safety properties and completeness to liveness properties. We then demonstrate the approach for a recently proposed threat model that quantifies the confidentiality of email communication on the Internet, including DNS, DNSSEC, and SMTP. Using off-the-shelf protocol verification tools, we discover two flaws in their threat model. After fixing them, we show that it provides symbolic soundness.


title: Recent Results from T2K

abstract: We report on latest results from the Tokai-to-Kamioka experiment studying the disappearance of $\nu_\mu$ and appearance of $\nu_e$ from neutrino oscillation with accelerator generated neutrinos. Thanks to increase in statistics and numerous upgrades to each part of the oscillation analysis, we set the most sensitive constraints on some of the oscillation parameters, including in particular the CP-violation angle $\delta_\mathrm{CP}$. Future prospects are also briefly discussed.


title: Hydrodynamic flow and concentration gradients in the gut enhance neutral bacterial diversity

abstract: The gut microbiota features important genetic diversity, and the specific spatial features of the gut may shape evolution within this environment. We investigate the fixation probability of neutral bacterial mutants within a minimal model of the gut that includes hydrodynamic flow and resulting gradients of food and bacterial concentrations. We find that this fixation probability is substantially increased compared to an equivalent well-mixed system, in the regime where the profiles of food and bacterial concentration are strongly spatially-dependent. Fixation probability then becomes independent of total population size. We show that our results can be rationalized by introducing an active population, which consists of those bacteria that are actively consuming food and dividing. The active population size yields an effective population size for neutral mutant fixation probability in the gut.


title: Explaining the Cabibbo Angle Anomaly and Lepton Flavour Universality Violation in Tau Decays With a Singly-Charged Scalar Singlet

abstract: The singly charged $SU(2)_L$ singlet scalar, with its necessarily flavour violating couplings to leptons, lends itself particularly well for an explanation of the Cabibbo Angle Anomaly and of hints for lepton flavour universality violation in $\tau \to \mu\bar \nu\nu$. In a setup addressing both anomalies, we predict loop-induced effects in $\tau\to e\gamma$ and in $\tau \to e\mu\mu$. A recast of ATLAS selectron and smuon searches allows us to derive a coupling-independent lower limit of $\approx 200$ GeV on the mass of the singly charged singlet scalar. At a future $e^+e^-$ collider, dark matter mono-photon searches could provide a complementary set of bounds.


title: Two-component nonlinear wave of the cubic Boussinesq equation

abstract: In this work, we employ the generalized perturbation reduction method to find the two-component vector breather solution of the cubic Boussinesq equation $U_{tt} - C U_{zz} - D U_{zzzz}+G (U^{3})_{zz}=0$. Explicit analytical expressions for the shape and parameters of the two-component nonlinear pulse oscillating with the sum and difference of the frequencies and wave numbers are obtained.


title: Large-scale clustering amongst Fermi blazars; evidence for axis alignments?

abstract: We find evidence for large-scale clustering amongst Fermi-selected BL Lac objects but not amongst Fermi-selected FSRQs. Using two-point correlation functions we have investigated the clustering properties of different classes of objects from the Fermi LAT 4FGL catalogue. We wanted to test the idea based on optical polarization observations that there might be large volumes of space in which AGN axes are aligned. To do this we needed a clean sample of blazars as these are objects with their jet axes pointing towards the observer and Fermi sources provide such a sample. We find that high latitude Fermi sources taken as a whole show a significant clustering signal on scales up to 30 degrees. To investigate if all blazars behave in the same way we used the machine learning classifications of Kovacevic, et al. (2020), which are based only on gamma-ray information, to separate BL Lac-like objects from FSRQ-like objects. A possible explanation for the clustering signal we find amongst the BL Lac-like objects is that there are indeed large volumes of space in which AGN axes are aligned. This signal might be washed out in FSRQs since they occupy a much larger volume of space. Thus our results support the idea that large scale polarization alignments could originate from coherent alignments of AGN axes. We speculate that these axis alignments may be related to the well-known intrinsic alignments of galaxy optical position angles.


title: Linearizability: A Typo

abstract: Linearizability is the de facto consistency condition for concurrent objects, widely used in theory and practice. Loosely speaking, linearizability classifies concurrent executions as correct if operations on shared objects appear to take effect instantaneously during the operation execution time. This paper calls attention to a somewhat-neglected aspect of linearizability: restrictions on how pending invocations are handled, an issue that has become increasingly important for software running on systems with non-volatile main memory. Interestingly, the original published definition of linearizability includes a typo (a symbol is missing a prime) that concerns exactly this issue. In this paper we point out the typo and provide an amendment to make the definition complete. We believe that pointing this typo out rigorously and proposing a fix is important and timely.


title: Automated segmentation of microtomography imaging of Egyptian mummies

abstract: Propagation Phase Contrast Synchrotron Microtomography (PPC-SR${\mu}$CT) is the gold standard for non-invasive and non-destructive access to internal structures of archaeological remains. In this analysis, the virtual specimen needs to be segmented to separate different parts or materials, a process that normally requires considerable human effort. In the Automated SEgmentation of Microtomography Imaging (ASEMI) project, we developed a tool to automatically segment these volumetric images, using manually segmented samples to tune and train a machine learning model. For a set of four specimens of ancient Egyptian animal mummies we achieve an overall accuracy of 94-98% when compared with manually segmented slices, approaching the results of off-the-shelf commercial software using deep learning (97-99%) at much lower complexity. A qualitative analysis of the segmented output shows that our results are close in terms of usability to those from deep learning, justifying the use of these techniques.


title: An upperbound for the number of critical points of the systole function on the surface moduli space

abstract: We obtain an upper bound for the number of critical points of the systole function on $\mathcal{M}_g$. Besides, we obtain an upper bound for the number of those critical points whose systole is smaller than a constant.


title: A Primer on Techtile: An R&D Testbed for Distributed Communication, Sensing and Positioning

abstract: The Techtile measurement infrastructure is a multi-functional, versatile testbed for new communication and sensing technologies relying on fine-grained distributed resources. The facility enables experimental research on hyper-connected interactive environments and validation of new wireless connectivity, sensing and positioning solutions. It consists of a data acquisition and processing equipment backbone and a fabric of dispersed edge computing devices, Software-Defined Radios, sensors, and LED sources. These bring intelligence close to the applications and can also collectively function as a massive, distributed resource. Furthermore, the infrastructure allows exploring more degrees and new types of diversity, i.e., scaling up the number of elements, introducing `3D directional diversity' by deploying the distributed elements with different orientations, and `interface diversity' by exploiting multiple technologies and hybrid signals (RF, acoustic, and visible light).


title: A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement

abstract: Network Slice placement with the problem of allocation of resources from a virtualized substrate network is an optimization problem which can be formulated as a multiobjective Integer Linear Programming (ILP) problem. However, to cope with the complexity of such a continuous task and seeking for optimality and automation, the use of Machine Learning (ML) techniques appear as a promising approach. We introduce a hybrid placement solution based on Deep Reinforcement Learning (DRL) and a dedicated optimization heuristic based on the Power of Two Choices principle. The DRL algorithm uses the so-called Asynchronous Advantage Actor Critic (A3C) algorithm for fast learning, and Graph Convolutional Networks (GCN) to automate feature extraction from the physical substrate network. The proposed Heuristically-Assisted DRL (HA-DRL) allows to accelerate the learning process and gain in resource usage when compared against other state-of-the-art approaches as the evaluation results evidence.


title: Cybersecurity Anomaly Detection in Adversarial Environments

abstract: The proliferation of interconnected battlefield information-sharing devices, known as the Internet of Battlefield Things (IoBT), introduced several security challenges. Inherent to the IoBT operating environment is the practice of adversarial machine learning, which attempts to circumvent machine learning models. This work examines the feasibility of cost-effective unsupervised learning and graph-based methods for anomaly detection in the network intrusion detection system setting, and also leverages an ensemble approach to supervised learning of the anomaly detection problem. We incorporate a realistic adversarial training mechanism when training supervised models to enable strong classification performance in adversarial environments. The results indicate that the unsupervised and graph-based methods were outperformed in detecting anomalies (malicious activity) by the supervised stacking ensemble method with two levels. This model consists of three different classifiers in the first level, followed by either a Naive Bayes or Decision Tree classifier for the second level. The model maintains an F1-score above 0.97 for malicious samples across all tested level two classifiers. Notably, Naive Bayes is the fastest level two classifier averaging 1.12 seconds while Decision Tree maintains the highest AUC score of 0.98.


title: Reasons, Challenges and Some Tools for Doing Reproducible Research in Transportation Research

abstract: This paper introduces reproducible research, and explains its importance, benefits and challenges. Some important tools for conducting reproducible research in Transportation Research are also introduced. Moreover, the source code for generating this paper has been designed in a way so that it can be used as a template for researchers to write their future journal papers as dynamic and reproducible documents.


title: A Separator Theorem for Hypergraphs and a CSP-SAT Algorithm

abstract: We show that for every $r \ge 2$ there exists $\epsilon_r > 0$ such that any $r$-uniform hypergraph with $m$ edges and maximum vertex degree $o(\sqrt{m})$ contains a set of at most $(\frac{1}{2} - \epsilon_r)m$ edges the removal of which breaks the hypergraph into connected components with at most $m/2$ edges. We use this to give an algorithm running in time $d^{(1 - \epsilon_r)m}$ that decides satisfiability of $m$-variable $(d, k)$-CSPs in which every variable appears in at most $r$ constraints, where $\epsilon_r$ depends only on $r$ and $k\in o(\sqrt{m})$. Furthermore our algorithm solves the corresponding #CSP-SAT and Max-CSP-SAT of these CSPs. We also show that CNF representations of unsatisfiable $(2, k)$-CSPs with variable frequency $r$ can be refuted in tree-like resolution in size $2^{(1 - \epsilon_r)m}$. Furthermore for Tseitin formulas on graphs with degree at most $k$ (which are $(2, k)$-CSPs) we give a deterministic algorithm finding such a refutation.


title: Color-kinematics duality from the Bern-Kosower formalism

abstract: Berends-Giele currents are fundamental building blocks for on-shell amplitudes in non-abelian gauge theory. We present a novel procedure to construct them using the Bern-Kosower formalism for one-loop gluon amplitudes. Applying the pinch procedure of that formalism to a suitable special case the currents are naturally obtained in terms of multi-particle fields and obeying colour-kinematics duality. As a feedback to the Bern-Kosower formalism we outline how the multi-particle polarisations and field-strength tensors can be used to significantly streamline the pinch procedure.


title: Facial Age Estimation using Convolutional Neural Networks

abstract: This paper is a part of a student project in Machine Learning at the Norwegian University of Science and Technology. In this paper, a deep convolutional neural network with five convolutional layers and three fully-connected layers is presented to estimate the ages of individuals based on images. The model is in its entirety trained from scratch, where a combination of three different datasets is used as training data. These datasets are the APPA dataset, UTK dataset, and the IMDB dataset. The images were preprocessed using a proprietary face-recognition software. Our model is evaluated on both a held-out test set, and on the Adience benchmark. On the test set, our model achieves a categorical accuracy of 52%. On the Adience benchmark, our model proves inferior compared with other leading models, with an exact accuray of 30%, and an one-off accuracy of 46%. Furthermore, a script was created, allowing users to estimate their age directly using their web camera. The script, alongside all other code, is located in our GitHub repository: AgeNet.


title: Troubleshooting Blind Image Quality Models in the Wild

abstract: Recently, the group maximum differentiation competition (gMAD) has been used to improve blind image quality assessment (BIQA) models, with the help of full-reference metrics. When applying this type of approach to troubleshoot "best-performing" BIQA models in the wild, we are faced with a practical challenge: it is highly nontrivial to obtain stronger competing models for efficient failure-spotting. Inspired by recent findings that difficult samples of deep models may be exposed through network pruning, we construct a set of "self-competitors," as random ensembles of pruned versions of the target model to be improved. Diverse failures can then be efficiently identified via self-gMAD competition. Next, we fine-tune both the target and its pruned variants on the human-rated gMAD set. This allows all models to learn from their respective failures, preparing themselves for the next round of self-gMAD competition. Experimental results demonstrate that our method efficiently troubleshoots BIQA models in the wild with improved generalizability.


title: Gigahertz measurement-device-independent quantum key distribution using directly modulated lasers

abstract: Measurement-device-independent quantum key distribution (MDI-QKD) is a technique for quantum-secured communication that eliminates all detector side-channels, although is currently limited by implementation complexity and low secure key rates. Here, we introduce a simple and compact MDI-QKD system design at gigahertz clock rates with enhanced resilience to laser fluctuations - thus enabling free-running semiconductor laser sources to be employed without spectral or phase feedback. This is achieved using direct laser modulation, carefully exploiting gain-switching and injection-locking laser dynamics to encode phase-modulated time-bin bits. Our design enables secure key rates that improve upon the state of the art by an order of magnitude, up to 8 bps at 54 dB channel loss and 2 kbps in the finite-size regime for 30 dB channel loss. This greatly simplified MDI-QKD system design and proof-of-principle demonstration shows that MDI-QKD is a practical, high-performance solution for future quantum communication networks.


title: Many-body theory for positronium scattering and pickoff annihilation in noble-gas atoms

abstract: The many-body-theory approach to positronium-atom interactions developed in [Phys. Rev. Lett. \textbf{120}, 183402 (2018)] is applied to the sequence of noble-gas atoms He-Xe. The Dyson equation is solved separately for an electron and positron moving in the field of the atom, with the entire system enclosed in a hard-wall spherical cavity. The two-particle Dyson equation is solved to give the energies and wave functions of the Ps eigenstates in the cavity. From these, we determine the scattering phase shifts and cross sections, and values of the pickoff annihilation parameter $^1Z_\text{eff}$ including short-range electron-positron correlations via vertex enhancement factors. Comparisons are made with available experimental data for elastic and momentum-transfer cross sections and $^1Z_\text{eff}$. Values of $^1Z_\text{eff}$ for He and Ne, previously reported in [Phys. Rev. Lett. \textbf{120}, 183402 (2018)], are found to be in near-perfect agreement with experiment, and for Ar, Kr, and Xe within a factor of 1.2.


title: Out-of-Manifold Regularization in Contextual Embedding Space for Text Classification

abstract: Recent studies on neural networks with pre-trained weights (i.e., BERT) have mainly focused on a low-dimensional subspace, where the embedding vectors computed from input words (or their contexts) are located. In this work, we propose a new approach to finding and regularizing the remainder of the space, referred to as out-of-manifold, which cannot be accessed through the words. Specifically, we synthesize the out-of-manifold embeddings based on two embeddings obtained from actually-observed words, to utilize them for fine-tuning the network. A discriminator is trained to detect whether an input embedding is located inside the manifold or not, and simultaneously, a generator is optimized to produce new embeddings that can be easily identified as out-of-manifold by the discriminator. These two modules successfully collaborate in a unified and end-to-end manner for regularizing the out-of-manifold. Our extensive evaluation on various text classification benchmarks demonstrates the effectiveness of our approach, as well as its good compatibility with existing data augmentation techniques which aim to enhance the manifold.


title: Autonomous stabilization of photonic Laughlin states through angular momentum potentials

abstract: We propose a method to stabilize Laughlin states of a large number of strongly interacting photons by combining a frequency-selective incoherent pump with a step-like potential in the angular momentum basis. Analytical expressions for the preparation efficiency and for the principal error sources are obtained. Direct extension of the preparation scheme to states containing single or multiple quasiholes is discussed.


title: Classifying Long Clinical Documents with Pre-trained Transformers

abstract: Automatic phenotyping is a task of identifying cohorts of patients that match a predefined set of criteria. Phenotyping typically involves classifying long clinical documents that contain thousands of tokens. At the same time, recent state-of-art transformer-based pre-trained language models limit the input to a few hundred tokens (e.g. 512 tokens for BERT). We evaluate several strategies for incorporating pre-trained sentence encoders into document-level representations of clinical text, and find that hierarchical transformers without pre-training are competitive with task pre-trained models.


title: A-priori sparsification of Galerkin-based reduced order models

abstract: A methodology to generate sparse Galerkin models of chaotic/unsteady fluid flows containing a minimal number of active triadic interactions is proposed. The key idea is to find an appropriate set of basis functions for the projection representing elementary flow structures that interact minimally one with the other and thus result in a triadic interaction coefficient tensor with sparse structure. Interpretable and computationally efficient Galerkin models can be thus obtained, since a reduced number of triadic interactions needs to be computed to evaluate the right hand side of the model. To find the basis functions, a subspace rotation technique is used, whereby a set of Proper Orthogonal Decomposition (POD) modes is rotated into a POD subspace of larger dimension using coordinates associated to low-energy dissipative scales to alter energy paths and the structure of the triadic interaction coefficient tensor. This rotation is obtained as the solution of a non-convex optimisation problem that maximises the energy captured by the new basis, promotes sparsity and ensures long-term temporal stability of the sparse Galerkin system. We demonstrate the approach on two-dimensional lid-driven cavity flow at $Re = 2 \times 10^4$ where the motion is chaotic. We show that the procedure generates Galerkin models with a reduced set of active triadic interactions, distributed in modal space according to established knowledge of scale interactions in two-dimensional flows. This property, however, is only observed if long-term temporal stability is explicitly included in the formulation, indicating that a dynamical constraint is necessary to obtain a physically consistent sparsification.


title: Learning Group Activities from Skeletons without Individual Action Labels

abstract: To understand human behavior we must not just recognize individual actions but model possibly complex group activity and interactions. Hierarchical models obtain the best results in group activity recognition but require fine grained individual action annotations at the actor level. In this paper we show that using only skeletal data we can train a state-of-the art end-to-end system using only group activity labels at the sequence level. Our experiments show that models trained without individual action supervision perform poorly. On the other hand we show that pseudo-labels can be computed from any pre-trained feature extractor with comparable final performance. Finally our carefully designed lean pose only architecture shows highly competitive results versus more complex multimodal approaches even in the self-supervised variant.