title: Metric Approximations of Spectral Triples on the Sierpi\'nski Gasket and other fractal curves

abstract: Noncommutative geometry provides a framework, via the construction of spectral triples, for the study of the geometry of certain classes of fractals. Many fractals are constructed as natural limits of certain sets with a simpler structure: for instance, the Sierpi\'nski is the limit of finite graphs consisting of various affine images of an equilateral triangle. It is thus natural to ask whether the spectral triples, constructed on a class of fractals called piecewise $C^1$-fractal curves, are indeed limits, in an appropriate sense, of spectral triples on the approximating sets. We answer this question affirmatively in this paper, where we use the spectral propinquity on the class of metric spectral triples, in order to formalize the sought-after convergence of spectral triples. Our results and methods are relevant to the study of analysis on fractals and have potential physical applications.


title: On the GHKS compactification of the moduli space of K3 surfaces of degree two

abstract: We investigate a toroidal compactification of the moduli space of K3 surfaces of degree $2$ originating from the program formulated by Gross-Hacking-Keel-Siebert. This construction uses Dolgachev's formulation of mirror symmetry and the birational geometry of the mirror family. Our main result in an analysis of the toric fan. For this we use the methods developed by two of us in a previous paper.


title: Weighted analyticity of Hartree-Fock eigenfunctions

abstract: We prove analytic-type estimates in weighted Sobolev spaces on the eigenfunctions of a class of elliptic and nonlinear eigenvalue problems with singular potentials, which includes the Hartree-Fock equations. Going beyond classical results on the analyticity of the wavefunctions away from the nuclei, we prove weighted estimates locally at each singular point, with precise control of the derivatives of all orders. Our estimates have far-reaching consequences for the approximation of the eigenfunctions of the problems considered, and they can be used to prove a priori estimates on the numerical solution of such eigenvalue problems.


title: On the problem of the finiteness of the compressed zero divisor graphs of Artinian rings

abstract: Let R be an Artinian ring and G be the compressed zero-divisor graph associated to R. The question of when the clique number of compressed zero-divisor graphs is finite was raised by J. Coykendall, S. Sather-Wagstaff, L. Sheppardson, and S. Spiroff, in their survey paper entitled On Zero-divisor Graphs. They proved that if length of R is at most four then the clique number is finite. In the length six case they gave an example of a ring where the clique is infinite. In this paper we show that when length of ring is five then the clique number of compressed zero-divisor graph is finite.


title: DA-Transformer: Distance-aware Transformer

abstract: Transformer has achieved great success in the NLP field by composing various advanced models like BERT and GPT. However, Transformer and its existing variants may not be optimal in capturing token distances because the position or distance embeddings used by these methods usually cannot keep the precise information of real distances, which may not be beneficial for modeling the orders and relations of contexts. In this paper, we propose DA-Transformer, which is a distance-aware Transformer that can exploit the real distance. We propose to incorporate the real distances between tokens to re-scale the raw self-attention weights, which are computed by the relevance between attention query and key. Concretely, in different self-attention heads the relative distance between each pair of tokens is weighted by different learnable parameters, which control the different preferences on long- or short-term information of these heads. Since the raw weighted real distances may not be optimal for adjusting self-attention weights, we propose a learnable sigmoid function to map them into re-scaled coefficients that have proper ranges. We first clip the raw self-attention weights via the ReLU function to keep non-negativity and introduce sparsity, and then multiply them with the re-scaled coefficients to encode real distance information into self-attention. Extensive experiments on five benchmark datasets show that DA-Transformer can effectively improve the performance of many tasks and outperform the vanilla Transformer and its several variants.


title: On the influence of magnetic topology on the propagation of internal gravity waves in the solar atmosphere

abstract: The solar surface is a continuous source of internal gravity waves (IGWs). IGWs are believed to supply the bulk of the wave energy for the lower solar atmosphere, but their existence and role for the energy balance of the upper layers is still unclear, largely due to the lack of knowledge about the influence of the Sun's magnetic fields on their propagation. In this work, we look at naturally excited IGWs in realistic models of the solar atmosphere and study the effect of different magnetic field topographies on their propagation. We carry out radiation-magnetohydrodynamic (R-MHD) simulations of a magnetic field free and two magnetic models -- one with an initial, homogeneous, vertical field of 100 G magnetic flux density and one with an initial horizontal field of 100 G flux density. The propagation properties of IGWs are studied by examining the phase-difference and coherence spectra in the $k_{h}$-$\omega$ diagnostic diagram. We find that IGWs in the upper solar atmosphere show upward propagation in the model with predominantly horizontal field similar to the model without magnetic field. In contrast to that the model with predominantly vertical fields show downward propagation. This crucial difference in the propagation direction is also revealed in the difference in energy transported by waves for heights below 0.8 Mm. Higher up, the propagation properties show a peculiar behaviour, which require further study. Our analysis suggests that IGWs may play a significant role in the heating of the chromospheric layers of the internetwork region where horizontal fields are thought to be prevalent.


title: Non-classicality and entanglement criteria for bipartite optical fields characterized by quadratic detectors II: Criteria based on probabilities

abstract: Numerous non-classicality criteria based on the probabilities of experimental photocount or theoretical photon-number distributions are derived using several approaches. Relations among the derived criteria are revealed and the fundamental criteria are identified. They are grouped into parametric systems that allow the analysis of the non-classicality from different points of view ('local' non-classicality, pairwise character of photon correlations, etc.). Considering their structure, the criteria may be divided into groups that differ in the power to resolve the non-classicality. Quantification of the non-classicality using the Lee non-classicality depth and the non-classicality counting parameter is discussed. The used number of field's modes is identified as an important parameter that may cause unexpected results. An appropriate linear transformation of a photocount (photon-number) distribution into its s-ordered form, needed for the determination of the non-classicality depth, is derived. For comparison, the derived criteria are applied both to an experimental photocount histogram of a twin beam and the reconstructed photon-number distributions with different levels of the noise.


title: Planetary system LHS 1140 revisited with ESPRESSO and TESS

abstract: LHS 1140 is an M dwarf known to host two known transiting planets at orbital periods of 3.77 and 24.7 days. The external planet (LHS 1140 b) is a rocky super-Earth that is located in the middle of the habitable zone of this low-mass star, placing this system at the forefront of the habitable exoplanet exploration. We further characterize this system by improving the physical and orbital properties and search for additional planetary-mass components in the system, also exploring the possibility of co-orbitals. We collected 113 new radial velocity observations with ESPRESSO over a 1.5-year time span with an average photon-noise precision of 1.07 m/s. We determine new masses with a precision of 6% for LHS 1140 b ($6.48 \pm 0.46~M_{\oplus}$) and 9% for LHS 1140 c ($m_c=1.78 \pm 0.17~M_{\oplus}$), reducing by half the previously published uncertainties. Although both planets have Earth-like bulk compositions, the internal structure analysis suggests that LHS 1140 b might be iron-enriched. In both cases, the water content is compatible to a maximum fraction of 10-12% in mass, which is equivalent to a deep ocean layer of $779 \pm 650$ km for the habitable-zone planet LHS 1140 b. Our results also provide evidence for a new planet candidate in the system ($m_d= 4.8\pm1.1~M_{\oplus}$) on a ~78.9-day orbital period, which is detected through three independent methods. The analysis also allows us to discard other planets above 0.5 $M_{\oplus}$ for periods shorter than 10 days and above 2 $M_{\oplus}$ for periods up to one year. Finally, our analysis discards co-orbital planets of LHS 1140 b down to 1 $M_{\oplus}$. Indications for a possible co-orbital signal in LHS 1140 c are detected in both radial velocity and photometric data, however. The new characterization of the system make it a key target for atmospheric studies of rocky worlds at different stellar irradiations


title: Exact hybrid-kinetic equilibria for magnetized plasmas with shearing flows

abstract: Context. Magnetized plasmas characterized by shearing flows are present in many natural contexts, such as the Earth's magnetopause and the solar wind. The collisionless nature of involved plasmas requires a kinetic description. When the width of the shear layer is of the order of ion scales, the Hybrid Vlasov-Maxwell approach can be adopted. Aims. The aim of the paper is to derive explicit forms for stationary configurations of magnetized plasmas with planar shearing flows,within the Hybrid Vlasov-Maxwell description. Two configurations are considered: the first with a uniform magnetic field obliquely directed with respect to the bulk velocity; and the second with a uniform-magnitude variable-direction magnetic field. Methods. Stationary ion distribution functions are obtained by combining single-particle constant of motions, which are derived studying particle dynamics. Preliminary information about the form of the distribution functions are analytically derived considering a local approximation for the background electromagnetic field. Then, a numerical method is set up to obtain a solution for general profiles. Results. The explicit distribution functions that are found allow to obtain profiles of density, bulk velocity, temperature and heat flux. Anisotropy and agyrotropy in the distribution function are also evaluated. Stationarity of the solution during numerical simulations is checked in the uniform oblique magnetic field case. Conclusions. The considered configurations can be used as models for the Earth's magnetopause in simulations of the Kelvin-Helmholtz instability.


title: Application of a quantum wave impedance method for zero-range singular potentials

abstract: An application of a quantum wave impedance method for a study of quantum-mechanical systems which con\-tain singular zero-range potentials is considered. It was shown how to reformulate the problem of an investigation of mentioned systems in terms of a quantum wave impedance. As a result both the scattering and bound states problems are solved for systems of single $\delta$, double $\delta$ and single $\delta-\delta'$ potentials. The formalization of solving systems with an arbitrary combination of a piesewise constant potential and a $\delta$-potentials with the help of a quantum wave impedance approach is described.


title: Efficient and high accuracy 3-D OCT angiography motion correction in pathology

abstract: We propose a novel method for non-rigid 3-D motion correction of orthogonally raster-scanned optical coherence tomography angiography volumes. This is the first approach that aligns predominantly axial structural features like retinal layers and transverse angiographic vascular features in a joint optimization. Combined with the use of orthogonal scans and favorization of kinematically more plausible displacements, the approach allows subpixel alignment and micrometer-scale distortion correction in all 3 dimensions. As no specific structures or layers are segmented, the approach is by design robust to pathologic changes. It is furthermore designed for highly parallel implementation and brief runtime, allowing its integration in clinical routine even for high density or wide-field scans. We evaluated the algorithm with metrics related to clinically relevant features in a large-scale quantitative evaluation based on 204 volumetric scans of 17 subjects including both a wide range of pathologies and healthy controls. Using this method, we achieve state-of-the-art axial performance and show significant advances in both transverse co-alignment and distortion correction, especially in the pathologic subgroup.


title: PP-LinkNet: Improving Semantic Segmentation of High Resolution Satellite Imagery with Multi-stage Training

abstract: Road network and building footprint extraction is essential for many applications such as updating maps, traffic regulations, city planning, ride-hailing, disaster response \textit{etc}. Mapping road networks is currently both expensive and labor-intensive. Recently, improvements in image segmentation through the application of deep neural networks has shown promising results in extracting road segments from large scale, high resolution satellite imagery. However, significant challenges remain due to lack of enough labeled training data needed to build models for industry grade applications. In this paper, we propose a two-stage transfer learning technique to improve robustness of semantic segmentation for satellite images that leverages noisy pseudo ground truth masks obtained automatically (without human labor) from crowd-sourced OpenStreetMap (OSM) data. We further propose Pyramid Pooling-LinkNet (PP-LinkNet), an improved deep neural network for segmentation that uses focal loss, poly learning rate, and context module. We demonstrate the strengths of our approach through evaluations done on three popular datasets over two tasks, namely, road extraction and building foot-print detection. Specifically, we obtain 78.19\% meanIoU on SpaceNet building footprint dataset, 67.03\% and 77.11\% on the road topology metric on SpaceNet and DeepGlobe road extraction dataset, respectively.


title: Three representations of the fractional $p$-Laplacian: semigroup, extension and Balakrishnan formulas

abstract: We introduce three representation formulas for the fractional $p$-Laplace operator in the whole range of parameters $0<s<1$ and $1<p<\infty$. Note that for $p\ne 2$ this a nonlinear operator. The first representation is based on a splitting procedure that combines a renormalized nonlinearity with the linear heat semigroup. The second adapts the nonlinearity to the Caffarelli-Silvestre linear extension technique. The third one is the corresponding nonlinear version of the Balakrishnan formula. We also discuss the correct choice of the constant of the fractional $p$-Laplace operator in order to have continuous dependence as $p\to 2$ and $s \to 0^+, 1^-$. A number of consequences and proposals are derived. Thus, we propose a natural spectral-type operator in domains, different from the standard restriction of the fractional $p$-Laplace operator acting on the whole space. We also propose numerical schemes, a new definition of the fractional $p$-Laplacian on manifolds, as well as alternative characterizations of the $W^{s,p}(\mathbb{R}^n)$ seminorms.


title: The cloudy shape of hot Jupiter thermal phase curves

abstract: Hot Jupiters have been predicted to have a strong day/night temperature contrast and a hot spot shifted eastward of the substellar point. This was confirmed by numerous phase curve observations probing the longitudinal brightness variation of the atmosphere. Global circulation models, however, systematically underestimate the phase curve amplitude and overestimate the shift of its maximum. We use a global circulation model including non-grey radiative transfer and realistic gas and cloud opacities to systematically investigate how the atmospheric circulation of hot Jupiters varies with equilibrium temperature from 1000 to 2200K. We show that the heat transport is very efficient for cloudless planets cooler than 1600K and becomes less efficient at higher temperatures. When nightside clouds are present, the day-to-night heat transport becomes extremely inefficient, leading to a good match to the observed low nightside temperatures. The constancy of this low temperature is, however, due to the strong dependence of the radiative timescale with temperature. We further show that nightside clouds increase the phase curve amplitude and decreases the phase curve offset at the same time. This change is very sensitive to the cloud chemical composition and particle size, meaning that the diversity in observed phase curves can be explained by a diversity of nightside cloud properties. Finally, we show that phase curve parameters do not necessarily track the day/night contrast nor the shift of the hot spot on isobars, and propose solutions to to recover the true hot-spot shift and day/night contrast.


title: Practical Deep Raw Image Denoising on Mobile Devices

abstract: Deep learning-based image denoising approaches have been extensively studied in recent years, prevailing in many public benchmark datasets. However, the stat-of-the-art networks are computationally too expensive to be directly applied on mobile devices. In this work, we propose a light-weight, efficient neural network-based raw image denoiser that runs smoothly on mainstream mobile devices, and produces high quality denoising results. Our key insights are twofold: (1) by measuring and estimating sensor noise level, a smaller network trained on synthetic sensor-specific data can out-perform larger ones trained on general data; (2) the large noise level variation under different ISO settings can be removed by a novel k-Sigma Transform, allowing a small network to efficiently handle a wide range of noise levels. We conduct extensive experiments to demonstrate the efficiency and accuracy of our approach. Our proposed mobile-friendly denoising model runs at ~70 milliseconds per megapixel on Qualcomm Snapdragon 855 chipset, and it is the basis of the night shot feature of several flagship smartphones released in 2019.


title: Clouds in Three-Dimensional Models of Hot Jupiters Over a Wide Range of Temperatures I: Thermal Structures and Broadband Phase Curve Predictions

abstract: Using a general circulation model (GCM), we investigate trends in simulated hot Jupiter atmospheres for a range of irradiation temperatures (1,500 - 4,000 K), surface gravities (10 and 40 m s-2), and cloud conditions. Our models include simplified temperature-dependent clouds with radiative feedback and show how different cloud compositions, vertical thicknesses, and opacities shape hot Jupiters atmospheres by potentially increasing planetary albedos, decreasing photospheric pressures and nightside temperatures, and in some cases producing strong dayside thermal inversions. With decreasing irradiation, clouds progressively form on the nightside and cooler western limb followed by the eastern limb and central dayside. We find that clouds significantly modify the radiative transport and affect the observable properties of planets colder than T_irr ~ 3,000~K (T_eq~2,100 K) depending on the clouds' vertical extent. The precise strength of expected effects depends on the assumed parameters, but trends in predicted phase curves emerge from an ensemble of simulations. Clouds lead to larger phase curve amplitudes and smaller phase curve offsets at IR wavelengths, compared to cloud-free models. At optical wavelengths, we predict mostly westward phase curve offsets at intermediate temperatures (T_irr ~ 2,000 - 3,500 K) with clouds confined to the nightside and western limb. If clouds are vertically compact (i.e. on order of a pressure scale height in thickness), their distributions and effects become more complicated as different condensates form at different heights -- some too deep to significantly affect the observable atmosphere. Our results have implications for interpreting the diversity of phase curve observations of planets with T_irr <~3,000~K.


title: Scalable changepoint and anomaly detection in cross-correlated data with an application to condition monitoring

abstract: Motivated by a condition monitoring application arising from subsea engineering we derive a novel, scalable approach to detecting anomalous mean structure in a subset of correlated multivariate time series. Given the need to analyse such series efficiently we explore a computationally efficient approximation of the maximum likelihood solution to the resulting modelling framework, and develop a new dynamic programming algorithm for solving the resulting Binary Quadratic Programme when the precision matrix of the time series at any given time-point is banded. Through a comprehensive simulation study, we show that the resulting methods perform favourably compared to competing methods both in the anomaly and change detection settings, even when the sparsity structure of the precision matrix estimate is misspecified. We also demonstrate its ability to correctly detect faulty time-periods of a pump within the motivating application.


title: Mean ergodic composition operators on $H^\infty(\mathbb{B}_n)$

abstract: In this paper, we study (uniformly) mean ergodic composition operators on $H^\infty(\mathbb{B}_n)$. Under some additional assumptions, it is shown that mean ergodic operators have norm convergent iterates in $H^\infty(\mathbb{B}_n)$, and that they are always uniformly mean ergodic.


title: Deep Learning from Small Amount of Medical Data with Noisy Labels: A Meta-Learning Approach

abstract: Computer vision systems recently made a big leap thanks to deep neural networks. However, these systems require correctly labeled large datasets in order to be trained properly, which is very difficult to obtain for medical applications. Two main reasons for label noise in medical applications are the high complexity of the data and conflicting opinions of experts. Moreover, medical imaging datasets are commonly tiny, which makes each data very important in learning. As a result, if not handled properly, label noise significantly degrades the performance. Therefore, a label-noise-robust learning algorithm that makes use of the meta-learning paradigm is proposed in this article. The proposed solution is tested on retinopathy of prematurity (ROP) dataset with a very high label noise of 68%. Results show that the proposed algorithm significantly improves the classification algorithm's performance in the presence of noisy labels.


title: General Reiteration Theorems for R and L Classes: Case of Right R-Spaces and Left L-Spaces

abstract: Given $E_0, E_1, E, F$ rearrangement invariant spaces, $a, b, b_0, b_1$ slowly varying functions and $0\leq \theta_0<\theta_1\leq 1$, we characterize the interpolation space $$(\overline{X}_{\theta_0,b_0,E_0}, \overline{X}^{\mathcal R}_{\theta_1, b_1,E_1,a,F})_{\theta,b,E} \quad \text{and} \quad (\overline{X}^{\mathcal L}_{\theta_0, b_0,E_0,a,F}, \overline{X}_{\theta_1,b_1,E_1})_{\theta,b,E},$$ for all possible values of $\theta\in[0,1]$. Applications to interpolation identities for grand and small Lebesgue spaces, Gamma spaces and $A$ and $B$-type spaces are given.


title: Discriminant Analysis of Distributional Data viaFractional Programming

abstract: We address classification of distributional data, where units are described by histogram or interval-valued variables. The proposed approach uses a linear discriminant function where distributions or intervals are represented by quantile functions, under specific assumptions. This discriminant function allows defining a score for each unit, in the form of a quantile function, which is used to classify the units in two a priori groups, using the Mallows distance. There is a diversity of application areas for the proposed linear discriminant method. In this work we classify the airline companies operating in NY airports based on air time and arrival/departure delays, using a full year fights.


title: Branching random walks in random environment: a survey

abstract: We consider branching particle processes on discrete structures like the hypercube in a random fitness landscape (i.e., random branching/killing rates). The main question is about the location where the main part of the population sits at a late time, if the state space is large. For answering this, we take the expectation with respect to the migration (mutation) and the branching/killing (selection) mechanisms, for fixed rates. This is intimately connected with the parabolic Anderson model, the heat equation with random potential, a model that is of interest in mathematical physics because of the observed prominent effect of intermittency (local concentration of the mass of the solution in small islands). We present several advances in the investigation of this effect, also related to questions inspired from biology.


title: Pair the Dots: Jointly Examining Training History and Test Stimuli for Model Interpretability

abstract: Any prediction from a model is made by a combination of learning history and test stimuli. This provides significant insights for improving model interpretability: {\it because of which part(s) of which training example(s), the model attends to which part(s) of a test example}. Unfortunately, existing methods to interpret a model's predictions are only able to capture a single aspect of either test stimuli or learning history, and evidences from both are never combined or integrated. In this paper, we propose an efficient and differentiable approach to make it feasible to interpret a model's prediction by jointly examining training history and test stimuli. Test stimuli is first identified by gradient-based methods, signifying {\it the part of a test example that the model attends to}. The gradient-based saliency scores are then propagated to training examples using influence functions to identify {\it which part(s) of which training example(s)} make the model attends to the test stimuli. The system is differentiable and time efficient: the adoption of saliency scores from gradient-based methods allows us to efficiently trace a model's prediction through test stimuli, and then back to training examples through influence functions. We demonstrate that the proposed methodology offers clear explanations about neural model decisions, along with being useful for performing error analysis, crafting adversarial examples and fixing erroneously classified examples.


title: Relative Depth Estimation as a Ranking Problem

abstract: We present a formulation of the relative depth estimation from a single image problem, as a ranking problem. By reformulating the problem this way, we were able to utilize literature on the ranking problem, and apply the existing knowledge to achieve better results. To this end, we have introduced a listwise ranking loss borrowed from ranking literature, weighted ListMLE, to the relative depth estimation problem. We have also brought a new metric which considers pixel depth ranking accuracy, on which our method is stronger.


title: Quantum Mechanics in Wavelet Basis

abstract: We describe a multi-scale resolution approach to analyzing problems in Quantum Mechanics using Daubechies wavelet basis. The expansion of the wavefunction of the quantum system in this basis allows a natural interpretation of each basis function as a quantum fluctuation of a specific resolution at a particular location. The Hamiltonian matrix constructed in this basis describes couplings between different length scales and thus allows for intuitive volume and resolution truncation. In quantum mechanical problems with a natural length scale, one can get approximate solution of the problem through simple matrix diagonalization. We illustrate this approach using the example of the standard quantum mechanical simple harmonic oscillator.


title: Distribution of neighborhood size in cities

abstract: We study the distribution of neighborhoods across a set of 12 global cities and find that the distribution of neighborhood sizes follows exponential decay across all cities under consideration. We are able to analytically show that this exponential distribution of neighbourhood sizes is consistent with the observed Zipf's Law for city sizes. We attempt to explain the emergence of exponential decay in neighbourhood size using a model of neighborhood dynamics where migration into and movement within the city are mediated by wealth. We find that, as observed empirically, the model generates exponential decay in neighborhood size distributions for a range of parameter specifications. The use of a comparative wealth-based metric to assess the relative attractiveness of a neighborhood combined with a stringent affordability threshold in mediating movement within the city are found to be necessary conditions for the the emergence of the exponential distribution. While an analytical treatment is difficult due to the globally coupled dynamics, we use a simple two-neighbourhood system to illustrate the precise dynamics yielding equilibrium non-equal neighborhood size distributions.


title: Resummation methods for Master Integrals

abstract: We present in detail two resummation methods emerging from the application of the Simplified Differential Equations approach to a canonical basis of master integrals. The first one is a method which allows for an easy determination of the boundary conditions, since it finds relations between the boundaries of the basis elements and the second one indicates how using the $x \rightarrow 1$ limit to the solutions of a canonical basis, one can obtain the solutions to a canonical basis for the same problem with one mass less. Both methods utilise the residue matrices for the letters $\{0,1\}$ of the canonical differential equation. As proof of concept, we apply these methods to a canonical basis for the three-loop ladder-box with one external mass off-shell, obtaining subsequently a canonical basis for the massless three-loop ladder-box as well as its solution.


title: Scalable Graph Networks for Particle Simulations

abstract: Learning system dynamics directly from observations is a promising direction in machine learning due to its potential to significantly enhance our ability to understand physical systems. However, the dynamics of many real-world systems are challenging to learn due to the presence of nonlinear potentials and a number of interactions that scales quadratically with the number of particles $N$, as in the case of the N-body problem. In this work, we introduce an approach that transforms a fully-connected interaction graph into a hierarchical one which reduces the number of edges to $O(N)$. This results in linear time and space complexity while the pre-computation of the hierarchical graph requires $O(N\log (N))$ time and $O(N)$ space. Using our approach, we are able to train models on much larger particle counts, even on a single GPU. We evaluate how the phase space position accuracy and energy conservation depend on the number of simulated particles. Our approach retains high accuracy and efficiency even on large-scale gravitational N-body simulations which are impossible to run on a single machine if a fully-connected graph is used. Similar results are also observed when simulating Coulomb interactions. Furthermore, we make several important observations regarding the performance of this new hierarchical model, including: i) its accuracy tends to improve with the number of particles in the simulation and ii) its generalisation to unseen particle counts is also much better than for models that use all $O(N^2)$ interactions.

categories: cs.LG astro-ph.IM physics.comp-ph stat.ML


title: Characterizing the companion AGBs using surface chemical composition of barium stars

abstract: Barium stars are one of the important probes to understand the origin and evolution of slow neutron-capture process elements in the Galaxy. These are extrinsic stars, where the observed s-process element abundances are believed to have an origin in the now invisible companions that produced these elements at their Asymptotic Giant Branch phase of evolution. We have attempted to understand the s-process nucleosynthesis, as well as the physical properties of the companion stars through a detailed comparison of observed elemental abundances of 10 barium stars with the predictions from AGB nucleosynthesis models, FRUITY. For these stars, we have presented estimates of abundances of several elements, C, N, O, Na, Al, $\alpha$-elements, Fe-peak elements and neutron-capture elements Rb, Sr, Y, Zr, Ba, La, Ce, Pr, Nd, Sm and Eu. The abundance estimates are based on high resolution spectral analysis. Observations of Rb in four of these stars have allowed us to put a limit to the mass of the companion AGB stars. Our analysis clearly shows that the former companions responsible for the surface abundance peculiarities of these stars are low-mass AGB stars. Kinematic analysis have shown the stars to be members of Galactic disk population.


title: FC-DCNN: A densely connected neural network for stereo estimation

abstract: We propose a novel lightweight network for stereo estimation. Our network consists of a fully-convolutional densely connected neural network (FC-DCNN) that computes matching costs between rectified image pairs. Our FC-DCNN method learns expressive features and performs some simple but effective post-processing steps. The densely connected layer structure connects the output of each layer to the input of each subsequent layer. This network structure and the fact that we do not use any fully-connected layers or 3D convolutions leads to a very lightweight network. The output of this network is used in order to calculate matching costs and create a cost-volume. Instead of using time and memory-inefficient cost-aggregation methods such as semi-global matching or conditional random fields in order to improve the result, we rely on filtering techniques, namely median filter and guided filter. By computing a left-right consistency check we get rid of inconsistent values. Afterwards we use a watershed foreground-background segmentation on the disparity image with removed inconsistencies. This mask is then used to refine the final prediction. We show that our method works well for both challenging indoor and outdoor scenes by evaluating it on the Middlebury, KITTI and ETH3D benchmarks respectively. Our full framework is available at https://github.com/thedodo/FC-DCNN


title: Some applications of interpolating sequences for Banach spaces of analytic functions

abstract: M. J. Beltr\'{a}n-Meneua et al. \cite{beltran1} and E. Jord\'{a} and A. Rodr\'{i}guez-Arenas \cite{jorda} characterized the (uniformly) mean ergodic composition operators on $H^\infty(\mathbb{D})$ and $H^\infty_\nu (\mathbb{D})$, respectively. In this paper, by using the interpolating sequences, we give other necessary and sufficient conditions for the (uniformly) mean ergodicity of composition operators on these spaces.


title: Consumer Behaviour in Retail: Next Logical Purchase using Deep Neural Network

abstract: Predicting future consumer behaviour is one of the most challenging problems for large scale retail firms. Accurate prediction of consumer purchase pattern enables better inventory planning and efficient personalized marketing strategies. Optimal inventory planning helps minimise instances of Out-of-stock/ Excess Inventory and, smart Personalized marketing strategy ensures smooth and delightful shopping experience. Consumer purchase prediction problem has generally been addressed by ML researchers in conventional manners, either through recommender systems or traditional ML approaches. Such modelling approaches do not generalise well in predicting consumer purchase pattern. In this paper, we present our study of consumer purchase behaviour, wherein, we establish a data-driven framework to predict whether a consumer is going to purchase an item within a certain time frame using e-commerce retail data. To model this relationship, we create a sequential time-series data for all relevant consumer-item combinations. We then build generalized non-linear models by generating features at the intersection of consumer, item, and time. We demonstrate robust performance by experimenting with different neural network architectures, ML models, and their combinations. We present the results of 60 modelling experiments with varying Hyperparameters along with Stacked Generalization ensemble and F1-Maximization framework. We then present the benefits that neural network architectures like Multi Layer Perceptron, Long Short Term Memory (LSTM), Temporal Convolutional Networks (TCN) and TCN-LSTM bring over ML models like Xgboost and RandomForest.


title: Identities and bases in the hypoplactic monoid

abstract: This paper presents new results on the identities satisfied by the hypoplactic monoid. We show how to embed the hypoplactic monoid of any rank strictly greater than 2 (including infinite rank) into a direct product of copies of the hypoplactic monoid of rank 2. This confirms that all hypoplactic monoids of rank greater than or equal to 2 satisfy exactly the same identities. We then give a complete characterization of those identities, and prove that the variety generated by the hypoplactic monoid has finite axiomatic rank, by giving a finite basis for it.


title: Long term dynamics of poverty transitions in India

abstract: We model the dynamics of poverty using a stochastic model of Geometric Brownian Motion with reallocation (RGBM) and explore both transient and persistent poverty over 1952-2006. We find that annual transitions in and out of poverty are common and show a rising trend, with the rise largely being driven by transitions out of poverty. Despite this promising trend, even toward the end of the time frame, there is a non-trivial proportion of individuals still transitioning annually into poverty, indicative of the economic fragility of those near the poverty line. We also find that there is still a marked persistence of poverty over time, though the probability of poverty persistence is slowly declining. Particularly concerning in this context are the poverty trajectories of those at the very bottom of the income distribution. The choice of poverty line appears to impact the dynamics, with higher poverty lines corresponding to lower transitions and higher persistence probabilities. The distinct nature of emergent transient and persistence dynamics suggests that the approaches to counter these phenomena need to be different, possibly incorporating both missing financial markets and state action.


title: Walks obeying two-step rules on the square lattice: full, half and quarter planes

abstract: We consider walks on the edges of the square lattice $\mathbb Z^2$ which obey \emph{two-step rules,} which allow (or forbid) steps in a given direction to be followed by steps in another direction. We classify these rules according to a number of criteria, and show how these properties affect their generating functions, asymptotic enumerations and limiting shapes, on the full lattice as well as the upper half plane. For walks in the quarter plane, we only make a few tentative first steps. We propose candidates for the group of a model, analogous to the group of a regular short-step quarter plane model, and investigate which models have finite versus infinite groups. We demonstrate that the orbit sum method used to solve a number of the original models can be made to work for some models here, producing a D-finite solution. We also generate short series for all models and guess differential or algebraic equations where possible. In doing so, we find that there are possibilities here which do not occur for the regular short-step models, including cases with algebraic or D-finite generating functions but infinite groups, as well as models with non-D-finite generating functions but finite groups.


title: Exploiting term sparsity in Noncommutative Polynomial Optimization

abstract: We provide a new hierarchy of semidefinite programming relaxations, called NCTSSOS, to solve large-scale sparse noncommutative polynomial optimization problems. This hierarchy features the exploitation of term sparsity hidden in the input data for eigenvalue and trace optimization problems. NCTSSOS complements the recent work that exploits correlative sparsity for noncommutative optimization problems by Klep, Magron and Povh in arXiv:1909.00569, and is the noncommutative analogue of the TSSOS framework by Wang, Magron and Lasserre in arXiv:1912.08899. We also propose an extension exploiting simultaneously correlative and term sparsity, as done previously in the commutative case arXiv:2005.02828. Under certain conditions, we prove that the optimums of the NCTSSOS hierarchy converge to the optimum of the corresponding dense SDP relaxation. We illustrate the efficiency and scalability of NCTSSOS by solving eigenvalue/trace optimization problems from the literature as well as randomly generated examples involving up to several thousands of variables.


title: Reversible and irreversible processes during cyclic voltammetry of an electrodeposited manganese oxide as catalyst for the oxygen evolution reaction

abstract: Manganese oxides have received much attention over the years among the wide range of electrocatalysts for the oxygen evolution reaction (OER) due to their low toxicity, high abundance and rich redox chemistry. While many previous studies focused on the activity of these materials, a better understanding of the material transformations relating to activation or degradation is highly desirable, both from a scientific perspective and for applications. We electrodeposited Na-containing MnOx without long-range order from an alkaline solution to investigate these aspects by cyclic voltammetry, scanning electron microscopy and x-ray absorption spectroscopy at the Mn-K and Mn-L edges. The pristine film was assigned to a layered edge-sharing Mn3+/4+ oxide with Mn-O bond lengths of mainly 1.87 {\AA} and some at 2.30 {\AA} as well as Mn-Mn bond lengths of 2.87 {\AA} based on fits to the extended x-ray fine structure. The decrease of the currents at voltages before the onset of the OER followed power laws with three different exponents depending on the number of cycles and the Tafel slope decreases from 186 \pm 48 to 114 \pm 18 mV dec-1 after 100 cycles, which we interpret in the context of surface coverage with unreacted intermediates. Post-mortem microscopy and bulk spectroscopy at the Mn-K edge showed no change of the microstructure, bulk local structure or bulk Mn valence. Yet, the surface region of MnOx oxidized toward Mn4+, which explains the reduction of the currents in agreement with literature. Surprisingly, we find that MnOx reactivates after 30 min at open-circuit (OC), where the currents and also the Tafel slope increase. Reactivation processes during OC are crucial because OC is unavoidable when coupling the electrocatalysts to intermittent power sources such as solar energy for sustainable energy production.


title: Spread of Covid-19 in urban neighbourhoods and slums of the developing world

abstract: We study the spread of Covid-19 across neighbourhoods of cities in the developing world and find that small numbers of neighbourhoods account for a majority of cases (k-index~0.7). We also find that the countrywide distribution of cases across states/provinces in these nations also displays similar inequality, indicating self-similarity across scales. Neighbourhoods with slums are found to contain the highest density of cases across all cities under consideration, revealing that slums constitute the most at-risk urban locations in this epidemic. We present a stochastic network model to study the spread of a respiratory epidemic through physically proximate and accidental daily human contacts in a city, and simulate outcomes for a city with two kinds of neighbourhoods - slum and non-slum. The model reproduces observed empirical outcomes for a broad set of parameter values - reflecting the potential validity of these findings for epidemic spread in general, especially across cities of the developing world. We also find that distribution of cases becomes less unequal as the epidemic runs its course, and that both peak and cumulative caseloads are worse for slum neighbourhoods than non-slums at the end of an epidemic. Large slums in the developing world therefore contain the most vulnerable populations in an outbreak, and the continuing growth of metropolises in Asia and Africa presents significant challenges for future respiratory outbreaks from perspectives of public health and socioeconomic equity.


title: Alternating Minimization Based First-Order Method for the Wireless Sensor Network Localization Problem

abstract: We propose an algorithm for the Wireless Sensor Network localization problem, which is based on the well-known algorithmic framework of Alternating Minimization. We start with a non-smooth and non-convex minimization, and transform it into an equivalent smooth and non-convex problem, which stands at the heart of our study. This paves the way to a new method which is globally convergent: not only does the sequence of objective function values converge, but the sequence of the location estimates also converges to a unique location that is a critical point of the corresponding (original) objective function. The proposed algorithm has a range of fully distributed to fully centralized implementations, which all have the property of global convergence. The algorithm is tested over several network configurations, and it is shown to produce more accurate solutions within a shorter time relative to existing methods.


title: Dynamic detection of current-induced spin-orbit magnetic fields: a phase independent approach

abstract: Current induced spin-orbit torques (SOTs) in ferromagnet/non-magnetic metal heterostructures open vast possibilities to design spintronic devices to store, process and transmit information in a simple architecture. It is a central task to search for efficient SOT-devices, and to quantify the magnitude as well as the symmetry of current-induced spin-orbit magnetic fields (SOFs). Here, we report a novel approach to determine the SOFs based on magnetization dynamics by means of time-resolved magneto-optic Kerr microscopy. A microwave current in a narrow Fe/GaAs (001) stripe generates an Oersted field as well as SOFs due to the reduced symmetry at the Fe/GaAs interface, and excites standing spin wave (SSW) modes because of the lateral confinement. Due to their different symmetries, the SOFs and the Oersted field generate distinctly different mode patterns. Thus it is possible to determine the magnitude of the SOFs from an analysis of the shape of the SSW patterns. Specifically, this method, which is conceptually different from previous approaches based on lineshape analysis, is phase independent and self-calibrated. It can be used to measure the current induced SOFs in other material systems, e.g., ferromagnetic metal/non-magnetic metal heterostructures.


title: Production and electromagnetic decay of hyperons: a feasibility study with HADES as a Phase-0 experiment at FAIR

abstract: A feasibility study has been performed in order to investigate the performance of the HADES detector to measure the electromagnetic decays of the hyperon resonances $\Sigma(1385)^0$, $\Lambda(1405)$ and $\Lambda{\Lambda}(1520)$ as well as the production of double strange baryon systems $\Xi^-$ and $\Lambda\Lambda$ in p+p reactions at a beam kinetic energy of 4.5 GeV. The existing HADES detector will be upgraded by a new Forward Detector, which extends the detector acceptance into a range of polar angles that plays a crucial role for these investigations. The analysis of each channel is preceded by a consideration of the production cross-sections. Afterwards the expected signal count rates using a target consisting of either liquid hydrogen or polyethylene are summarized.


title: Self-Imitation Learning for Robot Tasks with Sparse and Delayed Rewards

abstract: The application of reinforcement learning (RL) in robotic control is still limited in the environments with sparse and delayed rewards. In this paper, we propose a practical self-imitation learning method named Self-Imitation Learning with Constant Reward (SILCR). Instead of requiring hand-defined immediate rewards from environments, our method assigns the immediate rewards at each timestep with constant values according to their final episodic rewards. In this way, even if the dense rewards from environments are unavailable, every action taken by the agents would be guided properly. We demonstrate the effectiveness of our method in some challenging continuous robotics control tasks in MuJoCo simulation and the results show that our method significantly outperforms the alternative methods in tasks with sparse and delayed rewards. Even compared with alternatives with dense rewards available, our method achieves competitive performance. The ablation experiments also show the stability and reproducibility of our method.


title: Online Shaping for ISI Channels with a Limited Number of ADC Bits

abstract: An online shaping technique for high performance communication over Gaussian channels with Inter-Symbol Interference (ISI) and receiver Analog to Digital Converter (ADC) noise is presented. The technique uses online transmitter precoding over Pulse Amplitude Modulation (PAM) constellation, designed to shape the symbols distribution so that peak power constraint at the channel output is satisfied. An iterative decoder shares information between a modified M-BCJR module, which computes online the trellis transition probabilities of the shaped distribution, and turbo decoder. The result is a reduction in the required ADC Effective Number Of Bits (ENOB), which is in particular attractive in modern high-speed wireline links. Theoretical bounds are analytically derived which enable to assess the possible gain using shaping. On practical scenarios aim to transmit 200 Gbps and 400 Gbps over printed circuit board, we demonstrate in simulations an overall ENOB gains as high as 1.43 bit and 1.78 bit, respectively, compared to uniform 4-PAM transmission with turbo equalization at the receiver side.


title: Reduced order models for the incompressible Navier-Stokes equations on collocated grids using a 'discretize-then-project' approach

abstract: A novel reduced order model (ROM) for incompressible flows is developed by performing a Galerkin projection based on a fully (space and time) discrete full order model (FOM) formulation. This 'discretize-then-project' approach requires no pressure stabilization technique (even though the pressure term is present in the ROM) nor a boundary control technique (to impose the boundary conditions at the ROM level). These are two main advantages compared to existing approaches. The fully discrete FOM is obtained by a finite volume discretization of the incompressible Navier-Stokes equations on a collocated grid, with a forward Euler time discretization. Two variants of the time discretization method, the inconsistent and consistent flux method, have been investigated. The latter leads to divergence-free velocity fields, also on the ROM level, whereas the velocity fields are only approximately divergence-free in the former method. For both methods, accurate results have been obtained for test cases with different types of boundary conditions: a lid-driven cavity and an open-cavity (with an inlet and outlet). The ROM obtained with the consistent flux method, having divergence-free velocity fields, is slightly more accurate but also slightly more expensive to solve compared to the inconsistent flux method. The speedup ratio of the ROM and FOM computation times is the highest for the open cavity test case with the inconsistent flux method.


title: H. Cartan's theory for Riemann surfaces

abstract: We generalize the H. Cartan's theory of holomorphic curves for a general open Riemann surface. Besides, a vanishing theorem for jet differentials and a Bloch's theorem for Riemann surfaces are obtained.


title: Topological Floquet interface states in optical fibre loops

abstract: We experimentally observe a coexisting pair of topological anomalous Floquet interface states in a (1+1)-dimensional Discrete Photon Walk. We explicitly verify the robustness of these states against local static perturbations respecting chiral symmetry of the system, as well as their vulnerability against non-stationary perturbations. The walk is implemented based on pulses propagating in a pair of coupled fibre loops of dissimilar lengths with dynamically variable mutual coupling. The topological interface is created via phase modulation in one of the loops, which allows for an anomalous Floquet topological transition at the interface.


title: The Limiting Distribution of Character Sums

abstract: In this paper, we consider the distribution of the continuous paths of Dirichlet character sums modulo prime $q$ on the complex plane. We also find a limiting distribution as $q \rightarrow \infty$ using Steinhaus random multiplicative functions, stating properties of this random process. This is motivated by Kowalski and Sawin's work on Kloosterman paths.


title: Stochastic modelling of Gaussian processes by improper linear functionals

abstract: Various approaches to stochastic processes exist, noting that key properties such as measurability and continuity are not trivially satisfied. We introduce a new theory for Gaussian processes using improper linear functionals. Using a collection of i.i.d. standard normal variables, we define Gaussian white noise and discuss its properties. This is extended to general Gaussian processes on Hilbert space, where the variance is allowed to be any suitable operator. Our main focus is $L^2$ spaces, and we discuss criteria for Gaussian processes to be continuous in this setting. Finally, we outline a framework for statistical inference using the presented theory with focus on the special case of $L^2[0,1]$. We introduce the Fredholm determinant into the functional log-likelihood. We demonstrate that the naive functional log-likelihood is not consistent with the multivariate likelihood. A correction term is introduced, and we prove an asymptotical result.


title: NwQM: A neural quality assessment framework for Wikipedia

abstract: Millions of people irrespective of socioeconomic and demographic backgrounds, depend on Wikipedia articles everyday for keeping themselves informed regarding popular as well as obscure topics. Articles have been categorized by editors into several quality classes, which indicate their reliability as encyclopedic content. This manual designation is an onerous task because it necessitates profound knowledge about encyclopedic language, as well navigating circuitous set of wiki guidelines. In this paper we propose Neural wikipedia QualityMonitor (NwQM), a novel deep learning model which accumulates signals from several key information sources such as article text, meta data and images to obtain improved Wikipedia article representation. We present comparison of our approach against a plethora of available solutions and show 8% improvement over state-of-the-art approaches with detailed ablation studies.


title: Development of cooling system of solid state target for irradiation under proton beam of C18 cyclotron

abstract: In recent years, the possibility of direct production of the 99mTc isotope (bypassing the parent 99Mo stage) for medical purposes using nuclear reactions on charged particle beams has been actively discussed around the world [1,2]. At A.I. Alikhanyan National Science Laboratory (Yerevan Physics Institute), an activity is underway to develop a technology for producing the 99mTc isotope by irradiating a molybdenum target of 100Mo, pressed into a titanium base, with a proton beam of a C18 cyclotron [3,4,5]. One of the limitations of this technique is the utilization of heat released in the target as a result of proton energy loss [6,7]. The task of this work was the improvement of the thermal regime of a standard target for the C18 cyclotron due to a series of parallel grooves. Heat transfer experiments with prototypes of targets were carried out on a specially made test bench providing water cooling of its back side. A special Plexiglas thermal block was made to study the thermal processes in the target. The measurement results show that the above mentioned technique of processing the base of the target leads to a significant increase in the rate of cooling of the target, which will allow to irradiate at significantly higher proton beam intensities, which in its turn will increase the irradiation efficiency and reduce the cost of the final product.


title: Effects of plasticity on the anisotropy of the effective fracture toughness

abstract: This paper investigates the effects of plasticity on the effective fracture toughness. A layered material is considered as a modelling system. An elastic-plastic phase-field model and a surfing boundary condition are used to study how the crack propagates throughout the material and the evolution of the effective toughness as a function of the layer angle. We first study three idealized situations, where only one property among fracture toughness, Young's modulus and yield strength is heterogeneous whereas the others are uniform. We observe that in the case of toughness and strength heterogeneity, the material exhibits anomalous isotropy: the effective toughness is equal to the largest of the point-wise values for any layer angle except when the layers are parallel to the macroscopic direction of propagation. As the layer angle decreases, the crack propagates along the brittle-to-tough interfaces, whereas it goes straight when the layers have different yield strength but uniform toughness. We find that smooth deflections in the crack path do not induce any overall toughening and that the effective toughness is not proportional to either the cumulated fracture energy or the cumulated plastic work. In the case of elastic heterogeneity, the material is anisotropic in the sense of the effective toughness, as the latter varies as a function of the layer angle. Four toughening mechanisms are active: stress fluctuations, crack renucleation, plastic dissipation and plastic blunting. Finally, we consider a layered medium comprised of compliant-tough-weak and stiff-brittle-strong phases, as it is the case for many structural composites. We observe a transition from an interface-dominated to a plasticity-dominated failure regime, as the phase constituents become more ductile. The material is anisotropic in the sense of the effective toughness.


title: Two-dimensional electron-hole system under the influence of the Chern-Simons gauge field created by the quantum point vortices

abstract: In the present work the Chern-Simons(C-S) gauge field theory developed by Jackiw and Pi [1] and widely used to explain the fractional quantum Hall effects, was applied to describe the two-dimensional (2D) electron-hole (e-h) system in a strong perpendicular magnetic field under the influence of the quantum point vortices creating the Chern-Simons(C-S) gauge field. The composite particles formed by electrons and by holes with equal integer positive numbers of the attached quantum point vortices are described by the dressed field operators, which obey to the Fermi or to the Bose statistics depending on the even or odd numbers . It is shown that the phase operators as well as the vector and the scalar potentials of the C-S gauge field depend on the difference of the electron and of the hole density operators. They vanish in the mean field approximation, when the average values of the electron and of the whole densities coincide. Nevertheless, even in this case, the quantum fluctuations of the C-S gauge field lead to new physics of the 2D e-h system.


title: Neural Databases

abstract: In recent years, neural networks have shown impressive performance gains on long-standing AI problems, and in particular, answering queries from natural language text. These advances raise the question of whether they can be extended to a point where we can relax the fundamental assumption of database management, namely, that our data is represented as fields of a pre-defined schema. This paper presents a first step in answering that question. We describe NeuralDB, a database system with no pre-defined schema, in which updates and queries are given in natural language. We develop query processing techniques that build on the primitives offered by the state of the art Natural Language Processing methods. We begin by demonstrating that at the core, recent NLP transformers, powered by pre-trained language models, can answer select-project-join queries if they are given the exact set of relevant facts. However, they cannot scale to non-trivial databases and cannot perform aggregation queries. Based on these findings, we describe a NeuralDB architecture that runs multiple Neural SPJ operators in parallel, each with a set of database sentences that can produce one of the answers to the query. The result of these operators is fed to an aggregation operator if needed. We describe an algorithm that learns how to create the appropriate sets of facts to be fed into each of the Neural SPJ operators. Importantly, this algorithm can be trained by the Neural SPJ operator itself. We experimentally validate the accuracy of NeuralDB and its components, showing that we can answer queries over thousands of sentences with very high accuracy.


title: Self-avoiding walks and multiple context-free languages

abstract: Let $G$ be a quasi-transitive, locally finite, connected graph rooted at a vertex $o$, and let $c_n(o)$ be the number of self-avoiding walks of length $n$ on $G$ starting at $o$. We show that if $G$ has only thin ends, then the generating function $F_{\mathrm{SAW},o}(z)=\sum_{n \geq 0} c_n(o) z^n$ is an algebraic function. In particular, the connective constant of such a graph is an algebraic number. If $G$ is deterministically edge labelled, that is, every (directed) edge carries a label such that any two edges starting at the same vertex have different labels, then the set of all words which can be read along the edges of self-avoiding walks starting at $o$ forms a language denoted by $L_{\mathrm{SAW},o}$. Assume that the group of label-preserving graph automorphisms acts quasi-transitively. We show that $L_{\mathrm{SAW},o}$ is a $k$-multiple context-free language if and only if the size of all ends of $G$ is at most $2k$. Applied to Cayley graphs of finitely generated groups this says that $L_{\mathrm{SAW},o}$ is multiple context-free if and only if the group is virtually free.


title: Medical Code Assignment with Gated Convolution and Note-Code Interaction

abstract: Medical code assignment from clinical text is a fundamental task in clinical information system management. As medical notes are typically lengthy and the medical coding system's code space is large, this task is a long-standing challenge. Recent work applies deep neural network models to encode the medical notes and assign medical codes to clinical documents. However, these methods are still ineffective as they do not fully encode and capture the lengthy and rich semantic information of medical notes nor explicitly exploit the interactions between the notes and codes. We propose a novel method, gated convolutional neural networks, and a note-code interaction (GatedCNN-NCI), for automatic medical code assignment to overcome these challenges. Our methods capture the rich semantic information of the lengthy clinical text for better representation by utilizing embedding injection and gated information propagation in the medical note encoding module. With a novel note-code interaction design and a graph message passing mechanism, we explicitly capture the underlying dependency between notes and codes, enabling effective code prediction. A weight sharing scheme is further designed to decrease the number of trainable parameters. Empirical experiments on real-world clinical datasets show that our proposed model outperforms state-of-the-art models in most cases, and our model size is on par with light-weighted baselines.


title: Partial Information Decomposition of Boolean Functions: a Fourier Analysis perspective

abstract: Partial information decomposition (PID) partitions the information that a set of sources has about a target variable into synergistic, unique, and redundant contributions. This information-theoretic tool has recently attracted attention due to its potential to characterize the information processing in multivariate systems. However, the PID framework still lacks a solid and intuitive interpretation of its information components. In the aim to improve the understanding of PID components, we focus here on Boolean gates, a much-studied type of source-target mechanisms. Boolean gates have been extensively characterised via Fourier analysis which coefficients have been related to interesting properties of the functions defining the gates. In this paper, we establish for Boolean gates mechanisms a relation between their PID components and Fourier coefficients.


title: Temperature Structure of the Pipe Nebula Studied by the Intensity Anomaly of the OH 18 cm

abstract: We present observations of the four hyperfine structure components of the OH 18 cm transition (1612, 1665, 1667 and 1720 MHz) toward a filamentary dark cloud, the Pipe nebula, with the Green Bank Telescope. A statistical equilibrium analysis is applied to the spectra,and the kinetic temperature of a diffuse molecular gas surrounding dense cores is determined accurately; the derived temperature ranges from 40 K to 75 K. From this result, we assess the heating effect on the filamentarystructure of the nebula's "stem" region due to UV photons from a nearby star $\theta$-Ophiuchi and a possible filament-filament collision in the interface of the "stem" and "bowl" regions. In the stem region, the gas kinetic temperature is found to be almost independent of the apparent distance from $\theta$-Ophiuchi: the UV-heating effect by the star is not visible. On the other hand, the gas kinetic temperature is raised, as high as $\sim$75 K, at the interface of the two filamentary structures. This result provides us with an additional support to the filament-filament collision scenario in the Pipe nebula.


title: Differentiable Causal Discovery Under Unmeasured Confounding

abstract: The data drawn from biological, economic, and social systems are often confounded due to the presence of unmeasured variables. Prior work in causal discovery has focused on discrete search procedures for selecting acyclic directed mixed graphs (ADMGs), specifically ancestral ADMGs, that encode ordinary conditional independence constraints among the observed variables of the system. However, confounded systems also exhibit more general equality restrictions that cannot be represented via these graphs, placing a limit on the kinds of structures that can be learned using ancestral ADMGs. In this work, we derive differentiable algebraic constraints that fully characterize the space of ancestral ADMGs, as well as more general classes of ADMGs, arid ADMGs and bow-free ADMGs, that capture all equality restrictions on the observed variables. We use these constraints to cast causal discovery as a continuous optimization problem and design differentiable procedures to find the best fitting ADMG when the data comes from a confounded linear system of equations with correlated errors. We demonstrate the efficacy of our method through simulations and application to a protein expression dataset. Code implementing our methods is open-source and publicly available at https://gitlab.com/rbhatta8/dcd and will be incorporated into the Ananke package.


title: Peculiarities in the horizontal branch stars of globular cluster NGC 1851: Discovery of a Blue straggler companion to an EHB star

abstract: We present a study of Far Ultraviolet (FUV) bright horizontal branch (HB) stars to understand the peculiarities seen in the HB sequence of the Globular Cluster NGC 1851, using ground and space based multi-wavelength data. Optical and UV color magnitude diagrams are used to classify HB stars and their membership from HST and Gaia DR2 data. The Spectral energy distributions (SEDs) of the hot HB stars located from the core to tidal radii are constructed. The SEDs reveal that the HB stars near the G-jump show a decrease in the FUV flux when atmospheric models of cluster metallicity are used for fitting, but a better fit is found with higher metallicity models, as expected due to atmospheric diffusion. We report on four particularly interesting extreme HB (EHB) stars, two each in inner and outer regions. We detect a sub-luminous EHB and a "blue-Hook" candidates with temperatures Teff ~ 25,000 K and 31,000 K, respectively. We found an EHB star (Teff ~ 17,000 K) with the radius lies between the BHB and normal EHB stars. The most peculiar of our EHB stars (Teff ~ 28,000 K) is found to be a photometric binary to a Blue Straggler star (BSS) (Teff ~ 7,000 K), which is an important target for spectroscopic study. This discovery of the candidate EHB+BSS binary system, could help to explain the mass loss in the RGB phase, leading to the formation of EHB stars.


title: LCM from FCA Point of View: A CbO-style Algorithm with Speed-up Features

abstract: LCM is an algorithm for enumeration of frequent closed itemsets in transaction databases. It is well known that when we ignore the required frequency, the closed itemsets are exactly intents of formal concepts in Formal Concept Analysis (FCA). We describe LCM in terms of FCA and show that LCM is basically the Close-by-One algorithm with multiple speed-up features for processing sparse data. We analyze the speed-up features and compare them with those of similar FCA algorithms, like FCbO and algorithms from the In-Close family.


title: Passive RIS vs.Hybrid RIS: A Comparative Study on Channel Estimation

abstract: The reconfigurable intelligent surface (RIS) plays an important role in maintaining the connectivity in millimeter wave (mmWave) MIMO systems when the direct channel between the transceivers is blocked. However, it is difficult to acquire the channel state information (CSI), which is essential for the design of RIS phase control matrix and beamforming vectors at the transceivers. In this paper, we compare the channel estimation (CE) performance and achieved spectral efficiency (SE) of the purely passive and hybrid RIS architectures. CE is done via atomic norm minimization (ANM). For the purely passive RIS, we follow a two-stage procedure to sequentially estimate the channel parameters, while for the hybrid RIS we estimate the individual channels at the RIS based on the observations from active RIS elements assuming alternating uplink and downlink training. The simulation results show that the purely passive RIS brings better CE and SE performance compared to the hybrid RIS under the same training overhead. We further consider different setups for the hybrid RIS and study the tradeoffs among them.


title: Effect of Anisotropic Collisions on Solar Scattering Polarization

abstract: Scattering of anisotropic radiation by atoms, ions or molecules is sufficient to generate linear polarization observable in stars and planets atmospheres, circumstellar environments, and in particular in the Sun's atmosphere. This kind of polarization is called scattering polarization (SP) or second solar spectrum (SSS) if it is formed near the limb of the solar photosphere. Generation of linear SP can typically be reached more easily than circular SP. Interestingly, the later is often absent in observations and theories. Intrigued by this, we propose to demonstrate how circular SP can be created by anisotropic collisions if a magnetic field is present. We also demonstrate how anisotropic collisions can result in the creation of circular SP if the radiation field is anisotropic. We show that under certain conditions, linear SP creation is accompanied by the emergence of circular SP which can be useful for diagnostics of solar and astrophysical plasmas. We treat an example and calculate the density matrix elements of tensorial order $k\!=\!1$ which are directly associated with the presence of circular SP. This work should encourage theoretical and observational research to be increasingly oriented towards circular SP profiles in addition to linear SP in order to improve our analysis tools of astrophysical and solar observations.


title: Influence of the ice structure on the soft UV photochemistry of PAHs embedded in solid water

abstract: The UV photoreactivity of polycyclic aromatic hydrocarbons (PAHs) in porous amorphous solid water has long been known to form both oxygenated photoproducts and photofragments. The aim of this study was to examine the influence of the ice structure upon reactivity under soft UV irradiation conditions. Mixtures of PAHs with amorphous solid water (porous and compact) and crystalline (cubic and hexagonal) ices were prepared in a high vacuum chamber and irradiated using a mercury lamp for up to 2.5 hours. The results show that the production of oxygenated PAHs is efficient only in amorphous water ice, while fragmentation can occur in both amorphous and crystalline ices. We conclude that the reactivity is driven by PAH-water interactions in favourable geometries, notably where dangling bonds are available at the surface of pores. These results suggest that the formation of oxygenated PAH molecules is most likely to occur in interstellar environments with porous (or compact) amorphous solid water and that this reactivity could considerably influence the inventory of aromatics in meteorites.


title: Small Private Online Judge: A New Tool for Empirical Education Research

abstract: This paper puts forward the concept of Small Private Online Judge (SPOJ). Compared with Massive Open Online Judge (MOOJ), SPOJ has advantages in structured data acquisition of students' virtual behavior for its specific function and tight coupling with the classroom. SPOJ-based empirical education research can be conducted within "Acquisition-Analysis-Application" (3A) Framework. The case study of a SPOJ program clarifies the standard pattern of SPOJ-based 3A research and highlights the emergence of education-intelligence concept. The challenges of SPOJ-based empirical education research and implications of SPOJ are also discussed.


title: Understanding Twitter Engagement with a Click-Through Rate-based Method

abstract: This paper presents the POLINKS solution to the RecSys Challenge 2020 that ranked 6th in the final leaderboard. We analyze the performance of our solution that utilizes the click-through rate value to address the challenge task, we compare it with a gradient boosting model, and we report the quality indicators utilized for computing the final leaderboard.


title: On the Problem of Underranking in Group-Fair Ranking

abstract: Search and recommendation systems, such as search engines, recruiting tools, online marketplaces, news, and social media, output ranked lists of content, products, and sometimes, people. Credit ratings, standardized tests, risk assessments output only a score, but are also used implicitly for ranking. Bias in such ranking systems, especially among the top ranks, can worsen social and economic inequalities, polarize opinions, and reinforce stereotypes. On the other hand, a bias correction for minority groups can cause more harm if perceived as favoring group-fair outcomes over meritocracy. In this paper, we formulate the problem of underranking in group-fair rankings, which was not addressed in previous work. Most group-fair ranking algorithms post-process a given ranking and output a group-fair ranking. We define underranking based on how close the group-fair rank of each item is to its original rank, and prove a lower bound on the trade-off achievable for simultaneous underranking and group fairness in ranking. We give a fair ranking algorithm that takes any given ranking and outputs another ranking with simultaneous underranking and group fairness guarantees comparable to the lower bound we prove. Our algorithm works with group fairness constraints for any number of groups. Our experimental results confirm the theoretical trade-off between underranking and group fairness, and also show that our algorithm achieves the best of both when compared to the state-of-the-art baselines.


title: Learning Representations of Hierarchical Slates in Collaborative Filtering

abstract: We are interested in building collaborative filtering models for recommendation systems where users interact with slates instead of individual items. These slates can be hierarchical in nature. The central idea of our approach is to learn low dimensional embeddings of these slates. We present a novel way to learn these embeddings by making use of the (unknown) statistics of the underlying distribution generating the hierarchical data. Our representation learning algorithm can be viewed as a simple composition rule that can be applied recursively in a bottom-up fashion to represent arbitrarily complex hierarchical structures in terms of the representations of its constituent components. We demonstrate our ideas on two real world recommendation systems datasets including the one used for the RecSys 2019 challenge. For that dataset, we improve upon the performance achieved by the winning team's model by incorporating embeddings as features generated by our approach in their solution.


title: Using satellite imagery to understand and promote sustainable development

abstract: Accurate and comprehensive measurements of a range of sustainable development outcomes are fundamental inputs into both research and policy. We synthesize the growing literature that uses satellite imagery to understand these outcomes, with a focus on approaches that combine imagery with machine learning. We quantify the paucity of ground data on key human-related outcomes and the growing abundance and resolution (spatial, temporal, and spectral) of satellite imagery. We then review recent machine learning approaches to model-building in the context of scarce and noisy training data, highlighting how this noise often leads to incorrect assessment of models' predictive performance. We quantify recent model performance across multiple sustainable development domains, discuss research and policy applications, explore constraints to future progress, and highlight key research directions for the field.


title: Review the Enterprise Resource Planning in Moroccan Healthcare Organizations

abstract: The Hospital Information Systems (HIS) in Morocco take a central place in the process of patient care. An approach is made to analyze the current situation of the HIS within the institutions in order to bring an integral and generic vision, allowing the judicious articulation of the business and IT layers. Currently, the Enterprise Resource Planning (ERP) implemented remains a system consisting of several applications dedicated to specific areas. These systems have become an indispensable element within any hospital. The goal of our study is to discover how the ERP has been used in Moroccan healthcare sector and how these software should be implemented and used to improve healthcare services.


title: A novel idea: calculating anisotropic turbulence only by Kolmogorov structure constant C$_n^2$ and power law $\alpha$

abstract: As stated in the present research, the anisotropic non-Kolmogorov turbulence model is more in line with the actual turbulence. However, anisotropic factor is vital for the accuracy of calculations, and measuring it precisely is a challenging task. In this paper, utilizing three modeling approaches, we derive four different equivalence formulas between the anisotropic non-Kolmogorov and the Kolmogorov structure constants, and apply them to the extant anisotropic results. It is found that the anisotropic factor is eliminated and the anisotropic turbulence can be predicted only by Kolmogorov structure constant and power law.


title: Kink Oscillations in Solar Coronal Loops with Elliptical Cross-Sections. I. the linear regime

abstract: The cross sections of solar coronal loops are suggested to be rarely circular. We examine linear kink oscillations in straight, density-enhanced, magnetic cylinders with elliptical cross-sections by solving the three-dimensional magnetohydrodynamic equations from an initial-value-problem perspective. Motivated by relevant eigen-mode analyses, we distinguish between two independent polarizations, one along the major axis (the M-modes) and the other along the minor one (the m-modes). We find that, as happens for coronal loops with circular cross-sections, the apparent damping of the transverse displacement of the loop axis is accompanied by the accumulation of transverse Alfv\'enic motions and the consequent development of small-scales therein, suggesting the robustness of the concepts of resonant absorption and phase-mixing. In addition, two stages can in general be told apart in the temporal evolution of the loop displacement; a Gaussian time dependence precedes an exponential one. For the two examined density ratios between loops and their surroundings, the periods of the M-modes (m-modes) tend to increase (decrease) with the major-to-minor-half-axis ratio, and the damping times in the exponential stage for the M-modes tend to exceed their m-mode counterparts. This is true for the two transverse profiles we examine. However, the relative magnitudes of the damping times in the exponential stage for different polarizations depend on the specification of the transverse profile and/or the density contrast. The applications of our numerical findings are discussed in the context of coronal seismology.


title: InstantEmbedding: Efficient Local Node Representations

abstract: In this paper, we introduce InstantEmbedding, an efficient method for generating single-node representations using local PageRank computations. We theoretically prove that our approach produces globally consistent representations in sublinear time. We demonstrate this empirically by conducting extensive experiments on real-world datasets with over a billion edges. Our experiments confirm that InstantEmbedding requires drastically less computation time (over 9,000 times faster) and less memory (by over 8,000 times) to produce a single node's embedding than traditional methods including DeepWalk, node2vec, VERSE, and FastRP. We also show that our method produces high quality representations, demonstrating results that meet or exceed the state of the art for unsupervised representation learning on tasks like node classification and link prediction.


title: Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression

abstract: In this work, we present a novel approach for simultaneous knowledge transfer and model compression called Weight Squeezing. With this method, we perform knowledge transfer from a teacher model by learning the mapping from its weights to smaller student model weights. We applied Weight Squeezing to a pre-trained text classification model based on BERT-Medium model and compared our method to various other knowledge transfer and model compression methods on GLUE multitask benchmark. We observed that our approach produces better results while being significantly faster than other methods for training student models. We also proposed a variant of Weight Squeezing called Gated Weight Squeezing, for which we combined fine-tuning of BERT-Medium model and learning mapping from BERT-Base weights. We showed that fine-tuning with Gated Weight Squeezing outperforms plain fine-tuning of BERT-Medium model as well as other concurrent SoTA approaches while much being easier to implement.


title: Projection Predictive Inference for Generalized Linear and Additive Multilevel Models

abstract: Projection predictive inference is a decision theoretic Bayesian approach that decouples model estimation from decision making. Given a reference model previously built including all variables present in the data, projection predictive inference projects its posterior onto a constrained space of a subset of variables. Variable selection is then performed by sequentially adding relevant variables until predictive performance is satisfactory. Previously, projection predictive inference has been demonstrated only for generalized linear models (GLMs) and Gaussian processes (GPs) where it showed superior performance to competing variable selection procedures. In this work, we extend projection predictive inference to support variable and structure selection for generalized linear multilevel models (GLMMs) and generalized additive multilevel models (GAMMs). Our simulative and real-word experiments demonstrate that our method can drastically reduce the model complexity required to reach reference predictive performance and achieve good frequency properties.


title: A Pathologist-Annotated Dataset for Validating Artificial Intelligence: A Project Description and Pilot Study

abstract: Purpose: In this work, we present a collaboration to create a validation dataset of pathologist annotations for algorithms that process whole slide images (WSIs). We focus on data collection and evaluation of algorithm performance in the context of estimating the density of stromal tumor infiltrating lymphocytes (sTILs) in breast cancer. Methods: We digitized 64 glass slides of hematoxylin- and eosin-stained ductal carcinoma core biopsies prepared at a single clinical site. We created training materials and workflows to crowdsource pathologist image annotations on two modes: an optical microscope and two digital platforms. The workflows collect the ROI type, a decision on whether the ROI is appropriate for estimating the density of sTILs, and if appropriate, the sTIL density value for that ROI. Results: The pilot study yielded an abundant number of cases with nominal sTIL infiltration. Furthermore, we found that the sTIL densities are correlated within a case, and there is notable pathologist variability. Consequently, we outline plans to improve our ROI and case sampling methods. We also outline statistical methods to account for ROI correlations within a case and pathologist variability when validating an algorithm. Conclusion: We have built workflows for efficient data collection and tested them in a pilot study. As we prepare for pivotal studies, we will consider what it will take for the dataset to be fit for a regulatory purpose: study size, patient population, and pathologist training and qualifications. To this end, we will elicit feedback from the FDA via the Medical Device Development Tool program and from the broader digital pathology and AI community. Ultimately, we intend to share the dataset, statistical methods, and lessons learned.


title: Representations of shifted quantum affine algebras

abstract: We develop the representation theory of shifted quantum affine algebras $\mathcal{U}_q^\mu(\hat{\mathfrak{g}})$ and of their truncations which appeared in the study of quantized K-theoretic Coulomb branches of 3d $N = 4$ SUSY quiver gauge theories. Our approach is based on novel techniques, which are new in the cases of shifted Yangians or ordinary quantum affine algebras as well : realization in terms of asymptotical subalgebras of the quantum affine algebra $\mathcal{U}_q(\hat{\mathfrak{g}})$, induction and restriction functors to the category $\mathcal{O}$ of representations of the Borel subalgebra $\mathcal{U}_q(\hat{\mathfrak{b}})$ of $\mathcal{U}_q(\hat{\mathfrak{g}})$, relations between truncations and Baxter polynomiality in quantum integrable models, parametrization of simple modules via Langlands dual interpolation. We first introduce the category $\mathcal{O}_\mu$ of representations of $\mathcal{U}_q^\mu(\hat{\mathfrak{g}})$ and we classify its simple objects. Then we establish the existence of fusion products and we get a ring structure on the sum of the Grothendieck groups $K_0(\mathcal{O}_\mu)$. We classify simple finite-dimensional representations of $\mathcal{U}_q^\mu(\hat{\mathfrak{g}})$ and we obtain a cluster algebra structure on the Grothendieck ring of finite-dimensional representations. We prove a truncation has only a finite number of simple representations and we introduce a related partial ordering on simple modules. Eventually, we state a conjecture on the parametrization of simple modules of a non simply-laced truncation in terms of the Langlands dual Lie algebra. We have several evidences, including a general result for simple finite-dimensional representations.


title: Measuring the originality of intellectual property assets based on machine learning outputs

abstract: Originality criteria are frequently used to compare assets and, in particular, to assess the validity of intellectual property (IP) rights such as copyright and design rights. In this work, the originality of an asset is formulated as a function of the distances between this asset and its comparands, using concepts of maximum entropy and surprisal analysis. Namely, the originality function is defined according to the surprisal associated with a given asset. Creative assets can be justifiably compared to particles that repel each other via an electrostatic-like pair potential. This allows a very simple, suitably bounded formula to be obtained, in which the originality of an asset writes as the ratio of a reference energy to an interaction energy imparted to that asset. In particular, the originality of an asset can be expressed as a ratio of two average distances, i.e., the harmonic mean of the distances from this asset to its comparands divided by the harmonic mean of the distances between the sole comparands. Accordingly, the originality of objects such as IP assets can be simply estimated based on distances computed thanks to unsupervised machine learning techniques or other distance computation algorithms. Application is made to various types of assets, including emojis, typeface designs, paintings, and novel titles.


title: On Minor Left Prime Factorization Problem for Multivariate Polynomial Matrices

abstract: A new necessary and sufficient condition for the existence of minor left prime factorizations of multivariate polynomial matrices without full row rank is presented. The key idea is to establish a relationship between a matrix and its full row rank submatrix. Based on the new result, we propose an algorithm for factorizing matrices and have implemented it on the computer algebra system Maple. Two examples are given to illustrate the effectiveness of the algorithm, and experimental data shows that the algorithm is efficient.


title: Estimations of means and variances in a Markov linear model

abstract: Multivariate regression models and ANOVA are probably the most frequently applied methods of all statistical analyses. We study the case where the predictors are qualitative variables, and the response variable is quantitative. In this case, we propose an alternative to the classic approaches that does not assume homoscedasticity but assumes that a Markov chain can describe the covariates' correlations. This approach transforms the dependent covariates using a change of measure to independent covariates. The transformed estimates allow a pairwise comparison of the mean and variance of the contribution of different values of the covariates. We show that under standard moment conditions, the estimators are asymptotically normally distributed. We test our method with data from simulations and apply it to several classic data sets.


title: Analytical parameter estimation of the SIR epidemic model. Applications to the COVID-19 pandemic

abstract: The dramatic outbreak of the coronavirus disease 2019 (COVID-19) pandemics and its ongoing progression boosted the scientific community's interest in epidemic modeling and forecasting. The SIR (Susceptible-Infected-Removed) model is a simple mathematical model of epidemic outbreaks, yet for decades it evaded the efforts of the community to derive an explicit solution. The present work demonstrates that this is a non-trivial task. Notably, it is proven that the explicit solution of the model requires the introduction of a new transcendental special function, related to the Wright's Omega function. The present manuscript reports new analytical results and numerical routines suitable for parametric estimation of the SIR model. The manuscript introduces iterative algorithms approximating the incidence variable, which allows for estimation of the model parameters from the numbers of observed cases. The numerical approach is exemplified with data from the European Centre for Disease Prevention and Control (ECDC) for several European countries in the period Jan 2020 -- Jun 2020.


title: A Mathematical Comparison of the Schwarzschild and Kerr Metrics

abstract: A few physicists have recently constructed the generating compatibility conditions (CC) of the Killing operator for the Minkowski (M) , Schwarzschild (S) and Kerr (K) metrics. They discovered second order CC, well known for M, but also third order CC for S and K. In a recent paper, we have studied the cases of M and S, without using specific technical tools such as Teukolski scalars or Killing-Yano tensors. However, even if S($m$) and K($m,a$) are depending on constant parameters in such a way that S $\rightarrow $ M when $m \rightarrow 0$ and K $\rightarrow$ S when $ a \rightarrow 0$, the CC of S do not provide the CC of M when $m \rightarrow 0$ while the CC of K do not provide the CC of S when $a\rightarrow 0$. In this paper, using tricky motivating examples of operators with constant or variable parameters, we explain why the CC are depending on the choice of the parameters. In particular, the only purely intrinsic objects that can be defined, namely the extension modules, may change drastically. As the algebroid bracket is compatible with the {\it prolongation/projection} (PP) procedure, we provide for the first time all the CC for K in an intrinsic way, showing that they only depend on the underlying Killing algebras and that the role played by the Spencer operator is crucial. We get K$<$S$<$M with $2 < 4 < 10$ for the Killing algebras and explain why the formal search of the CC for M, S or K are strikingly different, even though each Spencer sequence is isomorphic to the tensor product of the Poincar\'{e} sequence for the exterior derivative by the corresponding Lie algebra.


title: Fast meningioma segmentation in T1-weighted MRI volumes using a lightweight 3D deep learning architecture

abstract: Automatic and consistent meningioma segmentation in T1-weighted MRI volumes and corresponding volumetric assessment is of use for diagnosis, treatment planning, and tumor growth evaluation. In this paper, we optimized the segmentation and processing speed performances using a large number of both surgically treated meningiomas and untreated meningiomas followed at the outpatient clinic. We studied two different 3D neural network architectures: (i) a simple encoder-decoder similar to a 3D U-Net, and (ii) a lightweight multi-scale architecture (PLS-Net). In addition, we studied the impact of different training schemes. For the validation studies, we used 698 T1-weighted MR volumes from St. Olav University Hospital, Trondheim, Norway. The models were evaluated in terms of detection accuracy, segmentation accuracy and training/inference speed. While both architectures reached a similar Dice score of 70% on average, the PLS-Net was more accurate with an F1-score of up to 88%. The highest accuracy was achieved for the largest meningiomas. Speed-wise, the PLS-Net architecture tended to converge in about 50 hours while 130 hours were necessary for U-Net. Inference with PLS-Net takes less than a second on GPU and about 15 seconds on CPU. Overall, with the use of mixed precision training, it was possible to train competitive segmentation models in a relatively short amount of time using the lightweight PLS-Net architecture. In the future, the focus should be brought toward the segmentation of small meningiomas (less than 2ml) to improve clinical relevance for automatic and early diagnosis as well as speed of growth estimates.


title: Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search

abstract: Despite transformers' impressive accuracy, their computational cost is often prohibitive to use with limited computational resources. Most previous approaches to improve inference efficiency require a separate model for each possible computational budget. In this paper, we extend PoWER-BERT (Goyal et al., 2020) and propose Length-Adaptive Transformer that can be used for various inference scenarios after one-shot training. We train a transformer with LengthDrop, a structural variant of dropout, which stochastically determines a sequence length at each layer. We then conduct a multi-objective evolutionary search to find a length configuration that maximizes the accuracy and minimizes the efficiency metric under any given computational budget. Additionally, we significantly extend the applicability of PoWER-BERT beyond sequence-level classification into token-level classification with Drop-and-Restore process that drops word-vectors temporarily in intermediate layers and restores at the last layer if necessary. We empirically verify the utility of the proposed approach by demonstrating the superior accuracy-efficiency trade-off under various setups, including span-based question answering and text classification. Code is available at https://github.com/clovaai/length-adaptive-transformer.