title: The bending energy of a semi-flexible polymer chain and the polygons of the polymer chain

abstract: We consider random walk model of a semi-flexible polymer chain on a square and a cubic lattice to enumerate conformations of the polymer chain in two and three dimensions, respectively. The bending energy of the chain is assumed as the key factor which controls the minimum average length of the chain in between two successive bends in the chain; and the average length of the chains per unit bend is defined as the persistence length of the polymer chain. It has been found that the minimum energy required to bend the chain is expressed in the form of simple relation which includes space dimensionality, step fugacity and persistence length.


title: A New Class of Irreducible Polynomials

abstract: In this article, we propose a few sufficient conditions on polynomials having integer coefficients all of whose zeros lie outside a closed disc centered at the origin in the complex plane and deduce the irreducibility over the ring of integers.


title: Effective field theory and scalar extensions of the top quark sector

abstract: Effective field theory (EFT) approaches are widely used at the LHC, such that it is important to study their validity, and ease of matching to specific new physics models. In this paper, we consider an extension of the SM in which a top quark couples to a new heavy scalar. We find the dimension six operators generated by this theory at low energy, and match the EFT to the full theory up to NLO precision in the simplified model coupling. We then examine the range of validity of the EFT description in top pair production, finding excellent validity even if the scalar mass is only slightly above LHC energies, provided NLO corrections are included. In the absence of the latter, the LO EFT overestimates kinematic distributions, such that over-optimistic constraints on BSM contributions are obtained. We next examine the constraints on the EFT and full models that are expected to be obtained from both top pair and four top production at the LHC, finding for low scalar masses that both processes show similar exclusion power. However, for larger masses, estimated LHC uncertainties push constraints into the non-perturbative regime, where the full model is difficult to analyse, and thus not perturbatively matchable to the EFT. This highlights the necessity to improve uncertainties of SM hypotheses in top final states.


title: Improved bounds for the Kakeya maximal conjecture in higher dimensions

abstract: We adapt Guth's polynomial partitioning argument for the Fourier restriction problem to the context of the Kakeya problem. By writing out the induction argument as a recursive algorithm, additional multiscale geometric information is made available. To take advantage of this, we prove that direction-separated tubes satisfy a multiscale version of the polynomial Wolff axioms. Altogether, this yields improved bounds for the Kakeya maximal conjecture in $\mathbb{R}^n$ with $n=5$ or $n\ge 7$ and improved bounds for the Kakeya set conjecture for an infinite sequence of dimensions.


title: Normal Forms for Manifolds of Normally Hyperbolic Singularities and Asymptotic Properties of Nearby Transitions

abstract: This paper contains theory on two related topics relevant to manifolds of normally hyperbolic singularities. First, theorems on the formal and $ C^k $ normal forms for these objects are proved. Then, the theorems are applied to give asymptotic properties of the transition map between sections transverse to the centre-stable and centre-unstable manifolds of some normally hyperbolic manifolds. A method is given for explicitly computing these so called Dulac maps. The Dulac map is revealed to have similar asymptotic structures as in the case of a saddle singularity in the plane.


title: Singer difference sets and the projective norm graph

abstract: We demonstrate a close connection between the classic planar Singer difference sets and certain norm equation systems arising from projective norm graphs. This, on the one hand leads to a novel description of planar Singer difference sets as a subset $\mathcal{H}$ of $\mathcal{N}$, the group of elements of norm 1 in the field extension $\mathbb{F}_{q^3}/\mathbb{F}_q$. $\mathcal{H}$ is given as the solution set of a simple polynomial equation, and we obtain an explicit formula expressing each non-identity element of $\mathcal{N}$ as a product $B\cdot C^{-1}$ with $B, C\in \mathcal{H}$. The description and the definitions naturally carry over to the nonplanar and the infinite setting. On the other hand, relying heavily on the difference set properties, we also complete the proof that the projective norm graph $\text{NG}(q,4)$ does contain the complete bipartite graph $K_{4,6}$ for every prime power $q \geq 5$. This complements the property, known for more than two decades, that projective norm graphs do not contain $K_{4,7}$ (and hence provide tight lower bounds for the Tur\'an number $ex(n,K_{4,7})$).


title: Equivalence of Gibbons-Werner method to geodesics method in the study of gravitational lensing

abstract: The Gibbons-Werner method where the Gauss-Bonnet theorem is applied to study the gravitational deflection angle has received much attention recently. In this paper, we study the equivalence of the Gibbons-Werner method to the standard geodesics method, and it is shown that the geodesics method can be derived with the Gibbons-Werner method, for asymptotically flat case. In the geodesics method, the gravitational deflection angle of particle depends entirely on the geodesic curvature of the particle ray in the Euclidean space. The gravitational deflection of light in Kerr-Newman spacetime is calculated by different technologies under the Gibbons-Werner framework, as an intuitive example to show the equivalence.


title: FastPose: Towards Real-time Pose Estimation and Tracking via Scale-normalized Multi-task Networks

abstract: Both accuracy and efficiency are significant for pose estimation and tracking in videos. State-of-the-art performance is dominated by two-stages top-down methods. Despite the leading results, these methods are impractical for real-world applications due to their separated architectures and complicated calculation. This paper addresses the task of articulated multi-person pose estimation and tracking towards real-time speed. An end-to-end multi-task network (MTN) is designed to perform human detection, pose estimation, and person re-identification (Re-ID) tasks simultaneously. To alleviate the performance bottleneck caused by scale variation problem, a paradigm which exploits scale-normalized image and feature pyramids (SIFP) is proposed to boost both performance and speed. Given the results of MTN, we adopt an occlusion-aware Re-ID feature strategy in the pose tracking module, where pose information is utilized to infer the occlusion state to make better use of Re-ID feature. In experiments, we demonstrate that the pose estimation and tracking performance improves steadily utilizing SIFP through different backbones. Using ResNet-18 and ResNet-50 as backbones, the overall pose tracking framework achieves competitive performance with 29.4 FPS and 12.2 FPS, respectively. Additionally, occlusion-aware Re-ID feature decreases the identification switches by 37% in the pose tracking process.


title: On the $p$-adic properties of Stirling numbers of the first kind

abstract: Let $n, k$ and $a$ be positive integers. The Stirling numbers of the first kind, denoted by $s(n,k)$, count the number of permutations of $n$ elements with $k$ disjoint cycles. Let $p$ be a prime. In recent years, Lengyel, Komatsu and Young, Leonetti and Sanna, Adelberg, Hong and Qiu made some progress in the study of the $p$-adic valuations of $s(n,k)$. In this paper, by using Washington's congruence on the generalized harmonic number and the $n$-th Bernoulli number $B_n$ and the properties of $m$-th Stirling numbers of the first kind obtained recently by the authors, we arrive at an exact expression or a lower bound of $v_p(s(ap, k))$ with $a$ and $k$ being integers such that $1\le a\le p-1$ and $1\le k\le ap$. This infers that for any regular prime $p\ge 7$ and for arbitrary integers $a$ and $k$ with $5\le a\le p-1$ and $a-2\le k\le ap-1$, one has $v_p(H(ap-1,k))<-\frac{\log{(ap-1)}}{2\log p}$ with $H(ap-1, k)$ being the $k$-th elementary symmetric function of $1, \frac{1}{2}, ..., \frac{1}{ap-1}$. This gives a partial support to a conjecture of Leonetti and Sanna raised in 2017. We also present results on $v_p(s(ap^n,ap^n-k))$ from which one can derive that under certain condition, for any prime $p\ge 5$, any odd number $k\ge 3$ and any sufficiently large integer $n$, if $(a,p)=1$, then $v_p(s(ap^{n+1},ap^{n+1}-))=v_p(s(ap^n,ap^n-k))+2$. It confirms partially Lengyel's conjecture proposed in 2015.


title: Rigidity of Bott-Samelson-Demazure-Hansen variety for $F_4$ and $G_2$

abstract: Let $G$ be a simple algebraic group of adjoint type over $\mathbb{C},$ whose root system is of type $F_{4}.$ Let $T$ be a maximal torus of $G$ and $B$ be a Borel subgroup of $G$ containing $T.$ Let $w$ be an element of Weyl group $W$ and $X(w)$ be the Schubert variety in the flag variety $G/B$ corresponding to $w.$ Let $Z(w, \underline{i})$ be the Bott-Samelson-Demazure-Hansen variety (the desingularization of $X(w)$) corresponding to a reduced expression $\underline{i}$ of $w.$ In this article, we study the cohomology modules of the tangent bundle on $Z(w_{0}, \underline{i}),$ where $w_{0}$ is the longest element of the Weyl group $W.$ We describe all the reduced expressions of $w_{0}$ in terms of a Coxeter element such that $Z(w_{0}, \underline{i})$ is rigid (see Theorem 8.1). Further, if $G$ is of type $G_{2},$ there is no reduced expression $\underline{i}$ of $w_{0}$ for which $Z(w_{0}, \underline{i})$ is rigid (see Theorem 8.2).


title: Two-stage Federated Phenotyping and Patient Representation Learning

abstract: A large percentage of medical information is in unstructured text format in electronic medical record systems. Manual extraction of information from clinical notes is extremely time consuming. Natural language processing has been widely used in recent years for automatic information extraction from medical texts. However, algorithms trained on data from a single healthcare provider are not generalizable and error-prone due to the heterogeneity and uniqueness of medical documents. We develop a two-stage federated natural language processing method that enables utilization of clinical notes from different hospitals or clinics without moving the data, and demonstrate its performance using obesity and comorbities phenotyping as medical task. This approach not only improves the quality of a specific clinical task but also facilitates knowledge progression in the whole healthcare system, which is an essential part of learning health system. To the best of our knowledge, this is the first application of federated machine learning in clinical NLP.


title: Clustered Variants of Haj\'os' Conjecture

abstract: Haj\'os conjectured that every graph containing no subdivision of the complete graph $K_{s+1}$ is properly $s$-colorable. This conjecture was disproved by Catlin. Indeed, the maximum chromatic number of such graphs is $\Omega(s^2/\log s)$. We prove that $O(s)$ colors are enough for a weakening of this conjecture that only requires every monochromatic component to have bounded size (so-called clustered coloring). Our approach leads to more results. Say that a graph is an almost $(\leq 1)$-subdivision of a graph $H$ if it can be obtained from $H$ by subdividing edges, where at most one edge is subdivided more than once. Note that every graph with no $H$-subdivision does not contain an almost $(\leq 1)$-subdivision of $H$. We prove the following (where $s \geq 2$): (1) Graphs of bounded treewidth and with no almost $(\leq 1)$-subdivision of $K_{s+1}$ are $s$-choosable with bounded clustering. (2) For every graph $H$, graphs with no $H$-minor and no almost $(\leq 1)$-subdivision of $K_{s+1}$ are $(s+1)$-colorable with bounded clustering. (3) For every graph $H$ of maximum degree at most $d$, graphs with no $H$-subdivision and no almost $(\leq 1)$-subdivision of $K_{s+1}$ are $\max\{s+3d-5,2\}$-colorable with bounded clustering. (4) For every graph $H$ of maximum degree $d$, graphs with no $K_{s,t}$ subgraph and no $H$-subdivision are $\max\{s+3d-4,2\}$-colorable with bounded clustering. (5) Graphs with no $K_{s+1}$-subdivision are $(4s-5)$-colorable with bounded clustering. The first result shows that the weakening of Haj\'{o}s' conjecture is true for graphs of bounded treewidth in a stronger sense; the final result is the first $O(s)$ bound on the clustered chromatic number of graphs with no $K_{s+1}$-subdivision.


title: On the divisor problem with congruence conditions

abstract: Let $d(n; r_1, q_1, r_2, q_2)$ be the number of factorization $n=n_1n_2$ satisfying $n_i\equiv r_i\pmod{q_i}$ ($i=1,2$) and $\Delta(x; r_1, q_1, r_2, q_2)$ be the error term of the summatory function of $d(n; r_1, q_1, r_2, q_2)$ with $x\geq (q_1q_2)^{1+\varepsilon}, 1\leq r_i\leq q_i$, and $(r_i, q_i)=1$ ($i=1, 2$). We study the power moments and sign changes of $\Delta(x; r_1, q_1, r_2, q_2)$, and prove that for a sufficiently large constant $C$, $\Delta(q_1q_2x; r_1, q_1, r_2, q_2)$ changes sign in the interval $[T,T+C\sqrt{T}]$ for any large $T$. Meanwhile, we show that for a small constant $c'$, there exist infinitely many subintervals of length $c'\sqrt{T}\log^{-7}T$ in $[T,2T]$ where $\pm \Delta(q_1q_2x; r_1, q_1, r_2, q_2)> c_5x^\frac{1}{4}$ always holds.


title: Deep Slice Interpolation via Marginal Super-Resolution, Fusion and Refinement

abstract: We propose a marginal super-resolution (MSR) approach based on 2D convolutional neural networks (CNNs) for interpolating an anisotropic brain magnetic resonance scan along the highly under-sampled direction, which is assumed to axial without loss of generality. Previous methods for slice interpolation only consider data from pairs of adjacent 2D slices. The possibility of fusing information from the direction orthogonal to the 2D slices remains unexplored. Our approach performs MSR in both sagittal and coronal directions, which provides an initial estimate for slice interpolation. The interpolated slices are then fused and refined in the axial direction for improved consistency. Since MSR consists of only 2D operations, it is more feasible in terms of GPU memory consumption and requires fewer training samples compared to 3D CNNs. Our experiments demonstrate that the proposed method outperforms traditional linear interpolation and baseline 2D/3D CNN-based approaches. We conclude by showcasing the method's practical utility in estimating brain volumes from under-sampled brain MR scans through semantic segmentation.


title: Diffusive Mobile MC with Absorbing Receivers: Stochastic Analysis and Applications

abstract: This paper presents a stochastic analysis of the time-variant channel impulse response (CIR) of a three dimensional diffusive mobile molecular communication (MC) system where the transmitter, the absorbing receiver, and the molecules can freely diffuse. In our analysis, we derive the mean, variance, probability density function (PDF), and cumulative distribution function (CDF) of the CIR. We also derive the PDF and CDF of the probability p that a released molecule is absorbed at the receiver during a given time period. The obtained analytical results are employed for the design of drug delivery and MC systems with imperfect channel state information. For the first application, we exploit the mean and variance of the CIR to optimize a controlled-release drug delivery system employing a mobile drug carrier. We evaluate the performance of the proposed release design based on the PDF and CDF of the CIR. We demonstrate significant savings in the amount of released drugs compared to a constant-release scheme and reveal the necessity of accounting for the drug-carrier's mobility to ensure reliable drug delivery. For the second application, we exploit the PDF of the distance between the mobile transceivers and the CDF of p to optimize three design parameters of an MC system employing on-off keying modulation and threshold detection. Specifically, we optimize the detection threshold at the receiver, the release profile at the transmitter, and the time duration of a bit frame. We show that the proposed optimal designs can significantly improve the system performance in terms of the bit error rate and the efficiency of molecule usage.


title: Learning Credible Deep Neural Networks with Rationale Regularization

abstract: Recent explainability related studies have shown that state-of-the-art DNNs do not always adopt correct evidences to make decisions. It not only hampers their generalization but also makes them less likely to be trusted by end-users. In pursuit of developing more credible DNNs, in this paper we propose CREX, which encourages DNN models to focus more on evidences that actually matter for the task at hand, and to avoid overfitting to data-dependent bias and artifacts. Specifically, CREX regularizes the training process of DNNs with rationales, i.e., a subset of features highlighted by domain experts as justifications for predictions, to enforce DNNs to generate local explanations that conform with expert rationales. Even when rationales are not available, CREX still could be useful by requiring the generated explanations to be sparse. Experimental results on two text classification datasets demonstrate the increased credibility of DNNs trained with CREX. Comprehensive analysis further shows that while CREX does not always improve prediction accuracy on the held-out test set, it significantly increases DNN accuracy on new and previously unseen data beyond test set, highlighting the advantage of the increased credibility.


title: SHREWD: Semantic Hierarchy-based Relational Embeddings for Weakly-supervised Deep Hashing

abstract: Using class labels to represent class similarity is a typical approach to training deep hashing systems for retrieval; samples from the same or different classes take binary 1 or 0 similarity values. This similarity does not model the full rich knowledge of semantic relations that may be present between data points. In this work we build upon the idea of using semantic hierarchies to form distance metrics between all available sample labels; for example cat to dog has a smaller distance than cat to guitar. We combine this type of semantic distance into a loss function to promote similar distances between the deep neural network embeddings. We also introduce an empirical Kullback-Leibler divergence loss term to promote binarization and uniformity of the embeddings. We test the resulting SHREWD method and demonstrate improvements in hierarchical retrieval scores using compact, binary hash codes instead of real valued ones, and show that in a weakly supervised hashing setting we are able to learn competitively without explicitly relying on class labels, but instead on similarities between labels.


title: A tale of two exponentiations in ${\cal N}=8$ supergravity

abstract: The structure of scattering amplitudes in supergravity theories continues to be of interest. Recently, the amplitude for $2\rightarrow 2$ scattering in ${\cal N}=8$ supergravity was presented at three-loop order for the first time. The result can be written in terms of an exponentiated one-loop contribution, modulo a remainder function which is free of infrared singularities, but contains leading terms in the high energy Regge limit. We explain the origin of these terms from a well-known, unitarity-restoring exponentiation of the high-energy gravitational $S$-matrix in impact-parameter space. Furthermore, we predict the existence of similar terms in the remainder function at all higher loop orders. Our results provide a non-trivial cross-check of the recent three-loop calculation, and a necessary consistency constraint for any future calculation at higher loops.


title: Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System

abstract: In real-world question-answering (QA) systems, ill-formed questions, such as wrong words, ill word order, and noisy expressions, are common and may prevent the QA systems from understanding and answering them accurately. In order to eliminate the effect of ill-formed questions, we approach the question refinement task and propose a unified model, QREFINE, to refine the ill-formed questions to well-formed question. The basic idea is to learn a Seq2Seq model to generate a new question from the original one. To improve the quality and retrieval performance of the generated questions, we make two major improvements: 1) To better encode the semantics of ill-formed questions, we enrich the representation of questions with character embedding and the recent proposed contextual word embedding such as BERT, besides the traditional context-free word embeddings; 2) To make it capable to generate desired questions, we train the model with deep reinforcement learning techniques that considers an appropriate wording of the generation as an immediate reward and the correlation between generated question and answer as time-delayed long-term rewards. Experimental results on real-world datasets show that the proposed QREFINE method can generate refined questions with more readability but fewer mistakes than the original questions provided by users. Moreover, the refined questions also significantly improve the accuracy of answer retrieval.


title: Rigidity of Bott-Samelson-Demazure-Hansen variety for $PSO(2n+1, \mathbb{C})$

abstract: Let $G=PSO(2n+1, \mathbb{C}) (n \ge 3)$ and $B$ be the Borel subgroup of $G$ containing maximal torus $T$ of $G.$ Let $w$ be an element of Weyl group $W$ and $X(w)$ be the Schubert variety in the flag variety $G/B$ corresponding to $w.$ Let $Z(w, \underline{i})$ be the Bott-Samelson-Demazure-Hansen variety (the desingularization of $X(w)$) corresponding to a reduced expression $\underline{i}$ of $w.$ In this article, we study the cohomology modules of the tangent bundle on $Z(w_{0}, \underline{i}),$ where $w_{0}$ is the longest element of the Weyl group $W.$ We describe all the reduced expressions of $w_{0}$ in terms of a Coxeter element such that all the higher cohomology modules of the tangent bundle on $Z(w_{0}, \underline{i})$ vanish (see Theorem \ref{theorem 8.1}).


title: Coupled Self-Consistent RPA Equations for Even and Odd Particle Numbers. Tests with Solvable Models

abstract: Coupled equations for even and odd particle number correlation functions are set up via the equation of motion method. For the even particle number case this leads to self-consistent RPA (SCRPA) equations already known from the literature. From the equations of the odd particle number case the single particle occupation probabilities are obtained in a self-consistent way. This is the essential new procedure of this work. Both, even and odd particle number cases are based on the same correlated vacuum and, thus, are coupled equations. Applications to the Lipkin model and the 1D Hubbard model give very good results.


title: Efficient Estimation of Pathwise Differentiable Target Parameters with the Undersmoothed Highly Adaptive Lasso

abstract: We consider estimation of a functional parameter of a realistically modeled data distribution based on observing independent and identically distributed observations. We define an $m$-th order Spline Highly Adaptive Lasso Minimum Loss Estimator (Spline HAL-MLE) of a functional parameter that is defined by minimizing the empirical risk function over an $m$-th order smoothness class of functions. We show that this $m$-th order smoothness class consists of all functions that can be represented as an infinitesimal linear combination of tensor products of $\leq m$-th order spline-basis functions, and involves assuming $m$-derivatives in each coordinate. By selecting $m$ with cross-validation we obtain a Spline-HAL-MLE that is able to adapt to the underlying unknown smoothness of the true function, while guaranteeing a rate of convergence faster than $n^{-1/4}$, as long as the true function is cadlag (right-continuous with left-hand limits) and has finite sectional variation norm. The $m=0$-smoothness class consists of all cadlag functions with finite sectional variation norm and corresponds with the original HAL-MLE defined in van der Laan (2015). In this article we establish that this Spline-HAL-MLE yields an asymptotically efficient estimator of any smooth feature of the functional parameter under an easily verifiable global undersmoothing condition. A sufficient condition for the latter condition is that the minimum of the empirical mean of the selected basis functions is smaller than a constant times $n^{-1/2}$, which is not parameter specific and enforces the selection of the $L_1$-norm in the lasso to be large enough to include sparsely supported basis. We demonstrate our general result for the $m=0$-HAL-MLE of the average treatment effect and of the integral of the square of the data density. We also present simulations for these two examples confirming the theory.


title: FCNHSMRA_HRS: Improve the performance of the movie hybrid recommender system using resource allocation approach

abstract: Recommender systems are systems that are capable of offering the most suitable services and products to users. Through specific methods and techniques, the recommender systems try to identify the most appropriate items, such as types of information and goods and propose the closest to the user's tastes. Collaborative filtering offering active user suggestions based on the rating of a set of users is one of the simplest and most comprehensible and successful models for finding people in the same tastes in the recommender systems. In this model, with increasing number of users and movie, the system is subject to scalability. On the other hand, it is important to improve the performance of the system when there is little information available on the ratings. In this paper, a movie hybrid recommender system based on FNHSM_HRS structure using resource allocation approach called FCNHSMRA_HRS is presented. The FNHSM_HRS structure was based on the heuristic similarity measure (NHSM), along with fuzzy clustering. Using the fuzzy clustering method in the proposed system improves the scalability problem and increases the accuracy of system suggestions. The proposed systems is based on collaborative filtering and, by using the heuristic similarity measure and applying the resource allocation approach, improves the performance, accuracy and precision of the system. The experimental results using MAE, Accuracy, Precision and Recall metrics based on MovieLens dataset show that the performance of the system is improved and the accuracy of recommendations in comparison of FNHSM_HRS and collaborative filtering methods that use other similarity measures for finding similarity, is increased


title: CUPCF: Combining Users Preferences in Collaborative Filtering for Better Recommendation

abstract: How to make the best decision between the opinions and tastes of your friends and acquaintances? Therefore, recommender systems are used to solve such issues. The common algorithms use a similarity measure to predict active users' tastes over a particular item. According to the cold start and data sparsity problems, these systems cannot predict and suggest particular items to users. In this paper, we introduce a new recommender system is able to find user preferences and based on it, provides the recommendations. Our proposed system called CUPCF is a combination of two similarity measures in collaborative filtering to solve the data sparsity problem and poor prediction (high prediction error rate) problems for better recommendation. The experimental results based on MovieLens dataset show that, combined with the preferences of the user's nearest neighbor, the proposed system error rate compared to a number of state-of-the-art recommendation methods improved. Furthermore, the results indicate the efficiency of CUPCF. The maximum improved error rate of the system is 15.5% and the maximum values of Accuracy, Precision and Recall of CUPCF are 0.91402, 0.91436 and 0.9974 respectively.


title: A Gordian Pair of Links

abstract: We construct a pair of isotopic link configurations that are not thick isotopic while preserving total length.


title: GraphSW: a training protocol based on stage-wise training for GNN-based Recommender Model

abstract: Recently, researchers utilize Knowledge Graph (KG) as side information in recommendation system to address cold start and sparsity issue and improve the recommendation performance. Existing KG-aware recommendation model use the feature of neighboring entities and structural information to update the embedding of currently located entity. Although the fruitful information is beneficial to the following task, the cost of exploring the entire graph is massive and impractical. In order to reduce the computational cost and maintain the pattern of extracting features, KG-aware recommendation model usually utilize fixed-size and random set of neighbors rather than complete information in KG. Nonetheless, there are two critical issues in these approaches: First of all, fixed-size and randomly selected neighbors restrict the view of graph. In addition, as the order of graph feature increases, the growth of parameter dimensionality of the model may lead the training process hard to converge. To solve the aforementioned limitations, we propose GraphSW, a strategy based on stage-wise training framework which would only access to a subset of the entities in KG in every stage. During the following stages, the learned embedding from previous stages is provided to the network in the next stage and the model can learn the information gradually from the KG. We apply stage-wise training on two SOTA recommendation models, RippleNet and Knowledge Graph Convolutional Networks (KGCN). Moreover, we evaluate the performance on six real world datasets, Last.FM 2011, Book-Crossing,movie, LFM-1b 2015, Amazon-book and Yelp 2018. The result of our experiments shows that proposed strategy can help both models to collect more information from the KG and improve the performance. Furthermore, it is observed that GraphSW can assist KGCN to converge effectively in high-order graph feature.


title: R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object

abstract: Rotation detection is a challenging task due to the difficulties of locating the multi-angle objects and separating them effectively from the background. Though considerable progress has been made, for practical settings, there still exist challenges for rotating objects with large aspect ratio, dense distribution and category extremely imbalance. In this paper, we propose an end-to-end refined single-stage rotation detector for fast and accurate object detection by using a progressive regression approach from coarse to fine granularity. Considering the shortcoming of feature misalignment in existing refined single-stage detector, we design a feature refinement module to improve detection performance by getting more accurate features. The key idea of feature refinement module is to re-encode the position information of the current refined bounding box to the corresponding feature points through pixel-wise feature interpolation to realize feature reconstruction and alignment. For more accurate rotation estimation, an approximate SkewIoU loss is proposed to solve the problem that the calculation of SkewIoU is not derivable. Experiments on three popular remote sensing public datasets DOTA, HRSC2016, UCAS-AOD as well as one scene text dataset ICDAR2015 show the effectiveness of our approach. Tensorflow and Pytorch version codes are available at https://github.com/Thinklab-SJTU/R3Det_Tensorflow and https://github.com/SJTU-Thinklab-Det/r3det-on-mmdetection, and R3Det is also integrated in our open source rotation detection benchmark: https://github.com/yangxue0827/RotationDetection.


title: Experimental investigation of the turbulent cascade development by injection of single large-scale Fourier modes

abstract: The current work presents an experimental investigation of the dynamic interactions between flow scales caused by repeated actions of the nonlinear term of the Navier-Stokes equation. Injecting a narrow band oscillation, representing a single Fourier mode, into a round jet flow allows the measurement of the downstream generation and development of higher harmonic spectral components and to measure when these components are eventually absorbed into fully developed turbulence. Furthermore, the dynamic evolution of the measured power spectra observed corresponds well to the measured cascaded delays reported by others. Closely matching spectral development and cascade delays have also been derived directly from a one-dimensional solution of the Navier-Stokes equation described in a companion paper. The results in the current work provide vital information about how initial conditions influence development of the shape of the spectrum and about the extent of the time scales in the triad interaction process, which should be of significance to turbulence modelers.


title: Exciting Pseudospin Dependent Edge States in Plasmonic Metasurfaces

abstract: We study a plasmonic metasurface that supports pseudospin dependent edge states confined at a subwavelength scale, considering full electrodynamic interactions including retardation and radiative effects. The spatial symmetry of the lattice of plasmonic nanoparticles gives rise to edge states with properties reminiscent of the quantum spin Hall effect in topological insulators. However, unlike the spin-momentum locking characteristic of topological insulators, these modes are not purely unidirectional and their propagation properties can be understood by analysing the spin angular momentum of the electromagnetic field, which is inhomogenous in the plane of the lattice. The local sign of the spin angular momentum determines the propagation direction of the mode under a near-field excitation source. We also study the optical response under far-field excitation and discuss in detail the effects of radiation and retardation.


title: Towards multi-sequence MR image recovery from undersampled k-space data

abstract: Undersampled MR image recovery has been widely studied for accelerated MR acquisition. However, it has been mostly studied under a single sequence scenario, despite the fact that multi-sequence MR scan is common in practice. In this paper, we aim to optimize multi-sequence MR image recovery from undersampled k-space data under an overall time constraint while considering the difference in acquisition time for various sequences. We first formulate it as a constrained optimization problem and then show that finding the optimal sampling strategy for all sequences and the best recovery model at the same time is combinatorial and hence computationally prohibitive. To solve this problem, we propose a blind recovery model that simultaneously recovers multiple sequences, and an efficient approach to find proper combination of sampling strategy and recovery model. Our experiments demonstrate that the proposed method outperforms sequence-wise recovery, and sheds light on how to decide the undersampling strategy for sequences within an overall time budget.


title: A VLT/FLAMES survey for massive binaries in Westerlund 1: VII. Cluster census

abstract: The formation, properties, and evolution of massive stars remain subject to considerable uncertainty; impacting on fields as diverse as galactic feedback and the nature of the progenitors of both electromagnetic and gravitational wave transients. The clusters many such stars reside within provide a unique laboratory for addressing these issues, and in this work we provide a comprehensive stellar census of Westerlund 1 to underpin such efforts. 69 new members were identified via I-band spectroscopy, yielding a total cluster population of 166 stars with initial masses of ~25Msun to ~50Msun, with more massive stars already lost to supernova. The stellar population follows a smooth and continuous morphological sequence from late-O giant through to OB supergiant. Subsequently, the progression bifurcates, with one branch yielding mid- to late-B hypergiants and cool super-/hypergiants, and the other massive blue stragglers, prior to a diverse population of H-depleted Wolf-Rayets. A substantial population of O-type stars with anomalously broad Paschen series lines are seen, a property which we attribute to binarity. Binary interaction is clearly required to yield the uniquely rich cohort of hypergiants, which includes both mass-stripped primaries and rejuvenated secondaries/stellar mergers. As a consequence future observations of Wd1 and similar stellar aggregates hold out the prospect of characterising both single- and binary- evolutionary channels for massive stars and determining their relative contributions. This in turn will permit the physical properties of such objects at the point of core-collapse to be predicted; of direct relevance for understanding the formation of relativistic remnants such as the magnetars associated with Wd1 and other young massive clusters (Abridged).


title: Using failed supernovae to constrain the Galactic r-process element production

abstract: Rapid neutron capture process (r-process) elements have been detected in a large fraction of metal-poor halo stars, with abundances relative to iron (Fe) that vary by over two orders of magnitude. This scatter is reduced to less than a factor of 3 in younger Galactic disc stars. The large scatter of r-process elements in the early Galaxy suggests that the r-process is made by rare events, like compact binary mergers and rare sub-classes of supernovae. Although being rare, neutron star mergers alone have difficulties to explain the observed enhancement of r-process elements in the lowest metallicity stars compared to Fe. The supernovae producing the two neutron stars already provide a substantial Fe abundance where the r-process ejecta from the merger would be injected. In this work we investigate another complementary scenario, where the r-process occurs in neutron star-black hole mergers in addition to neutron star mergers. Neutron star-black hole mergers would eject similar amounts of r-process matter as neutron star mergers, but only the neutron star progenitor would have produced Fe. Furthermore, a reduced efficiency of Fe production from single stars significantly alters the age-metallicity relation, which shifts the onset of r-process production to lower metallicities. We use the high-resolution [(20 pc)3/cell] inhomogeneous chemical evolution tool `ICE' to study the outcomes of these effects. In our simulations, an adequate combination of neutron star mergers and neutron star-black hole mergers qualitatively reproduces the observed r-process abundances in the Galaxy.


title: T-IFISS: a toolbox for adaptive FEM computation

abstract: T-IFISS is a finite element software package for studying finite element solution algorithms for deterministic and parametric elliptic partial differential equations. The emphasis is on self-adaptive algorithms with rigorous error control using a variety of a posteriori error estimation techniques. The open-source MATLAB framework provides a computational laboratory for experimentation and exploration, enabling users to quickly develop new discretizations and test alternative algorithms. The package is also valuable as a teaching tool for students who want to learn about state-of-the-art finite element methodology.


title: An atomic array optical clock with single-atom readout

abstract: Currently, the most accurate and stable clocks use optical interrogation of either a single ion or an ensemble of neutral atoms confined in an optical lattice. Here, we demonstrate a new optical clock system based on an array of individually trapped neutral atoms with single-atom readout, merging many of the benefits of ion and lattice clocks as well as creating a bridge to recently developed techniques in quantum simulation and computing with neutral atoms. We evaluate single-site resolved frequency shifts and short-term stability via self-comparison. Atom-by-atom feedback control enables direct experimental estimation of laser noise contributions. Results agree well with an ab initio Monte Carlo simulation that incorporates finite temperature, projective read-out, laser noise, and feedback dynamics. Our approach, based on a tweezer array, also suppresses interaction shifts while retaining a short dead time, all in a comparatively simple experimental setup suited for transportable operation. These results establish the foundations for a third optical clock platform and provide a novel starting point for entanglement-enhanced metrology, quantum clock networks, and applications in quantum computing and communication with individual neutral atoms that require optical clock state control.


title: Visualizing and Understanding the Effectiveness of BERT

abstract: Language model pre-training, such as BERT, has achieved remarkable results in many NLP tasks. However, it is unclear why the pre-training-then-fine-tuning paradigm can improve performance and generalization capability across different tasks. In this paper, we propose to visualize loss landscapes and optimization trajectories of fine-tuning BERT on specific datasets. First, we find that pre-training reaches a good initial point across downstream tasks, which leads to wider optima and easier optimization compared with training from scratch. We also demonstrate that the fine-tuning procedure is robust to overfitting, even though BERT is highly over-parameterized for downstream tasks. Second, the visualization results indicate that fine-tuning BERT tends to generalize better because of the flat and wide optima, and the consistency between the training loss surface and the generalization error surface. Third, the lower layers of BERT are more invariant during fine-tuning, which suggests that the layers that are close to input learn more transferable representations of language.


title: A deep learning model for segmentation of geographic atrophy to study its long-term natural history

abstract: Purpose: To develop and validate a deep learning model for automatic segmentation of geographic atrophy (GA) in color fundus images (CFIs) and its application to study growth rate of GA. Participants: 409 CFIs of 238 eyes with GA from the Rotterdam Study (RS) and the Blue Mountain Eye Study (BMES) for model development, and 5,379 CFIs of 625 eyes from the Age-Related Eye Disease Study (AREDS) for analysis of GA growth rate. Methods: A deep learning model based on an ensemble of encoder-decoder architectures was implemented and optimized for the segmentation of GA in CFIs. Four experienced graders delineated GA in CFIs from RS and BMES. These manual delineations were used to evaluate the segmentation model using 5-fold cross-validation. The model was further applied to CFIs from the AREDS to study the growth rate of GA. Linear regression analysis was used to study associations between structural biomarkers at baseline and GA growth rate. A general estimate of the progression of GA area over time was made by combining growth rates of all eyes with GA from the AREDS set. Results: The model obtained an average Dice coefficient of 0.72 $\pm$ 0.26 on the BMES and RS. An intraclass correlation coefficient of 0.83 was reached between the automatically estimated GA area and the graders' consensus measures. Eight automatically calculated structural biomarkers (area, filled area, convex area, convex solidity, eccentricity, roundness, foveal involvement and perimeter) were significantly associated with growth rate. Combining all growth rates indicated that GA area grows quadratically up to an area of around 12 mm$^{2}$, after which growth rate stabilizes or decreases. Conclusion: The presented deep learning model allowed for fully automatic and robust segmentation of GA in CFIs. These segmentations can be used to extract structural characteristics of GA that predict its growth rate.


title: The Distribution of Dense Cores near HII Regions

abstract: An investigation of dust emission associated with a large sample of HII regions has been carried out. Stacked results from this sample suggest that each HII region is at or near the center of a cluster of dense cores, that extends far beyond the HII region, and has volume density that decreases as r^(-3). The data also shows evidence for enhanced numbers of cores near the boundary of the HII regions. At the same time, a significant decrease in the number of cores, consistent with no cores, is observed in the interior of these HII regions. Neither these HII regions, nor their associated massive OB stars were found to have a significant heating effect on their associated dusty clumps. Clouds, or the outermost layers of the clumps in which the cores are embedded, are found to exert a strong shielding effect to external heating sources. Despite this, a large portion of the identified cores was found to be warmer than their surrounding cloud and consequently may be in the initial stages of star formation. The star formation efficiency of the 7 HII region systems with the most reliable mass budgets ranged between 1% and 9%.


title: Controlling branching angle of waveguide splitters based on GRIN lenses

abstract: Designing beam splitting structures with wide branching angles is of great significance. The branching angle of conventional Y-junctions is limited. In this paper, we investigate the possibility of utilizing gradient index (GRIN) lenses with two focal points such as the generalized Maxwell's fisheye (GMFE) and Eaton lenses in controlling the branching angle of power splitters. The GMFE lens can provide a wide range of branching angles, however, we present only splitting angles of 25$^\circ$, 45$^\circ$, and 65$^\circ$. Furthermore, we propose a 90$^\circ$ splitter structure by employing the Eaton lens. We evaluate the performance of the proposed power splitters by ray-tracing and full-wave finite element method. While GRIN lenses provide a broad range of splitting angles, they require isotropic metamaterials to implement high refractive indices at the center of these lenses.


title: A remark on locally direct product subsets in a topological Cartesian space

abstract: Let $X$ and $Y$ be topological spaces. Let $C$ be a path-connected closed set of $X\times Y$. Suppose that $C$ is locally direct product, that is, for any $(a,b)\in X\times Y$, there exist an open set $U$ of $X$, an open set $V$ of $Y$, a subset $I$ of $U$ and a subset $J$ of $V$ such that $(a,b) \in U\times V$ and $$C\cap (U\times V)=I\times J$$ hold. Then, in this memo, we show that $C$ is globally so, that is, there exist a subset $A$ of $X$ and a subset $B$ of $Y$ such that $$C=A\times B$$ holds. The proof is elementary. Here, we note that one might be able to think of a (perhaps, open) similar problem for a fiber product of locally trivial fiber spaces, not just for a direct product of topological spaces. In Appendix, we mentioned a simple example of a $C([0,1];\mathbb R)$-manifold that cannot be embedded in the direct product $(C([0,1];\mathbb R))^n$ as a $C([0,1];\mathbb R)$-submanifold. In addition, we introduce the concept of topological 2-space, which is locally the direct product of topological spaces and an analog of homotopy category for topological 2-space. Finally, we raise a question on the existence of an $\mathbb R^n$-Morse function and the existence of an $\mathbb R^n$-immersion in a finite-dimensional $\mathbb R^n$-Euclidean space. Here, we note that the problem of defining the concept of an $\mathbb R^n$-handle body may also be considered.


title: An Improved Distance to NGC 4258 and its Implications for the Hubble Constant

abstract: NGC 4258 is a critical galaxy for establishing the extragalactic distance scale and estimating the Hubble constant (Ho). Water masers in the nucleus of the galaxy orbit about its supermassive black hole, and very long baseline interferometric observations of their positions, velocities, and accelerations can be modeled to give a geometric estimate of the angular-diameter distance to the galaxy. We have improved the technique to obtain model parameter values, reducing both statistical and systematic uncertainties compared to previous analyses. We find the distance to NGC 4258 to be 7.576 +/- 0.082 (stat.) +/- 0.076 (sys.) Mpc. Using this as the sole source of calibration of the Cepheid-SN Ia distance ladder results in Ho = 72.0 +/- 1.9 km/s/Mpc, and in concert with geometric distances from Milky Way parallaxes and detached eclipsing binaries in the LMC we find Ho = 73.5 +/- 1.4 km/s/Mpc. The improved distance to NGC 4258 also provides a new calibration of the tip of the red giant branch of M_{F814W} = -4.01 +/- 0.04$ mag, with reduced systematic errors for the determination of Ho compared to the LMC-based calibration, because it is measured on the same Hubble Space Telescope photometric system and through similarly low extinction as SN Ia host halos. The result is Ho = 71.1 +/- 1.9 km/s/Mpc, in good agreement with the result from the Cepheid route, and there is no difference in Ho when using the same calibration from NGC 4258 and the same SN Ia Hubble diagram intercept to start and end both distance ladders.


title: [OII] emitters in MultiDark-Galaxies and DEEP2

abstract: We use three semi-analytic models (SAMs) of galaxy formation and evolution, run on the same 1$h^{-1}$Gpc MultiDark Planck2 cosmological simulation, to investigate the properties of [OII] emission line galaxies in the redshift range $0.6<z<1.2$. We compare model predictions with different observational data sets, including DEEP2--Firefly galaxies with absolute magnitudes. We estimate the [OII] luminosity, L[OII], using simple relations derived both from the models and observations and also using a public code. This code ideally uses as input instantaneous star formation rates (SFRs), which are only provided by one of the SAMs under consideration. We use this SAM to study the feasibility of inferring galaxies' L[OII] for models that only provide average SFRs. We find that the post-processing computation of L[OII] from average SFRs is accurate for model galaxies with dust attenuated L[OII]$\lesssim10^{42.2}$erg s$^{-1}$ ($<5\%$ discrepancy). We also explore how to derive the [OII] luminosity from simple relations using global properties usually output by SAMs. Besides the SFR, the model L[OII] is best correlated with the observed-frame $u$ and $g$ broad-band magnitudes. These correlations have coefficients (r-values) above 0.64 and a dispersion that varies with L[OII]. We use these correlations and an observational one based on SFR and metallicity to derive L[OII]. These relations result in [OII] luminosity functions and halo occupation distributions with shapes that vary depending on both the model and the method used. Nevertheless, for all the considered models, the amplitude of the clustering at scales above 1$h^{-1}$Mpc remains unchanged independently of the method used to derive L[OII].


title: Learning Signal Subgraphs from Longitudinal Brain Networks with Symmetric Bilinear Logistic Regression

abstract: Modern neuroimaging technologies, combined with state-of-the-art data processing pipelines, have made it possible to collect longitudinal observations of an individual's brain connectome at different ages. It is of substantial scientific interest to study how brain connectivity varies over time in relation to human cognitive traits. In brain connectomics, the structural brain network for an individual corresponds to a set of interconnections among brain regions. We propose a symmetric bilinear logistic regression to learn a set of small subgraphs relevant to a binary outcome from longitudinal brain networks as well as estimating the time effects of the subgraphs. We enforce the extracted signal subgraphs to have clique structure which has appealing interpretations as they can be related to neurological circuits. The time effect of each signal subgraph reflects how its predictive effect on the outcome varies over time, which may improve our understanding of interactions between the aging of brain structure and neurological disorders. Application of this method on longitudinal brain connectomics and cognitive capacity data shows interesting discovery of relevant interconnections among a small set of brain regions in frontal and temporal lobes with better predictive performance than competitors.


title: Nearly Optimal Measurement Scheduling for Partial Tomography of Quantum States

abstract: Many applications of quantum simulation require to prepare and then characterize quantum states by performing an efficient partial tomography to estimate observables corresponding to $k$-body reduced density matrices ($k$-RDMs). For instance, variational algorithms for the quantum simulation of chemistry usually require that one measure the fermionic 2-RDM. While such marginals provide a tractable description of quantum states from which many important properties can be computed, their determination often requires a prohibitively large number of circuit repetitions. Here we describe a method by which all elements of $k$-body qubit RDMs acting on $N$ qubits can be directly measured with a number of circuits scaling as ${\cal O}(3^{k} \log^{k-1}\! N)$, an exponential improvement in $N$ over prior art. Next, we show that if one is able to implement a linear depth circuit on a linear array prior to measurement, then one can directly measure all elements of the fermionic 2-RDM using only ${\cal O}(N^2)$ circuits. We prove that this result is asymptotically optimal, thus establishing an exponential separation between the number of circuits required to directly measure all elements of qubit versus fermion RDMs. We further demonstrate a technique to estimate the expectation value of any linear combination of fermionic 2-RDM elements using ${\cal O}(N^4 / \omega)$ circuits, each with only ${\cal O}(\omega)$ gates on a linear array where $\omega \leq N$ is a free parameter. We expect these results will improve the viability of many proposals for near-term quantum simulation.


title: A blockchain-based user-centric emission monitoring and trading system for multi-modal mobility

abstract: Since the transport sector accounts for one of the highest shares of greenhouse gases (GHG) emissions, several existing proposals state the idea to control the by the transportation sector caused GHG emissions through an Emission Trading Systems (ETS). However, most existing approaches integrate GHG emissions through the fuel consumption and car registration, limiting the tracing of emissions in more complex modes e.g. shared vehicles, shared rides and even public transportation. This paper presents a new design of a user-centric ETS and its implementation as a carbon Blockchain framework for Smart Mobility Data-market (cBSMD). The cBSMD allows for the seamless transactions of token-equivalent GHG emissions when realizing a trip, or an emission trading action as well as the transaction of individual, service or system-wide emission performance data. We demonstrate an instance of the cBSMD implementation for the transactions of an ETS where all travellers receive a certain amount of emission credits in the form of tokens, linked to the GHG price and a total emission cap. Travellers use their tokens each time they emit GHG when travelling in a multi-modal network, purchase tokens for a given trip when they have an insufficient token amount or sell when having a surplus of tokens due to a lower amount of emitted GHG. This instance of cBSMD is then applied to a case-study of 24hours of mobility of 3,186 travellers from Oakville, Ontario, Canada, where we showcase different cBSMD transactions and analyze token usage and emission performance.


title: Distributed Path Planning for Executing Cooperative Tasks with Time Windows

abstract: We investigate the distributed planning of robot trajectories for optimal execution of cooperative tasks with time windows. In this setting, each task has a value and is completed if sufficiently many robots are simultaneously present at the necessary location within the specified time window. Tasks keep arriving periodically over cycles. The task specifications (required number of robots, location, time window, and value) are unknown a priori and the robots try to maximize the value of completed tasks by planning their own trajectories for the upcoming cycle based on their past observations in a distributed manner. Considering the recharging and maintenance needs, robots are required to start and end each cycle at their assigned stations located in the environment. We map this problem to a game theoretic formulation and maximize the collective performance through distributed learning. Some simulation results are also provided to demonstrate the performance of the proposed approach.


title: Sharp polynomial decay rates for the damped wave equation with H\"older-like damping

abstract: We study decay rates for the energy of solutions of the damped wave equation on the torus. We consider dampings invariant in one direction and bounded above and below by multiples of $x^{\beta}$ near the boundary of the support and show decay at rate $1/t^{\frac{\beta+2}{\beta+3}}$. In the case where $W$ vanishes exactly like $x^{\beta}$ this result is optimal by work of the second author. The proof uses a version of the Morawetz multiplier method.


title: Tracing Player Knowledge in a Parallel Programming Educational Game

abstract: This paper focuses on "tracing player knowledge" in educational games. Specifically, given a set of concepts or skills required to master a game, the goal is to estimate the likelihood with which the current player has mastery of each of those concepts or skills. The main contribution of the paper is an approach that integrates machine learning and domain knowledge rules to find when the player applied a certain skill and either succeeded or failed. This is then given as input to a standard knowledge tracing module (such as those from Intelligent Tutoring Systems) to perform knowledge tracing. We evaluate our approach in the context of an educational game called "Parallel" to teach parallel and concurrent programming with data collected from real users, showing our approach can predict students skills with a low mean-squared error.


title: Universal momentum-to-real-space mapping of topological singularities

abstract: Topological properties of materials, as manifested in the intriguing phenomena of quantum Hall effect and topological insulators, have attracted overwhelming transdisciplinary interest in recent years. Topological edge states, for instance, have been realized in versatile systems including electromagnetic-waves. Typically, topological properties are revealed in momentum space, using concepts such as Chern number and Berry phase. Here, we demonstrate a universal mapping of the topology of Dirac-like cones from momentum space to real space. We evince the mapping by exciting the cones in photonic honeycomb (pseudospin-1/2) and Lieb (pseudospin-1) lattices with vortex beams of topological charge l, optimally aligned for a chosen pseudospin state s, leading to direct observation of topological charge conversion that follows the rule of l to l+2s. The mapping is theoretically accounted for all initial excitation conditions with the pseudospin-orbit interaction and nontrivial Berry phases. Surprisingly, such a mapping exists even in a deformed lattice where the total angular momentum is not conserved, unveiling its topological origin. The universality of the mapping extends beyond the photonic platform and 2D lattices: equivalent topological conversion occurs for 3D Dirac-Weyl synthetic magnetic monopoles, which could be realized in ultracold atomic gases and responsible for mechanism behind the vortex creation in electron beams traversing a magnetic monopole field.


title: REBOUNDx: A Library for Adding Conservative and Dissipative Forces to Otherwise Symplectic N-body Integrations

abstract: Symplectic methods, in particular the Wisdom-Holman map, have revolutionized our ability to model the long-term, conservative dynamics of planetary systems. However, many astrophysically important effects are dissipative. The consequences of incorporating such forces into otherwise symplectic schemes is not always clear. We show that moving to a general framework of non-commutative operators (dissipative or not) clarifies many of these questions, and that several important properties of symplectic schemes carry over to the general case. In particular, we show that explicit splitting schemes generically exploit symmetries in the applied external forces which often strongly suppress integration errors. Furthermore, we demonstrate that so-called `symplectic correctors' (which reduce energy errors by orders of magnitude at fixed computational cost) apply equally well to weakly dissipative systems and can thus be more generally thought of as `weak splitting correctors.' Finally, we show that previously advocated approaches of incorporating additional forces into symplectic methods work well for dissipative forces, but give qualitatively wrong answers for conservative but velocity-dependent forces like post-Newtonian corrections. We release REBOUNDx, an open-source C library for incorporating additional effects into REBOUND N-body integrations, together with a convenient Python wrapper. All effects are machine-independent and we provide a binary format that interfaces with the SimulationArchive class in REBOUND to enable the sharing and reproducibility of results. Users can add effects from a list of pre-implemented astrophysical forces, or contribute new ones.


title: Deep learning on butterfly phenotypes tests evolution's oldest mathematical model

abstract: Traditional anatomical analyses captured only a fraction of real phenomic information. Here, we apply deep learning to quantify total phenotypic similarity across 2468 butterfly photographs, covering 38 subspecies from the polymorphic mimicry complex of $\textit{Heliconius erato}$ and $\textit{Heliconius melpomene}$. Euclidean phenotypic distances, calculated using a deep convolutional triplet network, demonstrate significant convergence between interspecies co-mimics. This quantitatively validates a key prediction of M\"ullerian mimicry theory, evolutionary biology's oldest mathematical model. Phenotypic neighbor-joining trees are significantly correlated with wing pattern gene phylogenies, demonstrating objective, phylogenetically informative phenome capture. Comparative analyses indicate frequency-dependent, mutual convergence with coevolutionary exchange of wing pattern features. Therefore, phenotypic analysis supports reciprocal coevolution, predicted by classical mimicry theory but since disputed, and reveals mutual convergence as an intrinsic generator for the surprising diversity of M\"ullerian mimicry. This demonstrates that deep learning can generate phenomic spatial embeddings which enable quantitative tests of evolutionary hypotheses previously only testable subjectively.


title: Simple, Reversible Gradient Seebeck Coefficient Measurement System for 300-600K

abstract: An in-house Seebeck coefficient measurement system has been developed which can measure the thermoemf (Seebeck coefficient) of the sample, under large temperature difference, in the temperature range 300-600 K. Unlike majority of reported instrumental designs, the system does not have a hot walled chamber and hence is much closer to real time thermoelectric applications conditions. The system consists of two brass blocks supported heaters. These heaters are placed on either side of the sample through silver caps, thus allows individual temperature control. A reversible temperature gradient is applied across the sample and the measurement is carried out in quasi-static direct current mode. Hence, a more accurate Seebeck coefficient measurement is obtained.


title: A Method for an Untriggered, Time-Dependent, Source-Stacking Search for Neutrino Flares

abstract: Recent results from IceCube regarding TXS 0506+056 suggest that it may be useful to test the hypothesis of multiple neutrino flares, where each flare is not necessarily accompanied by a corresponding gamma-ray flare. An untriggered, time-dependent, source-stacking search would be optimal for testing this hypothesis, however such an analysis has yet to be applied to the full duration of IceCube data. Here, we discuss one possible way of constructing such an analysis, with a global test statistic obtained by summing the individual test statistics associated with each signal-like flare in the sample. This has the additional advantage of assessing the time structure of each source when running the analysis over a source catalog. We show that, for a signal consisting of many small flares, this style of analysis represents a significant increase in discovery potential over both the existing single-flare fit and the time-integrated stacking methods. Potential source catalogs are examined in combination with this method, including the possibility of a "self-triggered" catalog consisting of the locations of the highest energy northern sky events in the IceCube sample.


title: Generation of quasi-rectangle-states of the vibrational motion of an ion

abstract: We show how to generate quasi-rectangle-states of the vibrational motion of an ion, this is, states that have the same probability in a given position interval. We produce those states by repeated ion-laser interactions followed by conditional measurements that generate a superposition of squeezed states. The squeeze parameter of the initial state may be tuned in order to obtain such highly localized rectangle states.


title: Breakdown of intermediate one-half magnetization plateau of spin-1/2 Ising-Heisenberg and Heisenberg branched chains at triple and Kosterlitz-Thouless critical points

abstract: The spin-1/2 Ising-Heisenberg branched chain composed of regularly alternating Ising spins and Heisenberg dimers involving an additional side branching is rigorously solved in a magnetic field by the transfer-matrix approach. The ground-state phase diagram, the magnetization process and the concurrence measuring a degree of bipartite entanglement within the Heisenberg dimers are examined in detail. Three different ground states were found depending on a mutual interplay between the magnetic field and two different coupling constants: the modulated quantum antiferromagnetic phase, the quantum ferrimagnetic phase and the classical ferromagnetic phase. Two former quantum ground states are manifested in zero-temperature magnetization curves as intermediate plateaus at zero and one-half of the saturation magnetization, whereas the one-half plateau disappears at a triple point induced by a strong enough ferromagnetic Ising coupling. The ground-state phase diagram and zero-temperature magnetization curves of the analogous spin-1/2 Heisenberg branched chain were investigated using DMRG calculations. The latter fully quantum Heisenberg model involves, besides two gapful phases manifested as zero and one-half magnetization plateaus, gapless quantum spin-liquid phase. The intermediate one-half plateau of the spin-1/2 Heisenberg branched chain vanishes at Kosterlitz-Thouless quantum critical point between gapful and gapless quantum ground states unlike the triple point of the spin-1/2 Ising-Heisenberg branched chain.


title: A Bayesian Choice Model for Eliminating Feedback Loops

abstract: Self-reinforcing feedback loops in personalization systems are typically caused by users choosing from a limited set of alternatives presented systematically based on previous choices. We propose a Bayesian choice model built on Luce axioms that explicitly accounts for users' limited exposure to alternatives. Our model is fair---it does not impose negative bias towards unpresented alternatives, and practical---preference estimates are accurately inferred upon observing a small number of interactions. It also allows efficient sampling, leading to a straightforward online presentation mechanism based on Thompson sampling. Our approach achieves low regret in learning to present upon exploration of only a small fraction of possible presentations. The proposed structure can be reused as a building block in interactive systems, e.g., recommender systems, free of feedback loops.


title: IoU-balanced Loss Functions for Single-stage Object Detection

abstract: Single-stage object detectors have been widely applied in computer vision applications due to their high efficiency. However, we find that the loss functions adopted by single-stage object detectors hurt the localization accuracy seriously. Firstly, the standard cross-entropy loss for classification is independent of the localization task and drives all the positive examples to learn as high classification scores as possible regardless of localization accuracy during training. As a result, there will be many detections that have high classification scores but low IoU or detections that have low classification scores but high IoU. Secondly, for the standard smooth L1 loss, the gradient is dominated by the outliers that have poor localization accuracy during training. The above two problems will decrease the localization accuracy of single-stage detectors. In this work, IoU-balanced loss functions that consist of IoU-balanced classification loss and IoU-balanced localization loss are proposed to solve the above problems. The IoU-balanced classification loss pays more attention to positive examples with high IoU and can enhance the correlation between classification and localization tasks. The IoU-balanced localization loss decreases the gradient of examples with low IoU and increases the gradient of examples with high IoU, which can improve the localization accuracy of models. Extensive experiments on challenging public datasets such as MS COCO, PASCAL VOC and Cityscapes demonstrate that both IoU-balanced losses can bring substantial improvement for the popular single-stage detectors, especially for the localization accuracy. On COCO test-dev, the proposed methods can substantially improve AP by $1.0\%\sim1.7\%$ and AP75 by $1.0\%\sim2.4\%$. On PASCAL VOC, it can also substantially improve AP by $1.3\%\sim1.5\%$ and AP80, AP90 by $1.6\%\sim3.9\%$.


title: An Improved Compact Embedding Theorem for Degenerate Sobolev Spaces

abstract: This short note investigates the compact embedding of degenerate matrix weighted Sobolev spaces into weighted Lebesgue spaces. The Sobolev spaces explored are defined as the abstract completion of Lipschitz functions in a bounded domain $\Omega$ with respect to the norm: $$\|f\|_{QH^{1,p}(v,\mu;\Omega)} = \|f\|_{L^p_v(\Omega)} + \|\nabla f\|_{\mathcal{L}^p_Q(\mu;\Omega)}$$ where the weight $v$ is comparable to a power of the pointwise operator norm of the matrix valued function $Q=Q(x)$ in $\Omega$. Following our main theorem, we give an explicit application where degeneracy is controlled through an ellipticity condition of the form $$w(x)|\xi|^p \leq \left(\xi\cdot Q(x)\xi\right)^{p/2}\leq \tau(x)|\xi|^p$$ for a pair of $p$-admissible weights $w\leq \tau$ in $\Omega$. We also give explicit examples demonstrating the sharpness of our hypotheses.


title: The nature of the two-peak structure in NiO valence band photoemission

abstract: In spite of extensive studies on NiO and their accomplishments, the rich physics still raises unsolved physical problems. In particular, the nature of the two-peak structure in the valence band photoemission spectra is still controversial. By using \textit{ab initio} LQSGW+DMFT, the two-peak structure is shown to be driven by the concerted effect of antiferromagnetic ordering and intersite electron hopping. Magnetic ordering in the Ni-$e_{g}$ orbitals splits majority- and minority-spin Ni-$t_{2g}$ levels due to local Hund's coupling. Strong hybridization between O-$p$ and Ni-$e_g$, a signature of the Zhang-Rice bound state formation, boosts oxygen-mediated intersite Ni-$e_g$ orbital hopping, resulting in the enhancement of majority-spin Ni $t_{2g}$-$e_{g}$ splitting. Interestingly, these two splittings of distinct physical origins match and give rise to the observed two-peak structure in NiO. Our new understanding should be useful in designing advanced devices based on the NiO for the hole transport.


title: Detecting Gravitational Waves in Data with Non-Gaussian Noise

abstract: Searches for gravitational waves crucially depend on exact signal processing of noisy strain data from gravitational wave detectors, which are known to exhibit significant non-Gaussian behavior. In this paper, we study two distinct non-Gaussian effects in the LIGO/Virgo data which reduce the sensitivity of searches: first, variations in the noise power spectral density (PSD) on timescales of more than a few seconds; and second, loud and abrupt transient `glitches' of terrestrial or instrumental origin. We derive a simple procedure to correct, at first order, the effect of the variation in the PSD on the search background. Given the knowledge of the existence of localized glitches in particular segments of data, we also develop a method to insulate statistical inference from these glitches, so as to cleanly excise them without affecting the search background in neighboring seconds. We show the importance of applying these methods on the publicly available LIGO data, and measure an increase in the detection volume of at least $15\%$ from the PSD-drift correction alone, due to the improved background distribution.


title: Muon Identification Using Deep Neural Networks with the Muon Telescope Detector at STAR

abstract: The installation of the muon telescope detector opened new possibilities for studying dimuon production at STAR. However, backgrounds from hadron punch-through and weak decays of pions and kaons make the identification of primary muons challenging. In this paper we present a study of shallow and deep neural networks trained as classifiers for the purpose of muon identification using information from the muon telescope detector at STAR. The performance of shallow neural networks is presented as a function of the number of neurons in their hidden layer. A hyperparameter optimization for determining the optimal deep neural network classifier architecture is presented. The optimized deep neural network is compared with shallow neural networks, boosted decision trees, likelihood ratios, and traditional cut-based PID techniques. The superiority of the deep neural network based muon identification technique is demonstrated and compared with traditional PID through the measurement of the $\phi$ meson and the $\psi(2S)$ in p+p collisions at $\sqrt{s}$ = 200 GeV. The deep neural network based PID simultaneously provides higher signal efficiency, signal-to-background ratio, and significance of the $\phi$ peak compared to traditional PID techniques. Finally, a deep neural network assisted technique for measuring the muon purity in data is presented and discussed.


title: SenseBERT: Driving Some Sense into BERT

abstract: The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision techniques operate at the word form level, which serves as a surrogate for the underlying semantic content. This paper proposes a method to employ weak-supervision directly at the word sense level. Our model, named SenseBERT, is pre-trained to predict not only the masked words but also their WordNet supersenses. Accordingly, we attain a lexical-semantic level language model, without the use of human annotation. SenseBERT achieves significantly improved lexical understanding, as we demonstrate by experimenting on SemEval Word Sense Disambiguation, and by attaining a state of the art result on the Word in Context task.


title: Counting Immutable Beans: Reference Counting Optimized for Purely Functional Programming

abstract: Most functional languages rely on some garbage collection for automatic memory management. They usually eschew reference counting in favor of a tracing garbage collector, which has less bookkeeping overhead at runtime. On the other hand, having an exact reference count of each value can enable optimizations, such as destructive updates. We explore these optimization opportunities in the context of an eager, purely functional programming language. We propose a new mechanism for efficiently reclaiming memory used by nonshared values, reducing stress on the global memory allocator. We describe an approach for minimizing the number of reference counts updates using borrowed references and a heuristic for automatically inferring borrow annotations. We implemented all these techniques in a new compiler for an eager and purely functional programming language with support for multi-threading. Our preliminary experimental results demonstrate our approach is competitive and often outperforms state-of-the-art compilers.


title: Spectroscopic Signatures of Nonlocal Interfacial Coupling in Superconducting FeSe/SrTiO3 Heterostructures

abstract: The mechanism of enhanced superconductivity in the one unit-cell (1UC) FeSe film on a SrTiO3 (STO) substrate has stimulated significant research interest but remains elusive. Using low-temperature, voltage-gated Raman spectroscopy and low-temperature valence electron energy loss spectroscopy (VEELS), we characterize the phonon behavior and interfacial charge transfer in single- and few-layer FeSe films on STO. Raman measurements reveal ambipolar softening of the FeSe vibrational modes, mimicking that of the underlying STO substrate. We attribute this behavior to an interfacial coupling effect of STO on FeSe lattice dynamics. This interfacial coupling effect is further supported by local electron effective mass enhancement, which is determined from the red-shift in the FeSe VEELS spectrum near the FeSe/STO interface. Our work sheds light on the possible interfacial mechanisms contributing to the enhanced superconductivity across the FeSe/STO interface and further unveils the potential of low-temperature gated Raman spectroscopy and VEELS in clarifying a broad category of quantum materials.


title: A Multimodal Vision Sensor for Autonomous Driving

abstract: This paper describes a multimodal vision sensor that integrates three types of cameras, including a stereo camera, a polarization camera and a panoramic camera. Each sensor provides a specific dimension of information: the stereo camera measures depth per pixel, the polarization obtains the degree of polarization, and the panoramic camera captures a 360-degree landscape. Data fusion and advanced environment perception could be built upon the combination of sensors. Designed especially for autonomous driving, this vision sensor is shipped with a robust semantic segmentation network. In addition, we demonstrate how cross-modal enhancement could be achieved by registering the color image and the polarization image. An example of water hazard detection is given. To prove the multimodal vision sensor's compatibility with different devices, a brief runtime performance analysis is carried out.


title: The maximum number of points in the cross-polytope that form a packing set of a scaled cross-polytope

abstract: The problem of finding the largest number of points in the unit cross-polytope such that the $l_{1}$-distance between any two distinct points is at least $2r$ is investigated for $r\in\left(1-\frac{1}{n},1\right]$ in dimensions $\geq2$ and for $r\in\left(\frac{1}{2},1\right]$ in dimension $3$. For the $n$-dimensional cross-polytope, $2n$ points can be placed when $r\in\left(1-\frac{1}{n},1\right]$. For the three-dimensional cross-polytope, $10$ and $12$ points can be placed if and only if $r\in\left(\frac{3}{5},\frac{2}{3}\right]$ and $r\in\left(\frac{4}{7},\frac{3}{5}\right]$ respectively, and no more than $14$ points can be placed when $r\in\left(\frac{1}{2},\frac{4}{7}\right]$. Also, constructive arrangements of points that attain the upper bounds of $2n$, $10$, and $12$ are provided, as well as $13$ points for dimension $3$ when $r\in\left(\frac{1}{2},\frac{6}{11}\right]$.


title: Almost optimal local well-posedness for the Maxwell-Klein-Gordon system with data in Fourier-Lebesgue spaces

abstract: We prove a low regularity local well-posedness result for the Maxwell-Klein-Gordon system in three space dimensions for data in Fourier - Lebesgue spaces $\widehat{H}^{s,r}$ , where $\|f\|_{\widehat{H}^{s,r}} = \|\langle \xi \rangle^s \widehat{f}(\xi)\|_{\widehat{L}^{r'}}$ , $\frac{1}{r}+\frac{1}{r'} = 1$ . The assumed regularity for the data is almost optimal with respect to scaling as $r \to 1$ . This closes the gap between what is known in the case $r=2$ , namely $s > \frac{3}{4}$ , and the critical value $s_c = \frac{1}{2}$ with respect to scaling.


title: IRC+10216 mass loss properties through the study of $\lambda$3mm emission: Large spatial scale distribution of SiO, SiS, and CS

abstract: The study of the gas in the envelopes surrounding asymptotic giant branch (AGB) stars through observations in the millimetre wavelength range provides information about the history and nature of these molecular factories. Here we present ALMA observations at subarsecond resolution, complemented with IRAM-30m data, of several lines of SiO, SiS, and CS towards the best-studied AGB circumstellar envelope, IRC+10216. We aim to characterise their spatial distribution and determine their fractional abundances mainly through radiative transfer and chemical modelling. The three species display extended emission with several enhanced emission shells. CS displays the most extended distribution reaching distances up to approximately 20''. SiS and SiO emission have similar sizes of approximately 11'', but SiS emission is slightly more compact. We have estimated fractional abundances relative to H$_2$, which on average are equal to f(SiO)$\sim$10$^{-7}$, f(SiS)$\sim$10$^{-6}$, and f(CS)$\sim$10$^{-6}$ up to the photo-dissociation region. The observations and analysis presented here show evidence that the circumstellar material displays clear deviations from an homogeneous spherical wind, with clumps and low density shells that may allow UV photons from the interstellar medium (ISM) to penetrate deep into the envelope, shifting the photo-dissociation radius inwards. Our chemical model predicts photo-dissociation radii compatible with those derived from the observations, although it is unable to predict abundance variations from the starting radius of the calculations ($\sim$10$R_{*}$), which may reflect the simplicity of the model. We conclude that the spatial distribution of the gas proves the episodic and variable nature of the mass loss mechanism of IRC+10216, on timescales of hundreds of years.


title: Electromagnetic full-$f$ gyrokinetics in the tokamak edge with discontinuous Galerkin methods

abstract: We present an energy-conserving discontinuous Galerkin scheme for the full-$f$ electromagnetic gyrokinetic system in the long-wavelength limit. We use the symplectic formulation and solve directly for $\partial A_\parallel/\partial t$, the inductive component of the parallel electric field, using a generalized Ohm's law derived directly from the gyrokinetic equation. Linear benchmarks are performed to verify the implementation and show that the scheme avoids the Amp\`ere cancellation problem. We perform a nonlinear electromagnetic simulation in a helical open-field-line system as a rough model of the tokamak scrape-off layer using parameters from the National Spherical Torus Experiment (NSTX). This is the first published nonlinear electromagnetic gyrokinetic simulation on open field lines. Comparisons are made to a corresponding electrostatic simulation.


title: Correlation function methods for a system of annihilating Brownian particles

abstract: In this expository note we highlight the correlation function method as a unified approach in proving both hydrodynamic limits and fluctuation limits for reaction diffusion particle systems. For simplicity we focus on the case when the hydrodynamic limit is $\partial_t u=\frac{1}{2}\Delta u -u^2$, one of the simplest nonlinear reaction-diffusion equations. The outline of the proof follows from Chapter 4 of De Masi and Presutti [7] but to simplify the presentation, we consider reflected Brownian motion instead of reflected random walks. We also briefly mention the key ideas in proving the fluctuation result.


title: CLOTHO: Directed Test Generation for Weakly Consistent Database Systems

abstract: Relational database applications are notoriously difficult to test and debug. Concurrent execution of database transactions may violate complex structural invariants that constraint how changes to the contents of one (shared) table affect the contents of another. Simplifying the underlying concurrency model is one way to ameliorate the difficulty of understanding how concurrent accesses and updates can affect database state with respect to these sophisticated properties. Enforcing serializable execution of all transactions achieves this simplification, but it comes at a significant price in performance, especially at scale, where database state is often replicated to improve latency and availability. To address these challenges, this paper presents a novel testing framework for detecting serializability violations in (SQL) database-backed Java applications executing on weakly-consistent storage systems. We manifest our approach in a tool named CLOTHO, that combines a static analyzer and a model checker to generate abstract executions, discover serializability violations in these executions, and translate them back into concrete test inputs suitable for deployment in a test environment. To the best of our knowledge, CLOTHO is the first automated test generation facility for identifying serializability anomalies of Java applications intended to operate in geo-replicated distributed environments. An experimental evaluation on a set of industry-standard benchmarks demonstrates the utility of our approach.


title: PHYRE: A New Benchmark for Physical Reasoning

abstract: Understanding and reasoning about physics is an important ability of intelligent agents. We develop the PHYRE benchmark for physical reasoning that contains a set of simple classical mechanics puzzles in a 2D physical environment. The benchmark is designed to encourage the development of learning algorithms that are sample-efficient and generalize well across puzzles. We test several modern learning algorithms on PHYRE and find that these algorithms fall short in solving the puzzles efficiently. We expect that PHYRE will encourage the development of novel sample-efficient agents that learn efficient but useful models of physics. For code and to play PHYRE for yourself, please visit https://player.phyre.ai.


title: Non-coherent Detection and Bit Error Rate for an Ambient Backscatter Link in Time-Selective Fading

abstract: This paper focuses on the non-coherent detection in ambient backscatter communication, which is highly appealing for systems where the trade-off between signaling overhead and the actual data transmission is very critical. Modeling the time-selective fading channel as a first-order autoregressive (AR) process, we propose a new receiver architecture based on the direct averaging of the received signal samples for detection, which departs significantly from the energy averaging-based receivers considered in the literature. For the proposed setup, we characterize the exact asymptotic bit error rate (BER) for both single-antenna (SA) and multi-antenna (MA) receivers, and demonstrate the robustness of the new architecture to timing errors. Our results demonstrate that while the direct-link (DL) interference from the ambient power source leads to a BER floor in the SA receiver, the MA receiver can remove this interference by estimating the angle of arrival (AoA) of the DL. The analysis further quantifies the effect of improved angular resolution on the BER as a function of the number of receive antennas. A key intermediate result of our analysis is the derivation of a new concentration result for a general sum sequence that is central to the derivation of the conditional distributions of the received signal.


title: Driven quantum dot coupled to a fractional quantum Hall edge

abstract: We study a model of a quantum dot coupled to a quantum Hall edge of the Laughlin state, taking into account short-range interactions between the dot and the edge. This system has been studied experimentally in electron quantum optics in the context of single particle sources. We consider driving the dot out of equilibrium by a time-dependent bias voltage. We calculate the resulting current on the edge by applying the Kubo formula to the bosonized Hamiltonian. The Hamiltonian of this system can also be mapped to the spin-boson model and in this picture, the current can be perturbatively calculated using the non-interacting blip approximation (NIBA). We show that both methods of solution are in fact equivalent. We present numerics demonstrating that the perturbative approaches capture the essential physics at early times, although they fail to capture the charge quantization (or lack thereof) in the current pulses integrated over long times.


title: Distributionally Robust Optimization: A Review

abstract: The concepts of risk-aversion, chance-constrained optimization, and robust optimization have developed significantly over the last decade. Statistical learning community has also witnessed a rapid theoretical and applied growth by relying on these concepts. A modeling framework, called distributionally robust optimization (DRO), has recently received significant attention in both the operations research and statistical learning communities. This paper surveys main concepts and contributions to DRO, and its relationships with robust optimization, risk-aversion, chance-constrained optimization, and function regularization.


title: Effect of Activation Functions on the Training of Overparametrized Neural Nets

abstract: It is well-known that overparametrized neural networks trained using gradient-based methods quickly achieve small training error with appropriate hyperparameter settings. Recent papers have proved this statement theoretically for highly overparametrized networks under reasonable assumptions. These results either assume that the activation function is ReLU or they crucially depend on the minimum eigenvalue of a certain Gram matrix depending on the data, random initialization and the activation function. In the later case, existing works only prove that this minimum eigenvalue is non-zero and do not provide quantitative bounds. On the empirical side, a contemporary line of investigations has proposed a number of alternative activation functions which tend to perform better than ReLU at least in some settings but no clear understanding has emerged. This state of affairs underscores the importance of theoretically understanding the impact of activation functions on training. In the present paper, we provide theoretical results about the effect of activation function on the training of highly overparametrized 2-layer neural networks. A crucial property that governs the performance of an activation is whether or not it is smooth. For non-smooth activations such as ReLU, SELU and ELU, all eigenvalues of the associated Gram matrix are large under minimal assumptions on the data. For smooth activations such as tanh, swish and polynomials, the situation is more complex. If the subspace spanned by the data has small dimension then the minimum eigenvalue of the Gram matrix can be small leading to slow training. But if the dimension is large and the data satisfies another mild condition, then the eigenvalues are large. If we allow deep networks, then the small data dimension is not a limitation provided that the depth is sufficient. We discuss a number of extensions and applications of these results.


title: Exponential Attractor for Hindmarsh-Rose Equations in Neurodynamics

abstract: The existence of an exponential attractor for the diffusive Hindmarsh-Rose equations on a three-dimensional bounded domain originated in the study of neurodynamics is proved through uniform estimates together with a new theorem on the squeezing property of an abstract reaction-diffusion equation also proved in this paper. The results infer that the global attractor whose existence has been established in [23] for the Hindmarsh-Rose semiflow has a finite fractal dimension.


title: Pixel space convolution for cosmic microwave background experiments

abstract: Cosmic microwave background experiments have experienced an exponential increase in complexity, data size and sensitivity. One of the goals of current and future experiments is to characterize the B-mode power spectrum, which would be considered a strong evidence supporting inflation. The signal associated with inflationary B-modes is very weak, and so a successful detection requires exquisite control over systematic effects, several of which might arise due to the interaction between the electromagnetic properties of the telescope beam, the scanning strategy and the sky model. In this work, we present the Pixel Space COnvolver (PISCO), a new software tool capable of producing mock data streams for a general CMB experiment. PISCO uses a fully polarized representation of the electromagnetic properties of the telescope. PISCO also exploits the massively parallel architecture of Graphic Processing Units to accelerate the main calculation. This work shows the results of applying PISCO in several scenarios, included a realistic simulation of an ongoing experiment, the Cosmology Large Angular Scale Surveyor.


title: Automatic detection and diagnosis of sacroiliitis in CT scans as incidental findings

abstract: Early diagnosis of sacroiliitis may lead to preventive treatment which can significantly improve the patient's quality of life in the long run. Oftentimes, a CT scan of the lower back or abdomen is acquired for suspected back pain. However, since the differences between a healthy and an inflamed sacroiliac joint in the early stages are subtle, the condition may be missed. We have developed a new automatic algorithm for the diagnosis and grading of sacroiliitis CT scans as incidental findings, for patients who underwent CT scanning as part of their lower back pain workout. The method is based on supervised machine and deep learning techniques. The input is a CT scan that includes the patient's pelvis. The output is a diagnosis for each sacroiliac joint. The algorithm consists of four steps: 1) computation of an initial region of interest (ROI) that includes the pelvic joints region using heuristics and a U-Net classifier; 2) refinement of the ROI to detect both sacroiliac joints using a four-tree random forest; 3) individual sacroiliitis grading of each sacroiliac joint in each CT slice with a custom slice CNN classifier, and; 4) sacroiliitis diagnosis and grading by combining the individual slice grades using a random forest. Experimental results on 484 sacroiliac joints yield a binary and a 3-class case classification accuracy of 91.9% and 86%, a sensitivity of 95% and 82%, and an Area-Under-the-Curve of 0.97 and 0.57, respectively. Automatic computer-based analysis of CT scans has the potential of being a useful method for the diagnosis and grading of sacroiliitis as an incidental finding.


title: Further searches of the Higgs scalar sector at the ESS

abstract: Recent decades have witnessed remarkable confirmations of the Standard Model (SM) describing the Electro-Weak and Strong Interactions. The Higgs boson was observed at CERN-LHC at 7-8 TeV and 13 TeV. The HL-LHC, a major luminosity upgrade has been recently approved. The HL-LHC may be already an early "Higgs factory", however only capable to perform Ho related measurements with rather large uncertainties because of persisting backgrounds and uncertainties. New projects using leptons rather than hadrons should be investigated Ho has a spin zero and its coupling is proportional to the square of the lepton mass, greatly enhancing the production from pairs of muons. A mu+mu- Collider may operate at a much higher magnetic field respect to the e+e- Collider and it has a smaller radius, easily fitting within one existing European site. However muons are unstable particles: they must be produced in sufficient amounts from pions of a proton beam, cooled and quickly accelerated to the required energies. The scenario is here primarily concentrated to further developments of the European Spallation Source (ESS) under construction in the Lund site as the most intense future source of spallation neutrons. As a initial part of the program, muon cooling should be experimentally demonstrated with the much cheaper and simpler Initial Cooling Experiment.


title: Stars at High Spatial Resolution

abstract: We summarize some of the compelling new scientific opportunities for understanding stars and stellar systems that can be enabled by sub-milliarcsec (sub-mas) angular resolution, UV-Optical spectral imaging observations, which can reveal the details of the many dynamic processes (e.g., evolving magnetic fields, accretion, convection, shocks, pulsations, winds, and jets) that affect stellar formation, structure, and evolution. These observations can only be provided by long-baseline interferometers or sparse aperture telescopes in space, since the aperture diameters required are in excess of 500 m (a regime in which monolithic or segmented designs are not and will not be feasible) and since they require observations at wavelengths (UV) not accessible from the ground. Such observational capabilities would enable tremendous gains in our understanding of the individual stars and stellar systems that are the building blocks of our Universe and which serve as the hosts for life throughout the Cosmos.