title: Attn-HybridNet: Improving Discriminability of Hybrid Features with Attention Fusion

abstract: The principal component analysis network (PCANet) is an unsupervised parsimonious deep network, utilizing principal components as filters in its convolution layers. Albeit powerful, the PCANet consists of basic operations such as principal components and spatial pooling, which suffers from two fundamental problems. First, the principal components obtain information by transforming it to column vectors (which we call the amalgamated view), which incurs the loss of the spatial information in the data. Second, the generalized spatial pooling utilized in the PCANet induces feature redundancy and also fails to accommodate spatial statistics of natural images. In this research, we first propose a tensor-factorization based deep network called the Tensor Factorization Network (TFNet). The TFNet extracts features from the spatial structure of the data (which we call the minutiae view). We then show that the information obtained by the PCANet and the TFNet are distinctive and non-trivial but individually insufficient. This phenomenon necessitates the development of proposed HybridNet, which integrates the information discovery with the two views of the data. To enhance the discriminability of hybrid features, we propose Attn-HybridNet, which alleviates the feature redundancy by performing attention-based feature fusion. The significance of our proposed Attn-HybridNet is demonstrated on multiple real-world datasets where the features obtained with Attn-HybridNet achieves better classification performance over other popular baseline methods, demonstrating the effectiveness of the proposed technique.


title: Gradient Descent Ascent for Minimax Problems on Riemannian Manifolds

abstract: In the paper, we study a class of useful minimax problems on Riemanian manifolds and propose a class of effective Riemanian gradient-based methods to solve these minimax problems. Specifically, we propose an effective Riemannian gradient descent ascent (RGDA) algorithm for the deterministic minimax optimization. Moreover, we prove that our RGDA has a sample complexity of $O(\kappa^2\epsilon^{-2})$ for finding an $\epsilon$-stationary solution of the Geodesically-Nonconvex Strongly-Concave (GNSC) minimax problems, where $\kappa$ denotes the condition number. At the same time, we present an effective Riemannian stochastic gradient descent ascent (RSGDA) algorithm for the stochastic minimax optimization, which has a sample complexity of $O(\kappa^4\epsilon^{-4})$ for finding an $\epsilon$-stationary solution. To further reduce the sample complexity, we propose an accelerated Riemannian stochastic gradient descent ascent (Acc-RSGDA) algorithm based on the momentum-based variance-reduced technique. We prove that our Acc-RSGDA algorithm achieves a lower sample complexity of $\tilde{O}(\kappa^{4}\epsilon^{-3})$ in searching for an $\epsilon$-stationary solution of the GNSC minimax problems. Extensive experimental results on the robust distributional optimization and robust Deep Neural Networks (DNNs) training over Stiefel manifold demonstrate efficiency of our algorithms.


title: Surface and curvature properties of charged strangelets in compact objects

abstract: Droplets of absolutely stable strange quark matter (strangelets) immersed in a lepton background may be the energetically preferred composition of strange star crusts and of the interior of a new class of stars known as strangelet dwarfs. In this work we calculate the surface tension $\sigma$ and the curvature coefficient $\gamma$ of charged strangelets as a function of the baryon number density, the temperature, the chemical potential of trapped neutrinos, the strangelet size, the electric potential and the electric charge at their boundary. Strange quark matter in chemical equilibrium and with global electric charge neutrality is described within the MIT bag model. We focus on three different astrophysical scenarios, namely cold strange stars, proto strange stars and post merger strange stars. Finite size effects are implemented within the multiple reflection expansion framework. We find that $\sigma$ decreases significantly as the strangelet's boundary becomes more positively charged. This occurs because $\sigma$ is dominated by the contribution of $s$ quarks which are the most massive particles in the system. Negatively charged $s$-quarks are suppressed in strangelets with a large positive electric charge, diminishing their contribution to $\sigma$ and resulting in smaller values of the total $\sigma$. We verify that the more extreme astrophysical scenarios, with higher temperatures and higher neutrino chemical potentials, allow higher positive values of the strangelet's electric charge at the boundary and consequently smaller values of $\sigma$. In contrast, $\gamma$ is strongly dominated by the density of light ($u$ and $d$) quarks and is quite independent of the charge-per-baryon ratio, the temperature and neutrino trapping. We discuss the relative importance of surface and curvature effects as well as some astrophysical consequences of these results.


title: Similarity Based Stratified Splitting: an approach to train better classifiers

abstract: We propose a Similarity-Based Stratified Splitting (SBSS) technique, which uses both the output and input space information to split the data. The splits are generated using similarity functions among samples to place similar samples in different splits. This approach allows for a better representation of the data in the training phase. This strategy leads to a more realistic performance estimation when used in real-world applications. We evaluate our proposal in twenty-two benchmark datasets with classifiers such as Multi-Layer Perceptron, Support Vector Machine, Random Forest and K-Nearest Neighbors, and five similarity functions Cityblock, Chebyshev, Cosine, Correlation, and Euclidean. According to the Wilcoxon Sign-Rank test, our approach consistently outperformed ordinary stratified 10-fold cross-validation in 75\% of the assessed scenarios.


title: Invariant Representation Learning for Infant Pose Estimation with Small Data

abstract: Infant motion analysis is a topic with critical importance in early childhood development studies. However, while the applications of human pose estimation have become more and more broad, models trained on large-scale adult pose datasets are barely successful in estimating infant poses due to the significant differences in their body ratio and the versatility of their poses. Moreover, the privacy and security considerations hinder the availability of adequate infant pose data required for training of a robust model from scratch. To address this problem, this paper presents (1) building and publicly releasing a hybrid synthetic and real infant pose (SyRIP) dataset with small yet diverse real infant images as well as generated synthetic infant poses and (2) a multi-stage invariant representation learning strategy that could transfer the knowledge from the adjacent domains of adult poses and synthetic infant images into our fine-tuned domain-adapted infant pose (FiDIP) estimation model. In our ablation study, with identical network structure, models trained on SyRIP dataset show noticeable improvement over the ones trained on the only other public infant pose datasets. Integrated with pose estimation backbone networks with varying complexity, FiDIP performs consistently better than the fine-tuned versions of those models. One of our best infant pose estimation performers on the state-of-the-art DarkPose model shows mean average precision (mAP) of 93.6.


title: Machine learning for the diagnosis of Parkinson's disease: A systematic review

abstract: Diagnosis of Parkinson's disease (PD) is commonly based on medical observations and assessment of clinical signs, including the characterization of a variety of motor symptoms. However, traditional diagnostic approaches may suffer from subjectivity as they rely on the evaluation of movements that are sometimes subtle to human eyes and therefore difficult to classify, leading to possible misclassification. In the meantime, early non-motor symptoms of PD may be mild and can be caused by many other conditions. Therefore, these symptoms are often overlooked, making diagnosis of PD at an early stage challenging. To address these difficulties and to refine the diagnosis and assessment procedures of PD, machine learning methods have been implemented for the classification of PD and healthy controls or patients with similar clinical presentations (e.g., movement disorders or other Parkinsonian syndromes). To provide a comprehensive overview of data modalities and machine learning methods that have been used in the diagnosis and differential diagnosis of PD, in this study, we conducted a systematic literature review of studies published until February 14, 2020, using the PubMed and IEEE Xplore databases. A total of 209 studies were included, extracted for relevant information and presented in this systematic review, with an investigation of their aims, sources of data, types of data, machine learning methods and associated outcomes. These studies demonstrate a high potential for adaptation of machine learning methods and novel biomarkers in clinical decision making, leading to increasingly systematic, informed diagnosis of PD.


title: Quantum entanglement in nuclear Cooper pair tunneling with $\gamma$-rays

abstract: While Josephson-like junctions, transiently established in heavy ion collisions ($\tau_{coll}\approx10^{-21}$ s) between superfluid nuclei --through which Cooper pair tunneling ($Q$-value $Q_{2n}$) proceeds mainly in terms of successive transfer of entangled nucleons-- is deprived from the macroscopic aspects of a supercurrent, it displays many of the special effects associated with spontaneous symmetry breaking in gauge space (BCS condensation), which can be studied in terms of individual quantum states and of tunneling of single Cooper pairs. From the results of studies of one- and two- neutron transfer reactions carried out at energies below the Coulomb barrier we estimate the value of the mean square radius (correlation length) of the nuclear Cooper pair. A quantity related to the largest distance of closest approach for which the absolute two-nucleon tunneling cross section is of the order of the single-particle one. Furthermore, emission of $\gamma$-rays of (Josephson) frequency $\nu_J=Q_{2n}/h$ distributed over an energy range $\hbar/\tau_{coll}$ is predicted.


title: Quasi-maximum Likelihood Inference for Linear Double Autoregressive Models

abstract: This paper investigates the quasi-maximum likelihood inference including estimation, model selection and diagnostic checking for linear double autoregressive (DAR) models, where all asymptotic properties are established under only fractional moment of the observed process. We propose a Gaussian quasi-maximum likelihood estimator (G-QMLE) and an exponential quasi-maximum likelihood estimator (E-QMLE) for the linear DAR model, and establish the consistency and asymptotic normality for both estimators. Based on the G-QMLE and E-QMLE, two Bayesian information criteria are proposed for model selection, and two mixed portmanteau tests are constructed to check the adequacy of fitted models. Moreover, we compare the proposed G-QMLE and E-QMLE with the existing doubly weighted quantile regression estimator in terms of the asymptotic efficiency and numerical performance. Simulation studies illustrate the finite-sample performance of the proposed inference tools, and a real example on the Bitcoin return series shows the usefulness of the proposed inference tools.


title: Tailoring interface mixing and magnetic properties in (111) Permalloy/Pt multilayers

abstract: We present deposition and characterization of multilayers consisting of 20 repetitions of 15 $\r{A}$ thick permalloy Ni$_{80}$Fe$_{20}$ at. \% (Py) and 5 $\r{A}$ Pt. The samples were prepared by two different sputter deposition methods, namely dc magnetron sputtering (dcMS) and high power impulse magnetron sputtering (HiPIMS), that represent low and moderate ionized flux fraction of the film forming material, respectively, for deposition of the Py layers. The effect of substrate roughness, working gas pressure and sputter power on the in-plane uniaxial magnetic anisotropy of the films are studied. The multilayers were characterized by X-ray reflectivity and diffraction, and by magneto-optical Kerr effect (MOKE). It is shown that HiPIMS deposition produces multilayers with unique surface roughness regardless of the substrate surface roughness. Multilayers prepared by both dcMS and HiPIMS deposition present a strong (111) texture normal to the film plane. The results show that utilizing HiPIMS for deposition of the Py layer leads to a minimum interface mixing between individual layers compared to dcMS deposition performed at sputter power. This is associated with the smooth surface of Py deposited by HiPIMS. However, this sharp interface results in higher coercivity and an opening in the hard axis hysteresis loops while multilayers with intermixing present well defined in-plane uniaxial anisotropy i.e. a linear hard axis. Comparison with Py/Cu and Py/CuPt multilayers, prepared under identical conditions using HiPIMS, suggests that poor in-plane uniaxial anisotropy is obtained in the Py/Pt case, caused by the inverse magnetostriction arising from the large lattice mismatch between Py and Pt. The Py/Pt multilayers that exhibit interface mixing have a more relaxed interface and thus presents negligible inverse magnetostriction and have better defined anisotropy.


title: Effective field theory analysis of boson-trimer bond lengths to next-to-leading order

abstract: Cold Helium atoms are a unique system where a single excited three-body Efimov state occurs, naturally, without the need for an external magnetic field. While three-body bound state energies of cold Helium atoms have previously been investigated, recent experimental techniques have allowed their structure to also be studied. The weak interaction between Helium atoms leads to a helium-helium (dimer) scattering length, $a$, much larger than the helium-helium effective range of interaction, $r$. This feature is exploited in a theory that systematically expands observables in powers of $r/a$, known as short range effective field theory (srEFT), which has been used successfully to investigate properties of cold atom systems. Using srEFT we investigate the average bond length of atoms in the three-body ground state and excited Efimov state of cold Helium atoms. At leading-order (next-to-leading order) in srEFT, we find the average bond length of the $^4$He trimer ground state is 8.35(33) \r{A} (10.29(2) \r{A}) and the average bond length of the excited $^4$He trimer Efimov state is 103(4) \r{A} (105.3(2) \r{A}).


title: Comments on contact terms and conformal manifolds in the AdS/CFT correspondence

abstract: We study the contact terms that appear in the correlation functions of exactly marginal operators using the AdS/CFT correspondence. It is known that CFT with an exactly marginal deformation requires the existence of the contact terms with their coefficients having a geometrical interpretation in the context of conformal manifolds. We show that the AdS/CFT correspondence captures properly the mathematical structure of the correlation functions that is expected from the CFT analysis. For this purpose, we employ holographic RG to formulate a most general setup in the bulk for describing an exactly marginal deformation. The resultant bulk equations of motion are nonlinear and solved perturbatively to obtain the on-shell action. We compute three- and four-point functions of the exactly marginal operators using the GKP-Witten prescription, and show that they match with the expected results precisely. The cut-off surface prescription in the bulk serves as a regularization scheme for conformal perturbation theory in the boundary CFT. As an application, we examine a double OPE limit of the four-point functions. The anomalous dimensions of double trace operators are written in terms of the geometrical data of a conformal manifold.


title: SAR: Scale-Aware Restoration Learning for 3D Tumor Segmentation

abstract: Automatic and accurate tumor segmentation on medical images is in high demand to assist physicians with diagnosis and treatment. However, it is difficult to obtain massive amounts of annotated training data required by the deep-learning models as the manual delineation process is often tedious and expertise required. Although self-supervised learning (SSL) scheme has been widely adopted to address this problem, most SSL methods focus only on global structure information, ignoring the key distinguishing features of tumor regions: local intensity variation and large size distribution. In this paper, we propose Scale-Aware Restoration (SAR), a SSL method for 3D tumor segmentation. Specifically, a novel proxy task, i.e. scale discrimination, is formulated to pre-train the 3D neural network combined with the self-restoration task. Thus, the pre-trained model learns multi-level local representations through multi-scale inputs. Moreover, an adversarial learning module is further introduced to learn modality invariant representations from multiple unlabeled source datasets. We demonstrate the effectiveness of our methods on two downstream tasks: i) Brain tumor segmentation, ii) Pancreas tumor segmentation. Compared with the state-of-the-art 3D SSL methods, our proposed approach can significantly improve the segmentation accuracy. Besides, we analyze its advantages from multiple perspectives such as data efficiency, performance, and convergence speed.


title: Perceptual grouping explains constellations across cultures

abstract: Cultures around the world organise stars into constellations, or asterisms, and these groupings are often considered to be arbitrary and culture-specific. Yet there are striking similarities in asterisms across cultures, and groupings such as Orion, the Big Dipper, the Pleiades and the Southern Cross are widely recognized across many different cultures. Psychologists have informally suggested that these shared patterns are explained by Gestalt laws of grouping, but there have been no systematic attempts to catalog asterisms that recur across cultures or to explain the perceptual basis of these groupings. Here we compile data from 27 cultures around the world and show that a simple computational model of perceptual grouping accounts for many of the recurring cross-cultural asterisms. Our results suggest that basic perceptual principles account for more of the structure of asterisms across cultures than previously acknowledged and highlight ways in which specific cultures depart from this shared baseline.


title: Identifying and mitigating noise sources in precision pulsar timing data sets

abstract: Pulsar timing array projects measure the pulse arrival times of millisecond pulsars for the primary purpose of detecting nanohertz-frequency gravitational waves. The measurements include contributions from a number of astrophysical and instrumental processes, which can either be deterministic or stochastic. It is necessary to develop robust statistical and physical models for these noise processes because incorrect models diminish sensitivity and may cause a spurious gravitational wave detection. Here we characterise noise processes for the 26 pulsars in the second data release of the Parkes Pulsar Timing Array using Bayesian inference. In addition to well-studied noise sources found previously in pulsar timing array data sets such as achromatic timing noise and dispersion measure variations, we identify new noise sources including time-correlated chromatic noise that we attribute to variations in pulse scattering. We also identify "exponential dip" events in four pulsars, which we attribute to magnetospheric effects as evidenced by pulse profile shape changes observed for three of the pulsars. This includes an event in PSR J1713$+$0747, which had previously been attributed to interstellar propagation. We present noise models to be used in searches for gravitational waves. We outline a robust methodology to evaluate the performance of noise models and identify unknown signals in the data. The detection of variations in pulse profiles highlights the need to develop efficient profile domain timing methods.


title: Bayesian inference under small sample size -- A noninformative prior approach

abstract: A Bayesian inference method for problems with small samples and sparse data is presented in this paper. A general type of prior ($\propto 1/\sigma^{q}$) is proposed to formulate the Bayesian posterior for inference problems under small sample size. It is shown that this type of prior can represents a broad range of priors such as classical noninformative priors and asymptotically locally invariant priors. It is further shown in this study that such priors can be derived as the limiting states of Normal-Inverse-Gamma conjugate priors, allowing for analytical evaluations of Bayesian posteriors and predictors. The performance of different noninformative priors under small sample size is compared using the global likelihood. The method of Laplace approximation is employed to evaluate the global likelihood. A numerical linear regression problem and a realistic fatigue reliability problem are used to demonstrate the method and identify the optimal noninformative prior. Results indicate the predictor using Jeffreys' prior outperforms others. The advantage of the noninformative Bayesian estimator over the regular least square estimator under small sample size is shown.


title: Tracing the evolution of physics with a keyword co-occurrence network

abstract: Describing the evolution of science is a salient work not only for revealing the scientific trend but also for establishing a scientific classification system. In this paper, we investigate the evolution of science by observing the structure and change of keyword co-occurrence networks. Starting from seven target physics fields and their initial keywords selected by experts from the Korean Physical Society, we generate keyword co-occurrence networks better to capture topological structure with our proposed approach. In this way, we can construct a more relevant and abundant keyword network from a small set of initial keywords. With these networks, we successfully identify the scientific sub-field by detecting communities and extracting core keywords of each community. Furthermore, we trace the temporal evolution of sub-fields with the time-snapshot keyword network, the resultant temporal change of the community membership explains the evolution of the research field well. Our approach for tracing the evolution of the research field with a keyword co-occurrence network can shed light on identifying and assessing the evolution of science.


title: UV mission planning under uncertainty in vehicles' availability

abstract: Heterogeneous unmanned vehicles (UVs) are used in various defense and civil applications. Some of the civil applications of UVs for gathering data and monitoring include civil infrastructure management, agriculture, public safety, law enforcement, disaster relief, and transportation. This paper presents a two-stage stochastic model for a fuel-constrained UV mission planning problem with multiple refueling stations under uncertainty in availability of UVs. Given a set of points of interests (POI), a set of refueling stations for UVs, and a base station where the UVs are stationed and their availability is random, the objective is to determine route for each UV starting and terminating at the base station such that overall incentives collected by visiting POIs is maximized. We present an outer approximation based decomposition algorithm to solve large instances, and perform extensive computational experiments using random instances. Additionally, a data driven simulation study is performed using robot operating system (ROS) framework to corroborate the use of the stochastic programming approach.


title: FaiR-N: Fair and Robust Neural Networks for Structured Data

abstract: Fairness in machine learning is crucial when individuals are subject to automated decisions made by models in high-stake domains. Organizations that employ these models may also need to satisfy regulations that promote responsible and ethical A.I. While fairness metrics relying on comparing model error rates across subpopulations have been widely investigated for the detection and mitigation of bias, fairness in terms of the equalized ability to achieve recourse for different protected attribute groups has been relatively unexplored. We present a novel formulation for training neural networks that considers the distance of data points to the decision boundary such that the new objective: (1) reduces the average distance to the decision boundary between two groups for individuals subject to a negative outcome in each group, i.e. the network is more fair with respect to the ability to obtain recourse, and (2) increases the average distance of data points to the boundary to promote adversarial robustness. We demonstrate that training with this loss yields more fair and robust neural networks with similar accuracies to models trained without it. Moreover, we qualitatively motivate and empirically show that reducing recourse disparity across groups also improves fairness measures that rely on error rates. To the best of our knowledge, this is the first time that recourse capabilities across groups are considered to train fairer neural networks, and a relation between error rates based fairness and recourse based fairness is investigated.


title: Effects of Pycnonuclear Reactions on White Dwarf Stellar Evolution

abstract: This document presents a numerical study of the effects of high density nuclear reactions, pycnonuclear reactions, on the evolution of white dwarfs that accrete matter from a companion star. Primarily we seek observable properties that might be different when we include these nuclear reactions with varying microphysical assumptions. These different assumptions include effective nucleon-nucleon interactions, lattice structures and crystal polarization characteristics. Our results indicate that, although we find some significant differences in pycnonuclear reaction rates, the differences do not result in observable differences in the white dwarf evolution. Secondarily we examine the differences in observable properties when pycnonuclear reactions are assumed to happen and when they are assumed to not happen. In this case, our calculations indicate there can be observable differences in the radius, $R$, and the effective temperature, $T_{eff}$, at the stopping condition we use for our simulations, $L_{nuc} > 10^{8}\thinspace \rm{L}_{\odot}$, that is the total rate of energy released by nuclear fusion is greater than $10^{8}$ solar luminosities. Thirdly we explore the often neglected effect of temperature enhancement to pycnonuclear rates.


title: Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks

abstract: Supertagging is conventionally regarded as an important task for combinatory categorial grammar (CCG) parsing, where effective modeling of contextual information is highly important to this task. However, existing studies have made limited efforts to leverage contextual features except for applying powerful encoders (e.g., bi-LSTM). In this paper, we propose attentive graph convolutional networks to enhance neural CCG supertagging through a novel solution of leveraging contextual information. Specifically, we build the graph from chunks (n-grams) extracted from a lexicon and apply attention over the graph, so that different word pairs from the contexts within and across chunks are weighted in the model and facilitate the supertagging accordingly. The experiments performed on the CCGbank demonstrate that our approach outperforms all previous studies in terms of both supertagging and parsing. Further analyses illustrate the effectiveness of each component in our approach to discriminatively learn from word pairs to enhance CCG supertagging.


title: Mass Estimation in Manipulation Tasks of Domestic Service Robots using Fault Reconstruction Techniques

abstract: Manipulation is a key capability in domestic service robots, as can be seen in the rulebooks of last Robocup@Home editions. Currently, object recognition is performed based mostly on visual information. Some robots use also 3D information such as point clouds or laser scans but, to the knowledge of authors, robots don't use physical properties to improve object recognition. Estimation of an object's weight during a manipulation task is something new in the @Home league and such ability can improve performance of domestic service robots. In this work we propose to estimate the weight of the grasped object using Sliding Mode Observers. If we consider the manipulator without load as the nominal system and object's weight as a fault signal, we can estimate such weight by an appropriate filtering of the output error injection term of the sliding mode observer. To implement our proposal we used MATLAB and Simulink Robotics System Toolbox, ROS Toolbox and Simscape. To improve computation time we exported all algorithms to standalone ROS nodes from Simulink models. Tests were performed using two platforms: Justina's left manipulator (a robot developed at Biorobotics Laboratory, UNAM) and Neuronics Katana manipulators. We present results in simulation and discuss the performance of the proposed system and the possible sources of error. Finally we present our conclusions and state the future work.


title: Map-Based Temporally Consistent Geolocalization through Learning Motion Trajectories

abstract: In this paper, we propose a novel trajectory learning method that exploits motion trajectories on topological map using recurrent neural network for temporally consistent geolocalization of object. Inspired by human's ability to both be aware of distance and direction of self-motion in navigation, our trajectory learning method learns a pattern representation of trajectories encoded as a sequence of distances and turning angles to assist self-localization. We pose the learning process as a conditional sequence prediction problem in which each output locates the object on a traversable path in a map. Considering the prediction sequence ought to be topologically connected in the graph-structured map, we adopt two different hypotheses generation and elimination strategies to eliminate disconnected sequence prediction. We demonstrate our approach on the KITTI stereo visual odometry dataset which is a city-scale environment and can generate trajectory with metric information. The key benefits of our approach to geolocalization are that 1) we take advantage of powerful sequence modeling ability of recurrent neural network and its robustness to noisy input, 2) only require a map in the form of a graph and simply use an affordable sensor that generates motion trajectory and 3) do not need initial position. The experiments show that the motion trajectories can be learned by training an recurrent neural network, and temporally consistent geolocation can be predicted with both of the proposed strategies.


title: Searching for MHz Gravitational Waves from Harmonic Sources

abstract: A MHz gravitational wave search for harmonic sources was conducted using a 704-hr dataset obtained from the Holometer, a pair of 40-meter power recycled Michelson interferometers. Our search was designed to look for cosmic string loops and eccentric black hole binaries in an entirely unexplored frequency range from 1 to 25 MHz. The measured cross-spectral density between both interferometers was used to perform four different searches. First, we search to identify any fundamental frequencies bins that have excess power above 5$\sigma$. Second, we reduce the per-bin threshold on any individual frequency bin by employing that a fundamental frequency and its harmonics all collectively lie above a threshold. We vary the number of harmonics searched over from $n= 4$ up to $n=23$. Third, we perform an agnostic approach to identify harmonic candidates that may have a single contaminated frequency bin or follow a power-law dependence. Lastly, we expand on the agnostic approach for individual candidates and search for a potential underlying population of harmonic sources. Each method was tested on the interferometer dataset, as well as a dark noise, photon shot-noise-limited, and simulated Gaussian-noise datasets. We conclude that these four different search methods did not find any candidate frequencies that would be consistent with harmonic sources. This work presents a new way of searching for gravitational wave candidates, which allowed us to survey a previously unexplored frequency range.


title: ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesis

abstract: To assist human review process, we build a novel ReviewRobot to automatically assign a review score and write comments for multiple categories such as novelty and meaningful comparison. A good review needs to be knowledgeable, namely that the comments should be constructive and informative to help improve the paper; and explainable by providing detailed evidence. ReviewRobot achieves these goals via three steps: (1) We perform domain-specific Information Extraction to construct a knowledge graph (KG) from the target paper under review, a related work KG from the papers cited by the target paper, and a background KG from a large collection of previous papers in the domain. (2) By comparing these three KGs, we predict a review score and detailed structured knowledge as evidence for each review category. (3) We carefully select and generalize human review sentences into templates, and apply these templates to transform the review scores and evidence into natural language comments. Experimental results show that our review score predictor reaches 71.4%-100% accuracy. Human assessment by domain experts shows that 41.7%-70.5% of the comments generated by ReviewRobot are valid and constructive, and better than human-written ones for 20% of the time. Thus, ReviewRobot can serve as an assistant for paper reviewers, program chairs and authors.


title: Three-dimensional reconstruction of integrated implosion targets from simulated small-angle pinhole images

abstract: To indirectly evaluate the asymmetry of the radiation drive under limited measurement conditions in inertial confinement fusion research, we have proposed an integral method to approximate the three-dimensional self-radiation distribution of the compressed plasma core using only four pinhole images from a single laser entrance hole at a maximum projection angle of 10{\deg}. The simultaneous algebraic reconstruction technique (SART) that uses spatial constraints provided by the prior structural information and the central pinhole image is utilized in the simulation. The simulation results showed that the normalized mean square deviation between the original distribution and reconstruction results of the central radiation area of the simulated cavity was 0.4401, and the structural similarity of the cavity radiation distribution was 0.5566. Meanwhile, using more diagnostic holes could achieve better structural similarity and lower reconstruction error. In addition, the results indicated that our new proposed method could reconstruct the distribution of a compressed plasma core in a vacuum hohlraum with high accuracy.


title: To be Robust or to be Fair: Towards Fairness in Adversarial Training

abstract: Adversarial training algorithms have been proved to be reliable to improve machine learning models' robustness against adversarial examples. However, we find that adversarial training algorithms tend to introduce severe disparity of accuracy and robustness between different groups of data. For instance, a PGD adversarially trained ResNet18 model on CIFAR-10 has 93% clean accuracy and 67% PGD l-infty-8 robust accuracy on the class "automobile" but only 65% and 17% on the class "cat". This phenomenon happens in balanced datasets and does not exist in naturally trained models when only using clean samples. In this work, we empirically and theoretically show that this phenomenon can happen under general adversarial training algorithms which minimize DNN models' robust errors. Motivated by these findings, we propose a Fair-Robust-Learning (FRL) framework to mitigate this unfairness problem when doing adversarial defenses. Experimental results validate the effectiveness of FRL.


title: Asking Crowdworkers to Write Entailment Examples: The Best of Bad Options

abstract: Large-scale natural language inference (NLI) datasets such as SNLI or MNLI have been created by asking crowdworkers to read a premise and write three new hypotheses, one for each possible semantic relationships (entailment, contradiction, and neutral). While this protocol has been used to create useful benchmark data, it remains unclear whether the writing-based annotation protocol is optimal for any purpose, since it has not been evaluated directly. Furthermore, there is ample evidence that crowdworker writing can introduce artifacts in the data. We investigate two alternative protocols which automatically create candidate (premise, hypothesis) pairs for annotators to label. Using these protocols and a writing-based baseline, we collect several new English NLI datasets of over 3k examples each, each using a fixed amount of annotator time, but a varying number of examples to fit that time budget. Our experiments on NLI and transfer learning show negative results: None of the alternative protocols outperforms the baseline in evaluations of generalization within NLI or on transfer to outside target tasks. We conclude that crowdworker writing still the best known option for entailment data, highlighting the need for further data collection work to focus on improving writing-based annotation processes.


title: Spherical spin glass model with external field

abstract: We analyze the free energy and the overlaps in the 2-spin spherical Sherrington Kirkpatrick spin glass model with an external field for the purpose of understanding the transition between this model and the one without an external field. We compute the limiting values and fluctuations of the free energy as well as three types of overlaps in the setting where the strength of the external field goes to zero as the dimension of the spin variable grows. In particular, we consider overlaps with the external field, the ground state, and a replica. Our methods involve a contour integral representation of the partition function along with random matrix techniques. We also provide computations for the matching between different scaling regimes. Finally, we discuss the implications of our results for susceptibility and for the geometry of the Gibbs measure. Some of the findings of this paper are confirmed rigorously by Landon and Sosoe in their recent paper which came out independently and simultaneously.


title: Infinite-Dimensional Algebraic $\mathfrak{Spin}$($N$) Structure in Extended/Higher Dimensional SUSY Holoraumy for Valise and On-Shell Supermultiplet Representations

abstract: We explore the relationship between holoraumy and Hodge duality beyond four dimensions. We find this relationship to be ephemeral beyond six dimensions: it is not demanded by the structure of such supersymmetrical theories. In four dimensions for the case of the vector-tensor $\cal N$ = 4 multiplet, however, we show that such a linkage is present. Reduction to 1D theories presents evidence for a linkage from higher-dimensional supersymmetry to an infinite-dimensional algebra extending $\mathfrak{Spin}(N)$.


title: On the rigidity of Souslin trees and their generic branches

abstract: We show it is consistent that there is a Souslin tree $S$ such that after forcing with $S$, $S$ is Kurepa and for all clubs $C \subset \omega_1$, $S\upharpoonright C$ is rigid. This answers Fuchs's questions in Club degrees of rigidity and almost Kurepa trees. Moreover, we show it is consistent with $\diamondsuit$ that for every Souslin tree there is a dense $X \subset S$ which does not have a copy of $S$. This is related to a question due to Baumgartner.


title: Unifying the Concepts of Scattering and Structure Factor in Ordered and Disordered Samples

abstract: Scattering methods are widely used in many research areas to analyze and resolve material structures. Given the importance, a large number of full textbooks are devoted to this topic. However, technical details in experiments and disconnection between explanations from different perspectives often confuse and frustrate beginner students and researchers. To create an effective learning path, we review the core concepts about scattering and structure factor in this article in a self-contained way. Classical examples of scattering photography and spectroscopy are calculated. Sample CPU and GPU codes are provided to facilitate the understanding and application of these methods.


title: Model Selection for Cross-Lingual Transfer

abstract: Transformers that are pre-trained on multilingual corpora, such as, mBERT and XLM-RoBERTa, have achieved impressive cross-lingual transfer capabilities. In the zero-shot transfer setting, only English training data is used, and the fine-tuned model is evaluated on another target language. While this works surprisingly well, substantial variance has been observed in target language performance between different fine-tuning runs, and in the zero-shot setup, no target-language development data is available to select among multiple fine-tuned models. Prior work has relied on English dev data to select among models that are fine-tuned with different learning rates, number of steps and other hyperparameters, often resulting in suboptimal choices. In this paper, we show that it is possible to select consistently better models when small amounts of annotated data are available in auxiliary pivot languages. We propose a machine learning approach to model selection that uses the fine-tuned model's own internal representations to predict its cross-lingual capabilities. In extensive experiments we find that this method consistently selects better models than English validation data across twenty five languages (including eight low-resource languages), and often achieves results that are comparable to model selection using target language development data.


title: Effects of spin on constraining the seeds and growth of $\gtrsim 10^9M_\odot$ supermassive black holes in $z>6.5$ Quasars

abstract: The existence of $\gtrsim10^9M_\odot$ supermassive black holes (SMBHs) at redshift $z>6$ raises the problem of how such SMBHs can grow up within the cosmic time ($<1$\,Gyr) from small seed BHs. In this letter, we use the observations of $14$ Quasars at $z>6.5$ with mass estimates to constrain their seeds and early growth, by self-consistently considering the spin evolution and the possibility of super-Eddington accretion. We find that spin plays an important role in the growth of early SMBHs, and the constraints on seed mass and super-Eddington accretion fraction strongly depend on the assumed accretion history. If the accretion is coherent with single (or a small number of) episode(s), leading to high spins for the majority of accretion time, then the SMBH growth is relatively slow; and if the accretion is chaotic with many episodes and in each episode the total accreted mass is much less than the SMBH mass, leading to moderate/low spins, then the growth is relatively fast. The constraints on the seed mass and super-Eddington accretion fraction are degenerate. A significant fraction ($\gtrsim0.1\%-1\%$ in linear scale but $\sim 3-4$ dex in logarithmic scale for $10^3-10^4 M_\odot$ seeds) of super-Eddington accretion is required if the seed mass is not $\gg10^{5}M_\odot$, and the requirements of high seed-mass and/or super-Eddington accretion fraction are moderately relaxed if the accretion is chaotic.


title: Isolated singularities of Toda equations and cyclic Higgs bundles

abstract: This paper is the second part of our study on the Toda equations and the cyclic Higgs bundles associated to $r$-differentials over non-compact Riemann surfaces. We classify all the solutions up to boundedness around the isolated singularity of an $r$-differential under the assumption that the $r$-differential is meromorphic or has some type of essential singularity. As a result, for example, we classify all the solutions on ${\mathbb C}$ if the $r$-differential is a finite sum of the exponential of polynomials.


title: Single-Antenna-Based GPS Antijamming Method Exploiting Polarization Diversity

abstract: The vulnerability of Global Positioning System (GPS) receivers to jammers is a major concern owing to the extremely weak received signal power of GPS. Researches have been conducted on a variety of antenna array techniques to be used as countermeasures to GPS jammers, and their antijamming performance is known to be greater than that of single antenna methods. However, the application of antenna arrays remains limited because of their size, cost, and computational complexity. This study proposes and experimentally validates a novel space-time-polarization domain adaptive processing for a single-element dual-polarized antenna (STPAPS) by focusing on the polarization diversity of a dual-polarized antenna. The mathematical models of arbitrarily polarized signals received by dual-polarized antenna are derived, and an appropriate constraint matrix for dual-polarized-antenna-based GPS antijam is suggested. To reduce the computational complexity of the constraint matrix approach, the eigenvector constraint design scheme is adopted. The performance of STPAPS is quantitively and qualitatively evaluated through experiments as follows. 1) The carrier-to-noise-density ratio (C/N0) of STPAPS under synthetic jamming is demonstrated to be higher than that of the previous minimum mean squared error (MMSE) or minimum variance distortionless response (MVDR) based dual-polarized antenna methods. 2) The strengths and weaknesses of STPAPS are qualitatively compared with those of the previous single-element dual-polarized antenna methods that are not based on the MMSE or MVDR algorithms. 3) The characteristics of STPAPS (in terms of the directions and polarizations of the GPS and jamming signals) are compared with those of the conventional two-element single-polarized antenna array method, which has the same degree of freedom as that of STPAPS.


title: Learning to Attack with Fewer Pixels: A Probabilistic Post-hoc Framework for Refining Arbitrary Dense Adversarial Attacks

abstract: Deep neural network image classifiers are reported to be susceptible to adversarial evasion attacks, which use carefully crafted images created to mislead a classifier. Many adversarial attacks belong to the category of dense attacks, which generate adversarial examples by perturbing all the pixels of a natural image. To generate sparse perturbations, sparse attacks have been recently developed, which are usually independent attacks derived by modifying a dense attack's algorithm with sparsity regularisations, resulting in reduced attack efficiency. In this paper, we aim to tackle this task from a different perspective. We select the most effective perturbations from the ones generated from a dense attack, based on the fact we find that a considerable amount of the perturbations on an image generated by dense attacks may contribute little to attacking a classifier. Accordingly, we propose a probabilistic post-hoc framework that refines given dense attacks by significantly reducing the number of perturbed pixels but keeping their attack power, trained with mutual information maximisation. Given an arbitrary dense attack, the proposed model enjoys appealing compatibility for making its adversarial images more realistic and less detectable with fewer perturbations. Moreover, our framework performs adversarial attacks much faster than existing sparse attacks.


title: $\bar{B}\to X_s \gamma$ in BLMSSM

abstract: Applying the effective Lagrangian method, we study the Flavor Changing Neutral Current $b\to s\gamma$ within the minimal supersymmetric extension of the standard model where baryon and lepton numbers are local gauge symmetries. Constraints on the parameters are investigated numerically with the experimental data on branching ratio of $\bar{B}\to X_s\gamma$. Additionally, we present the corrections to direct CP-violation in $\bar{B}\rightarrow X_s\gamma$ and time-dependent CP-asymmetry in $B\rightarrow K^*\gamma$. With appropriate assumptions on parameters, we find the direct CP-violation $A_{CP}$ is very small, while one-loop contributions to $S_{K^*\gamma}$ can be significant.


title: BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover's Distance

abstract: Pre-trained language models (e.g., BERT) have achieved significant success in various natural language processing (NLP) tasks. However, high storage and computational costs obstruct pre-trained language models to be effectively deployed on resource-constrained devices. In this paper, we propose a novel BERT distillation method based on many-to-many layer mapping, which allows each intermediate student layer to learn from any intermediate teacher layers. In this way, our model can learn from different teacher layers adaptively for various NLP tasks. %motivated by the intuition that different NLP tasks require different levels of linguistic knowledge contained in the intermediate layers of BERT. In addition, we leverage Earth Mover's Distance (EMD) to compute the minimum cumulative cost that must be paid to transform knowledge from teacher network to student network. EMD enables the effective matching for many-to-many layer mapping. %EMD can be applied to network layers with different sizes and effectively measures semantic distance between the teacher network and student network. Furthermore, we propose a cost attention mechanism to learn the layer weights used in EMD automatically, which is supposed to further improve the model's performance and accelerate convergence time. Extensive experiments on GLUE benchmark demonstrate that our model achieves competitive performance compared to strong competitors in terms of both accuracy and model compression.


title: Magnetic Helicity Flux across Solar Active Region Photospheres: I. Hemispheric Sign Preference in Solar Cycle 24

abstract: A hemispheric preference in the dominant sign of magnetic helicity has been observed in numerous features in the solar atmosphere: i.e., left-handed/right-handed helicity in the northern/southern hemisphere. The relative importance of different physical processes which may contribute to the observed hemispheric sign preference (HSP) of magnetic helicity is still under debate. Here, we estimate magnetic helicity flux ($dH/dt$) across the photospheric surface for 4,802 samples of 1,105 unique active regions (ARs) that appeared over an 8-year period from 2010 to 2017 during solar cycle 24, using photospheric vector magnetic field observations by the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO). The estimates of $dH/dt$ show that 63% and 65% of the investigated AR samples in the northern and southern hemispheres, respectively, follow the HSP. We also find a trend that the HSP of $dH/dt$ increases from ~50-60% up to ~70-80% as ARs (1) appear at the earlier inclining phase of the solar cycle or higher latitudes; (2) have larger values of $|dH/dt|$, the total unsigned magnetic flux, and the average plasma flow speed. These observational findings support the enhancement of the HSP mainly by the Coriolis force acting on a buoyantly rising and expanding flux tube through the turbulent convection zone. In addition, the differential rotation on the solar surface as well as the tachocline $\alpha$-effect of flux-transport dynamo may reinforce the HSP for ARs at higher latitudes.


title: Session-layer Attack Traffic Classification by Program Synthesis

abstract: Writing classification rules to identify malicious network traffic is a time-consuming and error-prone task. Learning-based classification systems automatically extract such rules from positive and negative traffic examples. However, due to limitations in the representation of network traffic and the learning strategy, these systems lack both expressiveness to cover a range of attacks and interpretability in fully describing the attack traffic's structure at the session layer. This paper presents Sharingan system, which uses program synthesis techniques to generate network classification programs at the session layer. Sharingan accepts raw network traces as inputs, and reports potential patterns of the attack traffic in NetQRE, a domain specific language designed for specifying session-layer quantitative properties. Using Sharingan, network operators can better analyze the attack pattern due to the following advantages of Sharingan's learning process: (1) it requires minimal feature engineering, (2) it is amenable to efficient implementation of the learnt classifier, and (3) the synthesized program is easy to decipher and edit. We develop a range of novel optimizations that reduce the synthesis time for large and complex tasks to a matter of minutes. Our experiments show that Sharingan is able to correctly identify attacks from a diverse set of network attack traces and generates explainable outputs, while achieving accuracy comparable to state-of-the-art learning-based intrusion detection systems.


title: Unsupervised learning of topological phase transitions using Calinski-Harabaz index

abstract: Machine learning methods have been recently applied to learning phases of matter and transitions between them. Of particular interest is the topological phase transition, such as in the XY model, which can be difficult for unsupervised learning such as the principal component analysis. Recently, authors of [Nature Physics \textbf{15},790 (2019)] employed the diffusion-map method for identifying topological order and were able to determine the BKT phase transition of the XY model, specifically via the intersection of the average cluster distance $\bar{D}$ and the within cluster dispersion $\bar\sigma$ (when the different clusters vary from separation to mixing together). However, sometimes it is not easy to find the intersection if $\bar{D}$ or $\bar{\sigma}$ does not change too much due to topological constraint. In this paper, we propose to use the Calinski-Harabaz ($ch$) index, defined roughly as the ratio $\bar D/\bar \sigma$, to determine the critical points, at which the $ch$ index reaches a maximum or minimum value, or jump sharply. We examine the $ch$ index in several statistical models, including ones that contain a BKT phase transition. For the Ising model, the peaks of the quantity $ch$ or its components are consistent with the position of the specific heat maximum. For the XY model both on the square lattices and honeycomb lattices, our results of the $ch$ index show the convergence of the peaks over a range of the parameters $\varepsilon/\varepsilon_0$ in the Gaussian kernel. We also examine the generalized XY model with $q=2$ and $q=8$ and at the value away from the pure XY limit. Our method is thus useful to both topological and non-topological phase transitions and can achieve accuracy as good as supervised learning methods previously used in these models, and may be used for searching phases from experimental data.


title: Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring

abstract: Existing approaches for automated essay scoring and document representation learning typically rely on discourse parsers to incorporate discourse structure into text representation. However, the performance of parsers is not always adequate, especially when they are used on noisy texts, such as student essays. In this paper, we propose an unsupervised pre-training approach to capture discourse structure of essays in terms of coherence and cohesion that does not require any discourse parser or annotation. We introduce several types of token, sentence and paragraph-level corruption techniques for our proposed pre-training approach and augment masked language modeling pre-training with our pre-training method to leverage both contextualized and discourse information. Our proposed unsupervised approach achieves new state-of-the-art result on essay Organization scoring task.


title: Incorporating BERT into Parallel Sequence Decoding with Adapters

abstract: While large scale pre-trained language models such as BERT have achieved great success on various natural language understanding tasks, how to efficiently and effectively incorporate them into sequence-to-sequence models and the corresponding text generation tasks remains a non-trivial problem. In this paper, we propose to address this problem by taking two different BERT models as the encoder and decoder respectively, and fine-tuning them by introducing simple and lightweight adapter modules, which are inserted between BERT layers and tuned on the task-specific dataset. In this way, we obtain a flexible and efficient model which is able to jointly leverage the information contained in the source-side and target-side BERT models, while bypassing the catastrophic forgetting problem. Each component in the framework can be considered as a plug-in unit, making the framework flexible and task agnostic. Our framework is based on a parallel sequence decoding algorithm named Mask-Predict considering the bi-directional and conditional independent nature of BERT, and can be adapted to traditional autoregressive decoding easily. We conduct extensive experiments on neural machine translation tasks where the proposed method consistently outperforms autoregressive baselines while reducing the inference latency by half, and achieves $36.49$/$33.57$ BLEU scores on IWSLT14 German-English/WMT14 German-English translation. When adapted to autoregressive decoding, the proposed method achieves $30.60$/$43.56$ BLEU scores on WMT14 English-German/English-French translation, on par with the state-of-the-art baseline models.


title: Performance Evaluation and Modeling of Cryptographic Libraries for MPI Communications

abstract: In order for High-Performance Computing (HPC) applications with data security requirements to execute in the public cloud, the cloud infrastructure must ensure the privacy and integrity of data. To meet this goal, we consider incorporating encryption in the Message Passing Interface (MPI) library. We empirically evaluate four contemporary cryptographic libraries, OpenSSL, BoringSSL, Libsodium, and CryptoPP using micro-benchmarks and NAS parallel benchmarks on two different networking technologies, 10Gbps Ethernet and 40Gbps InfiniBand. We also develop accurate models that allow us to reason about the performance of encrypted MPI communication in different situations and give guidance on how to improve encrypted MPI performance.


title: Inverse Multiobjective Optimization Through Online Learning

abstract: We study the problem of learning the objective functions or constraints of a multiobjective decision making model, based on a set of sequentially arrived decisions. In particular, these decisions might not be exact and possibly carry measurement noise or are generated with the bounded rationality of decision makers. In this paper, we propose a general online learning framework to deal with this learning problem using inverse multiobjective optimization. More precisely, we develop two online learning algorithms with implicit update rules which can handle noisy data. Numerical results show that both algorithms can learn the parameters with great accuracy and are robust to noise.


title: Critical 2D Zakharov-Kuznetsov equation posed on a half-strip

abstract: An initial-boundary value problem for the critical generalized 2D Zakharov-Kuznetsov equation posed on a half-strip is considered. Existence, uniqueness and the exponential decay rate of global regular solutions for small initial data are established.


title: Hindsight Experience Replay with Kronecker Product Approximate Curvature

abstract: Hindsight Experience Replay (HER) is one of the efficient algorithm to solve Reinforcement Learning tasks related to sparse rewarded environments.But due to its reduced sample efficiency and slower convergence HER fails to perform effectively. Natural gradients solves these challenges by converging the model parameters better. It avoids taking bad actions that collapse the training performance. However updating parameters in neural networks requires expensive computation and thus increase in training time. Our proposed method solves the above mentioned challenges with better sample efficiency and faster convergence with increased success rate. A common failure mode for DDPG is that the learned Q-function begins to dramatically overestimate Q-values, which then leads to the policy breaking, because it exploits the errors in the Q-function. We solve this issue by including Twin Delayed Deep Deterministic Policy Gradients(TD3) in HER. TD3 learns two Q-functions instead of one and it adds noise tothe target action, to make it harder for the policy to exploit Q-function errors. The experiments are done with the help of OpenAis Mujoco environments. Results on these environments show that our algorithm (TDHER+KFAC) performs better inmost of the scenarios


title: A general Chevalley formula for semi-infinite flag manifolds and quantum K-theory

abstract: We give a Chevalley formula for an arbitrary weight for the torus-equivariant $K$-group of semi-infinite flag manifolds, which is expressed in terms of the quantum alcove model. As an application, we prove the Chevalley formula for an anti-dominant fundamental weight for the (small) torus-equivariant quantum $K$-theory $QK_{T}(G/B)$ of an (ordinary) flag manifold $G/B$; this has been a longstanding conjecture about the multiplicative structure of $QK_{T}(G/B)$. In type $A_{n-1}$, we prove that the so-called quantum Grothendieck polynomials indeed represent (opposite) Schubert classes in the (non-equivariant) quantum $K$-theory $QK(SL_{n}/B)$; we also obtain very explicit information about the coefficients in the respective Chevalley formula.


title: Multi-layer Residual Sparsifying Transform (MARS) Model for Low-dose CT Image Reconstruction

abstract: Signal models based on sparse representations have received considerable attention in recent years. On the other hand, deep models consisting of a cascade of functional layers, commonly known as deep neural networks, have been highly successful for the task of object classification and have been recently introduced to image reconstruction. In this work, we develop a new image reconstruction approach based on a novel multi-layer model learned in an unsupervised manner by combining both sparse representations and deep models. The proposed framework extends the classical sparsifying transform model for images to a Multi-lAyer Residual Sparsifying transform (MARS) model, wherein the transform domain data are jointly sparsified over layers. We investigate the application of MARS models learned from limited regular-dose images for low-dose CT reconstruction using Penalized Weighted Least Squares (PWLS) optimization. We propose new formulations for multi-layer transform learning and image reconstruction. We derive an efficient block coordinate descent algorithm to learn the transforms across layers, in an unsupervised manner from limited regular-dose images. The learned model is then incorporated into the low-dose image reconstruction phase. Low-dose CT experimental results with both the XCAT phantom and Mayo Clinic data show that the MARS model outperforms conventional methods such as FBP and PWLS methods based on the edge-preserving (EP) regularizer in terms of two numerical metrics (RMSE and SSIM) and noise suppression. Compared with the single-layer learned transform (ST) model, the MARS model performs better in maintaining some subtle details.


title: Customer Support Ticket Escalation Prediction using Feature Engineering

abstract: Understanding and keeping the customer happy is a central tenet of requirements engineering. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. If insufficient attention is given to support issues, however, their escalation to management becomes time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. Our work provides a step towards simplifying the job of support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, we used a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implemented these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. Finally, in addition to these research evaluation activities, we compared the performance of our support ticket model with that of a model developed with no feature engineering; the support ticket model features outperformed the non-engineered model. The artifacts created in this research are designed to serve as a starting place for organizations interested in predicting support ticket escalations, and for future researchers to build on to advance research in escalation prediction.


title: Strongly mixing systems are almost strongly mixing of all orders

abstract: We prove that any strongly mixing action of a countable abelian group on a probability space has higher order mixing properties. This is achieved via introducing and utilizing $\mathcal R$-limits, a notion of convergence which is based on the classical Ramsey Theorem. $\mathcal R$-limits are intrinsically connected with a new combinatorial notion of largeness which is similar to but has stronger properties than the classical notions of uniform density one and IP$^*$. While the main goal of this paper is to establish a $\textit{universal}$ property of strongly mixing actions of countable abelian groups, our results, when applied to $\mathbb Z$-actions, offer a new way of dealing with strongly mixing transformations. In particular, we obtain several new characterizations of strong mixing for $\mathbb Z$-actions, including a result which can be viewed as the analogue of the weak mixing of all orders property established by Furstenberg in the course of his proof of Szemer\'edi's theorem. We also demonstrate the versatility of $\mathcal R$-limits by obtaining new characterizations of higher order weak and mild mixing for actions of countable abelian groups.


title: Treed distributed lag nonlinear models

abstract: In studies of maternal exposure to air pollution a children's health outcome is regressed on exposures observed during pregnancy. The distributed lag nonlinear model (DLNM) is a statistical method commonly implemented to estimate an exposure-time-response function when it is postulated the exposure effect is nonlinear. Previous implementations of the DLNM estimate an exposure-time-response surface parameterized with a bivariate basis expansion. However, basis functions such as splines assume smoothness across the entire exposure-time-response surface, which may be unrealistic in settings where the exposure is associated with the outcome only in a specific time window. We propose a framework for estimating the DLNM based on Bayesian additive regression trees. Our method operates using a set of regression trees that each assume piecewise constant relationships across the exposure-time space. In a simulation, we show that our model outperforms spline-based models when the exposure-time surface is not smooth, while both methods perform similarly in settings where the true surface is smooth. Importantly, the proposed approach is lower variance and more precisely identifies critical windows during which exposure is associated with a future health outcome. We apply our method to estimate the association between maternal exposure to PM$_{2.5}$ and birth weight in a Colorado USA birth cohort.


title: Re-Transmission Diversity Multiple Access based on SIC and HARQ-IR

abstract: We consider multiple access with re-transmission diversity (RTxD) based on a hybrid automatic request (HARQ) protocol with incremental redundancy (IR) in this paper. In order to mitigate multiple access interference (MAI), we employ successive interference cancellation (SIC) at a receiver and derive conditions that all the signals from active users can be successfully decoded within a certain number of re-transmissions of IR blocks. We consider two special cases, and based on them we derive two multichannel random access schemes that have subchannels in the power and rate domains. Through the analysis and simulations, we can show that the proposed RTxD random access schemes can outperform other existing similar RTxD random access schemes.


title: Two-proton radioactivity of exotic nuclei beyond proton drip-line

abstract: To search for new candidates of the true and simultaneous two-proton ($2p$) radioactivity, the $2p$ decay energies (\textit{Q}$_{2p}$) are extracted by the Weizs\"{a}cker-Skyrme-4 (WS4) model, the finite-range droplet model (FRDM), the Kourra-Tachibaba-Uno-Yamada (KTUY) model and the Hartree-Fock-Bogoliubov mean-field model with the BSk29 Skyrme interaction (HFB29). Then, the $2p$ radioactivity half-lives are calculated within the generalized liquid drop model (GLDM) by inputting the four types of \textit{Q}$_{2p}$ values. By the energy and half-life constraints, it is found that the probable $2p$ decay candidates are the nuclei beyond the proton-drip line in the region of \textit{Z} $<$50 or \textit{Z}$\leq 50$ based on each nuclear mass model. In the region beyond \textit{Z}=50, the $2p$-decaying candidates are predicted only using the HFB29 mass model. Finally, the competition between the true $2p$ radioactivity and $\alpha$-decay for the nuclei above the \textit{N}=\textit{Z}=50 shell closures is discussed. It is shown that $^{101}$Te, $^{111}$Ba and $^{114}$Ce prefer to $2p$ radioactivity and the dominant decay mode of $^{107}$Xe and $^{116}$Ce is $\alpha$-decay.


title: Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance

abstract: Recent advances in automatic evaluation metrics for text have shown that deep contextualized word representations, such as those generated by BERT encoders, are helpful for designing metrics that correlate well with human judgements. At the same time, it has been argued that contextualized word representations exhibit sub-optimal statistical properties for encoding the true similarity between words or sentences. In this paper, we present two techniques for improving encoding representations for similarity metrics: a batch-mean centering strategy that improves statistical properties; and a computationally efficient tempered Word Mover Distance, for better fusion of the information in the contextualized word representations. We conduct numerical experiments that demonstrate the robustness of our techniques, reporting results over various BERT-backbone learned metrics and achieving state of the art correlation with human ratings on several benchmarks.


title: Antiphase Oscillations in the Time-Resolved Spin Structure Factor of a Photoexcited Mott Insulator

abstract: Motivated by the recent development of time-resolved resonant-inelastic x-ray scattering (TRRIXS) in photoexcited antiferromagnetic Mott insulators, we numerically investigate momentum-dependent transient spin dynamics in a half-filled Hubbard model on a square lattice. After turning off a pumping photon pulse, the intensity of a dynamical spin structure factor temporally oscillates with frequencies determined by the energy of two magnons in the antiferromagnetic Mott insulator. We find an antiphase behavior in the oscillations between two orthogonal momentum directions, parallel and perpendicular to the electric field of a pump pulse. The phase difference comes from the $B_{1g}$ channel of the two-magnon excitation. Observing the antiphase oscillations will be a big challenge for TRRIXS experiments when their time resolution will be improved by more than an order of magnitude.


title: Real-Time Detection of Simulator Sickness in Virtual Reality Games Based on Players' Psychophysiological Data during Gameplay

abstract: Virtual Reality (VR) technology has been proliferating in the last decade, especially in the last few years. However, Simulator Sickness (SS) still represents a significant problem for its wider adoption. Currently, the most common way to detect SS is using the Simulator Sickness Questionnaire (SSQ). SSQ is a subjective measurement and is inadequate for real-time applications such as VR games. This research aims to investigate how to use machine learning techniques to detect SS based on in-game characters' and users' physiological data during gameplay in VR games. To achieve this, we designed an experiment to collect such data with three types of games. We trained a Long Short-Term Memory neural network with the dataset eye-tracking and character movement data to detect SS in real-time. Our results indicate that, in VR games, our model is an accurate and efficient way to detect SS in real-time.


title: Tail asymptotics for the bivariate equi-skew Variance-Gamma distribution

abstract: We derive the asymptotic rate of decay to zero of the tail dependence of the bivariate skew Variance Gamma (VG) distribution under the equal-skewness condition, as an explicit regularly varying function. Our development is in terms of a slightly more general bivariate skew Generalized Hyperbolic (GH) distribution. Our initial reduction of the bivariate problem to a univariate one is motivated by our earlier study of tail dependence rate for the bivariate skew normal distribution


title: An Analysis of Robustness of Non-Lipschitz Networks

abstract: Despite significant advances, deep networks remain highly susceptible to adversarial attack. One fundamental challenge is that small input perturbations can often produce large movements in the network's final-layer feature space. In this paper, we define an attack model that abstracts this challenge, to help understand its intrinsic properties. In our model, the adversary may move data an arbitrary distance in feature space but only in random low-dimensional subspaces. We prove such adversaries can be quite powerful: defeating any algorithm that must classify any input it is given. However, by allowing the algorithm to abstain on unusual inputs, we show such adversaries can be overcome when classes are reasonably well-separated in feature space. We further provide strong theoretical guarantees for setting algorithm parameters to optimize over accuracy-abstention trade-offs using data-driven methods. Our results provide new robustness guarantees for nearest-neighbor style algorithms, and also have application to contrastive learning, where we empirically demonstrate the ability of such algorithms to obtain high robust accuracy with low abstention rates. Our model is also motivated by strategic classification, where entities being classified aim to manipulate their observable features to produce a preferred classification, and we provide new insights into that area as well.


title: Uplink Channel Estimation for Double-IRS Assisted Multi-User MIMO

abstract: To achieve the more promising passive beamforming gains in the double-intelligent reflecting surface (IRS) assisted system over the conventional single-IRS system, channel estimation is practically indispensable but also a more challenging problem to tackle, due to the presence of not only the single- but also double-reflection links that are intricately coupled. In this paper, we propose a new and efficient channel estimation scheme for the double-IRS assisted uplink multiple-input multiple-output (MIMO) communication system to resolve the cascaded channel state information (CSI) of both its single- and double-reflection links. First, for the single-user case, the higher-dimensional double-reflection channel is efficiently estimated at the multi-antenna base station (BS) with low training overhead by exploiting the fact that its cascaded channel coefficients are scaled versions of those of a lower-dimensional single-reflection channel. Then, the proposed channel estimation scheme is extended to the multi-user case, where given an arbitrary user's cascaded channel estimated as in the single-user case, the other users' cascaded channels are scaled versions of it and thus can be estimated with reduced training overhead. Simulation results verify the effectiveness of the proposed channel estimation scheme as compared to the benchmark scheme.


title: High Area/Energy Efficiency RRAM CNN Accelerator with Kernel-Reordering Weight Mapping Scheme Based on Pattern Pruning

abstract: Resistive Random Access Memory (RRAM) is an emerging device for processing-in-memory (PIM) architecture to accelerate convolutional neural network (CNN). However, due to the highly coupled crossbar structure in the RRAM array, it is difficult to exploit the sparsity of the network in RRAM-based CNN accelerator. To optimize the weight mapping of sparse network in the RRAM array and achieve high area and energy efficiency, we propose a novel weight mapping scheme and corresponding RRAM-based CNN accelerator architecture based on pattern pruning and Operation Unit(OU) mechanism. Experimental results show that our work can achieve 4.16x-5.20x crossbar area efficiency, 1.98x-2.15x energy efficiency, and 1.15x-1.35x performance speedup in comparison with the traditional weight mapping method.


title: Two-Facet Scalable Cooperative Optimization of Multi-Agent Systems in The Networked Environment

abstract: Cooperatively optimizing a vast number of agents that are connected over a large-scale network brings unprecedented scalability challenges. This paper revolves around problems optimizing coupled objective functions under coupled network-induced constraints and local constraints. The scalability of existing optimization paradigms is limited by either the agent population size or the network dimension. As a radical improvement, this paper for the first time constructs a two-facet scalable decentralized optimization framework. To this end, we first develop a systemic network dimension reduction technique to virtually cluster the agents and lower the dimension of network-induced constraints, then constitute a novel shrunken-primal-multi-dual subgradient (SPMDS) algorithm based on the reduced-dimension network. Rigorous optimality and convergence analyses of the proposed decentralized optimization framework are provided. The SPMDS-based optimization framework is free of agent-to-agent communication and no additional aggregators are required for agent clusters. The efficiency and efficacy of the proposed approaches are demonstrated, in comparison with benchmark methods, through simulations of electric vehicle charging control problems and traffic congestion control problems.


title: Tropical Geometric Variation of Phylogenetic Tree Shapes

abstract: We study the behavior of phylogenetic tree shapes in the tropical geometric interpretation of tree space. Tree shapes are formally referred to as tree topologies; a tree topology can also be thought of as a tree combinatorial type, which is given by the tree's branching configuration and leaf labeling. We use the tropical line segment as a framework to define notions of variance as well as invariance of tree topologies: we provide a combinatorial search theorem that describes all tree topologies occurring along a tropical line segment, as well as a setting under which tree topologies do not change along a tropical line segment. Our study is motivated by comparison to the moduli space endowed with a geodesic metric proposed by Billera, Holmes, and Vogtmann (referred to as BHV space); we consider the tropical geometric setting as an alternative framework to BHV space for sets of phylogenetic trees. We give an algorithm to compute tropical line segments which is lower in computational complexity than the fastest method currently available for BHV geodesics and show that its trajectory behaves more subtly: while the BHV geodesic traverses the origin for vastly different tree topologies, the tropical line segment bypasses it.


title: Two-Higgs doublet solution to the LSND, MiniBooNE and muon $g-2$ anomalies

abstract: We show that one of the simplest extensions of the Standard Model, the addition of a second Higgs doublet, when combined with a dark sector singlet scalar, allows us to: $i)$ explain the long-standing anomalies in the Liquid Scintillator Neutrino Detector (LSND) and MiniBooNE (MB) while maintaining compatibility with the null result from KARMEN, $ii)$ obtain, in the process, a portal to the dark sector, and $iii)$ comfortably account for the observed value of the muon $g-2$. Three singlet neutrinos allow for an understanding of observed neutrino mass-squared differences via a Type I seesaw, with two of the lighter states participating in the interaction in both LSND and MB. We obtain very good fits to energy and angular distributions in both experiments. We explain features of the solution presented here and discuss the constraints that our model must satisfy. We also mention prospects for future tests of its particle content.


title: Color Hom-Lie algebras, color Hom-Leibniz algebras and color omni-Hom-Lie algebras

abstract: Representations of color Hom-Lie algebras are reviewed, and it is shown that there exist a series of coboundary operators. We also introduce the notion of a color omni-Hom-Lie algebra associated to a vector space and an even invertible linear map. We show how regular color Hom-Lie algebra structures on a vector space can be characterized. Moreover, it is shown that the underlying algebraic structure of the color omni-Hom-Lie algebra is a color Hom-Leibniz algebra.


title: Repeated mergers of black hole binaries: implications for GW190521

abstract: The gravitational wave event GW190521 involves the merger of two black holes of $\sim 85\text{M}_\odot$ and $\sim 66\text{M}_\odot$ forming an intermediate-mass black hole (IMBH) of mass $\sim 142\text{M}_\odot$. Both progenitors are challenging to explain within standard stellar evolution as they are within the upper black-hole mass gap. We propose a dynamical formation pathway for this IMBH based on multiple mergers in the core of a globular cluster. We identify such scenarios from analysis of a set of 58 N-body simulations using \texttt{NBODY6-gpu}. In one of our simulations, we observe a stellar black hole undergoing a chain of seven binary mergers within 6 Gyr, attaining a final mass of $97.8\text{M}_\odot$. We discuss the dynamical interactions that lead to the final IMBH product, as well as the evolution of the black hole population in that simulation. We explore statistically the effects of gravitational recoil on the viability of such hierarchical mergers. From the analysis of all 58 simulations we observe additional smaller chains, tentatively inferring that an IMBH formation through hierarchical mergers is expected in the lifetime of a median mass globular cluster with probability $0.01 \lesssim p \lesssim 0.1$ without gravitational merger recoil. Using this order-of-magnitude estimate we show our results are broadly consistent with the rate implied by GW190521, assuming that gravitational recoil ejection of progenitors has a low probability. We discuss implications for future gravitational wave detections, emphasising the importance of studying such formation pathways for BHs within the upper mass gap as a means to constrain such modelling.


title: Tied pseudo links \& Pseudo knotoids

abstract: In this paper we study the theory of {\it pseudo knots}, which are knots with some missing crossing information, and we introduce and study the theory of {\it pseudo tied links} and the theory of {\it pseudo knotoids}. In particular, we first present a braiding algorithm for pseudo knots and we then introduce the $L$-moves in that setting, with the use of which we formulate a sharpened version of the analogue of the Markov theorem for pseudo braids. Then we introduce and study the theory of {\it tied pseudo links}, that generalize the notion of tied links, and we exploit the relation between tied pseudo links and tied singular links. We first present an $L$-move braid equivalence for tied singular braids. Then, we introduce the tied pseudo braid monoid and we formulate and prove analogues of the Alexander and Markov theorems for tied pseudo links. Finally, we introduce and study the theory of {\it pseudo knotoids}, that generalize the notion of knotoids. We present an isotopy theorem for pseudo knotoids and we then pass to the level of braidoids. We further introduce and study the {\it pseudo braidoids} by introducing the {\it pseudo} $L${\it -moves} and by presenting the analogues of the Alexander and Markov theorems for pseudo knotoids. We also discuss further research related to {\it tied (multi)-knotoids and tied pseudo (multi)-knotoids}. The theory of pseudo knots may serve as a strong tool in the study of DNA, while tied links have potential use in other aspects of molecular biology.


title: Bridging 2D and 3D Segmentation Networks for Computation Efficient Volumetric Medical Image Segmentation: An Empirical Study of 2.5D Solutions

abstract: Recently, deep convolutional neural networks have achieved great success for medical image segmentation. However, unlike segmentation of natural images, most medical images such as MRI and CT are volumetric data. In order to make full use of volumetric information, 3D CNNs are widely used. However, 3D CNNs suffer from higher inference time and computation cost, which hinders their further clinical applications. Additionally, with the increased number of parameters, the risk of overfitting is higher, especially for medical images where data and annotations are expensive to acquire. To issue this problem, many 2.5D segmentation methods have been proposed to make use of volumetric spatial information with less computation cost. Despite these works lead to improvements on a variety of segmentation tasks, to the best of our knowledge, there has not previously been a large-scale empirical comparison of these methods. In this paper, we aim to present a review of the latest developments of 2.5D methods for volumetric medical image segmentation. Additionally, to compare the performance and effectiveness of these methods, we provide an empirical study of these methods on three representative segmentation tasks involving different modalities and targets. Our experimental results highlight that 3D CNNs may not always be the best choice. Despite all these 2.5D methods can bring performance gains to 2D baseline, not all the methods hold the benefits on different datasets. We hope the results and conclusions of our study will prove useful for the community on exploring and developing efficient volumetric medical image segmentation methods.


title: Causal Structure Learning: a Bayesian approach based on random graphs

abstract: A Random Graph is a random object which take its values in the space of graphs. We take advantage of the expressibility of graphs in order to model the uncertainty about the existence of causal relationships within a given set of variables. We adopt a Bayesian point of view in order to capture a causal structure via interaction and learning with a causal environment. We test our method over two different scenarios, and the experiments mainly confirm that our technique can learn a causal structure. Furthermore, the experiments and results presented for the first test scenario demonstrate the usefulness of our method to learn a causal structure as well as the optimal action. On the other hand the second experiment, shows that our proposal manages to learn the underlying causal structure of several tasks with different sizes and different causal structures.


title: Characterizing multielectron dynamics during recollision

abstract: Measuring the delay for an electron to emerge from different states is one of the major achievements of attosecond science. This delay can have two origins - the electron wave packet is reshaped during departure by the electrostatic field of the ionizing medium or it is modified by dynamic interaction with the remaining electrons. Most experiments have observed the former, but confirmation requires a complex calculation. A direct measurement of multielectron dynamics is needed. Photo-recombination - the inverse of photoionization - occurs naturally during electron recollision and can be measured by combining a perturbing beam to modify the recollision electron before recombination. These in situ methods allow us to unambiguously isolate multielectron dynamics - the reference being the spectral phase of an attosecond pulse simultaneously measured in spectral regions without multielectron interaction. Here, we measure the group delay of the recollision electron caused by plasmonic resonance dynamics in Xe, simulate the in situ measured spectral phase of a recollision electron generated in the presence of the plasmonic resonance in C$_{60}$ and present a corresponding semi-classical theory based on the strong-field approximation. Our results suggest that in situ techniques, together with 300 eV recollision electrons, will allow the ultimate time response of electronic matter to be measured.


title: Crystal Truncation Rods from Miscut Surfaces with Alternating Terminations

abstract: Miscut surfaces of layered crystals can exhibit a stair-like sequence of terraces having periodic variation in their atomic structure. For hexagonal close-packed and related crystal structures with an {\alpha}{\beta}{\alpha}{\beta} stacking sequence, there have been long-standing questions regarding how the differences in adatom attachment kinetics at the steps separating the terraces affect the fractional coverage of {\alpha} vs. {\beta} termination during crystal growth. To demonstrate how surface X-ray scattering can help address these questions, we develop a general theory for the intensity distributions along crystal truncation rods (CTRs) for miscut surfaces with a combination of two terminations. We consider half-unit-cell-height steps, and variation of the coverages of the terraces above each step. Example calculations are presented for the GaN (0001) surface with various reconstructions. These show which CTR positions are most sensitive to the fractional coverage of the two terminations. We compare the CTR profiles for exactly oriented surfaces to those for vicinal surfaces having a small miscut angle, and investigate the circumstances under which the CTR profile for an exactly oriented surface is equal to the sum of the intensities of the corresponding family of CTRs for a miscut surface.


title: Discontinuous Galerkin methods for a dispersive wave hydro-sediment-morphodynamic model

abstract: A dispersive wave hydro-sediment-morphodynamic model developed by complementing the shallow water hydro-sediment-morphodynamic (SHSM) equations with the dispersive term from the Green-Naghdi equations is presented. A numerical solution algorithm for the model based on the second-order Strang operator splitting is presented. The model is partitioned into two parts, (1) the SHSM equations and (2) the dispersive correction part, which are discretized using discontinuous Galerkin finite element methods. This splitting technique provides a facility to select dynamically regions of a problem domain where the dispersive term is not applied, e.g. wave breaking regions where the dispersive wave model is no longer valid. Algorithms that can handle wetting-drying and detect wave breaking are provided and a number of numerical examples are presented to validate the developed numerical solution algorithm. The results of the simulations indicate that the model is capable of predicting sediment transport and bed morphodynamic processes correctly provided that the empirical models for the suspended and bed load transport are properly calibrated. Moreover, the developed model is able to accurately capture hydrodynamics and wave dispersion effects up to swash zones, and its application is justified for simulations where dispersive wave effects are prevalent.


title: Analysis of the rate of convergence of fully connected deep neural network regression estimates with smooth activation function

abstract: This article contributes to the current statistical theory of deep neural networks (DNNs). It was shown that DNNs are able to circumvent the so--called curse of dimensionality in case that suitable restrictions on the structure of the regression function hold. In most of those results the tuning parameter is the sparsity of the network, which describes the number of non-zero weights in the network. This constraint seemed to be the key factor for the good rate of convergence results. Recently, the assumption was disproved. In particular, it was shown that simple fully connected DNNs can achieve the same rate of convergence. Those fully connected DNNs are based on the unbounded ReLU activation function. In this article we extend the results to smooth activation functions, i.e., to the sigmoid activation function. It is shown that estimators based on fully connected DNNs with sigmoid activation function also achieve the minimax rates of convergence (up to $\ln n$-factors). In our result the number of hidden layers is fixed, the number of neurons per layer tends to infinity for sample size tending to infinity and a bound for the weights in the network is given.


title: Four-dimensional semi-Riemannian Szab\'o manifolds

abstract: In this paper, we prove that the deformed Riemannian extension of any affine Szab\'o manifold is a Szab\'o pseudo-Riemannian metric and vice-versa. We proved that the Ricci tensor of an affine surface is skew-symmetric and nonzero everywhere if and only if the affine surface is Szab\'o. We also find the necessary and sufficient condition for the affine Szab\'o surface to be recurrent. We prove that for an affine Szab\'o recurrent surface the recurrence covector of a recurrence tensor is not locally a gradient.


title: Low regularity well-posedness for the Yang-Mills system in 2D

abstract: The Cauchy problem for the Yang-Mills system in two space dimensions is treated for data with minimal regularity assumptions. In the classical case of data in $L^2$-based Sobolev spaces we have to assume that the number of derivatives is more than $3/4$ above the critical regularity with respect to scaling. For data in $L^r$-based Fourier-Lebesgue spaces this result can be improved by $1/4$ derivative in the sense of scaling as $r \to 1$ .


title: Mapping Chern numbers in quasi-periodic interacting spin chains

abstract: Quasi-periodic quantum spin chains were recently found to support many topological phases in the finite magnetization sectors. They can simulate strong topological phases from class A in arbitrary dimension that are characterized by first and higher order Chern numbers. In the present work, we use those findings to generate topological phases at finite magnetization densities that carry first Chern numbers. Given the reduced dimensionality of the spin chains, this provides a unique opportunity to investigate the bulk-boundary correspondence as well as the stability and quantization of the Chern number in the presence of interactions. The later is reformulated using a torus action on the algebra of observables and its quantization and stability is confirmed by numerical simulations. The relations between Chern values and the observed edge spectrum are also discussed.


title: Conformal upper bounds for the eigenvalues of the $p$-Laplacian

abstract: In this note we present upper bounds for the variational eigenvalues of the $p$-Laplacian on smooth domains of complete $n$-dimensional Riemannian manifolds and Neumann boundary conditions, and on compact (boundaryless) Riemannian manifolds. In particular, we provide upper bounds in the conformal class of a given manifold $(M,g)$ for $1<p\leq n$, and upper bounds for all $p>1$ when we fix a metric $g$. To do so, we use a metric approach for the construction of suitable test functions for the variational characterization of the eigenvalues. The upper bounds agree with the well-known asymptotic estimate of the eigenvalues due to Friedlander. We also present upper bounds for the variational eigenvalues on hypersurfaces bounding smooth domains in a Riemannian manifold in terms of the isoperimetric ratio.