title: Adjoint functor theorems for homotopically enriched categories

abstract: We prove an adjoint functor theorem in the setting of categories enriched in a monoidal model category $\mathcal V$ admitting certain limits. When $\mathcal V$ is equipped with the trivial model structure this recaptures the enriched version of Freyd's adjoint functor theorem. For non-trivial model structures, we obtain new adjoint functor theorems of a homotopical flavour - in particular, when $\mathcal V$ is the category of simplical sets we obtain a homotopical adjoint functor theorem appropriate to the $\infty$-cosmoi of Riehl and Verity. We also investigate accessibility in the enriched setting, in particular obtaining homotopical cocompleteness results for accessible $\infty$-cosmoi.


title: Homogeneous quasimorphisms, $C^0$-topology and Lagrangian intersection

abstract: We construct an example of a non-trivial homogeneous quasimorphism on the group of Hamiltonian diffeomorphisms of the two and four dimensional quadric hypersurfaces which is continuous with respect to both the $C^0$-metric and the Hofer metric. This answers a variant of a question of Entov--Polterovich--Py which is one of the open problems listed in the monograph of McDuff--Salamon. Throughout the proof, we make extensive use of the idea of working with different coefficient fields in quantum cohomology rings. As a by-product of the arguments in the paper, we answer a question of Polterovich--Wu regarding quasimorphisms on the group of Hamiltonian diffeomorphisms of the complex projective plane and prove some intersection results about Lagrangians in the four dimensional quadric hypersurface.


title: Towards Gender-Neutral Face Descriptors for Mitigating Bias in Face Recognition

abstract: State-of-the-art deep networks implicitly encode gender information while being trained for face recognition. Gender is often viewed as an important attribute with respect to identifying faces. However, the implicit encoding of gender information in face descriptors has two major issues: (a.) It makes the descriptors susceptible to privacy leakage, i.e. a malicious agent can be trained to predict the face gender from such descriptors. (b.) It appears to contribute to gender bias in face recognition, i.e. we find a significant difference in the recognition accuracy of DCNNs on male and female faces. Therefore, we present a novel `Adversarial Gender De-biasing algorithm (AGENDA)' to reduce the gender information present in face descriptors obtained from previously trained face recognition networks. We show that AGENDA significantly reduces gender predictability of face descriptors. Consequently, we are also able to reduce gender bias in face verification while maintaining reasonable recognition performance.


title: Global Attention Improves Graph Networks Generalization

abstract: This paper advocates incorporating a Low-Rank Global Attention (LRGA) module, a computation and memory efficient variant of the dot-product attention (Vaswani et al., 2017), to Graph Neural Networks (GNNs) for improving their generalization power. To theoretically quantify the generalization properties granted by adding the LRGA module to GNNs, we focus on a specific family of expressive GNNs and show that augmenting it with LRGA provides algorithmic alignment to a powerful graph isomorphism test, namely the 2-Folklore Weisfeiler-Lehman (2-FWL) algorithm. In more detail we: (i) consider the recent Random Graph Neural Network (RGNN) (Sato et al., 2020) framework and prove that it is universal in probability; (ii) show that RGNN augmented with LRGA aligns with 2-FWL update step via polynomial kernels; and (iii) bound the sample complexity of the kernel's feature map when learned with a randomly initialized two-layer MLP. From a practical point of view, augmenting existing GNN layers with LRGA produces state of the art results in current GNN benchmarks. Lastly, we observe that augmenting various GNN architectures with LRGA often closes the performance gap between different models.


title: Trends, Reversion, and Critical Phenomena in Financial Markets

abstract: Financial markets across all asset classes are known to exhibit trends. These trends have been exploited by traders for decades. Here, we empirically measure when trends revert, based on 30 years of daily futures prices for equity indices, interest rates, currencies and commodities. We find that trends tend to revert once they reach a critical level of statistical significance. Based on polynomial regression, we carefully measure this critical level. We find that it is universal across asset classes and has a universal scaling behavior, as the trend's time horizon runs from a few days to several years. The corresponding regression coefficients are small, but statistically highly significant, as confirmed by bootstrapping and out-of-sample testing. Our results signal to investors when to exit a trend. They also reveal how markets have become more efficient over the decades. Moreover, they point towards a potential deep analogy between financial markets and critical phenomena: our analysis supports the conjecture that financial markets can be modeled as statistical mechanical ensembles of Buy/Sell orders near critical points. In this analogy, the trend strength plays the role of an order parameter, whose dynamcis is described by a Langevin equation with a quartic potential.

categories: q-fin.ST cond-mat.stat-mech hep-th q-fin.PM q-fin.TR


title: Homology and cohomology intersection numbers of GKZ systems

abstract: We describe the homology intersection form associated to regular holonomic GKZ systems in terms of the combinatorics of regular triangulations. Combining this result with the twisted period relation, we obtain a formula of cohomology intersection numbers in terms of a Laurent series. We show that the cohomology intersection number depends rationally on the parameters. We also prove a conjecture of F. Beukers and C. Verschoor on the signature of the monodromy invariant hermitian form. This is a continuation of the previous work arXiv:1904.00565.


title: Pot, kettle: Nonliteral titles aren't (natural) science

abstract: Researchers may be tempted to attract attention through poetic titles for their publications, but would this be mistaken in some fields? Whilst poetic titles are known to be common in medicine, it is not clear whether the practice is widespread elsewhere. This article investigates the prevalence of poetic expressions in journal article titles 1996-2019 in 3.3 million articles from all 27 Scopus broad fields. Expressions were identified by manually checking all phrases with at least 5 words that occurred at least 25 times, finding 149 stock phrases, idioms, sayings, literary allusions, film names and song titles or lyrics. The expressions found are most common in the social sciences and the humanities. They are also relatively common in medicine, but almost absent from engineering and the natural and formal sciences. The differences may reflect the less hierarchical and more varied nature of the social sciences and humanities, where interesting titles may attract an audience. In engineering, natural science and formal science fields, authors should take extra care with poetic expressions, in case their choice is judged inappropriate. This includes interdisciplinary research overlapping these areas. Conversely, reviewers of interdisciplinary research involving the social sciences should be more tolerant of poetic license.


title: Reflexive Banach spaces with all power-bounded operators almost periodic

abstract: We analyze the ergodic properties of power-bounded operators on a reflexive Banach space of the form "scalar plus compact-power", and show that they are almost periodic (all the orbits are conditionally compact). If such an operator is weakly mixing, then it is stable (its powers converge in the strong operator topology).Let X-ISP be the separable reflexive indecomposable Banach space constructed by Argyros and Motakis, in which every operator has an invariant subspace. We conclude that every power-bounded operator on a closed subspace of X-ISP is almost periodic.


title: An Economies-of-Scale Service System Design Problem

abstract: This paper studies the design of a service system in the presence of economies-of-scale. The goal is to make decision on the number, location, service capacities of facilities as well as on the allocation of customers to the opened facilities in order to minimize the cost of whole system. The total cost includes opening and serving costs of facilities aggregated to the transportation and waiting costs of customers. To reflect the economies-of-scale in the modeling, a general opening cost function is supposed for each service facility with the characteristic of being concave and non-decreasing on its service capacity. A Lagrangian relaxation algorithm is developed for solving the problem in its general form. The algorithm decomposes the relaxed model into some homogeneous subproblems where each one can be optimally solved in polynomial time with no need for any optimization solver. Our computational experiment shows that the developed algorithm is both efficient and effective in solving the proposed problem.


title: On the determination of log-normal flux distributions for astrophysical systems

abstract: Determining whether the flux distribution of an Astrophysical source is a Gaussian or a log-normal, provides key insight into the nature of its variability. For lightcurves of moderate length ($< 10^3$), a useful first analysis is to test the Gaussianity of the flux and logarithm of the flux, by estimating the skewness and applying the Anderson-Darling (AD) method. We perform extensive simulations of lightcurves with different lengths, variability, Gaussian measurement errors and power spectrum index $\beta$ (i.e. $P(f) \propto f^{-\beta}$), to provide a prescriptionand guidelines for reliable use of these two tests. We present empirical fits for the expected standard deviation of skewness and tabulated AD test critical values for $\beta = 0.5$ and $1.0$, which differ from the values given in the literature which are for white noise ($\beta = 0$). Moreover, we show that for white noise, for most practical situations, these tests are meaningless, since binning in time alters the flux distribution. For $\beta \gtrsim 1.5$, the skewness variance does not decrease with length and hence the tests are not reliable. Thus, such tests can be applied only to systems with $\beta\gtrsim 0.5$ and $\beta \lesssim 1.0$. As an example of the prescription given in this work, we reconfirm that the Fermi data of the blazar, 3FGL\,J0730.2-1141, shows that its $\gamma$ ray flux is consistent with a log-normal distribution and not with a Gaussian one.


title: Continual General Chunking Problem and SyncMap

abstract: Humans possess an inherent ability to chunk sequences into their constituent parts. In fact, this ability is thought to bootstrap language skills and learning of image patterns which might be a key to a more animal-like type of intelligence. Here, we propose a continual generalization of the chunking problem (an unsupervised problem), encompassing fixed and probabilistic chunks, discovery of temporal and causal structures and their continual variations. Additionally, we propose an algorithm called SyncMap that can learn and adapt to changes in the problem by creating a dynamic map which preserves the correlation between variables. Results of SyncMap suggest that the proposed algorithm learn near optimal solutions, despite the presence of many types of structures and their continual variation. When compared to Word2vec, PARSER and MRIL, SyncMap surpasses or ties with the best algorithm on $66\%$ of the scenarios while being the second best in the remaining $34\%$. SyncMap's model-free simple dynamics and the absence of loss functions reveal that, perhaps surprisingly, much can be done with self-organization alone. Code available at https://github.com/zweifel/SyncMap.


title: Current bounds and future prospects of light neutralino dark matter in NMSSM

abstract: Unlike its minimal counterpart, the Next to Minimal supersymmetric Standard Model (NMSSM) allows the possibility that the lightest neutralino could have a mass as small as $\sim 1 {\rm GeV}$ while still providing a significant component of relic dark matter (DM). Such a neutralino can provide an invisible decay mode to the Higgs as well. Further, the observed SM-like Higgs boson ($H_{125}$) could also have an invisible branching fraction as high as $\sim 19\%$. Led by these facts, we first delineate the region of parameter space of the NMSSM with a light neutralino ($M_{{\tilde{\chi}}_{1}^{0}} < 62.5 {\rm GeV}$) that yields a thermal neutralino relic density smaller than the measured relic density of cold dark matter, and is also compatible with constraints from collider searches, searches for dark matter, and from flavor physics. We then examine the prospects for probing the NMSSM with a light neutralino via direct DM detection searches, via invisible Higgs boson width experiments at future $e^+e^-$ colliders, via searches for a light singlet Higgs boson in $2b2\mu$, $2b2\tau$ and $2\mu2\tau$ channels and via pair production of winos or doublet higgsinos at the high luminosity LHC and its proposed energy upgrade. For this last-mentioned electroweakino search, we perform a detailed analysis to map out the projected reach in the $3l+{\rm E{\!\!\!/}_T}$ channel, assuming that chargino decays to $W {\tilde{\chi}}_{1}^{0}$ and the neutralino(s) decay to $Z$ or $H_{125}$ + ${\tilde{\chi}}_{1}^{0}$. We find that the HL-LHC can discover SUSY in just part of the parameter space in each of these channels, which together can probe almost the entire parameter space. The HE-LHC probes essentially the entire region with higgsinos (winos) lighter than 1 TeV (2 TeV) independently of how the neutralinos decay, and leads to significantly larger signal rates.


title: Exploratory Analysis of a Social Media Network in Sri Lanka during the COVID-19 Virus Outbreak

abstract: During the COVID-19 pandemic, multiple aspects of human life were subjected to unprecedented changes, globally. In Sri Lanka, a developing country located in South Asia, it was possible to observe a range of events that arose due to the influence of the COVID-19 virus outbreak. Thus, the people of Sri Lanka used Social Media to voice their opinions regarding such events and those involved in them, enabling the ideal avenue to explore the social perception. However, the outcome of such actions was at certain times detrimental. This study was conducted as an attempt to identify the reasons for such instances as well as to identify the behaviours of the Sri Lankan populace during such a crisis event. To support this study, observations, as well as data of related posts from a sample of 50 sources, were manually collected from the most popular social media platform in Sri Lanka, Facebook. The posts considered spanned until approximately a month after the initial major virus outbreak in the country and contained content that even vaguely related to the virus. Utilising such data, various forms of analyses such as topic significance and topic co-occurrences were conducted. The findings highlight, while there can be social detrimental ideas shared, the majority of the posts point constructive and positive thoughts suggesting the successful influence from the cultural and social values Sri Lanka society promotes throughout.


title: The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems

abstract: This paper presents and characterizes an Open Application Repository for Federated Learning (OARF), a benchmark suite for federated machine learning systems. Previously available benchmarks for federated learning have focused mainly on synthetic datasets and use a limited number of applications. OARF mimics more realistic application scenarios with publicly available data sets as different data silos in image, text and structured data. Our characterization shows that the benchmark suite is diverse in data size, distribution, feature distribution and learning task complexity. The extensive evaluations with reference implementations show the future research opportunities for important aspects of federated learning systems. We have developed reference implementations, and evaluated the important aspects of federated learning, including model accuracy, communication cost, throughput and convergence time. Through these evaluations, we discovered some interesting findings such as federated learning can effectively increase end-to-end throughput.


title: Proper Time and Mass of the Universe

abstract: A modification of the homogeneous isotropic model of the Friedman universe with a scalar field is proposed, in which the proper time of the universe is added to the dynamic variables under the additional condition of its classical dynamics. Along with proper time, an additional parameter is included in the modified theory, which is an analog of the rest mass of a relativistic particle. Assuming the dependence of the gravitational constant on proper time, we obtain the rest mass as an additional dynamic variable.


title: Quantum teleportation, entanglement, and Bell nonlocality in Unruh channel

abstract: Decoherence is an unavoidable phenomenon that results from the interaction of the system with its surroundings. The study of decoherence due to the relativistic effects has the fundamental importance. The Unruh effect is observed by the relativistically accelerator observer. The unruh effect acts as a quantum channel and we call it the Unruh Channel. The Unruh channel can be characterize by providing its Kraus representation. We consider the bipartite scheme in which the quantum information is shared between an inertial observer (Alice) and an accelerated observer (Rob) in the case of Dirac field. We will show that this channel reduces the common quantum information between the two observers. In this work we will study the effects of the Unruh channel on various facets of quantum correlations, such as the quantum teleportation, entanglement, and Bell inequality violations for a Dirac field mode.


title: Repulsive Curves

abstract: Curves play a fundamental role across computer graphics, physical simulation, and mathematical visualization, yet most tools for curve design do nothing to prevent crossings or self-intersections. This paper develops efficient algorithms for (self-)repulsion of plane and space curves that are well-suited to problems in computational design. Our starting point is the so-called tangent-point energy, which provides an infinite barrier to self-intersection. In contrast to local collision detection strategies used in, e.g., physical simulation, this energy considers interactions between all pairs of points, and is hence useful for global shape optimization: local minima tend to be aesthetically pleasing, physically valid, and nicely distributed in space. A reformulation of gradient descent, based on a Sobolev-Slobodeckij inner product enables us to make rapid progress toward local minima---independent of curve resolution. We also develop a hierarchical multigrid scheme that significantly reduces the per-step cost of optimization. The energy is easily integrated with a variety of constraints and penalties (e.g., inextensibility, or obstacle avoidance), which we use for applications including curve packing, knot untangling, graph embedding, non-crossing spline interpolation, flow visualization, and robotic path planning.


title: Mining Student Responses to Infer Student Satisfaction Predictors

abstract: The identification and analysis of student satisfaction is a challenging issue. This is becoming increasingly important since a measure of student satisfaction is taken as an indication of how well a course has been taught. However, it remains a challenging problem as student satisfaction has various aspects. In this paper, we formulate the student satisfaction estimation as a prediction problem where we predict different levels of student satisfaction and infer the influential predictors related to course and instructor. We present five different aspects of student satisfaction in terms of 1) course content, 2) class participation, 3) achievement of initial expectations about the course, 4) relevancy towards professional development, and 5) if the course connects them and helps to explore the real-world situations. We employ state-of-the-art machine learning techniques to predict each of these aspects of student satisfaction levels. For our experiment, we utilize a large student evaluation dataset which includes student perception using different attributes related to courses and the instructors. Our experimental results and comprehensive analysis reveal that student satisfaction is more influenced by course attributes in comparison to instructor related attributes.


title: Isotropic stable motivic homotopy groups of spheres

abstract: In this paper we explore the isotropic stable motivic homotopy category constructed from the usual stable motivic homotopy category, following the work of Vishik on isotropic motives (see [29]), by killing anisotropic varieties. In particular, we focus on cohomology operations in the isotropic realm and study the structure of the isotropic Steenrod algebra. Then, we construct an isotropic version of the motivic Adams spectral sequence and apply it to find a complete description of the isotropic stable homotopy groups of the sphere spectrum, which happen to be isomorphic to the $Ext$-groups of the topological Steenrod algebra. At the end, we will see that this isomorphism is not only additive but respects higher products, completely identifying, as rings with higher structure, the cohomology of the classical Steenrod algebra with isotropic stable homotopy groups of spheres.


title: Exploiting Higher Order Smoothness in Derivative-free Optimization and Continuous Bandits

abstract: We study the problem of zero-order optimization of a strongly convex function. The goal is to find the minimizer of the function by a sequential exploration of its values, under measurement noise. We study the impact of higher order smoothness properties of the function on the optimization error and on the cumulative regret. To solve this problem we consider a randomized approximation of the projected gradient descent algorithm. The gradient is estimated by a randomized procedure involving two function evaluations and a smoothing kernel. We derive upper bounds for this algorithm both in the constrained and unconstrained settings and prove minimax lower bounds for any sequential search method. Our results imply that the zero-order algorithm is nearly optimal in terms of sample complexity and the problem parameters. Based on this algorithm, we also propose an estimator of the minimum value of the function achieving almost sharp oracle behavior. We compare our results with the state-of-the-art, highlighting a number of key improvements.


title: Pairwise mode-locking in dynamically-coupled parametric oscillators

abstract: Mode locking in lasers is a collective effect, where due to a weak coupling a large number of frequency modes lock their phases to oscillate in unison, forming an ultrashort pulse in time. We demonstrate an analogous collective effect in coupled parametric oscillators, which we term "pairwise mode-locking", where many pairs of modes with twin frequencies (symmetric around the center carrier) oscillate simultaneously with a locked phase-sum, while the phases of individual modes remain undefined. Thus, despite being broadband and multimode, the emission is not pulsed and lacks first-order coherence, while possessing a very high degree of second-order coherence. Our configuration is comprised of two coupled parametric oscillators within identical multimode cavities, where the coupling between the oscillators is modulated in time at the repetition rate of the cavity modes, with some analogy to active mode-locking in lasers. We demonstrate pairwise mode-locking in a radio-frequency (RF) experiment, covering over an octave of bandwidth with approximately 20 resonant mode-locked pairs, filling most of the available bandwidth between DC and the pump frequency. We accompany our experiment with an analytic model that accounts for the properties of the coupled parametric oscillators near threshold.


title: Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection

abstract: Detecting vehicles and representing their position and orientation in the three dimensional space is a key technology for autonomous driving. Recently, methods for 3D vehicle detection solely based on monocular RGB images gained popularity. In order to facilitate this task as well as to compare and drive state-of-the-art methods, several new datasets and benchmarks have been published. Ground truth annotations of vehicles are usually obtained using lidar point clouds, which often induces errors due to imperfect calibration or synchronization between both sensors. To this end, we propose Cityscapes 3D, extending the original Cityscapes dataset with 3D bounding box annotations for all types of vehicles. In contrast to existing datasets, our 3D annotations were labeled using stereo RGB images only and capture all nine degrees of freedom. This leads to a pixel-accurate reprojection in the RGB image and a higher range of annotations compared to lidar-based approaches. In order to ease multitask learning, we provide a pairing of 2D instance segments with 3D bounding boxes. In addition, we complement the Cityscapes benchmark suite with 3D vehicle detection based on the new annotations as well as metrics presented in this work. Dataset and benchmark are available online.


title: Membership deformation of commutativity and obscure $n$-ary algebras

abstract: A general mechanism for "breaking" commutativity in algebras is proposed: if the underlying set is taken to be not a crisp set, but rather an obscure/fuzzy set, the membership function, reflecting the degree of truth that an element belongs to the set, can be incorporated into the commutation relations. The special "deformations" of commutativity and $\varepsilon $-commutativity are introduced in such a way that equal degrees of truth result in the "nondeformed" case. We also sketch how to "deform" $\varepsilon$-Lie algebras and Weyl algebras. Further, the above constructions are extended to $n$-ary algebras for which the projective representations and $\varepsilon $-commutativity are studied.


title: Support $\tau_n$-tilting pairs

abstract: We introduce the higher version of the notion of Adachi-Iyama-Reiten's support $\tau$-tilting pairs, which is a generalization of maximal $\tau_n$-rigid pairs in the sense of Jacobsen-J{\o}rgensen. Let $\mathcal C$ be an $(n+2)$-angulated category with an $n$-suspension functor $\Sigma^n$ and an Opperman-Thomas cluster tilting object. We show that relative $n$-rigid objects in $\mathcal C$ are in bijection with $\tau_n$-rigid pairs in the $n$-abelian category $\mathcal C/{\rm add}\Sigma^n T$, and relative maximal $n$-rigid objects in $\mathcal C$ are in bijection with support $\tau_n$-tilting pairs. We also show that relative $n$-self-perpendicular objects are in bijection with maximal $\tau_n$-rigid pairs. These results generalise the work for $\mathcal C$ being $2n$-Calabi-Yau by Jacobsen-J{\o}rgensen and the work for $n=1$ by Yang-Zhu.


title: Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball

abstract: We study stochastic gradient descent (SGD) and the stochastic heavy ball method (SHB, otherwise known as the momentum method) for the general stochastic approximation problem. For SGD, in the convex and smooth setting, we provide the first \emph{almost sure} asymptotic convergence \emph{rates} for a weighted average of the iterates . More precisely, we show that the convergence rate of the function values is arbitrarily close to $o(1/\sqrt{k})$, and is exactly $o(1/k)$ in the so-called overparametrized case. We show that these results still hold when using stochastic line search and stochastic Polyak stepsizes, thereby giving the first proof of convergence of these methods in the non-overparametrized regime. Using a substantially different analysis, we show that these rates hold for SHB as well, but at the last iterate. This distinction is important because it is the last iterate of SGD and SHB which is used in practice. We also show that the last iterate of SHB converges to a minimizer \emph{almost surely}. Additionally, we prove that the function values of the deterministic HB converge at a $o(1/k)$ rate, which is faster than the previously known $O(1/k)$. Finally, in the nonconvex setting, we prove similar rates on the lowest gradient norm along the trajectory of SGD.


title: Learning Stable Nonparametric Dynamical Systems with Gaussian Process Regression

abstract: Modelling real world systems involving humans such as biological processes for disease treatment or human behavior for robotic rehabilitation is a challenging problem because labeled training data is sparse and expensive, while high prediction accuracy is required from models of these dynamical systems. Due to the high nonlinearity of problems in this area, data-driven approaches gain increasing attention for identifying nonparametric models. In order to increase the prediction performance of these models, abstract prior knowledge such as stability should be included in the learning approach. One of the key challenges is to ensure sufficient flexibility of the models, which is typically limited by the usage of parametric Lyapunov functions to guarantee stability. Therefore, we derive an approach to learn a nonparametric Lyapunov function based on Gaussian process regression from data. Furthermore, we learn a nonparametric Gaussian process state space model from the data and show that it is capable of reproducing observed data exactly. We prove that stabilization of the nominal model based on the nonparametric control Lyapunov function does not modify the behavior of the nominal model at training samples. The flexibility and efficiency of our approach is demonstrated on the benchmark problem of learning handwriting motions from a real world dataset, where our approach achieves almost exact reproduction of the training data.


title: Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Tasks

abstract: Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three different classes of MARL algorithms (independent learning, centralised multi-agent policy gradient, value decomposition) in a diverse range of cooperative multi-agent learning tasks. Our experiments serve as a reference for the expected performance of algorithms across different learning tasks, and we provide insights regarding the effectiveness of different learning approaches. We open-source EPyMARL, which extends the PyMARL codebase to include additional algorithms and allow for flexible configuration of algorithm implementation details such as parameter sharing. Finally, we open-source two environments for multi-agent research which focus on coordination under sparse rewards.


title: Applications of Hochschild cohomology to the moduli of subalgebras of the full matrix ring

abstract: Let ${\rm Mold}_{n, d}$ be the moduli of rank $d$ subalgebras of ${\rm M}_n$ over ${\Bbb Z}$. For $x \in {\rm Mold}_{n, d}$, let ${\mathcal A}(x) \subseteq {\rm M}_n(k(x))$ be the subalgebra of ${\rm M}_n$ corresponding to $x$, where $k(x)$ is the residue field of $x$. In this article, we apply Hochschild cohomology to ${\rm Mold}_{n, d}$. The dimension of the tangent space $T_{{\rm Mold}_{n, d}/{\Bbb Z}, x}$ of ${\rm Mold}_{n, d}$ over ${\Bbb Z}$ at $x$ can be calculated by the Hochschild cohomology $H^{1}({\mathcal A}(x), {\rm M}_n(k(x))/{\mathcal A}(x))$. We show that $H^{2}({\mathcal A}(x), {\rm M}_n(k(x))/{\mathcal A}(x)) = 0$ is a sufficient condition for the canonical morphism ${\rm Mold}_{n, d} \to {\Bbb Z}$ being smooth at $x$. We also calculate $H^{i}(A, {\rm M}_n(k)/A)$ for several $R$-subalgebras $A$ of ${\rm M}_n(R)$ over a commutative ring $R$. In particular, we summarize the results on $H^{i}(A, {\rm M}_n(k)/A)$ for all $k$-subalgebras $A$ of ${\rm M}_n(k)$ over an algebraically closed field $k$ in the case $n=2, 3$.


title: GP3: A Sampling-based Analysis Framework for Gaussian Processes

abstract: Although machine learning is increasingly applied in control approaches, only few methods guarantee certifiable safety, which is necessary for real world applications. These approaches typically rely on well-understood learning algorithms, which allow formal theoretical analysis. Gaussian process regression is a prominent example among those methods, which attracts growing attention due to its strong Bayesian foundations. Even though many problems regarding the analysis of Gaussian processes have a similar structure, specific approaches are typically tailored for them individually, without strong focus on computational efficiency. Thereby, the practical applicability and performance of these approaches is limited. In order to overcome this issue, we propose a novel framework called GP3, general purpose computation on graphics processing units for Gaussian processes, which allows to solve many of the existing problems efficiently. By employing interval analysis, local Lipschitz constants are computed in order to extend properties verified on a grid to continuous state spaces. Since the computation is completely parallelizable, the computational benefits of GPU processing are exploited in combination with multi-resolution sampling in order to allow high resolution analysis.


title: Explicitly Modeled Attention Maps for Image Classification

abstract: Self-attention networks have shown remarkable progress in computer vision tasks such as image classification. The main benefit of the self-attention mechanism is the ability to capture long-range feature interactions in attention-maps. However, the computation of attention-maps requires a learnable key, query, and positional encoding, whose usage is often not intuitive and computationally expensive. To mitigate this problem, we propose a novel self-attention module with explicitly modeled attention-maps using only a single learnable parameter for low computational overhead. The design of explicitly modeled attention-maps using geometric prior is based on the observation that the spatial context for a given pixel within an image is mostly dominated by its neighbors, while more distant pixels have a minor contribution. Concretely, the attention-maps are parametrized via simple functions (e.g., Gaussian kernel) with a learnable radius, which is modeled independently of the input content. Our evaluation shows that our method achieves an accuracy improvement of up to 2.2% over the ResNet-baselines in ImageNet ILSVRC and outperforms other self-attention methods such as AA-ResNet152 in accuracy by 0.9% with 6.4% fewer parameters and 6.7% fewer GFLOPs. This result empirically indicates the value of incorporating geometric prior into self-attention mechanism when applied in image classification.


title: The ternary Goldbach problem with two Piatetski-Shapiro primes and a prime with a missing digit

abstract: Let $$\gamma^*=\frac{8}{9}+\frac{2}{3}\:\frac{\log(10/9)}{\log 10}\:(\approx 0.919\ldots)\:.$$ Let $\gamma^*<\gamma_0\leq 1$, $c_0=1/\gamma_0$ be fixed. Let also $a_0\in\{0,1,\ldots, 9\}$.\\ We prove on assumption of the Generalized Riemann Hypothesis that each sufficiently large odd integer $N_0$ can be represented in the form $$N_0=p_1+p_2+p_3\:,$$ where the $p_i$ are of the form $p_i=[n_i^{c_0}]$, $n_i\in\mathbb{N}$, for $i=1,2$ and the decimal expansion of $p_3$ does not contain the digit $a_0$.\\ The proof merges methods of J. Maynard from his paper on the infinitude of primes with restricted digits, results of A. Balog and J. Friedlander on Piatetski-Shapiro primes and the Hardy-Littlewood circle method in two variables. This is the first result on the ternary Goldbach problem with primes of mixed type which involves primes with missing digits.


title: Massive Spinning Relativistic Particle: Revisited Under BRST and Supervariable Approaches

abstract: We discuss the continuous and infinitesimal gauge, supergauge, reparameterization, nilpotent Becchi-Rouet-Stora-Tyutin (BRST) and anti-BRST symmetries and derive corresponding nilpotent charges for the one (0+1)-dimensional (1D) massive model of a spinning relativistic particle. We exploit the theoretical potential and power of the BRST and supervariable approaches to derive the (anti-)BRST symmetries and coupled (but equivalent) Lagrangians for this system. In particular, we capture the off-shell nilpotency and absolute anticommutatvity of the conserved (anti-)BRST charges within the framework of the newly proposed (anti-)chiral supervariable approach (ACSA) to BRST formalism where only the (anti-)chiral supervariables (and their suitable super expansions are taken into account along the Grassmannian direction(s)). One of the novel observations of our present investigation is the derivation of the Curci-Ferrari (CF)-type restriction by the requirement of the absolute anticommutatvity of the (anti-)BRST charges in the ordinary space. We obtain the same restriction within the framework of ACSA to BRST formalism by (i) the symmetry invariance of the coupled Lagrangians, and (ii) the proof of the absolute anticommutatvity of the conserved and nilpotent (anti-)BRST charges. The observation of the anticommutativity property of the (anti-)BRST charges is a novel result in view of the fact that we have taken into account only the (anti-)chiral super expansions.


title: Resonant-amplified and invisible Bragg scattering based on spin coalescing modes

abstract: Unlike a real magnetic field, which separates the energy levels of particle with opposite spin polarization, a complex field can lead to a special kind of spectral degeneracy, known as exceptional point (EP), at which two spin eigenmodes coalesce. It allows an EP impurity to be an invisible scattering center for a fermion with the resonant spin polarization, but an amplifying emitter for opposite polarization. We show that a pair of conjugate EP modes supports resonant mutual stimulation, acting as a resonant amplifier based on the underlying mechanism of positive-feedback loop. Together with other Hermitian eigenmodes, a fermion with EP polarization exhibits some exclusive dynamics, referred to as EP dynamics. We construct several typical superlattices, which are built up by embedding EP-impurity arrays in a Hermitian two-dimensional square lattice. Numerical simulations are performed to demonstrate resonant amplification and invisibility of Bragg scattering.


title: An isoperimetric inequality for harmonic mean of Steklov eigenvalues in Hyperbolic space

abstract: In this article, we prove an isoperimetric inequality for the harmonic mean of the first $(n-1)$ nonzero Steklov eigenvalues on bounded domains in $n$-dimensional Hyperbolic space. Our approach to prove this result also gives a similar inequality for the first $n$ nonzero Steklov eigenvalues on bounded domains in $n$-dimensional Euclidean space.


title: FenceMask: A Data Augmentation Approach for Pre-extracted Image Features

abstract: We propose a novel data augmentation method named 'FenceMask' that exhibits outstanding performance in various computer vision tasks. It is based on the 'simulation of object occlusion' strategy, which aim to achieve the balance between object occlusion and information retention of the input data. By enhancing the sparsity and regularity of the occlusion block, our augmentation method overcome the difficulty of small object augmentation and notably improve performance over baselines. Sufficient experiments prove the performance of our method is better than other simulate object occlusion approaches. We tested it on CIFAR10, CIFAR100 and ImageNet datasets for Coarse-grained classification, COCO2017 and VisDrone datasets for detection, Oxford Flowers, Cornel Leaf and Stanford Dogs datasets for Fine-Grained Visual Categorization. Our method achieved significant performance improvement on Fine-Grained Visual Categorization task and VisDrone dataset.


title: Flatness over PI coideal subalgebras

abstract: Under the assumption that a residually finite dimensional Hopf algebra H has an Artinian ring of fractions it is proved that H is a flat module over any right coideal subalgebra satisfying a polynomial identity and is faithfully flat over any polynomial identity Hopf subalgebra. As a consequence we find a large class of Hopf algebras which are flat over all coideal subalgebras and are faithfully flat over all Hopf subalgebras.


title: Multiclass Disease Predictions Based on Integrated Clinical and Genomics Datasets

abstract: Clinical predictions using clinical data by computational methods are common in bioinformatics. However, clinical predictions using information from genomics datasets as well is not a frequently observed phenomenon in research. Precision medicine research requires information from all available datasets to provide intelligent clinical solutions. In this paper, we have attempted to create a prediction model which uses information from both clinical and genomics datasets. We have demonstrated multiclass disease predictions based on combined clinical and genomics datasets using machine learning methods. We have created an integrated dataset, using a clinical (ClinVar) and a genomics (gene expression) dataset, and trained it using instance-based learner to predict clinical diseases. We have used an innovative but simple way for multiclass classification, where the number of output classes is as high as 75. We have used Principal Component Analysis for feature selection. The classifier predicted diseases with 73\% accuracy on the integrated dataset. The results were consistent and competent when compared with other classification models. The results show that genomics information can be reliably included in datasets for clinical predictions and it can prove to be valuable in clinical diagnostics and precision medicine.


title: TATOO: a tidal-chronology standalone tool to estimate the age of massive close-in planetary systems

abstract: The presence of a massive close-in planet with an orbital period of a few days or less around a low-mass star can possibly results in a strong variation of the properties of the central star. Indeed, star-planet tidal interactions generate exchanges of angular momentum that can results in tidal spin-up. This effect could then lead to gyrochronological ages biased towards younger ages. Aims. This article provides the community with TATOO, a standalone tool based on tidal-chronology, to estimate the age of a massive close-in planetary system by only using its observed properties: mass of the planet and the star, stellar rotational and planetary orbital periods. I used the numerical code described in Gallet et al. (2018) to create a large multi-parametric grid of synthetic star-planet systems evolution, and 3D interpolation method to provide a fairly precise age estimate, using tidal-chronology technique, of any given planetary systems composed of at least of one massive close-in planet. About half of the planetary systems investigated in this work are subject to tidal spin-up bias. I pointed out that this bias linearly scales with the ratio between rotation to orbital period, making this quantity a useful proxy to rapidly investigate the need to use tidal-chronology. Moreover, while being model dependent, TATOO can also be used even if no rotational departure is present. In that case, it gives results in agreement with the classical gyrochronological analysis. TATOO is a useful tool specifically designed for massive close-in planetary systems that can also be used as a classical gyrochronological tool. For now it is the only publicly available software to estimate the age of massive close-in planetary systems subject to tidal spin-up. In that sense, tidal-chronology can be seen as a first order correction of the impact of tidal interaction on gyrochronology.


title: Towards non-parametric fiber-specific $T_1$ relaxometry in the human brain

abstract: Purpose: To estimate fiber-specific $T_1$ values, i.e. proxies for myelin content, in heterogeneous brain tissue. Methods: A diffusion-$T_1$ correlation experiment was carried out on an in vivo human brain using tensor-valued diffusion encoding and multiple repetition times. The acquired data was inverted using a Monte-Carlo inversion algorithm that retrieves non-parametric distributions $\mathcal{P}(\mathbf{D},R_1)$ of diffusion tensors and longitudinal relaxation rates $R_1 = 1/T_1$. Orientation distribution functions (ODFs) of the highly anisotropic components of $\mathcal{P}(\mathbf{D},R_1)$ were defined to visualize orientation-specific diffusion-relaxation properties. Finally, Monte-Carlo density-peak clustering (MC-DPC) was performed to quantify fiber-specific features and investigate microstructural differences between white-matter fiber bundles. Results: Parameter maps corresponding to $\mathcal{P}(\mathbf{D},R_1)$'s statistical descriptors were obtained, exhibiting the expected $R_1$ contrast between brain-tissue types. Our ODFs recovered local orientations consistent with the known anatomy and indicated possible differences in $T_1$ relaxation between major fiber bundles. These differences, confirmed by MC-DPC, were in qualitative agreement with previous model-based works but seem biased by the limitations of our current experimental setup. Conclusions: Our Monte-Carlo framework enables the non-parametric estimation of fiber-specific diffusion-$T_1$ features, thereby showing potential for characterizing developmental or pathological changes in $T_1$ within a given fiber bundle, and for investigating inter-bundle $T_1$ differences.


title: Uncovering the Topology of Time-Varying fMRI Data using Cubical Persistence

abstract: Functional magnetic resonance imaging (fMRI) is a crucial technology for gaining insights into cognitive processes in humans. Data amassed from fMRI measurements result in volumetric data sets that vary over time. However, analysing such data presents a challenge due to the large degree of noise and person-to-person variation in how information is represented in the brain. To address this challenge, we present a novel topological approach that encodes each time point in an fMRI data set as a persistence diagram of topological features, i.e. high-dimensional voids present in the data. This representation naturally does not rely on voxel-by-voxel correspondence and is robust to noise. We show that these time-varying persistence diagrams can be clustered to find meaningful groupings between participants, and that they are also useful in studying within-subject brain state trajectories of subjects performing a particular task. Here, we apply both clustering and trajectory analysis techniques to a group of participants watching the movie 'Partly Cloudy'. We observe significant differences in both brain state trajectories and overall topological activity between adults and children watching the same movie.


title: Ferroelastic-switching-driven colossal shear strain and piezoelectricity in a hybrid ferroelectric

abstract: Materials that can produce large controllable strains are widely used in shape memory devices, actuators and sensors. Great efforts have been made to improve the strain outputs of various material systems. Among them, ferroelastic transitions underpin giant reversible strains in electrically-driven ferro/piezoelectrics and thermally- or magneticallydriven shape memory alloys. However, large-strain ferroelastic switching in conventional ferroelectrics is very challenging while magnetic and thermal controls are not desirable for applications. Here, we demonstrate an unprecedentedly large shear strain up to 21.5 % in a hybrid ferroelectric, C6H5N(CH3)3CdCl3. The strain response is about two orders of magnitude higher than those of top-performing conventional ferroelectric polymers and oxides. It is achieved via inorganic bond switching and facilitated by the structural confinement of the large organic moieties, which prevents the undesired 180-degree polarization switching. Furthermore, Br substitution can effectively soften the bonds and result in giant shear piezoelectric coefficient (d35 ~ 4800 pm/V) in Br-rich end of the solid solution, C6H5N(CH3)3CdBr3xCl3(1-x). The superior electromechanical properties of the compounds promise their potential in lightweight and high energy density devices, and the strategy described here should inspire the development of next-generation piezoelectrics and electroactive materials based on hybrid ferroelectrics.


title: On variation of zeros of classical discrete orthogonal polynomials

abstract: The purpose of this note is to establish, from the hypergeometric-type difference equation introduced by Nikiforov and Uvarov, new tractable sufficient conditions for the monotonicity with respect to a real parameter of zeros of classical discrete orthogonal polynomials. This result allows one to carry out a systematic study of the monotonicity of zeros of classical orthogonal polynomials on linear, quadratic, q-linear, and q-quadratic grids. In particular, we analyze in a simple and unified way the monotonicity of the zeros of Hahn, Charlier, Krawtchouk, Meixner, Racah, dual Hahn, q-Meixner, quantum q-Krawtchouk, q-Krawtchouk, affine q-Krawtchouk, q-Charlier, Al-Salam-Carlitz, q-Hahn, little q-Jacobi, little q-Laguerre/Wall, q-Bessel, q-Racah and dual q-Hahn polynomials.


title: Optical Music Recognition: State of the Art and Major Challenges

abstract: Optical Music Recognition (OMR) is concerned with transcribing sheet music into a machine-readable format. The transcribed copy should allow musicians to compose, play and edit music by taking a picture of a music sheet. Complete transcription of sheet music would also enable more efficient archival. OMR facilitates examining sheet music statistically or searching for patterns of notations, thus helping use cases in digital musicology too. Recently, there has been a shift in OMR from using conventional computer vision techniques towards a deep learning approach. In this paper, we review relevant works in OMR, including fundamental methods and significant outcomes, and highlight different stages of the OMR pipeline. These stages often lack standard input and output representation and standardised evaluation. Therefore, comparing different approaches and evaluating the impact of different processing methods can become rather complex. This paper provides recommendations for future work, addressing some of the highlighted issues and represents a position in furthering this important field of research.


title: On Disentangled Representations Learned From Correlated Data

abstract: The focus of disentanglement approaches has been on identifying independent factors of variation in data. However, the causal variables underlying real-world observations are often not statistically independent. In this work, we bridge the gap to real-world scenarios by analyzing the behavior of the most prominent disentanglement approaches on correlated data in a large-scale empirical study (including 4260 models). We show and quantify that systematically induced correlations in the dataset are being learned and reflected in the latent representations, which has implications for downstream applications of disentanglement such as fairness. We also demonstrate how to resolve these latent correlations, either using weak supervision during training or by post-hoc correcting a pre-trained model with a small number of labels.


title: Examining the Role of Mood Patterns in Predicting Self-Reported Depressive symptoms

abstract: Depression is the leading cause of disability worldwide. Initial efforts to detect depression signals from social media posts have shown promising results. Given the high internal validity, results from such analyses are potentially beneficial to clinical judgment. The existing models for automatic detection of depressive symptoms learn proxy diagnostic signals from social media data, such as help-seeking behavior for mental health or medication names. However, in reality, individuals with depression typically experience depressed mood, loss of pleasure nearly in all the activities, feeling of worthlessness or guilt, and diminished ability to think. Therefore, a lot of the proxy signals used in these models lack the theoretical underpinnings for depressive symptoms. It is also reported that social media posts from many patients in the clinical setting do not contain these signals. Based on this research gap, we propose to monitor a type of signal that is well-established as a class of symptoms in affective disorders -- mood. The mood is an experience of feeling that can last for hours, days, or even weeks. In this work, we attempt to enrich current technology for detecting symptoms of potential depression by constructing a 'mood profile' for social media users.


title: Recent developments on Oka manifolds

abstract: In this paper we present the main developments in Oka theory since the publication of my book Stein Manifolds and Holomorphic Mappings (The Homotopy Principle in Complex Analysis)}, Second Edition, Springer, 2017. We also give several new results, examples and constructions of Oka domains in Euclidean and projective spaces. Furthermore, we show that for $n>1$ the fibre $\mathbb C^n$ in a Stein family can degenerate to a non-Oka fibre, thereby answering a question of Takeo Ohsawa. Several open problems are discussed.


title: Graph Meta Learning via Local Subgraphs

abstract: Prevailing methods for graphs require abundant label and edge information for learning. When data for a new task are scarce, meta-learning can learn from prior experiences and form much-needed inductive biases for fast adaption to new tasks. Here, we introduce G-Meta, a novel meta-learning algorithm for graphs. G-Meta uses local subgraphs to transfer subgraph-specific information and learn transferable knowledge faster via meta gradients. G-Meta learns how to quickly adapt to a new task using only a handful of nodes or edges in the new task and does so by learning from data points in other graphs or related, albeit disjoint label sets. G-Meta is theoretically justified as we show that the evidence for a prediction can be found in the local subgraph surrounding the target node or edge. Experiments on seven datasets and nine baseline methods show that G-Meta outperforms existing methods by up to 16.3%. Unlike previous methods, G-Meta successfully learns in challenging, few-shot learning settings that require generalization to completely new graphs and never-before-seen labels. Finally, G-Meta scales to large graphs, which we demonstrate on a new Tree-of-Life dataset comprising of 1,840 graphs, a two-orders of magnitude increase in the number of graphs used in prior work.


title: FinEst BERT and CroSloEngual BERT: less is more in multilingual models

abstract: Large pretrained masked language models have become state-of-the-art solutions for many NLP problems. The research has been mostly focused on English language, though. While massively multilingual models exist, studies have shown that monolingual models produce much better results. We train two trilingual BERT-like models, one for Finnish, Estonian, and English, the other for Croatian, Slovenian, and English. We evaluate their performance on several downstream tasks, NER, POS-tagging, and dependency parsing, using the multilingual BERT and XLM-R as baselines. The newly created FinEst BERT and CroSloEngual BERT improve the results on all tasks in most monolingual and cross-lingual situations


title: Lateral land movement prediction from GNSS position time series in a machine learning aided algorithm

abstract: We investigate the accuracy of conventional machine learning aided algorithms for the prediction of lateral land movement in an area using the precise position time series of permanent GNSS stations. The machine learning algorithms that are used are tantamount to the ones used in [1], except for the radial basis functions, i.e. multilayer perceptron, Bayesian neural network, Gaussian processes, k-nearest neighbor, generalized regression neural network, classification and regression trees, and support vector regression. A comparative analysis is presented in which the accuracy level of the mentioned machine learning methods is checked against each other. It is shown that the most accurate method for both of the components of the time series is the Gaussian processes, achieving up to 9.5 centimeters in accuracy.


title: On the rigidity of harmonic-Ricci solitons

abstract: In this paper we introduce the notion of rigidity for harmonic-Ricci solitons and we provide some characterizations of rigidity, generalizing some known results for Ricci solitons. In the compact case we are able to deal with not necessarily gradient solitons while, in the complete non-compact case, we restrict our attention to steady and shrinking gradient solitons. We show that the rigidity can be traced back to the vanishing of certain modified curvature tensors that take into account the geometry a Riemannian manifold equipped with a smooth map $\varphi$, called $\varphi$-curvatures, which are a natural generalization of the standard curvature tensors in the setting of harmonic-Ricci solitons.


title: Universal Decomposition Algebras Represent Endomorphisms

abstract: The goal of this paper is to supply an explicit description of the universal decomposition algebra of the generic polynomial of degree $n$ into the product of two monic polynomials, one of degree $r$, as a representation of Lie algebras of $n\times n$ matrices with polynomial entries. This is related with the bosonic vertex representation of the Lie algebra $gl_\infty$ due to Date, Jimbo, Kashiwara and Miwa.


title: Well-posedness for good Boussinesq equations subject to quasi-periodic initial data

abstract: This paper concerns the local well-posedness for the "good" Boussinesq equation subject to quasi-periodic initial conditions. By constructing a delicately and subtly iterative process together with an explicit combinatorial analysis, we show that there exists a unique solution for such a model in a small region of time. The size of this region depends on both the given data and the frequency vector involved. Moreover the local solution has an expansion with exponentially decaying Fourier coefficients.


title: Herr-complexes in the Lubin-Tate setting

abstract: In this article we extend work of Herr from the case of cyclotomic $(\varphi,\Gamma)$-modules to the general case of Lubin-Tate $(\varphi,\Gamma)$-modules. In particular, we define generalized $\varphi$- and $\psi$-Herr complexes, which calculate Galois cohomology, when applied to the etale $(\varphi,\Gamma)$-modules attached to the coefficients.


title: Team RUC_AIM3 Technical Report at Activitynet 2020 Task 2: Exploring Sequential Events Detection for Dense Video Captioning

abstract: Detecting meaningful events in an untrimmed video is essential for dense video captioning. In this work, we propose a novel and simple model for event sequence generation and explore temporal relationships of the event sequence in the video. The proposed model omits inefficient two-stage proposal generation and directly generates event boundaries conditioned on bi-directional temporal dependency in one pass. Experimental results show that the proposed event sequence generation model can generate more accurate and diverse events within a small number of proposals. For the event captioning, we follow our previous work to employ the intra-event captioning models into our pipeline system. The overall system achieves state-of-the-art performance on the dense-captioning events in video task with 9.894 METEOR score on the challenge testing set.


title: Entropic gradient descent algorithms and wide flat minima

abstract: The properties of flat minima in the empirical risk landscape of neural networks have been debated for some time. Increasing evidence suggests they possess better generalization capabilities with respect to sharp ones. First, we discuss Gaussian mixture classification models and show analytically that there exist Bayes optimal pointwise estimators which correspond to minimizers belonging to wide flat regions. These estimators can be found by applying maximum flatness algorithms either directly on the classifier (which is norm independent) or on the differentiable loss function used in learning. Next, we extend the analysis to the deep learning scenario by extensive numerical validations. Using two algorithms, Entropy-SGD and Replicated-SGD, that explicitly include in the optimization objective a non-local flatness measure known as local entropy, we consistently improve the generalization error for common architectures (e.g. ResNet, EfficientNet). An easy to compute flatness measure shows a clear correlation with test accuracy.


title: The JHU Multi-Microphone Multi-Speaker ASR System for the CHiME-6 Challenge

abstract: This paper summarizes the JHU team's efforts in tracks 1 and 2 of the CHiME-6 challenge for distant multi-microphone conversational speech diarization and recognition in everyday home environments. We explore multi-array processing techniques at each stage of the pipeline, such as multi-array guided source separation (GSS) for enhancement and acoustic model training data, posterior fusion for speech activity detection, PLDA score fusion for diarization, and lattice combination for automatic speech recognition (ASR). We also report results with different acoustic model architectures, and integrate other techniques such as online multi-channel weighted prediction error (WPE) dereverberation and variational Bayes-hidden Markov model (VB-HMM) based overlap assignment to deal with reverberation and overlapping speakers, respectively. As a result of these efforts, our ASR systems achieve a word error rate of 40.5% and 67.5% on tracks 1 and 2, respectively, on the evaluation set. This is an improvement of 10.8% and 10.4% absolute, over the challenge baselines for the respective tracks.


title: An exact mapping between loop-erased random walks and an interacting field theory with two fermions and one boson

abstract: We give a simplified proof for the equivalence of loop-erased random walks to a lattice model containing two complex fermions, and one complex boson. This equivalence works on an arbitrary directed graph. Specifying to the $d$-dimensional hypercubic lattice, at large scales this theory reduces to a scalar $\phi^4$-type theory with two complex fermions, and one complex boson. While the path integral for the fermions is the Berezin integral, for the bosonic field we can either use a complex field $\phi(x)\in \mathbb C$ (standard formulation) or a nilpotent one satisfying $\phi(x)^2 =0$. We discuss basic properties of the latter formulation, which has distinct advantages in the lattice model.


title: ResOT: Resource-Efficient Oblique Trees for Neural Signal Classification

abstract: Classifiers that can be implemented on chip with minimal computational and memory resources are essential for edge computing in emerging applications such as medical and IoT devices. This paper introduces a machine learning model based on oblique decision trees to enable resource-efficient classification on a neural implant. By integrating model compression with probabilistic routing and implementing cost-aware learning, our proposed model could significantly reduce the memory and hardware cost compared to state-of-the-art models, while maintaining the classification accuracy. We trained the resource-efficient oblique tree with power-efficient regularization (ResOT-PE) on three neural classification tasks to evaluate the performance, memory, and hardware requirements. On seizure detection task, we were able to reduce the model size by 3.4X and the feature extraction cost by 14.6X compared to the ensemble of boosted trees, using the intracranial EEG from 10 epilepsy patients. In a second experiment, we tested the ResOT-PE model on tremor detection for Parkinson's disease, using the local field potentials from 12 patients implanted with a deep-brain stimulation (DBS) device. We achieved a comparable classification performance as the state-of-the-art boosted tree ensemble, while reducing the model size and feature extraction cost by 10.6X and 6.8X, respectively. We also tested on a 6-class finger movement detection task using ECoG recordings from 9 subjects, reducing the model size by 17.6X and feature computation cost by 5.1X. The proposed model can enable a low-power and memory-efficient implementation of classifiers for real-time neurological disease detection and motor decoding.


title: Implications of baryon-dark matter interaction on IGM temperature and tSZ effect with magnetic field

abstract: We show that the combined effect of cosmic magnetic field and a possible non-standard interaction between baryons and dark matter has interesting consequences on the thermal Sunyaev$-$Zel${'}$dovich (tSZ) effect depending on the temperature and the ionization state of the intergalactic medium. The drag force between the baryons and dark matter due to the relative velocity between them, and their temperature difference results in heat transfer between these two species. At the same time the ambipolar diffusion and the decaying magnetic turbulence tends to heat up the baryons. This interplay of these two processes give rise to different evolution histories of the thermal and ionization state of the universe and hence influences the CMB spectrum at small scales through the tSZ effect. In this work, we have computed the evolution of the temperature, ionization fraction and the y-parameter of the CMB for different strengths of the magnetic field and the interaction cross-section. We note that an interaction cross-section of $\sigma_0=10^{-42}$ m$^{2}$ (with a magnetic field strength of $3.0$ nG) reduces the y-parameter by an order of magnitude as compared to the case with similar strength of magnetic field but where there is no such interaction between the baryons and dark matter.


title: High-resolution Bayesian mapping of landslide hazard with unobserved trigger event

abstract: Statistical models for landslide hazard enable mapping of risk factors and landslide occurrence intensity by using geomorphological covariates available at high spatial resolution. However, the spatial distribution of the triggering event (e.g., precipitation or earthquakes) is often not directly observed. In this paper, we develop Bayesian spatial hierarchical models for point patterns of landslide occurrences using different types of log-Gaussian Cox processes. Starting from a competitive baseline model that captures the unobserved precipitation trigger through a spatial random effect at slope unit resolution, we explore novel complex model structures that take clusters of events arising at small spatial scales into account, as well as nonlinear or spatially-varying covariate effects. For a 2009 event of around 4000 precipitation-triggered landslides in Sicily, Italy, we show how to fit our proposed models efficiently using the integrated nested Laplace approximation (INLA), and rigorously compare the performance of our models both from a statistical and applied perspective. In this context, we argue that model comparison should not be based on a single criterion, and that different models of various complexity may provide insights into complementary aspects of the same applied problem. In our application, our models are found to have mostly the same spatial predictive performance, implying that key to successful prediction is the inclusion of a slope-unit resolved random effect capturing the precipitation trigger. Interestingly, a parsimonious formulation of space-varying slope effects reflects a physical interpretation of the precipitation trigger: in subareas with weak trigger, the slope steepness is shown to be mostly irrelevant.


title: On the method of ascertainment of the possible historical proximity of two Extensive Air Showers

abstract: The increasing efforts are still in progress to establish existence and to investigate the properties of pairs of Extensive Air Showers (EAS) that can be considered as originated from a single event which produced the Cosmic Radiation (CR) particles that in turn initiated both showers. Considerably remote CR installations observing EAS events are particularly useful for this purpose. The estimation method is proposed for determination of such EAS pairs, observed by a pair of mutually remote installations and initiated by two initial CR particles, which can be regarded as historically proximal and possibly congenetic. The numerical example of application of this method is given using a toy simulation sample of showers.


title: An Analysis of Constant Step Size SGD in the Non-convex Regime: Asymptotic Normality and Bias

abstract: Structured non-convex learning problems, for which critical points have favorable statistical properties, arise frequently in statistical machine learning. Algorithmic convergence and statistical estimation rates are well-understood for such problems. However, quantifying the uncertainty associated with the underlying training algorithm is not well-studied in the non-convex setting. In order to address this shortcoming, in this work, we establish an asymptotic normality result for the constant step size stochastic gradient descent (SGD) algorithm--a widely used algorithm in practice. Specifically, based on the relationship between SGD and Markov Chains [DDB19], we show that the average of SGD iterates is asymptotically normally distributed around the expected value of their unique invariant distribution, as long as the non-convex and non-smooth objective function satisfies a dissipativity property. We also characterize the bias between this expected value and the critical points of the objective function under various local regularity conditions. Together, the above two results could be leveraged to construct confidence intervals for non-convex problems that are trained using the SGD algorithm.

categories: stat.ML cs.LG math.OC math.ST stat.CO stat.TH


title: Combinatorial Pure Exploration with Full-Bandit or Partial Linear Feedback

abstract: In this paper, we first study the problem of combinatorial pure exploration with full-bandit feedback (CPE-BL), where a learner is given a combinatorial action space $\mathcal{X} \subseteq \{0,1\}^d$, and in each round the learner pulls an action $x \in \mathcal{X}$ and receives a random reward with expectation $x^{\top} \theta$, with $\theta \in \mathbb{R}^d$ a latent and unknown environment vector. The objective is to identify the optimal action with the highest expected reward, using as few samples as possible. For CPE-BL, we design the first {\em polynomial-time adaptive} algorithm, whose sample complexity matches the lower bound (within a logarithmic factor) for a family of instances and has a light dependence of $\Delta_{\min}$ (the smallest gap between the optimal action and sub-optimal actions). Furthermore, we propose a novel generalization of CPE-BL with flexible feedback structures, called combinatorial pure exploration with partial linear feedback (CPE-PL), which encompasses several families of sub-problems including full-bandit feedback, semi-bandit feedback, partial feedback and nonlinear reward functions. In CPE-PL, each pull of action $x$ reports a random feedback vector with expectation of $M_{x} \theta $, where $M_x \in \mathbb{R}^{m_x \times d}$ is a transformation matrix for $x$, and gains a random (possibly nonlinear) reward related to $x$. For CPE-PL, we develop the first {\em polynomial-time} algorithm, which simultaneously addresses limited feedback, general reward function and combinatorial action space, and provide its sample complexity analysis. Our empirical evaluation demonstrates that our algorithms run orders of magnitude faster than the existing ones, and our CPE-BL algorithm is robust across different $\Delta_{\min}$ settings while our CPE-PL algorithm is the only one returning correct answers for nonlinear reward functions.


title: Fair Influence Maximization: A Welfare Optimization Approach

abstract: Several behavioral, social, and public health interventions, such as suicide/HIV prevention or community preparedness against natural disasters, leverage social network information to maximize outreach. Algorithmic influence maximization techniques have been proposed to aid with the choice of "peer leaders" or "influencers" in such interventions. Yet, traditional algorithms for influence maximization have not been designed with these interventions in mind. As a result, they may disproportionately exclude minority communities from the benefits of the intervention. This has motivated research on fair influence maximization. Existing techniques come with two major drawbacks. First, they require committing to a single fairness measure. Second, these measures are typically imposed as strict constraints leading to undesirable properties such as wastage of resources. To address these shortcomings, we provide a principled characterization of the properties that a fair influence maximization algorithm should satisfy. In particular, we propose a framework based on social welfare theory, wherein the cardinal utilities derived by each community are aggregated using the isoelastic social welfare functions. Under this framework, the trade-off between fairness and efficiency can be controlled by a single inequality aversion design parameter. We then show under what circumstances our proposed principles can be satisfied by a welfare function. The resulting optimization problem is monotone and submodular and can be solved efficiently with optimality guarantees. Our framework encompasses as special cases leximin and proportional fairness. Extensive experiments on synthetic and real world datasets including a case study on landslide risk management demonstrate the efficacy of the proposed framework.


title: Trajectory Generation by Chance Constrained Nonlinear MPC with Probabilistic Prediction

abstract: Continued great efforts have been dedicated towards high-quality trajectory generation based on optimization methods, however, most of them do not suitably and effectively consider the situation with moving obstacles; and more particularly, the future position of these moving obstacles in the presence of uncertainty within some possible prescribed prediction horizon. To cater to this rather major shortcoming, this work shows how a variational Bayesian Gaussian mixture model (vBGMM) framework can be employed to predict the future trajectory of moving obstacles; and then with this methodology, a trajectory generation framework is proposed which will efficiently and effectively address trajectory generation in the presence of moving obstacles, and also incorporating presence of uncertainty within a prediction horizon. In this work, the full predictive conditional probability density function (PDF) with mean and covariance is obtained, and thus a future trajectory with uncertainty is formulated as a collision region represented by a confidence ellipsoid. To avoid the collision region, chance constraints are imposed to restrict the collision probability, and subsequently a nonlinear MPC problem is constructed with these chance constraints. It is shown that the proposed approach is able to predict the future position of the moving obstacles effectively; and thus based on the environmental information of the probabilistic prediction, it is also shown that the timing of collision avoidance can be earlier than the method without prediction. The tracking error and distance to obstacles of the trajectory with prediction are smaller compared with the method without prediction.


title: Launching Stealth Attacks using Cloud

abstract: Cloud computing offers users scalable platforms and low resource cost. At the same time, the off-site location of the resources of this service model makes it more vulnerable to certain types of adversarial actions. Cloud computing has not only gained major user base, but also, it has the features that attackers can leverage to remain anonymous and stealth. With convenient access to data and technology, cloud has turned into an attack platform among other utilization. This paper reports our study to show that cyber attackers heavily abuse the public cloud platforms to setup their attack environments and launch stealth attacks. The paper first reviews types of attacks launched through cloud environment. It then reports case studies through which the processes of launching cyber attacks using clouds are demonstrated.


title: Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback

abstract: Behavioral cues play a significant part in human communication and cognitive perception. In most professional domains, employee recruitment policies are framed such that both professional skills and personality traits are adequately assessed. Hiring interviews are structured to evaluate expansively a potential employee's suitability for the position - their professional qualifications, interpersonal skills, ability to perform in critical and stressful situations, in the presence of time and resource constraints, etc. Therefore, candidates need to be aware of their positive and negative attributes and be mindful of behavioral cues that might have adverse effects on their success. We propose a multimodal analytical framework that analyzes the candidate in an interview scenario and provides feedback for predefined labels such as engagement, speaking rate, eye contact, etc. We perform a comprehensive analysis that includes the interviewee's facial expressions, speech, and prosodic information, using the video, audio, and text transcripts obtained from the recorded interview. We use these multimodal data sources to construct a composite representation, which is used for training machine learning classifiers to predict the class labels. Such analysis is then used to provide constructive feedback to the interviewee for their behavioral cues and body language. Experimental validation showed that the proposed methodology achieved promising results.


title: Dependency of Sliding Friction for Two Dimensional Systems on Electronegativity

abstract: We study the role of electronegativity in sliding friction for five different two dimensional (2D) monolayer systems using density functional theory (DFT) with van der Waals (vdW) corrections. We show that the friction between the commensurate 2D layered systems depends strongly on the electronegativity difference of the involved atoms. All the 2D layered structures exhibit almost the same magnitude of friction force when sliding along the nonpolar path, independent of the material and the surface structures. In contrast, for sliding friction along the polar path, the friction force obeys a universal linear scaling law as a function of the electronegativity difference of its constituent atoms. Further analyses demonstrate that atomic dipoles in the 2D monolayers induced by the electronegativity difference enhance the corrugation of charge distribution and increase the sliding barrier accordingly. Our studies reveal that electronegativity plays an important role in friction of low dimensional systems, and will provide a strategy for designing nanoscale devices further.


title: Loss Rate Forecasting Framework Based on Macroeconomic Changes: Application to US Credit Card Industry

abstract: A major part of the balance sheets of the largest US banks consists of credit card portfolios. Hence, managing the charge-off rates is a vital task for the profitability of the credit card industry. Different macroeconomic conditions affect individuals' behavior in paying down their debts. In this paper, we propose an expert system for loss forecasting in the credit card industry using macroeconomic indicators. We select the indicators based on a thorough review of the literature and experts' opinions covering all aspects of the economy, consumer, business, and government sectors. The state of the art machine learning models are used to develop the proposed expert system framework. We develop two versions of the forecasting expert system, which utilize different approaches to select between the lags added to each indicator. Among 19 macroeconomic indicators that were used as the input, six were used in the model with optimal lags, and seven indicators were selected by the model using all lags. The features that were selected by each of these models covered all three sectors of the economy. Using the charge-off data for the top 100 US banks ranked by assets from the first quarter of 1985 to the second quarter of 2019, we achieve mean squared error values of 1.15E-03 and 1.04E-03 using the model with optimal lags and the model with all lags, respectively. The proposed expert system gives a holistic view of the economy to the practitioners in the credit card industry and helps them to see the impact of different macroeconomic conditions on their future loss.


title: Fake Reviews Detection through Ensemble Learning

abstract: Customers represent their satisfactions of consuming products by sharing their experiences through the utilization of online reviews. Several machine learning-based approaches can automatically detect deceptive and fake reviews. Recently, there have been studies reporting the performance of ensemble learning-based approaches in comparison to conventional machine learning techniques. Motivated by the recent trends in ensemble learning, this paper evaluates the performance of ensemble learning-based approaches to identify bogus online information. The application of a number of ensemble learning-based approaches to a collection of fake restaurant reviews that we developed show that these ensemble learning-based approaches detect deceptive information better than conventional machine learning algorithms.


title: Equivalence of solutions between the four-dimensional novel and regularized EGB theories in a cylindrically symmetric spacetime

abstract: Recently, a novel four-dimensional Einstein-Gauss-Bonnet (EGB) theory was presented to bypass the Lovelock's theorem and to give nontrivial effects on the four-dimensional local gravity. The main mechanism is to introduce a redefinition $\alpha\rightarrow\alpha/(D-4)$ and to take the limit $D\rightarrow4$. However, this theory does not have standard four-dimensional field equations. Some regularization procedures are then proposed to address this problem [arXiv:2003.11552, arXiv:2003.12771, arXiv:2004.08362, arXiv:2004.09472, arXiv:2004.10716]. The resultant regularized four-dimensional EGB theory has the same on-shell action as the original theory. Thus it is expected that the novel four-dimensional EGB theory is equivalent to its regularized version. However, the equivalence of these two theories is symmetry-dependent. In this paper, we test the equivalence in a cylindrically symmetric spacetime. The well-defined field equations of the two theories are obtained, with which our follow-up analysis shows that they are equivalent in such spacetime. Cylindrical cosmic strings are then considered as specific examples of the metric. Three sets of solutions are obtained and the corresponding string mass densities are evaluated. The results reveal how the Gauss-Bonnet term in four dimensions contributes to the string geometry in the new theory.


title: Cloud as an Attack Platform

abstract: We present an exploratory study of responses from $75$ security professionals and ethical hackers in order to understand how they abuse cloud platforms for attack purposes. The participants were recruited at the Black Hat and DEF CON conferences. We presented the participants' with various attack scenarios and asked them to explain the steps they would have carried out for launching the attack in each scenario. Participants' responses were studied to understand attackers' mental models, which would improve our understanding of necessary security controls and recommendations regarding precautionary actions to circumvent the exploitation of clouds for malicious activities. We observed that in 93.78% of the responses, participants are abusing cloud services to establish their attack environment and launch attacks.


title: Inversion arrangements and the weak Bruhat order

abstract: For each permutation $w$, we can construct a collection of hyperplanes $\mathcal{A}_w$ according to the inversions of $w$, which is called the inversion hyperplane arrangement associated to $w$. It was conjectured by Postnikov and confirmed by Hultman, Linusson, Shareshian and Sj\"{o}strand that the number of regions of $\mathcal{A}_w$ is less than or equal to the number of permutations below $w$ in the Bruhat order, with the equality holds if and only if $w$ avoids the four patterns 4231, 35142, 42513 and 351624. In this paper, we show that the number of regions of $\mathcal{A}_w$ is greater than or equal to the number of permutations below $w$ in the weak Bruhat order, with the equality holds if and only if $w$ avoids the patterns 231 and 312.


title: Categorical anomaly detection in heterogeneous data using minimum description length clustering

abstract: Fast and effective unsupervised anomaly detection algorithms have been proposed for categorical data based on the minimum description length (MDL) principle. However, they can be ineffective when detecting anomalies in heterogeneous datasets representing a mixture of different sources, such as security scenarios in which system and user processes have distinct behavior patterns. We propose a meta-algorithm for enhancing any MDL-based anomaly detection model to deal with heterogeneous data by fitting a mixture model to the data, via a variant of k-means clustering. Our experimental results show that using a discrete mixture model provides competitive performance relative to two previous anomaly detection algorithms, while mixtures of more sophisticated models yield further gains, on both synthetic datasets and realistic datasets from a security scenario.


title: Robust Recursive Partitioning for Heterogeneous Treatment Effects with Uncertainty Quantification

abstract: Subgroup analysis of treatment effects plays an important role in applications from medicine to public policy to recommender systems. It allows physicians (for example) to identify groups of patients for whom a given drug or treatment is likely to be effective and groups of patients for which it is not. Most of the current methods of subgroup analysis begin with a particular algorithm for estimating individualized treatment effects (ITE) and identify subgroups by maximizing the difference across subgroups of the average treatment effect in each subgroup. These approaches have several weaknesses: they rely on a particular algorithm for estimating ITE, they ignore (in)homogeneity within identified subgroups, and they do not produce good confidence estimates. This paper develops a new method for subgroup analysis, R2P, that addresses all these weaknesses. R2P uses an arbitrary, exogenously prescribed algorithm for estimating ITE and quantifies the uncertainty of the ITE estimation, using a construction that is more robust than other methods. Experiments using synthetic and semi-synthetic datasets (based on real data) demonstrate that R2P constructs partitions that are simultaneously more homogeneous within groups and more heterogeneous across groups than the partitions produced by other methods. Moreover, because R2P can employ any ITE estimator, it also produces much narrower confidence intervals with a prescribed coverage guarantee than other methods.


title: A MeerKAT Survey of Nearby Novalike Cataclysmic Variables

abstract: We present the results of MeerKAT radio observations of eleven nearby novalike cataclysmic variables. We have detected radio emission from IM Eri, RW Sex, V3885 Sgr and V603 Aql. While RW Sex, V3885 Sgr and V603 Aql had been previously detected, this is the first reported radio detection of IM Eri. Our observations have doubled the sample of non-magnetic CVs with sensitive radio data. We observe that at our radio detection limits, a specific optical luminosity $\gtrsim 2.2\times 10^{18}$ erg/s/Hz (corresponding to $M_V \lesssim 6.0$) is required to produce a radio detection. We also observe that the X-ray and radio luminosities of our detected novalikes are on an extension of the $L_{X} \propto L_{R}^{\sim 0.7}$ power law originally proposed for non-pulsating neutron star low-mass X-ray binaries. We find no other correlations between the radio emission and emission in other wavebands or any other system parameters for the existing sample of radio-detected non-magnetic CVs. We measure in-band (0.9-1.7 GHz) radio spectral indices that are consistent with reports from earlier work. Finally, we constructed broad spectral energy distributions for our sample from published multi-wavelength data, and use them to place constraints on the mass transfer rates of these systems.


title: Vehicle Redistribution in Ride-Sourcing Markets using Convex Minimum Cost Flows

abstract: Ride-sourcing platforms often face imbalances in the demand and supply of rides across areas in their operating road-networks. As such, dynamic pricing methods have been used to mediate these demand asymmetries through surge price multipliers, thus incentivising higher driver participation in the market. However, the anticipated commercialisation of autonomous vehicles could transform the current ride-sourcing platforms to fleet operators. The absence of human drivers fosters the need for empty vehicle management to address any vehicle supply deficiencies. Proactive redistribution using integer programming and demand predictive models have been proposed in research to address this problem. A shortcoming of existing models, however, is that they ignore the market structure and underlying customer choice behaviour. As such, current models do not capture the real value of redistribution. To resolve this, we formulate the vehicle redistribution problem as a non-linear minimum cost flow problem which accounts for the relationship of supply and demand of rides, by assuming a customer discrete choice model and a market structure. We demonstrate that this model can have a convex domain, and we introduce an edge splitting algorithm to solve a transformed convex minimum cost flow problem for vehicle redistribution. By testing our model using simulation, we show that our redistribution algorithm can decrease wait times by more than 50%, increase profit up to 10% with less than 20% increase in vehicle mileage. Our findings outline that the value of redistribution is contingent on localised market structure and customer behaviour.


title: Multidimensional Wavelets for Scalable Image Decomposition: Orbital Wavelets

abstract: Wavelets are closely related to the Schr\"odinger's wave functions and the interpretation of Born. Similarly to the appearance of atomic orbital, it is proposed to combine anti-symmetric wavelets into orbital wavelets. The proposed approach allows the increase of the dimension of wavelets through this process. New orbital 2D-wavelets are introduced for the decomposition of still images, showing that it is possible to perform an analysis simultaneous in two distinct scales. An example of such an image analysis is shown.


title: ISO-ChaI 52: a weakly-accreting young stellar object with a dipper light curve

abstract: We report on the discovery of periodic dips in the multiband lightcurve of ISO-ChaI 52, a young stellar object in the Chamaeleon I dark cloud. This is one among the peculiar objects that display very low or negligible accretion both in their UV continuum and spectral lines, although they present a remarkable infrared excess emission characteristic of optically-thick circumstellar disks. We have analyzed a VLT/X-Shooter spectrum with the tool ROTFIT to determine the stellar parameters. The latter, along with photometry from our campaign with the REM telescope and from the literature, have allowed us to model the spectral energy distribution and to estimate the size and temperature of the inner and outer disk. From the rotational period of the star/disk system of 3.45 days we estimate a disk inclination of 36$^\circ$. The depth of the dips in different bands has been used to gain information about the occulting material. A single extinction law is not able to fit the observed behavior, while a two-component model of a disk warp composed of a dense region with a gray extinction and an upper layer with an ISM-type extinction provides a better fit of the data.


title: A Frankel type theorem for generic submanifolds of Sasakian manifolds

abstract: We introduce a weaker notion of generic submanifold of a Sasakian manifold and we prove a Frankel type theorem for this kind of submanifolds under suitable hypotesis on the index of the scalar Levi forms determined by normal directions. It concerns the intersection between a generic and an invariant submanifold and the intersection between two generic submanifolds. From this theorem we derive some topological information about generic submanifolds of Sasakian space forms.


title: Combinatorial encoding of Bernoulli schemes and the asymptotic behavior of Young tableaux

abstract: We consider two examples of a fully decodable combinatorial encoding of Bernoulli schemes: the encoding via Weyl simplices and the much more complicated encoding via the RSK (Robinson--Schensted--Knuth) correspondence. In the first case, the decodability is a quite simple fact, while in the second case, this is a nontrivial result obtained by D.~Romik and P.~\'Sniady and based on the papers~ \cite{KV}, \cite{VK}, and others. We comment on the proofs from the viewpoint of the theory of measurable partitions; another proof, using representation theory and generalized Schur--Weyl duality, will be presented elsewhere. We also study a new dynamics of Bernoulli variables on $P$-tableaux and find the limit 3D-shape of these tableaux.


title: Estimation and Inference for Multi-Kink Quantile Regression

abstract: The Multi-Kink Quantile Regression (MKQR) model is an important tool for analyzing data with heterogeneous conditional distributions, especially when quantiles of response variable are of interest, due to its robustness to outliers and heavy-tailed errors in the response. It assumes different linear quantile regression forms in different regions of the domain of the threshold covariate but are still continuous at kink points. In this paper, we investigate parameter estimation, kink point detection and statistical inference in MKQR models. We propose an iterative segmented quantile regression algorithm for estimating both the regression coefficients and the locations of kink points. The proposed algorithm is much more computationally efficient than the grid search algorithm and not sensitive to the selection of initial values. Asymptotic properties, such as selection consistency of the number of kink points, asymptotic normality of the estimators of both regression coefficients and kink effects, are established to justify the proposed method theoretically. A score test, based on partial subgradients, is developed to verify whether the kink effects exist or not. Test-inversion confidence intervals for kink location parameters are also constructed. Intensive simulation studies conducted show the proposed methods work very well when sample size is finite. Finally, we apply the MKQR models together with the proposed methods to the dataset about secondary industrial structure of China and the dataset about triceps skinfold thickness of Gambian females, which leads to some very interesting findings. A new R package MultiKink is developed to implement the proposed methods.


title: A Line-Search Descent Algorithm for Strict Saddle Functions with Complexity Guarantees

abstract: We describe a line-search algorithm which achieves the best-known worst-case complexity results for problems with a certain "strict saddle" property that has been observed to hold in low-rank matrix optimization problems. Our algorithm is adaptive, in the sense that it makes use of backtracking line searches and does not require prior knowledge of the parameters that define the strict saddle property.


title: UWSpeech: Speech to Speech Translation for Unwritten Languages

abstract: Existing speech to speech translation systems heavily rely on the text of target language: they usually translate source language either to target text and then synthesize target speech from text, or directly to target speech with target text for auxiliary training. However, those methods cannot be applied to unwritten target languages, which have no written text or phoneme available. In this paper, we develop a translation system for unwritten languages, named as UWSpeech, which converts target unwritten speech into discrete tokens with a converter, and then translates source-language speech into target discrete tokens with a translator, and finally synthesizes target speech from target discrete tokens with an inverter. We propose a method called XL-VAE, which enhances vector quantized variational autoencoder (VQ-VAE) with cross-lingual (XL) speech recognition, to train the converter and inverter of UWSpeech jointly. Experiments on Fisher Spanish-English conversation translation dataset show that UWSpeech outperforms direct translation and VQ-VAE baseline by about 16 and 10 BLEU points respectively, which demonstrate the advantages and potentials of UWSpeech.