title: Private Facial Diagnosis as an Edge Service for Parkinson's DBS Treatment Valuation

abstract: Facial phenotyping has recently been successfully exploited for medical diagnosis as a novel way to diagnose a range of diseases, where facial biometrics has been revealed to have rich links to underlying genetic or medical causes. In this paper, taking Parkinson's Diseases (PD) as a case study, we proposed an Artificial-Intelligence-of-Things (AIoT) edge-oriented privacy-preserving facial diagnosis framework to analyze the treatment of Deep Brain Stimulation (DBS) on PD patients. In the proposed framework, a new edge-based information theoretically secure framework is proposed to implement private deep facial diagnosis as a service over a privacy-preserving AIoT-oriented multi-party communication scheme, where partial homomorphic encryption (PHE) is leveraged to enable privacy-preserving deep facial diagnosis directly on encrypted facial patterns. In our experiments with a collected facial dataset from PD patients, for the first time, we demonstrated that facial patterns could be used to valuate the improvement of PD patients undergoing DBS treatment. We further implemented a privacy-preserving deep facial diagnosis framework that can achieve the same accuracy as the non-encrypted one, showing the potential of our privacy-preserving facial diagnosis as an trustworthy edge service for grading the severity of PD in patients.


title: Slow dynamics for self-adjoint semigroups and unitary evolution groups

abstract: We obtain slow dynamics for self-adjoint semigroups and unitary evolution groups. For semigroups, the slow dynamics is for orbits, and for the average return probability in the case of unitary evolution groups. We present an application to the quantum dynamics of purely absolutely continuous systems


title: Adaptive Interference Coordination over Channels with Unknown State at the Encoder and the Decoder

abstract: We generalize the problem of controlling the interference created to an external observer while communicating over a discrete memoryless channel (DMC) which was studied in \cite{serrano:2014}. In particular, we consider the scenario where the transmission is established over a compound DMC channel with unknown state at both the encoder and the decoder. Depending on the exact state $s$ of the channel, we ask for a different level of average precision $\Delta_s$ on the establishment of the interference coordination with the external observer. For this set-up, we fully characterize the capacity region.


title: Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Data

abstract: This paper investigates the theoretical foundations of the t-distributed stochastic neighbor embedding (t-SNE) algorithm, a popular nonlinear dimension reduction and data visualization method. A novel theoretical framework for the analysis of t-SNE based on the gradient descent approach is presented. For the early exaggeration stage of t-SNE, we show its asymptotic equivalence to power iterations based on the underlying graph Laplacian, characterize its limiting behavior, and uncover its deep connection to Laplacian spectral clustering, and fundamental principles including early stopping as implicit regularization. The results explain the intrinsic mechanism and the empirical benefits of such a computational strategy. For the embedding stage of t-SNE, we characterize the kinematics of the low-dimensional map throughout the iterations, and identify an amplification phase, featuring the intercluster repulsion and the expansive behavior of the low-dimensional map, and a stabilization phase. The general theory explains the fast convergence rate and the exceptional empirical performance of t-SNE for visualizing clustered data, brings forth interpretations of the t-SNE visualizations, and provides theoretical guidance for applying t-SNE and selecting its tuning parameters in various applications.


title: Algorithmic Principles of Camera-based Respiratory Motion Extraction

abstract: Measuring the respiratory signal from a video based on body motion has been proposed and recently matured in products for video health monitoring. The core algorithm for this measurement is the estimation of tiny chest/abdominal motions induced by respiration, and the fundamental challenge is motion sensitivity. Though prior arts reported on the validation with real human subjects, there is no thorough/rigorous benchmark to quantify the sensitivities and boundary conditions of motion-based core respiratory algorithms that measure sub-pixel displacement between video frames. In this paper, we designed a setup with a fully-controllable physical phantom to investigate the essence of core algorithms, together with a mathematical model incorporating two motion estimation strategies and three spatial representations, leading to six algorithmic combinations for respiratory signal extraction. Their promises and limitations are discussed and clarified via the phantom benchmark. The insights gained in this paper are intended to improve the understanding and applications of camera-based respiration measurement in health monitoring.


title: Collective anomaly detection in High-dimensional VAR Models

abstract: There is increasing interest in detecting collective anomalies: potentially short periods of time where the features of data change before reverting back to normal behaviour. We propose a new method for detecting a collective anomaly in VAR models. Our focus is on situations where the change in the VAR coefficient matrix at an anomaly is sparse, i.e. a small number of entries of the VAR coefficient matrix change. To tackle this problem, we propose a test statistic for a local segment that is built on the lasso estimator of the change in model parameters. This enables us to detect a sparse change more efficiently and our lasso-based approach becomes especially advantageous when the anomalous interval is short. We show that the new procedure controls Type 1 error and has asymptotic power tending to one. The practicality of our approach is demonstrated through simulations and two data examples, involving New York taxi trip data and EEG data.


title: Resonance production in PbPb collisions at 5.02 TeV via hydrodynamics and hadronic afterburner

abstract: Using a relativistic hydrodynamics + hadronic afterburner simulation we explore resonance production in PbPb collisions at 5.02 TeV, and demonstrate that many resonance yields, mean transverse momenta, and flows are very sensitive to the late stage hadronic rescattering. Out of all measured resonances $\Lambda(1520)$ is affected strongest by the hadronic rescattering stage, which allows to estimate its duration, and even constrain branching ratios of $\Sigma^* \to \Lambda(1520)\pi$ decays. Strong suppression of $\Lambda(1520)$, which in vacuum has a lifetime of 12.6 fm/$c$, is explained by its small lifetime in a hadronic medium, between 1 and 2 fm/$c$ at temperatures between 100 and 150 MeV. We find that some resonances like $\Delta(1232)$, $f_0(980)$, $a_0(980)$, $\Lambda(1405)$ are enhanced rather than suppressed by the afterburner.


title: Deep learning for detecting pulmonary tuberculosis via chest radiography: an international study across 10 countries

abstract: Tuberculosis (TB) is a top-10 cause of death worldwide. Though the WHO recommends chest radiographs (CXRs) for TB screening, the limited availability of CXR interpretation is a barrier. We trained a deep learning system (DLS) to detect active pulmonary TB using CXRs from 9 countries across Africa, Asia, and Europe, and utilized large-scale CXR pretraining, attention pooling, and noisy student semi-supervised learning. Evaluation was on (1) a combined test set spanning China, India, US, and Zambia, and (2) an independent mining population in South Africa. Given WHO targets of 90% sensitivity and 70% specificity, the DLS's operating point was prespecified to favor sensitivity over specificity. On the combined test set, the DLS's ROC curve was above all 9 India-based radiologists, with an AUC of 0.90 (95%CI 0.87-0.92). The DLS's sensitivity (88%) was higher than the India-based radiologists (75% mean sensitivity), p<0.001 for superiority; and its specificity (79%) was non-inferior to the radiologists (84% mean specificity), p=0.004. Similar trends were observed within HIV positive and sputum smear positive sub-groups, and in the South Africa test set. We found that 5 US-based radiologists (where TB isn't endemic) were more sensitive and less specific than the India-based radiologists (where TB is endemic). The DLS also remained non-inferior to the US-based radiologists. In simulations, using the DLS as a prioritization tool for confirmatory testing reduced the cost per positive case detected by 40-80% compared to using confirmatory testing alone. To conclude, our DLS generalized to 5 countries, and merits prospective evaluation to assist cost-effective screening efforts in radiologist-limited settings. Operating point flexibility may permit customization of the DLS to account for site-specific factors such as TB prevalence, demographics, clinical resources, and customary practice patterns.


title: Chimeras unfolded

abstract: The instability of mixing in the Kuramoto model of coupled phase oscillators is the key to understanding a range of spatiotemporal patterns, which feature prominently in collective dynamics of systems ranging from neuronal networks, to coupled lasers, to power grids. In this paper, we describe a codimension-2 bifurcation of mixing whose unfolding, in addition to the classical scenario of the onset of synchronization, also explains the formation of clusters and chimeras. We use a combination of linear stability analysis and Penrose diagrams to identify and analyze a variety of spatiotemporal patterns including stationary and traveling coherent clusters and twisted states, as well as their combinations with regions of incoherent behavior called chimera states. The linear stability analysis is used to estimate of the velocity distribution within these structures. Penrose diagrams, on the other hand, predict accurately the basins of their existence. Furthermore, we show that network topology can endow chimera states with nontrivial spatial organization. In particular, we present twisted chimera states, whose coherent regions are organized as stationary or traveling twisted states. The analytical results are illustrated with numerical bifurcation diagrams computed for the Kuramoto model with uni-, bi-, and tri-modal frequency distributions and all-to-all and nonlocal nearest-neighbor connectivity.


title: Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcare

abstract: Accurate and explainable health event predictions are becoming crucial for healthcare providers to develop care plans for patients. The availability of electronic health records (EHR) has enabled machine learning advances in providing these predictions. However, many deep learning based methods are not satisfactory in solving several key challenges: 1) effectively utilizing disease domain knowledge; 2) collaboratively learning representations of patients and diseases; and 3) incorporating unstructured text. To address these issues, we propose a collaborative graph learning model to explore patient-disease interactions and medical domain knowledge. Our solution is able to capture structural features of both patients and diseases. The proposed model also utilizes unstructured text data by employing an attention regulation strategy and then integrates attentive text features into a sequential learning process. We conduct extensive experiments on two important healthcare problems to show the competitive prediction performance of the proposed method compared with various state-of-the-art models. We also confirm the effectiveness of learned representations and model interpretability by a set of ablation and case studies.


title: Retrofitting FSO Systems in Existing RF Infrastructure: A Non-Zero Sum Game Technology

abstract: Progress in optical wireless communication (OWC) has unleashed the potential to transmit data in an ultra-fast manner without incurring large investments and bulk infrastructure. OWC includes wireless data transmissions in three optical sub-bands; ultraviolet, visible, and infrared. This paper discusses installing infrared OWC, known as free space optics (FSO), systems on top of installed radio frequency (RF) networks for outdoor applications to benefit from the reliability of RF links and the unlicensed broad optical spectrum, and the large data rates carried by laser beams propagating in free space. We equally review commercially available solutions and the hardware requirements for RF and FSO technology co-existence. The potential of hybrid RF/FSO for space communication is further discussed. Finally, open problems and future research directions are presented.


title: Experimental Evaluation of Multiprecision Strategies for GMRES on GPUs

abstract: Support for lower precision computation is becoming more common in accelerator hardware due to lower power usage, reduced data movement and increased computational performance. However, computational science and engineering (CSE) problems require double precision accuracy in several domains. This conflict between hardware trends and application needs has resulted in a need for multiprecision strategies at the linear algebra algorithms level if we want to exploit the hardware to its full potential while meeting the accuracy requirements. In this paper, we focus on preconditioned sparse iterative linear solvers, a key kernel in several CSE applications. We present a study of multiprecision strategies for accelerating this kernel on GPUs. We seek the best methods for incorporating multiple precisions into the GMRES linear solver; these include iterative refinement and parallelizable preconditioners. Our work presents strategies to determine when multiprecision GMRES will be effective and to choose parameters for a multiprecision iterative refinement solver to achieve better performance. We use an implementation that is based on the Trilinos library and employs Kokkos Kernels for performance portability of linear algebra kernels. Performance results demonstrate the promise of multiprecision approaches and demonstrate even further improvements are possible by optimizing low-level kernels.


title: Bosonic $\eta$-deformed $AdS_4\times\mathbb{CP}^3$ Background

abstract: We build the bosonic $\eta$-deformed $AdS_4\times\mathbb{CP}^3$ background generated by an $r$-matrix that satisfies the modified classical Yang-Baxter equation. In a special limit we find that it is the gravity dual of the noncommutative ABJM theory.


title: Total hadronic and photonic cross sections and the nuclear configurational entropy concept

abstract: In the framework of eikonalized mini-jet model, contributions from gluon recombination effects are studied for the free proton in $pp$ and $\bar p p$ reactions. The nuclear configurational entropy is then used to calculate the main parameters to estimate the total proton cross sections for the recent data LHC, also corroborating to previous developments. Photoproduction cross sections with vector meson dominance and saturation effects for both total hadronic and photonic cross sections at a high energy regime are investigated. Extreme points of the configurational entropy provide the experimentally obtained cross sections within an optimal root-mean-square deviation.


title: Sparse Spectral-Galerkin Method on An Arbitrary Tetrahedron Using Generalized Koornwinder Polynomials

abstract: In this paper, we propose a sparse spectral-Galerkin approximation scheme for solving the second-order partial differential equations on an arbitrary tetrahedron. Generalized Koornwinder polynomials are introduced on the reference tetrahedron as basis functions with their various recurrence relations and differentiation properties being explored. The method leads to well-conditioned and sparse linear systems whose entries can either be calculated directly by the orthogonality of the generalized Koornwinder polynomials for differential equations with constant coefficients or be evaluated efficiently via our recurrence algorithm for problems with variable coefficients. Clenshaw algorithms for the evaluation of any polynomial in an expansion of the generalized Koornwinder basis are also designed to boost the efficiency of the method. Finally, numerical experiments are carried out to illustrate the effectiveness of the proposed Koornwinder spectral method.


title: Bose-Einstein condensation and non-extensive statistics

abstract: We study the Bose-Einstein condensation in non-extensive statistics for a free gas of bosons, and extend the results to the non-relativistic case as well. We present results for the dependence of the critical temperature and the condensate fraction on the entropic index, q, and show that the condensate can exist only for a limited range of q in both relativistic and non-relativistic systems. We provide numerical results for other thermodynamics quantities like the internal energy, specific heat and number fluctuations. We discuss the implications for high energy physics and hadron physics. The results for the non-relativistic case can be of interest in cold-atom systems.


title: A generalization of Molino's theory and equivariant basic \^A-genus characters

abstract: Molino's theory is a mathematical tool for studying Riemannian foliations. In this paper, we propose a generalization of Molino's theory with two Riemannian foliations. For this purpose, the projection of foliation with respect to a fibration is discussed. The generalization results in an equivariant basic cohomological isomorphism in case of Killing foliation. It is a generalization of results given by Goertsches and T\"oben. We also give a geometric realization of the cohomological isomorphism through equivariant basic \^A-genus characters, who play a prominent role in calculating the index of an elliptic operator by Atiyah-Singer's index formula.


title: On the enumeration of polynomials with prescribed factorization pattern

abstract: We use generating functions over group rings to count polynomials over finite fields with the first few coefficients prescribed and a factorization pattern prescribed. In particular, we obtain different exact formulas for the number of monic $n$-smooth polynomial of degree $m$ over a finite field, as well as the number of monic $n$-smooth polynomial of degree $m$ with the prescribed trace coefficient.


title: Counting Hamiltonian cycles in planar triangulations

abstract: Hakimi, Schmeichel, and Thomassen in 1979 conjectured that every $4$-connected planar triangulation $G$ on $n$ vertices has at least $2(n-2)(n-4)$ Hamiltonian cycles, with equality if and only if $G$ is a double wheel. In this paper, we show that every $4$-connected planar triangulation on $n$ vertices has $\Omega(n^2)$ Hamiltonian cycles. Moreover, we show that if $G$ is a $4$-connected planar triangulation on $n$ vertices and the distance between any two vertices of degree $4$ in $G$ is at least $3$, then $G$ has $2^{\Omega(n^{1/4})}$ Hamiltonian cycles.


title: Trust Region Method for Coupled Systems of PDE Solvers and Deep Neural Networks

abstract: Physics-informed machine learning and inverse modeling require the solution of ill-conditioned non-convex optimization problems. First-order methods, such as SGD and ADAM, and quasi-Newton methods, such as BFGS and L-BFGS, have been applied with some success to optimization problems involving deep neural networks in computational engineering inverse problems. However, empirical evidence shows that convergence and accuracy for these methods remain a challenge. Our study unveiled at least two intrinsic defects of these methods when applied to coupled systems of partial differential equations (PDEs) and deep neural networks (DNNs): (1) convergence is often slow with long plateaus that make it difficult to determine whether the method has converged or not; (2) quasi-Newton methods do not provide a sufficiently accurate approximation of the Hessian matrix; this typically leads to early termination (one of the stopping criteria of the optimizer is satisfied although the achieved error is far from minimal). Based on these observations, we propose to use trust region methods for optimizing coupled systems of PDEs and DNNs. Specifically, we developed an algorithm for second-order physics constrained learning, an efficient technique to calculate Hessian matrices based on computational graphs. We show that trust region methods overcome many of the defects and exhibit remarkable fast convergence and superior accuracy compared to ADAM, BFGS, and L-BFGS.


title: Prototype-supervised Adversarial Network for Targeted Attack of Deep Hashing

abstract: Due to its powerful capability of representation learning and high-efficiency computation, deep hashing has made significant progress in large-scale image retrieval. However, deep hashing networks are vulnerable to adversarial examples, which is a practical secure problem but seldom studied in hashing-based retrieval field. In this paper, we propose a novel prototype-supervised adversarial network (ProS-GAN), which formulates a flexible generative architecture for efficient and effective targeted hashing attack. To the best of our knowledge, this is the first generation-based method to attack deep hashing networks. Generally, our proposed framework consists of three parts, i.e., a PrototypeNet, a generator, and a discriminator. Specifically, the designed PrototypeNet embeds the target label into the semantic representation and learns the prototype code as the category-level representative of the target label. Moreover, the semantic representation and the original image are jointly fed into the generator for a flexible targeted attack. Particularly, the prototype code is adopted to supervise the generator to construct the targeted adversarial example by minimizing the Hamming distance between the hash code of the adversarial example and the prototype code. Furthermore, the generator is against the discriminator to simultaneously encourage the adversarial examples visually realistic and the semantic representation informative. Extensive experiments verify that the proposed framework can efficiently produce adversarial examples with better targeted attack performance and transferability over state-of-the-art targeted attack methods of deep hashing. The related codes could be available at https://github.com/xunguangwang/ProS-GAN .


title: How Costly is Noise? Data and Disparities in Consumer Credit

abstract: We show that lenders face more uncertainty when assessing default risk of historically under-served groups in US credit markets and that this information disparity is a quantitatively important driver of inefficient and unequal credit market outcomes. We first document that widely used credit scores are statistically noisier indicators of default risk for historically under-served groups. This noise emerges primarily through the explanatory power of the underlying credit report data (e.g., thin credit files), not through issues with model fit (e.g., the inability to include protected class in the scoring model). Estimating a structural model of lending with heterogeneity in information, we quantify the gains from addressing these information disparities for the US mortgage market. We find that equalizing the precision of credit scores can reduce disparities in approval rates and in credit misallocation for disadvantaged groups by approximately half.


title: A Distribution Free Conditional Independence Test with Applications to Causal Discovery

abstract: This paper is concerned with test of the conditional independence. We first establish an equivalence between the conditional independence and the mutual independence. Based on the equivalence, we propose an index to measure the conditional dependence by quantifying the mutual dependence among the transformed variables. The proposed index has several appealing properties. (a) It is distribution free since the limiting null distribution of the proposed index does not depend on the population distributions of the data. Hence the critical values can be tabulated by simulations. (b) The proposed index ranges from zero to one, and equals zero if and only if the conditional independence holds. Thus, it has nontrivial power under the alternative hypothesis. (c) It is robust to outliers and heavy-tailed data since it is invariant to conditional strictly monotone transformations. (d) It has low computational cost since it incorporates a simple closed-form expression and can be implemented in quadratic time. (e) It is insensitive to tuning parameters involved in the calculation of the proposed index. (f) The new index is applicable for multivariate random vectors as well as for discrete data. All these properties enable us to use the new index as statistical inference tools for various data. The effectiveness of the method is illustrated through extensive simulations and a real application on causal discovery.


title: A unified approach to mean-field team: homogeneity, heterogeneity and quasi-exchangeability

abstract: This paper aims to systematically solve stochastic team optimization of large-scale system, in a rather general framework. Concretely, the underlying large-scale system involves considerable weakly-coupled cooperative agents for which the individual admissible controls: (\textbf{i}) enter the diffusion terms, (\textbf{ii}) are constrained in some closed-convex subsets, and (\textbf{iii}) subject to a general \emph{partial decentralized information} structure. A more important but serious feature: (\textbf{iv}) all agents are heterogenous with \emph{continuum} instead \emph{finite} diversity. Combination of (\textbf{i})-(\textbf{iv}) yields a quite general modeling of stochastic team-optimization, but on the other hand, also fails current existing techniques of team analysis. In particular, classical team consistency with continuum heterogeneity collapses because of (\textbf{i}). As the resolution, a novel \emph{unified approach} is proposed under which the intractable \emph{continuum} \emph{heterogeneity} can be converted to a more tractable \emph{homogeneity}. As a trade-off, the underlying randomness is augmented, and all agents become (quasi) weakly-exchangeable. Such approach essentially involves a subtle balance between homogeneity v.s. heterogeneity, and left (prior-sampling)- v.s. right (posterior-sampling) information filtration. Subsequently, the consistency condition (CC) system takes a new type of forward-backward stochastic system with \emph{double-projections} (due to (\textbf{ii}), (\textbf{iii})), along with \emph{spatial mean} on continuum heterogenous index (due to (\textbf{iv})). Such system is new in team literature and its well-posedness is also challenging. We address this issue under mild conditions. Related asymptotic optimality is also established.


title: Affine Ricci Solitons associated to the Bott connection on three-dimensional Lorentzian Lie groups

abstract: In this paper, we compute the Bott connections and their curvature on three-dimensional Lorentzian Lie groups with three different distributions, and we classify affine Ricci solitons associated to the Bott connection on three-dimensional Lorentzian Lie groups with three different distributions.


title: fybrrStream: A WebRTC based Efficient and Scalable P2P Live Streaming Platform

abstract: The demand for streaming media and live video conferencing is at peak and expected to grow further, thereby the need for low-cost streaming services with better quality and lower latency is essential. Therefore, in this paper, we propose a novel peer-to-peer (P2P) live streaming platform, called fybrrStream, where a logical mesh and physical tree i.e., hybrid topology-based approach is leveraged for low latency streaming. fybrrStream distributes the load on participating peers in a hierarchical manner by considering their network bandwidth, network latency, and node stability. fybrrStream costs as low as the cost of just hosting a light-weight website and the performance is comparable to the existing state-of-the-art media streaming services. We evaluated and tested the proposed fybrrStream platform with real-field experiments using 50+ users spread across India and results obtained show significant improvements in the live streaming performance over other schemes.


title: Right-angled Artin groups and curve graphs of nonorientable surfaces

abstract: Let $N$ be a closed nonorientable surface with or without marked points. In this paper we prove that, for every finite full subgraph $\Gamma$ of $\mathcal{C}^{\mathrm{two}}(N)$, the right-angled Artin group on $\Gamma$ can be embedded in the mapping class group of $N$. Here, $\mathcal{C}^{\mathrm{two}}(N)$ is the subgraph, induced by essential two-sided simple closed curves in $N$, of the ordinal curve graph $\mathcal{C}(N)$. In addition, we show that there exists a finite graph $\Gamma$ which is not a full subgraph of $\mathcal{C}^{\mathrm{two}}(N)$ for some $N$, but the right-angled Artin group on $\Gamma$ can be embedded in the mapping class group of $N$.


title: Dynamic Routing and Spectrum Assignment based on the Availability of Consecutive Sub-channels in Flexi-grid Optical Networks

abstract: Using Optical Orthogonal Frequency Multiplexing (O-OFDM), variable bandwidth channels can be created in Elastic Optical Networks (EON). This allows the use of spectrum more efficiently by allocating integral multiple of basic bandwidth slots to the lightpath requests. Consequently, such networks are also called flexible grid optical networks. It also adds a constraint of keeping all the allocated slots together when deciding the routes for the requests. This constraint called the contiguity constraint makes the routing and spectrum algorithms more challenging. In any network, the lightpath requests will arrive and depart dynamically and will invariably lead to spectrum fragmentation, and hence network will have a reduction in maximum possible utilization due to increased blocking probability. In this paper, we have presented an improvised RSA algorithm that leads to lesser fragmentation. It is evident from the results that the presented RSA algorithm uses adaptive parameters to reduce the blocking probability and fragmentation compared to other algorithms reported in the recent past.


title: Layerwise Optimization by Gradient Decomposition for Continual Learning

abstract: Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic forgetting". To achieve the consistencies between the old tasks and the new task, one effective solution is to modify the gradient for update. Previous methods enforce independent gradient constraints for different tasks, while we consider these gradients contain complex information, and propose to leverage inter-task information by gradient decomposition. In particular, the gradient of an old task is decomposed into a part shared by all old tasks and a part specific to that task. The gradient for update should be close to the gradient of the new task, consistent with the gradients shared by all old tasks, and orthogonal to the space spanned by the gradients specific to the old tasks. In this way, our approach encourages common knowledge consolidation without impairing the task-specific knowledge. Furthermore, the optimization is performed for the gradients of each layer separately rather than the concatenation of all gradients as in previous works. This effectively avoids the influence of the magnitude variation of the gradients in different layers. Extensive experiments validate the effectiveness of both gradient-decomposed optimization and layer-wise updates. Our proposed method achieves state-of-the-art results on various benchmarks of continual learning.


title: Power-grid stability predictions using transferable machine learning

abstract: Complex network analyses have provided clues to improve power-grid stability with the help of numerical models. The high computational cost of numerical simulations, however, has inhibited the approach, especially when it deals with the dynamic properties of power grids such as frequency synchronization. In this study, we investigate machine learning techniques to estimate the stability of power-grid synchronization. We test three different machine learning algorithms -- random forest, support vector machine, and artificial neural network -- training them with two different types of synthetic power grids consisting of homogeneous and heterogeneous input-power distribution, respectively. We find that the three machine learning models better predict the synchronization stability of power-grid nodes when they are trained with the heterogeneous input-power distribution than the homogeneous one. With the real-world power grids of Great Britain, Spain, France, and Germany, we also demonstrate that the machine learning algorithms trained on synthetic power grids are transferable to the stability prediction of the real-world power grids, which implies the prospective applicability of machine learning techniques on power-grid studies.


title: General Unbiased Estimating Equations for Variance Components in Linear Mixed Models

abstract: This paper introduces a general framework for estimating variance components in the linear mixed models via general unbiased estimating equations, which include some well-used estimators such as the restricted maximum likelihood estimator. We derive the asymptotic covariance matrices and second-order biases under general estimating equations without assuming the normality of the underlying distributions and identify a class of second-order unbiased estimators of variance components. It is also shown that the asymptotic covariance matrices and second-order biases do not depend on whether the regression coefficients are estimated by the generalized or ordinary least squares methods. We carry out numerical studies to check the performance of the proposed method based on typical linear mixed models.


title: Case Study: Context Interactions & Physics Faculty's Professional Development

abstract: This paper investigates the interactions between context and professional development of physics instructors in a case study of two physics faculty. A phenomenological-case study approach was used to analyze two physics faculty at different institutions over a year and a half using three semi-structured interviews each. The data enabled the identification of relevant context elements; and the impact of these elements on physics faculty was explored by adapting a framework that examines instructors' professional development. The analysis shows that both case study subjects used their physics expertise and growing understanding of their context to develop their physics teaching. However, this growth was enacted differently given the nature of their context, highlighting instructors' strengths in navigating their local context to improve their physics teaching. The results show the subtleties of how context has a salient, complex, and evolving role in moderating faculty's professional development. By taking a faculty-centric approach, this paper broadens the community's awareness of the ways physics instructors develop their physics teaching. This work contributes to a relatively new lens by which the physics community views, discusses, and supports the professional development of physics faculty.


title: Attention elasticities and invariant information costs

abstract: We consider a generalization of rational inattention problems by measuring costs of information through the information radius (Sibson, 1969; Verd\'u, 2015) of statistical experiments. We introduce a notion of attention elasticity measuring the sensitivity of attention strategies with respect to changes in incentives. We show how the introduced class of cost functions controls attention elasticities while the Shannon model restricts attention elasticity to be unity. We explore further differences and similarities relative to the Shannon model in relation to invariance, posterior separability, consideration sets, and the ability to learn events with certainty. Lastly, we provide an efficient alternating minimization method -- analogous to the Blahut-Arimoto algorithm -- to obtain optimal attention strategies.


title: Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classification

abstract: The usage of smartphone-collected respiratory sound, trained with deep learning models, for detecting and classifying COVID-19 becomes popular recently. It removes the need for in-person testing procedures especially for rural regions where related medical supplies, experienced workers, and equipment are limited. However, existing sound-based diagnostic approaches are trained in a fully supervised manner, which requires large scale well-labelled data. It is critical to discover new methods to leverage unlabelled respiratory data, which can be obtained more easily. In this paper, we propose a novel self-supervised learning enabled framework for COVID-19 cough classification. A contrastive pre-training phase is introduced to train a Transformer-based feature encoder with unlabelled data. Specifically, we design a random masking mechanism to learn robust representations of respiratory sounds. The pre-trained feature encoder is then fine-tuned in the downstream phase to perform cough classification. In addition, different ensembles with varied random masking rates are also explored in the downstream phase. Through extensive evaluations, we demonstrate that the proposed contrastive pre-training, the random masking mechanism, and the ensemble architecture contribute to improving cough classification performance.


title: Price of Precision in Coded Distributed Matrix Multiplication: A Dimensional Analysis

abstract: Coded distributed matrix multiplication (CDMM) schemes, such as MatDot codes, seek efficient ways to distribute matrix multiplication task(s) to a set of $N$ distributed servers so that the answers returned from any $R$ servers are sufficient to recover the desired product(s). For example, to compute the product of matrices ${\bf U, V}$, MatDot codes partition each matrix into $p>1$ sub-matrices to create smaller coded computation tasks that reduce the upload/storage at each server by $1/p$, such that ${\bf UV}$ can be recovered from the answers returned by any $R=2p-1$ servers. An important concern in CDMM is to reduce the recovery threshold $R$ for a given storage/upload constraint. Recently, Jeong et al. introduced Approximate MatDot (AMD) codes that are shown to improve the recovery threshold by a factor of nearly $2$, from $2p-1$ to $p$. A key observation that motivates our work is that the storage/upload required for approximate computing depends not only on the dimensions of the (coded) sub-matrices that are assigned to each server, but also on their precision levels -- a critical aspect that is not explored by Jeong et al. Our main contribution is a dimensional analysis of AMD codes inspired by the Generalized Degrees of Freedom (GDoF) framework previously developed for wireless networks, which indicates that for the same upload/storage, once the precision levels of the task assignments are accounted for, AMD codes surprisingly fall short in all aspects to even the trivial replication scheme which assigns the full computation task to every server. Indeed, the trivial replication scheme has a much better recovery threshold of $1$, better download cost, better computation cost, and much better encoding/decoding (none required) complexity than AMD codes. The dimensional analysis is supported by simple numerical experiments.


title: Time reversal symmetry breaking and $d$-wave superconductivity of triple-point fermions

abstract: We study the possibility of complex tensor ($d$-wave) superconducting order in three-dimensional semimetals with chiral spin-1/2 triple-point fermions, which have an effective orbital angular momentum of $L=1$ arising from a crossing of three bands. Retaining the first three lowest order terms in momentum and assuming rotational symmetry we show that the resulting mean-field $d$-wave ground state breaks time reversal symmetry, and depends crucially on the coefficients of the two quadratic terms in the Hamiltonian. The phase diagram at a finite chemical potential displays both the "cyclic" and the "ferromagnetic" states, distinguished by the average value of the magnetization; in the former state it is minimal (zero), whereas in the latter it is maximal (two). In both states we find mini Bogoliubov-Fermi surfaces in the quasiparticle spectrum, conforming to recent general arguments.


title: DeepMerge: Learning to Merge Programs

abstract: In collaborative software development, program merging is the mechanism to integrate changes from multiple programmers. Merge algorithms in modern version control systems report a conflict when changes interfere textually. Merge conflicts require manual intervention and frequently stall modern continuous integration pipelines. Prior work found that, although costly, a large majority of resolutions involve re-arranging text without writing any new code. Inspired by this observation we propose the first data-driven approach to resolve merge conflicts with a machine learning model. We realize our approach in a tool DeepMerge that uses a novel combination of (i) an edit-aware embedding of merge inputs and (ii) a variation of pointer networks, to construct resolutions from input segments. We also propose an algorithm to localize manual resolutions in a resolved file and employ it to curate a ground-truth dataset comprising 8,719 non-trivial resolutions in JavaScript programs. Our evaluation shows that, on a held out test set, DeepMerge can predict correct resolutions for 37% of non-trivial merges, compared to only 4% by a state-of-the-art semistructured merge technique. Furthermore, on the subset of merges with upto 3 lines (comprising 24% of the total dataset), DeepMerge can predict correct resolutions with 78% accuracy.


title: A powerful test for differentially expressed gene pathways via graph-informed structural equation modeling

abstract: A major task in genetic studies is to identify genes related to human diseases and traits to understand functional characteristics of genetic mutations and enhance patient diagnosis. Besides marginal analyses of individual genes, identification of gene pathways, i.e., a set of genes with known interactions that collectively contribute to specific biological functions, can provide more biologically meaningful results. Such gene pathway analysis can be formulated into a high-dimensional two-sample testing problem. Due to the typically limited sample size of gene expression datasets, most existing two-sample tests may have compromised powers because they ignore or only inefficiently incorporate the auxiliary pathway information on gene interactions. We propose T2-DAG, a Hotelling's $T^2$-type test for detecting differentially expressed gene pathways, which efficiently leverages the auxiliary pathway information on gene interactions through a linear structural equation model. We establish the asymptotic distribution of the test statistic under pertinent assumptions. Simulation studies under various scenarios show that T2-DAG outperforms several representative existing methods with well-controlled type-I error rates and substantially improved powers, even with incomplete or inaccurate pathway information or unadjusted confounding effects. We also illustrate the performance of T2-DAG in an application to detect differentially expressed KEGG pathways between different stages of lung cancer.


title: Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemes

abstract: While argument mining has achieved significant success in classifying argumentative relations between statements (support, attack, and neutral), we have a limited computational understanding of logical mechanisms that constitute those relations. Most recent studies rely on black-box models, which are not as linguistically insightful as desired. On the other hand, earlier studies use rather simple lexical features, missing logical relations between statements. To overcome these limitations, our work classifies argumentative relations based on four logical and theory-informed mechanisms between two statements, namely (i) factual consistency, (ii) sentiment coherence, (iii) causal relation, and (iv) normative relation. We demonstrate that our operationalization of these logical mechanisms classifies argumentative relations without directly training on data labeled with the relations, significantly better than several unsupervised baselines. We further demonstrate that these mechanisms also improve supervised classifiers through representation learning.


title: MHV amplitudes and BCFW recursion for Yang-Mills theory in the de Sitter static patch

abstract: We study the scattering problem in the static patch of de Sitter space, i.e. the problem of field evolution between the past and future horizons of a de Sitter observer. We formulate the problem in terms of off-shell fields in Poincare coordinates. This is especially convenient for conformal theories, where the static patch can be viewed as a flat causal diamond, with one tip at the origin and the other at timelike infinity. As an important example, we consider Yang-Mills theory at tree level. We find that static-patch scattering for Yang-Mills is subject to BCFW-like recursion relations. These can reduce any static-patch amplitude to one with N^{-1}MHV helicity structure, dressed by ordinary Minkowski amplitudes. We derive all the N^{-1}MHV static-patch amplitudes from self-dual Yang-Mills field solutions. Using the recursion relations, we then derive from these an infinite set of MHV amplitudes, with arbitrary number of external legs.


title: Neutron stars in $f(R,T)$ gravity with conserved energy-momentum tensor: Hydrostatic equilibrium and asteroseismology

abstract: We investigate the equilibrium and radial stability of spherically symmetric relativistic stars, considering a polytropic equation of state (EoS), within the framework of $f(R,T)$ gravity with a conservative energy-momentum tensor. Both modified stellar structure equations and Chandrasekhar's pulsation equations are derived for the $f(R,T)= R+ h(T)$ gravity model, where the function $h(T)$ assumes a specific form in order to safeguard the conservation equation for the energy-momentum tensor. The neutron star properties, such as radius, mass, binding energy and oscillation spectrum are studied in detail. Our results show that a cusp -- which signals the appearance of instability -- is formed when the binding energy is plotted as a function of the compact star proper mass. We find that the squared frequency of the fundamental vibration mode passes through zero at the central-density value corresponding to such a cusp where the binding energy is a minimum.


title: SoundFence: Securing Ultrasonic Sensors in Vehicles Using Physical-Layer Defense

abstract: Autonomous vehicles (AVs), equipped with numerous sensors such as camera, LiDAR, radar, and ultrasonic sensor, are revolutionizing the transportation industry. These sensors are expected to sense reliable information from a physical environment, facilitating the critical decision-making process of the AVs. Ultrasonic sensors, which detect obstacles in a short distance, play an important role in assisted parking and blind spot detection events. However, due to their weak security level, ultrasonic sensors are particularly vulnerable to signal injection attacks, when the attackers inject malicious acoustic signals to create fake obstacles and intentionally mislead the vehicles to make wrong decisions with disastrous aftermath. In this paper, we systematically analyze the attack model of signal injection attacks toward moving vehicles. By considering the potential threats, we propose SoundFence, a physical-layer defense system which leverages the sensors' signal processing capability without requiring any additional equipment. SoundFence verifies the benign measurement results and detects signal injection attacks by analyzing sensor readings and the physical-layer signatures of ultrasonic signals. Our experiment with commercial sensors shows that SoundFence detects most (more than 95%) of the abnormal sensor readings with very few false alarms, and it can also accurately distinguish the real echo from injected signals to identify injection attacks.


title: Zwicky Transient Facility and Globular Clusters: the Period-Luminosity and Period-Luminosity-Color Relations for Late-Type Contact Binaries

abstract: In this work, we aimed to derive the $gri$-band period-luminosity (PL) and period-luminosity-color (PLC) relations for late-type contact binaries, for the first time, located in the globular clusters, using the homogeneous light curves collected by the Zwicky Transient Factory (ZTF). We started with 79 contact binaries in 15 globular clusters, and retained 30 contact binaries in 10 globular clusters that have adequate number of data points in the ZTF light curves and unaffected by blending. Magnitudes at mean and maximum light of these contact binaries were determined using a fourth-order Fourier expansion, while extinction corrections were done using the {\tt Bayerstar2019} 3D reddening map together with adopting the homogeneous distances to their host globular clusters. After removing early-type and "anomaly" contact binaries, our derived $gri$-band PL and period-Wesenheit (PW) relations exhibit a much larger dispersion with large errors on the fitted coefficients. Nevertheless, the $gr$-band PL and PW relations based on this small sample of contact binaries in globular clusters were consistent with those based on a larger sample of nearby contact binaries. Good agreements of the PL and PW relations suggested both samples of contact binaries in the local Solar neighborhood and in the distant globular clusters can be combined and used to derive and calibrate the PL, PW and PLC relations. The final derived $gr$-band PL, PW and PLC relations were much improved than those based on the limited sample of contact binaries in the globular clusters.


title: Rethinking "Batch" in BatchNorm

abstract: BatchNorm is a critical building block in modern convolutional neural networks. Its unique property of operating on "batches" instead of individual samples introduces significantly different behaviors from most other operations in deep learning. As a result, it leads to many hidden caveats that can negatively impact model's performance in subtle ways. This paper thoroughly reviews such problems in visual recognition tasks, and shows that a key to address them is to rethink different choices in the concept of "batch" in BatchNorm. By presenting these caveats and their mitigations, we hope this review can help researchers use BatchNorm more effectively.


title: Spectral asymptotics and Lam\'e spectrum for coupled particles in periodic potentials

abstract: We make two observations on the motion of coupled particles in a periodic potential. Coupled pendula, or the space-discretized sine-Gordon equation is an example of this problem. Linearized spectrum of the synchronous motion turns out to have a hidden asymptotic periodicity in its dependence on the energy; this is the gist of the first observation. Our second observation is the discovery of a special property of the purely sinusoidal potentials: the linearization around the synchronous solution is equivalent to the classical Lam\`e equation. As a consequence, {\it all but one instability zones of the linearized equation collapse to a point for the one-harmonic potentials}. This provides a new example where Lam\'e's finite zone potential arises in the simplest possible setting.


title: Towards Novel Multipath Data Scheduling For Future IoT Systems: A Survey

abstract: During the initial years of its inception, the Internet was widely used for transferring data packets between users and respective data sources by using IP addresses. With the advancements in technology, the Internet has been used to share data within several small and resource-constrained devices connected in billions to create the framework for the so-called Internet of Things (IoT). These systems were known for the presentation of a large quantum of data emerging within these devices. On the flip side, these devices are known to impose huge overheads on the IoT network. Therefore, it was essential to develop solutions concerning different network-related problems as a part of IoT networking. In this paper, we review these challenges emerge in routing, congestion, energy conservation, scalability, heterogeneity, reliability, security, and quality of service (QoS). This can be leverage to use the available network optimally. As part of this research work, a detailed survey is to be conducted on the network optimization process within IoT, as presented in another research. Owing to the advances in wireless networking, relevant Internet-of-Things (IoT) devices were equipped with several elements, including multiple network access interfaces. The adoption of multipath TCP (MPTCP) technology would improve the total throughput of data transmission. On the other hand, leveraging traditional MPTCP path management algorithms lead to other problems in data transport areas along with even buffer blockage. This shall lead to massive issues in areas of reduction of transmission performance across the entire IoT network. To this end, we develop a novel multipath algorithm that would efficiently manage the data transport in an intelligently scheduled and seamless manner using multiple wireless/wireline paths.


title: Monitoring electrical systems data-network equipment by means of Fuzzy and Paraconsistent Annotated Logic

abstract: The constant increase in the amount and complexity of information obtained from IT data networkelements, for its correct monitoring and management, is a reality. The same happens to data net-works in electrical systems that provide effective supervision and control of substations and hydro-electric plants. Contributing to this fact is the growing number of installations and new environmentsmonitored by such data networks and the constant evolution of the technologies involved. This sit-uation potentially leads to incomplete and/or contradictory data, issues that must be addressed inorder to maintain a good level of monitoring and, consequently, management of these systems. Inthis paper, a prototype of an expert system is developed to monitor the status of equipment of datanetworks in electrical systems, which deals with inconsistencies without trivialising the inferences.This is accomplished in the context of the remote control of hydroelectric plants and substationsby a Regional Operation Centre (ROC). The expert system is developed with algorithms definedupon a combination of Fuzzy logic and Paraconsistent Annotated Logic with Annotation of TwoValues (PAL2v) in order to analyse uncertain signals and generate the operating conditions (faulty,normal, unstable or inconsistent / indeterminate) of the equipment that are identified as importantfor the remote control of hydroelectric plants and substations. A prototype of this expert systemwas installed on a virtualised server with CLP500 software (from the EFACEC manufacturer) thatwas applied to investigate scenarios consisting of a Regional (Brazilian) Operation Centre, with aGeneric Substation and a Generic Hydroelectric Plant, representing a remote control environment.


title: A different derivation of conservation laws for water waves

abstract: We consider a new nonlocal formulation of the water-wave problem for a free surface with an irrotational flow based on the work of Ablowitz, Fokas, and Musslimani and presented in the recent work of Oliveras. The main focus of the short paper is to show how one can systematically derive Olver's eight conservation laws not only for an irrotational fluid, but also for constant vorticity (linear shear flow) without explicitly relying on the underlying Lie symmetries. This allows us to make draw new conclusions about conservation laws and posit the existence of additional, nonlocal, conservation laws for the water-wave problem.


title: Vision Transformers are Robust Learners

abstract: Transformers, composed of multiple self-attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state-of-the-art (SOTA) standard accuracy. What remains largely unexplored is their robustness evaluation and attribution. In this work, we study the robustness of the Vision Transformer (ViT) against common corruptions and perturbations, distribution shifts, and natural adversarial examples. We use six different diverse ImageNet datasets concerning robust classification to conduct a comprehensive performance comparison of ViT models and SOTA convolutional neural networks (CNNs), Big-Transfer. Through a series of six systematically designed experiments, we then present analyses that provide both quantitative and qualitative indications to explain why ViTs are indeed more robust learners. For example, with fewer parameters and similar dataset and pre-training combinations, ViT gives a top-1 accuracy of 28.10% on ImageNet-A which is 4.3x higher than a comparable variant of BiT. Our analyses on image masking, Fourier spectrum sensitivity, and spread on discrete cosine energy spectrum reveal intriguing properties of ViT attributing to improved robustness. Code for reproducing our experiments is available at https://git.io/J3VO0.


title: RAIDER: Reinforcement-aided Spear Phishing Detector

abstract: Spear Phishing is a harmful cyber-attack facing business and individuals worldwide. Considerable research has been conducted recently into the use of Machine Learning (ML) techniques to detect spear-phishing emails. ML-based solutions may suffer from zero-day attacks; unseen attacks unaccounted for in the training data. As new attacks emerge, classifiers trained on older data are unable to detect these new varieties of attacks resulting in increasingly inaccurate predictions. Spear Phishing detection also faces scalability challenges due to the growth of the required features which is proportional to the number of the senders within a receiver mailbox. This differs from traditional phishing attacks which typically perform only a binary classification between phishing and benign emails. Therefore, we devise a possible solution to these problems, named RAIDER: Reinforcement AIded Spear Phishing DEtectoR. A reinforcement-learning based feature evaluation system that can automatically find the optimum features for detecting different types of attacks. By leveraging a reward and penalty system, RAIDER allows for autonomous features selection. RAIDER also keeps the number of features to a minimum by selecting only the significant features to represent phishing emails and detect spear-phishing attacks. After extensive evaluation of RAIDER over 11,000 emails and across 3 attack scenarios, our results suggest that using reinforcement learning to automatically identify the significant features could reduce the dimensions of the required features by 55% in comparison to existing ML-based systems. It also improves the accuracy of detecting spoofing attacks by 4% from 90% to 94%. In addition, RAIDER demonstrates reasonable detection accuracy even against a sophisticated attack named Known Sender in which spear-phishing emails greatly resemble those of the impersonated sender.


title: It\^oTTS and It\^oWave: Linear Stochastic Differential Equation Is All You Need For Audio Generation

abstract: In this paper, we propose to unify the two aspects of voice synthesis, namely text-to-speech (TTS) and vocoder, into one framework based on a pair of forward and reverse-time linear stochastic differential equations (SDE). The solutions of this SDE pair are two stochastic processes, one of which turns the distribution of mel spectrogram (or wave), that we want to generate, into a simple and tractable distribution. The other is the generation procedure that turns this tractable simple signal into the target mel spectrogram (or wave). The model that generates mel spectrogram is called It\^oTTS, and the model that generates wave is called It\^oWave. It\^oTTS and It\^oWave use the Wiener process as a driver to gradually subtract the excess signal from the noise signal to generate realistic corresponding meaningful mel spectrogram and audio respectively, under the conditional inputs of original text or mel spectrogram. The results of the experiment show that the mean opinion scores (MOS) of It\^oTTS and It\^oWave can exceed the current state-of-the-art methods, and reached 3.925$\pm$0.160 and 4.35$\pm$0.115 respectively. The generated audio samples are available at https://wushoule.github.io/ItoAudio/. All authors contribute equally to this work.


title: On Data-centric Forwarding in Mobile Ad-hoc Networks: Baseline Design and Simulation Analysis

abstract: IP networking deals with end-to-end communication where the network layer routing protocols maintain the reachability from one address to another. However, challenging environments, such as mobile ad-hoc networks or MANETs, lead to frequent path failures and changes between the sender and receiver, incurring higher packet loss. The obligatory route setup and maintenance of a device-to-device stable path in MANETs incur significant data retrieval delay and transmission overhead. Such overhead exaggerates the packet loss manifold. Named Data Networking (NDN) can avoid such delays and overhead and significantly improve the overall network performance. It does so with direct application-controlled named-data retrieval from any node in a network instead of reaching a specific IP address with protocol message exchange. However, existing works lack any explicit or systematic analysis to justify such claims. Our work analyzes the core NDN and IP architectures in a MANET at a baseline level. The extensive simulations show that NDN, when applied correctly, yields much lower data retrieval latency than IP and can lower the network transmission overhead in most cases. As a result, NDN's stateful forwarder can significantly increase the retrieval rate, offering a better trade-off at the network layer. Such performance comes from its caching, built-in multicast, and request aggregation without requiring an IP-like separate routing control plane.


title: Leveraging Two Types of Global Graph for Sequential Fashion Recommendation

abstract: Sequential fashion recommendation is of great significance in online fashion shopping, which accounts for an increasing portion of either fashion retailing or online e-commerce. The key to building an effective sequential fashion recommendation model lies in capturing two types of patterns: the personal fashion preference of users and the transitional relationships between adjacent items. The two types of patterns are usually related to user-item interaction and item-item transition modeling respectively. However, due to the large sets of users and items as well as the sparse historical interactions, it is difficult to train an effective and efficient sequential fashion recommendation model. To tackle these problems, we propose to leverage two types of global graph, i.e., the user-item interaction graph and item-item transition graph, to obtain enhanced user and item representations by incorporating higher-order connections over the graphs. In addition, we adopt the graph kernel of LightGCN for the information propagation in both graphs and propose a new design for item-item transition graph. Extensive experiments on two established sequential fashion recommendation datasets validate the effectiveness and efficiency of our approach.


title: Continuum random-phase approximation for gamma transition between excited states in neutron-rich nuclei

abstract: A characteristic feature of collective and particle-hole excitations in neutron-rich nuclei is that many of them couple to unbound neutron in continuum single-particle orbits. The continuum random phase approximation (cRPA) is a powerful many-body method that describes such excitations, and it provides a scheme to evaluate transition strengths from the ground state. In an attempt to apply cRPA to the radiative neutron capture reaction, we formulate in the present study an extended scheme of cRPA that describes gamma-transitions from the excited states under consideration, which decay to low-lying excited states as well as the ground state. This is achieved by introducing a non-local one-body operator which causes transitions to a low-lying excited state, and describing a density-matrix response against this operator. As a demonstration of this new scheme, we perform numerical calculation for dipole, quadrupole, and octupole excitations in $^{140}$Sn, and discuss E1 and E2 transitions decaying to low-lying $2^{+}_{1,2}$ and $3^{-}_{1}$ states. The results point to cases where the branching ratio to the low-lying states is larger than or comparable with that to the ground state. We discuss key roles of collectivity and continuum orbits in both initial and final states.


title: Convergence guarantee for the sparse monotone single index model

abstract: We consider a high-dimensional monotone single index model (hdSIM), which is a semiparametric extension of a high-dimensional generalize linear model (hdGLM), where the link function is unknown, but constrained with monotone and non-decreasing shape. We develop a scalable projection-based iterative approach, the "Sparse Orthogonal Descent Single-Index Model" (SOD-SIM), which alternates between sparse-thresholded orthogonalized "gradient-like" steps and isotonic regression steps to recover the coefficient vector. Our main contribution is that we provide finite sample estimation bounds for both the coefficient vector and the link function in high-dimensional settings under very mild assumptions on the design matrix $\mathbf{X}$, the error term $\epsilon$, and their dependence. The convergence rate for the link function matched the low-dimensional isotonic regression minimax rate up to some poly-log terms ($n^{-1/3}$). The convergence rate for the coefficients is also $n^{-1/3}$ up to some poly-log terms. This method can be applied to many real data problems, including GLMs with misspecified link, classification with mislabeled data, and classification with positive-unlabeled (PU) data. We study the performance of this method via both numerical studies and also an application on a rocker protein sequence data.


title: Tunneling Potentials for the Tunneling Action: Gauge Invariance

abstract: We formulate a procedure to obtain a gauge-invariant tunneling rate at zero temperature using the recently developed tunneling potential approach. This procedure relies on a consistent power counting in gauge coupling and a derivative expansion. The tunneling potential approach, while numerically more efficient than the standard bounce solution method, inherits the gauge-dependence of the latter when naively implemented. Using the Abelian Higgs model, we show how to obtain a tunneling rate whose residual gauge-dependence arises solely from the polynomial approximations adopted in the tunneling potential computation.


title: Greybody factor for massive fermion emitted by a black hole in dRGT massive gravity theory

abstract: The greybody factor of the massive Dirac field around the black hole in the dRGT massive gravity theory is investigated using the rigorous bound and the WKB approximation methods. In both methods, the greybody factor significantly depends on the shape of the potential. If the potential is smaller, there is more probability for the Dirac field to transmit through the black hole, therefore, the greybody factor is higher. Moreover, there exists a critical mass of the Dirac field such that the greybody factor is maximum. By comparing the results from these two methods, we argue that it is useful to use the rigorous bound method for the low potential cases, while using the WKB approximation method for the high potential cases.


title: Effects of polymers on the cavitating flow around a cylinder: A Large-scale molecular dynamics analysis

abstract: The cavitation flow of linear-polymer solutions around a cylinder is studied by performing a large-scale molecular dynamics simulation. The addition of polymer chains remarkably suppresses the cavitation. The polymers are stretched into a linear shape near the cylinder and entrained in the vortex behind the cylinder. As the polymers stretch, the elongational viscosity increases, which suppresses the vortex formation. Furthermore, the polymers exhibit an entropic elasticity owing to the stretching. This elastic energy increases the local temperature, which inhibits the cavitation inception. These effects of polymers result in the dramatic suppression of cavitation.


title: On computational capabilities of Ising machines based on nonlinear oscillators,

abstract: Dynamical Ising machines are actively investigated from the perspective of finding efficient heuristics for NP-hard optimization problems. However, the existing data demonstrate super-polynomial scaling of the running time with the system size, which is incompatible with large NP-hard problems. We show that oscillator networks implementing the Kuramoto model of synchronization are capable of demonstrating polynomial scaling. The dynamics of these networks is related to the semidefinite programming relaxation of the Ising model ground state problem. Consequently, such networks, as we numerically demonstrate, are capable of producing the best possible approximation in polynomial time. To reach such performance, however, the reconstruction of the binary Ising state (rounding) must be specially addressed. We demonstrate that commonly implemented forced collapse to a close-to-Ising state may diminish the computational capabilities up to their complete invalidation. Therefore, consistent treatment of rounding may cardinally improve various operation metrics of already existing and upcoming dynamical Ising machines.


title: Dermoscopic Image Classification with Neural Style Transfer

abstract: Skin cancer, the most commonly found human malignancy, is primarily diagnosed visually via dermoscopic analysis, biopsy, and histopathological examination. However, unlike other types of cancer, automated image classification of skin lesions is deemed more challenging due to the irregularity and variability in the lesions' appearances. In this work, we propose an adaptation of the Neural Style Transfer (NST) as a novel image pre-processing step for skin lesion classification problems. We represent each dermoscopic image as the style image and transfer the style of the lesion onto a homogeneous content image. This transfers the main variability of each lesion onto the same localized region, which allows us to integrate the generated images together and extract latent, low-rank style features via tensor decomposition. We train and cross-validate our model on a dermoscopic data set collected and preprocessed from the International Skin Imaging Collaboration (ISIC) database. We show that the classification performance based on the extracted tensor features using the style-transferred images significantly outperforms that of the raw images by more than 10%, and is also competitive with well-studied, pre-trained CNN models through transfer learning. Additionally, the tensor decomposition further identifies latent style clusters, which may provide clinical interpretation and insights.


title: Differentiable SLAM-net: Learning Particle SLAM for Visual Navigation

abstract: Simultaneous localization and mapping (SLAM) remains challenging for a number of downstream applications, such as visual robot navigation, because of rapid turns, featureless walls, and poor camera quality. We introduce the Differentiable SLAM Network (SLAM-net) along with a navigation architecture to enable planar robot navigation in previously unseen indoor environments. SLAM-net encodes a particle filter based SLAM algorithm in a differentiable computation graph, and learns task-oriented neural network components by backpropagating through the SLAM algorithm. Because it can optimize all model components jointly for the end-objective, SLAM-net learns to be robust in challenging conditions. We run experiments in the Habitat platform with different real-world RGB and RGB-D datasets. SLAM-net significantly outperforms the widely adapted ORB-SLAM in noisy conditions. Our navigation architecture with SLAM-net improves the state-of-the-art for the Habitat Challenge 2020 PointNav task by a large margin (37% to 64% success). Project website: http://sites.google.com/view/slamnet


title: The automorphism group of the Andr\'asfai graph

abstract: Let $k \geq 1$ be an integer and $n=3k-1$. Let $\mathbb{Z}_n$ denote the additive group of integers modulo $n$ and let $C$ be the subset of $\mathbb{Z}_n$ consisting of the elements congruent to 1 modulo 3. The Cayley graph $Cay(\mathbb{Z}_n; C)$ is known as the Andr$\acute{a}$sfai graph And($k$). In this note, we determine the automorphism group of this graph. We will show that $Aut(And(k))$ is isomorphic with the dihedral group $\mathbb{D}_{2n}$.


title: A Complete Axiomatisation for Divergence Preserving Branching Congruence of Finite-State Behaviours

abstract: We present an equational inference system for finite-state expressions, and prove that the system is sound and complete with respect to divergence preserving branching congruence, closing a problem that has been open since 1993. The inference system refines Rob van Glabbeek's simple and elegant complete axiomatisation for branching bisimulation congruence of finite-state behaviours by joining four simple axioms after dropping one axiom which is unsound under the more refined divergence sensitive semantics.


title: Sound Event Detection with Adaptive Frequency Selection

abstract: In this work, we present HIDACT, a novel network architecture for adaptive computation for efficiently recognizing acoustic events. We evaluate the model on a sound event detection task where we train it to adaptively process frequency bands. The model learns to adapt to the input without requesting all frequency sub-bands provided. It can make confident predictions within fewer processing steps, hence reducing the amount of computation. Experimental results show that HIDACT has comparable performance to baseline models with more parameters and higher computational complexity. Furthermore, the model can adjust the amount of computation based on the data and computational budget.


title: Variational Bandwidth Auto-encoder for Hybrid Recommender Systems

abstract: Hybrid recommendations have recently attracted a lot of attention where user features are utilized as auxiliary information to address the sparsity problem caused by insufficient user-item interactions. However, extracted user features generally contain rich multimodal information, and most of them are irrelevant to the recommendation purpose. Therefore, excessive reliance on these features will make the model overfit on noise and difficult to generalize. In this article, we propose a variational bandwidth auto-encoder (VBAE) for recommendations, aiming to address the sparsity and noise problems simultaneously. VBAE first encodes user collaborative and feature information into Gaussian latent variables via deep neural networks to capture non-linear user similarities. Moreover, by considering the fusion of collaborative and feature variables as a virtual communication channel from an information-theoretic perspective, we introduce a user-dependent channel to dynamically control the information allowed to be accessed from the feature embeddings. A quantum-inspired uncertainty measurement of the hidden rating embeddings is proposed accordingly to infer the channel bandwidth by disentangling the uncertainty information in the ratings from the semantic information. Through this mechanism, VBAE incorporates adequate auxiliary information from user features if collaborative information is insufficient, while avoiding excessive reliance on noisy user features to improve its generalization ability to new users. Extensive experiments conducted on three real-world datasets demonstrate the effectiveness of the proposed method. Codes and datasets are released at https://github.com/yaochenzhu/vbae.


title: $O(9,9)$ symmetry of NS-NS couplings at order $\alpha'^3$

abstract: Recently, imposing the $O(1,1)$ symmetry on the circle reduction of the classical effective action of string theory, we have found all NS-NS couplings of type II superstring theories at order $\alpha'^3$. In this paper we use the cosmological reduction on the couplings and show that, up to field redefinitions and total derivative terms, they are invariant under the $O(9,9)$ transformations.


title: Disentangled Variational Information Bottleneck for Multiview Representation Learning

abstract: Multiview data contain information from multiple modalities and have potentials to provide more comprehensive features for diverse machine learning tasks. A fundamental question in multiview analysis is what is the additional information brought by additional views and can quantitatively identify this additional information. In this work, we try to tackle this challenge by decomposing the entangled multiview features into shared latent representations that are common across all views and private representations that are specific to each single view. We formulate this feature disentanglement in the framework of information bottleneck and propose disentangled variational information bottleneck (DVIB). DVIB explicitly defines the properties of shared and private representations using constrains from mutual information. By deriving variational upper and lower bounds of mutual information terms, representations are efficiently optimized. We demonstrate the shared and private representations learned by DVIB well preserve the common labels shared between two views and unique labels corresponding to each single view, respectively. DVIB also shows comparable performance in classification task on images with corruptions. DVIB implementation is available at https://github.com/feng-bao-ucsf/DVIB.


title: Scattering of Evanescent Particles

abstract: Massive Klein-Gordon theory is quantized on the timelike hypercylinder in Minkowski space. Crucially, not only the propagating, but also the evanescent sector of phase space is included, laying in this way foundations for a quantum scattering theory of fields at finite distance. To achieve this, the novel $\alpha$-K\"ahler quantization scheme is employed in the framework of general boundary quantum field theory. A potential quantization ambiguity is fixed by stringent requirements, leading to a unitary radial evolution. Formulas for building scattering amplitudes and correlation functions are exhibited. A novel LSZ formula is derived, applicable to scattering at finite distance.


title: On the origin of switchbacks observed in the solar wind

abstract: The origin of switchbacks in the solar wind is discussed in two classes of theory that differ in the location of the source being either in the transition region near the Sun or in the solar wind, itself. The two classes of theory differ in their predictions of the switchback rate as a function of distance from the Sun. To test these theories, one-hour averages of Parker Solar Probe data were summed over orbits three through seven. It is found that: 1. The average switchback rate was independent of distance from the Sun. 2. The average switchback rate increased with solar wind speed. 3. The switchback size perpendicular to the flow increased as R, the distance from the Sun, while the radial size increased as R2, resulting in a large and increasing switchback aspect ratio with distance from the Sun. 4. The switchback rotation angle did not depend on either the solar wind speed or the distance from the Sun. These results are consistent with switchback formation in the transition region because their increase of tangential size with radius compensates for the radial falloff of their equatorial density to produce switchback rates that are independent of distance from the Sun. This constant observed switchback rate is inconsistent with an in situ source. Once formed, the switchback size and aspect ratio, but not the rotation angle, increased with radial distance to at least 100 solar radii. In addition, quiet intervals between switchback patches occurred at the lowest solar wind speeds.


title: On Supersymmetric Interface Defects, Brane Parallel Transport, Order-Disorder Transition and Homological Mirror Symmetry

abstract: We concentrate on a treatment of a Higgs-Coulomb duality as an absence of manifest phase transition between ordered and disordered phases of 2d $\mathcal{N}=(2,2)$ theories. We consider these examples of QFTs in the Schr\"odinger picture and identify Hilbert spaces of BPS states with morphisms in triangulated categories of D-brane boundary conditions. As a result of Higgs-Coulomb duality D-brane categories on IR vacuum moduli spaces are equivalent, this resembles an analog of homological mirror symmetry. Following construction ideas behind the Gaiotto-Moore-Witten algebra of the infrared one is able to introduce interface defects in these theories and associate them to D-brane parallel transport functors. We concentrate on surveying simple examples, analytic when possible calculations, numerical estimates and simple physical picture behind curtains of geometric objects. Categorification of hypergeometric series analytic continuation is derived as an Atiyah flop of the conifold. Finally we arrive to an interpretation of the braid group action on the derived category of coherent sheaves on cotangent bundles to flag varieties as a categorification of Berry connection on the Fayet-Illiopolous parameter space of a sigma-model with a quiver variety target space.

categories: hep-th math-ph math.AG math.MP math.RT math.SG


title: EasyFL: A Low-code Federated Learning Platform For Dummies

abstract: Academia and industry have developed several platforms to support the popular privacy-preserving distributed learning method -- Federated Learning (FL). However, these platforms are complex to use and require a deep understanding of FL, which imposes high barriers to entry for beginners, limits the productivity of researchers, and compromises deployment efficiency. In this paper, we propose the first low-code FL platform, EasyFL, to enable users with various levels of expertise to experiment and prototype FL applications with little coding. We achieve this goal while ensuring great flexibility and extensibility for customization by unifying simple API design, modular design, and granular training flow abstraction. With only a few lines of code, EasyFL empowers them with many out-of-the-box functionalities to accelerate experimentation and deployment. These practical functionalities are heterogeneity simulation, comprehensive tracking, distributed training optimization, and seamless deployment. They are proposed based on challenges identified in the proposed FL life cycle. Compared with other platforms, EasyFL not only requires just three lines of code (at least 10x lesser) to build a vanilla FL application but also incurs lower training overhead. Besides, our evaluations demonstrate that EasyFL expedites distributed training by 1.5x. It also improves the efficiency of deployment. We believe that EasyFL will increase the productivity of researchers and democratize FL to wider audiences.


title: Latest Belle II results on beauty and charm decays

abstract: We present the measurements, performed by the Belle II experiment, related to the B and D meson decays. These results are based on 63 fb$^{-1}$ and 9 fb$^{-1}$ of $e^+e^-$ collision data recorded by the Belle II detector at a center-of-mass energy corresponding to the mass of the Y(4S) resonance and 60 MeV below the Y(4S) resonance. The results reassure that Belle II is in the right direction in pursuit of measuring the Standard Model predictions with improved precision.


title: Utility Maximization for Multihop Wireless Networks Employing BATS Codes

abstract: BATS (BATched Sparse) codes are a class of efficient random linear network coding variation that has been studied for multihop wireless networks mostly in scenarios of a single communication flow. Towards sophisticated multi-flow network communications, we formulate a network utility maximization (NUM) problem that jointly optimizes the BATS code parameters of all the flows and network scheduling. The NUM problem adopts a batch-wise packet loss model that can be obtained from the network local statistics without any constraints on packet loss patterns. Moreover, the NUM problem allows a different number of recoded packets to be transmitted for different batches in a flow, which is called adaptive recoding. Due to both the probably nonconcave objective and the BATS code-related variables, the algorithms developed for the existing flow optimization problems cannot be applied directly to solve our NUM problem. We introduce a two-step algorithm to solve our NUM problem, where the first step solves the problem with nonadaptive recoding schemes, and the second step optimizes adaptive recoding hop-by-hop from upstream to downstream in each flow. We perform various numerical evaluations and simulations to verify the effectiveness and efficiency of the algorithm.


title: Towards Unsupervised Domain Adaptation for Deep Face Recognition under Privacy Constraints via Federated Learning

abstract: Unsupervised domain adaptation has been widely adopted to generalize models for unlabeled data in a target domain, given labeled data in a source domain, whose data distributions differ from the target domain. However, existing works are inapplicable to face recognition under privacy constraints because they require sharing sensitive face images between two domains. To address this problem, we propose a novel unsupervised federated face recognition approach (FedFR). FedFR improves the performance in the target domain by iteratively aggregating knowledge from the source domain through federated learning. It protects data privacy by transferring models instead of raw data between domains. Besides, we propose a new domain constraint loss (DCL) to regularize source domain training. DCL suppresses the data volume dominance of the source domain. We also enhance a hierarchical clustering algorithm to predict pseudo labels for the unlabeled target domain accurately. To this end, FedFR forms an end-to-end training pipeline: (1) pre-train in the source domain; (2) predict pseudo labels by clustering in the target domain; (3) conduct domain-constrained federated learning across two domains. Extensive experiments and analysis on two newly constructed benchmarks demonstrate the effectiveness of FedFR. It outperforms the baseline and classic methods in the target domain by over 4% on the more realistic benchmark. We believe that FedFR will shed light on applying federated learning to more computer vision tasks under privacy constraints.


title: Contact force measurements and local anisotropy in ellipses and disks

abstract: Experimental measurements of contact forces are limited to spheres and disks in three and two dimensions, making the evaluation of the shape effect and universality of force distributions and the comparison between experiments and theories extremely difficult. Here we present precise measurements of vector contact forces in photoelastic ellipses and disks subject to isotropic compression and pure shear. We find the local, instead of the global, stress ratio, control the width of the force distributions for forces larger than the mean, regardless of the particle shape and preparation protocols. By taking advantage of the anisotropic particle shape, we can determine the anisotropic growth of contacts in ellipses subject to isotropic compression, revealing the role of non-affine particle motions in homogenizing force distributions. Our results uncover the role of local anisotropy in the statistical framework of granular materials and open a new regime of exploring the role of particle shape on the mechanical and dynamical properties of granular materials in depth.


title: Hamiltonian Cycle Problem is in P

abstract: In this paper we present the first deterministic polynomial time algorithm for determining the existence of a Hamiltonian cycle and finding a Hamiltonian cycle in general graphs. Our algorithm can also solve the Hamiltonian path problem in the traceable graphs. The space complexity of our algorithm is O(n^4). The time complexity are theoretically O(n^5*d^2) on average and O(n^6*d^2) in the worst case respectively, where d is the maximum degree of vertex. With parallel computing, the space complexity can be improved to O(n^3) and the time complexity to O(n^3*d^2) on average and O(n^4*d^2) in the worst case. We construct the corresponding path hologram transformed from the original graph and compute the path set, which is a collection of segment sets consisting of all the vertices located on the same segment level among all the longest basic paths, of every vertex with greedy strategy. The path hologram is a multi-segment graph with the vertex <u, k> where u is a vertex and k is the segment level of u in the path hologram. To ensure that each valid path fragments can be visited and invalid path fragments cannot be visited, the key strategy of our method is the "consecutive" deleting-replenishing operations recursively on the left/right action field of a vertex, respectively. In fact, our algorithm can be directly applied to the original graph. Besides, our algorithm can deal with the finite general graphs including undirected, directed, and mixed. As a result, the well-known problem HCP in NPC can be now solved practically in deterministic polynomial time for general graphs in the worst case.


title: Intrablock Interleaving for Batched Network Coding with Blockwise Adaptive Recoding

abstract: Batched network coding (BNC) is a low-complexity solution to network transmission in multi-hop packet networks with packet loss. BNC encodes the source data into batches of packets. As a network coding scheme, the intermediate nodes perform recoding on the received packets belonging to the same batch instead of just forwarding them. A recoding scheme that may generate more recoded packets for batches of a higher rank is also called adaptive recoding. Meanwhile, in order to combat burst packet loss, the transmission of a block of batches can be interleaved. Stream interleaving studied in literature achieves the maximum separation among any two consecutive packets of a batch, but permutes packets across blocks and hence cannot bound the buffer size and the latency. To resolve the issue of stream interleaver, we design an intrablock interleaver for adaptive recoding that can preserve the advantages of using a block interleaver when the number of recoded packets is the same for all batches. We use potential energy in classical mechanics to measure the performance of an interleaver, and propose an algorithm to optimize the interleaver with this performance measure. Our problem formulation and algorithm for intrablock interleaving are also of independent interest.


title: Cross-Cluster Weighted Forests

abstract: Adapting machine learning algorithms to better handle clustering or batch effects within training data sets is important across a wide variety of biological applications. This article considers the effect of ensembling Random Forest learners trained on clusters within a single data set with heterogeneity in the distribution of the features. We find that constructing ensembles of forests trained on clusters determined by algorithms such as k-means results in significant improvements in accuracy and generalizability over the traditional Random Forest algorithm. We denote our novel approach as the Cross-Cluster Weighted Forest, and examine its robustness to various data-generating scenarios and outcome models. Furthermore, we explore the influence of the data-partitioning and ensemble weighting strategies the benefits of our method over the existing paradigm. Finally, we apply our approach to cancer molecular profiling and gene expression data sets that are naturally divisible into clusters and illustrate that our approach outperforms classic Random Forest. Code and supplementary material are available at https://github.com/m-ramchandran/cross-cluster.


title: A Chinese Remainder Theorem for Partitions

abstract: Let $s,t$ be natural numbers, and fix an $s$-core partition $\sigma$ and a $t$-core partition $\tau$. Put $d=\gcd(s,t)$ and $m= lcm(s,t)$, and write $N_{\sigma, \tau}(k)$ for the number of $m$-core partitions of length no greater than $k$ whose $s$-core is $\sigma$ and $t$-core is $\tau$. We prove that for $k$ large, $N_{\sigma, \tau}(k)$ is a quasipolynomial of period $m$ and degree $\frac{1}{d}(s-d)(t-d)$.


title: PPCA: Privacy-preserving Principal Component Analysis Using Secure Multiparty Computation(MPC)

abstract: Privacy-preserving data mining has become an important topic. People have built several multi-party-computation (MPC)-based frameworks to provide theoretically guaranteed privacy, the poor performance of real-world algorithms have always been a challenge. Using Principal Component Analysis (PCA) as an example, we show that by considering the unique performance characters of the MPC platform, we can design highly effective algorithm-level optimizations, such as replacing expensive operators and batching up. We achieve about 200$\times$ performance boost over existing privacy-preserving PCA algorithms with the same level of privacy guarantee. Also, using real-world datasets, we show that by combining multi-party data, we can achieve better training results.


title: Nonparametric regression for locally stationary functional time series

abstract: In this study, we develop an asymptotic theory of nonparametric regression for a locally stationary functional time series. First, we introduce the notion of a locally stationary functional time series (LSFTS) that takes values in a semi-metric space. Then, we propose a nonparametric model for LSFTS with a regression function that changes smoothly over time. We establish the uniform convergence rates of a class of kernel estimators, the Nadaraya-Watson (NW) estimator of the regression function, and a central limit theorem of the NW estimator.


title: A Unified Adaptive Recoding Framework for Batched Network Coding

abstract: Batched network coding is a variation of random linear network coding which has low computational and storage costs. In order to adapt to random fluctuations in the number of erasures in individual batches, it is not optimal to recode and transmit the same number of packets for all batches. Different distributed optimization models, which are called adaptive recoding schemes, were formulated for this purpose. The key component of these optimization problems is the expected value of the rank distribution of a batch at the next network node, which is also known as the expected rank. In this paper, we put forth a unified adaptive recoding framework with an arbitrary recoding field size. We show that the expected rank functions are concave when the packet loss pattern is a stationary stochastic process, which covers but not limited to independent packet loss and Gilbert-Elliott packet loss model. Under this concavity assumption, we show that there always exists a solution which not only can minimize the randomness on the number of recoded packets but also can tolerate rank distribution errors due to inaccurate measurements or limited precision of the machine. We provide an algorithm to obtain such an optimal optimal solution, and propose tuning schemes that can turn any feasible solution into a desired optimal solution.


title: Differentially Private Federated Knowledge Graphs Embedding

abstract: Knowledge graph embedding plays an important role in knowledge representation, reasoning, and data mining applications. However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data. In addition, the centralized embedding model may not scale to the extensive real-world knowledge graphs. Therefore, we propose a novel decentralized scalable learning framework, \emph{Federated Knowledge Graphs Embedding} (FKGE), where embeddings from different knowledge graphs can be learnt in an asynchronous and peer-to-peer manner while being privacy-preserving. FKGE exploits adversarial generation between pairs of knowledge graphs to translate identical entities and relations of different domains into near embedding spaces. In order to protect the privacy of the training data, FKGE further implements a privacy-preserving neural network structure to guarantee no raw data leakage. We conduct extensive experiments to evaluate FKGE on 11 knowledge graphs, demonstrating a significant and consistent improvement in model quality with at most 17.85\% and 7.90\% increases in performance on triple classification and link prediction tasks.


title: An Intrinsic Harnack inequality for some non-homogeneous parabolic equations in non-divergence form

abstract: In this paper, we establish a scale invariant Harnack inequality for some inhomogeneous parabolic equations in a suitable intrinsic geometry dictated by the nonlinearity. The class of equations that we consider correspond to the parabolic counterpart of the equations studied by Julin in [10] where a generalized Harnack inequality was obtained which quantifies the strong maximum principle. Our version of parabolic Harnack (see Theorem 1.2) when restricted to the elliptic case is however quite different from that in [10]. The key new feature of this work is an appropriate modification of the stack of cubes covering argument which is tailored for the nonlinearity that we consider.