title: COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings

abstract: We present a machine learning based COVID-19 cough classifier which can discriminate COVID-19 positive coughs from both COVID-19 negative and healthy coughs recorded on a smartphone. This type of screening is non-contact, easy to apply, and can reduce the workload in testing centres as well as limit transmission by recommending early self-isolation to those who have a cough suggestive of COVID-19. The datasets used in this study include subjects from all six continents and contain both forced and natural coughs, indicating that the approach is widely applicable. The publicly available Coswara dataset contains 92 COVID-19 positive and 1079 healthy subjects, while the second smaller dataset was collected mostly in South Africa and contains 18 COVID-19 positive and 26 COVID-19 negative subjects who have undergone a SARS-CoV laboratory test. Both datasets indicate that COVID-19 positive coughs are 15\%-20\% shorter than non-COVID coughs. Dataset skew was addressed by applying the synthetic minority oversampling technique (SMOTE). A leave-$p$-out cross-validation scheme was used to train and evaluate seven machine learning classifiers: LR, KNN, SVM, MLP, CNN, LSTM and Resnet50. Our results show that although all classifiers were able to identify COVID-19 coughs, the best performance was exhibited by the Resnet50 classifier, which was best able to discriminate between the COVID-19 positive and the healthy coughs with an area under the ROC curve (AUC) of 0.98. An LSTM classifier was best able to discriminate between the COVID-19 positive and COVID-19 negative coughs, with an AUC of 0.94 after selecting the best 13 features from a sequential forward selection (SFS). Since this type of cough audio classification is cost-effective and easy to deploy, it is potentially a useful and viable means of non-contact COVID-19 screening.


title: Role of Modern Optical Techniques in Gravitational Wave Detection

abstract: Gravitational waves were first proposed by Henri Poincar\'e in 1905 and were subsequently predicted by Albert Einstein in his General Theory of Relativity. In 2015, first Gravitational Waves signals were detected by LIGO of two black holes merging about 1.3 billion light-years away. The discovery opened a new window of astronomy. Currently, four laser interferometers are operating around the world, two American detectors which are located in Hanford and Livingston, one Italian detector (VIRGO) located at Pisa and an underground Japanese detector KAGRA. This paper describes the modern optical techniques that are being used and future planned techniques for gravitational wave detection.


title: A Probabilistic Guidance Approach to Swarm-to-Swarm Engagement Problem

abstract: This paper introduces a probabilistic guidance approach for the swarm-to-swarm engagement problem. The idea is based on driving the controlled swarm towards an adversary swarm, where the adversary swarm aims to converge to a stationary distribution that corresponds to a defended base location. The probabilistic approach is based on designing a Markov chain for the distribution of the swarm to converge a stationary distribution. This approach is decentralized, so each agent can propagate its position independently of other agents. Our main contribution is the formulation of the swarm-to-swarm engagement as an optimization problem where the population of each swarm decays with each engagement and determining a desired distribution for the controlled swarm to converge time-varying distribution and eliminate agents of the adversary swarm until adversary swarm enters the defended base location. We demonstrate the validity of proposed approach on several swarm engagement scenarios.


title: A Stochastic Path-Integrated Differential EstimatoR Expectation Maximization Algorithm

abstract: The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called \texttt{SPIDER-EM}, for inference from a training set of size $n$, $n \gg 1$. At the core of our algorithm is an estimator of the full conditional expectation in the {\sf E}-step, adapted from the stochastic path-integrated differential estimator ({\tt SPIDER}) technique. We derive finite-time complexity bounds for smooth non-convex likelihood: we show that for convergence to an $\epsilon$-approximate stationary point, the complexity scales as $K_{\operatorname{Opt}} (n,\epsilon )={\cal O}(\epsilon^{-1})$ and $K_{\operatorname{CE}}( n,\epsilon ) = n+ \sqrt{n} {\cal O}(\epsilon^{-1} )$, where $K_{\operatorname{Opt}}( n,\epsilon )$ and $K_{\operatorname{CE}}(n, \epsilon )$ are respectively the number of {\sf M}-steps and the number of per-sample conditional expectations evaluations. This improves over the state-of-the-art algorithms. Numerical results support our findings.


title: Learning Explainable Interventions to Mitigate HIV Transmission in Sex Workers Across Five States in India

abstract: Female sex workers(FSWs) are one of the most vulnerable and stigmatized groups in society. As a result, they often suffer from a lack of quality access to care. Grassroot organizations engaged in improving health services are often faced with the challenge of improving the effectiveness of interventions due to complex influences. This work combines structure learning, discriminative modeling, and grass-root level expertise of designing interventions across five different Indian states to discover the influence of non-obvious factors for improving safe-sex practices in FSWs. A bootstrapped, ensemble-averaged Bayesian Network structure was learned to quantify the factors that could maximize condom usage as revealed from the model. A discriminative model was then constructed using XgBoost and random forest in order to predict condom use behavior The best model achieved 83% sensitivity, 99% specificity, and 99% area under the precision-recall curve for the prediction. Both generative and discriminative modeling approaches revealed that financial literacy training was the primary influence and predictor of condom use in FSWs. These insights have led to a currently ongoing field trial for assessing the real-world utility of this approach. Our work highlights the potential of explainable models for transparent discovery and prioritization of anti-HIV interventions in female sex workers in a resource-limited setting.


title: Effect of backdoor attacks over the complexity of the latent space distribution

abstract: The input space complexity determines the model's capabilities to extract their knowledge and translate the space of attributes into a function which is assumed in general, as a concatenation of non-linear functions between layers. In the presence of backdoor attacks, the space complexity changes, and induces similarities between classes that directly affect the model's training. As a consequence, the model tends to overfit the input set. In this research, we suggest the D-vine Copula Auto-Encoder (VCAE) as a tool to estimate the latent space distribution under the presence of backdoor triggers. Since no assumptions are made on the distribution estimation, like in Variational Autoencoders (VAE). It is possible to observe the backdoor stamp in non-attacked categories randomly generated. We exhibit the differences between a clean model (baseline) and the attacked one (backdoor) in a pairwise representation of the distribution. The idea is to illustrate the dependency structure change in the input space induced by backdoor features. Finally, we quantify the entropy's changes and the Kullback-Leibler divergence between models. In our results, we found the entropy in the latent space increases by around 27\% due to the backdoor trigger added to the input


title: Teaching the Machine to Explain Itself using Domain Knowledge

abstract: Machine Learning (ML) has been increasingly used to aid humans to make better and faster decisions. However, non-technical humans-in-the-loop struggle to comprehend the rationale behind model predictions, hindering trust in algorithmic decision-making systems. Considerable research work on AI explainability attempts to win back trust in AI systems by developing explanation methods but there is still no major breakthrough. At the same time, popular explanation methods (e.g., LIME, and SHAP) produce explanations that are very hard to understand for non-data scientist persona. To address this, we present JOEL, a neural network-based framework to jointly learn a decision-making task and associated explanations that convey domain knowledge. JOEL is tailored to human-in-the-loop domain experts that lack deep technical ML knowledge, providing high-level insights about the model's predictions that very much resemble the experts' own reasoning. Moreover, we collect the domain feedback from a pool of certified experts and use it to ameliorate the model (human teaching), hence promoting seamless and better suited explanations. Lastly, we resort to semantic mappings between legacy expert systems and domain taxonomies to automatically annotate a bootstrap training set, overcoming the absence of concept-based human annotations. We validate JOEL empirically on a real-world fraud detection dataset. We show that JOEL can generalize the explanations from the bootstrap dataset. Furthermore, obtained results indicate that human teaching can further improve the explanations prediction quality by approximately $13.57\%$.


title: Every Corporation Owns Its Structure: Corporate Credit Ratings via Graph Neural Networks

abstract: Credit rating is an analysis of the credit risks associated with a corporation, which reflects the level of the riskiness and reliability in investing, and plays a vital role in financial risk. There have emerged many studies that implement machine learning and deep learning techniques which are based on vector space to deal with corporate credit rating. Recently, considering the relations among enterprises such as loan guarantee network, some graph-based models are applied in this field with the advent of graph neural networks. But these existing models build networks between corporations without taking the internal feature interactions into account. In this paper, to overcome such problems, we propose a novel model, Corporate Credit Rating via Graph Neural Networks, CCR-GNN for brevity. We firstly construct individual graphs for each corporation based on self-outer product and then use GNN to model the feature interaction explicitly, which includes both local and global information. Extensive experiments conducted on the Chinese public-listed corporate rating dataset, prove that CCR-GNN outperforms the state-of-the-art methods consistently.


title: Adaptable Automation with Modular Deep Reinforcement Learning and Policy Transfer

abstract: Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL algorithms predominantly specialize in a narrow range of tasks, are sample inefficient, and lack sufficient stability, which in turn hinder their industrial adoption. This article tackles this limitation by developing and testing a Hyper-Actor Soft Actor-Critic (HASAC) RL framework based on the notions of task modularization and transfer learning. The goal of the proposed HASAC is to enhance the adaptability of an agent to new tasks by transferring the learned policies of former tasks to the new task via a "hyper-actor". The HASAC framework is tested on a new virtual robotic manipulation benchmark, Meta-World. Numerical experiments show superior performance by HASAC over state-of-the-art deep RL algorithms in terms of reward value, success rate, and task completion time.


title: Backpropagation-Free Learning Method for Correlated Fuzzy Neural Networks

abstract: In this paper, a novel stepwise learning approach based on estimating desired premise parts' outputs by solving a constrained optimization problem is proposed. This learning approach does not require backpropagating the output error to learn the premise parts' parameters. Instead, the near best output values of the rules premise parts are estimated and their parameters are changed to reduce the error between current premise parts' outputs and the estimated desired ones. Therefore, the proposed learning method avoids error backpropagation, which lead to vanishing gradient and consequently getting stuck in a local optimum. The proposed method does not need any initialization method. This learning method is utilized to train a new Takagi-Sugeno-Kang (TSK) Fuzzy Neural Network with correlated fuzzy rules including many parameters in both premise and consequent parts, avoiding getting stuck in a local optimum due to vanishing gradient. To learn the proposed network parameters, first, a constrained optimization problem is introduced and solved to estimate the desired values of premise parts' output values. Next, the error between these values and the current ones is utilized to adapt the premise parts' parameters based on the gradient-descent (GD) approach. Afterward, the error between the desired and network's outputs is used to learn consequent parts' parameters by the GD method. The proposed paradigm is successfully applied to real-world time-series prediction and regression problems. According to experimental results, its performance outperforms other methods with a more parsimonious structure.


title: CUT: Controllable Unsupervised Text Simplification

abstract: In this paper, we focus on the challenge of learning controllable text simplifications in unsupervised settings. While this problem has been previously discussed for supervised learning algorithms, the literature on the analogies in unsupervised methods is scarse. We propose two unsupervised mechanisms for controlling the output complexity of the generated texts, namely, back translation with control tokens (a learning-based approach) and simplicity-aware beam search (decoding-based approach). We show that by nudging a back-translation algorithm to understand the relative simplicity of a text in comparison to its noisy translation, the algorithm self-supervises itself to produce the output of the desired complexity. This approach achieves competitive performance on well-established benchmarks: SARI score of 46.88% and FKGL of 3.65% on the Newsela dataset.


title: On spike-and-slab priors for Bayesian equation discovery of nonlinear dynamical systems via sparse linear regression

abstract: This paper presents the use of spike-and-slab (SS) priors for discovering governing differential equations of motion of nonlinear structural dynamic systems. The problem of discovering governing equations is cast as that of selecting relevant variables from a predetermined dictionary of basis variables and solved via sparse Bayesian linear regression. The SS priors, which belong to a class of discrete-mixture priors and are known for their strong sparsifying (or shrinkage) properties, are employed to induce sparse solutions and select relevant variables. Three different variants of SS priors are explored for performing Bayesian equation discovery. As the posteriors with SS priors are analytically intractable, a Markov chain Monte Carlo (MCMC)-based Gibbs sampler is employed for drawing posterior samples of the model parameters; the posterior samples are used for variable selection and parameter estimation in equation discovery. The proposed algorithm has been applied to four systems of engineering interest, which include a baseline linear system, and systems with cubic stiffness, quadratic viscous damping, and Coulomb damping. The results demonstrate the effectiveness of the SS priors in identifying the presence and type of nonlinearity in the system. Additionally, comparisons with the Relevance Vector Machine (RVM) - that uses a Student's-t prior - indicate that the SS priors can achieve better model selection consistency, reduce false discoveries, and derive models that have superior predictive accuracy. Finally, the Silverbox experimental benchmark is used to validate the proposed methodology.


title: Quasi-Newton's method in the class gradient defined high-curvature subspace

abstract: Classification problems using deep learning have been shown to have a high-curvature subspace in the loss landscape equal in dimension to the number of classes. Moreover, this subspace corresponds to the subspace spanned by the logit gradients for each class. An obvious strategy to speed up optimisation would be to use Newton's method in the high-curvature subspace and stochastic gradient descent in the co-space. We show that a naive implementation actually slows down convergence and we speculate why this might be.


title: Classifying Malware Using Function Representations in a Static Call Graph

abstract: We propose a deep learning approach for identifying malware families using the function call graphs of x86 assembly instructions. Though prior work on static call graph analysis exists, very little involves the application of modern, principled feature learning techniques to the problem. In this paper, we introduce a system utilizing an executable's function call graph where function representations are obtained by way of a recurrent neural network (RNN) autoencoder which maps sequences of x86 instructions into dense, latent vectors. These function embeddings are then modeled as vertices in a graph with edges indicating call dependencies. Capturing rich, node-level representations as well as global, topological properties of an executable file greatly improves malware family detection rates and contributes to a more principled approach to the problem in a way that deliberately avoids tedious feature engineering and domain expertise. We test our approach by performing several experiments on a Microsoft malware classification data set and achieve excellent separation between malware families with a classification accuracy of 99.41%.


title: Locally Linear Attributes of ReLU Neural Networks

abstract: A ReLU neural network determines/is a continuous piecewise linear map from an input space to an output space. The weights in the neural network determine a decomposition of the input space into convex polytopes and on each of these polytopes the network can be described by a single affine mapping. The structure of the decomposition, together with the affine map attached to each polytope, can be analyzed to investigate the behavior of the associated neural network.


title: On Extending NLP Techniques from the Categorical to the Latent Space: KL Divergence, Zipf's Law, and Similarity Search

abstract: Despite the recent successes of deep learning in natural language processing (NLP), there remains widespread usage of and demand for techniques that do not rely on machine learning. The advantage of these techniques is their interpretability and low cost when compared to frequently opaque and expensive machine learning models. Although they may not be be as performant in all cases, they are often sufficient for common and relatively simple problems. In this paper, we aim to modernize these older methods while retaining their advantages by extending approaches from categorical or bag-of-words representations to word embeddings representations in the latent space. First, we show that entropy and Kullback-Leibler divergence can be efficiently estimated using word embeddings and use this estimation to compare text across several categories. Next, we recast the heavy-tailed distribution known as Zipf's law that is frequently observed in the categorical space to the latent space. Finally, we look to improve the Jaccard similarity measure for sentence suggestion by introducing a new method of identifying similar sentences based on the set cover problem. We compare the performance of this algorithm against several baselines including Word Mover's Distance and the Levenshtein distance.


title: Clustering-based Automatic Construction of Legal Entity Knowledge Base from Contracts

abstract: In contract analysis and contract automation, a knowledge base (KB) of legal entities is fundamental for performing tasks such as contract verification, contract generation and contract analytic. However, such a KB does not always exist nor can be produced in a short time. In this paper, we propose a clustering-based approach to automatically generate a reliable knowledge base of legal entities from given contracts without any supplemental references. The proposed method is robust to different types of errors brought by pre-processing such as Optical Character Recognition (OCR) and Named Entity Recognition (NER), as well as editing errors such as typos. We evaluate our method on a dataset that consists of 800 real contracts with various qualities from 15 clients. Compared to the collected ground-truth data, our method is able to recall 84\% of the knowledge.


title: Finite-Part Integration in the Presence of Competing Singularities: Transformation Equations for the hypergeometric functions arising from Finite-Part Integration

abstract: Finite-part integration is a recently introduced method of evaluating convergent integrals by means of the finite part of divergent integrals [E.A. Galapon, {\it Proc. R. Soc. A 473, 20160567} (2017)]. Current application of the method involves exact and asymptotic evaluation of the generalized Stieltjes transform $\int_0^a f(x)/(\omega + x)^{\rho} \, \mathrm{d}x$ under the assumption that the extension of $f(x)$ in the complex plane is entire. In this paper, the method is elaborated further and extended to accommodate the presence of competing singularities of the complex extension of $f(x)$. Finite part integration is then applied to derive consequences of known Stieltjes integral representations of the Gauss function and the generalized hypergeometric function which involve Stieltjes transforms of functions with complex extensions having singularities in the complex plane. Transformation equations for the Gauss function are obtained from which known transformation equations are shown to follow. Also, building on the results for the Gauss function, transformation equations involving the generalized hypergeometric function $\,_3F_2$ are derived.


title: Multi-Label Contrastive Learning for Abstract Visual Reasoning

abstract: For a long time the ability to solve abstract reasoning tasks was considered one of the hallmarks of human intelligence. Recent advances in application of deep learning (DL) methods led, as in many other domains, to surpassing human abstract reasoning performance, specifically in the most popular type of such problems - the Raven's Progressive Matrices (RPMs). While the efficacy of DL systems is indeed impressive, the way they approach the RPMs is very different from that of humans. State-of-the-art systems solving RPMs rely on massive pattern-based training and sometimes on exploiting biases in the dataset, whereas humans concentrate on identification of the rules / concepts underlying the RPM (or generally a visual reasoning task) to be solved. Motivated by this cognitive difference, this work aims at combining DL with human way of solving RPMs and getting the best of both worlds. Specifically, we cast the problem of solving RPMs into multi-label classification framework where each RPM is viewed as a multi-label data point, with labels determined by the set of abstract rules underlying the RPM. For efficient training of the system we introduce a generalisation of the Noise Contrastive Estimation algorithm to the case of multi-label samples. Furthermore, we propose a new sparse rule encoding scheme for RPMs which, besides the new training algorithm, is the key factor contributing to the state-of-the-art performance. The proposed approach is evaluated on two most popular benchmark datasets (Balanced-RAVEN and PGM) and on both of them demonstrates an advantage over the current state-of-the-art results. Contrary to applications of contrastive learning methods reported in other domains, the state-of-the-art performance reported in the paper is achieved with no need for large batch sizes or strong data augmentation.


title: Budget Constrained Interactive Search for Multiple Targets

abstract: Interactive graph search leverages human intelligence to categorize target labels in a hierarchy, which are useful for image classification, product categorization, and database search. However, many existing studies of interactive graph search aim at identifying a single target optimally, and suffer from the limitations of asking too many questions and not being able to handle multiple targets. To address these two limitations, in this paper, we study a new problem of budget constrained interactive graph search for multiple targets called kBM-IGS-problem. Specifically, given a set of multiple targets T in a hierarchy, and two parameters k and b, the goal is to identify a k-sized set of selections S such that the closeness between selections S and targets T is as small as possible, by asking at most a budget of b questions. We theoretically analyze the updating rules and design a penalty function to capture the closeness between selections and targets. To tackle the kBM-IGS-problem, we develop a novel framework to ask questions using the best vertex with the largest expected gain, which makes a balanced trade-off between target probability and benefit gain. Based on the kBM-IGS framework, we first propose an efficient algorithm STBIS to handle the SingleTarget problem, which is a special case of kBM-IGS. Then, we propose a dynamic programming based method kBM-DP to tackle the MultipleTargets problem. To further improve efficiency, we propose two heuristic but efficient algorithms kBM-Topk and kBM-DP+. kBM-Topk develops a variant gain function and selects the top-k vertices independently. kBM-DP+ uses an upper bound of gains and prunes disqualified vertices to save computations. Experiments on large real-world datasets with ground-truth targets verify both the effectiveness and efficiency of our proposed algorithms.


title: Can I Take Your Subdomain? Exploring Related-Domain Attacks in the Modern Web

abstract: Related-domain attackers control a sibling domain of their target web application, e.g., as the result of a subdomain takeover. Despite their additional power over traditional web attackers, related-domain attackers received only limited attention by the research community. In this paper we define and quantify for the first time the threats that related-domain attackers pose to web application security. In particular, we first clarify the capabilities that related-domain attackers can acquire through different attack vectors, showing that different instances of the related-domain attacker concept are worth attention. We then study how these capabilities can be abused to compromise web application security by focusing on different angles, including: cookies, CSP, CORS, postMessage and domain relaxation. By building on this framework, we report on a large-scale security measurement on the top 50k domains from the Tranco list that led to the discovery of vulnerabilities in 887 sites, where we quantified the threats posed by related-domain attackers to popular web applications.


title: A Sparse Delaunay Filtration

abstract: We show how a filtration of Delaunay complexes can be used to approximate the persistence diagram of the distance to a point set in $R^d$. Whereas the full Delaunay complex can be used to compute this persistence diagram exactly, it may have size $O(n^{\lceil d/2 \rceil})$. In contrast, our construction uses only $O(n)$ simplices. The central idea is to connect Delaunay complexes on progressively denser subsamples by considering the flips in an incremental construction as simplices in $d+1$ dimensions. This approach leads to a very simple and straightforward proof of correctness in geometric terms, because the final filtration is dual to a $(d+1)$-dimensional Voronoi construction similar to the standard Delaunay filtration complex. We also, show how this complex can be efficiently constructed.


title: Ferromagnetic and spin-glass like transition in the $q$-neighbor Ising model on random graphs

abstract: The $q$-neighbor Ising model is investigated on homogeneous random graphs with a fraction of edges associated randomly with antiferromagnetic exchange integrals and the remaining edges with ferromagnetic ones. It is a nonequilibrium model for the opinion formation in which the agents, represented by two-state spins, change their opinions according to a Metropolis-like algorithm taking into account interactions with only a randomly chosen subset of their $q$ neighbors. Depending on the model parameters in Monte Carlo simulations phase diagrams are observed with first-order ferromagmetic transition, both first- and second-order ferromagnetic transitions and second-order ferromagnetic and spin-glass-like transitions as the temperature and fraction of antiferromagnetic exchange integrals are varied; in the latter case the obtained phase diagrams qualitatively resemble those for the dilute spin-glass model. Homogeneous mean-field and pair approximations are extented to take into account the effect of the antiferromagnetic exchange interactions on the ferromagnetic phase transition in the model. For a broad range of parameters critical temperatures for the first- or second-order ferromagnetic transition predicted by the homogeneous pair approximation show quantitative agreement with those obtained from Monte Carlo simulations; significant differences occur mainly in the vicinity of the tricritical point in which the critical lines for the second-order ferromagnetic and spin-glass-like transitions meet.


title: Port-Hamiltonian formulations of poroelastic network models

abstract: We investigate an energy-based formulation of the two-field poroelasticity model and the related multiple-network model as they appear in geosciences or medical applications. We propose a port-Hamiltonian formulation of the system equations, which is beneficial for preserving important system properties after discretization or model-order reduction. For this, we include the commonly omitted second-order term and consider the corresponding first-order formulation. The port-Hamiltonian formulation of the quasi-static case is then obtained by (formally) setting the second-order term zero. Further, we interpret the poroelastic equations as an interconnection of a network of submodels with internal energies, adding a control-theoretic understanding of the poroelastic equations.


title: Co-mining: Self-Supervised Learning for Sparsely Annotated Object Detection

abstract: Object detectors usually achieve promising results with the supervision of complete instance annotations. However, their performance is far from satisfactory with sparse instance annotations. Most existing methods for sparsely annotated object detection either re-weight the loss of hard negative samples or convert the unlabeled instances into ignored regions to reduce the interference of false negatives. We argue that these strategies are insufficient since they can at most alleviate the negative effect caused by missing annotations. In this paper, we propose a simple but effective mechanism, called Co-mining, for sparsely annotated object detection. In our Co-mining, two branches of a Siamese network predict the pseudo-label sets for each other. To enhance multi-view learning and better mine unlabeled instances, the original image and corresponding augmented image are used as the inputs of two branches of the Siamese network, respectively. Co-mining can serve as a general training mechanism applied to most of modern object detectors. Experiments are performed on MS COCO dataset with three different sparsely annotated settings using two typical frameworks: anchor-based detector RetinaNet and anchor-free detector FCOS. Experimental results show that our Co-mining with RetinaNet achieves 1.4%~2.1% improvements compared with different baselines and surpasses existing methods under the same sparsely annotated setting. Code is available at https://github.com/megvii-research/Co-mining.


title: Multiple solutions for some strongly degenerate second order elliptic equations

abstract: We consider a boundary value problem in a bounded domain involving a degenerate operator of the form $$L(u)=-\textrm{div} (a(x)\nabla u)$$ and a suitable nonlinearity $f$. The function $a$ vanishes on smooth 1-codimensional submanifolds of $\Omega$ where it is not allowed to be $C^{2}$. By using weighted Sobolev spaces we are still able to find existence of solutions which vanish, in the trace sense, on the set where $a$ vanishes.


title: Study of Gribov Copies in the Yang-Mills ensemble

abstract: Recently, based on a new procedure to quantize the theory in the continuum, it was argued that Singer's theorem points towards the existence of a Yang-Mills ensemble. In the new approach, the gauge fields are mapped into an auxiliary field space used to separately fix the gauge on different sectors labeled by center vortices. In this work, we study this procedure in more detail. We provide examples of configurations belonging to sectors labeled by center vortices and discuss the existence of nonabelian degrees of freedom. Then, we discuss the importance of the mapping injectivity, and show that this property holds infinitesimally for typical configurations of the vortex-free sector and for the simplest example in the one-vortex sector. Finally, we show that these configurations are free from Gribov copies.


title: Drugs4Covid: Drug-driven Knowledge Exploitation based on Scientific Publications

abstract: In the absence of sufficient medication for COVID patients due to the increased demand, disused drugs have been employed or the doses of those available were modified by hospital pharmacists. Some evidences for the use of alternative drugs can be found in the existing scientific literature that could assist in such decisions. However, exploiting large corpus of documents in an efficient manner is not easy, since drugs may not appear explicitly related in the texts and could be mentioned under different brand names. Drugs4Covid combines word embedding techniques and semantic web technologies to enable a drug-oriented exploration of large medical literature. Drugs and diseases are identified according to the ATC classification and MeSH categories respectively. More than 60K articles and 2M paragraphs have been processed from the CORD-19 corpus with information of COVID-19, SARS, and other related coronaviruses. An open catalogue of drugs has been created and results are publicly available through a drug browser, a keyword-guided text explorer, and a knowledge graph.


title: Robust Path-following for Keplerian Orbits

abstract: This work introduces a novel path-following control strategy inspired by the famous two-body problem, aiming to stabilize any Keplerian orbit. Utilizing insights from the mathematical structure of the two-body problem, we derive a robust path-following law adopting sliding mode control theory to achieve asymptotic convergence to bounded disturbances. The resulting control law is demonstrated to be asymptotically stable. Illustrative examples showcase its applicability, including orbiting an accelerated moving point, patching Keplerian trajectories for complex patterns, and orbital maintenance around the asteroid Itokawa. The proposed control law offers a significant advantage for the orbital station-keeping problem, as its sliding surface is formulated based on variables commonly used to define orbital dynamics. This inherent alignment facilitates easy application to orbital station-keeping scenarios.


title: IMAGO: A family photo album dataset for a socio-historical analysis of the twentieth century

abstract: Although one of the most popular practices in photography since the end of the 19th century, an increase in scholarly interest in family photo albums dates back to the early 1980s. Such collections of photos may reveal sociological and historical insights regarding specific cultures and times. They are, however, in most cases scattered among private homes and only available on paper or photographic film, thus making their analysis by academics such as historians, social-cultural anthropologists and cultural theorists very cumbersome. In this paper, we analyze the IMAGO dataset including photos belonging to family albums assembled at the University of Bologna's Rimini campus since 2004. Following a deep learning-based approach, the IMAGO dataset has offered the opportunity of experimenting with photos taken between year 1845 and year 2009, with the goals of assessing the dates and the socio-historical contexts of the images, without use of any other sources of information. Exceeding our initial expectations, such analysis has revealed its merit not only in terms of the performance of the approach adopted in this work, but also in terms of the foreseeable implications and use for the benefit of socio-historical research. To the best of our knowledge, this is the first work that moves along this path in literature.


title: Cosmology with galaxy cluster weak lensing: statistical limits and experimental design

abstract: We forecast constraints on the amplitude of matter clustering sigma_8(z) achievable with the combination of cluster weak lensing and number counts, in current and next-generation weak lensing surveys. We advocate an approach, analogous to galaxy-galaxy lensing, in which the observables in each redshift bin are the mean number counts and the mean weak lensing profile of clusters above a mass proxy threshold. The primary astrophysical nuisance parameter is the logarithmic scatter between the mass proxy and true mass near the threshold. For surveys similar to the Dark Energy Survey (DES), the Roman Space Telescope High Latitude Survey (HLS), and the Rubin Observatory Legacy Survey of Space and Time (LSST), we forecast aggregate precision on sigma_8 of 0.26%, 0.24%, and 0.10%, respectively, if the mass-observable scatter has an external prior better than 0.01. These constraints would be degraded by about 20% for a 0.05 prior on scatter in the case of DES or HLS and for a 0.016 prior for LSST. A one-month observing program with Roman Space Telescope targeting approximately 2500 massive clusters could achieve a 0.5% constraint on sigma_8(z=0.7) on its own, or a ~0.33% constraint in combination with the HLS. Realizing the constraining power of clusters requires accurate knowledge of the mass-observable relation and stringent control of systematics. We provide analytic approximations to our numerical results that allow easy scaling to other survey assumptions or other methods of cluster mass estimation.


title: Masses and decay constants of (axial-)vector mesons at finite chemical potential

abstract: We update our previous results for (pseudo-)scalar mesons at zero temperature and finite quark chemical potential and generalize the investigation to include (axial-)vector mesons. We determine bound-state properties such as meson masses and decay constants up to chemical potentials far in the first-order coexistence region. To extract the bound-states properties, we solve the Bethe-Salpeter equation and utilize Landau-gauge quark and gluon propagators obtained from a coupled set of (truncated) Dyson-Schwinger equations with N$_\textup{f}=2+1$ dynamical quark flavors at finite chemical potential and vanishing temperature. For multiple (pseudo-)scalar and (axial-)vector mesons, we observe constant masses and decay constants for chemical potentials up to the coexistence region of the first-order phase transition thus verifying explicitly the Silver-Blaze property of QCD. Inside the coexistence region the pion becomes more massive and its decay constants decrease, whereas corresponding quantities for the (axial-)vector mesons remain (almost) constant.


title: On the arithmetic Cohen-Macaulayness of varieties parameterized by Togliatti systems

abstract: Given any diagonal cyclic subgroup $\Lambda \subset GL(n+1,k)$ of order $d$, let $I_d\subset k[x_0,\ldots, x_n]$ be the ideal generated by all monomials $\{m_{1},\ldots, m_{r}\}$ of degree $d$ which are invariants of $\Lambda$. $I_d$ is a monomial Togliatti system, provided $r \leq \binom{d+n-1}{n-1}$, and in this case the projective toric variety $X_d$ parameterized by $(m_{1},\ldots, m_{r})$ is called a $GT$-variety with group $\Lambda$. We prove that all these $GT$-varieties are arithmetically Cohen-Macaulay and we give a combinatorial expression of their Hilbert functions. In the case $n=2$, we compute explicitly the Hilbert function, polynomial and series of $X_d$. We determine a minimal free resolution of its homogeneous ideal and we show that it is a binomial prime ideal generated by quadrics and cubics. We also provide the exact number of both types of generators. Finally, we pose the problem of determining whether a surface parameterized by a Togliatti system is aCM. We construct examples that are aCM and examples that are not.


title: Towards Human Haptic Gesture Interpretation for Robotic Systems

abstract: Physical human-robot interactions (pHRI) are less efficient and communicative than human-human interactions, and a key reason is a lack of informative sense of touch in robotic systems. Interpreting human touch gestures is a nuanced, challenging task with extreme gaps between human and robot capability. Among prior works that demonstrate human touch recognition capability, differences in sensors, gesture classes, feature sets, and classification algorithms yield a conglomerate of non-transferable results and a glaring lack of a standard. To address this gap, this work presents 1) four proposed touch gesture classes that cover an important subset of the gesture characteristics identified in the literature, 2) the collection of an extensive force dataset on a common pHRI robotic arm with only its internal wrist force-torque sensor, and 3) an exhaustive performance comparison of combinations of feature sets and classification algorithms on this dataset. We demonstrate high classification accuracies among our proposed gesture definitions on a test set, emphasizing that neural net-work classifiers on the raw data outperform other combinations of feature sets and algorithms. The accompanying video is here: https://youtu.be/gJPVImNKU68


title: Quark mixing with soft breaking of the parity in the minimal Left-Right model

abstract: We study the possibility of soft breaking effects of the generalized parity within the minimal Left-Right model. One aim of the paper is to elaborate on the potentiality, the limit, and the predictivity of a restored parity at high scale. While revisiting the issue of strong CP in the Left-Right theories, we motivate the possibility of explicit-parity-breaking, that we then parameterize in the right-handed quark mixing matrix. The strong CP parameter $\bar{\theta}$ is also parameterized in terms of the breaking. We discuss some possible phenomenological consequences in this scenario. In particular, the constraint provided by $\bar{\theta}$ enables us to quantify the maximal deviation of the right-handed quark mixings from the standard case with exact parity in term of a single parameter. This deviation has a direct impact on flavor physics.


title: Nonintrusive reduced order model for parametric solutions of inertia relief problems

abstract: The Inertia Relief (IR) technique is widely used by industry and produces equilibrated loads allowing to analyze unconstrained systems without resorting to the more expensive full dynamic analysis. The main goal of this work is to develop a computational framework for the solution of unconstrained parametric structural problems with IR and the Proper Generalized Decomposition (PGD) method. First, the IR method is formulated in a parametric setting for both material and geometric parameters. A reduced order model using the encapsulated PGD suite is then developed to solve the parametric IR problem, circumventing the so-called curse of dimensionality. With just one offline computation, the proposed PGD-IR scheme provides a computational vademecum that contains all the possible solutions for a pre-defined range of the parameters. The proposed approach is nonintrusive and it is therefore possible to be integrated with commercial FE packages. The applicability and potential of the developed technique is shown using a three dimensional test case and a more complex industrial test case. The first example is used to highlight the numerical properties of the scheme, whereas the second example demonstrates the potential in a more complex setting and it shows the possibility to integrate the proposed framework within a commercial FE package. In addition, the last example shows the possibility to use the generalized solution in a multi-objective optimization setting.


title: Optical and Hidden Transport Properties of BaFe$_{1.91}$Ni$_{0.09}$As$_{2}$ Film

abstract: Optical spectroscopy was used to study the electrodynamics and hidden transport properties of a BaFe$_{1.91}$Ni$_{0.09}$As$_{2}$ thin superconducting film. We analyzed the normal state data using a Drude-Lorentz model with two Drude components: one narrow ($D_1$) and another broad one ($D_2$). In the superconducting state, two gaps with $2\Delta _{0}^{(2)}/k_BT_c=1.9$--2.0 and $2\Delta _{0}^{(1)}/k_BT_c=4.0$--4.3 are formed from the narrow component $D_1$ while the broad component $D_2$ remains ungapped. The calculated total DC resistivity of the film and the low-temperature scattering rate for the narrow Drude component show a hidden Fermi-liquid behavior. The change of total electron-boson coupling ($\lambda_{tot}$) and representative energy ($\Omega_{0}$) in the normal state with respect to the superconducting state is typical of other iron-based materials as well as high-temperature superconducting (HTSC) cuprates.


title: High contrast imaging for the enhanced resolution imager and spectrometer (ERIS)

abstract: ERIS is a diffraction limited thermal infrared imager and spectrograph for the Very Large Telescope UT4. One of the science cases for ERIS is the detection and characterization of circumstellar structures and exoplanets around bright stars that are typically much fainter than the stellar diffraction halo. Enhanced sensitivity is provided through the combination of (i) suppression of the diffraction halo of the target star using coronagraphs, and (ii) removal of any residual diffraction structure through focal plane wavefront sensing and subsequent active correction. In this paper we present the two coronagraphs used for diffraction suppression and enabling high contrast imaging in ERIS.


title: Proactive DDoS Attack Mitigation in Cloud-Fog Environment using Moving Target Defense

abstract: Distributed Denial of Service (DDoS) attacks are serious cyber attacks and mitigating DDoS attacks in cloud is a topic of ongoing research interest which remains a major security challenge. Fog computing is an extension of cloud computing which has been used to secure cloud. Moving Target Defense (MTD) is a newly recognized, proactive security defense that can be used to mitigate DDoS attacks on cloud. MTD intends to make a system dynamic in nature and uncertain by changing attack surface continuously to confuse attackers. In this paper, a novel DDoS mitigation framework is presented to support Cloud-Fog Platform using MTD technique (CFPM). CFPM applies migration MTD technique at fog layer to mitigate DDoS attacks in cloud. It detects attacker among all the legitimate clients proactively at the fog layer and isolate it from innocent clients. CFPM uses an effective request handling procedure for load balancing and attacker isolation procedure which aims to minimize disruption to cloud server as well as serving fog servers. In addition, effectiveness of CFPM is evaluated by analyzing the behavior of the system before and after attack, considering different possible scenarios. This approach is effective as it uses the advantage of both MTD technique and Fog computing paradigm supporting cloud environment.


title: Sampling from Unknown Transition Densities of Diffusion processes

abstract: In this paper, we introduce a new method of sampling from transition densities of diffusion processes including those unknown in closed forms by solving a partial differential equation satisfied by the quotient of transition densities. We demonstrate the performance of the developed method on processes with known densities and the obtained results are consistent with theoretical values. The method is applied to Wright-Fisher diffusions owing to their importance in population genetics in studying interaction networks inherent in genetic data. Diffusion processes with bounded drift and non degenerate diffusion are considered as reference processes. $\bf {Key words}:$ Stochastic differential equation (SDE), Transition density, Fokker-Planck partial differential equation, Aronson's bound, Rejection sampling, Wright-Fisher diffusion.


title: Deterministic particle approximation of aggregation-diffusion equations on unbounded domains

abstract: We consider a one-dimensional aggregation-diffusion equation, which is the gradient flow in the Wasserstein space of a functional with competing attractive-repulsive interactions. We prove that the fully deterministic particle approximations with piecewise constant densities introduced in~\cite{Di Francesco-Rosini} starting from general bounded initial densities converge strongly in $L^1$ to bounded weak solutions of the PDE. In particular, the result is achieved in unbounded domains and for arbitrary nonnegative bounded initial densities, thus extending the results in \cite{Gosse-Toscani, Matthes-Osberger, Mathes-Soellner} (in which a no-vacuum condition is required) and giving an alternative approach to \cite{Carrillo-Craig-Patacchini} in the one-dimensional case, including also subquadratic and superquadratic diffusions.


title: Sketching Persistence Diagrams

abstract: Given a persistence diagram with $n$ points, we give an algorithm that produces a sequence of $n$ persistence diagrams converging in bottleneck distance to the input diagram, the $i$th of which has $i$ distinct (weighted) points and is a $2$-approximation to the closest persistence diagram with that many distinct points. For each approximation, we precompute the optimal matching between the $i$th and the $(i+1)$st. Perhaps surprisingly, the entire sequence of diagrams as well as the sequence of matchings can be represented in $O(n)$ space. The main approach is to use a variation of the greedy permutation of the persistence diagram to give good Hausdorff approximations and assign weights to these subsets. We give a new algorithm to efficiently compute this permutation, despite the high implicit dimension of points in a persistence diagram due to the effect of the diagonal. The sketches are also structured to permit fast (linear time) approximations to the Hausdorff distance between diagrams -- a lower bound on the bottleneck distance. For approximating the bottleneck distance, sketches can also be used to compute a linear-size neighborhood graph directly, obviating the need for geometric data structures used in state-of-the-art methods for bottleneck computation.


title: Accelerating Number Theoretic Transformations for Bootstrappable Homomorphic Encryption on GPUs

abstract: Homomorphic encryption (HE) draws huge attention as it provides a way of privacy-preserving computations on encrypted messages. Number Theoretic Transform (NTT), a specialized form of Discrete Fourier Transform (DFT) in the finite field of integers, is the key algorithm that enables fast computation on encrypted ciphertexts in HE. Prior works have accelerated NTT and its inverse transformation on a popular parallel processing platform, GPU, by leveraging DFT optimization techniques. However, these GPU-based studies lack a comprehensive analysis of the primary differences between NTT and DFT or only consider small HE parameters that have tight constraints in the number of arithmetic operations that can be performed without decryption. In this paper, we analyze the algorithmic characteristics of NTT and DFT and assess the performance of NTT when we apply the optimizations that are commonly applicable to both DFT and NTT on modern GPUs. From the analysis, we identify that NTT suffers from severe main-memory bandwidth bottleneck on large HE parameter sets. To tackle the main-memory bandwidth issue, we propose a novel NTT-specific on-the-fly root generation scheme dubbed on-the-fly twiddling (OT). Compared to the baseline radix-2 NTT implementation, after applying all the optimizations, including OT, we achieve 4.2x speedup on a modern GPU.


title: A new generalization of the Genocchi numbers and its consequence on the Bernoulli polynomials

abstract: This paper presents a new generalization of the Genocchi numbers and the Genocchi theorem. As consequences, we obtain some important families of integer-valued polynomials those are closely related to the Bernoulli polynomials. Denoting by ${(B_n)}_{n \in \mathbb{N}}$ the sequence of the Bernoulli numbers and by ${(B_n(X))}_{n \in \mathbb{N}}$ the sequence of the Bernoulli polynomials, we especially obtain that for any natural number $n$, the reciprocal polynomial of the polynomial $\big(B_n(X) - B_n\big)$ is integer-valued.


title: When are sequences of Boolean functions tame?

abstract: In \cite{js2006}, Jonasson and Steif conjectured that no non-degenerate sequence of transitive Boolean functions $ (f_n)_{n \geq 1}$ with $ \lim_{n \to \infty} I(f_n)= \infty $ could be tame (with respect to some $ (p_n)_{n \geq 1} $). In a companion paper \cite{f}, the author showed that this conjecture in its full generality is false, by providing a counter-example for the case when, at the same time, $\lim_{n \to \infty} np_n = \infty $ and $ \lim_{n \to \infty} n^\alpha p_n = 0$ for some $ \alpha \in (0,1 ).$ In this paper we show that with slightly different assumptions, the conclusion of the conjecture holds when the sequence $(p_n)_{n \geq 1}$ is bounded away from zero and one.


title: IoT DoS and DDoS Attack Detection using ResNet

abstract: The network attacks are increasing both in frequency and intensity with the rapid growth of internet of things (IoT) devices. Recently, denial of service (DoS) and distributed denial of service (DDoS) attacks are reported as the most frequent attacks in IoT networks. The traditional security solutions like firewalls, intrusion detection systems, etc., are unable to detect the complex DoS and DDoS attacks since most of them filter the normal and attack traffic based upon the static predefined rules. However, these solutions can become reliable and effective when integrated with artificial intelligence (AI) based techniques. During the last few years, deep learning models especially convolutional neural networks achieved high significance due to their outstanding performance in the image processing field. The potential of these convolutional neural network (CNN) models can be used to efficiently detect the complex DoS and DDoS by converting the network traffic dataset into images. Therefore, in this work, we proposed a methodology to convert the network traffic data into image form and trained a state-of-the-art CNN model, i.e., ResNet over the converted data. The proposed methodology accomplished 99.99\% accuracy for detecting the DoS and DDoS in case of binary classification. Furthermore, the proposed methodology achieved 87\% average precision for recognizing eleven types of DoS and DDoS attack patterns which is 9\% higher as compared to the state-of-the-art.


title: Automated Artefact Relevancy Determination from Artefact Metadata and Associated Timeline Events

abstract: Case-hindering, multi-year digital forensic evidence backlogs have become commonplace in law enforcement agencies throughout the world. This is due to an ever-growing number of cases requiring digital forensic investigation coupled with the growing volume of data to be processed per case. Leveraging previously processed digital forensic cases and their component artefact relevancy classifications can facilitate an opportunity for training automated artificial intelligence based evidence processing systems. These can significantly aid investigators in the discovery and prioritisation of evidence. This paper presents one approach for file artefact relevancy determination building on the growing trend towards a centralised, Digital Forensics as a Service (DFaaS) paradigm. This approach enables the use of previously encountered pertinent files to classify newly discovered files in an investigation. Trained models can aid in the detection of these files during the acquisition stage, i.e., during their upload to a DFaaS system. The technique generates a relevancy score for file similarity using each artefact's filesystem metadata and associated timeline events. The approach presented is validated against three experimental usage scenarios.


title: A Systematic Literature Review on Federated Learning: From A Model Quality Perspective

abstract: As an emerging technique, Federated Learning (FL) can jointly train a global model with the data remaining locally, which effectively solves the problem of data privacy protection through the encryption mechanism. The clients train their local model, and the server aggregates models until convergence. In this process, the server uses an incentive mechanism to encourage clients to contribute high-quality and large-volume data to improve the global model. Although some works have applied FL to the Internet of Things (IoT), medicine, manufacturing, etc., the application of FL is still in its infancy, and many related issues need to be solved. Improving the quality of FL models is one of the current research hotspots and challenging tasks. This paper systematically reviews and objectively analyzes the approaches to improving the quality of FL models. We are also interested in the research and application trends of FL and the effect comparison between FL and non-FL because the practitioners usually worry that achieving privacy protection needs compromising learning quality. We use a systematic review method to analyze 147 latest articles related to FL. This review provides useful information and insights to both academia and practitioners from the industry. We investigate research questions about academic research and industrial application trends of FL, essential factors affecting the quality of FL models, and compare FL and non-FL algorithms in terms of learning quality. Based on our review's conclusion, we give some suggestions for improving the FL model quality. Finally, we propose an FL application framework for practitioners.


title: Transfer learning to enhance amenorrhea status prediction in cancer and fertility data with missing values

abstract: Collecting sufficient labelled training data for health and medical problems is difficult (Antropova, et al., 2018). Also, missing values are unavoidable in health and medical datasets and tackling the problem arising from the inadequate instances and missingness is not straightforward (Snell, et al. 2017, Sterne, et al. 2009). However, machine learning algorithms have achieved significant success in many real-world healthcare problems, such as regression and classification and these techniques could possibly be a way to resolve the issues.


title: A small note on variation in segmentation annotations

abstract: We report on the results of a small crowdsourcing experiment conducted at a workshop on machine learning for segmentation held at the Danish Bio Imaging network meeting 2020. During the workshop we asked participants to manually segment mitochondria in three 2D patches. The aim of the experiment was to illustrate that manual annotations should not be seen as the ground truth, but as a reference standard that is subject to substantial variation. In this note we show how the large variation we observed in the segmentations can be reduced by removing the annotators with worst pair-wise agreement. Having removed the annotators with worst performance, we illustrate that the remaining variance is semantically meaningful and can be exploited to obtain segmentations of cell boundary and cell interior.


title: Patient similarity: methods and applications

abstract: Patient similarity analysis is important in health care applications. It takes patient information such as their electronic medical records and genetic data as input and computes the pairwise similarity between patients. Procedures of typical a patient similarity study can be divided into several steps including data integration, similarity measurement, and neighborhood identification. And according to an analysis of patient similarity, doctors can easily find the most suitable treatments. There are many methods to analyze the similarity such as cluster analysis. And during machine learning become more and more popular, Using neural networks such as CNN is a new hot topic. This review summarizes representative methods used in each step and discusses applications of patient similarity networks especially in the context of precision medicine.


title: Anticipation-induced social tipping -- Can the environment be stabilised by social dynamics?

abstract: In the past decades human activities caused global Earth system changes, e.g., climate change or biodiversity loss. Simultaneously, these associated impacts have increased environmental awareness within societies across the globe, thereby leading to dynamical feedbacks between the social and natural Earth system. Contemporary modelling attempts of Earth system dynamics rarely incorporate such co-evolutions and interactions are mostly studied unidirectionally through direct or remembered past impacts. Acknowledging that societies have the additional capability for foresight, this work proposes a conceptual feedback model of socio-ecological co-evolution with the specific construct of anticipation acting as a mediator between the social and natural system. Our model reproduces results from previous sociological threshold models with bi-stability if one assumes a static environment. Once the environment changes in response to societal behaviour the system instead converges towards a globally stable, but not necessarily desired, attractor. Ultimately, we show that anticipation of future ecological states then leads to metastability of the system where desired states can persist for a long time. We thereby demonstrate that foresight and anticipation form an important mechanism which, once its time horizon becomes large enough, fosters social tipping towards behaviour that can stabilise the environment and prevents potential socio-ecological collapse.


title: Asymptotic convergence rate of Dropout on shallow linear neural networks

abstract: We analyze the convergence rate of gradient flows on objective functions induced by Dropout and Dropconnect, when applying them to shallow linear Neural Networks (NNs) - which can also be viewed as doing matrix factorization using a particular regularizer. Dropout algorithms such as these are thus regularization techniques that use 0,1-valued random variables to filter weights during training in order to avoid coadaptation of features. By leveraging a recent result on nonconvex optimization and conducting a careful analysis of the set of minimizers as well as the Hessian of the loss function, we are able to obtain (i) a local convergence proof of the gradient flow and (ii) a bound on the convergence rate that depends on the data, the dropout probability, and the width of the NN. Finally, we compare this theoretical bound to numerical simulations, which are in qualitative agreement with the convergence bound and match it when starting sufficiently close to a minimizer.


title: Artificial Intelligence Accelerators based on Graphene Optoelectronic Devices

abstract: Optical and optoelectronic approaches of performing matrix-vector multiplication (MVM) operations have shown the great promise of accelerating machine learning (ML) algorithms with unprecedented performance. The incorporation of nanomaterials into the system can further improve the performance thanks to their extraordinary properties, but the non-uniformity and variation of nanostructures in the macroscopic scale pose severe limitations for large-scale hardware deployment. Here, we report a new optoelectronic architecture consisting of spatial light modulators and photodetector arrays made from graphene to perform MVM. The ultrahigh carrier mobility of graphene, nearly-zero-power-consumption electro-optic control, and extreme parallelism suggest ultrahigh data throughput and ultralow-power consumption. Moreover, we develop a methodology of performing accurate calculations with imperfect components, laying the foundation for scalable systems. Finally, we perform a few representative ML algorithms, including singular value decomposition, support vector machine, and deep neural networks, to show the versatility and generality of our platform.


title: Deep Multi-Scale Features Learning for Distorted Image Quality Assessment

abstract: Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the DNN-based quality assessment models by exploiting efficient multi-scale features. In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction. Our model is based on both residual maps and distorted images in luminance domain, where the proposed network contains spatial pyramid pooling and feature pyramid from the network structure. Our proposed network is optimized in a deep end-to-end supervision manner. To validate the effectiveness of the proposed method, extensive experiments are conducted on four widely-used image quality assessment databases, demonstrating the superiority of our algorithm.


title: Advanced Graph and Sequence Neural Networks for Molecular Property Prediction and Drug Discovery

abstract: Properties of molecules are indicative of their functions and thus are useful in many applications. With the advances of deep learning methods, computational approaches for predicting molecular properties are gaining increasing momentum. However, there lacks customized and advanced methods and comprehensive tools for this task currently. Here we develop a suite of comprehensive machine learning methods and tools spanning different computational models, molecular representations, and loss functions for molecular property prediction and drug discovery. Specifically, we represent molecules as both graphs and sequences. Built on these representations, we develop novel deep models for learning from molecular graphs and sequences. In order to learn effectively from highly imbalanced datasets, we develop advanced loss functions that optimize areas under precision-recall curves. Altogether, our work not only serves as a comprehensive tool, but also contributes towards developing novel and advanced graph and sequence learning methodologies. Results on both online and offline antibiotics discovery and molecular property prediction tasks show that our methods achieve consistent improvements over prior methods. In particular, our methods achieve #1 ranking in terms of both ROC-AUC and PRC-AUC on the AI Cures Open Challenge for drug discovery related to COVID-19. Our software is released as part of the MoleculeX library under AdvProp.


title: Tensor Data Scattering and the Impossibility of Slicing Theorem

abstract: This paper proposes a standard way to represent sparse tensors. A broad theoretical framework for tensor data scattering methods used in various deep learning frameworks is established. This paper presents a theorem that is very important for performance analysis and accelerator optimization for implementing data scattering. The theorem shows how the impossibility of slicing happens in tenser data scattering. A sparsity measuring formula is provided, which can effectively indicate the storage efficiency of sparse tensor and the possibility of parallelly using it. The source code, including CUDA code, is provided in a related open-source project.


title: Detection of False-Reading Attacks in the AMI Net-Metering System

abstract: In smart grid, malicious customers may compromise their smart meters (SMs) to report false readings to achieve financial gains illegally. Reporting false readings not only causes hefty financial losses to the utility but may also degrade the grid performance because the reported readings are used for energy management. This paper is the first work that investigates this problem in the net-metering system, in which one SM is used to report the difference between the power consumed and the power generated. First, we prepare a benign dataset for the net-metering system by processing a real power consumption and generation dataset. Then, we propose a new set of attacks tailored for the net-metering system to create malicious dataset. After that, we analyze the data and we found time correlations between the net meter readings and correlations between the readings and relevant data obtained from trustworthy sources such as the solar irradiance and temperature. Based on the data analysis, we propose a general multi-data-source deep hybrid learning-based detector to identify the false-reading attacks. Our detector is trained on net meter readings of all customers besides data from the trustworthy sources to enhance the detector performance by learning the correlations between them. The rationale here is that although an attacker can report false readings, he cannot manipulate the solar irradiance and temperature values because they are beyond his control. Extensive experiments have been conducted, and the results indicate that our detector can identify the false-reading attacks with high detection rate and low false alarm.


title: Global solvability, stability and oscillation criteria for systems of two first-order pseudo linear ordinary differential equations

abstract: In this paper we use the Riccati equation method with other ones to establish global solvability, stability and oscillation criteria for a class of two dimensional nonlinear systems of ordinary differential equations, which is a generalization of wide classes of second order nonlinear ordinary differential equations, studied by many authors. The applicability of some of these criteria are illustrated by examples.


title: RotNet: Fast and Scalable Estimation of Stellar Rotation Periods Using Convolutional Neural Networks

abstract: Magnetic activity in stars manifests as dark spots on their surfaces that modulate the brightness observed by telescopes. These light curves contain important information on stellar rotation. However, the accurate estimation of rotation periods is computationally expensive due to scarce ground truth information, noisy data, and large parameter spaces that lead to degenerate solutions. We harness the power of deep learning and successfully apply Convolutional Neural Networks to regress stellar rotation periods from Kepler light curves. Geometry-preserving time-series to image transformations of the light curves serve as inputs to a ResNet-18 based architecture which is trained through transfer learning. The McQuillan catalog of published rotation periods is used as ansatz to groundtruth. We benchmark the performance of our method against a random forest regressor, a 1D CNN, and the Auto-Correlation Function (ACF) - the current standard to estimate rotation periods. Despite limiting our input to fewer data points (1k), our model yields more accurate results and runs 350 times faster than ACF runs on the same number of data points and 10,000 times faster than ACF runs on 65k data points. With only minimal feature engineering our approach has impressive accuracy, motivating the application of deep learning to regress stellar parameters on an even larger scale


title: An Improved Iterative Neural Network for High-Quality Image-Domain Material Decomposition in Dual-Energy CT

abstract: Dual-energy computed tomography (DECT) has been widely used in many applications that need material decomposition. Image-domain methods directly decompose material images from high- and low-energy attenuation images, and thus, are susceptible to noise and artifacts on attenuation images. The purpose of this study is to develop an improved iterative neural network (INN) for high-quality image-domain material decomposition in DECT, and to study its properties. We propose a new INN architecture for DECT material decomposition. The proposed INN architecture uses distinct cross-material convolutional neural network (CNN) in image refining modules, and uses image decomposition physics in image reconstruction modules. The distinct cross-material CNN refiners incorporate distinct encoding-decoding filters and cross-material model that captures correlations between different materials. We study the distinct cross-material CNN refiner with patch-based reformulation and tight-frame condition. Numerical experiments with extended cardiactorso (XCAT) phantom and clinical data show that the proposed INN significantly improves the image quality over several image-domain material decomposition methods, including a conventional model-based image decomposition (MBID) method using an edge-preserving regularizer, a recent MBID method using pre-learned material-wise sparsifying transforms, and a noniterative deep CNN method. Our study with patch-based reformulations reveals that learned filters of distinct cross-material CNN refiners can approximately satisfy the tight-frame condition.


title: SoK: Exploring the State of the Art and the Future Potential of Artificial Intelligence in Digital Forensic Investigation

abstract: Multi-year digital forensic backlogs have become commonplace in law enforcement agencies throughout the globe. Digital forensic investigators are overloaded with the volume of cases requiring their expertise compounded by the volume of data to be processed. Artificial intelligence is often seen as the solution to many big data problems. This paper summarises existing artificial intelligence based tools and approaches in digital forensics. Automated evidence processing leveraging artificial intelligence based techniques shows great promise in expediting the digital forensic analysis process while increasing case processing capacities. For each application of artificial intelligence highlighted, a number of current challenges and future potential impact is discussed.


title: Wisdom of Committees: An Overlooked Approach To Faster and More Accurate Models

abstract: Committee-based models (ensembles or cascades) construct models by combining existing pre-trained ones. While ensembles and cascades are well-known techniques that were proposed before deep learning, they are not considered a core building block of deep model architectures and are rarely compared to in recent literature on developing efficient models. In this work, we go back to basics and conduct a comprehensive analysis of the efficiency of committee-based models. We find that even the most simplistic method for building committees from existing, independently pre-trained models can match or exceed the accuracy of state-of-the-art models while being drastically more efficient. These simple committee-based models also outperform sophisticated neural architecture search methods (e.g., BigNAS). These findings hold true for several tasks, including image classification, video classification, and semantic segmentation, and various architecture families, such as ViT, EfficientNet, ResNet, MobileNetV2, and X3D. Our results show that an EfficientNet cascade can achieve a 5.4x speedup over B7 and a ViT cascade can achieve a 2.3x speedup over ViT-L-384 while being equally accurate.


title: Gaussian process approach within a data-driven POD framework for fluid dynamics engineering problems

abstract: This work describes the implementation of a data-driven approach for the reduction of the complexity of parametrical partial differential equations (PDEs) employing Proper Orthogonal Decomposition (POD) and Gaussian Process Regression (GPR). This approach is applied initially to a literature case, the simulation of the stokes problems, and in the following to a real-world industrial problem, inside a shape optimization pipeline for a naval engineering problem.


title: Supersymmetric Graphene on Squashed Hemisphere

abstract: We compute the partition function of $\mathcal N=2$ supersymmetric mixed dimensional QED on a squashed hemisphere using localization. Mixed dimensional QED is an abelian gauge theory coupled to charged matter fields at the boundary. The partition function is a function of the complex gauge coupling $\tau$, the choice of R-symmetry and the squashing deformation. The superconformal R-symmetry is determined using the 3-dimensional F-maximization. The free energy as a function of squashing deformation allows computing correlation functions that contain the insertion of the energy-momentum tensor. We compute the 2-point correlation function of the boundary energy-momentum tensor by differentiating the free energy with respect to the squashing parameter. We comment on the behaviour of the 2-point function as we change the complex coupling $\tau$.


title: Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning

abstract: In this paper, we investigate a radio access network (RAN) slicing problem for Internet of vehicles (IoV) services with different quality of service (QoS) requirements, in which multiple logically-isolated slices are constructed on a common roadside network infrastructure. A dynamic RAN slicing framework is presented to dynamically allocate radio spectrum and computing resource, and distribute computation workloads for the slices. To obtain an optimal RAN slicing policy for accommodating the spatial-temporal dynamics of vehicle traffic density, we first formulate a constrained RAN slicing problem with the objective to minimize long-term system cost. This problem cannot be directly solved by traditional reinforcement learning (RL) algorithms due to complicated coupled constraints among decisions. Therefore, we decouple the problem into a resource allocation subproblem and a workload distribution subproblem, and propose a two-layer constrained RL algorithm, named Resource Allocation and Workload diStribution (RAWS) to solve them. Specifically, an outer layer first makes the resource allocation decision via an RL algorithm, and then an inner layer makes the workload distribution decision via an optimization subroutine. Extensive trace-driven simulations show that the RAWS effectively reduces the system cost while satisfying QoS requirements with a high probability, as compared with benchmarks.


title: Spectral properties of the $n$-Queens' Graphs

abstract: The $n$-Queens' graph, $\mathcal{Q}(n)$, is the graph associated to the $n \times n$ chessboard (a generalization of the classical $8 \times 8$ chessboard), with $n^2$ vertices, each one corresponding to a square of the chessboard. Two vertices of $\mathcal{Q}(n)$ are adjacent if and only if they are in the same row, in the same column or in the same diagonal of the chessboard. After a short overview on the main combinatorial properties of $\mathcal{Q}(n)$, its spectral properties are investigated. First, a lower bound on the least eigenvalue of an arbitrary graph is obtained using clique edge partitions and a sufficient condition for this lower bound be attained is deduced. For the particular case of $\mathcal{Q}(n)$, we prove that for every $n$, its least eigenvalue is not less than $-4$ and it is equal to $-4$ with multiplicity $(n-3)^2$, for every $n \ge 4$. Furthermore, $n-4$ is also an eigenvalue of $\mathcal{Q}(n)$, with multiplicity at least $\frac{n-2}{2}$ when $n$ is even and at least $\frac{n+1}{2}$ when $n$ is odd. A conjecture about the integer eigenvalues of $\mathcal{Q}(n)$ is presented. We finish this article with an algorithm to determine an equitable partition of the $n$-Queens' graph, $\mathcal{Q}(n)$, for $n \ge 3$, concluding that such equitable partition has $\frac{(\lceil n/2\rceil+1)\lceil n/2\rceil}{2}$ cells.


title: Radar Artifact Labeling Framework (RALF): Method for Plausible Radar Detections in Datasets

abstract: Research on localization and perception for Autonomous Driving is mainly focused on camera and LiDAR datasets, rarely on radar data. Manually labeling sparse radar point clouds is challenging. For a dataset generation, we propose the cross sensor Radar Artifact Labeling Framework (RALF). Automatically generated labels for automotive radar data help to cure radar shortcomings like artifacts for the application of artificial intelligence. RALF provides plausibility labels for radar raw detections, distinguishing between artifacts and targets. The optical evaluation backbone consists of a generalized monocular depth image estimation of surround view cameras plus LiDAR scans. Modern car sensor sets of cameras and LiDAR allow to calibrate image-based relative depth information in overlapping sensing areas. K-Nearest Neighbors matching relates the optical perception point cloud with raw radar detections. In parallel, a temporal tracking evaluation part considers the radar detections' transient behavior. Based on the distance between matches, respecting both sensor and model uncertainties, we propose a plausibility rating of every radar detection. We validate the results by evaluating error metrics on semi-manually labeled ground truth dataset of $3.28\cdot10^6$ points. Besides generating plausible radar detections, the framework enables further labeled low-level radar signal datasets for applications of perception and Autonomous Driving learning tasks.


title: Localization of Malaria Parasites and White Blood Cells in Thick Blood Smears

abstract: Effectively determining malaria parasitemia is a critical aspect in assisting clinicians to accurately determine the severity of the disease and provide quality treatment. Microscopy applied to thick smear blood smears is the de facto method for malaria parasitemia determination. However, manual quantification of parasitemia is time consuming, laborious and requires considerable trained expertise which is particularly inadequate in highly endemic and low resourced areas. This study presents an end-to-end approach for localisation and count of malaria parasites and white blood cells (WBCs) which aid in the effective determination of parasitemia; the quantitative content of parasites in the blood. On a dataset of slices of images of thick blood smears, we build models to analyse the obtained digital images. To improve model performance due to the limited size of the dataset, data augmentation was applied. Our preliminary results show that our deep learning approach reliably detects and returns a count of malaria parasites and WBCs with a high precision and recall. We also evaluate our system against human experts and results indicate a strong correlation between our deep learning model counts and the manual expert counts (p=0.998 for parasites, p=0.987 for WBCs). This approach could potentially be applied to support malaria parasitemia determination especially in settings that lack sufficient Microscopists.


title: Multicritical random partitions

abstract: We study two families of probability measures on integer partitions, which are Schur measures with parameters tuned in such a way that the edge fluctuations are characterized by a critical exponent different from the generic $1/3$. We find that the first part asymptotically follows a "higher-order analogue" of the Tracy-Widom GUE distribution, previously encountered by Le Doussal, Majumdar and Schehr in quantum statistical physics. We also compute limit shapes, and discuss an exact mapping between one of our families and the multicritical unitary matrix models introduced by Periwal and Shevitz.


title: Three-nucleon force contribution to the deuteron channel in $(d,p)$ reactions

abstract: The contribution of a three-nucleon (3N) force, acting between the neutron and proton in the incoming deuteron with a target nucleon, to the deuteron-target potential in the entrance channel of the $A(d,p)B$ reaction has been calculated within the adiabatic distorted wave approximation (ADWA). Four different 3N interaction sets from local chiral effective field theory ($\chi$EFT) at next-to-next-to-leading order (N2LO) were used. Strong sensitivity of the adiabatic deuteron-target potential to the choice of the 3N force format has been found, which originates from the enhanced sensitivity to the short-range physics of nucleon-nucleon (NN) and 3N interactions in the ADWA. Such a sensitivity is reduced when a Watanabe folding model is used to generate $d$-$A$ potential instead of ADWA. The impact of the 3N force contribution on $(d,p)$ cross sections depends on assumptions made about the $p$-$A$ and $n$-$A$ optical potentials used to calculate the distorted $d$-$A$ potential in the entrance channel. It is different for local and nonlocal optical potentials and depends on whether the induced three-body force arising due to neglect of target excitations is included or not.


title: Self-optimizing adaptive optics control with Reinforcement Learning

abstract: Current and future high-contrast imaging instruments require extreme Adaptive Optics (XAO) systems to reach contrasts necessary to directly image exoplanets. Telescope vibrations and the temporal error induced by the latency of the control loop limit the performance of these systems. Optimization of the (predictive) control algorithm is crucial in reducing these effects. We describe how model-free Reinforcement Learning can be used to optimize a Recurrent Neural Network controller for closed-loop adaptive optics control. We verify our proposed approach for tip-tilt control in simulations and a lab setup. The results show that this algorithm can effectively learn to suppress a combination of tip-tilt vibrations. Furthermore, we report decreased residuals for power-law input turbulence compared to an optimal gain integrator. Finally, we demonstrate that the controller can learn to identify the parameters of a varying vibration without requiring online updating of the control law. We conclude that Reinforcement Learning is a promising approach towards data-driven predictive control; future research will apply this approach to the control of high-order deformable mirrors


title: Robust control of quantum systems by quantum systems

abstract: Quantum systems can be controlled by other quantum systems in a reversible way, without any information leaking to the outside of the system-controller compound. Such coherent quantum control is deterministic, is less noisy than measurement-based feedback control, and has potential applications in a variety of quantum technologies, including quantum computation, quantum communication and quantum metrology. Here we introduce a coherent feedback protocol, consisting of a sequence of identical interactions with controlling quantum systems, that steers a quantum system from an arbitrary initial state towards a target state. We determine the broad class of such coherent feedback channels that achieve convergence to the target state, and then stabilise as well as protect it against noise. Our results imply that also weak system-controller interactions can counter noise if they occur with suitably high frequency. We provide an example of a control scheme that does not require knowledge of the target state encoded in the controllers, which could be the result of a quantum computation. It thus provides a mechanism for autonomous, purely quantum closed-loop control.


title: Effect of strain-induced orbital splitting on the magnetic excitations in undoped cuprates

abstract: We investigate the magnetic excitations in view of the recent reports suggesting that the spin-wave energy may exhibit a significant dependence on the in-plane strain of a thin film of La$_2$CuO$_4$. The nature of dependence, as we find, can be explained naturally within a two-orbital model based on the $d_{x^2-y^2}$ and $d_{3z^2-r^2}$ orbitals. In particular, as the orbital-splitting energy between the $d_{x^2-y^2}$ and $d_{3z^2-r^2}$ orbitals increases with compressive strain, the zone-boundary spin-wave energy hardens. However, the hardening persists only until the orbital splitting reaches $\sim$ 2eV, beyond which there is no significant change. The behavior of zone-boundary spin-wave energy is explained in terms of the extent of hybridization between one of the exchange-split $d_{x^2-y^2}$ band which is nearly half filled and the $d_{3z^2-r^2}$ band. The role of second-order antiferromagnetic superexchange process involving the inter-orbital hopping is also discussed.


title: DUG-RECON: A Framework for Direct Image Reconstruction using Convolutional Generative Networks

abstract: This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves mapping of projection main data collected from the detector to the image domain. This mapping is done typically through iterative reconstruction algorithms which are time consuming and computationally expensive. Trained deep learning networks provide faster outputs as proven in various tasks across computer vision. In this work we propose a direct reconstruction framework exclusively with deep learning architectures. The proposed framework consists of three segments, namely denoising, reconstruction and super resolution. The denoising and the super resolution segments act as processing steps. The reconstruction segment consists of a novel double U-Net generator (DUG) which learns the sinogram-to-image transformation. This entire network was trained on positron emission tomography (PET) and computed tomography (CT) images. The reconstruction framework approximates two-dimensional (2-D) mapping from projection domain to image domain. The architecture proposed in this proof-of-concept work is a novel approach to direct image reconstruction; further improvement is required to implement it in a clinical setting.


title: How merger-driven gas motions in galaxy clusters can turn AGN bubbles into radio relics

abstract: Radio relics in galaxy clusters are extended synchrotron sources produced by cosmic-ray electrons in the $\mu$G magnetic field. Many relics are found in the cluster periphery and have a cluster-centric, narrow arc-like shape, which suggests that the electrons are accelerated or re-accelerated by merger shock fronts propagating outward in the intracluster plasma. In the X-ray, some relics do exhibit such shocks at the location of the relic, but many do not. We explore the possibility that radio relics trace not the shock fronts but the shape of the underlying distribution of seed relativistic electrons, lit up by a recent shock passage. We use magnetohydrodynamic simulations of cluster mergers and include bubbles of relativistic electrons injected by jets from the central AGN or from an off-center radio galaxy. We show that the merger-driven gas motions (a) can advect the bubble cosmic rays to very large radii, and (b) spread the relativistic seed electrons preferentially in tangential direction -- along the gravitational equipotential surfaces -- producing extended, filamentary or sheet-like regions of intracluster plasma enriched with aged cosmic rays, which resemble radio relics. Once a shock front passes across such a region, the sharp radio emission edges would trace the sharp boundaries of these enriched regions rather than the front. We also show that these elongated cosmic ray features are naturally associated with magnetic fields stretched tangentially along their long axis, which could help explain the high polarization of relics.


title: Lipschitz stability for Backward Heat Equation with application to Fluorescence Microscopy

abstract: This second version of the manuscript includes, in the appendices, an erratum that points out an error on the published version and offers alternative results for the Lipschitz stability analysis of the backward heat propagation problem and its applications to light sheet fluorescence microscopy. Abstract of the first version: In this work, we study a Lipschitz stability result in the reconstruction of a compactly supported initial temperature for the heat equation in $\mathbb{R}^n$, from measurements along a positive time interval and over an open set containing its support. We take advantage of the explicit dependency of solutions to the heat equation with respect to the initial condition. By means of Carleman estimates we obtain an analogous result for the case when the observation is made along an exterior region $\omega\times(\tau,T)$, such that the unobserved part $\mathbb{R}^n\backslash\omega$ is bounded. In the latter setting, the method of Carleman estimates gives a general conditional logarithmic stability result when initial temperatures belong to a certain admissible set, and without the assumption of compactness of support. Furthermore, we apply these results to deduce a similar result for the heat equation in $\mathbb{R}$ for measurements available on a curve contained in $\mathbb{R}\times [0,\infty)$, from where a stability estimate for an inverse problem arising in 2D Fluorescence Microscopy is deduced as well. In order to further understand this Lipschitz stability, in particular, the magnitude of its stability constant with respect to the noise level of the measurements, a numerical reconstruction is presented based on the construction of a linear system for the inverse problem in Fluorescence Microscopy. We investigate the stability constant with the condition number of the corresponding matrix.


title: Asymptotic derivation of high-order rod models from non-linear 3D elasticity

abstract: We propose a method for deriving equivalent one-dimensional models for slender non-linear structures. The approach is designed to be broadly applicable, and can handle in principle finite strains, finite rotations, arbitrary cross-sections shapes, inhomogeneous elastic properties across the cross-section, arbitrary elastic constitutive laws (possibly with low symmetry) and arbitrary distributions of pre-strain, including finite pre-strain. It is based on a kinematic parameterization of the actual configuration that makes use of a center-line, a frame of directors, and local degrees of freedom capturing the detailed shape of cross-sections. A relaxation method is applied that holds the framed center-line fixed while relaxing the local degrees of freedom; it is asymptotically valid when the macroscopic strain and the properties of the rod vary slowly in the longitudinal direction. The outcome is a one-dimensional strain energy depending on the apparent stretching, bending and twisting strain of the framed center-line; the dependence on the strain gradients is also captured, yielding an equivalent rod model that is asymptotically exact to higher order. The method is presented in a fully non-linear setting and it is verified against linear and weakly non-linear solutions available from the literature.


title: Rokhlin's signature theorems

abstract: This note is written for a book dedicated to outstanding St-Petersburg mathematicians and timed to the ICM-2022 in St-Petersburg. In accordance with the plan of ICM-organizers, we try to tell about one of the most prominent Rokhlin's achievements in an accessible form and respecting the allowed volume.


title: Potential energy contribution to the thermopower of correlated electrons

abstract: Certain classes of strongly correlated systems promise high thermopower efficiency, but a full understanding of correlation effects on the Seebeck coefficient is lacking. This is partly due to limitations of Boltzmann-type approaches. One needs a formula for the thermopower that allows separate investigations of the kinetic and potential energy contributions to the evolution with temperature and doping of the thermopower. Here we address this issue by deriving for Hubbard-like interactions a formula for the thermopower that separates the potential from the kinetic energy contribution and facilitates a better understanding of correlation effects on the Seebeck coefficient. As an example, the thermopower of the one-band Hubbard model is calculated from dynamical mean-field. For interactions in both the intermediate and strong correlation limit, the contributions from kinetic and potential energy nearly cancel.


title: AugSplicing: Synchronized Behavior Detection in Streaming Tensors

abstract: How can we track synchronized behavior in a stream of time-stamped tuples, such as mobile devices installing and uninstalling applications in the lockstep, to boost their ranks in the app store? We model such tuples as entries in a streaming tensor, which augments attribute sizes in its modes over time. Synchronized behavior tends to form dense blocks (i.e. subtensors) in such a tensor, signaling anomalous behavior, or interesting communities. However, existing dense block detection methods are either based on a static tensor, or lack an efficient algorithm in a streaming setting. Therefore, we propose a fast streaming algorithm, AugSplicing, which can detect the top dense blocks by incrementally splicing the previous detection with the incoming ones in new tuples, avoiding re-runs over all the history data at every tracking time step. AugSplicing is based on a splicing condition that guides the algorithm (Section 4). Compared to the state-of-the-art methods, our method is (1) effective to detect fraudulent behavior in installing data of real-world apps and find a synchronized group of students with interesting features in campus Wi-Fi data; (2) robust with splicing theory for dense block detection; (3) streaming and faster than the existing streaming algorithm, with closely comparable accuracy.