title: Field-Embedded Factorization Machines for Click-through rate prediction

abstract: Click-through rate (CTR) prediction models are common in many online applications such as digital advertising and recommender systems. Field-Aware Factorization Machine (FFM) and Field-weighted Factorization Machine (FwFM) are state-of-the-art among the shallow models for CTR prediction. Recently, many deep learning-based models have also been proposed. Among deeper models, DeepFM, xDeepFM, AutoInt+, and FiBiNet are state-of-the-art models. The deeper models combine a core architectural component, which learns explicit feature interactions, with a deep neural network (DNN) component. We propose a novel shallow Field-Embedded Factorization Machine (FEFM) and its deep counterpart Deep Field-Embedded Factorization Machine (DeepFEFM). FEFM learns symmetric matrix embeddings for each field pair along with the usual single vector embeddings for each feature. FEFM has significantly lower model complexity than FFM and roughly the same complexity as FwFM. FEFM also has insightful mathematical properties about important fields and field interactions. DeepFEFM combines the FEFM interaction vectors learned by the FEFM component with a DNN and is thus able to learn higher order interactions. We conducted comprehensive experiments over a wide range of hyperparameters on two large publicly available real-world datasets. When comparing test AUC and log loss, the results show that FEFM and DeepFEFM outperform the existing state-of-the-art shallow and deep models for CTR prediction tasks. We have made the code of FEFM and DeepFEFM available in the DeepCTR library (https://github.com/shenweichen/DeepCTR).


title: Supervised Learning with Projected Entangled Pair States

abstract: Tensor networks, a model that originated from quantum physics, has been gradually generalized as efficient models in machine learning in recent years. However, in order to achieve exact contraction, only tree-like tensor networks such as the matrix product states and tree tensor networks have been considered, even for modeling two-dimensional data such as images. In this work, we construct supervised learning models for images using the projected entangled pair states (PEPS), a two-dimensional tensor network having a similar structure prior to natural images. Our approach first performs a feature map, which transforms the image data to a product state on a grid, then contracts the product state to a PEPS with trainable parameters to predict image labels. The tensor elements of PEPS are trained by minimizing differences between training labels and predicted labels. The proposed model is evaluated on image classifications using the MNIST and the Fashion-MNIST datasets. We show that our model is significantly superior to existing models using tree-like tensor networks. Moreover, using the same input features, our method performs as well as the multilayer perceptron classifier, but with much fewer parameters and is more stable. Our results shed light on potential applications of two-dimensional tensor network models in machine learning.

categories: cs.CV cond-mat.str-el cs.LG quant-ph stat.ML


title: PESAO: Psychophysical Experimental Setup for Active Observers

abstract: Most past and present research in computer vision involves passively observed data. Humans, however, are active observers outside the lab; they explore, search, select what and how to look. Nonetheless, how exactly active observation occurs in humans so that it can inform the design of active computer vision systems is an open problem. PESAO is designed for investigating active, visual observation in a 3D world. The goal was to build an experimental setup for various active perception tasks with human subjects (active observers) in mind that is capable of tracking the head and gaze. While many studies explore human performances, usually, they use line drawings portrayed in 2D, and no active observer is involved. PESAO allows us to bring many studies to the three-dimensional world, even involving active observers. In our instantiation, it spans an area of 400cm x 300cm and can track active observers at a frequency of 120Hz. Furthermore, PESAO provides tracking and recording of 6D head motion, gaze, eye movement-type, first-person video, head-mounted IMU sensor, birds-eye video, and experimenter notes. All are synchronized at microsecond resolution.


title: Monocular Depth Estimation Using Multi Scale Neural Network And Feature Fusion

abstract: Depth estimation from monocular images is a challenging problem in computer vision. In this paper, we tackle this problem using a novel network architecture using multi scale feature fusion. Our network uses two different blocks, first which uses different filter sizes for convolution and merges all the individual feature maps. The second block uses dilated convolutions in place of fully connected layers thus reducing computations and increasing the receptive field. We present a new loss function for training the network which uses a depth regression term, SSIM loss term and a multinomial logistic loss term combined. We train and test our network on Make 3D dataset, NYU Depth V2 dataset and Kitti dataset using standard evaluation metrics for depth estimation comprised of RMSE loss and SILog loss. Our network outperforms previous state of the art methods with lesser parameters.


title: Listener Modeling and Context-aware Music Recommendation Based on Country Archetypes

abstract: Music preferences are strongly shaped by the cultural and socio-economic background of the listener, which is reflected, to a considerable extent, in country-specific music listening profiles. Previous work has already identified several country-specific differences in the popularity distribution of music artists listened to. In particular, what constitutes the "music mainstream" strongly varies between countries. To complement and extend these results, the article at hand delivers the following major contributions: First, using state-of-the-art unsupervised learning techniques, we identify and thoroughly investigate (1) country profiles of music preferences on the fine-grained level of music tracks (in contrast to earlier work that relied on music preferences on the artist level) and (2) country archetypes that subsume countries sharing similar patterns of listening preferences. Second, we formulate four user models that leverage the user's country information on music preferences. Among others, we propose a user modeling approach to describe a music listener as a vector of similarities over the identified country clusters or archetypes. Third, we propose a context-aware music recommendation system that leverages implicit user feedback, where context is defined via the four user models. More precisely, it is a multi-layer generative model based on a variational autoencoder, in which contextual features can influence recommendations through a gating mechanism. Fourth, we thoroughly evaluate the proposed recommendation system and user models on a real-world corpus of more than one billion listening records of users around the world (out of which we use 369 million in our experiments) and show its merits vis-a-vis state-of-the-art algorithms that do not exploit this type of context information.


title: Prune Responsibly

abstract: Irrespective of the specific definition of fairness in a machine learning application, pruning the underlying model affects it. We investigate and document the emergence and exacerbation of undesirable per-class performance imbalances, across tasks and architectures, for almost one million categories considered across over 100K image classification models that undergo a pruning process.We demonstrate the need for transparent reporting, inclusive of bias, fairness, and inclusion metrics, in real-life engineering decision-making around neural network pruning. In response to the calls for quantitative evaluation of AI models to be population-aware, we present neural network pruning as a tangible application domain where the ways in which accuracy-efficiency trade-offs disproportionately affect underrepresented or outlier groups have historically been overlooked. We provide a simple, Pareto-based framework to insert fairness considerations into value-based operating point selection processes, and to re-evaluate pruning technique choices.


title: Applying a random projection algorithm to optimize machine learning model for breast lesion classification

abstract: Machine learning is widely used in developing computer-aided diagnosis (CAD) schemes of medical images. However, CAD usually computes large number of image features from the targeted regions, which creates a challenge of how to identify a small and optimal feature vector to build robust machine learning models. In this study, we investigate feasibility of applying a random projection algorithm to build an optimal feature vector from the initially CAD-generated large feature pool and improve performance of machine learning model. We assemble a retrospective dataset involving 1,487 cases of mammograms in which 644 cases have confirmed malignant mass lesions and 843 have benign lesions. A CAD scheme is first applied to segment mass regions and initially compute 181 features. Then, support vector machine (SVM) models embedded with several feature dimensionality reduction methods are built to predict likelihood of lesions being malignant. All SVM models are trained and tested using a leave-one-case-out cross-validation method. SVM generates a likelihood score of each segmented mass region depicting on one-view mammogram. By fusion of two scores of the same mass depicting on two-view mammograms, a case-based likelihood score is also evaluated. Comparing with the principle component analyses, nonnegative matrix factorization, and Chi-squared methods, SVM embedded with the random projection algorithm yielded a significantly higher case-based lesion classification performance with the area under ROC curve of 0.84+0.01 (p<0.02). The study demonstrates that the random project algorithm is a promising method to generate optimal feature vectors to help improve performance of machine learning models of medical images.


title: Is Each Layer Non-trivial in CNN?

abstract: Convolutional neural network (CNN) models have achieved great success in many fields. With the advent of ResNet, networks used in practice are getting deeper and wider. However, is each layer non-trivial in networks? To answer this question, we trained a network on the training set, then we replace the network convolution kernels with zeros and test the result models on the test set. We compared experimental results with baseline and showed that we can reach similar or even the same performances. Although convolution kernels are the cores of networks, we demonstrate that some of them are trivial and regular in ResNet.


title: Automatic Target Recognition (ATR) from SAR Imaginary by Using Machine Learning Techniques

abstract: Automatic Target Recognition (ATR) in Synthetic aperture radar (SAR) images becomes a very challenging problem owing to containing high level noise. In this study, a machine learning-based method is proposed to detect different moving and stationary targets using SAR images. First Order Statistical (FOS) features were obtained from Fast Fourier Transform (FFT), Discrete Cosine Transform (DCT) and Discrete Wavelet Transform (DWT) on gray level SAR images. Gray Level Co-occurrence Matrix (GLCM), Gray Level Run Length Matrix (GLRLM) and Gray Level Size Zone Matrix (GLSZM) algorithms are also used. These features are provided as input for the training and testing stage Support Vector Machine (SVM) model with Gaussian kernels. 4-fold cross-validations were implemented in performance evaluation. Obtained results showed that GLCM + SVM algorithm is the best model with 95.26% accuracy. This proposed method shows that moving and stationary targets in MSTAR database could be recognized with high performance.


title: CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics

abstract: Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with limited computational resources, e.g., mobile/embedded devices. The emerging topic of model pruning strives to address this problem by removing less important neurons and fine-tuning the pruned networks to minimize the accuracy loss. Nevertheless, existing automated pruning solutions often rely on a numerical threshold of the pruning criteria, lacking the flexibility to optimally balance the trade-off between model size and accuracy. Moreover, the complicated interplay between the stages of neuron pruning and model fine-tuning makes this process opaque, and therefore becomes difficult to optimize. In this paper, we address these challenges through a visual analytics approach, named CNNPruner. It considers the importance of convolutional filters through both instability and sensitivity, and allows users to interactively create pruning plans according to a desired goal on model size or accuracy. Also, CNNPruner integrates state-of-the-art filter visualization techniques to help users understand the roles that different filters played and refine their pruning plans. Through comprehensive case studies on CNNs with real-world sizes, we validate the effectiveness of CNNPruner.


title: PP-OCR: A Practical Ultra Lightweight OCR System

abstract: The Optical Character Recognition (OCR) systems have been widely used in various of application scenarios, such as office automation (OA) systems, factory automations, online educations, map productions etc. However, OCR is still a challenging task due to the various of text appearances and the demand of computational efficiency. In this paper, we propose a practical ultra lightweight OCR system, i.e., PP-OCR. The overall model size of the PP-OCR is only 3.5M for recognizing 6622 Chinese characters and 2.8M for recognizing 63 alphanumeric symbols, respectively. We introduce a bag of strategies to either enhance the model ability or reduce the model size. The corresponding ablation experiments with the real data are also provided. Meanwhile, several pre-trained models for the Chinese and English recognition are released, including a text detector (97K images are used), a direction classifier (600K images are used) as well as a text recognizer (17.9M images are used). Besides, the proposed PP-OCR are also verified in several other language recognition tasks, including French, Korean, Japanese and German. All of the above mentioned models are open-sourced and the codes are available in the GitHub repository, i.e., https://github.com/PaddlePaddle/PaddleOCR.


title: CMAX++ : Leveraging Experience in Planning and Execution using Inaccurate Models

abstract: Given access to accurate dynamical models, modern planning approaches are effective in computing feasible and optimal plans for repetitive robotic tasks. However, it is difficult to model the true dynamics of the real world before execution, especially for tasks requiring interactions with objects whose parameters are unknown. A recent planning approach, CMAX, tackles this problem by adapting the planner online during execution to bias the resulting plans away from inaccurately modeled regions. CMAX, while being provably guaranteed to reach the goal, requires strong assumptions on the accuracy of the model used for planning and fails to improve the quality of the solution over repetitions of the same task. In this paper we propose CMAX++, an approach that leverages real-world experience to improve the quality of resulting plans over successive repetitions of a robotic task. CMAX++ achieves this by integrating model-free learning using acquired experience with model-based planning using the potentially inaccurate model. We provide provable guarantees on the completeness and asymptotic convergence of CMAX++ to the optimal path cost as the number of repetitions increases. CMAX++ is also shown to outperform baselines in simulated robotic tasks including 3D mobile robot navigation where the track friction is incorrectly modeled, and a 7D pick-and-place task where the mass of the object is unknown leading to discrepancy between true and modeled dynamics.


title: NeuroDiff: Scalable Differential Verification of Neural Networks using Fine-Grained Approximation

abstract: As neural networks make their way into safety-critical systems, where misbehavior can lead to catastrophes, there is a growing interest in certifying the equivalence of two structurally similar neural networks. For example, compression techniques are often used in practice for deploying trained neural networks on computationally- and energy-constrained devices, which raises the question of how faithfully the compressed network mimics the original network. Unfortunately, existing methods either focus on verifying a single network or rely on loose approximations to prove the equivalence of two networks. Due to overly conservative approximation, differential verification lacks scalability in terms of both accuracy and computational cost. To overcome these problems, we propose NeuroDiff, a symbolic and fine-grained approximation technique that drastically increases the accuracy of differential verification while achieving many orders-of-magnitude speedup. NeuroDiff has two key contributions. The first one is new convex approximations that more accurately bound the difference neurons of two networks under all possible inputs. The second one is judicious use of symbolic variables to represent neurons whose difference bounds have accumulated significant error. We also find that these two techniques are complementary, i.e., when combined, the benefit is greater than the sum of their individual benefits. We have evaluated NeuroDiff on a variety of differential verification tasks. Our results show that NeuroDiff is up to 1000X faster and 5X more accurate than the state-of-the-art tool.


title: Deep learning regression for inverse quantum scattering

abstract: In this work we study the inverse quantum scattering via deep learning regression, which is implemented via a Multilayer Perceptron. A step-by-step method is provided in order to obtain the potential parameters. A circular boundary-wall potential was chosen to exemplify the method. Detailed discussion about the training is provided. A investigation with noisy data is presented and it is observed that the neural network is useful to predict the potential parameters.


title: Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issue

abstract: Recommendation is a prevalent and critical service in information systems. To provide personalized suggestions to users, industry players embrace machine learning, more specifically, building predictive models based on the click behavior data. This is known as the Click-Through Rate (CTR) prediction, which has become the gold standard for building personalized recommendation service. However, we argue that there is a significant gap between clicks and user satisfaction -- it is common that a user is "cheated" to click an item by the attractive title/cover of the item. This will severely hurt user's trust on the system if the user finds the actual content of the clicked item disappointing. What's even worse, optimizing CTR models on such flawed data will result in the Matthew Effect, making the seemingly attractive but actually low-quality items be more frequently recommended. In this paper, we formulate the recommendation models as a causal graph that reflects the cause-effect factors in recommendation, and address the clickbait issue by performing counterfactual inference on the causal graph. We imagine a counterfactual world where each item has only exposure features (i.e., the features that the user can see before making a click decision). By estimating the click likelihood of a user in the counterfactual world, we are able to reduce the direct effect of exposure features and eliminate the clickbait issue. Experiments on real-world datasets demonstrate that our method significantly improves the post-click satisfaction of CTR models.


title: Optimal Targeting in Super-Modular Games

abstract: We study an optimal targeting problem for super-modular games with binary actions and finitely many players. The considered problem consists in the selection of a subset of players of minimum size such that, when the actions of these players are forced to a controlled value while the others are left to repeatedly play a best response action, the system will converge to the greatest Nash equilibrium of the game. Our main contributions consist in showing that the problem is NP-complete and in proposing an efficient iterative algorithm with provable convergence properties for its solution. We discuss in detail the special case of network coordination games and its relation with the notion of cohesiveness. Finally, we show with simulations the strength of our approach with respect to naive heuristics based on classical network centrality measures.


title: From a Bounce to the Dark Energy Era with $F(R)$ Gravity

abstract: In this work we consider a cosmological scenario in which the Universe contracts initially having a bouncing-like behavior, and accordingly after it bounces off, it decelerates following a matter dominated like evolution and at very large positive times it undergoes through an accelerating stage. Our aim is to study such evolution in the context of $F(R)$ gravity theory, and confront quantitatively the model with the recent observations. Using several reconstruction techniques, we analytically obtain the form of $F(R)$ gravity in two extreme stages of the universe, particularly near the bounce and at the late time era respectively. With such analytic results and in addition by employing appropriate boundary conditions, we numerically solve the $F(R)$ gravitational equation to determine the form of the $F(R)$ for a wide range of values of the cosmic time. The numerically solved $F(R)$ gravity realizes an unification of certain cosmological epochs of the universe, in particular, from a non-singular bounce to a matter dominated epoch and from the matter dominated to a late time dark energy epoch. Correspondingly, the Hubble parameter and the effective equation of state parameter of the Universe are found and several qualitative features of the model are discussed. The Hubble radius goes to zero asymptotically in both sides of the bounce, which leads to the generation of the primordial curvature perturbation modes near the bouncing point. Correspondingly, we calculate the scalar and tensor perturbations power spectra near the bouncing point, and accordingly we determine the observable quantities like the spectral index of the scalar curvature perturbations, the tensor-to-scalar ratio, and as a result, we directly confront the present model with the latest Planck observations. Furthermore the $F(R)$ gravity dark energy epoch is confronted with the Sne-Ia+BAO+H(z)+CMB data.


title: New high-frequency radio observations of the Cygnus Loop supernova remnant with the Italian radio telescopes

abstract: Supernova remnants (SNRs) represent a powerful laboratory to study the Cosmic-Ray acceleration processes at the shocks, and their relation to the properties of the circumstellar medium. With the aim of studying the high-frequency radio emission and investigating the energy distribution of accelerated electrons and the magnetic field conditions, we performed single-dish observations of the large and complex Cygnus Loop SNR from 7.0 to 24.8 GHz with the Medicina and the Sardinia Radio Telescope, focusing on the northern filament (NGC 6992) and the southern shell. Both regions show a spectrum well fitted by a power-law function ($S\propto\nu^{-\alpha}$), with spectral index $\alpha=0.45\pm0.05$ for NGC 6992 and $\alpha=0.49\pm0.01$ for the southern shell and without any indication of a spectral break. The spectra are significantly flatter than the whole Cygnus Loop spectrum ($\alpha=0.54\pm0.01$), suggesting a departure from the plain shock acceleration mechanisms, which for NGC 6992 could be related to the ongoing transition towards a radiative shock. We model the integrated spectrum of the whole SNR considering the evolution of the maximum energy and magnetic field amplification. Through the radio spectral parameters, we infer a magnetic field at the shock of 10 $\mu$G. This value is compatible with a pure adiabatic compression of the interstellar magnetic field, suggesting that the amplification process is currently inefficient.


title: The principle of least action in the space of K\"ahler potentials

abstract: Given a compact K\"ahler manifold, the space $\mathcal H$ of its (relative) K\"ahler potentials is an infinite dimensional Fr\'echet manifold, on which Mabuchi and Semmes have introduced a natural connection $\nabla$. We study certain Lagrangians on $T\mathcal H$, in particular Finsler metrics, that are parallel with respect to the connection. We show that geodesics of $\nabla$ are paths of least action; under suitable conditions the converse also holds; and prove a certain convexity property of the least action. This generalizes earlier results of Calabi, Chen, and Darvas.


title: Coupling between COVID-19 and seasonal influenza leads to synchronization of their dynamics

abstract: Interactions between COVID-19 and other pathogens may change their dynamics. Specifically, this may hinder the modelling of empirical data when the symptoms of both infections are hard to distinguish. We introduce a model coupling the dynamics of COVID-19 and seasonal influenza, simulating cooperation, competition and asymmetric interactions. We find that the coupling synchronizes both infections, with a strong influence on the dynamics of influenza, reducing its time extent to a half.


title: Calabi-Yau threefolds over finite fields and torsion in cohomologies

abstract: We study various examples of Calabi-Yau threefolds over finite fields. In particular, we provide a counterexample to a conjecture of K. Joshi on lifting Calabi-Yau threefolds to characteristic zero. We also compute the p-adic cohomologies of some Calabi-Yau threefolds constructed by Cynk-van Straten which have remarkable arithmetic properties, as well as those of the Hirokado threefold. These examples and computations answer some outstanding questions of B. Bhatt, T. Ekedahl, van der Geer-Katsura and Patakfalvi-Zdanowicz, and shed new light on the Beauville-Bogomolov decomposition in positive characteristic. Our tools include p-adic Hodge theory as well as classical algebraic topology. We also give potential examples showing that Hodge numbers of threefolds in positive characteristic are not derived invariants, contrary to the case of characteristic zero.


title: Charmenability of arithmetic groups of product type

abstract: We discuss special properties of the spaces of characters and positive definite functions, as well as their associated dynamics, for arithmetic groups of product type. Axiomatizing these properties, we define the notions of charmenability and charfiniteness and study their applications to the topological dynamics, ergodic theory and unitary representation theory of the given groups. To do that, we study singularity properties of equivariant normal ucp maps between certain von Neumann algebras. We apply our discussion also to groups acting on product of trees.


title: A Predictive Interference Management Algorithm for URLLC in Beyond 5G Networks

abstract: Interference mitigation is a major design challenge in wireless systems,especially in the context of ultra-reliable low-latency communication (URLLC) services. Conventional average-based interference management schemes are not suitable for URLLC as they do not accurately capture the tail information of the interference distribution. This letter proposes a novel interference prediction algorithm that considers the entire interference distribution instead of only the mean. The key idea is to model the interference variation as a discrete state space discrete-time Markov chain. The state transition probability matrix is then used to estimate the state evolution in time, and allocate radio resources accordingly. The proposed scheme is found to meet the target reliability requirements in a low-latency single-shot transmission system considering realistic system assumptions, while requiring only ~25% more resources than the optimum case with perfect interference knowledge.


title: Origin of Weak MgII and Higher Ionization Absorption Lines in an Outflow from an Intermediate-Redshift Dwarf Satellite Galaxy

abstract: Observations at intermediate redshifts reveal the presence of numerous, compact, weak MgII absorbers with near to super-solar metallicities, often surrounded by more extended regions that produce CIV and/or OVI absorption in the circumgalactic medium at large impact parameters from luminous galaxies. Their origin and nature remains unclear. We hypothesize that undetected, satellite dwarf galaxies are responsible for producing some of these weak MgII absorbers. We test our hypothesis using gas dynamical simulations of galactic outflows from a dwarf satellite galaxy with a halo mass of $5\times10^{9}$ M$_{\odot}$, which could form in a larger $L^{*}$ halo at z=2, to study the gas interaction in the halo. We find that thin, filamentary, weak MgII absorbers are produced in two stages: 1) when shocked core collapse supernova (SNII) enriched gas descending in a galactic fountain gets shock compressed by upward flows driven by subsequent SNIIs and cools (phase 1), and later, 2) during an outflow driven by Type Ia supernovae that shocks and sweeps up pervasive SNII enriched gas, which then cools (phase 2). The width of the filaments and fragments are $\lesssim~100$ pc, and the smallest ones cannot be resolved at 12.8 pc resolution. The MgII absorbers in our simulations are continuously generated for >150 Myr by shocks and cooling, though each cloud survives for only ~60 Myr. Their metallicity is 10-20% solar metallicity and column density is $<10^{12}$ cm$^{-2}$. They are also surrounded by larger (0.5-1 kpc) CIV absorbers that seem to survive longer. In addition, larger-scale (>1 kpc) CIV and OVI clouds are produced in both expanding and shocked SNII enriched gas which is photoionized by the UV metagalactic radiation at intermediate redshift. Our simulation highlights the possibility of dwarf galactic outflows producing highly enriched multiphase gas.


title: Length-Bounded Paths Interdiction in Continuous Domain for Network Performance Assessment

abstract: Studying on networked systems, in which a communication between nodes is functional if their distance under a given metric is lower than a pre-defined threshold, has received significant attention recently. In this work, we propose a metric to measure network resilience on guaranteeing the pre-defined performance constraint. This metric is investigated under an optimization problem, namely \textbf{Length-bounded Paths Interdiction in Continuous Domain} (cLPI), which aims to identify a minimum set of nodes whose changes cause routing paths between nodes become undesirable for the network service. We show the problem is NP-hard and propose a framework by designing two oracles, \textit{Threshold Blocking} (TB) and \textit{Critical Path Listing} (CPL), which communicate back and forth to construct a feasible solution to cLPI with theoretical bicriteria approximation guarantees. Based on this framework, we propose two solutions for each oracle. Each combination of one solution to \tb and one solution to \cpl gives us a solution to cLPI. The bicriteria guarantee of our algorithms allows us to control the solutions's trade-off between the returned size and the performance accuracy. New insights into the advantages of each solution are further discussed via experimental analysis.


title: The Effect of Interacting Dark Energy on Mass-Temperature Relation in Galaxy Clusters

abstract: There are a variety of cosmological models for dark matter and dark energy in which a possible interaction is considered between these two significant components of the universe. We focus on five suggested models of interacting dark matter and dark energy and derive the modified virial theorem for them by developing a previous approach. It provides an opportunity to study the evolution of this modified virial theorem with time and interacting constants for different interacting models. Then we use this obtained virial condition to investigate the modified mass-temperature relation in galaxy clusters via three various methods. It reveals that the effect of interaction between dark matter and dark energy merely appears in the normalization factor of $M\propto T^{\frac{3}{2}}$. This relation also leads to a new constraint on the constants of interacting models, which only depends on the concentration parameter and density profile of the cluster. Then we use five observational data sets to check some proposed figures for the constants of interaction which have been resulted from other observational constraints. Finally, by fitting the observational results to the modified mass-temperature relation, we obtain values for interacting constants of three models and four specific cases of the two remained models. In agreement with many other observational outcomes, we find that according to observational data for masses and temperatures of the galaxy clusters, energy transfer occurs from dark matter to dark energy in the seven investigated models.


title: SPChain: Blockchain-based Medical Data Sharing and Privacy-preserving eHealth System

abstract: The development of eHealth systems has brought great convenience to people's life. Researchers have been combining new technologies to make eHealth systems work better for patients. The Blockchain-based eHealth system becomes popular because of its unique distributed tamper-resistant and privacy-preserving features. However, due to the security issues of the blockchain system, there are many security risks in eHealth systems utilizing the blockchain technology. i.e. 51% attacks can destroy blockchain-based systems. Besides, trivial transactions and frequent calls of smart contracts in the blockchain system bring additional costs and security risks to blockchain-based eHealth systems. Worse still, electronic medical records (EMRs) are controlled by medical institutions rather than patients, which causes privacy leakage issues. In this paper, we propose a medical data Sharing and Privacy-preserving eHealth system based on blockChain technology (SPChain). We combine RepuCoin with the SNARKs-based chameleon hash function to resist underlying blockchain attacks, and design a new chain structure to make microblocks contribute to the weight of blockchain. The system allows patients to share their EMRs among different medical institutions in a privacy-preserving way. Besides, authorized medical institutions can label wrong EMRs with the patients' permissions in the case of misdiagnosis. Security analysis and performance evaluation demonstrate that the proposed system can provide a strong security guarantee with a high efficiency.


title: Embedding theorems for solvable groups

abstract: In this paper, we prove a series of results on group embeddings in groups with a small number of generators. We show that each finitely generated group $G$ lying in a variety ${\mathcal M}$ can be embedded in a $4$-generated group $H \in {\mathcal M}{\mathcal A}$ (${\mathcal A}$ means the variety of abelian groups). If $G$ is a finite group, then $H$ can also be found as a finite group. It follows, that any finitely generated (finite) solvable group $G$ of the derived length $l$ can be embedded in a $4$-generated (finite) solvable group $H$ of length $l+1$. Thus, we answer the question of V. H. Mikaelian and A.Yu. Olshanskii. It is also shown that any countable group $G\in {\mathcal M}$, such that the abelianization $G_{ab}$ is a free abelian group, is embeddable in a $2$-generated group $H\in {\mathcal M}{\mathcal A}$.


title: Domain-Embeddings Based DGA Detection with Incremental Training Method

abstract: DGA-based botnet, which uses Domain Generation Algorithms (DGAs) to evade supervision, has become a part of the most destructive threats to network security. Over the past decades, a wealth of defense mechanisms focusing on domain features have emerged to address the problem. Nonetheless, DGA detection remains a daunting and challenging task due to the big data nature of Internet traffic and the potential fact that the linguistic features extracted only from the domain names are insufficient and the enemies could easily forge them to disturb detection. In this paper, we propose a novel DGA detection system which employs an incremental word-embeddings method to capture the interactions between end hosts and domains, characterize time-series patterns of DNS queries for each IP address and therefore explore temporal similarities between domains. We carefully modify the Word2Vec algorithm and leverage it to automatically learn dynamic and discriminative feature representations for over 1.9 million domains, and develop an simple classifier for distinguishing malicious domains from the benign. Given the ability to identify temporal patterns of domains and update models incrementally, the proposed scheme makes the progress towards adapting to the changing and evolving strategies of DGA domains. Our system is evaluated and compared with the state-of-art system FANCI and two deep-learning methods CNN and LSTM, with data from a large university's network named TUNET. The results suggest that our system outperforms the strong competitors by a large margin on multiple metrics and meanwhile achieves a remarkable speed-up on model updating.


title: Towards Fast, Accurate and Stable 3D Dense Face Alignment

abstract: Existing methods of 3D dense face alignment mainly concentrate on accuracy, thus limiting the scope of their practical applications. In this paper, we propose a novel regression framework named 3DDFA-V2 which makes a balance among speed, accuracy and stability. Firstly, on the basis of a lightweight backbone, we propose a meta-joint optimization strategy to dynamically regress a small set of 3DMM parameters, which greatly enhances speed and accuracy simultaneously. To further improve the stability on videos, we present a virtual synthesis method to transform one still image to a short-video which incorporates in-plane and out-of-plane face moving. On the premise of high accuracy and stability, 3DDFA-V2 runs at over 50fps on a single CPU core and outperforms other state-of-the-art heavy models simultaneously. Experiments on several challenging datasets validate the efficiency of our method. Pre-trained models and code are available at https://github.com/cleardusk/3DDFA_V2.


title: Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal Inference

abstract: Causal inference studies using textual social media data can provide actionable insights on human behavior. Making accurate causal inferences with text requires controlling for confounding which could otherwise impart bias. Recently, many different methods for adjusting for confounders have been proposed, and we show that these existing methods disagree with one another on two datasets inspired by previous social media studies. Evaluating causal methods is challenging, as ground truth counterfactuals are almost never available. Presently, no empirical evaluation framework for causal methods using text exists, and as such, practitioners must select their methods without guidance. We contribute the first such framework, which consists of five tasks drawn from real world studies. Our framework enables the evaluation of any casual inference method using text. Across 648 experiments and two datasets, we evaluate every commonly used causal inference method and identify their strengths and weaknesses to inform social media researchers seeking to use such methods, and guide future improvements. We make all tasks, data, and models public to inform applications and encourage additional research.


title: Using HCO$^+$ isotopologues as tracers of gas depletion in protoplanetary disk gaps

abstract: The widespread rings and gaps seen in the dust continuum in protoplanetary disks are sometimes accompanied by similar substructures seen in molecular line emission. One example is the outer gap at 100 au in AS 209, which shows that the H$_{13}$CO$^+$ and C$_{18}$O emission intensities decrease along with the continuum in the gap, while the DCO$^+$ emission increases inside the gap. We aim to study the behavior of DCO$^+$/H$_{13}$CO$^+$ and DCO$^+$/HCO$^+$ ratios in protoplanetary disk gaps assuming the two scenarios: the gas depletion follows the dust depletion and only the dust is depleted. We first modeled the physical disk structure using the thermo-chemical model ANDES. This 1+1D steady-state disk model calculates the thermal balance of gas and dust and includes the FUV, X-rays, cosmic rays, and other ionization sources together with the reduced chemical network for molecular coolants. Afterward, this physical structure was adopted for calculations of molecular abundances with the extended gas-grain chemical network with deuterium fractionation. Ideal synthetic spectra and 0th-moment maps were produced with LIME. We are able to qualitatively reproduce the increase in the DCO$^+$ intensity and the decrease in the H$_{13}$CO$^+$ and C$_{18}$O intensities inside the disk gap, which is qualitatively similar to what is observed in the outer AS 209 gap. The corresponding disk model assumes that both the gas and dust are depleted in the gap. The model with the gas-rich gap, where only the dust is depleted, produces emission that is too bright in all HCO$^+$ isotopologues and C$_{18}$O. The DCO$^+$/H$_{13}$CO$^+$ line ratio can be used to probe gas depletion in dust continuum gaps outside of the CO snow line. The DCO$^+$/C$_{18}$O line ratio shows a similar, albeit weaker, effect; however, these species can be observed simultaneously with a single ALMA or NOEMA setup.


title: Selection of strain and fitting schemes for calculating higher-order elastic constants

abstract: Criteria of selecting strain and fitting schemes are proposed for the calculation of higher-order elastic constants more efficiently, robustly and accurately. As demonstrated by the third-order elastic constants (TOECs) of diamond, the proposed method is 3-5 times faster than existing methods, and the range of strain for getting correct TOECs is expanded. In addition, our result provides an evidence for the inaccuracy of some previous experiments caused by higher-order effect, and the difference among experiments and several different theoretical methods is resolved. Finally, we give the recommend TOECs values for diamond.


title: Intersection points of planar curves can be computed

abstract: Consider two paths $\phi,\psi:[0;1]\to [0;1]^2$ in the unit square such that $\phi(0)=(0,0)$, $\phi(1)=(1,1)$, $\psi(0)=(0,1)$ and $\psi(1)=(1,0)$. By continuity of $\phi$ and $\psi$ there is a point of intersection. We prove that from $\phi$ and $\psi$ we can compute closed intervals $S_\phi,S_\psi \subseteq [0;1]$ such that $\phi(S_\phi)=\psi(S_\psi)$.


title: Going back to basics: accelerating exoplanet transit modelling using Taylor-series expansion of the orbital motion

abstract: A significant fraction of an exoplanet transit model evaluation time is spent calculating projected distances between the planet and its host star. This is a relatively fast operation for a circular orbit, but slower for an eccentric one. However, because the planet's position and its time derivatives are constant for any specific point in orbital phase, the projected distance can be calculated rapidly and accurately in the vicinity of the transit by expanding the planet's $x$ and $y$ positions in the sky plane into a Taylor series at mid-transit. Calculating the projected distance for an elliptical orbit using the four first time derivatives of the position vector (velocity, acceleration, jerk, and snap) is $\sim100$ times faster than calculating it using the Newton's method, and also significantly faster than calculating $z$ for a circular orbit because the approach does not use numerically expensive trigonometric functions. The speed gain in the projected distance calculation leads to 2-25 times faster transit model evaluation speed, depending on the transit model complexity and orbital eccentricity. Calculation of the four position derivatives using numerical differentiation takes $\sim1\,\mu$s with a modern laptop and needs to be done only once for a given orbit, and the maximum error the approximation introduces to a transit light curve is below 1~ppm for the major part of the physically plausible orbital parameter space.


title: Geometric properties of a certain class of compact dynamical horizons in locally rotationally symmetric class II spacetimes

abstract: In this paper we study the geometry of a certain class of compact dynamical horizons with a time-dependent induced metric in locally rotationally symmetric class II spacetimes. We first obtain a compactness condition for embedded $3$-manifolds in these spacetimes, satisfying the weak energy condition, with non-negative isotropic pressure $p$. General conditions for a $3$-manifold to be a dynamical horizon are imposed, as well as certain genericity conditions, which in the case of locally rotationally symmetric class II spacetimes reduces to the statement that `the weak energy condition is strictly satisfied or otherwise violated'. The compactness condition is presented as a spatial first order partial differential equation in the sheet expansion $\phi$, in the form $\hat{\phi}+(3/4)\phi^2-cK=0$, where $K$ is the Gaussian curvature of $2$-surfaces in the spacetime and $c$ is a real number parametrizing the differential equation, where $c$ can take on only two values, $0$ and $2$. Using geometric arguments, it is shown that the case $c=2$ can be ruled out, and the $\mathbb{S}^3$ ($3$-dimensional sphere) geometry of compact dynamical horizons for the case $c=0$ is established. Finally, an invariant characterization of this class of compact dynamical horizons is also presented.


title: Massive MIMO Channel Prediction: Kalman Filtering vs. Machine Learning

abstract: This paper focuses on channel prediction techniques for massive multiple-input multiple-output (MIMO) systems. Previous channel predictors are based on theoretical channel models, which would be deviated from realistic channels. In this paper, we develop and compare a vector Kalman filter (VKF)-based channel predictor and a machine learning (ML)-based channel predictor using the realistic channels from the spatial channel model (SCM), which has been adopted in the 3GPP standard for years. First, we propose a low-complexity mobility estimator based on the spatial average using a large number of antennas in massive MIMO. The mobility estimate can be used to determine the complexity order of developed predictors. The VKF-based channel predictor developed in this paper exploits the autoregressive (AR) parameters estimated from the SCM channels based on the Yule-Walker equations. Then, the ML-based channel predictor using the linear minimum mean square error (LMMSE)-based noise pre-processed data is developed. Numerical results reveal that both channel predictors have substantial gain over the outdated channel in terms of the channel prediction accuracy and data rate. The ML-based predictor has larger overall computational complexity than the VKF-based predictor, but once trained, the operational complexity of ML-based predictor becomes smaller than that of VKF-based predictor.


title: Single-molecule FRET dynamics of molecular motors in an ABEL Trap

abstract: Single-molecule F\"orster resonance energy transfer (smFRET) of molecular motors provides transformative insights into their dynamics and conformational changes both at high temporal and spatial resolution simultaneously. However, a key challenge of such FRET investigations is to observe a molecule in action for long enough without restricting its natural function. The Anti-Brownian ELectrokinetic Trap (ABEL trap) sets out to combine smFRET with molecular confinement to enable observation times of up to several seconds while removing any requirement of tethered surface attachment of the molecule in question. In addition, the ABEL trap's inherent ability to selectively capture FRET active molecules accelerates the data acquisition process. Here we exemplify the capabilities of the ABEL trap in performing extended timescale smFRET measurements on the molecular motor Rep, which is crucial for removing protein blocks ahead of the advancing DNA replication machinery and for restarting stalled DNA replication. We are able to monitor single Rep molecules up to 6 s with 1 ms time resolution capturing multiple conformational switching events during the observation time. Here we provide a step-by-step guide for the rational design, construction and implementation of the ABEL trap for smFRET detection of Rep in vitro. We include details of how to model the electric potential at the trap site and use Hidden Markov analysis of the smFRET trajectories.


title: Species-theoretic foundations of perturbative quantum field theory

abstract: We develop an algebraic formalism for perturbative quantum field theory (pQFT) which is based on Joyal's combinatorial species. We show that certain basic structures of pQFT are correctly viewed as algebraic structures internal to species, constructed with respect to the Cauchy monoidal product. Aspects of this formalism have appeared in the physics literature, particularly in the work of Bogoliubov-Shirkov, Steinmann, Ruelle, and Epstein-Glaser-Stora. In this paper, we give a fully explicit account in terms of modern theory developed by Aguiar-Mahajan. We describe the central construction of causal perturbation theory as a homomorphism from the Hopf monoid of set compositions, decorated with local observables, into the Wick algebra of microcausal polynomial observables. The operator-valued distributions called (generalized) time-ordered products and (generalized) retarded products are obtained as images of fundamental elements of this Hopf monoid under the curried homomorphism. The perturbative S-matrix scheme corresponds to the so-called universal series, and the property of causal factorization is naturally expressed in terms of the action of the Hopf monoid on itself by Hopf powers, called the Tits product. Given a system of fully renormalized time-ordered products, the perturbative construction of the corresponding interacting products is via an up biderivation of the Hopf monoid, which recovers Bogoliubov's formula.


title: Globalization emergence in the European Patent Office (EPO) patent network

abstract: We studied the evolution of the European Patent Office (EPO) patents applicants' collaborations network, within a 35 years span of data (1978-2013). Focusing on the Giant Component (GC) formation process over many time-windows, distributed throughout the data timeline, we found that the features governing this phenomenon are indicative of emerging globalization in the applicants' collaborations. The timeline appears to be divided into three regimes, corresponding to three states of the network's evolution. In the early years state, the GC takes long to form and the instant of its creation is easily pinpointed, while it features geographically segregated groups of applicants with technologically similar activities. In contrast, in the late years state, the GC forms quickly, the exact point of its creation is harder to spot, the applicants' activities are more disparate technologically, while their inter-regional collaborations are significantly increased. The middle years are an intermediate state between the two extreme of early and late years. Moreover, we concluded that the critical patents, which induce the GC's formation, are typically introduced by large-sized applicants and also that top patent-producing applicants are likely to submit critical patents, albeit at a lower rate than their overall patent submission. Lastly, we uncovered the crucial role that Japan plays in the network's coherence, through its prominent participation in the GC and the critical patents.


title: (In)approximability of Maximum Minimal FVS

abstract: We study the approximability of the NP-complete \textsc{Maximum Minimal Feedback Vertex Set} problem. Informally, this natural problem seems to lie in an intermediate space between two more well-studied problems of this type: \textsc{Maximum Minimal Vertex Cover}, for which the best achievable approximation ratio is $\sqrt{n}$, and \textsc{Upper Dominating Set}, which does not admit any $n^{1-\epsilon}$ approximation. We confirm and quantify this intuition by showing the first non-trivial polynomial time approximation for \textsc{Max Min FVS} with a ratio of $O(n^{2/3})$, as well as a matching hardness of approximation bound of $n^{2/3-\epsilon}$, improving the previous known hardness of $n^{1/2-\epsilon}$. The approximation algorithm also gives a cubic kernel when parameterized by the solution size. Along the way, we also obtain an $O(\Delta)$-approximation and show that this is asymptotically best possible, and we improve the bound for which the problem is NP-hard from $\Delta\ge 9$ to $\Delta\ge 6$. Having settled the problem's approximability in polynomial time, we move to the context of super-polynomial time. We devise a generalization of our approximation algorithm which, for any desired approximation ratio $r$, produces an $r$-approximate solution in time $n^{O(n/r^{3/2})}$. This time-approximation trade-off is essentially tight: we show that under the ETH, for any ratio $r$ and $\epsilon>0$, no algorithm can $r$-approximate this problem in time $n^{O((n/r^{3/2})^{1-\epsilon})}$, hence we precisely characterize the approximability of the problem for the whole spectrum between polynomial and sub-exponential time, up to an arbitrarily small constant in the second exponent.


title: Line Flow based SLAM

abstract: We propose a visual SLAM method by predicting and updating line flows that represent sequential 2D projections of 3D line segments. While feature-based SLAM methods have achieved excellent results, they still face problems in challenging scenes containing occlusions, blurred images, and repetitive textures. To address these problems, we leverage a line flow to encode the coherence of line segment observations of the same 3D line along the temporal dimension, which has been neglected in prior SLAM systems. Thanks to this line flow representation, line segments in a new frame can be predicted according to their corresponding 3D lines and their predecessors along the temporal dimension. We create, update, merge, and discard line flows on-the-fly. We model the proposed line flow based SLAM (LF-SLAM) using a Bayesian network. Extensive experimental results demonstrate that the proposed LF-SLAM method achieves state-of-the-art results due to the utilization of line flows. Specifically, LF-SLAM obtains good localization and mapping results in challenging scenes with occlusions, blurred images, and repetitive textures.


title: Privacy and Uniqueness of Neighborhoods in Social Networks

abstract: The ability to share social network data at the level of individual connections is beneficial to science: not only for reproducing results, but also for researchers who may wish to use it for purposes not foreseen by the data releaser. Sharing such data, however, can lead to serious privacy issues, because individuals could be re-identified, not only based on possible nodes' attributes, but also from the structure of the network around them. The risk associated with re-identification can be measured and it is more serious in some networks than in others. Various optimization algorithms have been proposed to anonymize the network while keeping the number of changes minimal. However, existing algorithms do not provide guarantees on where the changes will be made, making it difficult to quantify their effect on various measures. Using network models and real data, we show that the average degree of networks is a crucial parameter for the severity of re-identification risk from nodes' neighborhoods. Dense networks are more at risk, and, apart from a small band of average degree values, either almost all nodes are re-identifiable or they are all safe. Our results allow researchers to assess the privacy risk based on a small number of network statistics which are available even before the data is collected. As a rule-of-thumb, the privacy risks are high if the average degree is above 10. Guided by these results we propose a simple method based on edge sampling to mitigate the re-identification risk of nodes. Our method can be implemented already at the data collection phase. Its effect on various network measures can be estimated and corrected using sampling theory. These properties are in contrast with previous methods arbitrarily biasing the data. In this sense, our work could help in sharing network data in a statistically tractable way.


title: A Particle Method for Solving Fredholm Equations of the First Kind

abstract: Fredholm integral equations of the first kind are the prototypical example of ill-posed linear inverse problems. They model, among other things, reconstruction of distorted noisy observations and indirect density estimation and also appear in instrumental variable regression. However, their numerical solution remains a challenging problem. Many techniques currently available require a preliminary discretization of the domain of the solution and make strong assumptions about its regularity. For example, the popular expectation maximization smoothing (EMS) scheme requires the assumption of piecewise constant solutions which is inappropriate for most applications. We propose here a novel particle method that circumvents these two issues. This algorithm can be thought of as a Monte Carlo approximation of the EMS scheme which not only performs an adaptive stochastic discretization of the domain but also results in smooth approximate solutions. We analyze the theoretical properties of the EMS iteration and of the corresponding particle algorithm. Compared to standard EMS, we show experimentally that our novel particle method provides state-of-the-art performance for realistic systems, including motion deblurring and reconstruction of cross-section images of the brain from positron emission tomography.


title: Grey-Box Learning of Register Automata

abstract: Model learning (a.k.a. active automata learning) is a highly effective technique for obtaining black-box finite state models of software components. Thus far, generalisation to infinite state systems with inputs/outputs that carry data parameters has been challenging. Existing model learning tools for infinite state systems face scalability problems and can only be applied to restricted classes of systems (register automata with equality/inequality). In this article, we show how we can boost the performance of model learning techniques by extracting the constraints on input and output parameters from a run, and making this grey-box information available to the learner. More specifically, we provide new implementations of the tree oracle and equivalence oracle from RALib, which use the derived constraints. We extract the constraints from runs of Python programs using an existing tainting library for Python, and compare our grey-box version of RALib with the existing black-box version on several benchmarks, including some data structures from Python's standard library. Our proof-of-principle implementation results in almost two orders of magnitude improvement in terms of numbers of inputs sent to the software system. Our approach, which can be generalised to richer model classes, also enables RALib to learn models that are out of reach of black-box techniques, such as combination locks.


title: Depth-Adapted CNN for RGB-D cameras

abstract: Conventional 2D Convolutional Neural Networks (CNN) extract features from an input image by applying linear filters. These filters compute the spatial coherence by weighting the photometric information on a fixed neighborhood without taking into account the geometric information. We tackle the problem of improving the classical RGB CNN methods by using the depth information provided by the RGB-D cameras. State-of-the-art approaches use depth as an additional channel or image (HHA) or pass from 2D CNN to 3D CNN. This paper proposes a novel and generic procedure to articulate both photometric and geometric information in CNN architecture. The depth data is represented as a 2D offset to adapt spatial sampling locations. The new model presented is invariant to scale and rotation around the X and the Y axis of the camera coordinate system. Moreover, when depth data is constant, our model is equivalent to a regular CNN. Experiments of benchmarks validate the effectiveness of our model.


title: Instabilities and transition in cooled-wall hypersonic boundary layers

abstract: Wall cooling has substantial effects on the development of instabilities and transition processes in hypersonic boundary layers (HBLs). A sequence of linear stability theory, two-dimensional and non-linear three-dimensional DNSs is used to analyze Mach~6 boundary layers, with wall temperatures ranging from near-adiabatic to highly cooled conditions, where the second-mode instability radiates energy. Fluid-thermodynamic analysis shows that this radiation comprises both acoustic as well as vortical waves. 2D simulations show that the conventional "trapped" nature of second-mode instability is ruptured. Although the energy efflux of both acoustic and vortical components increases with wall-cooling, the destabilization effect is much stronger and no significant abatement of pressure perturbations is realized. In the near-adiabatic HBL, the wavepacket remains trapped within the boundary layer and attenuates outside the region of linear instability. However, wavepackets in the cooled-wall HBLs amplify and display nonlinear distortion, and transition more rapidly. The structure of the wavepacket displays different behavior; moderately-cooled walls show bifurcation into a leading turbulent head region and a trailing harmonic region, while highly-cooled wall cases display lower convection speeds and significant wavepacket elongation, with intermittent spurts of turbulence in the wake of the head region. This elongation effect is associated with a weakening of the lateral jet mechanism due to the breakdown of spanwise coherent structures. In moderately cooled-walls, the spatially-localized wall loading is due to coherent structures in the leading turbulent head region. In highly-cooled walls, the elongated near-wall streaks in the wake region of the wavepacket result in more than twice as large levels of skin friction and heat transfer over a sustained period of time.


title: A Time Series Data Analysis of Indian Commercial Dynamism

abstract: In this report it is analyzed the focuses of the commercial dynamism of India, covering the fundamentals of growth rate, trade balance, coverage rate, openness rate, share of world indicators and then present each of them in detail.


title: Casimir and Casimir-Polder Forces in Graphene Systems: Quantum Field Theoretical Description and Thermodynamics

abstract: We review recent results on the low-temperature behaviors of the Casimir-Polder and Casimir free energy an entropy for a polarizable atom interacting with a graphene sheet and for two graphene sheets, respectively. These results are discussed in the wide context of problems arising in the Lifshitz theory of van der Waals and Casimir forces when it is applied to metallic and dielectric bodies. After a brief treatment of different approaches to theoretical description of the electromagnetic response of graphene, we concentrate on the derivation of response function in the framework of thermal quantum field theory in the Matsubara formulation using the polarization tensor in (2+1)-dimensional space-time. The asymptotic expressions for the Casimir-Polder and Casimir free energy and entropy at low temperature, obtained with the polarization tensor, are presented for a pristine graphene as well as for graphene sheets possessing some nonzero energy gap $\Delta$ and chemical potential $\mu$ under different relationships between the values of $\Delta$ and $\mu$. Along with reviewing the results obtained in the literature, we present some new findings concerning the case of zero gap and nonzero chemical potential. The conclusion is made that the Lifshitz theory of the Casimir and Casimir-Polder forces in graphene systems using the quantum field theoretical description of a pristine graphene, as well as real graphene sheets with $\Delta>2\mu$ or $\Delta<2\mu$, is consistent with the requirements of thermodynamics. The case of graphene with $\Delta=2\mu\neq 0$ leads to an entropic anomaly, but is argued to be physically unrealistic. The way to a resolution of thermodynamic problems in the Lifshitz theory based on the results obtained for graphene is discussed.


title: Two balls maximize the third Neumann eigenvalue in hyperbolic space

abstract: We show that the third eigenvalue of the Neumann Laplacian in hyperbolic space is maximal for the disjoint union of two geodesic balls, among domains of given volume. This extends a recent result by Bucur and Henrot in Euclidean space, while providing a new proof of a key step in their argument


title: DR2S : Deep Regression with Region Selection for Camera Quality Evaluation

abstract: In this work, we tackle the problem of estimating a camera capability to preserve fine texture details at a given lighting condition. Importantly, our texture preservation measurement should coincide with human perception. Consequently, we formulate our problem as a regression one and we introduce a deep convolutional network to estimate texture quality score. At training time, we use ground-truth quality scores provided by expert human annotators in order to obtain a subjective quality measure. In addition, we propose a region selection method to identify the image regions that are better suited at measuring perceptual quality. Finally, our experimental evaluation shows that our learning-based approach outperforms existing methods and that our region selection algorithm consistently improves the quality estimation.


title: The Hole Argument

abstract: This paper reviews the hole argument as an argument against spacetime substantivalism. After a careful presentation of the argument itself I review possible responses.


title: Physical Zero-Knowledge Proof for Ripple Effect

abstract: Ripple Effect is a logic puzzle where the player has to fill numbers into empty cells in a rectangular grid. The grid is divided into rooms, and each room must contain consecutive integers starting from 1 to its size. Also, if two cells in the same row or column contain the same number $x$, there must be a space of at least $x$ cells separating the two cells. In this paper, we develop a physical zero-knowledge proof for the Ripple Effect puzzle using a deck of cards, which allows a prover to convince a verifier that he/she knows a solution without revealing it. In particular, given a secret number $x$ and a list of numbers, our protocol can physically verify that $x$ does not appear among the first $x$ numbers in the list without revealing $x$ or any number in the list.


title: TRECVID 2019: An Evaluation Campaign to Benchmark Video Activity Detection, Video Captioning and Matching, and Video Search & Retrieval

abstract: The TREC Video Retrieval Evaluation (TRECVID) 2019 was a TREC-style video analysis and retrieval evaluation, the goal of which remains to promote progress in research and development of content-based exploitation and retrieval of information from digital video via open, metrics-based evaluation. Over the last nineteen years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID has been funded by NIST (National Institute of Standards and Technology) and other US government agencies. In addition, many organizations and individuals worldwide contribute significant time and effort. TRECVID 2019 represented a continuation of four tasks from TRECVID 2018. In total, 27 teams from various research organizations worldwide completed one or more of the following four tasks: 1. Ad-hoc Video Search (AVS) 2. Instance Search (INS) 3. Activities in Extended Video (ActEV) 4. Video to Text Description (VTT) This paper is an introduction to the evaluation framework, tasks, data, and measures used in the workshop.


title: Drag of a Heated Sphere at Low Reynolds Numbers in the Presence of Buoyancy

abstract: Fully resolved simulations are used to quantify the effects of heat transfer in the presence of buoyancy on the drag of a spatially fixed heated spherical particle at low Reynolds numbers ($Re$) in the range $10^{-3} \le Re \le 10$ in a variable property fluid. The amount of heat addition from the sphere encompasses both, the heating regime where the Boussinesq approximation holds and the regime where it breaks down. The particle is assumed to have a low Biot number which means that the particle is uniformly at the same temperature and has no internal temperature gradients. Scaling buoyancy with inertial and viscous forces yields two related non-dimensional quantities, called Buoyancy Induced Viscous Reynolds Number ($Re_{BV}$) and Buoyancy Induced Inertial Reynolds Number ($Re_{BI}$). For ideal gases, $Re_{BV}$ is analogous to the Grashof number ($Gr$). No assumptions are made on the magnitude of $Re_{BI}$ (or equivalently $Re_{BV}$). The effects of the orientation of gravity relative to the free-stream velocity are examined. Large deviations in the value of the drag coefficient are observed when the Froude number ($Fr$) decreases and/or the temperature of the sphere increases. Under appropriate constraints on $Re_{BI}$ and $Re$, the total drag on a heated sphere in a low $Re$ flow in the presence of buoyancy (mixed convection) is shown to be, within 10% error, the linear superposition of the drag computed in two canonical setups: one being the drag on a steadily moving heated sphere in the absence of buoyancy (forced convection) and the other being natural convection. However, the effect of temperature variation on the drag of a sphere in both, forced and natural convection, is significant.


title: Experimental Investigation of Proppant Flow and Transport Dynamics Through Fracture Intersections

abstract: This paper investigates proppant flow and transport in intersected fractures at angles typical for intersections of pre-existing and new hydraulic fractures. Proppant is small granular material, which is placed into hydraulic fractures during geothermal and hydrocarbon reservoir stimulation and props the fluid paths open during reservoir exploitation. This study uses plexiglas laboratory slot experiments enhanced with an advanced image analysis for identifying particle trajectories and quantifying slurry velocities. Although proppant flow and transport has been broadly studied, the effects of intersecting fracture angles have not, especially coupled with fluid viscosities, flow rates, and proppant volumetric concentration effects. This paper specifically investigates the role of intermediate fracture angles, which have been identified to occur most frequently when the new hydraulic fractures intercept the existing ones. Results show that proppant flow and transport behavior after the intersection is very sensitive to carrying fluid viscosity and flow rates alteration, while differentiating proppant volumetric concentrations have a limited effect. Fracture intersection angle itself has a clear effect on proppant flow velocities and proppant settlement; furthermore, it enhances the effects from fluid viscosity, fluid flow rates, and proppant volumetric concentrations.


title: Synthetic Control, Synthetic Interventions, and COVID-19 spread: Exploring the impact of lockdown measures and herd immunity

abstract: The synthetic control method is an empirical methodology forcausal inference using observational data. By observing thespread of COVID-19 throughout the world, we analyze the dataon the number of deaths and cases in different regions usingthe power of prediction, counterfactual analysis, and syntheticinterventions of the synthetic control and its extensions. Weobserve that the number of deaths and cases in different re-gions would have been much smaller had the lockdowns beenimposed earlier and had the re-openings been done later, es-pecially among indoor bars and restaurants. We also analyzethe speculated impact of herd immunity on the spread giventhe population of each region and show that lockdown policieshave a very strong impact on the spread regardless of the levelof prior infections. Our most up-to-date code, model, and data can be foundon github: https://github.com/niloofarbayat/COVID19-synthetic-control-analysis


title: Robust Outlier Arm Identification

abstract: We study the problem of Robust Outlier Arm Identification (ROAI), where the goal is to identify arms whose expected rewards deviate substantially from the majority, by adaptively sampling from their reward distributions. We compute the outlier threshold using the median and median absolute deviation of the expected rewards. This is a robust choice for the threshold compared to using the mean and standard deviation, since it can identify outlier arms even in the presence of extreme outlier values. Our setting is different from existing pure exploration problems where the threshold is pre-specified as a given value or rank. This is useful in applications where the goal is to identify the set of promising items but the cardinality of this set is unknown, such as finding promising drugs for a new disease or identifying items favored by a population. We propose two $\delta$-PAC algorithms for ROAI, which includes the first UCB-style algorithm for outlier detection, and derive upper bounds on their sample complexity. We also prove a matching, up to logarithmic factors, worst case lower bound for the problem, indicating that our upper bounds are generally unimprovable. Experimental results show that our algorithms are both robust and about $5$x sample efficient compared to state-of-the-art.


title: Impact of Vertex Addition on Italian Domination Number

abstract: An Italian dominating function (IDF), of a graph G is a function $ f: V(G) \rightarrow \{0,1,2\} $ satisfying the condition that for every $ v\in V(G) $ with $ f(v) = 0, \sum_{ u\in N(v)} f(u) \geq 2. $ The weight of an IDF on $G$ is the sum $ f(V)= \sum_{v\in V(G)}f(v) $ and Italian domination number, $ \gamma_I(G) $ is the minimum weight of an IDF. In this paper, we study the impact of corona operator and addition of twins on Italian domination number.


title: Super-teams or fair leagues? Parity policies by powerful regulators don't prevent capture

abstract: Much of modern society is founded on orchestrating institutions that produce social goods by fostering motivated teams, pitting them against each other, and distributing the fruits of the arms races that ensue. However, even when the "market maker" is willing and able to maintain parity between teams, it may fail to maintain a level playing field, as some teams acquire enough advantage within the system to gain influence over it and institutionalize their advantage. Using outcomes of over 60,000 games from four professional basketball leagues and more than 100 years' worth of seasons, we compute the evolving rate of transitivity violations (A>B, B>C, but C>A) to measure the ability of leagues to maintain parity between teams, and support the efficient generation and distribution of innovation. Comparing against a baseline of randomly permuted outcomes, we find that basketball has become less competitive over time, suggesting that teams diverge in performance, and reflecting a possible failure of market makers to tame their overpowered teams. Our results suggest that rich-get-richer dynamics are so pernicious that they can even emerge under the watch of a powerful administrator that is motivated to prevent them.


title: Modeling Text with Decision Forests using Categorical-Set Splits

abstract: Decision forest algorithms typically model data by learning a binary tree structure recursively where every node splits the feature space into two sub-regions, sending examples into the left or right branch as a result. In axis-aligned decision forests, the "decision" to route an input example is the result of the evaluation of a condition on a single dimension in the feature space. Such conditions are learned using efficient, often greedy algorithms that optimize a local loss function. For example, a node's condition may be a threshold function applied to a numerical feature, and its parameter may be learned by sweeping over the set of values available at that node and choosing a threshold that maximizes some measure of purity. Crucially, whether an algorithm exists to learn and evaluate conditions for a feature type determines whether a decision forest algorithm can model that feature type at all. For example, decision forests today cannot consume textual features directly -- such features must be transformed to summary statistics instead. In this work, we set out to bridge that gap. We define a condition that is specific to categorical-set features -- defined as an unordered set of categorical variables -- and present an algorithm to learn it, thereby equipping decision forests with the ability to directly model text, albeit without preserving sequential order. Our algorithm is efficient during training and the resulting conditions are fast to evaluate with our extension of the QuickScorer inference algorithm. Experiments on benchmark text classification datasets demonstrate the utility and effectiveness of our proposal.


title: On conjectures of Minkowski and Woods for $n=10$

abstract: Let $\mathbb{L}$ be a lattice in $n$-dimensional Euclidean space $\mathbb{R}^n$ reduced in the sense of Korkine and Zolotareff and having a basis of the form $~(A_1,0,0,\cdots$ $,0),$ ~$(a_{2,1},A_2,0,\cdots,0),\cdots,$ $(a_{n,1},a_{n,2},\cdots,a_{n,n-1},A_n)$. A famous conjecture of Woods in Geometry of Numbers asserts that if $A_1A_2\cdots A_n = 1$ and $A_i\leq A_1$ for each $i$ then any closed sphere in $\mathbb{R}^n$ of radius $\sqrt{n/4}$ contains a point of $\mathbb{L}.$ Together with a result of C. T. McMullen (2005), the truth of Woods' Conjecture for a fixed $n$, implies the long standing classical conjecture of Minkowski on product of $n$ non-homogeneous linear forms for that value of $n$. In an earlier paper `Proc. Indian Acad. Sci. (Math. Sci.) Vol. 126, 2016, 501-548' we proved Woods' Conjecture for $n=9$. In this paper, we prove Woods' Conjecture and hence Minkowski's Conjecture for $n=10$.


title: A Generic Methodology for the Statistically Uniform & Comparable Evaluation of Automated Trading Platform Components

abstract: Although machine learning approaches have been widely used in the field of finance, to very successful degrees, these approaches remain bespoke to specific investigations and opaque in terms of explainability, comparability, and reproducibility. The primary objective of this research was to shed light upon this field by providing a generic methodology that was investigation-agnostic and interpretable to a financial markets practitioner, thus enhancing their efficiency, reducing barriers to entry, and increasing the reproducibility of experiments. The proposed methodology is showcased on two automated trading platform components. Namely, price levels, a well-known trading pattern, and a novel 2-step feature extraction method. The methodology relies on hypothesis testing, which is widely applied in other social and scientific disciplines to effectively evaluate the concrete results beyond simple classification accuracy. The main hypothesis was formulated to evaluate whether the selected trading pattern is suitable for use in the machine learning setting. Across the experiments we found that the use of the considered trading pattern in the machine learning setting is only partially supported by statistics, resulting in insignificant effect sizes (Rebound 7 - $0.64 \pm 1.02$, Rebound 11 $0.38 \pm 0.98$, and rebound 15 - $1.05 \pm 1.16$), but allowed the rejection of the null hypothesis. We showcased the generic methodology on a US futures market instrument and provided evidence that with this methodology we could easily obtain informative metrics beyond the more traditional performance and profitability metrics. This work is one of the first in applying this rigorous statistically-backed approach to the field of financial markets and we hope this may be a springboard for more research.


title: Neural-Network Assisted Study of Nitrogen Atom Dynamics on Amorphous Solid Water. I. Adsorption & Desorption

abstract: Dynamics of adsorption and desorption of (4S)-N on amorphous solid water are analyzed using molecular dynamics simulations. The underlying potential energy surface was provided by machine-learned interatomic potentials. Binding energies confirm the latest available theoretical and experimental results. The nitrogen sticking coefficient is close to unity at dust temperatures of 10 K but decreases at higher temperatures. We estimate a desorption time scale of 1 {\mu}s at 28 K. The estimated time scale allows chemical processes mediated by diffusion to happen before desorption, even at higher temperatures. We found that the energy dissipation process after a sticking event happens on the picosecond timescale at dust temperatures of 10 K, even for high energies of the incoming adsorbate. Our approach allows the simulation of large systems for reasonable time scales at an affordable computational cost and ab-initio accuracy. Moreover, it is generally applicable for the study of adsorption dynamics of interstellar radicals on dust surfaces.


title: Cusps of hyperbolic 4-manifolds and rational homology spheres

abstract: In the present paper, we construct a cusped hyperbolic $4$-manifold with all cusp sections homeomorphic to the Hantzsche-Wendt manifold, which is a rational homology sphere. By a result of Gol\'enia and Moroianu, the Laplacian on $2$-forms on such a manifold has purely discrete spectrum. This shows that one of the main results of Mazzeo and Phillips from 1990 cannot hold without additional assumptions on the homology of the cusps. This also answers a question by Gol\'enia and Moroianu from 2012. We also correct and refine the incomplete classification of compact orientable flat $3$-manifolds arising from cube colourings provided earlier by the last two authors.


title: Topological Kondo Device for distinguishing Quasi-Majorana and Majorana signatures

abstract: To confirm the Majorana signatures, significant effort has been devoted to distinguishing between Majorana zero modes (MZMs) and spatially separated quasi-Majorana modes (QMMs). Because both MZMs and QMMs cause a quantized zero-bias peak in the conductance measurement, their verification task is thought to be very difficult. Here, we proposed a simple device with a single nanowire, where the device could develop clear evidence of the topological Kondo effect in the topologically trivial phase with four QMMs. On the other hand, in the topological superconducting phase with MZMs, the transport signatures are significantly different. Therefore, our scheme provides a simple way to distinguish Majorana and quasi-Majorana modes.


title: Sub-Kelvin Cooling for the BICEP Array Project

abstract: In the field of astrophysics, the faint signal from distant galaxies and other dim cosmological sources at millimeter and submillimeter wavelengths require the use of high-sensitivity experiments. Cryogenics and the use of low-temperature detectors are essential to the accomplishment of the scientific objectives, allowing lower detector noise levels and improved instrument stability. Bolometric detectors are usually cooled to temperatures below 1K, and the constraints on the instrument are stringent, whether the experiment is a space-based platform or a ground-based telescope. The latter are usually deployed in remote and harsh environments such as the South Pole, where maintenance needs to be kept minimal. CEA-SBT has acquired a strong heritage in the development of vibration-free multistage helium-sorption coolers, which can provide cooling down to 200 mK when mounted on a cold stage at temperatures <5K. In this paper, we focus on the development of a three-stage cooler dedicated to the BICEP Array project led by Caltech/JPL, which aims to study the birth of the Universe and specifically the unique B-mode pattern imprinted by primordial gravitational waves on the polarization of the Cosmic Microwave Background. Several cryogenic receivers are being developed, each featuring one such helium-sorption cooler operated from a 4K stage cooled by a Cryomech pulse-tube with heat lifts of >1.35W at 4.2K and >36W at 45K. The major challenge of this project is the large masses to be cooled to sub-kelvin temperatures (26 kg at 250mK) and the resulting long cool-down time, which in this novel cooler design is kept to a minimum with the implementation of passive and active thermal links between different temperature stages. A first unit has been sized to provide 230, 70 and 2{\mu}W of net heat lifts at the maximum temperatures of 2.8K, 340 and 250mK, respectively, for a minimum duration of 48 hours.


title: On the Existence of Conditional Maximum Likelihood Estimates of the Binary Logit Model with Fixed Effects

abstract: By exploiting McFadden (1974)'s results on conditional logit estimation, we show that there exists a one-to-one mapping between existence and uniqueness of conditional maximum likelihood estimates of the binary logit model with fixed effects and the configuration of data points. Our results extend those in Albert and Anderson (1984) for the cross-sectional case and can be used to build a simple algorithm that detects spurious estimates in finite samples. As an illustration, we exhibit an artificial dataset for which the STATA's command \texttt{clogit} returns spurious estimates.


title: Critical review of prevailing explanations for the emergence of classicality in cosmology

abstract: There have been recent attempts at justifying, from first principles, and within the standard framework, the emergence of classical behavior in the post-inflationary cosmological context. Accounting for this emergence is an important issue, as it underlies the extraordinary empirical success of our current understanding of cosmology. In this work, we offer a critique of different efforts at explaining the emergence of classical behavior in cosmology within the standard framework. We argue that such endeavors are generically found lacking in conceptual clarity, as they invariably rely, either upon unjustified, implicit assumptions, or on circular logic. We conclude that, within the standard approach, the emergence of classical behavior in cosmology constitutes an unexplained phenomenon.


title: Ab initio Determination of Phase Stabilities of Dynamically Disordered Solids: rotational C2 disorder in Li2C2

abstract: The temperature-induced orthorhombic to cubic phase transition in Li2C2 is a prototypical example of a solid to solid phase transformation between an ordered phase, which is well described within the phonon theory, and a dynamically disordered phase with rotating molecules, for which the standard phonon theory is not applicable. The transformation in Li2C2 happens from a phase with directionally ordered C2 dimers to a structure, where they are dynamically disorderd. We provide a description of this transition by employing ab initio molecular dynamics (AIMD) based stress-strain thermodynamic integration on a deformation path that connects the ordered and dynamically disordered phases. The free energy difference between the two phases is obtained. The entropy that stabilizes the dynamically disordered cubic phase is captured by the behavior of the stress on the deformation path. We also show that a combination of the stress-strain thermodynamic integration and machine learning force field methodologies appears as a promising path in studies of dynamically disordered materials.


title: Time-reversal symmetry breaking in a square lattice

abstract: The bulk conductivity of a two-dimensional system is studied assuming that quantum interference effects break time-reversal symmetry in the presence of strong spin-orbit interaction and strong lattice potential. The study is carried out by direct diagonalization in order to explore the nonlinear-response regime. The system displays a quantized conductivity that depends on the intensity of the electric field and under specific conditions the conductivity limit at zero electric field shows a nonvanishing value.


title: DGTN: Dual-channel Graph Transition Network for Session-based Recommendation

abstract: The task of session-based recommendation is to predict user actions based on anonymous sessions. Recent research mainly models the target session as a sequence or a graph to capture item transitions within it, ignoring complex transitions between items in different sessions that have been generated by other users. These item transitions include potential collaborative information and reflect similar behavior patterns, which we assume may help with the recommendation for the target session. In this paper, we propose a novel method, namely Dual-channel Graph Transition Network (DGTN), to model item transitions within not only the target session but also the neighbor sessions. Specifically, we integrate the target session and its neighbor (similar) sessions into a single graph. Then the transition signals are explicitly injected into the embedding by channel-aware propagation. Experiments on real-world datasets demonstrate that DGTN outperforms other state-of-the-art methods. Further analysis verifies the rationality of dual-channel item transition modeling, suggesting a potential future direction for session-based recommendation.


title: Joint and Progressive Subspace Analysis (JPSA) with Spatial-Spectral Manifold Alignment for Semi-Supervised Hyperspectral Dimensionality Reduction

abstract: Conventional nonlinear subspace learning techniques (e.g., manifold learning) usually introduce some drawbacks in explainability (explicit mapping) and cost-effectiveness (linearization), generalization capability (out-of-sample), and representability (spatial-spectral discrimination). To overcome these shortcomings, a novel linearized subspace analysis technique with spatial-spectral manifold alignment is developed for a semi-supervised hyperspectral dimensionality reduction (HDR), called joint and progressive subspace analysis (JPSA). The JPSA learns a high-level, semantically meaningful, joint spatial-spectral feature representation from hyperspectral data by 1) jointly learning latent subspaces and a linear classifier to find an effective projection direction favorable for classification; 2) progressively searching several intermediate states of subspaces to approach an optimal mapping from the original space to a potential more discriminative subspace; 3) spatially and spectrally aligning manifold structure in each learned latent subspace in order to preserve the same or similar topological property between the compressed data and the original data. A simple but effective classifier, i.e., nearest neighbor (NN), is explored as a potential application for validating the algorithm performance of different HDR approaches. Extensive experiments are conducted to demonstrate the superiority and effectiveness of the proposed JPSA on two widely-used hyperspectral datasets: Indian Pines (92.98\%) and the University of Houston (86.09\%) in comparison with previous state-of-the-art HDR methods. The demo of this basic work (i.e., ECCV2018) is openly available at https://github.com/danfenghong/ECCV2018_J-Play.


title: Two-qubit entanglement generation through non-Hermitian Hamiltonians induced by repeated measurements on an ancilla

abstract: In contrast to classical systems, actual implementation of non-Hermitian Hamiltonian dynamics for quantum systems is a challenge because the processes of energy gain and dissipation are based on the underlying Hermitian system-environment dynamics that is trace preserving. Recently, a scheme for engineering non-Hermitian Hamiltonians as a result of repetitive measurements on an anicillary qubit has been proposed. The induced conditional dynamics of the main system is described by the effective non-Hermitian Hamiltonian arisng from the procedure. In this paper we demonstrate the effectiveness of such a protocol by applying it to physically relevant multi-spin models, showing that the effective non-Hermitian Hamiltonian drives the system to a maximally entangled stationary state. In addition, we report a new recipe to construct a physical scenario where the quantum dynamics of a physical system represented by a given non-Hermitian Hamiltonian model may be simulated. The physical implications and the broad scope potential applications of such a scheme are highlighted.


title: Unusual effects of magnetic dilution in the ferrimagnetic columnar ordered $\mathrm{Sm_2MnMnMn_{4-x}Ti_xO_{12}}$ perovskites

abstract: Powder neutron diffraction experiments have been employed to establish the effects of site-selective magnetic dilution in the Sm2MnMnMn4-x Tix O12 A-site columnar ordered quadruple perovskite manganites (x = 1, x = 2 and x = 3). We show that in all three compositions the Mn ions adopt a collinear ferrimagnetic structure below 27 K, 62 K and 34 K, respectively. An unexpected increase in the ordering temperature was observed between the x = 1 and x = 2 samples, which indicates a considerable departure from mean field behaviour. This result is corroborated by large reductions in the theoretical ground state magnetic moments observed across the series, which indicate the presence of spin fluctuations and or disorder. We show that long range magnetic order in the x = 3 sample, which occurs below the percolation threshold for B-B exchange, can only be understood to arise if magnetic order in Sm2MnMnMn4-xTixO12 is mediated via both A-B and B-B exchange, hence confirming the importance of A-B exchange interactions in these materials. Finally we show that site-selective magnetic dilution enables the tuning of a ferrimagnetic compensation point and the introduction of temperature-induced magnetization reversal.


title: Inter-particle ratchet effect determines global current of heterogeneous particles diffusing in confinement

abstract: In a model of $N$ volume-excluding spheres in a $d$-dimensional tube, we consider how differences between particles in their drift velocities, diffusivities, and sizes influence the steady state distribution and axial particle current. We show that the model is exactly solvable when the geometrical constraints prevent any particle from overtaking every other -- a notion we term quasi-one-dimensionality. Then, due to a ratchet effect, the current is biased towards the velocities of the least diffusive particles. We consider special cases of this model in one dimension, and derive the exact joint gap distribution for driven tracers in a passive bath. We describe the relationship between phase space structure and irreversible drift that makes the quasi-one-dimensional supposition key to the model's solvability.


title: Learning Realistic Patterns from Unrealistic Stimuli: Generalization and Data Anonymization

abstract: Good training data is a prerequisite to develop useful ML applications. However, in many domains existing data sets cannot be shared due to privacy regulations (e.g., from medical studies). This work investigates a simple yet unconventional approach for anonymized data synthesis to enable third parties to benefit from such private data. We explore the feasibility of learning implicitly from unrealistic, task-relevant stimuli, which are synthesized by exciting the neurons of a trained deep neural network (DNN). As such, neuronal excitation serves as a pseudo-generative model. The stimuli data is used to train new classification models. Furthermore, we extend this framework to inhibit representations that are associated with specific individuals. We use sleep monitoring data from both an open and a large closed clinical study and evaluate whether (1) end-users can create and successfully use customized classification models for sleep apnea detection, and (2) the identity of participants in the study is protected. Extensive comparative empirical investigation shows that different algorithms trained on the stimuli are able generalize successfully on the same task as the original model. However, architectural and algorithmic similarity between new and original models play an important role in performance. For similar architectures, the performance is close to that of using the true data (e.g., Accuracy difference of 0.56\%, Kappa coefficient difference of 0.03-0.04). Further experiments show that the stimuli can to a large extent successfully anonymize participants of the clinical studies.


title: Kernel-Based Smoothness Analysis of Residual Networks

abstract: A major factor in the success of deep neural networks is the use of sophisticated architectures rather than the classical multilayer perceptron (MLP). Residual networks (ResNets) stand out among these powerful modern architectures. Previous works focused on the optimization advantages of deep ResNets over deep MLPs. In this paper, we show another distinction between the two models, namely, a tendency of ResNets to promote smoother interpolations than MLPs. We analyze this phenomenon via the neural tangent kernel (NTK) approach. First, we compute the NTK for a considered ResNet model and prove its stability during gradient descent training. Then, we show by various evaluation methodologies that for ReLU activations the NTK of ResNet, and its kernel regression results, are smoother than the ones of MLP. The better smoothness observed in our analysis may explain the better generalization ability of ResNets and the practice of moderately attenuating the residual blocks.