title: Efficient, positive, and energy stable schemes for multi-D Poisson-Nernst-Planck systems

abstract: In this paper, we design, analyze, and numerically validate positive and energy-dissipating schemes for solving the time-dependent multi-dimensional system of Poisson-Nernst-Planck (PNP) equations, which has found much use in the modeling of biological membrane channels and semiconductor devices. The semi-implicit time discretization based on a reformulation of the system gives a well-posed elliptic system, which is shown to preserve solution positivity for arbitrary time steps. The first order (in time) fully-discrete scheme is shown to preserve solution positivity and mass conservation unconditionally, and energy dissipation with only a mild $O(1)$ time step restriction. The scheme is also shown to preserve the steady-state. For the fully second order (in both time and space) scheme with large time steps, solution positivity is restored by a local scaling limiter, which is shown to maintain the spatial accuracy. These schemes are easy to implement. Several three-dimensional numerical examples verify our theoretical findings and demonstrate the accuracy, efficiency, and robustness of the proposed schemes, as well as the fast approach to steady states.


title: Restricted k-color partitions, II

abstract: We consider $(k,j)$-colored partitions, partitions in which $k$ colors exist but at most $j$ colors may be chosen per size of part. In particular these generalize overpartitions. Advancing previous work, we find new congruences, including in previously unexplored cases where $k$ and $j$ are not coprime, as well as some noncongruences. As a useful aside, we give the apparently new generating function for the number of partitions in the $N \times M$ box with a given number of part sizes, and extend to multiple colors a conjecture of Dousse and Kim on unimodality in overpartitions.


title: Polaron bubble stabilised by medium-induced three-body interactions

abstract: Mixing two kinds of particles that repel each other usually results in either a homogeneous mixture when the repulsion is weak, or a complete phase separation of the two kinds when their repulsion is too strong. It is shown however that there is an intermediate regime where the two kinds can coexist in their ground state as a bubble immersed in a gas of one kind. Such a situation is obtained by adding heavy repulsive impurities into a Bose-Einstein condensate. Above a certain strength of the mutual repulsion, a stable bubble of impurities and bosons can be formed, resulting from the equilibrium between the interactions induced by the bosons inside the bubble and the outside pressure from the surrounding bosons. At some particular strength, the effective interactions between the impurities consist of only three-body interactions. Finally, above a critical strength, the bosons are ejected from the bubble and the impurities collapse into a pure bubble of impurities. This phenomenon could be observed with an imbalanced mixture of ultra-cold atoms of different masses. Moreover, it appears possible to reach a regime where the impurities form a dense bubble of strongly-interacting particles.


title: Pre-training via Leveraging Assisting Languages and Data Selection for Neural Machine Translation

abstract: Sequence-to-sequence (S2S) pre-training using large monolingual data is known to improve performance for various S2S NLP tasks in low-resource settings. However, large monolingual corpora might not always be available for the languages of interest (LOI). To this end, we propose to exploit monolingual corpora of other languages to complement the scarcity of monolingual corpora for the LOI. A case study of low-resource Japanese-English neural machine translation (NMT) reveals that leveraging large Chinese and French monolingual corpora can help overcome the shortage of Japanese and English monolingual corpora, respectively, for S2S pre-training. We further show how to utilize script mapping (Chinese to Japanese) to increase the similarity between the two monolingual corpora leading to further improvements in translation quality. Additionally, we propose simple data-selection techniques to be used prior to pre-training that significantly impact the quality of S2S pre-training. An empirical comparison of our proposed methods reveals that leveraging assisting language monolingual corpora, data selection and script mapping are extremely important for NMT pre-training in low-resource scenarios.


title: Cosmological Fluctuations in Delta Gravity

abstract: About 70\% of the Universe is Dark Energy, but the physics community still does not know what it is. Delta Gravity (DG) is an alternative theory of gravitation that could solve this cosmological problem. Previously, we studied the Universe's accelerated expansion, where DG was able to explain the SNe-Ia data successfully. In this work, we explore the cosmological fluctuations that give rise to the CMB through a hydrodynamic approximation. We calculate the gauge transformations for the metric and the perfect fluid to present the equations of the evolution of cosmological fluctuations, providing the necessary equations to solve in a semi-analytical way the scalar TT Power Spectrum. These equations will be useful for comparing the DG theory with astronomical observations and thus being able to constraint the DG cosmology, testing, in the future, the compatibility with the CMB Planck data, which are currently in controversy with SNe-Ia.


title: Gradient and Hessian approximations in Derivative Free Optimization

abstract: This work investigates finite differences and the use of interpolation models to obtain approximations to the first and second derivatives of a function. Here, it is shown that if a particular set of points is used in the interpolation model, then the solution to the associated linear system (i.e., approximations to the gradient and diagonal of the Hessian) can be obtained in $\mathcal{O}(n)$ computations, which is the same cost as finite differences, and is a saving over the $\mathcal{O}(n^3)$ cost when solving a general unstructured linear system. Moreover, if the interpolation points are formed using a `regular minimal positive basis', then the error bound for the gradient approximation is the same as for a finite differences approximation. Numerical experiments are presented that show how the derivative estimates can be employed within an existing derivative free optimization algorithm, thus demonstrating one of the potential practical uses of these derivative approximations.


title: Replica Exchange for Non-Convex Optimization

abstract: Gradient descent (GD) is known to converge quickly for convex objective functions, but it can be trapped at local minima. On the other hand, Langevin dynamics (LD) can explore the state space and find global minima, but in order to give accurate estimates, LD needs to run with a small discretization step size and weak stochastic force, which in general slow down its convergence. This paper shows that these two algorithms and their non-swapping variants. can ``collaborate" through a simple exchange mechanism, in which they swap their current positions if LD yields a lower objective function. This idea can be seen as the singular limit of the replica-exchange technique from the sampling literature. We show that this new algorithm converges to the global minimum linearly with high probability, assuming the objective function is strongly convex in a neighborhood of the unique global minimum. By replacing gradients with stochastic gradients, and adding a proper threshold to the exchange mechanism, our algorithm can also be used in online settings. We also study non-swapping variants of the algorithm, which achieve similar performance. We further verify our theoretical results through some numerical experiments and observe superior performance of the proposed algorithm over running GD or LD alone.


title: BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method

abstract: Accelerating DNN execution on various resource-limited computing platforms has been a long-standing problem. Prior works utilize l1-based group lasso or dynamic regularization such as ADMM to perform structured pruning on DNN models to leverage the parallel computing architectures. However, both of the pruning dimensions and pruning methods lack universality, which leads to degraded performance and limited applicability. To solve the problem, we propose a new block-based pruning framework that comprises a general and flexible structured pruning dimension as well as a powerful and efficient reweighted regularization method. Our framework is universal, which can be applied to both CNNs and RNNs, implying complete support for the two major kinds of computation-intensive layers (i.e., CONV and FC layers). To complete all aspects of the pruning-for-acceleration task, we also integrate compiler-based code optimization into our framework that can perform DNN inference in a real-time manner. To the best of our knowledge, it is the first time that the weight pruning framework achieves universal coverage for both CNNs and RNNs with real-time mobile acceleration and no accuracy compromise.


title: Backreacting holographic superconductors from the coupling of a scalar field to the Einstein tensor

abstract: We investigate the properties of the backreacting holographic superconductors from the coupling of a scalar field to the Einstein tensor in the background of a d-dimensional AdS black hole. Imposing the Dirichlet boundary condition of the trial function without the Neumann boundary conditions, we improve the analytical Sturm-Liouville method with an iterative procedure to explore the pure effect of the Einstein tensor on the holographic superconductors and find that the Einstein tensor hinders the condensate of the scalar field but does not affect the critical phenomena. Our analytical findings are in very good agreement with the numerical results from the "marginally stable modes" method, which implies that the Sturm-Liouville method is still powerful to study the holographic superconductors from the coupling of a scalar field to the Einstein tensor even if we consider the backreactions.


title: The de Hass-van Alphen quantum oscillations in BaSn3 superconductor with multiple Dirac fermions

abstract: By measuring the de Hass-van Alphen effect and calculating the electronic band structure, we have investigated the bulk Fermi surface of the BaSn3 superconductor with a transition temperature of ~ 4.4 K. Striking de Haas-van Alphen (dHvA) quantum oscillations are observed when the magnetic field B is perpendicular to both (100) and (001) planes. Our analysis unveiled nontrivial Berry phase imposed in the quantum oscillations when B is perpendicular to (100), with two fundamental frequencies at 31.5 T and 306.7 T, which likely arise from two corresponding hole pockets of the bands forming a type-II Dirac point. The results are supported by the ab initio calculations indicating a type-II Dirac point setting and tilting along the high symmetric K-H line of the Brillouin zone, about 0.13 eV above the Fermi level. Moreover, the calculations also revealed other two type-I Dirac points on the high symmetric {\Gamma}-A direction, but slightly far below the Fermi level. The results demonstrate BaSn3 as an excellent platform for the study of not only exotic properties of different types of Dirac fermions in a single material, but also the interplay between nontrivial topological states and superconductivity.


title: Isotriviality of smooth families of varieties of general type

abstract: In this paper, we proved that a log smooth family of log general type klt pairs with a special (in the sense of Campana) quasi-projective base is isotrivial. As a consequence, we proved the generalized Kebekus-Kov\'acs conjecture \cite[Conjecture 1.1]{WW19}, for smooth families of general type varieties as well as log smooth families of log canonical pairs of log general type, assuming the existence of relative good minimal models.


title: Scaling Laws for Neural Language Models

abstract: We study empirical scaling laws for language model performance on the cross-entropy loss. The loss scales as a power-law with model size, dataset size, and the amount of compute used for training, with some trends spanning more than seven orders of magnitude. Other architectural details such as network width or depth have minimal effects within a wide range. Simple equations govern the dependence of overfitting on model/dataset size and the dependence of training speed on model size. These relationships allow us to determine the optimal allocation of a fixed compute budget. Larger models are significantly more sample-efficient, such that optimally compute-efficient training involves training very large models on a relatively modest amount of data and stopping significantly before convergence.


title: A Search for Transiting Planets in the Globular Cluster M4 with K2: Candidates and Occurrence Limits

abstract: We perform a search for transiting planets in the NASA K2 observations of the globular cluster (GC) M4. This search is sensitive to larger orbital periods ($P\lesssim 35$ days, compared to the previous best of $P\lesssim 16$ days) and, at the shortest periods, smaller planet radii (R$_p\gtrsim0.3$ R$_J$, compared to the previous best of R$_p\gtrsim0.8$ R$_J$) than any previous search for GC planets. Seven planet candidates are presented. An analysis of the systematic noise in our data shows that most, if not all, of these candidates are likely false alarms. We calculate planet occurrence rates assuming our highest significance candidate is a planet and occurrence rate upper limits assuming no detections. We calculate 3$\sigma$ occurrence rate upper limits of 6.1\% for 0.71-2 R$_J$ planets with 1-36 day periods and 16\% for 0.36-0.71 R$_J$ planets with 1-10 day periods. The occurrence rates from Kepler, TESS, and RV studies of field stars are consistent with both a non-detection of a planet and detection of a single hot Jupiter in our data. Comparing to previous studies of GCs, we are unable to place a more stringent constraint than Gilliland et al. 2000 for the radius-period range they were sensitive to, but do place tighter constraints than both Weldrake et al. 2008 and Nascimbeni et al. 2012 for the large-radius regimes to which they were sensitive.


title: A covariance-enhanced approach to multi-tissue joint eQTL mapping with application to transcriptome-wide association studies

abstract: Transcriptome-wide association studies based on genetically predicted gene expression have the potential to identify novel regions associated with various complex traits. It has been shown that incorporating expression quantitative trait loci (eQTLs) corresponding to multiple tissue types can improve power for association studies involving complex etiology. In this article, we propose a new multivariate response linear regression model and method for predicting gene expression in multiple tissues simultaneously. Unlike existing methods for multi-tissue joint eQTL mapping, our approach incorporates tissue-tissue expression correlation, which allows us to more efficiently handle missing expression measurements and more accurately predict gene expression using a weighted summation of eQTL genotypes. We show through simulation studies that our approach performs better than the existing methods in many scenarios. We use our method to estimate eQTL weights for 29 tissues collected by GTEx, and show that our approach significantly improves expression prediction accuracy compared to competitors. Using our eQTL weights, we perform a multi-tissue-based S-MultiXcan transcriptome-wide association study and show that our method leads to more discoveries in novel regions and more discoveries overall than the existing methods. Estimated eQTL weights are available for download online at github.com/ajmolstad/MTeQTLResults.


title: Holographic p-wave superfluid in the AdS soliton background with $RF^{2}$ corrections

abstract: We investigate the holographic p-wave superfluid in the background metric of the AdS soliton with $RF^{2}$ corrections. Two models, namely, the Maxwell complex vector field model and Yang-Mills theory, are studied in the above context by employing the Sturm-Liouville approach as well as the shooting method. When turning on the spatial components of the gauge field, one observes that, in the probe limit, the inclusion of $RF^{2}$ corrections hinders the superfluid phase transition. On the other hand, however, in the absence of the superfluid velocity, it is found that the $RF^2$ corrections lead to distinct effects for the two models. Regardless of either the $RF^2$ correction or the spatial component of the gauge field, the phase transition of the system is observed to be always of the second order. Moreover, a linear relationship between the charge density and chemical potential is largely established near the critical point in both holographic superfluid models.


title: Synthesis of RE123 high-Tc superconductors with a high-entropy-alloy-type RE site

abstract: We have synthesized high-entropy-alloy-type (HEA-type) RE123 superconductors Y0.28Nd0.16Sm0.18Eu0.18Gd0.20Ba2Cu3O7-d and Y0.18La0.24Nd0.14Sm0.14Eu0.15Gd0.15Ba2Cu3O7-d with a superconducting transition temperature (Tc) exceeding 90 K. From comparison between HEA-type and conventional RE123 samples, we found that the mixing entropy at the rare earth site does not affect Tc and critical current density (Jc) of the RE123 samples. For all the examined samples, orthorhombicity was found to be an essential parameter for Tc and Jc. In the regime near orthorhombic-tetragonal boundary, Jc for the HEA-type sample was larger than that of conventional-type samples, which suggests that HEA-type RE123 may be useful to improve Jc in the structure with low orthorhombicity.


title: Continual Local Replacement for Few-shot Learning

abstract: The goal of few-shot learning is to learn a model that can recognize novel classes based on one or few training data. It is challenging mainly due to two aspects: (1) it lacks good feature representation of novel classes; (2) a few of labeled data could not accurately represent the true data distribution and thus it's hard to learn a good decision function for classification. In this work, we use a sophisticated network architecture to learn better feature representation and focus on the second issue. A novel continual local replacement strategy is proposed to address the data deficiency problem. It takes advantage of the content in unlabeled images to continually enhance labeled ones. Specifically, a pseudo labeling method is adopted to constantly select semantically similar images on the fly. Original labeled images will be locally replaced by the selected images for the next epoch training. In this way, the model can directly learn new semantic information from unlabeled images and the capacity of supervised signals in the embedding space can be significantly enlarged. This allows the model to improve generalization and learn a better decision boundary for classification. Our method is conceptually simple and easy to implement. Extensive experiments demonstrate that it can achieve state-of-the-art results on various few-shot image recognition benchmarks.


title: An approach to constrain models of accreting neutron stars with the use of an equation of state

abstract: We investigate X-ray bursts during the thermal evolution of an accreting neutron star which corresponds to the X-ray burster GS\ 1826-24. Physical quantities of the neutron star are included using an equation of state below and above the nuclear matter density. We adopt an equation of state and construct an approximate network that saves the computational time and calculates nuclear energy generation rates accompanying the abundance evolutions. The mass and radius of the neutron star are got by solving the stellar evolution equations from the center to the surface which involve necessary information such as the nuclear energy generation in accreting layers, heating from the crust, and neutrino emissions inside the stellar core. We reproduce the light curve and recurrence time of the X-ray burst from GS 1826-24 within the standard deviation of 1$\sigma$ for the assumed accretion rate, metallicity, and equation of state. It is concluded that the observed recurrence time is consistent with the theoretical model having metallicity of the initial CNO elements $Z_{\rm CNO}$ = 0.01. We suggest that the nuclear reaction rates responsible for the $rp$-process should be examined in detail, because the rates may change the shape of the light curve and our conclusion.


title: Characterizations of annihilator $(b,c)$-inverses in arbitrary rings

abstract: In this paper, we investigate some properties of annihilator $(b,c)$-inverses in an arbitrary ring. We demonstrate that one-sided annihilator $(b,c)$-inverses of elements in arbitrary rings may behave differently in contrast to one-sided $(b,c)$-inverses. Also, we discuss intertwining property, absorption law, reverse order law, and Cline's formula for annihilator $(b,c)$-inverses. As applications, we improve and extend some known results to $(b,c)$-inverses. In particular, we derive an equivalent condition of intertwining property for $(b,c)$-inverses in semigroups.


title: Modeling state-transition dynamics in resting-state brain signals by the hidden Markov and Gaussian mixture models

abstract: Recent studies have proposed that one can summarize brain activity into dynamics among a relatively small number of hidden states and that such an approach is a promising tool for revealing brain function. Hidden Markov models (HMMs) are a prevalent approach to inferring such neural dynamics among discrete brain states. However, the impact of assuming Markovian structure in neural time series data has not been sufficiently examined. Here, to address this situation and examine the performance of the HMM, we compare the model with the Gaussian mixture model (GMM), which is with no temporal regularization and thus a statistically simpler model than the HMM, by applying both models to synthetic time series generated from empirical resting-state functional magnetic resonance imaging (fMRI) data. We compared the GMM and HMM for various sampling frequencies, lengths of recording per participant, numbers of participants, and numbers of independent component signals. We find that the HMM attains a better accuracy of estimating the hidden state than the GMM in a majority of cases. However, we also find that the accuracy of the GMM is comparable to that of the HMM under the condition that the sampling frequency is reasonably low (e.g., TR = 2.88 or 3.60 s) or the data is relatively short. These results suggest that the GMM can be a viable alternative to the HMM for investigating hidden-state dynamics under this condition.


title: Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixtures

abstract: This paper shows that deep learning (DL) representations of data produced by generative adversarial nets (GANs) are random vectors which fall within the class of so-called \textit{concentrated} random vectors. Further exploiting the fact that Gram matrices, of the type $G = X^T X$ with $X=[x_1,\ldots,x_n]\in \mathbb{R}^{p\times n}$ and $x_i$ independent concentrated random vectors from a mixture model, behave asymptotically (as $n,p\to \infty$) as if the $x_i$ were drawn from a Gaussian mixture, suggests that DL representations of GAN-data can be fully described by their first two statistical moments for a wide range of standard classifiers. Our theoretical findings are validated by generating images with the BigGAN model and across different popular deep representation networks.


title: Wrapper Feature Selection Algorithm for the Optimization of an Indicator System of Patent Value Assessment

abstract: Effective patent value assessment provides decision support for patent transection and promotes the practical application of patent technology. The limitations of previous research on patent value assessment were analyzed in this work, and a wrapper-mode feature selection algorithm that is based on classifier prediction accuracy was developed. Verification experiments on multiple UCI standard datasets indicated that the algorithm effectively reduced the size of the feature set and significantly enhanced the prediction accuracy of the classifier. When the algorithm was utilized to establish an indicator system of patent value assessment, the size of the system was reduced, and the generalization performance of the classifier was enhanced. Sequential forward selection was applied to further reduce the size of the indicator set and generate an optimal indicator system of patent value assessment.


title: ProjectionPathExplorer: Exploring Visual Patterns in Projected Decision-Making Paths

abstract: In problem-solving, a path towards solutions can be viewed as a sequence of decisions. The decisions, made by humans or computers, describe a trajectory through a high-dimensional representation space of the problem. By means of dimensionality reduction, these trajectories can be visualized in lower-dimensional space. Such embedded trajectories have previously been applied to a wide variety of data, but analysis has focused almost exclusively on the self-similarity of single trajectories. In contrast, we describe patterns emerging from drawing many trajectories -- for different initial conditions, end states, and solution strategies -- in the same embedding space. We argue that general statements about the problem-solving tasks and solving strategies can be made by interpreting these patterns. We explore and characterize such patterns in trajectories resulting from human and machine-made decisions in a variety of application domains: logic puzzles (Rubik's cube), strategy games (chess), and optimization problems (neural network training). We also discuss the importance of suitably chosen representation spaces and similarity metrics for the embedding.


title: Classically Simulating Quantum Circuits with Local Depolarizing Noise

abstract: We study the effect of noise on the classical simulatability of quantum circuits defined by computationally tractable (CT) states and efficiently computable sparse (ECS) operations. Examples of such circuits, which we call CT-ECS circuits, are IQP, Clifford Magic, and conjugated Clifford circuits. This means that there exist various CT-ECS circuits such that their output probability distributions are anti-concentrated and not classically simulatable in the noise-free setting (under plausible assumptions). First, we consider a noise model where a depolarizing channel with an arbitrarily small constant rate is applied to each qubit at the end of computation. We show that, under this noise model, if an approximate value of the noise rate is known, any CT-ECS circuit with an anti-concentrated output probability distribution is classically simulatable. This indicates that the presence of small noise drastically affects the classical simulatability of CT-ECS circuits. Then, we consider an extension of the noise model where the noise rate can vary with each qubit, and provide a similar sufficient condition for classically simulating CT-ECS circuits with anti-concentrated output probability distributions.


title: A Bayesian Long Short-Term Memory Model for Value at Risk and Expected Shortfall Joint Forecasting

abstract: Value-at-Risk (VaR) and Expected Shortfall (ES) are widely used in the financial sector to measure the market risk and manage the extreme market movement. The recent link between the quantile score function and the Asymmetric Laplace density has led to a flexible likelihood-based framework for joint modelling of VaR and ES. It is of high interest in financial applications to be able to capture the underlying joint dynamics of these two quantities. We address this problem by developing a hybrid model that is based on the Asymmetric Laplace quasi-likelihood and employs the Long Short-Term Memory (LSTM) time series modelling technique from Machine Learning to capture efficiently the underlying dynamics of VaR and ES. We refer to this model as LSTM-AL. We adopt the adaptive Markov chain Monte Carlo (MCMC) algorithm for Bayesian inference in the LSTM-AL model. Empirical results show that the proposed LSTM-AL model can improve the VaR and ES forecasting accuracy over a range of well-established competing models.


title: Inverses, disintegrations, and Bayesian inversion in quantum Markov categories

abstract: We introduce quantum Markov categories as a structure that refines and extends a synthetic approach to probability theory and information theory so that it includes quantum probability and quantum information theory. In this broader context, we analyze three successively more general notions of reversibility and statistical inference: ordinary inverses, disintegrations, and Bayesian inverses. We prove that each one is a strictly special instance of the latter for certain subcategories, providing a categorical foundation for Bayesian inversion as a generalization of reversing a process. We unify the categorical and $C^*$-algebraic notions of almost everywhere (a.e.) equivalence. As a consequence, we prove many results including a universal no-broadcasting theorem for S-positive categories, a generalized Fisher--Neyman factorization theorem for a.e. modular categories, a relationship between error correcting codes and disintegrations, and the relationship between Bayesian inversion and Umegaki's non-commutative sufficiency.


title: Comments are welcome

abstract: Scholars present their new research at seminars and conferences, and send drafts to peers, hoping to receive comments and suggestions that will improve the quality of their work. Using a dataset of papers published in economics journals, this article measures how much peers' individual and collective comments improve the quality of research. Controlling for the quality of the research idea and author, I find that a one standard deviation increase in the number of peers' individual and collective comments increases the quality of the journal in which the research is published by 47%.


title: Embedding codimension of the space of arcs

abstract: We introduce a notion of embedding codimension of an arbitrary local ring, establish some general properties, and study in detail the case of arc spaces of schemes of finite type over a field. Viewing the embedding codimension as a measure of singularities, our main result can be interpreted as saying that the singularities of the arc space are maximal at the arcs that are fully embedded in the singular locus of the underlying scheme, and progressively improve as we move away from said locus. As an application, we complement a theorem of Drinfeld, Grinberg, and Kazhdan on formal neighborhoods in arc spaces by providing a converse to their theorem, an optimal bound for the embedding codimension of the formal model appearing in the statement, a precise formula for the embedding dimension of the model constructed in Drinfeld's proof, and a geometric meaningful way of realizing the decomposition stated in the theorem.


title: Improving speaker discrimination of target speech extraction with time-domain SpeakerBeam

abstract: Target speech extraction, which extracts a single target source in a mixture given clues about the target speaker, has attracted increasing attention. We have recently proposed SpeakerBeam, which exploits an adaptation utterance of the target speaker to extract his/her voice characteristics that are then used to guide a neural network towards extracting speech of that speaker. SpeakerBeam presents a practical alternative to speech separation as it enables tracking speech of a target speaker across utterances, and achieves promising speech extraction performance. However, it sometimes fails when speakers have similar voice characteristics, such as in same-gender mixtures, because it is difficult to discriminate the target speaker from the interfering speakers. In this paper, we investigate strategies for improving the speaker discrimination capability of SpeakerBeam. First, we propose a time-domain implementation of SpeakerBeam similar to that proposed for a time-domain audio separation network (TasNet), which has achieved state-of-the-art performance for speech separation. Besides, we investigate (1) the use of spatial features to better discriminate speakers when microphone array recordings are available, (2) adding an auxiliary speaker identification loss for helping to learn more discriminative voice characteristics. We show experimentally that these strategies greatly improve speech extraction performance, especially for same-gender mixtures, and outperform TasNet in terms of target speech extraction.


title: Visual Summary of Value-level Feature Attribution in Prediction Classes with Recurrent Neural Networks

abstract: Deep Recurrent Neural Networks (RNN) is increasingly used in decision-making with temporal sequences. However, understanding how RNN models produce final predictions remains a major challenge. Existing work on interpreting RNN models for sequence predictions often focuses on explaining predictions for individual data instances (e.g., patients or students). Because state-of-the-art predictive models are formed with millions of parameters optimized over millions of instances, explaining predictions for single data instances can easily miss a bigger picture. Besides, many outperforming RNN models use multi-hot encoding to represent the presence/absence of features, where the interpretability of feature value attribution is missing. We present ViSFA, an interactive system that visually summarizes feature attribution over time for different feature values. ViSFA scales to large data such as the MIMIC dataset containing the electronic health records of 1.2 million high-dimensional temporal events. We demonstrate that ViSFA can help us reason RNN prediction and uncover insights from data by distilling complex attribution into compact and easy-to-interpret visualizations.


title: Determining the time dependent matrix potential in a wave equation from partial boundary data

abstract: We study the inverse problem for determining the time-dependent matrix potential appearing in the wave equation. We prove the unique determination of potential from the knowledge of solution measured on a part of the boundary.


title: Adaptation of a deep learning malignancy model from full-field digital mammography to digital breast tomosynthesis

abstract: Mammography-based screening has helped reduce the breast cancer mortality rate, but has also been associated with potential harms due to low specificity, leading to unnecessary exams or procedures, and low sensitivity. Digital breast tomosynthesis (DBT) improves on conventional mammography by increasing both sensitivity and specificity and is becoming common in clinical settings. However, deep learning (DL) models have been developed mainly on conventional 2D full-field digital mammography (FFDM) or scanned film images. Due to a lack of large annotated DBT datasets, it is difficult to train a model on DBT from scratch. In this work, we present methods to generalize a model trained on FFDM images to DBT images. In particular, we use average histogram matching (HM) and DL fine-tuning methods to generalize a FFDM model to the 2D maximum intensity projection (MIP) of DBT images. In the proposed approach, the differences between the FFDM and DBT domains are reduced via HM and then the base model, which was trained on abundant FFDM images, is fine-tuned. When evaluating on image patches extracted around identified findings, we are able to achieve similar areas under the receiver operating characteristic curve (ROC AUC) of $\sim 0.9$ for FFDM and $\sim 0.85$ for MIP images, as compared to a ROC AUC of $\sim 0.75$ when tested directly on MIP images.


title: A Hypersensitive Breast Cancer Detector

abstract: Early detection of breast cancer through screening mammography yields a 20-35% increase in survival rate; however, there are not enough radiologists to serve the growing population of women seeking screening mammography. Although commercial computer aided detection (CADe) software has been available to radiologists for decades, it has failed to improve the interpretation of full-field digital mammography (FFDM) images due to its low sensitivity over the spectrum of findings. In this work, we leverage a large set of FFDM images with loose bounding boxes of mammographically significant findings to train a deep learning detector with extreme sensitivity. Building upon work from the Hourglass architecture, we train a model that produces segmentation-like images with high spatial resolution, with the aim of producing 2D Gaussian blobs centered on ground-truth boxes. We replace the pixel-wise $L_2$ norm with a weak-supervision loss designed to achieve high sensitivity, asymmetrically penalizing false positives and false negatives while softening the noise of the loose bounding boxes by permitting a tolerance in misaligned predictions. The resulting system achieves a sensitivity for malignant findings of 0.99 with only 4.8 false positive markers per image. When utilized in a CADe system, this model could enable a novel workflow where radiologists can focus their attention with trust on only the locations proposed by the model, expediting the interpretation process and bringing attention to potential findings that could otherwise have been missed. Due to its nearly perfect sensitivity, the proposed detector can also be used as a high-performance proposal generator in two-stage detection systems.


title: A Multi-site Study of a Breast Density Deep Learning Model for Full-field Digital Mammography Images and Synthetic Mammography Images

abstract: Purpose: To develop a Breast Imaging Reporting and Data System (BI-RADS) breast density deep learning (DL) model in a multi-site setting for synthetic two-dimensional mammography (SM) images derived from digital breast tomosynthesis exams using full-field digital mammography (FFDM) images and limited SM data. Materials and Methods: A DL model was trained to predict BI-RADS breast density using FFDM images acquired from 2008 to 2017 (Site 1: 57492 patients, 187627 exams, 750752 images) for this retrospective study. The FFDM model was evaluated using SM datasets from two institutions (Site 1: 3842 patients, 3866 exams, 14472 images, acquired from 2016 to 2017; Site 2: 7557 patients, 16283 exams, 63973 images, 2015 to 2019). Each of the three datasets were then split into training, validation, and test datasets. Adaptation methods were investigated to improve performance on the SM datasets and the effect of dataset size on each adaptation method is considered. Statistical significance was assessed using confidence intervals (CI), estimated by bootstrapping. Results: Without adaptation, the model demonstrated substantial agreement with the original reporting radiologists for all three datasets (Site 1 FFDM: linearly-weighted $\kappa_w$ = 0.75 [95% CI: 0.74, 0.76]; Site 1 SM: $\kappa_w$ = 0.71 [95% CI: 0.64, 0.78]; Site 2 SM: $\kappa_w$ = 0.72 [95% CI: 0.70, 0.75]). With adaptation, performance improved for Site 2 (Site 1: $\kappa_w$ = 0.72 [95% CI: 0.66, 0.79], 0.71 vs 0.72, P = .80; Site 2: $\kappa_w$ = 0.79 [95% CI: 0.76, 0.81], 0.72 vs 0.79, P $<$ .001) using only 500 SM images from that site. Conclusion: A BI-RADS breast density DL model demonstrated strong performance on FFDM and SM images from two institutions without training on SM images and improved using few SM images.


title: Efficient Steady-state Simulation of High-dimensional Stochastic Networks

abstract: We propose and study an asymptotically optimal Monte Carlo estimator for steady-state expectations of a d-dimensional reflected Brownian motion. Our estimator is asymptotically optimal in the sense that it requires $\tilde{O}(d)$ (up to logarithmic factors in $d$) i.i.d. Gaussian random variables in order to output an estimate with a controlled error. Our construction is based on the analysis of a suitable multi-level Monte Carlo strategy which, we believe, can be applied widely. This is the first algorithm with linear complexity (under suitable regularity conditions) for steady-state estimation of RBM as the dimension increases.


title: Universal behavior of the thermal Hall conductivity

abstract: We report theoretical and experimental analyses of the thermal Hall conductivity in correlated systems. For both fermionic and bosonic excitations with nontrivial topology, we show that at "intermediate" temperatures, the thermal Hall conductivity exhibits an unexpected universal scaling with a simple exponential form. At low temperatures, it behaves differently and reflects the spectral properties of underlying excitations. Our predictions are examined as examples in two prototype compounds, the quantum paraelectric SrTiO$_3$ and the spin-liquid compound RuCl$_3$. The experimental data can be largely covered by our proposed minimal phenomenological model independent of microscopic details, revealing dominant bosonic contributions in SrTiO$_3$ and gapped fermionic excitations in RuCl$_3$. Our work establishes a phenomenological link between microscopic models and experimental data and provides a unified basis for analyzing the thermal Hall conductivity in correlated systems over a wide temperature region.


title: Epileptic Seizure Detection and Classification using Time-Frequency Features in EEG Signals

abstract: The use of EEG signal to diagnose several brain abnormalities is well-established in the literature. Particularly, epileptic seizure can be detected using EEG signals and several works were done in this field. The joint time-frequency domain features proved to be an improvement in classification results. This can be attributed to the non-stationarity inherent feature of the EEG signals. Therefore, shifting to the joint time-frequency domain benefits in utilizing the variations in time with respect to frequency and vice versa to obtain better outcomes. The Bayesian classifier is utilized to obtain the ranking of the best features. The information gain criterion was built to test the system and obtain the results.


title: New semi-analytical solutions for advection-dispersion equations in multilayer porous media

abstract: A new semi-analytical solution to the advection-dispersion-reaction equation for modelling solute transport in layered porous media is derived using the Laplace transform. Our solution approach involves introducing unknown functions representing the dispersive flux at the interfaces between adjacent layers, allowing the multilayer problem to be solved separately on each layer in the Laplace domain before being numerically inverted back to the time domain. The derived solution is applicable to the most general form of linear advection-dispersion-reaction equation, a finite medium comprising an arbitrary number of layers, continuity of concentration and dispersive flux at the interfaces between adjacent layers and transient boundary conditions of arbitrary type at the inlet and outlet. The derived semi-analytical solution extends and addresses deficiencies of existing analytical solutions in a layered medium, which consider analogous processes such as diffusion or reaction-diffusion only and/or require the solution of complicated nonlinear transcendental equations to evaluate the solution expressions. Code implementing our semi-analytical solution is supplied and applied to a selection of test cases, with the reported results in excellent agreement with a standard numerical solution and other analytical results available in the literature.


title: Semi-DerainGAN: A New Semi-supervised Single Image Deraining Network

abstract: Removing the rain streaks from single image is still a challenging task, since the shapes and directions of rain streaks in the synthetic datasets are very different from real images. Although supervised deep deraining networks have obtained impressive results on synthetic datasets, they still cannot obtain satisfactory results on real images due to weak generalization of rain removal capacity, i.e., the pre-trained models usually cannot handle new shapes and directions that may lead to over-derained/under-derained results. In this paper, we propose a new semi-supervised GAN-based deraining network termed Semi-DerainGAN, which can use both synthetic and real rainy images in a uniform network using two supervised and unsupervised processes. Specifically, a semi-supervised rain streak learner termed SSRML sharing the same parameters of both processes is derived, which makes the real images contribute more rain streak information. To deliver better deraining results, we design a paired discriminator for distinguishing the real pairs from fake pairs. Note that we also contribute a new real-world rainy image dataset Real200 to alleviate the difference between the synthetic and real image do-mains. Extensive results on public datasets show that our model can obtain competitive performance, especially on real images.


title: TEAM: An Taylor Expansion-Based Method for Generating Adversarial Examples

abstract: Although Deep Neural Networks(DNNs) have achieved successful applications in many fields, they are vulnerable to adversarial examples.Adversarial training is one of the most effective methods to improve the robustness of DNNs, and it is generally considered as solving a saddle point problem that minimizes risk and maximizes perturbation.Therefore, powerful adversarial examples can effectively replicate the situation of perturbation maximization to solve the saddle point problem.The method proposed in this paper approximates the output of DNNs in the input neighborhood by using the Taylor expansion, and then optimizes it by using the Lagrange multiplier method to generate adversarial examples. If it is used for adversarial training, the DNNs can be effectively regularized and the defects of the model can be improved.


title: Toric spaces and face enumeration on simplicial manifolds

abstract: In this paper, we study the well-know $g$-conjecture for rational homology spheres in a topological way. To do this, we construct a class of topological spaces with torus actions, which can be viewed as topological generalizations of toric varieties. Along this way we prove that after doing stellar subdivision operations at some middle dimensional faces of an arbitrary rational homology sphere, the $g$-conjecture is valid. Furthermore, we give topological proofs of several fundamental algebraic results about Buchsbaum complexes and simplicial manifolds. In this process, we also get a few interesting results in toric topology.


title: Testing general relativity with the stellar-mass black hole in LMC X-1 using the continuum-fitting method

abstract: The iron line and the continuum-fitting methods are currently the two leading techniques for measuring black hole spins with electromagnetic radiation. They can be naturally extended for probing the spacetime geometry around black holes and testing general relativity in the strong field regime. In the past couple of years, there has been significant work to use the iron line method to test the nature of black holes. In this Letter, we use the continuum-fitting method and we show its capability of constraining the spacetime geometry around black holes by analyzing 17 RXTE data of the X-ray binary LMC X-1.


title: Towards context in large scale biomedical knowledge graphs

abstract: Contextual information is widely considered for NLP and knowledge discovery in life sciences since it highly influences the exact meaning of natural language. The scientific challenge is not only to extract such context data, but also to store this data for further query and discovery approaches. Here, we propose a multiple step knowledge graph approach using labeled property graphs based on polyglot persistence systems to utilize context data for context mining, graph queries, knowledge discovery and extraction. We introduce the graph-theoretic foundation for a general context concept within semantic networks and show a proof-of-concept based on biomedical literature and text mining. Our test system contains a knowledge graph derived from the entirety of PubMed and SCAIView data and is enriched with text mining data and domain specific language data using BEL. Here, context is a more general concept than annotations. This dense graph has more than 71M nodes and 850M relationships. We discuss the impact of this novel approach with 27 real world use cases represented by graph queries.


title: Global Existence of the Non-isothermal Poisson-Nernst-Planck-Fourier System

abstract: In this paper, we consider a non-isothermal electrokinetic model, which is derived from the Energetic Variational Approach. The charge transport is described through the Poisson-Nernst-Planck equations with variable temperature, and the heat flux satisfies the Fourier's law. This Poisson-Nernst-Planck-Fourier model satisfies both the first law and second law of thermodynamics as well as the Onsager's reciprocal relations, thus it is thermodynamic-consistent. Finally, we prove the global well-posedness for this model under the smallness assumption of the initial data by the energy method.


title: Gravitational Wave Detection and Fundamental Physics in Space: Foreword

abstract: This article is a foreword for the special issue on Gravitational Wave Detection and Fundamental Physics in Space for International Journal of Physics D. In the foreword, we review briefly the history of the development of mission concepts and projects for the gravitational wave detection in space together with fundamental physics missions. We summarize briefly the gravitational-wave detection-in-space science goals and the current progress in the experimental & technological developments presented in the articles of this special issue, and list the articles with publication information and arXiv numbers.


title: A One-Shot Learning Framework for Assessment of Fibrillar Collagen from Second Harmonic Generation Images of an Infarcted Myocardium

abstract: Myocardial infarction (MI) is a scientific term that refers to heart attack. In this study, we infer highly relevant second harmonic generation (SHG) cues from collagen fibers exhibiting highly non-centrosymmetric assembly together with two-photon excited cellular autofluorescence in infarcted mouse heart to quantitatively probe fibrosis, especially targeted at an early stage after MI. We present a robust one-shot machine learning algorithm that enables determination of 2D assembly of collagen with high spatial resolution along with its structural arrangement in heart tissues post-MI with spectral specificity and sensitivity. Detection, evaluation, and precise quantification of fibrosis extent at early stage would guide one to develop treatment therapies that may prevent further progression and determine heart transplant needs for patient survival.


title: The temperature of IGM at high redshifts: shock heating and high mach problem

abstract: The thermal history of cosmic gas in the Dark Ages remains largely unknown. It is important to quantify the impact of relevant physics on the IGM temperature between $z=10$ and $z \sim 30$, in order to interpret recent and oncoming observations, including results reported by EDGES. We revisit the gas heating due to structure formation shocks in this era, using a set of fixed grid cosmological hydrodynamical simulations performed by three different codes. In all our simulations, the cosmic gas is predicted to be in multiphase state since $z>30$. The gas surrounding high density peaks gradually develops a relation more sharp than $T \propto \rho^{2/3}$, approximately $T \propto \rho^{2}$, from $z=30$ to $z=11$, might due to shock heating. Meanwhile, the gas in void region tends to have a large local mach number, and their thermal state varies significantly from code to code. In the redshift range $11-20$, the mass fraction of gas shock heated above the CMB temperature in our simulations is larger than previous semi-analytical results by a factor of 2 to 8. At $z=15$, the fraction varies from $\sim 19\%$ to $52 \%$ among different codes. Between $z=11$ and $z=20$, the gas temperature $<1/T_{\rm{K}}>_M^{-1}$ is predicted to be $\sim 10-20$ K by two codes, much higher than the adiabatic cooling model and some previous works. However, in our simulations performed by RAMSES, $<1/T_{\rm{K}}>_M^{-1}$ is predicted to be even below the temperature required to explain result of the EDGES. Given the fact that different codes give different predictions, currently, it seems a challenge to make solid prediction on the temperature of gas at $z \sim 17$ in simulations.


title: On the Torelli group action on compact character varieties

abstract: The aim of this article is to prove that the Torelli group action on the G-character varieties is ergodic for G a connected, semi-simple and compact Lie group.


title: Socially intelligent task and motion planning for human-robot interaction

abstract: As social beings, much human behavior is predicated on social context - the ambient social state that includes cultural norms, social signals, individual preferences, etc. In this paper, we propose a socially-aware task and motion planning algorithm that considers social context to generate appropriate and effective plans in human social environments (HSEs). The key strength of our proposed approach is that it explicitly models how potential actions not only affect objective cost, but also transform the social context in which it plans and acts. We investigate strategies to limit the complexity of our algorithm, so that our planner will remain tractable for mobile platforms in complex HSEs like hospitals and factories. The planner will also consider the relative importance and urgency of its tasks, which it uses to determine when it is and is not appropriate to violate social expectations to achieve its objective. This social awareness will allow robots to understand a fundamental rule of society: just because something makes your job easier, does not make it the right thing to do! To our knowledge, the proposed work is the first task and motion planning approach that supports socially intelligent robot policy for HSEs. Through this ongoing work, robots will be able to understand, respect, and leverage social context accomplish tasks both acceptably and effectively in HSEs.


title: An Android Application Risk Evaluation Framework Based on Minimum Permission Set Identification

abstract: Android utilizes a security mechanism that requires apps to request permission for accessing sensitive user data, e.g., contacts and SMSs, or certain system features, e.g., camera and Internet access. However, Android apps tend to be overprivileged, i.e., they often request more permissions than necessary. This raises the security problem of overprivilege. To alleviate the overprivilege problem, this paper proposes MPDroid, an approach that combines static analysis and collaborative filtering to identify the minimum permissions for an Android app based on its app description and API usage. Given an app, MPDroid first employs collaborative filtering to identify the initial minimum permissions for the app. Then, through static analysis, the final minimum permissions that an app really needs are identified. Finally, it evaluates the overprivilege risk by inspecting the apps extra privileges, i.e., the unnecessary permissions requested by the app. Experiments are conducted on 16,343 popular apps collected from Google Play. The results show that MPDroid outperforms the state-of-the-art approach significantly.


title: Polarized emission by aligned grains in the Mie regime : application to protoplanetary disks observed by ALMA

abstract: The azimuthal polarization patterns observed in some protoplanetary disks by ALMA at millimeter wavelength have raised doubts about their being produced by dust grains aligned with the magnetic field lines. These conclusions were based on the calculations of dust polarized emission in the Rayleigh regime, i.e. for grain sizes much smaller than the wavelength. However, the grain size in such disks is estimated to be typically in the range 0.1 - 1 mm from independent observations. We study the dust polarization properties of aligned grains in emission in the Mie regime, i.e. when the mean grain size approches the wavelength. Using the T-MATRIX and DustEM codes, we compute the spectral dependence of the polarization fraction in emission for grains in perfect spinning alignment, for various grain size distributions of weakly-elongated oblate and prolate grains of astrosilicate composition, with a mean size ranging from 10 {\mu}m to 1 mm. In the submillimeter and millimeter wavelength range, the polarization by B-field aligned grains becomes negative for grains larger than ~ 250 {\mu}m, meaning that the polarization vector becomes parallel to the B-field. The transition from the positive to the negative polarization occurs at a wavelength {\lambda} ~ 1 mm. The regime of negative polarization does not exist for grains smaller than ~ 100 {\mu}m. When using realistic grain size distributions for disks with grains up to the submillimeter sizes, the polarization direction of thermal emission by aligned grains is shown to be parallel to the direction of the magnetic field over a significant fraction of the wavelengths typically used to observe young protoplanetary disks. This property may explain the peculiar azimuthal orientation of the polarization vectors in some of the disks observed with ALMA and attest of the conserved ability of dust polarized emission to trace the magnetic field in disks.


title: Magnetic-field-induced robust zero Hall plateau state in MnBi$_2$Te$_4$ Chern insulator

abstract: The intrinsic antiferromagnetic topological insulator MnBi2Te4 provides an ideal platform for exploring exotic topological quantum phenomena. Recently, the Chern insulator and axion insulator phases have been realized in few-layer MnBi2Te4 devices at low magnetic field regime. However, the fate of MnBi2Te4 in high magnetic field has never been explored in experiment. In this work, we report transport studies of exfoliated MnBi2Te4 flakes in pulsed magnetic fields up to 61.5 T. In the high-field limit, the Chern insulator phase with Chern number C = -1 evolves into a robust zero Hall resistance plateau state. Nonlocal transport measurements and theoretical calculations demonstrate that the charge transport in the zero Hall plateau state is conducted by two counter-propagating edge states that arise from the combined effects of Landau levels and large Zeeman effect in strong magnetic fields. Our result demonstrates the intricate interplay among intrinsic magnetic order, external magnetic field, and nontrivial band topology in MnBi2Te4.


title: Simple experimental procedures to distinguish photothermal from hot-carrier processes in plasmonics

abstract: Light absorption and scattering of plasmonic metal nanoparticles can lead to non-equilibrium charge carriers, intense electromagnetic near-fields, and heat generation, with promising applications in a vast range of fields, from chemical and physical sensing, to nanomedicine, and photocatalysis for the sustainable production of fuels and chemicals. Disentangling the relative contribution of thermal and non-thermal contributions in plasmon driven processes is however difficult. Nanoscale temperature measurements are technically challenging and macroscale experiments are often characterized by collective heating effects, which tend to make the actual temperature increase unpredictable. This work is intended to help the reader experimentally detect and quantify photothermal effects in plasmon-driven chemical reactions, to discriminate their contribution from the one due to photochemical processes, and to cast a critical eye on the current literature. To this aim, we review, and in some cases propose, seven simple experimental procedures, which do not require the use of complex or expensive thermal microscopy techniques. These proposed procedures are adaptable to a wide range of experiments and fields of research where photothermal effects need to be assessed, such as plasmonic-assisted chemistry, heterogeneous catalysis, photovoltaics, biosensing and enhanced molecular spectroscopy.


title: Magnetism at iridate/manganite interface: influence of strong spin-orbit interaction

abstract: The complex investigation of dc transport and magnetic properties of the epitaxial manganite/iridate heterostructure was carried out by mean of X-ray (XRD), dc resistance measurements, ferromagnetic resonance (FMR) and polarized neutron reflectivity (PNR). Epitaxial growth of the heterostructure proceeded according to the cube-to-cube mechanism with the small lattice turn. The dc measurement indicates the presence of a conduction channel at the iridate/manganite interface due to the charge leakage from iridate that makes it hole doped, while the manganite side becomes electron doped. This is confirmed by the first principles calculations based on density functional theory [Sayantika Bhowal, and Sashi Satpathy AIP Conference Proceedings 2005, 020007 (2018)] that show the charge transfer at the interface from the half-filled spin-orbit entangled Jeff = 1/2 state of the iridate to the empty e states of manganite. The neutron scattering data show the turn of magnetization vector of the heterostructure (mainly manganite) on 26 degree closer to the external field with reducing temperature down to 10K. Additional ferromagnetic state appearing at T<100K indicate on emergence of ferromagnetism in the thin (10 nm) paramagnetic SIO film close to the interface. We have measured the dc voltage aroused on the SIO film caused by spin pumping and the anisotropic magnetoresistance in the heterostructure.


title: Relic Density of Asymmetric Dark Matter with Sommerfeld enhancement

abstract: We investigate the evolution of abundance of the asymmetric thermal Dark Matter when its annihilation rate at chemical decoupling is boosted by the Sommerfeld enhancement. Then we discuss the effect of kinetic decoupling on relic abundance of asymmetric Dark Matter when the interaction rate depends on the velocity. Usually the relic density of asymmetric Dark Matter is analyzed in the frame of chemical decoupling. Indeed after decoupling from the chemical equilibrium, asymmetric Dark Matter particles and anti--particles were still in kinetic equilibrium for a while. It has no effect on the case of $s-$wave annihilation since there is no temperature dependence in this case. However, the kinetic decoupling has impacts for the case of $p-$wave annihilation and Sommerfeld enhanced $s-$ and $p-$wave annihilations. We investigate in which extent the kinetic decoupling affects the relic abundances of asymmetric Dark Matter particle and anti--particle in detail. We found the constraints on the cross section and asymmetry factor by using the observational data of relic density of Dark Matter.


title: A Four-Qubits Code that is a Quantum Deletion Error-Correcting Code with the Optimal Length

abstract: This paper provides a new instance of quantum deletion error-correcting codes. This code can correct any single quantum deletion error, while our code is only of length 4. This paper also provides an example of an encoding quantum circuit and decoding quantum circuits. It is also proven that the length of any single deletion error-correcting codes is greater than or equal to 4. In other words, our code is optimal for the code length.


title: Stacked Boosters Network Architecture for Short Term Load Forecasting in Buildings

abstract: This paper presents a novel deep learning architecture for short term load forecasting of building energy loads. The architecture is based on a simple base learner and multiple boosting systems that are modelled as a single deep neural network. The architecture transforms the original multivariate time series into multiple cascading univariate time series. Together with sparse interactions, parameter sharing and equivariant representations, this approach makes it possible to combat against overfitting while still achieving good presentation power with a deep network architecture. The architecture is evaluated in several short-term load forecasting tasks with energy data from an office building in Finland. The proposed architecture outperforms state-of-the-art load forecasting model in all the tasks.


title: Color representations of Ising models

abstract: In \cite{st2017}, the authors introduced the so-called \emph{general divide and color models}. One of the most well-known examples of such a model is the Ising model with external field $h = 0$, which has a color representation given by the random cluster model. In this paper, we give necessary and sufficient conditions for this color representation to be unique. We also show that if one considers the Ising model on a complete graph, then for many $h > 0$, there is no color representation. This shows in particular that any generalization of the random cluster model which provides color representations of Ising models with external fields cannot, in general, be a generalized divide and color models. Furthermore, we show that there can be at most finitely many $\beta > 0$ at which the random cluster model can be continuously extended to a color representation for $h \not = 0$.


title: Some oscillatory representations of fuzzy conformal group SU(2,2) with positive energy

abstract: We construct the relativistic fuzzy space as a non-commutative algebra of functions with purely structural and abstract coordinates being the creaction and annihilation (C/A) operators acting on a Hilbert space $\mathcal{H}_F$. Using these oscillators, we represent the conformal algebra $su(2,2)$ (containing the operators describing physical observables, that generate boosts, rotations, spatial and conformal translations, and dilatation) by operators acting on such functions and reconstruct an auxiliary Hilbert space $\mathcal{H}_A$ to describe this action. We then analyze states on such space and prove them to be boost-invariant. Eventually, we construct two classes of irreducible representations of $su(2,2)$ algebra with \textit{half-integer} dimension $d$ ([1]): (i) the classical fuzzy massless fields as a doubleton representation of the $su(2,2)$ constructed from one set of C/A operators in fundamental or unitary inequivalent dual representation and (ii) classical fuzzy massive fields as a direct product of two doubleton representations constructed from two sets of C/A operators that are in the fundamental and dual representation of the algebra respectively.


title: A Greedy algorithm for local heating

abstract: This paper studies a planning problem for supplying hot water in domestic environment. Hereby, boilers (e.g. gas or electric boilers, heat pumps or microCHPs) are used to heat water and store it for domestic demands. We consider a simple boiler which is either turned on or turned off and is connected to a buffer of limited capacity. The energy needed to run the boiler has to be bought e.g. on a day-ahead market, so we are interested in a planning which minimizes the cost to supply the boiler with energy in order to fulfill the given heat demand. We present a greedy algorithm for this heating problem whose time complexity is O(T {\alpha}(T )) where T is the number of time intervals and {\alpha} is the inverse of Ackermann function.


title: Amidst data-driven model reduction and control

abstract: In this note, we explore a middle ground between data-driven model reduction and data-driven control. In particular, we use snapshots collected from the system to build reduced models that can be expressed in terms of data. We illustrate how the derived family of reduced models can be used for data-driven control of the original system under suitable conditions. Finding a control law that stabilizes certain solutions of the original system as well as the one that reaches any desired state in final time are studied in detail.


title: First all-sky search for continuous gravitational-wave signals from unknown neutron stars in binary systems using Advanced LIGO data

abstract: Rotating neutron stars can emit continuous gravitational waves, which have not yet been detected. We present a search for continuous gravitational waves from unknown neutron stars in binary systems with orbital period between 15 and 45 days. This is the first time that Advanced LIGO data and the recently developed BinarySkyHough pipeline have been used in a search of this kind. No detections are reported, and upper limits on the gravitational wave amplitude are calculated, which improve the previous results by a factor of 17.


abstract: Automatically learning thematic clusters in network data has long been a challenging task in machine learning community. A number of approaches have been proposed to accomplish it, utilizing edges, vertex features, or both aforementioned. However, few of them consider how the quantification of dichotomous inclination w.r.t. network topology and vertex features may influence vertex-cluster preferences, which deters previous methods from uncovering more interpretable latent groups in network data. To fill this void, we propose a novel probabilistic model, dubbed Relational Thematic Clustering with Mutually Preferred Neighbors (RTCMPN). Different from prevalent approaches which predetermine the learning significance of edge structure and vertex features, RTCMPN can further learn the latent preferences indicating which neighboring vertices are more possible to be in the same cluster, and the dichotomous inclinations describing how relative significance w.r.t. edge structure and vertex features may impact the association between pairwise vertices. Therefore, cluster structure implanted with edge structure, vertex features, neighboring preferences, and vertex-vertex dichotomous inclinations can be learned by RTCMPN. We additionally derive an effective Expectation-Maximization algorithm for RTCMPN to infer the optimal model parameters. RTCMPN has been compared with several strong baselines on various network data. The remarkable results validate the effectiveness of RTCMPN.


title: Can current experimental data exclude non-Gaussian genuine band shapes in ultraviolet photoelectron spectra of the hydrated electron?

abstract: Two recent articles present results that allegedly exclude a possible multimodal distribution of the hydrated electron in ultraviolet photoelectron spectra. The first article bases its conclusion on the assumption that the non-Gaussian genuine band shape previously retrieved for the solvated electron in liquid water is an artefact arising from insufficient electron scattering cross sections used in the retrieval. The second article excludes a multimodal band shape based on a photoelectron spectrum of the solvated electron in water clusters recorded at a single ultraviolet photon energy, and it further assumes that cluster results are transferable to the liquid without further justification. Here, we show that based on current data multimodal distributions cannot be unambiguously excluded. Furthermore, the transferability of cluster results to the liquid can neither be justified nor refuted on the basis of currently available experimental ultraviolet photoelectron spectra.


title: Semiclassical Approach to Photophysics Beyond Kasha's Rule and Vibronic Spectroscopy Beyond the Condon Approximation. The Case of Azulene

abstract: Azulene is a prototypical molecule with an anomalous fluorescence from the second excited electronic state, thus violating Kasha's rule, and with an emission spectrum that cannot be understood within the Condon approximation. To better understand photophysics and spectroscopy of azulene and other non-conventional molecules, we develop a systematic, general, and efficient computational approach combining semiclassical dynamics of nuclei with ab initio electronic structure. First, to analyze the nonadiabatic effects, we complement the standard population dynamics by a rigorous measure of adiabaticity, estimated with the multiple-surface dephasing representation. Second, we propose a new semiclassical method for simulating non-Condon spectra, which combines the extended thawed Gaussian approximation with the efficient single-Hessian approach. S$_{1} \leftarrow$ S$_0$ and S$_{2} \leftarrow$ S$_0$ absorption and S$_{2} \rightarrow$ S$_0$ emission spectra of azulene, recorded in a new set of experiments, agree very well with our calculations. We find that accuracy of the evaluated spectra requires the treatment of anharmonicity, Herzberg--Teller, and mode-mixing effects.


title: A Unified Optimization Framework for Low-Rank Inducing Penalties

abstract: In this paper we study the convex envelopes of a new class of functions. Using this approach, we are able to unify two important classes of regularizers from unbiased non-convex formulations and weighted nuclear norm penalties. This opens up for possibilities of combining the best of both worlds, and to leverage each methods contribution to cases where simply enforcing one of the regularizers are insufficient. We show that the proposed regularizers can be incorporated in standard splitting schemes such as Alternating Direction Methods of Multipliers (ADMM), and other subgradient methods. Furthermore, we provide an efficient way of computing the proximal operator. Lastly, we show on real non-rigid structure-from-motion (NRSfM) datasets, the issues that arise from using weighted nuclear norm penalties, and how this can be remedied using our proposed method.


title: Arc-routing for winter road maintenance

abstract: The arc-routing problems are known to be notoriously hard. We study here a natural arc-routing problem on trees and more generally on bounded tree-width graphs and surprisingly show that it can be solved in a polynomial time. This implies a sub-exponential algorithm for the planar graphs and small number of maintaining cars, which is of practical relevance.


title: Sorting Permutations with Fixed Pinnacle Set

abstract: We give a positive answer to a question raised by Davis et al. ({\em Discrete Mathematics} 341, 2018), concerning permutations with the same pinnacle set. Given $\pi\in S_n$, a {\em pinnacle} of $\pi$ is an element $\pi_i$ ($i\neq 1,n$) such that $\pi_{i-1}<\pi_i>\pi_{i+1}$. The question is: given $\pi,\pi'\in S_n$ with the same pinnacle set $S$, is there a sequence of operations that transforms $\pi$ into $\pi'$ such that all the intermediate permutations have pinnacle set $S$? We introduce {\em balanced reversals}, defined as reversals that do not modify the pinnacle set of the permutation to which they are applied. Then we show that $\pi$ may be sorted by balanced reversals (i.e. transformed into a standard permutation $\Id_S$), implying that $\pi$ may be transformed into $\pi'$ using at most $4n-2\min\{p,3\}$ balanced reversals, where $p=|S|\geq 1$. In case $p=0$, at most $2n-1$ balanced reversals are needed.


title: Roughness-induced friction in liquid foams

abstract: Complex liquids flow is known to be drastically affected by the roughness condition at the interfaces. We combined stresses measurements and observations of the flow during the motion of different rough surfaces in dry liquid foams. We visually show that three distinct friction regimes exists: slippage, stick-slip motion, and anchored soap films. Our stress measurements are validated for slippage and anchored regimes based on existing models, and we propose a leverage rule to describe the stresses during the stick-slip regime. We find that the occurrence of the stick-slip or anchored regimes is controlled by the roughness factor, defined as the ratio between the size of the surface asperities and the radius of curvature of the Plateau borders.


title: Arrangements of Approaching Pseudo-Lines

abstract: We consider arrangements of $n$ pseudo-lines in the Euclidean plane where each pseudo-line $\ell_i$ is represented by a bi-infinite connected $x$-monotone curve $f_i(x)$, $x \in \mathbb{R}$, s.t.\ for any two pseudo-lines $\ell_i$ and $\ell_j$ with $i < j$, the function $x \mapsto f_j(x) - f_i(x)$ is monotonically decreasing and surjective (i.e., the pseudo-lines approach each other until they cross, and then move away from each other). We show that such \emph{arrangements of approaching pseudo-lines}, under some aspects, behave similar to arrangements of lines, while for other aspects, they share the freedom of general pseudo-line arrangements. For the former, we prove: 1. There are arrangements of pseudo-lines that are not realizable with approaching pseudo-lines. 2. Every arrangement of approaching pseudo-lines has a dual generalized configuration of points with an underlying arrangement of approaching pseudo-lines. For the latter, we show: 1. There are $2^{\Theta(n^2)}$ isomorphism classes of arrangements of approaching pseudo-lines (while there are only $2^{\Theta(n \log n)}$ isomorphism classes of line arrangements). 2. It can be decided in polynomial time whether an allowable sequence is realizable by an arrangement of approaching pseudo-lines. Furthermore, arrangements of approaching pseudo-lines can be transformed into each other by flipping triangular cells, i.e., they have a connected flip graph, and every bichromatic arrangement of this type contains a bichromatic triangular cell.


title: Supermassive Black Holes in the Early Universe

abstract: The discovery of high redshift quasars represents a challenge to the origin of supermassive black holes. Here, two evolutionary scenarios are considered. The first one concerns massive black holes in the local universe, which in a large majority have been formed by the growth of seeds as their host galaxies are assembled in accordance with the hierarchical picture. In the second scenario, seeds with masses around 100-150 M? grow by accretion of gas forming a non-steady massive disk, whose existence is supported by the detection of huge amounts of gas and dust in high-z quasars. These models of non-steady self-gravitating disks explain quite well the observed "Luminosity-Mass" relation of quasars at high-z, indicating also that these objects do not radiate at the so-called Eddington limit.


title: Giant optical nonlinearity in single silicon nanostructure: ultrasmall all-optical switch and super-resolution imaging

abstract: Silicon photonics has attracted significant interest in recent years due to its potential in integrated photonics components (1,2) as well as all-dielectric meta-optics elements.(3) Strong photon-photon interactions, aka optical nonlinearity, realizes active control of aforementioned photonic devices.(4,5) However, intrinsic nonlinearity of Si is too weak to envision practical applications. To boost the nonlinear response, long interaction-length structures such as waveguides, or resonant structures such as microring resonators or photonic crystals have been adopted.(6,7) Nevertheless, their feature sizes are typically larger than 10 $\mu$m, much larger than their electronic counterparts. Here we discover, when reducing the size of Si resonator down to ~100 nm, a giant photothermal nonlinearity that yields 400% reversible and repeatable deviation from linear scattering response at low excitation intensity (mW/$\mu$m$^2$). The equivalent nonlinear index n$_2$ at nanoscale is five-order larger than that of bulk, due to Mie resonance enhanced absorption and high-efficiency heating in the thermally isolated nanostructure. In addition, the nanoscale thermal relaxation time reaches nanosecond, implying GHz modulation speed. This large and fast nonlinearity enables applications toward all-optical control in nanoscale, as well as super-resolution imaging of silicon.


title: In-situ switchback formation in the expanding solar wind

abstract: Recent near-sun solar-wind observations from Parker Solar Probe have found a highly dynamic magnetic environment, permeated by abrupt radial-field reversals, or "switchbacks." We show that many features of the observed turbulence are reproduced by a spectrum of Alfv\'enic fluctuations advected by a radially expanding flow. Starting from simple superpositions of low-amplitude outward-propagating waves, our expanding-box compressible MHD simulations naturally develop switchbacks because (i) the normalized amplitude of waves grows due to expansion and (ii) fluctuations evolve towards spherical polarization (i.e., nearly constant field strength). These results suggest that switchbacks form in-situ in the expanding solar wind and are not indicative of impulsive processes in the chromosphere or corona.


title: Overcoming the curse of dimensionality for approximating Lyapunov functions with deep neural networks under a small-gain condition

abstract: We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dimension, i.e., the proposed approach is able to overcome the curse of dimensionality.


title: Thomas Decomposition and Nonlinear Control Systems

abstract: This paper applies the Thomas decomposition technique to nonlinear control systems, in particular to the study of the dependence of the system behavior on parameters. Thomas' algorithm is a symbolic method which splits a given system of nonlinear partial differential equations into a finite family of so-called simple systems which are formally integrable and define a partition of the solution set of the original differential system. Different simple systems of a Thomas decomposition describe different structural behavior of the control system in general. The paper gives an introduction to the Thomas decomposition method and shows how notions such as invertibility, observability and flat outputs can be studied. A Maple implementation of Thomas' algorithm is used to illustrate the techniques on explicit examples.


title: Information set decoding of Lee-metric codes over finite rings

abstract: Information set decoding (ISD) algorithms are the best known procedures to solve the decoding problem for general linear codes. These algorithms are hence used for codes without a visible structure, or for which efficient decoders exploiting the code structure are not known. Classically, ISD algorithms have been studied for codes in the Hamming metric. In this paper we switch from the Hamming metric to the Lee metric, and study ISD algorithms and their complexity for codes measured with the Lee metric over finite rings.


title: Miyamoto groups of code algebras

abstract: A code algebra $A_C$ is a nonassociative commutative algebra defined via a binary linear code $C$. In a previous paper, we classified when code algebras are $\mathbb{Z}_2$-graded axial (decomposition) algebras generated by small idempotents. In this paper, for each algebra in our classification, we obtain the Miyamoto group associated to the grading. We also show that the code algebra structure can be recovered from the axial decomposition algebra structure.


title: Linking Bank Clients using Graph Neural Networks Powered by Rich Transactional Data

abstract: Financial institutions obtain enormous amounts of data about user transactions and money transfers, which can be considered as a large graph dynamically changing in time. In this work, we focus on the task of predicting new interactions in the network of bank clients and treat it as a link prediction problem. We propose a new graph neural network model, which uses not only the topological structure of the network but rich time-series data available for the graph nodes and edges. We evaluate the developed method using the data provided by a large European bank for several years. The proposed model outperforms the existing approaches, including other neural network models, with a significant gap in ROC AUC score on link prediction problem and also allows to improve the quality of credit scoring.


title: Editorial for the Special Issue "Progress in Group Field Theory and Related Quantum Gravity Formalisms"

abstract: This Editorial introduces the Special Issue "Progress in Group Field Theory and Related Quantum Gravity Formalisms" which includes a number of research and review articles covering results in the group field theory (GFT) formalism for quantum gravity and in various neighbouring areas of quantum gravity research. We give a brief overview of the basic ideas of the GFT formalism, list some of its connections to other fields, and then summarise all contributions to the Special Issue.


title: Statistical Analysis and Information Theory of Screened Kratzer-Hellmann Potential Model

abstract: In this research, the radial Schrodinger equation for a newly proposed screened Kratzer-Hellmann potential model was studied via the conventional Nikiforov-Uvarov method. The approximate bound state solution of the Schrodinger equation was obtained using the Greene-Aldrich approximation, in addition to the normalized eigenfunction for the new potential model both analytically and numerically. These results were employed to evaluate the rotational-vibrational partition function and other thermodynamic properties for the screened Kratzer-Hellmann potential. We have discussed the results obtained graphically. Also, the normalized eigenfunction has been used to calculate some information-theoretic measures including Shannon entropy and Fisher information for low lying states in both position and momentum spaces numerically. We observed that the Shannon entropy results agreed with the Bialynicki-Birula and Mycielski inequality, while the Fisher information results obtained agreed with the Stam, Crammer-Rao inequality. From our results, we observed alternating increasing and decreasing localization across the screening parameter in the both eigenstates.


title: Spatial Control of Localized Oscillations in Arrays of Coupled Laser Dimers

abstract: Arrays of coupled semiconductor lasers are systems possessing radically complex dynamics that makes them useful for numerous applications in beam forming and beam shaping. In this work, we investigate the spatial controllability of oscillation amplitudes in an array of coupled photonic dimers, each consisting of two semiconductor lasers driven by differential pumping rates. We consider parameter values for which each dimer's stable phase-locked state has become unstable through a Hopf bifurcation and we show that, by assigning appropriate pumping rate values to each dimer, large-amplitude oscillations coexist with negligibly small amplitude oscillations. The spatial profile? of the amplitude of oscillations across the array can be dynamically controlled by appropriate pumping rate values in each dimer. This feature is shown to be quite robust, even for random detuning between the lasers, and suggests a mechanism for dynamically reconfigurable production of a large diversity of spatial profiles of laser amplitude oscillations.


title: On the Hauck-Donner Effect in Wald Tests: Detection, Tipping Points, and Parameter Space Characterization

abstract: The Wald test remains ubiquitous in statistical practice despite shortcomings such as its inaccuracy in small samples and lack of invariance under reparameterization. This paper develops on another but lesser-known shortcoming called the Hauck--Donner effect (HDE) whereby a Wald test statistic is not monotonely increasing as a function of increasing distance between the parameter estimate and the null value. Resulting in an upward biased $p$-value and loss of power, the aberration can lead to very damaging consequences such as in variable selection. The HDE afflicts many types of regression models and corresponds to estimates near the boundary of the parameter space. This article presents several new results, and its main contributions are to (i) propose a very general test for detecting the HDE, regardless of its underlying cause; (ii) fundamentally characterize the HDE by pairwise ratios of Wald and Rao score and likelihood ratio test statistics for 1-parameter distributions; (iii) show that the parameter space may be partitioned into an interior encased by 5 HDE severity measures (faint, weak, moderate, strong, extreme); (iv) prove that a necessary condition for the HDE in a 2 by 2 table is a log odds ratio of at least 2; (v) give some practical guidelines about HDE-free hypothesis testing. Overall, practical post-fit tests can now be conducted potentially to any model estimated by iteratively reweighted least squares, such as the generalized linear model (GLM) and Vector GLM (VGLM) classes, the latter which encompasses many popular regression models.


title: Effects of the institutional change based on democratization on origin and diffusion of technological innovation

abstract: Political systems shape institutions and govern institutional change supporting economic performance, production and diffusion of technological innovation. This study shows, using global data of countries, that institutional change, based on a progressive democratization of countries, is a driving force of inventions, adoption and diffusion of innovations in society. The relation between technological innovation and level of democracy can be explained with following factors: higher economic freedom in society, effective regulation, higher economic and political stability, higher investments in R&D and higher education, good economic governance and higher level of education system for training high-skilled human resources. Overall, then, the positive associations between institutional change, based on a process of democratization, and paths of technological innovation can sustain best practices of political economy for the development of economies in the presence of globalization and geographical expansion of markets.


title: CEFIoT: A Fault-Tolerant IoT Architecture for Edge and Cloud

abstract: Internet of Things (IoT), the emerging computing infrastructure that refers to the networked interconnection of physical objects, incorporates a plethora of digital systems that are being developed by means of a large number of applications. Many of these applications administer data collection on the edge and offer data storage and analytics capabilities in the cloud. This raises the following problems: (i) the processing stages in IoT applications need to have separate implementations for both the edge and the cloud, (ii) the placement of computation is inflexible with separate software stacks, as the optimal deployment decisions need to be made at runtime, and (iii) unified fault tolerance is essential in case of intermittent long-distance network connectivity problems, malicious harming of edge devices, or harsh environments. This paper proposes a novel fault-tolerant architecture CEFIoT for IoT applications by adopting state-of-the-art cloud technologies and deploying them also for edge computing. We solve the data fault tolerance issue by exploiting the Apache Kafka publish/subscribe platform as the unified high-performance data replication solution offering a common software stack for both the edge and the cloud. We also deploy Kubernetes for fault-tolerant management and the advanced functionality allowing on-the-fly automatic reconfiguration of the processing pipeline to handle both hardware and network connectivity based failures.


title: Fast, Compact and Highly Scalable Visual Place Recognition through Sequence-based Matching of Overloaded Representations

abstract: Visual place recognition algorithms trade off three key characteristics: their storage footprint, their computational requirements, and their resultant performance, often expressed in terms of recall rate. Significant prior work has investigated highly compact place representations, sub-linear computational scaling and sub-linear storage scaling techniques, but have always involved a significant compromise in one or more of these regards, and have only been demonstrated on relatively small datasets. In this paper we present a novel place recognition system which enables for the first time the combination of ultra-compact place representations, near sub-linear storage scaling and extremely lightweight compute requirements. Our approach exploits the inherently sequential nature of much spatial data in the robotics domain and inverts the typical target criteria, through intentionally coarse scalar quantization-based hashing that leads to more collisions but is resolved by sequence-based matching. For the first time, we show how effective place recognition rates can be achieved on a new very large 10 million place dataset, requiring only 8 bytes of storage per place and 37K unitary operations to achieve over 50% recall for matching a sequence of 100 frames, where a conventional state-of-the-art approach both consumes 1300 times more compute and fails catastrophically. We present analysis investigating the effectiveness of our hashing overload approach under varying sizes of quantized vector length, comparison of near miss matches with the actual match selections and characterise the effect of variance re-scaling of data on quantization.


title: The Pushshift Reddit Dataset

abstract: Social media data has become crucial to the advancement of scientific understanding. However, even though it has become ubiquitous, just collecting large-scale social media data involves a high degree of engineering skill set and computational resources. In fact, research is often times gated by data engineering problems that must be overcome before analysis can proceed. This has resulted recognition of datasets as meaningful research contributions in and of themselves. Reddit, the so called "front page of the Internet," in particular has been the subject of numerous scientific studies. Although Reddit is relatively open to data acquisition compared to social media platforms like Facebook and Twitter, the technical barriers to acquisition still remain. Thus, Reddit's millions of subreddits, hundreds of millions of users, and hundreds of billions of comments are at the same time relatively accessible, but time consuming to collect and analyze systematically. In this paper, we present the Pushshift Reddit dataset. Pushshift is a social media data collection, analysis, and archiving platform that since 2015 has collected Reddit data and made it available to researchers. Pushshift's Reddit dataset is updated in real-time, and includes historical data back to Reddit's inception. In addition to monthly dumps, Pushshift provides computational tools to aid in searching, aggregating, and performing exploratory analysis on the entirety of the dataset. The Pushshift Reddit dataset makes it possible for social media researchers to reduce time spent in the data collection, cleaning, and storage phases of their projects.


title: Equivalent Ensembles, Turbulence and Fluctuation Theorem

abstract: Stationary states of Navier-Stokes fluids have been proposed to be described equivalently by several alternative equations, besides the NS equation itself. In particular equivalence between the NS evolution and a reversible. It is natural to test whether, assuming the Chaotic Hypothesis, the Fluctuation Theorem can be applied to the reversible flows. Here an example is provided which also leads to the possibility of testing the prediction of the fluctuation theorem even in systems evolving irreversibly.


title: Multi-objective Neural Architecture Search via Non-stationary Policy Gradient

abstract: Multi-objective Neural Architecture Search (NAS) aims to discover novel architectures in the presence of multiple conflicting objectives. Despite recent progress, the problem of approximating the full Pareto front accurately and efficiently remains challenging. In this work, we explore the novel reinforcement learning (RL) based paradigm of non-stationary policy gradient (NPG). NPG utilizes a non-stationary reward function, and encourages a continuous adaptation of the policy to capture the entire Pareto front efficiently. We introduce two novel reward functions with elements from the dominant paradigms of scalarization and evolution. To handle non-stationarity, we propose a new exploration scheme using cosine temperature decay with warm restarts. For fast and accurate architecture evaluation, we introduce a novel pre-trained shared model that we continuously fine-tune throughout training. Our extensive experimental study with various datasets shows that our framework can approximate the full Pareto front well at fast speeds. Moreover, our discovered cells can achieve supreme predictive performance compared to other multi-objective NAS methods, and other single-objective NAS methods at similar network sizes. Our work demonstrates the potential of NPG as a simple, efficient, and effective paradigm for multi-objective NAS.


title: The Pushshift Telegram Dataset

abstract: Messaging platforms, especially those with a mobile focus, have become increasingly ubiquitous in society. These mobile messaging platforms can have deceivingly large user bases, and in addition to being a way for people to stay in touch, are often used to organize social movements, as well as a place for extremists and other ne'er-do-well to congregate. In this paper, we present a dataset from one such mobile messaging platform: Telegram. Our dataset is made up of over 27.8K channels and 317M messages from 2.2M unique users. To the best of our knowledge, our dataset comprises the largest and most complete of its kind. In addition to the raw data, we also provide the source code used to collect it, allowing researchers to run their own data collection instance. We believe the Pushshift Telegram dataset can help researchers from a variety of disciplines interested in studying online social movements, protests, political extremism, and disinformation.