title: A beginner's guide to non-abelian iPEPS for correlated fermions

abstract: Infinite projected entangled pair states (iPEPS) have emerged as a powerful tool for studying interacting two-dimensional fermionic systems. In this review, we discuss the iPEPS construction and some basic properties of this tensor network (TN) ansatz. Special focus is put on (i) a gentle introduction of the diagrammatic TN representations forming the basis for deriving the complex numerical algorithm, and (ii) the technical advance of fully exploiting non-abelian symmetries for fermionic iPEPS treatments of multi-band lattice models. The exploitation of non-abelian symmetries substantially increases the performance of the algorithm, enabling the treatment of fermionic systems up to a bond dimension $D=24$ on a square lattice. A variety of complex two-dimensional (2D) models thus become numerically accessible. Here, we present first promising results for two types of multi-band Hubbard models, one with $2$ bands of spinful fermions of $\mathrm{SU}(2)_\mathrm{spin} \otimes \mathrm{SU}(2)_\mathrm{orb}$ symmetry, the other with $3$ flavors of spinless fermions of $\mathrm{SU}(3)_\mathrm{flavor}$ symmetry.


title: The existence and utility of Giry algebras in probability theory

abstract: Giry algebras are barycenters maps, which are coequalizers of contractible coequalizer pairs (like any algebras), and their existence, in general, requires the measurable space be coseparated by the discrete two point space, and the hypothesis that no measurable cardinals exist. Under that hypothesis, every measurable space which is coseparated has an algebra, and the category of Giry algebras provides a convenient setting for probability theory because it is a symmetric monoidal closed category with all limits and colimits, as well as having a seperator and coseperator. This is in stark contrast to the Kleisi category of the Giry monad, which is often used to model conditional probability, which has a seperator but not much else.


title: Towards Sealed Resistive Plate Chambers

abstract: The mitigation of human-induced climate change is of crucial importance for the sustainability of humankind. For this aim the RPC community has exerted considerable effort over the last decade to reduce the emission of greenhouse gases from our detectors. These included searching for new eco-friendly gases, implementing recovery and/or recirculation systems, improving gastightness and using new materials and approaches in detector conception and operation for the reduction of gas flow rates. Along this line of work, we present here an RPC architecture aimed at a dramatic reduction of gas use in chambers meant for low-rate operation. Two chambers were tested for more than six months with zero gas flow showing no evidence of time-related effects, allowing to consider that permanently sealed RPCs may be within reach, with obvious practical and environmental advantages.


title: Robust Locality-Aware Regression for Labeled Data Classification

abstract: With the dramatic increase of dimensions in the data representation, extracting latent low-dimensional features becomes of the utmost importance for efficient classification. Aiming at the problems of unclear margin representation and difficulty in revealing the data manifold structure in most of the existing linear discriminant methods, we propose a new discriminant feature extraction framework, namely Robust Locality-Aware Regression (RLAR). In our model, we introduce a retargeted regression to perform the marginal representation learning adaptively instead of using the general average inter-class margin. Besides, we formulate a new strategy for enhancing the local intra-class compactness of the data manifold, which can achieve the joint learning of locality-aware graph structure and desirable projection matrix. To alleviate the disturbance of outliers and prevent overfitting, we measure the regression term and locality-aware term together with the regularization term by the L2,1 norm. Further, forcing the row sparsity on the projection matrix through the L2,1 norm achieves the cooperation of feature selection and feature extraction. Then, we derive an effective iterative algorithm for solving the proposed model. The experimental results over a range of UCI data sets and other benchmark databases demonstrate that the proposed RLAR outperforms some state-of-the-art approaches.


title: Sub-elliptic boundary value problems in flag domains

abstract: A flag domain in $\mathbb{R}^{3}$ is a subset of $\mathbb{R}^{3}$ of the form $\{(x,y,t) : y < A(x)\}$, where $A \colon \mathbb{R} \to \mathbb{R}$ is a Lipschitz function. We solve the Dirichlet and Neumann problems for the sub-elliptic Kohn-Laplacian $\bigtriangleup^{\flat} = X^{2} + Y^{2}$ in flag domains $\Omega \subset \mathbb{R}^{3}$, with $L^{2}$-boundary values. We also obtain improved regularity for solutions to the Dirichlet problem if the boundary values have first order $L^{2}$-Sobolev regularity. Our solutions are obtained as sub-elliptic single and double layer potentials, which are best viewed as integral operators on the first Heisenberg group. We develop the theory of these operators on flag domains, and their boundaries.


title: Pyramid wavefront sensor optical gains compensation using a convolutional model

abstract: Extremely Large Telescopes have overwhelmingly opted for the Pyramid wavefront sensor (PyWFS) over the more widely used Shack-Hartmann WaveFront Sensor (SHWFS) to perform their Single Conjugate Adaptive Optics (SCAO) mode. The PyWFS, a sensor based on Fourier filtering, has proven to be highly successful in many astronomy applications. However, it exhibits non-linearity behaviors that lead to a reduction of its sensitivity when working with non-zero residual wavefronts. This so-called Optical Gains (OG) effect, degrades the close loop performance of SCAO systems and prevents accurate correction of Non-Common Path Aberrations (NCPA). In this paper, we aim at computing the OG using a fast and agile strategy in order to control the PyWFS measurements in adaptive optics closed loop systems. Using a novel theoretical description of the PyFWS, which is based on a convolutional model, we are able to analytically predict the behavior of the PyWFS in closed-loop operation. This model enables us to explore the impact of residual wavefront error on particular aspects such as sensitivity and associated OG. The proposed method relies on the knowledge of the residual wavefront statistics and enables automatic estimation of the current OG. End-to-End numerical simulations are used to validate our predictions and test the relevance of our approach. We demonstrate, using on non-invasive strategy, that our method provides an accurate estimation of the OG. The model itself only requires AO telemetry data to derive statistical information on atmospheric turbulence. Furthermore, we show that by only using an estimation of the current Fried parameter r_0 and the basic system-level characteristics, OGs can be estimated with an accuracy of less than 10%. Finally, we highlight the importance of OG estimation in the case of NCPA compensation. The proposed method is applied to the PyWFS.


title: Efficient Reasoning in Regular Boardgames

abstract: We present the technical side of reasoning in Regular Boardgames (RBG) language -- a universal General Game Playing (GGP) formalism for the class of finite deterministic games with perfect information, encoding rules in the form of regular expressions. RBG serves as a research tool that aims to aid in the development of generalized algorithms for knowledge inference, analysis, generation, learning, and playing games. In all these tasks, both generality and efficiency are important. In the first part, this paper describes optimizations used by the RBG compiler. The impact of these optimizations ranges from 1.7 to even 33-fold efficiency improvement when measuring the number of possible game playouts per second. Then, we perform an in-depth efficiency comparison with three other modern GGP systems (GDL, Ludii, Ai Ai). We also include our own highly optimized game-specific reasoners to provide a point of reference of the maximum speed. Our experiments show that RBG is currently the fastest among the abstract general game playing languages, and its efficiency can be competitive to common interface-based systems that rely on handcrafted game-specific implementations. Finally, we discuss some issues and methodology of computing benchmarks like this.


title: Deep-CAPTCHA: a deep learning based CAPTCHA solver for vulnerability assessment

abstract: CAPTCHA is a human-centred test to distinguish a human operator from bots, attacking programs, or other computerised agents that tries to imitate human intelligence. In this research, we investigate a way to crack visual CAPTCHA tests by an automated deep learning based solution. The goal of this research is to investigate the weaknesses and vulnerabilities of the CAPTCHA generator systems; hence, developing more robust CAPTCHAs, without taking the risks of manual try and fail efforts. We develop a Convolutional Neural Network called Deep-CAPTCHA to achieve this goal. The proposed platform is able to investigate both numerical and alphanumerical CAPTCHAs. To train and develop an efficient model, we have generated a dataset of 500,000 CAPTCHAs to train our model. In this paper, we present our customised deep neural network model, we review the research gaps, the existing challenges, and the solutions to cope with the issues. Our network's cracking accuracy leads to a high rate of 98.94% and 98.31% for the numerical and the alpha-numerical test datasets, respectively. That means more works is required to develop robust CAPTCHAs, to be non-crackable against automated artificial agents. As the outcome of this research, we identify some efficient techniques to improve the security of the CAPTCHAs, based on the performance analysis conducted on the Deep-CAPTCHA model.


title: Fine-grained Human Evaluation of Transformer and Recurrent Approaches to Neural Machine Translation for English-to-Chinese

abstract: This research presents a fine-grained human evaluation to compare the Transformer and recurrent approaches to neural machine translation (MT), on the translation direction English-to-Chinese. To this end, we develop an error taxonomy compliant with the Multidimensional Quality Metrics (MQM) framework that is customised to the relevant phenomena of this translation direction. We then conduct an error annotation using this customised error taxonomy on the output of state-of-the-art recurrent- and Transformer-based MT systems on a subset of WMT2019's news test set. The resulting annotation shows that, compared to the best recurrent system, the best Transformer system results in a 31% reduction of the total number of errors and it produced significantly less errors in 10 out of 22 error categories. We also note that two of the systems evaluated do not produce any error for a category that was relevant for this translation direction prior to the advent of NMT systems: Chinese classifiers.


title: Bubble dynamics in a strong first-order quark-hadron transition

abstract: We investigate the dynamics of a strong first-order quark-hadron transition driven by cubic interaction via homogeneous bubble nucleation in the Friedberg-Lee model. The one-loop effective thermodynamics potential of the model and the critical bubble profiles have been calculated at different temperatures and chemical potentials. By taking the temperature and the chemical potential as the variables, the evolutions of the surface tension, the typical radius of the critical bubble and the shift in the coarse-grained free energy in the presence of a nucleation bubble are obtained and the limit on the reliability of the thin-wall approximation is also addressed accordingly. Our results are compared to those obtained for a weak first-order quark-hadron phase transition, especially the spinodal decomposition is relevant.


title: Cryptotree: fast and accurate predictions on encrypted structured data

abstract: Applying machine learning algorithms to private data, such as financial or medical data, while preserving their confidentiality, is a difficult task. Homomorphic Encryption (HE) is acknowledged for its ability to allow computation on encrypted data, where both the input and output are encrypted, which therefore enables secure inference on private data. Nonetheless, because of the constraints of HE, such as its inability to evaluate non-polynomial functions or to perform arbitrary matrix multiplication efficiently, only inference of linear models seem usable in practice in the HE paradigm so far. In this paper, we propose Cryptotree, a framework that enables the use of Random Forests (RF), a very powerful learning procedure compared to linear regression, in the context of HE. To this aim, we first convert a regular RF to a Neural RF, then adapt this to fit the HE scheme CKKS, which allows HE operations on real values. Through SIMD operations, we are able to have quick inference and prediction results better than the original RF on encrypted data.


title: A Generalized Gaussian Extension to the Rician Distribution for SAR Image Modeling

abstract: In this paper, we present a novel statistical model, $\textit{the generalized-Gaussian-Rician}$ (GG-Rician) distribution, for the characterization of synthetic aperture radar (SAR) images. Since accurate statistical models lead to better results in applications such as target tracking, classification, or despeckling, characterizing SAR images of various scenes including urban, sea surface, or agricultural, is essential. The proposed statistical model is based on the Rician distribution to model the amplitude of a complex SAR signal, the in-phase and quadrature components of which are assumed to be generalized-Gaussian distributed. The proposed amplitude GG-Rician model is further extended to cover the intensity SAR signals. In the experimental analysis, the GG-Rician model is investigated for amplitude and intensity SAR images of various frequency bands and scenes in comparison to state-of-the-art statistical models that include $\mathcal{K}$, Weibull, Gamma, and Lognormal. In order to decide on the most suitable model, statistical significance analysis via Kullback-Leibler divergence and Kolmogorov-Smirnov statistics are performed. The results demonstrate the superior performance and flexibility of the proposed model for all frequency bands and scenes and its applicability on both amplitude and intensity SAR images. The Matlab package is available at https://github.com/oktaykarakus/GG-Rician-SAR-Image-Modelling.


title: On Products of Delta Distributions and Resultants

abstract: We prove an identity in integral geometry, showing that if $P_x$ and $Q_x$ are two polynomials, $\int {\rm d}x\, \delta(P_x) \otimes \delta(Q_x)$ is proportional to $\delta(R)$ where $R$ is the resultant of $P_x$ and $Q_x$.


title: Hypergraph Clustering Based on PageRank

abstract: A hypergraph is a useful combinatorial object to model ternary or higher-order relations among entities. Clustering hypergraphs is a fundamental task in network analysis. In this study, we develop two clustering algorithms based on personalized PageRank on hypergraphs. The first one is local in the sense that its goal is to find a tightly connected vertex set with a bounded volume including a specified vertex. The second one is global in the sense that its goal is to find a tightly connected vertex set. For both algorithms, we discuss theoretical guarantees on the conductance of the output vertex set. Also, we experimentally demonstrate that our clustering algorithms outperform existing methods in terms of both the solution quality and running time. To the best of our knowledge, ours are the first practical algorithms for hypergraphs with theoretical guarantees on the conductance of the output set.


title: Efficient Algorithms for Convolutional Inverse Problems in Multidimensional Imaging

abstract: Multidimensional imaging, capturing image data in more than two dimensions, has been an emerging field with diverse applications. Due to the limitation of two-dimensional detectors in obtaining the high-dimensional image data, computational imaging approaches have been developed to pass on some of the burden to a reconstruction algorithm. In various image reconstruction problems in multidimensional imaging, the measurements are in the form of superimposed convolutions. In this paper, we introduce a general framework for the solution of these problems, called here convolutional inverse problems, and develop fast image reconstruction algorithms with analysis and synthesis priors. These include sparsifying transforms, as well as convolutional or patch-based dictionaries that can adapt to correlations in different dimensions. The resulting optimization problems are solved via alternating direction method of multipliers with closed-form, efficient, and parallelizable update steps. To illustrate their utility and versatility, the developed algorithms are applied to three-dimensional image reconstruction problems in computational spectral imaging for cases with or without correlation along the third dimension. As the advent of multidimensional imaging modalities expands to perform sophisticated tasks, these algorithms are essential for fast iterative reconstruction in various large-scale problems.


title: Physical characterization of 2020 AV2, the first known asteroid orbiting inside Venus orbit

abstract: The first known asteroid with the orbit inside that of Venus is 2020~AV$_{2}$. This may be the largest member of a new population of small bodies with the aphelion smaller than 0.718~au, called Vatiras. The surface of 2020~AV$_{2}$ is being constantly modified by the high temperature, by the strong solar wind irradiation that characterizes the innermost region of the Solar system, and by high-energy micrometeorite impacts. The study of its physical properties represents an extreme test-case for the science of near-Earth asteroids. Here, we report spectroscopic observations of 2020~AV$_{2}$ in the 0.5-1.5~$\mu m$ wavelength interval. These were performed with the Nordic Optical Telescope and the William Herschel Telescope. Based on the obtained spectra, we classify 2020~AV$_{2}$ as a Sa-type asteroid. We estimate the diameter of this Vatira to be $1.50_{-0.65}^{+1.10}$ km by considering the average albedo of A-type and S-complex asteroids ($p_V=0.23_{-0.08}^{+0.11}$), and the absolute magnitude (H=$16.40\pm0.78$ mag). The wide spectral band around 1~$\mu m$ shows the signature of an olivine rich composition. The estimated band centre $BIC = 1.08 \pm 0.02~\mu m$ corresponds to a ferroan olivine mineralogy similar to that of brachinite meteorites.


title: Inner Ensemble Networks: Average Ensemble as an Effective Regularizer

abstract: We introduce Inner Ensemble Networks (IENs) which reduce the variance within the neural network itself without an increase in the model complexity. IENs utilize ensemble parameters during the training phase to reduce the network variance. While in the testing phase, these parameters are removed without a change in the enhanced performance. IENs reduce the variance of an ordinary deep model by a factor of $1/m^{L-1}$, where $m$ is the number of inner ensembles and $L$ is the depth of the model. Also, we show empirically and theoretically that IENs lead to a greater variance reduction in comparison with other similar approaches such as dropout and maxout. Our results show a decrease of error rates between 1.7\% and 17.3\% in comparison with an ordinary deep model. We also show that IEN was preferred by Neural Architecture Search (NAS) methods over prior approaches. Code is available at https://github.com/abduallahmohamed/inner_ensemble_nets.


title: LFD-ProtoNet: Prototypical Network Based on Local Fisher Discriminant Analysis for Few-shot Learning

abstract: The prototypical network (ProtoNet) is a few-shot learning framework that performs metric learning and classification using the distance to prototype representations of each class. It has attracted a great deal of attention recently since it is simple to implement, highly extensible, and performs well in experiments. However, it only takes into account the mean of the support vectors as prototypes and thus it performs poorly when the support set has high variance. In this paper, we propose to combine ProtoNet with local Fisher discriminant analysis to reduce the local within-class covariance and increase the local between-class covariance of the support set. We show the usefulness of the proposed method by theoretically providing an expected risk bound and empirically demonstrating its superior classification accuracy on miniImageNet and tieredImageNet.


title: Hidden Markov Models Applied To Intraday Momentum Trading With Side Information

abstract: A Hidden Markov Model for intraday momentum trading is presented which specifies a latent momentum state responsible for generating the observed securities' noisy returns. Existing momentum trading models suffer from time-lagging caused by the delayed frequency response of digital filters. Time-lagging results in a momentum signal of the wrong sign, when the market changes trend direction. A key feature of this state space formulation, is no such lagging occurs, allowing for accurate shifts in signal sign at market change points. The number of latent states in the model is estimated using three techniques, cross validation, penalized likelihood criteria and simulation-based model selection for the marginal likelihood. All three techniques suggest either 2 or 3 hidden states. Model parameters are then found using Baum-Welch and Markov Chain Monte Carlo, whilst assuming a single (discretized) univariate Gaussian distribution for the emission matrix. Often a momentum trader will want to condition their trading signals on additional information. To reflect this, learning is also carried out in the presence of side information. Two sets of side information are considered, namely a ratio of realized volatilities and intraday seasonality. It is shown that splines can be used to capture statistically significant relationships from this information, allowing returns to be predicted. An Input Output Hidden Markov Model is used to incorporate these univariate predictive signals into the transition matrix, presenting a possible solution for dealing with the signal combination problem. Bayesian inference is then carried out to predict the securities $t+1$ return using the forward algorithm. Simple modifications to the current framework allow for a fully non-parametric model with asynchronous prediction.


title: Fatou and Julia like sets

abstract: For a family of holomorphic functions on an arbitrary domain, we introduce Fatou and Julia like sets, and establish some of their interesting properties.


title: On the dual step length of the alternating direction method of multipliers

abstract: The alternating direction method of multipliers (ADMM) is a most widely used optimization scheme for solving linearly constrained separable convex optimization problems. The convergence of the ADMM can be guaranteed when the dual step length is less than the golden ratio, while plenty of numerical evidence suggests that even larger dual step length often accelerates the convergence. It has also been proved that the dual step length can be enlarged to less than 2 in some special cases, namely, one of the separable functions in the objective function is linear, or both are quadratic plus some additional assumptions. However, it remains unclear whether the golden ratio can be exceeded in the general convex setting. In this paper, the performance estimation framework is used to analyze the convergence of the ADMM, and assisted by numerical and symbolic computations, a counter example is constructed, which indicates that the conventional measure may lose monotonicity as the dual step length exceeds the golden ratio, ruling out the possibility of breaking the golden ratio within this conventional analytic framework.


title: Joint Communications and Sensing: A Comprehensive Study

abstract: Joint communications and sensing (JCS) can improve the efficiency of power, bandwidth and hardware usage. The conflict between communications and sensing is analyzed in terms of bandwidth and power. It is found that the bandwidth is approximately partitioned between communication and sensing, thus making an almost zero-sum game, while the conflict in the power is marginal. The same conclusion holds when the receiver and target are separated. The feasible region and tradeoff boundary of JCS are obtaine.


title: Performance bounds of non-adiabatic quantum harmonic Otto engine and refrigerator under a squeezed thermal reservoir

abstract: We analyze the performance of a quantum Otto cycle, employing time-dependent harmonic oscillator as the working fluid undergoing sudden expansion and compression strokes during the adiabatic stages, coupled to a squeezed reservoir. First, we show that the maximum efficiency that our engine can achieve is 1/2 only, which is in contrast with the earlier studies claiming unit efficiency under the effect of squeezed reservoir. Then, we obtain analytic expressions for the upper bound on the efficiency as well as on the coefficient of performance of the Otto cycle. The obtained bounds are independent of the parameters of the system and depends on the reservoir parameters only. Additionally, with hot squeezed thermal bath, we obtain analytic expression for the efficiency at maximum work which satisfies the derived upper bound. Further, in the presence of squeezing in the cold reservoir, we specify an operational regime for the Otto refrigerator otherwise forbidden in the standard case.


title: Algebraic Ground Truth Inference: Non-Parametric Estimation of Sample Errors by AI Algorithms

abstract: Binary classification is widely used in ML production systems. Monitoring classifiers in a constrained event space is well known. However, real world production systems often lack the ground truth these methods require. Privacy concerns may also require that the ground truth needed to evaluate the classifiers cannot be made available. In these autonomous settings, non-parametric estimators of performance are an attractive solution. They do not require theoretical models about how the classifiers made errors in any given sample. They just estimate how many errors there are in a sample of an industrial or robotic datastream. We construct one such non-parametric estimator of the sample errors for an ensemble of weak binary classifiers. Our approach uses algebraic geometry to reformulate the self-assessment problem for ensembles of binary classifiers as an exact polynomial system. The polynomial formulation can then be used to prove - as an algebraic geometry algorithm - that no general solution to the self-assessment problem is possible. However, specific solutions are possible in settings where the engineering context puts the classifiers close to independent errors. The practical utility of the method is illustrated on a real-world dataset from an online advertising campaign and a sample of common classification benchmarks. The accuracy estimators in the experiments where we have ground truth are better than one part in a hundred. The online advertising campaign data, where we do not have ground truth data, is verified by an internal consistency approach whose validity we conjecture as an algebraic geometry theorem. We call this approach - algebraic ground truth inference.


title: Loop quantum Schwarzschild interior and black hole remnant

abstract: The interior of Schwarzschild black hole is quantized by the method of loop quantum gravity. The Hamiltonian constraint is solved and the physical Hilbert space is obtained in the model. The properties of a Dirac observable corresponding to the ADM mass of the Schwarzschild black hole are studied by both analytical and numerical techniques. It turns out that zero is not in the spectrum of this Dirac observable. This supports the existence of a stable remnant after the evaporation of a black hole. Our conclusion is valid for a general class of schemes adopted for loop quantization of the model.


title: Existential Theory of the Reals Completeness of Stationary Nash Equilibria in Perfect Information Stochastic Games

abstract: We show that the problem of deciding whether in a multi-player perfect information recursive game (i.e. a stochastic game with terminal rewards) there exists a stationary Nash equilibrium ensuring each player a certain payoff is Existential Theory of the Reals complete. Our result holds for acyclic games, where a Nash equilibrium may be computed efficiently by backward induction, and even for deterministic acyclic games with non-negative terminal rewards. We further extend our results to the existence of Nash equilibria where a single player is surely winning. Combining our result with known gadget games without any stationary Nash equilibrium, we obtain that for cyclic games, just deciding existence of any stationary Nash equilibrium is Existential Theory of the Reals complete. This holds for reach-a-set games, stay-in-a-set games, and for deterministic recursive games.


title: Mitigating Gender Bias in Captioning Systems

abstract: Image captioning has made substantial progress with huge supporting image collections sourced from the web. However, recent studies have pointed out that captioning datasets, such as COCO, contain gender bias found in web corpora. As a result, learning models could heavily rely on the learned priors and image context for gender identification, leading to incorrect or even offensive errors. To encourage models to learn correct gender features, we reorganize the COCO dataset and present two new splits COCO-GB V1 and V2 datasets where the train and test sets have different gender-context joint distribution. Models relying on contextual cues will suffer from huge gender prediction errors on the anti-stereotypical test data. Benchmarking experiments reveal that most captioning models learn gender bias, leading to high gender prediction errors, especially for women. To alleviate the unwanted bias, we propose a new Guided Attention Image Captioning model (GAIC) which provides self-guidance on visual attention to encourage the model to capture correct gender visual evidence. Experimental results validate that GAIC can significantly reduce gender prediction errors with a competitive caption quality. Our codes and the designed benchmark datasets are available at https://github.com/datamllab/Mitigating_Gender_Bias_In_Captioning_System.


title: Algebraic Language Theory for Eilenberg--Moore Algebras

abstract: We develop an algebraic language theory based on the notion of an Eilenberg--Moore algebra. In comparison to previous such frameworks the main contribution is the support for algebras with infinitely many sorts and the connection to logic in form of so-called `definable algebras'.


title: Non-interacting black hole binaries with Gaia and LAMOST

abstract: Until recently, black holes (BHs) could be discovered only through accretion from other stars in X-ray binaries, or in merging double compact objects. Improvements in astrometric and spectroscopic measurements have made it possible to detect BHs also in non-interacting BH binaries (nBHB) through a precise analysis of the companion's motion. In this study, using an updated version of the Startrack binary-star population modelling code and a detailed model of the Milky Way (MW) galaxy we calculate the expected number of detections for Gaia and LAMOST surveys. We develop a formalism to convolve the binary population synthesis output with a realistic stellar density distribution, star-formation history (SFH), and chemical evolution for the MW, which produces a probability distribution function of the predicted compact-binary population over the MW. This avoids the additional statistical uncertainty which is introduced by methods which Monte Carlo sample from binary population synthesis output to produce one potential specific realisation of the MW compact-binary distribution, and our method is also comparatively fast to such Monte Carlo realisations. Specifically, we predict $\sim41$-$340$ nBHBs to be observed by Gaia, although the numbers may drop to $\sim10$-$70$ if the recent ($\lesssim100\;$ Myr) star formation is low ($\sim1\;M_\odot$/yr ). For LAMOST we predict $\lesssim14$ detectable nBHBs, which is lower partially because its field-of-view covers just $\sim6\%$ of the Galaxy.


title: The Pair Approximation method for the ferromagnetic Heisenberg model with spin $S=1$ and arbitrary range of interactions. Application for the magnetic semiconductor CrIAs

abstract: The Pair Approximation method has been formulated for the isotropic ferromagnetic Heisenberg model with spin $S=1$. The exchange interactions of arbitrary range have been taken into account. The single-ion anisotropy has been considered as well as the external magnetic field. Within the method, the Gibbs free-energy has been derived, from which all thermodynamic properties can be self-consistently obtained. In order to illustrate the developed formalism, the numerical calculations have been performed for CrIAs planar magnetic semiconductor, a hypothetical material whose existence has been recently predicted by the Density Functional Theory-based calculations. For this model material, all the relevant thermodynamic magnetic properties have been studied. The numerical results have been presented in the figures and discussed.


title: The Metastable Behavior of a Schmitt-Trigger

abstract: Schmitt-Trigger circuits are the method of choice for converting general signal shapes into clean, well-behaved digital ones. In this context these circuits are often used for metastability handling, as well. However, like any other positive feedback circuit, a Schmitt-Trigger can become metastable itself. Therefore, its own metastable behavior must be well understood; in particular the conditions that may cause its metastability. In this paper we will build on existing results from Marino to show that (a) a monotonic input signal can cause late transitions but never leads to a non-digital voltage at the Schmitt-Trigger output, and (b) a non-monotonic input can pin the Schmitt-Trigger output to a constant voltage at any desired (also non-digital) level for an arbitrary duration. In fact, the output can even be driven to any waveform within the dynamic limits of the system. We will base our analysis on a mathematical model of a Schmitt-Trigger's dynamic behavior and perform SPICE simulations to support our theory and confirm its validity for modern CMOS implementations. Furthermore, we will discuss several use cases of a Schmitt-Trigger in the light of our results.


title: Shaken and stirred: When Bond meets Suess-de Vries and Gnevyshev-Ohl

abstract: We argue that the most prominent temporal features of the solar dynamo, in particular the Hale cycle, the Suess-de Vries cycle (associated with variations of the Gnevyshev-Ohl rule), Gleissberg-type cycles, and grand minima can be self-consistently explained by double synchronization with the 11.07-years periodic tidal forcing of the Venus-Earth-Jupiter system and the (mainly) 19.86-years periodic motion of the Sun around the barycenter of the solar system. In our numerical simulation, grand minima, and clusters thereof, emerge as intermittent and non-periodic events on millennial time scales, very similar to the series of Bond events which were observed throughout the Holocene and the last glacial period. If confirmed, such an intermittent transition to chaos would prevent any long-term prediction of solar activity, notwithstanding the fact that the shorter-term Hale and Suess-de Vries cycles are clocked by planetary motion.


title: On the Preservation of Spatio-temporal Information in Machine Learning Applications

abstract: In conventional machine learning applications, each data attribute is assumed to be orthogonal to others. Namely, every pair of dimension is orthogonal to each other and thus there is no distinction of in-between relations of dimensions. However, this is certainly not the case in real world signals which naturally originate from a spatio-temporal configuration. As a result, the conventional vectorization process disrupts all of the spatio-temporal information about the order/place of data whether it be $1$D, $2$D, $3$D, or $4$D. In this paper, the problem of orthogonality is first investigated through conventional $k$-means of images, where images are to be processed as vectors. As a solution, shift-invariant $k$-means is proposed in a novel framework with the help of sparse representations. A generalization of shift-invariant $k$-means, convolutional dictionary learning, is then utilized as an unsupervised feature extraction method for classification. Experiments suggest that Gabor feature extraction as a simulation of shallow convolutional neural networks provides a little better performance compared to convolutional dictionary learning. Many alternatives of convolutional-logic are also discussed for spatio-temporal information preservation, including a spatio-temporal hypercomplex encoding scheme.


title: ORD: Object Relationship Discovery for Visual Dialogue Generation

abstract: With the rapid advancement of image captioning and visual question answering at single-round level, the question of how to generate multi-round dialogue about visual content has not yet been well explored.Existing visual dialogue methods encode the image into a fixed feature vector directly, concatenated with the question and history embeddings to predict the response.Some recent methods tackle the co-reference resolution problem using co-attention mechanism to cross-refer relevant elements from the image, history, and the target question.However, it remains challenging to reason visual relationships, since the fine-grained object-level information is omitted before co-attentive reasoning. In this paper, we propose an object relationship discovery (ORD) framework to preserve the object interactions for visual dialogue generation. Specifically, a hierarchical graph convolutional network (HierGCN) is proposed to retain the object nodes and neighbour relationships locally, and then refines the object-object connections globally to obtain the final graph embeddings. A graph attention is further incorporated to dynamically attend to this graph-structured representation at the response reasoning stage. Extensive experiments have proved that the proposed method can significantly improve the quality of dialogue by utilising the contextual information of visual relationships. The model achieves superior performance over the state-of-the-art methods on the Visual Dialog dataset, increasing MRR from 0.6222 to 0.6447, and recall@1 from 48.48% to 51.22%.


title: iPEPS study of spin symmetry in the doped $t$-$J$ model

abstract: We study the two-dimensional $t$-$J$ model on a square lattice using infinite projected entangled pair states (iPEPS). At small doping, multiple orders, such as antiferromagnetic order, stripe order and superconducting order, are intertwined or compete with each other. We demonstrate the role of spin symmetry at small doping by either imposing SU(2) spin symmetry or its U(1) subgroup in the iPEPS ansatz, thereby excluding or allowing spontaneous spin-symmetry breaking respectively in the thermodynamic limit. From a detailed comparison of our simulations, we provide evidence that stripe order is pinned by long-range antiferromagnetic order. We also find that SU(2) iPEPS, which enforces a spin-singlet state, yields a uniform charge distribution and favors d-wave singlet pairing.


title: Terahertz photogalvanics in twisted bilayer graphene close to the second magic angle

abstract: We report on the observation of photogalvanic effects in twisted bilayer graphene (tBLG) with a twist angle of 0.6{\deg}. We show that excitation of tBLG bulk causes a photocurrent, whose sign and magnitude are controlled by orientation of the radiation electric field and the photon helicity. The observed photocurrent provides evidence for the reduction of the point group symmetry in low twist-angle tBLG to the lowest possible one. The developed theory shows that the current is formed by asymmetric scattering in gyrotropic tBLG. We also detected the photogalvanic current formed in the vicinity of the edges. For both, bulk and edge photocurrents, we demonstrate the emergence of pronounced oscillations upon variation of the gate voltage. The gate voltages associated with the oscillations coincide well with peaks in resistance measurements. These are well explained by inter-band transitions between a multitude of isolated bands in tBLG.


title: Maximal estimates for stochastic convolutions in 2-smooth Banach spaces and applications to stochastic evolution equations

abstract: This paper presents a survey of maximal inequalities for stochastic convolutions in $2$-smooth Banach spaces and their applications to stochastic evolution equations.


title: Placement and Routing Optimization for Automated Inspection with UAVs: A Study in Offshore Wind Farm

abstract: Wind power is a clean and widely deployed alternative to reducing our dependence on fossil fuel power generation. Under this trend, more turbines will be installed in wind farms. However, the inspection of the turbines in an offshore wind farm is a challenging task because of the harsh environment (e.g., rough sea, strong wind, and so on) that leads to high risk for workers who need to work at considerable height. Also, inspecting increasing number of turbines requires long man hours. In this regard, unmanned aerial vehicles (UAVs) can play an important role for automated inspection of the turbines for the operator, thus reducing the inspection time, man hours, and correspondingly the risk for the workers. In this case, the optimal number of UAVs enough to inspect all turbines in the wind farm is a crucial parameter. In addition, finding the optimal path for the UAVs' routes for inspection is also important and is equally challenging. In this paper, we formulate a placement optimization problem to minimize the number of UAVs in the wind farm and a routing optimization problem to minimize the inspection time. Wind has an impact on the flying range and the flying speed of UAVs, which is taken into account for both problems. The formulated problems are NP-hard. We therefore design heuristic algorithms to find solutions to both problems, and then analyze the complexity of the proposed algorithms. The data of the Walney wind farm are then utilized to evaluate the performance of the proposed algorithms. Simulation results clearly show that the proposed methods can obtain the optimal routing path for UAVs during the inspection.


title: Exact and heuristic methods for the discrete parallel machine scheduling location problem

abstract: The discrete parallel machine makespan scheduling location (ScheLoc) problem is an integrated combinatorial optimization problem that combines facility location and job scheduling. The problem consists in choosing the locations of $p$ machines among a finite set of candidates and scheduling a set of jobs on these machines, aiming to minimize the makespan. Depending on the machine location, the jobs may have different release dates, and thus the location decisions have a direct impact on the scheduling decisions. To solve the problem, it is proposed a new arc-flow formulation, a column generation and three heuristic procedures that are evaluated through extensive computational experiments. By embedding the proposed procedures into a framework algorithm, we are able to find proven optimal solutions for all benchmark instances from the related literature and to obtain small percentage gaps for a new set of challenging instances.


title: ETHOS: an Online Hate Speech Detection Dataset

abstract: Online hate speech is a recent problem in our society that is rising at a steady pace by leveraging the vulnerabilities of the corresponding regimes that characterise most social media platforms. This phenomenon is primarily fostered by offensive comments, either during user interaction or in the form of a posted multimedia context. Nowadays, giant corporations own platforms where millions of users log in every day, and protection from exposure to similar phenomena appears to be necessary in order to comply with the corresponding legislation and maintain a high level of service quality. A robust and reliable system for detecting and preventing the uploading of relevant content will have a significant impact on our digitally interconnected society. Several aspects of our daily lives are undeniably linked to our social profiles, making us vulnerable to abusive behaviours. As a result, the lack of accurate hate speech detection mechanisms would severely degrade the overall user experience, although its erroneous operation would pose many ethical concerns. In this paper, we present 'ETHOS', a textual dataset with two variants: binary and multi-label, based on YouTube and Reddit comments validated using the Figure-Eight crowdsourcing platform. Furthermore, we present the annotation protocol used to create this dataset: an active sampling procedure for balancing our data in relation to the various aspects defined. Our key assumption is that, even gaining a small amount of labelled data from such a time-consuming process, we can guarantee hate speech occurrences in the examined material.


title: A half-inverse problem for the singular diffusion operator with jump conditions

abstract: In this paper, half inverse spectral problem for diffusion operator with jump conditions dependent on the spectral parameter and discontinuoty coeffcient is considered. The half inverse problems is studied of determining the coeffcient and two potential functions of the boundary value problem its spectrum by Hocstadt- Lieberman and Yang-Zettl methods. We show that two potential functions on the whole interval and the parameters in the boundary and jump conditions can be determined from spectrum.


title: A connection between the Ice-type model of Linus Pauling and the three-color problem

abstract: The ice-type model proposed by Linus Pauling to explain its entropy at low temperatures is here approached in a didactic way. We first present a theoretically estimated low-temperature entropy and compare it with numerical results. Then, we consider the mapping between this model and the three-colour problem, i.e.,colouring a regular graph with coordination equal to 4 (a two-dimensional lattice) with three colours, for which we apply the transfer-matrix method to calculate all allowed configurations for two-dimensional square lattices of $N$ oxygen atoms ranging from 4 to 225. Finally, from a linear regression of the transfer matrix results, we obtain an estimate for the case $N\rightarrow \infty $ which is compared with the exact solution by Lieb.


title: Probing Neural Dialog Models for Conversational Understanding

abstract: The predominant approach to open-domain dialog generation relies on end-to-end training of neural models on chat datasets. However, this approach provides little insight as to what these models learn (or do not learn) about engaging in dialog. In this study, we analyze the internal representations learned by neural open-domain dialog systems and evaluate the quality of these representations for learning basic conversational skills. Our results suggest that standard open-domain dialog systems struggle with answering questions, inferring contradiction, and determining the topic of conversation, among other tasks. We also find that the dyadic, turn-taking nature of dialog is not fully leveraged by these models. By exploring these limitations, we highlight the need for additional research into architectures and training methods that can better capture high-level information about dialog.


title: An Augmented Translation Technique for low Resource language pair: Sanskrit to Hindi translation

abstract: Neural Machine Translation (NMT) is an ongoing technique for Machine Translation (MT) using enormous artificial neural network. It has exhibited promising outcomes and has shown incredible potential in solving challenging machine translation exercises. One such exercise is the best approach to furnish great MT to language sets with a little preparing information. In this work, Zero Shot Translation (ZST) is inspected for a low resource language pair. By working on high resource language pairs for which benchmarks are available, namely Spanish to Portuguese, and training on data sets (Spanish-English and English-Portuguese) we prepare a state of proof for ZST system that gives appropriate results on the available data. Subsequently the same architecture is tested for Sanskrit to Hindi translation for which data is sparse, by training the model on English-Hindi and Sanskrit-English language pairs. In order to prepare and decipher with ZST system, we broaden the preparation and interpretation pipelines of NMT seq2seq model in tensorflow, incorporating ZST features. Dimensionality reduction of word embedding is performed to reduce the memory usage for data storage and to achieve a faster training and translation cycles. In this work existing helpful technology has been utilized in an imaginative manner to execute our NLP issue of Sanskrit to Hindi translation. A Sanskrit-Hindi parallel corpus of 300 is constructed for testing. The data required for the construction of parallel corpus has been taken from the telecasted news, published on Department of Public Information, state government of Madhya Pradesh, India website.


title: An Algorithm to find Superior Fitness on NK Landscapes under High Complexity: Muddling Through

abstract: Under high complexity - given by pervasive interdependence between constituent elements of a decision in an NK landscape - our algorithm obtains fitness superior to that reported in extant research. We distribute the decision elements comprising a decision into clusters. When a change in value of a decision element is considered, a forward move is made if the aggregate fitness of the cluster members residing alongside the decision element is higher. The decision configuration with the highest fitness in the path is selected. Increasing the number of clusters obtains even higher fitness. Further, implementing moves comprising of up to two changes in a cluster also obtains higher fitness. Our algorithm obtains superior outcomes by enabling more extensive search, allowing inspection of more distant configurations. We name this algorithm the muddling through algorithm, in memory of Charles Lindblom who spotted the efficacy of the process long before sophisticated computer simulations came into being.


title: StackOverflow vs Kaggle: A Study of Developer Discussions About Data Science

abstract: Software developers are increasingly required to understand fundamental Data science (DS) concepts. Recently, the presence of machine learning (ML) and deep learning (DL) has dramatically increased in the development of user applications, whether they are leveraged through frameworks or implemented from scratch. These topics attract much discussion on online platforms. This paper conducts large-scale qualitative and quantitative experiments to study the characteristics of 197836 posts from StackOverflow and Kaggle. Latent Dirichlet Allocation topic modelling is used to extract twenty-four DS discussion topics. The main findings include that TensorFlow-related topics were most prevalent in StackOverflow, while meta discussion topics were the prevalent ones on Kaggle. StackOverflow tends to include lower-level troubleshooting, while Kaggle focuses on practicality and optimising leaderboard performance. In addition, across both communities, DS discussion is increasing at a dramatic rate. While TensorFlow discussion on StackOverflow is slowing, interest in Keras is rising. Finally, ensemble algorithms are the most mentioned ML/DL algorithms in Kaggle but are rarely discussed on StackOverflow. These findings can help educators and researchers to more effectively tailor and prioritise efforts in researching and communicating DS concepts towards different developer communities.


title: A Dataset and Benchmarks for Multimedia Social Analysis

abstract: We present a new publicly available dataset with the goal of advancing multi-modality learning by offering vision and language data within the same context. This is achieved by obtaining data from a social media website with posts containing multiple paired images/videos and text, along with comment trees containing images/videos and/or text. With a total of 677k posts, 2.9 million post images, 488k post videos, 1.4 million comment images, 4.6 million comment videos, and 96.9 million comments, data from different modalities can be jointly used to improve performances for a variety of tasks such as image captioning, image classification, next frame prediction, sentiment analysis, and language modeling. We present a wide range of statistics for our dataset. Finally, we provide baseline performance analysis for one of the regression tasks using pre-trained models and several fully connected networks.


title: Affective Conditioning on Hierarchical Networks applied to Depression Detection from Transcribed Clinical Interviews

abstract: In this work we propose a machine learning model for depression detection from transcribed clinical interviews. Depression is a mental disorder that impacts not only the subject's mood but also the use of language. To this end we use a Hierarchical Attention Network to classify interviews of depressed subjects. We augment the attention layer of our model with a conditioning mechanism on linguistic features, extracted from affective lexica. Our analysis shows that individuals diagnosed with depression use affective language to a greater extent than not-depressed. Our experiments show that external affective information improves the performance of the proposed architecture in the General Psychotherapy Corpus and the DAIC-WoZ 2017 depression datasets, achieving state-of-the-art 71.6 and 68.6 F1 scores respectively.


title: Open-Domain Question Answering with Pre-Constructed Question Spaces

abstract: Open-domain question answering aims at solving the task of locating the answers to user-generated questions in massive collections of documents. There are two families of solutions available: retriever-readers, and knowledge-graph-based approaches. A retriever-reader usually first uses information retrieval methods like TF-IDF to locate some documents or paragraphs that are likely to be relevant to the question, and then feeds the retrieved text to a neural network reader to extract the answer. Alternatively, knowledge graphs can be constructed from the corpus and be queried against to answer user questions. We propose a novel algorithm with a reader-retriever structure that differs from both families. Our reader-retriever first uses an offline reader to read the corpus and generate collections of all answerable questions associated with their answers, and then uses an online retriever to respond to user queries by searching the pre-constructed question spaces for answers that are most likely to be asked in the given way. We further combine retriever-reader and reader-retriever results into one single answer by examining the consistency between the two components. We claim that our algorithm solves some bottlenecks in existing work, and demonstrate that it achieves superior accuracy on real-world datasets.


title: DeepVar: An End-to-End Deep Learning Approach for Genomic Variant Recognition in Biomedical Literature

abstract: We consider the problem of Named Entity Recognition (NER) on biomedical scientific literature, and more specifically the genomic variants recognition in this work. Significant success has been achieved for NER on canonical tasks in recent years where large data sets are generally available. However, it remains a challenging problem on many domain-specific areas, especially the domains where only small gold annotations can be obtained. In addition, genomic variant entities exhibit diverse linguistic heterogeneity, differing much from those that have been characterized in existing canonical NER tasks. The state-of-the-art machine learning approaches in such tasks heavily rely on arduous feature engineering to characterize those unique patterns. In this work, we present the first successful end-to-end deep learning approach to bridge the gap between generic NER algorithms and low-resource applications through genomic variants recognition. Our proposed model can result in promising performance without any hand-crafted features or post-processing rules. Our extensive experiments and results may shed light on other similar low-resource NER applications.


title: Graph-Stega: Semantic Controllable Steganographic Text Generation Guided by Knowledge Graph

abstract: Most of the existing text generative steganographic methods are based on coding the conditional probability distribution of each word during the generation process, and then selecting specific words according to the secret information, so as to achieve information hiding. Such methods have their limitations which may bring potential security risks. Firstly, with the increase of embedding rate, these models will choose words with lower conditional probability, which will reduce the quality of the generated steganographic texts; secondly, they can not control the semantic expression of the final generated steganographic text. This paper proposes a new text generative steganography method which is quietly different from the existing models. We use a Knowledge Graph (KG) to guide the generation of steganographic sentences. On the one hand, we hide the secret information by coding the path in the knowledge graph, but not the conditional probability of each generated word; on the other hand, we can control the semantic expression of the generated steganographic text to a certain extent. The experimental results show that the proposed model can guarantee both the quality of the generated text and its semantic expression, which is a supplement and improvement to the current text generation steganography.


title: Lessons learned from (and since) the Voyager 2 flybys of Uranus and Neptune

abstract: More than 30 years have passed since the Voyager 2 fly-bys of Uranus and Neptune. I discuss a range of lessons learned from Voyager, broadly grouped into process, planning, and people. In terms of process, we must be open to new concepts: reliance on existing instrument technologies, propulsion systems, and operational modes is inherently limiting. I cite examples during recent decades that could open new vistas in exploration of the deep outer Solar System. Planning is crucial: mission gaps that last over three decades leave much scope for evolution both in mission development and in the targets themselves. I touch only briefly on planetary science, as that is covered in other papers in this issue, but the role of the decadal surveys will be examined in this section. I also sketch out how coordination of distinct and divergent international planning timelines yields both challenges and opportunity. Finally, I turn to people: with generational-length gaps between missions, continuity in knowledge and skills requires careful attention to people. The youngest participants in the Voyager missions (myself included) now approach retirement. We share here ideas for preparing the next generation of voyagers.


title: Multi-fidelity Neural Architecture Search with Knowledge Distillation

abstract: Neural architecture search (NAS) targets at finding the optimal architecture of a neural network for a problem or a family of problems. Evaluations of neural architectures are very time-consuming. One of the possible ways to mitigate this issue is to use low-fidelity evaluations, namely training on a part of a dataset, fewer epochs, with fewer channels, etc. In this paper, we propose a bayesian multi-fidelity method for neural architecture search: MF-KD. The method relies on a new approach to low-fidelity evaluations of neural architectures by training for a few epochs using a knowledge distillation. Knowledge distillation adds to a loss function a term forcing a network to mimic some teacher network. We carry out experiments on CIFAR-10, CIFAR-100, and ImageNet-16-120. We show that training for a few epochs with such a modified loss function leads to a better selection of neural architectures than training for a few epochs with a logistic loss. The proposed method outperforms several state-of-the-art baselines.


title: Subjective Question Answering: Deciphering the inner workings of Transformers in the realm of subjectivity

abstract: Understanding subjectivity demands reasoning skills beyond the realm of common knowledge. It requires a machine learning model to process sentiment and to perform opinion mining. In this work, I've exploited a recently released dataset for span-selection Question Answering, namely SubjQA. SubjQA is the first QA dataset that contains questions that ask for subjective opinions corresponding to review paragraphs from six different domains. Hence, to answer these subjective questions, a learner must extract opinions and process sentiment for various domains, and additionally, align the knowledge extracted from a paragraph with the natural language utterances in the corresponding question, which together enhance the difficulty of a QA task. The primary goal of this thesis was to investigate the inner workings (i.e., latent representations) of a Transformer-based architecture to contribute to a better understanding of these not yet well understood "black-box" models. Transformer's hidden representations, concerning the true answer span, are clustered more closely in vector space than those representations corresponding to erroneous predictions. This observation holds across the top three Transformer layers for both objective and subjective questions and generally increases as a function of layer dimensions. Moreover, the probability to achieve a high cosine similarity among hidden representations in latent space concerning the true answer span tokens is significantly higher for correct compared to incorrect answer span predictions. These results have decisive implications for down-stream applications, where it is crucial to know about why a neural network made mistakes, and in which point, in space and time the mistake has happened (e.g., to automatically predict correctness of an answer span prediction without the necessity of labeled data).


title: Automated Diagram Generation to Build Understanding and Usability

abstract: Causal loop and stock and flow diagrams are broadly used in System Dynamics because they help organize relationships and convey meaning. Using the analytical work of Schoenberg (2019) to select what to include in a compressed model, this paper demonstrates how that information can be clearly presented in an automatically generated causal loop diagram. The diagrams are generated using tools developed by people working in graph theory and the generated diagrams are clear and aesthetically pleasing. This approach can also be built upon to generate stock and flow diagrams. Automated stock and flow diagram generation opens the door to representing models developed using only equations, regardless or origin, in a clear and easy to understand way. Because models can be large, the application of grouping techniques, again developed for graph theory, can help structure the resulting diagrams in the most usable form. This paper describes the algorithms developed for automated diagram generation and shows a number of examples of their uses in large models. The application of these techniques to existing, but inaccessible, equation-based models can help broaden the knowledge base for System Dynamics modeling. The techniques can also be used to improve layout in all, or part, of existing models with diagrammatic informtion.


title: Wat zei je? Detecting Out-of-Distribution Translations with Variational Transformers

abstract: We detect out-of-training-distribution sentences in Neural Machine Translation using the Bayesian Deep Learning equivalent of Transformer models. For this we develop a new measure of uncertainty designed specifically for long sequences of discrete random variables -- i.e. words in the output sentence. Our new measure of uncertainty solves a major intractability in the naive application of existing approaches on long sentences. We use our new measure on a Transformer model trained with dropout approximate inference. On the task of German-English translation using WMT13 and Europarl, we show that with dropout uncertainty our measure is able to identify when Dutch source sentences, sentences which use the same word types as German, are given to the model instead of German.


title: An advanced workflow for single particle imaging with the limited data at an X-ray free-electron laser

abstract: An improved analysis for single particle imaging (SPI) experiments, using the limited data, is presented here. Results are based on a study of bacteriophage PR772 performed at the AMO instrument at the Linac Coherent Light Source (LCLS) as part of the SPI initiative. Existing methods were modified to cope with the shortcomings of the experimental data: inaccessibility of information from the half of the detector and small fraction of single hits. General SPI analysis workflow was upgraded with the expectation-maximization based classification of diffraction patterns and mode decomposition on the final virus structure determination step. The presented processing pipeline allowed us to determine the three-dimensional structure of the bacteriophage PR772 without symmetry constraints with a spatial resolution of 6.9 nm. The obtained resolution was limited by the scattering intensity during the experiment and the relatively small number of single hits.


title: Deep learning mediated single time-point image-based prediction of embryo developmental outcome at the cleavage stage

abstract: In conventional clinical in-vitro fertilization practices embryos are transferred either at the cleavage or blastocyst stages of development. Cleavage stage transfers, particularly, are beneficial for patients with relatively poor prognosis and at fertility centers in resource-limited settings where there is a higher chance of developmental failure in embryos in-vitro. However, one of the major limitations of embryo selections at the cleavage stage is the availability of very low number of manually discernable features to predict developmental outcomes. Although, time-lapse imaging systems have been proposed as possible solutions, they are cost-prohibitive and require bulky and expensive hardware, and labor-intensive. Advances in convolutional neural networks (CNNs) have been utilized to provide accurate classifications across many medical and non-medical object categories. Here, we report an automated system for classification and selection of human embryos at the cleavage stage using a trained CNN combined with a genetic algorithm. The system selected the cleavage stage embryo at 70 hours post insemination (hpi) that ultimately developed into top-quality blastocyst at 70 hpi with 64% accuracy, outperforming the abilities of embryologists in identifying embryos with the highest developmental potential. Such systems can have a significant impact on IVF procedures by empowering embryologists for accurate and consistent embryo assessment in both resource-poor and resource-rich settings.


title: Application of Fuzzy Rule based System for Highway Research Board Classification of Soils

abstract: Fuzzy rule-based model is a powerful tool for imitating the human way of thinking and solving uncertainty-related problems as it allows for understandable and interpretable rule bases. The objective of this paper is to study the applicability of fuzzy rule-based modelling to quantify soil classification for engineering purposes by qualitatively considering soil index properties. The classification system of the Highway Research Board is considered to illustrate a fuzzy rule-based model. The soil's index properties are fuzzified using triangular functions, and the fuzzy membership values are calculated. Fuzzy arithmetical operators are then applied to the membership values obtained for classification. Fuzzy decision tree classification algorithm is used to derive fuzzy if-then rules to quantify qualitative soil classification. The proposed system is implemented in MATLAB. The results obtained are checked and the implementation of the proposed model is measured against the outcomes of the laboratory tests.


title: Dark photons from pions produced in ultraperipheral $PbPb$ collisions

abstract: In this letter we propose the search of dark photons in the decay of pions produced by $\gamma \gamma$ interactions in ultraperipheral $PbPb$ collisions. The cross section is estimated considering an accurate treatment for the absorptive corrections and for the nuclear form factor. Predictions for the event rates are presented considering the expected luminosities for the LHC, High -- Luminosity LHC and High -- Energy LHC as well as for the Future Circular Collider. Our results indicate that a future experimental analysis of the pion production in ultraperipheral heavy ion collisions can be useful to probe the dark photon production and constrain its properties.


title: A cyanine dye rotaxane porphyrin nanoring complex as a model light harvesting system

abstract: A nanoring-rotaxane supramolecular assembly, with a Cy7 cyanine dye (hexamethylindotricarbocyanine) threaded along the axis of the nanoring, has been synthesized as a model for the energy transfer between the light harvesting complex LH1 and the reaction center in purple bacteria photosynthesis. The complex displays efficient energy transfer from the central cyanine dye to the surrounding zinc porphyrin nanoring. We present a theoretical model that reproduces the absorption spectrum of the nanoring and quantifies the excitonic coupling between the nanoring and the central dye, explaining the efficient energy transfer and elucidating the similarity with structurally related natural light harvesting systems.


title: Societal biases reinforcement through machine learning: A credit scoring perspective

abstract: Does machine learning and AI ensure that social biases thrive ? This paper aims to analyse this issue. Indeed, as algorithms are informed by data, if these are corrupted, from a social bias perspective, good machine learning algorithms would learn from the data provided and reverberate the patterns learnt on the predictions related to either the classification or the regression intended. In other words, the way society behaves whether positively or negatively, would necessarily be reflected by the models. In this paper, we analyse how social biases are transmitted from the data into banks loan approvals by predicting either the gender or the ethnicity of the customers using the exact same information provided by customers through their applications.


title: Remark on "When Are All the Zeros of a Polynomial Real and Distinct?"

abstract: The purpose of this note is to point out that the main result of [M. Chamberland, When Are All the Zeros of a Polynomial Real and Distinct? Amer. Math. Monthly. 127 (2020) 449-451] is implicitly contained in the elementary lore of the theory of orthogonal polynomials on the real line.


title: Modeling bike availability in a bike-sharing system using machine learning

abstract: This paper models the availability of bikes at San Francisco Bay Area Bike Share stations using machine learning algorithms. Random Forest (RF) and Least-Squares Boosting (LSBoost) were used as univariate regression algorithms, and Partial Least-Squares Regression (PLSR) was applied as a multivariate regression algorithm. The univariate models were used to model the number of available bikes at each station. PLSR was applied to reduce the number of required prediction models and reflect the spatial correlation between stations in the network. Results clearly show that univariate models have lower error predictions than the multivariate model. However, the multivariate model results are reasonable for networks with a relatively large number of spatially correlated stations. Results also show that station neighbors and the prediction horizon time are significant predictors. The most effective prediction horizon time that produced the least prediction error was 15 minutes.


title: Raising the regularity of generalized Abel equations in fractional Sobolev spaces with homogeneous boundary conditions

abstract: The generalized (or coupled) Abel equations on the bounded interval have been well investigated in H$\ddot{\text{o}}$lderian spaces that admit integrable singularities at the endpoints and relatively inadequate in other functional spaces. In recent years, such operators have appeared in BVPs of fractional-order differential equations such as fractional diffusion equations that are usually studied in the frame of fractional Sobolev spaces for weak solution and numerical approximation; and their analysis plays the key role during the process of converting weak solutions to the true solutions. This article develops the mapping properties of generalized Abel operators $\alpha {_aD_x^{-s}}+\beta {_xD_b^{-s}}$ in fractional Sobolev spaces, where $0<\alpha,\beta$, $\alpha+\beta=1$, $ 0<s<1$ and $ {_aD_x^{-s}}$, $ {_xD_b^{-s}}$ are fractional Riemann-Liouville integrals. It is mainly concerned with the regularity property of $(\alpha {_aD_x^{-s}}+\beta {_xD_b^{-s}})u=f$ by taking into account homogeneous boundary conditions. Namely, we investigate the regularity behavior of $u(x)$ while letting $f(x)$ become smoother and imposing homogeneous boundary restrictions $u(a)=u(b)=0$.


abstract: In this paper, we introduce and we study the concept of Continuous Controlled K-Frame for Hilbert $C^{\ast}$-Modules wich are generalizations of discrete Controlled K-Frames.


title: A Two-Phase Dynamic Contagion Model for COVID-19

abstract: In this paper, we propose a continuous-time stochastic intensity model, namely, two-phase dynamic contagion process(2P-DCP), for modelling the epidemic contagion of COVID-19 and investigating the lockdown effect based on the dynamic contagion model introduced by Dassios and Zhao (2011). It allows randomness to the infectivity of individuals rather than a constant reproduction number as assumed by standard models. Key epidemiological quantities, such as the distribution of final epidemic size and expected epidemic duration, are derived and estimated based on real data for various regions and countries. The associated time lag of the effect of intervention in each country or region is estimated. Our results are consistent with the incubation time of COVID-19 found by recent medical study. We demonstrate that our model could potentially be a valuable tool in the modeling of COVID-19. More importantly, the proposed model of 2P-DCP could also be used as an important tool in epidemiological modelling as this type of contagion models with very simple structures is adequate to describe the evolution of regional epidemic and worldwide pandemic.


title: The hidden side of COVID-19 spread in Italy

abstract: Background. The paper concerns the SARS-CoV2 (COVID-19) pandemic that, starting from the end of February 2020, began spreading along the Italian peninsula, by first attacking small communities in north regions, and then extending to the center and south of Italy, including the two main islands. Objective. The creation of a forecast model that manages to alert the decision-making bodies and, in particular, the healthcare system, to hinder the emergence of any other pandemic outbreaks, or the arrival of subsequent pandemic waves. Methods. A new mathematical model to describe the pandemic is given. The model includes the class of undiagnosed infected people, and has a multi-region extension, to cope with the in-time and in-space heterogeneity of the epidemic. Results. We obtain a robust and reliable tool for the forecast of the total and active cases, which can be also used to simulate different scenarios. Conclusions. We are able to address a number of issues, such as assessing the adoption of the lockdown in Italy, started from 11 March 2020, and how to employ a rapid screening test campaign for containing the epidemic.


title: CoDeNet: Efficient Deployment of Input-Adaptive Object Detection on Embedded FPGAs

abstract: Deploying deep learning models on embedded systems has been challenging due to limited computing resources. The majority of existing work focuses on accelerating image classification, while other fundamental vision problems, such as object detection, have not been adequately addressed. Compared with image classification, detection problems are more sensitive to the spatial variance of objects, and therefore, require specialized convolutions to aggregate spatial information. To address this need, recent work introduces dynamic deformable convolution to augment regular convolutions. However, this will lead to inefficient memory accesses of inputs with existing hardware. In this work, we harness the flexibility of FPGAs to develop a novel object detection pipeline with deformable convolutions. We show the speed-accuracy tradeoffs for a set of algorithm modifications including irregular-access versus limited-range and fixed-shape. We then Co-Design a Network CoDeNet with the modified deformable convolution and quantize it to 4-bit weights and 8-bit activations. With our high-efficiency implementation, our solution reaches 26.9 frames per second with a tiny model size of 0.76 MB while achieving 61.7 AP50 on the standard object detection dataset, Pascal VOC. With our higher accuracy implementation, our model gets to 67.1 AP50 on Pascal VOC with only 2.9 MB of parameters-20.9x smaller but 10% more accurate than Tiny-YOLO.


title: Geometric photon-drag effect and nonlinear shift current in centrosymmetric crystals

abstract: The nonlinear shift current, also known as the bulk photovoltaic current generated by linearly polarized light, has long been known to be absent in crystals with inversion symmetry. Here we argue that a non-zero shift current in centrosymmetric crystals can be activated by a photon-drag effect. Photon-drag shift current proceeds from a `shift current dipole' (a geometric quantity characterizing interband transitions) and manifests a purely transverse response in centrosymmetric crystals. This transverse nature proceeds directly from the shift-vector's pseudovector nature under mirror operation and underscores its intrinsic geometric origin. Photon-drag shift current can greatly enhanced by coupling to polaritons and provides a new and sensitive tool to interrogate the subtle interband coherences of materials with inversion symmetry previously thought to be inaccessible via photocurrent probes.


title: Neutrino Cooling of Primordial Hot Regions

abstract: The effect of neutrino cooling of possible primary regions filled by the hot matter is discussed. Such regions could contain the primordial density inhomogeneities of different origin and survive up to modern epoch. We show that the final temperature of such region is $\sim 10\, {\rm keV}$ provided that the initial temperature is within the interval $10\, {\rm keV} ... 100\, {\rm MeV}$. The cooling is realized due to the nuclear reactions containing $n-p$ transition. The lower limit $10\, {\rm keV}$ is accounted for by suppression of the reactions rates because of threshold effect and $n$, $e^{\pm}$ density diminishment.


title: Simple recipes for compact remnant masses and natal kicks

abstract: Based on recent results from three-dimensional supernova simulations and semi-analytical parametrised models, we develop analytical prescriptions for the dependence of the mass of neutron stars and black holes and the natal kicks, if any, on the pre-supernova carbon-oxygen core and helium shell masses. Our recipes are probabilistic rather than deterministic in order to account for the intrinsic stochasticity of stellar evolution and supernovae. We anticipate that these recipes will be particularly useful for rapid population synthesis, and we illustrate their application to distributions of remnant masses and kicks for a population of single stars.


title: An Unsupervised Machine Learning Approach to Assess the ZIP Code Level Impact of COVID-19 in NYC

abstract: New York City has been recognized as the world's epicenter of the novel Coronavirus pandemic. To identify the key inherent factors that are highly correlated to the Increase Rate of COVID-19 new cases in NYC, we propose an unsupervised machine learning framework. Based on the assumption that ZIP code areas with similar demographic, socioeconomic, and mobility patterns are likely to experience similar outbreaks, we select the most relevant features to perform a clustering that can best reflect the spread, and map them down to 9 interpretable categories. We believe that our findings can guide policy makers to promptly anticipate and prevent the spread of the virus by taking the right measures.


title: Impact of Particle Arrays on Phase Separation Composition Patterns

abstract: We examine the symmetry-breaking effect of fixed constellations of particles on the surface-directed spinodal decomposition of binary blends in the presence of particles whose surfaces have a preferential affinity for one of the components. Our phase-field simulations indicate that the phase separation morphology in the presence of particle arrays can be tuned to have a continuous, droplet, lamellar, or hybrid morphology depending on the interparticle spacing, blend composition, and time. In particular, when the interparticle spacing is large compared to the spinodal wavelength, a transient target pattern composed of alternate rings of preferred and non-preferred phases emerge at early times, tending to adopt the symmetry of the particle configuration. We reveal that such target patterns stabilize for certain characteristic length, time, and composition scales characteristic of the pure phase separating mixture. To illustrate the general range of phenomena exhibited by mixture-particle systems, we simulate the effects of single-particle, multi-particle, and cluster-particle systems having multiple geometrical configurations of the particle characteristic of pattern substrates on phase separation. Our simulations show that tailoring the particle configuration, or substrate pattern configuration, a relative fluid-particle composition should allow the desirable control of the phase separation morphology as in block copolymer materials, but where the scales accessible to this approach of organizing phase-separated fluids usually are significantly larger. Limited experiments confirm the trends observed in our simulations, which should provide some guidance in engineering patterned blend and other mixtures of technological interest.


title: MP Twitter Abuse in the Age of COVID-19: White Paper

abstract: As COVID-19 sweeps the globe, outcomes depend on effective relationships between the public and decision-makers. In the UK there were uncivil tweets to MPs about perceived UK tardiness to go into lockdown. The pandemic has led to increased attention on ministers with a role in the crisis. However, generally this surge has been civil. Prime minister Boris Johnson's severe illness with COVID-19 resulted in an unusual peak of supportive responses on Twitter. Those who receive more COVID-19 mentions in their replies tend to receive less abuse (significant negative correlation). Following Mr Johnson's recovery, with rising economic concerns and anger about lockdown violations by influential figures, abuse levels began to rise in May. 1,902 replies to MPs within the study period were found containing hashtags or terms that refute the existence of the virus (e.g. #coronahoax, #coronabollocks, 0.04% of a total 4.7 million replies, or 9% of the number of mentions of "stay home save lives" and variants). These have tended to be more abusive. Evidence of some members of the public believing in COVID-19 conspiracy theories was also found. Higher abuse levels were associated with hashtags blaming China for the pandemic.


title: Jointly Predicting Job Performance, Personality, Cognitive Ability, Affect, and Well-Being

abstract: Assessment of job performance, personalized health and psychometric measures are domains where data-driven and ubiquitous computing exhibits the potential of a profound impact in the future. Existing techniques use data extracted from questionnaires, sensors (wearable, computer, etc.), or other traits, to assess well-being and cognitive attributes of individuals. However, these techniques can neither predict individual's well-being and psychological traits in a global manner nor consider the challenges associated to processing the data available, that is incomplete and noisy. In this paper, we create a benchmark for predictive analysis of individuals from a perspective that integrates: physical and physiological behavior, psychological states and traits, and job performance. We design data mining techniques as benchmark and uses real noisy and incomplete data derived from wearable sensors to predict 19 constructs based on 12 standardized well-validated tests. The study included 757 participants who were knowledge workers in organizations across the USA with varied work roles. We developed a data mining framework to extract the meaningful predictors for each of the 19 variables under consideration. Our model is the first benchmark that combines these various instrument-derived variables in a single framework to understand people's behavior by leveraging real uncurated data from wearable, mobile, and social media sources. We verify our approach experimentally using the data obtained from our longitudinal study. The results show that our framework is consistently reliable and capable of predicting the variables under study better than the baselines when prediction is restricted to the noisy, incomplete data.


title: COVID-19 Mobility Data Collection of Seoul, South Korea

abstract: The relationship between pandemic and human mobility has received considerable attention from scholars, as it can provide an indication of how mobility patterns change in response to a public health crisis or whether reduced mobility contributes to preventing the spread of an infectious disease. While several studies attempted to unveil such relationship, no studies have focused on changes in human mobility at a finer scale utilizing comprehensive, high-resolution data. To address the complex association between pandemic's spread and human mobility, this paper presents two categories of mobility datasets - trip mode and trip purpose - that concern nearly 10 million citizens' movements during COVID-19 in the capital city of South Korea, Seoul, where no lockdowns has been imposed. We curate hourly data of subway ridership, traffic volume and population present count at selected points of interests. The results to be derived from the presented datasets can be used as an important reference for public health decision making in the post COVID-19 era.


title: An inverse problem in estimating the time dependent source term and initial temperature simultaneously by the polynomial regression and conjugate gradient method

abstract: From the final and interior temperature measurements identifying the source term with initial temperature simultaneously is an inverse heat conduction problem which is a kind of ill-posed. The optimal control framework has been found to be effective in dealing with these problems. However, they require to find the gradient information. This idea has been employed in this research. We derive the gradient of Tikhonov functional and establish the stability of the minimizer from the necessary condition. The stability and effectiveness of the evolutionary algorithm are presented for various test examples.


title: Tamil Vowel Recognition With Augmented MNIST-like Data Set

abstract: We report generation of a MNIST [4] compatible data set [1] for Tamil vowels to enable building a classification DNN or other such ML/AI deep learning [2] models for Tamil OCR/Handwriting applications. We report the capability of the 60,000 grayscale, 28x28 pixel dataset to build a 92% accuracy (training) and 82% cross-validation 4-layer CNN, with 100,000+ parameters, in TensorFlow. We also report a top-1 classification accuracy of 70% and top-2 classification accuracy of 92% on handwritten vowels showing, for the same network.


title: Sensor Artificial Intelligence and its Application to Space Systems -- A White Paper

abstract: Information and communication technologies have accompanied our everyday life for years. A steadily increasing number of computers, cameras, mobile devices, etc. generate more and more data, but at the same time we realize that the data can only partially be analyzed with classical approaches. The research and development of methods based on artificial intelligence (AI) made enormous progress in the area of interpretability of data in recent years. With growing experience, both, the potential and limitations of these new technologies are increasingly better understood. Typically, AI approaches start with the data from which information and directions for action are derived. However, the circumstances under which such data are collected and how they change over time are rarely considered. A closer look at the sensors and their physical properties within AI approaches will lead to more robust and widely applicable algorithms. This holistic approach which considers entire signal chains from the origin to a data product, "Sensor AI", is a highly relevant topic with great potential. It will play a decisive role in autonomous driving as well as in areas of automated production, predictive maintenance or space research. The goal of this white paper is to establish "Sensor AI" as a dedicated research topic. We want to exchange knowledge on the current state-of-the-art on Sensor AI, to identify synergies among research groups and thus boost the collaboration in this key technology for science and industry.


title: EPIC30M: An Epidemics Corpus Of Over 30 Million Relevant Tweets

abstract: Since the start of COVID-19, several relevant corpora from various sources are presented in the literature that contain millions of data points. While these corpora are valuable in supporting many analyses on this specific pandemic, researchers require additional benchmark corpora that contain other epidemics to facilitate cross-epidemic pattern recognition and trend analysis tasks. During our other efforts on COVID-19 related work, we discover very little disease related corpora in the literature that are sizable and rich enough to support such cross-epidemic analysis tasks. In this paper, we present EPIC30M, a large-scale epidemic corpus that contains 30 millions micro-blog posts, i.e., tweets crawled from Twitter, from year 2006 to 2020. EPIC30M contains a subset of 26.2 millions tweets related to three general diseases, namely Ebola, Cholera and Swine Flu, and another subset of 4.7 millions tweets of six global epidemic outbreaks, including 2009 H1N1 Swine Flu, 2010 Haiti Cholera, 2012 Middle-East Respiratory Syndrome (MERS), 2013 West African Ebola, 2016 Yemen Cholera and 2018 Kivu Ebola. Furthermore, we explore and discuss the properties of the corpus with statistics of key terms and hashtags and trends analysis for each subset. Finally, we demonstrate the value and impact that EPIC30M could create through a discussion of multiple use cases of cross-epidemic research topics that attract growing interest in recent years. These use cases span multiple research areas, such as epidemiological modeling, pattern recognition, natural language understanding and economical modeling.


title: Ancient Luoyang Bridge reveals a simple metagrating model in optics

abstract: The ancient Chinese bridge, Luoyang Bridge, has been revealed to obey similar laws to diminish waves, like an optical model, metagrating. Numerical simulations have been performed to verify this finding.


title: Tailoring multi-loop atom interferometers with adjustable momentum transfer

abstract: Multi-loop matter-wave interferometers are essential in quantum sensing to measure the derivatives of physical quantities in time or space. Because multi-loop interferometers require multiple reflections, imperfections of the matter-wave mirrors create spurious paths that scramble the signal of interest. Here we demonstrate a method of adjustable momentum transfer that prevents the recombination of the spurious paths in a double-loop atom interferometer aimed at measuring rotation rates. We experimentally study the recombination condition of the spurious matter waves, which is quantitatively supported by a model accounting for the coherence properties of the atomic source. We finally demonstrate the effectiveness of the method in building a cold-atom gyroscope with a single-shot acceleration sensitivity suppressed by a factor of at least 50. Our study will impact the design of multi-loop atom interferometers that measure a single inertial quantity.


title: Fast algebraic immunity of Boolean functions and LCD codes

abstract: Nowadays, the resistance against algebraic attacks and fast algebraic attacks are considered as an important cryptographic property for Boolean functions used in stream ciphers. Both attacks are very powerful analysis concepts and can be applied to symmetric cryptographic algorithms used in stream ciphers. The notion of algebraic immunity has received wide attention since it is a powerful tool to measure the resistance of a Boolean function to standard algebraic attacks. Nevertheless, an algebraic tool to handle the resistance to fast algebraic attacks is not clearly identified in the literature. In the current paper, we propose a new parameter to measure the resistance of a Boolean function to fast algebraic attack. We also introduce the notion of fast immunity profile and show that it informs both on the resistance to standard and fast algebraic attacks. Further, we evaluate our parameter for two secondary constructions of Boolean functions. Moreover, A coding-theory approach to the characterization of perfect algebraic immune functions is presented. Via this characterization, infinite families of binary linear complementary dual codes (or LCD codes for short) are obtained from perfect algebraic immune functions. The binary LCD codes presented in this paper have applications in armoring implementations against so-called side-channel attacks (SCA) and fault non-invasive attacks, in addition to their applications in communication and data storage systems.


title: Self-supervised Learning for Precise Pick-and-place without Object Model

abstract: Flexible pick-and-place is a fundamental yet challenging task within robotics, in particular due to the need of an object model for a simple target pose definition. In this work, the robot instead learns to pick-and-place objects using planar manipulation according to a single, demonstrated goal state. Our primary contribution lies within combining robot learning of primitives, commonly estimated by fully-convolutional neural networks, with one-shot imitation learning. Therefore, we define the place reward as a contrastive loss between real-world measurements and a task-specific noise distribution. Furthermore, we design our system to learn in a self-supervised manner, enabling real-world experiments with up to 25000 pick-and-place actions. Then, our robot is able to place trained objects with an average placement error of 2.7 (0.2) mm and 2.6 (0.8){\deg}. As our approach does not require an object model, the robot is able to generalize to unknown objects while keeping a precision of 5.9 (1.1) mm and 4.1 (1.2){\deg}. We further show a range of emerging behaviors: The robot naturally learns to select the correct object in the presence of multiple object types, precisely inserts objects within a peg game, picks screws out of dense clutter, and infers multiple pick-and-place actions from a single goal state.


title: Exact minimum speed of traveling waves in a Keller--Segel model

abstract: In this paper we present a Keller--Segel model with logistic growth dynamics arising in the study of chemotactic pattern formation. We prove the existence of a minimum wave speed for which the model exhibits nonnegative travelling wave solutions at all speeds above this value and none below. The exact value of the minimum wave speed is given for all biologically relevant parameter values. These results strengthen recent results where non-sharp upper and lower bounds on the minimum wave speed were derived in a restricted parameter regime.


title: Modeling and Controlling the Spread of Epidemic with Various Social and Economic Scenarios

abstract: We propose a dynamical model for describing the spread of epidemics. This model is an extension of the SIQR (susceptible-infected-quarantined-recovered) and SIRP (susceptible-infected-recovered-pathogen) models used earlier to describe various scenarios of epidemic spreading. As compared to the basic SIR model, our model takes into account two possible routes of contagion transmission: direct from the infected compartment to the susceptible compartment and indirect via some intermediate medium or fomites. Transmission rates are estimated in terms of average distances between the individuals in selected social environments and characteristic time spans for which the individuals stay in each of these environments. We also introduce a collective economic resource associated with the average amount of money or income per individual to describe the socioeconomic interplay between the spreading process and the resource available to infected individuals. The epidemic-resource coupling is supposed to be of activation type, with the recovery rate governed by the Arrhenius-like law. Our model brings an advantage of building various control strategies to mitigate the effect of epidemic and can be applied, in particular, to modeling the spread of COVID-19.

categories: physics.soc-ph econ.GN q-bio.PE q-fin.EC