title: A Probabilistic Approach to Voting, Allocation, Matching, and Coalition Formation

abstract: Randomisation and time-sharing are some of the oldest methods to achieve fairness. I make a case that applying these approaches to social choice settings constitutes a powerful paradigm that deserves an extensive and thorough examination. I discuss challenges and opportunities in applying these approaches to settings including voting, allocation, matching, and coalition formation.


title: Optimal strategies in the Fighting Fantasy gaming system: influencing stochastic dynamics by gambling with limited resource

abstract: Fighting Fantasy is a popular recreational fantasy gaming system worldwide. Combat in this system progresses through a stochastic game involving a series of rounds, each of which may be won or lost. Each round, a limited resource (`luck') may be spent on a gamble to amplify the benefit from a win or mitigate the deficit from a loss. However, the success of this gamble depends on the amount of remaining resource, and if the gamble is unsuccessful, benefits are reduced and deficits increased. Players thus dynamically choose to expend resource to attempt to influence the stochastic dynamics of the game, with diminishing probability of positive return. The identification of the optimal strategy for victory is a Markov decision problem that has not yet been solved. Here, we combine stochastic analysis and simulation with dynamic programming to characterise the dynamical behaviour of the system in the absence and presence of gambling policy. We derive a simple expression for the victory probability without luck-based strategy. We use a backward induction approach to solve the Bellman equation for the system and identify the optimal strategy for any given state during the game. The optimal control strategies can dramatically enhance success probabilities, but take detailed forms; we use stochastic simulation to approximate these optimal strategies with simple heuristics that can be practically employed. Our findings provide a roadmap to improving success in the games that millions of people play worldwide, and inform a class of resource allocation problems with diminishing returns in stochastic games.


title: Long-Range Propagation and Interference of $d$-wave Superconducting Pairs in Graphene

abstract: Recent experiments have shown that proximity with high-temperature superconductors induces unconventional superconducting correlations in graphene. Here we demonstrate that those correlations propagate hundreds of nanometer, allowing for the unique observation of $d$-wave Andreev pair interferences in YBa$_2$Cu$_3$O$_7$-graphene devices that behave as a Fabry-P\'erot cavity. The interferences show as a series of pronounced conductance oscillations analogous to those originally predicted by de Gennes--Saint-James for conventional metal-superconductor junctions. The present work is pivotal to the study of exotic directional effects expected for nodal superconductivity in Dirac materials.


title: When Relation Networks meet GANs: Relation GANs with Triplet Loss

abstract: Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution inputs and complex datasets. Since the randomly generated distribution can hardly overlap with the real distribution, training GANs often suffers from the gradient vanishing problem. A number of approaches have been proposed to address this issue by constraining the discriminator's capabilities using empirical techniques, like weight clipping, gradient penalty, spectral normalization etc. In this paper, we provide a more principled approach as an alternative solution to this issue. Instead of training the discriminator to distinguish real and fake input samples, we investigate the relationship between paired samples by training the discriminator to separate paired samples from the same distribution and those from different distributions. To this end, we explore a relation network architecture for the discriminator and design a triplet loss which performs better generalization and stability. Extensive experiments on benchmark datasets show that the proposed relation discriminator and new loss can provide significant improvement on variable vision tasks including unconditional and conditional image generation and image translation.


title: Courant-Dorfman algebras of differential operators and Dorfman connections of Courant algebroids

abstract: We construct an algebra and a complex of multidifferential operators on tensor products of a Courant algebroid E with values in the endomorphism bundle of a smooth vector bundle B, predual of E, extending the standard complex of the Courant-Dorfman algebra of E. Also, we study Dorfman connections of E on B, and show that the Cartan calculus, curvatures of induced connections and basic differential geometric identities of them make sense in this algebra.


title: Domain wall-grain boundary interactions in polycrystalline Pb(Zr0.7Ti0.3)O3 piezoceramics

abstract: Interactions between grain boundaries and domain walls were extensively studied in ferroelectric films and bicrystals. This knowledge, however, has not been transferred to polycrystalline ceramics, in which the grain size represents a powerful tool to tailor the dielectric and electromechanical response. Here, we relate changes in dielectric and electromechanical properties of a bulk polycrystalline Pb(Zr0.7Ti0.3)O3 to domain wall interactions with grain boundaries. Samples with grain sizes in the range of 3.9 - 10.4 micrometers were prepared and their microstructure, crystal structure, and dielectric/electromechanical properties were investigated. A decreasing grain size was accompanied by a reduction in large-signal electromechanical properties and an increase in small-signal dielectric permittivity. High-energy diffraction analysis revealed increasing microstrains upon decreasing the grain size, while piezoresponse force microscopy indicated an increased local coercive voltage near grain boundaries. The changes in properties were thus related to strained material volume close to the grain boundaries exhibiting reduced domain wall dynamics.


title: Improving STDP-based Visual Feature Learning with Whitening

abstract: In recent years, spiking neural networks (SNNs) emerge as an alternative to deep neural networks (DNNs). SNNs present a higher computational efficiency using low-power neuromorphic hardware and require less labeled data for training using local and unsupervised learning rules such as spike timing-dependent plasticity (STDP). SNN have proven their effectiveness in image classification on simple datasets such as MNIST. However, to process natural images, a pre-processing step is required. Difference-of-Gaussians (DoG) filtering is typically used together with on-center/off-center coding, but it results in a loss of information that is detrimental to the classification performance. In this paper, we propose to use whitening as a pre-processing step before learning features with STDP. Experiments on CIFAR-10 show that whitening allows STDP to learn visual features that are closer to the ones learned with standard neural networks, with a significantly increased classification performance as compared to DoG filtering. We also propose an approximation of whitening as convolution kernels that is computationally cheaper to learn and more suited to be implemented on neuromorphic hardware. Experiments on CIFAR-10 show that it performs similarly to regular whitening. Cross-dataset experiments on CIFAR-10 and STL-10 also show that it is fairly stable across datasets, making it possible to learn a single whitening transformation to process different datasets.


title: An Asymptotic Test for Constancy of the Variance under Short-Range Dependence

abstract: We present a novel approach to test for heteroscedasticity of a non-stationary time series that is based on Gini's mean difference of logarithmic local sample variances. In order to analyse the large sample behaviour of our test statistic, we establish new limit theorems for U-statistics of dependent triangular arrays. We derive the asymptotic distribution of the test statistic under the null hypothesis of a constant variance and show that the test is consistent against a large class of alternatives, including multiple structural breaks in the variance. Our test is applicable even in the case of non-stationary processes, assuming a locally stationary mean function. The performance of the test and its comparatively low computation time are illustrated in an extensive simulation study. As an application, we analyse Google Trends data, monitoring the relative search interest for the topic "global warming."


title: HRank: Filter Pruning using High-Rank Feature Map

abstract: Neural network pruning offers a promising prospect to facilitate deploying deep neural networks on resource-limited devices. However, existing methods are still challenged by the training inefficiency and labor cost in pruning designs, due to missing theoretical guidance of non-salient network components. In this paper, we propose a novel filter pruning method by exploring the High Rank of feature maps (HRank). Our HRank is inspired by the discovery that the average rank of multiple feature maps generated by a single filter is always the same, regardless of the number of image batches CNNs receive. Based on HRank, we develop a method that is mathematically formulated to prune filters with low-rank feature maps. The principle behind our pruning is that low-rank feature maps contain less information, and thus pruned results can be easily reproduced. Besides, we experimentally show that weights with high-rank feature maps contain more important information, such that even when a portion is not updated, very little damage would be done to the model performance. Without introducing any additional constraints, HRank leads to significant improvements over the state-of-the-arts in terms of FLOPs and parameters reduction, with similar accuracies. For example, with ResNet-110, we achieve a 58.2%-FLOPs reduction by removing 59.2% of the parameters, with only a small loss of 0.14% in top-1 accuracy on CIFAR-10. With Res-50, we achieve a 43.8%-FLOPs reduction by removing 36.7% of the parameters, with only a loss of 1.17% in the top-1 accuracy on ImageNet. The codes can be available at https://github.com/lmbxmu/HRank.


title: The impact of hexagonal boron nitride encapsulation on the structural and vibrational properties of few layer black phosphorus

abstract: The encapsulation of two-dimensional layered materials such as black phosphorus is of paramount importance for their stability in air. However, the encapsulation poses several questions, namely, how it affects, via the weak van der Waals forces, the properties of the black phosphorus and whether these properties can be tuned on demand. Prompted by these questions, we have investigated the impact of hexagonal boron nitride encapsulation on the structural and vibrational properties of few layer black phosphorus, using a first-principles method in the framework of density functional theory. We demonstrate that the encapsulation with hexagonal boron nitride imposes biaxial strain on the black phosphorus material, flattening its puckered structure, by decreasing the thickness of the layers via the increase of the puckered angle and the intra-layer P-P bonds. This work exemplifies the evolution of structural parameters in layered materials after the encapsulation process. We find that after encapsulation, phosphorene (single layer black phosphorous) contracts by 1.1% in the armchair direction and stretches by 1.3% in the zigzag direction, whereas few layer black phosphorus mainly expands by up to 3% in the armchair direction. However, these relatively small strains induced by the hexagonal BN, lead to significant changes in the vibrational properties of black phosphorus, with the redshifts of up to 10 cm$^{-1}$ of the high frequency optical mode $A_g^1$. In general, structural changes induced by the encapsulation process open the door to substrate controlled strain engineering in two-dimensional crystals.


title: Relaxing Relationship Queries on Graph Data

abstract: In many domains we have witnessed the need to search a large entity-relation graph for direct and indirect relationships between a set of entities specified in a query. A search result, called a semantic association (SA), is typically a compact (e.g., diameter-constrained) connected subgraph containing all the query entities. For this problem of SA search, efficient algorithms exist but will return empty results if some query entities are distant in the graph. To reduce the occurrence of failing query and provide alternative results, we study the problem of query relaxation in the context of SA search. Simply relaxing the compactness constraint will sacrifice the compactness of an SA, and more importantly, may lead to performance issues and be impracticable. Instead, we focus on removing the smallest number of entities from the original failing query, to form a maximum successful sub-query which minimizes the loss of result quality caused by relaxation. We prove that verifying the success of a sub-query turns into finding an entity (called a certificate) that satisfies a distance-based condition about the query entities. To efficiently find a certificate of the success of a maximum sub-query, we propose a best-first search algorithm that leverages distance-based estimation to effectively prune the search space. We further improve its performance by adding two fine-grained heuristics: one based on degree and the other based on distance. Extensive experiments over popular RDF datasets demonstrate the efficiency of our algorithm, which is more scalable than baselines.


title: Simulation of heat transfer and dissipation in targets used in nuclear astrophysics experiments

abstract: This work presents time-dependent numerical calculations of heat generation and dissipation in targets used in high ion-beam current nuclear astrophysics experiments. The simulation is beneficial for choosing the thickness of targets, maximum ion-beam current and design setup for cooling of such targets. It is found that for the very thin target ($^{27}Al(p,p),^{12}C(p,p)$) heat generation inside target is relatively low and a fair amount of high current (few $\mu$A)can be used without any melting issue. But in case of thick targets ($^{27}Al(p,\gamma),^{12}C(p,\gamma)$) cooling became essential for the survival of reaction target.


title: J-PET Framework: Software platform for PET tomography data reconstruction and analysis

abstract: J-PET Framework is an open-source software platform for data analysis, written in C++ and based on the ROOT package. It provides a common environment for implementation of reconstruction, calibration and filtering procedures, as well as for user-level analyses of Positron Emission Tomography data. The library contains a set of building blocks that can be combined by users with even little programming experience, into chains of processing tasks through a convenient, simple and well-documented API. The generic input-output interface allows processing the data from various sources: low-level data from the tomography acquisition system or from diagnostic setups such as digital oscilloscopes, as well as high-level tomography structures e.g. sinograms or a list of lines-of-response. Moreover, the environment can be interfaced with Monte Carlo simulation packages such as GEANT and GATE, which are commonly used in the medical scientific community.


title: Understanding developing turbulence by a study of the nonlinear energy transfer in the Navier-Stokes equation

abstract: In the present work, we investigate a numerical one-dimensional solver to the Navier-Stokes equation that retains all terms, including both pressure and dissipation. Solutions to simple examples that illustrate the actions of the nonlinear term are presented and discussed. The calculations take the full 4D flow as its starting point and continuously projects the forces acting on the fluid at a fixed Eulerian point in a stationary coordinate system onto the direction of the instantaneous velocity. Pressure is included through modeling. Adhering to the requirement that time must in general be considered an independent variable, the time development of the time records and power spectra of the velocity fluctuations are studied. It is found that the actions of the nonlinear term in the Navier-Stokes equation manifests itself by generating sharp pulses in the time traces, where the sharpness is bounded by the finite viscosity. In the spectral domain, the sharp gradients in the pulses generate energy contributions at high frequencies that yields a $-2$ slope across the inertial range. The $-2$ (or $-6/3$) slope is explained through a simple example and the classically expected $-5/3$ slope in the inertial range can be recovered from the pressure fluctuations from the full flow field that can be considered a noise contribution at the point considered. We also observe that the spectrum can in principle keep spreading to higher frequencies or wavenumbers without upper bound, as the viscosity is approaching the zero limit.


title: iLQGames.jl: Rapidly Designing and Solving Differential Games in Julia

abstract: In many problems that involve multiple decision making agents, optimal choices for each agent depend on the choices of others. Differential game theory provides a principled formalism for expressing these coupled interactions and recent work offers efficient approximations to solve these problems to non-cooperative equilibria. iLQGames.jl is a framework for designing and solving differential games, built around the iterative linear-quadratic method. It is written in the Julia programming language to allow flexible prototyping and integration with other research software, while leveraging the high-performance nature of the language to allow real-time execution. The open-source software package can be found at https://github.com/lassepe/iLQGames.jl.


title: Mode I fracture toughness of asymmetric metal-composite adhesive joints

abstract: In this work, the mode I fracture toughness of dissimilar metal-composite adhesive joints is experimentally investigated using the double cantilever beam (DCB) test. The particular joint under study is resulted by the adhesive joining of a thin titanium sheet with a thin carbon fiber reinforced plastic (CFRP) laminate and is envisioned to be implemented in the hybrid laminar flow control system of future aircraft. Four different industrial technologies for the joining of the titanium and CFRP adherents are evaluated/compared; co-bonding with and without adhesive and secondary bonding using either thermoset or thermoplastic CFRP. The vacuum-assisted resin transfer molding (VARTM) technique is employed for the manufacturing of the panels. After manufacturing, the panels are cut into test specimens that, because they are too thin (approximately 2.4 mm thick), needed to be stiffened from both titanium and composite sides with two aluminum backing beams to ensure the non-yielding of the titanium during the subsequent DCB tests. Towards the determination of the fracture toughness of the joint from the experimental data, an analytical model recently developed by the authors, that considers the bending-extension coupling of both sub-laminates constituting the test specimen as well as the manufacturing-induced residual thermal stresses, is applied. For the four manufacturing options (MO) investigated, the load-displacement behaviors, failure patterns, and fracture toughness performances are presented and compared.


title: 3DSSD: Point-based 3D Single Stage Object Detector

abstract: Currently, there have been many kinds of voxel-based 3D single stage detectors, while point-based single stage methods are still underexplored. In this paper, we first present a lightweight and effective point-based 3D single stage object detector, named 3DSSD, achieving a good balance between accuracy and efficiency. In this paradigm, all upsampling layers and refinement stage, which are indispensable in all existing point-based methods, are abandoned to reduce the large computation cost. We novelly propose a fusion sampling strategy in downsampling process to make detection on less representative points feasible. A delicate box prediction network including a candidate generation layer, an anchor-free regression head with a 3D center-ness assignment strategy is designed to meet with our demand of accuracy and speed. Our paradigm is an elegant single stage anchor-free framework, showing great superiority to other existing methods. We evaluate 3DSSD on widely used KITTI dataset and more challenging nuScenes dataset. Our method outperforms all state-of-the-art voxel-based single stage methods by a large margin, and has comparable performance to two stage point-based methods as well, with inference speed more than 25 FPS, 2x faster than former state-of-the-art point-based methods.


title: Perturbative Thermal QCD: Formalism and Applications

abstract: In this review article, we discuss the current status and future prospects of perturbation theory as a means of studying the equilibrium thermodynamic and near-equilibrium transport properties of deconfined QCD matter. We begin with a brief introduction to the general topic, after which we review in some detail the foundations and modern techniques of the real- and imaginary-time formalisms of thermal field theory, covering e.g. the different bases used in the real-time formalism and the resummations required to deal with soft and collinear contributions. After this, we discuss the current status of applications of these techniques, including topics such as electromagnetic rates, transport coefficients, jet quenching, heavy quarks and quarkonia, and the Equations of State of hot quark-gluon plasma as well as cold and dense quark matter. Finally, we conclude with our view of the future directions of the field, i.e. how we anticipate perturbative calculations to contribute to our collective understanding of strongly interacting matter in the coming years.


title: Reconstructing the Fraction of Baryons in the Intergalactic Medium with Fast Radio Bursts via Gaussian Processes

abstract: Fast radio bursts (FRBs) are a promising new probe for astronomy and cosmology. Thanks to their extragalactic and cosmological origin, FRBs could be used to study the intergalactic medium (IGM) and the cosmic expansion. It is expected that numerous FRBs with identified redshifts will be available in the near future through the identification of their host galaxies or counterparts. $\rm DM_{IGM}$, the contribution from IGM to the observed dispersion measure (DM) of FRB, carries the key information about IGM and the cosmic expansion history. We can thus study the evolution of the universe by using FRBs with identified redshifts. In the present work, we are interested in the fraction of baryon mass in the IGM, $f_{\rm IGM}$, which is useful to study the cosmic expansion and the problem of the "missing baryons". We propose to reconstruct the evolution of $f_{\rm IGM}$ as a function of redshift $z$ with FRBs via a completely model-independent method, namely Gaussian processes. Since there is not a large sample of FRBs with identified redshifts, we use simulated FRBs instead. Through various simulations, we show that this methodology works well.


title: Robust excitation and Raman conversion of guided vortices in chiral gas-filled photonic crystal fiber

abstract: The unique ring-shaped intensity patterns and helical phase fronts of optical vortices make them useful in many applications. Here we report for the first time efficient Raman frequency conversion between vortex modes in twisted hydrogen-filled single-ring hollow core photonic crystal fiber (SR-PCF). High fidelity transmission of optical vortices in untwisted SR-PCF becomes more and more difficult as the orbital angular momentum (OAM) order increases, due to scattering at structural imperfections in the fiber microstructure. In helically twisted SR-PCF, however, the degeneracy between left- and right-handed versions of the same mode is lifted, with the result that they are topologically protected from such scattering. With launch efficiencies of ~75%, a high damage threshold and broadband guidance, these fibers are ideal for performing nonlinear experiments that require the polarization state and azimuthal order of the interacting modes to be preserved over long distances. Vortex coherence waves (VCW) of internal molecular motion, carrying angular momentum, are excited in the gas, permitting the polarization and orbital angular momentum of the Raman bands to be tailored, even in spectral regions where conventional solid-core waveguides are opaque or susceptible to optical damage.


title: Learning Attentive Pairwise Interaction for Fine-Grained Classification

abstract: Fine-grained classification is a challenging problem, due to subtle differences among highly-confused categories. Most approaches address this difficulty by learning discriminative representation of individual input image. On the other hand, humans can effectively identify contrastive clues by comparing image pairs. Inspired by this fact, this paper proposes a simple but effective Attentive Pairwise Interaction Network (API-Net), which can progressively recognize a pair of fine-grained images by interaction. Specifically, API-Net first learns a mutual feature vector to capture semantic differences in the input pair. It then compares this mutual vector with individual vectors to generate gates for each input image. These distinct gate vectors inherit mutual context on semantic differences, which allow API-Net to attentively capture contrastive clues by pairwise interaction between two images. Additionally, we train API-Net in an end-to-end manner with a score ranking regularization, which can further generalize API-Net by taking feature priorities into account. We conduct extensive experiments on five popular benchmarks in fine-grained classification. API-Net outperforms the recent SOTA methods, i.e., CUB-200-2011 (90.0%), Aircraft(93.9%), Stanford Cars (95.3%), Stanford Dogs (90.3%), and NABirds (88.1%).


title: Twisted Alexander invariants of knot group representations

abstract: Given a homomorphism from a knot group to a fixed group, we introduce an element of a $K_1$-group, which is a generalization of (twisted) Alexander polynomials. We compare this $K_1$-class with other Alexander polynomials. In terms of semi-local rings, we compute the $K_1$-classes of some knots and show their non-triviality. We also introduce metabelian Alexander polynomials.


title: When the disc's away, the stars will play: dynamical masses in the nova-like variable KR Aur with a pinch of accretion

abstract: We obtained time-resolved optical photometry and spectroscopy of the nova-like variable KR Aurigae in the low state. The spectrum reveals a DAB white dwarf and a mid-M dwarf companion. Using the companion star's $i$-band ellipsoidal modulation we refine the binary orbital period to be $P = 3.906519 \pm 0.000001$ h. The light curve and the spectra show flaring activity due to episodic accretion. One of these events produced brightness oscillations at a period of 27.4 min, that we suggest to be related with the rotation period of a possibly magnetic white dwarf at either 27.4 or 54.8 min. Spectral modelling provided a spectral type of M4-5 for the companion star and $T_{1}=27148 \pm 496$ K, $\log g=8.90 \pm 0.07$, and $\log (\mathrm{He/H})= -0.79^{+0.07}_{-0.08}~~$ for the white dwarf. By simultaneously fitting absorption- and emission-line radial velocity curves and the ellipsoidal light curve, we determined the stellar masses to be $M_1 = 0.94^{+0.15}_{-0.11}~$ $M_\odot$ and $M_2 = 0.37^{+0.07}_{-0.07}~$ $M_\odot$ for the white dwarf and the M-dwarf, respectively, and an orbital inclination of $47^{+1^{\rm o}}_{-2^{\rm o}}$. Finally, we analyse time-resolved spectroscopy acquired when the system was at an $i$-band magnitude of 17.1, about 1.3 mag brighter than it was in the low state. In this intermediate state the line profiles contain an emission S-wave delayed by $\simeq 0.2$ orbital cycle relative to the motion of the white dwarf, similar to what is observed in SW Sextantis stars in the high state.


title: A Put-Call Transformation of the Exchange Option Problem under Stochastic Volatility and Jump Diffusion Dynamics

abstract: We price European and American exchange options where the underlying asset prices are modelled using a Merton (1976) jump-diffusion with a common Heston (1993) stochastic volatility process. Pricing is performed under an equivalent martingale measure obtained by setting the second asset yield process as the numeraire asset, as suggested by Bjerskund and Stensland (1993). Such a choice for the numeraire reduces the exchange option pricing problem, a two-dimensional problem, to pricing a call option written on the ratio of the yield processes of the two assets, a one-dimensional problem. The joint transition density function of the asset yield ratio process and the instantaneous variance process is then determined from the corresponding Kolmogorov backward equation via integral transforms. We then determine integral representations for the European exchange option price and the early exercise premium and state a linked system of integral equations that characterizes the American exchange option price and the associated early exercise boundary. Properties of the early exercise boundary near maturity are also discussed.


title: ALMA chemical survey of disk-outflow sources in Taurus (ALMA-DOT): I. CO, CS, CN, and H2CO around DG Tau B

abstract: The chemical composition of planets is inherited by the distribution of the various molecular species in the protoplanetary disk at thetime of their formation. As of today, only a handful of disks has been imaged in multiple spectral lines with high spatial resolution. As part of a small campaign devoted to the chemical characterization of disk-outflow sources in Taurus, we report on new ALMA Band 6 observations with 20 au resolution toward the embedded young star DG Tau B. Images of the continuum emission reveals a dust disk with rings and, putatively, a leading spiral arm. The disk, as well as the prominent outflow cavities, are detected in CO, H2CO, CS, and CN while they remain undetected in SO2, HDO, and CH3OH. From the absorption of the back-side outflow, we inferred that the disk emission is optically thick in the inner 50 au. This morphology explains why no line emission is detected from this inner region and poses some limitations toward the calculation of the dust mass and the characterization of the inner gaseous disk. The H2CO and CS emission from the inner 200 au is mostly from the disk and their morphology is very similar. The CN emission significantly differs from the other two molecules as it is observed only beyond 150 au. This ring-like morphology is consistent with previous observations and the predictions of thermochemical disk models. Finally, we constrained the disk-integrated column density of all molecules. In particular, we found that the CH3OH/H2CO ratio must be smaller than 2, making the methanol non-detection still consistent with the only such a ratio available from the literature (1.27 in TW Hya).


title: A knowledge-based model of civilization under climate change

abstract: Civilization produces knowledge, which acts as the driving force of its development. A macro-model of civilization that accounts for the effect of knowledge production on population, energy consumption and environmental conditions is developed. The model includes dynamic equations for world population, amount of knowledge circulating in civilization, the share of fossil fuels in total energy consumption, atmospheric CO2 concentration, and global mean surface temperature. Energy dissipation in knowledge production and direct loss of knowledge are taken into account. The model is calibrated using historical data for each variable. About 90 scenarios were calculated. It was shown that there are two control parameters - sensitivity of the population to temperature rise and coefficient of knowledge loss - which determine the future of civilization. In the two-dimensional space of these parameters, there is an area of sustainable development and an area of loss of stability. Calculations show that civilization is located just on the critical curve separating these areas, that is, at the edge of stability. A small deviation can ultimately lead either to a steady state of 10+ billion people or to the complete extinction of civilization. There are no intermediate steady states.


title: Fermionic state discrimination by local operations and classical communication

abstract: We consider the problem of local operations and classical communication (LOCC) discrimination between two bipartite pure states of fermionic systems. We show that, contrary to the case of quantum systems, for fermionic systems it is generally not possible to achieve the ideal state discrimination performances through LOCC measurements. On the other hand, we show that an ancillary system made of two fermionic modes in a maximally entangled state is a sufficient additional resource to attain the ideal performances via LOCC measurements. The stability of the ideal results is studied when the probability of preparation of the two states is perturbed, and a tight bound on the discrimination error is derived.


title: Leveraging Code Generation to Improve Code Retrieval and Summarization via Dual Learning

abstract: Code summarization generates brief natural language description given a source code snippet, while code retrieval fetches relevant source code given a natural language query. Since both tasks aim to model the association between natural language and programming language, recent studies have combined these two tasks to improve their performance. However, researchers have yet been able to effectively leverage the intrinsic connection between the two tasks as they train these tasks in a separate or pipeline manner, which means their performance can not be well balanced. In this paper, we propose a novel end-to-end model for the two tasks by introducing an additional code generation task. More specifically, we explicitly exploit the probabilistic correlation between code summarization and code generation with dual learning, and utilize the two encoders for code summarization and code generation to train the code retrieval task via multi-task learning. We have carried out extensive experiments on an existing dataset of SQL and Python, and results show that our model can significantly improve the results of the code retrieval task over the-state-of-art models, as well as achieve competitive performance in terms of BLEU score for the code summarization task.


title: Better Classifier Calibration for Small Data Sets

abstract: Classifier calibration does not always go hand in hand with the classifier's ability to separate the classes. There are applications where good classifier calibration, i.e. the ability to produce accurate probability estimates, is more important than class separation. When the amount of data for training is limited, the traditional approach to improve calibration starts to crumble. In this article we show how generating more data for calibration is able to improve calibration algorithm performance in many cases where a classifier is not naturally producing well-calibrated outputs and the traditional approach fails. The proposed approach adds computational cost but considering that the main use case is with small data sets this extra computational cost stays insignificant and is comparable to other methods in prediction time. From the tested classifiers the largest improvement was detected with the random forest and naive Bayes classifiers. Therefore, the proposed approach can be recommended at least for those classifiers when the amount of data available for training is limited and good calibration is essential.


title: ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Network

abstract: Scene text detection and recognition has received increasing research attention. Existing methods can be roughly categorized into two groups: character-based and segmentation-based. These methods either are costly for character annotation or need to maintain a complex pipeline, which is often not suitable for real-time applications. Here we address the problem by proposing the Adaptive Bezier-Curve Network (ABCNet). Our contributions are three-fold: 1) For the first time, we adaptively fit arbitrarily-shaped text by a parameterized Bezier curve. 2) We design a novel BezierAlign layer for extracting accurate convolution features of a text instance with arbitrary shapes, significantly improving the precision compared with previous methods. 3) Compared with standard bounding box detection, our Bezier curve detection introduces negligible computation overhead, resulting in superiority of our method in both efficiency and accuracy. Experiments on arbitrarily-shaped benchmark datasets, namely Total-Text and CTW1500, demonstrate that ABCNet achieves state-of-the-art accuracy, meanwhile significantly improving the speed. In particular, on Total-Text, our realtime version is over 10 times faster than recent state-of-the-art methods with a competitive recognition accuracy. Code is available at https://tinyurl.com/AdelaiDet


title: Beyond Camera Motion Blur Removing: How to Handle Outliers in Deblurring

abstract: Camera motion deblurring is an important low-level vision task for achieving better imaging quality. When a scene has outliers such as saturated pixels, the captured blurred image becomes more difficult to restore. In this paper, we propose a novel method to handle camera motion blur with outliers. We first propose an edge-aware scale-recurrent network (EASRN) to conduct deblurring. EASRN has a separate deblurring module that removes blur at multiple scales and an upsampling module that fuses different input scales. Then a salient edge detection network is proposed to supervise the training process and constraint the edges restoration. By simulating camera motion and adding various light sources, we can generate blurred images with saturation cutoff. Using the proposed data generation method, our network can learn to deal with outliers effectively. We evaluate our method on public test datasets including the GoPro dataset, Kohler's dataset and Lai's dataset. Both objective evaluation indexes and subjective visualization show that our method results in better deblurring quality than other state-of-the-art approaches.


title: Representation of Exchange Option Prices under Stochastic Volatility Jump-Diffusion Dynamics

abstract: In this article, we provide representations of European and American exchange option prices under stochastic volatility jump-diffusion (SVJD) dynamics following models by Merton (1976), Heston (1993), and Bates (1996). A Radon-Nikodym derivative process is also introduced to facilitate the shift from the objective market measure to other equivalent probability measures, including the equivalent martingale measure. Under the equivalent martingale measure, we derive the integro-partial differential equation that characterizes the exchange option prices. We also derive representations of the European exchange option price using the change-of-numeraire technique proposed by Geman et al. (1995) and the Fourier inversion formula derived by Caldana and Fusai (2013), and show that these two representations are comparable. Lastly, we show that the American exchange option price can be decomposed into the price of the European exchange option and an early exercise premium.


title: The local-global property for bitangents of plane quartics

abstract: We study the arithmetic of bitangents of smooth quartics over global fields. With the aid of computer algebra systems and using Elsenhans--Jahnel's results on the inverse Galois problem for bitangents, we show that, over any global field of characteristic different from $2$, there exist smooth quartics which have bitangents over every local field, but do not have bitangents over the global field. We give an algorithm to find such quartics explicitly, and give an example over $\mathbb{Q}$. We also discuss a similar problem concerning symmetric determinantal representations. This paper is a summary of the first author's talk at the JSIAM JANT workshop on algorithmic number theory in March 2019. Details will appear elsewhere.


title: Fast-rotating galaxies do not depart from the MOND mass-asymptotic-speed relation

abstract: Ogle et al. have fallaciously argued recently that fast-rotating disc galaxies break with the predictions of MOND: the 6 fastest rotators of the 23 galaxies in their sample appear to have higher rotational speeds than is consistent with the MOND relation between the baryonic mass of a galaxy, $M$, and its `rotational speed', $V$. They interpret this departure as a break in the observed $M-V$ relation from a logarithmic slope near the MOND-predicted $4$, to a shallow slope of $\approx 0$. However, Ogle et al. use the MAXIMAL rotational speed of the galaxies, $V_{max}$, not the ASYMPTOTIC one, $V_\infty$, which appears in the MOND prediction, $V_\infty^4=MGa_0$. Plotting their $M$ vs. $V_{max}$ pairs on an $M$ vs. $V_\infty$ plot from Lelli et al. (2016), they arrive erroneously at the above tension with MOND. The $H_\alpha$ rotation curves used by Ogle et al. are far too short reaching to probe the asymptotic regime, and determine $V_\infty$. However, it is well documented for fast rotators with observed, extended, HI rotation curves, that they can have $V_{max}$ considerably larger than the MOND-relevant $V_\infty$ [Noordermeer and Verheijen (NV) (2007) and others]. E.g., the fastest rotator in the NV sample has $V_{max}\approx 490{\rm ~km/s}$, but $V_\infty\approx 250{\rm ~km/s}$. NV also show that in a (MOND-irrelevant) $M-V_{max}$ plot the high-speed galaxies fall off the power-law line defined by the lower-speed ones, creating a break in the $M$ vs. $V$ relation, in just the way claimed by Ogle et al. But, when plotting the MOND-relevant $M$ vs. $V_\infty$ all galaxies fall near the same power-law relation, without a break.


title: Velocity-aided IMU-based Attitude Estimation

abstract: This paper addresses the problem of estimating the attitude of a rigid body, which is subject to high accelerations and equipped with inertial measurement unit (IMU) and sensors providing the body velocity (expressed in the reference frame attached to the body). That issue can be treated differently depending on the level of confidence in the measurements of the magnetometer of the IMU, particularly with regard to the observation of the inclination component with respect to the vertical direction, rendering possible to describe the interaction with gravity. Two cases are then studied: either (i) the magnetometer is absent and only the inclination can be estimated, (ii) the magnetometer is present, giving redundancy and full attitude observability. In the latter case, the presented observer allows to tune how much the inclination estimation is influenced by the magnetometer. All state estimators are proposed with proof of almost global asymptotic stability and local exponential convergence. Finally, these estimators are compared with state-of-the-art solutions in clean and noisy simulations, allowing recommended solutions to be drawn for each case.


title: The role of adaptivity in a numerical method for the Cox-Ingersoll-Ross model

abstract: We demonstrate the effectiveness of an adaptive explicit Euler method for the approximate solution of the Cox-Ingersoll-Ross model. This relies on a class of path-bounded timestepping strategies which work by reducing the stepsize as solutions approach a neighbourhood of zero. The method is hybrid in the sense that a convergent backstop method is invoked if the timestep becomes too small, or to prevent solutions from overshooting zero and becoming negative. Under parameter constraints that imply Feller's condition, we prove that such a scheme is strongly convergent, of order at least 1/2. Control of the strong error is important for multi-level Monte Carlo techniques. Under Feller's condition we also prove that the probability of ever needing the backstop method to prevent a negative value can be made arbitrarily small. Numerically, we compare this adaptive method to fixed step implicit and explicit schemes, and a novel semi-implicit adaptive variant. We observe that the adaptive approach leads to methods that are competitive in a domain that extends beyond Feller's condition, indicating suitability for the modelling of stochastic volatility in Heston-type asset models.


title: $\mathcal{PT}$-symmetry-breaking enhanced cavity optomechanical magnetometry

abstract: $\mathcal{PT}$-symmetry-breaking enhanced cavity optomechanical magnetometer is proposed, which is achieved by monitoring the change of intensity of a nonlinear four-wave mixing (FWM) process in a gain-cavity-assisted cavity optomechanical system (COMS). Compared with the traditional single loss COMS, the FWM intensity can be enhanced by two orders of magnitude when the gain-cavity-assisted COMS operates at the $\mathcal{PT}$-symmetry-breaking phase. Meanwhile, the sensitivity of magnetic field sensing can be increased from $10^{-9}$T to $10^{-11}$T. This originally comes from the fact that the effective detuning and decay of loss-cavity can be effectively modified in the $\mathcal{PT}$-symmetry-breaking phase. Our work shows that an ultrahigh-sensitivity magnetometer can be achieved in the $\mathcal{PT}$-symmetry-breaking COMS, which will have wide applications in the field of quantum sensing.


title: Inverse learning in Hilbert scales

abstract: We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of convergence for the regularized solution under the prior assumptions and a certain link condition. We express the error in terms of certain distance functions. For regression functions with smoothness given in terms of source conditions the error bound can then be explicitly established.


title: Over-sized gas clumps in an extremely-metal-poor molecular cloud revealed by ALMA's pc-scale maps

abstract: Metals are thought to have profound effects on the internal structures of molecular clouds in which stars are born. The absence of metals is expected to prevent gas from efficient cooling and fragmentation in theory. However, this effect has not yet been observed at low metallicity environments, such as in the early Universe and local dwarf galaxies, because of the lack of high spatial resolution maps of gas. We carried out ALMA observations of the carbon monoxide (CO) J=2-1 emission line at 1.4-parsec resolutions of a molecular cloud in DDO 70 at 7% solar metallicity, the most metal-poor galaxy currently known with a CO detection. In total, five clumps have been identified and they are found to follow more or less the Larson's law. Since the CO emission exists in regions with visual extinction A_V around 1.0, we converted this A_V to the gas mass surface density using a gas-to-dust ratio of 4,594+-2,848 for DDO 70. We found that the CO clumps in DDO 70 exhibit significantly larger (on average four times) sizes than those at the same gas mass surface densities in massive star-formation regions of the Milky Way. The existence of such large clumps appears to be consistent with theoretical expectations that gas fragmentation in low metallicity clouds is suppressed. While our observation is only for one cloud in the galaxy, if it is representative, the above result implies suppressed gas fragmentation during the cloud collapse and star formation in the early Universe.


title: Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation

abstract: In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured records and a reference text for describing another recordset. The output is a summary that accurately describes the partial content in the source recordset with the same writing style of the reference. The task is unsupervised due to lack of parallel data, and is challenging to select suitable records and style words from bi-aspect inputs respectively and generate a high-fidelity long document. To tackle those problems, we first build a dataset based on a basketball game report corpus as our testbed, and present an unsupervised neural model with interactive attention mechanism, which is used for learning the semantic relationship between records and reference texts to achieve better content transfer and better style preservation. In addition, we also explore the effectiveness of the back-translation in our task for constructing some pseudo-training pairs. Empirical results show superiority of our approaches over competitive methods, and the models also yield a new state-of-the-art result on a sentence-level dataset.


title: Mnemonics Training: Multi-Class Incremental Learning without Forgetting

abstract: Multi-Class Incremental Learning (MCIL) aims to learn new concepts by incrementally updating a model trained on previous concepts. However, there is an inherent trade-off to effectively learning new concepts without catastrophic forgetting of previous ones. To alleviate this issue, it has been proposed to keep around a few examples of the previous concepts but the effectiveness of this approach heavily depends on the representativeness of these examples. This paper proposes a novel and automatic framework we call mnemonics, where we parameterize exemplars and make them optimizable in an end-to-end manner. We train the framework through bilevel optimizations, i.e., model-level and exemplar-level. We conduct extensive experiments on three MCIL benchmarks, CIFAR-100, ImageNet-Subset and ImageNet, and show that using mnemonics exemplars can surpass the state-of-the-art by a large margin. Interestingly and quite intriguingly, the mnemonics exemplars tend to be on the boundaries between different classes.


title: A Mechanised Semantics for HOL with Ad-hoc Overloading

abstract: Isabelle/HOL augments classical higher-order logic with ad-hoc overloading of constant definitions---that is, one constant may have several definitions for non-overlapping types. In this paper, we present a mechanised proof that HOL with ad-hoc overloading is consistent. All our results have been formalised in the HOL4 theorem prover.


title: Superoptimization of WebAssembly Bytecode

abstract: Motivated by the fast adoption of WebAssembly, we propose the first functional pipeline to support the superoptimization of WebAssembly bytecode. Our pipeline works over LLVM and Souper. We evaluate our superoptimization pipeline with 12 programs from the Rosetta code project. Our pipeline improves the code section size of 8 out of 12 programs. We discuss the challenges faced in superoptimization of WebAssembly with two case studies.


title: Injective Domain Knowledge in Neural Networks for Transprecision Computing

abstract: Machine Learning (ML) models are very effective in many learning tasks, due to the capability to extract meaningful information from large data sets. Nevertheless, there are learning problems that cannot be easily solved relying on pure data, e.g. scarce data or very complex functions to be approximated. Fortunately, in many contexts domain knowledge is explicitly available and can be used to train better ML models. This paper studies the improvements that can be obtained by integrating prior knowledge when dealing with a non-trivial learning task, namely precision tuning of transprecision computing applications. The domain information is injected in the ML models in different ways: I) additional features, II) ad-hoc graph-based network topology, III) regularization schemes. The results clearly show that ML models exploiting problem-specific information outperform the purely data-driven ones, with an average accuracy improvement around 38%.


title: On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answering

abstract: Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper relations between image content and ideas expressed in language. We present a dataset that takes a step towards addressing this problem in that it contains questions expressed in two languages, and an evaluation process that co-opts a well understood image-based metric to reflect the method's ability to reason. Measuring reasoning directly encourages generalization by penalizing answers that are coincidentally correct. The dataset reflects the scene-text version of the VQA problem, and the reasoning evaluation can be seen as a text-based version of a referring expression challenge. Experiments and analysis are provided that show the value of the dataset.


title: Metal-free magnetism in chemically doped covalent organic frameworks

abstract: Organic and molecule-based magnets are not easily attainable, because to introduce stable paramagnetic centers to pure organic systems is challenging. Crystalline covalent organic frameworks (COFs) with high designability and chemical diversity constitute ideal platforms to access intriguing magnetic phenomena of organic materials. In this work, we proposed a general approach to attain unpaired electron spin and metal-free magnetism in narrow-band COFs by chemical doping. By using density functional theory calculations, we found that dopants with energy-matched frontier orbitals to COFs not only inject charges to them but also further localize the charges through orbital hybridization and formation of supramolecular charge-transfer complex. The localized states enable stable paramagnetic centers introduced to nonmagnetic COFs. Based on this discovery, we designed two new COFs with narrow valence band, which show prospective magnetism after doping with iodine. Further, we unraveled magnetic anisotropy in two-dimensional COFs and showed that both spin-conduction and magnetic interactions can be modulated by manipulating the building blocks of COFs. Our work highlights a practical scenario to attain magnetism in COFs and other organic materials, which hold great promise for applications in organic spintronic devices.


title: Automatic Estimation of Sphere Centers from Images of Calibrated Cameras

abstract: Calibration of devices with different modalities is a key problem in robotic vision. Regular spatial objects, such as planes, are frequently used for this task. This paper deals with the automatic detection of ellipses in camera images, as well as to estimate the 3D position of the spheres corresponding to the detected 2D ellipses. We propose two novel methods to (i) detect an ellipse in camera images and (ii) estimate the spatial location of the corresponding sphere if its size is known. The algorithms are tested both quantitatively and qualitatively. They are applied for calibrating the sensor system of autonomous cars equipped with digital cameras, depth sensors and LiDAR devices.


title: Baryon acoustic oscillations reconstruction using convolutional neural networks

abstract: We propose a new scheme to reconstruct the baryon acoustic oscillations (BAO) signal, which contains key cosmological information, based on deep convolutional neural networks (CNN). Trained with almost no fine-tuning, the network can recover large-scale modes accurately in the test set: the correlation coefficient between the true and reconstructed initial conditions reaches $90\%$ at $k\leq 0.2 h\mathrm{Mpc}^{-1}$, which can lead to significant improvements of the BAO signal-to-noise ratio down to $k\simeq0.4h\mathrm{Mpc}^{-1}$. Since this new scheme is based on the configuration-space density field in sub-boxes, it is local and less affected by survey boundaries than the standard reconstruction method, as our tests confirm. We find that the network trained in one cosmology is able to reconstruct BAO peaks in the others, i.e. recovering information lost to non-linearity independent of cosmology. The accuracy of recovered BAO peak positions is far less than that caused by the difference in the cosmology models for training and testing, suggesting that different models can be distinguished efficiently in our scheme. It is very promising that Our scheme provides a different new way to extract the cosmological information from the ongoing and future large galaxy surveys.


title: Generalized Extended Momentum Operator

abstract: We study and generalize the momentum operator satisfying the extended uncertainty principle relation (EUP). This generalized extended momentum operator (GEMO) consists of an arbitrary auxiliary function of position operator, $\mu \left( x\right) $, in such a combination that not only GEMO satisfies the EUP relation but also it is Hermitian. Next, we apply the GEMO to construct the generalized one-dimensional Schr\"{o}dinger equation. Upon using the so called point canonical transformation (PCT), we transform the generalized Schr\"{o}dinger equation from $x$-space to $z$-space where in terms of the transformed coordinate, $z$, it is of the standard form of the Schr\"{o}dinger equation. In continuation, we study two illustrative examples and solve the corresponding equations analytically to find the energy spectrum.


title: On the use of the Infinity Computer architecture to set up a dynamic precision floating-point arithmetic

abstract: We devise a variable precision floating-point arithmetic by exploiting the framework provided by the Infinity Computer. This is a computational platform implementing the Infinity Arithmetic system, a positional numeral system which can handle both infinite and infinitesimal quantities symbolized by the positive and negative finite powers of the radix grossone. The computational features offered by the Infinity Computer allows us to dynamically change the accuracy of representation and floating-point operations during the flow of a computation. When suitably implemented, this possibility turns out to be particularly advantageous when solving ill-conditioned problems. In fact, compared with a standard multi-precision arithmetic, here the accuracy is improved only when needed, thus not affecting that much the overall computational effort. An illustrative example about the solution of a nonlinear equation is also presented.


title: The Archimedean trap: Why traditional reinforcement learning will probably not yield AGI

abstract: After generalizing the Archimedean property of real numbers in such a way as to make it adaptable to non-numeric structures, we demonstrate that the real numbers cannot be used to accurately measure non-Archimedean structures. We argue that, since an agent with Artificial General Intelligence (AGI) should have no problem engaging in tasks that inherently involve non-Archimedean rewards, and since traditional reinforcement learning rewards are real numbers, therefore traditional reinforcement learning probably will not lead to AGI. We indicate two possible ways traditional reinforcement learning could be altered to remove this roadblock.


title: Novel Insights in the Levy-Levy-Solomon Agent-Based Economic Market Model

abstract: The Levy-Levy-Solomon model (A microscopic model of the stock market: cycles, booms, and crashes, Economic Letters 45 (1))is one of the most influential agent-based economic market models. In several publications this model has been discussed and analyzed. Especially Lux and Zschischang (Some new results on the Levy, Levy and Solomon microscopic stock market model, Physica A, 291(1-4)) have shown that the model exhibits finite-size effects. In this study we extend existing work in several directions. First, we show simulations which reveal finite-size effects of the model. Secondly, we shed light on the origin of these finite-size effects. Furthermore, we demonstrate the sensitivity of the Levy-Levy-Solomon model with respect to random numbers. Especially, we can conclude that a low-quality pseudo random number generator has a huge impact on the simulation results. Finally, we study the impact of the stopping criteria in the market clearance mechanism of the Levy-Levy-Solomon model.

categories: q-fin.TR econ.GN physics.soc-ph q-fin.EC


title: Photometric study of selected X-ray binaries

abstract: We present results of a long-term photometric multicolor optical monitoring project of selected low-mass and high-mass X-ray binaries carried out at the T\"UB\.ITAK National Observatory (TUG). New long-term $VRI$ multicolor observations of three selected X-ray binaries with neutron star components (HZ Her, ScoX-1, SAX J2103.5+4545) were observed between 2015 and 2019 with the TUG 60-cm telescope. The light variations of the systems are presented and discussed.


title: Self-blinking Dyes unlock High-order and Multi-plane Super-resolution Optical Fluctuation Imaging

abstract: Diffraction unlimited super-resolution imaging critically depends on the switching of fluorophores between at least two states, often induced using intense laser light and special buffers. The high illumination power or UV light required for appropriate blinking kinetics is currently hindering live-cell experiments. Recently, so-called self-blinking dyes that switch spontaneously between an open, fluorescent "on"-state and a closed colorless "off"-state were introduced. Here we exploit the synergy between super-resolution optical fluctuation imaging (SOFI) and spontaneously switching fluorophores for 2D functional and for volumetric imaging. SOFI tolerates high labeling densities, on-time ratios, and low signal-to-noise by analyzing higher-order statistics of a few hundred to thousand frames of stochastically blinking fluorophores. We demonstrate 2D imaging of fixed cells with a uniform resolution up to 50-60 nm in 6th order SOFI and characterize changing experimental conditions. We extend multiplane cross-correlation analysis to 4th order using biplane and 8-plane volumetric imaging achieving up to 29 (virtual) planes. The low laser excitation intensities needed for self-blinking SOFI are ideal for live-cell imaging. We show proof-of-principal time-resolved imaging by observing slow membrane movements in cells. Self-blinking SOFI provides a route for easy-to-use 2D and 3D high-resolution functional imaging that is robust against artefacts and suitable for live-cell imaging.


title: An Updated Galactic Double Neutron Star Merger Rate Based on Radio Pulsar Populations

abstract: Following the procedure described in Pol et al., we update the Galactic double neutron star (DNS) merger rate by including the new, highly eccentric DNS system J0509+3801 (Lynch et al.). This leads to a new Galactic DNS merger rate of $\mathcal{R}_{\rm MW} = 37^{+24}_{-11}$ Myr$^{-1}$, where the errors represent 90% confidence intervals. The corresponding DNS merger detection rate for Advanced LIGO is $\mathcal{R} = 1.9^{+1.2}_{-0.6} \times \left( D_{\rm r} / 100 \ \rm Mpc \right)^3 \rm yr^{-1},$ where $D_{\rm r}$ is the range distance. Using the LIGO O3 range distance of 130 Mpc (Abbott et al.), we predict that LIGO will detect anywhere between three and seven DNS mergers per year of observing at O3 sensitivity.


title: The dual formalisms of nonextensive thermodynamics for open systems with maximum entropy principle

abstract: We study the nonextensive thermodynamics for open systems. On the basis of the maximum entropy principle, the dual power-law q-distribution functions are re-deduced by using the dual particle number definitions and assuming that the chemical potential is constant in the two sets of parallel formalisms, where the fundamental thermodynamic equations with dual interpretations of thermodynamic quantities are derived for the open systems. By introducing parallel structures of Legendre transformations, other thermodynamic equations with dual interpretations of quantities are also deduced in the open systems, and then several dual thermodynamic relations are inferred. One can easily find that there are correlations between the dual relations, from which an equivalent rule is found that the Tsallis factor is invariable in calculations of partial derivative with constant volume or constant entropy. Using this rule, more correlations can be found. And the statistical expressions of the Lagrange internal energy and pressure are easily obtained.


title: The nonextensive statistical ensembles with dual thermodynamic interpretations

abstract: The nonextensive statistical ensembles are revisited for the complex systems with long-range interactions and long-range correlations. An approximation, the value of nonextensive parameter (1-q) is assumed to be very tiny, is adopted for the limit of large particle number for most normal systems. In this case, Tsallis entropy can be expanded as a function of energy and particle number fluctuation, and thus the power-law forms of the generalized Gibbs distribution and grand canonical distribution can be derived. These new distribution functions can be applied to derive the free energy and grand thermodynamic potential in nonextensive thermodynamics. In order to establish appropriate nonextensive thermodynamic formalism, the dual thermodynamic interpretations are necessary for thermodynamic relations and thermodynamic quantities. By using a new technique of parameter transformation, the single-particle distribution can be deduced from the power-law Gibbs distribution. This technique produces a link between the statistical ensemble and the quasi-independent system with two kinds of nonextensive parameter having quite different physical explanations. Furthermore, the technique is used to construct nonextensive quantum statistics and effectively to avoid the factorization difficulty in the power-law grand canonical distribution.


title: Dynamic Systems Simulation and Control Using Consecutive Recurrent Neural Networks

abstract: In this paper, we introduce a novel architecture to connecting adaptive learning and neural networks into an arbitrary machine's control system paradigm. Two consecutive Recurrent Neural Networks (RNNs) are used together to accurately model the dynamic characteristics of electromechanical systems that include controllers, actuators and motors. The age-old method of achieving control with the use of the- Proportional, Integral and Derivative constants is well understood as a simplified method that does not capture the complexities of the inherent nonlinearities of complex control systems. In the context of controlling and simulating electromechanical systems, we propose an alternative to PID controllers, employing a sequence of two Recurrent Neural Networks. The first RNN emulates the behavior of the controller, and the second the actuator/motor. The second RNN when used in isolation, potentially serves as an advantageous alternative to extant testing methods of electromechanical systems.


title: Examples of Morphological Calculus

abstract: In this paper we present an introduction to morphological calculus in which geometrical objects play the rule of generalised natural numbers.


title: Muon and Electron $g-2$ and the Origin of Fermion Mass Hierarchy

abstract: We present a model that gives a natural explanation to the charged lepton mass hierarchy and study the contributions to the electron and the muon $g-2$. In the model, we introduce lepton-flavor-dependent $U(1)_F$ symmetry and three additional Higgs doublets with $U(1)_F$ charges, to realize that each generation of charged leptons couples to one of the three additional Higgs doublets. The $U(1)_F$ symmetry is softly broken by $+1$ charges, and the smallness of the soft breaking naturally gives rise to the hierarchy of the Higgs VEVs, which then accounts for the charged lepton mass hierarchy. Since electron and muon couple to different scalar particles, each scalar contributes to the electron and the muon $g-2$ differently. We survey the space of parameters of the Higgs sector and find that there are sets of parameters that explain the muon $g-2$ discrepancy. On the other hand, we cannot find the parameter sets that can explain $g-2$ discrepancy within 2$\sigma$. Here the $U(1)_F$ symmetry suppresses charged lepton flavor violation.


title: Linear-frictional contact model for 3D discrete element simulations of granular systems

abstract: The linear-frictional contact model is the most commonly used contact mechanism for discrete element (DEM) simulations of granular materials. Linear springs with a frictional slider are used for modeling interactions in directions normal and tangential to the contact surface. Although the model is simple in two dimensions, its implementation in 3D faces certain subtle challenges, and the particle interactions that occur within a single time-step require careful modeling with a robust algorithm. The paper details a 3D algorithm that accounts for the changing direction of the tangential force within a time-step, the transition from elastic to slip behavior within a time-step, possible contact sliding during only part of a time-step, and twirling and rotation of the tangential force during a time-step. Without three of these adjustments, errors are introduced in the incremental stiffness of an assembly. Without the fourth adjustment, the resulting stress tensor is not only incorrect, it is no longer a tensor. The algorithm also computes the work increments during a time-step, both elastic and dissipative.


title: Quantitative distortion and the Hausdorff dimension of continued fractions

abstract: We prove a quantitative distortion theorem for iterated function systems that generate sets of continued fractions. As a consequence, we obtain upper and lower bounds on the Hausdorff dimension of any set of real or complex continued fractions. These bounds are solutions to Moran-type equations in the convergents that can be easily implemented in a computer algebra system.


title: ArcText: A Unified Text Approach to Describing Convolutional Neural Network Architectures

abstract: The superiority of Convolutional Neural Networks (CNNs) largely relies on their architectures that are often manually crafted with extensive human expertise. Unfortunately, such kind of domain knowledge is not necessarily owned by each of the users interested. Data mining on existing CNN can discover useful patterns and fundamental sub-comments from their architectures, providing researchers with strong prior knowledge to design proper CNN architectures when they have no expertise in CNNs. There have been various state-of-the-art data mining algorithms at hand, while there is only rare work that has been done for the mining. One of the main reasons is the gap between CNN architectures and data mining algorithms. Specifically, the current CNN architecture descriptions cannot be exactly vectorized to the input of data mining algorithms. In this paper, we propose a unified approach, named ArcText, to describing CNN architectures based on text. Particularly, four different units and an ordering method have been elaborately designed in ArcText, to uniquely describe the same architecture with sufficient information. Also, the resulted description can be exactly converted back to the corresponding CNN architecture. ArcText bridges the gap between CNN architectures and data mining researchers, and has the potentiality to be utilized to wider scenarios.


title: FR-Train: A Mutual Information-Based Approach to Fair and Robust Training

abstract: Trustworthy AI is a critical issue in machine learning where, in addition to training a model that is accurate, one must consider both fair and robust training in the presence of data bias and poisoning. However, the existing model fairness techniques mistakenly view poisoned data as an additional bias to be fixed, resulting in severe performance degradation. To address this problem, we propose FR-Train, which holistically performs fair and robust model training. We provide a mutual information-based interpretation of an existing adversarial training-based fairness-only method, and apply this idea to architect an additional discriminator that can identify poisoned data using a clean validation set and reduce its influence. In our experiments, FR-Train shows almost no decrease in fairness and accuracy in the presence of data poisoning by both mitigating the bias and defending against poisoning. We also demonstrate how to construct clean validation sets using crowdsourcing, and release new benchmark datasets.


title: Recurrent Dirichlet Belief Networks for Interpretable Dynamic Relational Data Modelling

abstract: The Dirichlet Belief Network~(DirBN) has been recently proposed as a promising approach in learning interpretable deep latent representations for objects. In this work, we leverage its interpretable modelling architecture and propose a deep dynamic probabilistic framework -- the Recurrent Dirichlet Belief Network~(Recurrent-DBN) -- to study interpretable hidden structures from dynamic relational data. The proposed Recurrent-DBN has the following merits: (1) it infers interpretable and organised hierarchical latent structures for objects within and across time steps; (2) it enables recurrent long-term temporal dependence modelling, which outperforms the one-order Markov descriptions in most of the dynamic probabilistic frameworks. In addition, we develop a new inference strategy, which first upward-and-backward propagates latent counts and then downward-and-forward samples variables, to enable efficient Gibbs sampling for the Recurrent-DBN. We apply the Recurrent-DBN to dynamic relational data problems. The extensive experiment results on real-world data validate the advantages of the Recurrent-DBN over the state-of-the-art models in interpretable latent structure discovery and improved link prediction performance.


title: Studies of heavy-ion collisions using PYTHIA Angantyr and UrQMD

abstract: In this paper, we show predictions from a new QGP-free, no-equilibration, improved baseline model for heavy-ion collisions. It is comprised of the PYTHIA Angantyr event generator coupled to UrQMD, as a hadronic cascade simulator, and compared to ALICE and CMS data from Pb-Pb collisions at $\sqrt{s_{\rm{NN}}}$ = 2.76 TeV. This coupling is made possible due to a new implementation of the hadron vertex model in PYTHIA Angantyr. Hadronic rescattering in UrQMD is shown to lead to a significant suppression of mid- to high-$p_\perp$ particle yields that is qualitatively consistent with measurements of nuclear modification factors. We further study the effect of hadronic rescatterings on high-$p_\perp$ particles by using two-particle correlations and show that some suppression of away-side jets occurs in the hadronic phase even without any partonic energy loss. Finally, the decorrelation of dijet structures at high momenta also leads to a reduction of the elliptic flow coefficient $v_{2}\{2\}$. These findings suggest that significant jet-quenching-like effects may still originate in the hadronic, as opposed to the partonic phase and prove that the usual Pb-Pb baseline, composed of a superposition of incoherent pp collisions, ignores coherent phenomena that are not strictly related to the QGP but may still be highly relevant.


title: Interaction between Surface Waves on Wire Lines

abstract: This paper investigates the coupling properties between surface waves on parallel wires. Finite Element Method (FEM) based and analytical models are developed for both single wire Sommerfeld and Goubau lines. Starting with the Sommerfeld type wave, we derive the analytical expression based on the assumption that the two-wire surface wave is a superposition of the two surface waves on the individual wires. Models are validated via measurements and a comparison study conducted between the analytic and the FEM-based computations for coupled Sommerfeld type lines. We then investigate the coupling between two Goubau lines with the FEM model. The measurement and calculations show remarkable agreement. The FEM-based and the analytical models match remarkably well too. The results exhibit new properties of favourable effects on surface waves propagation over multiple conductors. The short range behaviour of the coupled wires and consequently the existence of an optimum separation of coupled wires, is one of the most significant findings of this paper. We comment on the relevance of our results especially in relation to applications of high bandwidth demands and immanent cross-coupling effects.


title: F-manifold algebras and deformation quantization via pre-Lie algebras

abstract: The notion of an F-manifold algebra is the underlying algebraic structure of an $F$-manifold. We introduce the notion of pre-Lie formal deformations of commutative associative algebras and show that F-manifold algebras are the corresponding semi-classical limits. We study pre-Lie infinitesimal deformations and extension of pre-Lie n-deformation to pre-Lie (n+1)-deformation of a commutative associative algebra through the cohomology groups of pre-Lie algebras. We introduce the notions of pre-F-manifold algebras and dual pre-F-manifold algebras, and show that a pre-F-manifold algebra gives rise to an F-manifold algebra through the sub-adjacent associative algebra and the sub-adjacent Lie algebra. We use Rota-Baxter operators, more generally O-operators and average operators on F-manifold algebras to construct pre-F-manifold algebras and dual pre-F-manifold algebras.


title: Super-critical Hardy--Littlewood inequalities for multilinear forms

abstract: The multilinear Hardy--Littlewood inequalities provide estimates for the sum of the coefficients of multilinear forms $T:\ell_{p_{1}}^{n}\times\cdots \times\ell_{p_{m}}^{n}\rightarrow\mathbb{R}$ (or $\mathbb{C}$) when $1/p_{1}+\cdots+1/p_{m}<1.$ In this paper we investigate the critical and super-critical cases; i.e., when $1/p_{1}+\cdots+1/p_{m}\geq1.$


title: On Certain Topological Indices of Signed Graphs

abstract: The first Zagreb index of a graph $G$ is the sum of squares of the vertex degrees in a graph and the second Zagreb index of $G$ is the sum of products of degrees of adjacent vertices in $G$. The imbalance of an edge in $G$ is the numerical difference of degrees of its end vertices and the irregularity of $G$ is the sum of imbalances of all its edges. In this paper, we extend the concepts of these topological indices for signed graphs and discuss the corresponding results on signed graphs.


title: Multi-objective Consensus Clustering Framework for Flight Search Recommendation

abstract: In the travel industry, online customers book their travel itinerary according to several features, like cost and duration of the travel or the quality of amenities. To provide personalized recommendations for travel searches, an appropriate segmentation of customers is required. Clustering ensemble approaches were developed to overcome well-known problems of classical clustering approaches, that each rely on a different theoretical model and can thus identify in the data space only clusters corresponding to this model. Clustering ensemble approaches combine multiple clustering results, each from a different algorithmic configuration, for generating more robust consensus clusters corresponding to agreements between initial clusters. We present a new clustering ensemble multi-objective optimization-based framework developed for analyzing Amadeus customer search data and improve personalized recommendations. This framework optimizes diversity in the clustering ensemble search space and automatically determines an appropriate number of clusters without requiring user's input. Experimental results compare the efficiency of this approach with other existing approaches on Amadeus customer search data in terms of internal (Adjusted Rand Index) and external (Amadeus business metric) validations.


title: Age of Information Optimized MAC in V2X Sidelink via Piggyback-Based Collaboration

abstract: Real-time status update in future vehicular networks is vital to enable control-level cooperative autonomous driving. Cellular Vehicle-to-Everything (C-V2X), as one of the most promising vehicular wireless technologies, adopts a Semi-Persistent Scheduling (SPS) based Medium-Access-Control (MAC) layer protocol for its sidelink communications. Despite the recent and ongoing efforts to optimize SPS, very few work has considered the status update performance of SPS. In this paper, Age of Information (AoI) is first leveraged to evaluate the MAC layer performance of C-V2X sidelink. Critical issues of SPS, i.e., persistent packet collisions and Half-Duplex (HD) effects, are identified to hinder its AoI performance. Therefore, a piggyback-based collaboration method is proposed accordingly, whereby vehicles collaborate to inform each other of potential collisions and collectively afford HD errors, while entailing only a small signaling overhead. Closed-form AoI performance is derived for the proposed scheme, optimal configurations for key parameters are hence calculated, and the convergence property is proved for decentralized implementation. Simulation results show that compared with the standardized SPS and its state-of-the-art enhancement schemes, the proposed scheme shows significantly better performance, not only in terms of AoI, but also of conventional metrics such as transmission reliability.


title: Informative Bayesian Neural Network Priors for Weak Signals

abstract: Encoding domain knowledge into the prior over the high-dimensional weight space of a neural network is challenging but essential in applications with limited data and weak signals. Two types of domain knowledge are commonly available in scientific applications: 1. feature sparsity (fraction of features deemed relevant); 2. signal-to-noise ratio, quantified, for instance, as the proportion of variance explained (PVE). We show how to encode both types of domain knowledge into the widely used Gaussian scale mixture priors with Automatic Relevance Determination. Specifically, we propose a new joint prior over the local (i.e., feature-specific) scale parameters that encodes knowledge about feature sparsity, and a Stein gradient optimization to tune the hyperparameters in such a way that the distribution induced on the model's PVE matches the prior distribution. We show empirically that the new prior improves prediction accuracy, compared to existing neural network priors, on several publicly available datasets and in a genetics application where signals are weak and sparse, often outperforming even computationally intensive cross-validation for hyperparameter tuning.


title: Fractional-Order Models for the Static and Dynamic Analysis of Nonlocal Plates

abstract: This study presents the analytical formulation and the finite element solution of fractional order nonlocal plates under both Mindlin and Kirchoff formulations. By employing consistent definitions for fractional-order kinematic relations, the governing equations and the associated boundary conditions are derived based on variational principles. Remarkably, the fractional-order nonlocal model gives rise to a self-adjoint and positive-definite system that accepts a unique solution. Further, owing to the difficulty in obtaining analytical solutions to this fractional-order differ-integral problem, a 2D finite element model for the fractional-order governing equations is presented. Following a thorough validation with benchmark problems, the 2D fractional finite element model is used to study the static as well as the free dynamic response of fractional-order plates subject to various loading and boundary conditions. It is established that the fractional-order nonlocality leads to a reduction in the stiffness of the plate structure thereby increasing the displacements and reducing the natural frequency of vibration of the plates. Further, it is seen that the effect of nonlocality is stronger on the higher modes of vibration when compared to the fundamental mode. These effects of the fractional-order nonlocality are noted irrespective of the nature of the boundary conditions. More specifically, the fractional-order model of nonlocal plates is free from boundary effects that lead to paradoxical predictions such as hardening and absence of nonlocal effects in classical integral approaches to nonlocal elasticity. This consistency in the predictions is a result of the well-posed nature of the fractional-order governing equations that accept a unique solution.


title: Specializing Coherence, Consistency, and Push/Pull for GPU Graph Analytics

abstract: This work provides the first study to explore the interaction of update propagation with and without fine-grained synchronization (push vs. pull), emerging coherence protocols (GPU vs. DeNovo coherence), and software-centric consistency models (DRF0, DRF1, and DRFrlx) for graph workloads on emerging integrated GPU-CPU systems with native unified shared memory. We study 6 graph applications with 6 graph inputs for a total of 36 workloads running on 12 system (hardware+software) configurations reflecting the above design space of update propagation, coherence, and memory consistency. We make three key contributions. First, we show that there is no single best system configuration for all workloads, motivating systems with flexible coherence and consistency support. Second, we develop a model to accurately predict the best system configuration -- this model can be used by software designers to decide on push vs. pull and the consistency model and by flexible hardware to invoke the appropriate coherence and consistency configuration for the given workload. Third, we show that the design dimensions explored here are inter-dependent, reinforcing the need for software-hardware co-design in the above design dimensions. For example, software designers deciding on push vs. pull must consider the consistency model supported by hardware -- in some cases, push maybe better if hardware supports DRFrlx while pull may be better if hardware does not support DRFrlx.


title: A subtractive manufacturing constraint for level set topology optimization

abstract: We present a method for enforcing manufacturability constraints in generated parts such that they will be automatically ready for fabrication using a subtractive approach. We primarily target multi-axis CNC milling approaches but the method should generalize to other subtractive methods as well. To this end, we take as user input: the radius of curvature of the tool bit, a coarse model of the tool head and optionally a set of milling directions. This allows us to enforce the following manufacturability conditions: 1) surface smoothness such that the radius of curvature of the part does not exceed the milling bit radius, 2) orientation such that every part of the surface to be milled is visible from at least one milling direction, 3) accessibility such that every surface patch can be reached by the tool bit without interference with the tool or head mount. We will show how to efficiently enforce the constraint during level set-based topology optimization modifying the advection velocity such that at each iteration the topology optimization maintains a descent optimization direction and does not violate any of the manufacturability conditions. This approach models the actual subtractive process by carving away material accessible to the machine at each iteration until a local optimum is achieved.


title: Forecasting Foreign Exchange Rate: A Multivariate Comparative Analysis between Traditional Econometric, Contemporary Machine Learning & Deep Learning Techniques

abstract: In todays global economy, accuracy in predicting macro-economic parameters such as the foreign the exchange rate or at least estimating the trend correctly is of key importance for any future investment. In recent times, the use of computational intelligence-based techniques for forecasting macroeconomic variables has been proven highly successful. This paper tries to come up with a multivariate time series approach to forecast the exchange rate (USD/INR) while parallelly comparing the performance of three multivariate prediction modelling techniques: Vector Auto Regression (a Traditional Econometric Technique), Support Vector Machine (a Contemporary Machine Learning Technique), and Recurrent Neural Networks (a Contemporary Deep Learning Technique). We have used monthly historical data for several macroeconomic variables from April 1994 to December 2018 for USA and India to predict USD-INR Foreign Exchange Rate. The results clearly depict that contemporary techniques of SVM and RNN (Long Short-Term Memory) outperform the widely used traditional method of Auto Regression. The RNN model with Long Short-Term Memory (LSTM) provides the maximum accuracy (97.83%) followed by SVM Model (97.17%) and VAR Model (96.31%). At last, we present a brief analysis of the correlation and interdependencies of the variables used for forecasting.


title: Bayes-TrEx: a Bayesian Sampling Approach to Model Transparency by Example

abstract: Post-hoc explanation methods are gaining popularity for interpreting, understanding, and debugging neural networks. Most analyses using such methods explain decisions in response to inputs drawn from the test set. However, the test set may have few examples that trigger some model behaviors, such as high-confidence failures or ambiguous classifications. To address these challenges, we introduce a flexible model inspection framework: Bayes-TrEx. Given a data distribution, Bayes-TrEx finds in-distribution examples with a specified prediction confidence. We demonstrate several use cases of Bayes-TrEx, including revealing highly confident (mis)classifications, visualizing class boundaries via ambiguous examples, understanding novel-class extrapolation behavior, and exposing neural network overconfidence. We use Bayes-TrEx to study classifiers trained on CLEVR, MNIST, and Fashion-MNIST, and we show that this framework enables more flexible holistic model analysis than just inspecting the test set. Code is available at https://github.com/serenabooth/Bayes-TrEx.


title: An Optimization Approach to Jacobian Conjecture

abstract: Let $n\geq 2$ and $\mathbb K $ be a number field of characteristic $0$. Jacobian Conjecture asserts for a polynomial map $\mathcal P$ from $\mathbb K ^n$ to itself, if the determinant of its Jacobian matrix is a nonzero constant in $\mathbb K $ then the inverse $\mathcal P^{-1}$ exists and is also a polynomial map. This conjecture was firstly proposed by Keller in 1939 for $\mathbb K ^n=\mathbb C^2$ and put in Smale's 1998 list of Mathematical Problems for the Next Century. This study is going to present a proof for the conjecture. Our proof is based on Dru{\.{z}}kowski Map and Hadamard's Diffeomorphism Theorem, and additionally uses some optimization idea.


title: The Thousand-Pulsar-Array programme on MeerKAT I: Science objectives and first results

abstract: We report here on initial results from the Thousand Pulsar Array (TPA) programme, part of the Large Survey Project "MeerTime" on the MeerKAT telescope. The interferometer is used in tied-array mode in the band from 856 to 1712~MHz, and the wide band coupled with the large collecting area and low receiver temperature make it an excellent telescope for the study of radio pulsars. The TPA is a 5 year project which aims to observe (a) more than 1000 pulsars to obtain high-fidelity pulse profiles, (b) some 500 of these pulsars over multiple epochs, (c) long sequences of single-pulse trains from several hundred pulsars. The scientific outcomes from the programme will include determination of pulsar geometries, the location of the radio emission within the pulsar magnetosphere, the connection between the magnetosphere and the crust and core of the star, tighter constraints on the nature of the radio emission itself as well as interstellar medium studies. First results presented here include updated dispersion measures, 26 pulsars with Faraday rotation measures derived for the first time and a description of interesting emission phenomena observed thus far.


title: Identifying stochastic governing equations from data of the most probable transition trajectories

abstract: Extracting governing stochastic differential equation models from elusive data is crucial to understand and forecast dynamics for complex systems. We devise a method to extract the drift term and estimate the diffusion coefficient of a governing stochastic dynamical system, from its time-series data of the most probable transition trajectory. By the Onsager-Machlup theory, the most probable transition trajectory satisfies the corresponding Euler-Lagrange equation, which is a second order deterministic ordinary differential equation involving the drift term and diffusion coefficient. We first estimate the coefficients of the Euler-Lagrange equation based on the data of the most probable trajectory, and then we calculate the drift and diffusion coefficients of the governing stochastic dynamical system. These two steps involve sparse regression and optimization. Finally, we illustrate our method with an example and some discussions.


title: TensorShield: Tensor-based Defense Against Adversarial Attacks on Images

abstract: Recent studies have demonstrated that machine learning approaches like deep neural networks (DNNs) are easily fooled by adversarial attacks. Subtle and imperceptible perturbations of the data are able to change the result of deep neural networks. Leveraging vulnerable machine learning methods raises many concerns especially in domains where security is an important factor. Therefore, it is crucial to design defense mechanisms against adversarial attacks. For the task of image classification, unnoticeable perturbations mostly occur in the high-frequency spectrum of the image. In this paper, we utilize tensor decomposition techniques as a preprocessing step to find a low-rank approximation of images which can significantly discard high-frequency perturbations. Recently a defense framework called Shield could "vaccinate" Convolutional Neural Networks (CNN) against adversarial examples by performing random-quality JPEG compressions on local patches of images on the ImageNet dataset. Our tensor-based defense mechanism outperforms the SLQ method from Shield by 14% against FastGradient Descent (FGSM) adversarial attacks, while maintaining comparable speed.


title: Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures

abstract: This paper introduces an innovative physics-informed deep learning framework for metamodeling of nonlinear structural systems with scarce data. The basic concept is to incorporate physics knowledge (e.g., laws of physics, scientific principles) into deep long short-term memory (LSTM) networks, which boosts the learning within a feasible solution space. The physics constraints are embedded in the loss function to enforce the model training which can accurately capture latent system nonlinearity even with very limited available training datasets. Specifically for dynamic structures, physical laws of equation of motion, state dependency and hysteretic constitutive relationship are considered to construct the physics loss. In particular, two physics-informed multi-LSTM network architectures are proposed for structural metamodeling. The satisfactory performance of the proposed framework is successfully demonstrated through two illustrative examples (e.g., nonlinear structures subjected to ground motion excitation). It turns out that the embedded physics can alleviate overfitting issues, reduce the need of big training datasets, and improve the robustness of the trained model for more reliable prediction. As a result, the physics-informed deep learning paradigm outperforms classical non-physics-guided data-driven neural networks.


title: Empirical Study on Airline Delay Analysis and Prediction

abstract: The Big Data analytics are a logical analysis of very large scale datasets. The data analysis enhances an organization and improve the decision making process. In this article, we present Airline Delay Analysis and Prediction to analyze airline datasets with the combination of weather dataset. In this research work, we consider various attributes to analyze flight delay, for example, day-wise, airline-wise, cloud cover, temperature, etc. Moreover, we present rigorous experiments on various machine learning model to predict correctly the delay of a flight, namely, logistic regression with L2 regularization, Gaussian Naive Bayes, K-Nearest Neighbors, Decision Tree classifier and Random forest model. The accuracy of the Random Forest model is 82% with a delay threshold of 15 minutes of flight delay. The analysis is carried out using dataset from 1987 to 2008, the training is conducted with dataset from 2000 to 2007 and validated prediction result using 2008 data. Moreover, we have got recall 99% in the Random Forest model.