title: Solving diner's dilemma game, circuit implementation, and verification on IBMQ simulator

abstract: Diners dilemma is one of the most interesting problems in both economic and game theories. Here, we solve this problem for n (number of players) =4 with quantum rules and we are able to remove the dilemma of diners between the Pareto optimal and Nash equilibrium points of the game. We find the quantum strategy that gives maximum payoff for each diner without affecting the payoff and strategy of others. We use the quantum principles of superposition and entanglement that gives supremacy over any classical strategies. We present the circuit implementation for the game, design it on the IBM quantum simulator and verify the strategies in the quantum model.


title: Stochastic Gradient Descent Meets Distribution Regression

abstract: Stochastic gradient descent (SGD) provides a simple and efficient way to solve a broad range of machine learning problems. Here, we focus on distribution regression (DR), involving two stages of sampling: Firstly, we regress from probability measures to real-valued responses. Secondly, we sample bags from these distributions for utilizing them to solve the overall regression problem. Recently, DR has been tackled by applying kernel ridge regression and the learning properties of this approach are well understood. However, nothing is known about the learning properties of SGD for two stage sampling problems. We fill this gap and provide theoretical guarantees for the performance of SGD for DR. Our bounds are optimal in a mini-max sense under standard assumptions.


title: Large and moderate deviations principles and central limit theorem for the stochastic 3D primitive equations with gradient dependent noise

abstract: We establish the large deviations principle (LDP) and the moderate deviations principle (MDP) and an almost sure version of the central limit theorem (CLT) for the stochastic 3D viscous primitive equations driven by a multiplicative white noise allowing dependence on spatial gradient of solutions with initial data in $H^2$. The LDP is established using the weak convergence approach of Budjihara and Dupuis and uniform version of the stochastic Gronwall lemma. The result corrects a minor technical issue in Z. Dong, J. Zhai, and R. Zhang: Large deviations principles for 3D stochastic primitive equations, J. Differential Equations, 263(5):3110-3146, 2017, and establishes the result for a more general noise. The MDP is established using a similar argument.


title: FLIN: A Flexible Natural Language Interface for Web Navigation

abstract: AI assistants can now carry out tasks for users by directly interacting with website UIs. Current semantic parsing and slot-filling techniques cannot flexibly adapt to many different websites without being constantly re-trained. We propose FLIN, a natural language interface for web navigation that maps user commands to concept-level actions (rather than low-level UI actions), thus being able to flexibly adapt to different websites and handle their transient nature. We frame this as a ranking problem: given a user command and a webpage, FLIN learns to score the most relevant navigation instruction (involving action and parameter values). To train and evaluate FLIN, we collect a dataset using nine popular websites from three domains. Our results show that FLIN was able to adapt to new websites in a given domain.


title: Fields of definition of abelian subvarieties

abstract: In this paper we study the field of definition of abelian subvarieties $B\subset A_{\overline{K}}$ for an abelian variety $A$ over a field $K$ of characteristic $0$. We show that, provided that no isotypic component of $A_{\overline{K}}$ is simple, there are infinitely many abelian subvarieties of $A_{\overline{K}}$ with field of definition $K_A$, the field of definition of the endomorphisms of $A_{\overline{K}}$. This result combined with earlier work of R\'emond gives an explicit maximum for the minimal degree of a field extension over which an abelian subvariety of $A_{\overline{K}}$ is defined with varying $A$ of fixed dimension and $K$ of characteristic $0$.


title: Metrics and Isometries for Convex Functions

abstract: We introduce a class of functional analogs of the symmetric difference metric on the space of coercive convex functions on $\mathbb{R}^n$ with full-dimensional domain. We show that convergence with respect to these metrics is equivalent to epi-convergence. Furthermore, we give a full classification of all isometries with respect to some of the new metrics. Moreover, we introduce two new functional analogs of the Hausdorff metric on the spaces of coercive convex functions and super-coercive convex functions, respectively, and prove equivalence to epi-convergence.


title: Towards Benchmark Datasets for Machine Learning Based Website Phishing Detection: An experimental study

abstract: In this paper, we present a general scheme for building reproducible and extensible datasets for website phishing detection. The aim is to (1) enable comparison of systems using different features, (2) overtake the short-lived nature of phishing websites, and (3) keep track of the evolution of phishing tactics. For experimenting the proposed scheme, we start by adopting a refined classification of website phishing features and we systematically select a total of 87 commonly recognized ones, we classify them, and we made them subjects for relevance and runtime analysis. We use the collected set of features to build a dataset in light of the proposed scheme. Thereafter, we use a conceptual replication approach to check the genericity of former findings for the built dataset. Specifically, we evaluate the performance of classifiers on individual classes and on combinations of classes, we investigate different combinations of models, and we explore the effects of filter and wrapper methods on the selection of discriminative features. The results show that Random Forest is the most predictive classifier. Features gathered from external services are found the most discriminative where features extracted from web page contents are found less distinguishing. Besides external service based features, some web page content features are found time consuming and not suitable for runtime detection. The use of hybrid features provided the best accuracy score of 96.61%. By investigating different feature selection methods, filter-based ranking together with incremental removal of less important features improved the performance up to 96.83% better than wrapper methods.


title: An Adiabatic Theorem for Policy Tracking with TD-learning

abstract: We evaluate the ability of temporal difference learning to track the reward function of a policy as it changes over time. Our results apply a new adiabatic theorem that bounds the mixing time of time-inhomogeneous Markov chains. We derive finite-time bounds for tabular temporal difference learning and $Q$-learning when the policy used for training changes in time. To achieve this, we develop bounds for stochastic approximation under asynchronous adiabatic updates.


title: Sensitivities of future reactor and long-baseline neutrino experiments to NSI

abstract: We investigate the potential of the next generation long-baseline neutrino experiments DUNE and T2HK as well as the upcoming reactor experiment JUNO to constrain Non-Standard Interaction (NSI) parameters. JUNO is going to provide the most precise measurements of solar neutrino oscillation parameters as well as determining the neutrino mass ordering. We study how the results of JUNO combined with those of long-baseline neutrino experiments such as DUNE and T2HK can help to determine oscillation parameters and to constrain NSI parameters. We present excluded regions in NSI parameter space, $\epsilon_{\alpha \beta}$ assuming Standard Model (SM) as the null hypothesis. We further explore the correlations between the NSI parameters and CP-violation phase.


title: CoCo: Controllable Counterfactuals for Evaluating Dialogue State Trackers

abstract: Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood. We propose controllable counterfactuals (CoCo) to bridge this gap and evaluate dialogue state tracking (DST) models on novel scenarios, i.e., would the system successfully tackle the request if the user responded differently but still consistently with the dialogue flow? CoCo leverages turn-level belief states as counterfactual conditionals to produce novel conversation scenarios in two steps: (i) counterfactual goal generation at turn-level by dropping and adding slots followed by replacing slot values, (ii) counterfactual conversation generation that is conditioned on (i) and consistent with the dialogue flow. Evaluating state-of-the-art DST models on MultiWOZ dataset with CoCo-generated counterfactuals results in a significant performance drop of up to 30.8% (from 49.4% to 18.6%) in absolute joint goal accuracy. In comparison, widely used techniques like paraphrasing only affect the accuracy by at most 2%. Human evaluations show that COCO-generated conversations perfectly reflect the underlying user goal with more than 95% accuracy and are as human-like as the original conversations, further strengthening its reliability and promise to be adopted as part of the robustness evaluation of DST models.


title: Beam shaping for ultrafast materials processing

abstract: The remarkable temporal properties of ultra-short pulsed lasers in combination with novel beam shaping concepts enable the development of completely new material processing strategies. We demonstrate the benefit of employing focus distributions being tailored in all three spatial dimensions. As example advanced Bessel-like beam profiles, 3D-beam splitting concepts and flat-top focus distributions are used to achieve high-quality and efficient results for cutting, welding and drilling applications. Spatial and temporal in situ diagnostics is employed to analyze light-matter interaction and, in combination with flexible digital-holographic beam shaping techniques, to find the optimal beam shape for the respective laser application.


title: Beyond VQA: Generating Multi-word Answer and Rationale to Visual Questions

abstract: Visual Question Answering is a multi-modal task that aims to measure high-level visual understanding. Contemporary VQA models are restrictive in the sense that answers are obtained via classification over a limited vocabulary (in the case of open-ended VQA), or via classification over a set of multiple-choice-type answers. In this work, we present a completely generative formulation where a multi-word answer is generated for a visual query. To take this a step forward, we introduce a new task: ViQAR (Visual Question Answering and Reasoning), wherein a model must generate the complete answer and a rationale that seeks to justify the generated answer. We propose an end-to-end architecture to solve this task and describe how to evaluate it. We show that our model generates strong answers and rationales through qualitative and quantitative evaluation, as well as through a human Turing Test.


title: Controlling secondary flows in Taylor-Couette flow using stress-free boundary conditions

abstract: Taylor-Couette (TC) flow, the flow between two independently rotating and co-axial cylinders is commonly used as a canonical model for shear flows. Unlike plane Couette, pinned secondary flows can be found in TC flow. These are known as Taylor rolls and drastically affect the flow behaviour. We study the possibility of modifying these secondary structures using patterns of stress-free and no-slip boundary conditions on the inner cylinder. For this, we perform direct numerical simulations of narrow-gap TC flow with pure inner cylinder rotation at four different shear Reynolds numbers up to $Re_s=3\times 10^4$. We find that one-dimensional azimuthal patterns do not have a significant effect on the flow topology, and that the resulting torque is a large fraction ($\sim80-90\%$) of torque in the fully no-slip case. One-dimensional axial patterns decrease the torque more, and for certain pattern frequency disrupt the rolls by interfering with the existing Reynolds stresses that generate secondary structures. For $Re\geq 10^4$, this disruption leads to a smaller torque than what would be expected from simple boundary layer effects and the resulting effective slip length and slip velocity. We find that two-dimensional checkerboard patterns have similar behaviour to azimuthal patterns and do not affect the flow or the torque substantially, but two-dimensional spiral inhomogeneities can move around the pinned secondary flows as they induce persistent axial velocities. We quantify the roll's movement for various angles and the widths of the spiral pattern, and find a non-monotonic behaviour as a function of pattern angle and pattern frequency.


title: ReadOnce Transformers: Reusable Representations of Text for Transformers

abstract: We present ReadOnce Transformers, an approach to convert a transformer-based model into one that can build an information-capturing, task-independent, and compressed representation of text. The resulting representation is reusable across different examples and tasks, thereby requiring a document shared across many examples or tasks to only be \emph{read once}. This leads to faster training and evaluation of models. Additionally, we extend standard text-to-text transformer models to Representation+Text-to-text models, and evaluate on multiple downstream tasks: multi-hop QA, abstractive QA, and long-document summarization. Our one-time computed representation results in a 2x-5x speedup compared to standard text-to-text models, while the compression also allows existing language models to handle longer documents without the need for designing new pre-trained models.


title: H\"older regularity of Hamilton-Jacobi equations with stochastic forcing

abstract: We obtain space-time H\"older regularity estimates for solutions of first- and second-order Hamilton-Jacobi equations perturbed with an additive stochastic forcing term. The bounds depend only on the growth of the Hamiltonian in the gradient and on the regularity of the stochastic coefficients, in a way that is invariant with respect to a hyperbolic scaling.


title: Jointly convex mappings related to the Lieb's functional and Minkowski type operator inequalities

abstract: Employing the notion of operator log-convexity, we study joint concavity$/$ convexity of multivariable operator functions: $(A,B)\mapsto F(A,B)=h\left[ \Phi(f(A))\ \sigma\ \Psi(g(B))\right]$, where $\Phi$ and $\Psi$ are positive linear maps and $\sigma$ is an operator mean. As applications, we prove jointly concavity$/$convexity of matrix trace functions $\Tr\left\{ F(A,B)\right\}$. Moreover, considering positive multi-linear mappings in $F(A,B)$, our study of the joint concavity$/$ convexity of $(A_1,\cdots,A_k)\mapsto h\left[ \Phi(f(A_1),\cdots,f(A_k))\right]$ provides some generalizations and complement to results of Ando and Lieb concerning the concavity$/$ convexity of maps involving tensor product. In addition, we present Minkowski type operator inequalities for a unial positive linear map, which is an operator version of Minkowski type matrix trace inequalities under a more general setting than Carlen and Lieb, Bekjan, and Ando and Hiai.


title: Investigating 3D Atomic Environments for Enhanced QSAR

abstract: Predicting bioactivity and physical properties of molecules is a longstanding challenge in drug design. Most approaches use molecular descriptors based on a 2D representation of molecules as a graph of atoms and bonds, abstracting away the molecular shape. A difficulty in accounting for 3D shape is in designing molecular descriptors can precisely capture molecular shape while remaining invariant to rotations/translations. We describe a novel alignment-free 3D QSAR method using Smooth Overlap of Atomic Positions (SOAP), a well-established formalism developed for interpolating potential energy surfaces. We show that this approach rigorously describes local 3D atomic environments to compare molecular shapes in a principled manner. This method performs competitively with traditional fingerprint-based approaches as well as state-of-the-art graph neural networks on pIC$_{50}$ ligand-binding prediction in both random and scaffold split scenarios. We illustrate the utility of SOAP descriptors by showing that its inclusion in ensembling diverse representations statistically improves performance, demonstrating that incorporating 3D atomic environments could lead to enhanced QSAR for cheminformatics.


title: When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models

abstract: Transfer learning based on pretraining language models on a large amount of raw data has become a new norm to reach state-of-the-art performance in NLP. Still, it remains unclear how this approach should be applied for unseen languages that are not covered by any available large-scale multilingual language model and for which only a small amount of raw data is generally available. In this work, by comparing multilingual and monolingual models, we show that such models behave in multiple ways on unseen languages. Some languages greatly benefit from transfer learning and behave similarly to closely related high resource languages whereas others apparently do not. Focusing on the latter, we show that this failure to transfer is largely related to the impact of the script used to write such languages. Transliterating those languages improves very significantly the ability of large-scale multilingual language models on downstream tasks.


title: Stable ResNet

abstract: Deep ResNet architectures have achieved state of the art performance on many tasks. While they solve the problem of gradient vanishing, they might suffer from gradient exploding as the depth becomes large (Yang et al. 2017). Moreover, recent results have shown that ResNet might lose expressivity as the depth goes to infinity (Yang et al. 2017, Hayou et al. 2019). To resolve these issues, we introduce a new class of ResNet architectures, called Stable ResNet, that have the property of stabilizing the gradient while ensuring expressivity in the infinite depth limit.


title: Turbulent energization of electron power law tails during magnetic reconnection

abstract: Earth's magnetotail is an excellent laboratory to study the interplay of reconnection and turbulence in determining electron energization. The process of formation of a power law tail during turbulent reconnection is a documented fact still in need of a comprehensive explanation. We conduct a massively parallel particle in cell 3D simulation and use enhanced statistical resolution of the high energy range of the particle velocities to study how reconnection creates the conditions for the tail to be formed. The process is not direct acceleration by the coherent, laminar, reconnection-generated electric field. Rather, reconnection causes turbulent outflows where energy exchange is dominated by a highly non-gaussian distribution of fluctuations. Electron energization is diffuse throughout the entire reconnection outflow but it is heightened by regions of intensified magnetic field such as dipolarization fronts traveling towards Earth.


title: MARS: Multi-macro Architecture SRAM CIM-Based Accelerator with Co-designed Compressed Neural Networks

abstract: Convolutional neural networks (CNNs) play a key role in deep learning applications. However, the large storage overheads and the substantial computation cost of CNNs are problematic in hardware accelerators. Computing-in-memory (CIM) architecture has demonstrated great potential to effectively compute large-scale matrix-vector multiplication. However, the intensive multiply and accumulation (MAC) operations executed at the crossbar array and the limited capacity of CIM macros remain bottlenecks for further improvement of energy efficiency and throughput. To reduce computation costs, network pruning and quantization are two widely studied compression methods to shrink the model size. However, most of the model compression algorithms can only be implemented in digital-based CNN accelerators. For implementation in a static random access memory (SRAM) CIM-based accelerator, the model compression algorithm must consider the hardware limitations of CIM macros, such as the number of word lines and bit lines that can be turned on at the same time, as well as how to map the weight to the SRAM CIM macro. In this study, a software and hardware co-design approach is proposed to design an SRAM CIM-based CNN accelerator and an SRAM CIM-aware model compression algorithm. To lessen the high-precision MAC required by batch normalization (BN), a quantization algorithm that can fuse BN into the weights is proposed. Furthermore, to reduce the number of network parameters, a sparsity algorithm that considers a CIM architecture is proposed. Last, MARS, a CIM-based CNN accelerator that can utilize multiple SRAM CIM macros as processing units and support a sparsity neural network, is proposed.


title: Safeguarding the IoT from Malware Epidemics: A Percolation Theory Approach

abstract: The upcoming Internet of things (IoT) is foreseen to encompass massive numbers of connected devices, smart objects, and cyber-physical systems. Due to the large-scale and massive deployment of devices, it is deemed infeasible to safeguard 100% of the devices with state-of-the-art security countermeasures. Hence, large-scale IoT has inevitable loopholes for network intrusion and malware infiltration. Even worse, exploiting the high density of devices and direct wireless connectivity, malware infection can stealthily propagate through susceptible (i.e., unsecured) devices and form an epidemic outbreak without being noticed to security administration. A malware outbreak enables adversaries to compromise large population of devices, which can be exploited to launch versatile cyber and physical malicious attacks. In this context, we utilize spatial firewalls, to safeguard the IoT from malware outbreak. In particular, spatial firewalls are computationally capable devices equipped with state-of-the-art security and anti-malware programs that are spatially deployed across the network to filter the wireless traffic in order to detect and thwart malware propagation. Using tools from percolation theory, we prove that there exists a critical density of spatial firewalls beyond which malware outbreak is impossible. This, in turns, safeguards the IoT from malware epidemics regardless of the infection/treatment rates. To this end, a tractable upper bound for the critical density of spatial firewalls is obtained. Furthermore, we characterize the relative communications ranges of the spatial firewalls and IoT devices to ensure secure network connectivity. The percentage of devices secured by the firewalls is also characterized.


title: Dynamics of test particles around regular black holes in modified gravity

abstract: In the work, we have presented detailed analyses of the event horizon and curvature properties of spacetime around a regular black hole in modified gravity so-called regular MOG black hole. The motion of neutral, electrically charged and magnetized particles with magnetic dipole moment, in the close environment of the regular MOG black hole immersed in an external asymptotically uniform magnetic field has been also explored. Through the study on the motion of the neutral test particle, we have obtained that the positive (negative) values of the MOG parameter mimic the spin of a rotating Kerr black hole giving the same values for innermost stable pro-grade (retrograde) orbits of the particles in the range of the spin parameter $a/M \in(-0.4125, \ 0.6946)$. The efficiency of energy release from the accretion disk by the Novikov-Thorne model has been calculated and shown that the efficiency is linearly proportional to the increase of the MOG parameter $\alpha$, and exceeds up to 15 \% at the critical limiting value of the MOG parameter $\alpha_{\rm cr}$. The study of the charged particles dynamics has shown that innermost stable circular orbits (ISCOs) of the particle increases with the increase of the MOG parameter, while the increase of cyclotron frequency being responsible to the magnetic interaction causes the decrease of the latter. Moreover, the dynamics of magnetic dipoles has shown that the increase of the MOG and the magnetic coupling parameters lead to an increase of the inner radius and the width of the accretion disk consisting of magnetized particles. Finally, we have focused on showing the range of values of the magnetic coupling parameter causing the orbits to be stable.


title: On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning

abstract: Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data representations, and using auxiliary training objectives to mitigate bias during fine-tuning. Although these techniques achieve bias reduction for the task and domain at hand, the effects of bias mitigation may not directly transfer to new tasks, requiring additional data collection and customized annotation of sensitive attributes, and re-evaluation of appropriate fairness metrics. We explore the feasibility and benefits of upstream bias mitigation (UBM) for reducing bias on downstream tasks, by first applying bias mitigation to an upstream model through fine-tuning and subsequently using it for downstream fine-tuning. We find, in extensive experiments across hate speech detection, toxicity detection, occupation prediction, and coreference resolution tasks over various bias factors, that the effects of UBM are indeed transferable to new downstream tasks or domains via fine-tuning, creating less biased downstream models than directly fine-tuning on the downstream task or transferring from a vanilla upstream model. Though challenges remain, we show that UBM promises more efficient and accessible bias mitigation in LM fine-tuning.


title: Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector Machine

abstract: Wasserstein \textbf{D}istributionally \textbf{R}obust \textbf{O}ptimization (DRO) is concerned with finding decisions that perform well on data that are drawn from the worst-case probability distribution within a Wasserstein ball centered at a certain nominal distribution. In recent years, it has been shown that various DRO formulations of learning models admit tractable convex reformulations. However, most existing works propose to solve these convex reformulations by general-purpose solvers, which are not well-suited for tackling large-scale problems. In this paper, we focus on a family of Wasserstein distributionally robust support vector machine (DRSVM) problems and propose two novel epigraphical projection-based incremental algorithms to solve them. The updates in each iteration of these algorithms can be computed in a highly efficient manner. Moreover, we show that the DRSVM problems considered in this paper satisfy a H\"olderian growth condition with explicitly determined growth exponents. Consequently, we are able to establish the convergence rates of the proposed incremental algorithms. Our numerical results indicate that the proposed methods are orders of magnitude faster than the state-of-the-art, and the performance gap grows considerably as the problem size increases.


title: Optimal Algorithms for Stochastic Multi-Armed Bandits with Heavy Tailed Rewards

abstract: In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose $p$-th moment is bounded by a constant $\nu_{p}$ for $1<p\leq2$. First, we propose a novel robust estimator which does not require $\nu_{p}$ as prior information, while other existing robust estimators demand prior knowledge about $\nu_{p}$. We show that an error probability of the proposed estimator decays exponentially fast. Using this estimator, we propose a perturbation-based exploration strategy and develop a generalized regret analysis scheme that provides upper and lower regret bounds by revealing the relationship between the regret and the cumulative density function of the perturbation. From the proposed analysis scheme, we obtain gap-dependent and gap-independent upper and lower regret bounds of various perturbations. We also find the optimal hyperparameters for each perturbation, which can achieve the minimax optimal regret bound with respect to total rounds. In simulation, the proposed estimator shows favorable performance compared to existing robust estimators for various $p$ values and, for MAB problems, the proposed perturbation strategy outperforms existing exploration methods.


title: Adaptive quantum state tomography with iterative particle filtering

abstract: Several Bayesian estimation based heuristics have been developed to perform quantum state tomography (QST). Their ability to quantify uncertainties using region estimators and include a priori knowledge of the experimentalists makes this family of methods an attractive choice for QST. However, specialized techniques for pure states do not work well for mixed states and vice versa. In this paper, we present an adaptive particle filter (PF) based QST protocol which improves the scaling of fidelity compared to nonadaptive Bayesian schemes for arbitrary multi-qubit states. This is due to the protocol's unabating perseverance to find the states's diagonal bases and more systematic handling of enduring problems in popular PF methods relating to the subjectivity of informative priors and the invalidity of particles produced by resamplers. Numerical examples and implementation on IBM quantum devices demonstrate improved performance for arbitrary quantum states and the application readiness of our proposed scheme.


title: Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation

abstract: Non-Autoregressive machine Translation (NAT) models have demonstrated significant inference speedup but suffer from inferior translation accuracy. The common practice to tackle the problem is transferring the Autoregressive machine Translation (AT) knowledge to NAT models, e.g., with knowledge distillation. In this work, we hypothesize and empirically verify that AT and NAT encoders capture different linguistic properties of source sentences. Therefore, we propose to adopt Multi-Task learning to transfer the AT knowledge to NAT models through encoder sharing. Specifically, we take the AT model as an auxiliary task to enhance NAT model performance. Experimental results on WMT14 English-German and WMT16 English-Romanian datasets show that the proposed Multi-Task NAT achieves significant improvements over the baseline NAT models. Furthermore, the performance on large-scale WMT19 and WMT20 English-German datasets confirm the consistency of our proposed method. In addition, experimental results demonstrate that our Multi-Task NAT is complementary to knowledge distillation, the standard knowledge transfer method for NAT.


title: ExPAN(N)D: Exploring Posits for Efficient Artificial Neural Network Design in FPGA-based Systems

abstract: The recent advances in machine learning, in general, and Artificial Neural Networks (ANN), in particular, has made smart embedded systems an attractive option for a larger number of application areas. However, the high computational complexity, memory footprints, and energy requirements of machine learning models hinder their deployment on resource-constrained embedded systems. Most state-of-the-art works have considered this problem by proposing various low bit-width data representation schemes, optimized arithmetic operators' implementations, and different complexity reduction techniques such as network pruning. To further elevate the implementation gains offered by these individual techniques, there is a need to cross-examine and combine these techniques' unique features. This paper presents ExPAN(N)D, a framework to analyze and ingather the efficacy of the Posit number representation scheme and the efficiency of fixed-point arithmetic implementations for ANNs. The Posit scheme offers a better dynamic range and higher precision for various applications than IEEE $754$ single-precision floating-point format. However, due to the dynamic nature of the various fields of the Posit scheme, the corresponding arithmetic circuits have higher critical path delay and resource requirements than the single-precision-based arithmetic units. Towards this end, we propose a novel Posit to fixed-point converter for enabling high-performance and energy-efficient hardware implementations for ANNs with minimal drop in the output accuracy. We also propose a modified Posit-based representation to store the trained parameters of a network. Compared to an $8$-bit fixed-point-based inference accelerator, our proposed implementation offers $\approx46\%$ and $\approx18\%$ reductions in the storage requirements of the parameters and energy consumption of the MAC units, respectively.


title: Efficient Learning in Non-Stationary Linear Markov Decision Processes

abstract: We study episodic reinforcement learning in non-stationary linear (a.k.a. low-rank) Markov Decision Processes (MDPs), i.e, both the reward and transition kernel are linear with respect to a given feature map and are allowed to evolve either slowly or abruptly over time. For this problem setting, we propose OPT-WLSVI an optimistic model-free algorithm based on weighted least squares value iteration which uses exponential weights to smoothly forget data that are far in the past. We show that our algorithm, when competing against the best policy at each time, achieves a regret that is upper bounded by $\widetilde{\mathcal{O}}(d^{5/4}H^2 \Delta^{1/4} K^{3/4})$ where $d$ is the dimension of the feature space, $H$ is the planning horizon, $K$ is the number of episodes and $\Delta$ is a suitable measure of non-stationarity of the MDP. Moreover, we point out technical gaps in the study of forgetting strategies in non-stationary linear bandits setting made by previous works and we propose a fix to their regret analysis.


title: Large Scale Legal Text Classification Using Transformer Models

abstract: Large multi-label text classification is a challenging Natural Language Processing (NLP) problem that is concerned with text classification for datasets with thousands of labels. We tackle this problem in the legal domain, where datasets, such as JRC-Acquis and EURLEX57K labeled with the EuroVoc vocabulary were created within the legal information systems of the European Union. The EuroVoc taxonomy includes around 7000 concepts. In this work, we study the performance of various recent transformer-based models in combination with strategies such as generative pretraining, gradual unfreezing and discriminative learning rates in order to reach competitive classification performance, and present new state-of-the-art results of 0.661 (F1) for JRC-Acquis and 0.754 for EURLEX57K. Furthermore, we quantify the impact of individual steps, such as language model fine-tuning or gradual unfreezing in an ablation study, and provide reference dataset splits created with an iterative stratification algorithm.


title: Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation

abstract: Knowledge graphs (KGs) have helped neural models improve performance on various knowledge-intensive tasks, like question answering and item recommendation. By using attention over the KG, such KG-augmented models can also "explain" which KG information was most relevant for making a given prediction. In this paper, we question whether these models are really behaving as we expect. We show that, through a reinforcement learning policy (or even simple heuristics), one can produce deceptively perturbed KGs, which maintain the downstream performance of the original KG while significantly deviating from the original KG's semantics and structure. Our findings raise doubts about KG-augmented models' ability to reason about KG information and give sensible explanations.


title: Learning Contextualized Knowledge Structures for Commonsense Reasoning

abstract: Recently, knowledge graph (KG) augmented models have achieved noteworthy success on various commonsense reasoning tasks. However, KG edge (fact) sparsity and noisy edge extraction/generation often hinder models from obtaining useful knowledge to reason over. To address these issues, we propose a new KG-augmented model: Hybrid Graph Network (HGN). Unlike prior methods, HGN learns to jointly contextualize extracted and generated knowledge by reasoning over both within a unified graph structure. Given the task input context and an extracted KG subgraph, HGN is trained to generate embeddings for the subgraph's missing edges to form a "hybrid" graph, then reason over the hybrid graph while filtering out context-irrelevant edges. We demonstrate HGN's effectiveness through considerable performance gains across four commonsense reasoning benchmarks, plus a user study on edge validness and helpfulness.


title: Signatures of interfacial topological chiral modes via RKKY exchange interaction in Dirac and Weyl systems

abstract: We theoretically investigate the features of Ruderman-Kittel-Kasuya-Yosida (RKKY) exchange interaction between two magnetic impurities, mediated by the interfacial bound states inside a domain wall (DW). The latter separates the two regions with oppositely signed inversion symmetry broken terms in graphene and Weyl semimetal. The DW is modelled by a smooth quantum well which hosts a number of discrete bound states including a pair of gapless, metallic zero-energy modes with opposite chiralities. We find clear signatures of these interfacial chiral bound states in spin response (RKKY exchange interaction) which is robust to the deformation of the quantum well.


title: Stochastic Analysis of Cooperative Satellite-UAV Communications

abstract: In this paper, a dual-hop cooperative satellite-unmanned aerial vehicle (UAV) communication system including a satellite (S), a group of cluster headers (CHs), which are respectively with a group of uniformly distributed UAVs, is considered. Specifically, these CHs serve as aerial decode-and-forward relays to forward the information transmitted by S to UAVs. Moreover, free-space optical (FSO) and radio frequency (RF) technologies are respectively adopted over S-CH and CH-UAV links to exploit FSO's high directivity over long-distance transmission and RF's omnidirectional coverage ability. The positions of the CHs in the 3-dimensional space follow the Mat\'ern hard-core point processes type-II in which each CH can not be closer to any other ones than a predefined distance. Three different cases over CH-UAV links are considered during the performance modeling: interference-free, interference-dominated, and interference-and-noise cases. Then, the coverage performance of S-CH link and the CH-UAV links under three cases is studied and the closed-form analytical expressions of the coverage probability (CP) over both links are derived. Also, the asymptotic expressions for the CP over S-CH link and CH-UAV link in interference-free case are derived. Finally, numerical results are provided to validate our proposed analytical models and thus some meaningful conclusions are achieved.


title: Electromagnetic Source Imaging via a Data-Synthesis-Based Convolutional Encoder-Decoder Network

abstract: Electromagnetic source imaging (ESI) requires solving a highly ill-posed inverse problem. To seek a unique solution, traditional ESI methods impose various forms of priors that may not accurately reflect the actual source properties, which may hinder their broad applications. To overcome this limitation, in this paper a novel data-synthesized spatio-temporally convolutional encoder-decoder network method termed DST-CedNet is proposed for ESI. DST-CedNet recasts ESI as a machine learning problem, where discriminative learning and latent-space representations are integrated in a convolutional encoder-decoder network (CedNet) to learn a robust mapping from the measured electroencephalography/magnetoencephalography (E/MEG) signals to the brain activity. In particular, by incorporating prior knowledge regarding dynamical brain activities, a novel data synthesis strategy is devised to generate large-scale samples for effectively training CedNet. This stands in contrast to traditional ESI methods where the prior information is often enforced via constraints primarily aimed for mathematical convenience. Extensive numerical experiments as well as analysis of a real MEG and Epilepsy EEG dataset demonstrate that DST-CedNet outperforms several state-of-the-art ESI methods in robustly estimating source signals under a variety of source configurations.


title: EEGsig: an open-source machine learning-based toolbox for EEG signal processing

abstract: In the quest to realize a comprehensive EEG signal processing framework, in this paper, we demonstrate a toolbox and graphic user interface, EEGsig, for the full process of EEG signals. Our goal is to provide a comprehensive suite, free and open-source framework for EEG signal processing where the users especially physicians who do not have programming experience can focus on their practical requirements to speed up the medical projects. Developed on MATLAB software, we have aggregated all the three EEG signal processing steps, including preprocessing, feature extraction, and classification into EEGsig. In addition to a varied list of useful features, in EEGsig, we have implemented three popular classification algorithms (K-NN, SVM, and ANN) to assess the performance of the features. Our experimental results demonstrate that our novel framework for EEG signal processing attained excellent classification results and feature extraction robustness under different machine learning classifier algorithms. Besides, in EEGsig, for selecting the best feature extracted, all EEG signal channels can be visible simultaneously; thus, the effect of each task on the signal can be visible. We believe that our user-centered MATLAB package is an encouraging platform for novice users as well as offering the highest level of control to expert users


title: Pathfinder Discovery Networks for Neural Message Passing

abstract: In this work we propose Pathfinder Discovery Networks (PDNs), a method for jointly learning a message passing graph over a multiplex network with a downstream semi-supervised model. PDNs inductively learn an aggregated weight for each edge, optimized to produce the best outcome for the downstream learning task. PDNs are a generalization of attention mechanisms on graphs which allow flexible construction of similarity functions between nodes, edge convolutions, and cheap multiscale mixing layers. We show that PDNs overcome weaknesses of existing methods for graph attention (e.g. Graph Attention Networks), such as the diminishing weight problem. Our experimental results demonstrate competitive predictive performance on academic node classification tasks. Additional results from a challenging suite of node classification experiments show how PDNs can learn a wider class of functions than existing baselines. We analyze the relative computational complexity of PDNs, and show that PDN runtime is not considerably higher than static-graph models. Finally, we discuss how PDNs can be used to construct an easily interpretable attention mechanism that allows users to understand information propagation in the graph.


title: Towards Real-Time Magnetic Dosimetry Simulations for Inductive Charging Systems

abstract: The exposure of a human by magneto-quasistatic fields from wireless charging systems is to be determined from magnetic field measurements in near real-time. This requires a fast linear equations solver for the discrete Poisson system of the Co-Simulation Scalar Potential Finite Difference (Co-Sim. SPFD) scheme. Here, the use of the AmgX library on NVIDIA GPUs is presented for this task. It enables solving the equation system resulting from an ICNIRP recommended human voxel model resolution of 2 mm in less than 0.5 seconds on a single NVIDIA Tesla V100 GPU.


title: Persian Handwritten Digit, Character and Word Recognition Using Deep Learning

abstract: Digit, letter and word recognition for a particular script has various applications in todays commercial contexts. Nevertheless, only a limited number of relevant studies have dealt with Persian scripts. In this paper, deep neural networks are utilized through various DensNet architectures, as well as the Xception, are adopted, modified and further boosted through data augmentation and test time augmentation, in order to come up with an optical character recognition accounting for the particularities of the Persian language and the corresponding handwritings. Taking advantage of dividing the databases to training, validation and test sets, as well as k-fold cross validation, the comparison of the proposed method with various state-of-the-art alternatives is performed on the basis of the HODA and Sadri databases, which offer the most comprehensive collection of samples in terms of the various handwriting styles possessed by different human beings, as well as different forms each letter may take, which depend on its position within a word. On the HODA database, we achieve recognition rates of 99.72% and 89.99% for digits and characters, being 99.72%, 98.32% and 98.82% for digits, characters and words from the Sadri database, respectively.


title: Revisiting Neural Language Modelling with Syllables

abstract: Language modelling is regularly analysed at word, subword or character units, but syllables are seldom used. Syllables provide shorter sequences than characters, they can be extracted with rules, and their segmentation typically requires less specialised effort than identifying morphemes. We reconsider syllables for an open-vocabulary generation task in 20 languages. We use rule-based syllabification methods for five languages and address the rest with a hyphenation tool, which behaviour as syllable proxy is validated. With a comparable perplexity, we show that syllables outperform characters, annotated morphemes and unsupervised subwords. Finally, we also study the overlapping of syllables concerning other subword pieces and discuss some limitations and opportunities.


title: FedE: Embedding Knowledge Graphs in Federated Setting

abstract: Knowledge graphs (KGs) consisting of triples are always incomplete, so it's important to do Knowledge Graph Completion (KGC) by predicting missing triples. Multi-Source KG is a common situation in real KG applications which can be viewed as a set of related individual KGs where different KGs contains relations of different aspects of entities. It's intuitive that, for each individual KG, its completion could be greatly contributed by the triples defined and labeled in other ones. However, because of the data privacy and sensitivity, a set of relevant knowledge graphs cannot complement each other's KGC by just collecting data from different knowledge graphs together. Therefore, in this paper, we introduce federated setting to keep their privacy without triple transferring between KGs and apply it in embedding knowledge graph, a typical method which have proven effective for KGC in the past decade. We propose a Federated Knowledge Graph Embedding framework FedE, focusing on learning knowledge graph embeddings by aggregating locally-computed updates. Finally, we conduct extensive experiments on datasets derived from KGE benchmark datasets and results show the effectiveness of our proposed FedE.


title: Variational Bayesian Unlearning

abstract: This paper studies the problem of approximately unlearning a Bayesian model from a small subset of the training data to be erased. We frame this problem as one of minimizing the Kullback-Leibler divergence between the approximate posterior belief of model parameters after directly unlearning from erased data vs. the exact posterior belief from retraining with remaining data. Using the variational inference (VI) framework, we show that it is equivalent to minimizing an evidence upper bound which trades off between fully unlearning from erased data vs. not entirely forgetting the posterior belief given the full data (i.e., including the remaining data); the latter prevents catastrophic unlearning that can render the model useless. In model training with VI, only an approximate (instead of exact) posterior belief given the full data can be obtained, which makes unlearning even more challenging. We propose two novel tricks to tackle this challenge. We empirically demonstrate our unlearning methods on Bayesian models such as sparse Gaussian process and logistic regression using synthetic and real-world datasets.


title: NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints

abstract: Conditional text generation often requires lexical constraints, i.e., which words should or shouldn't be included in the output text. While the dominant recipe for conditional text generation has been large-scale pretrained language models that are finetuned on the task-specific training data, such models do not learn to follow the underlying constraints reliably, even when supervised with large amounts of task-specific examples. We propose NeuroLogic Decoding, a simple yet effective algorithm that enables neural language models -- supervised or not -- to generate fluent text while satisfying complex lexical constraints. Our approach is powerful yet efficient. It handles any set of lexical constraints that is expressible under predicate logic, while its asymptotic runtime is equivalent to conventional beam search. Empirical results on four benchmarks show that NeuroLogic Decoding outperforms previous approaches, including algorithms that handle a subset of our constraints. Moreover, we find that unsupervised models with NeuroLogic Decoding often outperform supervised models with conventional decoding, even when the latter is based on considerably larger networks. Our results suggest the limit of large-scale neural networks for fine-grained controllable generation and the promise of inference-time algorithms.


title: Unsupervised Paraphrasing with Pretrained Language Models

abstract: Paraphrase generation has benefited extensively from recent progress in the designing of training objectives and model architectures. However, previous explorations have largely focused on supervised methods, which require a large amount of labeled data that is costly to collect. To address this drawback, we adopt a transfer learning approach and propose a training pipeline that enables pre-trained language models to generate high-quality paraphrases in an unsupervised setting. Our recipe consists of task-adaptation, self-supervision, and a novel decoding algorithm named Dynamic Blocking (DB). To enforce a surface form dissimilar from the input, whenever the language model emits a token contained in the source sequence, DB prevents the model from outputting the subsequent source token for the next generation step. We show with automatic and human evaluations that our approach achieves state-of-the-art performance on both the Quora Question Pair (QQP) and the ParaNMT datasets and is robust to domain shift between the two datasets of distinct distributions. We also demonstrate that our model transfers to paraphrasing in other languages without any additional finetuning.


title: Maximum efficiency of absorption refrigerators at arbitrary cooling power

abstract: We consider absorption refrigerators consisting of simultaneously operating Carnot-type heat engine and refrigerator. Their maximum efficiency at given power (MEGP) is given by the product of MEGPs for the internal engine and refrigerator. The only subtlety of the derivation lies in the fact that the maximum cooling power of the absorption refrigerator is not limited just by the maximum power of the internal refrigerator but, due to the first law, also by that of the internal engine. As a specific example, we consider the simultaneous absorption refrigerators composed of low-dissipation (LD) heat engines and refrigerators, for which the expressions for MEGPs are known. The derived expression for maximum efficiency implies bounds on the MEGP of LD absorption refrigerators. It also implies that a slight decrease in power of the absorption refrigerator from its maximum value results in a large nonlinear increase in efficiency observed in heat engines whenever the ratio of maximum powers of the internal engine and the refrigerator does not diverge. Otherwise, the increase in efficiency is linear as observed in LD refrigerators. Thus, in all practical situations, the efficiency of LD absorption refrigerators significantly increases when their cooling power is slightly decreased from its maximum.


title: Nearly Optimal Variational Inference for High Dimensional Regression with Shrinkage Priors

abstract: We propose a variational Bayesian (VB) procedure for high-dimensional linear model inferences with heavy tail shrinkage priors, such as student-t prior. Theoretically, we establish the consistency of the proposed VB method and prove that under the proper choice of prior specifications, the contraction rate of the VB posterior is nearly optimal. It justifies the validity of VB inference as an alternative of Markov Chain Monte Carlo (MCMC) sampling. Meanwhile, comparing to conventional MCMC methods, the VB procedure achieves much higher computational efficiency, which greatly alleviates the computing burden for modern machine learning applications such as massive data analysis. Through numerical studies, we demonstrate that the proposed VB method leads to shorter computing time, higher estimation accuracy, and lower variable selection error than competitive sparse Bayesian methods.


title: Discriminative feature generation for classification of imbalanced data

abstract: The data imbalance problem is a frequent bottleneck in the classification performance of neural networks. In this paper, we propose a novel supervised discriminative feature generation (DFG) method for a minority class dataset. DFG is based on the modified structure of a generative adversarial network consisting of four independent networks: generator, discriminator, feature extractor, and classifier. To augment the selected discriminative features of the minority class data by adopting an attention mechanism, the generator for the class-imbalanced target task is trained, and the feature extractor and classifier are regularized using the pre-trained features from a large source data. The experimental results show that the DFG generator enhances the augmentation of the label-preserved and diverse features, and the classification results are significantly improved on the target task. The feature generation model can contribute greatly to the development of data augmentation methods through discriminative feature generation and supervised attention methods.


title: Force and state-feedback control for robots with non-collocated environmental and actuator forces

abstract: In this paper, we present an impedance control design for multi-variable linear and nonlinear robotic systems. The control design considers force and state feedback to improve the performance of the closed loop. Simultaneous feedback of forces and states allows the controller for an extra degree of freedom to approximate the desired impedance port behaviour. A numerical analysis is used to demonstrate the desired impedance closed-loop behaviour.


title: A dimension drop phenomenon of fractal cubes

abstract: Let E be a metric space. We introduce a notion of connectedness index of E, which is the Hausdor? dimension of the union of non-trivial connected components of E. We show that the connectedness index of a fractal cube E is strictly less than the Hausdor? dimension of E provided that E possesses a trivial connected component. Hence the connectedness index is a new Lipschitz invariant. Moreover, we investigate the relation between the connectedness index and topological Hausdor? dimension.


title: Resonance and antiresonance in Raman scattering in GaSe and InSe crystals

abstract: The temperature effect on the Raman scattering efficiency is investigated in $\varepsilon$-GaSe and $\gamma$-InSe crystals. We found that varying the temperature over a broad range from 5 K to 350 K permits to achieve both the resonant conditions and the antiresonance behaviour in Raman scattering of the studied materials. The resonant conditions of Raman scattering are observed at about 270 K under the 1.96 eV excitation for GaSe due to the energy proximity of the optical band gap. In the case of InSe, the resonant Raman spectra are apparent at about 50 K and 270 K under correspondingly the 2.41 eV and 2.54 eV excitations as a result of the energy proximity of the \mbox{so-called} B transition. Interestingly, the observed resonances for both materials are followed by an antiresonance behaviour noticeable at higher temperatures than the detected resonances. The significant variations of phonon-modes intensities can be explained in terms of electron-phonon coupling and quantum interference of contributions from different points of the Brillouin zone


title: On the Expressiveness of B\"uchi Arithmetic

abstract: We show that the existential fragment of B\"uchi arithmetic is strictly less expressive than full B\"uchi arithmetic of any base, and moreover establish that its $\Sigma_2$-fragment is already expressively complete. Furthermore, we show that regular languages of polynomial growth are definable in the existential fragment of B\"uchi arithmetic.


title: Parrondo's paradox for homeomorphisms

abstract: We construct two planar homeomorphisms $f$ and $g$ for which the origin is a globally asymptotically stable fixed point whereas for $f \circ g$ and $g \circ f$ the origin is a global repeller. Furthermore, the origin remains a global repeller for the iterated function system generated by $f$ and $g$ where each of the maps appears with a certain probability. This planar construction is also extended to any dimension greater than 2 and proves for first time the appearance of the Parrondo's dynamical paradox in odd dimensions.


title: Optimizing Multi-UAV Deployment in 3D Space to Minimize Task Completion Time in UAV-Enabled Mobile Edge Computing Systems

abstract: In Unmanned Aerial Vehicle (UAV)-enabled mobile edge computing (MEC) systems, UAVs can carry edge servers to help ground user equipment (UEs) offloading their computing tasks to the UAVs for execution. This paper aims to minimize the total time required for the UAVs to complete the offloaded tasks, while optimizing the three-dimensional (3D) deployment of UAVs, including their flying height and horizontal positions. Although the formulated optimization is a mixed integer nonlinear programmming, we convert it to a convex problem and develop a successive convex approximation (SCA) based algorithm to effectively solve it. The simulation results show that the joint optimization of the horizontal and the vertical position of a group of UAVs can achieve better performance than the traditional algorithms.


title: Some Theoretical Results Concerning Time-varying Nonparametric Regression with Local Stationary Regressors and Error

abstract: With regard to a three-step estimation procedure, proposed without theoretical discussion by Li and You in Journal of Applied Statistics and Management, for a nonparametric regression model with time-varying regression function, local stationary regressors and time-varying AR(p) (tvAR(p)) error process , we established all necessary asymptotic properties for each of estimator. We derive the convergence rate and asymptotic normality of the preliminary estimation of nonparametric regression function, establish the asymptotic distribution of time-varying coefficient functions in the error term, and present the asymptotic property of the refined estimation of nonparametric regression function. In addition, with regard to the ULASSO method for variable selection and constant coefficient detection for error term structure, we show that the ULASSO estimator can identify the true error term structure consistently. We conduct two simulation studies to illustrate the finite sample performance of the estimators and validate our theoretical discussion on the properties of the estimators.


title: Abduction and Argumentation for Explainable Machine Learning: A Position Survey

abstract: This paper presents Abduction and Argumentation as two principled forms for reasoning, and fleshes out the fundamental role that they can play within Machine Learning. It reviews the state-of-the-art work over the past few decades on the link of these two reasoning forms with machine learning work, and from this it elaborates on how the explanation-generating role of Abduction and Argumentation makes them naturally-fitting mechanisms for the development of Explainable Machine Learning and AI systems. Abduction contributes towards this goal by facilitating learning through the transformation, preparation, and homogenization of data. Argumentation, as a conservative extension of classical deductive reasoning, offers a flexible prediction and coverage mechanism for learning -- an associated target language for learned knowledge -- that explicitly acknowledges the need to deal, in the context of learning, with uncertain, incomplete and inconsistent data that are incompatible with any classically-represented logical theory.


title: A one-dimensional morphoelastic model for burn injuries: stability analysis, numerical validation and biological interpretation

abstract: To deal with permanent deformations and residual stresses, we consider a morphoelastic model for the scar formation as the result of wound healing after a skin trauma. Next to the mechanical components such as strain and displacements, the model accounts for biological constituents such as the concentration of signaling molecules, the cellular densities of fibroblasts and myofibroblasts, and the density of collagen. Here we present stability constraints for the one-dimensional counterpart of this morphoelastic model, for both the continuous and (semi-) discrete problem. We show that the truncation error between these eigenvalues associated with the continuous and semi-discrete problem is of order $\mathcal{O}(h^2)$. Next, we perform numerical validation to these constraints and provide a biological interpretation of the (in)stability. For the mechanical part of the model, the results show the components reach equilibria in a (non) monotonic way, depending on the value of the viscosity. The results show that the parameters of the chemical part of the model need to meet the stability constraint, depending on the decay rate of the signaling molecules, to avoid unrealistic results.


title: Unpredictable and Uniform RNG based on time of arrival using InGaAs Detectors

abstract: Quantum random number generators are becoming mandatory in a demanding technology world of high performing learning algorithms and security guidelines. Our implementation based on principles of quantum mechanics enable us to achieve the required randomness. We have generated high-quality quantum random numbers from a weak coherent source at telecommunication wavelength. The entropy is based on time of arrival of quantum states within a predefined time interval. The detection of photons by the InGaAs single-photon detectors and high precision time measurement of 5 ps enables us to generate 16 random bits per arrival time which is the highest reported to date. We have presented the theoretical analysis and experimental verification of the random number generation methodology. The method eliminates the requirement of any randomness extractor to be applied thereby, leveraging the principles of quantum physics to generate random numbers. The output data rate is on an average of 2.4 Mbps. The raw quantum random numbers are compared with NIST prescribed Blum-Blum-Shub pseudo random number generator and an in-house built hardware random number generator from FPGA, on the ENT and NIST Platform.


title: Adaptive In-network Collaborative Caching for Enhanced Ensemble Deep Learning at Edge

abstract: To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data-intensive intelligent processing services at edge. Among these data-intensive services, ensemble learning-based services can in natural leverage the distributed computation and storage resources at edge devices to achieve efficient data collection, processing, analysis. Collaborative caching has been applied in edge computing to support services close to the data source, in order to take the limited resources at edge devices to support high-performance ensemble learning solutions. To achieve this goal, we propose an adaptive in-network collaborative caching scheme for ensemble learning at edge. First, an efficient data representation structure is proposed to record cached data among different nodes. In addition, we design a collaboration scheme to facilitate edge nodes to cache valuable data for local ensemble learning, by scheduling local caching according to a summarization of data representations from different edge nodes. Our extensive simulations demonstrate the high performance of the proposed collaborative caching scheme, which significantly reduces the learning latency and the transmission overhead.


title: Electric Power Processing Using Logic Operation and Error Correction

abstract: In this study, electric power is processed using the logic operation method and the error correction algorithms to meet load demand. Electric power was treated as physically flow through the distribution network, which was governed by circuit configuration and efficiency. The hardware required to digitize or packetize electric power, which is called power packet router, was developed in this research work. It provides the opportunity for functional electric power dispatching disregarding the power flow in the circuit. This study proposes a new design for the network, which makes the logic operation of electric power possible and provides an algorithm to correct the inaccuracies caused by dissipation and noise. Phase shift of the power supply network is resulted by implementing the introduced design.


title: Pointwise periodic maps with quantized first integrals

abstract: We describe the global dynamics of some pointwise periodic piecewise linear maps in the plane that exhibit interesting dynamic features. For each of these maps we find a first integral. For these integrals the set of values are discrete, thus quantized. Furthermore, the level sets are bounded sets whose interior is formed by a finite number of open tiles of certain regular or uniform tessellations. The action of the maps on each invariant set of tiles is described geometrically.


title: A one-dimensional morphoelastic model for burn injuries: sensitivity analysis and a feasibility study

abstract: We consider a one-dimensional morphoelastic model describing post-burn scar contraction. This model describes the displacement of the dermal layer of the skin and the development of the effective Eulerian strain in the tissue. Besides these components, the model also contains components that play a major role in skin repair after trauma. These components are signaling molecules, fibroblasts, myofibroblasts, and collagen. We perform a sensitivity analysis for many parameters of the model and use the results for a feasibility study. In this study, we test whether the model is suitable for predicting the extent of contraction in different age groups. To this end, we conduct an extensive literature review to find parameter values. From the sensitivity analysis, we conclude that the most sensitive parameters are the equilibrium collagen concentration in the dermal layer, the apoptosis rate of fibroblasts and myofibroblasts, and the secretion rate of signaling molecules. Further, although we can use the model to simulate distinct contraction densities in different age groups, our results differ from what is seen in the clinic.


title: On Exponential Factorizations of Matrices over Banach Algebras

abstract: We study exponential factorization of invertible matrices over unital complex Banach algebras. In particular, we prove that every invertible matrix with entries in the algebra of holomorphic functions on a closed bordered Riemann surface can be written as a product of two exponents of matrices over this algebra. Our result extends similar results proved earlier in [KS] and [L] for $2\times 2$ matrices.


title: Constraining Mirror Dark Matter Inside Neutron Stars

abstract: We inspect the possibility that neutron star interiors are a mixture of ordinary matter and mirror dark matter. This is a scenario that can be naturally envisaged according to well studied accretion mechanisms, including the Bondi-Hoyle one. We show that the inclusion of mirror dark matter in neutron star models lowers the maximum neutron star mass for a given equation of state, and that it decreases the tidal deformability of a given neutron star. These general features imply that, given an equation of state, one can constrain the maximum viable amount of mirror dark matter in neutron stars in order to consistently fulfill existing maximum mass and tidal deformability constraints. Conversely, using tidal deformability measurements to rule out equations of state requires making assumptions on the amount of mirror dark matter contained in neutron stars. Finally, the presence of mirror dark matter also modifies the universal relation that links the tidal deformability of a neutron star to its compactness. Therefore, caution is mandatory when considering exotic models, such as the ones discussed in this paper.


title: ATRO: Adversarial Training with a Rejection Option

abstract: This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are empirically vulnerable to adversarial examples, which are slightly perturbed data samples that are wrongly classified. In real-world applications, adversarial attacks using such adversarial examples could cause serious problems. To this end, various methods are proposed to obtain a classifier that is robust against adversarial examples. Adversarial training is one of them, which trains a classifier to minimize the worst-case loss under adversarial attacks. In this paper, in order to acquire a more reliable classifier against adversarial attacks, we propose the method of Adversarial Training with a Rejection Option (ATRO). Applying the adversarial training objective to both a classifier and a rejection function simultaneously, classifiers trained by ATRO can choose to abstain from classification when it has insufficient confidence to classify a test data point. We examine the feasibility of the framework using the surrogate maximum hinge loss and establish a generalization bound for linear models. Furthermore, we empirically confirmed the effectiveness of ATRO using various models and real-world datasets.


title: Contributions of the kaon pair from $\rho(770)$ for the three-body decays $B \to D K\bar{K}$

abstract: We study the contributions of the kaon pair originating from the resonance $\rho(770)$ for the three-body decays $B \to D K\bar{K}$ by employing the perturbative QCD approach. According to the predictions in this work, the contributions from the intermediate state $\rho(770)^0 $ are relatively small for the three-body decays such as $B^0 \to \bar{D}^0 K^+ K^-$, $B_s^0 \to \bar{D}^0 K^+ K^-$, and $B^+ \to D_s^+ K^+K^-$, while about $20\%$ of the total three-body branching fraction for $B^+ \to \bar{D}^0 K^+ \bar{K}^0$ could possibly come from the subprocess $\rho(770)^+\to K^+ \bar{K}^0$. We also estimate the branching fractions for $\rho(770)^\pm$ decay into the kaon pair to be about $1\%$, and that for the neutral $\rho(770)$ decay into $K^+K^-$ or $K^0\bar{K}^0$ to be about $0.5\%$, which will be tested by future experiments.


title: The First Gamma-ray Emitting BL Lacertae Object at the Cosmic Dawn

abstract: One of the major challenges in studying the cosmic evolution of relativistic jets is the identification of the high-redshift ($z>3$) BL Lacertae objects, a class of jetted active galactic nuclei characterized by their quasi-featureless optical spectra. Here we report the identification of the first $\gamma$-ray emitting BL Lac object, 4FGL~J1219.0+3653 (J1219), beyond $z=3$, i.e., within the first two billion years of the age of the Universe. The optical and near-infrared spectra of J1219 taken from 10.4 m Gran Telescopio Canarias exhibit no emission lines down to an equivalent width of $\sim$3.5 A supporting its BL Lac nature. The detection of a strong Lyman-$\alpha$ break at $\sim$5570 A, on the other hand, confirms that J2119 is indeed a high-redshift ($z\sim3.59$) quasar. Based on the prediction of a recent BL Lac evolution model, J1219 is one of the only two such objects expected to be present within the comoving volume at $z=3.5$. Future identifications of more $z>3$ $\gamma$-ray emitting BL Lac sources, therefore, will be crucial to verify the theories of their cosmic evolution.


title: Deep Graph Matching and Searching for Semantic Code Retrieval

abstract: Code retrieval is to find the code snippet from a large corpus of source code repositories that highly matches the query of natural language description. Recent work mainly uses natural language processing techniques to process both query texts (i.e., human natural language) and code snippets (i.e., machine programming language), however neglecting the deep structured features of query texts and source codes, both of which contain rich semantic information. In this paper, we propose an end-to-end deep graph matching and searching (DGMS) model based on graph neural networks for the task of semantic code retrieval. To this end, we first represent both natural language query texts and programming language code snippets with the unified graph-structured data, and then use the proposed graph matching and searching model to retrieve the best matching code snippet. In particular, DGMS not only captures more structural information for individual query texts or code snippets but also learns the fine-grained similarity between them by cross-attention based semantic matching operations. We evaluate the proposed DGMS model on two public code retrieval datasets with two representative programming languages (i.e., Java and Python). Experiment results demonstrate that DGMS significantly outperforms state-of-the-art baseline models by a large margin on both datasets. Moreover, our extensive ablation studies systematically investigate and illustrate the impact of each part of DGMS.


title: Inductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets

abstract: We analyze the inductive bias of gradient descent for weight normalized smooth homogeneous neural nets, when trained on exponential or cross-entropy loss. We analyse both standard weight normalization (SWN) and exponential weight normalization (EWN), and show that the gradient flow path with EWN is equivalent to gradient flow on standard networks with an adaptive learning rate. We extend these results to gradient descent, and establish asymptotic relations between weights and gradients for both SWN and EWN. We also show that EWN causes weights to be updated in a way that prefers asymptotic relative sparsity. For EWN, we provide a finite-time convergence rate of the loss with gradient flow and a tight asymptotic convergence rate with gradient descent. We demonstrate our results for SWN and EWN on synthetic data sets. Experimental results on simple datasets support our claim on sparse EWN solutions, even with SGD. This demonstrates its potential applications in learning neural networks amenable to pruning.


title: Is the axionic dark matter an equilibrium system?

abstract: We consider an axionic dark matter model with a modified periodic potential for the pseudoscalar field in the framework of the axionic extension of the Einstein-aether theory. The modified potential is assumed to be equipped by the guiding function, which depends on the expansion scalar constructed as the trace of the covariant derivative of the aether velocity four-vector. The equilibrium state of the axion field is defined as the state, for which the modified potential itself and its first derivative with respect to the pseudoscalar field are equal to zero. We apply the developed formalism to the homogeneous isotropic cosmological model, and find the basic function, which describes the equilibrium state of the axionic dark matter in the expanding Universe.


title: Turbulence and Particle Acceleration in Radiative Shock Waves in the Cygnus Loop II: Development of Postshock Turbulence

abstract: Radiative shock waves in the Cygnus Loop and other supernova remnants show different morphologies in [O III] and H{\alpha} emission. We use HST spectra and narrowband images to study the development of turbulence in the cooling region behind a shock on the west limb of the Cygnus Loop. We refine our earlier estimates of shock parameters that were based upon ground-based spectra, including ram pressure, vorticity and magnetic field strength. We apply several techniques, including Fourier power spectra and the Rolling Hough Transform, to quantify the shape of the rippled shock front as viewed in different emission lines. We assess the relative importance of thermal instabilities, the thin shell instability, upstream density variations, and upstream magnetic field variations in producing the observed structure.


title: Word Embeddings for Chemical Patent Natural Language Processing

abstract: We evaluate chemical patent word embeddings against known biomedical embeddings and show that they outperform the latter extrinsically and intrinsically. We also show that using contextualized embeddings can induce predictive models of reasonable performance for this domain over a relatively small gold standard.


title: Classifying Eye-Tracking Data Using Saliency Maps

abstract: A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual attention has already elicited two potential research avenues: 1) determining the physiological or psychological state of the subject and 2) predicting the tasks associated with the act of viewing from the recorded eye-fixation data. To this end, this paper proposes a visual saliency based novel feature extraction method for automatic and quantitative classification of eye-tracking data, which is applicable to both of the research directions. Instead of directly extracting features from the fixation data, this method employs several well-known computational models of visual attention to predict eye fixation locations as saliency maps. Comparing the saliency amplitudes, similarity and dissimilarity of saliency maps with the corresponding eye fixations maps gives an extra dimension of information which is effectively utilized to generate discriminative features to classify the eye-tracking data. Extensive experimentation using Saliency4ASD, Age Prediction, and Visual Perceptual Task dataset show that our saliency-based feature can achieve superior performance, outperforming the previous state-of-the-art methods by a considerable margin. Moreover, unlike the existing application-specific solutions, our method demonstrates performance improvement across three distinct problems from the real-life domain: Autism Spectrum Disorder screening, toddler age prediction, and human visual perceptual task classification, providing a general paradigm that utilizes the extra-information inherent in saliency maps for a more accurate classification.


title: Planning with Exploration: Addressing Dynamics Bottleneck in Model-based Reinforcement Learning

abstract: Model-based reinforcement learning (MBRL) is believed to have higher sample efficiency compared with model-free reinforcement learning (MFRL). However, MBRL is plagued by dynamics bottleneck dilemma. Dynamics bottleneck dilemma is the phenomenon that the performance of the algorithm falls into the local optimum instead of increasing when the interaction step with the environment increases, which means more data can not bring better performance. In this paper, we find that the trajectory reward estimation error is the main reason that causes dynamics bottleneck dilemma through theoretical analysis. We give an upper bound of the trajectory reward estimation error and point out that increasing the agent's exploration ability is the key to reduce trajectory reward estimation error, thereby alleviating dynamics bottleneck dilemma. Motivated by this, a model-based control method combined with exploration named MOdel-based Progressive Entropy-based Exploration (MOPE2) is proposed. We conduct experiments on several complex continuous control benchmark tasks. The results verify that MOPE2 can effectively alleviate dynamics bottleneck dilemma and have higher sample efficiency than previous MBRL and MFRL algorithms.


title: OTFS Based Random Access Preamble Transmission For High Mobility Scenarios

abstract: We consider the problem of uplink timing synchronization for Orthogonal Time Frequency Space (OTFS) modulation based systems where information is embedded in the delay-Doppler (DD) domain. For this, we propose a novel Random Access (RA) preamble waveform based on OTFS modulation. We also propose a method to estimate the round-trip propagation delay between a user terminal (UT) and the base station (BS) based on the received RA preambles in the DD domain. This estimate (known as the timing advance estimate) is fed back to the respective UTs so that they can advance their uplink timing in order that the signal from all UTs in a cell is received at the BS in a time-synchronized manner. Through analysis and simulations we study the impact of OTFS modulation parameters of the RA preamble on the probability of timing error, which gives valuable insights on how to choose these parameters. Exhaustive numerical simulations of high mobility scenarios suggests that the timing error probability (TEP) performance of the proposed OTFS based RA is much more robust to channel induced multi-path Doppler shift when compared to the RA method in Fourth Generation (4G) systems.


title: Modeling and Optimization Trade-off in Meta-learning

abstract: By searching for shared inductive biases across tasks, meta-learning promises to accelerate learning on novel tasks, but with the cost of solving a complex bilevel optimization problem. We introduce and rigorously define the trade-off between accurate modeling and optimization ease in meta-learning. At one end, classic meta-learning algorithms account for the structure of meta-learning but solve a complex optimization problem, while at the other end domain randomized search (otherwise known as joint training) ignores the structure of meta-learning and solves a single level optimization problem. Taking MAML as the representative meta-learning algorithm, we theoretically characterize the trade-off for general non-convex risk functions as well as linear regression, for which we are able to provide explicit bounds on the errors associated with modeling and optimization. We also empirically study this trade-off for meta-reinforcement learning benchmarks.


title: RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering

abstract: Text-based visual question answering (VQA) requires to read and understand text in an image to correctly answer a given question. However, most current methods simply add optical character recognition (OCR) tokens extracted from the image into the VQA model without considering contextual information of OCR tokens and mining the relationships between OCR tokens and scene objects. In this paper, we propose a novel text-centered method called RUArt (Reading, Understanding and Answering the Related Text) for text-based VQA. Taking an image and a question as input, RUArt first reads the image and obtains text and scene objects. Then, it understands the question, OCRed text and objects in the context of the scene, and further mines the relationships among them. Finally, it answers the related text for the given question through text semantic matching and reasoning. We evaluate our RUArt on two text-based VQA benchmarks (ST-VQA and TextVQA) and conduct extensive ablation studies for exploring the reasons behind RUArt's effectiveness. Experimental results demonstrate that our method can effectively explore the contextual information of the text and mine the stable relationships between the text and objects.


title: On Testing of Samplers

abstract: Given a set of items $\mathcal{F}$ and a weight function $\mathtt{wt}: \mathcal{F} \mapsto (0,1)$, the problem of sampling seeks to sample an item proportional to its weight. Sampling is a fundamental problem in machine learning. The daunting computational complexity of sampling with formal guarantees leads designers to propose heuristics-based techniques for which no rigorous theoretical analysis exists to quantify the quality of generated distributions. This poses a challenge in designing a testing methodology to test whether a sampler under test generates samples according to a given distribution. Only recently, Chakraborty and Meel (2019) designed the first scalable verifier, called Barbarik1, for samplers in the special case when the weight function $\mathtt{wt}$ is constant, that is, when the sampler is supposed to sample uniformly from $\mathcal{F}$ . The techniques in Barbarik1, however, fail to handle general weight functions. The primary contribution of this paper is an affirmative answer to the above challenge: motivated by Barbarik1 but using different techniques and analysis, we design Barbarik2 an algorithm to test whether the distribution generated by a sampler is $\varepsilon$-close or $\eta$-far from any target distribution. In contrast to black-box sampling techniques that require a number of samples proportional to $|\mathcal{F}|$ , Barbarik2 requires only $\tilde{O}(tilt(\mathtt{wt},\varphi)^2/\eta(\eta - 6\varepsilon)^3)$ samples, where the $tilt$ is the maximum ratio of weights of two satisfying assignments. Barbarik2 can handle any arbitrary weight function. We present a prototype implementation of Barbarik2 and use it to test three state-of-the-art samplers.


title: Causal Effects of Linguistic Properties

abstract: We consider the problem of using observational data to estimate the causal effects of linguistic properties. For example, does writing a complaint politely lead to a faster response time? How much will a positive product review increase sales? This paper addresses two technical challenges related to the problem before developing a practical method. First, we formalize the causal quantity of interest as the effect of a writer's intent, and establish the assumptions necessary to identify this from observational data. Second, in practice, we only have access to noisy proxies for the linguistic properties of interest -- e.g., predictions from classifiers and lexicons. We propose an estimator for this setting and prove that its bias is bounded when we perform an adjustment for the text. Based on these results, we introduce TextCause, an algorithm for estimating causal effects of linguistic properties. The method leverages (1) distant supervision to improve the quality of noisy proxies, and (2) a pre-trained language model (BERT) to adjust for the text. We show that the proposed method outperforms related approaches when estimating the effect of Amazon review sentiment on semi-simulated sales figures. Finally, we present an applied case study investigating the effects of complaint politeness on bureaucratic response times.


title: An Explicitly Solvable Energy-Conserving Algorithm for Pitch-Angle Scattering in Magnetized Plasmas

abstract: We develop an Explicitly Solvable Energy-Conserving (ESEC) algorithm for the Stochastic Differential Equation (SDE) describing the pitch-angle scattering process in magnetized plasmas. The Cayley transform is used to calculate both the deterministic gyromotion and stochastic scattering, affording the algorithm to be explicitly solvable and exactly energy conserving. An unusual property of the SDE for pitch-angle scattering is that its coefficients diverge at the zero velocity and do not satisfy the global Lipschitz condition. Consequently, when standard numerical methods, such as the Euler-Maruyama (EM), are applied, numerical convergence is difficult to establish. For the proposed ESEC algorithm, its energy-preserving property enables us to overcome this obstacle. We rigorously prove that the ESEC algorithm is order 1/2 strongly convergent. This result is confirmed by detailed numerical studies. For the case of pitch-angle scattering in a magnetized plasma with a constant magnetic field, the numerical solution is benchmarked against the analytical solution, and excellent agreements are found.


title: Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration

abstract: Non-local low-rank tensor approximation has been developed as a state-of-the-art method for hyperspectral image (HSI) restoration, which includes the tasks of denoising, compressed HSI reconstruction and inpainting. Unfortunately, while its restoration performance benefits from more spectral bands, its runtime also substantially increases. In this paper, we claim that the HSI lies in a global spectral low-rank subspace, and the spectral subspaces of each full band patch group should lie in this global low-rank subspace. This motivates us to propose a unified paradigm combining the spatial and spectral properties for HSI restoration. The proposed paradigm enjoys performance superiority from the non-local spatial denoising and light computation complexity from the low-rank orthogonal basis exploration. An efficient alternating minimization algorithm with rank adaptation is developed. It is done by first solving a fidelity term-related problem for the update of a latent input image, and then learning a low-dimensional orthogonal basis and the related reduced image from the latent input image. Subsequently, non-local low-rank denoising is developed to refine the reduced image and orthogonal basis iteratively. Finally, the experiments on HSI denoising, compressed reconstruction, and inpainting tasks, with both simulated and real datasets, demonstrate its superiority with respect to state-of-the-art HSI restoration methods.


title: The Evolution of the Solar-Stellar Activity

abstract: We present a brief review of observational results contributing to modern ideas on the evolution of stellar activity. Basic laws, derived for both rotation-age and activity-rotation relationships, allow us to trace how the activity of low-mass stars changes with age during their stay on the main sequence. We focus on the evaluation of the activity properties of stars that could be analogs of the young Sun. Our study includes joint consideration of different tracers of activity, rotation and magnetic fields of Sun-like stars of various ages. We identify rotation periods, when the saturated regime of activity changes to the unsaturated mode, when the solar-type activity is formed: for G- and K-type stars, they are 1.1 and 3.3 days, respectively. This corresponds to an age interval of about 0.2-0.6 Gyr, when regular sunspot cycle began to be established on the early Sun. We discuss properties of the coronal and chromospheric activity in young Suns. Our evaluation of the EUV-fluxes in the spectral range of 1350-1750 A shows that the far-UV radiation of the early Sun was a factor of 7 times more intense than that of the present-day Sun, and twice higher when the regular sunspot cycle was established. For the young Sun, we can estimate the possible mass loss rate associated with quasi-steady outflow as $10^{-12} M_\odot$/yr. The results of observations of the largest flares on solar-type stars are also discussed, leading to conclusion that the most powerful phenomena occur on the fast-rotating stars in the saturated activity regime. Our estimate of the stellar magnetic fields makes it possible to evaluate the maximal possible flare energy. This could help us better understand the origin of extreme events on the Sun in the past.


title: Optimal Lockdown for Pandemic Control

abstract: As a common strategy of contagious disease containment, lockdowns will inevitably weaken the economy. The ongoing COVID-19 pandemic underscores the trade-off arising from public health and economic cost. An optimal lockdown policy to resolve this trade-off is highly desired. Here we propose a mathematical framework of pandemic control through an optimal stabilizing non-uniform lockdown, where our goal is to reduce the economic activity as little as possible while decreasing the number of infected individuals at a prescribed rate. This framework allows us to efficiently compute the optimal stabilizing lockdown policy for general epidemic spread models, including both the classical SIS/SIR/SEIR models and a new model of COVID-19 transmissions. We demonstrate the power of this framework by analyzing publicly available data of inter-county travel frequencies to analyze a model of COVID-19 spread in the 62 counties of New York State. We find that an optimal stabilizing lockdown based on epidemic status in April 2020 would have reduced economic activity more stringently outside of New York City compared to within it, even though the epidemic was much more prevalent in New York City at that point. Such a counterintuitive result highlights the intricacies of pandemic control and sheds light on future lockdown policy design.


title: Cycles in Asymptotically Stable and Chaotic Fractional Maps

abstract: The presence of the power-law memory is a significant feature of many natural (biological, physical, etc.) and social systems. Continuous and discrete fractional calculus is the instrument to describe the behavior of systems with the power-law memory. The existence of chaotic solutions is an intrinsic property of nonlinear dynamics (regular and fractional). The behavior of fractional systems can be very different from the behavior of the corresponding systems with no memory. Finding periodic points is essential for understanding regular and chaotic dynamics. Fractional systems do not have periodic points except for fixed points. Instead, they have asymptotically periodic points (sinks). There have been no reported results (formulae) that would allow calculations of asymptotically periodic points of nonlinear fractional systems so far. In this paper, we derive the equations that allow calculations of the coordinates of the asymptotically periodic sinks.


title: Disease Normalization with Graph Embeddings

abstract: The detection and normalization of diseases in biomedical texts are key biomedical natural language processing tasks. Disease names need not only be identified, but also normalized or linked to clinical taxonomies describing diseases such as MeSH. In this paper we describe deep learning methods that tackle both tasks. We train and test our methods on the known NCBI disease benchmark corpus. We propose to represent disease names by leveraging MeSH's graphical structure together with the lexical information available in the taxonomy using graph embeddings. We also show that combining neural named entity recognition models with our graph-based entity linking methods via multitask learning leads to improved disease recognition in the NCBI corpus.


title: Towards an open-source landscape for 3D CSEM modelling

abstract: Large-scale modelling of three-dimensional controlled-source electromagnetic (CSEM) surveys used to be feasible only for large companies and research consortia. This has changed over the last few years, and today there exists a selection of different open-source codes available to everyone. Using four different codes in the Python ecosystem, we perform simulations for increasingly complex models in a shallow marine setting. We first verify the computed fields with semi-analytical solutions for a simple layered model. Then we validate the responses of a more complex block model by comparing results obtained from each code. Finally we compare the responses of a real world model with results from the industry. On the one hand, these validations show that the open-source codes are able to compute comparable CSEM responses for challenging, large-scale models. On the other hand, they show many general and method-dependent problems that need to be faced for obtaining accurate results. Our comparison includes finite-element and finite-volume codes using structured rectilinear and octree meshes as well as unstructured tetrahedral meshes. Accurate responses can be obtained independently of the chosen method and the chosen mesh type. The runtime and memory requirements vary greatly based on the choice of iterative or direct solvers. However, we have found that much more time was spent on designing the mesh and setting up the simulations than running the actual computation. The challenging task is, irrespective of the chosen code, to appropriately discretize the model. We provide three models, each with their corresponding discretization and responses of four codes, which can be used for validation of new and existing codes.


title: Thermalization in massive deformations of Yang-Mills matrix models

abstract: We numerically study the classical evolution of a Yang-Mills matrix model with two distinct mass deformation terms, which can be contemplated as a massive deformation of the bosonic part of the BFSS model. Through numerical analysis, it is shown that when the simulations are started from a certain set of initial conditions, thermalization occurs. Besides, an estimation method is proposed to determine the approximate thermalization time. Using this method, we demonstrate that thermalization time vary logarithmically with increasing matrix size when the mass terms differ. Introducing a matrix configuration, we also obtain reduced actions and subsequently analyze how the thermalization time change as a function of the energy.