title: sPortfolio: Stratified Visual Analysis of Stock Portfolios

abstract: Quantitative Investment, built on the solid foundation of robust financial theories, is at the center stage in investment industry today. The essence of quantitative investment is the multi-factor model, which explains the relationship between the risk and return of equities. However, the multi-factor model generates enormous quantities of factor data, through which even experienced portfolio managers find it difficult to navigate. This has led to portfolio analysis and factor research being limited by a lack of intuitive visual analytics tools. Previous portfolio visualization systems have mainly focused on the relationship between the portfolio return and stock holdings, which is insufficient for making actionable insights or understanding market trends. In this paper, we present sPortfolio, which, to the best of our knowledge, is the first visualization that attempts to explore the factor investment area. In particular, sPortfolio provides a holistic overview of the factor data and aims to facilitate the analysis at three different levels: a Risk-Factor level, for a general market situation analysis; a Multiple-Portfolio level, for understanding the portfolio strategies; and a Single-Portfolio level, for investigating detailed operations. The system's effectiveness and usability are demonstrated through three case studies. The system has passed its pilot study and is soon to be deployed in industry.


title: Probing entanglement in Compton interactions

abstract: This theoretical research aims to examine areas of the Compton cross section of entangled annihilation photons for the purpose of testing for possible break down of theory, which could have consequences for predicted optimal capabilities of Compton PET systems.We provide maps of the cross section for entangled annihilation photons for experimental verification.We introduce a strategy to derive cross sections in a relatively straight forward manner for the Compton scattering of a hypothetical separable, mixed and entangled states. To understand the effect that entanglement has on the cross section for annihilation photons, we derive the cross section so that it is expressed in terms of the cross section of a hypothetical separable state and of a hypothetical forbidden maximally entangled state.We find lobe-like structures in the cross section which are regions where entanglement has the greatest effect.We also find that mixed states do not reproduce the cross section for annihilation photons, contrary to a recent investigation which reported otherwise.We review the motivation and method of the most precise Compton scattering experiment for annihilation photons, in order to resolve conflicting reports regarding the extent to which the cross section itself has been experimentally verified.


title: Optimal stopping contract for Public Private Partnerships under moral hazard

abstract: This paper studies optimal Public Private Partnerships contract between a public entity and a consortium, in continuous-time and with a continuous payment, with the possibility for the public to stop the contract. The public ("she") pays a continuous rent to the consortium ("he"), while the latter gives a best response characterized by his effort. This effect impacts the drift of the social welfare, until a terminal date decided by the public when she stops the contract and gives compensation to the consortium. Usually, the public can not observe the effort done by the consortium, leading to a principal agent's problem with moral hazard. We solve this optimal stochastic control with optimal stopping problem in this context of moral hazard. The public value function is characterized by the solution of an associated Hamilton Jacobi Bellman Variational Inequality. The public value function and the optimal effort and rent processes are computed numerically by using the Howard algorithm. In particular, the impact of the social welfare's volatility on the optimal contract is studied.


title: First-passage and first-hitting times of Levy flights and Levy walks

abstract: For both Levy flight and Levy walk search processes we analyse the full distribution of first-passage and first-hitting (or first-arrival) times. These are, respectively, the times when the particle moves across a point at some given distance from its initial position for the first time, or when it lands at a given point for the first time. For Levy motions with their propensity for long relocation events and thus the possibility to jump across a given point in space without actually hitting it ("leapovers"), these two definitions lead to significantly different results. We study the first-passage and first-hitting time distributions as functions of the Levy stable index, highlighting the different behaviour for the cases when the first absolute moment of the jump length distribution is finite or infinite. In particular we examine the limits of short and long times. Our results will find their application in the mathematical modelling of random search processes as well as computer algorithms.


title: A single-laser alternating-frequency magneto-optical trap

abstract: In this paper, we present a technique for magneto-optical cooling and trapping of neutral atoms using a single laser. The alternating-frequency magneto-optical trap (AF-MOT) uses an agile light source that sequentially switches between cooling and repumping transition frequencies by tuning the injection current of the laser diode. We report on the experimental demonstration of such a system for 87Rb and 85Rb based on a micro-integrated extended cavity diode laser (ECDL) performing laser frequency jumps of up to 6.6 GHz with a tuning time in the microsecond regime and a repetition rate of up to 7.6 kHz. For that, a combination of a feed-forward for coarse frequency control and a feedback for precise locking was used. We discuss the results of the AF-MOT characterization in terms of atom numbers and cloud temperature for different operation parameters.


title: Convergence of algorithms for fixed points of relatively nonexpansive mappings via Ishikawa iteration

abstract: By using the Ishikawa iterative algorithm, we approximate the fixed points and the best proximity points of a relatively non expansive mapping. Also, we use the von Neumann sequence to prove the convergence result in a Hilbert space setting. A comparison table is prepared using a numerical example which shows that the Ishikawa iterative algorithm is faster than some known iterative algorithms such as Picard and Mann iteration.


title: Extremal digraphs on Meyniel-type condition for hamiltonian cycles in balanced bipartite digraphs

abstract: Let $D$ be a strong balanced digraph on $2a$ vertices. Adamus et al. have proved that $D$ is hamiltonian if $d(u)+d(v)\ge 3a$ whenever $uv\notin A(D)$ and $vu\notin A(D)$. The lower bound $3a$ is tight. In this paper, we shall show that the extremal digraph on this condition is two classes of digraphs that can be clearly characterized. Moreover, we also show that if $d(u)+d(v)\geq 3a-1$ whenever $uv\notin A(D)$ and $vu\notin A(D)$, then $D$ is traceable. The lower bound $3a-1$ is tight.


title: A catalogue of 108 extended planetary nebulae observed by GALEX

abstract: We present the ultraviolet (UV) imaging observation of planetary nebulae (PNe) using archival data of Galaxy Evolution Explorer (GALEX). We found 358 PNe detected by GALEX in near-UV (NUV). We have compiled a catalogue of 108 extended PNe with sizes greater than 8 00 and provided the angular diameters for all the 108 extended PNe in NUV and 28 in FUV from the GALEX images considering 3{\sigma} surface brightness level above the background. Of the 108 PNe, 74 are elliptical, 24 are circular and 10 are bipolar in NUV with most being larger in the UV than in the radio, H{\alpha} or optical. We derived luminosities for 33 PNe in FUV (L FUV ) and 89 PNe in NUV (L NUV ) and found that most of the sources are very bright in UV. The FUV emission of the GALEX band includes contribution from prominent emission lines N IV] (1487 {\AA}), CIV (1550 {\AA}), and O III] (1661 {\AA}) whereas the NUV emission includes C III] (1907 {\AA}) and C II (2325 {\AA}) for PNe of all excitation classes. The other emission lines seen in low excitation PNe are O IV] (1403 {\AA}) and N III(1892 {\AA}) in FUV, and O II (2470 {\AA}) and Mg II (2830 {\AA}) in NUV. Similarly the emission lines O V (1371 {\AA}) and He II (1666 {\AA}) strongly contribute in FUV for high and medium excitation PNe but not for low excitation PNe. A mixture of other emission lines seen in all excitation PNe. We have also provided images of 34 PNe in NUV and 9 PNe in FUV.


title: A parameterized Douglas-Rachford Splitting algorithm for nonconvex optimization

abstract: In this paper, we study a parameterized Douglas-Rachford splitting method for a class of nonconvex optimization problem. A new merit function is constructed to establish the convergence of the whole sequence generated by the parameterized Douglas-Rachford splitting method. We then apply the parameterized Douglas-Rachford splitting method to three important classes of nonconvex optimization problems arising in data science: sparsity constrained least squares problem, feasibility problem and low rank matrix completion. Numerical results validate the effectiveness of the parameterized Douglas-Rachford splitting method compared with some other classical methods.


title: Template-Instance Loss for Offline Handwritten Chinese Character Recognition

abstract: The long-standing challenges for offline handwritten Chinese character recognition (HCCR) are twofold: Chinese characters can be very diverse and complicated while similarly looking, and cursive handwriting (due to increased writing speed and infrequent pen lifting) makes strokes and even characters connected together in a flowing manner. In this paper, we propose the template and instance loss functions for the relevant machine learning tasks in offline handwritten Chinese character recognition. First, the character template is designed to deal with the intrinsic similarities among Chinese characters. Second, the instance loss can reduce category variance according to classification difficulty, giving a large penalty to the outlier instance of handwritten Chinese character. Trained with the new loss functions using our deep network architecture HCCR14Layer model consisting of simple layers, our extensive experiments show that it yields state-of-the-art performance and beyond for offline HCCR.


title: Understanding the computation of time using neural network models

abstract: To maximize future rewards in this ever-changing world, animals must be able to discover the temporal structure of stimuli and then anticipate or act correctly at the right time. How the animals perceive, maintain, and use time intervals ranging from hundreds of milliseconds to multi-seconds in working memory? How temporal information is processed concurrently with spatial information and decision making? Why there are strong neuronal temporal signals in tasks in which temporal information is not required? A systematic understanding of the underlying neural mechanisms is still lacking. Here, we addressed these problems using supervised training of recurrent neural network models. We revealed that neural networks perceive elapsed time through state evolution along stereotypical trajectory, maintain time intervals in working memory in the monotonic increase or decrease of the firing rates of interval-tuned neurons, and compare or produce time intervals by scaling state evolution speed. Temporal and non-temporal information are coded in subspaces orthogonal with each other, and the state trajectories with time at different non-temporal information are quasi-parallel and isomorphic. Such coding geometry facilitates the decoding generalizability of temporal and non-temporal information across each other. The network structure exhibits multiple feedforward sequences that mutually excite or inhibit depending on whether their preferences of non-temporal information are similar or not. We identified four factors that facilitate strong temporal signals in non-timing tasks, including the anticipation of coming events. Our work discloses fundamental computational principles of temporal processing, and is supported by and gives predictions to a number of experimental phenomena.


title: Autonomous Navigation via Deep Reinforcement Learning for Resource Constraint Edge Nodes using Transfer Learning

abstract: Smart and agile drones are fast becoming ubiquitous at the edge of the cloud. The usage of these drones are constrained by their limited power and compute capability. In this paper, we present a Transfer Learning (TL) based approach to reduce on-board computation required to train a deep neural network for autonomous navigation via Deep Reinforcement Learning for a target algorithmic performance. A library of 3D realistic meta-environments is manually designed using Unreal Gaming Engine and the network is trained end-to-end. These trained meta-weights are then used as initializers to the network in a test environment and fine-tuned for the last few fully connected layers. Variation in drone dynamics and environmental characteristics is carried out to show robustness of the approach. Using NVIDIA GPU profiler it was shown that the energy consumption and training latency is reduced by 3.7x and 1.8x respectively without significant degradation in the performance in terms of average distance traveled before crash i.e. Mean Safe Flight (MSF). The approach is also tested on a real environment using DJI Tello drone and similar results were reported.


title: Towards Amplituhedron via One-Dimensional Theory

abstract: Inspired by the closed contour of momentum conservation in an interaction, we introduce an integrable one-dimensional theory that underlies some integrable models such as the Kadomtsev-Petviashvili (KP)-hierarchy and the amplituhedron. In this regard, by defining the action and partition function of the presented theory, while introducing a perturbation, we obtain its scattering matrix (S-matrix) with Grassmannian structure. This Grassmannian corresponds to a chord diagram, which specifies the closed contour of the one-dimensional theory. Then, we extract a solution of the KP-hierarchy using the S-matrix of theory. Furthermore, we indicate that the volume of phase-space of the one-dimensional manifold of the theory is equal to a corresponding Grassmannian integral. Actually, without any use of supersymmetry, we obtain a sort of general structure in comparison with the conventional Grassmannian integral and the resulted amplituhedron that is closely related to the Yang-Mills scattering amplitudes in four dimensions. The proposed theory is capable to express both the tree- and loop-levels amplituhedron (without employing hidden particles) and scattering amplitude in four dimensions in the twistor space as particular cases.


title: Stripe-based and Attribute-aware Network: A Two-Branch Deep Model for Vehicle Re-identification

abstract: Vehicle re-identification (Re-ID) has been attracting increasing interest in the field of computer vision due to the growing utilization of surveillance cameras in public security. However, vehicle Re-ID still suffers a similarity challenge despite the efforts made to solve this problem. This challenge involves distinguishing different instances with nearly identical appearances. In this paper, we propose a novel two-branch stripe-based and attribute-aware deep convolutional neural network (SAN) to learn the efficient feature embedding for vehicle Re-ID task. The two-branch neural network, consisting of stripe-based branch and attribute-aware branches, can adaptively extract the discriminative features from the visual appearance of vehicles. A horizontal average pooling and dimension-reduced convolutional layers are inserted into the stripe-based branch to achieve part-level features. Meanwhile, the attribute-aware branch extracts the global feature under the supervision of vehicle attribute labels to separate the similar vehicle identities with different attribute annotations. Finally, the part-level and global features are concatenated together to form the final descriptor of the input image for vehicle Re-ID. The final descriptor not only can separate vehicles with different attributes but also distinguish vehicle identities with the same attributes. The extensive experiments on both VehicleID and VeRi databases show that the proposed SAN method outperforms other state-of-the-art vehicle Re-ID approaches.


title: Relative coherent modules

abstract: Several authors have introduced various type of coherent-like rings and proved analogous results on these rings. It appears that all these relative coherent rings and all the used techniques can be unified. In [2], several coherent-like rings are unified. In this manuscript we continue this work and we introduce coherent-like module which also emphasizes our point of view by unifying the existed relative coherent concepts. Several classical results are generalized and some new results are given.


title: Selective probing of magnetic order on Tb and Ir sites in stuffed Tb$_{2+x}$Ir$_{2-x}$O$_{7-y}$ using resonant X-ray scattering

abstract: We study the magnetic structure of the "stuffed" (Tb-rich) pyrochlore iridate Tb$_{2+x}$Ir$_{2-x}$O$_{7-y}$, using resonant elastic x-ray scattering (REXS). In order to disentangle contributions from Tb and Ir magnetic sublattices, experiments were performed at the Ir $L_3$ and Tb $M_5$ edges, which provide selective sensitivity to Ir $5d$ and Tb $4f$ magnetic moments, respectively. At the Ir $L_3$ edge, we found the onset of long-range ${\bf k}={\bf 0}$ magnetic order below $T_{N}^\text{Ir}\sim$ 71 K, consistent with the expected signal of all-in all-out (AIAO) magnetic order. Using a single-ion model to calculate REXS cross-sections, we estimate an ordered magnetic moment of $\mu_{5d}^{\text{Ir}} \approx 0.34(3)\,\mu_B$ at 5 K. At the Tb $M_5$ edge, long-range ${\bf k}={\bf 0}$ magnetic order appeared below $\sim40$ K, also consistent with an AIAO magnetic structure on the Tb site. Additional insight into the magnetism of the Tb sublattice is gleaned from measurements at the $M_5$ edge in applied magnetic fields up to 6 T, which is found to completely suppress the Tb AIAO magnetic order. In zero applied field, the observed gradual onset of the Tb sublattice magnetisation with temperature suggests that it is induced by the magnetic order on the Ir site. The persistence of AIAO magnetic order, despite the greatly reduced ordering temperature and moment size compared to stoichiometric Tb$_{2}$Ir$_{2}$O$_{7}$, for which $T_{N}^{\text{Ir}} =130$ K and $\mu_{5d}^{\text{Ir}}=0.56\,\mu_B$, indicates that stuffing could be a viable means of tuning the strength of electronic correlations, thereby potentially offering a new strategy to achieve topologically non-trivial band crossings in pyrochlore iridates.


title: Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction

abstract: Click-through rate (CTR) prediction is an essential task in web applications such as online advertising and recommender systems, whose features are usually in multi-field form. The key of this task is to model feature interactions among different feature fields. Recently proposed deep learning based models follow a general paradigm: raw sparse input multi-filed features are first mapped into dense field embedding vectors, and then simply concatenated together to feed into deep neural networks (DNN) or other specifically designed networks to learn high-order feature interactions. However, the simple \emph{unstructured combination} of feature fields will inevitably limit the capability to model sophisticated interactions among different fields in a sufficiently flexible and explicit fashion. In this work, we propose to represent the multi-field features in a graph structure intuitively, where each node corresponds to a feature field and different fields can interact through edges. The task of modeling feature interactions can be thus converted to modeling node interactions on the corresponding graph. To this end, we design a novel model Feature Interaction Graph Neural Networks (Fi-GNN). Taking advantage of the strong representative power of graphs, our proposed model can not only model sophisticated feature interactions in a flexible and explicit fashion, but also provide good model explanations for CTR prediction. Experimental results on two real-world datasets show its superiority over the state-of-the-arts.


title: The wave particle duality -- does the concept of particle make sense in quantum mechanics? Should we ask the second quantization?

abstract: The quantum object is in general considered as displaying both wave and particle nature. By particle is understood an item localized in a very small volume of the space, and which cannot be simultaneously in two disjoint regions of the space. By wave, to the contrary, is understood a distributed item, occupying in some cases two or more disjoint regions of the space. The quantum formalism did not explain until today the so called "collapse" of the wave function, i.e. the shrinking of the wave function to one small region of the space, when a macroscopic object is encountered. This seems to happen in "which way" experiments. A very appealing explanation for this behavior is the idea of a particle, localized in some limited part of the wave-function. The present article challenges the concept of particle. It proves in base of a variant of the Tan, Walls and Collett experiment, that this concept leads to a situation in which the particle has to be simultaneously in two places distant from one another, situation that contradicts the very definition of a particle. Another argument is based on a modified version of the Afshar experiment, showing that the concept of particle is problematic. The concept of particle makes additional difficulties when the wave-function passes through fields. An unexpected possibility to solve these difficulties seems to arise from the cavity quantum electrodynamics studies done recently by S. Savasta and his collaborators. It involves virtual particles. One of these studies is briefly described here. Though, experimental results are expected, so that it is too soon to draw conclusions whether it speaks in favor, or against the concept of particle.


title: Unveiling the nuclear matter EoS from neutron star properties: a supervised machine learning approach

abstract: We explore supervised machine learning methods in extracting the non-linear maps between neutron stars (NS) observables and the equation of state (EoS) of nuclear matter. Using a Taylor expansion around saturation density, we have generated a set of model independent EoS describing stellar matter constrained by nuclear matter parameters that are thermodynamically consistent, causal, and consistent with astrophysical observations. From this set, the full non-linear dependencies of the NS tidal deformability and radius on the nuclear matter parameters were learned using two distinct machine learning methods. Due to the high accuracy of the learned non-linear maps, we were able to analyze the impact of each nuclear matter parameter on the NS observables, identify dependencies on the EoS properties beyond linear correlations and predict which stars allow us to draw strong constraints.


title: Systematic Asset Allocation using Flexible Views for South African Markets

abstract: We implement a systematic asset allocation model using the Historical Simulation with Flexible Probabilities (HS-FP) framework developed by Meucci. The HS-FP framework is a flexible non-parametric estimation approach that considers future asset class behavior to be conditional on time and market environments, and derives a forward looking distribution that is consistent with this view while remaining close as possible to the prior distribution. The framework derives the forward looking distribution by applying unequal time and state conditioned probabilities to historical observations of asset class returns. This is achieved using relative entropy to find estimates with the least distortion to the prior distribution. Here, we use the HS-FP framework on South African financial market data for asset allocation purposes; by estimating expected returns, correlations and volatilities that are better represented through the measured market cycle. We demonstrated a range of state variables that can be useful towards understanding market environments. Concretely, we compare the out-of-sample performance for a specific configuration of the HS-FP model relative to classic Mean Variance Optimization(MVO) and Equally Weighted (EW) benchmark models. The framework displays low probability of backtest overfitting and the out-of-sample net returns and Sharpe ratio point estimates of the HS-FP model outperforms the benchmark models. However, the results are inconsistent when training windows are varied, the Sharpe ratio is seen to be inflated, and the method does not demonstrate statistically significant out-performance on a gross and net basis.


title: Complexity of the universal theory of bounded residuated distributive lattice-ordered groupoids

abstract: We prove that the universal theory and the quasi-equational theory of bounded residuated distributive lattice-orderegroupoids are both EXPTIME-complete. Similar results areproven for bounded distributive lattices with a unary or binary operator and for some special classes of bounded residuated distributive lattice-ordered groupoids.


title: Hamming Distances in Vector Spaces over Finite Fields

abstract: Let $\mathbb{F}_q$ be the finite field of order $q$ and $E\subset \mathbb{F}_q^d$, where $4|d$. Using Fourier analytic techniques, we prove that if $|E|>\frac{q^{d-1}}{d}\binom{d}{d/2}\binom{d/2}{d/4}$, then the points of $E$ determine a Hamming distance $r$ for every even $r$.


title: Minimal Assumptions Refinement for GR(1) Specifications

abstract: Reactive synthesis is concerned with finding a correct-by-construction controller from formal specifications, typically expressed in Linear Temporal Logic (LTL). The specifications describe assumptions about an environment and guarantees to be achieved by the controller operating in that environment. If a controller exists, given the assumptions, the specification is said to be realizable. This paper focuses on finding a minimal set of assumptions that guarantee realizability in the context of counterstrategy-guided assumption refinement procedures. Specifically, we introduce the notion of minimal assumptions refinements and provide an algorithm that provably computes these with little time overhead. We show experimentally, using common benchmarks, that embedding our algorithm in state-of-the-art approaches for assumption refinement results in consistently shorter solutions than without such embedding, and allows to explore a higher number of candidate solutions. We also propose a hybrid variant for dealing with the higher sparsity of solutions in the space of minimal refinements and show that its application speeds up the identification of a solution.


title: A Meta-Analysis Of LHC Results

abstract: We report the preliminary results of a meta-analysis conducted to examine possible biases in the uncertainty values published in papers by ATLAS and CMS experiments. We have performed this analysis using two independent techniques; a vectoral analysis of the vector graphics files and a bitmap analysis of the raster graphic files of the exclusion plots from various physics searches. In both procedures, the aim is to compute the percentages of the data points scattered within 1-sigma and 2-sigma bands of the plots and verify whether the measured percentages agree with statistical norms assuming unbiased estimations of the uncertainties.


title: Green groupoids of 2-Calabi--Yau categories, derived Picard actions, and hyperplane arrangements

abstract: We present a construction of (faithful) group actions via derived equivalences in the general categorical setting of algebraic 2-Calabi--Yau triangulated categories. To each algebraic 2-Calabi--Yau category $\mathscr{C}$ satisfying standard mild assumptions, we associate a groupoid $\mathscr{G}_{ \mathscr{C} }$, named the green groupoid of $\mathscr{C}$, defined in an intrinsic homological way. Its objects are given by a set of representatives $\operatorname{mrig} \mathscr{C}$ of the equivalence classes of basic maximal rigid objects of $\mathscr{C}$, arrows are given by mutation, and relations are given by equating monotone (green) paths in the silting order. In this generality we construct a homomorphsim from the green groupoid $\mathscr{G}_{ \mathscr{C} }$ to the derived Picard groupoid of the collection of endomorphism rings of representatives of $\operatorname{mrig} \mathscr{C}$ in a Frobenius model of $\mathscr{C}$; the latter canonically acts by triangle equivalences between the derived categories of the rings. We prove that the constructed representation of the green groupoid $\mathscr{G}_{ \mathscr{C} }$ is faithful if the index chamber decompositions of the split Grothendieck groups of basic maximal rigid objects of $\mathscr{C}$ come from hyperplane arrangements. If $\Sigma^2 \cong \operatorname{id}$ and $\mathscr{C}$ has finitely many equivalence classes of basic maximal rigid objects, we prove that $\mathscr{G}_{ \mathscr{C} }$ is isomorphic to a Deligne groupoid of a hyperplane arrangement and that the representation of this groupoid is faithful.


title: Portfolio Cuts: A Graph-Theoretic Framework to Diversification

abstract: Investment returns naturally reside on irregular domains, however, standard multivariate portfolio optimization methods are agnostic to data structure. To this end, we investigate ways for domain knowledge to be conveniently incorporated into the analysis, by means of graphs. Next, to relax the assumption of the completeness of graph topology and to equip the graph model with practically relevant physical intuition, we introduce the portfolio cut paradigm. Such a graph-theoretic portfolio partitioning technique is shown to allow the investor to devise robust and tractable asset allocation schemes, by virtue of a rigorous graph framework for considering smaller, computationally feasible, and economically meaningful clusters of assets, based on graph cuts. In turn, this makes it possible to fully utilize the asset returns covariance matrix for constructing the portfolio, even without the requirement for its inversion. The advantages of the proposed framework over traditional methods are demonstrated through numerical simulations based on real-world price data.


title: Drop to Adapt: Learning Discriminative Features for Unsupervised Domain Adaptation

abstract: Recent works on domain adaptation exploit adversarial training to obtain domain-invariant feature representations from the joint learning of feature extractor and domain discriminator networks. However, domain adversarial methods render suboptimal performances since they attempt to match the distributions among the domains without considering the task at hand. We propose Drop to Adapt (DTA), which leverages adversarial dropout to learn strongly discriminative features by enforcing the cluster assumption. Accordingly, we design objective functions to support robust domain adaptation. We demonstrate efficacy of the proposed method on various experiments and achieve consistent improvements in both image classification and semantic segmentation tasks. Our source code is available at https://github.com/postBG/DTA.pytorch.


title: On the expected behaviour of noise regularised deep neural networks as Gaussian processes

abstract: Recent work has established the equivalence between deep neural networks and Gaussian processes (GPs), resulting in so-called neural network Gaussian processes (NNGPs). The behaviour of these models depends on the initialisation of the corresponding network. In this work, we consider the impact of noise regularisation (e.g. dropout) on NNGPs, and relate their behaviour to signal propagation theory in noise regularised deep neural networks. For ReLU activations, we find that the best performing NNGPs have kernel parameters that correspond to a recently proposed initialisation scheme for noise regularised ReLU networks. In addition, we show how the noise influences the covariance matrix of the NNGP, producing a stronger prior towards simple functions away from the training points. We verify our theoretical findings with experiments on MNIST and CIFAR-10 as well as on synthetic data.


title: What's My Process Model Composed of? A Systematic Literature Review of Meta-Models in BPM

abstract: Business process modelling languages typically enable the representation of business process models by employing (graphical) symbols. These symbols can vary depending upon the verbosity of the language, the modeling paradigm, the focus of the language, and so on. To make explicit the different constructs and rules employed by a specific language as well as bridge the gap across different languages, meta-models have been proposed in literature. These meta-models are a crucial source of knowledge on what state-of-the-art literature considers relevant to describe business processes. Moreover, the rapid growth of techniques and tools that aim at supporting all dimensions of business processes and not only its control flow perspective, as for instance data and organisational aspects, makes even more important to have a clear idea, already at the conceptual level, of the key process constructs. The goal of this work is to provide the first extensive systematic literature review (SLR) of business process meta-models. This SLR aims at answering research questions concerning: (i) the kind of meta-models proposed in literature; (ii) the recurring constructs they contain; (iii) their purposes; and (iv) their evaluations. Thirty-six papers were selected and evaluated against four research questions. The results indicate the existence of a reasonable body of work conducted in this specific area, but not a full maturity. In particular, while traditional paradigms towards business process modelling, and aspects related to the business process control flow seem to be well present, novel paradigms and aspects related to the organisational, data and goal-oriented aspects of business processes seem to be still under-investigated.


title: Neighborhood Growth Determines Geometric Priors for Relational Representation Learning

abstract: The problem of identifying geometric structure in heterogeneous, high-dimensional data is a cornerstone of representation learning. While there exists a large body of literature on the embeddability of canonical graphs, such as lattices or trees, the heterogeneity of the relational data typically encountered in practice limits the applicability of these classical methods. In this paper, we propose a combinatorial approach to evaluating embeddability, i.e., to decide whether a data set is best represented in Euclidean, Hyperbolic or Spherical space. Our method analyzes nearest-neighbor structures and local neighborhood growth rates to identify the geometric priors of suitable embedding spaces. For canonical graphs, the algorithm's prediction provably matches classical results. As for large, heterogeneous graphs, we introduce an efficiently computable statistic that approximates the algorithm's decision rule. We validate our method over a range of benchmark data sets and compare with recently published optimization-based embeddability methods.


title: Filtering theory for a weakly coloured noise process

abstract: The problem of analyzing the Ito stochastic differential system and its filtering has received attention. The classical approach to accomplish filtering for the Ito SDE is the Kushner equation. In contrast to the classical filtering approach, this paper presents filtering for the stochastic differential system affected by weakly coloured noise. As a special case, the process can be regarded as the Ornstein-Uhlenbeck (OU) process. The theory of this paper is based on a pioneering contribution of Stratonovich involving the perturbation-theoretic approach to noisy dynamical systems in combination with the notion of the filtering density evolution. Making the use of the filtering density evolution equation, the stochastic evolution of condition moment is derived. A scalar Duffing system driven by the OU process is employed to test the effectiveness of the filtering theory of the paper. Numerical simulations involving four different sets of initial conditions and system parameters are utilized to examine the efficacy of the filtering algorithm of this paper.


title: Optimization of One-parameter Family of Integration Formulae for Solving Stiff Chemical-kinetic ODEs

abstract: A fast and robust Jacobian-free time-integration method - called Minimum-error Adaptation of a Chemical-Kinetic ODE Solver (MACKS) - for solving stiff ODEs pertaining to chemical-kinetics is proposed herein. The MACKS formulation is based on optimization of the one-parameter family of integration formulae coupled with a dual time-stepping method to facilitate error minimization. The proposed method demonstrates higher accuracy compared to the method - Extended Robustness-enhanced numerical algorithm (ERENA) - previously proposed by the authors. Additionally, when this method is employed in homogeneous-ignition simulations, it facilitates realization of faster performance compared to the Variable-coefficient ODE solver (VODE).

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Model-based process design of a ternary protein separation using multi-step gradient ion-exchange SMB chromatography

abstract: Model-based process design of ion-exchange simulated moving bed (IEX-SMB) chromatography for center-cut separation of proteins is studied. Use of nonlinear binding models that describe more accurate adsorption behaviours of macro-molecules could make it impossible to utilize triangle theory to obtain operating parameters. Moreover, triangle theory provides no rules to design salt profiles in IEX-SMB. In the modelling study here, proteins (i.e., ribonuclease, cytochrome and lysozyme) on the chromatographic columns packed with strong cation-exchanger SP Sepharose FF is used as an example system. The general rate model with steric mass-action kinetics was used; two closed-loop IEX-SMB network schemes were investigated (i.e., cascade and eight-zone schemes). Performance of the IEX-SMB schemes was examined with respect to multi-objective indicators (i.e., purity and yield) and productivity, and compared to a single column batch system with the same amount of resin utilized. A multi-objective sampling algorithm, Markov Chain Monte Carlo (MCMC), was used to generate samples for constructing the Pareto optimal fronts. MCMC serves on the sampling purpose, which is interested in sampling the Pareto optimal points as well as those near Pareto optimal. Pareto fronts of the three schemes provide the full information of trade-off between the conflicting indicators of purity and yield. The results indicate the cascade IEX-SMB scheme and the integrated eight-zone IEX-SMB scheme have the similar performance that both outperforms the single column batch system.


title: Residual Encoder-Decoder Network for Deep Subspace Clustering

abstract: Subspace clustering aims to cluster unlabeled data that lies in a union of low-dimensional linear subspaces. Deep subspace clustering approaches based on auto-encoders have become very popular to solve subspace clustering problems. However, the training of current deep methods converges slowly, which is much less efficient than traditional approaches. We propose a Residual Encoder-Decoder network for deep Subspace Clustering (RED-SC), which symmetrically links convolutional and deconvolutional layers with skip-layer connections, with which the training converges much faster. We use a self-expressive layer to generate more accurate linear representation coefficients through different latent representations from multiple latent spaces. Experiments show the superiority of RED-SC in training efficiency and clustering accuracy. Moreover, we are the first one to apply residual encoder-decoder on unsupervised learning tasks.


title: Variational Auto-encoder Based Bayesian Poisson Tensor Factorization for Sparse and Imbalanced Count Data

abstract: Non-negative tensor factorization models enable predictive analysis on count data. Among them, Bayesian Poisson-Gamma models can derive full posterior distributions of latent factors and are less sensitive to sparse count data. However, current inference methods for these Bayesian models adopt restricted update rules for the posterior parameters. They also fail to share the update information to better cope with the data sparsity. Moreover, these models are not endowed with a component that handles the imbalance in count data values. In this paper, we propose a novel variational auto-encoder framework called VAE-BPTF which addresses the above issues. It uses multi-layer perceptron networks to encode and share complex update information. The encoded information is then reweighted per data instance to penalize common data values before aggregated to compute the posterior parameters for the latent factors. Under synthetic data evaluation, VAE-BPTF tended to recover the right number of latent factors and posterior parameter values. It also outperformed current models in both reconstruction errors and latent factor (semantic) coherence across five real-world datasets. Furthermore, the latent factors inferred by VAE-BPTF are perceived to be meaningful and coherent under a qualitative analysis.


title: Geomancer: An Open-Source Framework for Geospatial Feature Engineering

abstract: This paper presents Geomancer, an open-source framework for geospatial feature engineering. It simplifies the acquisition of geospatial attributes for downstream, large-scale machine learning tasks. Geomancer leverages any geospatial dataset stored in a data warehouse, users need only to define the features (Spells) they want to create, and cast them on any spatial dataset. In addition, these features can be exported into a JSON file (SpellBook) for sharing and reproducibility. Geomancer has been useful to some of our production use-cases such as property value estimation, area valuation, and more. It is available on Github, and can be installed from PyPI.


title: On the equivalence of authentication codes and robust (2,2)-threshold schemes

abstract: In this paper, we show a "direct" equivalence between certain authentication codes and robust secret sharing schemes. It was previously known that authentication codes and robust secret sharing schemes are closely related to similar types of designs, but direct equivalences had not been considered in the literature. Our new equivalences motivate the consideration of a certain "key-substitution attack." We study this attack and analyze it in the setting of "dual authentication codes." We also show how this viewpoint provides a nice way to prove properties and generalizations of some known constructions.


title: The magnetic properties of the protostellar core IRAS 15398-3359

abstract: Context. Magnetic fields can affect significantly the star formation process. The theory of the magnetically-driven collapse in a uniform field predicts that initially the contraction happens along the field lines. When the gravitational pull grows strong enough, the magnetic field lines pinch inwards, giving rise to a characteristic hourglass shape. Aims. We investigate the magnetic field structure of a young Class 0 object, IRAS 15398-3359, embedded in the Lupus I cloud. Previous observations at large scales suggest that this source evolved in an highly magnetised environment. This object thus appears an ideal candidate to study the magnetically driven core collapse in the low-mass regime. Methods. We have performed polarisation observations of IRAS 15398-3359 at 214$\mu$m using the SOFIA/HAWC+ instrument, thus tracing the linearly polarised thermal emission of cold dust. Results. Our data unveil a significant bend of the magnetic field lines due to the gravitational pull. The magnetic field appears ordered and aligned with the large-scale B-field of the cloud and with the outflow direction. We estimate a magnetic field strength of $B= 78 \mu$G, expected to be accurate within a factor of two. The measured mass-to-flux parameter is $\lambda= 0.95$, indicating that the core is in a transcritical regime.


title: Representation stability, secondary stability, and polynomial functors

abstract: We prove a general representation stability result for polynomial coefficient systems which lets us prove representation stability and secondary homological stability for many families of groups with polynomial coefficients. This gives two generalizations of classical homological stability theorems with twisted coefficients. We apply our results to prove homological stability for hyperelliptic mapping class groups with twisted coefficients, prove new representation stability results for congruence subgroups, establish secondary homological stability for groups of diffeomorphisms of surfaces viewed as discrete groups, and improve the known stable range for homological stability for general linear groups of the sphere spectrum.


title: Flexible distribution-free conditional predictive bands using density estimators

abstract: Conformal methods create prediction bands that control average coverage under no assumptions besides i.i.d. data. Besides average coverage, one might also desire to control conditional coverage, that is, coverage for every new testing point. However, without strong assumptions, conditional coverage is unachievable. Given this limitation, the literature has focused on methods with asymptotical conditional coverage. In order to obtain this property, these methods require strong conditions on the dependence between the target variable and the features. We introduce two conformal methods based on conditional density estimators that do not depend on this type of assumption to obtain asymptotic conditional coverage: Dist-split and CD-split. While Dist-split asymptotically obtains optimal intervals, which are easier to interpret than general regions, CD-split obtains optimal size regions, which are smaller than intervals. CD-split also obtains local coverage by creating a data-driven partition of the feature space that scales to high-dimensional settings and by generating prediction bands locally on the partition elements. In a wide variety of simulated scenarios, our methods have a better control of conditional coverage and have smaller length than previously proposed methods.


title: Efficient and Secure Substitution Box and Random Number Generators Over Mordell Elliptic Curves

abstract: Elliptic curve cryptography has received great attention in recent years due to its high resistance against modern cryptanalysis. The aim of this article is to present efficient generators to generate substitution boxes (S-boxes) and pseudo random numbers which are essential for many well-known cryptosystems. These generators are based on a special class of ordered Mordell elliptic curves. Rigorous analyses are performed to test the security strength of the proposed generators. For a given prime, the experimental results reveal that the proposed generators are capable of generating a large number of distinct, mutually uncorrelated, cryptographically strong S-boxes and sequences of random numbers in low time and space complexity. Furthermore, it is evident from the comparison that the proposed schemes can efficiently generate secure S-boxes and random numbers as compared to some of the well-known existing schemes over different mathematical structures.


title: Context-Gated Convolution

abstract: As the basic building block of Convolutional Neural Networks (CNNs), the convolutional layer is designed to extract local patterns and lacks the ability to model global context in its nature. Many efforts have been recently devoted to complementing CNNs with the global modeling ability, especially by a family of works on global feature interaction. In these works, the global context information is incorporated into local features before they are fed into convolutional layers. However, research on neuroscience reveals that the neurons' ability of modifying their functions dynamically according to context is essential for the perceptual tasks, which has been overlooked in most of CNNs. Motivated by this, we propose one novel Context-Gated Convolution (CGC) to explicitly modify the weights of convolutional layers adaptively under the guidance of global context. As such, being aware of the global context, the modulated convolution kernel of our proposed CGC can better extract representative local patterns and compose discriminative features. Moreover, our proposed CGC is lightweight and applicable with modern CNN architectures, and consistently improves the performance of CNNs according to extensive experiments on image classification, action recognition, and machine translation. Our code of this paper is available at https://github.com/XudongLinthu/context-gated-convolution.


title: Optimizing Information Freshness in Computing enabled IoT Networks

abstract: Internet of Things (IoT) has emerged as one of the key features of the next generation wireless networks, where timely delivery of status update packets is essential for many real-time IoT applications. To provide users with context-aware services and lighten the transmission burden, the raw data usually needs to be preprocessed before being transmitted to the destination. However, the effect of computing on the overall information freshness is not well understood. In this work, we first develop an analytical framework to investigate the information freshness, in terms of peak age of information (PAoI), of a computing enabled IoT system with multiple sensors. Specifically, we model the procedure of computing and transmission as a tandem queue, and derive the analytical expressions of the average PAoI for different sensors. Based on the theoretical results, we formulate a min-max optimization problem to minimize the maximum average PAoI of different sensors. We further design a derivative-free algorithm to find the optimal updating frequency, with which the complexity for checking the convexity of the formulated problem or obtaining the derivatives of the object function can be largely reduced. The accuracy of our analysis and effectiveness of the proposed algorithm are verified with extensive simulation results.


title: Large-time Behavior of Magnetohydrodynamics with Temperature-Dependent Heat-Conductivity

abstract: We study the large-time behavior of strong solutions to the equations of a planar magnetohydrodynamic compressible flow with the heat conductivity proportional to a nonnegative power of the temperature. Both the specific volume and the temperature are proved to be bounded from below and above independently of time. Moreover, it is shown that the global strong solution is nonlinearly exponentially stable as time tends to infinity. Our result can be regarded as a natural generalization of the previous ones for the compressible Navier-Stokes system to MHD system with either constant heat-conductivity or nonlinear and temperature-dependent heat-conductivity.


title: Formation mechanism of correspondence imaging with thermal light

abstract: Correspondence imaging can achieve positive-negative ghost images by just conditional averaging of partial patterns, without treating bucket intensities as weights. To explain its imaging mechanism, we develop a probability theory assuming the targets are of gray-scale and the thermal reference speckles obey an arbitrary independent and identical distribution. By both simulation and experiments, we find that the recovered values in each region of the same original gray value conditionally obey a Gaussian distribution. A crosspoint-to-standard-deviation ratio is used as the figure of merit to prove that the patterns with respect to larger bucket values generate a positive image with a higher quality, vice versa for negative one. This work complements the theory of ghost imaging.


title: Functorial differential spaces and the infinitesimal structure of space-time

abstract: We generalize the differential space concept as a tool for developing differential geometry, and enrich this geometry with infinitesimals that allow us to penetrate into the superfine structure of space. This is achieved by Yoneda embedding a ring of smooth functions into the category of loci. This permits us to define a category of functorial differential spaces. By suitably choosing various algebras as "stages" in this category, one obtains various classes of differential spaces, both known from the literature and many so far unknown. In particular, if one chooses a Weil algebra, infinitesimals are produced. We study the case with some Weil algebra which allows us to fully develop the corresponding differential geometry with infinitesimals. To test the behavior of infinitesimals, we construct a simplified RWFL cosmological model. As it should be expected, infinitesimals remain latent during the entire macroscopic evolution (regarded backwards in time), and come into play only when the universe attains infinitesimal dimensions. Then they penetrate into the structure of the initial singularity.


title: Ellipticity and Fredholmness of pseudo-differential operators on $\ell^2(\Zn)$

abstract: The minimal operator and the maximal operator of an elliptic pseudo-differential operator with symbols on $\Z^n\times \mathbb{T}^n$ are proved to coincide and the domain is given in terms of a Sobolev space. Ellipticity and Fredholmness are proved to be equivalent for pseudo-differential operators on $\Z^n$. The index of an elliptic pseudo-differential operator on $\Z^n$ is also computed.


title: Efficiency in managing peer-review of scientific manuscripts -- editors' perspective

abstract: The purpose of this paper is to introduce a model for measuring the efficiency in managing peer-review of scientific manuscripts by editors. The approach employed is based on the assumption that the editorial aim is to manage publication with high efficiency, employing the least amount of editorial resources. Efficiency is defined in this research as a measure based on 7 variables. An on-line survey was constructed and editors of journals originating from Serbia regularly publishing articles in the field of chemistry were invited to participate. An evaluation of the model is given based on responses from 24 journals and 50 editors. With this investigation we aimed to contribute to our understanding of the peer-review process and, possibly, offer a tool to improve the "efficiency" in journal editing. The proposed protocol may be adapted by other journals in order to assess the managing potential of editors.


title: A convergent numerical method to recover the initial condition of nonlinear parabolic equations from lateral Cauchy data

abstract: We propose a new numerical method for the solution of the problem of the reconstruction of the initial condition of a quasilinear parabolic equation from the measurements of both Dirichlet and Neumann data on the boundary of a bounded domain. Although this problem is highly nonlinear, we do not require an initial guess of the true solution. The key in our method is the derivation of a boundary value problem for a system of coupled quasilinear elliptic equations whose solution is the vector function of the spatially dependent Fourier coefficients of the solution to the governing parabolic equation. We solve this problem by an iterative method. The global convergence of the system is rigorously established using a Carleman estimate. Numerical examples are presented.


title: Adaptive Mesh Refinement for Topology Optimization with Discrete Geometric Components

abstract: This work introduces an Adaptive Mesh Refinement (AMR) strategy for the topology optimization of structures made of discrete geometric components using the geometry projection method. Practical structures made of geometric shapes such as bars and plates typically exhibit low volume fractions with respect to the volume of the design region they occupy. To maintain an accurate analysis and to ensure well-defined sensitivities in the geometry projection, it is required that the element size is smaller than the smallest dimension of each component. For low-volume-fraction structures, this leads to finite element meshes with very large numbers of elements. To improve the efficiency of the analysis and optimization, we propose a strategy to adaptively refine the mesh and reduce the number of elements by having a finer mesh on the geometric components, and a coarser mesh away from them. The refinement indicator stems very naturally from the geometry projection and is thus straightforward to implement. We demonstrate the effectiveness of the proposed AMR method by performing topology optimization for the design of minimum-compliance and stress-constrained structures made of bars and plates.


title: Dual Hoffman Bounds for the Stability and Chromatic Numbers Based on SDP

abstract: The notion of duality is a key element in understanding the interplay between the stability and chromatic numbers of a graph. This notion is a central aspect in the celebrated theory of perfect graphs, and is further and deeply developed in the context of the Lov\'asz theta function and its equivalent characterizations and variants. The main achievement of this paper is the introduction of a new family of norms, providing upper bounds for the stability number, that are obtained from duality from the norms motivated by Hoffman's lower bound for the chromatic number and which achieve the (complementary) Lov\'asz theta function at their optimum. As a consequence, our norms make it formal that Hoffman's bound for the chromatic number and the Delsarte-Hoffman ratio bound for the stability number are indeed dual. Further, we show that our new bounds strengthen the convex quadratic bounds for the stability number studied by Luz and Schrijver, and which achieve the Lov\'asz theta function at their optimum. One of the key observations regarding weighted versions of these bounds is that, for any upper bound for the stability number of a graph which is a positive definite monotone gauge function, its gauge dual is a lower bound on the fractional chromatic number, and conversely. Our presentation is elementary and accessible to a wide audience.


title: How to Not Measure Disentanglement

abstract: To evaluate disentangled representations several metrics have been proposed. However, theoretical guarantees for conventional metrics of disentanglement are missing. Moreover, conventional metrics do not have a consistent correlation with the outcomes of qualitative studies. In this paper we analyze metrics of disentanglement and their properties. We conclude that existing metrics of disentanglement were created to reflect different characteristics of disentanglement and do not satisfy two basic desirable properties: (1) assign a high score to representations that are disentangled according to the definition; and (2) assign a low score to representations that are entangled according to the definition. In addition, we propose a new metric of disentanglement and prove that it satisfies both of the properties.


title: Numerical algorithm for the model describing anomalous diffusion in expanding media

abstract: We provide a numerical algorithm for the model characterizing anomalous diffusion in expanding media, which is derived in [F. Le Vot, E. Abad, and S. B. Yuste, Phys. Rev. E {\bf96} (2017) 032117]. The Sobolev regularity for the equation is first established. Then we use the finite element method to discretize the Laplace operator and present error estimate of the spatial semi-discrete scheme based on the regularity of the solution; the backward Euler convolution quadrature is developed to approximate Riemann-Liouville fractional derivative and error estimates for the fully discrete scheme are established by using the continuity of solution. Finally, the numerical experiments verify the effectiveness of the algorithm.


title: Improved (In-)Approximability Bounds for d-Scattered Set

abstract: In the $d$-Scattered Set problem we are asked to select at least $k$ vertices of a given graph, so that the distance between any pair is at least $d$. We study the problem's (in-)approximability and offer improvements and extensions of known results for Independent Set, of which the problem is a generalization. Specifically, we show: - A lower bound of $\Delta^{\lfloor d/2\rfloor-\epsilon}$ on the approximation ratio of any polynomial-time algorithm for graphs of maximum degree $\Delta$ and an improved upper bound of $O(\Delta^{\lfloor d/2\rfloor})$ on the approximation ratio of any greedy scheme for this problem. - A polynomial-time $2\sqrt{n}$-approximation for bipartite graphs and even values of $d$, that matches the known lower bound by considering the only remaining case. - A lower bound on the complexity of any $\rho$-approximation algorithm of (roughly) $2^{\frac{n^{1-\epsilon}}{\rho d}}$ for even $d$ and $2^{\frac{n^{1-\epsilon}}{\rho(d+\rho)}}$ for odd $d$ (under the randomized ETH), complemented by $\rho$-approximation algorithms of running times that (almost) match these bounds.


title: Sobolev regularity of polar fractional maximal functions

abstract: We study the Sobolev regularity on the sphere $\mathbb{S}^d$ of the uncentered fractional Hardy-Littlewood maximal operator $\widetilde{\mathcal{M}}_{\beta}$ at the endpoint $p=1$, when acting on polar data. We first prove that if $q=\frac{d}{d-\beta}$, $0<\beta<d$ and $f$ is a polar $W^{1,1}(\mathbb{S}^d)$ function, we have $$\|\nabla \widetilde{\mathcal{M}}_{\beta}f\|_q\lesssim_{d,\beta}\|\nabla f\|_1.$$ We then prove that the map $$f\mapsto \big | \nabla \widetilde{\mathcal{M}}_{\beta}f \big |$$ is continuous from $W^{1,1}(\mathbb{S}^d)$ to $L^q(\mathbb{S}^d)$ when restricted to polar data. Our methods allow us to give a new proof of the continuity of the map $f\mapsto |\nabla \widetilde{M}_{\beta}f|$ from $W^{1,1}_{\text{rad}}(\mathbb{R}^d)$ to $L^q(\mathbb{R}^d)$. Moreover, we prove that a conjectural local boundedness for the centered fractional Hardy-Littlewood maximal operator $M_{\beta}$ implies the continuity of the map $f\mapsto |\nabla M_{\beta}f|$ from $W^{1,1}$ to $L^q$, in the context of polar functions on $\mathbb{S}^d$ and radial functions on $\mathbb{R}^d$.


title: Measuring Unfairness through Game-Theoretic Interpretability

abstract: One often finds in the literature connections between measures of fairness and measures of feature importance employed to interpret trained classifiers. However, there seems to be no study that compares fairness measures and feature importance measures. In this paper we propose ways to evaluate and compare such measures. We focus in particular on SHAP, a game-theoretic measure of feature importance; we present results for a number of unfairness-prone datasets.


title: McLeish Distribution: Performance of Digital Communications over Additive White McLeish Noise (AWMN) Channels

abstract: The objective of this article is to propose and statistically validate a more general additive non-Gaussian noise distribution, which we term McLeish distribution, whose random nature can model different impulsive noise environments commonly encountered in practice and provides a robust alternative to Gaussian noise distribution. In particular, for the first time in the literature, we establish the laws of McLeish distribution and therefrom derive the laws of the sum of McLeish distributions by obtaining closed-form expressions for their PDF, CDF, complementary CDF (C$^2$DF), MGF and higher-order moments. Further, for certain problems related to the envelope of complex random signals, we extend McLeish distribution to complex McLeish distribution and thereby propose circularly/elliptically symmetric (CS/ES) complex McLeish distributions with closed-form PDF, CDF, MGF and higher-order moments. For generalization of one-dimensional distribution to multi-dimensional distribution, we develop and propose both multivariate McLeish distribution and multivariate complex CS/ES (CCS/CES) McLeish distribution with analytically tractable and closed-form PDF, CDF, C$^2$DF and MGF. In addition to the proposed McLeish distribution framework and for its practical illustration, we theoretically investigate and prove the existence of McLeish distribution as additive noise in communication systems. Accordingly, we introduce additive white McLeish noise (AWMN) channels. For coherent/non-coherent signaling over AWMN channels, we propose novel expressions for MAP and ML symbol decisions and thereby obtain closed-form expressions for both BER of binary modulation schemes and SER of various M-ary modulation schemes. Further, we verify the validity and accuracy of our novel BER/SER expressions with some selected numerical examples and some computer-based simulations.


title: Fano Schemes of Complete Intersections in Toric Varieties

abstract: We study Fano schemes $F_k(X)$ for complete intersections $X$ in a projective toric variety $Y\subset \mathbb{P}^n$. Our strategy is to decompose $F_k(X)$ into closed subschemes based on the irreducible decomposition of $F_k(Y)$ as studied by Ilten and Zotine. We define the expected dimension for these subschemes, which always gives a lower bound on the actual dimension. Under additional assumptions, we show that these subschemes are non-empty and smooth of the expected dimension. Using tools from intersection theory, we can apply these results to count the number of linear subspaces in $X$ when the expected dimension of $F_k(X)$ is zero.


title: Open-plan Glare Evaluator (OGE): A Demonstration of a New Glare Prediction Approach Using Machine Learning Algorithms

abstract: Predicting discomfort glare in open-plan offices is a challenging problem. Although glare research has existed for more than 50 years, all current glare metrics have accuracy limitations, especially in open-plan offices with low lighting levels. Thus, it is crucial to develop a new method to predict glare more accurately. This paper is the first to adopt Machine Learning (ML) approaches in the prediction of glare. This research aims to demonstrate the validity of this approach by comparing the accuracy of the new ML model for open-plan offices (OGE) to the accuracy of the existing glare metrics using local dataset. To utilize and test this approach, Post-Occupancy Evaluation (POE) and High Dynamic Range (HDR) images were collected from 80 occupants (n=80) in four different open-plan offices in Brisbane, Australia. Consequently, various multi-region luminance values, luminance, and glare indices were calculated and examined as input features to train ML models. The accuracy of the ML model was compared to the accuracy of 24 indices which were also evaluated using a Receiver Operating Characteristic (ROC) analysis to identify the best cutoff values (thresholds) for each index in open-plan configurations. Results showed that the ML approach could predict glare with an accuracy of 83.8% (0.80 true positive rate and 0.86 true negative rate), which outperformed the accuracy of the previously developed glare metrics. OGE is applicable for open-plan office situations with low vertical illuminance (200 to 600 lux). However, ML models can be trained with more substantial datasets to achieve global model.


title: Facial Expression Recognition Using Human to Animated-Character Expression Translation

abstract: Facial expression recognition is a challenging task due to two major problems: the presence of inter-subject variations in facial expression recognition dataset and impure expressions posed by human subjects. In this paper we present a novel Human-to-Animation conditional Generative Adversarial Network (HA-GAN) to overcome these two problems by using many (human faces) to one (animated face) mapping. Specifically, for any given input human expression image, our HA-GAN transfers the expression information from the input image to a fixed animated identity. Stylized animated characters from the Facial Expression Research Group-Database (FERGDB) are used for the generation of fixed identity. By learning this many-to-one identity mapping function using our proposed HA-GAN, the effect of inter-subject variations can be reduced in Facial Expression Recognition(FER). We also argue that the expressions in the generated animated images are pure expressions and since FER is performed on these generated images, the performance of facial expression recognition is improved. Our initial experimental results on the state-of-the-art datasets show that facial expression recognition carried out on the generated animated images using our HA-GAN framework outperforms the baseline deep neural network and produces comparable or even better results than the state-of-the-art methods for facial expression recognition.


title: Networks of monetary flow at native resolution

abstract: People and companies move money with every financial transaction they make. We aim to understand how such activity gives rise to large-scale patterns of monetary flow. In this work, we trace the movement of e-money through the accounts of a mobile money system using the provider's own transaction records. The resulting transaction sequences---balance-respecting trajectories---are data objects that represent observed monetary flows. Common sequential motifs correspond to known use-cases of mobile money: digital payments, digital transfers, and money storage. We find that each activity creates a distinct network structure within the system, and we uncover coordinated gaming of the mobile money provider's commission schedule. Moreover, we find that e-money passes through the system in anywhere from minutes to months. This pronounced heterogeneity, even within the same use-case, can inform the modeling of turnover in money supply. Our methodology relates economic activity at the transaction level to large-scale patterns of monetary flow, broadening the scope of empirical study about the network and temporal structure of the economy.


title: Unsupervised Adversarial Correction of Rigid MR Motion Artifacts

abstract: Motion is one of the main sources for artifacts in magnetic resonance (MR) images. It can have significant consequences on the diagnostic quality of the resultant scans. Previously, supervised adversarial approaches have been suggested for the correction of MR motion artifacts. However, these approaches suffer from the limitation of required paired co-registered datasets for training which are often hard or impossible to acquire. Building upon our previous work, we introduce a new adversarial framework with a new generator architecture and loss function for the unsupervised correction of severe rigid motion artifacts in the brain region. Quantitative and qualitative comparisons with other supervised and unsupervised translation approaches showcase the enhanced performance of the introduced framework.


title: SmokEng: Towards Fine-grained Classification of Tobacco-related Social Media Text

abstract: Contemporary datasets on tobacco consumption focus on one of two topics, either public health mentions and disease surveillance, or sentiment analysis on topical tobacco products and services. However, two primary considerations are not accounted for, the language of the demographic affected and a combination of the topics mentioned above in a fine-grained classification mechanism. In this paper, we create a dataset of 3144 tweets, which are selected based on the presence of colloquial slang related to smoking and analyze it based on the semantics of the tweet. Each class is created and annotated based on the content of the tweets such that further hierarchical methods can be easily applied. Further, we prove the efficacy of standard text classification methods on this dataset, by designing experiments which do both binary as well as multi-class classification. Our experiments tackle the identification of either a specific topic (such as tobacco product promotion), a general mention (cigarettes and related products) or a more fine-grained classification. This methodology paves the way for further analysis, such as understanding sentiment or style, which makes this dataset a vital contribution to both disease surveillance and tobacco use research.


title: Online monitoring for safe pedestrian-vehicle interactions

abstract: As autonomous systems begin to operate amongst humans, methods for safe interaction must be investigated. We consider an example of a small autonomous vehicle in a pedestrian zone that must safely maneuver around people in a free-form fashion. We investigate two key questions: How can we effectively integrate pedestrian intent estimation into our autonomous stack. Can we develop an online monitoring framework to give formal guarantees on the safety of such human-robot interactions. We present a pedestrian intent estimation framework that can accurately predict future pedestrian trajectories given multiple possible goal locations. We integrate this into a reachability-based online monitoring scheme that formally assesses the safety of these interactions with nearly real-time performance (approximately 0.3 seconds). These techniques are integrated on a test vehicle with a complete in-house autonomous stack, demonstrating effective and safe interaction in real-world experiments.


title: Partially Pooled Propensity Score Models for Average Treatment Effect Estimation with Multilevel Data

abstract: Causal inference analyses often use existing observational data, which in many cases has some clustering of individuals. In this paper we discuss propensity score weighting methods in a multilevel setting where within clusters individuals share unmeasured confounders that are related to treatment assignment and the potential outcomes. We focus in particular on settings where models with fixed cluster effects are either not feasible or not useful due to the presence of a large number of small clusters. We found, both through numerical experiments and theoretical derivations, that a strategy of grouping clusters with similar treatment prevalence and estimating propensity scores within such cluster groups is effective in reducing bias from unmeasured cluster-level covariates under mild conditions on the outcome model. We apply our proposed method in evaluating the effectiveness of center-based pre-school program participation on children's achievement at kindergarten, using the Early Childhood Longitudinal Study, Kindergarten data.


title: Base partition for mixed families of finitary and cofinitary matroids

abstract: Let ${\mathcal{M} = (M_i \colon i\in K)}$ be a finite or infinite family consisting of matroids on a common ground set $E$ each of which may be finitary or cofinitary. We prove the following Cantor-Bernstein-type result: If there is a collection of bases, one for each $M_i$, which covers the set $E$, and also a collection of bases which is pairwise disjoint, then there is a collection of bases which partitions $E$. We also show that the failure of this Cantor-Bernstein-type statement for arbitrary matroid families is consistent relative to the axioms of set theory ZFC.


title: Facial Emotion Recognition using Convolutional Neural Networks

abstract: Facial expression recognition is a topic of great interest in most fields from artificial intelligence and gaming to marketing and healthcare. The goal of this paper is to classify images of human faces into one of seven basic emotions. A number of different models were experimented with, including decision trees and neural networks before arriving at a final Convolutional Neural Network (CNN) model. CNNs work better for image recognition tasks since they are able to capture spacial features of the inputs due to their large number of filters. The proposed model consists of six convolutional layers, two max pooling layers and two fully connected layers. Upon tuning of the various hyperparameters, this model achieved a final accuracy of 0.60.


title: VAIS ASR: Building a conversational speech recognition system using language model combination

abstract: Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from situation where the speaking style is conversation and in noisy environments. It is not straight-forward to tackle such problems due to difficulties in data collection for both speech and text. In this paper, we attempt to mitigate the problems using language models combination techniques that allows us to utilize both large amount of writing style text and small number of conversation text data. Evaluation on the VLSP 2019 ASR challenges showed that our system achieved 4.85% WER on the VLSP 2018 and 15.09% WER on the VLSP 2019 data sets.


title: Stationary flows for compressible viscous fluid in a perturbed half-space

abstract: We consider the compressible Navier--Stokes equation in a perturbed half-space with an outflow boundary condition as well as the supersonic condition. For a half-space, it has been known that a certain planar stationary solution exist and it is time-asymptotically stable. The planar stationary solution is independent of the tangential directions and its velocities of the tangential directions are zero. In this paper, we show the unique existence of stationary solutions for the perturbed half-space. The feature of our work is that our stationary solution depends on all directions and has multidirectional flow. Furthermore, we also prove the asymptotic stability of this stationary solution.


title: Flavour and CP predictions from orbifold compactification

abstract: We propose a theory for fermion masses and mixings in which an $A_4$ family symmetry arises naturally from a six-dimensional spacetime after orbifold compactification. The flavour symmetry leads to the successful "golden" quark-lepton unification formula. The model reproduces oscillation parameters with good precision, giving sharp predictions for the CP violating phases of quarks and leptons, in particular $\delta^\ell \simeq +268 ^\circ$. The effective neutrinoless double-beta decay mass parameter is also sharply predicted as $\langle m_{\beta\beta}\rangle \simeq 2.65\ meV$.


title: A phase-field approach for modeling equilibrium solute segregation at the interphase boundary in binary alloys

abstract: A number of experimental and theoretical findings in age hardening alloys suggest that specific solute elements preferentially segregate to and reduce the energy of the interphase boundary (IB). This segregation mechanism can stabilize the precipitation microstructure against coarsening, allowing higher operating temperatures in structural applications. Herein, we present a phase field model of solute segregation to IBs that separate matrix and precipitate phases in binary alloys. The proposed modeling framework is capable of capturing bulk thermodynamics and interfacial free energies, while also accounting for various mass transport mechanisms. Analytical equilibrium solutions of one-dimensional systems are presented, and excess IB quantities are evaluated independent of the Gibbs dividing surface convention. With the aid of the parallel tangent construction, IB segregation isotherms are established in terms of the alloy composition and the model parameters describing the free energy functions. Under the regular solution approximation, computational studies elucidating the dependence of the IB energy and segregation levels on temperature and free energy model parameters are presented. We show that the model is consistent with the Gibbs adsorption equation; therefore, it is possible to compare the adsorption behavior predicted by the model parameters with experiments and atomistic simulations. Future work on extending the model to ternary alloys, and incorporating the effect of elastic interactions on IB segregation is expected.


title: HVDC Loss Factors in the Nordic Power Market

abstract: In the Nordic countries (Sweden, Norway, Finland and Denmark), many interconnectors are formed by long High-Voltage Direct-Current (HVDC) lines. Every year, the operation of such interconnectors costs millions of Euros to Transmission System Operators (TSOs) due to the high amount of losses that are not considered while clearing the market. To counteract this problem, Nordic TSOs (Svenska kraftn\"at - Sweden, Statnett - Norway, Fingrid - Finland, Energinet - Denmark) have proposed to introduce linear HVDC loss factors in the market clearing algorithm. The assessment of such a measure requires a detailed model of the system under investigation. In this paper we develop and introduce a detailed market model of the Nordic countries and we analyze the impact of different loss factor formulations. We show that linear loss factors penalize one HVDC line over the other, and this can jeopardize revenues of merchant HVDC lines. In this regard, we propose piecewise-linear loss factors: a simple to implement but highly effective solution. Moreover, we demonstrate how the introduction of only HVDC loss factors is a partial solution, since it disproportionately increases the AC losses. Our results show that the inclusion of AC loss factors can eliminate this problem.


title: VAIS Hate Speech Detection System: A Deep Learning based Approach for System Combination

abstract: Nowadays, Social network sites (SNSs) such as Facebook, Twitter are common places where people show their opinions, sentiments and share information with others. However, some people use SNSs to post abuse and harassment threats in order to prevent other SNSs users from expressing themselves as well as seeking different opinions. To deal with this problem, SNSs have to use a lot of resources including people to clean the aforementioned content. In this paper, we propose a supervised learning model based on the ensemble method to solve the problem of detecting hate content on SNSs in order to make conversations on SNSs more effective. Our proposed model got the first place for public dashboard with 0.730 F1 macro-score and the third place with 0.584 F1 macro-score for private dashboard at the sixth international workshop on Vietnamese Language and Speech Processing 2019.


title: Strongly-coupled aeroelastic free-vortex wake framework for floating offshore wind turbine rotors. Part 2: Application

abstract: This two-part paper presents the integration of the free-vortex wake method (FVM) with an aeroelastic framework suitable to model the rotor-wake interactions engendered by floating offshore wind turbine (FOWT) rotors in operation. Part 1 of this paper introduces the numerical development and validation of an aeroelastic framework. Due to a lack of experimental aeroelastic benchmarks for FOWTs, a series of validation studies are conducted against the rotor aerodynamic and structural performance of the National Renewable Energy Laboratory (NREL) 5-MW reference wind turbine. Part 2 of this paper focuses on the modeling and simulating different aeroelastic operational conditions of FOWTs. Numerical results of the current framework capture consistently the aerodynamic rotor performance, such as power, thrust, and torque of wave-induced pitching FOWTs. In addition, the presented aeroelastic framework yields additional information about the power, thrust, and torque fluctuations due to the out-of-phase blade passing frequency and corresponding blade deflections. The fidelity of the presented framework demonstrates, for the first time, an FVM-based aeroelastic method capable of carrying out investigations on rotor-wake interactions and relevant aeroelastic phenomena of FOWTs.


title: An Introduction to Particle Dark Matter

abstract: We review the features of Dark Matter as a particle, presenting some old and new instructive models, and looking for their physical implications in the early universe and in the process of structure formation. We also present a schematic of Dark Matter searches and introduce the most promising candidates to the role of Dark Matter particle.


title: Cross-Domain Image Classification through Neural-Style Transfer Data Augmentation

abstract: In particular, the lack of sufficient amounts of domain-specific data can reduce the accuracy of a classifier. In this paper, we explore the effects of style transfer-based data transformation on the accuracy of a convolutional neural network classifiers in the context of automobile detection under adverse winter weather conditions. The detection of automobiles under highly adverse weather conditions is a difficult task as such conditions present large amounts of noise in each image. The InceptionV2 architecture is trained on a composite dataset, consisting of either normal car image dataset , a mixture of normal and style transferred car images, or a mixture of normal car images and those taken at blizzard conditions, at a ratio of 80:20. All three classifiers are then tested on a dataset of car images taken at blizzard conditions and on vehicle-free snow landscape images. We evaluate and contrast the effectiveness of each classifier upon each dataset, and discuss the strengths and weaknesses of style-transfer based approaches to data augmentation.


title: Changing the speed of optical coherence in free space

abstract: It is typically assumed that the fluctuations associated with a stationary broadband incoherent field propagate in free space at the speed of light in vacuum c. Here we introduce the concept of 'coherence group velocity', which -- in analogy to the group velocity of coherent pulses -- is the speed of the peak of the coherence function. We confirm experimentally that incorporating a judicious spatio-temporal spectral structure into a field allows tuning its coherence group velocity in free space. Utilizing light from a super-luminescent diode, we interferometrically measure the group delay encountered by the cross-correlation of a structured field synthesized from this source with the unstructured diode field. By tracking the propagation of this cross-correlation function, we measure coherence group velocities in the range from 12c to -6c.


title: Recent Advances in Imaging Around Corners

abstract: Seeing around corners, also known as non-line-of-sight (NLOS) imaging is a computational method to resolve or recover objects hidden around corners. Recent advances in imaging around corners have gained significant interest. This paper reviews different types of existing NLOS imaging techniques and discusses the challenges that need to be addressed, especially for their applications outside of a constrained laboratory environment. Our goal is to introduce this topic to broader research communities as well as provide insights that would lead to further developments in this research area.


title: On Laplacian Monopoles

abstract: We consider the action of the (combinatorial) Laplacian of a finite and simple graph on integer vectors. By a \emph{Laplacian monopole} we mean an image vector negative at exactly one coordinate associated with a vertex. We consider a numerical semigroup $H_f(P)$ given by all monopoles at a vertex of a graph. The well-known analogy between finite graphs and algebraic curves (Riemann surfaces) has motivated much work. More specifically for us, the motivation arises out of the classical Weierstrass semigroup of a rational point on a curve whose properties are tied to the Riemann-Roch Theorem, as well as out of the graph theoretic Riemann-Roch Theorem demonstrated by Baker and Norine. We determine $H_f(P)$ for some families of graphs and demonstrate a connection between $H_f(P)$ and the vertex (also edge) connectivity of a graph. We also study $H_r(P)$, another numerical semigroup which arises out of the result of Baker and Norine, and explore its connection to $H_f(P)$ on graphs. We show that $H_r(P)\subseteq H_f(P)$ in a number of special cases. In contrast to the situation in the classical setting, we demonstrate that $H_f(P)\setminus H_r(P)$ can be arbitrarily large and identify a potential obstruction to the inclusion of $H_r(P)$ in $H_f(P)$ in general, though we still conjecture this inclusion. We conclude with a few open questions.


title: Real-time outlier detection for large datasets by RT-DetMCD

abstract: Modern industrial machines can generate gigabytes of data in seconds, frequently pushing the boundaries of available computing power. Together with the time criticality of industrial processing this presents a challenging problem for any data analytics procedure. We focus on the deterministic minimum covariance determinant method (DetMCD), which detects outliers by fitting a robust covariance matrix. We construct a much faster version of DetMCD by replacing its initial estimators by two new methods and incorporating update-based concentration steps. The computation time is reduced further by parallel computing, with a novel robust aggregation method to combine the results from the threads. The speed and accuracy of the proposed real-time DetMCD method (RT-DetMCD) are illustrated by simulation and a real industrial application to food sorting.


title: Free-space optical delay line using space-time wave packets

abstract: An optical buffer having a large delay-bandwidth-product -- a critical component for future all-optical communications networks -- remains elusive. Central to its realization is a controllable inline optical delay line, previously accomplished via engineered dispersion in optical materials or photonic structures constrained by a low delay-bandwidth product. Here we show that space-time wave packets whose group velocity in free space is continuously tunable provide a versatile platform for constructing inline optical delay lines. By spatio-temporal spectral-phase-modulation, wave packets in the same or in different spectral windows that initially overlap in space and time subsequently separate by multiple pulse widths upon free propagation by virtue of their different group velocities. Delay-bandwidth products of ~100 for pulses of width ~1 ps are observed, with no fundamental limit on the system bandwidth.


title: Tangent Categories from the Coalgebras of Differential Categories

abstract: Following the pattern from linear logic, the coKleisli category of a differential category is a Cartesian differential category. What then is the coEilenberg-Moore category of a differential category? The answer is a tangent category! A key example arises from the opposite of the category of Abelian groups with the free exponential modality. The coEilenberg-Moore category, in this case, is the opposite of the category of commutative rings. That the latter is a tangent category captures a fundamental aspect of both algebraic geometry and Synthetic Differential Geometry. The general result applies when there are no negatives and thus encompasses examples arising from combinatorics and computer science. This is an extended version of a conference paper for CSL2020.


title: Quasi-constant fundamental weights in terms of Levi Weyl groups

abstract: In joint work with J.-S. Koskivirta, we had previously introduced the notion of "quasi-constant" character (of a maximal torus of a connected reductive group over a field); we showed that over an algebraically closed field it naturally unifies the notions "minuscule" and "co-minuscule". In this note we describe a characterization of quasi-constant fundamental weights in terms of the Weyl group of a maximal Levi subgroup. Equivalently, purely in the language of root systems, the result characterizes special and co-special vertices of Dynkin diagrams in terms of Weyl groups of maximal sub-root systems.


title: Electron dynamics in strained graphene

abstract: The paper presents a theoretical description of the effects of strain induced by out-of-plane deformations on charge distributions and transport on graphene. A review of a continuum model for electrons using the Dirac formalism is complemented with elasticity theory to represent strain fields. The resulting model is cast in terms of scalar and pseudo-magnetic fields that control electron dynamics. Two distinct geometries, a bubble, and a fold are chosen to represent the most commonly observed deformations in experimental settings. It is shown that local charge accumulation regions appear in deformed areas, with a peculiar charge distribution that favors the occupation of one sublattice only. This unique phenomenon that allows distinguishing each carbon atom in the unit cell, is the manifestation of a sublattice symmetry broken phase. For specific parameters, resonant states appear in localized charged regions, as shown by the emergence of discrete levels in band structure calculations. These findings are presented in terms of intuitive pictures that exploit analogies with confinement produced by square barriers. In addition, electron currents through strained regions are spatially separated into their valley components, making possible the manipulation of electrons with different valley indices. The degree of valley filtering (or polarization) for a specific system can be controlled by properly designing the strained area. The comparison between efficiencies of filters built with this type of geometries identifies extended deformations as better valley filters. A proposal for their experimental implementations as a component of devices and a discussion for potential observation of novel physics in strained structures are presented at the end of the article.


title: A Recommendation for Net Undercount Estimation in Iran Population and Dwelling Censuses

abstract: Census counts are subject to different types of nonsampling errors. One of these main errors is coverage error. Undercount and overcount are two types of coverage error. Undercount usually occurs more than the other, thus net undercount estimation is important. There are various methods for estimating the coverage error in censuses. One of these methods is dual system (DS) that usually uses data from the census and a post-enumeration survey (PES). In this paper, the coverage error and necessity of its evaluation, PES design and DS method are explained. Then PES associated approaches and their effects on DS estimation are illustrated and these approaches are compared. Finally, we explain the Statistical Center of Iran method of estimating net undercount in Iran 2006 population and dwelling census and a suggestion will be given for improving net undercount estimation in population and dwelling censuses of Iran.


title: Decoding Working Memory Load from EEG with LSTM Networks

abstract: Working memory (WM) is a mechanism that temporarily stores and manipulates information in service of behavioral goals and is a highly dynamic process. Previous studies have considered decoding WM load using EEG but have not investigated the contribution of sequential information contained in the temporal patterns of the EEG data that can differentiate different WM loads. In our study, we develop a novel method of investigating the role of sequential information in the manipulation and storage of verbal information at various time scales and localize topographically the sources of the sequential information based decodability. High density EEG (128-channel) were recorded from twenty subjects performing a Sternberg verbal WM task with varying memory loads. Long Short-Term Memory Recurrent Neural Networks (LSTM-RNN) were trained to decode memory load during encoding, retention, activity-silent, and retrieval periods. Decoding accuracy was compared between ordered data and a temporally shuffled version that retains pattern based information of the data but not temporal relation to assess the contribution of sequential information to decoding memory load. The results show that (1) decoding accuracy increases with increase in the length of the EEG time series given to the LSTM for both ordered and temporally shuffled cases, with the increase being faster for ordered than temporally shuffled time series, and (2) according to the decoding weight maps, the frontal, temporal and some parietal areas are an important source of sequential information based decodability. This study, to our knowledge, is the first study applying a LSTM-RNN approach to investigate temporal dynamics in human EEG data in encoding WM load information.


title: 3x + 1 Problem. Syracuse Conjecture

abstract: In this paper; we prove that all sequences can be broken up in cycles. Each cycle follows the same pattern: 1) Upward trajectory. Odd and even numbers alternate until the cycle reaches an upper bound 2) Downward trajectory. Two or more consecutive even numbers follow until it reaches another odd number. At this point, it's the beginning of the following cycle. Any sequence is evidently made of many consecutive cycles. In order to prove the conjecture, we build two sequences. The first sequence starts from any odd number. The sequence unfolds one cycle after the another. After each cycle, we build a second sequence that is built following a parallel path to the previous one, but adapting the last cycle to ensure it converges down to 1. In other words, their cycles have the same pattern of upward and downward steps except for the very last cycle. Finally, we prove that both sequences must be the same. Since the latter sequence converges to 1, so must the former. This document is a revision of the previous rev.12. There are significant changes that were made in order to make it easier to follow. The foundations of the demonstration remain the same.