title: Learning distant cause and effect using only local and immediate credit assignment

abstract: We present a recurrent neural network memory that uses sparse coding to create a combinatoric encoding of sequential inputs. Using several examples, we show that the network can associate distant causes and effects in a discrete stochastic process, predict partially-observable higher-order sequences, and enable a DQN agent to navigate a maze by giving it memory. The network uses only biologically-plausible, local and immediate credit assignment. Memory requirements are typically one order of magnitude less than existing LSTM, GRU and autoregressive feed-forward sequence learning models. The most significant limitation of the memory is generalization to unseen input sequences. We explore this limitation by measuring next-word prediction perplexity on the Penn Treebank dataset.


title: A Review of Semi Supervised Learning Theories and Recent Advances

abstract: Semi-supervised learning, which has emerged from the beginning of this century, is a new type of learning method between traditional supervised learning and unsupervised learning. The main idea of semi-supervised learning is to introduce unlabeled samples into the model training process to avoid performance (or model) degeneration due to insufficiency of labeled samples. Semi-supervised learning has been applied successfully in many fields. This paper reviews the development process and main theories of semi-supervised learning, as well as its recent advances and importance in solving real-world problems demonstrated by typical application examples.


title: Beyond Exponentially Discounted Sum: Automatic Learning of Return Function

abstract: In reinforcement learning, Return, which is the weighted accumulated future rewards, and Value, which is the expected return, serve as the objective that guides the learning of the policy. In classic RL, return is defined as the exponentially discounted sum of future rewards. One key insight is that there could be many feasible ways to define the form of the return function (and thus the value), from which the same optimal policy can be derived, yet these different forms might render dramatically different speeds of learning this policy. In this paper, we research how to modify the form of the return function to enhance the learning towards the optimal policy. We propose to use a general mathematical form for return function, and employ meta-learning to learn the optimal return function in an end-to-end manner. We test our methods on a specially designed maze environment and several Atari games, and our experimental results clearly indicate the advantages of automatically learning optimal return functions in reinforcement learning.


title: Efficient Wrapper Feature Selection using Autoencoder and Model Based Elimination

abstract: We propose a computationally efficient wrapper feature selection method - called Autoencoder and Model Based Elimination of features using Relevance and Redundancy scores (AMBER) - that uses a single ranker model along with autoencoders to perform greedy backward elimination of features. The ranker model is used to prioritize the removal of features that are not critical to the classification task, while the autoencoders are used to prioritize the elimination of correlated features. We demonstrate the superior feature selection ability of AMBER on 4 well known datasets corresponding to different domain applications via comparing the classification accuracies with other computationally efficient state-of-the-art feature selection techniques. Interestingly, we find that the ranker model that is used for feature selection does not necessarily have to be the same as the final classifier that is trained on the selected features. Finally, we note how a smaller number of features can lead to higher accuracies on some datasets, and hypothesize that overfitting the ranker model on the training set facilitates the selection of more salient features.


title: Non-parametric reconstruction of dark energy and cosmic expansion from the Pantheon compilation of type Ia supernovae

abstract: The equation of state (EoS) of dark energy plays an important role in the evolution of the universe and arouses great interests in recent years. With the progress on observational technique, precise constraint on the EoS of dark energy becomes possible. In this paper, we reconstruct the EoS of dark energy and cosmic expansion using Gaussian processes (GP) from the most up-to-date Pantheon compilation of type Ia supernovae (SNe Ia), which consists of 1048 finely calibrated SNe Ia. The reconstructed EoS of dark energy has large uncertainty due to its dependence on the second order derivative of the construction. Adding the direct measurements of Hubble parameters $H(z)$ as an additional constraint on the first order derivative can partially reduce the uncertainty, but is still not precise enough to distinguish between evolving and constant dark energy. Besides, the results heavily rely on the prior of Hubble constant $H_0$. The $H_0$ value inferred from SNe+$H(z)$ without prior is $H_0=70.5\pm 0.5~{\textrm{km}~\textrm{s}^{-1}~\textrm{Mpc}^{-1}}$. Moreover, the matter density $\Omega_M$ has an unnegligible effect on the reconstruction of dark energy. Therefore, more accurate determinations on $H_0$ and $\Omega_M$ are needed to tightly constrain the EoS of dark energy.


title: Inference with Hybrid Bio-hardware Neural Networks

abstract: To understand the learning process in brains, biologically plausible algorithms have been explored by modeling the detailed neuron properties and dynamics. On the other hand, simplified multi-layer models of neural networks have shown great success on computational tasks such as image classification and speech recognition. However, the computational models that can achieve good accuracy for these learning applications are very different from the bio-plausible models. This paper studies whether a bio-plausible model of a in vitro living neural network can be used to perform machine learning tasks and achieve good inference accuracy. A novel two-layer bio-hardware hybrid neural network is proposed. The biological layer faithfully models variations of synapses, neurons, and network sparsity in in vitro living neural networks. The hardware layer is a computational fully-connected layer that tunes parameters to optimize for accuracy. Several techniques are proposed to improve the inference accuracy of the proposed hybrid neural network. For instance, an adaptive pre-processing technique helps the proposed neural network to achieve good learning accuracy for different living neural network sparsity. The proposed hybrid neural network with realistic neuron parameters and variations achieves a 98.3% testing accuracy for the handwritten digit recognition task on the full MNIST dataset.


title: Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification

abstract: Non-line-of-sight (NLOS) imaging of objects not visible to either the camera or illumination source is a challenging task with vital applications including surveillance and robotics. Recent NLOS reconstruction advances have been achieved using time-resolved measurements which requires expensive and specialized detectors and laser sources. In contrast, we propose a data-driven approach for NLOS 3D localization and object identification requiring only a conventional camera and projector. To generalize to complex line-of-sight (LOS) scenes with non-planar surfaces and occlusions, we introduce an adaptive lighting algorithm. This algorithm, based on radiosity, identifies and illuminates scene patches in the LOS which most contribute to the NLOS light paths, and can factor in system power constraints. We achieve an average identification of 87.1% object identification for four classes of objects, and average localization of the NLOS object's centroid with a mean-squared error (MSE) of 1.97 cm in the occluded region for real data taken from a hardware prototype. These results demonstrate the advantage of combining the physics of light transport with active illumination for data-driven NLOS imaging.


title: LambdaOpt: Learn to Regularize Recommender Models in Finer Levels

abstract: Recommendation models mainly deal with categorical variables, such as user/item ID and attributes. Besides the high-cardinality issue, the interactions among such categorical variables are usually long-tailed, with the head made up of highly frequent values and a long tail of rare ones. This phenomenon results in the data sparsity issue, making it essential to regularize the models to ensure generalization. The common practice is to employ grid search to manually tune regularization hyperparameters based on the validation data. However, it requires non-trivial efforts and large computation resources to search the whole candidate space; even so, it may not lead to the optimal choice, for which different parameters should have different regularization strengths. In this paper, we propose a hyperparameter optimization method, LambdaOpt, which automatically and adaptively enforces regularization during training. Specifically, it updates the regularization coefficients based on the performance of validation data. With LambdaOpt, the notorious tuning of regularization hyperparameters can be avoided; more importantly, it allows fine-grained regularization (i.e. each parameter can have an individualized regularization coefficient), leading to better generalized models. We show how to employ LambdaOpt on matrix factorization, a classical model that is representative of a large family of recommender models. Extensive experiments on two public benchmarks demonstrate the superiority of our method in boosting the performance of top-K recommendation.


title: Dynamical generation of quark/lepton mass hierarchy in an extra dimension

abstract: We show that the observed quark/lepton mass hierarchy can be realized dynamically on an interval extra dimension with point interactions. In our model, the positions of the point interactions play a crucial role to control the quark/lepton mass hierarchy and are determined by the minimization of the Casimir energy. By use of the exact extra-dimensional coordinate-dependent vacuum expectation value of a gauge singlet scalar, we find that there is a parameter set, where the positions of the point interactions are stabilized and fixed, which can reproduce the experimental values of the quark masses precisely enough, while the charged lepton part is less relevant. We also show that possible mixings among the charged leptons will improve the situation significantly.


title: Fractional elliptic equations with Hardy potential and critical nonlinearities

abstract: In this paper, we consider the fractional elliptic equation \begin{align*} \left\{\begin{aligned} &(-\Delta)^s u-\mu\frac{u}{|x|^{2s}} = \frac{|u|^{2_s^\ast (\alpha)-2}u}{|x|^{\alpha}} + f(x,u), && \mbox{in} \ \Omega,\\ &u=0, && \mbox{in} \ \mathbb{R}^{n}\backslash \ \Omega, \end{aligned}\right. \end{align*} where $\Omega\subset R^n$ is a smooth bounded domain, $0\in\Omega$, $0<s<1$, $0<\alpha<2s<n$, $2_{s}^{\ast}(\alpha)=\frac{2(n-\alpha)}{n-2s}$. Under some assumptions on $\mu$ and $f$, we obtain the existence of nonnegative solutions.


title: Additive Conjugacy and the Bohr Compactification of Orthogonal Representations

abstract: We say that two unitary or orthogonal representations of a finitely generated group $G$ are additive conjugates if they are intertwined by an additive map, which need not be continuous. We associate to each representation of $G$ a topological action that is a complete additive conjugacy invariant: the action of $G$ by group automorphisms on the Bohr compactification of the underlying Hilbert space. Using this construction we show that the property of having almost invariant vectors is an additive conjugacy invariant. As an application we show that $G$ is amenable if and only if there is a nonzero homomorphism from $L^2(G)$ into $\mathbb{R}/\mathbb{Z}$ that is invariant to the $G$-action.


title: GraphNVP: An Invertible Flow Model for Generating Molecular Graphs

abstract: We propose GraphNVP, the first invertible, normalizing flow-based molecular graph generation model. We decompose the generation of a graph into two steps: generation of (i) an adjacency tensor and (ii) node attributes. This decomposition yields the exact likelihood maximization on graph-structured data, combined with two novel reversible flows. We empirically demonstrate that our model efficiently generates valid molecular graphs with almost no duplicated molecules. In addition, we observe that the learned latent space can be used to generate molecules with desired chemical properties.


title: Instability of natural convection in a laterally heated cube with perfectly conducting horizontal boundaries

abstract: Oscillatory instability of buoyancy convection in a laterally heated cube with perfectly thermally conducting horizontal boundaries is studied. The effect of the spanwise boundaries on the oscillatory instability onset is studied. The problem is treated by Krylov-subspace-iteration based Newton and Arnoldi methods. The Krylov basis vectors are calculated by a novel approach that involves the SIMPLE iteration and a projection onto a space of functions satisfying all linearized and homogeneous boundary conditions. The finite volume grid is gradually refined from 1003 to 2563 finite volumes. A self-sustaining oscillatory process responsible for the instability onset is revealed, visualized and explained.


title: Differentiable Algorithm Networks for Composable Robot Learning

abstract: This paper introduces the Differentiable Algorithm Network (DAN), a composable architecture for robot learning systems. A DAN is composed of neural network modules, each encoding a differentiable robot algorithm and an associated model; and it is trained end-to-end from data. DAN combines the strengths of model-driven modular system design and data-driven end-to-end learning. The algorithms and models act as structural assumptions to reduce the data requirements for learning; end-to-end learning allows the modules to adapt to one another and compensate for imperfect models and algorithms, in order to achieve the best overall system performance. We illustrate the DAN methodology through a case study on a simulated robot system, which learns to navigate in complex 3-D environments with only local visual observations and an image of a partially correct 2-D floor map.


title: Counting abelian varieties over finite fields via Frobenius densities

abstract: Let $[X,\lambda]$ be a principally polarized abelian variety over a finite field with commutative endomorphism ring; further suppose that either $X$ is ordinary or the field is prime. Motivated by an equidistribution heuristic, we introduce a factor $\nu_v([X,\lambda])$ for each place $v$ of $\mathbb Q$, and show that the product of these factors essentially computes the size of the isogeny class of $[X,\lambda]$. The derivation of this mass formula depends on a formula of Kottwitz and on analysis of measures on the group of symplectic similitudes, and in particular does not rely on a calculation of class numbers.


title: SGD on Neural Networks Learns Functions of Increasing Complexity

abstract: We perform an experimental study of the dynamics of Stochastic Gradient Descent (SGD) in learning deep neural networks for several real and synthetic classification tasks. We show that in the initial epochs, almost all of the performance improvement of the classifier obtained by SGD can be explained by a linear classifier. More generally, we give evidence for the hypothesis that, as iterations progress, SGD learns functions of increasing complexity. This hypothesis can be helpful in explaining why SGD-learned classifiers tend to generalize well even in the over-parameterized regime. We also show that the linear classifier learned in the initial stages is "retained" throughout the execution even if training is continued to the point of zero training error, and complement this with a theoretical result in a simplified model. Key to our work is a new measure of how well one classifier explains the performance of another, based on conditional mutual information.


title: Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network

abstract: Previous cross-lingual knowledge graph (KG) alignment studies rely on entity embeddings derived only from monolingual KG structural information, which may fail at matching entities that have different facts in two KGs. In this paper, we introduce the topic entity graph, a local sub-graph of an entity, to represent entities with their contextual information in KG. From this view, the KB-alignment task can be formulated as a graph matching problem; and we further propose a graph-attention based solution, which first matches all entities in two topic entity graphs, and then jointly model the local matching information to derive a graph-level matching vector. Experiments show that our model outperforms previous state-of-the-art methods by a large margin.


title: Perceived Advantage in Perspective Application of Integrated Choice and Latent Variable Model to Capture Electric Vehicles Perceived Advantage from Consumers Perspective

abstract: Relative advantage, or the degree to which a new technology is perceived to be better over the existing technology it supersedes, has a significant impact on individuals decision of adopting to the new technology. This paper investigates the impact of electric vehicles perceived advantage over the conventional internal combustion engine vehicles, from consumers perspective, on their decision to select electric vehicles. Data is obtained from a stated preference survey from 1176 residents in New South Wales, Australia. The collected data is used to estimate an integrated choice and latent variable model of electric vehicle choice, which incorporates the perceived advantage of electric vehicles in the form of latent variables in the utility function. The design of the electric vehicle, impact on the environment, and safety are three identified advantages from consumers point of view. The model is used to simulate the effectiveness of various policies to promote electric vehicles on different cohorts. Rebate on the purchase price is found to be the most effective strategy to promote electric vehicles adoption.


title: Clairvoyant State Machine Replication

abstract: We propose a new protocol for the generalized consensus problem in asynchronous systems subject to Byzantine server failures. The protocol solves the consensus problem in a setting in which information about conflict between transactions is available (such information can be in the form of transaction read and write sets). Unlike most prior proposals (for generalized or classical consensus), which use a leader to order transactions, this protocol is leaderless, and relies on non-skipping timestamps for transaction ordering. Being leaderless, the protocol does not need to pause for leader elections. The use of non-skipping timestamps permits servers to commit transactions as soon as they know that no conflicting transaction can be ordered earlier. For n servers of which f may be faulty, this protocol requires n > 4f.


title: The comprehensive theory of light

abstract: Modern attempts to understand light go back to Newton who considered light to be particles, the so called corpuscular theory, and the other school of Huygens, Young and others. Huygens and Young viewpoint emphasised the wave property. This difference of opinions persisted for close to two centuries till Maxwell theory solidly established light as a wave phenomenon associated with Electromagnetism. A serious schism so to speak was introduced into the theory of light with the understanding of "Light gas", the so called Black Body radiation. Einstein's photon hypothesis and Bose's successful derivation of the Planck spectrum put the corpuscular theory back in place, while classical description continues to be used as well. One may then wonder if this being a classical limit may have to be corrected when dealing with quantum phenomena. To most people's surprise, the classical description was in fact a subset of the full quantum description, and the classical states of light could be shown to be subsumed within the fully quantum description without having to take the limit of Planck's constant h going to zero. This was the resolution provided by E. C. G. Sudarshan's Diagonal representation as the most general formalism for dealing with light.


title: Boundary behavior and interior H\"older regularity of solution to nonlinear stochastic partial differential equations driven by space-time white noise

abstract: We present uniqueness and existence in weighted Sobolev spaces of the equation $$ u_t=(au_{xx}+bu_x+cu)+ \xi |u|^{1+\lambda} {\dot{B}}, \quad\,\, t>0, \, x\in (0,1) $$ with initial data $u(0,\cdot)=u_0$ and zero boundary data. Here $\lambda\in [0,1/2)$, $\dot{B}$ is a space-time white noise, and the coefficients $a,b,c$ and the function $\xi$ depend on $(\omega,t,x)$ and the initial data $u_0$ depends on $(\omega,x)$. More importantly, we obtain various interior H\"older regularities and boundary behaviors of the solution. For instance, if the initial data is in appropriate $L_p$ spaces, then for any small $\varepsilon>0$ and $T<\infty$, almost surely $$ \rho^{-1/2-\kappa}u \in C^{\frac{1}{4}-\frac{\kappa}{2}-\varepsilon, \frac{1}{2}-\kappa-\varepsilon}_{t,x}([0,T]\times (0,1)), \quad \forall\, \kappa\in (\lambda, 1/2), $$ where $\rho(x)$ is the distance from $x$ to the boundary. Taking $\kappa \downarrow \lambda$, one gets the the maximal H\"older exponents in time and space, which are $1/4-\lambda/2-\varepsilon$ and $1/2-\lambda-\varepsilon $ respectively. Also, letting $\kappa \uparrow 1/2$, one gets better decay or behavior near the boundary.


title: Chiral phase transition in (2 + 1)-flavor QCD

abstract: The chiral phase transition temperature $T_{c}^{0}$ is a fundamental quantity of QCD. To determine this quantity we have performed simulations of (2 + 1)-flavor QCD using the Highly Improved Staggered Quarks (HISQ/tree) action on $N_{\tau}=6, 8$ and 12 lattices with aspect ratios $N_{\sigma}/N_{\tau}$ ranging from 4 to 8. In our simulations the strange quark mass is fixed to its physical value $m_{s}^{\rm{phy}}$, and the values of two degenerate light quark masses $m_{l}$ are varied from $m_{s}^{\rm{phy}}/20$ to $m_{s}^{\rm{phy}}/160$ which correspond to a Goldstone pion mass $m_{\pi}$ ranging from 160 MeV to 55 MeV in the continuum limit. By investigating the light quark mass dependence and the volume dependence of various chiral observables, e.g. chiral susceptibilities and Binder cumulants, no evidence for a first order phase transition in our current quark mass window is found. Two estimators $T_{60}$ and $T_{\delta}$ are proposed to extract the chiral phase transition temperature $T_{c}^{0}$ in the chiral and continuum limit and our current estimate for $T_{c}^{0}$ is $132_{-6}^{+3}$ MeV.


title: Bose's derivation, the crucial link to quantum mechanics

abstract: In this brief note I address the question not frequently asked, namely, why did it take two decades between Einstein's first proposal of photons and derivation of the full Planck formula from first principles of Statistical Mechanics, albeit with a fundamental new approach to counting of states. Secondly, why did it fall to an independent inquirer, S. N. Bose, in far away Dacca to arrive at the correct derivation of this formula, arguably a most crucial one of the first half of the twentieth century? Reasonable hypotheses are proposed for answers to both. I also argue that the timing of Bose's communication to Einstein played a crucial role in Einstein's approval of de Broglie's thesis and hence the emergence of the definitive version of quantum mechanics in the late 1920's.


title: Average Bias and Polynomial Sources

abstract: We identify a new notion of pseudorandomness for randomness sources, which we call the average bias. Given a distribution $Z$ over $\{0,1\}^n$, its average bias is: $b_{\text{av}}(Z) =2^{-n} \sum_{c \in \{0,1\}^n} |\mathbb{E}_{z \sim Z}(-1)^{\langle c, z\rangle}|$. A source with average bias at most $2^{-k}$ has min-entropy at least $k$, and so low average bias is a stronger condition than high min-entropy. We observe that the inner product function is an extractor for any source with average bias less than $2^{-n/2}$. The notion of average bias especially makes sense for polynomial sources, i.e., distributions sampled by low-degree $n$-variate polynomials over $\mathbb{F}_2$. For the well-studied case of affine sources, it is easy to see that min-entropy $k$ is exactly equivalent to average bias of $2^{-k}$. We show that for quadratic sources, min-entropy $k$ implies that the average bias is at most $2^{-\Omega(\sqrt{k})}$. We use this relation to design dispersers for separable quadratic sources with a min-entropy guarantee.


title: Connected Floer homology of covering involutions

abstract: Using the covering involution on the double branched cover of the three-sphere branched along a knot, and adapting ideas of Hendricks-Manolescu and Hendricks-Hom-Lidman, we define new knot invariants and apply them to deduce novel linear independence results in the smooth concordance group of knots.


title: Uncertainty-based Continual Learning with Adaptive Regularization

abstract: We introduce a new neural network-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), which builds on traditional Bayesian online learning framework with variational inference. We focus on two significant drawbacks of the recently proposed regularization-based methods: a) considerable additional memory cost for determining the per-weight regularization strengths and b) the absence of gracefully forgetting scheme, which can prevent performance degradation in learning new tasks. In this paper, we show UCL can solve these two problems by introducing a fresh interpretation on the Kullback-Leibler (KL) divergence term of the variational lower bound for Gaussian mean-field approximation. Based on the interpretation, we propose the notion of node-wise uncertainty, which drastically reduces the number of additional parameters for implementing per-weight regularization. Moreover, we devise two additional regularization terms that enforce stability by freezing important parameters for past tasks and allow plasticity by controlling the actively learning parameters for a new task. Through extensive experiments, we show UCL convincingly outperforms most of recent state-of-the-art baselines not only on popular supervised learning benchmarks, but also on challenging lifelong reinforcement learning tasks. The source code of our algorithm is available at https://github.com/csm9493/UCL.


title: iNavFIter: Next-Generation Inertial Navigation Computation Based on Functional Iteration

abstract: Inertial navigation computation is to acquire the attitude, velocity and position information of a moving body by integrating inertial measurements from gyroscopes and accelerometers. Over half a century has witnessed great efforts in coping with the motion non-commutativity errors to accurately compute the navigation information as far as possible, so as not to compromise the quality measurements of inertial sensors. Highly dynamic applications and the forthcoming cold-atom precision inertial navigation systems demand for even more accurate inertial navigation computation. The paper gives birth to an inertial navigation algorithm to fulfill that demand, named the iNavFIter, which is based on a brand-new framework of functional iterative integration and Chebyshev polynomials. Remarkably, the proposed iNavFIter reduces the non-commutativity errors to almost machine precision, namely, the coning/sculling/scrolling errors that have perplexed the navigation community for long. Numerical results are provided to demonstrate its accuracy superiority over the state-of-the-art inertial navigation algorithms at affordable computation cost.


title: Polynomial Tensor Sketch for Element-wise Function of Low-Rank Matrix

abstract: This paper studies how to sketch element-wise functions of low-rank matrices. Formally, given low-rank matrix A = [Aij] and scalar non-linear function f, we aim for finding an approximated low-rank representation of the (possibly high-rank) matrix [f(Aij)]. To this end, we propose an efficient sketching-based algorithm whose complexity is significantly lower than the number of entries of A, i.e., it runs without accessing all entries of [f(Aij)] explicitly. The main idea underlying our method is to combine a polynomial approximation of f with the existing tensor sketch scheme for approximating monomials of entries of A. To balance the errors of the two approximation components in an optimal manner, we propose a novel regression formula to find polynomial coefficients given A and f. In particular, we utilize a coreset-based regression with a rigorous approximation guarantee. Finally, we demonstrate the applicability and superiority of the proposed scheme under various machine learning tasks.


title: Modal Logics that Bound the Circumference of Transitive Frames

abstract: For each natural number $n$ we study the modal logic determined by the class of transitive Kripke frames in which there are no cycles of length greater than $n$ and no strictly ascending chains. The case $n=0$ is the G\"odel-L\"ob provability logic. Each logic is axiomatised by adding a single axiom to K4, and is shown to have the finite model property and be decidable. We then consider a number of extensions of these logics, including restricting to reflexive frames to obtain a corresponding sequence of extensions of S4. When $n=1$, this gives the famous logic of Grzegorczyk, known as S4Grz, which is the strongest modal companion to intuitionistic propositional logic. A topological semantic analysis shows that the $n$-th member of the sequence of extensions of S4 is the logic of hereditarily $n+1$-irresolvable spaces when the modality $\Diamond$ is interpreted as the topological closure operation. We also study the definability of this class of spaces under the interpretation of $\Diamond$ as the derived set (of limit points) operation. The variety of modal algebras validating the $n$-th logic is shown to be generated by the powerset algebras of the finite frames with cycle length bounded by $n$. Moreover each algebra in the variety is a model of the universal theory of the finite ones, and so is embeddable into an ultraproduct of them.


title: Effect of Inertia on Linear Viscoelasticity of Harmonic Dumbbell Model

abstract: The overdamped (inertialess) dumbbell model is widely utilized to study rheological properties of polymers or other soft matters. In most cases, the effect of inertia is merely neglected because the momentum relaxation is much faster than the bond relaxation. We theoretically analyze the effect of inertia on the linear viscoelasticity of the harmonic dumbbell model. We show that the momentum and bond relaxation modes are kinetically coupled and the inertia can affect the bond relaxation if the momentum relaxation is not sufficiently fast. We derive an overdamped Langevin equation for the dumbbell model, which incorporates the weak inertia effect. Our model predicts the bond relaxation dynamics with the weak inertia effect correctly. We discuss how the weak inertia affects the linear viscoelasticity of a simple harmonic dumbbell model and the Rouse model.


title: $L_2$-cohomology, derivations and quantum Markov semi-groups on $q$-Gaussian algebras

abstract: We study (quasi-)cohomological properties through an analysis of quantum Markov semi-groups. We construct higher order Hochschild cocycles using gradient forms associated with a quantum Markov semi-group. By using Schatten-$\mathcal{S}_p$ estimates we analyze when these cocycles take values in the coarse bimodule. For the 1-cocycles (the derivations) we show that under natural conditions they imply the Akemann-Ostrand property (using the Riesz transform). We apply this to $q$-Gaussian algebras $\Gamma_q(H)$. As a result $q$-Gaussians satisfy AO$^+$ for $| q | \leqslant \dim(H)^{-1/2}$. This includes a new range of $q$ in low dimensions compared to Shlyakhtenko.


title: Concavifiability and convergence: necessary and sufficient conditions for gradient descent analysis

abstract: Convergence of the gradient descent algorithm has been attracting renewed interest due to its utility in deep learning applications. Even as multiple variants of gradient descent were proposed, the assumption that the gradient of the objective is Lipschitz continuous remained an integral part of the analysis until recently. In this work, we look at convergence analysis by focusing on a property that we term as concavifiability, instead of Lipschitz continuity of gradients. We show that concavifiability is a necessary and sufficient condition to satisfy the upper quadratic approximation which is key in proving that the objective function decreases after every gradient descent update. We also show that any gradient Lipschitz function satisfies concavifiability. A constant known as the concavifier analogous to the gradient Lipschitz constant is derived which is indicative of the optimal step size. As an application, we demonstrate the utility of finding the concavifier the in convergence of gradient descent through an example inspired by neural networks. We derive bounds on the concavifier to obtain a fixed step size for a single hidden layer ReLU network.


title: A note on the symmetry of sequence spaces

abstract: We give a self-contained treatment of symmetric Banach sequence spaces and some of their natural properties. We are particularly interested in the symmetry of the norm and the existence of symmetric linear functionals. Many of the presented results are known or commonly accepted but are not found in the literature.


title: Nonparametric Heterogeneous Treatment Effect Estimation in Repeated Cross Sectional Designs

abstract: Identifying heterogeneity in a population's response to a health or policy intervention is crucial for evaluating and informing policy decisions. We propose a novel heterogeneous treatment effect estimator in the difference-in-differences design with repeated cross sectional data, where we observe different samples of a population at two time periods separated by the onset of a policy intervention, as well as samples of a population that serves as the control. Our estimator has orthogonality properties that enable fast rates on learning the treatment effect while allowing slower rates for estimating nuisance components. Our proposal shows promising empirical performance across a variety of simulation setups.


title: Solving NP-Hard Problems on Graphs with Extended AlphaGo Zero

abstract: There have been increasing challenges to solve combinatorial optimization problems by machine learning. Khalil et al. proposed an end-to-end reinforcement learning framework, S2V-DQN, which automatically learns graph embeddings to construct solutions to a wide range of problems. To improve the generalization ability of their Q-learning method, we propose a novel learning strategy based on AlphaGo Zero which is a Go engine that achieved a superhuman level without the domain knowledge of the game. Our framework is redesigned for combinatorial problems, where the final reward might take any real number instead of a binary response, win/lose. In experiments conducted for five kinds of NP-hard problems including {\sc MinimumVertexCover} and {\sc MaxCut}, our method is shown to generalize better to various graphs than S2V-DQN. Furthermore, our method can be combined with recently-developed graph neural network (GNN) models such as the \emph{Graph Isomorphism Network}, resulting in even better performance. This experiment also gives an interesting insight into a suitable choice of GNN models for each task.


title: Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation

abstract: Relations amongst entities play a central role in image understanding. Due to the complexity of modeling (subject, predicate, object) relation triplets, it is crucial to develop a method that can not only recognize seen relations, but also generalize to unseen cases. Inspired by a previously proposed visual translation embedding model, or VTransE, we propose a context-augmented translation embedding model that can capture both common and rare relations. The previous VTransE model maps entities and predicates into a low-dimensional embedding vector space where the predicate is interpreted as a translation vector between the embedded features of the bounding box regions of the subject and the object. Our model additionally incorporates the contextual information captured by the bounding box of the union of the subject and the object, and learns the embeddings guided by the constraint predicate $\approx$ union (subject, object) $-$ subject $-$ object. In a comprehensive evaluation on multiple challenging benchmarks, our approach outperforms previous translation-based models and comes close to or exceeds the state of the art across a range of settings, from small-scale to large-scale datasets, from common to previously unseen relations. It also achieves promising results for the recently introduced task of scene graph generation.


title: NIL: Learning Nonlinear Interpolants

abstract: Nonlinear interpolants have been shown useful for the verification of programs and hybrid systems in contexts of theorem proving, model checking, abstract interpretation, etc. The underlying synthesis problem, however, is challenging and existing methods have limitations on the form of formulae to be interpolated. We leverage classification techniques with space transformations and kernel tricks as established in the realm of machine learning, and present a counterexample-guided method named NIL for synthesizing polynomial interpolants, thereby yielding a unified framework tackling the interpolation problem for the general quantifier-free theory of nonlinear arithmetic, possibly involving transcendental functions. We prove the soundness of NIL and propose sufficient conditions under which NIL is guaranteed to converge, i.e., the derived sequence of candidate interpolants converges to an actual interpolant, and is complete, namely the algorithm terminates by producing an interpolant if there exists one. The applicability and effectiveness of our technique are demonstrated experimentally on a collection of representative benchmarks from the literature, where in particular, our method suffices to address more interpolation tasks, including those with perturbations in parameters, and in many cases synthesizes simpler interpolants compared with existing approaches.


title: Purely rotational symmetry-protected topological crystalline insulator $\alpha$-Bi4Br4

abstract: Recent theoretical advances have proposed a new class of topological crystalline insulator (TCI) phases protected by rotational symmetries. Distinct from topological insulators (TIs), rotational symmetry-protected TCIs are expected to show unique topologically protected boundary modes: First, the surface normal to the rotational axis features unpinned Dirac surface states whose Dirac points are located at generic k points. Second, due to the higher-order bulk boundary correspondence, a 3D TCI also supports 1D helical edge states. Despite the unique topological electronic properties, to date, purely rotational symmetry-protected TCIs remain elusive in real materials. Using first-principles band calculations and theoretical modeling, we identify the van der Waals material $\alpha$-Bi4Br4 as a TCI purely protected by rotation symmetry. We show that the Bi4Br4's (010) surface exhibits a pair of unpinned topological Dirac fermions protected by the two-fold rotational axis. These unpinned Dirac fermions show an exotic spin texture highly favorable for spin transport and a band structure consisting of van Hove singularities due to Lifshitz transition. We also identify 1D topological hinge states along the edges of an $\alpha$-Bi4Br4 rod. We further discuss how the proposed topological electronic properties in $\alpha$-Bi4Br4 can be observed by various experimental techniques.


title: Data Load Balancing In Mobile Ad Hoc Network Using Fuzzy Logic (DBMF)

abstract: Volume and movement of data rapidly increasing in every type of data communications and networking, and ad hoc networks are not spared from these challenges. Traditional Multipath routing protocols in Mobile Ad-hoc Networks (MANETs) did not focus on data load distribution and balancing as much as required. In this scheme, we have proposed data load distribution and balancing through multiple paths simultaneously. We have considered three important parameters of ad hoc network those are: mobility of node, the energy of node and packet drop rate at a node. This scheme combines these three metrics using fuzzy logic to get the decisive parameter. We have shown improvement of this scheme over similar kind of protocols in NS-2 network simulator.


title: Mixing for Smooth Time-Changes of General Nilflows

abstract: We consider completely irrational nilflows on any nilmanifold of step at least $2$. We show that there exists a dense set of smooth time-changes such that any time-change in this class which is not measurably trivial gives rise to a mixing nilflow. This in particular reproves and generalizes to any nilflow (of step at least $2$) the main result proved in [AFU] for the special class of Heisenberg (step $2$) nilflows, and later generalized in [Rav2] to a class of nilflows of arbitrary step which are isomorphic to suspensions of higher-dimensional linear toral skew-shifts.


title: Resource theory of asymmetric distinguishability

abstract: This paper systematically develops the resource theory of asymmetric distinguishability, as initiated roughly a decade ago [K. Matsumoto, arXiv:1010.1030 (2010)]. The key constituents of this resource theory are quantum boxes, consisting of a pair of quantum states, which can be manipulated for free by means of an arbitrary quantum channel. We introduce bits of asymmetric distinguishability as the basic currency in this resource theory, and we prove that it is a reversible resource theory in the asymptotic limit, with the quantum relative entropy being the fundamental rate of resource interconversion. The distillable distinguishability is the optimal rate at which a quantum box consisting of independent and identically distributed (i.i.d.) states can be converted to bits of asymmetric distinguishability, and the distinguishability cost is the optimal rate for the reverse transformation. Both of these quantities are equal to the quantum relative entropy. The exact one-shot distillable distinguishability is equal to the min-relative entropy, and the exact one-shot distinguishability cost is equal to the max-relative entropy. Generalizing these results, the approximate one-shot distillable distinguishability is equal to the smooth min-relative entropy, and the approximate one-shot distinguishability cost is equal to the smooth max-relative entropy. As a notable application of the former results, we prove that the optimal rate of asymptotic conversion from a pair of i.i.d. quantum states to another pair of i.i.d. quantum states is fully characterized by the ratio of their quantum relative entropies.

categories: quant-ph cs.IT hep-th math-ph math.IT math.MP


title: Rapid flipping of parametric phase states

abstract: Since the invention of the solid-state transistor, the overwhelming majority of computers followed the von Neumann architecture that strictly separates logic operations and memory. Today, there is a revived interest in alternative computation models accompanied by the necessity to develop corresponding hardware architectures. The Ising machine, for example, is a variant of the celebrated Hopfield network based on the Ising model. It can be realized with artifcial spins such as the `parametron' that arises in driven nonlinear resonators. The parametron encodes binary information in the phase state of its oscillation. It enables, in principle, logic operations without energy transfer and the corresponding speed limitations. In this work, we experimentally demonstrate flipping of parametron phase states on a timescale of an oscillation period, much faster than the ringdown time \tau that is often (erroneously) deemed a fundamental limit for resonator operations. Our work establishes a new paradigm for resonator-based logic architectures.


title: Studying synthesis confinement effects on the internal structure of nanogels in computer simulations

abstract: We study the effects of droplet finite size on the structure of nanogel particles synthesized by random crosslinking of molecular polymers diluted in nanoemulsions. For this, we use a bead-spring computer model of polymer-like structures that mimics the confined random crosslinking process corresponding to irradiation- or electrochemically-induced crosslinking methods. Our results indicate that random crosslinking under strong confinement can lead to unusual nanogel internal structures, with a central region less dense than the external one, whereas under moderate confinement the resulting structure has a denser central region. We analyze the topology of the polymer networks forming nanogel particles with both types of architectures, their overall structural parameters, their response to the quality of the solvent and compare the cases of non-ionic and ionic systems.


title: Non-equilibrium ionization effects on solar EUV and X-ray imaging observations

abstract: During transient events such as major solar eruptions, the plasma can be far from the equilibrium ionization state because of rapid heating or cooling. Non-equilibrium ionization~(NEI) is important in rapidly evolving systems where the thermodynamical timescale is shorter than the ionization or recombination time scales. We investigate the effects of NEI on EUV and X-ray observations by the Atmospheric Imaging Assembly (AIA) on board Solar Dynamic Observatory and X-ray Telescope (XRT) on board Hinode. Our model assumes that the plasma is initially in ionization equilibrium at low temperature, and it is heated rapidly by a shock or magnetic reconnection. We tabulate the responses of the AIA and XRT passbands as functions of temperature and a characteristic timescale, $n_{e}t$. We find that most of the ions reach equilibrium at $n_{e}t\leq$10$^{12}$ cm$^{-3}$s. Comparing ratios of the responses between different passbands allows us to determine whether a combination of plasmas at temperatures in ionization equilibrium can account for a given AIA and XRT observation. It also expresses how far the observed plasma is from equilibrium ionization. We apply the ratios to a supra-arcade plasma sheet on 2012 January 27. We find that the closer the plasma is to the arcade, the closer it is to a single-temperature plasma in ionization equilibrium. We also utilize the set of responses to estimate the temperature and density for shocked plasma associated with a coronal mass ejection on 2010 June 13. The temperature and density ranges we obtain are in reasonable agreement with previous works.


title: Towards a Wearable Interface for Food Quality Grading through ERP Analysis

abstract: Sensory evaluation is used to assess the consumer acceptance of foods or other consumer products, so as to improve industrial processes and marketing strategies. The procedures currently involved are time-consuming because they require a statistical approach from measurements and feedback reports from a wide set of evaluators under a well-established measurement setup. In this paper, we propose to collect directly the signal of the perceived quality of the food from Event-related potentials (ERPs) that are the outcome of the processing of visual stimuli. This permits to narrow the number of evaluators since errors related to psychological factors are by-passed. We present the design of a wearable system for ERP measurement and we present preliminary results on the use of ERP to give a quantitative measure to the appearance of a food product. The system is developed to be wearable and our experiments demonstrate that is possible to use it to identify and classify the grade of acceptance of the food.


title: LatentGNN: Learning Efficient Non-local Relations for Visual Recognition

abstract: Capturing long-range dependencies in feature representations is crucial for many visual recognition tasks. Despite recent successes of deep convolutional networks, it remains challenging to model non-local context relations between visual features. A promising strategy is to model the feature context by a fully-connected graph neural network (GNN), which augments traditional convolutional features with an estimated non-local context representation. However, most GNN-based approaches require computing a dense graph affinity matrix and hence have difficulty in scaling up to tackle complex real-world visual problems. In this work, we propose an efficient and yet flexible non-local relation representation based on a novel class of graph neural networks. Our key idea is to introduce a latent space to reduce the complexity of graph, which allows us to use a low-rank representation for the graph affinity matrix and to achieve a linear complexity in computation. Extensive experimental evaluations on three major visual recognition tasks show that our method outperforms the prior works with a large margin while maintaining a low computation cost.


title: Complexity lower bounds for computing the approximately-commuting operator value of non-local games to high precision

abstract: We study the problem of approximating the commuting-operator value of a two-player non-local game. It is well-known that it is $\mathrm{NP}$-complete to decide whether the classical value of a non-local game is 1 or $1- \epsilon$. Furthermore, as long as $\epsilon$ is small enough, this result does not depend on the gap $\epsilon$. In contrast, a recent result of Fitzsimons, Ji, Vidick, and Yuen shows that the complexity of computing the quantum value grows without bound as the gap $\epsilon$ decreases. In this paper, we show that this also holds for the commuting-operator value of a game. Specifically, in the language of multi-prover interactive proofs, we show that the power of $\mathrm{MIP}^{co}(2,1,1,s)$ (proofs with two provers, one round, completeness probability $1$, soundness probability $s$, and commuting-operator strategies) can increase without bound as the gap $1-s$ gets arbitrarily small. Our results also extend naturally in two ways, to perfect zero-knowledge protocols, and to lower bounds on the complexity of computing the approximately-commuting value of a game. Thus we get lower bounds on the complexity class $\mathrm{PZK}$-$\mathrm{MIP}^{co}_{\delta}(2,1,1,s)$ of perfect zero-knowledge multi-prover proofs with approximately-commuting operator strategies, as the gap $1-s$ gets arbitrarily small. While we do not know any computable time upper bound on the class $\mathrm{MIP}^{co}$, a result of the first author and Vidick shows that for $s = 1-1/\text{poly}(f(n))$ and $\delta = 1/\text{poly}(f(n))$, the class $\mathrm{MIP}^{co}_\delta(2,1,1,s)$, with constant communication from the provers, is contained in $\mathrm{TIME}(\exp(\text{poly}(f(n))))$. We give a lower bound of $\mathrm{coNTIME}(f(n))$ (ignoring constants inside the function) for this class, which is tight up to polynomial factors assuming the exponential time hypothesis.


title: Effects of baryons on weak lensing peak statistics

abstract: Upcoming weak-lensing surveys have the potential to become leading cosmological probes provided all systematic effects are under control. Recently, the ejection of gas due to feedback energy from active galactic nuclei (AGN) has been identified as major source of uncertainty, challenging the success of future weak-lensing probes in terms of cosmology. In this paper we investigate the effects of baryons on the number of weak-lensing peaks in the convergence field. Our analysis is based on full-sky convergence maps constructed via light-cones from $N$-body simulations, and we rely on the baryonic correction model of Schneider et al. (2019) to model the baryonic effects on the density field. As a result we find that the baryonic effects strongly depend on the Gaussian smoothing applied to the convergence map. For a DES-like survey setup, a smoothing of $\theta_k\gtrsim8$ arcmin is sufficient to keep the baryon signal below the expected statistical error. Smaller smoothing scales lead to a significant suppression of high peaks (with signal-to-noise above 2), while lower peaks are not affected. The situation is more severe for a Euclid-like setup, where a smoothing of $\theta_k\gtrsim16$ arcmin is required to keep the baryonic suppression signal below the statistical error. Smaller smoothing scales require a full modelling of baryonic effects since both low and high peaks are strongly affected by baryonic feedback.


title: Dynamical and cohomological obstructions to extending group actions

abstract: We study cohomological obstructions to extending group actions on the boundary $\partial M$ of a $3$-manifold to a $C^0$-action on $M$ when $\partial M$ is diffeomorphic to a torus or a sphere. In particular, we show that for a $3$-manifold $M$ with torus boundary which is not diffeomorphic to a solid torus, the torus action on the boundary does not extend to a $C^0$-action on $M$.


title: Rogue waves on the periodic wave background in the focusing nonlinear Schrodinger equation

abstract: We present exact solutions for rogue waves arising on the background of periodic waves in the focusing nonlinear Schrodinger equation. The exact solutions are obtained by characterizing the Lax spectrum related to the periodic waves and by using the one-fold Darboux transformation. The magnification factor of the rogue waves is computed in the closed analytical form. We relate the rogue wave solutions to the modulation instability of the periodic wave background.


title: Implicit Rugosity Regularization via Data Augmentation

abstract: Deep (neural) networks have been applied productively in a wide range of supervised and unsupervised learning tasks. Unlike classical machine learning algorithms, deep networks typically operate in the \emph{overparameterized} regime, where the number of parameters is larger than the number of training data points. Consequently, understanding the generalization properties and the role of (explicit or implicit) regularization in these networks is of great importance. In this work, we explore how the oft-used heuristic of \emph{data augmentation} imposes an {\em implicit regularization} penalty of a novel measure of the \emph{rugosity} or "roughness" based on the tangent Hessian of the function fit to the training data.


title: AmoebaContact and GDFold: a new pipeline for rapid prediction of protein structures

abstract: Native contacts between residues could be predicted from the amino acid sequence of proteins, and the predicted contact information could assist the de novo protein structure prediction. Here, we present a novel pipeline of a residue contact predictor AmoebaContact and a contact-assisted folder GDFold for rapid protein structure prediction. Unlike mainstream contact predictors that utilize human-designed neural networks, AmoebaContact adopts a set of network architectures that are found as optimal for contact prediction through automatic searching and predicts the residue contacts at a series of cutoffs. Different from conventional contact-assisted folders that only use top-scored contact pairs, GDFold considers all residue pairs from the prediction results of AmoebaContact in a differentiable loss function and optimizes the atom coordinates using the gradient descent algorithm. Combination of AmoebaContact and GDFold allows quick reconstruction of the protein structure, with comparable model quality to the state-of-the-art protein structure prediction methods.


title: Image Deformation Meta-Networks for One-Shot Learning

abstract: Humans can robustly learn novel visual concepts even when images undergo various deformations and lose certain information. Mimicking the same behavior and synthesizing deformed instances of new concepts may help visual recognition systems perform better one-shot learning, i.e., learning concepts from one or few examples. Our key insight is that, while the deformed images may not be visually realistic, they still maintain critical semantic information and contribute significantly to formulating classifier decision boundaries. Inspired by the recent progress of meta-learning, we combine a meta-learner with an image deformation sub-network that produces additional training examples, and optimize both models in an end-to-end manner. The deformation sub-network learns to deform images by fusing a pair of images --- a probe image that keeps the visual content and a gallery image that diversifies the deformations. We demonstrate results on the widely used one-shot learning benchmarks (miniImageNet and ImageNet 1K Challenge datasets), which significantly outperform state-of-the-art approaches. Code is available at https://github.com/tankche1/IDeMe-Net.


title: Lane-free Artificial-Fluid Concept for Vehicular Traffic

abstract: A novel paradigm for vehicular traffic in the era of connected and automated vehicles (CAVs) is proposed, which includes two combined principles: lane-free traffic and vehicle nudging, whereby vehicles are "pushing" (from a distance, using communication or sensors) other vehicles in front of them. This traffic paradigm features several advantages, including: smoother and safer driving; increase of roadway capacity; and no need for the anisotropy restriction. The proposed concept provides, for the first time since the automobile invention, the possibility to actively design (rather than describe) the traffic flow characteristics in an optimal way, i.e. to engineer the future CAV traffic flow as an efficient artificial fluid. Options, features, application domains and required research topics are discussed. Preliminary simulation results illustrate some basic features of the concept.


title: Bound state solutions for non-autonomous fractional Schr\"{o}dinger-Poisson equations with critical exponent

abstract: In this paper, we study the fractional Schr\"{o}dinger-Poisson equation \begin{equation*} \ \left\{\begin{aligned} &(-\Delta)^{s}u+V(x)u+K(x)\phi u=|u|^{2^{\ast}_{s}-2}u, &\mbox{in} \ \mathbb{R}^{3},\\ &(-\Delta)^{s}\phi=K(x)u^{2},&\mbox{in} \ \mathbb{R}^{3}, \end{aligned}\right. \end{equation*} where $s\in (\frac{3}{4},1]$, $2^{\ast}_{s}=\frac{6}{3-2s}$ is the fractional critical exponent, $K\in L^{\frac{6}{6s-3}}(\mathbb{R}^{3})$ and $V\in L^{\frac{3}{2s}}(\mathbb{R}^{3})$ are nonnegative functions. If $\|V\|_{\frac{3}{2s}}+\|K\|_{\frac{6}{6s-3}}$ is sufficiently small, we prove that the equation has at least one bound state solution.


title: Cheat-Proof Communication through Cluster Head (C3H) in Mobile Ad Hoc Network

abstract: The mobile ad hoc network (MANET) is a wireless network based on a group of mobile nodes without any centralised infrastructure. In civilian data communication, all nodes cannot be homogeneous-type and not do a specific data communication. Therefore, node co-operation and cheat-proof are essential characteristics for successfully running MANETs in civilian data communication. Denial of service and malicious behaviour of the node are the main concerns in securing successful communication in MANETs. This scheme proposed a generic solution to preventing malicious behaviour of the node by the cluster head through the single hop node clustering strategy.


title: Tuning the Magnetic Ground State by Charge Transfer Energy in SrCoO2.5 via Strain Engineering

abstract: SrCoO2.5 (SCO) is a charge transfer insulator with 3d6 ground state configuration leading to antiferromagnetic nature. It is observed that substrate induced strain engineering modifies the ground state of SCO thin film with 3d7L (L:O-2p hole) configuration causing negative charge transfer energy.The consequent strong hybridization between O-2p and Co-3d bands causes a hole in O-2p band leading to hole mediated unconventional ferromagnetic ordering in SrCoO2.5 thin film. This opens up a new avenue to tune the electronic structure vis a vis magnetic property via strain engineering.


title: Phase Diagram of a Generalized XY Model with Geometrical Frustration

abstract: In the present study we investigate the effects of geometrical frustration on the XY model with antiferromagnetic (AFM) coupling on a triangular lattice, generalized by the inclusion of a third-order antinematic term (AN3). We demonstrate that at non-zero temperatures such a generalization leads to a phase diagram consisting of three different quasi-long-range ordered (QLRO) phases. Compared to the model with the second-order AN coupling (AN2), it includes besides the AFM and AN3 phases which appear in the limits of relatively strong AFM and AN3 interactions, respectively, an additional complex noncollinear QLRO phase at lower temperatures wedged between the AFM and AN3 phases. This new phase originates from the competition between the AFM and AN3 couplings, which is absent in the model with the AN2 coupling.


title: Existence, linear stability and long-time nonlinear stability of Klein-Gordon breathers in the small-amplitude limit

abstract: In this paper we consider a discrete Klein-Gordon (dKG) equation on $\ZZ^d$ in the limit of the discrete nonlinear Schrodinger (dNLS) equation, for which small-amplitude breathers have precise scaling with respect to the small coupling strength $\eps$. By using the classical Lyapunov-Schmidt method, we show existence and linear stability of the KG breather from existence and linear stability of the corresponding dNLS soliton. Nonlinear stability, for an exponentially long time scale of the order $\mathcal{O}(\exp(\eps^{-1}))$, is also obtained via the normal form technique, together with higher order approximations of the KG breather through perturbations of the corresponding dNLS soliton.


title: Unimodal value distribution of Laplace eigenfunctions and a monotonicity formula

abstract: Let $M$ be a compact, connected Riemannian manifold whose Riemannian volume measure is denoted by $\sigma$. Let $f: M \rightarrow \mathbb{R}$ be a non-constant eigenfunction of the Laplacian. The random wave conjecture suggests that in certain situations, the value distribution of $f$ under $\sigma$ is approximately Gaussian. Write $\mu$ for the measure whose density with respect to $\sigma$ is $|\nabla f|^2$. We observe that the value distribution of $f$ under $\mu$ admits a unimodal density attaining its maximum at the origin. Thus, in a sense, the zero set of an eigenfunction is the largest of all level sets. When $M$ is a manifold with boundary, the same holds for Laplace eigenfunctions satisfying either the Dirichlet or the Neumann boundary conditions. Additionally, we prove a monotonicity formula for level sets of solid spherical harmonics, essentially by viewing nodal sets of harmonic functions as weighted minimal hypersurfaces.


title: Class numbers of CM algebraic tori, CM abelian varieties and components of unitary Shimura varieties

abstract: We give a formula for the class number of an arbitrary CM algebraic torus over $\mathbb{Q}$. This is proved based on results of Ono and Shyr. As applications, we give formulas for numbers of polarized CM abelian varieties, of connected components of unitary Shimura varieties and of certain polarized abelian varieties over finite fields. We also give a second proof of our main result.


title: Magnetic Inhibition of Centrifugal Instability in Astrophysical Jets

abstract: Recently it was shown that the centrifugal instability may be important in the dynamics of astrophysical jets undergoing reconfinement by external pressure. However, these studies were limited to the case of unmagnetised flows. Here we explore the role of the magnetic field within both the Newtonian and relativistic frameworks. Since the jet problem is rather complicated, we focus instead on the simpler problem of cylindrical rotation and axial magnetic field, which shares significant similarity with the jet problem, and consider only axisymmetric perturbations. The studied equilibrium configurations involve a cylindrical interface and they are stable to non-magnetic centrifugal and magneto-rotational instabilities everywhere except this interface. We use a heuristic approach to derive the local stability criterion for the interface in the magnetic case and numerical simulations to verify the role of the magnetic field. The theory and simulations agree quite well for Newtonian models but indicate a potential discrepancy for the relativistic models in the limit of high Lorentz factor of the rotational motion at the interface. In general, the magnetic field sets a critical wavelength below which the centrifugal modes are stabilised. We discuss the implication of our findings for the astrophysical jets, which suggest that the centrifugal instability develops only in jets with relatively low magnetisation. Namely, the magnetic pressure has to be below the thermal one and for the relativistic case the jets have to be kinetic-energy dominated.


title: The Nipple-Areola Complex for Criminal Identification

abstract: In digital and multimedia forensics, identification of child sexual offenders based on digital evidence images is highly challenging due to the fact that the offender's face or other obvious characteristics such as tattoos are occluded, covered, or not visible at all. Nevertheless, other naked body parts, e.g., chest are still visible. Some researchers proposed skin marks, skin texture, vein or androgenic hair patterns for criminal and victim identification. There are no available studies of nipple-areola complex (NAC) for offender identification. In this paper, we present a study of offender identification based on the NAC, and we present NTU-Nipple-v1 dataset, which contains 2732 images of 428 different male nipple-areolae. Popular deep learning and hand-crafted recognition methods are evaluated on the provided dataset. The results indicate that the NAC can be a useful characteristic for offender identification.


title: Crowdsourced Peer Learning Activity for Internet of Things Education: A Case Study

abstract: Computing devices such as laptops, tablets and mobile phones have become part of our daily lives. End users increasingly know more and more information about these devices. Further, more technically savvy end users know how such devices are being built and know how to choose one over the others. However, we cannot say the same about the Internet of Things (IoT) products. Due to its infancy nature of the marketplace, end users have very little idea about IoT products. To address this issue, we developed a method, a crowdsourced peer learning activity, supported by an online platform (OLYMPUS) to enable a group of learners to learn IoT products space better. We conducted two different user studies to validate that our tool enables better IoT education. Our method guide learners to think more deeply about IoT products and their design decisions. The learning platform we developed is open source and available for the community.


title: Trace and axial anomalies on equal footing

abstract: We discuss for some particular non supersymmetric theories a generalized symmetry that includes both the scale and axial transformations and leads to a single current that may contain also a pseudoscalar term. The method, inspired by the superconformal anomalies has important application for low energy effective models where it allows the introduction of a single complex glueball field with a scalar and a pseudoscalar component on the same footing with the complex meson nonets fields made of quarks. Both axial and trace and axial anomalies are satisfied in accordance to the meson structure and the QCD requirements.


title: Electric Vehicles and their Effect on Network Load

abstract: The composition of the fleet of road cars is changing from fuel powered cars to plug-in hybrid (PHEV) and electrical vehicles (EV). The (electrical) range of these vehicles is limited, leading to so called `range anxiety'. Firstly, this leads to a preference of shorter routes. Secondly, (PH)EVs have the ability to regenerate energy from braking, which make routes with many accerelations and decelerations not as unattractive for drivers of (PH)EVs as for drivers of vehicles with an internal combustion engine (ICE). This paper combines this, and adds drivers might prefer a lower speed limit due to a lower energy consumption. These elements are compared to with road characteristics. It is found, motorways are usually less favourable for drivers of (PH)EVs compared to drivers of ICE vehicles, and they will prefer the shorter routes on secondary roads or through towns. This will influence the use of the underlying road network, and thereby affecting congestion, emissions and safety. This shift towards the underlying road network needs to be taken into account in designs for the network.


title: Generalized power domination in claw-free regular graphs

abstract: In this paper, we give a series of couterexamples to negate a conjecture and hence answer an open question on the $k$-power domination of regular graphs (see [P. Dorbec et al., SIAM J. Discrete Math., 27 (2013), pp. 1559-1574]). Furthermore, we focus on the study of $k$-power domination of claw-free graphs. We show that for $l\in\{2,3\}$ and $k\ge l$, the $k$-power domination number of a connected claw-free $(k+l+1)$-regular graph on $n$ vertices is at most $\frac{n}{k+l+2}$, and this bound is tight.


title: Discrete Infomax Codes for Supervised Representation Learning

abstract: Learning compact discrete representations of data is a key task on its own or for facilitating subsequent processing of data. In this paper we present a model that produces Discrete InfoMax Codes (DIMCO); we learn a probabilistic encoder that yields k-way d-dimensional codes associated with input data. Our model's learning objective is to maximize the mutual information between codes and labels with a regularization, which enforces entries of a codeword to be as independent as possible. We show that the infomax principle also justifies previous loss functions (e.g., cross-entropy) as its special cases. Our analysis also shows that using shorter codes, as DIMCO does, reduces overfitting in the context of few-shot classification. Through experiments in various domains, we observe this implicit meta-regularization effect of DIMCO. Furthermore, we show that the codes learned by DIMCO are efficient in terms of both memory and retrieval time compared to previous methods.


title: Dynamical irreducibility of polynomials modulo primes

abstract: For a class of polynomials $f \in \mathbb{Z}[X]$, which in particular includes all quadratic polynomials, and also trinomials of some special form, we show that, under some natural conditions (necessary for quadratic polynomials), the set of primes $p$ such that all iterations of $f$ are irreducible modulo $p$ is of relative density zero. Furthermore, we give an explicit bound on the rate of the decay of the density of such primes in an interval $[1, Q]$ as $Q \to \infty$. For this class of polynomials this gives a more precise version of a recent result of A. Ferraguti (2018), which applies to arbitrary polynomials but requires a certain assumption about their Galois group. Furthermore, under the Generalised Riemann Hypothesis we obtain a stronger bound on this density.


title: DSReg: Using Distant Supervision as a Regularizer

abstract: In this paper, we aim at tackling a general issue in NLP tasks where some of the negative examples are highly similar to the positive examples, i.e., hard-negative examples. We propose the distant supervision as a regularizer (DSReg) approach to tackle this issue. The original task is converted to a multi-task learning problem, in which distant supervision is used to retrieve hard-negative examples. The obtained hard-negative examples are then used as a regularizer. The original target objective of distinguishing positive examples from negative examples is jointly optimized with the auxiliary task objective of distinguishing softened positive (i.e., hard-negative examples plus positive examples) from easy-negative examples. In the neural context, this can be done by outputting the same representation from the last neural layer to different $softmax$ functions. Using this strategy, we can improve the performance of baseline models in a range of different NLP tasks, including text classification, sequence labeling and reading comprehension.


title: Evaluating and Calibrating Uncertainty Prediction in Regression Tasks

abstract: Predicting not only the target but also an accurate measure of uncertainty is important for many machine learning applications and in particular safety-critical ones. In this work we study the calibration of uncertainty prediction for regression tasks which often arise in real-world systems. We show that the existing definition for calibration of a regression uncertainty [Kuleshov et al. 2018] has severe limitations in distinguishing informative from non-informative uncertainty predictions. We propose a new definition that escapes this caveat and an evaluation method using a simple histogram-based approach. Our method clusters examples with similar uncertainty prediction and compares the prediction with the empirical uncertainty on these examples. We also propose a simple, scaling-based calibration method that preforms as well as much more complex ones. We show results on both a synthetic, controlled problem and on the object detection bounding-box regression task using the COCO and KITTI datasets.


title: Strain-derivative of thermoelectric properties: a sensitive probe for nematicity

abstract: The nematic instability of iron-based superconductors is an undebatable ingredient of the physics of iron-based superconductors. Yet, its origin remains enigmatic as it involves a fermiology with an intricate interplay of lattice-, orbital- and spin- degrees of freedom. It is well known that thermoelectric transport is an excellent probe for revealing even subtle signatures of instabilities and pertinent fluctuations. In this paper, we report a strong response of the thermoelectric transport properties of two underdoped 1111 iron-based superconductors to a vanishingly small strain. By introducing the strain-derivative of the Seebeck and the Nernst coefficients, we provide a novel description of the nematic order parameter, proving the existence of an anisotropic Peltier-tensor beside an anisotropic conductivity-tensor. Our measurements reveal that the transport nematic phenomenology is the result of the combined effect of both an anisotropic scattering time and Fermi surface distortions, pointing out that in a realistic description, abreast of the spin-fluctuations also the orbital character is a fundamental ingredient. In addition, we show that nematic fluctuations universally relax in a Curie-Weiss fashion above T_S in all the elasto-transport measurements and we provide evidences that nematicity must be band-selective.


title: Dynamic buckling of an inextensible elastic ring: Linear and nonlinear analyses

abstract: Slender elastic objects such as a column tend to buckle under loads. While static buckling is well understood as a bifurcation problem, the evolution of shapes during dynamic buckling is much harder to study. Elastic rings under normal pressure have emerged as a theoretical and experimental paradigm for the study of dynamic buckling with controlled loads. Experimentally, an elastic ring is placed within a soap film. When the film outside the ring is removed, surface tension pulls the ring inward, mimicking an external pressurization. Here we present a theoretical analysis of this process by performing a post-bifurcation analysis of an elastic ring under pressure. This analysis allows us to understand how inertia, material properties, and loading affect the observed shape. In particular, we combine direct numerical solutions with a post-bifurcation asymptotic analysis to show that inertia drives the system towards higher modes that cannot be selected in static buckling. Our theoretical results explain experimental observations that cannot be captured by a standard linear stability analysis.


title: Visualizing Poiseuille flow of hydrodynamic electrons

abstract: Hydrodynamics is a general description for the flow of a fluid, and is expected to hold even for fundamental particles such as electrons when inter-particle interactions dominate. While various aspects of electron hydrodynamics were revealed in recent experiments, the fundamental spatial structure of hydrodynamic electrons, the Poiseuille flow profile, has remained elusive. In this work, we provide the first real-space imaging of Poiseuille flow of an electronic fluid, as well as visualization of its evolution from ballistic flow. Utilizing a scanning nanotube single electron transistor, we image the Hall voltage of electronic flow through channels of high-mobility graphene. We find that the profile of the Hall field across the channel is a key physical quantity for distinguishing ballistic from hydrodynamic flow. We image the transition from flat, ballistic field profiles at low temperature into parabolic field profiles at elevated temperatures, which is the hallmark of Poiseuille flow. The curvature of the imaged profiles is qualitatively reproduced by Boltzmann calculations, which allow us to create a 'phase diagram' that characterizes the electron flow regimes. Our results provide long-sought, direct confirmation of Poiseuille flow in the solid state, and enable a new approach for exploring the rich physics of interacting electrons in real space.


title: Adaptive Influence Maximization with Myopic Feedback

abstract: We study the adaptive influence maximization problem with myopic feedback under the independent cascade model: one sequentially selects k nodes as seeds one by one from a social network, and each selected seed returns the immediate neighbors it activates as the feedback available for later selections, and the goal is to maximize the expected number of total activated nodes, referred as the influence spread. We show that the adaptivity gap, the ratio between the optimal adaptive influence spread and the optimal non-adaptive influence spread, is at most 4 and at least e/(e-1), and the approximation ratios with respect to the optimal adaptive influence spread of both the non-adaptive greedy and adaptive greedy algorithms are at least \frac{1}{4}(1 - \frac{1}{e}) and at most \frac{e^2 + 1}{(e + 1)^2} < 1 - \frac{1}{e}. Moreover, the approximation ratio of the non-adaptive greedy algorithm is no worse than that of the adaptive greedy algorithm, when considering all graphs. Our result confirms a long-standing open conjecture of Golovin and Krause (2011) on the constant approximation ratio of adaptive greedy with myopic feedback, and it also suggests that adaptive greedy may not bring much benefit under myopic feedback.


title: OICSR: Out-In-Channel Sparsity Regularization for Compact Deep Neural Networks

abstract: Channel pruning can significantly accelerate and compress deep neural networks. Many channel pruning works utilize structured sparsity regularization to zero out all the weights in some channels and automatically obtain structure-sparse network in training stage. However, these methods apply structured sparsity regularization on each layer separately where the correlations between consecutive layers are omitted. In this paper, we first combine one out-channel in current layer and the corresponding in-channel in next layer as a regularization group, namely out-in-channel. Our proposed Out-In-Channel Sparsity Regularization (OICSR) considers correlations between successive layers to further retain predictive power of the compact network. Training with OICSR thoroughly transfers discriminative features into a fraction of out-in-channels. Correspondingly, OICSR measures channel importance based on statistics computed from two consecutive layers, not individual layer. Finally, a global greedy pruning algorithm is designed to remove redundant out-in-channels in an iterative way. Our method is comprehensively evaluated with various CNN architectures including CifarNet, AlexNet, ResNet, DenseNet and PreActSeNet on CIFAR-10, CIFAR-100 and ImageNet-1K datasets. Notably, on ImageNet-1K, we reduce 37.2% FLOPs on ResNet-50 while outperforming the original model by 0.22% top-1 accuracy.


title: Sums of squares in function fields over Henselian local fields

abstract: We give upper bounds for the level and the Pythagoras number of function fields over fraction fields of integral Henselian excellent local rings. In particular, we show that the Pythagoras number of $\mathbb{R}((x_1,\dots,x_n))$ is $\leq 2^{n-1}$, which answers positively a question of Choi, Dai, Lam and Reznick.


title: Learning Dynamics of Attention: Human Prior for Interpretable Machine Reasoning

abstract: Without relevant human priors, neural networks may learn uninterpretable features. We propose Dynamics of Attention for Focus Transition (DAFT) as a human prior for machine reasoning. DAFT is a novel method that regularizes attention-based reasoning by modelling it as a continuous dynamical system using neural ordinary differential equations. As a proof of concept, we augment a state-of-the-art visual reasoning model with DAFT. Our experiments reveal that applying DAFT yields similar performance to the original model while using fewer reasoning steps, showing that it implicitly learns to skip unnecessary steps. We also propose a new metric, Total Length of Transition (TLT), which represents the effective reasoning step size by quantifying how much a given model's focus drifts while reasoning about a question. We show that adding DAFT results in lower TLT, demonstrating that our method indeed obeys the human prior towards shorter reasoning paths in addition to producing more interpretable attention maps. Our code is available at https://github.com/kakao/DAFT.


title: Nano-patterning of cuprate superconductors by masked He$^+$ ion irradiation: 3-dimensional profiles of the local critical temperature

abstract: Irradiation of cuprate high-$T_c$ superconductors with light ions of moderate energy creates point defects that lead to a reduction or full suppression of the critical temperature. By shaping the ion flux with a stencil mask, nanostructures for emerging superconducting electronics can be fabricated. The 3-dimensional shape of such defect landscapes is examined, based on calculations of full collision cascades and atom displacements. A relation between the calculated defect density and experimental values of the critical temperature $T_c$ in thin YBa$_2$Cu$_3$O$_{7-\delta}$ films is etablished that allows to determine the distribution of local $T_c$'s and its 3-dimensional visualization. The results confirm that, using 75 keV He$^+$ ion irradiation and a stencil mask, well-defined patterns of non-superconducting material in the superconducting matrix can be produced with low blurring.


title: A Framework for App Store Optimization

abstract: In this paper a framework for app store optimization is proposed. The framework is based on two main areas: developer dependent elements and user dependent elements. Developer dependent elements are similar to factors in search engine optimization. User dependent elements are similar to activities in social media. The proposed framework is modelled after downloading sample data from two leading app stores: Google Play and Apple iTunes. Results show that developer dependent elements can be better optimized. Names and descriptions of mobile apps are not fully utilized.


title: CompactNet: Platform-Aware Automatic Optimization for Convolutional Neural Networks

abstract: Convolutional Neural Network (CNN) based Deep Learning (DL) has achieved great progress in many real-life applications. Meanwhile, due to the complex model structures against strict latency and memory restriction, the implementation of CNN models on the resource-limited platforms is becoming more challenging. This work proposes a solution, called CompactNet\footnote{Project URL: \url{https://github.com/CompactNet/CompactNet}}, which automatically optimizes a pre-trained CNN model on a specific resource-limited platform given a specific target of inference speedup. Guided by a simulator of the target platform, CompactNet progressively trims a pre-trained network by removing certain redundant filters until the target speedup is reached and generates an optimal platform-specific model while maintaining the accuracy. We evaluate our work on two platforms of a mobile ARM CPU and a machine learning accelerator NPU (Cambricon-1A ISA) on a Huawei Mate10 smartphone. For the state-of-the-art slim CNN model made for the embedded platform, MobileNetV2, CompactNet achieves up to a 1.8x kernel computation speedup with equal or even higher accuracy for image classification tasks on the Cifar-10 dataset.


title: Rogue waves, self-similar statistics, and self-similar intermediate asymptotics

abstract: We advance a statistical theory of extreme event emergence in random nonlinear wave systems with self-similar intermediate asymptotics. We show, within the framework of a generic (1 + 1)D nonlinear Schrodinger equation with linear gain, that extreme events and even rogue waves in weakly nonlinear, statistical open systems emerge as parabolic-shape giant fluctuations in the self-similar asymptotic propagation regime. We analytically demonstrate the self-similar structure of the non-Gaussian statistics of emergent rogue waves and validate our results with numerical simulations. Our results shed new light on generic statistical features of extreme events in nonlinear open systems with self-similar intermediate asymptotics.


title: Purity oscillations in coupled Bose-Einstein condensates

abstract: It is shown that the distinct oscillations of the purity of the single-particle density matrix for many-body open quantum systems with balanced gain and loss reported by Dast et al. [Phys. Rev. A 93, 033617 (2016)] can also be found in closed quantum systems of which subsystems experience a gain and loss of particles. This is demonstrated with two different lattice setups for cold atoms, viz. a ring of six lattice sites with periodic boundary conditions and a linear chain of four lattice wells. In both cases pronounced purity oscillations are found, and it is shown that they can be made experimentally accessible via the average contrast in interference experiments.


title: Invertible generative models for inverse problems: mitigating representation error and dataset bias

abstract: Trained generative models have shown remarkable performance as priors for inverse problems in imaging -- for example, Generative Adversarial Network priors permit recovery of test images from 5-10x fewer measurements than sparsity priors. Unfortunately, these models may be unable to represent any particular image because of architectural choices, mode collapse, and bias in the training dataset. In this paper, we demonstrate that invertible neural networks, which have zero representation error by design, can be effective natural signal priors at inverse problems such as denoising, compressive sensing, and inpainting. Given a trained generative model, we study the empirical risk formulation of the desired inverse problem under a regularization that promotes high likelihood images, either directly by penalization or algorithmically by initialization. For compressive sensing, invertible priors can yield higher accuracy than sparsity priors across almost all undersampling ratios, and due to their lack of representation error, invertible priors can yield better reconstructions than GAN priors for images that have rare features of variation within the biased training set, including out-of-distribution natural images. We additionally compare performance for compressive sensing to unlearned methods, such as the deep decoder, and we establish theoretical bounds on expected recovery error in the case of a linear invertible model.


title: Extended supersymmetry with central charges in Dirac action with curved extra dimensions

abstract: We discuss a new realization of $\mathcal{N}$-extended quantum-mechanical supersymmetry (QM SUSY) with central charges hidden in the four-dimensional (4D) mass spectrum of higher dimensional Dirac action with curved extra dimensions. We show that this $\mathcal{N}$-extended QM SUSY results from symmetries in extra dimensions, and the supermultiplets in this supersymmetry algebra correspond to the Bogomol'nyi--Prasad--Sommerfield states. Furthermore, we examine the model of the $S^2$ extra dimension with a magnetic monopole background and confirm that the $\mathcal{N}$-extended QM SUSY explains the degeneracy of the 4D mass spectrum.


title: Constraining modified gravity with ringdown signals: an explicit example

abstract: An explicit example is found showing how a modified theory of gravity can be constrained with the ringdown signals from merger of binary black holes. This has been made possible by the fact that the modified gravitational theory considered in this work has an exact rotating black hole solution and that the corresponding quasi-normal modes can be calculated. With these, we obtain the possible constraint that can be placed on the parameter describing the deviation of this particular alternative theory from general relativity by using the detection of the ringdown signals from binary black holes's merger with future space-based gravitational wave detectors.


title: Gram-Gauss-Newton Method: Learning Overparameterized Neural Networks for Regression Problems

abstract: First-order methods such as stochastic gradient descent (SGD) are currently the standard algorithm for training deep neural networks. Second-order methods, despite their better convergence rate, are rarely used in practice due to the prohibitive computational cost in calculating the second-order information. In this paper, we propose a novel Gram-Gauss-Newton (GGN) algorithm to train deep neural networks for regression problems with square loss. Our method draws inspiration from the connection between neural network optimization and kernel regression of neural tangent kernel (NTK). Different from typical second-order methods that have heavy computational cost in each iteration, GGN only has minor overhead compared to first-order methods such as SGD. We also give theoretical results to show that for sufficiently wide neural networks, the convergence rate of GGN is \emph{quadratic}. Furthermore, we provide convergence guarantee for mini-batch GGN algorithm, which is, to our knowledge, the first convergence result for the mini-batch version of a second-order method on overparameterized neural networks. Preliminary experiments on regression tasks demonstrate that for training standard networks, our GGN algorithm converges much faster and achieves better performance than SGD.


title: Sparse Estimation of Historical Functional Linear Models with a Nested Group Bridge Approach

abstract: The conventional historical functional linear model relates the current value of the functional response at time t to all past values of the functional covariate up to time t. Motivated by situations where it is more reasonable to assume that only recent, instead of all, past values of the functional covariate have an impact on the functional response, we investigate in this work the historical functional linear model with an unknown forward time lag into the history. Besides the common goal of estimating the bivariate regression coefficient function, we also aim to identify the historical time lag from the data, which is important in many applications. Tailored for this purpose, we propose an estimation procedure adopting the finite element method to conform naturally to the trapezoidal domain of the bivariate coefficient function. A nested group bridge penalty is developed to provide simultaneous estimation of the bivariate coefficient function and the historical lag. The method is demonstrated in a real data example investigating the effect of muscle activation recorded via the noninvasive electromyography (EMG) method on lip acceleration during speech production. The finite sample performance of our proposed method is examined via simulation studies in comparison with the conventional method.


title: Results on Multiple Coulomb Scattering from 12 and 20 GeV electrons on Carbon targets

abstract: Multiple scattering effects of 12 and 20 GeV electrons on 8 and 20 mm thickness carbon targets have been studied with high-resolution silicon microstrip detectors of the UA9 apparatus at the H8 line at CERN. Comparison of the scattering angle between data and GEANT4 simulation shows excellent agreement in the core of the distributions leaving some residual disagreement in the tails.


title: EEG-based Emotional Video Classification via Learning Connectivity Structure

abstract: Electroencephalography (EEG) is a useful way to implicitly monitor the users perceptual state during multimedia consumption. One of the primary challenges for the practical use of EEG-based monitoring is to achieve a satisfactory level of accuracy in EEG classification. Connectivity between different brain regions is an important property for the classification of EEG. However, how to define the connectivity structure for a given task is still an open problem, because there is no ground truth about how the connectivity structure should be in order to maximize the classification performance. In this paper, we propose an end-to-end neural network model for EEG-based emotional video classification, which can extract an appropriate multi-layer graph structure and signal features directly from a set of raw EEG signals and perform classification using them. Experimental results demonstrate that our method yields improved performance in comparison to the existing approaches where manually defined connectivity structures and signal features are used. Furthermore, we show that the graph structure extraction process is reliable in terms of consistency, and the learned graph structures make much sense in the viewpoint of emotional perception occurring in the brain.


title: Online Measurement-Based Estimation of Dynamic System State Matrix in Ambient Conditions

abstract: In this paper, a purely measurement-based method is proposed to estimate the dynamic system state matrix by applying the regression theorem of the multivariate Ornstein-Uhlenbeck process. The proposed method employs a recursive algorithm to minimize the required computational effort, making it applicable to the real-time environment. One main advantage of the proposed method is model independence, i.e., it is independent of the network model and the dynamic model of generators. Among various applications of the estimated matrix, detecting and locating unexpected network topology change is illustrated in details. Simulation studies have shown that the proposed measurement-based method can provide an accurate and efficient estimation of the dynamic system state matrix under the occurrence of unexpected topology change. Besides, various implementation conditions are tested to show that the proposed method can provide accurate approximation despite measurement noise, missing PMUs, and the implementation of higher-order generator models with control devices.


title: Computational Aspects of Equilibria in Discrete Preference Games

abstract: We study the complexity of equilibrium computation in discrete preference games. These games were introduced by Chierichetti, Kleinberg, and Oren (EC '13, JCSS '18) to model decision-making by agents in a social network that choose a strategy from a finite, discrete set, balancing between their intrinsic preferences for the strategies and their desire to choose a strategy that is `similar' to their neighbours. There are thus two components: a social network with the agents as vertices, and a metric space of strategies. These games are potential games, and hence pure Nash equilibria exist. Since their introduction, a number of papers have studied various aspects of this model, including the social cost at equilibria, and arrival at a consensus. We show that in general, equilibrium computation in discrete preference games is PLS-complete, even in the simple case where each agent has a constant number of neighbours. If the edges in the social network are weighted, then the problem is PLS-complete even if each agent has a constant number of neighbours, the metric space has constant size, and every pair of strategies is at distance 1 or 2. Further, if the social network is directed, modelling asymmetric influence, an equilibrium may not even exist. On the positive side, we show that if the metric space is a tree metric, or is the product of path metrics, then the equilibrium can be computed in polynomial time.


title: Validating the Validation: Reanalyzing a large-scale comparison of Deep Learning and Machine Learning models for bioactivity prediction

abstract: Machine learning methods may have the potential to significantly accelerate drug discovery. However, the increasing rate of new methodological approaches being published in the literature raises the fundamental question of how models should be benchmarked and validated. We reanalyze the data generated by a recently published large-scale comparison of machine learning models for bioactivity prediction and arrive at a somewhat different conclusion. We show that the performance of support vector machines is competitive with that of deep learning methods. Additionally, using a series of numerical experiments, we question the relevance of area under the receiver operating characteristic curve as a metric in virtual screening, and instead suggest that area under the precision-recall curve should be used in conjunction with the receiver operating characteristic. Our numerical experiments also highlight challenges in estimating the uncertainty in model performance via scaffold-split nested cross validation.