title: Performance / Complexity Trade-offs of the Sphere Decoder Algorithm for Massive MIMO Systems

abstract: Massive MIMO systems are seen by many researchers as a paramount technology toward next generation networks. This technology consists of hundreds of antennas that are capable of sending and receiving simultaneously a huge amount of data. One of the main challenges when using this technology is the necessity of an efficient decoding framework. The latter must guarantee both a low complexity and a good signal detection accuracy. The Sphere Decoder (SD) algorithm represents one of the promising decoding algorithms in terms of detection accuracy. However, it is inefficient for dealing with large MIMO systems due to its prohibitive complexity. To overcome this drawback, we propose to revisit the sequential SD algorithm and implement several variants that aim at finding appropriate trade-offs between complexity and performance. Then, we propose an efficient high-level parallel SD scheme based on the master/worker paradigm, which permits multiple SD instances to simultaneously explore the search space, while mitigating the overheads from load imbalance. The results of our parallel SD implementation outperform the state-of-the-art by more than 5x using similar MIMO configuration systems, and show a super-linear speedup on multicore platforms. Moreover, this paper presents a new hybrid implementation that combines the strengths of SD and K-best algorithms, i.e., maintaining the detection accuracy of SD, while reducing the complexity using the K-best way of pruning search space. The hybrid approach extends our parallel SD implementation: the master contains the SD search tree, and the workers use the K-best algorithm to accelerate its exploration. The resulting hybrid approach enhances the diversification gain, and therefore, lowers the overall complexity. Our synergistic hybrid approach permits to deal with large MIMO configurations up to 100x100, without sacrificing the accuracy and complexity.


title: A Short Lecture on Topological Crystallography and a Discrete Surface Theory

abstract: This is an unrefereed lecture note based on lectures in 'Introductory Workshop on Discrete Differential Geometry' at Korea University on January 21--24, 2019. In this note, we discuss topological crystallography, which is a mathematical theory of crystal structures. The most symmetric structure among all placements of the graph is obtained by a variational principle in topological crystallography. We also discuss a theory of trivalent discrete surfaces in $3$-dimensional Euclidean space, which are mathematical models of crystal/molecular structures.


title: Structure-Preserving and Efficient Numerical Methods for Ion Transport

abstract: Ion transport, often described by the Poisson--Nernst--Planck (PNP) equations, is ubiquitous in electrochemical devices and many biological processes of significance. In this work, we develop conservative, positivity-preserving, energy dissipating, and implicit finite difference schemes for solving the multi-dimensional PNP equations with multiple ionic species. A central-differencing discretization based on harmonic-mean approximations is employed for the Nernst--Planck (NP) equations. The backward Euler discretization in time is employed to derive a fully implicit nonlinear system, which is efficiently solved by a newly proposed Newton's method. The improved computational efficiency of the Newton's method originates from the usage of the electrostatic potential as the iteration variable, rather than the unknowns of the nonlinear system that involves both the potential and concentration of multiple ionic species. Numerical analysis proves that the numerical schemes respect three desired analytical properties (conservation, positivity preserving, and energy dissipation) fully discretely. Based on advantages brought by the harmonic-mean approximations, we are able to establish estimate on the upper bound of condition numbers of coefficient matrices in linear systems that are solved iteratively. The solvability and stability of the linearized problem in the Newton's method are rigorously established as well. Numerical tests are performed to confirm the anticipated numerical accuracy, computational efficiency, and structure-preserving properties of the developed schemes. Adaptive time stepping is implemented for further efficiency improvement. Finally, the proposed numerical approaches are applied to characterize ion transport subject to a sinusoidal applied potential.


title: Towards Robust and Reproducible Active Learning Using Neural Networks

abstract: Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL methods use different heuristics to accomplish this goal. In this study, we demonstrate that under identical experimental settings, different types of AL algorithms (uncertainty based, diversity based, and committee based) produce an inconsistent gain over random sampling baseline. Through a variety of experiments, controlling for sources of stochasticity, we show that variance in performance metrics achieved by AL algorithms can lead to results that are not consistent with the previously reported results. We also found that under strong regularization, AL methods show marginal or no advantage over the random sampling baseline under a variety of experimental conditions. Finally, we conclude with a set of recommendations on how to assess the results using a new AL algorithm to ensure results are reproducible and robust under changes in experimental conditions. We share our codes to facilitate AL evaluations. We believe our findings and recommendations will help advance reproducible research in AL using neural networks. We open source our code at https://github.com/PrateekMunjal/TorchAL


title: Adversarial Attacks on Machine Learning Systems for High-Frequency Trading

abstract: Algorithmic trading systems are often completely automated, and deep learning is increasingly receiving attention in this domain. Nonetheless, little is known about the robustness properties of these models. We study valuation models for algorithmic trading from the perspective of adversarial machine learning. We introduce new attacks specific to this domain with size constraints that minimize attack costs. We further discuss how these attacks can be used as an analysis tool to study and evaluate the robustness properties of financial models. Finally, we investigate the feasibility of realistic adversarial attacks in which an adversarial trader fools automated trading systems into making inaccurate predictions.


title: Decay Properties of Conventional and Hybrid Charmonium Mesons

abstract: In this paper, Schrodinger equation is numerically applied through non-relativistic potential model for deriving Spectrum, radial wave functions at origin, decay constants, lepton and photon decay widths for radial and orbital excited conventional as well as hybrid charmonium mesons. These calculated results are found in agreement with others theoretical results and with the experimental observations.


title: Nonlinear behavior of RC shear walls: From experiments to the field reports

abstract: Post-earthquake damage evaluation has indicated that although the buildings with shear walls exhibited an appropriate overall performance in the recent severe earthquakes, in some cases, however, the columns and the shear walls were damaged, due to the presence of short structural elements and inadequate transverse reinforcement. Such memories amongst engineers have promoted this attitude that the shear walls structures exhibit a brittle overall performance. So the conviction that shear walls are inherently brittle still prevails amongst engineers, and therefore, they usually prefer to choose moment-resisting RC frames without shear walls. For getting an insight into the nonlinear behavior of RC shear walls, we have reviewed the experiments conducted on the RC shear walls. Besides, through using the post-earthquake reports written after major earthquakes, we have checked and scrutinized the seismic performance of RC frames equipped with shear walls too. Investigations performed on the nonlinear behavior of the shear walls have demonstrated that slender shear walls, designed to fail in flexural mode, could safely dissipate excitations energy of the earthquakes. These studies also revealed that even squat shear walls can be designed in a way that their behavior would be similar to those of the slender walls. Considering these matters, designed shear walls according to the recent codes maintain sufficient shear strength and respectable energy dissipation capability.


title: Assessing randomness with the aid of quantum state measurement

abstract: Randomness is a valuable resource in science, cryptography, engineering, and information technology. Quantum-mechanical sources of randomness are attractive because of the indeterminism of individual quantum processes. Here we consider the production of random bits from polarization measurements on photons. We first present a pedagogical discussion of how the quantum randomness inherent in such measurements is connected to quantum coherence, and how it can be quantified in terms of the quantum state and an associated entropy value known as min-entropy. We then explore these concepts by performing a series of single-photon experiments that are suitable for the undergraduate laboratory. We prepare photons in different nonentangled and entangled states, and measure these states tomographically. We use the information about the quantum state to determine, in terms of the min-entropy, the minimum amount of randomness produced from a given photon state by different bit-generating measurements. This is helpful in assessing the presence of quantum randomness and in ensuring the quality and security of the random-bit source.


title: Trapping of swimmers in a vortex lattice

abstract: We examine the motion of rigid, ellipsoidal swimmers subjected to a steady vortex flow in two dimensions. Numerical simulations of swimmers in a spatially periodic array of vortices reveal a range of possible behaviors, including trapping inside a single vortex and motility-induced diffusion across many vortices. While the trapping probability vanishes at a sufficiently high swimming speed, we find that it exhibits surprisingly large oscillations as this critical swimming speed is approached. Strikingly, at even higher swimming speeds, we find swimmers that swim perpendicular to their elongation direction can again become trapped. To explain this complex behavior, we investigate the underlying swimmer phase-space geometry. We identify the fixed points and periodic orbits of the swimmer equations of motion that regulate swimmer trapping inside a single vortex cell. For low to intermediate swimming speeds, we find that a stable periodic orbit surrounded by invariant tori forms a transport barrier to swimmers and can trap them inside individual vortices. For swimming speeds approaching the maximum fluid speed, we find instead that perpendicular swimmers can be trapped by asymptotically stable fixed points. A bifurcation analysis of the stable periodic orbit and the fixed points explains the complex and non-monotonic breakdown and reemergence of swimmer trapping as the swimmer speed and shape are varied.


title: Feedback game on Eulerian graphs

abstract: In this paper, we introduce a two-player impartial game on graphs, called a {\em feedback game}, which is a variant of the generalized geography. We study the feedback game on Eulerian graphs. In particular, we show that the PSPACE-completeness of the game and determine the winner of the game on several classes of Eulerian graphs.


title: Learning to Continually Learn

abstract: Continual lifelong learning requires an agent or model to learn many sequentially ordered tasks, building on previous knowledge without catastrophically forgetting it. Much work has gone towards preventing the default tendency of machine learning models to catastrophically forget, yet virtually all such work involves manually-designed solutions to the problem. We instead advocate meta-learning a solution to catastrophic forgetting, allowing AI to learn to continually learn. Inspired by neuromodulatory processes in the brain, we propose A Neuromodulated Meta-Learning Algorithm (ANML). It differentiates through a sequential learning process to meta-learn an activation-gating function that enables context-dependent selective activation within a deep neural network. Specifically, a neuromodulatory (NM) neural network gates the forward pass of another (otherwise normal) neural network called the prediction learning network (PLN). The NM network also thus indirectly controls selective plasticity (i.e. the backward pass of) the PLN. ANML enables continual learning without catastrophic forgetting at scale: it produces state-of-the-art continual learning performance, sequentially learning as many as 600 classes (over 9,000 SGD updates).


title: The Break-Even Point on Optimization Trajectories of Deep Neural Networks

abstract: The early phase of training of deep neural networks is critical for their final performance. In this work, we study how the hyperparameters of stochastic gradient descent (SGD) used in the early phase of training affect the rest of the optimization trajectory. We argue for the existence of the "break-even" point on this trajectory, beyond which the curvature of the loss surface and noise in the gradient are implicitly regularized by SGD. In particular, we demonstrate on multiple classification tasks that using a large learning rate in the initial phase of training reduces the variance of the gradient, and improves the conditioning of the covariance of gradients. These effects are beneficial from the optimization perspective and become visible after the break-even point. Complementing prior work, we also show that using a low learning rate results in bad conditioning of the loss surface even for a neural network with batch normalization layers. In short, our work shows that key properties of the loss surface are strongly influenced by SGD in the early phase of training. We argue that studying the impact of the identified effects on generalization is a promising future direction.


title: Causal structure learning from time series: Large regression coefficients may predict causal links better in practice than small p-values

abstract: In this article, we describe the algorithms for causal structure learning from time series data that won the Causality 4 Climate competition at the Conference on Neural Information Processing Systems 2019 (NeurIPS). We examine how our combination of established ideas achieves competitive performance on semi-realistic and realistic time series data exhibiting common challenges in real-world Earth sciences data. In particular, we discuss a) a rationale for leveraging linear methods to identify causal links in non-linear systems, b) a simulation-backed explanation as to why large regression coefficients may predict causal links better in practice than small p-values and thus why normalising the data may sometimes hinder causal structure learning. For benchmark usage, we detail the algorithms here and provide implementations at https://github.com/sweichwald/tidybench . We propose the presented competition-proven methods for baseline benchmark comparisons to guide the development of novel algorithms for structure learning from time series.


title: Coded Federated Learning

abstract: Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the local models for a global view, without requiring sharing of training data. The convergence performance of federated learning is severely impacted in heterogeneous computing platforms such as those at the wireless edge, where straggling computations and communication links can significantly limit timely model parameter updates. This paper develops a novel coded computing technique for federated learning to mitigate the impact of stragglers. In the proposed Coded Federated Learning (CFL) scheme, each client device privately generates parity training data and shares it with the central server only once at the start of the training phase. The central server can then preemptively perform redundant gradient computations on the composite parity data to compensate for the erased or delayed parameter updates. Our results show that CFL allows the global model to converge nearly four times faster when compared to an uncoded approach


title: A Multi-Channel Neural Graphical Event Model with Negative Evidence

abstract: Event datasets are sequences of events of various types occurring irregularly over the time-line, and they are increasingly prevalent in numerous domains. Existing work for modeling events using conditional intensities rely on either using some underlying parametric form to capture historical dependencies, or on non-parametric models that focus primarily on tasks such as prediction. We propose a non-parametric deep neural network approach in order to estimate the underlying intensity functions. We use a novel multi-channel RNN that optimally reinforces the negative evidence of no observable events with the introduction of fake event epochs within each consecutive inter-event interval. We evaluate our method against state-of-the-art baselines on model fitting tasks as gauged by log-likelihood. Through experiments on both synthetic and real-world datasets, we find that our proposed approach outperforms existing baselines on most of the datasets studied.


title: UnMask: Adversarial Detection and Defense Through Robust Feature Alignment

abstract: Deep learning models are being integrated into a wide range of high-impact, security-critical systems, from self-driving cars to medical diagnosis. However, recent research has demonstrated that many of these deep learning architectures are vulnerable to adversarial attacks--highlighting the vital need for defensive techniques to detect and mitigate these attacks before they occur. To combat these adversarial attacks, we developed UnMask, an adversarial detection and defense framework based on robust feature alignment. The core idea behind UnMask is to protect these models by verifying that an image's predicted class ("bird") contains the expected robust features (e.g., beak, wings, eyes). For example, if an image is classified as "bird", but the extracted features are wheel, saddle and frame, the model may be under attack. UnMask detects such attacks and defends the model by rectifying the misclassification, re-classifying the image based on its robust features. Our extensive evaluation shows that UnMask (1) detects up to 96.75% of attacks, and (2) defends the model by correctly classifying up to 93% of adversarial images produced by the current strongest attack, Projected Gradient Descent, in the gray-box setting. UnMask provides significantly better protection than adversarial training across 8 attack vectors, averaging 31.18% higher accuracy. We open source the code repository and data with this paper: https://github.com/safreita1/unmask.


title: Emulating duration and curvature of coral snake anti-predator thrashing behaviors using a soft-robotic platform

abstract: This paper presents a soft-robotic platform for exploring the ecological relevance of non-locomotory movements via animal-robot interactions. Coral snakes (genus Micrurus) and their mimics use vigorous, non-locomotory, and arrhythmic thrashing to deter predation. There is variation across snake species in the duration and curvature of anti-predator thrashes, and it is unclear how these aspects of motion interact to contribute to snake survival. In this work, soft robots composed of fiber-reinforced elastomeric enclosures (FREEs) are developed to emulate the anti-predator behaviors of three genera of snake. Curvature and duration of motion are estimated for both live snakes and robots, providing a quantitative assessment of the robots' ability to emulate snake poses. The curvature values of the fabricated soft-robotic head, midsection, and tail segments are found to overlap with those exhibited by live snakes. Soft robot motion durations were less than or equal to those of snakes for all three genera. Additionally, combinations of segments were selected to emulate three specific snake genera with distinct anti-predatory behavior, producing curvature values that aligned well with live snake observations.


title: Scores for Multivariate Distributions and Level Sets

abstract: Forecasts of multivariate probability distributions are required for a variety of applications. Scoring rules enable the evaluation of forecast accuracy, and comparison between forecasting methods. We propose a theoretical framework for scoring rules for multivariate distributions, which encompasses the existing quadratic score and multivariate continuous ranked probability score. We demonstrate how this framework can be used to generate new scoring rules. In some multivariate contexts, it is a forecast of a level set that is needed, such as a density level set for anomaly detection or the level set of the cumulative distribution as a measure of risk. This motivates consideration of scoring functions for such level sets. For univariate distributions, it is well-established that the continuous ranked probability score can be expressed as the integral over a quantile score. We show that, in a similar way, scoring rules for multivariate distributions can be decomposed to obtain scoring functions for level sets. Using this, we present scoring functions for different types of level set, including density level sets and level sets for cumulative distributions. To compute the scores, we propose a simple numerical algorithm. We perform a simulation study to support our proposals, and we use real data to illustrate usefulness for forecast combining and CoVaR estimation.


title: Robustness to Programmable String Transformations via Augmented Abstract Training

abstract: Deep neural networks for natural language processing tasks are vulnerable to adversarial input perturbations. In this paper, we present a versatile language for programmatically specifying string transformations -- e.g., insertions, deletions, substitutions, swaps, etc. -- that are relevant to the task at hand. We then present an approach to adversarially training models that are robust to such user-defined string transformations. Our approach combines the advantages of search-based techniques for adversarial training with abstraction-based techniques. Specifically, we show how to decompose a set of user-defined string transformations into two component specifications, one that benefits from search and another from abstraction. We use our technique to train models on the AG and SST2 datasets and show that the resulting models are robust to combinations of user-defined transformations mimicking spelling mistakes and other meaning-preserving transformations.


title: Polarizing Front Ends for Robust CNNs

abstract: The vulnerability of deep neural networks to small, adversarially designed perturbations can be attributed to their "excessive linearity." In this paper, we propose a bottom-up strategy for attenuating adversarial perturbations using a nonlinear front end which polarizes and quantizes the data. We observe that ideal polarization can be utilized to completely eliminate perturbations, develop algorithms to learn approximately polarizing bases for data, and investigate the effectiveness of the proposed strategy on the MNIST and Fashion MNIST datasets.


title: Extracting and Validating Explanatory Word Archipelagoes using Dual Entropy

abstract: The logical connectivity of text is represented by the connectivity of words that form archipelagoes. Here, each archipelago is a sequence of islands of the occurrences of a certain word. An island here means the local sequence of sentences where the word is emphasized, and an archipelago of a length comparable to the target text is extracted using the co-variation of entropy A (the window-based entropy) on the distribution of the word's occurrences with the width of each time window. Then, the logical connectivity of text is evaluated on entropy B (the graph-based entropy) computed on the distribution of sentences to connected word-clusters obtained on the co-occurrence of words. The results show the parts of the target text with words forming archipelagoes extracted on entropy A, without learned or prepared knowledge, form an explanatory part of the text that is of smaller entropy B than the parts extracted by the baseline methods.


title: The growth of the discriminant of the endomorphism ring of the reduction of a rank 2 generic Drinfeld module

abstract: Let $\psi: A \to F\{\tau\}$ be a Drinfeld $A$-module over $F$ of rank 2 and without complex multiplication, where $A = {\mathbb{F}}_q[T]$, $F = {\mathbb{F}}_q(T)$, and $q$ is an odd prime power. For a prime $\mathfrak{p} = p A$ of $A$ of good reduction for $\psi$ and with residue field ${\mathbb{F}}_{\mathfrak{p}}$, we study the growth of the absolute value $|\Delta_{\mathfrak{p}}|$ of the discriminant of the ${\mathbb{F}}_{\mathfrak{p}}$-endomorphism ring of the reduction of $\psi$ modulo $\mathfrak{p}$. We prove that for all $\mathfrak{p}$, $|\Delta_{\mathfrak{p}}|$ grows with $|p|$. Moreover, we prove that for a density 1 of primes $\mathfrak{p}$, $|\Delta_{\mathfrak{p}}|$ is as close as possible to its upper bound $|a_{\mathfrak{p}}^2 - 4 \mu_{\mathfrak{p}}p|$, where $X^2+a_{\mathfrak{p}}X+\mu_{\mathfrak{p}} p \in A[X]$ is the characteristic polynomial of $\tau^{\text{deg} \ p}$.


title: Mixing effects of $\Sigma^0-\Lambda^0$ in $\Lambda_c^+$ decays

abstract: We analyze the mixing between $\Sigma^0$ and $\Lambda^0$ based on the baryon masses. We distinguish the contributions from QCD and QED in the baryon mass splittings. We find that the mixing angle between $\Sigma^0$ and $\Lambda^0$ is $(2.07\pm 0.03)\times 10^{-2} $, which leads to the decay branching fraction and up-down asymmetry of $\Lambda_c^+ \to \Sigma^0 e^+ \nu_e$ to be ${\cal B}(\Lambda_c^+ \to \Sigma^0 e^+ \nu_e)=(1.5\pm 0.2)\times 10^{-5}$ and $\alpha(\Lambda_c^+ \to \Sigma^0 e^+ \nu_e)=-0.86\pm 0.04$, respectively. Moreover, we obtain that $\Delta {\cal B}\equiv {\cal B}(\Lambda_c^+\to \Sigma^0 \pi^+) - {\cal B}(\Lambda_c^+\to \Sigma^+\pi^0)=(3.8\pm 0.5)\times 10^{-4}$ and $\Delta \alpha \equiv\alpha(\Lambda_c^+\to \Sigma^0 \pi^+) -\alpha(\Lambda_c^+\to \Sigma^+\pi^0)=(-1.6\pm 0.7)\times10^{-2}$, which should vanish without the mixing.


title: Cavity ring-down spectroscopy of CO$_2$ near $\lambda$ = 2.06 $\mu$m: Accurate transition intensities for the Orbiting Carbon Observatory-2 (OCO-2) "strong band"

abstract: The $\lambda$ = 2.06 $\mu$m absorption band of CO$_2$ is widely used for the remote sensing of atmospheric carbon dioxide, making it relevant to many important top-down measurements of carbon flux. The forward models used in the retrieval algorithms employed in these measurements require increasingly accurate line intensity and line shape data from which absorption cross-sections can be computed. To overcome accuracy limitations of existing line lists, we used frequency-stabilized cavity ring-down spectroscopy to measure 39 transitions in the $^{12}$C$^{16}$O$_2$ absorption band. The line intensities were measured with an estimated relative combined standard uncertainty of $u_r$ = 0.08 %. We predict the $J$-dependence of the measured intensities using two theoretical modesl: a one-dimensional spectroscopic model with Herman-Wallis rotation-vibration corrections, and a line-by-line ab initio dipole moment surface model [Zak et al. JQSRT 2016;177:31-42]. For the second approach, we fit only a single factor to rescale the theoretical integrated band intensity to be consistent with the measured intensities. We find that the latter approach yields an equally adequate representation of the fitted $J$-dependent intensity data and provides the most physically general representation of the results. Our recommended value for the integrated band intensity equal to 7.183$\times$10$^{-21}$ cm molecule$^{-1}$ $\pm$ 6$\times$10$^{-24}$ cm molecule$^{-1}$ is based on the rescaled ab initio model and corresponds to a fitted scale factor of 1.0069 $\pm$ 0.0002. Comparisons of literature intensity values to our results reveal systematic deviations ranging from $-$1.16 % to +0.33 %.

categories: physics.atom-ph astro-ph.EP astro-ph.IM physics.ao-ph physics.chem-ph physics.ins-det


title: Studies on charging-up of single Gas Electron Multiplier

abstract: Mechanisms of charging-up and charging-down of Gas Electron Multiplier (GEM) have been studied. Experimental investigations have been carried out on both dielectric polarization and radiation charging of GEMs. Environmental parameters, such as pressure and temperature have been monitored to normalize their effects on the charging-up and charging-down measurements. Variation in gain due to the combined, as well as individual, effects of the mentioned parameters has been illustrated.


title: Heat radiation reduction in the cryostat with multilayer insulation technique

abstract: Multilayer insulation (MLI) is an important technique for the reduction of radiation heat load in cryostats. The present work is focused on investigation for the selection of suitable reflective layer and spacer material in MLI systems. In our analysis, we have selected perforated double-Aluminized Mylar (DAM) with Dacron, unperforated DAM with Silk-net and perforated DAM with Glass-tissue for their evaluation as the reflective layer as well as spacer materials in MLI technique. Current work would discuss the calculation of the effect of layer density and the number of layers on the heat load. Knowing the key parameters of MLI, we have compared the heat load generation in spherical as well as cylindrical cryostats and the effect of layering near and outer surface on the heat load.


title: The Sample Complexity of Meta Sparse Regression

abstract: This paper addresses the meta-learning problem in sparse linear regression with infinite tasks. We assume that the learner can access several similar tasks. The goal of the learner is to transfer knowledge from the prior tasks to a similar but novel task. For p parameters, size of the support set k , and l samples per task, we show that T \in O (( k log(p) ) /l ) tasks are sufficient in order to recover the common support of all tasks. With the recovered support, we can greatly reduce the sample complexity for estimating the parameter of the novel task, i.e., l \in O (1) with respect to T and p . We also prove that our rates are minimax optimal. A key difference between meta-learning and the classical multi-task learning, is that meta-learning focuses only on the recovery of the parameters of the novel task, while multi-task learning estimates the parameter of all tasks, which requires l to grow with T . Instead, our efficient meta-learning estimator allows for l to be constant with respect to T (i.e., few-shot learning).


title: Subcritical Hopf Bifurcations in the FitzHugh-Nagumo Model

abstract: It had been shown that the transition from a rigidly rotating spiral wave to a meandering spiral wave is via a Hopf bifurcation. Many studies have shown that these bifurcations are supercritical, but we present numerical studies which show that subcritical bifurcations are also present within FitzHugh-Nagumo. Furthermore, we present a evidence that this bifurcation is highly sensitive to initial conditions, and it is possible to convert one solution in the hysteresis loop to the other.


title: SURF: A Simple, Universal, Robust, Fast Distribution Learning Algorithm

abstract: Sample- and computationally-efficient distribution estimation is a fundamental tenet in statistics and machine learning. We present SURF, an algorithm for approximating distributions by piecewise polynomials. SURF is: simple, replacing prior complex optimization techniques by straight-forward {empirical probability} approximation of each potential polynomial piece {through simple empirical-probability interpolation}, and using plain divide-and-conquer to merge the pieces; universal, as well-known polynomial-approximation results imply that it accurately approximates a large class of common distributions; robust to distribution mis-specification as for any degree $d \le 8$, it estimates any distribution to an $\ell_1$ distance $< 3$ times that of the nearest degree-$d$ piecewise polynomial, improving known factor upper bounds of 3 for single polynomials and 15 for polynomials with arbitrarily many pieces; fast, using optimal sample complexity, running in near sample-linear time, and if given sorted samples it may be parallelized to run in sub-linear time. In experiments, SURF outperforms state-of-the art algorithms.

categories: stat.ML cs.IT cs.LG math.IT math.ST stat.TH


title: On non-selfadjoint operators with finite discrete spectrum

abstract: We consider some compact non-selfadjoint perturbations of fibered one-dimensional discrete Schr\"odinger operators. We show that the perturbed operator exhibits finite discrete spectrum under suitable\- regularity conditions.


title: Dynamics of large scale networks following a merger

abstract: We study the dynamic network of relationships among avatars in the massively multiplayer online game Planetside 2. In the spring of 2014, two separate servers of this game were merged, and as a result, two previously distinct networks were combined into one. We observed the evolution of this network in the seven month period following the merger and report our observations. We found that some structures of original networks persist in the combined network for a long time after the merger. As the original avatars are gradually removed, these structures slowly dissolve, but they remain observable for a surprisingly long time. We present a number of visualizations illustrating the post-merger dynamics and discuss time evolution of selected quantities characterizing the topology of the network.


title: Adiabatic ground state preparation in an expanding lattice

abstract: We implement and characterize a numerical algorithm inspired by the $s$-source framework [Phys. Rev.~B 93, 045127 (2016)] for building a quantum many-body ground state wavefunction on a lattice of size $2L$ by applying adiabatic evolution to the corresponding ground state at size $L$, along with $L$ interleaved ancillae. The procedure can in principle be iterated to repeatedly double the size of the system. We implement the algorithm for several one dimensional spin model Hamiltonians, and find that the construction works particularly well when the gap is large and, interestingly, at scale invariant critical points. We explain this feature as a natural consequence of the lattice expansion procedure. This behavior holds for both the integrable transverse-field Ising model and non-integrable variations. We also develop an analytic perturbative understanding of the errors deep in either phase of the transverse field Ising model, and suggest how the circuit could be modified to parametrically reduce errors. In addition to sharpening our perspective on entanglement renormalization in 1D, the algorithm could also potentially be used to build states experimentally, enabling the realization of certain long-range correlated states with low depth quantum circuits.


title: Oscillating Strange Quark Matter Objects Excited in Stellar Systems

abstract: It is shown that strange quark matter (SQM) objects, stars, and planets, can very efficiently convert the mechanical energy into hadronic energy when they oscillate. This is because the mass density at the edge of SQM objects, $\rho_0{=}4.7{\times}10^{14}\frac{\mathrm{g}}{\mathrm{cm}^3}$, is the critical density below which SQM is unstable with respect to decay into photons, hadrons, and leptons. We consider here radial oscillations of SQM objects that could be induced in stellar or planetary systems where tidal interactions are ubiquitous. Oscillations of $0.1\%$ radius amplitude already result in $1\,$keV per unit baryon number excitation near the surface of SQM stars. The excitation energy is converted into electromagnetic energy in a short time of 1 ms, during a few oscillations. Higher amplitude oscillations result in faster energy release that could lead to fragmentation or dissolution of SQM stars. This would have significant consequences for hypothetical SQM star binaries and planetary systems of SQM planets with regard to gravitational wave emission.


title: One-Class Graph Neural Networks for Anomaly Detection in Attributed Networks

abstract: Nowadays, graph-structured data are increasingly used to model complex systems. Meanwhile, detecting anomalies from graph has become a vital research problem of pressing societal concerns. Anomaly detection is an unsupervised learning task of identifying rare data that differ from the majority. As one of the dominant anomaly detection algorithms, One Class Support Vector Machine has been widely used to detect outliers. However, those traditional anomaly detection methods lost their effectiveness in graph data. Since traditional anomaly detection methods are stable, robust and easy to use, it is vitally important to generalize them to graph data. In this work, we propose One Class Graph Neural Network (OCGNN), a one-class classification framework for graph anomaly detection. OCGNN is designed to combine the powerful representation ability of Graph Neural Networks along with the classical one-class objective. Compared with other baselines, OCGNN achieves significant improvements in extensive experiments.


title: The Pragmatic Turn in Explainable Artificial Intelligence (XAI)

abstract: In this paper I argue that the search for explainable models and interpretable decisions in AI must be reformulated in terms of the broader project of offering a pragmatic and naturalistic account of understanding in AI. Intuitively, the purpose of providing an explanation of a model or a decision is to make it understandable to its stakeholders. But without a previous grasp of what it means to say that an agent understands a model or a decision, the explanatory strategies will lack a well-defined goal. Aside from providing a clearer objective for XAI, focusing on understanding also allows us to relax the factivity condition on explanation, which is impossible to fulfill in many machine learning models, and to focus instead on the pragmatic conditions that determine the best fit between a model and the methods and devices deployed to understand it. After an examination of the different types of understanding discussed in the philosophical and psychological literature, I conclude that interpretative or approximation models not only provide the best way to achieve the objectual understanding of a machine learning model, but are also a necessary condition to achieve post-hoc interpretability. This conclusion is partly based on the shortcomings of the purely functionalist approach to post-hoc interpretability that seems to be predominant in most recent literature.


title: Graded Bourbaki ideals of graded modules

abstract: In this paper we study graded Bourbaki ideals. It is a well-known fact that for torsionfree modules over Noetherian normal domains, Bourbaki sequences exist. We give criteria in terms of certain attached matrices for a homomorphism of modules to induce a Bourbaki sequence. Special attention is given to graded Bourbaki sequences. In the second part of the paper, we apply these results to the Koszul cycles of the residue class field and determine particular Bourbaki ideals explicitly. We also obtain in a special case the relationship between the structure of the Rees algebra of a Koszul cycle and the Rees algebra of its Bourbaki ideal.


title: On Layered Fan-Planar Graph Drawings

abstract: In this paper, we study fan-planar drawings that use $h$ layers and are proper, i.e., edges connect adjacent layers. We show that if the embedding of the graph is fixed, then testing the existence of such drawings is fixed-parameter tractable in $h$, via a reduction to a similar result for planar graphs by Dujmovi\'{c} et al. If the embedding is not fixed, then we give partial results for $h=2$: It was already known how to test existence of fan-planar proper 2-layer drawings for 2-connected graphs, and we show here how to test this for trees. Along the way, we exhibit other interesting results for graphs with a fan-planar proper $h$-layer drawings; in particular we bound their pathwidth and show that they have a bar-1-visibility representation.


title: A characterization of proportionally representative committees

abstract: A well-known axiom for proportional representation is Proportionality of Solid Coalitions (PSC). We characterize committees satisfying PSC as possible outcomes of the Minimal Demand rule, which generalizes an approach pioneered by Michael Dummett.


title: Training Question Answering Models From Synthetic Data

abstract: Question and answer generation is a data augmentation method that aims to improve question answering (QA) models given the limited amount of human labeled data. However, a considerable gap remains between synthetic and human-generated question-answer pairs. This work aims to narrow this gap by taking advantage of large language models and explores several factors such as model size, quality of pretrained models, scale of data synthesized, and algorithmic choices. On the SQuAD1.1 question answering task, we achieve higher accuracy using solely synthetic questions and answers than when using the SQuAD1.1 training set questions alone. Removing access to real Wikipedia data, we synthesize questions and answers from a synthetic corpus generated by an 8.3 billion parameter GPT-2 model. With no access to human supervision and only access to other models, we are able to train state of the art question answering networks on entirely model-generated data that achieve 88.4 Exact Match (EM) and 93.9 F1 score on the SQuAD1.1 dev set. We further apply our methodology to SQuAD2.0 and show a 2.8 absolute gain on EM score compared to prior work using synthetic data.


title: Convex Shape Representation with Binary Labels for Image Segmentation: Models and Fast Algorithms

abstract: We present a novel and effective binary representation for convex shapes. We show the equivalence between the shape convexity and some properties of the associated indicator function. The proposed method has two advantages. Firstly, the representation is based on a simple inequality constraint on the binary function rather than the definition of convex shapes, which allows us to obtain efficient algorithms for various applications with convexity prior. Secondly, this method is independent of the dimension of the concerned shape. In order to show the effectiveness of the proposed representation approach, we incorporate it with a probability based model for object segmentation with convexity prior. Efficient algorithms are given to solve the proposed models using Lagrange multiplier methods and linear approximations. Various experiments are given to show the superiority of the proposed methods.


title: Molecular static simulation of edge dislocation core in bcc iron

abstract: We simulate the dislocation core structure in bcc iron using the modified Molecular Static method. A feature of this method is the application of an iterative procedure in which the atomic structure in the vicinity of the defect and the constants that determine the displacements of atoms immersed in the elastic continuum are calculated in a self-consistent manner. Following the mentioned approach, we develop a model for calculating the atomic structure of edge dislocations, taking into account the anisotropy of the elastic medium surrounding the main calculation cell. Anisotropy is taken into account by introducing an explicit angular dependence for the parameters of the elastic field created by the dislocation: magnitude of Burgers vector and Poisson's ratio. Simulation is carried out for a split dislocation with Burgers vector along [100]. The convergence of the iterative algorithm is shown and the influence of the computational cell size on the results is considered. Calculated results are: atomic structure of dislocation in bcc iron, angular dependence of the parameters describing the elastic dislocation field at large distances from the dislocation line, and the strain tensor components in the entire simulation area.


title: Cesium $nD_{J}$+$6S_{1/2}$ Rydberg molecules and their permanent electric dipole moments

abstract: Cs$_2$ Rydberg-ground molecules consisting of a Rydberg, $nD_{J}$ (33 $\leq$ $n$ $\leq$ 39), and a ground state atom, 6$S_{1/2} (F=$3 or 4$)$, are investigated by photo-association spectroscopy in a cold atomic gas. We observe vibrational spectra that correspond to triplet $^T\Sigma$ and mixed $^{S,T}\Sigma$ molecular states. We establish scaling laws for the energies of the lowest vibrational states vs principal quantum number and obtain zero-energy singlet and triplet $s$-wave scattering lengths from experimental data and a Fermi model. Line broadening in electric fields reveals the permanent molecular electric-dipole moments; measured values agree well with calculations. We discuss the negative polarity of the dipole moments, which differs from previously reported cases.


title: Efficient solvers for hybridized three-field mixed finite element coupled poromechanics

abstract: We consider a mixed hybrid finite element formulation for coupled poromechanics. A stabilization strategy based on a macro-element approach is advanced to eliminate the spurious pressure modes appearing in undrained/incompressible conditions. The efficient solution of the stabilized mixed hybrid block system is addressed by developing a class of block triangular preconditioners based on a Schur-complement approximation strategy. Robustness, computational efficiency and scalability of the proposed approach are theoretically discussed and tested using challenging benchmark problems on massively parallel architectures.


title: Emergent Communication with World Models

abstract: We introduce Language World Models, a class of language-conditional generative model which interpret natural language messages by predicting latent codes of future observations. This provides a visual grounding of the message, similar to an enhanced observation of the world, which may include objects outside of the listening agent's field-of-view. We incorporate this "observation" into a persistent memory state, and allow the listening agent's policy to condition on it, akin to the relationship between memory and controller in a World Model. We show this improves effective communication and task success in 2D gridworld speaker-listener navigation tasks. In addition, we develop two losses framed specifically for our model-based formulation to promote positive signalling and positive listening. Finally, because messages are interpreted in a generative model, we can visualize the model beliefs to gain insight into how the communication channel is utilized.


title: Error estimation of the Relaxation Finite Difference Scheme for the nonlinear Schr\"odinger Equation

abstract: We consider an initial- and boundary- value problem for the nonlinear Schr\"odinger equation with homogeneous Dirichlet boundary conditions in the one space dimension case. We discretize the problem in space by a central finite difference method and in time by the Relaxation Scheme proposed by C. Besse [C. R. Acad. Sci. Paris S\'er. I {\bf 326} (1998), 1427-1432]. We provide optimal order error estimates, in the discrete $L_t^{\infty}(H_x^1)$ norm, for the approximation error at the time nodes and at the intermediate time nodes. In the context of the nonlinear Schr{\"o}dinger equation, it is the first time that the derivation of an error estimate, for a fully discrete method based on the Relaxation Scheme, is completely addressed.


title: Bayesian Multi-scale Modeling of Factor Matrix without using Partition Tree

abstract: The multi-scale factor models are particularly appealing for analyzing matrix- or tensor-valued data, due to their adaptiveness to local geometry and intuitive interpretation. However, the reliance on the binary tree for recursive partitioning creates high complexity in the parameter space, making it extremely challenging to quantify its uncertainty. In this article, we discover an alternative way to generate multi-scale matrix using simple matrix operation: starting from a random matrix with each column having two unique values, its Cholesky whitening transform obeys a recursive partitioning structure. This allows us to consider a generative distribution with large prior support on common multi-scale factor models, and efficient posterior computation via Hamiltonian Monte Carlo. We demonstrate its potential in a multi-scale factor model to find broader regions of interest for human brain connectivity.


title: Multi-Representation Knowledge Distillation For Audio Classification

abstract: As an important component of multimedia analysis tasks, audio classification aims to discriminate between different audio signal types and has received intensive attention due to its wide applications. Generally speaking, the raw signal can be transformed into various representations (such as Short Time Fourier Transform and Mel Frequency Cepstral Coefficients), and information implied in different representations can be complementary. Ensembling the models trained on different representations can greatly boost the classification performance, however, making inference using a large number of models is cumbersome and computationally expensive. In this paper, we propose a novel end-to-end collaborative learning framework for the audio classification task. The framework takes multiple representations as the input to train the models in parallel. The complementary information provided by different representations is shared by knowledge distillation. Consequently, the performance of each model can be significantly promoted without increasing the computational overhead in the inference stage. Extensive experimental results demonstrate that the proposed approach can improve the classification performance and achieve state-of-the-art results on both acoustic scene classification tasks and general audio tagging tasks.


title: An integral theorem for plurisubharmonic functions

abstract: In this paper, we prove an integral theorem for Cegrell class $\mathcal{F}(f)$ and use this result to study the $\mathcal{F}$-equivalence relation.


title: Private Stochastic Convex Optimization: Efficient Algorithms for Non-smooth Objectives

abstract: In this paper, we revisit the problem of private stochastic convex optimization. We propose an algorithm based on noisy mirror descent, which achieves optimal rates both in terms of statistical complexity and number of queries to a first-order stochastic oracle in the regime when the privacy parameter is inversely proportional to the number of samples.


title: Improved MPC Algorithms for MIS, Matching, and Coloring on Trees and Beyond

abstract: We present $O(\log\log n)$ round scalable Massively Parallel Computation algorithms for maximal independent set and maximal matching, in trees and more generally graphs of bounded arboricity, as well as for constant coloring trees. Following the standards, by a scalable MPC algorithm, we mean that these algorithms can work on machines that have capacity/memory as small as $n^{\delta}$ for any positive constant $\delta<1$. Our results improve over the $O(\log^2\log n)$ round algorithms of Behnezhad et al. [PODC'19]. Moreover, our matching algorithm is presumably optimal as its bound matches an $\Omega(\log\log n)$ conditional lower bound of Ghaffari, Kuhn, and Uitto [FOCS'19].


title: Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problems

abstract: Plug-and-play (PnP) is a non-convex framework that combines ADMM or other proximal algorithms with advanced denoiser priors. Recently, PnP has achieved great empirical success, especially with the integration of deep learning-based denoisers. However, a key problem of PnP based approaches is that they require manual parameter tweaking. It is necessary to obtain high-quality results across the high discrepancy in terms of imaging conditions and varying scene content. In this work, we present a tuning-free PnP proximal algorithm, which can automatically determine the internal parameters including the penalty parameter, the denoising strength and the terminal time. A key part of our approach is to develop a policy network for automatic search of parameters, which can be effectively learned via mixed model-free and model-based deep reinforcement learning. We demonstrate, through numerical and visual experiments, that the learned policy can customize different parameters for different states, and often more efficient and effective than existing handcrafted criteria. Moreover, we discuss the practical considerations of the plugged denoisers, which together with our learned policy yield state-of-the-art results. This is prevalent on both linear and nonlinear exemplary inverse imaging problems, and in particular, we show promising results on Compressed Sensing MRI and phase retrieval.


title: On multivariate fractional random fields: tempering and operator-stable laws

abstract: In this paper, we define a new and broad family of vector-valued random fields called tempered operator fractional operator-stable random fields (TRF, for short). TRF is typically non-Gaussian and generalizes tempered fractional stable stochastic processes. TRF comprises moving average and harmonizable-type subclasses that are constructed by tempering (matrix-) homogeneous, matrix-valued kernels in time- and Fourier-domain stochastic integrals with respect to vector-valued, strictly operator-stable random measures. We establish the existence and fundamental properties of TRF. Assuming both Gaussianity and isotropy, we show the equivalence between certain moving average and harmonizable subclasses of TRF. In addition, we establish sample path properties in the scalar-valued case for several Gaussian instances.


title: General Relativistic Hydrodynamics on a Moving-mesh I: Static Spacetimes

abstract: We present the first-ever moving-mesh general relativistic hydrodynamics solver for static spacetimes as implemented in the code, MANGA. Our implementation builds on the architectures of MANGA and the numerical relativity Python package NRPy+. We review the general algorithm to solve these equations and, in particular, detail the time stepping; Riemann solution across moving faces; conversion between primitive and conservative variables; validation and correction of hydrodynamic variables; and mapping of the metric to a Voronoi moving-mesh grid. We present test results for the numerical integration of an unmagnetized Tolman-Oppenheimer-Volkoff star for 24 dynamical times. We demonstrate that at a resolution of $10^6$ mesh generating points, the star is stable and its central density drifts downward by 2% over this timescale. At a lower resolution the central density drift increases in a manner consistent with the adopted second order spatial reconstruction scheme. These results agree well with the exact solutions, and we find the error behavior to be similar to Eulerian codes with second-order spatial reconstruction. We also demonstrate that the new code recovers the fundamental mode frequency for the same TOV star but with its initial pressure depleted by 10%


title: Convex cones in mapping spaces between matrix algebras

abstract: We introduce the notion of one-sided mapping cones of positive linear maps between matrix algebras. These are convex cones of maps that are invariant under compositions by completely positive maps from either the left or right side. The duals of such convex cones can be characterized in terms of ampliation maps, which can also be used to characterize many notions from quantum information theory---such as separability, entanglement-breaking maps, Schmidt numbers, as well as decomposable maps and $k$-positive maps in functional analysis. In fact, such characterizations hold if and only if the involved cone is a one-sided mapping cone. Through this analysis, we obtain mapping properties for compositions of cones from which we also obtain several equivalent statements of the PPT (positive partial transpose) square conjecture.


title: Preference Modeling with Context-Dependent Salient Features

abstract: We consider the problem of estimating a ranking on a set of items from noisy pairwise comparisons given item features. We address the fact that pairwise comparison data often reflects irrational choice, e.g. intransitivity. Our key observation is that two items compared in isolation from other items may be compared based on only a salient subset of features. Formalizing this framework, we propose the salient feature preference model and prove a finite sample complexity result for learning the parameters of our model and the underlying ranking with maximum likelihood estimation. We also provide empirical results that support our theoretical bounds and illustrate how our model explains systematic intransitivity. Finally we demonstrate strong performance of maximum likelihood estimation of our model on both synthetic data and two real data sets: the UT Zappos50K data set and comparison data about the compactness of legislative districts in the US.


title: "Wait, I'm Still Talking!" Predicting the Dialogue Interaction Behavior Using Imagine-Then-Arbitrate Model

abstract: Producing natural and accurate responses like human beings is the ultimate goal of intelligent dialogue agents. So far, most of the past works concentrate on selecting or generating one pertinent and fluent response according to current query and its context. These models work on a one-to-one environment, making one response to one utterance each round. However, in real human-human conversations, human often sequentially sends several short messages for readability instead of a long message in one turn. Thus messages will not end with an explicit ending signal, which is crucial for agents to decide when to reply. So the first step for an intelligent dialogue agent is not replying but deciding if it should reply at the moment. To address this issue, in this paper, we propose a novel Imagine-then-Arbitrate (ITA) neural dialogue model to help the agent decide whether to wait or to make a response directly. Our method has two imaginator modules and an arbitrator module. The two imaginators will learn the agent's and user's speaking style respectively, generate possible utterances as the input of the arbitrator, combining with dialogue history. And the arbitrator decides whether to wait or to make a response to the user directly. To verify the performance and effectiveness of our method, we prepared two dialogue datasets and compared our approach with several popular models. Experimental results show that our model performs well on addressing ending prediction issue and outperforms baseline models.


title: Power-Constrained Trajectory Optimization for Wireless UAV Relays with Random Requests

abstract: This paper studies the adaptive trajectory design of a rotary-wing UAV serving as a relay between ground nodes dispersed in a circular cell and generating uplink data transmissions randomly according to a Poisson process, and a central base station. We seek to minimize the expected average communication delay to service the data transmission requests, subject to an average power constraint on the mobility of the UAV. The problem is cast as a semi-Markov decision process, and it is shown that the policy exhibits a two-scale structure, which can be efficiently optimized: in the outer decision, upon starting a communication phase, and given its current radius, the UAV selects a target end radius position so as to optimally balance a trade-off between average long-term communication delay and power consumption; in the inner decision, the UAV selects its trajectory between the start radius and the selected end radius, so as to greedily minimize the delay and energy consumption to serve the current request. Numerical evaluations show that, during waiting phases, the UAV circles at some optimal radius at the most energy efficient speed, until a new request is received. Lastly, the expected average communication delay and power consumption of the optimal policy is compared to that of several heuristics, demonstrating a reduction in latency by over 50% and 20%, respectively, compared to static and mobile heuristic schemes.


title: Spectroscopic Determination of Stellar Parameters and Oxygen Abundances for Hyades/Field G-K Dwarfs

abstract: It has been occasionally suggested that Fe abundances of K dwarfs derived from Fe I and Fe II lines show considerable discrepancies and oxygen abundances determined from high-excitation O I 7771-5 triplet lines are appreciably overestimated (the problem becoming more serious towards lower Teff), which however has not yet been widely confirmed. With an aim to clarify this issue, we spectroscopically determined the atmospheric parameters of 148 G-K dwarfs (Hyades cluster stars and field stars) by assuming the classical Fe I/Fe II ionization equilibrium as usual, and determined their oxygen abundances by applying the non-LTE spectrum fitting analysis to O I 7771-5 lines. It turned out that the resulting parameters did not show any significant inconsistency with those determined by other methods (for example, the mean differences in Teff and log g from the well-determined solutions of Hyades dwarfs are mostly <~100K and <~0.1dex). Likewise, the oxygen abundances of Hyades stars are around [O/H]~+0.2dex (consistent with the metallicity of this cluster) without exhibiting any systematic Teff-dependence. Accordingly, we conclude that parameters can be spectroscopically evaluated to a sufficient precision in the conventional manner (based on the Saha-Boltzmann equation for Fe I/Fe II) and oxygen abundances can be reliably determined from the O I 7771-5 triplet for K dwarfs as far as stars of Teff>~4500K are concerned. We suspect that previously reported strongly Teff-dependent discrepancies may have stemmed mainly from overestimation of weak-line strengths and/or improper Teff scale.


title: Systematic Synthesis and Design of Ultra-Low Threshold Parametric Frequency Dividers

abstract: A new method is discussed for the systematic synthesis, design and performance optimization of varactor-based parametric frequency dividers (PFDs) exhibiting an ultra-low power threshold ($P_{th}$). For the first time, it is analytically shown that the $P_{th}$-value exhibited by any PFD can always be expressed as an explicit closed-form function of the different impedances forming its network. Such a unique and unexplored property permits to rely on linear models, during the PFD design and performance optimization. The validity of our analytical model has been verified, in a commercial circuit simulator, through time-domain and frequency-domain algorithms. To demonstrate the effectiveness of our new synthesis approach, we also report on a lumped prototype of a 200:100MHz PFD, realized on a printed circuit board (PCB). Although inductors with quality factors lower than 50 were used, the PFD prototype exhibits a $P_{th}$-value lower than $-$15dBm. Such a low $P_{th}$-value is the lowest one ever reported for passive varactor-based PFDs, operating in the same frequency range.


title: Efficient Sentence Embedding via Semantic Subspace Analysis

abstract: A novel sentence embedding method built upon semantic subspace analysis, called semantic subspace sentence embedding (S3E), is proposed in this work. Given the fact that word embeddings can capture semantic relationship while semantically similar words tend to form semantic groups in a high-dimensional embedding space, we develop a sentence representation scheme by analyzing semantic subspaces of its constituent words. Specifically, we construct a sentence model from two aspects. First, we represent words that lie in the same semantic group using the intra-group descriptor. Second, we characterize the interaction between multiple semantic groups with the inter-group descriptor. The proposed S3E method is evaluated on both textual similarity tasks and supervised tasks. Experimental results show that it offers comparable or better performance than the state-of-the-art. The complexity of our S3E method is also much lower than other parameterized models.


title: Global Convergence and Variance-Reduced Optimization for a Class of Nonconvex-Nonconcave Minimax Problems

abstract: Nonconvex minimax problems appear frequently in emerging machine learning applications, such as generative adversarial networks and adversarial learning. Simple algorithms such as the gradient descent ascent (GDA) are the common practice for solving these nonconvex games and receive lots of empirical success. Yet, it is known that these vanilla GDA algorithms with constant step size can potentially diverge even in the convex setting. In this work, we show that for a subclass of nonconvex-nonconcave objectives satisfying a so-called two-sided Polyak-{\L}ojasiewicz inequality, the alternating gradient descent ascent (AGDA) algorithm converges globally at a linear rate and the stochastic AGDA achieves a sublinear rate. We further develop a variance reduced algorithm that attains a provably faster rate than AGDA when the problem has the finite-sum structure.


title: Notes on neighborhood semantics for logics of unknown truths and false beliefs

abstract: In this article, we study logics of unknown truths and false beliefs under neighborhood semantics. We compare the relative expressivity of the two logics. It turns out that they are incomparable over various classes of neighborhood models, and the combination of the two logics are equally expressive as standard modal logic over any class of neighborhood models. We propose morphisms for each logic, which can help us explore the frame definability problem, show a general soundness and completeness result, and generalize some results in the literature. We axiomatize the two logics over various classes of neighborhood frames. Last but not least, we extend the results to the case of public announcements, which has good applications to Moore sentences and some others.


title: Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks

abstract: As a promising technology in the Internet of Underwater Things, underwater sensor networks have drawn a widespread attention from both academia and industry. However, designing a routing protocol for underwater sensor networks is a great challenge due to high energy consumption and large latency in the underwater environment. This paper proposes a Q-learning-based localization-free anypath routing (QLFR) protocol to prolong the lifetime as well as reduce the end-to-end delay for underwater sensor networks. Aiming at optimal routing policies, the Q-value is calculated by jointly considering the residual energy and depth information of sensor nodes throughout the routing process. More specifically, we define two reward functions (i.e., depth-related and energy-related rewards) for Q-learning with the objective of reducing latency and extending network lifetime. In addition, a new holding time mechanism for packet forwarding is designed according to the priority of forwarding candidate nodes. Furthermore, a mathematical analysis is presented to analyze the performance of the proposed routing protocol. Extensive simulation results demonstrate the superiority performance of the proposed routing protocol in terms of the end-to-end delay and the network lifetime.


title: Self-similar motions and related relative equilibria in the $N$-point vortex system

abstract: We study self-similar solutions of the point-vortex system. The explicit formula for self-similar solutions has been obtained for the three point-vortex problem and for a specific example of the four and five point-vortex problems. We see that the families consisting of these self-similar collapsing solutions are described by one-parameter families, and their collapse time and Hamiltonian are also expressed by functions of the same parameter. Then, the configurations at limit points of the parameter are in relative equilibria. For the many-vortex problem, we investigate the point-vortex system with the help of numerical computations. In particular, considering the case that $N - 1$ point vortices have a uniform vortex strength, we show that families of self-similar collapsing solutions continuously depend on the Hamiltonian and the self-similar solutions asymptotically approach relative equilibria as the Hamiltonian gets close to certain values. In addition, we prove the existence of relative equilibria for the four point-vortex system. We also investigate an example of seven point vortices with non-uniform vortex strengths and give numerical results for it.


title: Neural Architecture Search for Compressed Sensing Magnetic Resonance Image Reconstruction

abstract: Recent works have demonstrated that deep learning (DL) based compressed sensing (CS) implementation can accelerate Magnetic Resonance (MR) Imaging by reconstructing MR images from sub-sampled k-space data. However, network architectures adopted in previous methods are all designed by handcraft. Neural Architecture Search (NAS) algorithms can automatically build neural network architectures which have outperformed human designed ones in several vision tasks. Inspired by this, here we proposed a novel and efficient network for the MR image reconstruction problem via NAS instead of manual attempts. Particularly, a specific cell structure, which was integrated into the model-driven MR reconstruction pipeline, was automatically searched from a flexible pre-defined operation search space in a differentiable manner. Experimental results show that our searched network can produce better reconstruction results compared to previous state-of-the-art methods in terms of PSNR and SSIM with 4-6 times fewer computation resources. Extensive experiments were conducted to analyze how hyper-parameters affect reconstruction performance and the searched structures. The generalizability of the searched architecture was also evaluated on different organ MR datasets. Our proposed method can reach a better trade-off between computation cost and reconstruction performance for MR reconstruction problem with good generalizability and offer insights to design neural networks for other medical image applications. The evaluation code will be available at https://github.com/yjump/NAS-for-CSMRI.


title: Feedback Identification of conductance-based models

abstract: This paper applies the classical prediction error method (PEM) to the estimation of nonlinear discrete-time models of neuronal systems subject to input-additive noise. While the nonlinear system exhibits excitability, bifurcations, and limit-cycle oscillations, we prove consistency of the parameter estimation procedure under output feedback. Hence, this paper provides a rigorous framework for the application of conventional nonlinear system identification methods to discrete-time stochastic neuronal systems. The main result exploits the elementary property that conductance-based models of neurons have an exponentially contracting inverse dynamics. This property is implied by the voltage-clamp experiment, which has been the fundamental modeling experiment of neurons ever since the pioneering work of Hodgkin and Huxley.


title: Feedback for nonlinear system identification

abstract: Motivated by neuronal models from neuroscience, we consider the system identification of simple feedback structures whose behaviors include nonlinear phenomena such as excitability, limit-cycles and chaos. We show that output feedback is sufficient to solve the identification problem in a two-step procedure. First, the nonlinear static characteristic of the system is extracted, and second, using a feedback linearizing law, a mildly nonlinear system with an approximately-finite memory is identified. In an ideal setting, the second step boils down to the identification of a LTI system. To illustrate the method in a realistic setting, we present numerical simulations of the identification of two classical systems that fit the assumed model structure.


title: Integrated Biophysical Modeling and Image Analysis: Application to Neuro-Oncology

abstract: Central nervous system (CNS) tumors come with the vastly heterogeneous histologic, molecular and radiographic landscape, rendering their precise characterization challenging. The rapidly growing fields of biophysical modeling and radiomics have shown promise in better characterizing the molecular, spatial, and temporal heterogeneity of tumors. Integrative analysis of CNS tumors, including clinically-acquired multi-parametric magnetic resonance imaging (mpMRI) and the inverse problem of calibrating biophysical models to mpMRI data, assists in identifying macroscopic quantifiable tumor patterns of invasion and proliferation, potentially leading to improved (i) detection/segmentation of tumor sub-regions, and (ii) computer-aided diagnostic/prognostic/predictive modeling. This paper presents a summary of (i) biophysical growth modeling and simulation, (ii) inverse problems for model calibration, (iii) their integration with imaging workflows, and (iv) their application on clinically-relevant studies. We anticipate that such quantitative integrative analysis may even be beneficial in a future revision of the World Health Organization (WHO) classification for CNS tumors, ultimately improving patient survival prospects.


title: An Empirical Study of Android Security Bulletins in Different Vendors

abstract: Mobile devices encroach on almost every part of our lives, including work and leisure, and contain a wealth of personal and sensitive information. It is, therefore, imperative that these devices uphold high security standards. A key aspect is the security of the underlying operating system. In particular, Android plays a critical role due to being the most dominant platform in the mobile ecosystem with more than one billion active devices and due to its openness, which allows vendors to adopt and customize it. Similar to other platforms, Android maintains security by providing monthly security patches and announcing them via the Android security bulletin. To absorb this information successfully across the Android ecosystem, impeccable coordination by many different vendors is required. In this paper, we perform a comprehensive study of 3,171 Android-related vulnerabilities and study to which degree they are reflected in the Android security bulletin, as well as in the security bulletins of three leading vendors: Samsung, LG, and Huawei. In our analysis, we focus on the metadata of these security bulletins (e.g., timing, affected layers, severity, and CWE data) to better understand the similarities and differences among vendors. We find that (i) the studied vendors in the Android ecosystem have adopted different structures for vulnerability reporting, (ii) vendors are less likely to react with delay for CVEs with Android Git repository references, (iii) vendors handle Qualcomm-related CVEs differently from the rest of external layer CVEs.


title: Soft mode parameter as an indicator for the activation energy spectra in metallic glass

abstract: The activation energy (E_A) spectra of potential energy landscape (PEL) provides a convenient perspective for interpreting complex phenomena in amorphous materials; however, the link between the E_A spectra and other physical properties in metallic glasses is still mysterious. By systematically probing the E_A spectra for numerous metallic glass samples with distinct local geometric ordering, which correspond to broad processing histories, it is found that the shear modulus of the samples are strongly correlated with the arithmetic mean of the E_A spectra rather than with the local geometrical ordering. Furthermore, we studied the correlation of the obtained E_A spectra and various well-established physical parameters. The outcome of our research clearly demonstrates that the soft mode parameter {\Psi} and the E_A spectrum are correlated; therefore, it could be a good indicator of metallic glass properties and sheds important light on the structure-property relationship in metallic glass through the medium of PEL.


title: Novel therapeutic targets in chronic myeloid leukaemia through a discrete time discrete Markov chain model of BCR-ABL1 interactions

abstract: Chronic Myeloid Leukaemia (CML) is a blood-derived proliferative disorder, which is highly associated to a translocation of chromosomes 9 and 22 or the creation of Philadelphia chromosome Ph(+) cases, inducing the synthesis of a chimeric fusion protein, namely BCR-ABL1 (Breakpoint Cluster Region-Abelson 1 chimeric protein), which is known for driving the pathophysiology of the disease, however variants of CML are also recognized as CML Ph(-), these nonetheless account for a small percentage of the overall CML patients; posing thus the question whether BCR-ABL1 fusion protein is required for the whole of the pathophysiology of CML. Hereof, through a stochastic description, a discrete time discrete Markov chain depicts the various protein-protein interactions of BCR-ABL1 to better understand signalling pathways and time-dependent evolution of these pathways, as well as to provide prospective therapeutic protein targets to improve both the specificity of the treatment and the life-expectancy of the patients.


title: Using Single-Step Adversarial Training to Defend Iterative Adversarial Examples

abstract: Adversarial examples have become one of the largest challenges that machine learning models, especially neural network classifiers, face. These adversarial examples break the assumption of attack-free scenario and fool state-of-the-art (SOTA) classifiers with insignificant perturbations to human. So far, researchers achieved great progress in utilizing adversarial training as a defense. However, the overwhelming computational cost degrades its applicability and little has been done to overcome this issue. Single-Step adversarial training methods have been proposed as computationally viable solutions, however they still fail to defend against iterative adversarial examples. In this work, we first experimentally analyze several different SOTA defense methods against adversarial examples. Then, based on observations from experiments, we propose a novel single-step adversarial training method which can defend against both single-step and iterative adversarial examples. Lastly, through extensive evaluations, we demonstrate that our proposed method outperforms the SOTA single-step and iterative adversarial training defense. Compared with ATDA (single-step method) on CIFAR10 dataset, our proposed method achieves 35.67% enhancement in test accuracy and 19.14% reduction in training time. When compared with methods that use BIM or Madry examples (iterative methods) on CIFAR10 dataset, it saves up to 76.03% in training time with less than 3.78% degeneration in test accuracy.


title: Bayesian Survival Analysis Using the rstanarm R Package

abstract: Survival data is encountered in a range of disciplines, most notably health and medical research. Although Bayesian approaches to the analysis of survival data can provide a number of benefits, they are less widely used than classical (e.g. likelihood-based) approaches. This may be in part due to a relative absence of user-friendly implementations of Bayesian survival models. In this article we describe how the rstanarm R package can be used to fit a wide range of Bayesian survival models. The rstanarm package facilitates Bayesian regression modelling by providing a user-friendly interface (users specify their model using customary R formula syntax and data frames) and using the Stan software (a C++ library for Bayesian inference) for the back-end estimation. The suite of models that can be estimated using rstanarm is broad and includes generalised linear models (GLMs), generalised linear mixed models (GLMMs), generalised additive models (GAMs) and more. In this article we focus only on the survival modelling functionality. This includes standard parametric (exponential, Weibull, Gompertz) and flexible parametric (spline-based) hazard models, as well as standard parametric accelerated failure time (AFT) models. All types of censoring (left, right, interval) are allowed, as is delayed entry (left truncation), time-varying covariates, time-varying effects, and frailty effects. We demonstrate the functionality through worked examples. We anticipate these implementations will increase the uptake of Bayesian survival analysis in applied research.


title: Data Augmentation for Copy-Mechanism in Dialogue State Tracking

abstract: While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both training set and test set) and unseen ones (values that occur in training set but not in test set). Recently, the copy-mechanism has been widely used in DST models to handle unseen slot values, which copies slot values from user utterance directly. In this paper, we aim to find out the factors that influence the generalization ability of a common copy-mechanism model for DST. Our key observations include: 1) the copy-mechanism tends to memorize values rather than infer them from contexts, which is the primary reason for unsatisfactory generalization performance; 2) greater diversity of slot values in the training set increase the performance on unseen values but slightly decrease the performance on seen values. Moreover, we propose a simple but effective algorithm of data augmentation to train copy-mechanism models, which augments the input dataset by copying user utterances and replacing the real slot values with randomly generated strings. Users could use two hyper-parameters to realize a trade-off between the performances on seen values and unseen ones, as well as a trade-off between overall performance and computational cost. Experimental results on three widely used datasets (WoZ 2.0, DSTC2, and Multi-WoZ 2.0) show the effectiveness of our approach.


title: Towards Label-Free 3D Segmentation of Optical Coherence Tomography Images of the Optic Nerve Head Using Deep Learning

abstract: Since the introduction of optical coherence tomography (OCT), it has been possible to study the complex 3D morphological changes of the optic nerve head (ONH) tissues that occur along with the progression of glaucoma. Although several deep learning (DL) techniques have been recently proposed for the automated extraction (segmentation) and quantification of these morphological changes, the device specific nature and the difficulty in preparing manual segmentations (training data) limit their clinical adoption. With several new manufacturers and next-generation OCT devices entering the market, the complexity in deploying DL algorithms clinically is only increasing. To address this, we propose a DL based 3D segmentation framework that is easily translatable across OCT devices in a label-free manner (i.e. without the need to manually re-segment data for each device). Specifically, we developed 2 sets of DL networks. The first (referred to as the enhancer) was able to enhance OCT image quality from 3 OCT devices, and harmonized image-characteristics across these devices. The second performed 3D segmentation of 6 important ONH tissue layers. We found that the use of the enhancer was critical for our segmentation network to achieve device independency. In other words, our 3D segmentation network trained on any of 3 devices successfully segmented ONH tissue layers from the other two devices with high performance (Dice coefficients > 0.92). With such an approach, we could automatically segment images from new OCT devices without ever needing manual segmentation data from such devices.


title: Conceptual Game Expansion

abstract: Automated game design is the problem of automatically producing games through computational processes. Traditionally, these methods have relied on the authoring of search spaces by a designer, defining the space of all possible games for the system to author. In this paper, we instead learn representations of existing games from gameplay video and use these to approximate a search space of novel games. In a human subject study we demonstrate that these novel games are indistinguishable from human games in terms of challenge, and that one of the novel games was equivalent to one of the human games in terms of fun, frustration, and likeability.


title: Markov Chain Monte-Carlo Phylogenetic Inference Construction in Computational Historical Linguistics

abstract: More and more languages in the world are under study nowadays, as a result, the traditional way of historical linguistics study is facing some challenges. For example, the linguistic comparative research among languages needs manual annotation, which becomes more and more impossible with the increasing amount of language data coming out all around the world. Although it could hardly replace linguists work, the automatic computational methods have been taken into consideration and it can help people reduce their workload. One of the most important work in historical linguistics is word comparison from different languages and find the cognate words for them, which means people try to figure out if the two languages are related to each other or not. In this paper, I am going to use computational method to cluster the languages and use Markov Chain Monte Carlo (MCMC) method to build the language typology relationship tree based on the clusters.


title: Synchrotron radiation in $\gamma$-ray burst prompt emission

abstract: Growing evidence suggests that synchrotron radiation plays a significant role in shaping the spectra of most $\gamma$-ray bursts. The relativistic jets producing them likely carry a significant fraction of energy in the form of a Poynting flux.


title: Energy decay for small solutions to semilinear wave equations with weakly dissipative structure

abstract: This article gives an energy decay result for small data solutions to a class of semilinear wave equations in two space dimensions possessing weakly dissipative structure relevant to the Agemi condition.


title: The Outbreak Evaluation of COVID-19 in Wuhan District of China

abstract: There were 27 novel coronavirus pneumonia cases found in Wuhan, China in December 2019, named as 2019-nCoV temporarily and COVID-19 formally by WHO on 11 February, 2020. In December 2019 and January 2020, COVID-19 has spread in large scale among the population, which brought terrible disaster to the life and property of the Chinese people. In this paper, we will first analyze the feature and pattern of the virus transmission, and discuss the key impact factors and uncontrollable factors of epidemic transmission based on public data. Then the virus transmission can be modelled and used for the inflexion and extinction period of epidemic development so as to provide theoretical support for the Chinese government in the decision-making of epidemic prevention and recovery of economic production. Further, this paper demonstrates the effectiveness of the prevention methods taken by the Chinese government such as multi-level administrative region isolation. It is of great importance and practical significance for the world to deal with public health emergencies.


title: Parameter estimation for an Ornstein-Uhlenbeck Process driven by a general Gaussian noise

abstract: In this paper, we consider an inference problem for an Ornstein-Uhlenbeck process driven by a general one-dimensional centered Gaussian process $(G_t)_{t\ge 0}$. The second order mixed partial derivative of the covariance function $ R(t,\, s)=\mathbb{E}[G_t G_s]$ can be decomposed into two parts, one of which coincides with that of fractional Brownian motion and the other is bounded by $(ts)^{\beta-1}$ up to a constant factor. This condition is valid for a class of continuous Gaussian processes that fails to be self-similar or have stationary increments. Some examples include the subfractional Brownian motion and the bi-fractional Brownian motion. Under this assumption, we study the parameter estimation for drift parameter in the Ornstein-Uhlenbeck process driven by the Gaussian noise $(G_t)_{t\ge 0}$. For the least squares estimator and the second moment estimator constructed from the continuous observations, we prove the strong consistency and the asympotic normality, and obtain the Berry-Ess\'{e}en bounds. The proof is based on the inner product's representation of the Hilbert space $\mathfrak{H}$ associated with the Gaussian noise $(G_t)_{t\ge 0}$, and the estimation of the inner product based on the results of the Hilbert space associated with the fractional Brownian motion.


title: Double Hopf bifurcation in nonlocal reaction-diffusion systems with spatial average kernel

abstract: In this paper, we consider a general reaction-diffusion system with nonlocal effects and Neumann boundary conditions, where a spatial average kernel is chosen to be the nonlocal kernel. By virtue of the center manifold reduction technique and normal form theory, we present a new algorithm for computing normal forms associated with the codimension-two double Hopf bifurcation of nonlocal reaction-diffusion equations. The theoretical results are applied to a predator-prey model, and complex dynamic behaviors such as spatially nonhomogeneous periodic oscillations and spatially nonhomogeneous quasi-periodic oscillations could occur.


title: Sample canonical correlation coefficients of high-dimensional random vectors: local law and Tracy-Widom limit

abstract: Consider two random vectors $\mathbf C_1^{1/2}\mathbf x \in \mathbb R^p$ and $\mathbf C_2^{1/2}\mathbf y\in \mathbb R^q$, where the entries of $\mathbf x$ and $\mathbf y$ are i.i.d. random variables with mean zero and variance one, and $\mathbf C_1$ and $\mathbf C_2$ are $p \times p$ and $q\times q$ deterministic population covariance matrices. With $n$ independent samples of $(\mathbf C_1^{1/2}\mathbf x,\mathbf C_2^{1/2}\mathbf y)$, we study the sample correlation between these two vectors using canonical correlation analysis. We denote by $S_{xx}$ and $S_{yy}$ the sample covariance matrices for $\mathbf C_1^{1/2}\mathbf x$ and $\mathbf C_2^{1/2}\mathbf y$, respectively, and $S_{xy}$ the sample cross-covariance matrix. Then the sample canonical correlation coefficients are the square roots of the eigenvalues of the sample canonical correlation matrix $\cal C_{XY}:=S_{xx}^{-1}S_{xy}S_{yy}^{-1}S_{yx}$. Under the high-dimensional setting with ${p}/{n}\to c_1 \in (0, 1)$ and ${q}/{n}\to c_2 \in (0, 1-c_1)$ as $n\to \infty$, we prove that the largest eigenvalue of $\mathcal C_{XY}$ converges to the Tracy-Widom distribution as long as we have $\lim_{s \rightarrow \infty}s^4 [\mathbb{P}(\vert x_{ij} \vert \geq s)+ \mathbb{P}(\vert y_{ij} \vert \geq s)]=0$. This extends the result in [16], which established the Tracy-Widom limit of the largest eigenvalue of $\mathcal C_{XY}$ under the assumption that all moments are finite. Our proof is based on a linearization method, which reduces the problem to the study of a $(p+q+2n)\times (p+q+2n)$ random matrix $H$. In particular, we shall prove an optimal local law on its inverse $G:=H^{-1}$, i.e the resolvent. This local law is the main tool for both the proof of the Tracy-Widom law in this paper, and the study in [22,23] on the canonical correlation coefficients of high-dimensional random vectors with finite rank correlations.


title: Causal Inference in Genetic Trio Studies

abstract: We introduce a method to rigorously draw causal inferences---inferences immune to all possible confounding---from genetic data that include parents and offspring. Causal conclusions are possible with these data because the natural randomness in meiosis can be viewed as a high-dimensional randomized experiment. We make this observation actionable by developing a novel conditional independence test that identifies regions of the genome containing distinct causal variants. The proposed Digital Twin Test compares an observed offspring to carefully constructed synthetic offspring from the same parents in order to determine statistical significance, and it can leverage any black-box multivariate model and additional non-trio genetic data in order to increase power. Crucially, our inferences are based only on a well-established mathematical description of the rearrangement of genetic material during meiosis and make no assumptions about the relationship between the genotypes and phenotypes.


title: Revealing the low-temperature fast relaxation peak in a model metallic glass

abstract: By systematically investigating the relaxation behavior of a model metallic glass based on the extensive molecular dynamics (MD) simulations combined with the dynamic mechanical spectroscopy method, a pronounced ultra-low temperature peak on the loss modulus spectrum was discovered for the first time in MD simulations. It was found that the relation peak occurs at a much lower temperature than the typical temperature for the conventional beta relation peak as reported in the literature. According to the atomic displacement analysis, we unravel that the reversible atomic motions, rather than the thermal vibrations or local structural rearrangements, mainly contribute to this relaxation peak. We further identify the atomic level mechanism of this fast relaxation process by characterizing the local geometrical anisotropy. Furthermore, by tracing the dynamic behaviors of these "reversible" atoms, we demonstrate the intrinsic hierarchy of the local relaxation modes, which are triggered by atomic vibrations and gradually developed to the reversible and irreversible atomic movements. Our findings shed light on a general picture of the relaxation processes in metallic glasses.


title: Machine Translation System Selection from Bandit Feedback

abstract: Adapting machine translation systems in the real world is a difficult problem. In contrast to offline training, users cannot provide the type of fine-grained feedback (such as correct translations) typically used for improving the system. Moreover, different users have different translation needs, and even a single user's needs may change over time. In this work we take a different approach, treating the problem of adaptation as one of selection. Instead of adapting a single system, we train many translation systems using different architectures, datasets, and optimization methods. Using bandit learning techniques on simulated user feedback, we learn a policy to choose which system to use for a particular translation task. We show that our approach can (1) quickly adapt to address domain changes in translation tasks, (2) outperform the single best system in mixed-domain translation tasks, and (3) make effective instance-specific decisions when using contextual bandit strategies.


title: Appropriate Learning Rates of Adaptive Learning Rate Optimization Algorithms for Training Deep Neural Networks

abstract: This paper deals with nonconvex stochastic optimization problems in deep learning and provides appropriate learning rates with which adaptive learning rate optimization algorithms, such as Adam and AMSGrad, can approximate a stationary point of the problem. In particular, constant and diminishing learning rates are provided to approximate a stationary point of the problem. Our results also guarantee that the adaptive learning rate optimization algorithms can approximate global minimizers of convex stochastic optimization problems. The adaptive learning rate optimization algorithms are examined in numerical experiments on text and image classification. The experiments show that the algorithms with constant learning rates perform better than ones with diminishing learning rates.


title: A study on summation-integral type operators

abstract: In this paper, we investigate the approximation properties of the summation-integral type operators as defined by Mishra et al. (Boll. Unione Mat. Ital. (2016) 8:297-305) and determine the local results as well as prove the convergence theorem of the defined operators. Further, check the asymptotic behavior of the operators and obtain the asymptotic formula for the operators, moreover, the quantitative means of Voronovskaja type theorem is also discussed for an upper bound of the pointwise convergent, as well as obtain the Gruss Voronovskaya-type theorem. Finally, the graphical representation is given to support the approximation results of the operators.


title: A new matrix inequality involving partial traces

abstract: Let $A$ be an $m\times m$ positive semidefinite block matrix with each block being $n$-square. We write $\mathrm{tr}_1$ and $\mathrm{tr}_2$ for the first and second partial trace, respectively. In this paper, we prove the following inequality \[ (\mathrm{tr} A)I_{mn} - (\mathrm{tr}_2 A) \otimes I_n \ge \pm \bigl( I_m\otimes (\mathrm{tr}_1 A) -A\bigr).\] This inequality is not only a generalization of Ando's result [ILAS Conference (2014)] and Lin [Canad. Math. Bull. 59 (2016) 585--591], but it also could be regarded as a complement of a recent result of Choi [Linear Multilinear Algebra 66 (2018) 1619--1625]. Additionally, some new partial traces inequalities for positive semidefinite block matrices are also included.