title: Parallel Tempering via Simulated Tempering Without Normalizing Constants

abstract: In this paper we develop a new general Bayesian methodology that simultaneously estimates parameters of interest and the marginal likelihood of the model. The proposed methodology builds on Simulated Tempering, which is a powerful algorithm that enables sampling from multi-modal distributions. However, Simulated Tempering comes with the practical limitation of needing to specify a prior for the temperature along a chosen discretization schedule that will allow calculation of normalizing constants at each temperature. Our proposed model defines the prior for the temperature so as to remove the need for calculating normalizing constants at each temperature and thereby enables a continuous temperature schedule, while preserving the sampling efficiency of the Simulated Tempering algorithm. The resulting algorithm simultaneously estimates parameters while estimating marginal likelihoods through thermodynamic integration. We illustrate the applicability of the new algorithm to different examples involving mixture models of Gaussian distributions and ordinary differential equation models.


title: DFS: A Dataset File System for Data Discovering Users

abstract: Many research questions can be answered quickly and efficiently using data already collected for previous research. This practice is called secondary data analysis (SDA), and has gained popularity due to lower costs and improved research efficiency. In this paper we propose DFS, a file system to standardize the metadata representation of datasets, and DDU, a scalable architecture based on DFS for semi-automated metadata generation and data recommendation on the cloud. We discuss how DFS and DDU lays groundwork for automatic dataset aggregation, how it integrates with existing data wrangling and machine learning tools, and explores their implications on datasets stored in digital libraries.


title: Can We Derive Explicit and Implicit Bias from Corpus?

abstract: Language is a popular resource to mine speakers' attitude bias, supposing that speakers' statements represent their bias on concepts. However, psychology studies show that people's explicit bias in statements can be different from their implicit bias in mind. Although both explicit and implicit bias are useful for different applications, current automatic techniques do not distinguish them. Inspired by psychological measurements of explicit and implicit bias, we develop an automatic language-based technique to reproduce psychological measurements on large population. By connecting each psychological measurement with the statements containing the certain combination of special words, we derive explicit and implicit bias by understanding the sentiment of corresponding category of statements. Extensive experiments on English and Chinese serious media (Wikipedia) and non-serious media (social media) show that our method successfully reproduce the small-scale psychological observations on large population and achieve new findings.


title: Partial regularity of suitable weak solutions of the Navier-Stokes-Planck-Nernst-Poisson equation

abstract: In this paper, inspired by the seminal work by Caffarelli-Kohn-Nirenberg \cite{CKN} on the incompressible Navier-Stokes equation, we establish the existence of a suitable weak solution to the Navier-Stokes-Planck-Nernst-Poisson equation in dimension three, which is shown to be smooth away from a closed set whose $1$-dimensional parabolic Hausdorff measure is zero.


title: Local estimate of fundamental groups

abstract: For any complete $n$-dim Riemannian manifold $M^n$ with nonnegative Ricci curvature, Kapovitch and Wilking proved that any finitely generated subgroup of the fundamental group $\pi_1(M^n)$ can be generated by $C(n)$ generators. Inspired by their work, we give a quantitative proof of the above theorem and show that $C(n)\leq n^{n^{20n}} $. Our main tools are quantitative Cheeger-Colding's almost splitting theory, and the squeeze lemma for covering groups between two Riemannian manifolds with nonnegative Ricci curvature.


title: PAC-Bayes Un-Expected Bernstein Inequality

abstract: We present a new PAC-Bayesian generalization bound. Standard bounds contain a $\sqrt{L_n \cdot \KL/n}$ complexity term which dominates unless $L_n$, the empirical error of the learning algorithm's randomized predictions, vanishes. We manage to replace $L_n$ by a term which vanishes in many more situations, essentially whenever the employed learning algorithm is sufficiently stable on the dataset at hand. Our new bound consistently beats state-of-the-art bounds both on a toy example and on UCI datasets (with large enough $n$). Theoretically, unlike existing bounds, our new bound can be expected to converge to $0$ faster whenever a Bernstein/Tsybakov condition holds, thus connecting PAC-Bayesian generalization and {\em excess risk\/} bounds---for the latter it has long been known that faster convergence can be obtained under Bernstein conditions. Our main technical tool is a new concentration inequality which is like Bernstein's but with $X^2$ taken outside its expectation.


title: Fast Online "Next Best Offers" using Deep Learning

abstract: In this paper, we present iPrescribe, a scalable low-latency architecture for recommending 'next-best-offers' in an online setting. The paper presents the design of iPrescribe and compares its performance for implementations using different real-time streaming technology stacks. iPrescribe uses an ensemble of deep learning and machine learning algorithms for prediction. We describe the scalable real-time streaming technology stack and optimized machine-learning implementations to achieve a 90th percentile recommendation latency of 38 milliseconds. Optimizations include a novel mechanism to deploy recurrent Long Short Term Memory (LSTM) deep learning networks efficiently.


title: JEDI: Many-to-Many End-to-End Encryption and Key Delegation for IoT

abstract: As the Internet of Things (IoT) emerges over the next decade, developing secure communication for IoT devices is of paramount importance. Achieving end-to-end encryption for large-scale IoT systems, like smart buildings or smart cities, is challenging because multiple principals typically interact indirectly via intermediaries, meaning that the recipient of a message is not known in advance. This paper proposes JEDI (Joining Encryption and Delegation for IoT), a many-to-many end-to-end encryption protocol for IoT. JEDI encrypts and signs messages end-to-end, while conforming to the decoupled communication model typical of IoT systems. JEDI's keys support expiry and fine-grained access to data, common in IoT. Furthermore, JEDI allows principals to delegate their keys, restricted in expiry or scope, to other principals, thereby granting access to data and managing access control in a scalable, distributed way. Through careful protocol design and implementation, JEDI can run across the spectrum of IoT devices, including ultra low-power deeply embedded sensors severely constrained in CPU, memory, and energy consumption. We apply JEDI to an existing IoT messaging system and demonstrate that its overhead is modest.


title: Rewarding Smatch: Transition-Based AMR Parsing with Reinforcement Learning

abstract: Our work involves enriching the Stack-LSTM transition-based AMR parser (Ballesteros and Al-Onaizan, 2017) by augmenting training with Policy Learning and rewarding the Smatch score of sampled graphs. In addition, we also combined several AMR-to-text alignments with an attention mechanism and we supplemented the parser with pre-processed concept identification, named entities and contextualized embeddings. We achieve a highly competitive performance that is comparable to the best published results. We show an in-depth study ablating each of the new components of the parser


title: A Weighted Linear Matroid Parity Algorithm

abstract: The matroid parity (or matroid matching) problem, introduced as a common generalization of matching and matroid intersection problems, is so general that it requires an exponential number of oracle calls. Nevertheless, Lov\'asz (1980) showed that this problem admits a min-max formula and a polynomial algorithm for linearly represented matroids. Since then efficient algorithms have been developed for the linear matroid parity problem. In this paper, we present a combinatorial, deterministic, polynomial-time algorithm for the weighted linear matroid parity problem. The algorithm builds on a polynomial matrix formulation using Pfaffian and adopts a primal-dual approach based on the augmenting path algorithm of Gabow and Stallmann (1986) for the unweighted problem.


title: MolecularRNN: Generating realistic molecular graphs with optimized properties

abstract: Designing new molecules with a set of predefined properties is a core problem in modern drug discovery and development. There is a growing need for de-novo design methods that would address this problem. We present MolecularRNN, the graph recurrent generative model for molecular structures. Our model generates diverse realistic molecular graphs after likelihood pretraining on a big database of molecules. We perform an analysis of our pretrained models on large-scale generated datasets of 1 million samples. Further, the model is tuned with policy gradient algorithm, provided a critic that estimates the reward for the property of interest. We show a significant distribution shift to the desired range for lipophilicity, drug-likeness, and melting point outperforming state-of-the-art works. With the use of rejection sampling based on valency constraints, our model yields 100% validity. Moreover, we show that invalid molecules provide a rich signal to the model through the use of structure penalty in our reinforcement learning pipeline.


title: Estimates of Dirichlet Eigenvalues for a Class of Sub-elliptic Operators

abstract: Let $\Omega$ be a bounded connected open subset in $\mathbb{R}^n$ with smooth boundary $\partial\Omega$. Suppose that we have a system of real smooth vector fields $X=(X_{1},X_{2},$ $\cdots,X_{m})$ defined on a neighborhood of $\overline{\Omega}$ that satisfies the H\"{o}rmander's condition. Suppose further that $\partial\Omega$ is non-characteristic with respect to $X$. For a self-adjoint sub-elliptic operator $\triangle_{X}= -\sum_{i=1}^{m}X_{i}^{*} X_i$ on $\Omega$, we denote its $k^{th}$ Dirichlet eigenvalue by $\lambda_k$. We will provide an uniform upper bound for the sub-elliptic Dirichlet heat kernel. We will also give an explicit sharp lower bound estimate for $\lambda_{k}$, which has a polynomially growth in $k$ of the order related to the generalized M\'{e}tivier index. We will establish an explicit asymptotic formula of $\lambda_{k}$ that generalizes the M\'{e}tivier's results in 1976. Our asymptotic formula shows that under a certain condition, our lower bound estimate for $\lambda_{k}$ is optimal in terms of the growth of $k$. Moreover, the upper bound estimate of the Dirichlet eigenvalues for general sub-elliptic operators will also be given, which, in a certain sense, has the optimal growth order.


title: The Origin of the Stellar Mass-Stellar Metallicity Relation in the Milky Way Satellites and beyond

abstract: Observations and semianalytical galaxy formation and evolution models (SAMs) have suggested the existence of a stellar mass-stellar metallicity relation (MZR), which is shown to be universal for different types of galaxies over a large range of stellar masses ($M_*\sim 10^3$-$10^{11}M_\odot$) and dark matter (DM) halo masses ($M_{\rm halo}\sim 10^9$-$10^{15}h^{-1}M_\odot$). In this work, we construct a chemical evolution model to investigate the origin of the MZR, including both the effects of gas inflows and outflows in galaxies. We solve the MZR from the chemical evolution model, by assuming that the cold gas mass ($M_{\rm cold}$) and the stellar feedback efficiency ($\beta$) follow some power-law scaling relationships with $M_*$ during the growth of a galaxy, i.e., $M_{\rm cold}\propto M_*^{\alpha_{\rm gs}}$ and $\beta\propto M_*^{\alpha_{\beta{\rm s}}}$. We use the SAM to obtain these power-law scaling relations, which appear to be roughly universal over a large range of stellar masses for both satellites and central galaxies within a large range of halo masses. The range of the MZRs produced by our models is in a narrow space, which provides support to the universality of the MZRs. The formation of the MZR is a result caused jointly by that the cold gas fraction decreases with increasing $M_*$ and by that the stellar feedback efficiency decreases with increasing $M_*$ in the galaxy growth, and the exponent in the MZR is around $-\alpha_{\beta{\rm s}}$ or $1-\alpha_{\rm gs}$. The MZR represents an ''average'' evolutional track for the stellar metallicity of a galaxy. The comparison of our model with some previous models for the origin of MZRs is also discussed.


title: An uncountable J\'{o}nsson algebra in a minimal variety

abstract: We construct a J\'{o}nsson algebra of cardinality $\omega_1$ in the variety of J\'{o}nsson-Tarski algebras.


title: Efficient Multiway Hash Join on Reconfigurable Hardware

abstract: We propose the algorithms for performing multiway joins using a new type of coarse grain reconfigurable hardware accelerator~-- ``Plasticine''~-- that, compared with other accelerators, emphasizes high compute capability and high on-chip communication bandwidth. Joining three or more relations in a single step, i.e. multiway join, is efficient when the join of any two relations yields too large an intermediate relation. We show at least 200X speedup for a sequence of binary hash joins execution on Plasticine over CPU. We further show that in some realistic cases, a Plasticine-like accelerator can make 3-way joins more efficient than a cascade of binary hash joins on the same hardware, by a factor of up to 45X.


title: Characterization of cell division control strategies through continuous rate models

abstract: Recent experiments have supported the Adder model for E. coli division control. This model posits that bacteria grow, on average, a fixed size before division. It also predicts decorrelation between the noise in the added size and the size at birth. Here we use new experiments and a theoretical approach based on continuous rate models to explore deviations from the adder strategy, specifically, the division control of E. coli growing with glycerol as carbon source. In this medium, the division strategy is sizer-like, which means that the added size decreases with the size at birth. We found that in a sizer-like strategy the mean added size decreases with the size at birth while the noise in added size increases. We discuss possible molecular mechanisms underlying this strategy, and propose a general model that encompasses the different division strategies.


title: Deep Learning for Distributed Optimization: Applications to Wireless Resource Management

abstract: This paper studies a deep learning (DL) framework to solve distributed non-convex constrained optimizations in wireless networks where multiple computing nodes, interconnected via backhaul links, desire to determine an efficient assignment of their states based on local observations. Two different configurations are considered: First, an infinite-capacity backhaul enables nodes to communicate in a lossless way, thereby obtaining the solution by centralized computations. Second, a practical finite-capacity backhaul leads to the deployment of distributed solvers equipped along with quantizers for communication through capacity-limited backhaul. The distributed nature and the nonconvexity of the optimizations render the identification of the solution unwieldy. To handle them, deep neural networks (DNNs) are introduced to approximate an unknown computation for the solution accurately. In consequence, the original problems are transformed to training tasks of the DNNs subject to non-convex constraints where existing DL libraries fail to extend straightforwardly. A constrained training strategy is developed based on the primal-dual method. For distributed implementation, a novel binarization technique at the output layer is developed for quantization at each node. Our proposed distributed DL framework is examined in various network configurations of wireless resource management. Numerical results verify the effectiveness of our proposed approach over existing optimization techniques.


title: Learning Equilibria of Simulation-Based Games

abstract: We tackle a fundamental problem in empirical game-theoretic analysis (EGTA), that of learning equilibria of simulation-based games. Such games cannot be described in analytical form; instead, a black-box simulator can be queried to obtain noisy samples of utilities. Our approach to EGTA is in the spirit of probably approximately correct learning. We design algorithms that learn so-called empirical games, which uniformly approximate the utilities of simulation-based games with finite-sample guarantees. These algorithms can be instantiated with various concentration inequalities. Building on earlier work, we first apply Hoeffding's bound, but as the size of the game grows, this bound eventually becomes statistically intractable; hence, we also use the Rademacher complexity. Our main results state: with high probability, all equilibria of the simulation-based game are approximate equilibria in the empirical game (perfect recall); and conversely, all approximate equilibria in the empirical game are approximate equilibria in the simulation-based game (approximately perfect precision). We evaluate our algorithms on several synthetic games, showing that they make frugal use of data, produce accurate estimates more often than the theory predicts, and are robust to different forms of noise.


title: A Value-based Trust Assessment Model for Multi-agent Systems

abstract: An agent's assessment of its trust in another agent is commonly taken to be a measure of the reliability/predictability of the latter's actions. It is based on the trustor's past observations of the behaviour of the trustee and requires no knowledge of the inner-workings of the trustee. However, in situations that are new or unfamiliar, past observations are of little help in assessing trust. In such cases, knowledge about the trustee can help. A particular type of knowledge is that of values - things that are important to the trustor and the trustee. In this paper, based on the premise that the more values two agents share, the more they should trust one another, we propose a simple approach to trust assessment between agents based on values, taking into account if agents trust cautiously or boldly, and if they depend on others in carrying out a task.


title: Measurement of Charge Cloud Size in X-ray SOI Pixel Sensors

abstract: We report on a measurement of the size of charge clouds produced by X-ray photons in X-ray SOI (Silicon-On-Insulator) pixel sensor named XRPIX. We carry out a beam scanning experiment of XRPIX using a monochromatic X-ray beam at 5.0 keV collimated to $\sim 10$ $\mu$m with a 4-$\mu$m$\phi$ pinhole, and obtain the spatial distribution of single-pixel events at a sub-pixel scale. The standard deviation of charge clouds of 5.0 keV X-ray is estimated to be $\sigma_{\rm cloud} = 4.30 \pm 0.07$ $\mu$m. Compared to the detector response simulation, the estimated charge cloud size is well explained by a combination of photoelectron range, thermal diffusion, and Coulomb repulsion. Moreover, by analyzing the fraction of multi-pixel events in various energies, we find that the energy dependence of the charge cloud size is also consistent with the simulation.


title: Supervised Online Hashing via Similarity Distribution Learning

abstract: Online hashing has attracted extensive research attention when facing streaming data. Most online hashing methods, learning binary codes based on pairwise similarities of training instances, fail to capture the semantic relationship, and suffer from a poor generalization in large-scale applications due to large variations. In this paper, we propose to model the similarity distributions between the input data and the hashing codes, upon which a novel supervised online hashing method, dubbed as Similarity Distribution based Online Hashing (SDOH), is proposed, to keep the intrinsic semantic relationship in the produced Hamming space. Specifically, we first transform the discrete similarity matrix into a probability matrix via a Gaussian-based normalization to address the extremely imbalanced distribution issue. And then, we introduce a scaling Student t-distribution to solve the challenging initialization problem, and efficiently bridge the gap between the known and unknown distributions. Lastly, we align the two distributions via minimizing the Kullback-Leibler divergence (KL-diverence) with stochastic gradient descent (SGD), by which an intuitive similarity constraint is imposed to update hashing model on the new streaming data with a powerful generalizing ability to the past data. Extensive experiments on three widely-used benchmarks validate the superiority of the proposed SDOH over the state-of-the-art methods in the online retrieval task.


title: Using Latent Variable Models to Observe Academic Pathways

abstract: Understanding large-scale patterns in student course enrollment is a problem of great interest to university administrators and educational researchers. Yet important decisions are often made without a good quantitative framework of the process underlying student choices. We propose a probabilistic approach to modelling course enrollment decisions, drawing inspiration from multilabel classification and mixture models. We use ten years of anonymized student transcripts from a large university to construct a Gaussian latent variable model that learns the joint distribution over course enrollments. The models allow for a diverse set of inference queries and robustness to data sparsity. We demonstrate the efficacy of this approach in comparison to others, including deep learning architectures, and demonstrate its ability to infer the underlying student interests that guide enrollment decisions.


title: Coexistence of polar displacements and conduction in doped ferroelectrics: an ab initio comparative study

abstract: Polar metals are rare because free carriers in metals screen electrostatic potential and eliminate internal dipoles. Degenerate doped ferroelectrics may create an approximate polar metallic phase. We use first-principles calculations to investigate $n$-doped LiNbO$_3$-type oxides (LiNbO$_3$ as the prototype) and compare to widely studied perovskite oxides (BaTiO$_3$ as the prototype). In the rigid-band approximation, substantial polar displacements in $n$-doped LiNbO$_3$ persist even at 0.3 $e$/f.u. ($\simeq$ 10$^{21}$ cm$^{-3}$), while polar displacements in $n$-doped BaTiO$_3$ quickly get suppressed and completely vanish at 0.1 $e$/f.u. Furthermore, in $n$-doped LiNbO$_3$, Li-O displacements decay more slowly than Nb-O displacements, while in $n$-doped BaTiO$_3$, Ba-O and Ti-O displacements decay approximately at the same rate. Supercell calculations that use oxygen vacancies as electron donors support the main results from the rigid-band approximation and provide more detailed charge distributions. Substantial cation displacements are observed throughout LiNbO$_{3-\delta}$($\delta = 4.2\%$), while cation displacements in BaTiO$_{3-\delta}$($\delta = 4.2\%$) are almost completely suppressed. We find that conduction electrons in LiNbO$_{3-\delta}$ are not as uniformly distributed as in BaTiO$_{3-\delta}$, implying that the rigid-band approximation should be used with caution in simulating electron doped LiNbO$_3$-type oxides. Our work shows that polar distortions and conduction can coexist in a wide range of electron concentration in $n$-doped LiNbO$_3$, which is a practical approach to generating an approximate polar metallic phase. Combining doped ferroelectrics and doped semiconductors may create new functions for devices.


title: Origin of Two Larmor Frequencies in the Coherent Spin Dynamics of Colloidal CdSe Quantum Dots Revealed by Controlled Charging

abstract: Coherent spin dynamics in colloidal CdSe quantum dots (QDs) typically show two spin components with different Larmor frequencies, whose origin is an open question. We exploit the photocharging approach to identify their origin and find that surface states play a key role in the appearance of the spin signals. By controlling the photocharging with electron or hole acceptors, we show that the specific spin component can be enhanced by the choice of acceptor type. In core/shell CdSe/ZnS QDs, the spin signals are significantly weaker. Our results exclude the neutral exciton as the spin origin and suggest that both Larmor frequencies are related to the coherent spin precession of electrons in photocharged QDs. The lower frequency is due to the electron confined in the middle of the QD, and the higher frequency to the electron additionally localized in the vicinity of the surface.


title: Residual Networks as Nonlinear Systems: Stability Analysis using Linearization

abstract: We regard pre-trained residual networks (ResNets) as nonlinear systems and use linearization, a common method used in the qualitative analysis of nonlinear systems, to understand the behavior of the networks under small perturbations of the input images. We work with ResNet-56 and ResNet-110 trained on the CIFAR-10 data set. We linearize these networks at the level of residual units and network stages, and the singular value decomposition is used in the stability analysis of these components. It is found that most of the singular values of the linearizations of residual units are 1 and, in spite of the fact that the linearizations depend directly on the activation maps, the singular values differ only slightly for different input images. However, adjusting the scaling of the skip connection or the values of the weights in a residual unit has a significant impact on the singular value distributions. Inspection of how random and adversarial perturbations of input images propagate through the network reveals that there is a dramatic jump in the magnitude of adversarial perturbations towards the end of the final stage of the network that is not present in the case of random perturbations. We attempt to gain a better understanding of this phenomenon by projecting the perturbations onto singular vectors of the linearizations of the residual units.


title: More on Numbers and Graphs

abstract: In this note we revisit a "ring of graphs" Q in which the set of finite simple graphs N extend the role of the natural numbers and the signed graphs Z extend the role of the integers. We point out the existence of a norm which allows to complete Q to a real or complex Banach algebra R or C.


title: Design Light-weight 3D Convolutional Networks for Video Recognition Temporal Residual, Fully Separable Block, and Fast Algorithm

abstract: Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory access and computing power prohibit it from being used in resource-constrained scenarios, such as portable and edge devices. So in this paper, we first propose a two-stage Fully Separable Block (FSB) to significantly compress the model sizes of 3D ConvNets. Then a feature enhancement approach named Temporal Residual Gradient (TRG) is developed to improve the performance of compressed model on video tasks, which provides higher accuracy, faster convergency and better robustness. Moreover, in order to further decrease the computing workload, we propose a hybrid Fast Algorithm (hFA) to drastically reduce the computation complexity of convolutions. These methods are effectively combined to design a light-weight and efficient ConvNet for video recognition tasks. Experiments on the popular dataset report 2.3x compression rate, 3.6x workload reduction, and 6.3% top-1 accuracy gain, over the state-of-the-art SlowFast model, which is already a highly compact model. The proposed methods also show good adaptability on traditional 3D ConvNet, demonstrating 7.4x more compact model, 11.0x less workload, and 3.0% higher accuracy


title: Multi-Precision Quantized Neural Networks via Encoding Decomposition of -1 and +1

abstract: The training of deep neural networks (DNNs) requires intensive resources both for computation and for storage performance. Thus, DNNs cannot be efficiently applied to mobile phones and embedded devices, which seriously limits their applicability in industry applications. To address this issue, we propose a novel encoding scheme of using {-1,+1} to decompose quantized neural networks (QNNs) into multi-branch binary networks, which can be efficiently implemented by bitwise operations (xnor and bitcount) to achieve model compression, computational acceleration and resource saving. Based on our method, users can easily achieve different encoding precisions arbitrarily according to their requirements and hardware resources. The proposed mechanism is very suitable for the use of FPGA and ASIC in terms of data storage and computation, which provides a feasible idea for smart chips. We validate the effectiveness of our method on both large-scale image classification tasks (e.g., ImageNet) and object detection tasks. In particular, our method with low-bit encoding can still achieve almost the same performance as its full-precision counterparts.


title: Vehicle Detection in Deep Learning

abstract: Computer vision is developing rapidly with the support of deep learning techniques. This thesis proposes an advanced vehicle-detection model based on an improvement to classical convolutional neural networks. The advanced model was applied against a vehicle detection benchmark and was built to detect on-road objects. First, we propose a high-level architecture for our advanced model, which utilizes different state-of-the-art deep learning techniques. Then, we utilize the residual neural networks and region proposal network to achieve competitive performance according to the vehicle detection benchmark. Lastly, we describe the developing trend of vehicle detection techniques and the future direction of research.


title: Rethinking Table Recognition using Graph Neural Networks

abstract: Document structure analysis, such as zone segmentation and table recognition, is a complex problem in document processing and is an active area of research. The recent success of deep learning in solving various computer vision and machine learning problems has not been reflected in document structure analysis since conventional neural networks are not well suited to the input structure of the problem. In this paper, we propose an architecture based on graph networks as a better alternative to standard neural networks for table recognition. We argue that graph networks are a more natural choice for these problems, and explore two gradient-based graph neural networks. Our proposed architecture combines the benefits of convolutional neural networks for visual feature extraction and graph networks for dealing with the problem structure. We empirically demonstrate that our method outperforms the baseline by a significant margin. In addition, we identify the lack of large scale datasets as a major hindrance for deep learning research for structure analysis and present a new large scale synthetic dataset for the problem of table recognition. Finally, we open-source our implementation of dataset generation and the training framework of our graph networks to promote reproducible research in this direction.


title: Cumulative link models for deep ordinal classification

abstract: This paper proposes a deep convolutional neural network model for ordinal regression by considering a family of probabilistic ordinal link functions in the output layer. The link functions are those used for cumulative link models, which are traditional statistical linear models based on projecting each pattern into a 1-dimensional space. A set of ordered thresholds splits this space into the different classes of the problem. In our case, the projections are estimated by a non-linear deep neural network. To further improve the results, we combine these ordinal models with a loss function that takes into account the distance between the categories, based on the weighted Kappa index. Three different link functions are studied in the experimental study, and the results are contrasted with statistical analysis. The experiments run over two different ordinal classification problems and the statistical tests confirm that these models improve the results of a nominal model and outperform other robust proposals considered in the literature.


title: A structure theorem for finite fields

abstract: We present a new structure theorem for finite fields of odd order that relates multiplicative and additive structure in an interesting way. This theorem has several applications, including an improved understanding of Dickson and Chebyshev polynomials and some formulas with a number-theoretic flavor. This paper is an abridged version of two math arXiv articles by the author [arXiv:1707.06870, arXiv:1707.06877].


title: Deep Representation Learning for Road Detection through Siamese Network

abstract: Robust road detection is a key challenge in safe autonomous driving. Recently, with the rapid development of 3D sensors, more and more researchers are trying to fuse information across different sensors to improve the performance of road detection. Although many successful works have been achieved in this field, methods for data fusion under deep learning framework is still an open problem. In this paper, we propose a Siamese deep neural network based on FCN-8s to detect road region. Our method uses data collected from a monocular color camera and a Velodyne-64 LiDAR sensor. We project the LiDAR point clouds onto the image plane to generate LiDAR images and feed them into one of the branches of the network. The RGB images are fed into another branch of our proposed network. The feature maps that these two branches extract in multiple scales are fused before each pooling layer, via padding additional fusion layers. Extensive experimental results on public dataset KITTI ROAD demonstrate the effectiveness of our proposed approach.


title: Narrow-band photonic quantum entanglement with counterpropagating domain engineering

abstract: Photonic entanglement is a crucial resource for quantum information technologies, including quantum information processing and long-distance communication. These applications call for narrow-band entanglement sources, being compatible with the photon-electron interfaces and relax the dispersion-induced entanglement-degradation in the network mediums. However, such Giga-hertz-level bandwidth is a challenge for the photonic entanglement based on conventional spontaneous parametric down-conversion. Here we introduce a state-of-art domain-engineering technology for the counterpropagating phase matching in the polarization-entanglement generation, which results in an inherent bandwidth of 7.1 GHz at telecom wavelength. This geometry also resolves the fundamental challenge for the deterministic separation of the entangled photon pairs at frequency degeneracy, so that efficient collinear interaction can be achieved in a periodically-poled KTP waveguide and results in a spectral brightness of 3.4*10^3(GHz*mW*s)^-1. The 155 ps base-to-base Hong-Ou-Mandel dip also confirms the source bandwidth, with and a high interference visibility of 97.1%. The entanglement is measured to violate the Bell inequality by up to 18.5 standard deviations, with Clauser-Horne-Shimony-Holt S-parameter of 2.720. The quantum state tomography further characterizes the entanglement, with fidelity F=95.71%. These unique features establish a cornerstone for the photonic entanglement sources development and warrant broad practical quantum information applications.


title: Effect of driving on coarsening dynamics in phase-separating systems

abstract: We consider the Cahn-Hilliard (CH) equation with a Burgers-type convective term that is used as a model of coarsening dynamics in laterally driven phase-separating systems. In the absence of driving, it is known that solutions to the standard CH equation are characterized by an initial stage of phase separation into regions of one phase surrounded by the other phase (i.e., clusters or drops/holes or islands are obtained) followed by the coarsening process, where the average size of the structures grows in time and their number decreases. Moreover, two main coarsening modes have been identified in the literature, namely, coarsening due to volume transfer and due to translation. In the opposite limit of strong driving, the well-known Kuramoto-Sivashinsky (KS) equation is recovered, which may produce complicated chaotic spatio-temporal oscillations. The primary aim of the present work is to perform a detailed and systematic investigation of the transitions in the solutions of the convective CH (cCH) equation for a wide range of parameter values, and, in particular, to understand in detail how the coarsening dynamics is affected by an increase of the strength of the lateral driving force. Considering symmetric two-drop states, we find that one of the coarsening modes is stabilized at relatively weak driving, and the type of the remaining mode may change as driving increases. Furthermore, there exist intervals in the driving strength where coarsening is completely stabilized. In the intervals where the symmetric two-drop states are unstable they can evolve, for example, into one-drop states, two-drop states of broken symmetry or even time-periodic two-drop states that consist of two traveling drops that periodically exchange mass. We present detailed stability diagrams for symmetric two-drop states in various parameter planes and corroborate our findings by selected time simulations.


title: The amplitude of solar p-mode oscillations from three-dimensional convection simulations

abstract: The amplitude of solar p-mode oscillations is governed by stochastic excitation and mode damping, both of which take place in the surface convection zone. However, the time-dependent, turbulent nature of convection makes it difficult to self-consistently study excitation and damping processes through the use of traditional one-dimensional hydrostatic models. To this end, we carried out \textit{ab initio} three-dimensional, hydrodynamical numerical simulations of the solar atmosphere to investigate how p-modes are driven and dissipated in the Sun. The description of surface convection in the simulations is free from the tuneable parameters typically adopted in traditional one-dimensional models. Mode excitation and damping rates are computed based on analytical expressions whose ingredients are evaluated directly from the three-dimensional model. With excitation and damping rates both available, we estimate the theoretical oscillation amplitude and frequency of maximum power, $\nu_{\max}$, for the Sun. We compare our numerical results with helioseismic observations, finding encouraging agreement between the two. The numerical method presented here provides a novel way to investigate the physical processes responsible for mode driving and damping, and should be valid for all solar-type oscillating stars.


title: Hereditary Interval Algebras and Cardinal Characteristics of the Continuum

abstract: An interval algebra is a Boolean algebra which is isomorphic to the algebra of finite unions of half-open intervals, of a linearly ordered set. An interval algebra is hereditary if every subalgebra is an interval algebra. We answer a question of M. Bekkali and S. Todor\v{c}evi\'c, by showing that it is consistent that every $\sigma$-centered interval algebra of size $\mathfrak{b}$ is hereditary. We also show that there is, in ZFC, an hereditary interval algebra of cardinality $\aleph_1.$


title: Real-Time Adversarial Attacks

abstract: In recent years, many efforts have demonstrated that modern machine learning algorithms are vulnerable to adversarial attacks, where small, but carefully crafted, perturbations on the input can make them fail. While these attack methods are very effective, they only focus on scenarios where the target model takes static input, i.e., an attacker can observe the entire original sample and then add a perturbation at any point of the sample. These attack approaches are not applicable to situations where the target model takes streaming input, i.e., an attacker is only able to observe past data points and add perturbations to the remaining (unobserved) data points of the input. In this paper, we propose a real-time adversarial attack scheme for machine learning models with streaming inputs.


title: A Primer on Persistent Homology of Finite Metric Spaces

abstract: TDA (topological data analysis) is a relatively new area of research related to importing classical ideas from topology into the realm of data analysis. Under the umbrella term TDA, there falls, in particular, the notion of persistent homology, which can be described in a nutshell, as the study of scale dependent homological invariants of datasets. In these notes, we provide a terse self contained description of the main ideas behind the construction of persistent homology as an invariant feature of datasets, and its stability to perturbations.


title: Realization of phase locking in good-bad-cavity active optical clock

abstract: The residual cavity-pulling effect limits further narrowing of linewidth in dual-wavelength (DW) good-bad-cavity active optical clocks (AOCs). In this paper, we for the first time experimentally realize the cavity-length stabilization of the 1064/1470 nm DW-AOCs by utilizing the phase locking technique of two independent 1064 nm good-cavity lasers. The frequency tracking accuracy between the two main-cavities of DW-AOCs is better than $3 \times {10^{ - 16}}$ at 1 s, and can reach $1 \times {10^{ - 17}}$ at 1000 s. Each 1470 nm bad-cavity laser achieves a most probable linewidth of 53 Hz, which is about a quarter of that without phase locking. The influence of the asynchronous cavity-lengths variation between two DW laser systems is suppressed.


title: Safety Augmented Value Estimation from Demonstrations (SAVED): Safe Deep Model-Based RL for Sparse Cost Robotic Tasks

abstract: Reinforcement learning (RL) for robotics is challenging due to the difficulty in hand-engineering a dense cost function, which can lead to unintended behavior, and dynamical uncertainty, which makes exploration and constraint satisfaction challenging. We address these issues with a new model-based reinforcement learning algorithm, Safety Augmented Value Estimation from Demonstrations (SAVED), which uses supervision that only identifies task completion and a modest set of suboptimal demonstrations to constrain exploration and learn efficiently while handling complex constraints. We then compare SAVED with 3 state-of-the-art model-based and model-free RL algorithms on 6 standard simulation benchmarks involving navigation and manipulation and a physical knot-tying task on the da Vinci surgical robot. Results suggest that SAVED outperforms prior methods in terms of success rate, constraint satisfaction, and sample efficiency, making it feasible to safely learn a control policy directly on a real robot in less than an hour. For tasks on the robot, baselines succeed less than 5% of the time while SAVED has a success rate of over 75% in the first 50 training iterations. Code and supplementary material is available at https://tinyurl.com/saved-rl.


title: Deep Bayesian Optimization on Attributed Graphs

abstract: Attributed graphs, which contain rich contextual features beyond just network structure, are ubiquitous and have been observed to benefit various network analytics applications. Graph structure optimization, aiming to find the optimal graphs in terms of some specific measures, has become an effective computational tool in complex network analysis. However, traditional model-free methods suffer from the expensive computational cost of evaluating graphs; existing vectorial Bayesian optimization methods cannot be directly applied to attributed graphs and have the scalability issue due to the use of Gaussian processes (GPs). To bridge the gap, in this paper, we propose a novel scalable Deep Graph Bayesian Optimization (DGBO) method on attributed graphs. The proposed DGBO prevents the cubical complexity of the GPs by adopting a deep graph neural network to surrogate black-box functions, and can scale linearly with the number of observations. Intensive experiments are conducted on both artificial and real-world problems, including molecular discovery and urban road network design, and demonstrate the effectiveness of the DGBO compared with the state-of-the-art.


title: Data-driven Algorithm Selection and Parameter Tuning: Two Case studies in Optimization and Signal Processing

abstract: Machine learning algorithms typically rely on optimization subroutines and are well-known to provide very effective outcomes for many types of problems. Here, we flip the reliance and ask the reverse question: can machine learning algorithms lead to more effective outcomes for optimization problems? Our goal is to train machine learning methods to automatically improve the performance of optimization and signal processing algorithms. As a proof of concept, we use our approach to improve two popular data processing subroutines in data science: stochastic gradient descent and greedy methods in compressed sensing. We provide experimental results that demonstrate the answer is ``yes'', machine learning algorithms do lead to more effective outcomes for optimization problems, and show the future potential for this research direction.


title: Luck Matters: Understanding Training Dynamics of Deep ReLU Networks

abstract: We analyze the dynamics of training deep ReLU networks and their implications on generalization capability. Using a teacher-student setting, we discovered a novel relationship between the gradient received by hidden student nodes and the activations of teacher nodes for deep ReLU networks. With this relationship and the assumption of small overlapping teacher node activations, we prove that (1) student nodes whose weights are initialized to be close to teacher nodes converge to them at a faster rate, and (2) in over-parameterized regimes and 2-layer case, while a small set of lucky nodes do converge to the teacher nodes, the fan-out weights of other nodes converge to zero. This framework provides insight into multiple puzzling phenomena in deep learning like over-parameterization, implicit regularization, lottery tickets, etc. We verify our assumption by showing that the majority of BatchNorm biases of pre-trained VGG11/16 models are negative. Experiments on (1) random deep teacher networks with Gaussian inputs, (2) teacher network pre-trained on CIFAR-10 and (3) extensive ablation studies validate our multiple theoretical predictions.


title: RSS-Based Q-Learning for Indoor UAV Navigation

abstract: In this paper, we focus on the potential use of unmanned aerial vehicles (UAVs) for search and rescue (SAR) missions in GPS-denied indoor environments. We consider the problem of navigating a UAV to a wireless signal source, e.g., a smartphone or watch owned by a victim. We assume that the source periodically transmits RF signals to nearby wireless access points. Received signal strength (RSS) at the UAV, which is a function of the UAV and source positions, is fed to a Q-learning algorithm and the UAV is navigated to the vicinity of the source. Unlike the traditional location-based Q-learning approach that uses the GPS coordinates of the agent, our method uses the RSS to define the states and rewards of the algorithm. It does not require any a priori information about the environment. These, in turn, make it possible to use the UAVs in indoor SAR operations. Two indoor scenarios with different dimensions are created using a ray tracing software. Then, the corresponding heat maps that show the RSS at each possible UAV location are extracted for more realistic analysis. Performance of the RSS-based Q-learning algorithm is compared with the baseline (location-based) Q-learning algorithm in terms of convergence speed, average number of steps per episode, and the total length of the final trajectory. Our results show that the RSS-based Q-learning provides competitive performance with the location-based Q-learning.


title: A simple and efficient numerical method for pricing discretely monitored early-exercise options

abstract: We present a simple, fast, and accurate method for pricing a variety of discretely monitored options in the Black-Scholes framework, including autocallable structured products, single and double barrier options, and Bermudan options. The method is based on a quadrature technique, and it employs only elementary calculations and a fixed one-dimensional uniform grid. The convergence rate is $O(1/N^4)$ and the complexity is $O(MN\log N)$, where $N$ is the number of grid points and $M$ is the number of observation dates.


title: Improving the resolution of Cryo-EM single particle analysis

abstract: We presented a new 3D refinement method for Cryo-EM single particle analysis which can improve the resolution of final electron density map in this paper. We proposed to enforce both sparsity and smoothness to improve the regularity of electron density map in the refinement process. To achieve this goal, we designed a novel type of real space penalty function and incorporated it into the refinement process. We bridged the backprojection step with local kernel regression, thus enabling us to embed the 3D model in reproducing kernel Hilbert space using specific kernels. We also proposed a first order method to solve the resulting optimization problem and implemented it efficiently with CUDA. We compared the performance of our new method with respect to the traditional method on real datasets using a set of widely used metrics for Cryo-EM model validation. We demonstrated that our method outperforms the traditional method in terms of those metrics. The implementation of our method can be found at https://github.com/alncat/cryoem.


title: Bypassing Backdoor Detection Algorithms in Deep Learning

abstract: Deep learning models are vulnerable to various adversarial manipulations of their training data, parameters, and input sample. In particular, an adversary can modify the training data and model parameters to embed backdoors into the model, so the model behaves according to the adversary's objective if the input contains the backdoor features, referred to as the backdoor trigger (e.g., a stamp on an image). The poisoned model's behavior on clean data, however, remains unchanged. Many detection algorithms are designed to detect backdoors on input samples or model parameters, through the statistical difference between the latent representations of adversarial and clean input samples in the poisoned model. In this paper, we design an adversarial backdoor embedding algorithm that can bypass the existing detection algorithms including the state-of-the-art techniques. We design an adaptive adversarial training algorithm that optimizes the original loss function of the model, and also maximizes the indistinguishability of the hidden representations of poisoned data and clean data. This work calls for designing adversary-aware defense mechanisms for backdoor detection.


title: Non-scattering energies for acoustic-type equations on manifolds with a single flat end

abstract: In this paper, we consider the scattering theory for acoustic-type equations on non-compact manifolds with a single flat end. Our main purpose is to show an existence result of non-scattering energies. Precisely, we show a Weyl-type lower bound for the number of non-scattering energies. Usually a scattered wave occurs for every incident wave by the inhomogeneity of the media. However, there may exist suitable wavenumbers and patterns of incident waves such that the corresponding scattered wave vanishes. We call (the square of) this wavenumber a non-scattering energy in this paper. The problem of non-scattering energies can be reduced to a well-known interior transmission eigenvalues problem.


title: Understanding and Extending Incremental Determinization for 2QBF

abstract: Incremental determinization is a recently proposed algorithm for solving quantified Boolean formulas with one quantifier alternation. In this paper, we formalize incremental determinization as a set of inference rules to help understand the design space of similar algorithms. We then present additional inference rules that extend incremental determinization in two ways. The first extension integrates the popular CEGAR principle and the second extension allows us to analyze different cases in isolation. The experimental evaluation demonstrates that the extensions significantly improve the performance.


title: Semi-supervised Learning for Acoustic Impedance Inversion

abstract: Recent applications of deep learning in the seismic domain have shown great potential in different areas such as inversion and interpretation. Deep learning algorithms, in general, require tremendous amounts of labeled data to train properly. To overcome this issue, we propose a semi-supervised framework for acoustic impedance inversion based on convolutional and recurrent neural networks. Specifically, seismic traces and acoustic impedance traces are modeled as time series. Then, a neural-network-based inversion model comprising convolutional and recurrent neural layers is used to invert seismic data for acoustic impedance. The proposed workflow uses well log data to guide the inversion. In addition, it utilizes a learned seismic forward model to regularize the training and to serve as a geophysical constraint for the inversion. The proposed workflow achieves an average correlation of 98% between the estimated and target elastic impedance using 20 AI traces for training.


title: Improving Open Information Extraction via Iterative Rank-Aware Learning

abstract: Open information extraction (IE) is the task of extracting open-domain assertions from natural language sentences. A key step in open IE is confidence modeling, ranking the extractions based on their estimated quality to adjust precision and recall of extracted assertions. We found that the extraction likelihood, a confidence measure used by current supervised open IE systems, is not well calibrated when comparing the quality of assertions extracted from different sentences. We propose an additional binary classification loss to calibrate the likelihood to make it more globally comparable, and an iterative learning process, where extractions generated by the open IE model are incrementally included as training samples to help the model learn from trial and error. Experiments on OIE2016 demonstrate the effectiveness of our method. Code and data are available at https://github.com/jzbjyb/oie_rank.


title: Targeted Estimation of L2 Distance Between Densities and its Application to Geo-spatial Data

abstract: We examine the integrated squared difference, also known as the L2 distance (L2D), between two probability densities. Such a distance metric allows for comparison of differences between pairs of distributions or changes in a distribution over time. We propose a targeted maximum likelihood estimator for this parameter based on samples of independent and identically distributed observations from both underlying distributions. We compare our method to kernel density estimation and demonstrate superior performance for our method with regards to confidence interval coverage rate and mean squared error.


title: ParPaRaw: Massively Parallel Parsing of Delimiter-Separated Raw Data

abstract: Parsing is essential for a wide range of use cases, such as stream processing, bulk loading, and in-situ querying of raw data. Yet, the compute-intense step often constitutes a major bottleneck in the data ingestion pipeline, since parsing of inputs that require more involved parsing rules is challenging to parallelise. This work proposes a massively parallel algorithm for parsing delimiter-separated data formats on GPUs. Other than the state-of-the-art, the proposed approach does not require an initial sequential pass over the input to determine a thread's parsing context. That is, how a thread, beginning somewhere in the middle of the input, should interpret a certain symbol (e.g., whether to interpret a comma as a delimiter or as part of a larger string enclosed in double-quotes). Instead of tailoring the approach to a single format, we are able to perform a massively parallel FSM simulation, which is more flexible and powerful, supporting more expressive parsing rules with general applicability. Achieving a parsing rate of as much as 14.2 GB/s, our experimental evaluation on a GPU with 3584 cores shows that the presented approach is able to scale to thousands of cores and beyond. With an end-to-end streaming approach, we are able to exploit the full-duplex capabilities of the PCIe bus and hide latency from data transfers. Considering the end-to-end performance, the algorithm parses 4.8 GB in as little as 0.44 seconds, including data transfers.


title: Fine-Grained Spoiler Detection from Large-Scale Review Corpora

abstract: This paper presents computational approaches for automatically detecting critical plot twists in reviews of media products. First, we created a large-scale book review dataset that includes fine-grained spoiler annotations at the sentence-level, as well as book and (anonymized) user information. Second, we carefully analyzed this dataset, and found that: spoiler language tends to be book-specific; spoiler distributions vary greatly across books and review authors; and spoiler sentences tend to jointly appear in the latter part of reviews. Third, inspired by these findings, we developed an end-to-end neural network architecture to detect spoiler sentences in review corpora. Quantitative and qualitative results demonstrate that the proposed method substantially outperforms existing baselines.


title: TACNet: Transition-Aware Context Network for Spatio-Temporal Action Detection

abstract: Current state-of-the-art approaches for spatio-temporal action detection have achieved impressive results but remain unsatisfactory for temporal extent detection. The main reason comes from that, there are some ambiguous states similar to the real actions which may be treated as target actions even by a well-trained network. In this paper, we define these ambiguous samples as "transitional states", and propose a Transition-Aware Context Network (TACNet) to distinguish transitional states. The proposed TACNet includes two main components, i.e., temporal context detector and transition-aware classifier. The temporal context detector can extract long-term context information with constant time complexity by constructing a recurrent network. The transition-aware classifier can further distinguish transitional states by classifying action and transitional states simultaneously. Therefore, the proposed TACNet can substantially improve the performance of spatio-temporal action detection. We extensively evaluate the proposed TACNet on UCF101-24 and J-HMDB datasets. The experimental results demonstrate that TACNet obtains competitive performance on JHMDB and significantly outperforms the state-of-the-art methods on the untrimmed UCF101-24 in terms of both frame-mAP and video-mAP.


title: Constructive Type-Logical Supertagging with Self-Attention Networks

abstract: We propose a novel application of self-attention networks towards grammar induction. We present an attention-based supertagger for a refined type-logical grammar, trained on constructing types inductively. In addition to achieving a high overall type accuracy, our model is able to learn the syntax of the grammar's type system along with its denotational semantics. This lifts the closed world assumption commonly made by lexicalized grammar supertaggers, greatly enhancing its generalization potential. This is evidenced both by its adequate accuracy over sparse word types and its ability to correctly construct complex types never seen during training, which, to the best of our knowledge, was as of yet unaccomplished.


title: Fast and Agile Vision-Based Flight with Teleoperation and Collision Avoidance on a Multirotor

abstract: We present a multirotor architecture capable of aggressive autonomous flight and collision-free teleoperation in unstructured, GPS-denied environments. The proposed system enables aggressive and safe autonomous flight around clutter by integrating recent advancements in visual-inertial state estimation and teleoperation. Our teleoperation framework maps user inputs onto smooth and dynamically feasible motion primitives. Collision-free trajectories are ensured by querying a locally consistent map that is incrementally constructed from forward-facing depth observations. Our system enables a non-expert operator to safely navigate a multirotor around obstacles at speeds of 10 m/s. We achieve autonomous flights at speeds exceeding 12 m/s and accelerations exceeding 12 m/s^2 in a series of outdoor field experiments that validate our approach.


title: Sequence Modeling of Temporal Credit Assignment for Episodic Reinforcement Learning

abstract: Recent advances in deep reinforcement learning algorithms have shown great potential and success for solving many challenging real-world problems, including Go game and robotic applications. Usually, these algorithms need a carefully designed reward function to guide training in each time step. However, in real world, it is non-trivial to design such a reward function, and the only signal available is usually obtained at the end of a trajectory, also known as the episodic reward or return. In this work, we introduce a new algorithm for temporal credit assignment, which learns to decompose the episodic return back to each time-step in the trajectory using deep neural networks. With this learned reward signal, the learning efficiency can be substantially improved for episodic reinforcement learning. In particular, we find that expressive language models such as the Transformer can be adopted for learning the importance and the dependency of states in the trajectory, therefore providing high-quality and interpretable learned reward signals. We have performed extensive experiments on a set of MuJoCo continuous locomotive control tasks with only episodic returns and demonstrated the effectiveness of our algorithm.


title: Towards unification of quark and lepton flavors in $A_4$ modular invariance

abstract: We study quark and lepton mass matrices in the $A_4$ modular symmetry towards the unification of the quark and lepton flavors. We adopt modular forms of weights $2$ and $6$ for quarks and charged leptons, while we use modular forms of weight $4$ for the neutrino mass matrix which is generated by the Weinberg operator. We obtain the successful quark mass matrices, in which the down-type quark mass matrix is constructed by modular forms of weight $2$, but the up-type quark mass matrix is constructed by modular forms of weight $6$. Two regions of $\tau$ are consistent with observed CKM matrix elements. The one is close to $\tau=i$ and the other is in the larger ${\rm Im }[\tau]$. On the other hand, lepton mass matrices work well only at nearby $\tau=i$, which overlaps with the one of the quark sector, for the normal hierarchy of neutrino masses. In the common $\tau$ region for quarks and leptons, the predicted sum of neutrino masses is $87$--$120$meV taking account of its cosmological bound. Since both the Dirac CP phase $\delta_{CP}^\ell$ and $\sin^2\theta_{23}$ are correlated with the sum of neutrino masses, improving its cosmological bound provides crucial tests for our scheme as well as the precise measurement of $\sin^2\theta_{23}$ and $\delta_{CP}^\ell$. The effective neutrino mass of the $0\nu\beta\beta$ decay is $\langle m_{ee}\rangle=15$--$31$\,meV. It is remarked that the modulus $\tau$ is fixed at nearby $\tau=i$ in the fundamental domain of SL$(2,Z)$, which suggests the residual symmetry $Z_2$ in the quark and lepton mass matrices. The inverted hierarchy of neutrino masses is excluded by the cosmological bound of the sum of neutrino masses.


title: Discriminative structural graph classification

abstract: This paper focuses on the discrimination capacity of aggregation functions: these are the permutation invariant functions used by graph neural networks to combine the features of nodes. Realizing that the most powerful aggregation functions suffer from a dimensionality curse, we consider a restricted setting. In particular, we show that the standard sum and a novel histogram-based function have the capacity to discriminate between any fixed number of inputs chosen by an adversary. Based on our insights, we design a graph neural network aiming, not to maximize discrimination capacity, but to learn discriminative graph representations that generalize well. Our empirical evaluation provides evidence that our choices can yield benefits to the problem of structural graph classification.


title: The Interplay of Competition and Cooperation Among Service Providers (Part I)

abstract: This paper investigates the incentives of mobile network operators (MNOs) for acquiring additional spectrum to offer mobile virtual network operators (MVNOs) and thereby inviting competition for a common pool of end users (EUs). We consider a base case and two generalizations: (i) one MNO and one MVNO, (ii) one MNO, one MVNO and an outside option, and (iii) two MNOs and one MVNO. In each of these cases, we model the interactions of the service providers (SPs) using a sequential game, identify when the Subgame Perfect Nash Equilibrium (SPNE) exists, when it is unique and characterize the SPNE when it exists. The characterizations are easy to compute, and are in closed form or involve optimizations in only one decision variable. We identify metrics to quantify the interplay between cooperation and competition, and evaluate those as also the SPNEs to show that cooperation between MNO and MVNO can enhance the payoffs of both, while increased competition due to the presence of additional MNOs is beneficial to EUs but reduces the payoffs of the SPs.


title: Linear response in neuronal networks: from neurons dynamics to collective response

abstract: We review two examples where the linear response of a neuronal network submitted to an external stimulus can be derived explicitely, including network parameters dependence. This is done in a statistical physics-like approach where one associates to the spontaneous dynamics of the model a natural notion of Gibbs distribution inherited from ergodic theory or stochastic processes. These two examples are the Amari-Wilson-Cowan model and a conductance based Integrate and Fire model.


title: Cross-sectional Learning of Extremal Dependence among Financial Assets

abstract: We propose a novel probabilistic model to facilitate the learning of multivariate tail dependence of multiple financial assets. Our method allows one to construct from known random vectors, e.g., standard normal, sophisticated joint heavy-tailed random vectors featuring not only distinct marginal tail heaviness, but also flexible tail dependence structure. The novelty lies in that pairwise tail dependence between any two dimensions is modeled separately from their correlation, and can vary respectively according to its own parameter rather than the correlation parameter, which is an essential advantage over many commonly used methods such as multivariate $t$ or elliptical distribution. It is also intuitive to interpret, easy to track, and simple to sample comparing to the copula approach. We show its flexible tail dependence structure through simulation. Coupled with a GARCH model to eliminate serial dependence of each individual asset return series, we use this novel method to model and forecast multivariate conditional distribution of stock returns, and obtain notable performance improvements in multi-dimensional coverage tests. Besides, our empirical finding about the asymmetry of tails of the idiosyncratic component as well as the market component is interesting and worth to be well studied in the future.


title: The interactions between antiferromagnetism, tetrahedral sites and electron-phonon coupling in FeSe1-xTex and FeSe/SrTiO3

abstract: We show that the superconducting transition temperature Tc of FeSe1-xTex can be computed to reasonable values in a modified McMillan approach in which the electron-phonon coupling is amplified by the antiferromagnetism and the out-of-plane phonons triggered by the tetrahedral lattice sites. This interplay is not only effective at ambient pressure, but also under hydrostatic compression. According to our model, the theoretical Tc of the compressed FeSe0.5Te0.5 agrees with experiment results. More importantly, by taking into account the interfacial effect between an FeSe monolayer and its SrTiO3 substrate as an additional gain factor, our calculated Tc value is up to 91 K high, and provides evidence that the strong Tc enhancement recently observed in such monolayers with Tc reaching 100 K may be due to an enhanced-electron phonon coupling.


title: Lattice equations and dielectric function for optical lattice vibrations in monolayer transition metal dichalcogenides

abstract: Using a microscopic dipole lattice model including electronic polarization (EP) of ions and local field effects (LFEs) self-consistently, two sets of three equations are deduced for long wavelength in-plane and out-of-plane optical lattice vibrations in monolayer (ML) transition metal dichalcogenides (TMDs). Expressions for the lattice vibrational energy density are obtained for the two-dimensional (2D) crystals. The linear coefficients of the lattice equations can be determined by first-principles calculation, making these equations very useful for studying the lattice dynamical properties. The two pairs of equations describing the polar vibrations have the same forms as those for ML hexagonal BN and also resemble Huang's equations for bulk [Proc. Roy. Soc. A 208, 352 (1951)]. Each pair of the equations are solved simultaneously with the equation of electrostatics, and explicit expressions are obtained for the in-plane longitudinal and transverse optical (LO and TO) modes and out-of-plane optical (ZO) modes. The LO phonon dispersion relation is identical to the analytical expression of Sohier et al. [Nano Lett. 17, 3758 (2017)]. All the optical phonon branches except for LO are nondispersive at the long wavelengths. A 2D longitudinal lattice dielectric function $\epsilon(k,\omega)$ is deduced, allowing one to rederive the LO phonon dispersion simply from $\epsilon(k,\omega)=0$. A 2D Lyddane--Sachs--Teller relation and a frequency--susceptibility relation are obtained for in-plane and out-of-plane vibrations, respectively, through which the phonon frequencies are related to the 2D dielectric functions or susceptibilities. The explicit expressions are applied to calculate various dynamical properties when knowing three first-principles calculated parameters, and the ionic EP and LFEs are studied thoroughly.


title: Attentional Policies for Cross-Context Multi-Agent Reinforcement Learning

abstract: Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time. We propose new neural policy architectures for these multi-agent problems. In contrast to other methods of training an individual, discrete policy for each agent and then enforcing cooperation through some additional inter-policy mechanism, we follow the spirit of recent work on the power of relational inductive biases in deep networks by learning multi-agent relationships at the policy level via an attentional architecture. In our method, all agents share the same policy, but independently apply it in their own context to aggregate the other agents' state information when selecting their next action. The structure of our architectures allow them to be applied on environments with varying numbers of agents. We demonstrate our architecture on a benchmark multi-agent autonomous vehicle coordination problem, obtaining superior results to a full-knowledge, fully-centralized reference solution, and significantly outperforming it when scaling to large numbers of agents.


title: Differential Equation Invariance Axiomatization

abstract: This article proves the completeness of an axiomatization for differential equation invariants described by Noetherian functions. First, the differential equation axioms of differential dynamic logic are shown to be complete for reasoning about analytic invariants. Completeness crucially exploits differential ghosts, which introduce additional variables that can be chosen to evolve freely along new differential equations. Cleverly chosen differential ghosts are the proof-theoretical counterpart of dark matter. They create new hypothetical state, whose relationship to the original state variables satisfies invariants that did not exist before. The reflection of these new invariants in the original system then enables its analysis. An extended axiomatization with existence and uniqueness axioms is complete for all local progress properties, and, with a real induction axiom, is complete for all semianalytic invariants. This parsimonious axiomatization serves as the logical foundation for reasoning about invariants of differential equations. Indeed, it is precisely this logical treatment that enables the generalization of completeness to the Noetherian case.


title: Privacy-Preserving Detection of IoT Devices Connected Behind a NAT in a Smart Home Setup

abstract: Today, telecommunication service providers (telcos) are exposed to cyber-attacks executed by compromised IoT devices connected to their customers' networks. Such attacks might have severe effects not only on the target of attacks but also on the telcos themselves. To mitigate those risks we propose a machine learning based method that can detect devices of specific vulnerable IoT models connected behind a domestic NAT, thereby identifying home networks that pose a risk to the telco's infrastructure and availability of services. As part of the effort to preserve the domestic customers' privacy, our method relies on NetFlow data solely, refraining from inspecting the payload. To promote future research in this domain we share our novel dataset, collected in our lab from numerous and various commercial IoT devices.


title: Towards to $H_0$ Tension by the Theoretical Hubble Parameter in the Infinite Future

abstract: There exists a constant value of $H(z)$ at $z=-1$ when in $\omega$CDM universe with $\omega > -1$, which is independent on other cosmological parameters. We first combine this theoretical $H(z)$ value with the latest 43 observational $H(z)$ data (OHD) to perform the model-independent Gaussian Processes (GP) and constrain the Hubble constant. We obtain $H_0$=67.67$\pm3.03\ {\rm km\ s^{-1} Mpc^{-1}}$, which is in agreement with $H_0$ values from Plank Collaboration (2015) ($0.24 \sigma $ tension) but a larger deviation from Riess et al. (2016) ($1.60 \sigma $ tension), while $H_0$=71.09\ $\pm3.71\ {\rm km\ s^{-1} Mpc^{-1}}$ $ (0.64 \sigma $ tension) by only using latest 43 OHD. Using this $H_0$ value, we perform $\chi^2$ statistics with Markov Chain Monte Carlo (MCMC) method to constrain cosmological parameters. We obtain $\Omega_M=0.26 \pm 0.02$ and $\omega=-0.85 \pm 0.06$ in flat $\omega CDM$ model, and $\Omega_M=0.27\pm 0.04 , \Omega_\Lambda=0.80 \pm 0.12$ and $\omega=-0.82 \pm 0.07$ in non-flat $\omega CDM$ model, which are larger than those not using the theoretical $H(z)$ value.


title: Current enhancement in solid-state nanopores depends on three-dimensional DNA structure

abstract: The translocation of double-stranded DNA through a solid-state nanopore may either decrease or increase the ionic current depending on the ionic concentration of the surrounding solution. Below a certain crossover ionic concentration, the current change inverts from a current blockade to current enhancement. In this paper, we show that the crossover concentration for bundled DNA nanostructures composed of multiple connected DNA double-helices is lower than that of double-stranded DNA. Our measurements suggest that counterion mobility in the vicinity of DNA is reduced depending on the three-dimensional structure of the molecule. We further demonstrate that introducing neutral polymers such as polyethylene glycol into the measurement solution reduces electroosmotic outflow from the nanopore, allowing translocation of large DNA structures at low salt concentrations. Our experiments contribute to an improved understanding of ion transport in confined DNA environments, which is critical for the development of nanopore sensing techniques as well as synthetic membrane channels. Our salt-dependent measurements of model DNA nanostructures will guide the development of computational models of DNA translocation through nanopores.


title: An accelerated inexact proximal point method for solving nonconvex-concave min-max problems

abstract: This paper presents smoothing schemes for obtaining approximate stationary points of unconstrained or linearly-constrained composite nonconvex-concave min-max (and hence nonsmooth) problems by applying well-known algorithms to composite smooth approximations of the original problems. More specifically, in the unconstrained (resp. constrained) case, approximate stationary points of the original problem are obtained by applying, to its composite smooth approximation, an accelerated inexact proximal point (resp. quadratic penalty) method presented in a previous paper by the authors. Iteration complexity bounds for both smoothing schemes are also established. Finally, numerical results are given to demonstrate the efficiency of the unconstrained smoothing scheme.


title: Neural network-based anomaly detection for high-resolution X-ray spectroscopy

abstract: We propose an anomaly detection technique for high-resolution X-ray spectroscopy. The method is based on the neural network architecture variational autoencoder, and requires only {\it normal} samples for training. We implement the network using Python taking account of the effect of Poisson statistics carefully, and deonstrate the concept with simulated high-resolution X-ray spectral datasets of one-temperature, two-temperature and non-equilibrium plasma. Our proposed technique would assist scientists in finding important information that would otherwise be missed due to the unmanageable amount of data taken with future X-ray observatories.


title: PAC-Bayesian Transportation Bound

abstract: Empirically, the PAC-Bayesian analysis is known to produce tight risk bounds for practical machine learning algorithms. However, in its naive form, it can only deal with stochastic predictors while such predictors are rarely used and deterministic predictors often performs well in practice. To fill this gap, we develop a new generalization error bound, the PAC-Bayesian transportation bound, unifying the PAC-Bayesian analysis and the chaining method in view of the optimal transportation. It is the first PAC-Bayesian bound that relates the risks of any two predictors according to their distance, and capable of evaluating the cost of de-randomization of stochastic predictors faced with continuous loss functions. As an example, we give an upper bound on the de-randomization cost of spectrally normalized neural networks (NNs) to evaluate how much randomness contributes to the generalization of NNs.


title: Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds

abstract: Eliciting labels from crowds is a potential way to obtain large labeled data. Despite a variety of methods developed for learning from crowds, a key challenge remains unsolved: \emph{learning from crowds without knowing the information structure among the crowds a priori, when some people of the crowds make highly correlated mistakes and some of them label effortlessly (e.g. randomly)}. We propose an information theoretic approach, Max-MIG, for joint learning from crowds, with a common assumption: the crowdsourced labels and the data are independent conditioning on the ground truth. Max-MIG simultaneously aggregates the crowdsourced labels and learns an accurate data classifier. Furthermore, we devise an accurate data-crowds forecaster that employs both the data and the crowdsourced labels to forecast the ground truth. To the best of our knowledge, this is the first algorithm that solves the aforementioned challenge of learning from crowds. In addition to the theoretical validation, we also empirically show that our algorithm achieves the new state-of-the-art results in most settings, including the real-world data, and is the first algorithm that is robust to various information structures. Codes are available at \hyperlink{https://github.com/Newbeeer/Max-MIG}{https://github.com/Newbeeer/Max-MIG}


title: The whole picture of the large-scale structure of the CL1604 supercluster at z$\sim$0.9

abstract: We present the large-scale structure over more than 50 comoving Mpc scale at z $\sim$ 0.9 where the CL1604 supercluster, which is one of the largest structures ever known at high redshifts, is embedded. The wide-field deep imaging survey by the Subaru Strategic Program with Hyper Suprime-Cam reveals that the already-known CL1604 supercluster is a mere part of larger-scale structure extending to both the north and the south. We confirm that there are galaxy clusters at three slightly different redshifts in the northern and southern sides of the supercluster by determining the redshifts of 55 red-sequence galaxies and 82 star-forming galaxies in total by the follow-up spectroscopy with Subaru/FOCAS and Gemini-N/GMOS. This suggests that the structure ever known as the CL1604 supercluster is the tip of the iceberg. We investigate stellar population of the red-sequence galaxies using 4000 A break and Balmer H$\delta$ absorption line. Almost all of the red-sequence galaxies brighter than 21.5 mag in $z$-band show an old stellar population with $\gtrsim2$ Gyr. The comparison of composite spectra of the red-sequence galaxies in the individual clusters show that the galaxies at a similar redshift have similar stellar population age, even if they are located $\sim$50 Mpc apart from each other. However, there could be a large variation in the star formation history. Therefore, it is likely that galaxies associated with the large-scale structure at 50 Mpc scale formed at almost the same time, have assembled into the denser regions, and then have evolved with different star formation history along the hierarchical growth of the cosmic web.


title: Content Word-based Sentence Decoding and Evaluating for Open-domain Neural Response Generation

abstract: Various encoder-decoder models have been applied to response generation in open-domain dialogs, but a majority of conventional models directly learn a mapping from lexical input to lexical output without explicitly modeling intermediate representations. Utilizing language hierarchy and modeling intermediate information have been shown to benefit many language understanding and generation tasks. Motivated by Broca's aphasia, we propose to use a content word sequence as an intermediate representation for open-domain response generation. Experimental results show that the proposed method improves content relatedness of produced responses, and our models can often choose correct grammar for generated content words. Meanwhile, instead of evaluating complete sentences, we propose to compute conventional metrics on content word sequences, which is a better indicator of content relevance.


title: Astrophysics in Strong Electromagnetic Fields and Laboratory Astrophysics

abstract: Recent observations of gravitational waves from binary mergers of black holes or neutron stars and the rapid development of ultra-intense lasers lead strong field physics to a frontier of new physics in the 21st century. Strong gravity phenomena are most precisely described by general relativity, and lasers that are described by another most precisely tested quantum electrodynamics (QED) can be focused into a tiny area in a short period through the chirped pulse amplification and generate extremely high intensity electromagnetic (EM) fields beyond the conventional methods. It is physically interesting to study QED phenomena in curved spacetimes, in which both strong gravitational and electromagnetic fields play important roles. There are many sources for strong gravitational and electromagnetic fields in the sky or universe, such highly magnetized neutron stars, magnetized black holes, and the early universe. We review quantum field theoretical frameworks for QED both in the Minkowski spacetime and curved spacetimes, in particular, charged black holes and the early universe, and discuss the QED physics in strong EM fields, such as the vacuum polarization and Schwinger pair production and their implications to astrophysics and cosmology.


title: Impact on the decay rate of $B_s\to \mu^+\mu^-$ from the dispersive two-photon transition

abstract: We study the long-distance contribution to $B_s\to\mu^+\mu^-$ decay, which is generated by the two-photon intermediate state via $B_s\to\gamma^*\gamma^*\to\mu^+\mu^-$ transition. It is found that the dispersive two-photon amplitude can interfere with the dominant short-distance amplitude, which gives rise to new theoretical uncertainty in the branching ratio of $B_s\to\mu^+\mu^-$. Our analysis shows that, by taking into account present experimental constraints, this uncertainty could be up to the same order of magnitude as some theoretical uncertainties of ${\cal B}(B_s\to\mu^+\mu^-)$ given in the past literature. Future precise studies of the double radiative $B_s\to\gamma\gamma$ decay, both experimentally and theoretically, may help to reduce the uncertainty. This novel effect has never been examined in $B_s\to\mu^+\mu^-$ decay.


title: Inverting Learned Dynamics Models for Aggressive Multirotor Control

abstract: We present a control strategy that applies inverse dynamics to a learned acceleration error model for accurate multirotor control input generation. This allows us to retain accurate trajectory and control input generation despite the presence of exogenous disturbances and modeling errors. Although accurate control input generation is traditionally possible when combined with parameter learning-based techniques, we propose a method that can do so while solving the relatively easier non-parametric model learning problem. We show that our technique is able to compensate for a larger class of model disturbances than traditional techniques can and we show reduced tracking error while following trajectories demanding accelerations of more than 7 m/s^2 in multirotor simulation and hardware experiments.


title: High thermoelectric performance of two-dimensional (PbTe)2 layer

abstract: The electronic, phonon and thermoelectric transport properties of (PbTe)2 layer are systematically investigated by using first-principles pseudopotential method and Boltzmann transport equation. Our calculations demonstrate that there is a valley degeneracy of six for the top valence band, which leads to larger carrier concentration and thus higher electrical conductivity without obvious reduction in the Seebeck coefficient. Moreover, the intrinsic van der Waals interactions between neighboring Pb layers induce additional phonon scattering and thus ultrasmall lattice thermal conductivity. As a consequence, a maximum p-type ZT value of 2.9 can be achieved at 1000 K. Moreover, we find almost identical n- and p-type ZT in the temperature range from 300 K to 800 K.


title: Symbol Emergence as an Interpersonal Multimodal Categorization

abstract: This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. Semiotic communication is defined, in this study, as the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchange of signs with other agents. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence is also verified in an experiment with two agents observing daily objects in the real-world environment. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories.


title: Fundamental groups of split real Kac-Moody groups and generalized real flag manifolds. With appendices by Tobias Hartnick and Ralf K\"ohl and by Julius Gr\"uning and Ralf K\"ohl

abstract: We determine the fundamental groups of symmetrizable algebraically simply connected split real Kac-Moody groups endowed with the Kac-Peterson topology. In analogy to the finite-dimensional situation, the Iwasawa decomposition $G = KAU_+$ provides a weak homotopy equivalence $K \hookrightarrow G$, implying $\pi_1(G) = \pi_1(K)$. It thus suffices to determine $\pi_1(K)$ which we achieve by investigating the fundamental groups of generalized flag varieties. Our results apply in all cases in which the Bruhat decomposition of the generalized flag variety is a CW decomposition $-$ in particular, we cover the complete symmetrizable situation; the result concerning the structure of $\pi_1(K)$ more generally also holds in the non-symmetrizable two-spherical situation.


title: Point Clouds Learning with Attention-based Graph Convolution Networks

abstract: Point clouds data, as one kind of representation of 3D objects, are the most primitive output obtained by 3D sensors. Unlike 2D images, point clouds are disordered and unstructured. Hence it is not straightforward to apply classification techniques such as the convolution neural network to point clouds analysis directly. To solve this problem, we propose a novel network structure, named Attention-based Graph Convolution Networks (AGCN), to extract point clouds features. Taking the learning process as a message propagation between adjacent points, we introduce an attention mechanism to AGCN for analyzing the relationships between local features of the points. In addition, we introduce an additional global graph structure network to compensate for the relative information of the individual points in the graph structure network. The proposed network is also extended to an encoder-decoder structure for segmentation tasks. Experimental results show that the proposed network can achieve state-of-the-art performance in both classification and segmentation tasks.


title: Evidence of charge density wave with anisotropic gap in monolayer VTe$_2$ film

abstract: We report experimental evidence of charge density wave (CDW) transition in monolayer 1T-VTe$_2$ film. 4$\times$4 reconstruction peaks are observed by low energy electron diffraction below the transition temperature $T_{CDW}$ = 186 K. Angle-resolved photoemission spectroscopy measurements reveal arc-like pockets with anisotropic CDW gaps up to 50 meV. The anisotropic CDW gap is attributed to the imperfect nesting of the CDW wave vector, and first-principles calculations reveal phonon softening at the same vector, suggesting the important roles of Fermi surface nesting and electron-phonon interaction in the CDW mechanism.


title: Comparative Analysis of State-of-the-Art EDoS Mitigation Techniques in Cloud Computing Environment

abstract: A new variant of the DDoS attack, called Economic Denial of Sustainability attack has emerged. Since the cloud service is based on the pay-per-use model, the EDoS attack endeavors to scale up the resource usage over time to the point the purveyor of the server is financially incapable of sustaining the service due to the incurred unaffordable usage charges. The implication of the EDoS attack is a major security implication as more elastic cloud services are being deployed. Existing techniques to detect and mitigate such attacks are either have low accuracy or ineffective and, in some cases, aggravate the attack even further. Therefore, an Enhanced Mitigation Mechanism is proposed to address these shortcomings using OpenFlow and statistical techniques, i.e. Hellinger Distance and Entropy. The experiments clearly depicted that EMM is able to detect and mitigate EDoS attacks with high accuracy and it is effective in terms of resource utilization compared to existing mitigation techniques. Thus, can be deployed in the cloud environment without the need for additional resource requirements.


title: Audio Caption in a Car Setting with a Sentence-Level Loss

abstract: Captioning has attracted much attention in image and video understanding while a small amount of work examines audio captioning. This paper contributes a Mandarin-annotated dataset for audio captioning within a car scene. A sentence-level loss is proposed to be used in tandem with a GRU encoder-decoder model to generate captions with higher semantic similarity to human annotations. We evaluate the model on the newly-proposed Car dataset, a previously published Mandarin Hospital dataset and the Joint dataset, indicating its generalization capability across different scenes. An improvement in all metrics can be observed, including classical natural language generation (NLG) metrics, sentence richness and human evaluation ratings. However, though detailed audio captions can now be automatically generated, human annotations still outperform model captions on many aspects.


title: Ordinal Bucketing for Game Trees using Dynamic Quantile Approximation

abstract: In this paper, we present a simple and cheap ordinal bucketing algorithm that approximately generates $q$-quantiles from an incremental data stream. The bucketing is done dynamically in the sense that the amount of buckets $q$ increases with the number of seen samples. We show how this can be used in Ordinal Monte Carlo Tree Search (OMCTS) to yield better bounds on time and space complexity, especially in the presence of noisy rewards. Besides complexity analysis and quality tests of quantiles, we evaluate our method using OMCTS in the General Video Game Framework (GVGAI). Our results demonstrate its dominance over vanilla Monte Carlo Tree Search in the presence of noise, where OMCTS without bucketing has a very bad time and space complexity.


title: A large eddy simulation method for DGSEM using non-linearly optimized relaxation filters

abstract: In this paper, we apply a specifically designed dissipative spatial filter as sub-grid scale model within the increasingly popular discontinuous Galerkin methods and the closely related flux reconstruction high order methods for large eddy simulation. The parameters of the filter kernel are optimized with data obtained from direct numerical simulation, that is filtered and used as a ground truth to fit the overall kinetic energy and dissipation rate over time. The optimization is carried out for polynomial degree 3 to 10. The optimal kernels are rigorously tested in the limit of infinite Reynolds number flows (HIT and Taylor Green Vortex flow). Additionally, a brief extension to plane turbulent channel flow is given. Besides the overall good performance, the method is especially attractive in combination with wall modeled LES, because it avoids the computation of second order derivatives for very high Reynolds number flows.


title: Perey-effect in Continuum-Discretized Coupled-Channel description of $(d,p)$ reactions

abstract: The Perey-effect in two-body channels of $(d,p)$ reactions has been known for a long time. It arises when the nonlocal two-body deuteron-target and/or proton-target problem is approximated by a local one, manifesting itself in a reduction of the scattering channel wave functions in the nuclear interior. However, the $(d,p)$ reaction mechanism requires explicit accounting for three-body dynamics involving the target and the neutron and proton in the deuteron. Treating nonlocality of the nucleon-target interactions within a three-body context requires significant effort and demands going beyond the widely-used adiabatic approximation, which can be done using a continuum-discretized coupled-channel (CDCC) method. However, the inclusion of nonlocal interactions into the CDCC description of $(d,p)$ reactions has not been developed yet. Here, we point out that, similarly to the two-body nonlocal case, nonlocality in a three-body channel can be accounted for by introducing the Perey factors. We explain this procedure and present the first CDCC calculations to our knowledge including the Perey-effect.