title: Two-stage dimension reduction for noisy high-dimensional images and application to Cryogenic Electron Microscopy

abstract: Principal component analysis (PCA) is arguably the most widely used dimension-reduction method for vector-type data. When applied to a sample of images, PCA requires vectorization of the image data, which in turn entails solving an eigenvalue problem for the sample covariance matrix. We propose herein a two-stage dimension reduction (2SDR) method for image reconstruction from high-dimensional noisy image data. The first stage treats the image as a matrix, which is a tensor of order 2, and uses multilinear principal component analysis (MPCA) for matrix rank reduction and image denoising. The second stage vectorizes the reduced-rank matrix and achieves further dimension and noise reduction. Simulation studies demonstrate excellent performance of 2SDR, for which we also develop an asymptotic theory that establishes consistency of its rank selection. Applications to cryo-EM (cryogenic electronic microscopy), which has revolutionized structural biology, organic and medical chemistry, cellular and molecular physiology in the past decade, are also provided and illustrated with benchmark cryo-EM datasets. Connections to other contemporaneous developments in image reconstruction and high-dimensional statistical inference are also discussed.


title: Graph Pruning for Model Compression

abstract: Previous AutoML pruning works utilized individual layer features to automatically prune filters. We analyze the correlation for two layers from the different blocks which have a short-cut structure. It shows that, in one block, the deeper layer has many redundant filters which can be represented by filters in the former layer. So, it is necessary to take information from other layers into consideration in pruning. In this paper, a novel pruning method, named GraphPruning, is proposed. Any series of the network is viewed as a graph. To automatically aggregate neighboring features for each node, a graph aggregator based on graph convolution networks(GCN) is designed. In the training stage, a PruningNet that is given aggregated node features generates reasonable weights for any size of the sub-network. Subsequently, the best configuration of the Pruned Network is searched by reinforcement learning. Different from previous work, we take the node features from a well-trained graph aggregator instead of the hand-craft features, as the states in reinforcement learning. Compared with other AutoML pruning works, our method has achieved the state-of-the-art under the same conditions on ImageNet-2012.


title: Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Vec

abstract: A unique challenge for e-commerce recommendation is that customers are often interested in products that are more advanced than their already purchased products, but not reversed. The few existing recommender systems modeling unidirectional sequence output a limited number of categories or continuous variables. To model the ordered sequence, we design the first recommendation system that both embed purchased items with Word2Vec, and model the sequence with stateless LSTM RNN. The click-through rate of this recommender system in production outperforms its solely Word2Vec based predecessor. Developed in 2017, it was perhaps the first published real-world application that makes distributed predictions of a single machine trained Keras model on Spark slave nodes at a scale of more than 0.4 million columns per row.


title: Toy model of boundary states with spurious topological entanglement entropy

abstract: Topological entanglement entropy has been extensively used as an indicator of topologically ordered phases. We study the conditions needed for two-dimensional topologically trivial states to exhibit spurious contributions that contaminates topological entanglement entropy. We show that if the state at the boundary of a subregion is a stabilizer state, then it has a non-zero spurious contribution to the region if and only if, the state is in a non-trivial one-dimensional $G_1\times G_2$ symmetry-protected-topological (SPT) phase. However, we provide a candidate of a boundary state that has a non-zero spurious contribution but does not belong to any such SPT phase.


title: On the singularity structure of the discrete KdV equation

abstract: The discrete KdV (dKdV) equation, the pinnacle of discrete integrability, is often thought to possess the singularity confinement property because it confines on an elementary quadrilateral. Here we investigate the singularity structure of the dKdV equation through reductions of the equation, obtained for initial conditions on a staircase with height 1, and show that it is much more subtle than one might assume. We first study the singularities for the mappings obtained after reduction and contrast these with the singularities that arise in non-integrable generalizations of those mappings. We then show that the so-called `express method' for obtaining dynamical degrees for second order mappings can be succesfully applied to all the higher order mappings we derived. Finally, we use the information obtained on the singularity structure of the reductions to describe an important subset of singularity patterns for the dKdV equation and we present an example of a non-confining pattern and explain why its existence does not contradict the integrability of the dKdV equation.


title: Learning Feature Interactions with Lorentzian Factorization Machine

abstract: Learning representations for feature interactions to model user behaviors is critical for recommendation system and click-trough rate (CTR) predictions. Recent advances in this area are empowered by deep learning methods which could learn sophisticated feature interactions and achieve the state-of-the-art result in an end-to-end manner. These approaches require large number of training parameters integrated with the low-level representations, and thus are memory and computational inefficient. In this paper, we propose a new model named "LorentzFM" that can learn feature interactions embedded in a hyperbolic space in which the violation of triangle inequality for Lorentz distances is available. To this end, the learned representation is benefited by the peculiar geometric properties of hyperbolic triangles, and result in a significant reduction in the number of parameters (20\% to 80\%) because all the top deep learning layers are not required. With such a lightweight architecture, LorentzFM achieves comparable and even materially better results than the deep learning methods such as DeepFM, xDeepFM and Deep \& Cross in both recommendation and CTR prediction tasks.


title: Atomic-scale observations of electrical and mechanical manipulation of topological polar flux-closure

abstract: The ability to controllably manipulate the complex topological polar configurations, such as polar flux-closure via external stimuli, enables many applications in electromechanical devices and nanoelectronics including high-density information storage. Here, by using the atomically resolved in situ scanning transmission electron microscopy, we find that a polar flux-closure structure in PbTiO3/SrTiO3 superlattices films can be reversibly switched to ordinary mono ferroelectric c domain or a domain under electric field or stress. Specifically, the electric field initially drives the flux-closure move and breaks them to form intermediate a/c striped domains, while the mechanical stress firstly starts to squeeze the flux-closures to convert into small vortices at the interface and form a continues dipole wave. After the removal of the external stimuli, the flux-closure structure spontaneously returns. Our atomic study provides valuable insights into understanding the lattice-charge interactions and the competing interactions balance in these complex topological structures. Such reversible switching between the flux-closure and ordinary ferroelectric domains also provides the foundation for applications such as memories and sensors.


title: On the sensitivity of heliosphere models to the uncertainty of the low-energy charge exchange cross section

abstract: Models play an important role in our understanding of the global structure of the solar wind and its interaction with the interstellar medium. A critical ingredient in many types of models are the charge-exchange collisions between ions and neutrals. Some ambiguity exists in the charge-exchange cross-section for protons and hydrogen atoms, depending on which experimental data is used. The differences are greatest at low energies, and for the plasma-neutral interaction in the outer heliosheath may exceed 50\%. In this paper we assess a number of existing data sets and formulae for proton-hydrogen charge-exchange. We use a global simulation of the heliosphere to quantify the differences between the currently favored cross-section, and a formulation we suggest that more closely matches the majority of available data. We find that in order to make the resulting two heliospheres the same size, the interstellar proton and hydrogen densities need to be adjusted by 10 to 15\%, which provides a way to link the uncertainty in the cross-section to the uncertainty in the parameters of the pristine interstellar plasma.


title: Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator

abstract: Federated Learning is a new distributed learning mechanism which allows model training on a large corpus of decentralized data owned by different data providers, without sharing or leakage of raw data. According to the characteristics of data dis-tribution, it could be usually classified into three categories: horizontal federated learning, vertical federated learning, and federated transfer learning. In this paper we present a solution for parallel dis-tributed logistic regression for vertical federated learning. As compared with existing works, the role of third-party coordinator is removed in our proposed solution. The system is built on the pa-rameter server architecture and aims to speed up the model training via utilizing a cluster of servers in case of large volume of training data. We also evaluate the performance of the parallel distributed model training and the experimental results show the great scalability of the system.


title: Virtual cycles of stable (quasi)-maps with fields

abstract: We generalize the results of Chang-Li, Kim-Oh and Chang-Li on the moduli of $p$-fields to the setting of (quasi-)maps to complete intersections in arbitrary smooth Deligne-Mumford stacks with projective coarse moduli. In particular, we show that the virtual cycle of stable (quasi-)maps to a complete intersection can be recovered by the cosection localized virtual cycle of the moduli of $p$-fields of the ambient space.


title: Factorized Multimodal Transformer for Multimodal Sequential Learning

abstract: The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better generalization to real world, multimodal sequential learning becomes a fundamental research area. Arguably, modeling arbitrarily distributed spatio-temporal dynamics within and across modalities is the biggest challenge in this research area. In this paper, we present a new transformer model, called the Factorized Multimodal Transformer (FMT) for multimodal sequential learning. FMT inherently models the intramodal and intermodal (involving two or more modalities) dynamics within its multimodal input in a factorized manner. The proposed factorization allows for increasing the number of self-attentions to better model the multimodal phenomena at hand; without encountering difficulties during training (e.g. overfitting) even on relatively low-resource setups. All the attention mechanisms within FMT have a full time-domain receptive field which allows them to asynchronously capture long-range multimodal dynamics. In our experiments we focus on datasets that contain the three commonly studied modalities of language, vision and acoustic. We perform a wide range of experiments, spanning across 3 well-studied datasets and 21 distinct labels. FMT shows superior performance over previously proposed models, setting new state of the art in the studied datasets.


title: Robust Learning-based Predictive Control for Discrete-time Nonlinear Systems with Unknown Dynamics and State Constraints

abstract: Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically solving an online nominal MPC problem, which requires prior model information and frequent access to onboard computational resources. In this paper, we propose an efficient robust MPC solution based on receding horizon reinforcement learning, called r-LPC, for unknown nonlinear systems with state constraints and disturbances. The proposed r-LPC utilizes a Koopman operator-based prediction model obtained off-line from pre-collected input-output datasets. Unlike classic tube-based MPC, in each prediction time interval of r-LPC, we use an actor-critic structure to learn a near-optimal feedback control policy rather than a control sequence. The resulting closed-loop control policy can be learned off-line and deployed online or learned online in an asynchronous way. In the latter case, online learning can be activated whenever necessary; for instance, the safety constraint is violated with the deployed policy. The closed-loop recursive feasibility, robustness, and asymptotic stability are proven under function approximation errors of the actor-critic networks. Simulation and experimental results on two nonlinear systems with unknown dynamics and disturbances have demonstrated that our approach has better or comparable performance when compared with tube-based MPC and LQR, and outperforms a recently developed actor-critic learning approach.


title: Spectral Classification and Ionized Gas Outflows in $z\sim2$ WISE-Selected Hot Dust-Obscured Galaxies

abstract: We present VLT/XSHOOTER rest-frame UV-optical spectra of 10 Hot Dust-Obscured Galaxies (Hot DOGs) at $z\sim2$ to investigate AGN diagnostics and to assess the presence and effect of ionized gas outflows. Most Hot DOGs in this sample are narrow-line dominated AGN (type 1.8 or higher), and have higher Balmer decrements than typical type 2 quasars. Almost all (8/9) sources show evidence for ionized gas outflows in the form of broad and blueshifted [O III] profiles, and some sources have such profiles in H$\alpha$ (5/7) or [O II] (3/6). Combined with the literature, these results support additional sources of obscuration beyond the simple torus invoked by AGN unification models. Outflow rates derived from the broad [O III] line ($\rm \gtrsim10^{3}\,M_{\odot}\,yr^{-1}$) are greater than the black hole accretion and star formation rates, with feedback efficiencies ($\sim0.1-1\%$) consistent with negative feedback to the host galaxy's star formation in merger-driven quasar activity scenarios. We find the broad emission lines in luminous, obscured quasars are often better explained by outflows within the narrow line region, and caution that black hole mass estimates for such sources in the literature may have substantial uncertainty. Regardless, we find lower bounds on the Eddington ratio for Hot DOGs near unity.


title: Effectively Prefetching Remote Memory with Leap

abstract: Memory disaggregation over RDMA can improve the performance of memory-constrained applications by replacing disk swapping with remote memory accesses. However, state-of-the-art memory disaggregation solutions still use data path components designed for slow disks. As a result, applications experience remote memory access latency significantly higher than that of the underlying low-latency network, which itself is too high for many applications. In this paper, we propose Leap, a prefetching solution for remote memory accesses due to memory disaggregation. At its core, Leap employs an online, majority-based prefetching algorithm, which increases the page cache hit rate. We complement it with a lightweight and efficient data path in the kernel that isolates each application's data path to the disaggregated memory and mitigates latency bottlenecks arising from legacy throughput-optimizing operations. Integration of Leap in the Linux kernel improves the median and tail remote page access latencies of memory-bound applications by up to 104.04x and 22.62x, respectively, over the default data path. This leads to up to 10.16x performance improvements for applications using disaggregated memory in comparison to the state-of-the-art solutions.


title: Identify the cells' nuclei based on the deep learning neural network

abstract: Identify the cells' nuclei is the important point for most medical analyses. To assist doctors finding the accurate cell' nuclei location automatically is highly demanded in the clinical practice. Recently, fully convolutional neural network (FCNs) serve as the back-bone in many image segmentation, like liver and tumer segmentation in medical field, human body block in technical filed. The cells' nuclei identification task is also kind of image segmentation. To achieve this, we prefer to use deep learning algorithms. we construct three general frameworks, one is Mask Region-based Convolutional Neural Network (Mask RCNN), which has the high performance in many image segmentations, one is U-net, which has the high generalization performance on small dataset and the other is DenseUNet, which is mixture network architecture with Dense Net and U-net. we compare the performance of these three frameworks. And we evaluated our method on the dataset of data science bowl 2018 challenge. For single model without any ensemble, they all have good performance.


title: Interplay between nonstandard and nuclear constraints in coherent elastic neutrino-nucleus scattering experiments

abstract: New measurements of the coherent elastic neutrino-nucleus scattering (CEvNS) are expected to be achieved in the near future by using two neutrino production channels with different energy distributions: the very low energy electron antineutrinos from reactor sources and the muon and electron neutrinos from spallation neutron sources (SNS) with a relatively higher energy. Although precise measurements of this reaction would allow an improved knowledge of standard and beyond the Standard Model physics, it is important to distinguish the different new contributions to the process. We illustrate this idea by constraining the average neutron root mean square (rms) radius of the scattering material, as a standard physics parameter, together with the nonstandard interactions (NSI) contribution as the new physics formalism. We show that the combination of experiments with different neutrino energy ranges could give place to more robust constraints on these parameters as long as the systematic errors are under control.


title: Quasinormal mode and spectroscopy of a Schwarzschild black hole surrounded by a cloud of strings in Rastall gravity

abstract: We obtain the solution of a static spherically symmetric black hole surrounded by a cloud of strings in Rastall gravity and study the influence of the parameter $a$ associated with strings on the event horizon and the Hawking temperature. Through analyzing the black hole metric, we find that the static spherically symmetric black hole solution surrounded by a cloud of strings in Rastall gravity can be transformed into the static spherically symmetric black hole solution surrounded by quintessence in Einstein gravity when the parameter $\beta$ of Rastall gravity is positive, which provides a possibility for the string fluid to be a candidate of dark energy. We use the method of Regge and Wheeler together with the high order WKB-Pad\'{e} approximation to calculate the quasinormal mode frequencies of the odd parity gravitational perturbation and simultaneously apply the unstable null geodesics of black holes to compute the quasinormal mode frequencies at the eikonal limit for this black hole model. The results show that the increase of the parameter $a$ makes the gravitational wave decay slowly in Rastall gravity. In addition, we utilize two methods, which are based on the adiabatic invariant integral and the periodic property of outgoing waves, respectively, to derive the area spectrum and entropy spectrum of the black hole model. The results show that the area spectrum and entropy spectrum are equidistant spaced. The former is same as the case of Einstein gravity, while the latter is different, depending on the Rastall parameter $\beta$.


title: Efficiency fluctuations and noise induced refrigerator-to-heater transition in information engines

abstract: Understanding noisy information engines is a fundamental problem of non-equilibrium physics, particularly in biomolecular systems agitated by thermal and active fluctuations in the cell. By the generalized second law of thermodynamics, the efficiency of these engines is bounded by the mutual information passing through their noisy feedback loop. Yet, direct measurement of the interplay between mutual information and energy has so far been elusive. To allow such examination, we explore here the entire phase-space of a noisy colloidal information engine, and study efficiency fluctuations due to the stochasticity of the mutual information and extracted work. We find that the average efficiency is maximum for non-zero noise level, at which the distribution of efficiency switches from bimodal to unimodal, and the stochastic efficiency often exceeds unity. We identify a line of anomalous, noise-driven equilibrium states that defines a refrigerator-to-heater transition, and test the generalized integral fluctuation theorem for continuous engines.


title: Dynamical Breaking to Special or Regular Subgroups in $SO(N)$ Nambu--Jona-Lasinio Model

abstract: It is recently shown that in 4D $SU(N)$ Nambu--Jona-Lasinio (NJL) type models, the $SU(N)$ symmetry breaking into its special subgroups is not special but much more common than that into the regular subgroups, where the fermions belong to complex representations of $SU(N)$. We perform the same analysis for $SO(N)$ NJL model for various $N$ with fermions belonging to an irreducible spinor representation of $SO(N)$. We find that the symmetry breaking into special or regular subgroups has some correlation with the type of fermion representations; i.e., complex, real, pseudo-real representations.


title: Reaching and violating thermodynamic uncertainty bounds in information engines

abstract: Thermodynamic uncertainty relations (TURs) set fundamental bounds on the fluctuation and dissipation of stochastic systems. Here, we examine these bounds, in experiment and theory, by exploring the entire phase space of a cyclic information engine operating in a non-equilibrium steady state. Close to its maximal efficiency, we find that the engine violates the original TUR. This first experimental demonstration of TUR violation agrees with recently proposed softer bounds: The engine satisfies two generalized TUR bounds derived from the detailed fluctuation theorem with feedback control and another bound linking fluctuation and dissipation to mutual information and Renyi divergence. We examine how the interplay of work fluctuation and dissipation shapes the information conversion efficiency of the engine, and find that dissipation is minimal at a finite noise level, where the original TUR is violated.


title: Multiple rogue wave solutions for (2+1)-dimensional Boussinesq equation

abstract: In this paper, a modified symbolic computation approach is proposed. The multiple rogue wave solutions of a generalized (2+1)-dimensional Boussinesq equation are obtained by using the modified symbolic computation approach. Dynamics features of these obtained multiple rogue wave solutions are displayed in 3D and contour plots. Compared with the original symbolic computation approach, our method does not need to find Hirota bilinear form of nonlinear system.


title: Graph Convolution Networks for Probabilistic Modeling of Driving Acceleration

abstract: The ability to model and predict ego-vehicle's surrounding traffic is crucial for autonomous pilots and intelligent driver-assistance systems. Acceleration prediction is important as one of the major components of traffic prediction. This paper proposes novel approaches to the acceleration prediction problem. By representing spatial relationships between vehicles with a graph model, we build a generalized acceleration prediction framework. This paper studies the effectiveness of proposed Graph Convolution Networks, which operate on graphs predicting the acceleration distribution for vehicles driving on highways. We further investigate prediction improvement through integrating of Recurrent Neural Networks to disentangle the temporal complexity inherent in the traffic data. Results from simulation studies using comprehensive performance metrics support the conclusion that our proposed networks outperform state-of-the-art methods in generating realistic trajectories over a prediction horizon.


title: On the Role of Solvent in Hydrophobic Cavity-ligand Recognition Kinetics

abstract: Solvent often manifests itself as the key determinant of the kinetic aspect of molecular recognition process. While the solvent is often depicted as a source of barrier in the ligand recognition process by polar cavity, the nature of solvent's role in the recognition process involving hydrophobic cavity and hydrophobic ligand remains to be addressed. In this work, we quantitatively assess the role of solvent in dictating the kinetic process of recognition in a popular system involving hydrophobic cavity and ligand. In this prototypical system the hydrophobic cavity undergoes \textit{dewetting transition} as the ligand approaches the cavity, which influences the cavity-ligand recognition kinetics. Here, we build Markov state model (MSM) using adaptively sampled unrestrained molecular dynamics simulation trajectories to map the kinetic recognition process. The MSM-reconstructed free energy surface recovers a broad water distribution at an intermediate cavity-ligand separation, consistent with previous report of dewetting transition in this system. Time-structured independent component analysis of the simulated trajectories quantitatively shows that cavity-solvent density contributes considerably in an optimised reaction coordinate involving cavity-ligand separation and water occupancy. Our approach quantifies two solvent-mediated macro states at an intermediate separation of the cavity-ligand recognition pathways, apart from the fully ligand-bound and fully ligand-unbound macro states. Interestingly, we find that these water-mediated intermediates, while transient in populations, can undergo slow mutual interconversion and create possibilities of multiple pathways of cavity recognition by the ligand. Overall, the work provides a quantitative assessment of the role that solvent plays in facilitating the recognition process involving hydrophobic cavity.


title: Differentiable Algorithm for Marginalising Changepoints

abstract: We present an algorithm for marginalising changepoints in time-series models that assume a fixed number of unknown changepoints. Our algorithm is differentiable with respect to its inputs, which are the values of latent random variables other than changepoints. Also, it runs in time O(mn) where n is the number of time steps and m the number of changepoints, an improvement over a naive marginalisation method with O(n^m) time complexity. We derive the algorithm by identifying quantities related to this marginalisation problem, showing that these quantities satisfy recursive relationships, and transforming the relationships to an algorithm via dynamic programming. Since our algorithm is differentiable, it can be applied to convert a model non-differentiable due to changepoints to a differentiable one, so that the resulting models can be analysed using gradient-based inference or learning techniques. We empirically show the effectiveness of our algorithm in this application by tackling the posterior inference problem on synthetic and real-world data.


title: Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

abstract: Despite renewed awareness of the importance of articulation, it remains a challenge for instructors to handle the pronunciation needs of language learners. There are relatively scarce pedagogical tools for pronunciation teaching and learning. Unlike inefficient, traditional pronunciation instructions like listening and repeating, electronic visual feedback (EVF) systems such as ultrasound technology have been employed in new approaches. Recently, an ultrasound-enhanced multimodal method has been developed for visualizing tongue movements of a language learner overlaid on the face-side of the speaker's head. That system was evaluated for several language courses via a blended learning paradigm at the university level. The result was asserted that visualizing the articulator's system as biofeedback to language learners will significantly improve articulation learning efficiency. In spite of the successful usage of multimodal techniques for pronunciation training, it still requires manual works and human manipulation. In this article, we aim to contribute to this growing body of research by addressing difficulties of the previous approaches by proposing a new comprehensive, automatic, real-time multimodal pronunciation training system, benefits from powerful artificial intelligence techniques. The main objective of this research was to combine the advantages of ultrasound technology, three-dimensional printing, and deep learning algorithms to enhance the performance of previous systems. Our preliminary pedagogical evaluation of the proposed system revealed a significant improvement in flexibility, control, robustness, and autonomy.


title: A Census of Sub-kiloparsec Resolution Metallicity Gradients in Star-forming Galaxies at Cosmic Noon from HST Slitless Spectroscopy

abstract: We present hitherto the largest sample of gas-phase metallicity radial gradients measured at sub-kiloparsec resolution in star-forming galaxies in the redshift range of $z\in[1.2, 2.3]$. These measurements are enabled by the synergy of slitless spectroscopy from the Hubble Space Telescope near-infrared channels and the lensing magnification from foreground galaxy clusters. Our sample consists of 76 galaxies with stellar mass ranging from 10$^7$ to 10$^{10}$ $M_\odot$, instantaneous star-formation rate in the range of [1, 100] $M_\odot$/yr, and global metallicity [$\frac{1}{12}$, 2] solar. At 2-$\sigma$ confidence level, 15/76 galaxies in our sample show negative radial gradients, whereas 7/76 show inverted gradients. Combining ours and all other metallicity gradients obtained at similar resolution currently available in the literature, we measure a negative mass dependence of $\Delta\log({\rm O/H})/\Delta r~ [\mathrm{dex~kpc^{-1}}] = \left(-0.020\pm0.007\right) + \left(-0.016\pm0.008\right) \log(M_\ast/10^{9.4} M_\odot)$ with the intrinsic scatter being $\sigma=0.060\pm0.006$ over four orders of magnitude in stellar mass. Our result is consistent with strong feedback, not secular processes, being the primary governor of the chemo-structural evolution of star-forming galaxies during the disk mass assembly at cosmic noon. We also find that the intrinsic scatter of metallicity gradients increases with decreasing stellar mass and increasing specific star-formation rate. This increase in the intrinsic scatter is likely caused by the combined effect of cold-mode gas accretion and merger-induced starbursts, with the latter more predominant in the dwarf mass regime of $M_\ast\lesssim10^9 M_\odot$.


title: The radial distribution of supernovae compared to star formation tracers

abstract: Given the limited availability of direct evidence (pre-explosion observations) for supernova (SN) progenitors, the location of supernovae (SNe) within their host galaxies can be used to set limits on one of their most fundamental characteristics, their initial progenitor mass. We present our constraints on SN progenitors derived by comparing the radial distributions of 80 SNe in the SINGG and SUNGG surveys to the R-band, Halpha, and UV light distributions of the 55 host galaxies. The strong correlation of Type Ia SNe with R-band light is consistent with models containing only low mass progenitors, reflecting earlier findings. When we limit the analysis of Type II SNe to apertures containing 90 per cent of the total flux, the radial distribution of these SNe best traces far ultraviolet (FUV) emission, consistent with recent direct detections indicating Type II SNe have moderately massive red supergiant progenitors. Stripped Envelope (SE) SNe have the strongest correlation with Halpha fluxes, indicative of very massive progenitors (M* > 20 M_solar). This result contradicts a small, but growing, number of direct detections of SE SN progenitors indicating they are moderately massive binary systems. Our result is consistent, however, with a recent population analysis suggesting binary SE SN progenitor masses are regularly underestimated. SE SNe are centralised with respect to Type II SNe and there are no SE SNe recorded beyond half the maximum disc radius in the optical and one third the disc radius in the ultraviolet. The absence of SE SNe beyond these distances is consistent with reduced massive star formation efficiencies in the outskirts of the host galaxies.


title: Trend to Equilibrium for the Kinetic Fokker-Planck Equation via the Neural Network Approach

abstract: The issue of the relaxation to equilibrium has been at the core of the kinetic theory of rarefied gas dynamics. In the paper, we introduce the Deep Neural Network (DNN) approximated solutions to the kinetic Fokker-Planck equation in a bounded interval and study the large-time asymptotic behavior of the solutions and other physically relevant macroscopic quantities. We impose the varied types of boundary conditions including the inflow-type and the reflection-type boundaries as well as the varied diffusion and friction coefficients and study the boundary effects on the asymptotic behaviors. These include the predictions on the large-time behaviors of the pointwise values of the particle distribution and the macroscopic physical quantities including the total kinetic energy, the entropy, and the free energy. We also provide the theoretical supports for the pointwise convergence of the neural network solutions to the \textit{a priori} analytic solutions. We use the library \textit{PyTorch}, the activation function \textit{tanh} between layers, and the \textit{Adam} optimizer for the Deep Learning algorithm.


title: Weakly-Supervised Opinion Summarization by Leveraging External Information

abstract: Opinion summarization from online product reviews is a challenging task, which involves identifying opinions related to various aspects of the product being reviewed. While previous works require additional human effort to identify relevant aspects, we instead apply domain knowledge from external sources to automatically achieve the same goal. This work proposes AspMem, a generative method that contains an array of memory cells to store aspect-related knowledge. This explicit memory can help obtain a better opinion representation and infer the aspect information more precisely. We evaluate this method on both aspect identification and opinion summarization tasks. Our experiments show that AspMem outperforms the state-of-the-art methods even though, unlike the baselines, it does not rely on human supervision which is carefully handcrafted for the given tasks.


title: A Discrete CVAE for Response Generation on Short-Text Conversation

abstract: Neural conversation models such as encoder-decoder models are easy to generate bland and generic responses. Some researchers propose to use the conditional variational autoencoder(CVAE) which maximizes the lower bound on the conditional log-likelihood on a continuous latent variable. With different sampled la-tent variables, the model is expected to generate diverse responses. Although the CVAE-based models have shown tremendous potential, their improvement of generating high-quality responses is still unsatisfactory. In this paper, we introduce a discrete latent variable with an explicit semantic meaning to improve the CVAE on short-text conversation. A major advantage of our model is that we can exploit the semantic distance between the latent variables to maintain good diversity between the sampled latent variables. Accordingly, we pro-pose a two-stage sampling approach to enable efficient diverse variable selection from a large latent space assumed in the short-text conversation task. Experimental results indicate that our model outperforms various kinds of generation models under both automatic and human evaluations and generates more diverse and in-formative responses.


title: A Fully Convolutional Network for MR Fingerprinting

abstract: Magnetic Resonance Fingerprinting (MRF) methods typically rely on dictionary matching to map the temporal MRF signals to quantitative tissue parameters. These methods suffer from heavy storage and computation requirements as the dictionary size grows. To address these issues, we proposed an end to end fully convolutional neural network for MRF reconstruction (MRF-FCNN), which firstly employ linear dimensionality reduction and then use neural network to project the data into the tissue parameters manifold space. Experiments on the MAGIC data demonstrate the effectiveness of the method.


title: Time-Domain Multi-modal Bone/air Conducted Speech Enhancement

abstract: Previous studies have proven that integrating video signals, as a complementary modality, can facilitate improved performance for speech enhancement (SE). However, video clips usually contain large amounts of data and pose a high cost in terms of computational resources and thus may complicate the SE system. As an alternative source, a bone-conducted speech signal has a moderate data size while manifesting speech-phoneme structures, and thus complements its air-conducted counterpart. In this study, we propose a novel multi-modal SE structure in the time domain that leverages bone- and air-conducted signals. In addition, we examine two ensemble-learning-based strategies, early fusion (EF) and late fusion (LF), to integrate the two types of speech signals, and adopt a deep learning-based fully convolutional network to conduct the enhancement. The experiment results on the Mandarin corpus indicate that this newly presented multi-modal (integrating bone- and air-conducted signals) SE structure significantly outperforms the single-source SE counterparts (with a bone- or air-conducted signal only) in various speech evaluation metrics. In addition, the adoption of an LF strategy other than an EF in this novel SE multi-modal structure achieves better results.


title: Fast Power System Cascading Failure Path Searching with High Wind Power Penetration

abstract: Cascading failures have become a severe threat to interconnected modern power systems. The ultrahigh complexity of the interconnected networks is the main challenge toward the understanding and management of cascading failures. In addition, high penetration of wind power integration introduces large uncertainties and further complicates the problem into a massive scenario simulation problem. This paper proposes a framework that enables a fast cascading path searching under high penetration of wind power. In addition, we ease the computational burden by formulating the cascading path searching problem into a Markov chain searching problem and further use a dictionary-based technique to accelerate the calculations. In detail, we first generate massive wind generation and load scenarios. Then, we utilize the Markov search strategy to decouple the problem into a large number of DC power flow (DCPF) and DC optimal power flow (DCOPF) problems. The major time-consuming part, the DCOPF and the DCPF problems, is accelerated by the dynamic construction of a line status dictionary (LSD). The information in the LSD can significantly ease the computation burden of the following DCPF and DCOPF problems. The proposed method is proven to be effective by a case study of the IEEE RTS-79 test system and an empirical study of China's Henan Province power system.


title: Archipelago: A Scalable Low-Latency Serverless Platform

abstract: The increased use of micro-services to build web applications has spurred the rapid growth of Function-as-a-Service (FaaS) or serverless computing platforms. While FaaS simplifies provisioning and scaling for application developers, it introduces new challenges in resource management that need to be handled by the cloud provider. Our analysis of popular serverless workloads indicates that schedulers need to handle functions that are very short-lived, have unpredictable arrival patterns, and require expensive setup of sandboxes. The challenge of running a large number of such functions in a multi-tenant cluster makes existing scheduling frameworks unsuitable. We present Archipelago, a platform that enables low latency request execution in a multi-tenant serverless setting. Archipelago views each application as a DAG of functions, and every DAG in associated with a latency deadline. Archipelago achieves its per-DAG request latency goals by: (1) partitioning a given cluster into a number of smaller worker pools, and associating each pool with a semi-global scheduler (SGS), (2) using a latency-aware scheduler within each SGS along with proactive sandbox allocation to reduce overheads, and (3) using a load balancing layer to route requests for different DAGs to the appropriate SGS, and automatically scale the number of SGSs per DAG. Our testbed results show that Archipelago meets the latency deadline for more than 99% of realistic application request workloads, and reduces tail latencies by up to 36X compared to state-of-the-art serverless platforms.


title: Signals of Axion Like Dark Matter in Time Dependent Polarization of Light

abstract: We consider the search for axion-like particles (ALPs) by using time series data of the polarization angle of the light. If the condensation of an ALP plays the role of dark matter, the polarization plane of the light oscillates as a function of time and we may be able to detect the signal of the ALP by continuously observing the polarization. In particular, we discuss that the analysis of the Fourier-transformed data of the time-dependent polarization angle is powerful to find the signal of the ALP dark matter. We pay particular attention to the light coming from astrophysical sources such as protoplanetary disks, supernova remnants, the foreground emission of the cosmic microwave background, and so on. We show that, for the ALP mass of $\sim 10^{-22}$--$10^{-19}\ {\rm eV}$, ALP searches in the Fourier space may reach the parameter region which is unexplored by other searches yet.


title: Adversarial Risk Analysis for First-Price Sealed-Bid Auctions

abstract: Adversarial Risk Analysis (ARA) is an upcoming methodology that is considered to have advantages over the traditional decision theoretic and game theoretic approaches. ARA solutions for first-price sealed-bid (FPSB) auctions have been found but only under strong assumptions which make the model somewhat unrealistic. In this paper, we use ARA methodology to model FPSB auctions using more realistic assumptions. We define a new utility function that considers bidders' wealth, we assume a reserve price and find solutions not only for risk-neutral but also for risk-averse as well as risk-seeking bidders. We model the problem using ARA for non-strategic play and level-k thinking solution concepts.


title: Developments in Multi-Agent Fair Allocation

abstract: Fairness is becoming an increasingly important concern when designing markets, allocation procedures, and computer systems. I survey some recent developments in the field of multi-agent fair allocation.


title: Domain Knowledge Aided Explainable Artificial Intelligence for Intrusion Detection and Response

abstract: Artificial Intelligence (AI) has become an integral part of modern-day security solutions for its ability to learn very complex functions and handling "Big Data". However, the lack of explainability and interpretability of successful AI models is a key stumbling block when trust in a model's prediction is critical. This leads to human intervention, which in turn results in a delayed response or decision. While there have been major advancements in the speed and performance of AI-based intrusion detection systems, the response is still at human speed when it comes to explaining and interpreting a specific prediction or decision. In this work, we infuse popular domain knowledge (i.e., CIA principles) in our model for better explainability and validate the approach on a network intrusion detection test case. Our experimental results suggest that the infusion of domain knowledge provides better explainability as well as a faster decision or response. In addition, the infused domain knowledge generalizes the model to work well with unknown attacks, as well as opens the path to adapt to a large stream of network traffic from numerous IoT devices.


title: Representations and deformations of Hom-Lie-Yamaguti superalgebras

abstract: Let $(L, \alpha)$ be a Hom-Lie-Yamaguti superalgebra. We first introduce the representation and cohomology theory of Hom-Lie-Yamaguti superalgebras. Furthermore, we introduce the notions of generalized derivations and representations of $(L, \alpha)$ and present some properties. Finally, we investigate the deformations of $(L, \alpha)$ by choosing some suitable cohomology.


title: Strong Cosmic Censorship in higher curvature gravity

abstract: Deterministic nature of general relativity is ensured by the strong cosmic censorship conjecture, which asserts that spacetime cannot be extended beyond Cauchy horizon with square integrable connection. Although this conjecture holds true for asymptotically flat black hole spacetimes in general relativity, a potential violation of this conjecture occurs in charged asymptotically de Sitter spacetimes. Since it is expected that Einstein-Hilbert action will involve higher curvature corrections, in this article we have studied whether one can restore faith in the strong cosmic censorship when higher curvature corrections to general relativity are considered. Contrary to our expectations, we have explicitly demonstrated that not only a violation to the conjecture occurs near extremality, but the violation appears to become stronger as the strength of the higher curvature term increases.


title: Enabling Personalized Decision Support with Patient-Generated Data and Attributable Components

abstract: Decision-making related to health is complex. Machine learning (ML) and patient generated data can identify patterns and insights at the individual level, where human cognition falls short, but not all ML-generated information is of equal utility for making health-related decisions. We develop and apply attributable components analysis (ACA), a method inspired by optimal transport theory, to type 2 diabetes self-monitoring data to identify patterns of association between nutrition and blood glucose control. In comparison with linear regression, we found that ACA offers a number of characteristics that make it promising for use in decision support applications. For example, ACA was able to identify non-linear relationships, was more robust to outliers, and offered broader and more expressive uncertainty estimates. In addition, our results highlight a tradeoff between model accuracy and interpretability, and we discuss implications for ML-driven decision support systems.


title: Dual Learning-based Video Coding with Inception Dense Blocks

abstract: In this paper, a dual learning-based method in intra coding is introduced for PCS Grand Challenge. This method is mainly composed of two parts: intra prediction and reconstruction filtering. They use different network structures, the neural network-based intra prediction uses the full-connected network to predict the block while the neural network-based reconstruction filtering utilizes the convolutional networks. Different with the previous filtering works, we use a network with more powerful feature extraction capabilities in our reconstruction filtering network. And the filtering unit is the block-level so as to achieve a more accurate filtering compensation. To our best knowledge, among all the learning-based methods, this is the first attempt to combine two different networks in one application, and we achieve the state-of-the-art performance for AI configuration on the HEVC Test sequences. The experimental result shows that our method leads to significant BD-rate saving for provided 8 sequences compared to HM-16.20 baseline (average 10.24% and 3.57% bitrate reductions for all-intra and random-access coding, respectively). For HEVC test sequences, our model also achieved a 9.70% BD-rate saving compared to HM-16.20 baseline for all-intra configuration.


title: Investigating bankruptcy prediction models in the presence of extreme class imbalance and multiple stages of economy

abstract: In the area of credit risk analytics, current Bankruptcy Prediction Models (BPMs) struggle with (a) the availability of comprehensive and real-world data sets and (b) the presence of extreme class imbalance in the data (i.e., very few samples for the minority class) that degrades the performance of the prediction model. Moreover, little research has compared the relative performance of well-known BPM's on public datasets addressing the class imbalance problem. In this work, we apply eight classes of well-known BPMs, as suggested by a review of decades of literature, on a new public dataset named Freddie Mac Single-Family Loan-Level Dataset with resampling (i.e., adding synthetic minority samples) of the minority class to tackle class imbalance. Additionally, we apply some recent AI techniques (e.g., tree-based ensemble techniques) that demonstrate potentially better results on models trained with resampled data. In addition, from the analysis of 19 years (1999-2017) of data, we discover that models behave differently when presented with sudden changes in the economy (e.g., a global financial crisis) resulting in abrupt fluctuations in the national default rate. In summary, this study should aid practitioners/researchers in determining the appropriate model with respect to data that contains a class imbalance and various economic stages.


title: Categories of singularities of invertible polynomials

abstract: We study the categories of singularities coming from Landau-Ginzburg models given by the invertible polynomials. Such categories appear on the B-side of the Berglund-H\"ubsch mirror symmetry. We provide an efficient method of computing morphism spaces in these categories and explicitly construct full strongly exceptional collections in the cases of small dimensions ($n\le 3$). Finally, we use this construction in order to prove Orlov's conjecture stating that such collections can be chosen to have block decompositions of size one more than the number of variables.


title: Data Programming using Continuous and Quality-Guided Labeling Functions

abstract: Scarcity of labeled data is a bottleneck for supervised learning models. A paradigm that has evolved for dealing with this problem is data programming. An existing data programming paradigm allows human supervision to be provided as a set of discrete labeling functions (LF) that output possibly noisy labels to input instances and a generative modelfor consolidating the weak labels. We enhance and generalize this paradigm by supporting functions that output a continuous score (instead of a hard label) that noisily correlates with labels. We show across five applications that continuous LFs are more natural to program and lead to improved recall. We also show that accuracy of existing generative models is unstable with respect to initialization, training epochs, and learning rates. We give control to the data programmer to guide the training process by providing intuitive quality guides with each LF. We propose an elegant method of incorporating these guides into the generative model. Our overall method, called CAGE, makes the data programming paradigm more reliable than other tricks based on initialization, sign-penalties, or soft-accuracy constraints.


title: The chemical signatures of planetary engulfment events in binary systems

abstract: Planetary engulfment events involve the chemical assimilation of a planet into a star's external layer. This can cause a change in the chemical pattern of the stellar atmosphere in a way that mirrors the composition of the rocky object engulfed, with the refractory elements being more abundant than the volatiles. Due to these stellar chemical changes, planetary engulfment events can render the process of chemical tagging potentially inaccurate. A line-by-line differential analysis of twin stars in wide binary systems allows us to test the chemical homogeneity of these associations with typical individual stellar Fe I uncertainties of 0.01 dex and eventually unveil chemical anomalies that could be attributed to planetary engulfment events. Out of the 14 systems analysed here, we report the discovery of the most chemically inhomogeneous system to date (HIP34407/HIP34426). The median difference in abundances of refractory elements within the pair is 0.19 dex and the trend between the differential abundances and condensation temperature suggests that the anomaly is likely due to a planetary engulfment event. Within our sample, five other chemically anomalous systems are found.


title: Astrophysics: Extreme emission seen from $\gamma$-ray bursts

abstract: Cosmic explosions called $\gamma$-ray bursts are the most energetic bursting events in the universe. Observations of extremely high-energy emission from two $\gamma$-ray bursts provide a new way to study these gigantic explosions.


title: Shape Detection In 2D Ultrasound Images

abstract: Ultrasound images are one of the most widely used techniques in clinical settings to analyze and detect different organs for study or diagnoses of diseases. The dependence on subjective opinions of experts such as radiologists calls for an automatic recognition and detection system that can provide an objective analysis. Previous work done on this topic is limited and can be classified by the organ of interest. Hybrid neural networks, linear and logistic regression models, 3D reconstructed models, and various machine learning techniques have been used to solve complex problems such as detection of lesions and cancer. Our project aims to use Dual Path Networks (DPN) to segment and detect shapes in ultrasound images taken from 3D printed models of the liver. Further the DPN deep architectures could be coupled with Fully Convolutional Network (FCN) to refine the results. Data denoised with various filters would be used to gauge how they fare against each other and provide the best results. Small amount of dataset works with DPNs, and hence, that should be appropriate for us as our dataset shall be limited in size. Moreover, the ultrasound scans shall need to be taken from different orientations of the scanner with respect to the organ, such that the training dataset can accurately perform segmentation and shape detection.


title: Constrained Heterogeneous Vehicle Path Planning for Large-area Coverage

abstract: There is a strong demand for covering a large area autonomously by multiple UAVs (Unmanned Aerial Vehicles) supported by a ground vehicle. Limited by UAVs' battery life and communication distance, complete coverage of large areas typically involves multiple take-offs and landings to recharge batteries, and the transportation of UAVs between operation areas by a ground vehicle. In this paper, we introduce a novel large-area-coverage planning framework which collectively optimizes the paths for aerial and ground vehicles. Our method first partitions a large area into sub-areas, each of which a given fleet of UAVs can cover without recharging batteries. UAV operation routes, or trails, are then generated for each sub-area. Next, the assignment of trials to different UAVs and the order in which UAVs visit their assigned trails are simultaneously optimized to minimize the total UAV flight distance. Finally, a ground vehicle transportation path which visits all sub-areas is found by solving an asymmetric traveling salesman problem (ATSP). Although finding the globally optimal trail assignment and transition paths can be formulated as a Mixed Integer Quadratic Program (MIQP), the MIQP is intractable even for small problems. We show that the solution time can be reduced to close-to-real-time levels by first finding a feasible solution using a Random Key Genetic Algorithm (RKGA), which is then locally optimized by solving a much smaller MIQP.


title: Preprojective roots and cycle graphs

abstract: We study $c$-preprojective roots for a Coxeter element $c$ of infinite Coxeter group $W$. In particular, we consider the case when any positive root is $c$-preprojective for some Coxeter element $c$. In this paper, by assuming that the Coxeter graph of $W$ is cyclic, we establish that any positive root is $c$-preprojective for some Coxeter element $c$ if and only if $W$ is an affine Coxeter group.


title: On the Extremal Zagreb Indices of $\mathbf{\textit{n}}$-Vertex Chemical Trees with Fixed Number of Segments or Branching Vertices

abstract: Let $\mathcal{CT}_{n,k}$ and $\mathcal{CT}^*_{n,b}$ be the classes of all $n$-vertex chemical trees with $k$ segments and $b$ branching vertices, respectively, where $3\le k\le n-1$ and $1\le b< \frac{n}{2}-1$. The solution of the problem of finding trees from the class $\mathcal{CT}_{n,k}$ or $\mathcal{CT}^*_{n,b}$, with the minimum first Zagreb index or minimum second Zagreb index follows directly from the main results of [MATCH Commun. Math. Comput. Chem. 72 (2014) 825-834] or [MATCH Commun. Math. Comput. Chem. 74 (2015) 57-79]. In this paper, the chemical trees with the maximum first/second Zagreb index are characterized from each of the aforementioned graph classes.


title: Full Characterization of Minimal Linear Codes as Cutting Blocking Sets

abstract: In this paper, we first study in detail the relationship between minimal linear codes and cutting blocking sets, which were recently introduced by Bonini and Borello, and then completely characterize minimal linear codes as cutting blocking sets. As a direct result, minimal projective codes of dimension $3$ and $t$-fold blocking sets with $t\ge 2$ in projective planes are identical objects. Some bounds on the parameters of minimal codes are derived from this characterization. This confirms a recent conjecture by Alfarano, Borello and Neri in [a geometric characterization of minimal codes and their asymptotic performance, arXiv:1911.11738, 2019] about a lower bound of the minimum distance of a minimal code. Using this new link between minimal codes and blocking sets, we also present new general primary and secondary constructions of minimal linear codes. As a result, infinite families of minimal linear codes not satisfying the Aschikhmin-Barg's condition are obtained. In addition to this, the weight distributions of two subfamilies of the proposed minimal linear codes are established. Open problems are also presented.


title: The regularity of edge rings and matching numbers

abstract: Let $K[G]$ denote the edge ring of a finite connected simple graph $G$ on $[d]$ and $\mat(G)$ the matching number of $G$. It is shown that $\reg(K[G]) \leq \mat(G)$ if $G$ is non-bipartite and $K[G]$ is normal, and that $\reg(K[G]) \leq \mat(G) - 1$ if $G$ is bipartite.


title: On meromorphic solutions of non-linear differential equations of Tumura-Clunie type

abstract: Meromorphic solutions of non-linear differential equations of the form $f^n+P(z,f)=h$ are investigated, where $n\geq 2$ is an integer, $h$ is a meromorphic function, and $P(z,f)$ is differential polynomial in $f$ and its derivatives with small functions as its coefficients. In the existing literature this equation has been studied in the case when $h$ has the particular form $h(z)=p_1(z)e^{\alpha_1(z)}+p_2(z)e^{\alpha_2(z)}$, where $p_1, p_2$ are small functions of $f$ and $\alpha_1,\alpha_2$ are entire functions. In such a case the order of $h$ is either a positive integer or equal to infinity. In this article it is assumed that $h$ is a meromorphic solution of the linear differential equation $h'' +r_1(z) h' +r_0(z) h=r_2(z)$ with rational coefficients $r_0,r_1,r_2$, and hence the order of $h$ is a rational number. Recent results by Liao-Yang-Zhang (2013) and Liao (2015) follow as special cases of the main results.


title: This Car is Mine!: Automobile Theft Countermeasure Leveraging Driver Identification with Generative Adversarial Networks

abstract: As a car becomes more connected, a countermeasure against automobile theft has become a significant task in the real world. To respond to automobile theft, data mining, biometrics, and additional authentication methods are proposed. Among current countermeasures, data mining method is one of the efficient ways to capture the owner driver's unique characteristics. To identify the owner driver from thieves, previous works applied various algorithms toward driving data. Such data mining methods utilized supervised learning, thus required labeled data set. However, it is unrealistic to gather and apply the thief's driving pattern. To overcome this problem, we propose driver identification method with GAN. GAN has merit to build identification model by learning the owner driver's data only. We trained GAN only with owner driver's data and used trained discriminator to identify the owner driver. From actual driving data, we evaluated our identification model recognizes the owner driver well. By ensembling various driver authentication methods with the proposed model, we expect industry can develop automobile theft countermeasures available in the real world.


title: The Niemytzki plane is kappa-metrizable

abstract: We try to explain the differences between the concepts of stratifiable space and $\varkappa$-metrizable space. In particular, we give a characterization of $\varkappa$-metrizable spaces which is modelled on Chigogidze's characterization. Moreover, we present a $\varkappa$-metric for the Niemytzki plane, using the properties of the Euclidean metric.


title: Privacy-Aware Recommendation with Private-Attribute Protection using Adversarial Learning

abstract: Recommendation is one of the critical applications that helps users find information relevant to their interests. However, a malicious attacker can infer users' private information via recommendations. Prior work obfuscates user-item data before sharing it with recommendation system. This approach does not explicitly address the quality of recommendation while performing data obfuscation. Moreover, it cannot protect users against private-attribute inference attacks based on recommendations. This work is the first attempt to build a Recommendation with Attribute Protection (RAP) model which simultaneously recommends relevant items and counters private-attribute inference attacks. The key idea of our approach is to formulate this problem as an adversarial learning problem with two main components: the private attribute inference attacker, and the Bayesian personalized recommender. The attacker seeks to infer users' private-attribute information according to their items list and recommendations. The recommender aims to extract users' interests while employing the attacker to regularize the recommendation process. Experiments show that the proposed model both preserves the quality of recommendation service and protects users against private-attribute inference attacks.


title: Neural Networks Learning and Memorization with (almost) no Over-Parameterization

abstract: Many results in recent years established polynomial time learnability of various models via neural networks algorithms. However, unless the model is linear separable, or the activation is a polynomial, these results require very large networks -- much more than what is needed for the mere existence of a good predictor. In this paper we prove that SGD on depth two neural networks can memorize samples, learn polynomials with bounded weights, and learn certain kernel spaces, with near optimal network size, sample complexity, and runtime. In particular, we show that SGD on depth two network with $\tilde{O}\left(\frac{m}{d}\right)$ hidden neurons (and hence $\tilde{O}(m)$ parameters) can memorize $m$ random labeled points in $\mathbb{S}^{d-1}$.


title: SwarmCloak: Landing of a Swarm of Nano-Quadrotors on Human Arms

abstract: We propose a novel system SwarmCloak for landing of a fleet of four flying robots on the human arms using light-sensitive landing pads with vibrotactile feedback. We developed two types of wearable tactile displays with vibromotors which are activated by the light emitted from the LED array at the bottom of quadcopters. In a user study, participants were asked to adjust the position of the arms to land up to two drones, having only visual feedback, only tactile feedback or visual-tactile feedback. The experiment revealed that when the number of drones increases, tactile feedback plays a more important role in accurate landing and operator's convenience. An important finding is that the best landing performance is achieved with the combination of tactile and visual feedback. The proposed technology could have a strong impact on the human-swarm interaction, providing a new level of intuitiveness and engagement into the swarm deployment just right from the skin surface.


title: Entanglement swapping for Bell states and Greenberger-Horne-Zeilinger states in qubit systems

abstract: We introduce a class of two-level multi-particle Greenberger-Horne-Zeilinger (GHZ) states, and study entanglement swapping between two systems for Bell states and the class of GHZ states in qubit systems, respectively. We give the formulas for the entanglement swapping of Bell states and GHZ states in any number of qubit systems. We further consider entanglement swapping between any number of Bell states and between any number of the introduced GHZ states, and propose a series of entanglement swapping schemes in a detailed way. We illustrate the applications of such schemes in quantum information processing by proposing quantum protocols for quantum key distribution, quantum secret sharing and quantum private comparison.


title: Feature Noise Induces Loss Discrepancy Across Groups

abstract: The performance of standard learning procedures has been observed to differ widely across groups. Recent studies usually attribute this loss discrepancy to an information deficiency for one group (e.g., one group has less data). In this work, we point to a more subtle source of loss discrepancy---feature noise. Our main result is that even when there is no information deficiency specific to one group (e.g., both groups have infinite data), adding the same amount of feature noise to all individuals leads to loss discrepancy. For linear regression, we thoroughly characterize the effect of feature noise on loss discrepancy in terms of the amount of noise, the difference between moments of the two groups, and whether group information is used or not. We then show this loss discrepancy does not vanish immediately if a shift in distribution causes the groups to have similar moments. On three real-world datasets, we show feature noise increases the loss discrepancy if groups have different distributions, while it does not affect the loss discrepancy on datasets where groups have similar distributions.


title: Neuron Interaction Based Representation Composition for Neural Machine Translation

abstract: Recent NLP studies reveal that substantial linguistic information can be attributed to single neurons, i.e., individual dimensions of the representation vectors. We hypothesize that modeling strong interactions among neurons helps to better capture complex information by composing the linguistic properties embedded in individual neurons. Starting from this intuition, we propose a novel approach to compose representations learned by different components in neural machine translation (e.g., multi-layer networks or multi-head attention), based on modeling strong interactions among neurons in the representation vectors. Specifically, we leverage bilinear pooling to model pairwise multiplicative interactions among individual neurons, and a low-rank approximation to make the model computationally feasible. We further propose extended bilinear pooling to incorporate first-order representations. Experiments on WMT14 English-German and English-French translation tasks show that our model consistently improves performances over the SOTA Transformer baseline. Further analyses demonstrate that our approach indeed captures more syntactic and semantic information as expected.


title: PAG-Net: Progressive Attention Guided Depth Super-resolution Network

abstract: In this paper, we propose a novel method for the challenging problem of guided depth map super-resolution, called PAGNet. It is based on residual dense networks and involves the attention mechanism to suppress the texture copying problem arises due to improper guidance by RGB images. The attention module mainly involves providing the spatial attention to guidance image based on the depth features. We evaluate the proposed trained models on test dataset and provide comparisons with the state-of-the-art depth super-resolution methods.


title: Economy Statistical Recurrent Units For Inferring Nonlinear Granger Causality

abstract: Granger causality is a widely-used criterion for analyzing interactions in large-scale networks. As most physical interactions are inherently nonlinear, we consider the problem of inferring the existence of pairwise Granger causality between nonlinearly interacting stochastic processes from their time series measurements. Our proposed approach relies on modeling the embedded nonlinearities in the measurements using a component-wise time series prediction model based on Statistical Recurrent Units (SRUs). We make a case that the network topology of Granger causal relations is directly inferrable from a structured sparse estimate of the internal parameters of the SRU networks trained to predict the processes$'$ time series measurements. We propose a variant of SRU, called economy-SRU, which, by design has considerably fewer trainable parameters, and therefore less prone to overfitting. The economy-SRU computes a low-dimensional sketch of its high-dimensional hidden state in the form of random projections to generate the feedback for its recurrent processing. Additionally, the internal weight parameters of the economy-SRU are strategically regularized in a group-wise manner to facilitate the proposed network in extracting meaningful predictive features that are highly time-localized to mimic real-world causal events. Extensive experiments are carried out to demonstrate that the proposed economy-SRU based time series prediction model outperforms the MLP, LSTM and attention-gated CNN-based time series models considered previously for inferring Granger causality.


title: A Novel Method of Marginalisation using Low Discrepancy Sequences for Integrated Nested Laplace Approximations

abstract: Recently, it has been shown that approximations to marginal posterior distributions obtained using a low discrepancy sequence (LDS) can outperform standard grid-based methods with respect to both accuracy and computational efficiency. This recent method, which we will refer to as LDS-StM, can also produce good approximations to multimodal posteriors. However, implementation of LDS-StM into integrated nested Laplace approximations (INLA), a methodology in which grid-based methods are used, is challenging. Motivated by this problem, we propose modifications to LDS-StM that improves the approximations and make it compatible with INLA, without sacrificing computational speed. We also present two examples to demonstrate that LDS-StM with modifications can outperform INLA's own grid approximation with respect to speed and accuracy. We also demonstrate the flexibility of the new approach for the approximation of multimodal marginals.


title: On the Robustness of Signal Characteristic-Based Sender Identification

abstract: Vehicles become more vulnerable to remote attackers in modern days due to their increasing connectivity and range of functionality. Such increased attack vectors enable adversaries to access a vehicle Electronic Control Unit (ECU). As of today in-vehicle access can cause drastic consequences, because the most commonly used in-vehicle bus technology, the Controller Area Network (CAN), lacks sender identification. With low limits on bandwidth and payload, as well as resource constrains on hardware, usage of cryptographic measures is limited. As an alternative, sender identification methods were presented, identifying the sending ECU on the basis of its analog message signal. While prior works showed promising results on the security and feasibility for those approaches, the potential changes in signals over a vehicle's lifetime have only been partly addressed. This paper closes this gap. We conduct a 4~months measurement campaign containing more than 80,000 frames from a real vehicle. The data reflects different driving situations, different seasons and weather conditions, a 19-week break, and a car repair altering the physical CAN properties. We demonstrate the impact of temperature dependencies, analyze the signal changes and define strategies for their handling. In the evaluation, the identification rate can be increased from 91.23% to 99.98% by a targeted updating of the system parameters. At the same time, the detection of intrusions can be improved from 76.83% to 99.74%, while no false positives occured during evaluation. Lastly, we show how to increase the overall performance of such systems by double monitoring the bus at different positions.


title: Analysis of Evolutionary Behavior in Self-Learning Media Search Engines

abstract: The diversity of intrinsic qualities of multimedia entities tends to impede their effective retrieval. In a SelfLearning Search Engine architecture, the subtle nuances of human perceptions and deep knowledge are taught and captured through unsupervised reinforcement learning, where the degree of reinforcement may be suitably calibrated. Such architectural paradigm enables indexes to evolve naturally while accommodating the dynamic changes of user interests. It operates by continuously constructing indexes over time, while injecting progressive improvement in search performance. For search operations to be effective, convergence of index learning is of crucial importance to ensure efficiency and robustness. In this paper, we develop a Self-Learning Search Engine architecture based on reinforcement learning using a Markov Decision Process framework. The balance between exploration and exploitation is achieved through evolutionary exploration Strategies. The evolutionary index learning behavior is then studied and formulated using stochastic analysis. Experimental results are presented which corroborate the steady convergence of the index evolution mechanism. Index Term


title: Classifying Vietnamese Disease Outbreak Reports with Important Sentences and Rich Features

abstract: Text classification is an important field of research from mid 90s up to now. It has many applications, one of them is in Web-based biosurveillance systems which identify and summarize online disease outbreak reports. In this paper we focus on classifying Vietnamese disease outbreak reports. We investigate important properties of disease outbreak reports, e.g., sentences containing names of outbreak disease, locations. Evaluation on 10-time 10- fold cross-validation using the Support Vector Machine algorithm shows that using sentences containing disease outbreak names with its preceding/following sentences in combination with location features achieve the best F-score with 86.67% - an improvement of 0.38% in comparison to using all raw text. Our results suggest that using important sentences and rich feature can improve performance of Vietnamese disease outbreak text classification.


title: Primary rank of the class group of real cyclotomic fields

abstract: Let $H= \mathbb{Q}(\zeta_{n} + {\zeta_{n}}^{-1})$ and $\ell$ be an odd prime such that $q \equiv 1 \pmod \ell$ for some prime factor $q$ of $n$. We get a bound on the $\ell$-rank of the class group of $H$(under some conditions) in terms of the $\ell$-rank of the class group of real quadratic subfield contained in $H$. This is an extension of a recent work of E. Agathocleous (with alternate hypothesis) where she handles $\ell=3$ case. As an application of our main result we relate the $\ell$-rank of real quadratic subfields of $H$.


title: Correlating the Electronic Structures of Metallic/Semiconductor MoTe2 Interface to its Atomic Structures

abstract: Contact interface properties are important in determining the performances of devices based on atomically thin two-dimensional (2D) materials, especially those with short channels. Understanding the contact interface is therefore quite important to design better devices. Herein, we use scanning transmission electron microscopy, electron energy loss spectroscopy, and first-principles calculations to reveal the electronic structures within the metallic (1T')-semiconducting (2H) MoTe2 coplanar phase boundary across a wide spectral range and correlate its properties and atomic structure. We find that the 2H-MoTe2 excitonic peaks cross the phase boundary into the 1T' phase within a range of approximately 150 nm. The 1T'-MoTe2 crystal field can penetrate the boundary and extend into the 2H phase by approximately two unit cells. The plasmonic oscillations exhibit strong angle dependence, i.e., a red-shift (approximately 0.3 eV-1.2 eV) occurs within 4 nm at 1T'/2H-MoTe2 boundaries with large tilt angles, but there is no shift at zero-tilted boundaries. These atomic-scale measurements reveal the structure-property relationships of 1T'/2H-MoTe2 boundary, providing useful information for phase boundary engineering and device development based on 2D materials.


title: Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extraction

abstract: A relation tuple consists of two entities and the relation between them, and often such tuples are found in unstructured text. There may be multiple relation tuples present in a text and they may share one or both entities among them. Extracting such relation tuples from a sentence is a difficult task and sharing of entities or overlapping entities among the tuples makes it more challenging. Most prior work adopted a pipeline approach where entities were identified first followed by finding the relations among them, thus missing the interaction among the relation tuples in a sentence. In this paper, we propose two approaches to use encoder-decoder architecture for jointly extracting entities and relations. In the first approach, we propose a representation scheme for relation tuples which enables the decoder to generate one word at a time like machine translation models and still finds all the tuples present in a sentence with full entity names of different length and with overlapping entities. Next, we propose a pointer network-based decoding approach where an entire tuple is generated at every time step. Experiments on the publicly available New York Times corpus show that our proposed approaches outperform previous work and achieve significantly higher F1 scores.


title: UAV-enabled Secure Communication with Finite Blocklength

abstract: In the finite blocklength scenario, which is suitable for practical applications, a method of maximizing the average effective secrecy rate (AESR) is proposed for a UAV-enabled secure communication by optimizing the UAV's trajectory and transmit power subject to the UAV's mobility constraints and transmit power constraints. To address the formulated non-convex optimization problem, it is first decomposed into two non-convex subproblems. Then the two subproblems are converted respectively into two convex subproblems via the first-order approximation. Finally, an alternating iteration algorithm is developed by solving the two subproblems iteratively using successive convex approximation (SCA) technique. Numerical results show that our proposed scheme achieves a better AESR performance than both the benchmark schemes.


title: Suggested quasi Cassegrain system for multi-beam observation of FAST

abstract: FAST, the largest single-dish radio telescope in the world, has a 500-meter diameter main reflector and a 300-meter diameter illumination area. It has a shape variable main reflector, which changes the shape of the illuminated area in the main reflector into a paraboloid continuously. In this article, we propose a quasi Cassegrain system to FAST. The detailed design results are given in this paper. Such a quasi Cassegrain system only needs to add a 14.6-meter diameter secondary reflector, which is close to the size of the feed cabin, the distance from the secondary reflector to the focus is only 5.08-meter, and it has excellent image quality. In this quasi Cassegrain system the shape of the illuminated area in the main reflector continuously changes into an optimized hyperboloid. Using this quasi Cassegrain system from frequency 0.5 G to 8 G, the multi-beam system can include 7 to 217 feeds. If this system is used in combination with PAF technology, more multi-beam feeds can be used.


title: Minimizing the Information Leakage Regarding High-Level Task Specifications

abstract: We consider a scenario in which an autonomous agent carries out a mission in a stochastic environment while passively observed by an adversary. For the agent, minimizing the information leaked to the adversary regarding its high-level specification is critical in creating an informational advantage. We express the specification of the agent as a parametric linear temporal logic formula, measure the information leakage by the adversary's confidence in the agent's mission specification, and propose algorithms to synthesize a policy for the agent which minimizes the information leakage to the adversary. In the scenario considered, the adversary aims to infer the specification of the agent from a set of candidate specifications, each of which has an associated likelihood probability. The agent's objective is to synthesize a policy that maximizes the entropy of the adversary's likelihood distribution while satisfying its specification. We propose two approaches to solve the resulting synthesis problem. The first approach computes the exact satisfaction probabilities for each candidate specification, whereas the second approach utilizes the Fr\'echet inequalities to approximate them. For each approach, we formulate a mixed-integer program with a quasiconcave objective function. We solve the problem using a bisection algorithm. Finally, we compare the performance of both approaches on numerical simulations.


title: Degree-Bounded Generalized Polymatroids and Approximating the Metric Many-Visits TSP

abstract: In the Bounded Degree Matroid Basis Problem, we are given a matroid and a hypergraph on the same ground set, together with costs for the elements of that set as well as lower and upper bounds $f(\varepsilon)$ and $g(\varepsilon)$ for each hyperedge $\varepsilon$. The objective is to find a minimum-cost basis $B$ such that $f(\varepsilon) \leq |B \cap \varepsilon| \leq g(\varepsilon)$ for each hyperedge $\varepsilon$. Kir\'aly et al. (Combinatorica, 2012) provided an algorithm that finds a basis of cost at most the optimum value which violates the lower and upper bounds by at most $2 \Delta-1$, where $\Delta$ is the maximum degree of the hypergraph. When only lower or only upper bounds are present for each hyperedge, this additive error is decreased to $\Delta-1$. We consider an extension of the matroid basis problem to generalized polymatroids, or g-polymatroids, and additionally allow element multiplicities. The Bounded Degree g-polymatroid Element Problem with Multiplicities takes as input a g-polymatroid $Q(p,b)$ instead of a matroid, and besides the lower and upper bounds, each hyperedge $\varepsilon$ has element multiplicities $m_\varepsilon$. Building on the approach of Kir\'aly et al., we provide an algorithm for finding a solution of cost at most the optimum value, having the same additive approximation guarantee. As an application, we develop a $1.5$-approximation for the metric Many-Visits TSP, where the goal is to find a minimum-cost tour that visits each city $v$ a positive $r(v)$ number of times. Our approach combines our algorithm for the Bounded Degree g-polymatroid Element Problem with Multiplicities with the principle of Christofides' algorithm from 1976 for the (single-visit) metric TSP, whose approximation guarantee it matches.


title: Performance Effectiveness of Multimedia Information Search Using the Epsilon-Greedy Algorithm

abstract: In the search and retrieval of multimedia objects, it is impractical to either manually or automatically extract the contents for indexing since most of the multimedia contents are not machine extractable, while manual extraction tends to be highly laborious and time-consuming. However, by systematically capturing and analyzing the feedback patterns of human users, vital information concerning the multimedia contents can be harvested for effective indexing and subsequent search. By learning from the human judgment and mental evaluation of users, effective search indices can be gradually developed and built up, and subsequently be exploited to find the most relevant multimedia objects. To avoid hovering around a local maximum, we apply the epsilon-greedy method to systematically explore the search space. Through such methodic exploration, we show that the proposed approach is able to guarantee that the most relevant objects can always be discovered, even though initially it may have been overlooked or not regarded as relevant. The search behavior of the present approach is quantitatively analyzed, and closed-form expressions are obtained for the performance of two variants of the epsilon-greedy algorithm, namely EGSE-A and EGSE-B. Simulations and experiments on real data set have been performed which show good agreement with the theoretical findings. The present method is able to leverage exploration in an effective way to significantly raise the performance of multimedia information search, and enables the certain discovery of relevant objects which may be otherwise undiscoverable.


title: Quantum empty Bianchi I spacetime with internal time

abstract: We discuss the question of time in a Bianchi I quantum cosmology in the framework of singularity avoidance. We show that time parameters fall into two distinct classes, that are such that the time development of the wave function either always leads to the appearance of a singularity (fast-gauge time) or that always prevents it from occurring (slow-gauge time). Furthermore, we find that, in the latter case, there exists an asymptotic regime, independent of the clock choice. This may point to a possible solution of the clock issue in quantum cosmology if there exists a suitable class of clocks all yielding identical relevant physical consequences.


title: Formation of dynamically transversely trapping surfaces and the stretched hoop conjecture

abstract: A dynamically transversely trapping surface (DTTS) is a new concept of an extension of a photon sphere that appropriately represents a strong gravity region and has close analogy with a trapped surface. We study formation of a marginally DTTS in time-symmetric, conformally flat initial data with two black holes, with a spindle-shaped source, and with a ring-shaped source, and clarify that $\mathcal{C}\lesssim 6\pi GM$ describes the condition for the DTTS formation well, where $\mathcal{C}$ is the circumference and $M$ is the mass of the system. This indicates that an understanding analogous to the hoop conjecture for the horizon formation is possible. Exploring the ring system further, we find configurations where a marginally DTTS with the torus topology forms inside a marginally DTTS with the spherical topology, without being hidden by an apparent horizon. There also exist configurations where a marginally trapped surface with the torus topology forms inside a marginally trapped surface with the spherical topology, showing a further similarity between DTTSs and trapped surfaces.


title: Existence of nodal line semi-metal in a generalized three dimensional Haldane model

abstract: We construct and study a time reversal broken tight binding model on diamond lattice with complex next-nearest-neighbour hopping which can be thought of as a generalisation of two dimensional Haldane model in three dimension. The model also breaks inversion symmetry owing to sub-lattice dependent chemical potential. We calculate the spectrum of the model and find the existence of six pairs of anisotropic gapless points with linear dependence on momentum. The coordinates of the gapless points are ($2 \pi, \pi \pm k_0,0),~ (2 \pi, \pi \pm k_0,2 \pi)$ and their possible permutations . The condition for gapless spectrum is very similar to the two dimensional case. Each gapless points are having well defined chirality and in the gapless phase specific set of planes have non-zero Chern number. The gapped phase is a trivial bulk insulator which has vanishing Chern number as well as Hopf index. The model belongs to the symmetry class AIII according to the ten-fold way of classification. Surprisingly the gapless phase does contain a gapped surface state where as the gapped state has a gapless surface states as found in (1,1,1) direction.


title: Visual Relationship Detection with Low Rank Non-Negative Tensor Decomposition

abstract: We address the problem of Visual Relationship Detection (VRD) which aims to describe the relationships between pairs of objects in the form of triplets of (subject, predicate, object). We observe that given a pair of bounding box proposals, objects often participate in multiple relations implying the distribution of triplets is multimodal. We leverage the strong correlations within triplets to learn the joint distribution of triplet variables conditioned on the image and the bounding box proposals, doing away with the hitherto used independent distribution of triplets. To make learning the triplet joint distribution feasible, we introduce a novel technique of learning conditional triplet distributions in the form of their normalized low rank non-negative tensor decompositions. Normalized tensor decompositions take form of mixture distributions of discrete variables and thus are able to capture multimodality. This allows us to efficiently learn higher order discrete multimodal distributions and at the same time keep the parameter size manageable. We further model the probability of selecting an object proposal pair and include a relation triplet prior in our model. We show that each part of the model improves performance and the combination outperforms state-of-the-art score on the Visual Genome (VG) and Visual Relationship Detection (VRD) datasets.


title: Continual adaptation for efficient machine communication

abstract: To communicate with new partners in new contexts, humans rapidly form new linguistic conventions. Recent neural language models are able to comprehend and produce the existing conventions present in their training data, but are not able to flexibly and interactively adapt those conventions on the fly as humans do. We introduce an interactive repeated reference task as a benchmark for models of adaptation in communication and propose a regularized continual learning framework that allows an artificial agent initialized with a generic language model to more accurately and efficiently communicate with a partner over time. We evaluate this framework through simulations on COCO and in real-time reference game experiments with human partners.


title: Hausdorff measure of sets of distributional chaotic pairs for shift maps

abstract: Let $\sigma_{K}: \sum_{K}\rightarrow \sum_{K}$ be a shift map. For an interval $[p,q]\subset[0,1]$, let $D_{\sigma_{K}}([p,q])$ denote the set of pairs for which the density spectrum of the $\epsilon$-approach time set equals $[p,q]$ when $\epsilon$ is small and $E_{\sigma_{K}}([p,q])$ the set of pairs for which the density spectrum of the $\epsilon$-approach time set converges to $[p,q]$ when $\epsilon\rightarrow 0^+$. Then $\dim_{H} D_{\sigma_{K}}([p,q])=\dim_{H} E_{\sigma_{K}}([p,q])=2-q$. Moreover, $\mathscr{H}^{2-q}(E_{\sigma_{K}}([p,q]))=1$ when $q=0$ and $\mathscr{H}^{2-q}(E_{\sigma_{K}}([p,q]))=+\infty$ when $q>0$. Meanwhile, $\mathscr{H}^{2-q}(D_{\sigma_{K}}([p,q]))=+\infty$ when $q=1$ and $\mathscr{H}^{2-q}(D_{\sigma_{K}}([p,q]))=0$ when $q<1$.


title: Quark fluctuations and anisotropic confinement in magnetic fields

abstract: We study the string tension $\sigma$ of quantum chromodynamics (QCD) in external magnetic fields $B$ by combining the quasi-particle treatments for quarks with the collective treatments for gluons. We utilize the 1/Nc-expansion (Nc: number of colors) and the framework of Wilson's strong coupling expansion at long distance, and compare the resulting string tensions with the lattice data. The effects of magnetic fields are taken into account through the dielectric functions, which are evaluated from the one-loop polarization due to light flavor quarks with $B$-dependent effective masses $M_{\rm f}(B)\ ({\rm f}=u,d,s)$. All Landau levels are adopted in the calculations so that we can explore the string tensions from weak to strong magnetic fields. For the effective quark masses, we use a simple parameterization: $M_{\rm f}(B) = M_{\rm f}(0) + C_B |q_{\rm f}B|^{1/2}$ with $q_{\rm f}$ the electric charge of a given flavor and $C_B$ an adaptive parameter. We find that the parameter $C_B$ needs to be small, $C_B \lesssim 0.05$, to qualitatively reproduce the trends of lattice QCD results for $0 \leq |eB| \lesssim 1.5\, {\rm GeV}^2$. The quantitative agreement is found for $C_B \simeq 0$ and the strong coupling $\alpha_S \simeq 5$ in the infrared.


title: Knowledge Network and a Knowledge Network Example

abstract: Knowledge networks can be defined as social networks that enable the transfer of the knowledge, which is defined as the intellectual product formed as a result of the work of human intelligence, to be transferred to any other means of communication. A knowledge network represents a large number of people, resources and relationships between them, to create the highest value, primarily to accumulate and use knowledge through the process of generating and transmitting knowledge. General structure of knowledge networks; it consists of three basic stages: gathering, organizing and disseminating knowledge. The first step, knowledge collection, institutions and organizations to enter the network structure of the knowledge that is present. The organizing phase is the structuring of irregular and unstructured knowledge in the network structure according to certain standards and recording them regularly in the structure. Knowledge dissemination can be expressed as the transfer of organized knowledge in accordance with user knowledge and needs. The purpose of the training knowledge network is to ensure communication between the student, the teacher and the guide, and to store the knowledge that is formed in a course, to enable the system to be recorded in a systematic way, to disseminate it according to the needs of the users and to update the knowledge. A dynamic website and content management system have been developed for the training knowledge network. The training knowledge network has a flexible structure to support web technologies. By making production, management and publication of knowledge within the framework of specific needs, it provides knowledge network for different problems, producing different and tailored solutions. With the example of education knowledge network, a knowledge network that can be developed according to the innovative knowledge network structure is designed.


title: An inexact augmented Lagrangian method for nonsmooth optimization on Riemannian manifold

abstract: We consider a nonsmooth optimization problem on Riemannian manifold, whose objective function is the sum of a differentiable component and a nonsmooth convex function. We propose a manifold inexact augmented Lagrangian method (MIALM) for the considered problem. The problem is reformulated to a separable form. By utilizing the Moreau envelope, we get a smoothing subproblem at each iteration of the proposed method. Theoretically, under suitable assumptions, the convergence to critical point of the proposed method is established. In particular, under the condition of that the approximate global minimizer of the iteration subproblem could be obtained, we prove the convergence to global minimizer of the origin problem. Numerical experiments show that, the MIALM is a competitive method compared to some existing methods.


title: On the radius of spatial analyticity for the inviscid Boussinesq equations

abstract: In this paper, we study the problem of analyticity of smooth solutions of the inviscid Boussinesq equations. If the initial datum is real-analytic, the solution remains real-analytic on the existence interval. By an inductive method we can obtain lower bounds on the radius of spatial analyticity of the smooth solution.