title: Low regularity a priori estimates for the fourth order cubic nonlinear Schr\"odinger equation

abstract: We consider the low regularity behavior of the fourth order cubic nonlinear Schr\"odinger equation (4NLS) \begin{align*} \begin{cases} i\partial_tu+\partial_x^4u=\pm \vert u \vert^2u, \quad(t,x)\in \mathbb{R}\times \mathbb{R}\\ u(x,0)=u_0(x)\in H^s\left(\mathbb{R}\right). \end{cases} \end{align*} In arXiv:1911.03253, the author showed that this equation is globally well-posed in $H^s, s\geq -\frac{1}{2}$ and ill-posedness in the sense that the solution map fails to be uniformly continuous for $-\frac{15}{14}<s<-\frac{1}{2}$. Therefore, $s=-\frac{1}{2}$ is the lowest regularity that can be handled by the contraction argument. In spite of this ill-posedness result, we obtain a priori bound below $s<-1/2$. This a priori estimate guarantees the existence of a weak solution for $-3/4<s<-1/2$. But we cannot establish full well-posedness because of the lack of energy estimate of differences of solutions. Our method is inspired by Koch-Tataru \cite{KT2007}. We use the $U^p$ and $V^p$ based spaces adapted to frequency dependent time intervals on which the nonlinear evolution can be still described by linear dynamics.


title: Statistics of temperature and thermal energy dissipation rate in low-Prandtl number turbulent thermal convection

abstract: We report the statistical properties of temperature and thermal energy dissipation rate in low-Prandtl number turbulent Rayleigh-B\'enard convection. High resolution two-dimensional direct numerical simulations were carried out for the Rayleigh number ($Ra$) of $10^{6} \le Ra \le 10^{7}$ and the Prandtl number ($Pr$) of 0.025. Our results show that the global heat transport and momentum scaling in terms of Nusselt number ($Nu$) and Reynolds number ($Re$) are $Nu=0.21Ra^{0.25}$ and $Re=6.11Ra^{0.50}$, respectively, indicating that the scaling exponents are smaller than those for moderate-Prandtl number fluids (such as water or air) in the same convection cell. In the central region of the cell, probability density functions (PDFs) of temperature profiles show stretched exponential peak and the Gaussian tail; in the sidewall region, PDFs of temperature profiles show a multimodal distribution at relative lower $Ra$, while they approach the Gaussian profile at relative higher $Ra$. We split the energy dissipation rate into contributions from bulk and boundary layers and found the locally averaged thermal energy dissipation rate from the boundary layer region is an order of magnitude larger than that from the bulk region. Even if the much smaller volume occupied by the boundary layer region is considered, the globally averaged thermal energy dissipation rate from the boundary layer region is still larger than that from the bulk region. We further numerically determined the scaling exponents of globally averaged thermal energy dissipation rates as functions of $Ra$ and $Re$.


title: Persistent oscillations versus thermalization in the quench dynamics of quantum gases with long-range interactions

abstract: Searching for nonthermalized dynamics in interacting quantum systems is not only of fundamental theoretical interest in nonequilibrium quantum physics, but also of immense practical significance in quantum information processing. In this paper, we study quantum quench dynamics in an hard-core bosonic model with infinite-range interactions, which have been realized in recent high-finesse cavity experiments. We show the long-time dynamics of this model can exhibit either undamped oscillations or thermalization depending on the choice of initial states. The long-range nature of the interactions rather than conserved quantities are responsible for such nonergodic dynamical behaviors.


title: Asymptotically Optimal Sampling-based Planners

abstract: An asymptotically optimal sampling-based planner employs sampling to solve robot motion planning problems and returns paths with a cost that converges to the optimal solution cost, as the number of samples approaches infinity. This comprehensive article covers the theoretical characteristics of asymptotic optimality of motion planning algorithms, and traces its origins, analysis models, practical performance, extensions, and applications.


title: Robust M{\o}lmer-S{\o}renson gate for neutral atoms using rapid adiabatic Rydberg dressing

abstract: The Rydberg blockade mechanism is now routinely considered for entangling qubits encoded in clock states of neutral atoms. Challenges towards implementing entangling gates with high fidelity include errors due to thermal motion of atoms, laser amplitude inhomogeneities, and imperfect Rydberg blockade. We show that adiabatic rapid passage by Rydberg dressing provides a mechanism for implementing two-qubit entangling gates by accumulating phases that are robust to these imperfections. We find that the typical error in implementing a two-qubit gate, such as the controlled phase gate, is dominated by errors in the single atom light shift, and that this can be easily corrected using adiabatic dressing interleaved with a simple spin echo sequence. This results in a two-qubit M{\o}lmer-S{\o}renson gate. A gate fidelity $\sim 0.995$ is achieveable with modest experimental parameters and a path to higher fidelities is possible for Rydberg states in atoms with a stronger blockade, longer lifetimes, and larger Rabi frequencies.


title: Network Inference in Systems Biology: Recent Developments, Challenges, and Applications

abstract: One of the most interesting, difficult, and potentially useful topics in computational biology is the inference of gene regulatory networks (GRNs) from expression data. Although researchers have been working on this topic for more than a decade and much progress has been made, it remains an unsolved problem and even the most sophisticated inference algorithms are far from perfect. In this paper, we review the latest developments in network inference, including state-of-the-art algorithms like PIDC, Phixer, and more. We also discuss unsolved computational challenges, including the optimal combination of algorithms, integration of multiple data sources, and pseudo-temporal ordering of static expression data. Lastly, we discuss some exciting applications of network inference in cancer research, and provide a list of useful software tools for researchers hoping to conduct their own network inference analyses.


title: Hierarchically Robust Representation Learning

abstract: With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that those features can contain appropriate semantic information. Therefore, with a model trained on a large-scale benchmark data set (e.g., ImageNet), the extracted features can work well on other tasks. In this work, we investigate this phenomenon and demonstrate that deep features can be suboptimal due to the fact that they are learned by minimizing the empirical risk. When the data distribution of the target task is different from that of the benchmark data set, the performance of deep features can degrade. Hence, we propose a hierarchically robust optimization method to learn more generic features. Considering the example-level and concept-level robustness simultaneously, we formulate the problem as a distributionally robust optimization problem with Wasserstein ambiguity set constraints, and an efficient algorithm with the conventional training pipeline is proposed. Experiments on benchmark data sets demonstrate the effectiveness of the robust deep representations.


title: Multidataset Independent Subspace Analysis with Application to Multimodal Fusion

abstract: In the last two decades, unsupervised latent variable models---blind source separation (BSS) especially---have enjoyed a strong reputation for the interpretable features they produce. Seldom do these models combine the rich diversity of information available in multiple datasets. Multidatasets, on the other hand, yield joint solutions otherwise unavailable in isolation, with a potential for pivotal insights into complex systems. To take advantage of the complex multidimensional subspace structures that capture underlying modes of shared and unique variability across and within datasets, we present a direct, principled approach to multidataset combination. We design a new method called multidataset independent subspace analysis (MISA) that leverages joint information from multiple heterogeneous datasets in a flexible and synergistic fashion. Methodological innovations exploiting the Kotz distribution for subspace modeling in conjunction with a novel combinatorial optimization for evasion of local minima enable MISA to produce a robust generalization of independent component analysis (ICA), independent vector analysis (IVA), and independent subspace analysis (ISA) in a single unified model. We highlight the utility of MISA for multimodal information fusion, including sample-poor regimes and low signal-to-noise ratio scenarios, promoting novel applications in both unimodal and multimodal brain imaging data.


title: Tunable Layer Circular Photogalvanic Effect in Twisted Bilayers

abstract: We develop a general theory of the layer circular photogalvanic effect (LCPGE) in quasi two-dimensional chiral bilayers, which refers to the appearance of a polarization-dependent, out-of-plane dipole moment induced by circularly polarized light. We elucidate the geometric origin of the LCPGE as two types of interlayer coordinate shift weighted by the quantum metric tensor and the Berry curvature, respectively. As a concrete example, we calculate the LCPGE in twisted bilayer graphene, and find that it exhibits a resonance peak whose frequency can be tuned from visible to infrared as the twisting angle varies. The LCPGE thus provides a promising route towards frequency-sensitive, circularly-polarized light detection, particularly in the infrared range.


title: In the beginning: Langlands' doctoral thesis

abstract: This is a draft version of an invited article for a forthcoming book `The genesis of Langlands Program', eds. Julia Mueller and Freydoon Shahidi, which will be published in the London Mathematics Society Lecture Notes Series. It gives a description of the background and content of the unpublished doctoral thesis of Robert Langlands with many alternative explanations and proofs of the principal results.


title: Radio Emission from Interstellar Shocks: Young Type Ia Supernova Remnants and the Case of N 103B in the Large Magellanic Cloud

abstract: Here we present a radio continuum study based on new and archival data from the Australia Telescope Compact Array towards N 103B, a young (<=1000 yrs) spectroscopically confirmed type Ia SNR in the Large Magellanic Cloud (LMC) and proposed to have originated from a single degenerate progenitor. The radio morphology of this SNR is asymmetrical with two bright regions towards the north-west and south-west of the central location as defined by radio emission. N 103B identified features include: a radio spectral index of -0.75+-0.01 (consistent with other young type Ia SNRs in the Galaxy); a bulk SNR expansion rate as in X-rays; morphology and polarised electrical field vector measurements where we note radial polarisation peak towards the north-west of the remnant at both 5500 and 9000 MHz. The spectrum is concave-up and the most likely reason is the non-linear diffusive shock acceleration effects or presence of two different populations of ultra-relativistic electrons. We also note unpolarized clumps near the south-west region which is in agreement with this above scenario. We derive a typical magnetic field strength for N 103B, of 16.4 microG for an average rotation measurement of 200 rad m^-2. However, we estimate the equipartition field to be of the order of ~235 microG with an estimated minimum energy of Emin=6.3*10^48 erg. The close (~0.5 degree) proximity of N 103B to the LMC mid-plane indicates that an early encounter with dense interstellar medium may have set an important constrain on SNR evolution. Finally, we compare features of N 103B, to six other young type Ia SNRs in the LMC and Galaxy, with a range of proposed degeneracy scenarios to highlight potential differences due to a different models. We suggest that the single degenerate scenario might point to morphologically asymmetric type Ia supernova explosions.


title: Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

abstract: Large, richly annotated datasets have accelerated progress in fields such as computer vision and natural language processing, but replicating these successes in robotics has been challenging. While prior data collection methodologies such as self-supervision have resulted in large datasets, the data can have poor signal-to-noise ratio. By contrast, previous efforts to collect task demonstrations with humans provide better quality data, but they cannot reach the same data magnitude. Furthermore, neither approach places guarantees on the diversity of the data collected, in terms of solution strategies. In this work, we leverage and extend the RoboTurk platform to scale up data collection for robotic manipulation using remote teleoperation. The primary motivation for our platform is two-fold: (1) to address the shortcomings of prior work and increase the total quantity of manipulation data collected through human supervision by an order of magnitude without sacrificing the quality of the data and (2) to collect data on challenging manipulation tasks across several operators and observe a diverse set of emergent behaviors and solutions. We collected over 111 hours of robot manipulation data across 54 users and 3 challenging manipulation tasks in 1 week, resulting in the largest robot dataset collected via remote teleoperation. We evaluate the quality of our platform, the diversity of demonstrations in our dataset, and the utility of our dataset via quantitative and qualitative analysis. For additional results, supplementary videos, and to download our dataset, visit http://roboturk.stanford.edu/realrobotdataset .


title: Decompressing Knowledge Graph Representations for Link Prediction

abstract: This paper studies the problem of predicting missing relationships between entities in knowledge graphs through learning their representations. Currently, the majority of existing link prediction models employ simple but intuitive scoring functions and relatively small embedding size so that they could be applied to large-scale knowledge graphs. However, these properties also restrict the ability to learn more expressive and robust features. Therefore, diverging from most of the prior works which focus on designing new objective functions, we propose, DeCom, a simple but effective mechanism to boost the performance of existing link predictors such as DistMult, ComplEx, etc, through extracting more expressive features while preventing overfitting by adding just a few extra parameters. Specifically, embeddings of entities and relationships are first decompressed to a more expressive and robust space by decompressing functions, then knowledge graph embedding models are trained in this new feature space. Experimental results on several benchmark knowledge graphs and advanced link prediction systems demonstrate the generalization and effectiveness of our method. Especially, RESCAL + DeCom achieves state-of-the-art performance on the FB15k-237 benchmark across all evaluation metrics. In addition, we also show that compared with DeCom, explicitly increasing the embedding size significantly increase the number of parameters but could not achieve promising performance improvement.


title: Control of accuracy on Taylor-collocation method for load leveling problem

abstract: High penetration of renewable energy sources coupled with the decentralization of transport and heating loads in future power systems will result in even more complex unit commitment problem solution using energy storage system scheduling for efficient load leveling. This paper employees an adaptive approach to load leveling problem using the Volterra integral dynamical models. The problem is formulated as the solution of the Volterra integral equation of the first kind which is attacked using Taylor-collocation numerical method which has the second-order accuracy and enjoys self-regularization properties, which is associated with confidence levels of system demand. Also, the CESTAC method is applied to find the optimal approximation, optimal error and optimal step of the collocation method. This adaptive approach is suitable for energy storage optimization in real-time. The efficiency of the proposed methodology is demonstrated on the Single Electricity Market of the Island of Ireland.


title: The cyclic matching sequenceability of regular graphs

abstract: The cyclic matching sequenceability of a simple graph $G$, denoted $\mathrm{cms}(G)$, is the largest integer $s$ for which there exists a cyclic ordering of the edges of $G$ so that every set of $s$ consecutive edges forms a matching. In this paper we consider the minimum cyclic matching sequenceability of $k$-regular graphs. We completely determine this for $2$-regular graphs, and give bounds for $k \geq 3$.


title: Integrative Factor Regression and Its Inference for Multimodal Data Analysis

abstract: Multimodal data, where different types of data are collected from the same subjects, are fast emerging in a large variety of scientific applications. Factor analysis is commonly used in integrative analysis of multimodal data, and is particularly useful to overcome the curse of high dimensionality and high correlations. However, there is little work on statistical inference for factor analysis based supervised modeling of multimodal data. In this article, we consider an integrative linear regression model that is built upon the latent factors extracted from multimodal data. We address three important questions: how to infer the significance of one data modality given the other modalities in the model; how to infer the significance of a combination of variables from one modality or across different modalities; and how to quantify the contribution, measured by the goodness-of-fit, of one data modality given the others. When answering each question, we explicitly characterize both the benefit and the extra cost of factor analysis. Those questions, to our knowledge, have not yet been addressed despite wide use of factor analysis in integrative multimodal analysis, and our proposal bridges an important gap. We study the empirical performance of our methods through simulations, and further illustrate with a multimodal neuroimaging analysis.


title: Periodic Solutions for SDEs through Upper and Lower Solutions

abstract: We study a kind of better recurrence than Kolmogorov's one: periodicity recurrence,which corresponds periodic solutions in distribution for stochastic differential equations. On the basis of technique of upper and lower solutions and comparison principle, we obtain the existence of periodic solutions in distribution for stochastic differential equations (SDEs). Hence this provides an effective method how to study the periodicity of stochastic systems by analyzing deterministic ones. We also illustrate our results.


title: Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation

abstract: We study the problem of visual question answering (VQA) in images by exploiting supervised domain adaptation, where there is a large amount of labeled data in the source domain but only limited labeled data in the target domain with the goal to train a good target model. A straightforward solution is to fine-tune a pre-trained source model by using those limited labeled target data, but it usually cannot work well due to the considerable difference between the data distributions of the source and target domains. Moreover, the availability of multiple modalities (i.e., images, questions and answers) in VQA poses further challenges to model the transferability between those different modalities. In this paper, we tackle the above issues by proposing a novel supervised multi-modal domain adaptation method for VQA to learn joint feature embeddings across different domains and modalities. Specifically, we align the data distributions of the source and target domains by considering all modalities together as well as separately for each individual modality. Based on the extensive experiments on the benchmark VQA 2.0 and VizWiz datasets for the realistic open-ended VQA task, we demonstrate that our proposed method outperforms the existing state-of-the-art approaches in this challenging domain adaptation setting for VQA.


title: Measuring the Time-Varying Market Efficiency in the Prewar and Wartime Japanese Stock Market, 1924-1943

abstract: This study explores the time-varying structure of market efficiency in the prewar and wartime Japanese stock market using a new market capitalization-weighted stock price index, the equity performance index. We examine whether the adaptive market hypothesis (AMH) is supported in that era. First, we find that the degree of market efficiency in the prewar and wartime Japanese stock market varies over time and with major historical events. This implies that the AMH is supported in this market. Second, we find that the variation in market efficiency observed in this study is significantly different from that in previous studies because of whether the price index is capitalization weighted. Finally, as government intervention in the market intensified throughout the 1930s, market efficiency declined as the war risk premium rose, especially from the time when the Pacific War became inevitable.


title: Invariant Representations through Adversarial Forgetting

abstract: We propose a novel approach to achieving invariance for deep neural networks in the form of inducing amnesia to unwanted factors of data through a new adversarial forgetting mechanism. We show that the forgetting mechanism serves as an information-bottleneck, which is manipulated by the adversarial training to learn invariance to unwanted factors. Empirical results show that the proposed framework achieves state-of-the-art performance at learning invariance in both nuisance and bias settings on a diverse collection of datasets and tasks.


title: Accurate Uncertainty Estimation and Decomposition in Ensemble Learning

abstract: Ensemble learning is a standard approach to building machine learning systems that capture complex phenomena in real-world data. An important aspect of these systems is the complete and valid quantification of model uncertainty. We introduce a Bayesian nonparametric ensemble (BNE) approach that augments an existing ensemble model to account for different sources of model uncertainty. BNE augments a model's prediction and distribution functions using Bayesian nonparametric machinery. It has a theoretical guarantee in that it robustly estimates the uncertainty patterns in the data distribution, and can decompose its overall predictive uncertainty into distinct components that are due to different sources of noise and error. We show that our method achieves accurate uncertainty estimates under complex observational noise, and illustrate its real-world utility in terms of uncertainty decomposition and model bias detection for an ensemble in predict air pollution exposures in Eastern Massachusetts, USA.


title: LMLFM: Longitudinal Multi-Level Factorization Machine

abstract: We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC) (correlations among observations for each individual over time), {\em cluster correlation} (CC) (correlations among individuals that have similar characteristics), or both. These correlations are often accounted for using {\em mixed effects models} that include {\em fixed effects} and {\em random effects}, where the fixed effects capture the regression parameters that are shared by all individuals, whereas random effects capture those parameters that vary across individuals. However, the current state-of-the-art methods are unable to select the most predictive fixed effects and random effects from a large number of variables, while accounting for complex correlation structure in the data and non-linear interactions among the variables. We propose Longitudinal Multi-Level Factorization Machine (LMLFM), to the best of our knowledge, the first model to address these challenges in learning predictive models from longitudinal data. We establish the convergence properties, and analyze the computational complexity, of LMLFM. We present results of experiments with both simulated and real-world longitudinal data which show that LMLFM outperforms the state-of-the-art methods in terms of predictive accuracy, variable selection ability, and scalability to data with large number of variables. The code and supplemental material is available at \url{https://github.com/junjieliang672/LMLFM}.


title: A*SLAM: A Dual Fisheye Stereo Edge SLAM

abstract: This paper proposes an A*SLAM system that features combining two sets of fisheye stereo cameras and taking the image edge as the SLAM features. The dual fisheye stereo camera sets cover the full environmental view of the SLAM system. From each fisheye stereo image pair, a panorama depth image can be directly extracted for initializing the SLAM feature. The edge feature is an illumination invariant feature. The paper presents a method of the edge-based simultaneous localization and mapping process using both the normal and inverted images interchangeably.


title: Lattice QCD calculation of the pion charge radius using a model-independent method

abstract: We use a method to calculate the hadron's charge radius without model-dependent momentum extrapolations. The method does not require the additional quark propagator inversions on the twisted boundary conditions or the computation of the momentum derivatives of quark propagators and thus is easy to implement. We apply this method to the calculation of pion charge radius $\langle r_\pi^2\rangle$. For comparison, we also determine $\langle r_\pi^2\rangle$ with the traditional approach of computing the slope of the form factors. The new method produces results consistent with those from the traditional method and with statistical errors 1.5-1.9 times smaller. For the four gauge ensembles at the physical pion masses, the statistical errors of $\langle r_\pi^2\rangle$ range from 2.1% to 4.6% by using $\lesssim50$ configurations. For the ensemble at $m_\pi\approx 340$ MeV, the statistical uncertainty is even reduced to a sub-percent level.


title: Learning to Order Sub-questions for Complex Question Answering

abstract: Answering complex questions involving multiple entities and relations is a challenging task. Logically, the answer to a complex question should be derived by decomposing the complex question into multiple simple sub-questions and then answering those sub-questions. Existing work has followed this strategy but has not attempted to optimize the order of how those sub-questions are answered. As a result, the sub-questions are answered in an arbitrary order, leading to larger search space and a higher risk of missing an answer. In this paper, we propose a novel reinforcement learning(RL) approach to answering complex questions that can learn a policy to dynamically decide which sub-question should be answered at each stage of reasoning. We lever-age the expected value-variance criterion to enable the learned policy to balance between the risk and utility of answering a sub-question. Experiment results show that the RL approach can substantially improve the optimality of ordering the sub-questions, leading to improved accuracy of question answering. The proposed method for learning to order sub-questions is general and can thus be potentially combined with many existing ideas for answering complex questions to enhance their performance.


title: de Rham decomposition for Riemannian manifolds with boundary

abstract: In this paper, we extend the classical de Rham decomposition theorem to the case of Riemannian manifolds with boundary by using the trick of development of curves.


title: The Alon-Tarsi number of $K_5$-minor-free graphs

abstract: In this paper, we show the following three theorems. Let $G$ be a $K_5$-minor-free graph. Then Alon-Tarsi number of $G$ is at most $5$, there exists a matching $M$ of $G$ such that the Alon-Tarsi number of $G-M$ is at most $4$, and there exists a forest $F$ such that the Alon-Tarsi number of $G-E(F)$ is at most $3$.


title: Parallel, Modular Fabric Actuators for a 2-DOF Pneumatic Sleeve

abstract: The shoulder is responsible for the movement of the entire upper limb. It is capable of articulating in three degrees-of-freedom (DOF), enabling the arm to perform manipulation actions with incomparable dexterity. Exoskeletons targeting the shoulder must be able to emulate its complex kinematics. While typical architectures have proven to be useful, they employ complex and usually inadequate techniques to match the mobility of the shoulder. A new 2-DOF soft robotic shoulder exoskeleton is presented. Modular soft robotic actuators with separated inflation modules on the exoskeleton are able to emulate the humerus' natural movement. These actuators were organized into two antagonistic pairs and operate in a parallel configuration. We present the design and functionality of the actuators powering the exoskeleton. The actuator design enables it to perform 3-D bending with insignificant resistance. We measured its performance through a series of static and dynamic tests. Depending on the configuration, the actuator can generate up to a maximum torque of 15.54 N-m and can respond with a minimum rise time of ~2s when excited by a step input. We demonstrated its ability to perform assistance of shoulder movements. It is capable of reaching any point on the humerus' workspace from any starting position.


title: Generative Autoregressive Networks for 3D Dancing Move Synthesis from Music

abstract: This paper proposes a framework which is able to generate a sequence of three-dimensional human dance poses for a given music. The proposed framework consists of three components: a music feature encoder, a pose generator, and a music genre classifier. We focus on integrating these components for generating a realistic 3D human dancing move from music, which can be applied to artificial agents and humanoid robots. The trained dance pose generator, which is a generative autoregressive model, is able to synthesize a dance sequence longer than 5,000 pose frames. Experimental results of generated dance sequences from various songs show how the proposed method generates human-like dancing move to a given music. In addition, a generated 3D dance sequence is applied to a humanoid robot, showing that the proposed framework can make a robot to dance just by listening to music.


title: BP-Transformer: Modelling Long-Range Context via Binary Partitioning

abstract: The Transformer model is widely successful on many natural language processing tasks. However, the quadratic complexity of self-attention limit its application on long text. In this paper, adopting a fine-to-coarse attention mechanism on multi-scale spans via binary partitioning (BP), we propose BP-Transformer (BPT for short). BPT yields $O(k\cdot n\log (n/k))$ connections where $k$ is a hyperparameter to control the density of attention. BPT has a good balance between computation complexity and model capacity. A series of experiments on text classification, machine translation and language modeling shows BPT has a superior performance for long text than previous self-attention models. Our code, hyperparameters and CUDA kernels for sparse attention are available in PyTorch.


title: Multilinear Spherical Maximal Function

abstract: In dimensions $n\ge 2$ we obtain $L^{p_1}(\mathbb R^n) \times\dots\times L^{p_m}(\mathbb R^n)$ to $L^p(\mathbb R^n)$ boundedness for the multilinear spherical maximal function in the largest possible open set of indices and we provide counterexamples that indicate the optimality of our results. Moreover, we obtain weak type and Lorentz space estimates as well as counterexamples in the endpoint cases.


title: Compressed Underwater Acoustic Communications for Dynamic Interaction with Underwater Vehicles

abstract: Underwater vehicles are utilized in various applications including underwater data-collection missions. The tethered connection constrains the mission both in distance traveled and number of vehicles that can run in the same area, while the addition of acoustic communications onto the vehicles grants them several functionalities. However, due to the low bandwidth of the underwater acoustic channel-which leads to low data rates-and the time overhead imposed by both the channel propagation delay and the processing delay by the acoustic modems, efficient protocols are required. In this paper, an implicit data-compression and transmission protocol is proposed to carry out environmental monitoring missions such as adaptive sampling of physical and chemical parameters in the water. In a semi-autonomous manner between the vehicle and the control center, both sides keep silent in data transmission as long as they can estimate and predict the actions of the other side, unless environmental data and/or kinematic data are found to be unpredictable. Our design puts the human in the loop to send high-level control commands. Experiments were conducted using an autonomous vehicle with WHOI micro-modems in the Raritan River, Somerset, Carnegie Lake in Princeton, and in the Marine Park in Red Bank, all in New Jersey.


title: Photometric reverberation mapping of AGNs at 0.1 < z < 0.8: I. Observational technique

abstract: The improvement of the calibration relation for determining the size of the broad-line region from the observed optical luminosity of active galactic nuclei (AGN) is a necessary task to study fundamental parameters of distant AGNs such as mass of the central supermassive black hole. The most popular method of the BLR size estimation is the reverberation mapping based on measuring the time delay between the continuum flux and the flux in the emission lines. In our work, we apply the method of photometric reverberation mapping in medium-band filters, adapted for observations at the Zeiss-1000 telescope of the SAO RAS, for the study of AGN with broad lines in the range of redshifts $0.1 < z < 0.8$. This paper describes the technique of observations and data processing, provides a sample of objects and demonstrates the stability of the used method. As a preliminary result for 2MASX J08535955+7700543 at $z=0.1$ we have obtained time delay estimates of $\tau (ICCF)=32.2^{\pm10.6}$ days and $\tau(JAVELIN)=39.5_{-15.8}^{+23.0}$ days that are consistent with each other and also within the accuracy of the existing calibration relations.


title: SUMMIT: A Simulator for Urban Driving in Massive Mixed Traffic

abstract: Autonomous driving in an unregulated urban crowd is an outstanding challenge, especially, in the presence of many aggressive, high-speed traffic participants. This paper presents SUMMIT, a high-fidelity simulator that facilitates the development and testing of crowd-driving algorithms. By leveraging the open-source OpenStreetMap map database and a heterogeneous multi-agent motion prediction model developed in our earlier work, SUMMIT simulates dense, unregulated urban traffic for heterogeneous agents at any worldwide locations that OpenStreetMap supports. SUMMIT is built as an extension of CARLA and inherits from it the physics and visual realism for autonomous driving simulation. SUMMIT supports a wide range of applications, including perception, vehicle control and planning, and end-to-end learning. We provide a context-aware planner together with benchmark scenarios and show that SUMMIT generates complex, realistic traffic behaviors in challenging crowd-driving settings.


title: Morse theory with homotopy coherent diagrams

abstract: We study Morse theory on noncompact manifolds equipped with exhaustions by compact pieces, defining the Morse homology of a pair which consists of the manifold and related geometric/homotopy data. We construct a collection of Morse data parametrized by cubes of arbitrary dimensions. From this collection, we obtain a family of linear maps subject to some coherency conditions, which can be packaged into a homotopy coherent diagram. We introduce a chain complex which is a colimit for the diagram and show that it computes the Morse homology.


title: Second-order optimality conditions for non-convex set-constrained optimization problems

abstract: In this paper we study second-order optimality conditions for non-convex set-constrained optimization problems. For a convex set-constrained optimization problem, it is well-known that second-order optimality conditions involve the support function of the second-order tangent set. In this paper we propose two approaches for establishing second-order optimality conditions for the non-convex case. In the first approach we extend the concept of the support function so that it is applicable to general non-convex set-constrained problems, whereas in the second approach we introduce the notion of the directional regular tangent cone and apply classical results of convex duality theory. Besides the second-order optimality conditions, the novelty of our approach lies in the systematic introduction and use, respectively, of directional versions of well-known concepts from variational analysis.


title: ALMA Observations of Atomic Carbon [C I] (${^3\mathrm{P}}_1\rightarrow{^3\mathrm{P}}_0$) and Low-$J$ CO Lines in the Starburst Galaxy NGC 1808

abstract: We present [C I] (${^3\mathrm{P}}_1\rightarrow{^3\mathrm{P}}_0$), $^{12}$CO, $^{13}$CO, and C$^{18}$O ($J=2\rightarrow1$) observations of the central region (radius 1 kpc) of the starburst galaxy NGC 1808 at 30-50 pc resolution conducted with Atacama Large Millimeter/submillimeter Array. Radiative transfer analysis of multiline data indicates warm ($T_\mathrm{k}\sim40\mathrm{-}80$ K) and dense ($n_\mathrm{H_2}\sim10^{3\mathrm{-}4}$ cm$^{-3}$) molecular gas with high column density of atomic carbon ($N_\mathrm{CI}\sim3\times10^{18}$ cm$^{-2}$) in the circumnuclear disk (central 100 pc). The C I/H$_2$ abundance in the central 1 kpc is $\sim3-7\times10^{-5}$, consistent with the values in luminous infrared galaxies. The intensity ratios of [C I]/CO(1-0) and [C I]/CO(3-2), respectively, decrease and increase with radius in the central 1 kpc, whereas [C I]/CO(2-1) is uniform within statistical errors. The result can be explained by excitation and optical depth effects, since the effective critical density of CO (2-1) is comparable to that of [C I]. The distribution of [C I] is similar to that of $^{13}$CO (2-1), and the ratios of [C I] to $^{13}$CO (2-1) and C$^{18}$O (2-1) are uniform within $\sim30\%$ in the central $<400$ pc starburst disk. The results suggest that [C I] (${^3\mathrm{P}}_1\rightarrow{^3\mathrm{P}}_0$) luminosity can be used as a CO-equivalent tracer of molecular gas mass, although caution is needed when applied in resolved starburst nuclei (e.g., circumnuclear disk), where the [C I]/CO(1-0) luminosity ratio is enhanced due to high excitation and atomic carbon abundance. The [C I]/CO(1-0) intensity ratio toward the base of the starburst-driven outflow is $\lesssim0.15$, and the upper limits of the mass and kinetic energy of the atomic carbon outflow are $\sim1\times10^4~M_\odot$ and $\sim3\times10^{51}$ erg, respectively.


title: Cost-Effective Data Feeds to Blockchains via Workload-Adaptive Data Replication

abstract: Feeding external data to a blockchain, a.k.a. data feed, is an essential task to enable blockchain interoperability and support emerging cross-domain applications, notably stablecoins. Given the data-intensive feeds in real life (e.g., high-frequency price updates) and the high cost in using blockchain, namely Gas, it is imperative to reduce the Gas cost of data feeds. Motivated by the constant-changing workloads in finance and other applications, this work focuses on designing a dynamic, workload-aware approach for cost effectiveness in Gas. This design space is understudied in the existing blockchain research which has so far focused on static data placement. This work presents GRuB, a cost-effective data feed that dynamically replicates data between the blockchain and an off-chain cloud storage. GRuB's data replication is workload-adaptive by monitoring the current workload and making online decisions w.r.t. data replication. A series of online algorithms are proposed that achieve the bounded worst-case cost in blockchain's Gas. GRuB runs the decision-making components on the untrusted cloud off-chain for lower Gas costs, and employs a security protocol to authenticate the data transferred between the blockchain and cloud. The overall GRuB system can autonomously achieve low Gas costs with changing workloads. We built a GRuB prototype functional with Ethereum and Google LevelDB, and supported real applications in stablecoins. Under real workloads collected from the Ethereum contract-call history and mixed workloads of YCSB, we systematically evaluate GRuB's cost which shows a saving of Gas by 10% ~ 74%, with comparison to the baselines of static data-placement.


title: Combinatorics of the double-dimer model

abstract: We prove that the partition function for tripartite double-dimer configurations of a planar bipartite graph satisfies a recurrence related to the Desnanot-Jacobi identity from linear algebra. A similar identity for the dimer partition function was established nearly 20 years ago by Kuo and has applications to random tiling theory and the theory of cluster algebras. This work was motivated in part by the potential for applications in these areas. Additionally, we discuss an application to Donaldson-Thomas and Pandharipande-Thomas theory which will be the subject of a forthcoming paper. The proof of our recurrence requires generalizing work of Kenyon and Wilson; specifically, lifting their assumption that the nodes of the graph are black and odd or white and even.


title: Real-time Image Enhancement for Vision-based Autonomous Underwater Vehicle Navigation in Murky Waters

abstract: Classic vision-based navigation solutions, which are utilized in algorithms such as Simultaneous Localization and Mapping (SLAM), usually fail to work underwater when the water is murky and the quality of the recorded images is low. That is because most SLAM algorithms are feature-based techniques and often it is impossible to extract the matched features from blurry underwater images. To get more useful features, image processing techniques can be used to dehaze the images before they are used in a navigation/localization algorithm. There are many well-developed methods for image restoration, but the degree of enhancement and the resource cost of the methods are different. In this paper, we propose a new visual SLAM, specifically-designed for the underwater environment, using Generative Adversarial Networks (GANs) to enhance the quality of underwater images with underwater image quality evaluation metrics. This procedure increases the efficiency of SLAM and gets a better navigation and localization accuracy. We evaluate the proposed GANs-SLAM combination by using different images with various levels of turbidity in the water. Experiments were conducted and the data was extracted from the Carnegie Lake in Princeton, and the Raritan river both in New Jersey, USA.


title: Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variables

abstract: Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation of task-oriented dialogue system to low-resource languages. To tackle this challenge, we first use a set of very few parallel word pairs to refine the aligned cross-lingual word-level representations. We then employ a latent variable model to cope with the variance of similar sentences across different languages, which is induced by imperfect cross-lingual alignments and inherent differences in languages. Finally, the experimental results show that even though we utilize much less external resources, our model achieves better adaptation performance for natural language understanding task (i.e., the intent detection and slot filling) compared to the current state-of-the-art model in the zero-shot scenario.


title: Time-Optimal Coordination for Connected and Automated Vehicles at Adjacent Intersections

abstract: In this paper, we provide a hierarchical coordination framework for connected and automated vehicles (CAVs) at two adjacent intersections. This framework consists of an upper-level scheduling problem and a low-level optimal control problem. By partitioning the area around two adjacent intersections into different zones, we formulate a scheduling problem for each individual CAV aimed at minimizing its total travel time. For each CAV, the solution of the upper-level problem designates the arrival times at each zones on its path which becomes the inputs of the low-level problem. The solution of the low-level problem yields the optimal control input (acceleration/deceleration) of each CAV to exit the intersections at the time specified in the upper-level scheduling problem. We validate the performance of our proposed hierarchical framework through extensive numerical simulations and comparison with signalized intersections, centralized scheduling, and FIFO queuing policy.


title: Lefschetz Properties and Hyperplane Arrangements

abstract: In this article, we study the weak and strong Lefschetz properties, and the related notion of almost revlex ideal, in the non-Artinian case, proving that several results known in the Artinian case hold also in this more general setting. We then apply the obtained results to the study of the Jacobian algebra of hyperplane arrangements.


title: Theoretical study of $ \rm{Nb} $ isotope productions by muon capture reaction on $ {}^{100} \rm{Mo} $

abstract: The isotope $ {}^{99} \rm{Mo} $, the generator of $ {}^{99m} \rm{Tc} $ used for diagnostic imaging, is supplied by extracting from fission fragments of highly enriched uranium in reactors. However, a reactor-free production method of $ {}^{99} \rm{Mo} $ is searched over the world from the point of view of nuclear proliferation. Recently, $ {}^{99} \rm{Mo} $ production through a muon capture reaction was proposed and it was found that about $ 50 \, \% $ of $ {}^{100} \rm{Mo} $ turned into $ {}^{99} \rm{Mo} $ through $ {}^{100} \rm{Mo} \left( \mu^-, n \right) $ reaction [arXiv:1908.08166]. However, the detailed physical process of the muon capture reaction is not completely understood. We, therefore, study the muon capture reaction of $ ^{100} \rm{Mo} $ by a theoretical approach. We used the proton-neutron QRPA to calculate the muon capture rate. The muon wave function is calculated with considering the electronic distribution of the atom and the nuclear charge distribution. The particle evaporation process from the daughter nucleus is calculated by a statistical model. From the model calculation, about $ 38 \, \% $ of $ {}^{100} \rm{Mo} $ is converted to $ {}^{99} \rm{Mo} $ through the muon capture reaction, which is in a reasonable agreement with the experimental data. It is revealed that negative parity states, especially $ 1^- $ state, play an important role in $ {}^{100} \rm{Mo} \left( \mu^-, n \right) {}^{99} \rm{Nb} $. The feasibility of $ {}^{99} \rm{Mo} $ production by the muon capture reaction is also discussed. Isotope production by the muon capture reaction strongly depends on the nuclear structure.


title: Discovery of Jet-Induced Soft Lags of XTE J1550-564 during Its 1998 Outburst

abstract: X-ray time lags are complicated in nature. The exact reasons for complex lag spectra are yet to be known. However, the hard lags, in general, are believed to be originated due to the inverse Comptonization process. But, the origin of soft lags remained mischievous. Recent studies on "Disk-Jet Connections" revealed that the jets are also contributing to the X-ray spectral and timing properties in a magnitude which was more than what was predicted earlier. In this article, we first show an exact anti-correlation between X-ray time lag and radio flux for XTE J1550-546 during its 1998 outburst. We propose that the soft lags might be generated due to the change in the accretion disk structure along the line of sight during higher jet activity.


title: On the Three Methods for Bounding the Rate of Convergence for some Continuous-time Markov Chains

abstract: Consideration is given to the three different analytical methods for the computation of upper bounds for the rate of convergence to the limiting regime of one specific class of (in)homogeneous continuous-time Markov chains. This class is particularly suited to describe evolutions of the total number of customers in (in)homogeneous $M/M/S$ queueing systems with possibly state-dependent arrival and service intensities, batch arrivals and services. One of the methods is based on the logarithmic norm of a linear operator function; the other two rely on Lyapunov functions and differential inequalities, respectively. Less restrictive conditions (compared to those known from the literature) under which the methods are applicable, are being formulated. Two numerical examples are given. It is also shown that for homogeneous birth-death Markov processes defined on a finite state space with all transition rates being positive, all methods yield the same sharp upper bound.


title: Some mudular inequalities in Lebesgue spaces with variable exponent

abstract: Our aim is to study the modular inequalities for some operators, for example the Bergman projection acting on, in Lebesgue spaces with variable exponent. Under proper assumptions on the variable exponent, we prove that the modular inequalities are hold if and only if the exponent almost everywhere equals to a constant. In order to get the main results, we prove a lemma for a lower pointwise bound for these operators of a characteristic function.


title: DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

abstract: In end-to-end dialogue modeling and agent learning, it is important to (1) effectively learn knowledge from data, and (2) fully utilize heterogeneous information, e.g., dialogue act flow and utterances. However, the majority of existing methods cannot simultaneously satisfy the two conditions. For example, rule definition and data labeling during system design take too much manual work, and sequence-to-sequence methods only model one-side utterance information. In this paper, we propose a novel joint end-to-end model by multi-task representation learning, which can capture the knowledge from heterogeneous information through automatically learning knowledgeable low-dimensional embeddings from data, named with DialogAct2Vec. The model requires little manual work for intervention in system design and we find that the multi-task learning can greatly improve the effectiveness of representation learning. Extensive experiments on a public dataset for restaurant reservation show that the proposed method leads to significant improvements against the state-of-the-art baselines on both the act prediction task and utterance prediction task.


title: Effective classical correspondence of the Mott transition

abstract: We derive an effective classical model to describe the Mott transition of the half-filled one-band Hubbard model in the framework of the dynamical mean-field theory with hybridization expansion of the continuous time quantum Monte Carlo. We find a simple two-body interaction of exponential form and reveal a classical correspondence of the Mott transition driven by a logarithmically divergent interaction length. Our work provides an alternative angle to view the Mott physics and suggests a renewed possibility to extend the application of the quantum-to-classical mapping in understanding condensed matter physics


title: A post hoc test on the Sharpe ratio

abstract: We describe a post hoc test for the Sharpe ratio, analogous to Tukey's test for pairwise equality of means. The test can be applied after rejection of the hypothesis that all population Signal-Noise ratios are equal. The test is applicable under a simple correlation structure among asset returns. Simulations indicate the test maintains nominal type I rate under a wide range of conditions and is moderately powerful under reasonable alternatives.


title: Program Synthesis by Type-Guided Abstraction Refinement

abstract: We consider the problem of type-directed component based synthesis where, given a set of (typed) components and a query type, the goal is to synthesize a term that inhabits the query. Classical approaches based on proof search in intuitionistic logics do not scale up to the standard libraries of modern languages, which span hundreds or thousands of components. Recent graph reachability based methods proposed for languages like Java do scale, but only apply to components over monomorphic data and functions: polymorphic data and functions infinitely explode the size of the graph that must be searched, rendering synthesis intractable. We introduce type-guided abstraction refinement (TYGAR), a new approach for scalable type-directed synthesis over polymorphic datatypes and components. Our key insight is that we can overcome the explosion by building a graph over abstract types which represent a potentially unbounded set of concrete types. We show how to use graph reachability to search for candidate terms over abstract types, and introduce a new algorithm that uses proofs of untypeability of ill-typed candidates to iteratively refine the abstraction until a well-typed result is found. We have implemented TYGAR in H+, a tool that takes as input a set of Haskell libraries and a query type, and returns a Haskell term that uses functions from the provided libraries to implement the query type. We have evaluated H+ on a set of 44 queries using a set of popular Haskell libraries with a total of 291 components. Our results demonstrate that H+ returns an interesting solution within the first five results for 33 out of 44 queries. Moreover, TYGAR allows H+ to rapidly return well-typed terms, with the median time to first solution of just 1.4 seconds.


title: Seismic data interpolation based on U-net with texture loss

abstract: Missing traces in acquired seismic data is a common occurrence during the collection of seismic data. Deep neural network (DNN) has shown considerable promise in restoring incomplete seismic data. However, several DNN-based approaches ignore the specific characteristics of seismic data itself, and only focus on reducing the difference between the recovered and the original signals. In this study, a novel Seismic U-net InterpolaTor (SUIT) is proposed to preserve the seismic texture information while reconstructing the missing traces. Aside from minimizing the reconstruction error, SUIT enhances the texture consistency between the recovery and the original completely seismic data, by designing a pre-trained U-Net to extract the texture information. The experiments show that our method outperforms the classic state-of-art methods in terms of robustness.


title: Paradox of Modeling Curved Faults Revisited with General Non-Hypersingular Stress Green's Functions

abstract: In a dislocation problem, a paradoxical discordance is known to occur between an original smooth curve and an infinitesimally discretized curve. To solve this paradox, we have investigated a non-hypersingular expression for the integral kernel (called the stress Green's function) which describes the stress field caused by the displacement discontinuity. We first develop a compact alternative expression of the non-hypersingular stress Green's function for general two- and three-dimensional infinite homogeneous elastic media. We next compute the stress Green's functions on a curved fault and revisit the paradox. We find that previously obtained non-hypersingular stress Green's functions are incorrect for curved faults, and that smooth and infinitesimally segmented faults are equivalent. Their compatibility bridges the gap between analytical methods featuring curved faults and numerical methods using subdivided flat patches.


title: SMIX($\lambda$): Enhancing Centralized Value Functions for Cooperative Multi-Agent Reinforcement Learning

abstract: Learning a stable and generalizable centralized value function (CVF) is a crucial but challenging task in multi-agent reinforcement learning (MARL), as it has to deal with the issue that the joint action space increases exponentially with the number of agents in such scenarios. This paper proposes an approach, named SMIX(${\lambda}$), to address the issue using an efficient off-policy centralized training method within a flexible learner search space. As importance sampling for such off-policy training is both computationally costly and numerically unstable, we proposed to use the ${\lambda}$-return as a proxy to compute the TD error. With this new loss function objective, we adopt a modified QMIX network structure as the base to train our model. By further connecting it with the ${Q(\lambda)}$ approach from an unified expectation correction viewpoint, we show that the proposed SMIX(${\lambda}$) is equivalent to ${Q(\lambda)}$ and hence shares its convergence properties, while without being suffered from the aforementioned curse of dimensionality problem inherent in MARL. Experiments on the StarCraft Multi-Agent Challenge (SMAC) benchmark demonstrate that our approach not only outperforms several state-of-the-art MARL methods by a large margin, but also can be used as a general tool to improve the overall performance of other CTDE-type algorithms by enhancing their CVFs.


title: Tracing the co-evolution path of super massive black holes and spheroids with AKARI-selected ultra-luminous IR galaxies at intermediate redshifts

abstract: We present the stellar population and ionized-gas outflow properties of ultra-luminous IR galaxies (ULIRGs) at $z=$ 0.1-1.0, which are selected from AKARI FIR all-sky survey. We construct a catalog of 1077 ULIRGs to examine feedback effect after major mergers. 202 out of the 1077 ULIRGs are spectroscopically identified by SDSS and Subaru/FOCAS observations. Thanks to deeper depth and higher resolution of AKARI compared to the previous IRAS survey, and reliable identification from WISE MIR pointing, the sample is unique in identifying optically-faint (i$\sim$20) IR-bright galaxies, which could be missed in previous surveys. A self-consistent spectrum-SED decomposition method, which constrains stellar population properties in SED modeling based on spectral fitting results, has been employed for 149 ULIRGs whose optical continua are dominated by host galaxies. They are massive galaxies ($M_{\rm star}\sim10^{11}$-$10^{12}$ M$_{\odot}$), associated with intense star formation activities (SFR $\sim$ 200-2000 M$_{\odot}$ yr$^{-1}$). The sample covers a range of AGN bolometric luminosity of $10^{10}$-$10^{13}$ L$_{\odot}$, and the outflow velocity measured from [OIII] 5007A line shows a correlation with AGN luminosity. Eight galaxies show extremely fast outflows with velocity up to 1500-2000 km s$^{-1}$. However, the co-existence of vigorous starbursts and strong outflows suggests the star formation has not been quenched during the ULIRG phase. By deriving stellar mass and mass fraction of young stellar population, we find no significant discrepancies between stellar properties of ULIRGs with weak and powerful AGNs. The results are not consistent with the merger-induced evolutionary scenario, which predicts that SF-dominated ULIRGs show smaller stellar mass and younger stellar populations compared to AGN-dominated ULIRGs.


title: UW-MARL: Multi-Agent Reinforcement Learning for Underwater Adaptive Sampling using Autonomous Vehicles

abstract: Near-real-time water-quality monitoring in uncertain environments such as rivers, lakes, and water reservoirs of different variables is critical to protect the aquatic life and to prevent further propagation of the potential pollution in the water. In order to measure the physical values in a region of interest, adaptive sampling is helpful as an energy- and time-efficient technique since an exhaustive search of an area is not feasible with a single vehicle. We propose an adaptive sampling algorithm using multiple autonomous vehicles, which are well-trained, as agents, in a Multi-Agent Reinforcement Learning (MARL) framework to make efficient sequence of decisions on the adaptive sampling procedure. The proposed solution is evaluated using experimental data, which is fed into a simulation framework. Experiments were conducted in the Raritan River, Somerset and in Carnegie Lake, Princeton, NJ during July 2019.


title: Instability of solutions to the Ginzburg-Landau equation on $S^{n}$ and $\mathbb{CP}^{n}$

abstract: We study critical points of the Ginzburg-Landau (GL) functional and the abelian Yang-Mills-Higgs (YMH) functional on the sphere and the complex projective space, both equipped with the standard metrics. For the GL functional we prove that on $S^{n}$ with $n \geq 2$ and $\mathbb{CP}^{n}$ with $n \geq 1$, stable critical points must be constants. In addition, for GL critical points on $S^{n}$ for $n \geq 3$ we obtain a lower bound on the Morse index under suitable assumptions. On the other hand, for the abelian YMH functional we prove that on $S^{n}$ with $n \geq 4$ there are no stable critical points unless the line bundle is isomorphic to $S^n \times \mathbb{C}$, in which case the only stable critical points are the trivial ones. Our methods come from the work of Lawson--Simons.


title: Paired Domination versus Domination and Packing Number in Graphs

abstract: Given a graph $G=(V(G), E(G))$, the size of a minimum dominating set, minimum paired dominating set, and a minimum total dominating set of a graph $G$ are denoted by $\gamma(G)$, $\gamma_{\rm pr}(G)$, and $\gamma_{t}(G)$, respectively. For a positive integer $k$, a $k$-packing in $G$ is a set $S \subseteq V(G)$ such that for every pair of distinct vertices $u$ and $v$ in $S$, the distance between $u$ and $v$ is at least $k+1$. The $k$-packing number is the order of a largest $k$-packing and is denoted by $\rho_{k}(G)$. It is well known that $\gamma_{\rm pr}(G) \le 2\gamma(G)$. In this paper, we prove that it is NP-hard to determine whether $\gamma_{\rm pr}(G) = 2\gamma(G)$ even for bipartite graphs. We provide a simple characterization of trees with $\gamma_{\rm pr}(G) = 2\gamma(G)$, implying a polynomial-time recognition algorithm. We also prove that even for a bipartite graph, it is NP-hard to determine whether $\gamma_{\rm pr}(G)=\gamma_{t}(G)$. We finally prove that it is both NP-hard to determine whether $\gamma_{\rm pr}(G)=2\rho_{4}(G)$ and whether $\gamma_{\rm pr}(G)=2\rho_{3}(G)$.


title: Beyond Similarity: Relation Embedding with Dual Attentions for Item-based Recommendation

abstract: Given the effectiveness and ease of use, Item-based Collaborative Filtering (ICF) methods have been broadly used in industry in recent years. The key of ICF lies in the similarity measurement between items, which however is a coarse-grained numerical value that can hardly capture users' fine-grained preferences toward different latent aspects of items from a representation learning perspective. In this paper, we propose a model called REDA (latent Relation Embedding with Dual Attentions) to address this challenge. REDA is essentially a deep learning based recommendation method that employs an item relation embedding scheme through a neural network structure for inter-item relations representation. A relational user embedding is then proposed by aggregating the relation embeddings between all purchased items of a user, which not only better characterizes user preferences but also alleviates the data sparsity problem. Moreover, to capture valid meta-knowledge that reflects users' desired latent aspects and meanwhile suppress their explosive growth towards overfitting, we further propose a dual attentions mechanism, including a memory attention and a weight attention. A relation-wise optimization method is finally developed for model inference by constructing a personalized ranking loss for item relations. Extensive experiments are implemented on real-world datasets and the proposed model is shown to greatly outperform state-of-the-art methods, especially when the data is sparse.


title: Numerical Simulation and Completeness Survey of Bubbles in the Taurus and Perseus Molecular Clouds

abstract: Previous studies have analyzed the energy injection into the interstellar matter due to molecular bubbles. They found that the total kinetic energies of bubbles are comparable to, or even larger than, those of outflows but still less than the gravitational potential and turbulence energies of the hosting clouds. We examined the possibility that previous studies underestimated the energy injection due to being unable to detect dim or incomplete bubbles. We simulated typical molecular bubbles and inserted them into the $^{13}$CO Five College Radio Astronomical Observatory maps of the Taurus and Perseus Molecular Clouds. We determined bubble identification completeness by applying the same procedures to both simulated and real data sets. We proposed a detectability function for both the Taurus and Perseus molecular clouds based on a multivariate approach. In Taurus, bubbles with kinetic energy less than ~$1 \times 10^{44}$ erg are likely to be missed. We found that the total missing kinetic energy in Taurus is less than a couple of $10^{44}$ erg, which only accounts for around 0.2% of the total kinetic energy of identified bubbles. In Perseus, bubbles with kinetic energy less than ~$2 \times 10^{44}$ erg are likely to be missed. We found that the total missing kinetic energy in Perseus is less than $10^{45}$ erg, which only accounts for around 1% of the total kinetic energy of identified bubbles. We thus conclude that previous manual bubble identification routines used in Taurus and Perseus can be considered to be energetically complete. Therefore, we confirm that energy injection from dynamic structures, namely outflows and bubbles, produced by star formation feedback are sufficient to sustain turbulence at a spatial scale from ~0.1 to ~2.8 pc.


title: Collaborative Homomorphic Computation on Data Encrypted under Multiple Keys

abstract: Homomorphic encryption (HE) is a promising cryptographic technique for enabling secure collaborative machine learning in the cloud. However, support for homomorphic computation on ciphertexts under multiple keys is inefficient. Current solutions often require key setup before any computation or incur large ciphertext size (at best, grow linearly to the number of involved keys). In this paper, we proposed a new approach that leverages threshold and multi-key HE to support computations on ciphertexts under different keys. Our new approach removes the need for key setup between each client and the set of model owners. At the same time, this approach reduces the number of encrypted models to be offloaded to the cloud evaluator, and the ciphertext size with a dimension reduction from (N+1)x2 to 2x2. We present the details of each step and discuss the complexity and security of our approach.


title: Activity Monitoring of Islamic Prayer (Salat) Postures using Deep Learning

abstract: In the Muslim community, the prayer (i.e. Salat) is the second pillar of Islam, and it is the most essential and fundamental worshiping activity that believers have to perform five times a day. From a gestures' perspective, there are predefined human postures that must be performed in a precise manner. However, for several people, these postures are not correctly performed, due to being new to Salat or even having learned prayers in an incorrect manner. Furthermore, the time spent in each posture has to be balanced. To address these issues, we propose to develop an artificial intelligence assistive framework that guides worshippers to evaluate the correctness of the postures of their prayers. This paper represents the first step to achieve this objective and addresses the problem of the recognition of the basic gestures of Islamic prayer using Convolutional Neural Networks (CNN). The contribution of this paper lies in building a dataset for the basic Salat positions, and train a YOLOv3 neural network for the recognition of the gestures. Experimental results demonstrate that the mean average precision attains 85% for a training dataset of 764 images of the different postures. To the best of our knowledge, this is the first work that addresses human activity recognition of Salat using deep learning.


title: Type II superstring field theory with cyclic L-infinity structure

abstract: We construct a complete type II superstring field theory that includes all the NS-NS, R-NS, NS-R and R-R sectors. As in the open and heterotic superstring cases, the R-NS, NS-R and R-R string fields are constrained by using the picture-changing operators. In particular, we use a non-local inverse picture-changing operator for the constraint on the R-R string field, which seems to be inevitable due to the compatibility of the extra constraint with the closed string constraints. The natural symplectic form in the restricted Hilbert space gives a non-local kinetic action for the R-R sector, but it correctly provides the propagator expected from the first-quantized formulation. Extending the prescription previously obtained for the heterotic string field theory, we give a construction of general type II superstring products, which realizes a cyclic L-infinity structure, and thus provides a gauge-invariant action based on the homotopy algebraic formulation. Three typical four-string amplitudes derived from the constructed string field theory are demonstrated to agree with those in the first-quantized formulation. We also give the half-Wess-Zumino-Witten action defined in the medium Hilbert space whose left-moving sector is still restricted to the small Hilbert space.


title: Authentication of Smartphone Users Using Behavioral Biometrics

abstract: Smartphones and tablets have become ubiquitous in our daily lives. Smartphones, in particular, have become more than personal assistants. These devices have provided new avenues for consumers to play, work, and socialize whenever and wherever they want. Smartphones are small in size, so they are easy to handle and to stow and carry in users' pockets or purses. However, mobile devices are also susceptible to various problems. One of the greatest concerns is the possibility of breach in security and privacy if the device is seized by an outside party. It is possible that threats can come from friends as well as strangers. Due to the size of smart devices, they can be easily lost and may expose details of users' private lives. In addition, this might enable pervasive observation or imitation of one's movements and activities, such as sending messages to contacts, accessing private communication, shopping with a credit card, and relaying information about where one has been. This paper highlights the potential risks that occur when smartphones are stolen or seized, discusses the concept of continuous authentication, and analyzes current approaches and mechanisms of behavioral biometrics with respect to methodology, associated datasets and evaluation approaches.


title: Two limits on Hardy and Sobolev inequalities

abstract: It is known that classical Hardy and Sobolev inequalities hold when the exponent $p$ and the dimension $N$ satisfy $p < N < \infty$. In this note, we consider two limits of Hardy and Sobolev inequalities as $p \nearrow N$ and $N \nearrow \infty$ in some sense.


title: Exoplanet Imitators: A test of stellar activity behavior in radial velocity signals

abstract: Accurately modeling effects from stellar activity is a key step in detecting radial velocity signals of low-mass and long-period exoplanets. Radial velocities from stellar activity are dominated by magnetic active regions that move in and out of sight as the star rotates, producing signals with timescales related to the stellar rotation period. Methods to characterize radial velocity periodograms assume that peaks from magnetic active regions will typically occur at the stellar rotation period or a related harmonic. However, with surface features unevenly spaced and evolving over time, signals from magnetic activity are not perfectly periodic, and the effectiveness of characterizing them with sine curves is unconfirmed. With a series of simulations, we perform the first test of common assumptions about signals from magnetic active regions in radial velocity periodograms. We simulate radial velocities with quasi-periodic signals that account for evolution and migration of magnetic surface features. As test cases, we apply our analysis to two exoplanet hosts, Kepler-20 and K2-131. Simulating observing schedules and uncertainties of real radial velocity surveys, we find that magnetic active regions commonly produce maximum periodogram peaks at spurious periods unrelated to the stellar rotation period: 81% and 72% of peaks, respectively for K2-131 and Kepler-20. These unexpected peaks can potentially lead to inaccuracies in derived planet masses. We also find that these spurious peaks can sometimes survive multiple seasons of observation, imitating signals typically attributed to exoplanet companions.


title: Context-aware Active Multi-Step Reinforcement Learning

abstract: Reinforcement learning has attracted great attention recently, especially policy gradient algorithms, which have been demonstrated on challenging decision making and control tasks. In this paper, we propose an active multi-step TD algorithm with adaptive stepsizes to learn actor and critic. Specifically, our model consists of two components: active stepsize learning and adaptive multi-step TD algorithm. Firstly, we divide the time horizon into chunks and actively select state and action inside each chunk. Then given the selected samples, we propose the adaptive multi-step TD, which generalizes TD($\lambda$), but adaptively switch on/off the backups from future returns of different steps. Particularly, the adaptive multi-step TD introduces a context-aware mechanism, here a binary classifier, which decides whether or not to turn on its future backups based on the context changes. Thus, our model is kind of combination of active learning and multi-step TD algorithm, which has the capacity for learning off-policy without the need of importance sampling. We evaluate our approach on both discrete and continuous space tasks in an off-policy setting respectively, and demonstrate competitive results compared to other reinforcement learning baselines.


title: Atomic Origin of Spin-Valve Magnetoresistance at the SrRuO3 Grain Boundary

abstract: Defects ubiquitously exist in crystal materials and usually exhibit a very different nature than the bulk matrix, and hence, their presence can have significant impacts on the properties of devices. Although it is well accepted that the properties of defects are determined by their unique atomic environments, the precise knowledge of such relationships is far from clear for most oxides due to the complexity of defects and difficulties in characterization. Here, we fabricate a 36.8{\deg} SrRuO3 grain boundary of which the transport measurements show a spin-valve magnetoresistance. We identify its atomic arrangement, including oxygen, using scanning transmission electron microscopy and spectroscopy. Based on the as-obtained atomic structure, the density functional theory calculations suggest that the spin-valve magnetoresistance is because of the dramatically reduced magnetic moments at the boundary. The ability to manipulate magnetic properties at the nanometer scale via defect control allows new strategies to design magnetic/electronic devices with low-dimensional magnetic order.


title: Efficiency Assessment of Approximated Spatial Predictions for Large Datasets

abstract: Due to the well-known computational showstopper of the exact Maximum Likelihood Estimation (MLE) for large geospatial observations, a variety of approximation methods have been proposed in the literature, which usually require tuning certain inputs. For example, the recently developed Tile Low-Rank approximation (TLR) method involves many tuning parameters, including numerical accuracy. To properly choose the tuning parameters, it is crucial to adopt a meaningful criterion for the assessment of the prediction efficiency with different inputs, which the most commonly-used Mean Square Prediction Error (MSPE) criterion and the Kullback-Leibler Divergence criterion cannot fully describe. In this paper, we present three other criteria, the Mean Loss of Efficiency (MLOE), Mean Misspecification of the Mean Square Error (MMOM), and Root mean square MOM (RMOM), and show numerically that, in comparison with the common MSPE criterion and the Kullback-Leibler Divergence criterion, our criteria are more informative, and thus more adequate to assess the loss of the prediction efficiency by using the approximated or misspecified covariance models. Hence, our suggested criteria are more useful for the determination of tuning parameters for sophisticated approximation methods of spatial model fitting. To illustrate this, we investigate the trade-off between the execution time, estimation accuracy, and prediction efficiency for the TLR method with extensive simulation studies and suggest proper settings of the TLR tuning parameters. We then apply the TLR method to a large spatial dataset of soil moisture in the area of the Mississippi River basin, and compare the TLR with the Gaussian predictive process and the composite likelihood method, showing that our suggested criteria can successfully be used to choose the tuning parameters that can keep the estimation or the prediction accuracy in applications.


title: Linear-Quadratic Time-Inconsistent Mean-Field Type Stackelberg Differential Games: Time-Consistent Open-Loop Solutions

abstract: In this technical note, we consider the linear-quadratic time-inconsistent mean-field type leader-follower Stackelberg differential game with an adapted open-loop information structure. The objective functionals of the leader and the follower include conditional expectations of state and control (mean field) variables, and the cost parameters could be general nonexponential discounting depending on the initial time. As stated in the existing literature, these two general settings of the objective functionals induce time inconsistency in the optimal solutions. Given an arbitrary control of the leader, we first obtain the follower's (time-consistent) equilibrium control and its state feedback representation in terms of the nonsymmetric coupled Riccati differential equations (RDEs) and the backward stochastic differential equation (SDE). This provides the rational behavior of the follower, characterized by the forward-backward SDE (FBSDE). We then obtain the leader's explicit (time-consistent) equilibrium control and its state feedback representation in terms of the nonsymmetric coupled RDEs under the FBSDE constraint induced by the follower. With the solvability of the nonsymmetric coupled RDEs, the equilibrium controls of the leader and the follower constitute the time-consistent Stackelberg equilibrium. Finally, the numerical examples are provided to check the solvability of the nonsymmetric coupled RDEs.


title: A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis

abstract: In Mandarin text-to-speech (TTS) system, the front-end text processing module significantly influences the intelligibility and naturalness of synthesized speech. Building a typical pipeline-based front-end which consists of multiple individual components requires extensive efforts. In this paper, we proposed a unified sequence-to-sequence front-end model for Mandarin TTS that converts raw texts to linguistic features directly. Compared to the pipeline-based front-end, our unified front-end can achieve comparable performance in polyphone disambiguation and prosody word prediction, and improve intonation phrase prediction by 0.0738 in F1 score. We also implemented the unified front-end with Tacotron and WaveRNN to build a Mandarin TTS system. The synthesized speech by that got a comparable MOS (4.38) with the pipeline-based front-end (4.37) and close to human recordings (4.49).


title: Dependency Stochastic Boolean Satisfiability: A Logical Formalism for NEXPTIME Decision Problems with Uncertainty

abstract: Stochastic Boolean Satisfiability (SSAT) is a logical formalism to model decision problems with uncertainty, such as Partially Observable Markov Decision Process (POMDP) for verification of probabilistic systems. SSAT, however, is limited by its descriptive power within the PSPACE complexity class. More complex problems, such as the NEXPTIME-complete Decentralized POMDP (Dec-POMDP), cannot be succinctly encoded with SSAT. To provide a logical formalism of such problems, we extend the Dependency Quantified Boolean Formula (DQBF), a representative problem in the NEXPTIME-complete class, to its stochastic variant, named Dependency SSAT (DSSAT), and show that DSSAT is also NEXPTIME-complete. We demonstrate the potential applications of DSSAT to circuit synthesis of probabilistic and approximate design. Furthermore, to study the descriptive power of DSSAT, we establish a polynomial-time reduction from Dec-POMDP to DSSAT. With the theoretical foundations paved in this work, we hope to encourage the development of DSSAT solvers for potential broad applications.


title: Photon-mediated localization in two-level qubit arrays

abstract: We predict the existence of a novel interaction-induced spatial localization in a periodic array of qubits coupled to a waveguide. This localization can be described as a quantum analogue of a self-induced optical lattice between two indistinguishable photons, where one photon creates a standing wave that traps the other photon. The localization is caused by the interplay between on-site repulsion due to the photon blockade and the waveguide-mediated long-range coupling between the qubits.


title: Electrostatic Imaging of Encapsulated Graphene

abstract: Devices made from two dimensional materials such as graphene and transition metal dichalcogenides exhibit remarkable electronic properties of interest to many subdisciplines of nanoscience. Owing to their 2D nature, their quality is highly susceptible to contamination and degradation when exposed to the ambient environment. Protecting the 2D layers by encapsulation between hexagonal boron nitride layers significantly improves their quality. Locating these samples within the encapsulant and assessing their integrity prior to further processing then becomes challenging. Here we show that conductive scanning probe techniques such as electrostatic force and Kelvin force microscopy makes it possible to visualize the encapsulated layers, their charge environment and local defects including cracks and bubbles on the sub-micrometer scale. Our techniques are employed without requiring electrical contact to the embedded layer, providing valuable feedback on the local electronic quality prior to any device etching or electrode deposition. We show that these measurement modes, which are simple extensions of atomic force microscopy, are perfectly suited for imaging encapsulated conductors and their local charge environments.


title: Text classification with pixel embedding

abstract: We propose a novel framework to understand the text by converting sentences or articles into video-like 3-dimensional tensors. Each frame, corresponding to a slice of the tensor, is a word image that is rendered by the word's shape. The length of the tensor equals to the number of words in the sentence or article. The proposed transformation from the text to a 3-dimensional tensor makes it very convenient to implement an $n$-gram model with convolutional neural networks for text analysis. Concretely, we impose a 3-dimensional convolutional kernel on the 3-dimensional text tensor. The first two dimensions of the convolutional kernel size equal the size of the word image and the last dimension of the kernel size is $n$. That is, every time when we slide the 3-dimensional kernel over a word sequence, the convolution covers $n$ word images and outputs a scalar. By iterating this process continuously for each $n$-gram along with the sentence or article with multiple kernels, we obtain a 2-dimensional feature map. A subsequent 1-dimensional max-over-time pooling is applied to this feature map, and three fully-connected layers are used for conducting text classification finally. Experiments of several text classification datasets demonstrate surprisingly superior performances using the proposed model in comparison with existing methods.


title: Sparse Modeling in Quantum Many-Body Problems

abstract: This review paper describes the basic concept and technical details of sparse modeling and its applications to quantum many-body problems. Sparse modeling refers to methodologies for finding a small number of relevant parameters that well explain a given dataset. This concept reminds us physics, where the goal is to find a small number of physical laws that are hidden behind complicated phenomena. Sparse modeling extends the target of physics from natural phenomena to data, and may be interpreted as "physics for data". The first half of this review introduces sparse modeling for physicists. It is assumed that readers have physics background but no expertise in data science. The second half reviews applications. Matsubara Green's function, which plays a central role in descriptions of correlated systems, has been found to be sparse, meaning that it contains little information. This leads to (i) a new method for solving the ill-conditioned inverse problem for analytical continuation, and (ii) a highly compact representation of Matsubara Green's function, which enables efficient calculations for quantum many-body systems.


title: A bright electromagnetic counterpart to extreme mass ratio inspirals

abstract: The extreme mass ratio inspiral (EMRI), defined as a stellar-mass compact object inspiraling into a supermassive black hole (SMBH), has been widely argued to be a low-frequency gravitational wave (GW) source. EMRIs providing accurate measurements of black hole mass and spin, are one of the primary interests for Laser Interferometer Space Antenna (LISA). However, it is usually believed that there are no electromagnetic (EM) counterparts to EMRIs. Here we show a new formation channel of EMRIs with tidal disruption flares as EM counterparts. In this scenario, flares can be produced from the tidal stripping of the helium (He) envelope of a massive star by an SMBH. The left compact core of the massive star will evolve into an EMRI. We find that, under certain initial eccentricity and semimajor axis, the GW frequency of the inspiral can enter LISA band within 10 $\sim$ 20 years, which makes the tidal disruption flare an EM precursor to EMRI. Although the event rate is just $2\times 10^{-4}~\rm Gpc^{-3}yr^{-1}$, this association can not only improve the localization accuracy of LISA and help to find the host galaxy of EMRI, but also serve as a new GW standard siren for cosmology.


title: TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

abstract: We propose TANDA, an effective technique for fine-tuning pre-trained Transformer models for natural language tasks. Specifically, we first transfer a pre-trained model into a model for a general task by fine-tuning it with a large and high-quality dataset. We then perform a second fine-tuning step to adapt the transferred model to the target domain. We demonstrate the benefits of our approach for answer sentence selection, which is a well-known inference task in Question Answering. We built a large scale dataset to enable the transfer step, exploiting the Natural Questions dataset. Our approach establishes the state of the art on two well-known benchmarks, WikiQA and TREC-QA, achieving MAP scores of 92% and 94.3%, respectively, which largely outperform the previous highest scores of 83.4% and 87.5%, obtained in very recent work. We empirically show that TANDA generates more stable and robust models reducing the effort required for selecting optimal hyper-parameters. Additionally, we show that the transfer step of TANDA makes the adaptation step more robust to noise. This enables a more effective use of noisy datasets for fine-tuning. Finally, we also confirm the positive impact of TANDA in an industrial setting, using domain specific datasets subject to different types of noise.


title: Classification of subbundles on the Fargues-Fontaine curve

abstract: We completely classify all subbundles of a given vector bundle on the Fargues-Fontaine curve. Our classification is given in terms of a simple and explicit condition on Harder-Narasimhan polygons. Our proof is inspired by the proof of the main theorem in [Hon19], but also involves a number of nontrivial adjustments.


title: An empirical study of the relation between network architecture and complexity

abstract: In this preregistration submission, we propose an empirical study of how networks handle changes in complexity of the data. We investigate the effect of network capacity on generalization performance in the face of increasing data complexity. For this, we measure the generalization error for an image classification task where the number of classes steadily increases. We compare a number of modern architectures at different scales in this setting. The methodology, setup, and hypotheses described in this proposal were evaluated by peer review before experiments were conducted.


title: Domain wall motion in a diffusive weak ferromagnet

abstract: We study the domain wall motion in a disordered weak ferromagnet, induced by injecting a spin current from a strong ferromagnet. Starting from the spin diffusion equation describing the spin accumulation in the weak ferromagnet, we calculate the force and torque acting on the domain wall. We also study the ensuing domain wall dynamics, and suggest a possible measurement method for detecting the domain wall motion via measuring the additional resistance.


title: Classification on the Computational Complexity of Spin Models

abstract: In this note, we provide a unifying framework to investigate the computational complexity of classical spin models and give the full classification on spin models in terms of system dimensions, randomness, external magnetic fields and types of spin coupling. We further discuss about the implications of NP-complete Hamiltonian models in physics and the fundamental limitations of all numerical methods imposed by such models. We conclude by a brief discussion on the picture when quantum computation and quantum complexity theory are included.

categories: cond-mat.dis-nn cond-mat.str-el cs.CC quant-ph


title: Leveraging Dependency Forest for Neural Medical Relation Extraction

abstract: Medical relation extraction discovers relations between entity mentions in text, such as research articles. For this task, dependency syntax has been recognized as a crucial source of features. Yet in the medical domain, 1-best parse trees suffer from relatively low accuracies, diminishing their usefulness. We investigate a method to alleviate this problem by utilizing dependency forests. Forests contain many possible decisions and therefore have higher recall but more noise compared with 1-best outputs. A graph neural network is used to represent the forests, automatically distinguishing the useful syntactic information from parsing noise. Results on two biomedical benchmarks show that our method outperforms the standard tree-based methods, giving the state-of-the-art results in the literature.


title: Tuning PoW with Hybrid Expenditure

abstract: Proof of Work (PoW) is a Sybil-deterrence security mechanism. It introduces an external cost to a system by requiring computational effort to perform actions. However, since its inception, a central challenge was to tune this cost. Initial designs for deterring spam email and DoS attacks applied overhead equally to honest participants and attackers. Requiring too little effort did not deter attacks, whereas too much encumbered honest participation. This might be the reason it was never widely adopted. Nakamoto overcame this trade-off in Bitcoin by distinguishing desired from malicious behavior and introducing internal rewards for the former. This solution gained popularity in securing cryptocurrencies and using the virtual internally-minted tokens for rewards. However, in existing blockchain protocols the internal rewards fund (almost) the same value of external expenses. Thus, as the token value soars, so does the PoW expenditure. Bitcoin PoW, for example, already expends as much electricity as Colombia or Switzerland. This amount of resource-guzzling is unsustainable and hinders even wider adoption of these systems. In this work we present Hybrid Expenditure Blockchain (HEB), a novel PoW mechanism. HEB is a generalization of Nakamoto's protocol that enables tuning the external expenditure by introducing a complementary internal-expenditure mechanism. Thus, for the first time, HEB decouples external expenditure from the reward value. We show a practical parameter choice by which HEB requires significantly less external consumption compare to Nakamoto's protocol, its resilience against rational attackers is similar, and it retains the decentralized and permissionless nature of the system. Taking the Bitcoin ecosystem as an example, HEB cuts the electricity consumption by half.


title: Split generalized-$\alpha$ method: A linear-cost solver for a modified generalized-method for multi-dimensional second-order hyperbolic systems

abstract: We propose a variational splitting technique for the generalized-$\alpha$ method to solve hyperbolic partial differential equations. We use tensor-product meshes to develop the splitting method, which has a computational cost that grows linearly with respect to the total number of degrees of freedom for multi-dimensional problems. We consider standard $C^0$ finite elements as well as smoother B-splines in isogeometric analysis for the spatial discretization. We also study the spectrum of the amplification matrix to establish the unconditional stability of the method. We then show that the stability behavior affects the overall behavior of the integrator on the entire interval and not only at the limits $0$ and $\infty$. We use various examples to demonstrate the performance of the method and the optimal approximation accuracy. For the numerical tests, we compute the $L_2$ and $H^1$ norms to show the optimal convergence of the discrete method in space and second-order accuracy in time.


title: A network-based microfoundation of Granovetter's threshold model for social tipping

abstract: Social tipping, where minorities trigger larger populations to engage in collective action, has been suggested as one key aspect in addressing contemporary global challenges. Here, we refine Granovetter's widely acknowledged theoretical threshold model of collective behavior as a numerical modelling tool for understanding social tipping processes and resolve issues that so far have hindered such applications. Based on real-world observations and social movement theory, we group the population into certain or potential actors, such that -- in contrast to its original formulation -- the model predicts non-trivial final shares of acting individuals. Then, we use a network cascade model to explain and analytically derive that previously hypothesized broad threshold distributions emerge if individuals become active via social interaction. Thus, through intuitive parameters and low dimensionality our refined model is adaptable to explain the likelihood of engaging in collective behavior where social tipping like processes emerge as saddle-node bifurcations and hysteresis.


title: Fast Learning of Temporal Action Proposal via Dense Boundary Generator

abstract: Generating temporal action proposals remains a very challenging problem, where the main issue lies in predicting precise temporal proposal boundaries and reliable action confidence in long and untrimmed real-world videos. In this paper, we propose an efficient and unified framework to generate temporal action proposals named Dense Boundary Generator (DBG), which draws inspiration from boundary-sensitive methods and implements boundary classification and action completeness regression for densely distributed proposals. In particular, the DBG consists of two modules: Temporal boundary classification (TBC) and Action-aware completeness regression (ACR). The TBC aims to provide two temporal boundary confidence maps by low-level two-stream features, while the ACR is designed to generate an action completeness score map by high-level action-aware features. Moreover, we introduce a dual stream BaseNet (DSB) to encode RGB and optical flow information, which helps to capture discriminative boundary and actionness features. Extensive experiments on popular benchmarks ActivityNet-1.3 and THUMOS14 demonstrate the superiority of DBG over the state-of-the-art proposal generator (e.g., MGG and BMN). Our code will be made available upon publication.


title: A hybrid text normalization system using multi-head self-attention for mandarin

abstract: In this paper, we propose a hybrid text normalization system using multi-head self-attention. The system combines the advantages of a rule-based model and a neural model for text preprocessing tasks. Previous studies in Mandarin text normalization usually use a set of hand-written rules, which are hard to improve on general cases. The idea of our proposed system is motivated by the neural models from recent studies and has a better performance on our internal news corpus. This paper also includes different attempts to deal with imbalanced pattern distribution of the dataset. Overall, the performance of the system is improved by over 1.5% on sentence-level and it has a potential to improve further.