title: Using BibTeX to Automatically Generate Labeled Data for Citation Field Extraction

abstract: Accurate parsing of citation reference strings is crucial to automatically construct scholarly databases such as Google Scholar or Semantic Scholar. Citation field extraction (CFE) is precisely this task---given a reference label which tokens refer to the authors, venue, title, editor, journal, pages, etc. Most methods for CFE are supervised and rely on training from labeled datasets that are quite small compared to the great variety of reference formats. BibTeX, the widely used reference management tool, provides a natural method to automatically generate and label training data for CFE. In this paper, we describe a technique for using BibTeX to generate, automatically, a large-scale 41M labeled strings), labeled dataset, that is four orders of magnitude larger than the current largest CFE dataset, namely the UMass Citation Field Extraction dataset [Anzaroot and McCallum, 2013]. We experimentally demonstrate how our dataset can be used to improve the performance of the UMass CFE using a RoBERTa-based [Liu et al., 2019] model. In comparison to previous SoTA, we achieve a 24.48% relative error reduction, achieving span level F1-scores of 96.3%.


title: Fast Subtrajectory Similarity Search in Road Networks under Weighted Edit Distance Constraints

abstract: In this paper, we address a similarity search problem for spatial trajectories in road networks. In particular, we focus on the subtrajectory similarity search problem, which involves finding in a database the subtrajectories similar to a query trajectory. A key feature of our approach is that we do not focus on a specific similarity function; instead, we consider weighted edit distance (WED), a class of similarity functions which allows user-defined cost functions and hence includes several important similarity functions such as EDR and ERP. We model trajectories as strings, and propose a generic solution which is able to deal with any similarity function belonging to the class of WED. By employing the filter-and-verify strategy, we introduce subsequence filtering to efficiently prunes trajectories and find candidates. In order to choose a proper subsequence to optimize the candidate number, we model the choice as a discrete optimization problem (NP-hard) and compute it using a 2-approximation algorithm. To verify candidates, we design bidirectional tries, with which the verification starts from promising positions and leverage the shared segments of trajectories and the sparsity of road networks for speed-up. Experiments are conducted on large datasets to demonstrate the effectiveness of WED and the efficiency of our method for various similarity functions under WED.


title: Average motion of emerging solar active region polarities II: Joy's law

abstract: The tilt of solar active regions described by Joy's law is essential for converting a toroidal field to a poloidal field in Babcock-Leighton dynamo models. In thin flux tube models the Coriolis force causes Joy's law, acting on east-west flows as they rise towards the surface. Our goal is to measure the evolution of the average tilt angle of hundreds of active regions as they emerge, so that we can constrain the origins of Joy's law. We measured the tilt angle of the primary bipoles in 153 emerging active regions in the Solar Dynamics Observatory Helioseismic Emerging Active Region survey. We used line-of-sight magnetic field measurements averaged over 6 hours to define the polarities and measure the tilt angle up to four days after emergence. We find that at the time of emergence the polarities are on average aligned east-west, and that neither the separation nor the tilt depends on latitude. We do find, however, that ARs at higher latitudes have a faster north-south separation speed than those closer to the equator at the emergence time. After emergence, the tilt angle increases and Joy's law is evident about two days later. The scatter in the tilt angle is independent of flux until about one day after emergence, when higher-flux regions have a smaller scatter in tilt angle than lower-flux regions. Our finding that active regions emerge with an east-west alignment is surprising since thin flux tube models predict that tilt angles of rising flux tubes are generated below the surface. Previously reported tilt angle relaxation of deeply anchored flux tubes can be largely explained by the change in east-west separation. We conclude that Joy's law is caused by an inherent north-south separation speed present when the flux first reaches the surface, and that the scatter in the tilt angle is consistent with buffeting of the polarities by supergranulation.


title: On the Conditional Expectation of Mean Shifted Gaussian Distributions

abstract: In this paper, we consider a property of univariate Gaussian distributions namely conditional expectation shift (or centroid shift). Specifically, we compare two Gaussian distributions in which they differ only in their means. Equivalently, we can view this situation as one of the distribution is shifted to the right. These two distributions are conditioned on the same event in which the realizations fall in the right interval or left interval. We show that if a Gaussian distribution is shifted to the right while the conditioning event remains the same then the conditional expectation is shifted to the right concurrently.


title: Wideband Collaborative Spectrum Sensing using Massive MIMO Decision Fusion

abstract: In this paper, in order to tackle major challenges of spectrum exploration \& allocation in Cognitive Radio (CR) networks, we apply the general framework of Decision Fusion (DF) to wideband collaborative spectrum sensing based on Orthogonal Frequency Division Multiplexing (OFDM) reporting. At the transmitter side, we employ OFDM without Cyclic Prefix (CP) in order to improve overall bandwidth efficiency of the reporting phase in networks with high user density. On the other hand, at the receiver side (of the reporting channel) we device the Time-Reversal Widely Linear (TR-WL), Time-Reversal Maximal Ratio Combining (TR-MRC) and modified TR-MRC (TR-mMRC) rules for DF. The DF Center (DFC) is assumed to be equipped with a large antenna array, serving a number of unauthorized users competing for the spectrum, thereby resulting in a ``virtual'' massive Multiple-Input Multiple-Output (MIMO) channel. The effectiveness of the proposed TR-based rules in combating ($a$) inter-symbol and ($b$) inter-carrier interference over conventional (non-TR) counterparts is then examined, as a function of the Signal-to-Interference-plus-Noise Ratio (SINR). Closed-form performance, in terms of system false-alarm and detection probabilities, is derived for the formulated fusion rules. Finally, the impact of large-scale channel effects on the proposed fusion rules is also investigated, via Monte-Carlo simulations.


title: Shock formation for the Burgers-Hilbert equation

abstract: We prove finite time blowup of the Burgers-Hilbert equation. We construct smooth initial data with finite $H^5$-norm such that the $L^\infty$-norm of the spacial derivative of the solution blows up. The blowup is an asymptotic self-similar shock at one single point with an explicitly computable blowup profile. The blowup profile is a cusp with H\"older $1/3$ continuity. The blowup time and location are described in terms of explicit ODEs. Our proof uses a transformation to modulated self-similar variables, the quantitative properties of the stable self-similar solution to the inviscid Burgers equation, an $L^2$-estimate in self-similar variables, and pointwise estimates for Hilbert transform and for transport equations.


title: A gaze driven fast-forward method for first-person videos

abstract: The growing data sharing and life-logging cultures are driving an unprecedented increase in the amount of unedited First-Person Videos. In this paper, we address the problem of accessing relevant information in First-Person Videos by creating an accelerated version of the input video and emphasizing the important moments to the recorder. Our method is based on an attention model driven by gaze and visual scene analysis that provides a semantic score of each frame of the input video. We performed several experimental evaluations on publicly available First-Person Videos datasets. The results show that our methodology can fast-forward videos emphasizing moments when the recorder visually interact with scene components while not including monotonous clips.


title: Predicting the time variation of radio emission from MHD simulations of a flaring T-Tauri star

abstract: We model the time dependent radio emission from a disk accretion event in a T-Tauri star using 3D, ideal magnetohydrodynamic simulations combined with a gyrosynchrotron emission and radiative transfer model. We predict for the first time, the multi-frequency (1$-$1000 GHz) intensity and circular polarisation from a flaring T-Tauri star. A flux tube, connecting the star with its circumstellar disk, is populated with a distribution of non-thermal electrons which is allowed to decay exponentially after a heating event in the disk and the system is allowed to evolve. The energy distribution of the electrons, as well as the non-thermal power law index and loss rate, are varied to see their effect on the overall flux. Spectra are generated from different lines of sight, giving different views of the flux tube and disk. The peak flux typically occurs around 20$-$30 GHz and the radio luminosity is consistent with that observed from T-Tauri stars. For all simulations, the peak flux is found to decrease and move to lower frequencies with elapsing time. The frequency-dependent circular polarisation can reach 10$-$30$\%$ but has a complex structure which evolves as the flare evolves. Our models show that observations of the evolution of the spectrum and its polarisation can provide important constraints on physical properties of the flaring environment and associated accretion event.


title: Fundamental solutions of the Dirac operator in the Friedmann-Lema\^itre-Robertson-Walker spacetime

abstract: The equation of the spin-$\frac{1}{2}$ particles in the Friedmann-Lema\^itre-Robertson-Walker spacetime is investigated. The retarded and advanced fundamental solutions to the Dirac operator and generalized Dirac operator as well as the fundamental solutions to the Cauchy problem are written in explicit form via the fundamental solution of the wave equation in the Minkowski spacetime.


title: Time-Resolved fMRI Shared Response Model using Gaussian Process Factor Analysis

abstract: Multi-subject fMRI studies are challenging due to the high variability of both brain anatomy and functional brain topographies across participants. An effective way of aggregating multi-subject fMRI data is to extract a shared representation that filters out unwanted variability among subjects. Some recent work has implemented probabilistic models to extract a shared representation in task fMRI. In the present work, we improve upon these models by incorporating temporal information in the common latent structures. We introduce a new model, Shared Gaussian Process Factor Analysis (S-GPFA), that discovers shared latent trajectories and subject-specific functional topographies, while modelling temporal correlation in fMRI data. We demonstrate the efficacy of our model in revealing ground truth latent structures using simulated data, and replicate experimental performance of time-segment matching and inter-subject similarity on the publicly available Raider and Sherlock datasets. We further test the utility of our model by analyzing its learned model parameters in the large multi-site SPINS dataset, on a social cognition task from participants with and without schizophrenia.


title: Global Data Science Project for COVID-19

abstract: This paper aims at providing the summary of the Global Data Science Project (GDSC) for COVID-19. as on May 31 2020. COVID-19 has largely impacted on our societies through both direct and indirect effects transmitted by the policy measures to counter the spread of viruses. We quantitatively analysed the multifaceted impacts of the COVID-19 pandemic on our societies including people's mobility, health, and social behaviour changes. People's mobility has changed significantly due to the implementation of travel restriction and quarantine measurements. Indeed, the physical distance has widened at international (cross-border), national and regional level. At international level, due to the travel restrictions, the number of international flights has plunged overall at around 88 percent during March. In particular, the number of flights connecting Europe dropped drastically in mid of March after the United States announced travel restrictions to Europe and the EU and participating countries agreed to close borders, at 84 percent decline compared to March 10th. Similarly, we examined the impacts of quarantine measures in the major city: Tokyo (Japan), New York City (the United States), and Barcelona (Spain). Within all three cities, we found the significant decline in traffic volume. We also identified the increased concern for mental health through the analysis of posts on social networking services such as Twitter and Instagram. Notably, in the beginning of April 2020, the number of post with #depression on Instagram doubled, which might reflect the rise in mental health awareness among Instagram users. Besides, we identified the changes in a wide range of people's social behaviors, as well as economic impacts through the analysis of Instagram data and primary survey data.


title: Multi-Agent Reinforcement Learning in a Realistic Limit Order Book Market Simulation

abstract: Optimal order execution is widely studied by industry practitioners and academic researchers because it determines the profitability of investment decisions and high-level trading strategies, particularly those involving large volumes of orders. However, complex and unknown market dynamics pose significant challenges for the development and validation of optimal execution strategies. In this paper, we propose a model-free approach by training Reinforcement Learning (RL) agents in a realistic market simulation environment with multiple agents. First, we configure a multi-agent historical order book simulation environment for execution tasks built on an Agent-Based Interactive Discrete Event Simulation (ABIDES) [arXiv:1904.12066]. Second, we formulate the problem of optimal execution in an RL setting where an intelligent agent can make order execution and placement decisions based on market microstructure trading signals in High Frequency Trading (HFT). Third, we develop and train an RL execution agent using the Double Deep Q-Learning (DDQL) algorithm in the ABIDES environment. In some scenarios, our RL agent converges towards a Time-Weighted Average Price (TWAP) strategy. Finally, we evaluate the simulation with our RL agent by comparing it with a market replay simulation using real market Limit Order Book (LOB) data.


title: Deep Learning-based Aerial Image Segmentation with Open Data for Disaster Impact Assessment

abstract: Satellite images are an extremely valuable resource in the aftermath of natural disasters such as hurricanes and tsunamis where they can be used for risk assessment and disaster management. In order to provide timely and actionable information for disaster response, in this paper a framework utilising segmentation neural networks is proposed to identify impacted areas and accessible roads in post-disaster scenarios. The effectiveness of pretraining with ImageNet on the task of aerial image segmentation has been analysed and performances of popular segmentation models compared. Experimental results show that pretraining on ImageNet usually improves the segmentation performance for a number of models. Open data available from OpenStreetMap (OSM) is used for training, forgoing the need for time-consuming manual annotation. The method also makes use of graph theory to update road network data available from OSM and to detect the changes caused by a natural disaster. Extensive experiments on data from the 2018 tsunami that struck Palu, Indonesia show the effectiveness of the proposed framework. ENetSeparable, with 30% fewer parameters compared to ENet, achieved comparable segmentation results to that of the state-of-the-art networks.


title: Self-supervised Learning from a Multi-view Perspective

abstract: As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning. Many proposed approaches for self-supervised learning follow naturally a multi-view perspective, where the input (e.g., original images) and the self-supervised signals (e.g., augmented images) can be seen as two redundant views of the data. Building from this multi-view perspective, this paper provides an information-theoretical framework to better understand the properties that encourage successful self-supervised learning. Specifically, we demonstrate that self-supervised learned representations can extract task-relevant information and discard task-irrelevant information. Our theoretical framework paves the way to a larger space of self-supervised learning objective design. In particular, we propose a composite objective that bridges the gap between prior contrastive and predictive learning objectives, and introduce an additional objective term to discard task-irrelevant information. To verify our analysis, we conduct controlled experiments to evaluate the impact of the composite objectives. We also explore our framework's empirical generalization beyond the multi-view perspective, where the cross-view redundancy may not be clearly observed.


title: Backward Reachability Approach to State-Constrained Stochastic Optimal Control Problems for Jump Diffusion Systems

abstract: In this paper, we consider the stochastic optimal control problem for jump diffusion systems with state constraints. In general, the value function of such problems is a discontinuous viscosity solution of the Hamilton-Jacobi-Bellman (HJB) equation, since the regularity cannot be guaranteed at the boundary of the state constraint. By adapting approaches of \cite{Bokanowski_SICON_2016} and the stochastic target theory, we obtain an equivalent representation of the original value function as the backward reachable set. We then show that this backward reachable can be characterized by the zero-level set of the auxiliary value function for the unconstrained stochastic control problem, which includes two additional unbounded controls as a consequence of the martingale representation theorem. We prove that the auxiliary value function is a unique continuous viscosity solution of the associated HJB equation, which is the second-order nonlinear integro-partial differential equation (IPDE). Our paper provides an explicit way to characterize the original (possibly discontinuous) value function as a zero-level set of the continuous solution of the auxiliary HJB equation. The proof of the existence and uniqueness requires a new technique due to the unbounded control sets, and the presence of the singularity of the corresponding L\'evy measure in the nonlocal operator of the HJB equation.


title: Hunting gravitational wave black holes with microlensing

abstract: Gravitational microlensing is a powerful tool to search for a population of invisible black holes (BHs) in the Milky Way (MW), including isolated BHs and binary BHs at wide orbits that are complementary to gravitational wave observations. By monitoring highly populated regions of source stars like the MW bulge region, one can pursue microlensing events due to these BHs. We find that if BHs have a Salpeter-like mass function extended beyond $30M_\odot$ and a similar velocity and spatial structure to stars in the Galactic bulge and disk regions, the BH population is a dominant source of the microlensing events at long timescales of the microlensing light curve $\gtrsim 100~$days. This is due to a boosted sensitivity of the microlensing event rate to lens mass, given as $M^2$, for such long-timescale events. A monitoring observation of $2 \times 10^{10}$ stars in the bulge region over 10 years with the Rubin Observatory Legacy Survey of Space and Time (LSST) would enable one to find about $6\times 10^5$ BH microlensing events. We evaluate the efficiency of potential LSST cadences for characterizing the light curves of BH microlensing and find that nearly all events of long timescales can be detected.


title: Deep reinforcement learning for optical systems: A case study of mode-locked lasers

abstract: We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and reinforcement learning to produce robust and stable learning for control. Deep RL is ideally suited for optical systems as the tuning and control relies on interactions with its environment with a goal-oriented objective to achieve optimal immediate or delayed rewards. This allows the optical system to recognize bi-stable structures and navigate, via trajectory planning, to optimally performing solutions, the first such algorithm demonstrated to do so in optical systems. We specifically demonstrate the deep RL architecture on a mode-locked laser, where robust self-tuning and control can be established through access of the deep RL agent to its waveplates and polarizers. We further integrate transfer learning to help the deep RL agent rapidly learn new parameter regimes and generalize its control authority. Additionally, the deep RL learning can be easily integrated with other control paradigms to provide a broad framework to control any optical system.


title: Syn2Real Transfer Learning for Image Deraining using Gaussian Processes

abstract: Recent CNN-based methods for image deraining have achieved excellent performance in terms of reconstruction error as well as visual quality. However, these methods are limited in the sense that they can be trained only on fully labeled data. Due to various challenges in obtaining real world fully-labeled image deraining datasets, existing methods are trained only on synthetically generated data and hence, generalize poorly to real-world images. The use of real-world data in training image deraining networks is relatively less explored in the literature. We propose a Gaussian Process-based semi-supervised learning framework which enables the network in learning to derain using synthetic dataset while generalizing better using unlabeled real-world images. Through extensive experiments and ablations on several challenging datasets (such as Rain800, Rain200H and DDN-SIRR), we show that the proposed method, when trained on limited labeled data, achieves on-par performance with fully-labeled training. Additionally, we demonstrate that using unlabeled real-world images in the proposed GP-based framework results in superior performance as compared to existing methods. Code is available at: https://github.com/rajeevyasarla/Syn2Real


title: Semiparametric Bayesian Inference for the Transmission Dynamics of COVID-19 with a State-Space Model

abstract: The outbreak of Coronavirus Disease 2019 (COVID-19) is an ongoing pandemic affecting over 200 countries and regions. Inference about the transmission dynamics of COVID-19 can provide important insights into the speed of disease spread and the effects of mitigation policies. We develop a novel Bayesian approach to such inference based on a probabilistic compartmental model using data of daily confirmed COVID-19 cases. In particular, we consider a probabilistic extension of the classical susceptible-infectious-recovered model, which takes into account undocumented infections and allows the epidemiological parameters to vary over time. We estimate the disease transmission rate via a Gaussian process prior, which captures nonlinear changes over time without the need of specific parametric assumptions. We utilize a parallel-tempering Markov chain Monte Carlo algorithm to efficiently sample from the highly correlated posterior space. Predictions for future observations are done by sampling from their posterior predictive distributions. Performance of the proposed approach is assessed using simulated datasets. Finally, our approach is applied to COVID-19 data from four states of the United States: Washington, New York, California, and Illinois. An R package BaySIR is made available at https://github.com/tianjianzhou/BaySIR for the public to conduct independent analysis or reproduce the results in this paper.


title: Contrastive Multi-View Representation Learning on Graphs

abstract: We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or contrasting multi-scale encodings do not improve performance, and the best performance is achieved by contrasting encodings from first-order neighbors and a graph diffusion. We achieve new state-of-the-art results in self-supervised learning on 8 out of 8 node and graph classification benchmarks under the linear evaluation protocol. For example, on Cora (node) and Reddit-Binary (graph) classification benchmarks, we achieve 86.8% and 84.5% accuracy, which are 5.5% and 2.4% relative improvements over previous state-of-the-art. When compared to supervised baselines, our approach outperforms them in 4 out of 8 benchmarks. Source code is released at: https://github.com/kavehhassani/mvgrl


title: Variational Optimization for the Submodular Maximum Coverage Problem

abstract: We examine the \emph{submodular maximum coverage problem} (SMCP), which is related to a wide range of applications. We provide the first variational approximation for this problem based on the Nemhauser divergence, and show that it can be solved efficiently using variational optimization. The algorithm alternates between two steps: (1) an E step that estimates a variational parameter to maximize a parameterized \emph{modular} lower bound; and (2) an M step that updates the solution by solving the local approximate problem. We provide theoretical analysis on the performance of the proposed approach and its curvature-dependent approximate factor, and empirically evaluate it on a number of public data sets and several application tasks.


title: Exploring Quality and Generalizability in Parameterized Neural Audio Effects

abstract: Deep neural networks have shown promise for music audio signal processing applications, often surpassing prior approaches, particularly as end-to-end models in the waveform domain. Yet results to date have tended to be constrained by low sample rates, noise, narrow domains of signal types, and/or lack of parameterized controls (i.e. "knobs"), making their suitability for professional audio engineering workflows still lacking. This work expands on prior research published on modeling nonlinear time-dependent signal processing effects associated with music production by means of a deep neural network, one which includes the ability to emulate the parameterized settings you would see on an analog piece of equipment, with the goal of eventually producing commercially viable, high quality audio, i.e. 44.1 kHz sampling rate at 16-bit resolution. The results in this paper highlight progress in modeling these effects through architecture and optimization changes, towards increasing computational efficiency, lowering signal-to-noise ratio, and extending to a larger variety of nonlinear audio effects. Toward these ends, the strategies employed involved a three-pronged approach: model speed, model accuracy, and model generalizability. Most of the presented methods provide marginal or no increase in output accuracy over the original model, with the exception of dataset manipulation. We found that limiting the audio content of the dataset, for example using datasets of just a single instrument, provided a significant improvement in model accuracy over models trained on more general datasets.


title: A simple virtual element-based flux recovery on quadtree

abstract: In this paper, we introduce a simple local flux recovery for $\mathcal{Q}_k$ finite element of a scalar coefficient diffusion equation on quadtree meshes, with no restriction on the irregularities of hanging nodes. The construction requires no specific ad hoc tweaking for hanging nodes on $l$-irregular ($l\geq 2$) meshes thanks to the adoption of virtual element families. The rectangular elements with hanging nodes are treated as polygons as in the flux recovery context. An efficient a posteriori error estimator is then constructed based on the recovered flux, and its reliability is proved under common assumptions, both of which are further verified in numerics.


title: Dual-level Semantic Transfer Deep Hashing for Efficient Social Image Retrieval

abstract: Social network stores and disseminates a tremendous amount of user shared images. Deep hashing is an efficient indexing technique to support large-scale social image retrieval, due to its deep representation capability, fast retrieval speed and low storage cost. Particularly, unsupervised deep hashing has well scalability as it does not require any manually labelled data for training. However, owing to the lacking of label guidance, existing methods suffer from severe semantic shortage when optimizing a large amount of deep neural network parameters. Differently, in this paper, we propose a Dual-level Semantic Transfer Deep Hashing (DSTDH) method to alleviate this problem with a unified deep hash learning framework. Our model targets at learning the semantically enhanced deep hash codes by specially exploiting the user-generated tags associated with the social images. Specifically, we design a complementary dual-level semantic transfer mechanism to efficiently discover the potential semantics of tags and seamlessly transfer them into binary hash codes. On the one hand, instance-level semantics are directly preserved into hash codes from the associated tags with adverse noise removing. Besides, an image-concept hypergraph is constructed for indirectly transferring the latent high-order semantic correlations of images and tags into hash codes. Moreover, the hash codes are obtained simultaneously with the deep representation learning by the discrete hash optimization strategy. Extensive experiments on two public social image retrieval datasets validate the superior performance of our method compared with state-of-the-art hashing methods. The source codes of our method can be obtained at https://github.com/research2020-1/DSTDH


title: Sequential Density Ratio Estimation for Simultaneous Optimization of Speed and Accuracy

abstract: Classifying sequential data as early and as accurately as possible is a challenging yet critical problem, especially when a sampling cost is high. One algorithm that achieves this goal is the sequential probability ratio test (SPRT), which is known as Bayes-optimal: it can keep the expected number of data samples as small as possible, given the desired error upper-bound. However, the original SPRT makes two critical assumptions that limit its application in real-world scenarios: (i) samples are independently and identically distributed, and (ii) the likelihood of the data being derived from each class can be calculated precisely. Here, we propose the SPRT-TANDEM, a deep neural network-based SPRT algorithm that overcomes the above two obstacles. The SPRT-TANDEM sequentially estimates the log-likelihood ratio of two alternative hypotheses by leveraging a novel Loss function for Log-Likelihood Ratio estimation (LLLR) while allowing correlations up to $N (\in \mathbb{N})$ preceding samples. In tests on one original and two public video databases, Nosaic MNIST, UCF101, and SiW, the SPRT-TANDEM achieves statistically significantly better classification accuracy than other baseline classifiers, with a smaller number of data samples. The code and Nosaic MNIST are publicly available at https://github.com/TaikiMiyagawa/SPRT-TANDEM.


title: Inclusive charged and neutral particle multiplicity distributions in $\chi_{cJ}$ and $J/\psi$ decays

abstract: Using a sample of 106 million $\psi(3686)$ decays, $\psi(3686) \to \gamma \chi_{cJ} (J = 0, 1, 2)$ and $\psi(3686) \to \gamma \chi_{cJ}, \chi_{cJ} \to \gamma J/\psi$ $(J = 1, 2)$ events are utilized to study inclusive $\chi_{cJ} \to$ anything, $\chi_{cJ} \to$ hadrons, and $J/\psi \to$ anything distributions, including distributions of the number of charged tracks, electromagnetic calorimeter showers, and $\pi^0$s, and to compare them with distributions obtained from the BESIII Monte Carlo simulation. Information from each Monte Carlo simulated decay event is used to construct matrices connecting the detected distributions to the input predetection "produced" distributions. Assuming these matrices also apply to data, they are used to predict the analogous produced distributions of the decay events. Using these, the charged particle multiplicities are compared with results from MARK I. Further, comparison of the distributions of the number of photons in data with those in Monte Carlo simulation indicates that G-parity conservation should be taken into consideration in the simulation.


title: CNN-Based Semantic Change Detection in Satellite Imagery

abstract: Timely disaster risk management requires accurate road maps and prompt damage assessment. Currently, this is done by volunteers manually marking satellite imagery of affected areas but this process is slow and often error-prone. Segmentation algorithms can be applied to satellite images to detect road networks. However, existing methods are unsuitable for disaster-struck areas as they make assumptions about the road network topology which may no longer be valid in these scenarios. Herein, we propose a CNN-based framework for identifying accessible roads in post-disaster imagery by detecting changes from pre-disaster imagery. Graph theory is combined with the CNN output for detecting semantic changes in road networks with OpenStreetMap data. Our results are validated with data of a tsunami-affected region in Palu, Indonesia acquired from DigitalGlobe.


title: Predictions of microstructure and stress in planar extensional flows of a dense viscous suspension

abstract: We consider extensional flows of a dense layer of spheres in a viscous fluid and employ force and torque balances to determine the trajectory of particle pairs that contribute to the stress. In doing this, we use Stokesian dynamics simulations to guide the choice of the near-contacting pairs that follow such a trajectory. We specify the boundary conditions on the representative trajectory, and determine the distribution of particles along it and how the stress depends on the microstructure and strain rate. We test the resulting predictions using the numerical simulations. Also, we show that the relation between the tensors of stress and strain rate involves the second and fourth moments of the particle distribution function.


title: Adaptive Experimental Design with Temporal Interference: A Maximum Likelihood Approach

abstract: Suppose an online platform wants to compare a treatment and control policy, e.g., two different matching algorithms in a ridesharing system, or two different inventory management algorithms in an online retail site. Standard randomized controlled trials are typically not feasible, since the goal is to estimate policy performance on the entire system. Instead, the typical current practice involves dynamically alternating between the two policies for fixed lengths of time, and comparing the average performance of each over the intervals in which they were run as an estimate of the treatment effect. However, this approach suffers from *temporal interference*: one algorithm alters the state of the system as seen by the second algorithm, biasing estimates of the treatment effect. Further, the simple non-adaptive nature of such designs implies they are not sample efficient. We develop a benchmark theoretical model in which to study optimal experimental design for this setting. We view testing the two policies as the problem of estimating the steady state difference in reward between two unknown Markov chains (i.e., policies). We assume estimation of the steady state reward for each chain proceeds via nonparametric maximum likelihood, and search for consistent (i.e., asymptotically unbiased) experimental designs that are efficient (i.e., asymptotically minimum variance). Characterizing such designs is equivalent to a Markov decision problem with a minimum variance objective; such problems generally do not admit tractable solutions. Remarkably, in our setting, using a novel application of classical martingale analysis of Markov chains via Poisson's equation, we characterize efficient designs via a succinct convex optimization problem. We use this characterization to propose a consistent, efficient online experimental design that adaptively samples the two Markov chains.


title: Node Embeddings and Exact Low-Rank Representations of Complex Networks

abstract: Low-dimensional embeddings, from classical spectral embeddings to modern neural-net-inspired methods, are a cornerstone in the modeling and analysis of complex networks. Recent work by Seshadhri et al. (PNAS 2020) suggests that such embeddings cannot capture local structure arising in complex networks. In particular, they show that any network generated from a natural low-dimensional model cannot be both sparse and have high triangle density (high clustering coefficient), two hallmark properties of many real-world networks. In this work we show that the results of Seshadhri et al. are intimately connected to the model they use rather than the low-dimensional structure of complex networks. Specifically, we prove that a minor relaxation of their model can generate sparse graphs with high triangle density. Surprisingly, we show that this same model leads to exact low-dimensional factorizations of many real-world networks. We give a simple algorithm based on logistic principal component analysis (LPCA) that succeeds in finding such exact embeddings. Finally, we perform a large number of experiments that verify the ability of very low-dimensional embeddings to capture local structure in real-world networks.


title: Critical Theory for the Breakdown of Photon Blockade

abstract: Photon blockade is the result of the interplay between the quantized nature of light and strong optical nonlinearities, whereby strong photon-photon repulsion prevents a quantum optical system from absorbing multiple photons. We theoretically study a single atom coupled to the light field, described by the resonantly driven Jaynes--Cummings model, in which case the photon blockade breaks down in a second order phase transition at a critical drive strength. We show that this transition is associated to the spontaneous breaking of an anti-unitary PT-symmetry. Within a semiclassical approximation we calculate the expectation values of observables in the steady state. We then move beyond the semiclassical approximation and approach the critical point from the disordered (blockaded) phase by reducing the Lindblad quantum master equation to a classical rate equation that we solve. The width of the steady-state distribution in Fock space is found to diverge as we approach the critical point with a simple power-law, allowing us to calculate the critical scaling of steady state observables without invoking mean-field theory. We propose a simple physical toy model for biased diffusion in the space of occupation numbers, which captures the universal properties of the steady state. We list several experimental platforms where this phenomenon may be observed.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech physics.atom-ph


title: Adversarial Attacks on Brain-Inspired Hyperdimensional Computing-Based Classifiers

abstract: Being an emerging class of in-memory computing architecture, brain-inspired hyperdimensional computing (HDC) mimics brain cognition and leverages random hypervectors (i.e., vectors with a dimensionality of thousands or even more) to represent features and to perform classification tasks. The unique hypervector representation enables HDC classifiers to exhibit high energy efficiency, low inference latency and strong robustness against hardware-induced bit errors. Consequently, they have been increasingly recognized as an appealing alternative to or even replacement of traditional deep neural networks (DNNs) for local on device classification, especially on low-power Internet of Things devices. Nonetheless, unlike their DNN counterparts, state-of-the-art designs for HDC classifiers are mostly security-oblivious, casting doubt on their safety and immunity to adversarial inputs. In this paper, we study for the first time adversarial attacks on HDC classifiers and highlight that HDC classifiers can be vulnerable to even minimally-perturbed adversarial samples. Concretely, using handwritten digit classification as an example, we construct a HDC classifier and formulate a grey-box attack problem, where an attacker's goal is to mislead the target HDC classifier to produce erroneous prediction labels while keeping the amount of added perturbation noise as little as possible. Then, we propose a modified genetic algorithm to generate adversarial samples within a reasonably small number of queries. Our results show that adversarial images generated by our algorithm can successfully mislead the HDC classifier to produce wrong prediction labels with a high probability (i.e., 78% when the HDC classifier uses a fixed majority rule for decision). Finally, we also present two defense strategies -- adversarial training and retraining-- to strengthen the security of HDC classifiers.


title: Fitted Q-Learning for Relational Domains

abstract: We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be performed using a gradient-boosting technique. Our proposed framework performs reasonably well on standard domains without using domain models and using fewer training trajectories.


title: Speaker Diarization: Using Recurrent Neural Networks

abstract: Speaker Diarization is the problem of separating speakers in an audio. There could be any number of speakers and final result should state when speaker starts and ends. In this project, we analyze given audio file with 2 channels and 2 speakers (on separate channel). We train Neural Network for learning when a person is speaking. We use different type of Neural Networks specifically, Single Layer Perceptron (SLP), Multi Layer Perceptron (MLP), Recurrent Neural Network (RNN) and Convolution Neural Network (CNN) we achieve $\sim$92\% of accuracy with RNN. The code for this project is available at https://github.com/vishalshar/SpeakerDiarization_RNN_CNN_LSTM


title: Condensing Two-stage Detection with Automatic Object Key Part Discovery

abstract: Modern two-stage object detectors generally require excessively large models for their detection heads to achieve high accuracy. To address this problem, we propose that the model parameters of two-stage detection heads can be condensed and reduced by concentrating on object key parts. To this end, we first introduce an automatic object key part discovery task to make neural networks discover representative sub-parts in each foreground object. With these discovered key parts, we then decompose the object appearance modeling into a key part modeling process and a global modeling process for detection. Key part modeling encodes fine and detailed features from the discovered key parts, and global modeling encodes rough and holistic object characteristics. In practice, such decomposition allows us to significantly abridge model parameters without sacrificing much detection accuracy. Experiments on popular datasets illustrate that our proposed technique consistently maintains original performance while waiving around 50% of the model parameters of common two-stage detection heads, with the performance only deteriorating by 1.5% when waiving around 96% of the original model parameters. Codes are released on: https://github.com/zhechen/Condensing2stageDetection.


title: Max-Min Optimal Beamforming for Cell-Free Massive MIMO

abstract: This letter develops an optimum beamforming method for downlink transmissions in cell-free massive multiple-input multiple-output (MIMO) systems, which employ a massive number of distributed access points to provide concurrent services to multiple users. The optimum design is formulated as a max-min problem that maximizes the minimum signal-to-interference-plus-noise ratio of all users. It is shown analytically that the problem is quasi-concave, and the optimum solution is obtained with the second-order cone programming. The proposed method identifies the best achievable beamforming performance in cell-free massive MIMO systems. The results can be used as benchmarks for the design of practical low complexity beamformers.


title: Integrated Replay Spoofing-aware Text-independent Speaker Verification

abstract: A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for building an integrated system of speaker verification and presentation attack detection: an end-to-end monolithic approach and a back-end modular approach. The first approach simultaneously trains speaker identification, presentation attack detection, and the integrated system using multi-task learning using a common feature. However, through experiments, we hypothesize that the information required for performing speaker verification and presentation attack detection might differ because speaker verification systems try to remove device-specific information from speaker embeddings, while presentation attack detection systems exploit such information. Therefore, we propose a back-end modular approach using a separate deep neural network (DNN) for speaker verification and presentation attack detection. This approach has thee input components: two speaker embeddings (for enrollment and test each) and prediction of presentation attacks. Experiments are conducted using the ASVspoof 2017-v2 dataset, which includes official trials on the integration of speaker verification and presentation attack detection. The proposed back-end approach demonstrates a relative improvement of 21.77% in terms of the equal error rate for integrated trials compared to a conventional speaker verification system.


title: Checking marking reachability with the state equation in Petri net subclasses

abstract: Although decidable, the marking reachability problem for Petri nets is well-known to be intractable in general, and a non-elementary lower bound has been recently uncovered. In order to alleviate this difficulty, various structural and behavioral restrictions have been considered, allowing to relate reachability to properties that are easier to check. For a given initial marking, the set of potentially reachable markings is described by the state equation solutions and over-approximates the set of reachable markings. In this paper, we delineate several subclasses of weighted Petri nets in which the set of reachable markings equals the set of potentially reachable ones, a property we call the PR-R equality. When fulfilled, this property allows to use linear algebra to answer the reachability questions, avoiding a brute-force analysis of the state space. Notably, we provide conditions under which this equality holds in classes much more expressive than marked graphs, adding places with several ingoing and outgoing transitions, which allows to model real applications with shared buffers. To achieve it, we investigate the relationship between liveness, reversibility, boundedness and potential reachability in Petri nets. We also show that this equality does not hold in classes with close modeling capability when the conditions are relaxed.


title: Robust Estimation of Tree Structured Ising Models

abstract: We consider the task of learning Ising models when the signs of different random variables are flipped independently with possibly unequal, unknown probabilities. In this paper, we focus on the problem of robust estimation of tree-structured Ising models. Without any additional assumption of side information, this is an open problem. We first prove that this problem is unidentifiable, however, this unidentifiability is limited to a small equivalence class of trees formed by leaf nodes exchanging positions with their neighbors. Next, we propose an algorithm to solve the above problem with logarithmic sample complexity in the number of nodes and polynomial run-time complexity. Lastly, we empirically demonstrate that, as expected, existing algorithms are not inherently robust in the proposed setting whereas our algorithm correctly recovers the underlying equivalence class.


title: Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis

abstract: Multi-source unsupervised domain adaptation (MS-UDA) for sentiment analysis (SA) aims to leverage useful information in multiple source domains to help do SA in an unlabeled target domain that has no supervised information. Existing algorithms of MS-UDA either only exploit the shared features, i.e., the domain-invariant information, or based on some weak assumption in NLP, e.g., smoothness assumption. To avoid these problems, we propose two transfer learning frameworks based on the multi-source domain adaptation methodology for SA by combining the source hypotheses to derive a good target hypothesis. The key feature of the first framework is a novel Weighting Scheme based Unsupervised Domain Adaptation framework (WS-UDA), which combine the source classifiers to acquire pseudo labels for target instances directly. While the second framework is a Two-Stage Training based Unsupervised Domain Adaptation framework (2ST-UDA), which further exploits these pseudo labels to train a target private extractor. Importantly, the weights assigned to each source classifier are based on the relations between target instances and source domains, which measured by a discriminator through the adversarial training. Furthermore, through the same discriminator, we also fulfill the separation of shared features and private features. Experimental results on two SA datasets demonstrate the promising performance of our frameworks, which outperforms unsupervised state-of-the-art competitors.


title: Using an expert deviation carrying the knowledge of climate data in usual clustering algorithms

abstract: In order to help physicists to expand their knowledge of the climate in the Lesser Antilles, we aim to identify the spatio-temporal configurations using clustering analysis on wind speed and cumulative rainfall datasets. But we show that using the L2 norm in conventional clustering methods as K-Means (KMS) and Hierarchical Agglomerative Clustering (HAC) can induce undesirable effects. So, we propose to replace Euclidean distance (L2) by a dissimilarity measure named Expert Deviation (ED). Based on the symmetrized Kullback-Leibler divergence, the ED integrates the properties of the observed physical parameters and climate knowledge. This measure helps comparing histograms of four patches, corresponding to geographical zones, that are influenced by atmospheric structures. The combined evaluation of the internal homogeneity and the separation of the clusters obtained using ED and L2 was performed. The results, which are compared using the silhouette index, show five clusters with high indexes. For the two available datasets one can see that, unlike KMS-L2, KMS-ED discriminates the daily situations favorably, giving more physical meaning to the clusters discovered by the algorithm. The effect of patches is observed in the spatial analysis of representative elements for KMS-ED. The ED is able to produce different configurations which makes the usual atmospheric structures clearly identifiable. Atmospheric physicists can interpret the locations of the impact of each cluster on a specific zone according to atmospheric structures. KMS-L2 does not lead to such an interpretability, because the situations represented are spatially quite smooth. This climatological study illustrates the advantage of using ED as a new approach.


title: Machine Learning and Control Theory

abstract: We survey in this article the connections between Machine Learning and Control Theory. Control Theory provide useful concepts and tools for Machine Learning. Conversely Machine Learning can be used to solve large control problems. In the first part of the paper, we develop the connections between reinforcement learning and Markov Decision Processes, which are discrete time control problems. In the second part, we review the concept of supervised learning and the relation with static optimization. Deep learning which extends supervised learning, can be viewed as a control problem. In the third part, we present the links between stochastic gradient descent and mean-field theory. Conversely, in the fourth and fifth parts, we review machine learning approaches to stochastic control problems, and focus on the deterministic case, to explain, more easily, the numerical algorithms.


title: The Tianlai Cylinder Pathfinder Array: System Functions and Basic Performance Analysis

abstract: The Tianlai Cylinder Pathfinder is a radio interferometer array designed to test techniques for 21 cm intensity mapping in the post-reionization Universe, with the ultimate aim of mapping the large scale structure and measuring cosmological parameters such as the dark energy equation of state. Each of its three parallel cylinder reflectors is oriented in the north-south direction, and the array has a large field of view. As the Earth rotates, the northern sky is observed by drift scanning. The array is located in Hongliuxia, a radio-quiet site in Xinjiang, and saw its first light in September 2016. In this first data analysis paper for the Tianlai cylinder array, we discuss the sub-system qualification tests, and present basic system performance obtained from preliminary analysis of the commissioning observations during 2016-2018. We show typical interferometric visibility data, from which we derive the actual beam profile in the east-west direction and the frequency band-pass response. We describe also the calibration process to determine the complex gains for the array elements, either using bright astronomical point sources, or an artificial on site calibrator source, and discuss the instrument response stability, crucial for transit interferometry. Based on this analysis, we find a system temperature of about 90 K, and we also estimate the sensitivity of the array.


title: Simultaneously Learning Stochastic and Adversarial Episodic MDPs with Known Transition

abstract: This work studies the problem of learning episodic Markov Decision Processes with known transition and bandit feedback. We develop the first algorithm with a ``best-of-both-worlds'' guarantee: it achieves $\mathcal{O}(log T)$ regret when the losses are stochastic, and simultaneously enjoys worst-case robustness with $\tilde{\mathcal{O}}(\sqrt{T})$ regret even when the losses are adversarial, where $T$ is the number of episodes. More generally, it achieves $\tilde{\mathcal{O}}(\sqrt{C})$ regret in an intermediate setting where the losses are corrupted by a total amount of $C$. Our algorithm is based on the Follow-the-Regularized-Leader method from Zimin and Neu (2013), with a novel hybrid regularizer inspired by recent works of Zimmert et al. (2019a, 2019b) for the special case of multi-armed bandits. Crucially, our regularizer admits a non-diagonal Hessian with a highly complicated inverse. Analyzing such a regularizer and deriving a particular self-bounding regret guarantee is our key technical contribution and might be of independent interest.


title: Kings and Kernels in Semicomplete Compositions

abstract: Let $k$ be an integer with $k\geq 2$. A $k$-king in a digraph $D$ is a vertex which can reach every other vertex by a directed path of length at most $k$ and a non-king is a vertex which is not a 3-king. A subset $K$ is $k$-independent if for every pair of vertices $x,y \in K$, we have $d_D(x, y), d_D(y, x)\geq k$; it is $\ell$-absorbent if for every $x\in V(D)\setminus K$ there exists $y\in K$ such that $d_D(x, y)\leq \ell$. A $k$-kernel of $D$ is a $k$-independent and $(k-1)$-absorbent subset of $V(D)$. A kernel is a 2-kernel. A set $K\subseteq V(D)$ is a quasi-kernel of $D$ if it is independent, and for every vertex $x\in V(D)\setminus K$, there exists $y\in K$ such that $d_D(x, y)\leq 2$. The problem {\sc $k$-Kernel} is determining whether a given digraph has a $k$-kernel. Let $Q=T[H_1, \dots, H_t]$ be the composition of $T$ and $H_i$ ($1\leq i\leq t, t\ge 2$), where $T$ is a digraph with $t$ vertices, and $H_1, \dots, H_t$ are pairwise disjoint digraphs. The composition $Q=T[H_1, \dots, H_t]$ is a semicomplete composition if $T$ is semicomplete. In this paper, we study kings and kernels in semicomplete compositions. For the topic of kings, we characterize digraph compositions with a $k$-king and digraph compositions all of whose vertices are $k$-kings, respectively. We also discuss the existence of 3-kings, and study the minimum number of 4-kings in a strong semicomplete composition. For the topic of kernels, we first study the existence of a pair of disjoint quasi-kernels in semicomplete compositions. We then deduce that the problem {\sc $k$-Kernel} restricted to strong semicomplete compositions is NP-complete when $k\in \{2,3\}$, and is polynomial-time solvable when $k\geq 4$. We also prove that when $k$ is divisible by 2 or 3, the problem {\sc $k$-Kernel} restricted to non-strong semicomplete compositions is NP-complete.


title: Simultaneous Decision Making for Stochastic Multi-echelon Inventory Optimization with Deep Neural Networks as Decision Makers

abstract: We propose a framework that uses deep neural networks (DNN) to optimize inventory decisions in complex multi-echelon supply chains. We first introduce pairwise modeling of general stochastic multi-echelon inventory optimization (SMEIO). Then, we present a framework which uses DNN agents to directly determine order-up-to levels between any adjacent pair of nodes in the supply chain. Our model considers a finite horizon and accounts for the initial inventory conditions. Our method is suitable for a wide variety of supply chain networks, including general topologies that may contain both assembly and distribution nodes, and systems with nonlinear cost structures. We first numerically demonstrate the effectiveness of the method by showing that its solutions are close to the optimal solutions for single-node and serial supply chain networks, for which exact methods are available. Then, we investigate more general supply chain networks and find that the proposed method performs better in terms of both objective function values and the number of interactions with the environment compared to alternate methods.


title: Learning With Differential Privacy

abstract: The leakage of data might have been an extreme effect on the personal level if it contains sensitive information. Common prevention methods like encryption-decryption, endpoint protection, intrusion detection system are prone to leakage. Differential privacy comes to the rescue with a proper promise of protection against leakage, as it uses a randomized response technique at the time of collection of the data which promises strong privacy with better utility. Differential privacy allows one to access the forest of data by describing their pattern of groups without disclosing any individual trees. The current adaption of differential privacy by leading tech companies and academia encourages authors to explore the topic in detail. The different aspects of differential privacy, it's application in privacy protection and leakage of information, a comparative discussion, on the current research approaches in this field, its utility in the real world as well as the trade-offs - will be discussed.


title: High-probability Convergence Bounds for Non-convex Stochastic Gradient Descent

abstract: Stochastic gradient descent is one of the most common iterative algorithms used in machine learning. While being computationally cheap to implement, recent literature suggests it may have implicit regularization properties that prevent over-fitting. This paper analyzes the properties of stochastic gradient descent from a theoretical standpoint to help bridge the gap between theoretical and empirical results. Most theoretical results either assume convexity or only provide convergence results in mean, while this paper proves convergence bounds in high probability without assuming convexity. Assuming strong smoothness, we prove high probability convergence bounds in two settings: (1) assuming the Polyak-{\L}ojasiewicz inequality and norm sub-Gaussian gradient noise and (2) assuming norm sub-Weibull gradient noise. In the first setting, we combine our convergence bounds with existing generalization bounds in order to bound the true risk and show that for a certain number of epochs, convergence and generalization balance in such a way that the true risk goes to the empirical minimum as the number of samples goes to infinity. In the second setting, as an intermediate step to proving convergence, we prove a probability result of independent interest. The probability result extends Freedman-type concentration beyond the sub-exponential threshold to heavier-tailed martingale difference sequences.


title: Discovery and astrophysical properties of Galactic open clusters in dense stellar fields using Gaia DR2

abstract: We report the discovery of 25 new open clusters resulting from a search in dense low galactic latitude fields. We also provide, for the first time, structural and astrophysical parameters for the new findings and 34 other recently discovered open clusters using Gaia DR2 data. The candidates were confirmed by jointly inspecting the vector point diagrams and spatial distribution. The discoveries were validated by matching near known objects and comparing their mean astrometric parameters with the available literature. A decontamination algorithm was applied to the three-dimensional astrometric space to derive membership likelihoods for clusters stars. By rejecting stars with low membership likelihoods, we built decontaminated colour-magnitude diagrams and derived the clusters astrophysical parameters by isochrone fitting. The structural parameters were also derived by King-profile fittings over the stellar distributions. The investigated clusters are mainly located within 3 kpc from the Sun, with ages ranging from 30 Myr to 3.2 Gyr and reddening limited to E(B-V)=2.5. On average, our cluster sample presents less concentrated structures than Gaia DR2 confirmed clusters, since the derived core radii are larger while the tidal radii are not significantly different. Most of them are located in the IV quadrant of the Galactic disc at low latitudes, therefore they are immersed in dense fields characteristic of the inner Milky Way.


title: Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis

abstract: Deep learning (DL) algorithms are considered as a methodology of choice for remote-sensing image analysis over the past few years. Due to its effective applications, deep learning has also been introduced for automatic change detection and achieved great success. The present study attempts to provide a comprehensive review and a meta-analysis of the recent progress in this subfield. Specifically, we first introduce the fundamentals of deep learning methods which arefrequently adopted for change detection. Secondly, we present the details of the meta-analysis conducted to examine the status of change detection DL studies. Then, we focus on deep learning-based change detection methodologies for remote sensing images by giving a general overview of the existing methods. Specifically, these deep learning-based methods were classified into three groups; fully supervised learning-based methods, fully unsupervised learning-based methods and transfer learning-based techniques. As a result of these investigations, promising new directions were identified for future research. This study will contribute in several ways to our understanding of deep learning for change detection and will provide a basis for further research.


title: Agent Programming for Industrial Applications: Some Advantages and Drawbacks

abstract: Autonomous agents are seen as a prominent technology to be applied in industrial scenarios. Classical automation solutions are struggling with challenges related to high dynamism, prompt actuation, heterogeneous entities, including humans, and decentralised decision-making. Besides promoting concepts, languages, and tools to face such challenges, agents must also provide high reliability. To assess how appropriate and mature are agents for industrial applications, we have investigated its application in two scenarios of the gas and oil industry. This paper presents the development of systems and the initial results highlighting the advantages and drawbacks of the agents approach when compared with the existing automation solutions.


title: Local Simulations of Spiral Galaxies with the TIGRESS Framework: I. Star Formation and Arm Spurs/Feathers

abstract: Spiral arms greatly affect gas flows and star formation in disk galaxies. We use local three-dimensional simulations of the vertically-stratified, self-gravitating, differentially-rotating, interstellar medium (ISM) subject to a stellar spiral potential to study the effects of spiral arms on star formation and formation of arm spurs/feathers. We adopt the TIGRESS framework of Kim & Ostriker (2017) to handle radiative heating and cooling, star formation, and ensuing supernova (SN) feedback. We find that more than 90% of star formation takes place in spiral arms, but the global star formation rate (SFR) in models with spiral arms is enhanced by less than a factor of 2 compared to the no-arm counterpart. This results from a quasi-linear relationship between the SFR surface density Sigma_SFR and the gas surface density Sigma, and supports the picture that spiral arms do not trigger star formation but rather concentrate star-forming regions. Correlated SN feedback produces gaseous spurs/feathers downstream from arms in both magnetized and unmagnetized models. These spurs/feathers are short-lived and have magnetic fields parallel to their length, in contrast to the longer-lived features with perpendicular magnetic fields induced by gravitational instability. SN feedback drives the turbulent component of magnetic fields, with the total magnetic field strength sublinearly proportional to Sigma. The total midplane pressure varies by a factor of ~10 between arm and interarm regions but agrees locally with the total vertical ISM weight, while Sigma_SFR is locally consistent with the prediction of pressure-regulated, feedback-modulated theory.


title: Giant nonlinear Hall effect in twisted WSe$_2$

abstract: The recently discovered nonlinear Hall effect (NHE) in a few non-interacting systems provides a novel mechanism to generate second harmonic electrical Hall signals under time-reversal-symmetric conditions. Here, we introduce a new approach to engineering NHE by using twisted moir\'e structures. We find that the twisted WSe$_2$ bilayer exhibits a NHE when tuning the Fermi level to the moir\'e flat bands. Near half-filling of the first moir\'e band, the nonlinear Hall signal shows a sharp peak with the generation efficiency at least two orders of magnitude larger than those in previous experiments. We propose that the giant NHE and diverging generation efficiency originate from a mass-diverging type continuous Mott transition, which is evidenced by resistivity measurements. This work demonstrates not only how interaction effects can couple to Berry curvature dipoles to produce novel quantum phenomena, but also what NHE measurements can provide for developing a new tool to study the quantum criticality.


title: Regret Minimization for Causal Inference on Large Treatment Space

abstract: Predicting which action (treatment) will lead to a better outcome is a central task in decision support systems. To build a prediction model in real situations, learning from biased observational data is a critical issue due to the lack of randomized controlled trial (RCT) data. To handle such biased observational data, recent efforts in causal inference and counterfactual machine learning have focused on debiased estimation of the potential outcomes on a binary action space and the difference between them, namely, the individual treatment effect. When it comes to a large action space (e.g., selecting an appropriate combination of medicines for a patient), however, the regression accuracy of the potential outcomes is no longer sufficient in practical terms to achieve a good decision-making performance. This is because the mean accuracy on the large action space does not guarantee the nonexistence of a single potential outcome misestimation that might mislead the whole decision. Our proposed loss minimizes a classification error of whether or not the action is relatively good for the individual target among all feasible actions, which further improves the decision-making performance, as we prove. We also propose a network architecture and a regularizer that extracts a debiased representation not only from the individual feature but also from the biased action for better generalization in large action spaces. Extensive experiments on synthetic and semi-synthetic datasets demonstrate the superiority of our method for large combinatorial action spaces.


title: Hybrid Tree-based Models for Insurance Claims

abstract: Two-part models and Tweedie generalized linear models (GLMs) have been used to model loss costs for short-term insurance contract. For most portfolios of insurance claims, there is typically a large proportion of zero claims that leads to imbalances resulting in inferior prediction accuracy of these traditional approaches. This article proposes the use of tree-based models with a hybrid structure that involves a two-step algorithm as an alternative approach to these traditional models. The first step is the construction of a classification tree to build the probability model for frequency. In the second step, we employ elastic net regression models at each terminal node from the classification tree to build the distribution model for severity. This hybrid structure captures the benefits of tuning hyperparameters at each step of the algorithm; this allows for improved prediction accuracy and tuning can be performed to meet specific business objectives. We examine and compare the predictive performance of such a hybrid tree-based structure in relation to the traditional Tweedie model using both real and synthetic datasets. Our empirical results show that these hybrid tree-based models produce more accurate predictions without the loss of intuitive interpretation.


title: Classification of simple strong Harish-Chandra $W(m,n)$-modules

abstract: We classify all simple strong Harish-Chandra modules for the Lie superalgebra $W(m,n)$. We show that every such module is either strongly cuspidal or a module of the highest weight type. We construct tensor modules for $W(m,n)$, which are parametrized by simple finite-dimensional $gl(m,n)$-modules and show that every simple strongly cuspidal $W(m,n)$-module is a quotient of a tensor module. Finally, we realize modules of the highest weight type as simple quotients of the generalized Verma modules induced from tensor modules for $W(m-1,n)$.


title: Towards Jacamo-rest: A Resource-Oriented Abstraction for Managing Multi-Agent Systems

abstract: The Multi-Agent Oriented Programming (MAOP) paradigm provides abstractions to model and implements entities of agents, as well as of their organisations and environments. In recent years, researchers have started to explore the integration of MAOP and the resource-oriented web architecture (REST). This paper further advances this line of research by presenting an ongoing work on jacamo-rest, a resource-oriented web-based abstraction for the multi-agent programming platform JaCaMo. Jacamo-rest takes Multi-Agent System (MAS) interoperability to a new level, enabling MAS to not only interact with services or applications of the World Wide Web but also to be managed and updated in their specifications by other applications. To add a developer interface to JaCaMo that is suitable for the Web, we provide a novel conceptual perspective on the management of MAOP specification entities as web resources. We tested jacamo-rest using it as a middleware of a programming interface application that provides modern software engineering facilities such as continuous deployments and iterative software development for MAS.


title: Exploring the Vulnerability of Deep Neural Networks: A Study of Parameter Corruption

abstract: We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding this matter. In this work, we propose an indicator to measure the robustness of neural network parameters by exploiting their vulnerability via parameter corruption. The proposed indicator describes the maximum loss variation in the non-trivial worst-case scenario under parameter corruption. For practical purposes, we give a gradient-based estimation, which is far more effective than random corruption trials that can hardly induce the worst accuracy degradation. Equipped with theoretical support and empirical validation, we are able to systematically investigate the robustness of different model parameters and reveal vulnerability of deep neural networks that has been rarely paid attention to before. Moreover, we can enhance the models accordingly with the proposed adversarial corruption-resistant training, which not only improves the parameter robustness but also translates into accuracy elevation.


title: Understanding Points of Correspondence between Sentences for Abstractive Summarization

abstract: Fusing sentences containing disparate content is a remarkable human ability that helps create informative and succinct summaries. Such a simple task for humans has remained challenging for modern abstractive summarizers, substantially restricting their applicability in real-world scenarios. In this paper, we present an investigation into fusing sentences drawn from a document by introducing the notion of points of correspondence, which are cohesive devices that tie any two sentences together into a coherent text. The types of points of correspondence are delineated by text cohesion theory, covering pronominal and nominal referencing, repetition and beyond. We create a dataset containing the documents, source and fusion sentences, and human annotations of points of correspondence between sentences. Our dataset bridges the gap between coreference resolution and summarization. It is publicly shared to serve as a basis for future work to measure the success of sentence fusion systems. (https://github.com/ucfnlp/points-of-correspondence)


title: P-ADMMiRNN: Training RNN with Stable Convergence via An Efficient and Paralleled ADMM Approach

abstract: It is hard to train Recurrent Neural Network (RNN) with stable convergence and avoid gradient vanishing and exploding problems, as the weights in the recurrent unit are repeated from iteration to iteration. Moreover, RNN is sensitive to the initialization of weights and bias, which brings difficulties in training. The Alternating Direction Method of Multipliers (ADMM) has become a promising algorithm to train neural networks beyond traditional stochastic gradient algorithms with the gradient-free features and immunity to unsatisfactory conditions. However, ADMM could not be applied to train RNN directly since the state in the recurrent unit is repetitively updated over timesteps. Therefore, this work builds a new framework named ADMMiRNN upon the unfolded form of RNN to address the above challenges simultaneously. We also provide novel update rules and theoretical convergence analysis. We explicitly specify essential update rules in the iterations of ADMMiRNN with constructed approximation techniques and solutions to each sub-problem instead of vanilla ADMM. Numerical experiments are conducted on MNIST, IMDb, and text classification tasks. ADMMiRNN achieves convergent results and outperforms the compared baselines. Furthermore, ADMMiRNN trains RNN more stably without gradient vanishing or exploding than stochastic gradient algorithms. We also provide a distributed paralleled algorithm regarding ADMMiRNN, named P-ADMMiRNN, including Synchronous Parallel ADMMiRNN (SP-ADMMiRNN) and Asynchronous Parallel ADMMiRNN (AP-ADMMiRNN), which is the first to train RNN with ADMM in an asynchronous parallel manner. The source code is publicly available.


title: Training with Multi-Layer Embeddings for Model Reduction

abstract: Modern recommendation systems rely on real-valued embeddings of categorical features. Increasing the dimension of embedding vectors improves model accuracy but comes at a high cost to model size. We introduce a multi-layer embedding training (MLET) architecture that trains embeddings via a sequence of linear layers to derive superior embedding accuracy vs. model size trade-off. Our approach is fundamentally based on the ability of factorized linear layers to produce superior embeddings to that of a single linear layer. We focus on the analysis and implementation of a two-layer scheme. Harnessing the recent results in dynamics of backpropagation in linear neural networks, we explain the ability to get superior multi-layer embeddings via their tendency to have lower effective rank. We show that substantial advantages are obtained in the regime where the width of the hidden layer is much larger than that of the final embedding (d). Crucially, at conclusion of training, we convert the two-layer solution into a single-layer one: as a result, the inference-time model size scales as d. We prototype the MLET scheme within Facebook's PyTorch-based open-source Deep Learning Recommendation Model. We show that it allows reducing d by 4-8X, with a corresponding improvement in memory footprint, at given model accuracy. The experiments are run on two publicly available click-through-rate prediction benchmarks (Criteo-Kaggle and Avazu). The runtime cost of MLET is 25%, on average.


title: Adjoined Networks: A Training Paradigm with Applications to Network Compression

abstract: Compressing deep neural networks while maintaining accuracy is important when we want to deploy large, powerful models in production and/or edge devices. One common technique used to achieve this goal is knowledge distillation. Typically, the output of a static pre-defined teacher (a large base network) is used as soft labels to train and transfer information to a student (or smaller) network. In this paper, we introduce Adjoined Networks, or AN, a learning paradigm that trains both the original base network and the smaller compressed network together. In our training approach, the parameters of the smaller network are shared across both the base and the compressed networks. Using our training paradigm, we can simultaneously compress (the student network) and regularize (the teacher network) any architecture. In this paper, we focus on popular CNN-based architectures used for computer vision tasks. We conduct an extensive experimental evaluation of our training paradigm on various large-scale datasets. Using ResNet-50 as the base network, AN achieves 71.8% top-1 accuracy with only 1.8M parameters and 1.6 GFLOPs on the ImageNet data-set. We further propose Differentiable Adjoined Networks (DAN), a training paradigm that augments AN by using neural architecture search to jointly learn both the width and the weights for each layer of the smaller network. DAN achieves ResNet-50 level accuracy on ImageNet with $3.8\times$ fewer parameters and $2.2\times$ fewer FLOPs.


title: Boundedness of fibers for pluricanonical maps of varieties of general type

abstract: We prove that the r-th pluricanonical maps of threefolds of general type have birationally bounded fibers if $r\geqslant 2$. Similarly, we prove that the r-th pluricanonical maps of fourfolds of general type have birationally bounded fibers if $r\geqslant 4$. We extend these results to higher dimensions in terms of constants arising naturally from the birational geometry of varieties of general type.


title: Banach Space Representer Theorems for Neural Networks and Ridge Splines

abstract: We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear inverse problems with total variation-like regularization in the Radon domain subject to data fitting constraints. We derive a representer theorem showing that finite-width, single-hidden layer neural networks are solutions to these inverse problems. We draw on many techniques from variational spline theory and so we propose the notion of polynomial ridge splines, which correspond to single-hidden layer neural networks with truncated power functions as the activation function. The representer theorem is reminiscent of the classical reproducing kernel Hilbert space representer theorem, but we show that the neural network problem is posed over a non-Hilbertian Banach space. While the learning problems are posed in the continuous-domain, similar to kernel methods, the problems can be recast as finite-dimensional neural network training problems. These neural network training problems have regularizers which are related to the well-known weight decay and path-norm regularizers. Thus, our result gives insight into functional characteristics of trained neural networks and also into the design neural network regularizers. We also show that these regularizers promote neural network solutions with desirable generalization properties.


title: A survey on deep hashing for image retrieval

abstract: Hashing has been widely used in approximate nearest search for large-scale database retrieval for its computation and storage efficiency. Deep hashing, which devises convolutional neural network architecture to exploit and extract the semantic information or feature of images, has received increasing attention recently. In this survey, several deep supervised hashing methods for image retrieval are evaluated and I conclude three main different directions for deep supervised hashing methods. Several comments are made at the end. Moreover, to break through the bottleneck of the existing hashing methods, I propose a Shadow Recurrent Hashing(SRH) method as a try. Specifically, I devise a CNN architecture to extract the semantic features of images and design a loss function to encourage similar images projected close. To this end, I propose a concept: shadow of the CNN output. During optimization process, the CNN output and its shadow are guiding each other so as to achieve the optimal solution as much as possible. Several experiments on dataset CIFAR-10 show the satisfying performance of SRH.


title: A two weight inequality for Calder\'{o}n-Zygmund operators on spaces of homogeneous type with applications

abstract: Let $(X,d,\mu )$ be a space of homogeneous type in the sense of Coifman and Weiss, i.e. $d$ is a quasi metric on $X$ and $\mu $ is a positive measure satisfying the doubling condition. Suppose that $u$ and $v$ are two locally finite positive Borel measures on $(X,d,\mu )$. Subject to the pair of weights satisfying a side condition, we characterize the boundedness of a Calder\'{o}n--Zygmund operator $T$ from $L^{2}(u)$ to $L^{2}(v)$ in terms of the $A_{2}$ condition and two testing conditions. For every cube $B\subset X$, we have the following testing conditions, with $\mathbf{1}_{B}$ taken as the indicator of $B$ \begin{equation*} \Vert T(u\mathbf{1}_{B})\Vert _{L^{2}(B, v)}\leq \mathcal{T}\Vert 1_{B}\Vert _{L^{2}(u)}, \end{equation*} \begin{equation*} \Vert T^{\ast }(v\mathbf{1}_{B})\Vert _{L^{2}(B, u)}\leq \mathcal{T}\Vert 1_{B}\Vert _{L^{2}(v)}. \end{equation*} The proof uses stopping cubes and corona decompositions originating in work of Nazarov, Treil and Volberg, along with the pivotal side condition.


title: The Universal Theory Of The Hyperfinite II$_1$ Factor Is Not Computable

abstract: We show that the universal theory of the hyperfinite II$_1$ factor is not computable. The proof uses the recent result that MIP*=RE. Combined with an earlier observation of the authors, this yields a proof that the Connes Embedding Problem has a negative solution that avoids the equivalences with Kirchberg's QWEP Conjecture and Tsirelson's Problem.+


title: Distributionally Robust Batch Contextual Bandits

abstract: Policy learning using historical observational data is an important problem that has found widespread applications. Examples include selecting offers, prices, advertisements to send to customers, as well as selecting which medication to prescribe to a patient. However, existing literature rests on the crucial assumption that the future environment where the learned policy will be deployed is the same as the past environment that has generated the data -- an assumption that is often false or too coarse an approximation. In this paper, we lift this assumption and aim to learn a distributionally robust policy with incomplete observational data. We first present a policy evaluation procedure that allows us to assess how well the policy does under the worst-case environment shift. We then establish a central limit theorem type guarantee for this proposed policy evaluation scheme. Leveraging this evaluation scheme, we further propose a novel learning algorithm that is able to learn a policy that is robust to adversarial perturbations and unknown covariate shifts with a performance guarantee based on the theory of uniform convergence. Finally, we empirically test the effectiveness of our proposed algorithm in synthetic datasets and demonstrate that it provides the robustness that is missing using standard policy learning algorithms. We conclude the paper by providing a comprehensive application of our methods in the context of a real-world voting dataset.


title: Long-lived and multiplexed atom-photon entanglement interface with feed-forward-controlled readouts

abstract: The quantum interface (QI) that generates entanglement between photonic and spin-wave (atomic memory) qubits is a basic building block for quantum repeaters. Realizing ensemble-based repeaters in practice requires quantum memory providing long lifetime and multimode capacity. Significant progresses have been achieved on these separate goals. The remaining challenge is to combine long-lived and multimode memories into a single QI. Here, by establishing multimode, magnetic-field-insensitive and long-wavelength spin-wave storage in laser-cooled atoms that are placed inside a phase-passively-stabilized polarization interferometer, we constructed a multiplexed QI that stores up to three long-lived spin-wave qubits. Using a feed-forward-controlled system, we demonstrated that the multiplexed QI gives rise to a 3-fold increase in the atom-photon (photon-photon) entanglement-generation probability compared to single-mode QIs. The measured Bell parameter is 2.5+/-0.1 combined with a memory lifetime up to 1ms. The presented work represents a key step forward in realizing fiber-based long-distance quantum communications.


title: Quant Bust 2020

abstract: We explain in a nontechnical fashion why dollar-neutral quant trading strategies, such as equities Statistical Arbitrage, suffered substantial losses (drawdowns) during the COVID-19 market selloff. We discuss: (i) why these strategies work during "normal" times; (ii) the market regimes when they work best; and (iii) their limitations and the reasons for why they "break" during extreme market events. An accompanying appendix (with a link to freely accessible source code) includes backtests for various strategies, which put flesh on and illustrate the discussion in the main text.


title: Survey of Extremely High-velocity Outflows in Sloan Digital Sky Survey Quasars

abstract: We present a survey of extremely high-velocity outflows (EHVOs) in quasars, defined by speeds between 0.1c and 0.2c. This region of the parameter space has not been included in previous surveys, but it might present the biggest challenge for theoretical models and it might be a large contributor to feedback due to the outflows' potentially large kinetic power. Using the Sloan Digital Sky Survey, we find 40 quasar spectra with broad EHVO CIV absorption, 10 times more than the number of previously known cases. We characterize the EHVO absorption and find that in 26 cases, CIV is accompanied by NV and/or OVI absorption. We find that EHVO quasars lack HeII emission and have overall larger bolometric luminosities and black hole masses than those of their parent sample and BALQSOs, while we do not find significant differences in their Eddington ratios. We also report a trend toward larger black hole masses as the velocity of the outflowing gas increases in the BALQSOs in our sample. The overall larger Lbol and lack of HeII emission of EHVO quasars suggest that radiation is likely driving these outflows. We find a potential evolutionary effect as EHVO quasars seem to be more predominant at large redshifts. We estimate that the kinetic power of these outflows may be similar to or even larger than that of the outflows from BALQSOs as the velocity factor increases this parameter by 1-2.5 orders of magnitude. Further study of EHVO quasars will help improve our understanding of quasar physics.


title: Chemical-Grafting of Graphene Oxide Quantum Dots for Enhanced Electrochemical Analysis of Aromatics

abstract: Because of high surface area and combination of various functional groups, graphene oxide (GO) is currently one of the most actively studying materials for electroanalytical applications. Self-supported GO is not practical enough to be utilized individually and thus is commonly integrated with different supporting carriers. Having large lateral size GO can only wrap the particles of the support and thus, can significantly reduce the surface area of porous materials. To reach synergy form high surface area and polyfunctional nature of GO, and a rigid structure of porous support, the lateral size of GO must be essentially decreased. Recently reported graphene oxide quantum dots (GOQDs) can fulfill this task. We report successful preparation of mesoporous silica supported GOQDs exhibiting strong luminescent band with the maximum at 404 nm. From N2 adsorption isotherms, it was demonstrated that the surface area of the resulted hybrid material was augmented. Raman spectrum of SiO2-GOQDs shows two distinct peaks at 1585 cm-1(G-peak) and 1372 cm-1 (D-peak) indicating presence ordered basal plane of graphene with aromatic sp2 domains, and disordered oxygen-containing structure. Covalent immobilization of GOQDs on aminosilica via such oxygen-containing fragments was proved by FTIR, MAS 13C MNR, and XPS spectroscopy. SiO2-GOQDs was used as a modifier of carbon paste electrode for differential pulse voltammetry determination of four environmental: sulfamethoxazole, trimethoprim, diethylstilbestrol (DES), and estriol (EST). The modified electrodes demonstrated an essential decrease in LOD for EST (220%) and DES (760%), which was explained by significant pi-pi stacking interaction between GOQDs and aromatic system of the analytes.


title: Data Augmentation for Training Dialog Models Robust to Speech Recognition Errors

abstract: Speech-based virtual assistants, such as Amazon Alexa, Google assistant, and Apple Siri, typically convert users' audio signals to text data through automatic speech recognition (ASR) and feed the text to downstream dialog models for natural language understanding and response generation. The ASR output is error-prone; however, the downstream dialog models are often trained on error-free text data, making them sensitive to ASR errors during inference time. To bridge the gap and make dialog models more robust to ASR errors, we leverage an ASR error simulator to inject noise into the error-free text data, and subsequently train the dialog models with the augmented data. Compared to other approaches for handling ASR errors, such as using ASR lattice or end-to-end methods, our data augmentation approach does not require any modification to the ASR or downstream dialog models; our approach also does not introduce any additional latency during inference time. We perform extensive experiments on benchmark data and show that our approach improves the performance of downstream dialog models in the presence of ASR errors, and it is particularly effective in the low-resource situations where there are constraints on model size or the training data is scarce.


title: Dissipativity and positive off-diagonal property of operators on ordered Banach spaces

abstract: In this paper, we provide a sublinear function $p$ on ordered Banach spaces, which depends on the order structure of the space. With respect to this $p$, we study the relation between $p$-contractivity of positive semigroups and the $p$-dissipativity of its generators. The positive off-diagonal property of generators is also studied in ordered vector spaces.


title: Distributed Optimization for Massive Connectivity

abstract: Massive device connectivity in Internet of Thing (IoT) networks with sporadic traffic poses significant communication challenges. To overcome this challenge, the serving base station is required to detect the active devices and estimate the corresponding channel state information during each coherence block. The corresponding joint activity detection and channel estimation problem can be formulated as a group sparse estimation problem, also known under the name "Group Lasso". This letter presents a fast and efficient distributed algorithm to solve such Group Lasso problems, which alternates between solving small-scaled problems in parallel and dealing with a linear equation for consensus. Numerical results demonstrate the speedup of this algorithm compared with the state-of-the-art methods in terms of convergence speed and computation time.


title: Spectral Form Factor for Time-dependent Matrix model

abstract: The quantum chaos is related to a Gaussian random matrix model, which shows a dip-ramp-plateau behavior in the spectral form factor for the large size $N$. The spectral form factor of time dependent Gaussian random matrix model shows also dip-ramp-plateau behavior with a rounding behavior instead of a kink near Heisenberg time. This model is converted to two matrix model, made of $M_1$ and $M_2$. The numerical evaluation for finite $N$ and analytic expression in the large $N$ are compared for the spectral form factor.


title: Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction

abstract: Rich user behavior data has been proven to be of great value for click-through rate prediction tasks, especially in industrial applications such as recommender systems and online advertising. Both industry and academy have paid much attention to this topic and propose different approaches to modeling with long sequential user behavior data. Among them, memory network based model MIMN proposed by Alibaba, achieves SOTA with the co-design of both learning algorithm and serving system. MIMN is the first industrial solution that can model sequential user behavior data with length scaling up to 1000. However, MIMN fails to precisely capture user interests given a specific candidate item when the length of user behavior sequence increases further, say, by 10 times or more. This challenge exists widely in previously proposed approaches. In this paper, we tackle this problem by designing a new modeling paradigm, which we name as Search-based Interest Model (SIM). SIM extracts user interests with two cascaded search units: (i) General Search Unit acts as a general search from the raw and arbitrary long sequential behavior data, with query information from candidate item, and gets a Sub user Behavior Sequence which is relevant to candidate item; (ii) Exact Search Unit models the precise relationship between candidate item and SBS. This cascaded search paradigm enables SIM with a better ability to model lifelong sequential behavior data in both scalability and accuracy. Apart from the learning algorithm, we also introduce our hands-on experience on how to implement SIM in large scale industrial systems. Since 2019, SIM has been deployed in the display advertising system in Alibaba, bringing 7.1\% CTR and 4.4\% RPM lift, which is significant to the business. Serving the main traffic in our real system now, SIM models user behavior data with maximum length reaching up to 54000, pushing SOTA to 54x.


title: Bailout Stigma

abstract: We develop a model of bailout stigma where accepting a bailout signals a firm's balance-sheet weakness and worsens its funding prospect. To avoid stigma, high-quality firms either withdraw from subsequent financing after receiving bailouts or refuse bailouts altogether to send a favorable signal. The former leads to a short-lived stimulation with a subsequent market freeze even worse than if there were no bailouts. The latter revives the funding market, albeit with delay, to the level achievable without any stigma, and implements a constrained optimal outcome. A menu of multiple bailout programs also compounds bailout stigma and worsens market freeze.