title: Human Pose Transfer by Adaptive Hierarchical Deformation

abstract: Human pose transfer, as a misaligned image generation task, is very challenging. Existing methods cannot effectively utilize the input information, which often fail to preserve the style and shape of hair and clothes. In this paper, we propose an adaptive human pose transfer network with two hierarchical deformation levels. The first level generates human semantic parsing aligned with the target pose, and the second level generates the final textured person image in the target pose with the semantic guidance. To avoid the drawback of vanilla convolution that treats all the pixels as valid information, we use gated convolution in both two levels to dynamically select the important features and adaptively deform the image layer by layer. Our model has very few parameters and is fast to converge. Experimental results demonstrate that our model achieves better performance with more consistent hair, face and clothes with fewer parameters than state-of-the-art methods. Furthermore, our method can be applied to clothing texture transfer.


title: On a class of closed cocycles for algebras of non-formal, possibly unbounded, pseudodifferential operators

abstract: In this article, we consider algebras $\mathcal{A}$ of non-formal pseudodifferential operators over $S^1$ which contain $C^\infty(S^1),$ understood as multiplication operators. We apply a construction of Chern-Weil type forms in order to get $2k-$closed cocycles. For $k=1,$ we obtain a cocycle on the algebra of (maybe non classical) pseudodifferential operators with the same cohomology class as the Schwinger cocycle on the algebra of Classical pseudodifferential operators, previously extended and studied by the author on algebras of the same type.


title: Some aspects on the computational implementation of diverse terms arising in mixed virtual element formulations

abstract: In the present paper we describe the computational implementation of some integral terms that arise from mixed virtual element methods (mixed-VEM) in two-dimensional pseudostress-velocity formulations. The implementation presented here consider any polynomial degree $k \geq 0$ in a natural way by building several local matrices of small size through the matrix multiplication and the Kronecker product. In particular, we apply the foregoing mentioned matrices to the Navier-Stokes equations with Dirichlet boundary conditions, whose mixed-VEM formulation was originally proposed and analyzed in a recent work using virtual element subspaces for $H(\text{div})$ and $H^1$, simultaneously. In addition, an algorithm is proposed for the assembly of the associated global linear system for the Newton's iteration. Finally, we present a numerical example in order to illustrate the performance of the mixed-VEM scheme and confirming the expected theoretical convergence rates.


title: Discriminative Pre-training for Low Resource Title Compression in Conversational Grocery

abstract: The ubiquity of smart voice assistants has made conversational shopping commonplace. This is especially true for low consideration segments like grocery. A central problem in conversational grocery is the automatic generation of short product titles that can be read out fast during a conversation. Several supervised models have been proposed in the literature that leverage manually labeled datasets and additional product features to generate short titles automatically. However, obtaining large amounts of labeled data is expensive and most grocery item pages are not as feature-rich as other categories. To address this problem we propose a pre-training based solution that makes use of unlabeled data to learn contextual product representations which can then be fine-tuned to obtain better title compression even in a low resource setting. We use a self-attentive BiLSTM encoder network with a time distributed softmax layer for the title compression task. We overcome the vocabulary mismatch problem by using a hybrid embedding layer that combines pre-trained word embeddings with trainable character level convolutions. We pre-train this network as a discriminator on a replaced-token detection task over a large number of unlabeled grocery product titles. Finally, we fine tune this network, without any modifications, with a small labeled dataset for the title compression task. Experiments on Walmart's online grocery catalog show our model achieves performance comparable to state-of-the-art models like BERT and XLNet. When fine tuned on all of the available training data our model attains an F1 score of 0.8558 which lags the best performing model, BERT-Base, by 2.78% and XLNet by 0.28% only, while using 55 times lesser parameters than both. Further, when allowed to fine tune on 5% of the training data only, our model outperforms BERT-Base by 24.3% in F1 score.


title: Deformation of loops in 2D packing of flexible rods

abstract: The injection of a long flexible rod into a two-dimensional domain yields a complex pattern commonly studied through elasticity theory, packing analysis, and fractal geometries. "Loop" is a one-vertex entity that is naturally formed in this system. The role of the elastic features of each loop in 2D packing has not yet been discussed. In this work, we point out how the shape of a given loop in the complex structure allows estimating local deformations and forces. First, we build sets of symmetric free loops and performed compression experiments. Then, tight packing configurations are analyzed by using image processing. We found that the dimensions of the loops, confined or not, obey the same dependence on the deformation. The result is consistent with a simple model based on 2D elastic theory for filaments, where the rod adopts the shape of Euler's elasticas between its contact points. The force and the stored energy are obtained from numerical integration of the analytic expressions. In an additional experiment, we obtain that the compression force for deformed loops corroborates the theoretical findings. The importance of the shape of the loop is discussed and we hope that the theoretical curves may allow statistical considerations in future investigations.


title: Ionized outflows from active galactic nuclei as the essential elements of feedback

abstract: Outflows from active galactic nuclei (AGN) are one of the fundamental mechanisms by which the central supermassive black hole interacts with its host galaxy. Detected in $\ge 50\%$ of nearby AGN, these outflows have been found to carry kinetic energy that is a significant fraction of AGN power, and thereby give negative feedback to their host galaxies. To understand the physical processes that regulate them, it is important to have a robust estimate of their physical and dynamical parameters. In this review we summarize our current understanding on the physics of the ionized outflows detected in absorption in the UV and X-ray wavelength bands. We discuss the most relevant observations and our current knowledge and uncertainties in the measurements of the outflow parameters. We also discuss their origin and acceleration mechanisms. The commissioning and concept studies of large telescope missions with high resolution spectrographs in UV/optical and X-rays along with rapid advancements in simulations offer great promise for discoveries in this field over the next decade.


title: MiniVLM: A Smaller and Faster Vision-Language Model

abstract: Recent vision-language (VL) studies have shown remarkable progress by learning generic representations from massive image-text pairs with transformer models and then fine-tuning on downstream VL tasks. While existing research has been focused on achieving high accuracy with large pre-trained models, building a lightweight model is of great value in practice but is less explored. In this paper, we propose a smaller and faster VL model, MiniVLM, which can be finetuned with good performance on various downstream tasks like its larger counterpart. MiniVLM consists of two modules, a vision feature extractor and a transformer-based vision-language fusion module. We design a Two-stage Efficient feature Extractor (TEE), inspired by the one-stage EfficientDet network, to significantly reduce the time cost of visual feature extraction by $95\%$, compared to a baseline model. We adopt the MiniLM structure to reduce the computation cost of the transformer module after comparing different compact BERT models. In addition, we improve the MiniVLM pre-training by adding $7M$ Open Images data, which are pseudo-labeled by a state-of-the-art captioning model. We also pre-train with high-quality image tags obtained from a strong tagging model to enhance cross-modality alignment. The large models are used offline without adding any overhead in fine-tuning and inference. With the above design choices, our MiniVLM reduces the model size by $73\%$ and the inference time cost by $94\%$ while being able to retain $94-97\%$ of the accuracy on multiple VL tasks. We hope that MiniVLM helps ease the use of the state-of-the-art VL research for on-the-edge applications.


title: Network-Cognizant Time-Coupled Aggregate Flexibility of Distribution Systems Under Uncertainties

abstract: Increasing integration of distributed energy resources (DERs) within distribution feeders provides unprecedented flexibility at the distribution-transmission interconnection. To exploit this flexibility and to use the capacity potential of aggregate DERs, feasible substation power injection trajectories need to be efficiently characterized. This paper provides an ellipsoidal inner approximation of the set of feasible power injection trajectories at the substation such that for any point in the set, there exists a feasible disaggregation strategy of DERs for any load uncertainty realization. The problem is formulated as one of finding the robust maximum volume ellipsoid inside the flexibility region under uncertainty. Though the problem is NP-hard even in the deterministic case, this paper derives novel approximations of the resulting adaptive robust optimization problem based on optimal second-stage policies. The proposed approach yields less conservative flexibility characterization than existing flexibility region approximation formulations. The efficacy of the proposed method is demonstrated on a realistic distribution feeder.


title: Using Computer Vision to Automate Hand Detection and Tracking of Surgeon Movements in Videos of Open Surgery

abstract: Open, or non-laparoscopic surgery, represents the vast majority of all operating room procedures, but few tools exist to objectively evaluate these techniques at scale. Current efforts involve human expert-based visual assessment. We leverage advances in computer vision to introduce an automated approach to video analysis of surgical execution. A state-of-the-art convolutional neural network architecture for object detection was used to detect operating hands in open surgery videos. Automated assessment was expanded by combining model predictions with a fast object tracker to enable surgeon-specific hand tracking. To train our model, we used publicly available videos of open surgery from YouTube and annotated these with spatial bounding boxes of operating hands. Our model's spatial detections of operating hands significantly outperforms the detections achieved using pre-existing hand-detection datasets, and allow for insights into intra-operative movement patterns and economy of motion.


title: Fermat's Little Theorem and Euler's Theorem in a class of rings

abstract: Considering $\mathbb{Z}_n$ the ring of integers modulo $n$, the classical Fermat-Euler theorem establishes the existence of a specific natural number $\varphi(n)$ satisfying the following property: $ x^{\varphi(n)}=1%\hspace{1.0cm}\text{for all}\hspace{0.2cm}x\in \mathbb{Z}_n^*, $ for all $x$ belonging to the group of units of $\mathbb{Z}_n$. In this manuscript, this result is extended to a class of rings that satisfies some mild conditions.


title: Double Free-Layer Magnetic Tunnel Junctions for Probabilistic Bits

abstract: Naturally random devices that exploit ambient thermal noise have recently attracted attention as hardware primitives for accelerating probabilistic computing applications. One such approach is to use a low barrier nanomagnet as the free layer of a magnetic tunnel junction (MTJ) whose magnetic fluctuations are converted to resistance fluctuations in the presence of a stable fixed layer. Here, we propose and theoretically analyze a magnetic tunnel junction with no fixed layers but two free layers that are circularly shaped disk magnets. We use an experimentally benchmarked model that accounts for finite temperature magnetization dynamics, bias-dependent charge and spin-polarized currents as well as the dipolar coupling between the free layers. We obtain analytical results for statistical averages of fluctuations that are in good agreement with the numerical model. We find that the free layers with low diameters fluctuate to randomize the resistance of the MTJ in an approximately bias-independent manner. We show how such MTJs can be used to build a binary stochastic neuron (or a p-bit) in hardware. Unlike earlier stochastic MTJs that need to operate at a specific bias point to produce random fluctuations, the proposed design can be random for a wide range of bias values, independent of spin-transfer-torque pinning. Moreover, in the absence of a carefully optimized stabled fixed layer, the symmetric double-free layer stack can be manufactured using present day Magnetoresistive Random Access Memory (MRAM) technology by minimal changes to the fabrication process. Such devices can be used as hardware accelerators in energy-efficient computing schemes that require a large throughput of tunably random bits.


title: Attentional-Biased Stochastic Gradient Descent

abstract: In this paper, we present a simple yet effective provable method (named ABSGD) for addressing the data imbalance or label noise problem in deep learning. Our method is a simple modification to momentum SGD where we assign an individual importance weight to each sample in the mini-batch. The individual-level weight of sampled data is systematically proportional to the exponential of a scaled loss value of the data, where the scaling factor is interpreted as the regularization parameter in the framework of distributionally robust optimization (DRO). Depending on whether the scaling factor is positive or negative, ABSGD is guaranteed to converge to a stationary point of an information-regularized min-max or min-min DRO problem, respectively. Compared with existing class-level weighting schemes, our method can capture the diversity between individual examples within each class. Compared with existing individual-level weighting methods using meta-learning that require three backward propagations for computing mini-batch stochastic gradients, our method is more efficient with only one backward propagation at each iteration as in standard deep learning methods. ABSGD is flexible enough to combine with other robust losses without any additional cost. Our empirical studies on several benchmark datasets demonstrate the effectiveness of the proposed method.\footnote{Code is available at:\url{https://github.com/qiqi-helloworld/ABSGD/}}


title: An overview of SPSA: recent development and applications

abstract: There is an increasing need in solving high-dimensional optimization problems under non-deterministic environment. The simultaneous perturbation stochastic approximation (SPSA) algorithm has recently attracted considerable attention for solving high-dimensional optimization problems where the analytical formula cannot be attained. SPSA is designed to estimate the gradient by applying perturbation on a random subset of dimensions at each iteration. SPSA can be easily implemented and is highly efficient in that that it relies on measurements of the objective function, not on measurements of the gradient of the objective function. Since its invention, SPSA has been implemented in various fields such as reinforcement learning, production optimization etc. The paper briefly discuss the recent development of SPSA and its applications.


title: Paper Moebius bands with T Patterns

abstract: This paper gives another proof of the key lemma in my recent paper which solves the optimal paper Moebius band conjecture of Halpern and Weaver, namely Lemma T. The proof here is longer but it offers more geometric intuition about what is going on.


title: MEME: Generating RNN Model Explanations via Model Extraction

abstract: Recurrent Neural Networks (RNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering RNN-based approaches is improving their explainability and interpretability. In this work we present MEME: a model extraction approach capable of approximating RNNs with interpretable models represented by human-understandable concepts and their interactions. We demonstrate how MEME can be applied to two multivariate, continuous data case studies: Room Occupation Prediction, and In-Hospital Mortality Prediction. Using these case-studies, we show how our extracted models can be used to interpret RNNs both locally and globally, by approximating RNN decision-making via interpretable concept interactions.


title: ZnO Nanowire Arrays Decorated with Titanium Nitride Nanoparticles as Surface Enhanced Raman Scattering Substrates

abstract: In this work, ZnO nanowire arrays decorated with titanium nitride (TiN) nanoparticles as surface enhanced Raman scattering (SERS) substrates is demonstrated. ZnO nanowires were grown by hydrothermal synthesis while ~100 nm TiN nanoparticles were obtained by grinding commercial powders for several hours. They were then decorated on the ZnO nanowire arrays using acetone as the medium. Scanning electron microscopy confirmed the presence of TiN nanoparticles on the ZnO nanowires. TiN nanoparticles exhibited localized surface plasmon resonances at 430, 520 and 600 nm. SERS experiments using Nile Blue and Methylene Blue as the analyte molecules showed significant enhancement in the Raman signals. It is shown that the origin of the SERS effect is chemical in nature, due to charge transfer between the analyte molecule and the TiN nanoparticles. The current work, thus, represents a simple, cost-effective and facile method for the fabrication of TiN based surface enhanced Raman scattering substrates.


title: Learn-Prune-Share for Lifelong Learning

abstract: In lifelong learning, we wish to maintain and update a model (e.g., a neural network classifier) in the presence of new classification tasks that arrive sequentially. In this paper, we propose a learn-prune-share (LPS) algorithm which addresses the challenges of catastrophic forgetting, parsimony, and knowledge reuse simultaneously. LPS splits the network into task-specific partitions via an ADMM-based pruning strategy. This leads to no forgetting, while maintaining parsimony. Moreover, LPS integrates a novel selective knowledge sharing scheme into this ADMM optimization framework. This enables adaptive knowledge sharing in an end-to-end fashion. Comprehensive experimental results on two lifelong learning benchmark datasets and a challenging real-world radio frequency fingerprinting dataset are provided to demonstrate the effectiveness of our approach. Our experiments show that LPS consistently outperforms multiple state-of-the-art competitors.


title: Open-World Class Discovery with Kernel Networks

abstract: We study an Open-World Class Discovery problem in which, given labeled training samples from old classes, we need to discover new classes from unlabeled test samples. There are two critical challenges to addressing this paradigm: (a) transferring knowledge from old to new classes, and (b) incorporating knowledge learned from new classes back to the original model. We propose Class Discovery Kernel Network with Expansion (CD-KNet-Exp), a deep learning framework, which utilizes the Hilbert Schmidt Independence Criterion to bridge supervised and unsupervised information together in a systematic way, such that the learned knowledge from old classes is distilled appropriately for discovering new classes. Compared to competing methods, CD-KNet-Exp shows superior performance on three publicly available benchmark datasets and a challenging real-world radio frequency fingerprinting dataset.


title: $k$-Variance: A Clustered Notion of Variance

abstract: We introduce $k$-variance, a generalization of variance built on the machinery of random bipartite matchings. $K$-variance measures the expected cost of matching two sets of $k$ samples from a distribution to each other, capturing local rather than global information about a measure as $k$ increases; it is easily approximated stochastically using sampling and linear programming. In addition to defining $k$-variance and proving its basic properties, we provide in-depth analysis of this quantity in several key cases, including one-dimensional measures, clustered measures, and measures concentrated on low-dimensional subsets of $\mathbb R^n$. We conclude with experiments and open problems motivated by this new way to summarize distributional shape.

categories: math.ST cs.LG cs.NA math.NA stat.ML stat.TH


title: Fast and Scalable Sparse Triangular Solver for Multi-GPU Based HPC Architectures

abstract: Designing efficient and scalable sparse linear algebra kernels on modern multi-GPU based HPC systems is a daunting task due to significant irregular memory references and workload imbalance across the GPUs. This is particularly the case for Sparse Triangular Solver (SpTRSV) which introduces additional two-dimensional computation dependencies among subsequent computation steps. Dependency information is exchanged and shared among GPUs, thus warrant for efficient memory allocation, data partitioning, and workload distribution as well as fine-grained communication and synchronization support. In this work, we demonstrate that directly adopting unified memory can adversely affect the performance of SpTRSV on multi-GPU architectures, despite linking via fast interconnect like NVLinks and NVSwitches. Alternatively, we employ the latest NVSHMEM technology based on Partitioned Global Address Space programming model to enable efficient fine-grained communication and drastic synchronization overhead reduction. Furthermore, to handle workload imbalance, we propose a malleable task-pool execution model which can further enhance the utilization of GPUs. By applying these techniques, our experiments on the NVIDIA multi-GPU supernode V100-DGX-1 and DGX-2 systems demonstrate that our design can achieve on average 3.53x (up to 9.86x) speedup on a DGX-1 system and 3.66x (up to 9.64x) speedup on a DGX-2 system with 4-GPUs over the Unified-Memory design. The comprehensive sensitivity and scalability studies also show that the proposed zero-copy SpTRSV is able to fully utilize the computing and communication resources of the multi-GPU system.


title: Primordial Non-Gaussianity from G-inflation

abstract: Enormous information about interactions is contained in the non-Gaussianities of the primordial curvature perturbations, which are essential to break the degeneracy of inflationary models. We study the primordial bispectra for G-inflation models predicting both sharp and broad peaks in the primordial scalar power spectrum. We calculate the non-Gaussianity parameter $f_{\mathrm{NL}}$ in the equilateral limit and squeezed limit numerically, and confirm that the consistency relation holds in these models. Even though $f_{\mathrm{NL}}$ becomes large at the scales before the power spectrum reaches the peak and the scales where there are wiggles in the power spectrum, it remains to be small at the peak scales. Therefore, the contributions of non-Gaussianity to the scalar induced secondary gravitational waves and primordial black hole abundance are expected to be negligible.


title: Online Stochastic Optimization with Wasserstein Based Non-stationarity

abstract: We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker needs to specify an action from a convex and compact action set to collect the reward and consume the budget. Each cost function corresponds to the consumption of one budget. In each period, the reward and cost functions are drawn from an unknown distribution, which is non-stationary across time. The objective of the decision maker is to maximize the cumulative reward subject to the budget constraints. This formulation captures a wide range of applications including online linear programming and network revenue management, among others. In this paper, we consider two settings: (i) a data-driven setting where the true distribution is unknown but a prior estimate (possibly inaccurate) is available; (ii) an uninformative setting where the true distribution is completely unknown. We propose a unified Wasserstein-distance based measure to quantify the inaccuracy of the prior estimate in setting (i) and the non-stationarity of the system in setting (ii). We show that the proposed measure leads to a necessary and sufficient condition for the attainability of a sublinear regret in both settings. For setting (i), we propose a new algorithm, which takes a primal-dual perspective and integrates the prior information of the underlying distributions into an online gradient descent procedure in the dual space. The algorithm also naturally extends to the uninformative setting (ii). Under both settings, we show the corresponding algorithm achieves a regret of optimal order. In numerical experiments, we demonstrate how the proposed algorithms can be naturally integrated with the re-solving technique to further boost the empirical performance.


title: Microfluidic device coupled with total internal reflection microscopy for in situ observation of precipitation

abstract: In situ observation of precipitation or phase separation induced by solvent addition is important in studying its dynamics. Combined with optical and fluorescence microscopy, microfluidic devices have been leveraged in studying the phase separation in various materials including biominerals, nanoparticles, and inorganic crystals. However, strong scattering from the subphases in the mixture is problematic for in situ study of phase separation with high temporal and spatial resolution. In this work, we present a quasi-2D microfluidic device combined with total internal reflection microscopy as an approach for in situ observation of phase separation. The quasi-2D microfluidic device comprises of a shallow main channel and a deep side channel. Mixing between a solution in the main channel (solution A) and another solution (solution B) in the side channel is predominantly driven by diffusion due to high fluid resistance from the shallow height of the main channel, which is confirmed using fluorescence microscopy. Moreover, relying on diffusive mixing, we can control the composition of the mixture in the main channel by tuning the composition of solution B. We demonstrate the application of our method for in situ observation of asphaltene precipitation and beta-alanine crystallization.


title: The Arithmetic Fourier Transform

abstract: The Arithmetic Fourier Transform is a numerical formulation for computing Fourier series and Taylor series coefficients. It competes with the Fast Fourier Transform in terms of speed and efficiency, requiring only addition operations and can be performed by parallel processing. The AFT has some deep connections with the Prime Number Theorem and its rich history is discussed in this expository article.


title: Fully-Automated Liver Tumor Localization and Characterization from Multi-Phase MR Volumes Using Key-Slice ROI Parsing: A Physician-Inspired Approach

abstract: Using radiological scans to identify liver tumors is crucial for proper patient treatment. This is highly challenging, as top radiologists only achieve F1 scores of roughly 80% (hepatocellular carcinoma (HCC) vs. others) with only moderate inter-rater agreement, even when using multi-phase magnetic resonance (MR) imagery. Thus, there is great impetus for computer-aided diagnosis (CAD) solutions. A critical challenge is to robustly parse a 3D MR volume to localize diagnosable regions of interest (ROI), especially for edge cases. In this paper, we break down this problem using a key-slice parser (KSP), which emulates physician workflows by first identifying key slices and then localizing their corresponding key ROIs. To achieve robustness, the KSP also uses curve-parsing and detection confidence re-weighting. We evaluate our approach on the largest multi-phase MR liver lesion test dataset to date (430 biopsy-confirmed patients). Experiments demonstrate that our KSP can localize diagnosable ROIs with high reliability: 87% patients have an average 3D overlap of >= 40% with the ground truth compared to only 79% using the best tested detector. When coupled with a classifier, we achieve an HCC vs. others F1 score of 0.801, providing a fully-automated CAD performance comparable to top human physicians.


title: Comparing Generic and Community-Situated Crowdsourcing for Data Validation in the Context of Recovery from Substance Use Disorders

abstract: Targeting the right group of workers for crowdsourcing often achieves better quality results. One unique example of targeted crowdsourcing is seeking community-situated workers whose familiarity with the background and the norms of a particular group can help produce better outcome or accuracy. These community-situated crowd workers can be recruited in different ways from generic online crowdsourcing platforms or from online recovery communities. We evaluate three different approaches to recruit generic and community-situated crowd in terms of the time and the cost of recruitment, and the accuracy of task completion. We consider the context of Alcoholics Anonymous (AA), the largest peer support group for recovering alcoholics, and the task of identifying and validating AA meeting information. We discuss the benefits and trade-offs of recruiting paid vs. unpaid community-situated workers and provide implications for future research in the recovery context and relevant domains of HCI, and for design of crowdsourcing ICT systems.


title: A Dual-Store Structure for Knowledge Graphs

abstract: To effectively manage increasing knowledge graphs in various domains, a hot research topic, knowledge graph storage management, has emerged. Existing methods are classified to relational stores and native graph stores. Relational stores are able to store large-scale knowledge graphs and convenient in updating knowledge, but the query performance weakens obviously when the selectivity of a knowledge graph query is large. Native graph stores are efficient in processing complex knowledge graph queries due to its index-free adjacent property, but they are inapplicable to manage a large-scale knowledge graph due to limited storage budgets or inflexible updating process. Motivated by this, we propose a dual-store structure which leverages a graph store to accelerate the complex query process in the relational store. However, it is challenging to determine what data to transfer from relational store to graph store at what time. To address this problem, we formulate it as a Markov Decision Process and derive a physical design tuner DOTIL based on reinforcement learning. With DOTIL, the dual-store structure is adaptive to dynamic changing workloads. Experimental results on real knowledge graphs demonstrate that our proposed dual-store structure improves query performance up to average 43.72% compared with the most commonly used relational stores.


title: Light speed variation from active galactic nuclei

abstract: Recent studies on the high-energy photons from gamma-ray bursts~(GRBs) suggested a light speed variation $v(E)=c(1-E/E_{\mathrm{LV}})$ with $E_\mathrm{LV}=3.6\times 10^{17}$ GeV. We check this speed variation from previous observations on light curves of three active galactic nuclei (AGNs), namely Markarian 421 (Mrk 421), Markarian 501 (Mrk 501) and PKS 2155-304. We show that several phenomena related to the light curves of these AGNs can serve as the supports for the light speed variation determined from GRBs.


title: Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Prediction

abstract: In the Click-Through Rate (CTR) prediction scenario, user's sequential behaviors are well utilized to capture the user interest in the recent literature. However, despite being extensively studied, these sequential methods still suffer from three limitations. First, existing methods mostly utilize attention on the behavior of users, which is not always suitable for CTR prediction, because users often click on new products that are irrelevant to any historical behaviors. Second, in the real scenario, there exist numerous users that have operations a long time ago, but turn relatively inactive in recent times. Thus, it is hard to precisely capture user's current preferences through early behaviors. Third, multiple representations of user's historical behaviors in different feature subspaces are largely ignored. To remedy these issues, we propose a Multi-Interactive Attention Network (MIAN) to comprehensively extract the latent relationship among all kinds of fine-grained features (e.g., gender, age and occupation in user-profile). Specifically, MIAN contains a Multi-Interactive Layer (MIL) that integrates three local interaction modules to capture multiple representations of user preference through sequential behaviors and simultaneously utilize the fine-grained user-specific as well as context information. In addition, we design a Global Interaction Module (GIM) to learn the high-order interactions and balance the different impacts of multiple features. Finally, Offline experiment results from three datasets, together with an Online A/B test in a large-scale recommendation system, demonstrate the effectiveness of our proposed approach.


title: Predicting Generalization in Deep Learning via Local Measures of Distortion

abstract: We study generalization in deep learning by appealing to complexity measures originally developed in approximation and information theory. While these concepts are challenged by the high-dimensional and data-defined nature of deep learning, we show that simple vector quantization approaches such as PCA, GMMs, and SVMs capture their spirit when applied layer-wise to deep extracted features giving rise to relatively inexpensive complexity measures that correlate well with generalization performance. We discuss our results in 2020 NeurIPS PGDL challenge.


title: Completely regular codes in Johnson and Grassmann graphs with small covering radii

abstract: Let L be a Desarguesian 2-spread in the Grassmann graph $J_q(n,2)$. We prove that the collection of the 4-subspaces, which do not contain subspaces from L is a completely regular code in $J_q(n,4)$. Similarly, we construct a completely regular code in the Johnson graph $J(n,6)$ from the Steiner quadruple system of the extended Hamming code. We obtain several new completely regular codes covering radius 1 in the Grassmann graph $J_2(6,3)$ using binary linear programming.


title: Syntactic representation learning for neural network based TTS with syntactic parse tree traversal

abstract: Syntactic structure of a sentence text is correlated with the prosodic structure of the speech that is crucial for improving the prosody and naturalness of a text-to-speech (TTS) system. Nowadays TTS systems usually try to incorporate syntactic structure information with manually designed features based on expert knowledge. In this paper, we propose a syntactic representation learning method based on syntactic parse tree traversal to automatically utilize the syntactic structure information. Two constituent label sequences are linearized through left-first and right-first traversals from constituent parse tree. Syntactic representations are then extracted at word level from each constituent label sequence by a corresponding uni-directional gated recurrent unit (GRU) network. Meanwhile, nuclear-norm maximization loss is introduced to enhance the discriminability and diversity of the embeddings of constituent labels. Upsampled syntactic representations and phoneme embeddings are concatenated to serve as the encoder input of Tacotron2. Experimental results demonstrate the effectiveness of our proposed approach, with mean opinion score (MOS) increasing from 3.70 to 3.82 and ABX preference exceeding by 17% compared with the baseline. In addition, for sentences with multiple syntactic parse trees, prosodic differences can be clearly perceived from the synthesized speeches.


title: fMRI-Kernel Regression: A Kernel-based Method for Pointwise Statistical Analysis of rs-fMRI for Population Studies

abstract: Due to the spontaneous nature of resting-state fMRI (rs-fMRI) signals, cross-subject comparison and therefore, group studies of rs-fMRI are challenging. Most existing group comparison methods use features extracted from the fMRI time series, such as connectivity features, independent component analysis (ICA), and functional connectivity density (FCD) methods. However, in group studies, especially in the case of spectrum disorders, distances to a single atlas or a representative subject do not fully reflect the differences between subjects that may lie on a multi-dimensional spectrum. Moreover, there may not exist an individual subject or even an average atlas in such cases that is representative of all subjects. Here we describe an approach that measures pairwise distances between the synchronized rs-fMRI signals of pairs of subjects instead of to a single reference point. We also present a method for fMRI data comparison that leverages this generated pairwise feature to establish a radial basis function kernel matrix. This kernel matrix is used in turn to perform kernel regression of rs-fMRI to a clinical variable such as a cognitive or neurophysiological performance score of interest. This method opens a new pointwise analysis paradigm for fMRI data. We demonstrate the application of this method by performing a pointwise analysis on the cortical surface using rs-fMRI data to identify cortical regions associated with variability in ADHD index. While pointwise analysis methods are common in anatomical studies such as cortical thickness analysis and voxel- and tensor-based morphometry and its variants, such a method is lacking for rs-fMRI and could improve the utility of rs-fMRI for group studies. The method presented in this paper is aimed at filling this gap.


title: Spontaneous Emotion Recognition from Facial Thermal Images

abstract: One of the key research areas in computer vision addressed by a vast number of publications is the processing and understanding of images containing human faces. The most often addressed tasks include face detection, facial landmark localization, face recognition and facial expression analysis. Other, more specialized tasks such as affective computing, the extraction of vital signs from videos or analysis of social interaction usually require one or several of the aforementioned tasks that have to be performed. In our work, we analyze that a large number of tasks for facial image processing in thermal infrared images that are currently solved using specialized rule-based methods or not solved at all can be addressed with modern learning-based approaches. We have used USTC-NVIE database for training of a number of machine learning algorithms for facial landmark localization.


title: Federated Mimic Learning for Privacy Preserving Intrusion Detection

abstract: Internet of things (IoT) devices are prone to attacks due to the limitation of their privacy and security components. These attacks vary from exploiting backdoors to disrupting the communication network of the devices. Intrusion Detection Systems (IDS) play an essential role in ensuring information privacy and security of IoT devices against these attacks. Recently, deep learning-based IDS techniques are becoming more prominent due to their high classification accuracy. However, conventional deep learning techniques jeopardize user privacy due to the transfer of user data to a centralized server. Federated learning (FL) is a popular privacy-preserving decentralized learning method. FL enables training models locally at the edge devices and transferring local models to a centralized server instead of transferring sensitive data. Nevertheless, FL can suffer from reverse engineering ML attacks that can learn information about the user's data from model. To overcome the problem of reverse engineering, mimic learning is another way to preserve the privacy of ML-based IDS. In mimic learning, a student model is trained with the public dataset, which is labeled with the teacher model that is trained by sensitive user data. In this work, we propose a novel approach that combines the advantages of FL and mimic learning, namely federated mimic learning to create a distributed IDS while minimizing the risk of jeopardizing users' privacy, and benchmark its performance compared to other ML-based IDS techniques using NSL-KDD dataset. Our results show that we can achieve 98.11% detection accuracy with federated mimic learning.


title: Under an Iron Sky: On the Entropy at the Start of the Universe

abstract: Curiously, our Universe was born in a low entropy state, with abundant free energy to power stars and life. The form that this free energy takes is usually thought to be gravitational: the Universe is almost perfectly smooth, and so can produce sources of energy as matter collapses under gravity. It has recently been argued that a more important source of low-entropy energy is nuclear: the Universe expands too fast to remain in nuclear statistical equilibrium (NSE), effectively shutting off nucleosynthesis in the first few minutes, providing leftover hydrogen as fuel for stars. Here, we fill in the astrophysical details of this scenario, and seek the conditions under which a Universe will emerge from early nucleosynthesis as almost-purely iron. In so doing, we identify a hitherto-overlooked character in the story of the origin of the second law: matter-antimatter asymmetry.


title: Symmetry energy investigation with pion production from Sn+Sn systems

abstract: In the past two decades, pions created in the high density regions of heavy ion collisions have been predicted to be sensitive at high densities to the symmetry energy term in the nuclear equation of state, a property that is key to our understanding of neutron stars. In a new experiment designed to study the symmetry energy, the multiplicities of negatively and positively charged pions have been measured with high accuracy for central $^{132}$Sn+$^{124}$Sn, $^{112}$Sn+$^{124}$Sn, and $^{108}$Sn+$^{112}$Sn collisions at $E/A=270~\mathrm{MeV}$ with the S$\pi$RIT Time Projection Chamber. While the uncertainties of individual pion multiplicities are measured to 4\%, those of the charged pion multiplicity ratios are measured to 2\%. We compare these data to predictions from seven major transport models. The calculations reproduce qualitatively the dependence of the multiplicities and their ratios on the total neutron to proton number in the colliding systems. However, the predictions of the transport models from different codes differ too much to allow extraction of reliable constraints on the symmetry energy from the data. This finding may explain previous contradictory conclusions on symmetry energy constraints obtained from pion data in Au+Au system. These new results call for better understanding of the differences among transport codes, and new observables that are more sensitive to the density dependence of the symmetry energy.


title: MVFNet: Multi-View Fusion Network for Efficient Video Recognition

abstract: Conventionally, spatiotemporal modeling network and its complexity are the two most concentrated research topics in video action recognition. Existing state-of-the-art methods have achieved excellent accuracy regardless of the complexity meanwhile efficient spatiotemporal modeling solutions are slightly inferior in performance. In this paper, we attempt to acquire both efficiency and effectiveness simultaneously. First of all, besides traditionally treating H x W x T video frames as space-time signal (viewing from the Height-Width spatial plane), we propose to also model video from the other two Height-Time and Width-Time planes, to capture the dynamics of video thoroughly. Secondly, our model is designed based on 2D CNN backbones and model complexity is well kept in mind by design. Specifically, we introduce a novel multi-view fusion (MVF) module to exploit video dynamics using separable convolution for efficiency. It is a plug-and-play module and can be inserted into off-the-shelf 2D CNNs to form a simple yet effective model called MVFNet. Moreover, MVFNet can be thought of as a generalized video modeling framework and it can specialize to be existing methods such as C2D, SlowOnly, and TSM under different settings. Extensive experiments are conducted on popular benchmarks (i.e., Something-Something V1 & V2, Kinetics, UCF-101, and HMDB-51) to show its superiority. The proposed MVFNet can achieve state-of-the-art performance with 2D CNN's complexity.


title: Largest similar copies of convex polygons amidst polygonal obstacles

abstract: Given a convex polygon $P$ with $k$ vertices and a polygonal domain $Q$ consisting of polygonal obstacles with total size $n$ in the plane, we study the optimization problem of finding a largest similar copy of $P$ that can be placed in $Q$ without intersecting the obstacles. We improve the time complexity for solving the problem to $O(k^2n^2\lambda_4(k)\log{n})$. This is progress of improving the previously best known results by Chew and Kedem [SoCG89, CGTA93] and Sharir and Toledo [SoCG91, CGTA94] on the problem in more than 25 years.


title: Active Feature Selection for the Mutual Information Criterion

abstract: We study active feature selection, a novel feature selection setting in which unlabeled data is available, but the budget for labels is limited, and the examples to label can be actively selected by the algorithm. We focus on feature selection using the classical mutual information criterion, which selects the $k$ features with the largest mutual information with the label. In the active feature selection setting, the goal is to use significantly fewer labels than the data set size and still find $k$ features whose mutual information with the label based on the \emph{entire} data set is large. We explain and experimentally study the choices that we make in the algorithm, and show that they lead to a successful algorithm, compared to other more naive approaches. Our design draws on insights which relate the problem of active feature selection to the study of pure-exploration multi-armed bandits settings. While we focus here on mutual information, our general methodology can be adapted to other feature-quality measures as well. The code is available at the following url: https://github.com/ShacharSchnapp/ActiveFeatureSelection.


title: GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation

abstract: In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures the geometric relationships between depth and surface normals with the proposed depth-to-normal and normal-to-depth modules. In particular, the "depth-to-normal" module exploits the least square solution of estimating surface normals from depth to improve their quality, while the "normal-to-depth" module refines the depth map based on the constraints on surface normals through kernel regression. Boundary information is exploited via an edge-aware refinement module. GeoNet++ effectively predicts depth and surface normals with strong 3D consistency and sharp boundaries resulting in better reconstructed 3D scenes. Note that GeoNet++ is generic and can be used in other depth/normal prediction frameworks to improve the quality of 3D reconstruction and pixel-wise accuracy of depth and surface normals. Furthermore, we propose a new 3D geometric metric (3DGM) for evaluating depth prediction in 3D. In contrast to current metrics that focus on evaluating pixel-wise error/accuracy, 3DGM measures whether the predicted depth can reconstruct high-quality 3D surface normals. This is a more natural metric for many 3D application domains. Our experiments on NYUD-V2 and KITTI datasets verify that GeoNet++ produces fine boundary details, and the predicted depth can be used to reconstruct high-quality 3D surfaces. Code has been made publicly available.


title: Fine-Grained Lineage for Safer Notebook Interactions

abstract: Computational notebooks have emerged as the platform of choice for data science and analytical workflows, enabling rapid iteration and exploration. By keeping intermediate program state in memory and segmenting units of execution into so-called "cells", notebooks allow users to execute their workflows interactively and enjoy particularly tight feedback. However, as cells are added, removed, reordered, and rerun, this hidden intermediate state accumulates in a way that is not necessarily correlated with the notebook's visible code, making execution behavior difficult to reason about, and leading to errors and lack of reproducibility. We present NBSafety, a custom Jupyter kernel that uses runtime tracing and static analysis to automatically manage lineage associated with cell execution and global notebook state. NBSafety detects and prevents errors that users make during unaided notebook interactions, all while preserving the flexibility of existing notebook semantics. We evaluate NBSafety's ability to prevent erroneous interactions by replaying and analyzing 666 real notebook sessions. Of these, NBSafety identified 117 sessions with potential safety errors, and in the remaining 549 sessions, the cells that NBSafety identified as resolving safety issues were more than $7\times$ more likely to be selected by users for re-execution compared to a random baseline, even though the users were not using NBSafety and were therefore not influenced by its suggestions.


title: Radial Deformation Emplacement in Power Transformers Using Long Short-Term Memory Networks

abstract: A power transformer winding is usually subject to mechanical stress and tension because of improper transportation or operation. Radial deformation (RD) is an example of mechanical stress that can impact power transformer operation through short circuit faults and insulation damages. Frequency response analysis (FRA) is a well-known method to diagnose mechanical defects in transformers. Despite the precision of FRA, the interpretation of the calculated frequency response curves is not straightforward and requires complex calculations. In this paper, a deep learning algorithm called long short-term memory (LSTM) is used as a feature extraction technique to locate RD faults in their early stages. The experimental results verify the effectiveness of the proposed method in the diagnosis and locating of RD defects.


title: LEARN++: Recurrent Dual-Domain Reconstruction Network for Compressed Sensing CT

abstract: Compressed sensing (CS) computed tomography has been proven to be important for several clinical applications, such as sparse-view computed tomography (CT), digital tomosynthesis and interior tomography. Traditional compressed sensing focuses on the design of handcrafted prior regularizers, which are usually image-dependent and time-consuming. Inspired by recently proposed deep learning-based CT reconstruction models, we extend the state-of-the-art LEARN model to a dual-domain version, dubbed LEARN++. Different from existing iteration unrolling methods, which only involve projection data in the data consistency layer, the proposed LEARN++ model integrates two parallel and interactive subnetworks to perform image restoration and sinogram inpainting operations on both the image and projection domains simultaneously, which can fully explore the latent relations between projection data and reconstructed images. The experimental results demonstrate that the proposed LEARN++ model achieves competitive qualitative and quantitative results compared to several state-of-the-art methods in terms of both artifact reduction and detail preservation.


title: Using Restricted Boltzmann Machines to Model Molecular Geometries

abstract: Precise physical descriptions of molecules can be obtained by solving the Schrodinger equation; however, these calculations are intractable and even approximations can be cumbersome. Force fields, which estimate interatomic potentials based on empirical data, are also time-consuming. This paper proposes a new methodology for modeling a set of physical parameters by taking advantage of the restricted Boltzmann machine's fast learning capacity and representational power. By training the machine on ab initio data, we can predict new data in the distribution of molecular configurations matching the ab initio distribution. In this paper we introduce a new RBM based on the Tanh activation function, and conduct a comparison of RBMs with different activation functions, including sigmoid, Gaussian, and (Leaky) ReLU. Finally we demonstrate the ability of Gaussian RBMs to model small molecules such as water and ethane.


title: Contrastive Learning for Label-Efficient Semantic Segmentation

abstract: Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have achieved impressive results by using large amounts of labeled training data, their performance drops significantly as the amount of labeled data decreases. This happens because deep CNNs trained with the de facto cross-entropy loss can easily overfit to small amounts of labeled data. To address this issue, we propose a simple and effective contrastive learning-based training strategy in which we first pretrain the network using a pixel-wise, label-based contrastive loss, and then fine-tune it using the cross-entropy loss. This approach increases intra-class compactness and inter-class separability, thereby resulting in a better pixel classifier. We demonstrate the effectiveness of the proposed training strategy using the Cityscapes and PASCAL VOC 2012 segmentation datasets. Our results show that pretraining with the proposed contrastive loss results in large performance gains (more than 20% absolute improvement in some settings) when the amount of labeled data is limited. In many settings, the proposed contrastive pretraining strategy, which does not use any additional data, is able to match or outperform the widely-used ImageNet pretraining strategy that uses more than a million additional labeled images.


title: Two-dimensional pauli equation in noncommutative phase-space

abstract: In this paper, we investigated the Pauli equation in a two-dimensional noncommutative phase-space by considering a constant magnetic field perpendicular to the plane. We mapped the noncommutative problem to the equivalent commutative one through a set of two-dimensional Bopp-shift transformation. The energy spectrum and the wave function of the two-dimensional noncommutative Pauli equation are found, where the problem in question has been mapped to the Landau problem. Further, within the classical limit, we have derived the noncommutative semi-classical partition function of the two-dimensional Pauli system of one-particle and N-particle systems. Consequently, we have studied its thermodynamic properties, i.e. the Helmholtz free energy, mean energy, specific heat and entropy in noncommutative and commutative phase-spaces. The impact of the phase-space noncommutativity on the Pauli system is successfully examined.


title: Estimating Spread of Contact-Based Contagions in a Population Through Sub-Sampling

abstract: Physical contacts result in the spread of various phenomena such as viruses, gossips, ideas, packages and marketing pamphlets across a population. The spread depends on how people move and co-locate with each other, or their mobility patterns. How far such phenomena spread has significance for both policy making and personal decision making, e.g., studying the spread of COVID-19 under different intervention strategies such as wearing a mask. In practice, mobility patterns of an entire population is never available, and we usually have access to location data of a subset of individuals. In this paper, we formalize and study the problem of estimating the spread of a phenomena in a population, given that we only have access to sub-samples of location visits of some individuals in the population. We show that simple solutions such as estimating the spread in the sub-sample and scaling it to the population, or more sophisticated solutions that rely on modeling location visits of individuals do not perform well in practice, the former because it ignores contacts between unobserved individuals and sampled ones and the latter because it yields inaccurate modeling of co-locations. Instead, we directly model the co-locations between the individuals. We introduce PollSpreader and PollSusceptible, two novel approaches that model the co-locations between individuals using a contact network, and infer the properties of the contact network using the subsample to estimate the spread of the phenomena in the entire population. We show that our estimates provide an upper bound and a lower bound on the spread of the disease in expectation. Finally, using a large high-resolution real-world mobility dataset, we experimentally show that our estimates are accurate, while other methods that do not correctly account for co-locations between individuals result in wrong observations (e.g, premature herd-immunity).


title: Remarks on martingale representation theorem for set-valued martingales

abstract: Martingale representation theorem for set-valued martingales was proposed by M. Kisielewicz [J. Math. Anal. Appl. 2014]. We shall prove that the result holds only for very special case: the set-valued martingale degenerates to the point-valued one. A revised representation theorem for a special kind of non-degenerate set-valued martingales is presented.


title: Network Traffic Control for Multi-homed End-hosts via SDN

abstract: Software Defined Networking (SDN) is an emerging technology of efficiently controlling and managing computer networks, such as in data centres, Wide Area Networks (WANs), as well as in ubiquitous communication. In this paper, we explore the idea of embedding the SDN components, represented by SDN controller and virtual switch, in end-hosts to improve network performance. In particular, we consider load balancing across multiple network interfaces on end-hosts with different link capacity scenarios. We have explored and implemented different SDN-based load balancing approaches based on OpenFlow software switches, and have demonstrated the feasibility and the potential of this approach. The proposed system has been evaluated with multipath transmission control protocol (MPTCP). Our results demonstrated the potential of applying the SDN concepts on multi-homed devices resulting in an increase in achieved throughput of 55\% compared to the legacy single network approach and 10\% compared to the MPTCP.


title: A Novel Tool for the Accurate and Affordable Early Diagnosis of Pancreatic Cancer via Machine Learning and Bioinformatics

abstract: Pancreatic cancer (PC) is the fourth leading cause of cancer death in the United States due to its five-year survival rate of 10%. Late diagnosis, affiliated with the asymptomatic nature in early stages and the location of the cancer with respect to the pancreas, makes current widely-accepted screening methods unavailable. Prior studies have achieved low (70-75%) diagnostic accuracy, possibly because 80% of PC cases are associated with diabetes, leading to misdiagnosis. To address the problems of frequent late diagnosis and misdiagnosis, we developed an accessible, accurate and affordable diagnostic tool for PC, by analyzing the expression of nineteen genes in PC and diabetes. First, machine learning algorithms were trained on four groups of subjects, depending on the occurrence of PC and Diabetes. The models were analyzed with 400 PC subjects at varying stages to ensure validity. Naive Bayes, Neural Network and K-Nearest Neighbors models achieved the highest testing accuracy of around 92.6%. Second, the biological implication of the nineteen genes was investigated using bioinformatics tools. It was found that these genes were significantly involved in regulating the cytoplasm, cytoskeleton and nuclear receptor activity in the pancreas, specifically in acinar and ductal cells. Our novel tool is the first in the literature that achieves a PC diagnostic accuracy of above 90%, having the potential to significantly improve the detection of PC in the background of diabetes and increase the five-year survival rate.


title: Intra-cavity field dynamics near avoided mode crossing in concentric silicon nitride ring resonator

abstract: Understanding the intra-cavity field dynamics in passive microresonator systems has already been intriguing. It becomes fascinating when the system is complex, such as a concentric dual microring resonator that exhibit avoided mode crossing (AMC). In this work, we present a systematic study of intra-cavity oscillatory field dynamics near AMC in a concentric silicon nitride microring resonator with the help of the coupled Lugiato-Lefever equation (LLE). We identify two regions viz. weakly coupled region (WCR) and strongly coupled region (SCR) based on eigenfrequency separation of the two-hybrid modes, which originate from mode coupling near AMC. In WCR, the mode coupling effect is dominant, leading to intra-cavity power oscillation between these two modes in a periodic manner and non-identical variation of their phases. In SCR, the mode coupling effect reduces gradually with nearly identical characteristics of both the modes. We further verify our numerical findings with the semi-analytical variational method, leading to an in-depth understanding of the mode coupling induced dynamics. We finally analyze the polarization evolving state, and the polarization locked state with the help of Stokes parameters and Jones vectors in WCR and SCR, respectively.


title: Edge Intelligence for Autonomous Driving in 6G Wireless System: Design Challenges and Solutions

abstract: In a level-5 autonomous driving system, the autonomous driving vehicles (AVs) are expected to sense the surroundings via analyzing a large amount of data captured by a variety of onboard sensors in near-real-time. As a result, enormous computing costs will be introduced to the AVs for processing the tasks with the deployed machine learning (ML) model, while the inference accuracy may not be guaranteed. In this context, the advent of edge intelligence (EI) and sixth-generation (6G) wireless networking are expected to pave the way to more reliable and safer autonomous driving by providing multi-access edge computing (MEC) together with ML to AVs in close proximity. To realize this goal, we propose a two-tier EI-empowered autonomous driving framework. In the autonomous-vehicles tier, the autonomous vehicles are deployed with the shallow layers by splitting the trained deep neural network model. In the edge-intelligence tier, an edge server is implemented with the remaining layers (also deep layers) and an appropriately trained multi-task learning (MTL) model. In particular, obtaining the optimal offloading strategy (including the binary offloading decision and the computational resources allocation) can be formulated as a mixed-integer nonlinear programming (MINLP) problem, which is solved via MTL in near-real-time with high accuracy. On another note, an edge-vehicle joint inference is proposed through neural network segmentation to achieve efficient online inference with data privacy-preserving and less communication delay. Experiments demonstrate the effectiveness of the proposed framework, and open research topics are finally listed.


title: Joint Hardware Design and Capacity Analysis for Intelligent Reflecting Surface Enabled Terahertz MIMO Communications

abstract: Terahertz (THz) communications have been envisioned as a promising enabler to provide ultra-high data transmission for sixth generation (6G) wireless networks. To tackle the blockage vulnerability brought by severe path attenuation and poor diffraction of THz waves, an intelligent reflecting surface (IRS) is put forward to smartly control the incident THz waves by adjusting the phase shifts. In this paper, we firstly design an efficient hardware structure of graphene-based IRS with phase response up to 306.82 degrees. Subsequently, to characterize the capacity of the IRS-enabled THz multiple-input multiple-output (MIMO) system, an adaptive gradient descent (A-GD) algorithm is developed by dynamically updating the step size during the iterative process, which is determined by the second-order Taylor expansion formulation. In contrast with conventional gradient descent (C-GD) algorithm with fixed step size, the A-GD algorithm evidently improves the achievable rate performance. However, both A-GD algorithm and C-GD algorithm inherit the unacceptable complexity. Then a low complexity alternating optimization (AO) algorithm is proposed by alternately optimizing the precoding matrix by a column-by-column (CBC) algorithm and the phase shift matrix of the IRS by a linear search algorithm. Ultimately, the numerical results demonstrate the effectiveness of the designed hardware structure and the considered algorithms.


title: Approximating the two-mode two-photon Rabi model

abstract: The Rabi model describes the simplest nontrivial interaction between a few-level system and a bosonic mode, featuring in multiple seemingly unrelated systems of importance to quantum science and technology. While exact expressions for the energies of this model and its few-mode extensions have been obtained, they involve roots of transcendental functions and are thus cumbersome and unintuitive. Utilizing the symmetric generalized rotating wave approximation (S-GRWA), we develop a family of approximations to the energies of the two-mode two-photon Rabi model. The simplest elements of the family are analytically tractable, providing good approximations in regimes of interest such as ultra- and deep-strong coupling. Higher-order approximate energies can be used if more accuracy is required.


title: Bi-Classifier Determinacy Maximization for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation challenges the problem of transferring knowledge from a well-labelled source domain to an unlabelled target domain. Recently,adversarial learning with bi-classifier has been proven effective in pushing cross-domain distributions close. Prior approaches typically leverage the disagreement between bi-classifier to learn transferable representations, however, they often neglect the classifier determinacy in the target domain, which could result in a lack of feature discriminability. In this paper, we present a simple yet effective method, namely Bi-Classifier Determinacy Maximization(BCDM), to tackle this problem. Motivated by the observation that target samples cannot always be separated distinctly by the decision boundary, here in the proposed BCDM, we design a novel classifier determinacy disparity (CDD) metric, which formulates classifier discrepancy as the class relevance of distinct target predictions and implicitly introduces constraint on the target feature discriminability. To this end, the BCDM can generate discriminative representations by encouraging target predictive outputs to be consistent and determined, meanwhile, preserve the diversity of predictions in an adversarial manner. Furthermore, the properties of CDD as well as the theoretical guarantees of BCDM's generalization bound are both elaborated. Extensive experiments show that BCDM compares favorably against the existing state-of-the-art domain adaptation methods.


title: Momentum-space signatures of Berry flux monopoles in a Weyl semimetal

abstract: Since the early days of Dirac flux quantization, magnetic monopoles have been sought after as a potential corollary of quantized electric charge. As opposed to magnetic monopoles embedded into the theory of electromagnetism, Weyl crystals exhibit Berry flux monopoles in reciprocal parameter space. As a function of crystal momentum, such monopoles locate at the degeneracy point of the Weyl cone. Here, we report momentum-resolved spectroscopic signatures of Berry flux monopoles in TaAs as a paradigmatic Weyl semimetal. We have probed the orbital and spin angular momentum (OAM and SAM) of the Weyl-fermion states by angle-resolved photoemission spectroscopy at bulk-sensitive soft X-ray energies (SX-ARPES) combined with photoelectron spin detection and circular dichroism. Supported by first-principles calculations, our measurements image characteristics of a topologically non-trivial winding of the OAM at the Weyl nodes and unveil a chirality-dependent SAM of the Weyl bands. Our results experimentally visualize the non-trivial momentum-space topology in a Weyl semimetal, promising to have profound implications for the study of quantum-geometric effects in solids.


title: Hereditary cotorsion pairs on extriangulated subcategories

abstract: Let $\mathcal B$ be an extriangulated category with enough projectives and enough injectives. We define a proper $m$-term subcategory $\mathcal G$ on $\mathcal B$, which is an extriangulated subcategory. Then we give a correspondence between cotorsion pairs on $\mathcal G$, support $\tau$-tilting subcategories on an abelian quotient of $\mathcal G$ when $m=2$. If such $\mathcal G$ is induced by a hereditary cotorsion pair, then we give a correspondence between cotorsion pairs on $\mathcal G$ and intermediate cotorsion pairs on $\mathcal B$ under certain assumptions. At last, we study an important property of such extriangulated subcategory $\mathcal G$.


title: Solutions of definable ODEs with regular separation and dichotomy interlacement versus Hardy

abstract: We introduce a notion of regular separation for solutions of systems of ODEs $y'=F(x,y)$, where F is definable in a polynomially bounded o-minimal structure and $y = (y_1,y_2)$. Given a pair of solutions with flat contact, we prove that, if one of them has the property of regular separation, the pair is either interlaced or generates a Hardy field. We adapt this result to trajectories of three-dimensional vector fields with definable coefficients. In the particular case of real analytic vector fields, it improves the dichotomy interlaced/separated of certain integral pencils obtained by F. Cano, R. Moussu and the third author. In this context, we show that the set of trajectories with the regular separation property and asymptotic to a formal invariant curve is never empty and it is represented by a subanalytic set of minimal dimension containing the curve. Finally, we show how to construct examples of formal invariant curves which are transcendental with respect to subanalytic sets, using the so-called (SAT) property introduced by J.-P. Rolin, R. Shaefke and the third author.


title: Thermodynamic properties of the finite-temperature electron gas by the fermionic path integral Monte Carlo method

abstract: The new {\em ab initio} quantum path integral Monte Carlo approach has been developed and applied for the entropy difference calculations for the strongly coupled degenerated uniform electron gas (UEG), a well--known model of simple metals. Calculations have been carried out at finite temperature in canonical ensemble over the wide density and temperature ranges. Obtained data may be crucial for density functional theory. Improvements of the developed approach include the Coulomb and exchange interaction of fermions in the basic Monte Carlo cell and its periodic images and the proper change of variables in the path integral measure. The developed approach shows good agreement with available results for fermions even at temperature four times less than the Fermi energy and practically doesn't suffer from the "fermionic sign problem", which takes place in standard path integral Monte Carlo simulations of degenerate fermionic systems. Presented results include pair distribution functions, isochors and isotherms of pressure, internal energy and entropy change in strongly coupled and degenerate UEG in a wide range of density and temperature.


title: KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning

abstract: Reasoning is a critical ability towards complete visual understanding. To develop machine with cognition-level visual understanding and reasoning abilities, the visual commonsense reasoning (VCR) task has been introduced. In VCR, given a challenging question about an image, a machine must answer correctly and then provide a rationale justifying its answer. The methods adopting the powerful BERT model as the backbone for learning joint representation of image content and natural language have shown promising improvements on VCR. However, none of the existing methods have utilized commonsense knowledge in visual commonsense reasoning, which we believe will be greatly helpful in this task. With the support of commonsense knowledge, complex questions even if the required information is not depicted in the image can be answered with cognitive reasoning. Therefore, we incorporate commonsense knowledge into the cross-modal BERT, and propose a novel Knowledge Enhanced Visual-and-Linguistic BERT (KVL-BERT for short) model. Besides taking visual and linguistic contents as input, external commonsense knowledge extracted from ConceptNet is integrated into the multi-layer Transformer. In order to reserve the structural information and semantic representation of the original sentence, we propose using relative position embedding and mask-self-attention to weaken the effect between the injected commonsense knowledge and other unrelated components in the input sequence. Compared to other task-specific models and general task-agnostic pre-training models, our KVL-BERT outperforms them by a large margin.


title: Dynamics of a quantum phase transition in the Aubry-Andr\'{e}-Harper model with $p$-wave superconductivity

abstract: We investigate the nonequilibrium dynamics of the one-dimension Aubry-Andr\'{e}-Harper model with $p$-wave superconductivity by changing the potential strength with slow and sudden quench. Firstly, we study the slow quench dynamics from localized phase to critical phase by linearly decreasing the potential strength $V$. The localization length is finite and its scaling obeys the Kibble-Zurek mechanism. The results show that the second-order phase transition line shares the same critical exponent $z\nu$, giving the correlation length $\nu=0.997$ and dynamical exponent $z=1.373$, which are different from the Aubry-Andr\'{e} model. Secondly, we also study the sudden quench dynamics between three different phases: localized phase, critical phase, and extended phase. In the limit of $V=0$ and $V=\infty$, we analytically study the sudden quench dynamics via the Loschmidt echo. The results suggest that, if the initial state and the post-quench Hamiltonian are in different phases, the Loschmidt echo vanishes at some time intervals. Furthermore, we found that, if the initial value is in the critical phase, the direction of the quench is the same as one of the two limits mentioned before, and similar behaviors will occur.


title: Effective multi-view registration of point sets based on student's t mixture model

abstract: Recently, Expectation-maximization (EM) algorithm has been introduced as an effective means to solve multi-view registration problem. Most of the previous methods assume that each data point is drawn from the Gaussian Mixture Model (GMM), which is difficult to deal with the noise with heavy-tail or outliers. Accordingly, this paper proposed an effective registration method based on Student's t Mixture Model (StMM). More specially, we assume that each data point is drawn from one unique StMM, where its nearest neighbors (NNs) in other point sets are regarded as the t-distribution centroids with equal covariances, membership probabilities, and fixed degrees of freedom. Based on this assumption, the multi-view registration problem is formulated into the maximization of the likelihood function including all rigid transformations. Subsequently, the EM algorithm is utilized to optimize rigid transformations as well as the only t-distribution covariance for multi-view registration. Since only a few model parameters require to be optimized, the proposed method is more likely to obtain the desired registration results. Besides, all t-distribution centroids can be obtained by the NN search method, it is very efficient to achieve multi-view registration. What's more, the t-distribution takes the noise with heavy-tail into consideration, which makes the proposed method be inherently robust to noises and outliers. Experimental results tested on benchmark data sets illustrate its superior performance on robustness and accuracy over state-of-the-art methods.


title: Entanglement preparation and non-reciprocal excitation evolution in giant atoms by controllable dissipation and coupling

abstract: We investigate the dynamics of giant atom(s) in a waveguide QED scenario, where the atom couples to the coupled resonator waveguide via two sites. For a single giant atom setup, we find that the atomic dissipation rate can be adjusted by tuning its size. For the two giant atoms system, the waveguide will induce the controllable individual and collective dissipation as well as effective inter-atom coupling. As a result, we can theoretically realize the robust entangled state preparation and non-reciprocal excitation evolution. We hope our study can be applied in quantum information processing based on photonic and acoustic waveguide setup.


title: C2C-GenDA: Cluster-to-Cluster Generation for Data Augmentation of Slot Filling

abstract: Slot filling, a fundamental module of spoken language understanding, often suffers from insufficient quantity and diversity of training data. To remedy this, we propose a novel Cluster-to-Cluster generation framework for Data Augmentation (DA), named C2C-GenDA. It enlarges the training set by reconstructing existing utterances into alternative expressions while keeping semantic. Different from previous DA works that reconstruct utterances one by one independently, C2C-GenDA jointly encodes multiple existing utterances of the same semantics and simultaneously decodes multiple unseen expressions. Jointly generating multiple new utterances allows to consider the relations between generated instances and encourages diversity. Besides, encoding multiple existing utterances endows C2C with a wider view of existing expressions, helping to reduce generation that duplicates existing data. Experiments on ATIS and Snips datasets show that instances augmented by C2C-GenDA improve slot filling by 7.99 (11.9%) and 5.76 (13.6%) F-scores respectively, when there are only hundreds of training utterances.


title: Predicting Software Effort from Use Case Points: A Systematic Review

abstract: Context: Predicting software project effort from Use Case Points (UCP) method is increasingly used among researchers and practitioners. However, unlike other effort estimation domains, this area of interest has not been systematically reviewed. Aims: There is a need for a systemic literature review to provide directions and supports for this research area of effort estimation. Specifically, the objective of this study is twofold: to classify UCP effort estimation papers based on four criteria: contribution type, research approach, dataset type and techniques used with UCP; and to analyze these papers from different views: estimation accuracy, favorable estimation context and impact of combined techniques on the accuracy of UCP. Method: We used the systematic literature review methodology proposed by Kitchenham and Charters. This includes searching for the most relevant papers, selecting quality papers, extracting data and drawing results. Result: The authors of UCP research paper, are generally not aware of previous published results and conclusions in the field of UCP effort estimation. There is a lack of UCP related publications in the top software engineering journals. This makes a conclusion that such papers are not useful for the community. Furthermore, most articles used small numbers of projects which cannot support generalizing the conclusion in most cases. Conclusions: There are multiple research directions for UCP method that have not been examined so far such as validating the algebraic construction of UCP based on industrial data. Also, there is a need for standard automated tools that govern the process of translating use case diagram into its corresponding UCP metrics. Although there is an increase interest among researchers to collect industrial data and build effort prediction models based on machine learning methods, the quality of data is still subject to debate


title: DeepSweep: An Evaluation Framework for Mitigating DNN Backdoor Attacks using Data Augmentation

abstract: Public resources and services (e.g., datasets, training platforms, pre-trained models) have been widely adopted to ease the development of Deep Learning-based applications. However, if the third-party providers are untrusted, they can inject poisoned samples into the datasets or embed backdoors in those models. Such an integrity breach can cause severe consequences, especially in safety- and security-critical applications. Various backdoor attack techniques have been proposed for higher effectiveness and stealthiness. Unfortunately, existing defense solutions are not practical to thwart those attacks in a comprehensive way. In this paper, we investigate the effectiveness of data augmentation techniques in mitigating backdoor attacks and enhancing DL models' robustness. An evaluation framework is introduced to achieve this goal. Specifically, we consider a unified defense solution, which (1) adopts a data augmentation policy to fine-tune the infected model and eliminate the effects of the embedded backdoor; (2) uses another augmentation policy to preprocess input samples and invalidate the triggers during inference. We propose a systematic approach to discover the optimal policies for defending against different backdoor attacks by comprehensively evaluating 71 state-of-the-art data augmentation functions. Extensive experiments show that our identified policy can effectively mitigate eight different kinds of backdoor attacks and outperform five existing defense methods. We envision this framework can be a good benchmark tool to advance future DNN backdoor studies.


title: Split then Refine: Stacked Attention-guided ResUNets for Blind Single Image Visible Watermark Removal

abstract: Digital watermark is a commonly used technique to protect the copyright of medias. Simultaneously, to increase the robustness of watermark, attacking technique, such as watermark removal, also gets the attention from the community. Previous watermark removal methods require to gain the watermark location from users or train a multi-task network to recover the background indiscriminately. However, when jointly learning, the network performs better on watermark detection than recovering the texture. Inspired by this observation and to erase the visible watermarks blindly, we propose a novel two-stage framework with a stacked attention-guided ResUNets to simulate the process of detection, removal and refinement. In the first stage, we design a multi-task network called SplitNet. It learns the basis features for three sub-tasks altogether while the task-specific features separately use multiple channel attentions. Then, with the predicted mask and coarser restored image, we design RefineNet to smooth the watermarked region with a mask-guided spatial attention. Besides network structure, the proposed algorithm also combines multiple perceptual losses for better quality both visually and numerically. We extensively evaluate our algorithm over four different datasets under various settings and the experiments show that our approach outperforms other state-of-the-art methods by a large margin. The code is available at http://github.com/vinthony/deep-blind-watermark-removal.


title: Product Differentiation and Geographical Expansion of Exports Network at Industry level

abstract: Industries can enter one country first, and then enter its neighbors' markets. Firms in the industry can expand trade network through the export behavior of other firms in the industry. If a firm is dependent on a few foreign markets, the political risks of the markets will hurt the firm. The frequent trade disputes reflect the importance of the choice of export destinations. Although the market diversification strategy was proposed before, most firms still focus on a few markets, and the paper shows reasons.In this paper, we assume the entry cost of firms is not all sunk cost, and show 2 ways that product heterogeneity impacts extensive margin of exports theoretically and empirically. Firstly, the increase in product heterogeneity promotes the increase in market power and profit, and more firms are able to pay the entry cost. If more firms enter the market, the information of the market will be known by other firms in the industry. Firms can adjust their behavior according to other firms, so the information changes entry cost and is not sunk cost completely. The information makes firms more likely to entry the market, and enter the surrounding markets of existing markets of other firms in the industry. When firms choose new markets, they tend to enter the markets with few competitors first.Meanwhile, product heterogeneity will directly affect the firms' network expansion, and the reduction of product heterogeneity will increase the value of peer information. This makes firms more likely to entry the market, and firms in the industry concentrate on the markets.


title: Data-Driven Dispatchable Regions with Potentially Active Boundaries for Renewable Power Generation: Concept and Construction

abstract: The dispatchable region of volatile renewable power generation (RPG) quantifies how much uncertainty the power system can handle at a given operating point. State-of-the-art dispatchable region (DR) research has studied how system operational constraints influence the DR but has seldom considered the effect of the uncertainty features of RPG outputs. The traditional DR is generally described by a large number of boundaries, and it is computationally intensive to construct. To bridge these gaps, a novel type of DR is defined, which is enclosed by potentially active boundaries (PABs) that consider the operational constraints and uncertainty features of RPG outputs. The proposed DR is easier to construct because the PABs are only a small part of the traditional DR boundaries. The procedure for constructing the proposed DR is described in terms of the progressive search for PABs, which is formulated as a mixed-integer linear program by incorporating the discrete observed data points of RPG outputs as an approximate distribution. A parallel solution paradigm is also developed to expedite the construction procedure when using a large observed dataset. Simulation tests on the IEEE 30-bus and 118-bus systems verify the effectiveness and scalability of the proposed DR and the efficiency of the proposed algorithm.


title: Lattice dynamics of KAgF3 perovskite, unique 1D antiferromagnet

abstract: Theoretical DFT calculations using GGA+U and HSE06 frameworks enabled vibrational mode assignment and partial (atomic) phonon DOS determination in KAgF3 perovskite, a low-dimensional magnetic fluoroargentate(II). Twelve bands in the spectra of KAgF3 were assigned to either IR active or Raman active modes, reaching very good correlation with experimental values (R2>0.997). Low-temperature Raman measurements indicate that the intriguing spin-Peierls-like phase transition at 230 K is an order-disorder transition and it does not strongly impact the vibrational structure of the material.


title: Context-Enhanced Entity and Relation Embedding for Knowledge Graph Completion

abstract: Most researches for knowledge graph completion learn representations of entities and relations to predict missing links in incomplete knowledge graphs. However, these methods fail to take full advantage of both the contextual information of entity and relation. Here, we extract contexts of entities and relations from the triplets which they compose. We propose a model named AggrE, which conducts efficient aggregations respectively on entity context and relation context in multi-hops, and learns context-enhanced entity and relation embeddings for knowledge graph completion. The experiment results show that AggrE is competitive to existing models.


title: Relative roles of multiple scattering and Fresnel diffraction in the imaging of small molecules using electrons, Part II: Differential Holographic Tomography

abstract: It has been argued that in atomic-resolution transmission electron microscopy (TEM) of sparse weakly scattering structures, such as small biological molecules, multiple electron scattering usually has only a small effect, while the in-molecule Fresnel diffraction can be significant due to the intrinsically shallow depth of focus. These facts suggest that the three-dimensional reconstruction of such structures from defocus image series collected at multiple rotational orientations of a molecule can be effectively performed for each atom separately, using the incoherent first Born approximation. The corresponding reconstruction method, termed here Differential Holographic Tomography, is developed theoretically and demonstrated computationally on several numerical models of biological molecules. It is shown that the method is capable of accurate reconstruction of the locations of atoms in a molecule from TEM data collected at a small number of random orientations of the molecule, with one or more defocus images per orientation. Possible applications to cryogenic electron microscopy and other areas are briefly discussed.


title: Optimization and Learning With Nonlocal Calculus

abstract: Nonlocal models have recently had a major impact in nonlinear continuum mechanics and are used to describe physical systems/processes which cannot be accurately described by classical, calculus based "local" approaches. In part, this is due to their multiscale nature that enables aggregation of micro-level behavior to obtain a macro-level description of singular/irregular phenomena such as peridynamics, crack propagation, anomalous diffusion and transport phenomena. At the core of these models are nonlocal differential operators, including nonlocal analogs of the gradient/Hessian. This paper initiates the use of such nonlocal operators in the context of optimization and learning. We define and analyze the convergence properties of nonlocal analogs of (stochastic) gradient descent and Newton's method on Euclidean spaces. Our results indicate that as the nonlocal interactions become less noticeable, the optima corresponding to nonlocal optimization converge to the "usual" optima. At the same time, we argue that nonlocal learning is possible in situations where standard calculus fails. As a stylized numerical example of this, we consider the problem of non-differentiable parameter estimation on a non-smooth translation manifold and show that our nonlocal gradient descent recovers the unknown translation parameter from a non-differentiable objective function.


title: Variational Quantum algorithm for Poisson equation

abstract: The Poisson equation has wide applications in many areas of science and engineering. Although there are some quantum algorithms that can efficiently solve the Poisson equation, they generally require a fault-tolerant quantum computer which is beyond the current technology. In this paper, we propose a Variational Quantum Algorithm (VQA) to solve the Poisson equation, which can be executed on Noise Intermediate-Scale Quantum (NISQ) devices. In detail, we first adopt the finite difference method to transform the Poisson equation into a linear system. Then, according to the special structure of the linear system, we find an explicit tensor product decomposition, with only $2\log n+1$ items, of its coefficient matrix under a specific set of simple operators, where $n$ is the dimension of the coefficient matrix. This implies that the proposed VQA only needs $O(\log n)$ measurements, which dramatically reduce quantum resources. Additionally, we perform quantum Bell measurements to efficiently evaluate the expectation values of simple operators. Numerical experiments demonstrate that our algorithm can effectively solve the Poisson equation.


title: Geodesic orbit metrics on homogeneous spaces constructed by strongly isotropy irreducible spaces

abstract: In this paper, we focus on homogeneous spaces which are constructed from two strongly isotropy irreducible spaces, and prove that any geodesic orbit metric on these spaces is naturally reductive.


title: Status of the MUonE experiment

abstract: The MUonE experiment aims at an independent and very precise determination of the leading hadronic contribution to the muon magnetic moment, based on an alternative method, complementary to the existing ones. This can be achieved by measuring with unprecedented precision the shape of the differential cross section of $\mu e$ elastic scattering, using the intense muon beam available at CERN, with energy of 150 GeV, off atomic electrons of a light target. The status of the project is presented, with recent results in preparation for the test run scheduled in 2021 with a reduced detector.


title: Peristalsis by pulses of activity

abstract: Peristalsis by actively generated waves of muscle contraction is one of the most fundamental ways of producing motion in living systems. We show that peristalsis can be modeled by a train of rectangular-shaped solitary waves of localized activity propagating through otherwise passive matter. Our analysis is based on the FPU-type discrete model accounting for active stresses and we reveal the existence in this problem of a critical regime which we argue to be physiologically advantageous.


title: Maximal intersections in finite groups

abstract: For a finite group $G$, we investigate the behaviour of four invariants, $\text{MaxDim}(G),$ $\text{MinDim}(G),$ $\text{MaxInt}(G)$ and $\text{MinInt}(G),$ measuring in some way the width and the height of the lattice $\mathcal M(G)$ consisting of the intersections of the maximal subgroups of $G.$


title: Iterative Utterance Segmentation for Neural Semantic Parsing

abstract: Neural semantic parsers usually fail to parse long and complex utterances into correct meaning representations, due to the lack of exploiting the principle of compositionality. To address this issue, we present a novel framework for boosting neural semantic parsers via iterative utterance segmentation. Given an input utterance, our framework iterates between two neural modules: a segmenter for segmenting a span from the utterance, and a parser for mapping the span into a partial meaning representation. Then, these intermediate parsing results are composed into the final meaning representation. One key advantage is that this framework does not require any handcraft templates or additional labeled data for utterance segmentation: we achieve this through proposing a novel training method, in which the parser provides pseudo supervision for the segmenter. Experiments on Geo, ComplexWebQuestions, and Formulas show that our framework can consistently improve performances of neural semantic parsers in different domains. On data splits that require compositional generalization, our framework brings significant accuracy gains: Geo 63.1 to 81.2, Formulas 59.7 to 72.7, ComplexWebQuestions 27.1 to 56.3.


title: Inter-orbital nematicity and the origin of a single electron Fermi pocket in FeSe

abstract: The electronic structure of the enigmatic iron-based superconductor FeSe has puzzled researchers since spectroscopic probes failed to observe the expected electron pocket at the $Y$ point in the 1-Fe Brillouin zone. It has been speculated that this pocket, essential for an understanding of the superconducting state, is either absent or incoherent. Here, we perform a theoretical study of the preferred nematic order originating from nearest-neighbor Coulomb interactions in an electronic model relevant for FeSe. We find that at low temperatures the dominating nematic components are of inter-orbital $d_{xz}-d_{xy}$ and $d_{yz}-d_{xy}$ character, with spontaneously broken amplitudes for these two components. This inter-orbital nematic order naturally leads to distinct hybridization gaps at the $X$ and $Y$ points of the 1-Fe Brillouin zone, and may thereby produce highly anisotropic Fermi surfaces with only a single electron pocket at one of these momentum-space locations. The associated superconducting gap structure obtained with the generated low-energy electronic band structure from spin-fluctuation mediated pairing agrees well with that measured experimentally. Finally, from a comparison of the computed spin susceptibility to available neutron scattering data, we discuss the necessity of additional self-energy effects, and explore the role of orbital-dependent quasiparticle weights as a minimal means to include them.