title: New Estimates for the Numerical Radius

abstract: In this article, we present new inequalities for the numerical radius of the sum of two Hilbert space operators. These new inequalities will enable us to obtain many generalizations and refinements of some well known inequalities, including multiplicative behavior of the numerical radius and norm bounds. Among many other applications, it is shown that if $T$ is accretive-dissipative, then \[\frac{1}{\sqrt{2}}\left\| T \right\|\le \omega \left( T \right),\] where $\omega \left( \cdot \right)$ and $\left\| \cdot \right\|$ denote the numerical radius and the usual operator norm, respectively. This inequality provides a considerable refinement of the well known inequality $\frac{1}{2}\|T\|\leq \omega(T).$


title: Adding Chit-Chat to Enhance Task-Oriented Dialogues

abstract: Existing dialogue corpora and models are typically designed under two disjoint motives: while task-oriented systems focus on achieving functional goals (e.g., booking hotels), open-domain chatbots aim at making socially engaging conversations. In this work, we propose to integrate both types of systems by Adding Chit-Chat to ENhance Task-ORiented dialogues (ACCENTOR), with the goal of making virtual assistant conversations more engaging and interactive. Specifically, we propose a Human <-> AI collaborative data collection approach for generating diverse chit-chat responses to augment task-oriented dialogues with minimal annotation effort. We then present our new chit-chat-based annotations to 23.8K dialogues from two popular task-oriented datasets (Schema-Guided Dialogue and MultiWOZ 2.1) and demonstrate their advantage over the originals via human evaluation. Lastly, we propose three new models for adding chit-chat to task-oriented dialogues, explicitly trained to predict user goals and to generate contextually relevant chit-chat responses. Automatic and human evaluations show that, compared with the state-of-the-art task-oriented baseline, our models can code-switch between task and chit-chat to be more engaging, interesting, knowledgeable, and humanlike, while maintaining competitive task performance.


title: NUANCED: Natural Utterance Annotation for Nuanced Conversation with Estimated Distributions

abstract: Existing conversational systems are mostly agent-centric, which assumes the user utterances would closely follow the system ontology (for NLU or dialogue state tracking). However, in real-world scenarios, it is highly desirable that the users can speak freely in their own way. It is extremely hard, if not impossible, for the users to adapt to the unknown system ontology. In this work, we attempt to build a user-centric dialogue system. As there is no clean mapping for a user's free form utterance to an ontology, we first model the user preferences as estimated distributions over the system ontology and map the users' utterances to such distributions. Learning such a mapping poses new challenges on reasoning over existing knowledge, ranging from factoid knowledge, commonsense knowledge to the users' own situations. To this end, we build a new dataset named NUANCED that focuses on such realistic settings for conversational recommendation. Collected via dialogue simulation and paraphrasing, NUANCED contains 5.1k dialogues, 26k turns of high-quality user responses. We conduct experiments, showing both the usefulness and challenges of our problem setting. We believe NUANCED can serve as a valuable resource to push existing research from the agent-centric system to the user-centric system. The code and data is publicly available at \url{https://github.com/facebookresearch/nuanced}.


title: Symmetric correspondences with decomposable minimal equation

abstract: We study symmetric correspondences with completely decomposable minimal equation on smooth projective curves $C$. The Jacobian of $C$ then decomposes correspondingly. For all positive integers $g$ and $\ell$, we give series of examples of smooth curves $C$ of genus $n^\ell (g-1) +1$ with correspondences satisfying minimal equations of degree $\ell+1$ such that the Jacobian of $C$ has at least $2^\ell$ isogeny components.


title: Dataset Dynamics via Gradient Flows in Probability Space

abstract: Various machine learning tasks, from generative modeling to domain adaptation, revolve around the concept of dataset transformation and manipulation. While various methods exist for transforming unlabeled datasets, principled methods to do so for labeled (e.g., classification) datasets are missing. In this work, we propose a novel framework for dataset transformation, which we cast as optimization over data-generating joint probability distributions. We approach this class of problems through Wasserstein gradient flows in probability space, and derive practical and efficient particle-based methods for a flexible but well-behaved class of objective functions. Through various experiments, we show that this framework can be used to impose constraints on classification datasets, adapt them for transfer learning, or to re-purpose fixed or black-box models to classify -- with high accuracy -- previously unseen datasets.


title: Mechanism Design for Stable Matching with Contracts in a Dynamic Manufacturing-as-a-Service (MaaS) Marketplace

abstract: Two-sided manufacturing-as-a-service (MaaS) marketplaces connect clients requesting manufacturing services to suppliers providing those services. Matching mechanisms i.e. allocation of clients' orders to suppliers is a key design parameter of the marketplace platform. The platform might perform an allocation to maximize its revenue or optimize for social welfare of all participants. However, individual participants might not get maximum value from their match and reject it to form matches (called blocking groups) themselves, thereby bypassing the platform. This paper considers the bipartite matching problem in MaaS marketplaces in a dynamic environment and proposes approximately stable matching solutions using mechanism design and mathematical programming approaches to limit the formation of blocking groups. Matching is based on non-strict, incomplete and interdependent preferences of participants over contracts enabling negotiations between both sides. Empirical simulations are used to test the mechanisms in a simulated 3D printing marketplace and to evaluate the impact of stability on its performance. It is found that stable matching results in small degradation in social welfare of the marketplace. However, it leads to a significantly better outcome in terms of stability of allocation. Unstable matchings introduce anarchy into marketplace with participants rejecting its allocation leading to performance poorer than stable matchings.


title: Measuring Association Between Labels and Free-Text Rationales

abstract: In interpretable NLP, we require faithful rationales that reflect the model's decision-making process for an explained instance. While prior work focuses on extractive rationales (a subset of the input words), we investigate their less-studied counterpart: free-text natural language rationales. We demonstrate that pipelines, existing models for faithful extractive rationalization on information-extraction style tasks, do not extend as reliably to "reasoning" tasks requiring free-text rationales. We turn to models that jointly predict and rationalize, a class of widely used high-performance models for free-text rationalization whose faithfulness is not yet established. We define label-rationale association as a necessary property for faithfulness: the internal mechanisms of the model producing the label and the rationale must be meaningfully correlated. We propose two measurements to test this property: robustness equivalence and feature importance agreement. We find that state-of-the-art T5-based joint models exhibit both properties for rationalizing commonsense question-answering and natural language inference, indicating their potential for producing faithful free-text rationales.


title: Federated Bandit: A Gossiping Approach

abstract: In this paper, we study \emph{Federated Bandit}, a decentralized Multi-Armed Bandit problem with a set of $N$ agents, who can only communicate their local data with neighbors described by a connected graph $G$. Each agent makes a sequence of decisions on selecting an arm from $M$ candidates, yet they only have access to local and potentially biased feedback/evaluation of the true reward for each action taken. Learning only locally will lead agents to sub-optimal actions while converging to a no-regret strategy requires a collection of distributed data. Motivated by the proposal of federated learning, we aim for a solution with which agents will never share their local observations with a central entity, and will be allowed to only share a private copy of his/her own information with their neighbors. We first propose a decentralized bandit algorithm Gossip_UCB, which is a coupling of variants of both the classical gossiping algorithm and the celebrated Upper Confidence Bound (UCB) bandit algorithm. We show that Gossip_UCB successfully adapts local bandit learning into a global gossiping process for sharing information among connected agents, and achieves guaranteed regret at the order of $O(\max\{ \texttt{poly}(N,M) \log T, \texttt{poly}(N,M)\log_{\lambda_2^{-1}} N\})$ for all $N$ agents, where $\lambda_2\in(0,1)$ is the second largest eigenvalue of the expected gossip matrix, which is a function of $G$. We then propose Fed_UCB, a differentially private version of Gossip_UCB, in which the agents preserve $\epsilon$-differential privacy of their local data while achieving $O(\max \{\frac{\texttt{poly}(N,M)}{\epsilon}\log^{2.5} T, \texttt{poly}(N,M) (\log_{\lambda_2^{-1}} N + \log T) \})$ regret.


title: Modular Networks for Compositional Instruction Following

abstract: Standard architectures used in instruction following often struggle on novel compositions of subgoals (e.g. navigating to landmarks or picking up objects) observed during training. We propose a modular architecture for following natural language instructions that describe sequences of diverse subgoals. In our approach, subgoal modules each carry out natural language instructions for a specific subgoal type. A sequence of modules to execute is chosen by learning to segment the instructions and predicting a subgoal type for each segment. When compared to standard, non-modular sequence-to-sequence approaches on ALFRED, a challenging instruction following benchmark, we find that modularization improves generalization to novel subgoal compositions, as well as to environments unseen in training.


title: An Inexact Accelerated Stochastic ADMM for Separable Convex Optimization

abstract: An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a possibly nonsmooth convex function and a smooth function which is an average of many component convex functions. Problems having this structure often arise in machine learning and data mining applications. AS-ADMM combines the ideas of both ADMM and the stochastic gradient methods using variance reduction techniques. One of the ADMM subproblems employs a linearization technique while a similar linearization could be introduced for the other subproblem. For a specified choice of the algorithm parameters, it is shown that the objective error and the constraint violation are $\mathcal{O}(1/k)$ relative to the number of outer iterations $k$. Under a strong convexity assumption, the expected iterate error converges to zero linearly. A linearized variant of AS-ADMM and incremental sampling strategies are also discussed. Numerical experiments with both stochastic and deterministic ADMM algorithms show that AS-ADMM can be particularly effective for structured optimization arising in big data applications.


title: X-TaSNet: Robust and Accurate Time-Domain Speaker Extraction Network

abstract: Extracting the speech of a target speaker from mixed audios, based on a reference speech from the target speaker, is a challenging yet powerful technology in speech processing. Recent studies of speaker-independent speech separation, such as TasNet, have shown promising results by applying deep neural networks over the time-domain waveform. Such separation neural network does not directly generate reliable and accurate output when target speakers are specified, because of the necessary prior on the number of speakers and the lack of robustness when dealing with audios with absent speakers. In this paper, we break these limitations by introducing a new speaker-aware speech masking method, called X-TaSNet. Our proposal adopts new strategies, including a distortion-based loss and corresponding alternating training scheme, to better address the robustness issue. X-TaSNet significantly enhances the extracted speech quality, doubling SDRi and SI-SNRi of the output speech audio over state-of-the-art voice filtering approach. X-TaSNet also improves the reliability of the results by improving the accuracy of speaker identity in the output audio to 95.4%, such that it returns silent audios in most cases when the target speaker is absent. These results demonstrate X-TaSNet moves one solid step towards more practical applications of speaker extraction technology.


title: Impurity in a Fermi gas under non-Hermitian spin-orbit coupling

abstract: We study the fate of an impurity in a two-component, non-interacting Fermi gas under a non- Hermitian spin-orbit coupling (SOC) which is generated by dissipative Raman lasers. While SOC mixes the two spin species in the Fermi gas thus modifies the single-particle dispersions, we consider the case where the impurity only interacts with one of the spin species. As a result, spectral properties of the impurity constitute an ideal probe to the dissipative Fermi gas in the background. In particular, we show that dissipation destabilizes polarons in favor of molecular formation, consistent with previous few-body studies. The dissipative nature of the Fermi gas further leads to broadened peaks in the inverse radio-frequency spectra for both the attractive and repulsive polaron branches, which could serve as signals for experimental observation. Our results provides an exemplary scenario where the interplay of non-Hermiticity and interaction can be probed.


title: Artificial Neural Network Modeling of the Conformable Fractional Isothermal Gas Spheres

abstract: The isothermal gas sphere is a particular type of Lane-Emden equation and is used widely to model many problems in astrophysics like stars, star clusters, and the formation of galaxies. In this paper, we present a computational scheme to simulate the conformable fractional isothermal gas sphere using an artificial neural network (ANN) technique and compare the obtained results with the analytical solution deduced using the Taylor series. We performed our calculations, trained the ANN, and tested it using a wide range of the fractional parameter. Besides the Emden functions, we calculated the mass-radius relations and the density profiles of the fractional isothermal gas spheres. The results obtained provided that ANN could perfectly simulate the conformable fractional isothermal gas spheres.


title: Diverse R-PPG: Camera-Based Heart Rate Estimation for Diverse Subject Skin-Tones and Scenes

abstract: Heart rate (HR) is an essential clinical measure for the assessment of cardiorespiratory instability. Since communities of color are disproportionately affected by both COVID-19 and cardiovascular disease, there is a pressing need to deploy contactless HR sensing solutions for high-quality telemedicine evaluations. Existing computer vision methods that estimate HR from facial videos exhibit biased performance against dark skin tones. We present a novel physics-driven algorithm that boosts performance on darker skin tones in our reported data. We assess the performance of our method through the creation of the first telemedicine-focused remote vital signs dataset, the VITAL dataset. 432 videos (~864 minutes) of 54 subjects with diverse skin tones are recorded under realistic scene conditions with corresponding vital sign data. Our method reduces errors due to lighting changes, shadows, and specular highlights and imparts unbiased performance gains across skin tones, setting the stage for making medically inclusive non-contact HR sensing technologies a viable reality for patients of all skin tones.


title: Conversational Semantic Parsing for Dialog State Tracking

abstract: We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic compositionality, cross-domain knowledge sharing and co-reference. We present TreeDST, a dataset of 27k conversations annotated with tree-structured dialog states and system acts. We describe an encoder-decoder framework for DST with hierarchical representations, which leads to 20% improvement over state-of-the-art DST approaches that operate on a flat meaning space of slot-value pairs.


title: On Learning Text Style Transfer with Direct Rewards

abstract: In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly consider different aspects of the style-transferred outputs. In particular, we leverage semantic similarity metrics originally used for fine-tuning neural machine translation models to explicitly assess the preservation of content between system outputs and input texts. We also investigate the potential weaknesses of the existing automatic metrics and propose efficient strategies of using these metrics for training. The experimental results show that our model provides significant gains in both automatic and human evaluation over strong baselines, indicating the effectiveness of our proposed methods and training strategies.


title: New hybrid control of a 2 DoF Robot Arm

abstract: Robot arms have been using in different systems, which the control of designed in desired trajectory is the main task. Also, it is anticipated that while in operation the developed 2DoF robot arm will be constantly encountered with noises such as friction forces. A new integral sliding mode control (NISMC) is therefore being introduced to suppress noise due to its robustness. Then, New hybrid control system (NHISMC) is proposed, which constantly calculates an error value and applies a correction value to the system. This will enhance trajectory and minimize tracking error. In comparison with two other controllers, such as traditional sliding mode control (SMC) and NISMC, experimental results confirmed the efficacy of the proposed control method.


title: Structure-Grounded Pretraining for Text-to-SQL

abstract: Learning to capture text-table alignment is essential for tasks like text-to-SQL. A model needs to correctly recognize natural language references to columns and values and to ground them in the given database schema. In this paper, we present a novel weakly supervised Structure-Grounded pretraining framework (StruG) for text-to-SQL that can effectively learn to capture text-table alignment based on a parallel text-table corpus. We identify a set of novel prediction tasks: column grounding, value grounding and column-value mapping, and leverage them to pretrain a text-table encoder. Additionally, to evaluate different methods under more realistic text-table alignment settings, we create a new evaluation set Spider-Realistic based on Spider dev set with explicit mentions of column names removed, and adopt eight existing text-to-SQL datasets for cross-database evaluation. STRUG brings significant improvement over BERT-LARGE in all settings. Compared with existing pretraining methods such as GRAPPA, STRUG achieves similar performance on Spider, and outperforms all baselines on more realistic sets. The Spider-Realistic dataset is available at https://doi.org/10.5281/zenodo.5205322.


title: New compound fractional sliding mode control and super-twisting control of a MEMS gyroscope

abstract: In this research we propose a new compound Fractional Order Sliding Mode Controller (FOSMC) and SuperTwisting Controller (FOSMC+STC) to control of a MEMS gyroscope. A new sliding mode surface has been defined to design the proposed new sliding mode controller. The main advantages of a FOSMC is its high tracking performance and robustness against external perturbation, but it is susceptible to chattering. By augmenting a STC with a FOSMC, the chattering phenomenon is eliminated, singularity problem is solved and systems robustness has significatnetly improved. Simulation results validate the effectiveness of the proposed control approach.


title: The Discovery of Tunable Universality Class in Superconducting $\beta$-W Thin Films

abstract: The interplay between quenched disorder and critical behavior in quantum phase transitions is conceptually fascinating and of fundamental importance for understanding phase transitions. However, it is still unclear whether or not the quenched disorder influences the universality class of quantum phase transitions. More crucially, the absence of superconducting-metal transitions under in-plane magnetic fields in 2D superconductors imposes constraints on the universality of quantum criticality. Here, we discover the tunable universality class of superconductor-metal transition by changing the disorder strength in $\beta$-W films with varying thickness. The finite-size scaling uncovers the switch of universality class: quantum Griffiths singularity to multiple quantum criticality at a critical thickness of $t_{c \perp 1}\sim 8 nm$ and then from multiple quantum criticality to single criticality at $t_{c\perp 2}\sim 16 nm$. Moreover, the superconducting-metal transition is observed for the first time under in-plane magnetic fields and the universality class is changed at $t_{c \parallel }\sim 8 nm$. The discovery of tunable universality class under both out-of-plane and in-plane magnetic fields provides broad information for the disorder effect on superconducting-metal transitions and quantum criticality.


title: Improved Synthetic Training for Reading Comprehension

abstract: Automatically generated synthetic training examples have been shown to improve performance in machine reading comprehension (MRC). Compared to human annotated gold standard data, synthetic training data has unique properties, such as high availability at the possible expense of quality. In view of such differences, in this paper, we explore novel applications of synthetic examples to MRC. Our proposed pre-training and knowledge distillation strategies show significant improvements over existing methods. In a particularly surprising discovery, we observe that synthetic distillation often yields students that can outperform the teacher model.


title: Improving Multilingual Models with Language-Clustered Vocabularies

abstract: State-of-the-art multilingual models depend on vocabularies that cover all of the languages the model will expect to see at inference time, but the standard methods for generating those vocabularies are not ideal for massively multilingual applications. In this work, we introduce a novel procedure for multilingual vocabulary generation that combines the separately trained vocabularies of several automatically derived language clusters, thus balancing the trade-off between cross-lingual subword sharing and language-specific vocabularies. Our experiments show improvements across languages on key multilingual benchmark tasks TyDi QA (+2.9 F1), XNLI (+2.1\%), and WikiAnn NER (+2.8 F1) and factor of 8 reduction in out-of-vocabulary rate, all without increasing the size of the model or data.


title: New compound control algorithm in sliding mode control to reduce the chattering phenomenon: experimental validation

abstract: In this work, a new SMS is proposed to achieve high tracking and suitable robustness. However, the chattering phenomenon should be regarded as the main drawback of the SMC. Therefore, a new compound control algorithm is used for reducing the chattering phenomenon. The applied compound control law constantly evaluates the error and send the correct value to the system. This significantly will reduce the chattering phenomenon. The performance of the control methods validated by applying on a robot arm experimentally.


title: Fair Hate Speech Detection through Evaluation of Social Group Counterfactuals

abstract: Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always desirable to equalize the effects of social groups because of their essential role in distinguishing outgroup-derogatory hate, such that particular types of hateful rhetoric carry the intended meaning only when contextualized around certain social group tokens. Counterfactual token fairness for a mentioned social group evaluates the model's predictions as to whether they are the same for (a) the actual sentence and (b) a counterfactual instance, which is generated by changing the mentioned social group in the sentence. Our approach assures robust model predictions for counterfactuals that imply similar meaning as the actual sentence. To quantify the similarity of a sentence and its counterfactual, we compare their likelihood score calculated by generative language models. By equalizing model behaviors on each sentence and its counterfactuals, we mitigate bias in the proposed model while preserving the overall classification performance.


title: Open-Domain Dialogue Generation Based on Pre-trained Language Models

abstract: Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target sentences; (2) Transformer-Dec using Transformer decoder for both source and target sentences; (3) Transformer-MLM using Transformer decoder that applies bi-directional attention on the source side and left-to-right attention on the target side with masked language model objective; and (4) Transformer-AR that uses auto-regressive objective instead. In this study, we compare these frameworks on 3 datasets, and our comparison reveals that the best framework uses bidirectional attention on the source side and does not separate encoder and decoder. We also examine model discrepancy, and our experiments confirm that the performance of a model is directly impacted by the underlying discrepancies. We then propose two correction methods to reduce the discrepancies, and both improve the model performance. These results show that discrepancies is an important factor to consider when we use a pre-trained model, and a reduction in discrepancies can lead to improved performance.


title: The motion of respiratory droplets produced by coughing

abstract: Coronavirus disease 2019 (COVID-19) has become a global pandemic infectious respiratory disease with high mortality and infectiousness. This paper investigates respiratory droplet transmission, which is critical to understanding, modeling and controlling epidemics. In the present work, we implemented flow visualization, particle image velocimetry (PIV) and particle shadow tracking velocimetry (PSTV) to measure the velocity of the airflow and droplets involved in coughing and then constructed a physical model considering the evaporation effect to predict the motion of droplets under different weather conditions. The experimental results indicate that the convection velocity of cough airflow presents the relationship $t^{-0.7}$ with time; hence, the distance from the cougher increases by $t^{0.3}$ in the range of our measurement domain. Substituting these experimental results into the physical model reveals that the small droplets (initial diameter $D \leq$ 100 $\mu$m) evaporate to droplet nuclei and that the large droplets with $D \geq$ 500 $\mu$m and initial velocity $u_0 \geq$ 5 m/s travel more than 2 m. Winter conditions of low temperature and high relative humidity can cause more droplets to settle to the ground, which may be a possible driver of a second pandemic wave in the autumn and winter seasons.


title: Groups definable in o-minimal structures: various properties and a diagram

abstract: We present a diagram surveying equivalence or strict implication for properties of different nature (algebraic, model theoretic, topological, etc.) about groups definable in o-minimal structures. All results are well-known and an extensive bibliography is provided.


title: Uncertainty Aware Semi-Supervised Learning on Graph Data

abstract: Thanks to graph neural networks (GNNs), semi-supervised node classification has shown the state-of-the-art performance in graph data. However, GNNs have not considered different types of uncertainties associated with class probabilities to minimize risk of increasing misclassification under uncertainty in real life. In this work, we propose a multi-source uncertainty framework using a GNN that reflects various types of predictive uncertainties in both deep learning and belief/evidence theory domains for node classification predictions. By collecting evidence from the given labels of training nodes, the Graph-based Kernel Dirichlet distribution Estimation (GKDE) method is designed for accurately predicting node-level Dirichlet distributions and detecting out-of-distribution (OOD) nodes. We validated the outperformance of our proposed model compared to the state-of-the-art counterparts in terms of misclassification detection and OOD detection based on six real network datasets. We found that dissonance-based detection yielded the best results on misclassification detection while vacuity-based detection was the best for OOD detection. To clarify the reasons behind the results, we provided the theoretical proof that explains the relationships between different types of uncertainties considered in this work.


title: Deep Clustering of Text Representations for Supervision-free Probing of Syntax

abstract: We explore deep clustering of text representations for unsupervised model interpretation and induction of syntax. As these representations are high-dimensional, out-of-the-box methods like KMeans do not work well. Thus, our approach jointly transforms the representations into a lower-dimensional cluster-friendly space and clusters them. We consider two notions of syntax: Part of speech Induction (POSI) and constituency labelling (CoLab) in this work. Interestingly, we find that Multilingual BERT (mBERT) contains surprising amount of syntactic knowledge of English; possibly even as much as English BERT (EBERT). Our model can be used as a supervision-free probe which is arguably a less-biased way of probing. We find that unsupervised probes show benefits from higher layers as compared to supervised probes. We further note that our unsupervised probe utilizes EBERT and mBERT representations differently, especially for POSI. We validate the efficacy of our probe by demonstrating its capabilities as an unsupervised syntax induction technique. Our probe works well for both syntactic formalisms by simply adapting the input representations. We report competitive performance of our probe on 45-tag English POSI, state-of-the-art performance on 12-tag POSI across 10 languages, and competitive results on CoLab. We also perform zero-shot syntax induction on resource impoverished languages and report strong results.


title: ShiftAddNet: A Hardware-Inspired Deep Network

abstract: Multiplication (e.g., convolution) is arguably a cornerstone of modern deep neural networks (DNNs). However, intensive multiplications cause expensive resource costs that challenge DNNs' deployment on resource-constrained edge devices, driving several attempts for multiplication-less deep networks. This paper presented ShiftAddNet, whose main inspiration is drawn from a common practice in energy-efficient hardware implementation, that is, multiplication can be instead performed with additions and logical bit-shifts. We leverage this idea to explicitly parameterize deep networks in this way, yielding a new type of deep network that involves only bit-shift and additive weight layers. This hardware-inspired ShiftAddNet immediately leads to both energy-efficient inference and training, without compromising the expressive capacity compared to standard DNNs. The two complementary operation types (bit-shift and add) additionally enable finer-grained control of the model's learning capacity, leading to more flexible trade-off between accuracy and (training) efficiency, as well as improved robustness to quantization and pruning. We conduct extensive experiments and ablation studies, all backed up by our FPGA-based ShiftAddNet implementation and energy measurements. Compared to existing DNNs or other multiplication-less models, ShiftAddNet aggressively reduces over 80% hardware-quantified energy cost of DNNs training and inference, while offering comparable or better accuracies. Codes and pre-trained models are available at https://github.com/RICE-EIC/ShiftAddNet.


title: Measuring the `I don't know' Problem through the Lens of Gricean Quantity

abstract: We consider the intrinsic evaluation of neural generative dialog models through the lens of Grice's Maxims of Conversation (1975). Based on the maxim of Quantity (be informative), we propose Relative Utterance Quantity (RUQ) to diagnose the `I don't know' problem, in which a dialog system produces generic responses. The linguistically motivated RUQ diagnostic compares the model score of a generic response to that of the reference response. We find that for reasonable baseline models, `I don't know' is preferred over the reference the majority of the time, but this can be reduced to less than 5% with hyperparameter tuning. RUQ allows for the direct analysis of the `I don't know' problem, which has been addressed but not analyzed by prior work.


title: Document-level Event Extraction with Efficient End-to-end Learning of Cross-event Dependencies

abstract: Fully understanding narratives often requires identifying events in the context of whole documents and modeling the event relations. However, document-level event extraction is a challenging task as it requires the extraction of event and entity coreference, and capturing arguments that span across different sentences. Existing works on event extraction usually confine on extracting events from single sentences, which fail to capture the relationships between the event mentions at the scale of a document, as well as the event arguments that appear in a different sentence than the event trigger. In this paper, we propose an end-to-end model leveraging Deep Value Networks (DVN), a structured prediction algorithm, to efficiently capture cross-event dependencies for document-level event extraction. Experimental results show that our approach achieves comparable performance to CRF-based models on ACE05, while enjoys significantly higher computational efficiency.


title: GAZEV: GAN-Based Zero-Shot Voice Conversion over Non-parallel Speech Corpus

abstract: Non-parallel many-to-many voice conversion is recently attract-ing huge research efforts in the speech processing community. A voice conversion system transforms an utterance of a source speaker to another utterance of a target speaker by keeping the content in the original utterance and replacing by the vocal features from the target speaker. Existing solutions, e.g., StarGAN-VC2, present promising results, only when speech corpus of the engaged speakers is available during model training. AUTOVCis able to perform voice conversion on unseen speakers, but it needs an external pretrained speaker verification model. In this paper, we present our new GAN-based zero-shot voice conversion solution, called GAZEV, which targets to support unseen speakers on both source and target utterances. Our key technical contribution is the adoption of speaker embedding loss on top of the GAN framework, as well as adaptive instance normalization strategy, in order to address the limitations of speaker identity transfer in existing solutions. Our empirical evaluations demonstrate significant performance improvement on output speech quality and comparable speaker similarity to AUTOVC.


title: New Approaches for Natural Language Understanding based on the Idea that Natural Language encodes both Information and its Processing Procedures

abstract: We must recognize that natural language is a way of information encoding, and it encodes not only the information but also the procedures for how information is processed. To understand natural language, the same as we conceive and design computer languages, the first step is to separate information (or data) and the processing procedures of information (or data). In natural language, some processing procedures of data are encoded directly as the structure chunk and the pointer chunk (this paper has reclassified lexical chunks as the data chunk, structure chunk, and the pointer chunk); some processing procedures of data imply in sentences structures; some requests of processing procedures are expressed by information senders and processed by information receivers. For the data parts, the classification encoding system of attribute information and the information organization architecture (including constitutional structures of information sets and the hierarchy between the information sets) were discussed. In section 2, the theoretical part elaborated in section 2 has been verified in examples and proofed that the studies in this paper have achieved the goal of enabling machines to understand the information conveyed in the dialogue. In section 4, the author summarizes the basic conditions of "Understanding", rethinks what "Understanding" is and how to proceed. The study in this paper provides a practical, theoretical basis and research methods for NLU. It also can be applied in large-scale and multi-type information processing in the artificial intelligence (AI) area.


title: Investigating High-Energy Proton-Induced Reactions on Spherical Nuclei: Implications for the Pre-Equilibrium Exciton Model

abstract: A number of accelerator-based isotope production facilities utilize 100- to 200-MeV proton beams due to the high production rates enabled by high-intensity beam capabilities and the greater diversity of isotope production brought on by the long range of high-energy protons. However, nuclear reaction modeling at these energies can be challenging because of the interplay between different reaction modes and a lack of existing guiding cross section data. A Tri-lab collaboration has been formed among the Lawrence Berkeley, Los Alamos, and Brookhaven National Laboratories to address these complexities by characterizing charged-particle nuclear reactions relevant to the production of established and novel radioisotopes. In the inaugural collaboration experiments, stacked-targets of niobium foils were irradiated at the Brookhaven Linac Isotope Producer (E$_p$=200 MeV) and the Los Alamos Isotope Production Facility (E$_p$=100 MeV) to measure $^{93}$Nb(p,x) cross sections between 50 and 200 MeV. The measured cross-section results were compared with literature data as well as the default calculations of the nuclear model codes TALYS, CoH, EMPIRE, and ALICE. We developed a standardized procedure that determines the reaction model parameters that best reproduce the most prominent reaction channels in a physically justifiable manner. The primary focus of the procedure was to determine the best parametrization for the pre-equilibrium two-component exciton model. This modeling study revealed a trend toward a relative decrease for internal transition rates at intermediate proton energies (E$_p$=20-60 MeV) in the current exciton model as compared to the default values. The results of this work are instrumental for the planning, execution, and analysis essential to isotope production.


title: Passivity properties for regulation of DC networks with stochastic load demand

abstract: In this paper we present new (stochastic) passivity properties for Direct Current (DC) power networks, where the unknown and unpredictable load demand is modelled by a stochastic process. More precisely, the considered power network consists of distributed generation units supplying ZIP loads, i.e., nonlinear loads comprised of impedance (Z), current (I) and power (P) components. Differently from the majority of the results in the literature, where each of these components is assumed to be constant, we consider time-varying loads whose dynamics are described by a class of stochastic differential equations. Finally, we prove that an existing distributed control scheme achieving current sharing and (average) voltage regulation ensures the asymptotic stochastic stability of the controlled network.


title: Lower bounds for the first eigenvalue of the Laplacian on K\"ahler manifolds

abstract: We establish lower bound for the first nonzero eigenvalue of the Laplacian on a closed K\"ahler manifold in terms of dimension, diameter, and lower bounds of holomorphic sectional curvature and orthogonal Ricci curvature. On compact K\"ahler manifolds with boundary, we prove lower bounds for the first nonzero Neumann or Dirichlet eigenvalue in terms of geometric data. Our results are K\"ahler analogues of well-known results for Riemannian manifolds.


title: Absence of Low-Energy Shape Coexistence in $^{80}$Ge: The Nonobservation of a Proposed Excited 0$_2^+$ Level at 639 keV

abstract: The $^{80}$Ge structure was investigated in a high-statistics $\beta$-decay experiment of $^{80}$Ga using the GRIFFIN spectrometer at TRIUMF-ISAC through $\gamma$, $\beta$-$e$, $e$-$\gamma$ and $\gamma$-$\gamma$ spectroscopy. No evidence was found for the recently reported 0$_2^{+}$ 639-keV level suggested as evidence for low-energy shape coexistence in $^{80}$Ge. Large-scale shell model calculations performed in $^{78,80,82}$Ge place the $0^{+}_{2}$ level in $^{80}$Ge at 2\,MeV. The new experimental evidence combined with shell model predictions indicate that low-energy shape coexistence is not present in $^{80}$Ge.


title: X-Class: Text Classification with Extremely Weak Supervision

abstract: In this paper, we explore text classification with extremely weak supervision, i.e., only relying on the surface text of class names. This is a more challenging setting than the seed-driven weak supervision, which allows a few seed words per class. We opt to attack this problem from a representation learning perspective -- ideal document representations should lead to nearly the same results between clustering and the desired classification. In particular, one can classify the same corpus differently (e.g., based on topics and locations), so document representations should be adaptive to the given class names. We propose a novel framework X-Class to realize the adaptive representations. Specifically, we first estimate class representations by incrementally adding the most similar word to each class until inconsistency arises. Following a tailored mixture of class attention mechanisms, we obtain the document representation via a weighted average of contextualized word representations. With the prior of each document assigned to its nearest class, we then cluster and align the documents to classes. Finally, we pick the most confident documents from each cluster to train a text classifier. Extensive experiments demonstrate that X-Class can rival and even outperform seed-driven weakly supervised methods on 7 benchmark datasets. Our dataset and code are released at https://github.com/ZihanWangKi/XClass/ .


title: CaM-Gen:Causally-aware Metric-guided Text Generation

abstract: Content is created for a well-defined purpose, often described by a metric or signal represented in the form of structured information. The relationship between the goal (metrics) of target content and the content itself is non-trivial. While large-scale language models show promising text generation capabilities, guiding the generated text with external metrics is challenging. These metrics and content tend to have inherent relationships and not all of them may be of consequence. We introduce CaM-Gen: Causally aware Generative Networks guided by user-defined target metrics incorporating the causal relationships between the metric and content features. We leverage causal inference techniques to identify causally significant aspects of a text that lead to the target metric and then explicitly guide generative models towards these by a feedback mechanism. We propose this mechanism for variational autoencoder and Transformer-based generative models. The proposed models beat baselines in terms of the target metric control while maintaining fluency and language quality of the generated text. To the best of our knowledge, this is one of the early attempts at controlled generation incorporating a metric guide using causal inference.


title: Improving the generalization of network based relative pose regression: dimension reduction as a regularizer

abstract: Visual localization occupies an important position in many areas such as Augmented Reality, robotics and 3D reconstruction. The state-of-the-art visual localization methods perform pose estimation using geometry based solver within the RANSAC framework. However, these methods require accurate pixel-level matching at high image resolution, which is hard to satisfy under significant changes from appearance, dynamics or perspective of view. End-to-end learning based regression networks provide a solution to circumvent the requirement for precise pixel-level correspondences, but demonstrate poor performance towards cross-scene generalization. In this paper, we explicitly add a learnable matching layer within the network to isolate the pose regression solver from the absolute image feature values, and apply dimension regularization on both the correlation feature channel and the image scale to further improve performance towards generalization and large viewpoint change. We implement this dimension regularization strategy within a two-layer pyramid based framework to regress the localization results from coarse to fine. In addition, the depth information is fused for absolute translational scale recovery. Through experiments on real world RGBD datasets we validate the effectiveness of our design in terms of improving both generalization performance and robustness towards viewpoint change, and also show the potential of regression based visual localization networks towards challenging occasions that are difficult for geometry based visual localization methods.


title: Collaborative Machine Learning with Incentive-Aware Model Rewards

abstract: Collaborative machine learning (ML) is an appealing paradigm to build high-quality ML models by training on the aggregated data from many parties. However, these parties are only willing to share their data when given enough incentives, such as a guaranteed fair reward based on their contributions. This motivates the need for measuring a party's contribution and designing an incentive-aware reward scheme accordingly. This paper proposes to value a party's reward based on Shapley value and information gain on model parameters given its data. Subsequently, we give each party a model as a reward. To formally incentivize the collaboration, we define some desirable properties (e.g., fairness and stability) which are inspired by cooperative game theory but adapted for our model reward that is uniquely freely replicable. Then, we propose a novel model reward scheme to satisfy fairness and trade off between the desirable properties via an adjustable parameter. The value of each party's model reward determined by our scheme is attained by injecting Gaussian noise to the aggregated training data with an optimized noise variance. We empirically demonstrate interesting properties of our scheme and evaluate its performance using synthetic and real-world datasets.


title: Content-Based Personalized Recommender System Using Entity Embeddings

abstract: Recommender systems are a class of machine learning algorithms that provide relevant recommendations to a user based on the user's interaction with similar items or based on the content of the item. In settings where the content of the item is to be preserved, a content-based approach would be beneficial. This paper aims to highlight the advantages of the content-based approach through learned embeddings and leveraging these advantages to provide better and personalised movie recommendations based on user preferences to various movie features such as genre and keyword tags.


title: Private Outsourced Bayesian Optimization

abstract: This paper presents the private-outsourced-Gaussian process-upper confidence bound (PO-GP-UCB) algorithm, which is the first algorithm for privacy-preserving Bayesian optimization (BO) in the outsourced setting with a provable performance guarantee. We consider the outsourced setting where the entity holding the dataset and the entity performing BO are represented by different parties, and the dataset cannot be released non-privately. For example, a hospital holds a dataset of sensitive medical records and outsources the BO task on this dataset to an industrial AI company. The key idea of our approach is to make the BO performance of our algorithm similar to that of non-private GP-UCB run using the original dataset, which is achieved by using a random projection-based transformation that preserves both privacy and the pairwise distances between inputs. Our main theoretical contribution is to show that a regret bound similar to that of the standard GP-UCB algorithm can be established for our PO-GP-UCB algorithm. We empirically evaluate the performance of our PO-GP-UCB algorithm with synthetic and real-world datasets.


title: COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval

abstract: We present a large, challenging dataset, COUGH, for COVID-19 FAQ retrieval. Similar to a standard FAQ dataset, COUGH consists of three parts: FAQ Bank, Query Bank and Relevance Set. The FAQ Bank contains ~16K FAQ items scraped from 55 credible websites (e.g., CDC and WHO). For evaluation, we introduce Query Bank and Relevance Set, where the former contains 1,236 human-paraphrased queries while the latter contains ~32 human-annotated FAQ items for each query. We analyze COUGH by testing different FAQ retrieval models built on top of BM25 and BERT, among which the best model achieves 48.8 under P@5, indicating a great challenge presented by COUGH and encouraging future research for further improvement. Our COUGH dataset is available at https://github.com/sunlab-osu/covid-faq.


title: Irregular collective dynamics in a Kuramoto-Daido system

abstract: We analyse the collective behavior of a mean-field model of phase-oscillators of Kuramoto-Daido type coupled through pairwise interactions which depend on phase differences: the coupling function is composed of three harmonics. We provide convincing evidence of a transient but long-lasting chaotic collective chaos, which persists in the thermodynamic limit. The regime is analysed with the help of clever direct numerical simulations, by determining the maximum Lyapunov exponent and assessing the transversal stability to the self-consistent mean field. The structure of the invariant measure is finally described in terms of a resolution-dependent entropy.


title: Naturally occurring van der Waals materials

abstract: The exfoliation of two naturally occurring van der Waals minerals, graphite and molybdenite, arouse an unprecedented level of interest by the scientific community and shaped a whole new field of research: 2D materials research. Several years later, the family of van der Waals materials that can be exfoliated to isolate 2D materials keeps growing, but most of them are synthetic. Interestingly, in nature plenty of naturally occurring van der Waals minerals can be found with a wide range of chemical compositions and crystal structures whose properties are mostly unexplored so far. This Perspective aims to provide an overview of different families of van der Waals minerals to stimulate their exploration in the 2D limit.


title: Attentive Autoencoders for Multifaceted Preference Learning in One-class Collaborative Filtering

abstract: Most existing One-Class Collaborative Filtering (OC-CF) algorithms estimate a user's preference as a latent vector by encoding their historical interactions. However, users often show diverse interests, which significantly increases the learning difficulty. In order to capture multifaceted user preferences, existing recommender systems either increase the encoding complexity or extend the latent representation dimension. Unfortunately, these changes inevitably lead to increased training difficulty and exacerbate scalability issues. In this paper, we propose a novel and efficient CF framework called Attentive Multi-modal AutoRec (AMA) that explicitly tracks multiple facets of user preferences. Specifically, we extend the Autoencoding-based recommender AutoRec to learn user preferences with multi-modal latent representations, where each mode captures one facet of a user's preferences. By leveraging the attention mechanism, each observed interaction can have different contributions to the preference facets. Through extensive experiments on three real-world datasets, we show that AMA is competitive with state-of-the-art models under the OC-CF setting. Also, we demonstrate how the proposed model improves interpretability by providing explanations using the attention mechanism.


title: Coincidence theorems for finite topological spaces

abstract: We adapt the definition of the Vietoris map to the framework of finite topological spaces and we prove some coincidence theorems. From them, we deduce a Lefschetz fixed point theorem for multivalued maps that improves recent results in the literature. Finally, it is given an application to the approximation of discrete dynamical systems in polyhedra.


title: Drawing WS2 thermal sensors on paper substrates

abstract: Paper based thermoresistive sensors are fabricated by rubbing WS2 powder against a piece of standard copier paper, like the way a pencil is used to write on paper. The abrasion between the layered material and the rough paper surface erodes the material, breaking the weak van der Waals interlayer bonds, yielding a film of interconnected platelets. The resistance of WS2 presents a strong temperature dependence, as expected for a semiconductor material in which charge transport is due to thermally activated carriers. This strong temperature dependence makes the paper supported WS2 devices extremely sensitive to small changes in temperature. This exquisite thermal sensitivity, and their fast response times to sudden temperature changes, is exploited thereby demonstrating the usability of a WS2-on-paper thermal sensor in a respiration monitoring device.


title: Correlation functions of non-Markovian systems out of equilibrium: Analytical expressions beyond single-exponential memory

abstract: This paper is concerned with correlation functions of stochastic systems with memory, a prominent example being a molecule or colloid moving through a complex (e.g., viscoelastic) fluid environment. Analytical investigations of such systems based on non-Markovian stochastic equations are notoriously difficult. A common approximation is that of a single-exponential memory, corresponding to the introduction of one auxiliary variable coupled to the Markovian dynamics of the main variable. As a generalization, we here investigate a class of "toy" models with altogether three degrees of freedom, giving rise to more complex forms of memory. Specifically, we consider, mainly on an analytical basis, the under- and overdamped motion of a colloidal particle coupled linearly to two auxiliary variables, where the coupling between variables can be either reciprocal or non-reciprocal. Projecting out the auxiliary variables, we obtain non-Markovian Langevin equations with friction kernels and colored noise, whose structure is similar to that of a generalized Langevin equation. For the present systems, however, the non-Markovian equations may violate the fluctuation-dissipation relation as well as detailed balance, indicating that the systems are out of equilibrium. We then study systematically the connection between the coupling topology of the underlying Markovian system and various autocorrelation functions.We demonstrate that already two auxiliary variables can generate surprisingly complex (e.g., non-monotonic or oscillatory) memory and correlation functions. Finally, we show that a minimal overdamped model with two auxiliary variables and suitable non-reciprocal coupling yields correlation functions resembling those describing hydrodynamic backflow in an optical trap.


title: REDE: End-to-end Object 6D Pose Robust Estimation Using Differentiable Outliers Elimination

abstract: Object 6D pose estimation is a fundamental task in many applications. Conventional methods solve the task by detecting and matching the keypoints, then estimating the pose. Recent efforts bringing deep learning into the problem mainly overcome the vulnerability of conventional methods to environmental variation due to the hand-crafted feature design. However, these methods cannot achieve end-to-end learning and good interpretability at the same time. In this paper, we propose REDE, a novel end-to-end object pose estimator using RGB-D data, which utilizes network for keypoint regression, and a differentiable geometric pose estimator for pose error back-propagation. Besides, to achieve better robustness when outlier keypoint prediction occurs, we further propose a differentiable outliers elimination method that regresses the candidate result and the confidence simultaneously. Via confidence weighted aggregation of multiple candidates, we can reduce the effect from the outliers in the final estimation. Finally, following the conventional method, we apply a learnable refinement process to further improve the estimation. The experimental results on three benchmark datasets show that REDE slightly outperforms the state-of-the-art approaches and is more robust to object occlusion.


title: Pairwise Representation Learning for Event Coreference

abstract: Natural Language Processing tasks such as resolving the coreference of events require understanding the relations between two text snippets. These tasks are typically formulated as (binary) classification problems over independently induced representations of the text snippets. In this work, we develop a Pairwise Representation Learning (PairwiseRL) scheme for the event mention pairs, in which we jointly encode a pair of text snippets so that the representation of each mention in the pair is induced in the context of the other one. Furthermore, our representation supports a finer, structured representation of the text snippet to facilitate encoding events and their arguments. We show that PairwiseRL, despite its simplicity, outperforms the prior state-of-the-art event coreference systems on both cross-document and within-document event coreference benchmarks. We also conduct in-depth analysis in terms of the improvement and the limitation of pairwise representation so as to provide insights for future work.


title: Stop Bugging Me! Evading Modern-Day Wiretapping Using Adversarial Perturbations

abstract: Mass surveillance systems for voice over IP (VoIP) conversations pose a great risk to privacy. These automated systems use learning models to analyze conversations, and calls that involve specific topics are routed to a human agent for further examination. In this study, we present an adversarial-learning-based framework for privacy protection for VoIP conversations. We present a novel method that finds a universal adversarial perturbation (UAP), which, when added to the audio stream, prevents an eavesdropper from automatically detecting the conversation's topic. As shown in our experiments, the UAP is agnostic to the speaker or audio length, and its volume can be changed in real time, as needed. Our real-world solution uses a Teensy microcontroller that acts as an external microphone and adds the UAP to the audio in real time. We examine different speakers, VoIP applications (Skype, Zoom, Slack, and Google Meet), and audio lengths. Our results in the real world suggest that our approach is a feasible solution for privacy protection.


title: Autoregressive Score Matching

abstract: Autoregressive models use chain rule to define a joint probability distribution as a product of conditionals. These conditionals need to be normalized, imposing constraints on the functional families that can be used. To increase flexibility, we propose autoregressive conditional score models (AR-CSM) where we parameterize the joint distribution in terms of the derivatives of univariate log-conditionals (scores), which need not be normalized. To train AR-CSM, we introduce a new divergence between distributions named Composite Score Matching (CSM). For AR-CSM models, this divergence between data and model distributions can be computed and optimized efficiently, requiring no expensive sampling or adversarial training. Compared to previous score matching algorithms, our method is more scalable to high dimensional data and more stable to optimize. We show with extensive experimental results that it can be applied to density estimation on synthetic data, image generation, image denoising, and training latent variable models with implicit encoders.


title: Graph Information Bottleneck

abstract: Representation learning of graph-structured data is challenging because both graph structure and node features carry important information. Graph Neural Networks (GNNs) provide an expressive way to fuse information from network structure and node features. However, GNNs are prone to adversarial attacks. Here we introduce Graph Information Bottleneck (GIB), an information-theoretic principle that optimally balances expressiveness and robustness of the learned representation of graph-structured data. Inheriting from the general Information Bottleneck (IB), GIB aims to learn the minimal sufficient representation for a given task by maximizing the mutual information between the representation and the target, and simultaneously constraining the mutual information between the representation and the input data. Different from the general IB, GIB regularizes the structural as well as the feature information. We design two sampling algorithms for structural regularization and instantiate the GIB principle with two new models: GIB-Cat and GIB-Bern, and demonstrate the benefits by evaluating the resilience to adversarial attacks. We show that our proposed models are more robust than state-of-the-art graph defense models. GIB-based models empirically achieve up to 31% improvement with adversarial perturbation of the graph structure as well as node features.


title: A Frustratingly Easy Approach for Entity and Relation Extraction

abstract: End-to-end relation extraction aims to identify named entities and extract relations between them. Most recent work models these two subtasks jointly, either by casting them in one structured prediction framework, or performing multi-task learning through shared representations. In this work, we present a simple pipelined approach for entity and relation extraction, and establish the new state-of-the-art on standard benchmarks (ACE04, ACE05 and SciERC), obtaining a 1.7%-2.8% absolute improvement in relation F1 over previous joint models with the same pre-trained encoders. Our approach essentially builds on two independent encoders and merely uses the entity model to construct the input for the relation model. Through a series of careful examinations, we validate the importance of learning distinct contextual representations for entities and relations, fusing entity information early in the relation model, and incorporating global context. Finally, we also present an efficient approximation to our approach which requires only one pass of both entity and relation encoders at inference time, achieving an 8-16$\times$ speedup with a slight reduction in accuracy.


title: Constructing Taxonomies from Pretrained Language Models

abstract: We present a method for constructing taxonomic trees (e.g., WordNet) using pretrained language models. Our approach is composed of two modules, one that predicts parenthood relations and another that reconciles those predictions into trees. The parenthood prediction module produces likelihood scores for each potential parent-child pair, creating a graph of parent-child relation scores. The tree reconciliation module treats the task as a graph optimization problem and outputs the maximum spanning tree of this graph. We train our model on subtrees sampled from WordNet, and test on non-overlapping WordNet subtrees. We show that incorporating web-retrieved glosses can further improve performance. On the task of constructing subtrees of English WordNet, the model achieves 66.7 ancestor F1, a 20.0% relative increase over the previous best published result on this task. In addition, we convert the original English dataset into nine other languages using Open Multilingual WordNet and extend our results across these languages.


title: Asymptotic analysis of the 2D convective Brinkman-Forchheimer equations in unbounded domains: Global attractors and upper semicontinuity

abstract: In this work, we carry out the asymptotic analysis of the two dimensional convective Brinkman-Forchheimer (CBF) equations, which characterize the motion of incompressible fluid flows in a saturated porous medium. We establish the existence of a global attractor in both bounded (using compact embedding) and Poincar\'e domains (using asymptotic compactness property). In Poincar\'e domains, for $r=1,2$ and $3$, the estimates for Hausdorff as well as fractal dimensions of the global attractors are also obtained. We then show an upper semicontinuity of global attractors for the 2D CBF equations. We consider an expanding sequence of simply connected, bounded and smooth subdomains $\Omega_m$ of the Poincar\'e domain $\Omega$ such that $\Omega_m\to\Omega$ as $m\to\infty$. If $\mathscr{A}_m$ and $\mathscr{A}$ are the global attractors of the 2D CBF equations corresponding to $\Omega$ and $\Omega_m$, respectively, then we show that for large enough $m$, the global attractor $\mathscr{A}_m$ enters into any neighborhood $\mathcal{U}(\mathscr{A})$ of $\mathscr{A}$. The presence of Darcy term in the CBF equations helps us to obtain the above mentioned results in general unbounded domains also. Finally, we discuss about the quasi-stability property of the semigroup associated with the 2D CBF equations in bounded domains and establish the existence of finite fractal dimensional global as well as exponential attractors for $r\in[1,\infty)$.


title: Impact of sloping porous seabed on the efficiency of an OWC against oblique waves

abstract: The study examines the influence of a sloping porous bed on the efficiency of an oscillating water column (OWC) device facing oblique water waves. A vertical, surface piercing, thin plate near a rigid wall approximates the OWC. The system is simulated using a multi-domain boundary element method assuming the linear potential theory. The impact of varying sloping bed structural parameters and influence of the incident wave angle on the performance of the OWC is evaluated and discussed. The significance of this model to act as a breakwater protecting near-shore marine facilities is also highlighted. The OWC efficiency is found to be highly sensitive to the slope of the porous seabed, and seabed porosity is found to stabilize the resonant frequency against changes in water levels. OWCs are found to be more efficient over porous seabeds with higher frictional coefficients. The results indicate optimum values for the parameters governing such a wave energy conversion system that can be used for the design and implementation of the model.


title: Differentially Private Online Submodular Maximization

abstract: In this work we consider the problem of online submodular maximization under a cardinality constraint with differential privacy (DP). A stream of $T$ submodular functions over a common finite ground set $U$ arrives online, and at each time-step the decision maker must choose at most $k$ elements of $U$ before observing the function. The decision maker obtains a payoff equal to the function evaluated on the chosen set, and aims to learn a sequence of sets that achieves low expected regret. In the full-information setting, we develop an $(\varepsilon,\delta)$-DP algorithm with expected $(1-1/e)$-regret bound of $\mathcal{O}\left( \frac{k^2\log |U|\sqrt{T \log k/\delta}}{\varepsilon} \right)$. This algorithm contains $k$ ordered experts that learn the best marginal increments for each item over the whole time horizon while maintaining privacy of the functions. In the bandit setting, we provide an $(\varepsilon,\delta+ O(e^{-T^{1/3}}))$-DP algorithm with expected $(1-1/e)$-regret bound of $\mathcal{O}\left( \frac{\sqrt{\log k/\delta}}{\varepsilon} (k (|U| \log |U|)^{1/3})^2 T^{2/3} \right)$. Our algorithms contains $k$ ordered experts that learn the best marginal item to select given the items chosen her predecessors, while maintaining privacy of the functions. One challenge for privacy in this setting is that the payoff and feedback of expert $i$ depends on the actions taken by her $i-1$ predecessors. This particular type of information leakage is not covered by post-processing, and new analysis is required. Our techniques for maintaining privacy with feedforward may be of independent interest.


title: Bipartite extension graphs and the Duflo--Serganova functor

abstract: We consider several examples when the extension graph admits a bipartition compatible with the action of Duflo--Serganova functors.


title: Building a Boostless Bootstrap for the Bispectrum

abstract: The observation of primordial correlators by cosmological surveys is a very promising avenue to probe high energies and the perturbative regime of quantum gravity. Hence, it is imperative that we understand how these observables are shaped by the pillars of fundamental physics, namely unitarity, locality and symmetries. To this end, we study the three-point correlators of gravitons and scalar curvature perturbations around a quasi de Sitter spacetime. We identify a set of Bootstrap Rules that fully fix the form of these correlators in the asymptotic future, i.e. at the boundary, and make no reference to bulk time evolution. Importantly, our Boostless Bootstrap accounts for the ubiquitous (spontaneous) breaking of de Sitter boosts caused by any inflationary background. We show how all bispectra involving gravitons in single-clock, canonical inflation can be easily derived in this approach. We also derive for the first time the scalar bispectrum in the Effective Field Theory of inflation to any order in derivatives. In many cases, our derivation is computationally simpler than the corresponding explicit calculation, and makes particularly transparent the implications of locality, the choice of vacuum, and the underlying symmetries.


title: The action of the Virasoro algebra in quantum spin chains. I. The non-rational case

abstract: We investigate the action of discretized Virasoro generators, built out of generators of the lattice Temperley-Lieb algebra ("Koo-Saleur generators"[arXiv:hep-th/9312156]), in the critical XXZ quantum spin chain. We explore the structure of the continuum-limit Virasoro modules at generic central charge for the XXZ vertex model, paralleling [arXiv:2007.11539] for the loop model. We find again indecomposable modules, but this time not logarithmic ones. The limit of the Temperley-Lieb modules $\mathcal{W}_{j,1}$ for $j\neq 0$ contains pairs of "conjugate states" with conformal weights $(h_{r,s},h_{r,-s})$ and $(h_{r,-s},h_{r,s})$ that give rise to dual structures: Verma or co-Verma modules. The limit of $\mathcal{W}_{0,\mathfrak{q}^{\pm2}}$ contains diagonal fields $(h_{r,1},h_{r,1})$ and gives rise to either only Verma or only co-Verma modules, depending on the sign of the exponent in $\mathfrak{q}^{\pm 2}$. In order to obtain matrix elements of Koo-Saleur generators at large system size $N$ we use Bethe ansatz and Quantum Inverse Scattering methods, computing the form factors for relevant combinations of three neighbouring spin operators. Relations between form factors ensure that the above duality exists already at the lattice level. We also study in which sense Koo-Saleur generators converge to Virasoro generators. We consider convergence in the weak sense, investigating whether the commutator of limits is the same as the limit of the commutator? We find that it coincides only up to the central term. As a side result we compute the ground-state expectation value of two neighbouring Temperley-Lieb generators in the XXZ spin chain.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: "Nice Try, Kiddo": Investigating Ad Hominems in Dialogue Responses

abstract: Ad hominem attacks are those that target some feature of a person's character instead of the position the person is maintaining. These attacks are harmful because they propagate implicit biases and diminish a person's credibility. Since dialogue systems respond directly to user input, it is important to study ad hominems in dialogue responses. To this end, we propose categories of ad hominems, compose an annotated dataset, and build a classifier to analyze human and dialogue system responses to English Twitter posts. We specifically compare responses to Twitter topics about marginalized communities (#BlackLivesMatter, #MeToo) versus other topics (#Vegan, #WFH), because the abusive language of ad hominems could further amplify the skew of power away from marginalized populations. Furthermore, we propose a constrained decoding technique that uses salient $n$-gram similarity as a soft constraint for top-$k$ sampling to reduce the amount of ad hominems generated. Our results indicate that 1) responses from both humans and DialoGPT contain more ad hominems for discussions around marginalized communities, 2) different quantities of ad hominems in the training data can influence the likelihood of generating ad hominems, and 3) we can use constrained decoding techniques to reduce ad hominems in generated dialogue responses.


title: Rethinking embedding coupling in pre-trained language models

abstract: We re-evaluate the standard practice of sharing weights between input and output embeddings in state-of-the-art pre-trained language models. We show that decoupled embeddings provide increased modeling flexibility, allowing us to significantly improve the efficiency of parameter allocation in the input embedding of multilingual models. By reallocating the input embedding parameters in the Transformer layers, we achieve dramatically better performance on standard natural language understanding tasks with the same number of parameters during fine-tuning. We also show that allocating additional capacity to the output embedding provides benefits to the model that persist through the fine-tuning stage even though the output embedding is discarded after pre-training. Our analysis shows that larger output embeddings prevent the model's last layers from overspecializing to the pre-training task and encourage Transformer representations to be more general and more transferable to other tasks and languages. Harnessing these findings, we are able to train models that achieve strong performance on the XTREME benchmark without increasing the number of parameters at the fine-tuning stage.


title: Embedding of the Racah Algebra R($\boldsymbol{n}$) and Superintegrability

abstract: The rank-$1$ Racah algebra $R(3)$ plays a pivotal role in the theory of superintegrable systems. It appears as the symmetry algebra of the $3$-parameter system on the $2$-sphere from which all second-order conformally flat superintegrable models in $2$D can be obtained by means of suitable limits and contractions. A higher rank generalization of $R(3)$, the so-called rank $n-2$ Racah algebra $R(n)$, has been considered recently and showed to be the symmetry algebra of the general superintegrable model on the $(n-1)$-sphere. In the present work, we show that such an algebraic structure naturally arises as embedded inside a larger quadratic algebra characterizing $n$D superintegrable models with non-central terms. This is shown both in classical and quantum mechanics through suitable (symplectic or differential) realisations of the Racah and additional generators. Among the main results, we present an explicit construction of the complete symmetry algebras for two families of $n$-dimensional maximally superintegrable models, the Smorodinsky-Winternitz system and the generalized Kepler-Coulomb system. For both families, the underlying symmetry algebras are higher-rank quadratic algebras containing the Racah algebra $R(n)$ as subalgebra. High-order algebraic relations among the generators of the full quadratic algebras are also obtained both in the classical and quantum frameworks. These results should shed new light to the further understanding of the structures of quadratic algebras in the context of superintegrable systems.


title: Topological bands in two-dimensional orbital-active bipartite lattices

abstract: The search for large gap quantum spin Hall (QSH) and quantum anomalous Hall (QAH) insulators is important both for fundamental and practical interests. The degenerate multi-orbitals $p_x,p_y$ in honeycomb lattice provides a paradigm for QSH state with a boosted topological gap of the first order in atomic spin-orbit coupling. By using elementary band representation, we explore the feasibility of this mechanism for QSH in general two-dimensional lattices, and find that the biparticle lattices with $C_{3v}$ or $C_{4v}$ symmetry and degenerate multi-orbitals could work. We further provide concrete tight-binding models on honeycomb, kagome and square lattices to demonstrate the desired topological physics. By introducing ferromagnetism into QSH state, we extend the mechanism to QAH state with a boosted gap. The QSH and QAH states can be achieved when Fermi level is at integer filling only for honeycomb lattice, but at certain fractional filling for other lattices. We conclude with a brief discussion on the possible material venues for such mechanism.


title: Unified dynamic approach for simulating quantum tunneling and thermionic emission at metal/organic interface

abstract: Injection from metallic electrodes serves as a main channel of charge generation in organic semiconducting devices and the quantum effect is normally regarded to be essential. We develop a dynamic approach based upon the surface hopping (SH) algorithm and classical device modeling, by which both quantum tunneling and thermionic emission of charge carrier injection at metal/organic interfaces are concurrently investigated. The injected charges from metallic electrode are observed to quickly spread onto the organic molecules following by an accumulation close to the interface induced by the built-in electric field, exhibiting a transition from delocalization to localization. We compare the Ehrenfest dynamics on mean-field level and the SH algorithm by simulating the temperature dependence of charge injection dynamics, and it is found that the former one leads to an improper result that the injection efficiency decreases with increasing temperature at room-temperature regime while SH results are credible. The relationship between injected charges and the applied bias voltage suggests it is the quantum tunneling that dominates the low-threshold injection characteristics in molecular crystals, which is further supported by the calculation results of small entropy change during the injection processes. An optimum interfacial width for charge injection efficiency at the interface is also quantified and can be utilized to understand the role of interfacial buffer layer in practical devices.


title: Cross-neutralising: Probing for joint encoding of linguistic information in multilingual models

abstract: Multilingual sentence encoders are widely used to transfer NLP models across languages. The success of this transfer is, however, dependent on the model's ability to encode the patterns of cross-lingual similarity and variation. Yet, little is known as to how these models are able to do this. We propose a simple method to study how relationships between languages are encoded in two state-of-the-art multilingual models (i.e. M-BERT and XLM-R). The results provide insight into their information sharing mechanisms and suggest that linguistic properties are encoded jointly across typologically-similar languages in these models.


title: Text Editing by Command

abstract: A prevailing paradigm in neural text generation is one-shot generation, where text is produced in a single step. The one-shot setting is inadequate, however, when the constraints the user wishes to impose on the generated text are dynamic, especially when authoring longer documents. We address this limitation with an interactive text generation setting in which the user interacts with the system by issuing commands to edit existing text. To this end, we propose a novel text editing task, and introduce WikiDocEdits, a dataset of single-sentence edits crawled from Wikipedia. We show that our Interactive Editor, a transformer-based model trained on this dataset, outperforms baselines and obtains positive results in both automatic and human evaluations. We present empirical and qualitative analyses of this model's performance.


title: Context-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model

abstract: Although many context-aware neural machine translation models have been proposed to incorporate contexts in translation, most of those models are trained end-to-end on parallel documents aligned in sentence-level. Because only a few domains (and language pairs) have such document-level parallel data, we cannot perform accurate context-aware translation in most domains. We therefore present a simple method to turn a sentence-level translation model into a context-aware model by incorporating a document-level language model into the decoder. Our context-aware decoder is built upon only a sentence-level parallel corpora and monolingual corpora; thus no document-level parallel data is needed. In a theoretical viewpoint, the core part of this work is the novel representation of contextual information using point-wise mutual information between context and the current sentence. We show the effectiveness of our approach in three language pairs, English to French, English to Russian, and Japanese to English, by evaluation in \textsc{bleu} and contrastive tests for context-aware translation.


title: Keyphrase Extraction with Dynamic Graph Convolutional Networks and Diversified Inference

abstract: Keyphrase extraction (KE) aims to summarize a set of phrases that accurately express a concept or a topic covered in a given document. Recently, Sequence-to-Sequence (Seq2Seq) based generative framework is widely used in KE task, and it has obtained competitive performance on various benchmarks. The main challenges of Seq2Seq methods lie in acquiring informative latent document representation and better modeling the compositionality of the target keyphrases set, which will directly affect the quality of generated keyphrases. In this paper, we propose to adopt the Dynamic Graph Convolutional Networks (DGCN) to solve the above two problems simultaneously. Concretely, we explore to integrate dependency trees with GCN for latent representation learning. Moreover, the graph structure in our model is dynamically modified during the learning process according to the generated keyphrases. To this end, our approach is able to explicitly learn the relations within the keyphrases collection and guarantee the information interchange between encoder and decoder in both directions. Extensive experiments on various KE benchmark datasets demonstrate the effectiveness of our approach.


title: Multilingual Speech Translation with Efficient Finetuning of Pretrained Models

abstract: We present a simple yet effective approach to build multilingual speech-to-text (ST) translation by efficient transfer learning from pretrained speech encoder and text decoder. Our key finding is that a minimalistic LNA (LayerNorm and Attention) finetuning can achieve zero-shot crosslingual and cross-modality transfer ability by only finetuning less than 10% of the pretrained parameters. This enables effectively leveraging large pretrained models with low training cost. Using wav2vec 2.0 for acoustic modeling, and mBART for multilingual text generation, our approach advanced the new state-of-the-art for 34 translation directions (and surpassing cascaded ST for 23 of them) on large-scale multilingual ST benchmark CoVoST 2 (+6.4 BLEU on average across 15 En-X directions and +5.1 BLEU on average across 19 X-En directions). Our approach demonstrates strong zero-shot performance in a many-to-many multilingual model (+5.7 BLEU on average across 18 non-English directions), making it an appealing approach for attaining high-quality speech translation with improved parameter and data efficiency.


title: Drift of random walks on abelian covers of finite volume homogeneous spaces

abstract: Let $G$ be a connected simple real Lie group, $\Lambda_{0}\subseteq G$ a lattice and $\Lambda \unlhd \Lambda_{0}$ a normal subgroup such that $\Lambda_{0}/\Lambda\simeq \mathbb{Z}^d$. We study the drift of a random walk on the $\mathbb{Z}^d$-cover $\Lambda\backslash G$ of the finite volume homogeneous space $\Lambda_{0}\backslash G$. This walk is defined by a Zariski-dense compactly supported probability measure $\mu$ on $G$. We first assume the covering map $\Lambda\backslash G\rightarrow \Lambda_{0}\backslash G$ does not unfold any cusp of $\Lambda_{0}\backslash G$ and compute the drift at \emph{every} starting point. Then we remove this assumption and describe the drift almost everywhere. The case of hyperbolic manifolds of dimension 2 stands out with non-converging type behaviors. The recurrence of the trajectories is also characterized in this context.


title: Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions

abstract: Pre-trained contextual vision-and-language (V&L) models have achieved impressive performance on various benchmarks. However, existing models require a large amount of parallel image-caption data for pre-training. Such data are costly to collect and require cumbersome curation. Inspired by unsupervised machine translation, we investigate if a strong V&L representation model can be learned through unsupervised pre-training without image-caption corpora. In particular, we propose to conduct ``mask-and-predict'' pre-training on text-only and image-only corpora and introduce the object tags detected by an object recognition model as anchor points to bridge two modalities. We find that such a simple approach achieves performance close to a model pre-trained with aligned data, on four English V&L benchmarks. Our work challenges the widely held notion that aligned data is necessary for V&L pre-training, while significantly reducing the amount of supervision needed for V&L models.


title: X-ray tomography investigation of cyclically sheared granular materials

abstract: We perform combined X-ray tomography and shear force measurements on a cyclically sheared granular system with highly transient behaviors, and obtain the evolution of microscopic structures and the macroscopic shear force during the shear cycle. We explain the macroscopic behaviors of the system based on microscopic processes, including the particle level structural rearrangement and frictional contact variation. Specifically, we show how contact friction can induce large structural fluctuations and cause significant shear dilatancy effect for granular materials, and we also construct an empirical constitutive relationship for the macroscopic shear force.


title: Global-scale massive feature extraction from monthly hydroclimatic time series: Statistical characterizations, spatial patterns and hydrological similarity

abstract: Hydroclimatic time series analysis focuses on a few feature types (e.g., autocorrelations, trends, extremes), which describe a small portion of the entire information content of the observations. Aiming to exploit a larger part of the available information and, thus, to deliver more reliable results (e.g., in hydroclimatic time series clustering contexts), here we approach hydroclimatic time series analysis differently, i.e., by performing massive feature extraction. In this respect, we develop a big data framework for hydroclimatic variable behaviour characterization. This framework relies on approximately 60 diverse features and is completely automatic (in the sense that it does not depend on the hydroclimatic process at hand). We apply the new framework to characterize mean monthly temperature, total monthly precipitation and mean monthly river flow. The applications are conducted at the global scale by exploiting 40-year-long time series originating from over 13 000 stations. We extract interpretable knowledge on seasonality, trends, autocorrelation, long-range dependence and entropy, and on feature types that are met less frequently. We further compare the examined hydroclimatic variable types in terms of this knowledge and, identify patterns related to the spatial variability of the features. For this latter purpose, we also propose and exploit a hydroclimatic time series clustering methodology. This new methodology is based on Breiman's random forests. The descriptive and exploratory insights gained by the global-scale applications prove the usefulness of the adopted feature compilation in hydroclimatic contexts. Moreover, the spatially coherent patterns characterizing the clusters delivered by the new methodology build confidence in its future exploitation...


title: GO FIGURE: A Meta Evaluation of Factuality in Summarization

abstract: While neural language models can generate text with remarkable fluency and coherence, controlling for factual correctness in generation remains an open research question. This major discrepancy between the surface-level fluency and the content-level correctness of neural generation has motivated a new line of research that seeks automatic metrics for evaluating the factuality of machine text. In this paper, we introduce GO FIGURE, a meta-evaluation framework for evaluating factuality evaluation metrics. We propose five necessary and intuitive conditions to evaluate factuality metrics on diagnostic factuality data across three different summarization tasks. Our benchmark analysis on ten factuality metrics reveals that our meta-evaluation framework provides a robust and efficient evaluation that is extensible to multiple types of factual consistency and standard generation metrics, including QA metrics. It also reveals that while QA metrics generally improve over standard metrics that measure factuality across domains, performance is highly dependent on the way in which questions are generated.


title: Pressure Mode Decomposition Analysis of the Flow past a Cross-flow Oscillating Circular Cylinder

abstract: Proper orthogonal decomposition (POD) is often employed in developing reduced-order models (ROM) in fluid flows for design, control, and optimization. Contrary to the usual practice where velocity field is the focus, we apply the POD analysis on the pressure field data obtained from numerical simulations of the flow past stationary and oscillating cylinders. Since pressure mainly contributes to the hydrodynamic forces acting on the structure, we compute the pressure POD modes on the cylinder surface oscillating in lock-in and lock-out regions. These modes are then dissected into sine and cosine magnitudes to estimate their contribution in the development of pressure lift and drag decomposition coefficients, respectively. The key finding of this study is that more POD modes are required to capture the flow physics in nonsynchronous regimes as compared to synchronization case. Engineering application of this study is the development of reduced-order models for effective control techniques.


title: Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation

abstract: Models pretrained with self-supervised objectives on large text corpora achieve state-of-the-art performance on English text summarization tasks. However, these models are typically fine-tuned on hundreds of thousands of data points, an infeasible requirement when applying summarization to new, niche domains. In this work, we introduce a novel and generalizable method, called WikiTransfer, for fine-tuning pretrained models for summarization in an unsupervised, dataset-specific manner. WikiTransfer fine-tunes pretrained models on pseudo-summaries, produced from generic Wikipedia data, which contain characteristics of the target dataset, such as the length and level of abstraction of the desired summaries. WikiTransfer models achieve state-of-the-art, zero-shot abstractive summarization performance on the CNN-DailyMail dataset and demonstrate the effectiveness of our approach on three additional diverse datasets. These models are more robust to noisy data and also achieve better or comparable few-shot performance using 10 and 100 training examples when compared to few-shot transfer from other summarization datasets. To further boost performance, we employ data augmentation via round-trip translation as well as introduce a regularization term for improved few-shot transfer. To understand the role of dataset aspects in transfer performance and the quality of the resulting output summaries, we further study the effect of the components of our unsupervised fine-tuning data and analyze few-shot performance using both automatic and human evaluation.


title: XDM: Improving Sequential Deep Matching with Unclicked User Behaviors for Recommender System

abstract: Deep learning-based sequential recommender systems have recently attracted increasing attention from both academia and industry. Most of industrial Embedding-Based Retrieval (EBR) system for recommendation share the similar ideas with sequential recommenders. Among them, how to comprehensively capture sequential user interest is a fundamental problem. However, most existing sequential recommendation models take as input clicked or purchased behavior sequences from user-item interactions. This leads to incomprehensive user representation and sub-optimal model performance, since they ignore the complete user behavior exposure data, i.e., items impressed yet unclicked by users. In this work, we attempt to incorporate and model those unclicked item sequences using a new learning approach in order to explore better sequential recommendation technique. An efficient triplet metric learning algorithm is proposed to appropriately learn the representation of unclicked items. Our method can be simply integrated with existing sequential recommendation models by a confidence fusion network and further gain better user representation. The offline experimental results based on real-world E-commerce data demonstrate the effectiveness and verify the importance of unclicked items in sequential recommendation. Moreover we deploy our new model (named XDM) into EBR of recommender system at Taobao, outperforming the deployed previous generation SDM.


title: Resolvent and spectral measure for Schr\"odinger operators on flat Euclidean cones

abstract: We construct the Schwartz kernel of resolvent and spectral measure for Schr\"odinger operators on the flat Euclidean cone $(X,g)$, where $X=C(\mathbb{S}_\sigma^1)=(0,\infty)\times \mathbb{S}_\sigma^1$ is a product cone over the circle, $\mathbb{S}_\sigma^1=\R/2\pi \sigma\Z$, with radius $\sigma>0$ and the metric $g=dr^2+r^2 d\theta^2$. As products, we prove the dispersive estimates for the Schr\"odinger and half-wave propagators in this setting.


title: Social distancing in pedestrian dynamics and its effect on disease spreading

abstract: Non-pharmaceutical measures such as social distancing, can play an important role to control an epidemic in the absence of vaccinations. In this paper, we study the impact of social distancing on epidemics for which it is executable. We use a mathematical model combining human mobility and disease spreading. For the mobility dynamics, we design an agent based model consisting of pedestrian dynamics with a novel type of force to resemble social distancing in crowded sites. For the spreading dynamics, we consider the compartmental SIE dynamics plus an indirect transmission with the footprints of the infectious pedestrians being the contagion factor. We show that the increase in the intensity of social distancing has a significant effect on the exposure risk. By classifying the population into social distancing abiders and non-abiders, we conclude that the practice of social distancing, even by a minority of potentially infectious agents, results in a drastic change on the population exposure risk, but reduces the effectiveness of the protocols when practiced by the rest of the population. Furthermore, we observe that for contagions which the indirect transmission is more significant, the effectiveness of social distancing would be reduced. This study can provide a quantitative guideline for policy-making on exposure risk reduction.


title: Output Regulation for Load Frequency Control

abstract: Motivated by the inadequacy of the existing control strategies for power systems affected by time-varying uncontrolled power injections such as loads and the increasingly widespread renewable energy sources, this paper proposes two control schemes based on the well-known output regulation control methodology. The first one is designed based on the classical output regulation theory and addresses the so-called Load Frequency Control (LFC) problem in presence of time-varying uncontrolled power injections. Then, in order to also minimize the generation costs, we use an approximate output regulation method that solves numerically only the partial differential equation of the regulator equation and propose a controller based on this solution, minimizing an appropriate penalty function. An extensive case study shows excellent performance of the proposed control schemes in different and critical scenarios.