title: Few-cycle vacuum squeezing in nanophotonics

abstract: One of the most fundamental quantum states of light is squeezed vacuum, in which noise in one of the quadratures is less than the standard quantum noise limit. Significant progress has been made in the generation of optical squeezed vacuum and its utilization for numerous applications. However, it remains challenging to generate, manipulate, and measure such quantum states in nanophotonics with performances required for a wide range of scalable quantum information systems. Here, we overcome this challenge in lithium niobate nanophotonics by utilizing ultrashort-pulse phase-sensitive amplifiers for both generation and all-optical measurement of squeezed states on the same chip. We generate a squeezed state spanning over more than 25 THz of bandwidth supporting only a few optical cycles, and measure a maximum of 4.9 dB of squeezing ($\sim$11 dB inferred). This level of squeezing surpasses the requirements for a wide range of quantum information systems. Our results on generation and measurement of few-optical-cycle squeezed states in nanophotonics enable a practical path towards scalable quantum information systems with THz clock rates and open opportunities for studying non-classical nature of light in the sub-cycle regime.


title: DEFER: Distributed Edge Inference for Deep Neural Networks

abstract: Modern machine learning tools such as deep neural networks (DNNs) are playing a revolutionary role in many fields such as natural language processing, computer vision, and the internet of things. Once they are trained, deep learning models can be deployed on edge computers to perform classification and prediction on real-time data for these applications. Particularly for large models, the limited computational and memory resources on a single edge device can become the throughput bottleneck for an inference pipeline. To increase throughput and decrease per-device compute load, we present DEFER (Distributed Edge inFERence), a framework for distributed edge inference, which partitions deep neural networks into layers that can be spread across multiple compute nodes. The architecture consists of a single "dispatcher" node to distribute DNN partitions and inference data to respective compute nodes. The compute nodes are connected in a series pattern where each node's computed result is relayed to the subsequent node. The result is then returned to the Dispatcher. We quantify the throughput, energy consumption, network payload, and overhead for our framework under realistic network conditions using the CORE network emulator. We find that for the ResNet50 model, the inference throughput of DEFER with 8 compute nodes is 53% higher and per node energy consumption is 63% lower than single device inference. We further reduce network communication demands and energy consumption using the ZFP serialization and LZ4 compression algorithms. We have implemented DEFER in Python using the TensorFlow and Keras ML libraries, and have released DEFER as an open-source framework to benefit the research community.


title: Storm Surges as Seen by Coastal and Spaceborne Radars: Case Studies in British Columbia

abstract: Short-term sea level fluctuations prompted by abrupt atmospheric changes can be hazardous phenomena for coastal regions. We report on two such recent storm surges that occurred in 2020 on the shores of British Columbia, Canada. A rare concordance of ground-based and spaceborne sensors made it possible to observe these events with a variety of instruments : (1) a coastal oceanographic radar; (2) the synthetic aperture radar onboard satellite Sentinel-1B; and (3) a network of shoreside tide gauges. In the light of these case studies we show how satellite-based radar data can be used to complement the observation and interpretation of ground-based measurements in the context of ``tsunami-like'' sea level oscillations.


title: TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic Clusters

abstract: Topic taxonomies, which represent the latent topic (or category) structure of document collections, provide valuable knowledge of contents in many applications such as web search and information filtering. Recently, several unsupervised methods have been developed to automatically construct the topic taxonomy from a text corpus, but it is challenging to generate the desired taxonomy without any prior knowledge. In this paper, we study how to leverage the partial (or incomplete) information about the topic structure as guidance to find out the complete topic taxonomy. We propose a novel framework for topic taxonomy completion, named TaxoCom, which recursively expands the topic taxonomy by discovering novel sub-topic clusters of terms and documents. To effectively identify novel topics within a hierarchical topic structure, TaxoCom devises its embedding and clustering techniques to be closely-linked with each other: (i) locally discriminative embedding optimizes the text embedding space to be discriminative among known (i.e., given) sub-topics, and (ii) novelty adaptive clustering assigns terms into either one of the known sub-topics or novel sub-topics. Our comprehensive experiments on two real-world datasets demonstrate that TaxoCom not only generates the high-quality topic taxonomy in terms of term coherency and topic coverage but also outperforms all other baselines for a downstream task.


title: Three-dimensional structure and formation mechanism of biskyrmions in uniaxial ferromagnets

abstract: Magnetic biskyrmions are observed in experiments but their existences are still under debate. In this work, we present the existence of biskyrmions in a magnetic film with tilted uniaxial anisotropy via micromagnetic simulations. We find biskyrmions and bubbles share a unified three-dimensional structure, in which the relative position of two intrinsic Bloch points dominates the two-dimensional topological property in the film middle. The film edge can drive Bloch points and transform bubbles into biskyrmions via the demagnetizing field. This mechanism is found in the formation process of biskyrmions in confined geometry under zero field. Our work clarifies the structure and formation mechanism of biskyrmions, emphasizing the three-dimensional aspect of skyrmion-related nanostructures.


title: Computing Longest (Common) Lyndon Subsequences

abstract: Given a string $T$ with length $n$ whose characters are drawn from an ordered alphabet of size $\sigma$, its longest Lyndon subsequence is a longest subsequence of $T$ that is a Lyndon word. We propose algorithms for finding such a subsequence in $O(n^3)$ time with $O(n)$ space, or online in $O(n^3 \sigma)$ space and time. Our first result can be extended to find the longest common Lyndon subsequence of two strings of length $n$ in $O(n^4 \sigma)$ time using $O(n^3)$ space.


title: Hierarchical Neural Network Approaches for Long Document Classification

abstract: Text classification algorithms investigate the intricate relationships between words or phrases and attempt to deduce the document's interpretation. In the last few years, these algorithms have progressed tremendously. Transformer architecture and sentence encoders have proven to give superior results on natural language processing tasks. But a major limitation of these architectures is their applicability for text no longer than a few hundred words. In this paper, we explore hierarchical transfer learning approaches for long document classification. We employ pre-trained Universal Sentence Encoder (USE) and Bidirectional Encoder Representations from Transformers (BERT) in a hierarchical setup to capture better representations efficiently. Our proposed models are conceptually simple where we divide the input data into chunks and then pass this through base models of BERT and USE. Then output representation for each chunk is then propagated through a shallow neural network comprising of LSTMs or CNNs for classifying the text data. These extensions are evaluated on 6 benchmark datasets. We show that USE + CNN/LSTM performs better than its stand-alone baseline. Whereas the BERT + CNN/LSTM performs on par with its stand-alone counterpart. However, the hierarchical BERT models are still desirable as it avoids the quadratic complexity of the attention mechanism in BERT. Along with the hierarchical approaches, this work also provides a comparison of different deep learning algorithms like USE, BERT, HAN, Longformer, and BigBird for long document classification. The Longformer approach consistently performs well on most of the datasets.


title: Deformable One-Dimensional Object Detection for Routing and Manipulation

abstract: Many methods exist to model and track deformable one-dimensional objects (e.g., cables, ropes, and threads) across a stream of video frames. However, these methods depend on the existence of some initial conditions. To the best of our knowledge, the topic of detection methods that can extract those initial conditions in non-trivial situations has hardly been addressed. The lack of detection methods limits the use of the tracking methods in real-world applications and is a bottleneck for fully autonomous applications that work with these objects. This paper proposes an approach for detecting deformable one-dimensional objects which can handle crossings and occlusions. It can be used for tasks such as routing and manipulation and automatically provides the initialization required by the tracking methods. Our algorithm takes an image containing a deformable object and outputs a chain of fixed-length cylindrical segments connected with passive spherical joints. The chain follows the natural behavior of the deformable object and fills the gaps and occlusions in the original image. Our tests and experiments have shown that the method can correctly detect deformable one-dimensional objects in various complex conditions.


title: Pruning-aware Sparse Regularization for Network Pruning

abstract: Structural neural network pruning aims to remove the redundant channels in the deep convolutional neural networks (CNNs) by pruning the filters of less importance to the final output accuracy. To reduce the degradation of performance after pruning, many methods utilize the loss with sparse regularization to produce structured sparsity. In this paper, we analyze these sparsity-training-based methods and find that the regularization of unpruned channels is unnecessary. Moreover, it restricts the network's capacity, which leads to under-fitting. To solve this problem, we propose a novel pruning method, named MaskSparsity, with pruning-aware sparse regularization. MaskSparsity imposes the fine-grained sparse regularization on the specific filters selected by a pruning mask, rather than all the filters of the model. Before the fine-grained sparse regularization of MaskSparity, we can use many methods to get the pruning mask, such as running the global sparse regularization. MaskSparsity achieves 63.03%-FLOPs reduction on ResNet-110 by removing 60.34% of the parameters, with no top-1 accuracy loss on CIFAR-10. On ILSVRC-2012, MaskSparsity reduces more than 51.07% FLOPs on ResNet-50, with only a loss of 0.76% in the top-1 accuracy. The code is released at https://github.com/CASIA-IVA-Lab/MaskSparsity. Moreover, we have integrated the code of MaskSparity into a PyTorch pruning toolkit, EasyPruner, at https://gitee.com/casia_iva_engineer/easypruner.


title: COPA-SSE: Semi-structured Explanations for Commonsense Reasoning

abstract: We present Semi-Structured Explanations for COPA (COPA-SSE), a new crowdsourced dataset of 9,747 semi-structured, English common sense explanations for Choice of Plausible Alternatives (COPA) questions. The explanations are formatted as a set of triple-like common sense statements with ConceptNet relations but freely written concepts. This semi-structured format strikes a balance between the high quality but low coverage of structured data and the lower quality but high coverage of free-form crowdsourcing. Each explanation also includes a set of human-given quality ratings. With their familiar format, the explanations are geared towards commonsense reasoners operating on knowledge graphs and serve as a starting point for ongoing work on improving such systems. The dataset is available at https://github.com/a-brassard/copa-sse.


title: Data-Driven Deep Learning Based Hybrid Beamforming for Aerial Massive MIMO-OFDM Systems with Implicit CSI

abstract: In an aerial hybrid massive multiple-input multiple-output (MIMO) and orthogonal frequency division multiplexing (OFDM) system, how to design a spectral-efficient broadband multi-user hybrid beamforming with a limited pilot and feedback overhead is challenging. To this end, by modeling the key transmission modules as an end-to-end (E2E) neural network, this paper proposes a data-driven deep learning (DL)-based unified hybrid beamforming framework for both the time division duplex (TDD) and frequency division duplex (FDD) systems with implicit channel state information (CSI). For TDD systems, the proposed DL-based approach jointly models the uplink pilot combining and downlink hybrid beamforming modules as an E2E neural network. While for FDD systems, we jointly model the downlink pilot transmission, uplink CSI feedback, and downlink hybrid beamforming modules as an E2E neural network. Different from conventional approaches separately processing different modules, the proposed solution simultaneously optimizes all modules with the sum rate as the optimization object. Therefore, by perceiving the inherent property of air-to-ground massive MIMO-OFDM channel samples, the DL-based E2E neural network can establish the mapping function from the channel to the beamformer, so that the explicit channel reconstruction can be avoided with reduced pilot and feedback overhead. Besides, practical low-resolution phase shifters (PSs) introduce the quantization constraint, leading to the intractable gradient backpropagation when training the neural network. To mitigate the performance loss caused by the phase quantization error, we adopt the transfer learning strategy to further fine-tune the E2E neural network based on a pre-trained network that assumes the ideal infinite-resolution PSs. Numerical results show that our DL-based schemes have considerable advantages over state-of-the-art schemes.


title: Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records

abstract: Disease risk prediction has attracted increasing attention in the field of modern healthcare, especially with the latest advances in artificial intelligence (AI). Electronic health records (EHRs), which contain heterogeneous patient information, are widely used in disease risk prediction tasks. One challenge of applying AI models for risk prediction lies in generating interpretable evidence to support the prediction results while retaining the prediction ability. In order to address this problem, we propose the method of jointly embedding words and labels whereby attention modules learn the weights of words from medical notes according to their relevance to the names of risk prediction labels. This approach boosts interpretability by employing an attention mechanism and including the names of prediction tasks in the model. However, its application is only limited to the handling of textual inputs such as medical notes. In this paper, we propose a label dependent attention model LDAM to 1) improve the interpretability by exploiting Clinical-BERT (a biomedical language model pre-trained on a large clinical corpus) to encode biomedically meaningful features and labels jointly; 2) extend the idea of joint embedding to the processing of time-series data, and develop a multi-modal learning framework for integrating heterogeneous information from medical notes and time-series health status indicators. To demonstrate our method, we apply LDAM to the MIMIC-III dataset to predict different disease risks. We evaluate our method both quantitatively and qualitatively. Specifically, the predictive power of LDAM will be shown, and case studies will be carried out to illustrate its interpretability.


title: Asymptotic self-similar blow-up profile for three-dimensional axisymmetric Euler equations using neural networks

abstract: Whether there exist finite time blow-up solutions for the 2-D Boussinesq and the 3-D Euler equations are of fundamental importance to the field of fluid mechanics. We develop a new numerical framework, employing physics-informed neural networks (PINNs), that discover, for the first time, a smooth self-similar blow-up profile for both equations. The solution itself could form the basis of a future computer-assisted proof of blow-up for both equations. In addition, we demonstrate PINNs could be successfully applied to find unstable self-similar solutions to fluid equations by constructing the first example of an unstable self-similar solution to the C\'ordoba-C\'ordoba-Fontelos equation. We show that our numerical framework is both robust and adaptable to various other equations.


title: When Facial Expression Recognition Meets Few-Shot Learning: A Joint and Alternate Learning Framework

abstract: Human emotions involve basic and compound facial expressions. However, current research on facial expression recognition (FER) mainly focuses on basic expressions, and thus fails to address the diversity of human emotions in practical scenarios. Meanwhile, existing work on compound FER relies heavily on abundant labeled compound expression training data, which are often laboriously collected under the professional instruction of psychology. In this paper, we study compound FER in the cross-domain few-shot learning setting, where only a few images of novel classes from the target domain are required as a reference. In particular, we aim to identify unseen compound expressions with the model trained on easily accessible basic expression datasets. To alleviate the problem of limited base classes in our FER task, we propose a novel Emotion Guided Similarity Network (EGS-Net), consisting of an emotion branch and a similarity branch, based on a two-stage learning framework. Specifically, in the first stage, the similarity branch is jointly trained with the emotion branch in a multi-task fashion. With the regularization of the emotion branch, we prevent the similarity branch from overfitting to sampled base classes that are highly overlapped across different episodes. In the second stage, the emotion branch and the similarity branch play a "two-student game" to alternately learn from each other, thereby further improving the inference ability of the similarity branch on unseen compound expressions. Experimental results on both in-the-lab and in-the-wild compound expression datasets demonstrate the superiority of our proposed method against several state-of-the-art methods.


title: Fibrantly generated weak factorization systems

abstract: We prove that, assuming Vop\venka's principle, every small projectivity class in a locally presentable category is accessible.


title: Label-dependent and event-guided interpretable disease risk prediction using EHRs

abstract: Electronic health records (EHRs) contain patients' heterogeneous data that are collected from medical providers involved in the patient's care, including medical notes, clinical events, laboratory test results, symptoms, and diagnoses. In the field of modern healthcare, predicting whether patients would experience any risks based on their EHRs has emerged as a promising research area, in which artificial intelligence (AI) plays a key role. To make AI models practically applicable, it is required that the prediction results should be both accurate and interpretable. To achieve this goal, this paper proposed a label-dependent and event-guided risk prediction model (LERP) to predict the presence of multiple disease risks by mainly extracting information from unstructured medical notes. Our model is featured in the following aspects. First, we adopt a label-dependent mechanism that gives greater attention to words from medical notes that are semantically similar to the names of risk labels. Secondly, as the clinical events (e.g., treatments and drugs) can also indicate the health status of patients, our model utilizes the information from events and uses them to generate an event-guided representation of medical notes. Thirdly, both label-dependent and event-guided representations are integrated to make a robust prediction, in which the interpretability is enabled by the attention weights over words from medical notes. To demonstrate the applicability of the proposed method, we apply it to the MIMIC-III dataset, which contains real-world EHRs collected from hospitals. Our method is evaluated in both quantitative and qualitative ways.


title: On a conjecture concerning the shuffle-compatible permutation statistics

abstract: The notion of shuffle-compatible permutation statistics was implicit in Stanley's work on P-partitions and was first explicitly studied by Gessel and Zhuang. The aim of this paper is to prove that the triple ${\rm (udr, pk, des)}$ is shuffle-compatible as conjectured by Gessel and Zhuang, where ${\rm udr}$ denotes the number of up-down runs, ${\rm pk}$ denotes the peak number, and ${\rm des}$ denotes the descent number. This is accomplished by establishing an ${\rm (udr, pk, des)}$-preserving bijection in the spirit of Baker-Jarvis and Sagan's bijective proofs of shuffle-compatibility property of permutation statistics. As an application, our bijection also enables us to prove that the pair $({\rm cpk}, {\rm cdes})$ is cyclic shuffle-compatible, where ${\rm cpk}$ denotes the cyclic peak number and ${\rm cdes}$ denotes the cyclic descent number.


title: Challenges of Return-Oriented-Programming on the Xtensa Hardware Architecture

abstract: This paper shows how the Xtensa architecture can be attacked with Return-Oriented-Programming (ROP). The presented techniques include possibilities for both supported Application Binary Interfaces (ABIs). Especially for the windowed ABI a powerful mechanism is presented that not only allows to jump to gadgets but also to manipulate registers without relying on specific gadgets. This paper purely focuses on how the properties of the architecture itself can be exploited to chain gadgets and not on specific attacks or a gadget catalog.


title: Unsupervised Multimodal Word Discovery based on Double Articulation Analysis with Co-occurrence cues

abstract: Human infants acquire their verbal lexicon with minimal prior knowledge of language based on the statistical properties of phonological distributions and the co-occurrence of other sensory stimuli. This study proposes a novel fully unsupervised learning method for discovering speech units using phonological information as a distributional cue and object information as a co-occurrence cue. The proposed method can acquire words and phonemes from speech signals using unsupervised learning and utilize object information based on multiple modalities-vision, tactile, and auditory-simultaneously. The proposed method is based on the nonparametric Bayesian double articulation analyzer (NPB-DAA) discovering phonemes and words from phonological features, and multimodal latent Dirichlet allocation (MLDA) categorizing multimodal information obtained from objects. In an experiment, the proposed method showed higher word discovery performance than baseline methods. Words that expressed the characteristics of objects (i.e., words corresponding to nouns and adjectives) were segmented accurately. Furthermore, we examined how learning performance is affected by differences in the importance of linguistic information. Increasing the weight of the word modality further improved performance relative to that of the fixed condition.


title: Least squares estimators based on the Adams method for stochastic differential equations with small L\'evy noise

abstract: We consider stochastic differential equations (SDEs) driven by small L\'evy noise with some unknown parameters, and propose a new type of least squares estimators based on discrete samples from the SDEs. To approximate the increments of a process from the SDEs, we shall use not the usual Euler method, but the Adams method, that is, a well-known numerical approximation of the solution to the ordinary differential equation appearing in the limit of the SDE. We show the consistency of the proposed estimators as well as the asymptotic distribution in a suitable observation scheme. We also show that our estimators can be better than the usual LSE based on the Euler method in the finite sample performance.


title: Modelling of a cyclist's power for time trials on a velodrome

abstract: We formulate a phenomenological model to study the power applied by a cyclist on a velodrome\, -- \,for individual timetrials\, -- \,taking into account the straights, circular arcs, connecting transition curves and banking. The dissipative forces we consider are air resistance, rolling resistance, lateral friction and drivetrain resistance. Also, power can be used to increase the kinetic and gravitational potential energy. Herein, to model a steady ride\, -- \,as expected for individual timetrials\, -- \,we assume a constant centre-of-mass speed, while allowing the cadence and power to vary during a lap. Hence, the kinetic energy is constant and the only mechanical energy whose change we need to consider is the increase of gravitational potential energy due to raising the centre of mass upon exiting each curve. The effect of dissipative forces is examined at each point of the lap; the effect of conservative forces is examined as an average. The latter is a small\, -- \,albeit not negligible\, -- \,part of the total power, and its inclusion within a model is a novelty presented herein. It increases the model's empirical adequacy. Following derivations and justifications of expressions that constitute this mathematical model, we present a numerical example. We show that the cadence and power vary slightly during a steady ride. In other words, a constant centre-of-mass speed entails nearly constant cadence and power, as expected for a steady ride and as supported by measurements. Also, we examine changes in the required power due to changes of various quantities, such as air density at a velodrome, laptime and several others, as well as the model sensitivity to input errors. Furthermore, we examine the effects on the required power of slight and gradual changes in speed, which are pertinent to individual time trials.


title: Galactic and Extragalactic Sources of Very High Energy Gamma-rays

abstract: Very high energy {\gamma}-rays are one of the most important messengers of the non-thermal Universe. The major motivation of very high energy {\gamma}-ray astronomy is to find sources of high energy cosmic rays. Several astrophysical sources are known to accelerate cosmic rays to very high energies under extreme conditions. Very high energy {\gamma}-rays are produced at these astrophysical sites or near through interactions of cosmic rays in the surrounding medium close to the sources. Gamma-rays, being neutral, travel in a straight line and thus give us valuable information about the cosmic ray sources and their surroundings. Additionally, very high energy {\gamma}-ray astronomy can probe many fundamental physics questions. Ground-based {\gamma}-ray astronomy began its journey in 1989 when Whipple telescope detected TeV {\gamma}-rays from the Crab, a pulsar wind nebula in the Milky Way. In the last two decades, technological improvements have facilitated the development of the latest generation of very high energy detectors and telescopes which have delivered exciting new results. Until now over two hundred very high energy {\gamma}-ray sources, both galactic and extra-galactic has been detected. These observations have provided a deeper insight into a large number of important questions in high energy astrophysics and astroparticle physics. This review article is an attempt to enumerate the most important results in the exciting and rapidly developing field of very high energy {\gamma}-ray astronomy.


title: Magnetic correlation between two local spins in a quantum spin Hall insulator

abstract: Two spins located at the edge of a quantum spin Hall insulator may interact with each other via indirect spin-exchange interaction mediated by the helical edge states, namely the RKKY interaction, which can be measured by the magnetic correlation between the two spins. By means of the newly developed natural orbitals renormalization group (NORG) method, we investigated the magnetic correlation between two Kondo impurities interacting with the helical edge states, based on the Kane-Mele model defined in a finite zigzag graphene nanoribbon with spin-orbital coupling (SOC). We find that the SOC effect breaks the symmetry in spatial distribution of the magnetic correlation, leading to anisotropy in the RKKY interaction. Specifically, the total correlation is always ferromagnetic (FM) when the two impurities are located at the same sublattice, while it is always antiferromagnetic (AFM) when at the different sublattices. Meanwhile, the behavior of the in-plane correlation is consistent with that of the total correlation. However, the out-of-plane correlation can be tuned from FM to AFM by manipulating either the Kondo coupling or the interimpurity distance. Furthermore, the magnetic correlation is tunable by the SOC, especially that the out-of-plane correlation can be adjusted from FM to AFM by increasing the strength of SOC. Dynamic properties of the system, represented by the spin-staggered excitation spectrum and the spin-staggered susceptibility at the two impurity sites, are finally explored. It is shown that the spin-staggered susceptibility is larger when the two impurities are located at the different sublattices than at the same sublattice, which is consistent with the behavior of the out-of-plane correlation. On the other hand, our study further demonstrates that the NORG is an effective numerical method for studying the quantum impurity systems.


title: Implicit correlations within phenomenological parametric models of the neutron star equation of state

abstract: The rapid increase in the number and precision of astrophysical probes of neutron stars in recent years allows for the inference of their equation of state. Observations target different macroscopic properties of neutron stars which vary from star to star, such as mass and radius, but the equation of state allows for a common description of all neutron stars. To connect these observations and infer the properties of dense matter and neutron stars simultaneously, models for the equation of state are introduced. Parametric models rely on carefully engineered functional forms that reproduce a large array of realistic equations of state. Such models benefit from their simplicity but are limited because any finite-parameter model cannot accurately approximate all possible equations of state. Nonparametric models overcome this by increasing model freedom at the cost of increased complexity. In this study, we compare common parametric and nonparametric models, quantify the limitations of the former, and study the impact of modeling on our current understanding of high-density physics. We show that parametric models impose strongly model-dependent, and sometimes opaque, correlations between density scales. Such interdensity correlations result in tighter constraints that are unsupported by data and can lead to biased inference of the equation of state and of individual neutron star properties.


title: Tit for Tattling: Cooperation, communication, and how each could stabilize the other

abstract: Indirect reciprocity is a mechanism by which individuals cooperate with those who have cooperated with others. This creates a regime in which repeated interactions are not necessary to incent cooperation (as would be required for direct reciprocity). However, indirect reciprocity creates a new problem: how do agents know who has cooperated with others? To know this, agents would need to access some form of reputation information. Perhaps there is a communication system to disseminate reputation information, but how does it remain truthful and informative? Most papers assume the existence of a truthful, forthcoming, and informative communication system; in this paper, we seek to explain how such a communication system could remain evolutionarily stable in the absence of exogenous pressures. Specifically, we present three conditions that together maintain both the truthfulness of the communication system and the prevalence of cooperation: individuals (1) use a norm that rewards the behaviors that it prescribes (an aligned norm), (2) can signal not only about the actions of other agents, but also about their truthfulness (by acting as third party observers to an interaction), and (3) make occasional mistakes, demonstrating how error can create stability by introducing diversity.


title: Bumpy metric theorem in the sense of Man{\'e} for non-convex Hamiltonians

abstract: We prove a bumpy metric theorem in the sense of Ma\~{n}e for non-convex Hamiltonians that are satisfying a certain geometric property.


title: Resistance Training using Prior Bias: toward Unbiased Scene Graph Generation

abstract: Scene Graph Generation (SGG) aims to build a structured representation of a scene using objects and pairwise relationships, which benefits downstream tasks. However, current SGG methods usually suffer from sub-optimal scene graph generation because of the long-tailed distribution of training data. To address this problem, we propose Resistance Training using Prior Bias (RTPB) for the scene graph generation. Specifically, RTPB uses a distributed-based prior bias to improve models' detecting ability on less frequent relationships during training, thus improving the model generalizability on tail categories. In addition, to further explore the contextual information of objects and relationships, we design a contextual encoding backbone network, termed as Dual Transformer (DTrans). We perform extensive experiments on a very popular benchmark, VG150, to demonstrate the effectiveness of our method for the unbiased scene graph generation. In specific, our RTPB achieves an improvement of over 10% under the mean recall when applied to current SGG methods. Furthermore, DTrans with RTPB outperforms nearly all state-of-the-art methods with a large margin.


title: Retinal processing: insights from mathematical modelling

abstract: The retina is the entrance of the visual system. Although based on common biophysical principles the dynamics of retinal neurons is quite different from their cortical counterparts, raising interesting problems for modellers. In this paper I address some mathematically stated questions in this spirit, discussing, in particular: (1) How could lateral amacrine cell connectivity shape the spatio-temporal spike response of retinal ganglion cells ? (2) How could spatio-temporal stimuli correlations and retinal network dynamics shape the spike train correlations at the output of the retina ? These questions are addressed, first, introducing a mathematically tractable model of the layered retina, integrating amacrine cells lateral connectivity and piecewise linear rectification, allowing to compute the retinal ganglion cells receptive field together with the voltage and spike correlations of retinal ganglion cells resulting from the amacrine cells networks. Then, I review some recent results showing how the concept of spatio-temporal Gibbs distributions and linear response theory can be used to characterize the collective spike response to a spatio-temporal stimulus of a set of retinal ganglion cells, coupled via effective interactions corresponding to the amacrine cells network. On these bases, I briefly discuss several potential consequences of these results at the cortical level.


title: CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities

abstract: Large language models (LMs) offer unprecedented language generation capabilities and exciting opportunities for interaction design. However, their highly context-dependent capabilities are difficult to grasp and are often subjectively interpreted. In this paper, we argue that by curating and analyzing large interaction datasets, the HCI community can foster more incisive examinations of LMs' generative capabilities. Exemplifying this approach, we present CoAuthor, a dataset designed for revealing GPT-3's capabilities in assisting creative and argumentative writing. CoAuthor captures rich interactions between 63 writers and four instances of GPT-3 across 1445 writing sessions. We demonstrate that CoAuthor can address questions about GPT-3's language, ideation, and collaboration capabilities, and reveal its contribution as a writing "collaborator" under various definitions of good collaboration. Finally, we discuss how this work may facilitate a more principled discussion around LMs' promises and pitfalls in relation to interaction design. The dataset and an interface for replaying the writing sessions are publicly available at https://coauthor.stanford.edu.


title: The extent of ionization in simulations of radio-loud AGNs impacting kpc gas discs

abstract: We use the results of relativistic hydrodynamic simulations of jet-ISM interactions in a galaxy with a radio-loud AGN to quantify the extent of ionization in the central few kpcs of the gaseous galactic disc. We perform post-process radiative transfer of AGN radiation through the simulated gaseous jet-perturbed disc to estimate the extent of photo-ionization by the AGN with an incident luminosity of $10^{45}~\mathrm{erg\,s^{-1}}$. We also map the gas that is collisionally ionized due to shocks driven by the jet. The analysis was carried out for simulations with similar jet power ($10^{45}~\mathrm{erg\,s^{-1}}$) but different jet orientations with respect to the gas disc. We find that the shocks from the jets can ionize a significant fraction (up to 33$\%$) of dense gas ($n>100\,\mathrm{cm^{-3}}$) in the disc, and that the jets clear out the central regions of gas for AGN radiation to penetrate to larger distances in the disc. Jets inclined towards the disc plane couple more strongly with the ISM and ionize a larger fraction of gas in the disc as compared to the vertical jet. However, similar to previous studies, we find that the AGN radiation is quickly absorbed by the outer layers of dense clouds in the disc, and is not able to substantially ionize the disc on a global scale. Thus, compared to jet-ISM interactions, we expect that photo-ionization by the AGN radiation only weakly affects the star-formation activity in the central regions of the galactic disc ($\lesssim 1$ kpc), although the jet-induced shocks can spread farther out.


title: On the central limit theorem for stationary random fields under L 1 -projective condition

abstract: The first aim of this paper is to wonder to what extent we can generalize the central limit theorem of Gordin [5] under the so-called L 1-projective criteria to ergodic stationary random fields when completely commuting filtrations are considered. Surprisingly it appears that this result cannot be extended to its full generality and that an additional condition is needed.


title: Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze

abstract: This paper describes a feature extraction and gaze estimation software, named \textit{Pistol} that can be used with Pupil Invisible projects and other eye trackers in the future. In offline mode, our software extracts multiple features from the eye including, the pupil and iris ellipse, eye aperture, pupil vector, iris vector, eye movement types from pupil and iris velocities, marker detection, marker distance, 2D gaze estimation for the pupil center, iris center, pupil vector, and iris vector using Levenberg Marquart fitting and neural networks. The gaze signal is computed in 2D for each eye and each feature separately and for both eyes in 3D also for each feature separately. We hope this software helps other researchers to extract state-of-the-art features for their research out of their recordings. Link: https://es-cloud.cs.uni-tuebingen.de/d/8e2ab8c3fdd444e1a135/?p=%2FPISTOL&mode=list


title: Numerical solution of the div-curl problem by finite element exterior calculus

abstract: We are interested in the numerical reconstruction of a vector field with prescribed divergence and curl in a general domain of R 3 or R 2 , not necessarily contractible. To this aim, we introduce some basic concepts of finite element exterieur calculus and rely heavily on recent results of P. Leopardi and A. Stern. The goal of the paper is to take advantage of the links between usual vector calculus and exterior calculus and show the interest of the exterior calculus framework, without too much prior knowledge of the subject. We start by describing the method used for contractible domains and its implementation using the FEniCS library (see fenicsproject.org). We then address the problems encountered with non contractible domains and general boundary conditions and explain how to adapt the method to handle these cases. Finally we give some numerical results obtained with this method, in dimension 2 and 3.


title: Improved Bounds on the Span of $L(1,2)$-edge Labeling of Some Infinite Regular Grids

abstract: For two given nonnegative integers $h$ and $k$, an $L(h,k)$-edge labeling of a graph $G$ is the assignment of labels $\{0,1, \cdots, n\}$ to the edges so that two edges having a common vertex are labeled with difference at least $h$ and two edges not having any common vertex but having a common edge connecting them are labeled with difference at least $k$. The span $\lambda'_{h,k}{(G)}$ is the minimum $n$ such that $G$ admits an $L(h,k)$-edge labeling. Here our main focus is on finding $\lambda'_{1,2}{(G)}$ for $L(1,2)$-edge labeling of infinite regular hexagonal ($T_3$), square ($T_4$), triangular ($T_6$) and octagonal ($T_8$) grids. It was known that $7 \leq \lambda'_{1,2}{(T_3)} \leq 8$, $10 \leq \lambda'_{1,2}{(T_4)} \leq 11$, $16 \leq \lambda'_{1,2}{(T_6)} \leq 20$ and $25 \leq \lambda'_{1,2}{(T_8)} \leq 28$. Here we settle two long standing open questions i.e. $\lambda'_{1,2}{(T_3)}$ and $\lambda'_{1,2}{(T_4)}$. We show $\lambda'_{1,2}{(T_3)} =7$, $\lambda'_{1,2}{(T_4)}= 11$. We also improve the bound for $T_6$ and $T_8$ and prove $\lambda'_{1,2}{(T_6)} \geq 18$, $ \lambda'_{1,2}{(T_8)} \geq 26$.


title: Uniaxial polarization analysis of bulk ferromagnets: Theory and first experimental Results

abstract: Based on Brown's static equations of micromagnetics, we compute the uniaxial polarization of the scattered neutron beam of a bulk magnetic material. The theoretical expressions are compared to experimental data on a soft magnetic nanocrystalline alloy. The micromagnetic SANS theory provides a general framework for polarized real-space neutron methods, and it opens up a new avenue for magnetic neutron data analysis on magnetic microstructures.


title: Feedback law to stabilize linear infinite-dimensional systems

abstract: We design a new feedback law to stabilize a linear infinite-dimensional control system, where the state operator generates a C0-group and the control operator is unbounded. Our feedback law is based on the integration of a mutated Gramian operator-valued function. In the structure of the aforementioned mutated Gramian operator, we utilize the weak observability inequality in [21, 14] and borrow some idea used to construct generalized Gramian operators in [11, 23, 24]. Unlike most related works where the exact controllability is required, we only assume the above-mentioned weak observability inequality which is equivalent to the stabilizability of the system.


title: Visual Sensor Network Stimulation Model Identification via Gaussian Mixture Model and Deep Embedded Features

abstract: Visual sensor networks (VSNs) constitute a fundamental class of distributed sensing systems, with unique complexity and appealing performance features, which correspondingly bring in quite active lines of research. An important research direction consists in the identification and estimation of the VSN sensing features: these are practically useful when scaling with the number of cameras or with the observed scene complexity. With this context in mind, this paper introduces for the first time the idea of Stimulation Model (SM), as a mathematical relation between the set of detectable events and the corresponding stimulated cameras observing those events. The formulation of the related SM identification problem is proposed, along with a proper network observations model, and a solution approach based on deep embedded features and soft clustering. In detail: first, the Gaussian Mixture Modeling is employed to provide a suitable description for data distribution, while an autoencoder is used to reduce undesired effects due to the so-called curse of dimensionality emerging in case of large scale networks. Then, it is shown that a SM can be learnt by solving Maximum A-Posteriori estimation on the encoded features belonging to a space with lower dimensionality. Numerical results on synthetic scenarios are reported to validate the devised estimation algorithm.


title: A Shorter Path to Celestial Currents

abstract: Here we consider what happens when we lift a codimension-1 slice of the celestial sphere to a codimension-1 slice of the bulk spacetime in a manner that respects our ability to quotient by the null generators of $\mathcal{I}^\pm$ to get to our codimension-2 hologram. The contour integrals of the 2D currents for the celestial symmetries lift to the standard boundary integrals of the 2-form generators for the gauge theory and celestial Ward identities follow directly from Noether's theorem.


title: An Efficient Hashing-based Ensemble Method for Collaborative Outlier Detection

abstract: In collaborative outlier detection, multiple participants exchange their local detectors trained on decentralized devices without exchanging their own data. A key problem of collaborative outlier detection is efficiently aggregating multiple local detectors to form a global detector without breaching the privacy of participants' data and degrading the detection accuracy. We study locality-sensitive hashing-based ensemble methods to detect collaborative outliers since they are mergeable and compatible with differentially private mechanisms. Our proposed LSH iTables is simple and outperforms recent ensemble competitors on centralized and decentralized scenarios over many real-world data sets.


title: Statistical mechanics analysis of general multi-dimensional knapsack problems

abstract: Knapsack problem (KP) is a representative combinatorial optimization problem that aims to maximize the total profit by selecting a subset of items under given constraints on the total weights. In this study, we analyze a generalized version of KP, which is termed the generalized multidimensional knapsack problem (GMDKP). As opposed to the basic KP, GMDKP allows multiple choices per item type under multiple weight constraints. Although several efficient algorithms are known and the properties of their solutions have been examined to a significant extent for basic KPs, there is a paucity of known algorithms and studies on the solution properties of GMDKP. To gain insight into the problem, we assess the typical achievable limit of the total profit for a random ensemble of GMDKP using the replica method. Our findings are summarized as follows: (1) When the profits of item types are normally distributed, the total profit grows in the leading order with respect to the number of item types as the maximum number of choices per item type $x^{\rm max}$ increases while it depends on $x^{\rm max}$ only in a sub-leading order if the profits are constant among the item types. (2) A greedy-type heuristic can find a nearly optimal solution whose total profit is lower than the optimal value only by a sub-leading order with a low computational cost. (3) The sub-leading difference from the optimal total profit can be improved by a heuristic algorithm based on the cavity method. Extensive numerical experiments support these findings.


title: General P-Splines for Non-Uniform B-Splines

abstract: We proposed a new penalized B-splines estimator, the general P-spline, to accommodate non-uniform B-splines on unevenly spaced knots. It is a complement to Eilers and Marx's standard P-spline tailored for uniform B-splines on equidistant knots. At its core, we derived a novel general difference penalty that accounts for irregular knot spacing, while still being easy to compute and interpret. Both P-spline variants are useful for practical smoothing, because either one can produce a more satisfactory fit than the other, depending on the knot sequence being used and the data being analyzed. Therefore, practitioners should try out both before betting on either one, for which we have implemented general P-spline in R packages gps and gps.mgcv. The new general P-spline is closely related to O'Sullivan spline (or O-spline) through a sandwich formula that links general difference penalty to derivative penalty. Though both penalties seem equally powerful in wiggliness control for their mathematical association and statistical similarity, simulation studies show that general P-spline either outperforms O-spline in terms of mean squared error, or performs equally well, making it a superior replacement of O-spline.


title: Comparison of Bayesian and particle swarm algorithms for hyperparameter optimisation in machine learning applications in high energy physics

abstract: When using machine learning (ML) techniques, users typically need to choose a plethora of algorithm-specific parameters, referred to as hyperparameters. In this paper, we compare the performance of two algorithms, particle swarm optimisation (PSO) and Bayesian optimisation (BO), for the autonomous determination of these hyperparameters in applications to different ML tasks typical for the field of high energy physics (HEP). Our evaluation of the performance includes a comparison of the capability of the PSO and BO algorithms to make efficient use of the highly parallel computing resources that are characteristic of contemporary HEP experiments.


title: Fast quantum state transfer and entanglement for cavity-coupled many qubits via dark pathways

abstract: Quantum state transfer (QST) and entangled state generation (ESG) are important building blocks for modern quantum information processing. To achieve these tasks, convention wisdom is to consult the quantum adiabatic evolution, which is time-consuming, and thus is of low fidelity. Here, using the shortcut to adiabaticity technique, we propose a general method to realize high-fidelity fast QST and ESG in a cavity-coupled many qubits system via its dark pathways, which can be further designed for high-fidelity quantum tasks with different optimization purpose. Specifically, with a proper dark pathway, QST and ESG between any two qubits can be achieved without decoupling the others, which simplifies experimental demonstrations. Meanwhile, ESG among all qubits can also be realized in a single step. In addition, our scheme can be implemented in many quantum systems, and we illustrate its implementation on superconducting quantum circuits. Therefore, we propose a powerful strategy for selective quantum manipulation, which is promising in cavity coupled quantum systems and could find many convenient applications in quantum information processing.


title: Tutela: An Open-Source Tool for Assessing User-Privacy on Ethereum and Tornado Cash

abstract: A common misconception among blockchain users is that pseudonymity guarantees privacy. The reality is almost the opposite. Every transaction one makes is recorded on a public ledger and reveals information about one's identity. Mixers, such as Tornado Cash, were developed to preserve privacy through "mixing" transactions with those of others in an anonymity pool, making it harder to link deposits and withdrawals from the pool. Unfortunately, it is still possible to reveal information about those in the anonymity pool if users are not careful. We introduce Tutela, an application built on expert heuristics to report the true anonymity of an Ethereum address. In particular, Tutela has three functionalities: first, it clusters together Ethereum addresses based on interaction history such that for an Ethereum address, we can identify other addresses likely owned by the same entity; second, it shows Ethereum users their potentially compromised transactions; third, Tutela computes the true size of the anonymity pool of each Tornado Cash mixer by excluding potentially compromised transactions. A public implementation of Tutela can be found at https://github.com/TutelaLabs/tutela-app. To use Tutela, visit https://www.tutela.xyz.


title: FeynGrav : FeynCalc extension for gravity amplitudes

abstract: Package FeynGrav which provides a framework to deal with Feynman rules for gravity within FeynCalc is presented. We present a framework to deal with the corresponding Feynman rules for general relativity and non-supersymmetric matter minimally coupled to gravity. Applicability of the package is tested with 2 -> 2 on-shell tree level graviton scattering, polarization operators, and one-loop scalar-gravitational interaction structure.


title: Geometric quenches in quasi-disordered lattice system

abstract: While global quantum quench has been extensively used in the literature to understand the localization-delocalization transition for the one-dimensional quantum spin chain, the effect of geometric quench (which corresponds to a sudden change of the geometry of the chain) in the context of such transitions is yet to be well understood. In this work, we investigate the effect of geometric quench in the Aubry-Andre model, which supports localization-delocalization transition even in one dimension. We study the spreading of the entanglement and the site-occupation with time and find many interesting features that can be used to characterize localization-delocalization transition. We observe that geometric quench causes a power-law type growth of the entanglement entropy in the delocalized phase in contrast to the linear growth which is found in the global quench studies. Remarkably, we also find that the saturation values in the Many-body localized (MBL) phase obey Area law in contrast to the usual volume law which is a signature feature of the MBL phase in the context of global quench.


title: Leaving No One Behind: A Multi-Scenario Multi-Task Meta Learning Approach for Advertiser Modeling

abstract: Advertisers play an essential role in many e-commerce platforms like Taobao and Amazon. Fulfilling their marketing needs and supporting their business growth is critical to the long-term prosperity of platform economies. However, compared with extensive studies on user modeling such as click-through rate predictions, much less attention has been drawn to advertisers, especially in terms of understanding their diverse demands and performance. Different from user modeling, advertiser modeling generally involves many kinds of tasks (e.g. predictions of advertisers' expenditure, active-rate, or total impressions of promoted products). In addition, major e-commerce platforms often provide multiple marketing scenarios (e.g. Sponsored Search, Display Ads, Live Streaming Ads) while advertisers' behavior tend to be dispersed among many of them. This raises the necessity of multi-task and multi-scenario consideration in comprehensive advertiser modeling, which faces the following challenges: First, one model per scenario or per task simply doesn't scale; Second, it is particularly hard to model new or minor scenarios with limited data samples; Third, inter-scenario correlations are complicated, and may vary given different tasks. To tackle these challenges, we propose a multi-scenario multi-task meta learning approach (M2M) which simultaneously predicts multiple tasks in multiple advertising scenarios.


title: The unusual emission from PSR B1859+07 with FAST

abstract: We present simultaneous broad-band radio observations on the abnormal emission mode from PSR B1859$+$07 using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). This pulsar shows peculiar emission phenomena, which are occasional shifts of emission to an early rotational phase and mode change of emission at the normal phase. We confirm all these three emission modes with our datasets, including the B (burst) and Q (quiet) modes of the non-shift pulses and the emission shift mode with a quasi-periodicity of 155 pulses. We also identify a new type of emission shift event, which has emission at the normal phase during the event. We studied polarisation properties of these emission modes in details, and found that they all have similar polarisation angle (PA) curve, indicating the emission of all these three modes are from the same emission height.


title: Dynamic density correlations in a baryon rich fluid using Mori-Zwanzig-Nakjima projection operator method

abstract: In this work, we calculate the dynamic density correlations using Mori-Zwanzig-Nakajima projection operator method. With a judicious choice of slow variables we derive the evolution equations for these slow variables starting from generalised Langevin equation. We get the hydrodynamic form of density correlations function which consist of two acoustic peaks: also called Brillouin peaks, and one thermal peak: also called Rayleigh peak. We then estimate the dynamic density correlations near the critical point using critical exponents extracted from the statistical bootstrap model of hadronic matter. We find that the bulk viscosity contributes to the sound attenuation at leading order $\sim|t|^{-\frac{5}{4}}$ while the thermal conductivity contribute at sub-leading order $\sim|t|^{-\frac{3}{4}}$. On the other hand, only the thermal conductivity contributes at leading order $\sim|t|^{\frac{1}{4}}$ to the thermal diffusivity. We discuss the implications of these results in a search for the QCD critical point in the heavy-ion collision experiments.


title: Buildup of the Magnetic Flux Ropes in Homologous Solar Eruptions

abstract: Homologous coronal mass ejections (CMEs) are an interesting phenomenon, and it is possible to investigate the formation of CMEs by comparing multi-CMEs under a homologous physical condition. AR 11283 had been present on the solar surface for several days when a bipole emerged on 2011 September 4. Its positive polarity collided with the pre-existing negative polarity belonging to a different bipole, producing recurrent solar activities along the polarity inversion line (PIL) between the colliding polarities, namely the so-called collisional PIL (cPIL). Our results show that a large amount of energy and helicity were built up in the form of magnetic flux ropes (MFRs), with recurrent release and accumulation processes. These MFRs were built up along the cPIL. A flux deficit method is adopted and shows that magnetic cancellation happens along the cPIL due to the collisional shearing scenario proposed by Chintzoglou et al. The total amount of canceled flux was $\sim$0.7$\times$10$^{21}$ Mx with an uncertainty of $\sim$13.2$\%$ within the confidence region of the 30$^\circ$ sun-center distance. The canceled flux amounts to 24$\%$ of the total unsigned flux of the bipolar magnetic region. The results show that the magnetic fields beside the cPIL are very sheared, and the average shear angle is above 70$^\circ$ after the collision. The fast expansion of the twist kernels of the MFRs and the continuous eruptive activities are both driven by the collisional shearing process. These results are important for better understanding the buildup process of the MFRs associated with homologous solar eruptions.


title: Snooker Statistics and Zipf's Law

abstract: Zipf's law is well known in linguistics: the frequency of a word is inversely proportional to its rank. This is a special case of a more general power law, a common phenomenon in many kinds of real-world statistical data. Here, it is shown that snooker statistics also follow such a mathematical pattern, but with varying (estimated) parameter values. Two types of rankings (prize money earned and centuries scored), and three time-frames (all-time, decade, and year) are considered. The results indicate that the power law parameter values depend on the type of ranking used as well as the time-frame considered. Furthermore, in some cases the resulting parameter values vary significantly over time, for which a plausible explanation is provided.


title: Sensor Scheduling Design for Complex Networks under a Distributed State Estimation Framework

abstract: This paper investigates sensor scheduling for state estimation of complex networks over shared transmission channels. For a complex network of dynamical systems, referred to as nodes, a sensor network is adopted to measure and estimate the system states in a distributed way, where a sensor is used to measure a node. The estimates are transmitted from sensors to the associated nodes, in the presence of one-step time delay and subject to packet loss. Due to limited transmission capability, only a portion of sensors are allowed to send information at each time step. The goal of this paper is to seek an optimal sensor scheduling policy minimizing the overall estimation errors. Under a distributed state estimation framework, this problem is reformulated as a Markov decision process, where the one-stage reward for each node is strongly coupled. The feasibility of the problem reformulation is ensured. In addition, an easy-to-check condition is established to guarantee the existence of an optimal deterministic and stationary policy. Moreover, it is found that the optimal policies have a threshold, which can be used to reduce the computational complexity in obtaining these policies. Finally, the effectiveness of the theoretical results is illustrated by several simulation examples.


title: Recommendation Unlearning

abstract: Recommender systems provide essential web services by learning users' personal preferences from collected data. However, in many cases, systems also need to forget some training data. From the perspective of privacy, several privacy regulations have recently been proposed, requiring systems to eliminate any impact of the data whose owner requests to forget. From the perspective of utility, if a system's utility is damaged by some bad data, the system needs to forget these data to regain utility. From the perspective of usability, users can delete noise and incorrect entries so that a system can provide more useful recommendations. While unlearning is very important, it has not been well-considered in existing recommender systems. Although there are some researches have studied the problem of machine unlearning in the domains of image and text data, existing methods can not been directly applied to recommendation as they are unable to consider the collaborative information. In this paper, we propose RecEraser, a general and efficient machine unlearning framework tailored to recommendation task. The main idea of RecEraser is to partition the training set into multiple shards and train a constituent model for each shard. Specifically, to keep the collaborative information of the data, we first design three novel data partition algorithms to divide training data into balanced groups based on their similarity. Then, considering that different shard models do not uniformly contribute to the final prediction, we further propose an adaptive aggregation method to improve the global model utility. Experimental results on three public benchmarks show that RecEraser can not only achieve efficient unlearning, but also outperform the state-of-the-art unlearning methods in terms of model utility. The source code can be found at https://github.com/chenchongthu/Recommendation-Unlearning


title: Nonparametric Feature Selection by Random Forests and Deep Neural Networks

abstract: Random forests are a widely used machine learning algorithm, but their computational efficiency is undermined when applied to large-scale datasets with numerous instances and useless features. Herein, we propose a nonparametric feature selection algorithm that incorporates random forests and deep neural networks, and its theoretical properties are also investigated under regularity conditions. Using different synthetic models and a real-world example, we demonstrate the advantage of the proposed algorithm over other alternatives in terms of identifying useful features, avoiding useless ones, and the computation efficiency. Although the algorithm is proposed using standard random forests, it can be widely adapted to other machine learning algorithms, as long as features can be sorted accordingly.


title: Global existence for partially dissipative hyperbolic systems in the Lp framework, and relaxation limit

abstract: Here we investigate global strong solutions for a class of partially dissipative hyperbolic systems in the framework of critical homogeneous Besov spaces. Our primary goal is to extend the analysis of our previous paper [10] to a functional framework where the low frequencies of the solution are only bounded in L p-type spaces with p larger than 2. This enables us to prescribe weaker smallness conditions for global well-posedness and to get a more accurate information on the qualitative properties of the constructed solutions. Our existence theorem in particular applies to the multi-dimensional isentropic compressible Euler system with relaxation, and provide us with bounds that are independent of the relaxation parameter. As a consequence, we justify rigorously the relaxation limit to the porous media equation and exhibit explicit rates of convergence for suitable norms, a completely new result to the best of our knowledge.


title: Adaptive Weighted Guided Image Filtering for Depth Enhancement in Shape-From-Focus

abstract: Existing shape from focus (SFF) techniques cannot preserve depth edges and fine structural details from a sequence of multi-focus images. Moreover, noise in the sequence of multi-focus images affects the accuracy of the depth map. In this paper, a novel depth enhancement algorithm for the SFF based on an adaptive weighted guided image filtering (AWGIF) is proposed to address the above issues. The AWGIF is applied to decompose an initial depth map which is estimated by the traditional SFF into a base layer and a detail layer. In order to preserve the edges accurately in the refined depth map, the guidance image is constructed from the multi-focus image sequence, and the coefficient of the AWGIF is utilized to suppress the noise while enhancing the fine depth details. Experiments on real and synthetic objects demonstrate the superiority of the proposed algorithm in terms of anti-noise, and the ability to preserve depth edges and fine structural details compared to existing methods.


title: STURE: Spatial-Temporal Mutual Representation Learning for Robust Data Association in Online Multi-Object Tracking

abstract: Online multi-object tracking (MOT) is a longstanding task for computer vision and intelligent vehicle platform. At present, the main paradigm is tracking-by-detection, and the main difficulty of this paradigm is how to associate current candidate detections with historical tracklets. However, in the MOT scenarios, each historical tracklet is composed of an object sequence, while each candidate detection is just a flat image, which lacks temporal features of the object sequence. The feature difference between current candidate detections and historical tracklets makes the object association much harder. Therefore, we propose a Spatial-Temporal Mutual Representation Learning (STURE) approach which learns spatial-temporal representations between current candidate detections and historical sequences in a mutual representation space. For historical trackelets, the detection learning network is forced to match the representations of sequence learning network in a mutual representation space. The proposed approach is capable of extracting more distinguishing detection and sequence representations by using various designed losses in object association. As a result, spatial-temporal feature is learned mutually to reinforce the current detection features, and the feature difference can be relieved. To prove the robustness of the STURE, it is applied to the public MOT challenge benchmarks and performs well compared with various state-of-the-art online MOT trackers based on identity-preserving metrics.


title: Deep Learning Based Framework for Iranian License Plate Detection and Recognition

abstract: License plate recognition systems have a very important role in many applications such as toll management, parking control, and traffic management. In this paper, a framework of deep convolutional neural networks is proposed for Iranian license plate recognition. The first CNN is the YOLOv3 network that detects the Iranian license plate in the input image while the second CNN is a Faster R-CNN that recognizes and classifies the characters in the detected license plate. A dataset of Iranian license plates consisting of ill-conditioned images also developed in this paper. The YOLOv3 network achieved 99.6% mAP, 98.26% recall, 98.08% accuracy, and average detection speed is only 23ms. Also, the Faster R-CNN network trained and tested on the developed dataset and achieved 98.97% recall, 99.9% precision, and 98.8% accuracy. The proposed system can recognize the license plate in challenging situations like unwanted data on the license plate. Comparing this system with other Iranian license plate recognition systems shows that it is Faster, more accurate and also this system can work in an open environment.


title: Characterizing level one in group-based concatenation hierarchies

abstract: We investigate two operators on classes of regular languages: polynomial closure (Pol) and Boolean closure (Bool). We apply these operators to classes of group languages G and to their well-suited extensions G+, which is the least Boolean algebra containing G and the singleton language containing the empty word. This yields the classes Bool(Pol(G)) and Bool(Pol(G+)). These classes form the first level in important classifications of classes of regular languages, called concatenation hierarchies, which admit natural logical characterizations. We present generic algebraic characterizations of these classes. They imply that one may decide whether a regular language belongs to such a class, provided that a more general problem called separation is decidable for the input class G. The proofs are constructive and rely exclusively on notions from language and automata theory.


title: A sojourn-based approach to semi-Markov Reinforcement Learning

abstract: In this paper we introduce a new approach to discrete-time semi-Markov decision processes based on the sojourn time process. Different characterizations of discrete-time semi-Markov processes are exploited and decision processes are constructed by their means. With this new approach, the agent is allowed to consider different actions depending also on the sojourn time of the process in the current state. A numerical method based on $Q$-learning algorithms for finite horizon reinforcement learning and stochastic recursive relations is investigated. Finally, we consider two toy examples: one in which the reward depends on the sojourn-time, according to the gambler's fallacy; the other in which the environment is semi-Markov even if the reward function does not depend on the sojourn time. These are used to carry on some numerical evaluations on the previously presented $Q$-learning algorithm and on a different naive method based on deep reinforcement learning.


title: Design and performance of a scintillation tracker for track matching in nuclear-emulsion-based neutrino interaction measurement

abstract: Precise measurement of neutrino-nucleus interactions with an accelerator neutrino beam is highly important for current and future neutrino oscillation experiments. To measure muon-neutrino charged-current interactions with nuclear-emulsion-based hybrid detector, muon track matching among the detectors are essential. We describe the design and performance of a newly developed scintillation tracker for the muon track matching in the neutrino-nucleus interaction measurement with nuclear emulsion detectors. The muon tracks are reconstructed using the scintillation tracker and another detector called Baby MIND, then, they are matched with the tracks in nuclear emulsion detectors. The scintillation tracker consists of four layers of horizontally and vertically aligned scintillator bars, covering an area of $1\,\mathrm{m} \times 1\,\mathrm{m}$. In the layer, 24 mm-wide plastic scintillator bars are specially arranged with deliberate gaps between each other. By recognizing the hit pattern of the four layers, a precise positional resolution of 2.5 mm is achieved while keeping the number of readout channels as small as 256. The efficiency of the track matching is evaluated to be more than 97% for forward-going muons, and the positional and angular resolutions of the scintillation tracker are 2.5 mm and 20-40 mrad respectively. The results demonstrate the usefulness of the design of the scintillation tracker for the muon track matching in the nuclear-emulsion-based neutrino-nucleus interaction measurements.


title: Hermite-Pad\'{e} approximation and integrability

abstract: We show that solution to the Hermite-Pad\'{e} type I approximation problem leads in a natural way to a subclass of solutions of the Hirota (discrete Kadomtsev-Petviashvili) system and of its adjoint linear problem. Our result explains the appearence of various ingredients of the integrable systems theory in application to multiple orthogonal polynomials, numerical algorthms, random matrices, and in other branches of mathematical physics and applied mathematics where the Hermite-Pad\'{e} approximation problem is relevant. We present also the geometric algorithm, based on the notion of Desargues maps, of construction of solutions of the problem in the projective space over the field of rational functions. As a byproduct we obtain the corresponding generalization of the Wynn recurrence. We isolate the boundary data of the Hirota system which provide solutions to Hermite-Pad\'{e} problem showing that the corresponding reduction lowers dimensionality of the system. In particular, we obtain certain equations which, in addition to the known ones given by Paszkowski, can be considered as direct analogs of the Frobenius identities. We study the place of the reduced system within the integrability theory, which results in finding multidimensional (in the sense of number of variables) extension of the discrete-time Toda chain equations.


title: The $a^3\Sigma^+$ state of KCs revisited: hyperfine structure analysis and potential refinement

abstract: Laser-induced fluorescence spectra of the $c^3\Sigma^+(v_{c},J_{c}=N_{c})\rightarrow a^3\Sigma^+(v_{a},N_{a} = J_{c} \pm 1)$ transitions excited from the ground $X^1\Sigma^+$ state of $^{39}$K$^{133}$Cs molecule were recorded with Fourier-transform spectrometer IFS125-HR (Bruker) at the highest achievable spectral resolution of 0.0063 cm${}^{-1}$. Systematic study of the hyperfine structure (HFS) of the $a^3\Sigma^+$ state for levels with $v_{a} \in [0, 27]$ and $N_{a} \in [24, 90]$ shows that the splitting monotonically increases with $v_{a}$. The spectroscopic study was supported by ab initio calculations of the magnetic hyperfine interaction in $X^1\Sigma^+$ and $a^3\Sigma^+$ states. The discovered variation of the electronic matrix elements with the internuclear distance $R$ is in a good agreement with the observed $v_{a}$-dependencies of the HFS. Overall set of available experimental data on the $a^3\Sigma^+$ state was used to improve the potential energy curve particularly near a bottom, providing the refined dissociation energy $D_e$=267.21(1) cm${}^{-1}$. The ab initio HFS matrix elements, combined with the empirical $X^1\Sigma^+$ and $a^3\Sigma^+$ PECs in the framework of the invented coupled-channel deperturbation model, reproduce the experimental term values of both ground states within 0.003 cm${}^{-1}$ accuracy up to their common dissociation limit.

categories: physics.atom-ph physics.atm-clus physics.chem-ph physics.comp-ph


title: Photoproduction $\gamma p \to K^+\Lambda(1690)$ in an effective Lagrangian approach

abstract: A gauge-invariant model is constructed for the $\gamma p \to K^+\Lambda(1690)$ reaction within a tree-level effective Lagrangian approach with the purpose to understand the underlying production mechanisms and to study the resonance contributions in this reaction. In addition to the $t$-channel $K$ and $K^\ast$ exchanges, the $s$-channel nucleon exchange, and the interaction current, the $s$-channel nucleon resonance exchanges are also included in constructing the reaction amplitudes to describe the data. It is found that the contributions from the $s$-channel $N(2570)5/2^-$ exchange are required to describe the most recently measured total cross-section data for $\gamma p \to K^+\Lambda(1690)$ from the CLAS Collaboration. Further analysis shows that the interaction current dominates the $\gamma p \to K^+\Lambda(1690)$ reaction near the threshold as a result of gauge invariance. The $t$-channel $K$ exchange contributes significantly, while the contributions from the $t$-channel $K^\ast$ exchange as well as the $s$-channel nucleon exchange turn out to be negligible. The contributions from the $s$-channel $N(2570)5/2^-$ exchange are found to be responsible for the bump structure shown in the CLAS total cross-section data above the center-of-mass energy $W \approx 2.7$ GeV. The predictions of the differential cross sections for $\gamma p \to K^+\Lambda(1690)$ are shown and discussed, which can provide theoretical guidances for the future experiments.


title: Asymptotic stability for two-dimensional Boussinesq systems around the Couette flow in a finite channel

abstract: In this paper, we study the asymptotic stability for the two-dimensional Navier-Stokes Boussinesq system around the Couette flow with small viscosity $\nu$ and small thermal diffusion $\mu$ in a finite channel. In particular, we prove that if the initial velocity and initial temperature $(v_{in},\rho_{in})$ satisfies $\|v_{in}-(y,0)\|_{H_{x,y}^2}\leq \e_0 \min\{\nu,\mu\}^{\f12}$ and $\|\rho_{in}-1\|_{H_x^{1}L_y^2}\leq \e_1 \min\{\nu,\mu\}^{\f{11}{12}}$ for some small $\e_0,\e_1$ independent of $\nu, \mu$, then for the solution of the two-dimensional Navier-Stokes Boussinesq system, the velocity remains within $O(\min\{\nu,\mu\}^{\f12})$ of the Couette flow, and approaches to Couette flow as $t\to\infty$; the temperature remains within $O(\min\{\nu,\mu\}^{\f{11}{12}})$ of the constant $1$, and approaches to $1$ as $t\to\infty$.


title: Influence of channel mixing in fermionic Hong-Ou-Mandel experiments

abstract: We consider an electronic Hong-Ou-Mandel interferometer in the integer quantum Hall regime, where the colliding electronic states are generated by applying voltage pulses (creating for instance Levitons) to ohmic contacts. The aim of this work is to investigate possible mechanisms leading to a reduced visibility of the Pauli dip, i.e., the noise suppression expected for synchronized sources. It is known that electron-electron interactions cannot account for this effect and always lead to a full suppression of the Hong-Ou-Mandel noise. Focusing on the case of filling factor $\nu=2$, we show instead that a reduced visibility of the Pauli dip can result from mixing of the copropagating edge channels, arising from tunneling events between them.


title: Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scale

abstract: The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the scalability of state-of-the-arts starts to become a crucial bottleneck. In this paper, inspired by our experience when deploying hyper-parameter tuning in a real-world application in production and the limitations of existing systems, we propose Hyper-Tune, an efficient and robust distributed hyper-parameter tuning framework. Compared with existing systems, Hyper-Tune highlights multiple system optimizations, including (1) automatic resource allocation, (2) asynchronous scheduling, and (3) multi-fidelity optimizer. We conduct extensive evaluations on benchmark datasets and a large-scale real-world dataset in production. Empirically, with the aid of these optimizations, Hyper-Tune outperforms competitive hyper-parameter tuning systems on a wide range of scenarios, including XGBoost, CNN, RNN, and some architectural hyper-parameters for neural networks. Compared with the state-of-the-art BOHB and A-BOHB, Hyper-Tune achieves up to 11.2x and 5.1x speedups, respectively.


title: Ray Based Distributed Autonomous Vehicle Research Platform

abstract: My project tackles the question of whether Ray can be used to quickly train autonomous vehicles using a simulator (Carla), and whether a platform robust enough for further research purposes can be built around it. Ray is an open-source framework that enables distributed machine learning applications. Distributed computing is a technique which parallelizes computational tasks, such as training a model, among many machines. Ray abstracts away the complex coordination of these machines, making it rapidly scalable. Carla is a vehicle simulator that generates data used to train a model. The bulk of the project was writing the training logic that Ray would use to train my distributed model. Imitation learning is the best fit for autonomous vehicles. Imitation learning is an alternative to reinforcement learning and it works by trying to learn the optimal policy by imitating an expert (usually a human) given a set of demonstrations. A key deliverable for the project was showcasing my trained agent in a few benchmark tests, such as navigating a complex turn through traffic. Beyond that, the broader ambition was to develop a research platform where others could quickly train and run experiments on huge amounts of Carla vehicle data. Thus, my end product is not a single model, but a large-scale, open-source research platform (RayCarla) for autonomous vehicle researchers to utilize.


title: A Computation Model with Automatic Functions and Relations as Primitive Operations

abstract: Prior work of Hartmanis and Simon (Hartmanis and Simon, 1974) and Floyd and Knuth (Floyd and Knuth, 1990) investigated what happens if a device uses primitive steps more natural than single updates of a Turing tape. One finding was that in the numerical setting, addition, subtraction, comparisons and bit-wise Boolean operations of numbers preserve polynomial time while incorporating concatenation or multiplication allows to solve all PSPACE problems in polynomially many steps. Therefore we propose to use updates and comparisons with automatic functions as primitive operations and use constantly many registers; the resulting model covers all primitive operations of Hartmanis and Simon as well as Floyd and Knuth, but the model remains in polynomial time. The present work investigates in particular the deterministic complexity of various natural problems and also gives an overview on the nondeterministic complexity of this model.


title: Landslide Susceptibility Modeling by Interpretable Neural Network

abstract: Landslides are notoriously difficult to predict because numerous spatially and temporally varying factors contribute to slope stability. Artificial neural networks (ANN) have been shown to improve prediction accuracy but are largely uninterpretable. Here we introduce an additive ANN optimization framework to assess landslide susceptibility, as well as dataset division and outcome interpretation techniques. We refer to our approach, which features full interpretability, high accuracy, high generalizability and low model complexity, as superposable neural network (SNN) optimization. We validate our approach by training models on landslide inventory from three different easternmost Himalaya regions. Our SNN outperformed physically-based and statistical models and achieved similar performance to state-of-the-art deep neural networks. The SNN models found the product of slope and precipitation and hillslope aspect to be important primary contributors to high landslide susceptibility, which highlights the importance of strong slope-climate couplings, along with microclimates, on landslide occurrences.


title: Structural changes across thermodynamic maxima in supercooled liquid tellurium: a water-like scenario

abstract: Liquid polymorphism is an intriguing phenomenon which has been found in a few single-component systems, the most famous being water. By supercooling liquid Te to more than 130 K below its melting point and performing simultaneous small-angle and wide-angle X-ray scattering measurements, we observe clear maxima in its thermodynamic response functions around 615 K, suggesting the possible existence of liquid polymorphism. A close look at the underlying structural evolution shows the development of intermediate-range order upon cooling, most strongly around the thermodynamic maxima, which we attribute to bond-orientational ordering. The striking similarities between our results and those of water, despite the lack of hydrogen-bonding and tetrahedrality in tellurium, indicate that water-like anomalies may be a general phenomenon among liquid systems with competing bond- and density-ordering.


title: Virasoro Constraint for Uglov Matrix Model

abstract: We study the root of unity limit of $(\textbf{q}, \textbf{t})$-deformed Virasoro matrix models, for which we call the resulting model Uglov matrix model. We derive the associated Virasoro constraints on the partition function and find agreement of the central charge with the expression obtained from the level-rank duality associated with the parafermion CFT.


title: On the type of the von Neumann algebra of an open subgroup of the Neretin group

abstract: The Neretin group $\mathcal{N}_{d,k}$ is the totally disconnected locally compact group consisting of almost automorphisms of the tree $\mathcal{T}_{d,k}$. This group has a distinguished open subgroup $\mathcal{O}_{d,k}$. We prove that this open subgroup is not of type I. This gives an alternative proof of the recent result of P.-E. Caprace, A. Le Boudec and N. Matte Bon which states that the Neretin group is not of type I, and answers their question whether $\mathcal{O}_{d,k}$ is of type I or not.


title: Human and Automatic Speech Recognition Performance on German Oral History Interviews

abstract: Automatic speech recognition systems have accomplished remarkable improvements in transcription accuracy in recent years. On some domains, models now achieve near-human performance. However, transcription performance on oral history has not yet reached human accuracy. In the present work, we investigate how large this gap between human and machine transcription still is. For this purpose, we analyze and compare transcriptions of three humans on a new oral history data set. We estimate a human word error rate of 8.7% for recent German oral history interviews with clean acoustic conditions. For comparison with recent machine transcription accuracy, we present experiments on the adaptation of an acoustic model achieving near-human performance on broadcast speech. We investigate the influence of different adaptation data on robustness and generalization for clean and noisy oral history interviews. We optimize our acoustic models by 5 to 8% relative for this task and achieve 23.9% WER on noisy and 15.6% word error rate on clean oral history interviews.


title: Unveiling music genre structure through common-interest communities

abstract: Using a dataset of more than 90,000 metal music reviews written by over 9,000 users in a period of 15 years, we analyse the genre structure of metal music with the aid of review text information. We model the relationships between genres using a user-oriented network, based on the written reviews. We then perform community detection and employ a network "averaging" method to obtain stable genre clusters, in order to analyse the structures of clusters both locally within each cluster and globally over the entire network. In addition to identifying the clusters, we use Dependency Parsing and modified Term Frequency - Inverse Document Frequency to extract significant and unique features of each cluster. These structures and review text information can allow us to understand how music audience (fans) perceive similar and different genres, and also assist in classifying different genres which share common-interest user communities, offering a more objective way in grouping music genres. Furthermore, the classification can also help recommendation engines provide more targeted suggestions of music, and potentially help musicians to select genre labels for their music, and design music to better cater to preferences of their audiences based on previous reviews.


title: Surrogate-assisted distributed swarm optimisation for computationally expensive geoscientific models

abstract: Evolutionary algorithms provide gradient-free optimisation which is beneficial for models that have difficulty in obtaining gradients; for instance, geoscientific landscape evolution models. However, such models are at times computationally expensive and even distributed swarm-based optimisation with parallel computing struggles. We can incorporate efficient strategies such as surrogate-assisted optimisation to address the challenges; however, implementing inter-process communication for surrogate-based model training is difficult. In this paper, we implement surrogate-based estimation of fitness evaluation in distributed swarm optimisation over a parallel computing architecture. We first test the framework on a set of benchmark optimisation problems and then apply it to a geoscientific model that features a landscape evolution model. Our results demonstrate very promising results for benchmark functions and the Badlands landscape evolution model. We obtain a reduction in computational time while retaining optimisation solution accuracy through the use of surrogates in a parallel computing environment. The major contribution of the paper is in the application of surrogate-based optimisation for geoscientific models which can in the future help in a better understanding of paleoclimate and geomorphology.


title: Stochastic linear-quadratic control with a jump and regime switching on a random horizon

abstract: In this paper, we study a stochastic linear-quadratic control problem with random coefficients and regime switching on a horizon $[0,T\wedge\tau]$, where $\tau$ is a given random jump time for the underlying state process and $T$ is a constant. We obtain an explicit optimal state feedback control and explicit optimal cost value by solving a system of stochastic Riccati equations (SREs) with jumps on $[0,T\wedge\tau]$. By the decomposition approach stemming from filtration enlargement theory, we express the solution of the system of SREs with jumps in terms of another system of SREs involving only Brownian filtration on the deterministic horizon $[0,T]$. Solving the latter system is the key theoretical contribution of this paper and we establish this for three different cases, one of which seems to be new in the literature. These results are then applied to study a mean-variance hedging problem with random parameters that depend on both Brownian motion and Markov chain. The optimal portfolio and optimal value are presented in closed forms with the aid of a system of linear backward stochastic differential equations with jumps and unbounded coefficients in addition to the SREs with jumps.


title: Taylor3DNet: Fast 3D Shape Inference With Landmark Points Based Taylor Series

abstract: Benefiting from the continuous representation ability, deep implicit functions can represent a shape at infinite resolution. However, extracting high-resolution iso-surface from an implicit function requires forward-propagating a network with a large number of parameters for numerous query points, thus preventing the generation speed. Inspired by the Taylor series, we propose Taylo3DNet to accelerate the inference of implicit shape representations. Taylor3DNet exploits a set of discrete landmark points and their corresponding Taylor series coefficients to represent the implicit field of a 3D shape, and the number of landmark points is independent of the resolution of the iso-surface extraction. Once the coefficients corresponding to the landmark points are predicted, the network evaluation for each query point can be simplified as a low-order Taylor series calculation with several nearest landmark points. Based on this efficient representation, our Taylor3DNet achieves a significantly faster inference speed than classical network-based implicit functions. We evaluate our approach on reconstruction tasks with various input types, and the results demonstrate that our approach can improve the inference speed by a large margin without sacrificing the performance compared with state-of-the-art baselines.


title: The maximum cardinality of trifferent codes with lengths 5 and 6

abstract: A code $\mathcal{C} \subseteq \{0, 1, 2\}^n$ is said to be trifferent with length $n$ when for any three distinct elements of $\mathcal{C}$ there exists a coordinate in which they all differ. Defining $\mathcal{T}(n)$ as the maximum cardinality of trifferent codes with length $n$, $\mathcal{T}(n)$ is unknown for $n \ge 5$. In this note, we use an optimized search algorithm to show that $\mathcal{T}(5) = 10$ and $\mathcal{T}(6) = 13$.


title: A stable and causal model of magnetohydrodynamics

abstract: We formulate the theory of first-order dissipative magnetohydrodynamics in an arbitrary hydrodynamic frame under the assumption of parity-invariance and discrete charge symmetry. We study the mode spectrum of Alfv\'en and magnetosonic waves as well as the spectrum of gapped excitations and derive constraints on the transport coefficients such that generic equilibrium states with constant magnetic fields are stable and causal under linearised perturbations. We solve these constraints for a specific equation of state and show that there exists a large family of hydrodynamic frames that renders the linear fluctuations stable and causal. This theory does not require introducing new dynamical degrees of freedom and therefore is a promising and simpler alternative to M\"{u}ller-Israel-Stewart-type theories. Together with a detailed analysis of transport, entropy production and Kubo formulae, the theory presented here is well suited for studying dissipative effects in various contexts ranging from heavy-ion collisions to astrophysics.


title: High-Level Synthesis Performance Prediction using GNNs: Benchmarking, Modeling, and Advancing

abstract: Agile hardware development requires fast and accurate circuit quality evaluation from early design stages. Existing work of high-level synthesis (HLS) performance prediction usually needs extensive feature engineering after the synthesis process. To expedite circuit evaluation from as earlier design stage as possible, we propose a rapid and accurate performance modeling, exploiting the representation power of graph neural networks (GNNs) by representing C/C++ programs as graphs. The contribution of this work is three-fold. First, we build a standard benchmark containing 40k C synthesizable programs, which includes both synthetic programs and three sets of real-world HLS benchmarks. Each program is implemented on FPGA to generate ground-truth performance metrics. Second, we formally formulate the HLS performance prediction problem on graphs, and propose multiple modeling strategies with GNNs that leverage different trade-offs between prediction timeliness (early/late prediction) and accuracy. Third, we further propose a novel hierarchical GNN that does not sacrifice timeliness but largely improves prediction accuracy, significantly outperforming HLS tools. We apply extensive evaluations for both synthetic and unseen real-case programs; our proposed predictor largely outperforms HLS by up to 40X and excels existing predictors by 2X to 5X in terms of resource usage and timing prediction.


title: Toward Self-learning End-to-End Task-Oriented Dialog Systems

abstract: End-to-end task bots are typically learned over a static and usually limited-size corpus. However, when deployed in dynamic, changing, and open environments to interact with users, task bots tend to fail when confronted with data that deviate from the training corpus, i.e., out-of-distribution samples. In this paper, we study the problem of automatically adapting task bots to changing environments by learning from human-bot interactions with minimum or zero human annotations. We propose SL-AGENT, a novel self-learning framework for building end-to-end task bots. SL-AGENT consists of a dialog model and a pre-trained reward model to predict the quality of an agent response. It enables task bots to automatically adapt to changing environments by learning from the unlabeled human-bot dialog logs accumulated after deployment via reinforcement learning with the incorporated reward model. Experimental results on four well-studied dialog tasks show the effectiveness of SL-AGENT to automatically adapt to changing environments, using both automatic and human evaluations. We will release code and data for further research.