title: RobustART: Benchmarking Robustness on Architecture Design and Training Techniques

abstract: Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design and training techniques affect robustness. Comprehensively benchmarking their relationships is beneficial for better understanding and developing robust DNNs. Thus, we propose RobustART, the first comprehensive Robustness investigation benchmark on ImageNet regarding ARchitecture design (49 human-designed off-the-shelf architectures and 1200+ networks from neural architecture search) and Training techniques (10+ techniques, e.g., data augmentation) towards diverse noises (adversarial, natural, and system noises). Extensive experiments substantiated several insights for the first time, e.g., (1) adversarial training is effective for the robustness against all noises types for Transformers and MLP-Mixers; (2) given comparable model sizes and aligned training settings, CNNs > Transformers > MLP-Mixers on robustness against natural and system noises; Transformers > MLP-Mixers > CNNs on adversarial robustness; (3) for some light-weight architectures, increasing model sizes or using extra data cannot improve robustness. Our benchmark presents: (1) an open-source platform for comprehensive robustness evaluation; (2) a variety of pre-trained models to facilitate robustness evaluation; and (3) a new view to better understand the mechanism towards designing robust DNNs. We will continuously develop to this ecosystem for the community.


title: Memory from coupled instabilities in unfolded crumpled sheets

abstract: Crumpling an ordinary thin sheet transforms it into a structure with unusual mechanical behaviors, such as enhanced rigidity, emission of crackling noise, slow relaxations, and memory retention. A central challenge in explaining these behaviours lies in understanding the contribution of the complex geometry of the sheet. Here, we combine cyclic driving protocols and 3D imaging to correlate the global mechanical response and the underlying geometric transformations in unfolded crumpled sheets. We find that their response to cyclic strain is intermittent, hysteretic, and encodes a memory of the largest applied compression. Using 3D imaging, we show that these behaviours emerge due to an interplay between localized and interacting geometric instabilities in the sheet. A simple model confirms that these minimal ingredients are sufficient to explain the observed behaviors. Finally, we show that after training multiple memories can be encoded, a phenomenon known as return point memory. Our study lays the foundation for understanding the complex mechanics of crumpled sheets and presents an experimental and theoretical framework for the study of memory formation in systems of interacting instabilities.


title: Uncovering Main Causalities for Long-tailed Information Extraction

abstract: Information Extraction (IE) aims to extract structural information from unstructured texts. In practice, long-tailed distributions caused by the selection bias of a dataset, may lead to incorrect correlations, also known as spurious correlations, between entities and labels in the conventional likelihood models. This motivates us to propose counterfactual IE (CFIE), a novel framework that aims to uncover the main causalities behind data in the view of causal inference. Specifically, 1) we first introduce a unified structural causal model (SCM) for various IE tasks, describing the relationships among variables; 2) with our SCM, we then generate counterfactuals based on an explicit language structure to better calculate the direct causal effect during the inference stage; 3) we further propose a novel debiasing approach to yield more robust predictions. Experiments on three IE tasks across five public datasets show the effectiveness of our CFIE model in mitigating the spurious correlation issues.


title: Spin-affected reflexive and stretching separation of off-center droplet collision

abstract: Recent studies have demonstrated the significant roles of droplet self-spin motion in affecting the head-on collision of binary droplets. In this paper, we present a computational study by using the Volume-of-Fluid (VOF) method to investigate the spin-affected droplet separation of off-center collisions, which are more probable in reality and phenomenologically richer than head-on collisions. Different separation modes are identified through a parametric study with varying spinning speed and impact parameter. A prominent finding is that increasing the droplet spinning speed tends to suppress the reflexive separation and to promote the stretching separation. Physically, the reflexive separation is suppressed because the increased rotational energy reduces the excessive reflexive kinetic energy within the droplet, which is the cause for the droplet reflexive separation. The stretching separation is promoted because the increased droplet angular momentum enhances the local stretching flow within the droplet, which tends to separate the droplet. The roles of orbital angular momentum and spin angular momentum in affecting the droplet separation are further substantiated by studying the collision between two spinning droplets with either the same or opposite chirality. In addition, a theoretical model based on conservation laws is proposed to qualitatively describe the boundaries of coalescence-separation transition influenced by droplet self-spin motion.


title: Photon counting probabilities of the output field for a single-photon input

abstract: We derive photon counting statistics for an output field of a single-photon wave packet interacting with a quantum system (e.g. a quantum harmonic oscillator or a two-level atom). We determine the exclusive probability densities for the output field by making use of quantum filtering theory. The quantum trajectories for continuous in time measurements of the output field (reflected and transmitted), are determined starting from a collision model and difference filtering equations. We provide analytical formulae for quantum trajectories associated with a two-dimensional stochastic counting process, we describe their structure, and give a physical interpretation to them. Moreover, we provide analytical expressions for probability densities for the times of successive photon detections for a single-photon field scattered on a two-level atom, for an arbitrary photon profile and any initial state of the atom.


title: A Privacy-Preserving Logistics Information System with Traceability

abstract: Logistics Information System (LIS) is an interactive system that provides information for logistics managers to monitor and track logistics business. In recent years, with the rise of online shopping, LIS is becoming increasingly important. However, since the lack of effective protection of personal information, privacy protection issue has become the most problem concerned by users. Some data breach events in LIS released users' personal information, including address, phone number, transaction details, etc. In this paper, to protect users' privacy in LIS, a privacy-preserving LIS with traceability (PPLIST) is proposed by combining multi-signature with pseudonym. In our PPLIST scheme, to protect privacy, each user can generate and use different pseudonyms in different logistics services. The processing of one logistics is recorded and unforgeable. Additionally, if the logistics information is abnormal, a trace party can de-anonymize users, and find their real identities. Therefore, our PPLIST efficiently balances the relationship between privacy and traceability.


title: Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems

abstract: In recent years, several high-performance conversational systems have been proposed based on the Transformer encoder-decoder model. Although previous studies analyzed the effects of the model parameters and the decoding method on subjective dialogue evaluations with overall metrics, they did not analyze how the differences of fine-tuning datasets affect on user's detailed impression. In addition, the Transformer-based approach has only been verified for English, not for such languages with large inter-language distances as Japanese. In this study, we develop large-scale Transformer-based Japanese dialogue models and Japanese chit-chat datasets to examine the effectiveness of the Transformer-based approach for building chit-chat dialogue systems. We evaluated and analyzed the impressions of human dialogues in different fine-tuning datasets, model parameters, and the use of additional information.


title: Bornon: Bengali Image Captioning with Transformer-based Deep learning approach

abstract: Image captioning using Encoder-Decoder based approach where CNN is used as the Encoder and sequence generator like RNN as Decoder has proven to be very effective. However, this method has a drawback that is sequence needs to be processed in order. To overcome this drawback some researcher has utilized the Transformer model to generate captions from images using English datasets. However, none of them generated captions in Bengali using the transformer model. As a result, we utilized three different Bengali datasets to generate Bengali captions from images using the Transformer model. Additionally, we compared the performance of the transformer-based model with a visual attention-based Encoder-Decoder approach. Finally, we compared the result of the transformer-based model with other models that employed different Bengali image captioning datasets.


title: Fan-out enabled spin wave majority gate

abstract: By its very nature, Spin Wave (SW) interference provides intrinsic support for Majority logic function evaluation. Due to this and the fact that the $3$-input Majority (MAJ3) gate and the Inverter constitute a universal Boolean logic gate set, different MAJ3 gate implementations have been proposed. However, they cannot be directly utilized for the construction of larger SW logic circuits as they lack a key cascading mechanism, i.e., fan-out capability. In this paper, we introduce a novel ladder-shaped SW MAJ3 gate design able to provide a maximum fan-out of 2 (FO2). The proper gate functionality is validated by means of micromagnetic simulations, which also demonstrate that the amplitude mismatch between the two outputs is negligible proving that an FO2 is properly achieved. Additionally, we evaluate the gate area and compare it with SW state-of-the-art and 15nm CMOS counterparts working under the same conditions. Our results indicate that the proposed structure requires 12x less area than the 15 nm CMOS MAJ3 gate and that at the gate level the fan-out capability results in 16% area savings, when compared with the state-of-the-art SW majority gate counterparts.


title: Topological two-particle dynamics in a periodically driven lattice model with on-site interactions

abstract: We develop a realistic protocol to observe a robust topological dynamics of two-particle bound states in a lattice model with on-site interactions and suitably designed time-dependent hoppings. This Floquet scheme can be realistically implemented on existing digital quantum computer platforms. Marked differences from the topological single-particle dynamics of two independent particles and clear signatures of the entanglement between the two constituent particles are highlighted.


title: Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence

abstract: Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM). The method distributes similarities of candidate matches over a geometric transformation space and evaluates them in a convolutional manner. We cast it into a trainable neural layer with a semi-isotropic high-dimensional kernel, which learns non-rigid matching with a small number of interpretable parameters. To further improve the efficiency of high-dimensional voting, we also propose to use an efficient kernel decomposition with center-pivot neighbors, which significantly sparsifies the proposed semi-isotropic kernels without performance degradation. To validate the proposed techniques, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra-class variations.


title: Fundamental limits of over-the-air optimization: Are analog schemes optimal?

abstract: We consider over-the-air convex optimization on a $d-$dimensional space where coded gradients are sent over an additive Gaussian noise channel with variance $\sigma^2$. The codewords satisfy an average power constraint $P$, resulting in the signal-to-noise ratio (SNR) of $P/\sigma^2$. We derive bounds for the convergence rates for over-the-air optimization. Our first result is a lower bound for the convergence rate showing that any code must slowdown the convergence rate by a factor of roughly $\sqrt{d/\log(1+\mathtt{SNR})}$. Next, we consider a popular class of schemes called $analog$ $coding$, where a linear function of the gradient is sent. We show that a simple scaled transmission analog coding scheme results in a slowdown in convergence rate by a factor of $\sqrt{d(1+1/\mathtt{SNR})}$. This matches the previous lower bound up to constant factors for low SNR, making the scaled transmission scheme optimal at low SNR. However, we show that this slowdown is necessary for any analog coding scheme. In particular, a slowdown in convergence by a factor of $\sqrt{d}$ for analog coding remains even when SNR tends to infinity. Remarkably, we present a simple quantize-and-modulate scheme that uses $Amplitude$ $Shift$ $Keying$ and almost attains the optimal convergence rate at all SNRs.


title: 2-in-1 Accelerator: Enabling Random Precision Switch for Winning Both Adversarial Robustness and Efficiency

abstract: The recent breakthroughs of deep neural networks (DNNs) and the advent of billions of Internet of Things (IoT) devices have excited an explosive demand for intelligent IoT devices equipped with domain-specific DNN accelerators. However, the deployment of DNN accelerator enabled intelligent functionality into real-world IoT devices still remains particularly challenging. First, powerful DNNs often come at prohibitive complexities, whereas IoT devices often suffer from stringent resource constraints. Second, while DNNs are vulnerable to adversarial attacks especially on IoT devices exposed to complex real-world environments, many IoT applications require strict security. Existing DNN accelerators mostly tackle only one of the two aforementioned challenges (i.e., efficiency or adversarial robustness) while neglecting or even sacrificing the other. To this end, we propose a 2-in-1 Accelerator, an integrated algorithm-accelerator co-design framework aiming at winning both the adversarial robustness and efficiency of DNN accelerators. Specifically, we first propose a Random Precision Switch (RPS) algorithm that can effectively defend DNNs against adversarial attacks by enabling random DNN quantization as an in-situ model switch. Furthermore, we propose a new precision-scalable accelerator featuring (1) a new precision-scalable MAC unit architecture which spatially tiles the temporal MAC units to boost both the achievable efficiency and flexibility and (2) a systematically optimized dataflow that is searched by our generic accelerator optimizer. Extensive experiments and ablation studies validate that our 2-in-1 Accelerator can not only aggressively boost both the adversarial robustness and efficiency of DNN accelerators under various attacks, but also naturally support instantaneous robustness-efficiency trade-offs adapting to varied resources without the necessity of DNN retraining.


title: Ergodic property of random diffusivity system with trapping events

abstract: Brownian yet non-Gaussian phenomenon has recently been observed in many biological and active matter systems. The main idea of explaining this phenomenon is to introduce a random diffusivity for particles moving in inhomogeneous environment. This paper considers a Langevin system containing a random diffusivity and an $\alpha$-stable subordinator with $\alpha<1$. This model describes the particle's motion in complex media where both the long trapping events and random diffusivity exist. We derive the general expressions of ensemble- and time-averaged mean-squared displacements which only contain the values of the inverse subordinator and diffusivity. Further taking specific time-dependent diffusivity, we obtain the analytic expressions of ergodicity breaking parameter and probability density function of the time-averaged mean-squared displacement. The results imply the nonergodicity of the random diffusivity model for any kind of diffusivity, including the critical case where the model presenting normal diffusion.


title: Space Meets Time: Local Spacetime Neural Network For Traffic Flow Forecasting

abstract: Traffic flow forecasting is a crucial task in urban computing. The challenge arises as traffic flows often exhibit intrinsic and latent spatio-temporal correlations that cannot be identified by extracting the spatial and temporal patterns of traffic data separately. We argue that such correlations are universal and play a pivotal role in traffic flow. We put forward {spacetime interval learning} as a paradigm to explicitly capture these correlations through a unified analysis of both spatial and temporal features. Unlike the state-of-the-art methods, which are restricted to a particular road network, we model the universal spatio-temporal correlations that are transferable from cities to cities. To this end, we propose a new spacetime interval learning framework that constructs a local-spacetime context of a traffic sensor comprising the data from its neighbors within close time points. Based on this idea, we introduce local spacetime neural network (STNN), which employs novel spacetime convolution and attention mechanism to learn the universal spatio-temporal correlations. The proposed STNN captures local traffic patterns, which does not depend on a specific network structure. As a result, a trained STNN model can be applied on any unseen traffic networks. We evaluate the proposed STNN on two public real-world traffic datasets and a simulated dataset on dynamic networks. The experiment results show that STNN not only improves prediction accuracy by 4% over state-of-the-art methods, but is also effective in handling the case when the traffic network undergoes dynamic changes as well as the superior generalization capability.


title: Evaluating Computer Vision Techniques for Urban Mobility on Large-Scale, Unconstrained Roads

abstract: Conventional approaches for addressing road safety rely on manual interventions or immobile CCTV infrastructure. Such methods are expensive in enforcing compliance to traffic rules and do not scale to large road networks. This paper proposes a simple mobile imaging setup to address several common problems in road safety at scale. We use recent computer vision techniques to identify possible irregularities on roads, the absence of street lights, and defective traffic signs using videos from a moving camera-mounted vehicle. Beyond the inspection of static road infrastructure, we also demonstrate the mobile imaging solution's applicability to spot traffic violations. Before deploying our system in the real-world, we investigate the strengths and shortcomings of computer vision techniques on thirteen condition-based hierarchical labels. These conditions include different timings, road type, traffic density, and state of road damage. Our demonstrations are then carried out on 2000 km of unconstrained road scenes, captured across an entire city. Through this, we quantitatively measure the overall safety of roads in the city through carefully constructed metrics. We also show an interactive dashboard for visually inspecting and initiating action in a time, labor and cost-efficient manner. Code, models, and datasets used in this work will be publicly released.


title: Factor and Idiosyncratic VAR-Ito Volatility Models for Heavy-Tailed High-Frequency Financial Data

abstract: This paper introduces a novel It\^{o} diffusion process for both factor and idiosyncratic volatilities whose eigenvalues follow the vector auto-regressive (VAR) model. We call it the factor and idiosyncratic VAR-It\^{o} (FIVAR-It\^o) model. The FIVAR-It\^o model considers dynamics of the factor and idiosyncratic volatilities and involve many parameters. In addition, the empirical studies have shown that the financial returns often exhibit heavy tails. To address these two issues simultaneously, we propose a penalized optimization procedure with a truncation scheme for a parameter estimation. We apply the proposed parameter estimation procedure to predicting large volatility matrices and investigate its asymptotic properties. Using high-frequency trading data, the proposed method is applied to large volatility matrix prediction and minimum variance portfolio allocation.


title: 2-output spin wave programmable logic gate

abstract: This paper presents a 2-output Spin-Wave Programmable Logic Gate structure able to simultaneously evaluate any pair of AND, NAND, OR, NOR, XOR, and XNOR Boolean functions. Our proposal provides the means for fanout achievement within the Spin Wave computation domain and energy and area savings as two different functions can be simultaneously evaluated on the same input data. We validate our proposal by means of Object Oriented Micromagnetic Framework (OOMMF) simulations and demonstrate that by phase and magnetization threshold output sensing AND, OR, NAND, NOR and XOR and XNOR functionalities can be achieved, respectively. To get inside into the potential practical implications of our approach we use the proposed gate to implement a 3-input Majority gate, which we evaluate and compare with state of the art equivalent implementations in terms of area, delay, and energy consumptions. Our estimations indicate that the proposed gate provides 33% and 16% energy and area reduction, respectively, when compared with spin-wave counterpart and 42% energy reduction while consuming 12x less area when compared to a 15 nm CMOS implementation.


title: n-bit Data Parallel Spin Wave Logic Gate

abstract: Due to their very nature, Spin Waves (SWs) created in the same waveguide, but with different frequencies, can coexist while selectively interacting with their own species only. The absence of inter-frequency interferences isolates input data sets encoded in SWs with different frequencies and creates the premises for simultaneous data parallel SW based processing without hardware replication or delay overhead. In this paper we leverage this SW property by introducing a novel computation paradigm, which allows for the parallel processing of n-bit input data vectors on the same basic SW based logic gate. Subsequently, to demonstrate the proposed concept, we present 8-bit parallel 3-input Majority gate implementation and validate it by means of Object Oriented MicroMagnetic Framework (OOMMF) simulations. To evaluate the potential benefit of our proposal we compare the 8-bit data parallel gate with equivalent scalar SW gate based implementation. Our evaluation indicates that 8-bit data 3-input Majority gate implementation requires 4.16x less area than the scalar SW gate based equivalent counterpart while preserving the same delay and energy consumption figures.


title: Ageing related states of complex network formation in areca nuts

abstract: Complex pattern formation is an essential characteristic of plants and their ageing, growth, and evolution. Perception of these patterns is an intrinsic nature of plant-dependent animals for coexistence. Areca nut consisting of complex patterns is considered to be addictive for humans and has increased adverse health effects. However, no critical study is performed on the complex pattern of the areca nut. A large number of areca nuts has been studied since 2017 to develop a low-cost tool for the LMICs to categorise areca nuts. We present the first finding to identify similarities among complex networks of differently aged areca nuts by investigating the internal patterns of randomly chosen nuts from the same age group. We developed a smartphone camera-based high-resolution measurement with comprehensive biophysical mathematics and a quantum mechanical concept called density of states (DOS). We found that the DOS can provide a unique coefficient to represent age and ageing together using a single number. The average of these single numbers for less aged nuts and highly aged nuts are 4.9 and 3.8, respectively. If fruit looks aged from its external morphology as well as internal morphology, our method identifies the intrinsic similarities among the ageing networks without implementing any computationally expensive search algorithm. We show clear evidence of the diversity of ageing from relative and absolute colour vision perspectives. We have also conducted further analyses of local DOS, Fourier decomposition, correlation study, spectral decomposition, and structural similarity index.


title: Gutzwiller approximation approach to the SU(4) $t$-$J$ model

abstract: We develop the Gutzwiller approximation method to obtain the renormalized Hamiltonian of the SU(4) $t$-$J$ model with the corresponding renormalization factors. Subsequently, a mean-field theory is employed on the renormalized Hamiltonian of the model on the honeycomb lattice under the scenario of a cooperative condensation of carriers moving in the resonating valence bond state of flavors. In particular, we find that the extended $s$-wave superconducting state is more favorable than the $d\pm id$-wave superconducting state in the doping range close to quarter filling. The pairing states of the SU(4) case reveal the property that the spin-singlet pairing and the spin-triplet pairing can coexist simultaneously. Our results might provide new insights into the twisted bilayer graphene system.


title: Joint Debiased Representation Learning and Imbalanced Data Clustering

abstract: One of the most promising approaches for unsupervised learning is combining deep representation learning and deep clustering. Some recent works propose to simultaneously learn representation using deep neural networks and perform clustering by defining a clustering loss on top of embedded features. However, these approaches are sensitive to imbalanced data and out-of-distribution samples. As a consequence, these methods optimize clustering by pushing data close to randomly initialized cluster centers. This is problematic when the number of instances varies largely in different classes or a cluster with few samples has less chance to be assigned a good centroid. To overcome these limitations, we introduce a new unsupervised framework for joint debiased representation learning and image clustering. We simultaneously train two deep learning models, a deep representation network that captures the data distribution, and a deep clustering network that learns embedded features and performs clustering. Specifically, the clustering network and learning representation network both take advantage of our proposed statistics pooling block that represents mean, variance, and cardinality to handle the out-of-distribution samples and class imbalance. Our experiments show that using these representations, one can considerably improve results on imbalanced image clustering across a variety of image datasets. Moreover, the learned representations generalize well when transferred to the out-of-distribution dataset.


title: AdaK-NER: An Adaptive Top-K Approach for Named Entity Recognition with Incomplete Annotations

abstract: State-of-the-art Named Entity Recognition(NER) models rely heavily on large amountsof fully annotated training data. However, ac-cessible data are often incompletely annotatedsince the annotators usually lack comprehen-sive knowledge in the target domain. Normallythe unannotated tokens are regarded as non-entities by default, while we underline thatthese tokens could either be non-entities orpart of any entity. Here, we study NER mod-eling with incomplete annotated data whereonly a fraction of the named entities are la-beled, and the unlabeled tokens are equiva-lently multi-labeled by every possible label.Taking multi-labeled tokens into account, thenumerous possible paths can distract the train-ing model from the gold path (ground truthlabel sequence), and thus hinders the learn-ing ability. In this paper, we propose AdaK-NER, named the adaptive top-Kapproach, tohelp the model focus on a smaller feasible re-gion where the gold path is more likely to belocated. We demonstrate the superiority ofour approach through extensive experimentson both English and Chinese datasets, aver-agely improving 2% in F-score on the CoNLL-2003 and over 10% on two Chinese datasetscompared with the prior state-of-the-art works.


title: Prior Omission of Dissimilar Source Domain(s) for Cost-Effective Few-Shot Learning

abstract: Few-shot slot tagging is an emerging research topic in the field of Natural Language Understanding (NLU). With sufficient annotated data from source domains, the key challenge is how to train and adapt the model to another target domain which only has few labels. Conventional few-shot approaches use all the data from the source domains without considering inter-domain relations and implicitly assume each sample in the domain contributes equally. However, our experiments show that the data distribution bias among different domains will significantly affect the adaption performance. Moreover, transferring knowledge from dissimilar domains will even introduce some extra noises so that affect the performance of models. To tackle this problem, we propose an effective similarity-based method to select data from the source domains. In addition, we propose a Shared-Private Network (SP-Net) for the few-shot slot tagging task. The words from the same class would have some shared features. We extract those shared features from the limited annotated data on the target domain and merge them together as the label embedding to help us predict other unlabelled data on the target domain. The experiment shows that our method outperforms the state-of-the-art approaches with fewer source data. The result also proves that some training data from dissimilar sources are redundant and even negative for the adaption.


title: Gradient Estimates For $\Delta u + a(x)u\log u + b(x)u = 0$ and its Parabolic Counterpart Under Integral Ricci Curvature Bounds

abstract: In this paper, we consider a class of important nonlinear elliptic equations $$\Delta u + a(x)u\log u + b(x)u = 0$$ on a collapsed complete Riemannian manifold and its parabolic counterpart under integral curvature conditions, where $a(x)$ and $b(x)$ are two $C^1$-smooth real functions. Some new local gradient estimates for positive solutions to these equations are derived by Moser's iteration provided that the integral Ricci curvature is small enough. Especially, some classical results are extended by our estimates and a few interesting corollaries are given. Furthermore, some global gradient estimates are also established under certain geometric conditions. Some estimates obtained in this paper play an important role in a recent paper by Y. Ma and B. Wang [17], which extended and improved the main results due to B. Wang [29] to the case of integral Ricci curvature bounds.


title: Uni-FedRec: A Unified Privacy-Preserving News Recommendation Framework for Model Training and Online Serving

abstract: News recommendation is important for personalized online news services. Most existing news recommendation methods rely on centrally stored user behavior data to both train models offline and provide online recommendation services. However, user data is usually highly privacy-sensitive, and centrally storing them may raise privacy concerns and risks. In this paper, we propose a unified news recommendation framework, which can utilize user data locally stored in user clients to train models and serve users in a privacy-preserving way. Following a widely used paradigm in real-world recommender systems, our framework contains two stages. The first one is for candidate news generation (i.e., recall) and the second one is for candidate news ranking (i.e., ranking). At the recall stage, each client locally learns multiple interest representations from clicked news to comprehensively model user interests. These representations are uploaded to the server to recall candidate news from a large news pool, which are further distributed to the user client at the ranking stage for personalized news display. In addition, we propose an interest decomposer-aggregator method with perturbation noise to better protect private user information encoded in user interest representations. Besides, we collaboratively train both recall and ranking models on the data decentralized in a large number of user clients in a privacy-preserving way. Experiments on two real-world news datasets show that our method can outperform baseline methods and effectively protect user privacy.


title: Physics-based Deep Learning

abstract: This digital book contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands-on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we'll look at physical loss constraints, more tightly coupled learning algorithms with differentiable simulations, as well as reinforcement learning and uncertainty modeling. We live in exciting times: these methods have a huge potential to fundamentally change what computer simulations can achieve.


title: Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy

abstract: Simultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different translation quality and latency in practical applications, the previous methods usually need to train multiple SiMT models for different latency levels, resulting in large computational costs. In this paper, we propose a universal SiMT model with Mixture-of-Experts Wait-k Policy to achieve the best translation quality under arbitrary latency with only one trained model. Specifically, our method employs multi-head attention to accomplish the mixture of experts where each head is treated as a wait-k expert with its own waiting words number, and given a test latency and source inputs, the weights of the experts are accordingly adjusted to produce the best translation. Experiments on three datasets show that our method outperforms all the strong baselines under different latency, including the state-of-the-art adaptive policy.


title: Quotients, $\ell_\infty$ and abstract Ces\`aro spaces

abstract: Investigating some re-arrangement properties of the norm in the quotient spaces $X/X_a$ we determine the properties of the spaces $X$ guaranteeing the existence of a lattice isometric copy of $\ell_\infty$ in the abstract Ces\`aro spaces $CX$.


title: Constrained Toda hierarchy and turning points of the Ruijsenaars-Schneider model

abstract: We introduce a new integrable hierarchy of nonlinear differential-difference equations which we call constrained Toda hierarchy (C-Toda). It can be regarded as a certain subhierarchy of the 2D Toda lattice obtained by imposing the constraint $\bar {\cal L}={\cal L}^{\dag}$ on the two Lax operators (in the symmetric gauge). We prove the existence of the tau-function of the C-Toda hierarchy and show that it is the square root of the 2D Toda lattice tau-function. In this and some other respects the C-Toda is a Toda analogue of the CKP hierarchy. It is also shown that zeros of the tau-function of elliptic solutions satisfy the dynamical equations of the Ruijsenaars-Schneider model restricted to turning points in the phase space. The spectral curve has holomorphic involution which interchange the marked points in which the Baker-Akhiezer function has essential singularities.


title: Hot electron cooling in InSb probed by ultrafast time-resolved terahertz cyclotron resonance

abstract: Measuring terahertz (THz) conductivity on an ultrafast time scale is an excellent way to observe charge-carrier dynamics in semiconductors as a function of time after photoexcitation. However, a conductivity measurement alone cannot separate the effects of charge-carrier recombination from effective mass changes as charges cool and experience different regions of the electronic band structure. Here we present a form of time-resolved magneto-THz spectroscopy which allows us to measure cyclotron effective mass on a picosecond time scale. We demonstrate this technique by observing electron cooling in the technologically-significant narrow-bandgap semiconductor indium antimonide (InSb). A significant reduction of electron effective mass from 0.032$m_\mathrm{e}$ to 0.017$m_\mathrm{e}$ is observed in the first 200ps after injecting hot electrons. Measurement of electron effective mass in InSb as a function of photo-injected electron density agrees well with conduction band non-parabolicity predictions from ab initio calculations of the quasiparticle band structure.


title: Comparision between regularity of small symbolic powers and ordinary powers of an edge ideal

abstract: Let $G$ be a simple graph and $I$ its edge ideal. We prove that $${\rm reg}(I^{(s)}) = {\rm reg}(I^s)$$ for $s = 2,3$, where $I^{(s)}$ is the $s$-th symbolic power of $I$. As a consequence, we prove the following bounds \begin{align*} {\rm reg} I^{s} & \le {\rm reg} I + 2s - 2, \text{ for } s = 2,3, {\rm reg} I^{(s)} & \le {\rm reg} I + 2s - 2,\text{ for } s = 2,3,4. \end{align*}


title: Triply heavy tetraquark states

abstract: In the framework of an extended chromomagnetic model, we systematically study the mass spectrum of the $S$-wave $qQ\bar{Q}\bar{Q}$ tetraquarks. Their mass spectra are mainly determined by the color interaction. For the $qc\bar{c}\bar{c}$, $qb\bar{c}\bar{c}$ and $qb\bar{b}\bar{b}$ tetraquarks, the color interaction favors the color-sextet $\ket{(qQ)^{6_{c}}(\bar{Q}\bar{Q})^{\bar{6}_{c}}}$ configuration over the color-triplet $\ket{(qQ)^{\bar{3}_{c}}(\bar{Q}\bar{Q})^{3_{c}}}$ one. But for the $qc\bar{b}\bar{b}$ tetraquarks, the color-triplet configuration is favored. We find no stable states which lie below the thresholds of two pseudoscalar mesons. The lowest axial-vector states with the $qQ\bar{b}\bar{b}$ flavor configuration may be narrow. They lie just above the thresholds of two pseudoscalar mesons, but cannot decay into these channels because of the conservation of the angular momentum and parity.


title: Modeling Concentrated Cross-Attention for Neural Machine Translation with Gaussian Mixture Model

abstract: Cross-attention is an important component of neural machine translation (NMT), which is always realized by dot-product attention in previous methods. However, dot-product attention only considers the pair-wise correlation between words, resulting in dispersion when dealing with long sentences and neglect of source neighboring relationships. Inspired by linguistics, the above issues are caused by ignoring a type of cross-attention, called concentrated attention, which focuses on several central words and then spreads around them. In this work, we apply Gaussian Mixture Model (GMM) to model the concentrated attention in cross-attention. Experiments and analyses we conducted on three datasets show that the proposed method outperforms the baseline and has significant improvement on alignment quality, N-gram accuracy, and long sentence translation.


title: Review on the Operator/Feynman diagram/Dessins d'enfant Correspondence in Tensor Model

abstract: A short review of the Operator/Feynman diagram/dessin d'enfants correspondence in the rank 3 tensor model is presented, and the cut & join operation is given in the language of dessin d'enfants as a straightforward development. We classify operators of the rank 3 tensor model up to level 5 with dessin d'enfants.


title: Hopf bifurcation of a free boundary problem modeling tumor growth with angiogenesis and two time delays

abstract: This paper concerns a free boundary problem modeling tumor growth with angiogenesis and two time delays. The two delays represent the time taken for cells to undergo mitosis and modify the rate of cell loss because of apoptosis, respectively. We study the stability of stationary solutions and find that Hopf bifurcation occurs under some conditions, which extends the results of Xu. Furthermore, numerical simulations are performed to investigate the relationship among the rate of angiogenesis, two time delays and Hopf bifurcation.


title: Translating Solitons to Flows by Powers of The Gaussian Curvature in Riemannian Products

abstract: We consider translating solitons to flows by positive powers $\alpha$ of the Gaussian curvature -- called $K^\alpha$-flows -- in Riemannian products $M\times\mathbb R.$ We prove that, when $M$ is the Euclidean space $\mathbb R^n,$ the sphere $\mathbb S^n,$ or one of the hyperbolic spaces $\mathbb{H}_{\mathbb F}^m,$ there exist complete rotational translating solitons to $K^\alpha$-flow in $M\times\mathbb R$ for certain values of $\alpha.$


title: A novel high dimensional fitted scheme for stochastic optimal control problems

abstract: Stochastic optimal principle leads to the resolution of a partial differential equation (PDE), namely the Hamilton-Jacobi-Bellman (HJB) equation. In general, this equation cannot be solved analytically, thus numerical algorithms are the only tools to provide accurate approximations. The aims of this paper is to introduce a novel fitted finite volume method to solve high dimensional degenerated HJB equation from stochastic optimal control problems in high dimension ($ n\geq 3$). The challenge here is due to the nature of our HJB equation which is a degenerated second-order partial differential equation coupled with an optimization problem. For such problems, standard scheme such as finite difference method losses its monotonicity and therefore the convergence toward the viscosity solution may not be guarantee. We discretize the HJB equation using the fitted finite volume method, well known to tackle degenerated PDEs, while the time discretisation is performed using the Implicit Euler scheme. We show that matrices resulting from spatial discretization and temporal discretization are M--matrices. Numerical results in finance demonstrating the accuracy of the proposed numerical method comparing to the standard finite difference method are provided.


title: Exact hydrodynamic solution of a double domain wall melting in the spin-1/2 XXZ model

abstract: We investigate the non-equilibrium dynamics of a one-dimensional spin-1/2 XXZ model at zero-temperature in the regime $|\Delta|< 1$, initially prepared in a product state with two domain walls i.e, $|\downarrow\dots\downarrow\uparrow\dots\uparrow\downarrow\dots\downarrow\rangle$. At early times, the two domain walls evolve independently and only after a calculable time a non-trivial interplay between the two emerges and results in the occurrence of a split Fermi sea. For $\Delta=0$, we derive exact asymptotic results for the magnetization and the spin current by using a semi-classical Wigner function approach, and we exactly determine the spreading of entanglement entropy exploiting the recently developed tools of quantum fluctuating hydrodynamics. In the interacting case, we analytically solve the Generalized Hydrodynamics equation providing exact expressions for the conserved quantities. We display some numerical results for the entanglement entropy also in the interacting case and we propose a conjecture for its asymptotic value.


title: Towards Evaluation of Cross-document Coreference Resolution Models Using Datasets with Diverse Annotation Schemes

abstract: Established cross-document coreference resolution (CDCR) datasets contain event-centric coreference chains of events and entities with identity relations. These datasets establish strict definitions of the coreference relations across related tests but typically ignore anaphora with more vague context-dependent loose coreference relations. In this paper, we qualitatively and quantitatively compare the annotation schemes of ECB+, a CDCR dataset with identity coreference relations, and NewsWCL50, a CDCR dataset with a mix of loose context-dependent and strict coreference relations. We propose a phrasing diversity metric (PD) that encounters for the diversity of full phrases unlike the previously proposed metrics and allows to evaluate lexical diversity of the CDCR datasets in a higher precision. The analysis shows that coreference chains of NewsWCL50 are more lexically diverse than those of ECB+ but annotating of NewsWCL50 leads to the lower inter-coder reliability. We discuss the different tasks that both CDCR datasets create for the CDCR models, i.e., lexical disambiguation and lexical diversity. Finally, to ensure generalizability of the CDCR models, we propose a direction for CDCR evaluation that combines CDCR datasets with multiple annotation schemes that focus of various properties of the coreference chains.


title: DC algorithms for a class of sparse group $\ell_0$ regularized optimization problems

abstract: In this paper, we consider a class of sparse group $\ell_0$ regularized optimization problems. Firstly, we give a continuous relaxation model of the considered problem and establish the equivalence of these two problems in the sense of global minimizers. Then, we define a class of stationary points of the relaxation problem, and prove that any defined stationary point is a local minimizer of the considered sparse group $\ell_0$ regularized problem and satisfies a desirable property of its global minimizers. Further, based on the difference-of-convex (DC) structure of the relaxation problem, we design two DC algorithms to solve the relaxation problem. We prove that any accumulation point of the iterates generated by them is a stationary point of the relaxation problem. In particular, all accumulation points have a common support set and a unified lower bound for the nonzero entries, and their zero entries can be attained within finite iterations. Moreover, we prove the convergence of the entire iterates generated by the proposed algorithms. Finally, we give some numerical experiments to show the efficiency of the proposed algorithms.


title: XCoref: Cross-document Coreference Resolution in the Wild

abstract: Datasets and methods for cross-document coreference resolution (CDCR) focus on events or entities with strict coreference relations. They lack, however, annotating and resolving coreference mentions with more abstract or loose relations that may occur when news articles report about controversial and polarized events. Bridging and loose coreference relations trigger associations that may lead to exposing news readers to bias by word choice and labeling. For example, coreferential mentions of "direct talks between U.S. President Donald Trump and Kim" such as "an extraordinary meeting following months of heated rhetoric" or "great chance to solve a world problem" form a more positive perception of this event. A step towards bringing awareness of bias by word choice and labeling is the reliable resolution of coreferences with high lexical diversity. We propose an unsupervised method named XCoref, which is a CDCR method that capably resolves not only previously prevalent entities, such as persons, e.g., "Donald Trump," but also abstractly defined concepts, such as groups of persons, "caravan of immigrants," events and actions, e.g., "marching to the U.S. border." In an extensive evaluation, we compare the proposed XCoref to a state-of-the-art CDCR method and a previous method TCA that resolves such complex coreference relations and find that XCoref outperforms these methods. Outperforming an established CDCR model shows that the new CDCR models need to be evaluated on semantically complex mentions with more loose coreference relations to indicate their applicability of models to resolve mentions in the "wild" of political news articles.


title: Translating solitons of translation and homothetical types

abstract: We prove that if a translating soliton can be expressed as the sum of two curves and one of these curves is planar, then the other curve is also planar and consequently the surface must be a plane or a grim reaper. We also investigate translating solitons that can be locally written as the product of two functions of one variable. We extend the results in Lorentz-Minkowski space.


title: Ruled translating solitons in Minkowski 3-space

abstract: We characterize all ruled translating solitons in Minkowski 3-space. In contrast to the Euclidean space, we find ruled translating solitons that are not cylindrical. These surfaces appear when the vector field that defines the rulings, viewed as a curve, is a lightlike straight line. We also classify all cylindrical translating solitons, obtaining surfaces that can be considered as analogous to the grim reapers of Euclidean space, but also other surfaces which have no a counterpart in the Euclidean space.


title: Exact defective colorings of graphs

abstract: An exact $(k,d)$-coloring of a graph $G$ is a coloring of its vertices with $k$ colors such that each vertex $v$ is adjacent to exactly $d$ vertices having the same color as $v$. The exact $d$-defective chromatic number, denoted $\chi_d^=(G)$, is the minimum $k$ such that there exists an exact $(k,d)$-coloring of $G$. In an exact $(k,d)$-coloring, which for $d=0$ corresponds to a proper coloring, each color class induces a $d$-regular subgraph. We give basic properties for the parameter and determine its exact value for cycles, trees, and complete graphs. In addition, we establish bounds on $\chi_d^=(G)$ for all relevant values of $d$ when $G$ is planar, chordal, or has bounded treewidth. We also give polynomial-time algorithms for finding certain types of exact $(k,d)$-colorings in cactus graphs and block graphs. Our main result is on the computational complexity of $d$-EXACT DEFECTIVE $k$-COLORING in which we are given a graph $G$ and asked to decide whether $\chi_d^=(G) \leq k$. Specifically, we prove that the problem is NP-complete for all $d \geq 1$ and $k \geq 2$.


title: Multilingual Translation via Grafting Pre-trained Language Models

abstract: Can pre-trained BERT for one language and GPT for another be glued together to translate texts? Self-supervised training using only monolingual data has led to the success of pre-trained (masked) language models in many NLP tasks. However, directly connecting BERT as an encoder and GPT as a decoder can be challenging in machine translation, for GPT-like models lack a cross-attention component that is needed in seq2seq decoders. In this paper, we propose Graformer to graft separately pre-trained (masked) language models for machine translation. With monolingual data for pre-training and parallel data for grafting training, we maximally take advantage of the usage of both types of data. Experiments on 60 directions show that our method achieves average improvements of 5.8 BLEU in x2en and 2.9 BLEU in en2x directions comparing with the multilingual Transformer of the same size.


title: Towards a Rigorous Evaluation of Time-series Anomaly Detection

abstract: In recent years, proposed studies on time-series anomaly detection (TAD) report high F1 scores on benchmark TAD datasets, giving the impression of clear improvements in TAD. However, most studies apply a peculiar evaluation protocol called point adjustment (PA) before scoring. In this paper, we theoretically and experimentally reveal that the PA protocol has a great possibility of overestimating the detection performance; that is, even a random anomaly score can easily turn into a state-of-the-art TAD method. Therefore, the comparison of TAD methods after applying the PA protocol can lead to misguided rankings. Furthermore, we question the potential of existing TAD methods by showing that an untrained model obtains comparable detection performance to the existing methods even when PA is forbidden. Based on our findings, we propose a new baseline and an evaluation protocol. We expect that our study will help a rigorous evaluation of TAD and lead to further improvement in future researches.


title: Giant demagnetization effects induced by superconducting films

abstract: We show that a ferromagnetic (F) slab with the in-plane magnetization sandwiched between two superconducting (S) films experiences strong demagnetization effect due to the Meissner screening of the stray magnetic field by the superconductors. In the extreme case the transition of the S films from normal to the superconducting state can switch the demagnetization factor from 0 to 1 which is in a sharp contrast with the S/F bilayers where such transition affects the magnetic field inside the F film only slightly. The giant demagnetization effect is shown to be qualitatively robust against the decreasing of the superconducting film thickness and may provide a hint towards the explanation of the anomalously large ferromagnetic resonance frequency shift recently observed for the S/F/S structures [I. A. Golovchanskiy, N. N. Abramov, V. S. Stolyarov, V. I. Chichkov, M. Silaev, I. V. Shchetinin, A. A. Golubov, V. V. Ryazanov, A. V. Ustinov, and M. Yu. Kuprianov, Phys. Rev. Appl. 14, 024086 (2020)].


title: Parameterless Gene-pool Optimal Mixing Evolutionary Algorithms

abstract: When it comes to solving optimization problems with evolutionary algorithms (EAs) in a reliable and scalable manner, detecting and exploiting linkage information, i.e., dependencies between variables, can be key. In this article, we present the latest version of, and propose substantial enhancements to, the Gene-pool Optimal Mixing Evoutionary Algorithm (GOMEA): an EA explicitly designed to estimate and exploit linkage information. We begin by performing a large-scale search over several GOMEA design choices, to understand what matters most and obtain a generally best-performing version of the algorithm. Next, we introduce a novel version of GOMEA, called CGOMEA, where linkage-based variation is further improved by filtering solution mating based on conditional dependencies. We compare our latest version of GOMEA, the newly introduced CGOMEA, and another contending linkage-aware EA DSMGA-II in an extensive experimental evaluation, involving a benchmark set of 9 black-box problems that can only be solved efficiently if their inherent dependency structure is unveiled and exploited. Finally, in an attempt to make EAs more usable and resilient to parameter choices, we investigate the performance of different automatic population management schemes for GOMEA and CGOMEA, de facto making the EAs parameterless. Our results show that GOMEA and CGOMEA significantly outperform the original GOMEA and DSMGA-II on most problems, setting a new state of the art for the field.


title: The $A$-M\"{o}bius function of a finite group

abstract: The M\"{o}bius function of the subgroup lettice of a finite group $G$ has been introduced by Hall and applied to investigate several different questions. We propose the following generalization. Let $A$ be a subgroup of the automorphism group $\rm{Aut}(G)$ of a finite group $G$ and denote by $\mathcal C_A(G)$ the set of $A$-conjugacy classes of subgroups of $G.$ For $H\leq G$ let $[H]_A~=~\{~H^a ~\mid ~a\in ~A\}$ be the element of $\mathcal C_A(G)$ containing $H.$ We may define an ordering in $\mathcal C_A(G)$ in the following way: $[H]_A\leq [K]_A$ if $H^a\leq K$ for some $a\in A$. We consider the M\"{o}bius function $\mu_A$ of the corresponding poset and analyse its properties and possible applications.


title: CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation

abstract: Learning user representations based on historical behaviors lies at the core of modern recommender systems. Recent advances in sequential recommenders have convincingly demonstrated high capability in extracting effective user representations from the given behavior sequences. Despite significant progress, we argue that solely modeling the observational behaviors sequences may end up with a brittle and unstable system due to the noisy and sparse nature of user interactions logged. In this paper, we propose to learn accurate and robust user representations, which are required to be less sensitive to (attack on) noisy behaviors and trust more on the indispensable ones, by modeling counterfactual data distribution. Specifically, given an observed behavior sequence, the proposed CauseRec framework identifies dispensable and indispensable concepts at both the fine-grained item level and the abstract interest level. CauseRec conditionally samples user concept sequences from the counterfactual data distributions by replacing dispensable and indispensable concepts within the original concept sequence. With user representations obtained from the synthesized user sequences, CauseRec performs contrastive user representation learning by contrasting the counterfactual with the observational. We conduct extensive experiments on real-world public recommendation benchmarks and justify the effectiveness of CauseRec with multi-aspects model analysis. The results demonstrate that the proposed CauseRec outperforms state-of-the-art sequential recommenders by learning accurate and robust user representations.


title: Global dynamics of GDP and trade

abstract: We use the logistic equation to model the dynamics of the GDP and the trade of the six countries with the highest GDP in the world, namely, USA, China, Japan, Germany, UK and India. From the modelling of the economic data, which are made available by the World Bank, we predict the maximum values of the growth of GDP and trade, as well as the duration over which exponential growth can be sustained. We set up the correlated growth of GDP and trade as the phase solutions of an autonomous second-order dynamical system. GDP and trade are related to each other by a power law, whose exponent seems to differentiate the six national economies into two types. Under conducive conditions for economic growth, our conclusions have general validity.


title: Class-Distribution-Aware Calibration for Long-Tailed Visual Recognition

abstract: Despite impressive accuracy, deep neural networks are often miscalibrated and tend to overly confident predictions. Recent techniques like temperature scaling (TS) and label smoothing (LS) show effectiveness in obtaining a well-calibrated model by smoothing logits and hard labels with scalar factors, respectively. However, the use of uniform TS or LS factor may not be optimal for calibrating models trained on a long-tailed dataset where the model produces overly confident probabilities for high-frequency classes. In this study, we propose class-distribution-aware TS (CDA-TS) and LS (CDA-LS) by incorporating class frequency information in model calibration in the context of long-tailed distribution. In CDA-TS, the scalar temperature value is replaced with the CDA temperature vector encoded with class frequency to compensate for the over-confidence. Similarly, CDA-LS uses a vector smoothing factor and flattens the hard labels according to their corresponding class distribution. We also integrate CDA optimal temperature vector with distillation loss, which reduces miscalibration in self-distillation (SD). We empirically show that class-distribution-aware TS and LS can accommodate the imbalanced data distribution yielding superior performance in both calibration error and predictive accuracy. We also observe that SD with an extremely imbalanced dataset is less effective in terms of calibration performance. Code is available in https://github.com/mobarakol/Class-Distribution-Aware-TS-LS.


title: Mining counterexamples for wide-signature algebras with an Isabelle server

abstract: We propose an approach for searching for counterexamples of statements about algebraic structures with a medium-sized signature using the Isabelle proof assistant in an efficient, parallel manner. We contribute a Python client Isabelle server and other scripts implementing our approach, and provide results of our computational experiments. In particular, our experiments yield counterexamples that resolve a previously open question regarding the interdependencies between distributive-like identities in residuated binars.


title: RVMDE: Radar Validated Monocular Depth Estimation for Robotics

abstract: Stereoscopy exposits a natural perception of distance in a scene, and its manifestation in 3D world understanding is an intuitive phenomenon. However, an innate rigid calibration of binocular vision sensors is crucial for accurate depth estimation. Alternatively, a monocular camera alleviates the limitation at the expense of accuracy in estimating depth, and the challenge exacerbates in harsh environmental conditions. Moreover, an optical sensor often fails to acquire vital signals in harsh environments, and radar is used instead, which gives coarse but more accurate signals. This work explores the utility of coarse signals from radar when fused with fine-grained data from a monocular camera for depth estimation in harsh environmental conditions. A variant of feature pyramid network (FPN) extensively operates on fine-grained image features at multiple scales with a fewer number of parameters. FPN feature maps are fused with sparse radar features extracted with a Convolutional neural network. The concatenated hierarchical features are used to predict the depth with ordinal regression. We performed experiments on the nuScenes dataset, and the proposed architecture stays on top in quantitative evaluations with reduced parameters and faster inference. The depth estimation results suggest that the proposed techniques can be used as an alternative to stereo depth estimation in critical applications in robotics and self-driving cars. The source code will be available in the following: \url{https://github.com/MI-Hussain/RVMDE}.


title: Another characterization of meager ideals

abstract: We show that an ideal $\mathcal{I}$ on the positive integers is meager if and only if there exists a bounded nonconvergent real sequence $x$ such that the set of subsequences [resp. permutations] of $x$ which preserve the set of $\mathcal{I}$-limit points is comeager and, in addition, every accumulation point of $x$ is also an $\mathcal{I}$-limit point (that is, a limit of a subsequence $(x_{n_k})$ such that $\{n_1,n_2,\ldots,\} \notin \mathcal{I}$). The analogous characterization holds also for $\mathcal{I}$-cluster points.


title: Utility Fairness for the Differentially Private Federated Learning

abstract: Federated learning (FL) allows predictive model training on the sensed data in a wireless Internet of things (IoT) network evading data collection cost in terms of energy, time, and privacy. In this paper, for a FL setting, we model the learning gain achieved by an IoT device against its participation cost as its utility. The local model quality and the associated cost differs from device to device due to the device-heterogeneity which could be time-varying. We identify that this results in utility unfairness because the same global model is shared among the devices. In the vanilla FL setting, the master is unaware of devices' local model computation and transmission costs, thus it is unable to address the utility unfairness problem. In addition, a device may exploit this lack of knowledge at the master to intentionally reduce its expenditure and thereby boost its utility. We propose to control the quality of the global model shared with the devices, in each round, based on their contribution and expenditure. This is achieved by employing differential privacy to curtail global model divulgence based on the learning contribution. Furthermore, we devise adaptive computation and transmission policies for each device to control its expenditure in order to mitigate utility unfairness. Our results show that the proposed scheme reduces the standard deviation of the energy cost of devices by 99% in comparison to the benchmark scheme, while the standard deviation of the training loss of devices varies around 0.103.


title: BV equivalence with boundary

abstract: An extension of the notion of classical equivalence of equivalence in the Batalin--(Fradkin)--Vilkovisky (BV) and (BFV) framework for local Lagrangian field theory on manifolds possibly with boundary is discussed. Equivalence is phrased in both a strict and a lax sense, distinguished by the compatibility between the BV data for a field theory and its boundary BFV data, necessary for quantisation. In this context, the first- and second-order formulations of non-Abelian Yang--Mills and of classical mechanics on curved backgrounds, all of which admit a strict BV-BFV description, are shown to be pairwise equivalent as strict BV-BFV theories. This in particular implies that their BV-complexes are quasi-isomorphic. Furthermore, Jacobi theory and one-dimensional gravity coupled with scalar matter are compared as classically-equivalent reparametrisation-invariant versions of classical mechanics, but such that only the latter admits a strict BV-BFV formulation. They are shown to be equivalent as lax BV-BFV theories and to have isomorphic BV cohomologies. This shows that strict BV-BFV equivalence is a strictly finer notion of equivalence of theories.


title: Cutting a cake for infinitely many guests

abstract: Fair division with unequal shares is an intensively studied recourse allocation problem. For $ i\in [n] $, let $ \mu_i $ be an atomless probability measure on the measurable space $(C,\mathcal{S}) $ and let $ t_i $ be positive numbers (entitlements) with $ \sum_{i=1}^{n}t_i=1 $. A fair division is a partition of $ C $ into sets $ S_i\in \mathcal{S} $ with $ \mu_i(S_i)\geq t_i$ for every $ i\in [n] $. We introduce new algorithms to solve the fair division problem with irrational entitlements. They are based on the classical Last diminisher technique and we believe that they are simpler than the known methods. Then we show that a fair division always exists even for infinitely many players.


title: Reversible modulation of metal-insulator transition in VO2 via chemically-induced oxygen migration

abstract: Metal-insulator transitions (MIT),an intriguing correlated phenomenon induced by the subtle competition of the electrons' repulsive Coulomb interaction and kinetic energy, is of great potential use for electronic applications due to the dramatic change in resistivity. Here, we demonstrate a reversible control of MIT in VO2 films via oxygen stoichiometry engineering. By facilely depositing and dissolving a water-soluble yet oxygen-active Sr3Al2O6 capping layer atop the VO2 at room temperature, oxygen ions can reversibly migrate between VO2 and Sr3Al2O6, resulting in a gradual suppression and a complete recovery of MIT in VO2. The migration of the oxygen ions is evidenced in a combination of transport measurement, structural characterization and first-principles calculations. This approach of chemically-induced oxygen migration using a water-dissolvable adjacent layer could be useful for advanced electronic and iontronic devices and studying oxygen stoichiometry effects on the MIT.


title: Rankin-Selberg integrals for principal series representations of GL(n)

abstract: We prove that the local Rankin--Selberg integrals for principal series representations of the general linear groups agree with certain simple integrals over the Rankin--Selberg subgroups, up to certain constants given by the local gamma factors.


title: Rankin-Selberg convolutions for $\mathrm{GL}(n)\times \mathrm{GL}(n)$ and $\mathrm{GL}(n)\times \mathrm{GL}(n-1)$ for principal series representations

abstract: Let $\mathsf k$ be a local field. Let $I_\nu$ and $I_{\nu'}$ be smooth principal series representations of $\mathrm{GL}_n(\mathsf k)$ and $\mathrm{GL}_{n-1}(\mathsf k)$ respectively. The Rankin-Selberg integrals yield a continuous bilinear map $I_\nu\times I_{\nu'}\rightarrow \mathbb C$ with a certain invariance property. We study integrals over a certain open orbit that also yield a continuous bilinear map $I_\nu\times I_{\nu'}\rightarrow \mathbb C$ with the same invariance property, and show that these integrals equal the Rankin-Selberg integrals up to an explicit constant. Similar results are also obtained for Rankin-Selberg integrals for $\mathrm{GL}_n(\mathsf k)\times \mathrm{GL}_n(\mathsf k)$.


title: Period relations for Rankin-Selberg convolutions for $\mathrm{GL}(n)\times \mathrm{GL}(n-1)$

abstract: We formulate and prove the archimedean period relations for Rankin-Selberg convolutions for $\mathrm{GL}(n)\times \mathrm{GL}(n-1)$. As a consequence, we prove the period relations for critical values of the Rankin-Selberg L-functions for $\mathrm{GL}(n)\times \mathrm{GL}(n-1)$ over arbitrary number fields.


title: On the distance spectrum of minimal cages and associated distance biregular graphs

abstract: A $(k,g)$-cage is a $k$-regular simple graph of girth $g$ with minimum possible number of vertices. In this paper, $(k,g)$-cages which are Moore graphs are referred as minimal $(k,g)$-cages. A simple connected graph is called distance regular(DR) if all its vertices have the same intersection array. A bipartite graph is called distance biregular(DBR) if all the vertices of the same partite set admit the same intersection array. It is known that minimal $(k,g)$-cages are DR graphs and their subdivisions are DBR graphs. In this paper, for minimal $(k,g)$-cages we give a formula for distance spectral radius in terms of $k$ and $g$, and also determine polynomials of degree $[\frac{g}{2}]$, which is the diameter of the graph. This polynomial gives all distance eigenvalues when the variable is substituted by adjacency eigenvalues. We show that a minimal $(k,g)$-cage of diameter $d$ has $d+1$ distinct distance eigenvalues, and this partially answers a problem posed in [5]. We prove that every DBR graph is a $2$-partitioned transmission regular graph and then give a formula for its distance spectral radius. By this formula we obtain the distance spectral radius of subdivision of minimal $(k,g)$-cages. Finally we determine the full distance spectrum of subdivision of some minimal $(k,g)$-cages.


title: Remote sensing and faithful quantum teleportation through non-localized qubits

abstract: One of the most important applications of quantum physics is quantum teleportation, the possibility to transfer quantum states over arbitrary distances. In this paper, we address the idea of remote sensing in a teleportation scenario with topological qubits more robust against noise. We also investigate the enhancement of quantum teleportation through non-local characteristics of the topological qubits. In particular, we show that how this nonlocal property, helps us to achieve near-perfect quantum teleportation even with mixed quantum states. Considering the limitations imposed by decoherence and the subsequent mixedness of the resource state, we find that our results may solve important challenges in realizing faithful teleportation over long distances.


title: Benchmarking Processor Performance by Multi-Threaded Machine Learning Algorithms

abstract: Machine learning algorithms have enabled computers to predict things by learning from previous data. The data storage and processing power are increasing rapidly, thus increasing machine learning and Artificial intelligence applications. Much of the work is done to improve the accuracy of the models built in the past, with little research done to determine the computational costs of machine learning acquisitions. In this paper, I will proceed with this later research work and will make a performance comparison of multi-threaded machine learning clustering algorithms. I will be working on Linear Regression, Random Forest, and K-Nearest Neighbors to determine the performance characteristics of the algorithms as well as the computation costs to the obtained results. I will be benchmarking system hardware performance by running these multi-threaded algorithms to train and test the models on a dataset to note the differences in performance matrices of the algorithms. In the end, I will state the best performing algorithms concerning the performance efficiency of these algorithms on my system.


title: Improved DHOST Genesis

abstract: We improve the DHOST Genesis proposed in \cite{Ilyas:2020zcb}, such that the near scale invariant scalar power spectrum can be generated from the model itself, without involking extra mechanism like a string gas. Besides, the superluminality problem of scalar perturbation plagued in \cite{Ilyas:2020zcb} can be rescued by choosing proper DHOST action.


title: Existence conditions for hidden feedback loops in online recommender systems

abstract: We explore a hidden feedback loops effect in online recommender systems. Feedback loops result in degradation of online multi-armed bandit (MAB) recommendations to a small subset and loss of coverage and novelty. We study how uncertainty and noise in user interests influence the existence of feedback loops. First, we show that an unbiased additive random noise in user interests does not prevent a feedback loop. Second, we demonstrate that a non-zero probability of resetting user interests is sufficient to limit the feedback loop and estimate the size of the effect. Our experiments confirm the theoretical findings in a simulated environment for four bandit algorithms.


title: Quasi-Monte Carlo-Based Conditional Malliavin Method for Continuous-Time Asian Option Greeks

abstract: Although many methods for computing the Greeks of discrete-time Asian options are proposed, few methods to calculate the Greeks of continuous-time Asian options are known. In this paper, we develop an integration by parts formula in the multi-dimensional Malliavin calculus, and apply it to obtain the Greeks formulae for continuous-time Asian options in the multi-asset situation. We combine the Malliavin method with the quasi-Monte Carlo method to calculate the Greeks in simulation. We discuss the asymptotic convergence of simulation estimates for the continuous-time Asian option Greeks obtained by Malliavin derivatives. We propose to use the conditional quasi-Monte Carlo method to smooth Malliavin Greeks, and show that the calculation of conditional expectations analytically is viable for many types of Asian options. We prove that the new estimates for Greeks have good smoothness. For binary Asian options, Asian call options and up-and-out Asian call options, for instance, our estimates are infinitely times differentiable. We take the gradient principal component analysis method as a dimension reduction technique in simulation. Numerical experiments demonstrate the large efficiency improvement of the proposed method, especially for Asian options with discontinuous payoff functions.


title: Learning To Describe Player Form in The MLB

abstract: Major League Baseball (MLB) has a storied history of using statistics to better understand and discuss the game of baseball, with an entire discipline of statistics dedicated to the craft, known as sabermetrics. At their core, all sabermetrics seek to quantify some aspect of the game, often a specific aspect of a player's skill set - such as a batter's ability to drive in runs (RBI) or a pitcher's ability to keep batters from reaching base (WHIP). While useful, such statistics are fundamentally limited by the fact that they are derived from an account of what happened on the field, not how it happened. As a first step towards alleviating this shortcoming, we present a novel, contrastive learning-based framework for describing player form in the MLB. We use form to refer to the way in which a player has impacted the course of play in their recent appearances. Concretely, a player's form is described by a 72-dimensional vector. By comparing clusters of players resulting from our form representations and those resulting from traditional abermetrics, we demonstrate that our form representations contain information about how players impact the course of play, not present in traditional, publicly available statistics. We believe these embeddings could be utilized to predict both in-game and game-level events, such as the result of an at-bat or the winner of a game.


title: COSMic: A Coherence-Aware Generation Metric for Image Descriptions

abstract: Developers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations. However, image captioning metrics have struggled to give accurate learned estimates of the semantic and pragmatic success of output text. We address this weakness by introducing the first discourse-aware learned generation metric for evaluating image descriptions. Our approach is inspired by computational theories of discourse for capturing information goals using coherence. We present a dataset of image$\unicode{x2013}$description pairs annotated with coherence relations. We then train a coherence-aware metric on a subset of the Conceptual Captions dataset and measure its effectiveness$\unicode{x2014}$its ability to predict human ratings of output captions$\unicode{x2014}$on a test set composed of out-of-domain images. We demonstrate a higher Kendall Correlation Coefficient for our proposed metric with the human judgments for the results of a number of state-of-the-art coherence-aware caption generation models when compared to several other metrics including recently proposed learned metrics such as BLEURT and BERTScore.


title: Well-posedness of path-dependent semilinear parabolic master equations

abstract: Master equations are partial differential equations for measure-dependent unknowns, and are introduced to describe asymptotic equilibrium of large scale mean-field interacting systems, especially in games and control theory. In this paper we introduce new semilinear master equations whose unknowns are functionals of both paths and path measures. They include state-dependent master equations, path-dependent partial differential equations (PPDEs), history information dependent master equations and time inconsistent (e.g. time-delayed) equations, which naturally arise in stochastic control theory and games. We give a classical solution to the master equation by introducing a new notation called strong vertical derivative (SVD) for path-dependent functionals, inspired by Dupire's vertical derivative, and applying stochastic forward-backward system argument. Moreover, we consider a general non-smooth case with a functional mollifying method.


title: Financial Trading with Feature Preprocessing and Recurrent Reinforcement Learning

abstract: Financial trading aims to build profitable strategies to make wise investment decisions in the financial market. It has attracted interests in the machine learning community for a long time. This paper proposes to trade financial assets automatically using feature preprocessing skills and Recurrent Reinforcement Learning (RRL) algorithm. The strategy starts from technical indicators extracted from assets' market information. Then these technical indicators are preprocessed by Principal Component Analysis (PCA) and Discrete Wavelet Transform (DWT) and eventually inputted to the RRL algorithm to do the trading. The extensive empirical evidence shows that the proposed strategy is not only effective and robust in its performance, but also can mitigate the drawbacks underlying the initial trading using RRL.


title: Team Correlated Equilibria in Zero-Sum Extensive-Form Games via Tree Decompositions

abstract: Despite the many recent practical and theoretical breakthroughs in computational game theory, equilibrium finding in extensive-form team games remains a significant challenge. While NP-hard in the worst case, there are provably efficient algorithms for certain families of team game. In particular, if the game has common external information, also known as A-loss recall -- informally, actions played by non-team members (i.e., the opposing team or nature) are either unknown to the entire team, or common knowledge within the team -- then polynomial-time algorithms exist (Kaneko & Kline 1995). In this paper, we devise a completely new algorithm for solving team games. It uses a tree decomposition of the constraint system representing each team's strategy to reduce the number and degree of constraints required for correctness (tightness of the mathematical program). Our approach has the bags of the tree decomposition correspond to team-public states. Our algorithm reduces the problem of solving team games to a linear program with at most $O(NW^{w+1})$ nonzero entries in the constraint matrix, where $N$ is the size of the game tree, $w$ is a parameter that depends on the amount of uncommon external information, and $W$ is the treewidth of the tree decomposition. In public-action games, our program size is bounded by the tighter $2^{O(nt)}N$ for teams of $n$ players with $t$ types each. Our algorithm is based on a new way to write a custom, concise tree decomposition, and its fast run time does not assume that the decomposition has small treewidth. Since our algorithm describes the polytope of correlated strategies directly, we get equilibrium finding in correlated strategies for free -- instead of, say, having to run a double oracle algorithm. We show via experiments on a standard suite of games that our algorithm achieves state-of-the-art performance on all benchmark game classes except one.


title: Thermal Perturbations from Cosmological Constant Relaxation

abstract: We probe the cosmological consequences of a recently proposed class of solutions to the cosmological constant problem. In these models, the universe undergoes a long period of inflation followed by a contraction and a bounce that sets the stage for the hot big bang era. A requirement of any successful early universe model is that it must reproduce the observed scale-invariant density perturbations at CMB scales. While these class of models involve a long period of inflation, the inflationary Hubble scale during their observationally relevant stages is at or below the current Hubble scale, rendering the de Sitter fluctuations too weak to seed the CMB anisotropies. We show that sufficiently strong perturbations can still be sourced thermally if the relaxion field serving as the inflaton interacts with a thermal bath, which can be generated and maintained by the same interaction. We present a simple model where the relaxion field is derivatively (i.e. technically naturally) coupled to a non-abelian gauge sector, which gets excited tachyonically and subsequently thermalizes due to its nonlinear self-interactions. This model explains both the smallness of the cosmological constant and the amplitude of CMB anisotropies.


title: Remarks on the solution map for Yudovich solutions of the Euler equations

abstract: Consider Yudovich solutions to the incompressible Euler equations with bounded initial vorticity in bounded planar domains or in $\mathbb{R}^2$. We present a purely Lagrangian proof that the solution map is strongly continuous in $L^p$ for all $p\in [1, \infty)$ and is weakly-$*$ continuous in $L^\infty$.


title: Dual-view Snapshot Compressive Imaging via Optical Flow Aided Recurrent Neural Network

abstract: Dual-view snapshot compressive imaging (SCI) aims to capture videos from two field-of-views (FoVs) using a 2D sensor (detector) in a single snapshot, achieving joint FoV and temporal compressive sensing, and thus enjoying the advantages of low-bandwidth, low-power, and low-cost. However, it is challenging for existing model-based decoding algorithms to reconstruct each individual scene, which usually require exhaustive parameter tuning with extremely long running time for large scale data. In this paper, we propose an optical flow-aided recurrent neural network for dual video SCI systems, which provides high-quality decoding in seconds. Firstly, we develop a diversity amplification method to enlarge the differences between scenes of two FoVs, and design a deep convolutional neural network with dual branches to separate different scenes from the single measurement. Secondly, we integrate the bidirectional optical flow extracted from adjacent frames with the recurrent neural network to jointly reconstruct each video in a sequential manner. Extensive results on both simulation and real data demonstrate the superior performance of our proposed model in a short inference time. The code and data are available at https://github.com/RuiyingLu/OFaNet-for-Dual-view-SCI.


title: Scaling of Entropy Production under Coarse Graining in Active Disordered Media

abstract: Entropy production plays a fundamental role in the study of non-equilibrium systems by offering a quantitative handle on the degree of time-reversal symmetry breaking. It depends crucially on the degree of freedom considered as well as on the scale of description. It was hitherto unknown how the entropy production at one resolution of the degrees of freedom is related to the entropy production at another resolution. This relationship is of particular relevance to coarse grained and continuum descriptions of a given phenomenon. In this work, we derive the scaling of the entropy production under iterative coarse graining on the basis of the correlations of the underlying microscopic transition rates. Our approach unveils a natural criterion to distinguish equilibrium-like and genuinely non-equilibrium macroscopic phenomena based on the sign of the scaling exponent of the entropy production per mesostate.


title: What's in a Name? Answer Equivalence For Open-Domain Question Answering

abstract: A flaw in QA evaluation is that annotations often only provide one gold answer. Thus, model predictions semantically equivalent to the answer but superficially different are considered incorrect. This work explores mining alias entities from knowledge bases and using them as additional gold answers (i.e., equivalent answers). We incorporate answers for two settings: evaluation with additional answers and model training with equivalent answers. We analyse three QA benchmarks: Natural Questions, TriviaQA, and SQuAD. Answer expansion increases the exact match score on all datasets for evaluation, while incorporating it helps model training over real-world datasets. We ensure the additional answers are valid through a human post hoc evaluation.


title: The Labeled Direct Product Optimally Solves String Problems on Graphs

abstract: Suffix trees are an important data structure at the core of optimal solutions to many fundamental string problems, such as exact pattern matching, longest common substring, matching statistics, and longest repeated substring. Recent lines of research focused on extending some of these problems to vertex-labeled graphs, although using ad-hoc approaches which in some cases do not generalize to all input graphs. In the absence of a ubiquitous tool like the suffix tree for labeled graphs, we introduce the labeled direct product of two graphs as a general tool for obtaining optimal algorithms: we obtain conceptually simpler algorithms for the quadratic problems of string matching (SMLG) and longest common substring (LCSP) in labeled graphs. Our algorithms are also more efficient, since they run in time linear in the size of the labeled product graph, which may be smaller than quadratic for some inputs, and their run-time is predictable, because the size of the labeled direct product graph can be precomputed efficiently. We also solve LCSP on graphs containing cycles, which was left as an open problem by Shimohira et al. in 2011. To show the power of the labeled product graph, we also apply it to solve the matching statistics (MSP) and the longest repeated string (LRSP) problems in labeled graphs. Moreover, we show that our (worst-case quadratic) algorithms are also optimal, conditioned on the Orthogonal Vectors Hypothesis. Finally, we complete the complexity picture around LRSP by studying it on undirected graphs.


title: Raney numbers, threshold sequences and Motzkin-like paths

abstract: We provide new interpretations for a subset of Raney numbers, involving threshold sequences and Motzkin-like paths with long up and down steps. Given three integers n, k, l such that n >= 1, k >= 2 and 0 <= l <= k-2, a (k,l)-threshold sequence of length n is any strictly increasing sequence S=(s_1 s_2 ... s_n) of integers such that ki <= s_i <= kn+l. These sequences are in bijection with ordered (l+1)-tuples of k-ary trees. We prove this result and identify the Raney numbers that count the (k,l)-threshold sequences. As a consequence, when k=2 and k=3, we deduce combinatorial identities involving Catalan numbers and powers of 2, and respectively Fuss-Catalan and Raney numbers. Finally, we show how to represent threshold sequences as Motzkin-like paths with long up and down steps, and deduce that these paths are enumerated by the same Raney numbers.


title: Myopic Bike and Say Hi: Games for Empathizing with The Myopic

abstract: Myopia is an eye condition that makes it difficult for people to focus on faraway objects. It has become one of the most serious eye conditions worldwide and negatively impacts the quality of life of those who suffer from it. Although myopia is prevalent, many non-myopic people have misconceptions about it and encounter challenges empathizing with myopia situations and those who suffer from it. In this research, we developed two virtual reality (VR) games, (1) Myopic Bike and (2) Say Hi, to provide a means for the non-myopic population to experience the frustration and difficulties of myopic people. Our two games simulate two inconvenient daily life scenarios (riding a bicycle and greeting someone on the street) that myopic people encounter when not wearing glasses. We evaluated four participants' game experiences through questionnaires and semi-structured interviews. Overall, our two VR games can create an engaging and non-judgmental experience for the non-myopic population to better understand and empathize with those who suffer from myopia.


title: Structure-preserving Discretization of the Hessian Complex based on Spline Spaces

abstract: We want to propose a new discretization ansatz for the second order Hessian complex exploiting benefits of isogeometric analysis, namely the possibility of high-order convergence and smoothness of test functions. Although our approach is firstly only valid in domains that are obtained by affine linear transformations of a unit cube, we see in the approach a relatively simple way to obtain inf-sup stable and arbitrary fast convergent methods for the underlying Hodge-Laplacians. Background for this is the theory of Finite Element Exterior Calculus (FEEC) which guides us to structure-preserving discrete sub-complexes.


title: MLReal: Bridging the gap between training on synthetic data and real data applications in machine learning

abstract: Among the biggest challenges we face in utilizing neural networks trained on waveform data (i.e., seismic, electromagnetic, or ultrasound) is its application to real data. The requirement for accurate labels forces us to develop solutions using synthetic data, where labels are readily available. However, synthetic data often do not capture the reality of the field/real experiment, and we end up with poor performance of the trained neural network (NN) at the inference stage. We describe a novel approach to enhance supervised training on synthetic data with real data features (domain adaptation). Specifically, for tasks in which the absolute values of the vertical axis (time or depth) of the input data are not crucial, like classification, or can be corrected afterward, like velocity model building using a well-log, we suggest a series of linear operations on the input so the training and application data have similar distributions. This is accomplished by applying two operations on the input data to the NN model: 1) The crosscorrelation of the input data (i.e., shot gather, seismic image, etc.) with a fixed reference trace from the same dataset. 2) The convolution of the resulting data with the mean (or a random sample) of the autocorrelated data from another domain. In the training stage, the input data are from the synthetic domain and the auto-correlated data are from the real domain, and random samples from real data are drawn at every training epoch. In the inference/application stage, the input data are from the real subset domain and the mean of the autocorrelated sections are from the synthetic data subset domain. Example applications on passive seismic data for microseismic event source location determination and active seismic data for predicting low frequencies are used to demonstrate the power of this approach in improving the applicability of trained models to real data.


title: Constrained Lagrangian dissipative contact dynamics

abstract: We show that the contact dynamics obtained from the Herglotz variational principle can be described as a constrained nonholonomic or vakonomic ordinary Lagrangian system depending on a dissipative variable with an adequate choice of one constraint. As a consequence we obtain the dynamics of contact nonholonomic and vakonomic systems as ordinary variational calculus with constraints on a Lagrangian with a dissipative variable. The variation of the energy and the other dissipative quantities are also obtained giving the usual results.


title: A pulsar wind nebula origin of the LHAASO-detected UHE gamma-ray sources

abstract: The recent measurement by LHAASO of gamma-ray emission extending up to 100s of TeV from multiple Galactic sources represents a major observational step forward in the search for the origin of the Galactic cosmic rays. The burning question is if this ultra-high-energy emission is associated to acceleration of protons and/or nuclei to PeV energies, or can be associated to PeV-electron accelerators. A strong Klein-Nishina suppression of inverse Compton emission at these energies is unavoidable, nevertheless we show here that inverse Compton emission can provide a natural explanation of the measured emission, and that an association to the established PeV-electron accelerating source class of pulsar wind nebulae is also rather natural. However, a clear distinction between different models requires taking into account multi-wavelength data, having good knowledge about the local environmental conditions and, in some cases, to perform multi-source modeling.


title: A Right Invariant Extended Kalman Filter for Object based SLAM

abstract: With the recent advance of deep learning based object recognition and estimation, it is possible to consider object level SLAM where the pose of each object is estimated in the SLAM process. In this paper, based on a novel Lie group structure, a right invariant extended Kalman filter (RI-EKF) for object based SLAM is proposed. The observability analysis shows that the proposed algorithm automatically maintains the correct unobservable subspace, while standard EKF (Std-EKF) based SLAM algorithm does not. This results in a better consistency for the proposed algorithm comparing to Std-EKF. Finally, simulations and real world experiments validate not only the consistency and accuracy of the proposed algorithm, but also the practicability of the proposed RI-EKF for object based SLAM problem. The MATLAB code of the algorithm is made publicly available.


title: InDuDoNet: An Interpretable Dual Domain Network for CT Metal Artifact Reduction

abstract: For the task of metal artifact reduction (MAR), although deep learning (DL)-based methods have achieved promising performances, most of them suffer from two problems: 1) the CT imaging geometry constraint is not fully embedded into the network during training, leaving room for further performance improvement; 2) the model interpretability is lack of sufficient consideration. Against these issues, we propose a novel interpretable dual domain network, termed as InDuDoNet, which combines the advantages of model-driven and data-driven methodologies. Specifically, we build a joint spatial and Radon domain reconstruction model and utilize the proximal gradient technique to design an iterative algorithm for solving it. The optimization algorithm only consists of simple computational operators, which facilitate us to correspondingly unfold iterative steps into network modules and thus improve the interpretablility of the framework. Extensive experiments on synthesized and clinical data show the superiority of our InDuDoNet. Code is available in \url{https://github.com/hongwang01/InDuDoNet}.%method on the tasks of MAR and downstream multi-class pelvic fracture segmentation.


title: Global Existence for the unstable Cahn-Hilliard equation in 2D with a Shear Flow

abstract: In this paper, we consider the advective unstable Cahn-Hilliard equation in 2D with shear flow: \begin{equation*} \begin{cases} u_t+Av_1(y) \partial_x u+\varepsilon \Delta^2 u= \Delta(a u^3+ b u^2) \quad & \quad \textrm{on} \quad \mathbb T^2; \\ \\ u \ \textrm{periodic} \quad & \quad \textrm{on} \quad \partial \mathbb T^2, \end{cases} \end{equation*} with an initial data $u_0 \in H_0^2(\mathbb T^2)$, where $\mathbb T^2$ is the two-dimensional torus, $A, \varepsilon>0$, $a<0$, $b \in \mathbb R$. Under the assumption that the shear has a finite number of critical points and there are linearly growing modes only in the direction of the shear, we show the $L^2$-energy of the solutions to such problems converges expotentially to zero, if in addition, both $|a|$ and $\left\| \int_{\mathbb T} u_0(x, \cdot ) dx \right\|_{L_y^2}$ are sufficiently small.