title: Learning Regularization Parameters of Inverse Problems via Deep Neural Networks

abstract: In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the mapping from observation data to regularization parameters. Once the network is trained, regularization parameters for newly obtained data can be computed by efficient forward propagation of the DNN. We show that a wide variety of regularization functionals, forward models, and noise models may be considered. The network-obtained regularization parameters can be computed more efficiently and may even lead to more accurate solutions compared to existing regularization parameter selection methods. We emphasize that the key advantage of using DNNs for learning regularization parameters, compared to previous works on learning via optimal experimental design or empirical Bayes risk minimization, is greater generalizability. That is, rather than computing one set of parameters that is optimal with respect to one particular design objective, DNN-computed regularization parameters are tailored to the specific features or properties of the newly observed data. Thus, our approach may better handle cases where the observation is not a close representation of the training set. Furthermore, we avoid the need for expensive and challenging bilevel optimization methods as utilized in other existing training approaches. Numerical results demonstrate the potential of using DNNs to learn regularization parameters.


abstract: Face presentation attack detection plays a critical role in the modern face recognition pipeline. A face presentation attack detection model with good generalization can be obtained when it is trained with face images from different input distributions and different types of spoof attacks. In reality, training data (both real face images and spoof images) are not directly shared between data owners due to legal and privacy issues. In this paper, with the motivation of circumventing this challenge, we propose a Federated Face Presentation Attack Detection (FedPAD) framework that simultaneously takes advantage of rich fPAD information available at different data owners while preserving data privacy. In the proposed framework, each data center locally trains its own fPAD model. A server learns a global fPAD model by iteratively aggregating model updates from all data centers without accessing private data in each of them. To equip the aggregated fPAD model in the server with better generalization ability to unseen attacks from users, following the basic idea of FedPAD, we further propose a Federated Generalized Face Presentation Attack Detection (FedGPAD) framework. A federated domain disentanglement strategy is introduced in FedGPAD, which treats each data center as one domain and decomposes the fPAD model into domain-invariant and domain-specific parts in each data center. Two parts disentangle the domain-invariant and domain-specific features from images in each local data center, respectively. A server learns a global fPAD model by only aggregating domain-invariant parts of the fPAD models from data centers and thus a more generalized fPAD model can be aggregated in server. We introduce the experimental setting to evaluate the proposed FedPAD and FedGPAD frameworks and carry out extensive experiments to provide various insights about federated learning for fPAD.


title: Attitude Observation for Second Order Attitude Kinematics

abstract: This paper addresses the problem of estimating the attitude and angular velocity of a rigid object by exploiting its second order kinematic model. The approach is particularly useful in cases where angular velocity measurements are not available and the attitude and angular velocity of an object need to be estimated from accelerometers and magnetometers. We propose a novel sensor modality that uses multiple accelerometers to measure the angular acceleration of an object as well as using magnetometers to measure partial attitude. We extend the approach of equivariant observer design to second order attitude kinematics by demonstrating that the special Euclidean group acts as a symmetry group on the system considered. The observer design is based on the lifted kinematics and we prove almost global asymptotic stability and local uniform exponential stability of the estimation error. The performance of the observer is demonstrated in simulation.


title: Taming the sign problem in auxiliary field quantum Monte Carlo using accurate trial wave functions

abstract: We explore different ways of incorporating accurate trial wave functions into free projection auxiliary field quantum Monte Carlo (fp-AFQMC). Trial states employed include coupled cluster singles and doubles, multi-Slater, and symmetry projected mean-field wave functions. We adapt a recently proposed fast multi-Slater local energy evaluation algorithm for fp-AFQMC, making the use of long expansions from selected configuration interaction methods feasible. We demonstrate how these trial wave functions serve to mitigate the sign problem and accelerate convergence in quantum chemical problems, allowing the application of fp-AFQMC to systems of substantial sizes. Our calculations on the widely studied $\text{Cu}_2\text{O}_2^{2+}$ model system show that many previously reported isomerization energies differ substantially from the near-exact fp-AFQMC value.


title: AR-LSAT: Investigating Analytical Reasoning of Text

abstract: Analytical reasoning is an essential and challenging task that requires a system to analyze a scenario involving a set of particular circumstances and perform reasoning over it to make conclusions. In this paper, we study the challenge of analytical reasoning of text and introduce a new dataset consisting of questions from the Law School Admission Test from 1991 to 2016. We analyze what knowledge understanding and reasoning abilities are required to do well on this task. Furthermore, to address this reasoning challenge, we design two different baselines: (1) a Transformer-based method which leverages the state-of-the-art pre-trained language models and (2) Analytical Reasoning Machine (ARM), a logical-level reasoning framework extracting symbolic knowledge (e.g, participants, facts, logical functions) to deduce legitimate solutions. In our experiments, we find that the Transformer-based models struggle to solve this task as their performance is close to random guess and ARM achieves better performance by leveraging symbolic knowledge and interpretable reasoning steps. Results show that both methods still lag far behind human performance, which leave further space for future research.


title: Learning How to Ask: Querying LMs with Mixtures of Soft Prompts

abstract: Natural-language prompts have recently been used to coax pretrained language models into performing other AI tasks, using a fill-in-the-blank paradigm (Petroni et al., 2019) or a few-shot extrapolation paradigm (Brown et al., 2020). For example, language models retain factual knowledge from their training corpora that can be extracted by asking them to "fill in the blank" in a sentential prompt. However, where does this prompt come from? We explore the idea of learning prompts by gradient descent -- either fine-tuning prompts taken from previous work, or starting from random initialization. Our prompts consist of "soft words," i.e., continuous vectors that are not necessarily word type embeddings from the language model. Furthermore, for each task, we optimize a mixture of prompts, learning which prompts are most effective and how to ensemble them. Across multiple English LMs and tasks, our approach hugely outperforms previous methods, showing that the implicit factual knowledge in language models was previously underestimated. Moreover, this knowledge is cheap to elicit: random initialization is nearly as good as informed initialization.


title: GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback

abstract: Deep reinforcement learning (DRL) has achieved great successes in many simulated tasks. The sample inefficiency problem makes applying traditional DRL methods to real-world robots a great challenge. Generative Adversarial Imitation Learning (GAIL) -- a general model-free imitation learning method, allows robots to directly learn policies from expert trajectories in large environments. However, GAIL shares the limitation of other imitation learning methods that they can seldom surpass the performance of demonstrations. In this paper, to address the limit of GAIL, we propose GAN-Based Interactive Reinforcement Learning (GAIRL) from demonstration and human evaluative feedback by combining the advantages of GAIL and interactive reinforcement learning. We tested our proposed method in six physics-based control tasks, ranging from simple low-dimensional control tasks -- Cart Pole and Mountain Car, to difficult high-dimensional tasks -- Inverted Double Pendulum, Lunar Lander, Hopper and HalfCheetah. Our results suggest that with both optimal and suboptimal demonstrations, a GAIRL agent can always learn a more stable policy with optimal or close to optimal performance, while the performance of the GAIL agent is upper bounded by the performance of demonstrations or even worse than it. In addition, our results indicate the reason that GAIRL is superior over GAIL is the complementary effect of demonstrations and human evaluative feedback.


title: Zero-Shot Instance Segmentation

abstract: Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires high professional skills. We follow this motivation and propose a new task set named zero-shot instance segmentation (ZSI). In the training phase of ZSI, the model is trained with seen data, while in the testing phase, it is used to segment all seen and unseen instances. We first formulate the ZSI task and propose a method to tackle the challenge, which consists of Zero-shot Detector, Semantic Mask Head, Background Aware RPN and Synchronized Background Strategy. We present a new benchmark for zero-shot instance segmentation based on the MS-COCO dataset. The extensive empirical results in this benchmark show that our method not only surpasses the state-of-the-art results in zero-shot object detection task but also achieves promising performance on ZSI. Our approach will serve as a solid baseline and facilitate future research in zero-shot instance segmentation.


title: Axion-like particle inflation and dark matter

abstract: In this paper, we propose a generalized natural inflation (GNI) model to study axion-like particle (ALP) inflation and dark matter (DM). GNI contains two additional parameters $(n_1, n_2)$ in comparison with the natural inflation, that make GNI more general. The $n_1$ build the connection between GNI and other ALP inflation model, $n_2$ controls the inflaton mass. After considering the cosmic microwave background and other cosmological observation limits, the model can realize small-field inflation with a wide mass range, and the ALP inflaton considering here can serve as the DM candidate for certain parameter spaces.


title: Mitigating the Effects of Reading Interruptions by Providing Reviews and Previews

abstract: As reading on mobile devices is becoming more ubiquitous, content is consumed in shorter intervals and is punctuated by frequent interruptions. In this work, we explore the best way to mitigate the effects of reading interruptions on longer text passages. Our hypothesis is that short summaries of either previously read content (reviews) or upcoming content (previews) will help the reader re-engage with the reading task. Our target use case is for students who study using electronic textbooks and who are frequently mobile. We present a series of pilot studies that examine the benefits of different types of summaries and their locations, with respect to variations in text content and participant cohorts. We find that users prefer reviews after an interruption, but that previews shown after interruptions have a larger positive influence on comprehension. Our work is a first step towards smart reading applications that proactively provide text summaries to mitigate interruptions on the go.


title: Learning Metrics from Mean Teacher: A Supervised Learning Method for Improving the Generalization of Speaker Verification System

abstract: Most speaker verification tasks are studied as an open-set evaluation scenario considering the real-world condition. Thus, the generalization power to unseen speakers is of paramount important to the performance of the speaker verification system. We propose to apply \textit {Mean Teacher}, a temporal averaging model, to extract speaker embeddings with small intra-class variance and large inter-class variance. The mean teacher network refers to the temporal averaging of deep neural network parameters; it can produces more accurate and stable representations than using weights after the training finished. By learning the reliable intermediate representation of the mean teacher network, we expect that the proposed method can explore more discriminatory embedding spaces and improve the generalization performance of the speaker verification system. Experimental results on the VoxCeleb1 test set demonstrate that the proposed method relatively improves performance by 11.61\%, compared to a baseline system.


title: Breakdown of quantum-classical correspondence and dynamical generation of entanglement

abstract: The {\it exchange} interaction arising from the particle indistinguishability is of central importance to physics of many-particle quantum systems. Here we study analytically the dynamical generation of quantum entanglement induced by this interaction in an isolated system, namely, an ideal Fermi gas confined in a chaotic cavity, which evolves unitarily from a non-Gaussian pure state. We find that the breakdown of the quantum-classical correspondence of particle motion, via dramatically changing the spatial structure of many-body wavefunction, leads to profound changes of the entanglement structure. Furthermore, for a class of initial states, such change leads to the approach to thermal equilibrium everywhere in the cavity, with the well-known Ehrenfest time in quantum chaos as the thermalization time. Specifically, the quantum expectation values of various correlation functions at different spatial scales are all determined by the Fermi-Dirac distribution. In addition, by using the reduced density matrix (RDM) and the entanglement entropy (EE) as local probes, we find that the gas inside a subsystem is at equilibrium with that outside, and its thermal entropy is the EE, even though the whole system is in a pure state. As a by-product of this work, we provide an analytical solution supporting an important conjecture on thermalization, made and numerically studied by Garrison and Grover in: Phys. Rev. X \textbf{8}, 021026 (2018), and strengthen its statement.


title: Newton-based methods for finding the positive ground state of Gross-Pitaevskii equations

abstract: The discretization of Gross-Pitaevskii equations (GPE) leads to a nonlinear eigenvalue problem with eigenvector nonlinearity (NEPv). In this paper, we use two Newton-based methods to compute the positive ground state of GPE. The first method comes from the Newton-Noda iteration for saturable nonlinear Schr\"odinger equations proposed by Liu, which can be transferred to GPE naturally. The second method combines the idea of the Bisection method and the idea of Newton method, in which, each subproblem involving block tridiagonal linear systems can be solved easily. We give an explicit convergence and computational complexity analysis for it. Numerical experiments are provided to support the theoretical results.


title: Revisiting the Onsets and Frames Model with Additive Attention

abstract: Recent advances in automatic music transcription (AMT) have achieved highly accurate polyphonic piano transcription results by incorporating onset and offset detection. The existing literature, however, focuses mainly on the leverage of deep and complex models to achieve state-of-the-art (SOTA) accuracy, without understanding model behaviour. In this paper, we conduct a comprehensive examination of the Onsets-and-Frames AMT model, and pinpoint the essential components contributing to a strong AMT performance. This is achieved through exploitation of a modified additive attention mechanism. The experimental results suggest that the attention mechanism beyond a moderate temporal context does not benefit the model, and that rule-based post-processing is largely responsible for the SOTA performance. We also demonstrate that the onsets are the most significant attentive feature regardless of model complexity. The findings encourage AMT research to weigh more on both a robust onset detector and an effective post-processor.


title: Search to aggregate neighborhood for graph neural network

abstract: Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which has made impressive success in discovering effective architectures in convolutional neural networks. However, it is non-trivial to apply NAS approaches to GNN due to challenges in search space design and the expensive searching cost of existing NAS methods. In this work, to obtain the data-specific GNN architectures and address the computational challenges facing by NAS approaches, we propose a framework, which tries to Search to Aggregate NEighborhood (SANE), to automatically design data-specific GNN architectures. By designing a novel and expressive search space, we propose a differentiable search algorithm, which is more efficient than previous reinforcement learning based methods. Experimental results on four tasks and seven real-world datasets demonstrate the superiority of SANE compared to existing GNN models and NAS approaches in terms of effectiveness and efficiency. (Code is available at: https://github.com/AutoML-4Paradigm/SANE).


title: Representative Forgery Mining for Fake Face Detection

abstract: Although vanilla Convolutional Neural Network (CNN) based detectors can achieve satisfactory performance on fake face detection, we observe that the detectors tend to seek forgeries on a limited region of face, which reveals that the detectors is short of understanding of forgery. Therefore, we propose an attention-based data augmentation framework to guide detector refine and enlarge its attention. Specifically, our method tracks and occludes the Top-N sensitive facial regions, encouraging the detector to mine deeper into the regions ignored before for more representative forgery. Especially, our method is simple-to-use and can be easily integrated with various CNN models. Extensive experiments show that the detector trained with our method is capable to separately point out the representative forgery of fake faces generated by different manipulation techniques, and our method enables a vanilla CNN-based detector to achieve state-of-the-art performance without structure modification.


title: Study of a Discretized Fractional-order eco-epidemiological model with prey infection

abstract: In this paper, an attempt is made to understand the dynamics of a three-dimensional discrete fractional-order eco-epidemiological model with Holling type II functional response. We first discretize a fractional-order predator-prey-parasite system with piecewise constant arguments and then explore the system dynamics. Analytical conditions for the local stability of different fixed points have been determined using the Jury criterion. Several examples are given to substantiate the analytical results. Our analysis shows that stability of the discrete fractional order system strongly depends on the step-size and the fractional order. More specifically, the critical value of the step-size, where the switching of stability occurs, decreases as the order of the fractional derivative decreases. Simulation results explore that the discrete fractional-order system may also exhibit complex dynamics, like chaos, for higher step-size.


title: The Quantum Otto Heat Engine with a relativistically moving thermal bath

abstract: We investigate the quantum thermodynamic cycle of a quantum heat engine carrying out an Otto thermodynamic cycle. We use the thermal properties of a moving heat bath with relativistic velocity with respect to the cold bath. As a working medium, we use a two-level system and a harmonic oscillator that interact with a moving heat bath and a static cold bath. In the current work, the quantum heat engine is studied in the high and low temperatures regime. Using quantum thermodynamics and the theory of open quantum system we obtain the total produced work, the efficiency and the efficiency at maximum power. The maximum efficiency of the Otto quantum heat engine depends only on the ratio of the minimum and maximum energy gaps. On the contrary, the efficiency at maximum power and the extracted work decreases with the velocity since the motion of the heat bath has an energy cost for the quantum heat engine. Furthermore, the efficiency at maximum power depends on the nature of the working medium.


title: Deep Data Density Estimation through Donsker-Varadhan Representation

abstract: Estimating the data density is one of the challenging problems in deep learning. In this paper, we present a simple yet effective method for estimating the data density using a deep neural network and the Donsker-Varadhan variational lower bound on the KL divergence. We show that the optimal critic function associated with the Donsker-Varadhan representation on the KL divergence between the data and the uniform distribution can estimate the data density. We also present the deep neural network-based modeling and its stochastic learning. The experimental results and possible applications of the proposed method demonstrate that it is competitive with the previous methods and has a lot of possibilities in applied to various applications.


title: Detection of Dataset Shifts in Learning-Enabled Cyber-Physical Systems using Variational Autoencoder for Regression

abstract: Cyber-physical systems (CPSs) use learning-enabled components (LECs) extensively to cope with various complex tasks under high-uncertainty environments. However, the dataset shifts between the training and testing phase may lead the LECs to become ineffective to make large-error predictions, and further, compromise the safety of the overall system. In our paper, we first provide the formal definitions for different types of dataset shifts in learning-enabled CPS. Then, we propose an approach to detect the dataset shifts effectively for regression problems. Our approach is based on the inductive conformal anomaly detection and utilizes a variational autoencoder for regression model which enables the approach to take into consideration both LEC input and output for detecting dataset shifts. Additionally, in order to improve the robustness of detection, layer-wise relevance propagation (LRP) is incorporated into our approach. We demonstrate our approach by using an advanced emergency braking system implemented in an open-source simulator for self-driving cars. The evaluation results show that our approach can detect different types of dataset shifts with a small number of false alarms while the execution time is smaller than the sampling period of the system.


title: Semi-supervised Learning Framework for UAV Detection

abstract: The use of supervised learning with various sensing techniques such as audio, visual imaging, thermal sensing, RADAR, and radio frequency (RF) have been widely applied in the detection of unmanned aerial vehicles (UAV) in an environment. However, little or no attention has been given to the application of unsupervised or semi-supervised algorithms for UAV detection. In this paper, we proposed a semi-supervised technique and architecture for detecting UAVs in an environment by exploiting the RF signals (i.e., fingerprints) between a UAV and its flight-controller communication under wireless inference such as Bluetooth and WiFi. By decomposing the RF signals using a two-level wavelet packet transform, we estimated the second moment statistic (i.e., variance) of the coefficients in each packet as a feature set. We developed a local outlier factor model as the UAV detection algorithm using the coefficient variances of the wavelet packets from WiFi and Bluetooth signals. When detecting the presence of RF-based UAV, we achieved an accuracy of 96.7$\%$ and 86$\%$ at a signal-to-noise ratio of 30~dB and 18~dB, respectively. The application of this approach is not limited to UAV detection as it can be extended to the detection of rogue RF devices in an environment.


title: Perception Entropy: A Metric for Multiple Sensors Configuration Evaluation and Design

abstract: Sensor configuration, including the sensor selections and their installation locations, serves a crucial role in autonomous driving. A well-designed sensor configuration significantly improves the performance upper bound of the perception system. However, as leveraging multiple sensors is becoming the mainstream setting, existing methods mainly focusing on single-sensor configuration problems are hardly utilized in practice. To tackle these issues, we propose a novel method based on conditional entropy in Bayesian theory to evaluate the sensor configurations containing both cameras and LiDARs. Correspondingly, an evaluation metric, perception entropy, is introduced to measure the difference between two configurations, which considers both the perception algorithm performance and the selections of the sensors. To the best of our knowledge, this is the first method to tackle the multi-sensor configuration problem for autonomous vehicles. The simulation results, extensive comparisons, and analysis all demonstrate the superior performance of our proposed approach.


title: Arithmetic of Spring Forces on the Banjo Bridge

abstract: Spring-like forces on the bridge are key to a banjo's characteristic voice. These are due to the tension in strings and head. Conceptually distinct from the forces of waves in the strings and head that encode the underlying music, the spring-like forces impact the timbre of how those waves are converted to sound. This note presents a simplified model that allows the head contribution to be calculated (mostly) with paper and pencil. The key simplification is placing a circular bridge at the center of the head. The resulting formulae show how design elements and player's adjustments can effect the sound. The results also provide estimates of the magnitudes of the effects when evaluated with numerical values for Young's moduli and typical banjo set-up specs. For steel strings and tight mylar head, the head contribution is about three times as large as that of the strings.


title: The X-CLASS survey: A catalogue of 1646 X-ray-selected galaxy clusters up to z$\sim$1.5

abstract: Cosmological probes based on galaxy clusters rely on cluster number counts and large-scale structure information. X-ray cluster surveys are well suited for this purpose, since they are far less affected than optical surveys by projection effects, and cluster properties can be predicted with good accuracy. The XMM Cluster Archive Super Survey, X-CLASS, is a serendipitous search of X-ray-detected galaxy clusters in 4176 XMM-Newton archival observations until August 2015. All observations are clipped to exposure times of 10 and 20 ks to obtain uniformity and they span ~269 deg$^2$ across the high-Galactic latitude sky ($|b|> 20^o$). The main goal of the survey is the compilation of a well-selected cluster sample suitable for cosmological analyses. We describe the detection algorithm, the visual inspection, the verification process and the redshift validation of the cluster sample, as well as the cluster selection function computed by simulations. We also present the various metadata that are released with the catalogue, along with the redshifts of 124 clusters obtained with a dedicated multi-object spectroscopic follow-up programme. With this publication we release the new X-CLASS catalogue of 1646 well-selected X-ray-detected clusters over a wide sky area, along with their selection function. The sample spans a wide redshift range, from the local Universe up to z~1.5, with 982 spectroscopically confirmed clusters, and over 70 clusters above z=0.8. Because of its homogeneous selection and thorough verification, the cluster sample can be used for cosmological analyses, but also as a test-bed for the upcoming eROSITA observations and other current and future large-area cluster surveys. It is the first time that such a catalogue is made available to the community via an interactive database which gives access to a wealth of supplementary information, images, and data.


title: Look at my new blue force-sensing shoes!

abstract: To function autonomously in the physical world, humanoid robots need high-fidelity sensing systems, especially for forces that cannot be easily modeled. Modeling forces in robot feet is particularly challenging due to static indeterminacy, thereby requiring direct sensing. Unfortunately, resolving forces in the feet of some smaller-sized humanoids is limited both by the quality of sensors and the current algorithms used to interpret the data. This paper presents light-weight, low-cost and open-source force-sensing shoes to improve force measurement for popular smaller-sized humanoid robots, and a method for calibrating the shoes. The shoes measure center of pressure (CoP) and normal ground reaction force (GRF). The calibration method enables each individual shoe to reach high measurement precision by applying known forces at different locations of the shoe and using a regularized least squares optimization to interpret sensor outputs. A NAO robot is used as our experimental platform. Experiments are conducted to compare the measurement performance between the shoes and the robot's factory-installed force-sensing resistors (FSRs), and to evaluate the calibration method over these two sensing modules. Experimental results show that the shoes significantly improve CoP and GRF measurement precision compared to the robot's built-in FSRs. Moreover, the developed calibration method improves the measurement performance for both our shoes and the built-in FSRs.


title: An Integrated Optimization-Learning Framework for Online Combinatorial Computation Offloading in MEC Networks

abstract: Mobile edge computing (MEC) is a promising paradigm to accommodate the increasingly prosperous delay-sensitive and computation-intensive applications in 5G systems. To achieve optimum computation performance in a dynamic MEC environment, mobile devices often need to make online decisions on whether to offload the computation tasks to nearby edge terminals under the uncertainty of future system information (e.g., random wireless channel gain and task arrivals). The design of an efficient online offloading algorithm is challenging. On one hand, the fast-varying edge environment requires frequently solving a hard combinatorial optimization problem where the integer offloading decision and continuous resource allocation variables are strongly coupled. On the other hand, the uncertainty of future system states makes it hard for the online decisions to satisfy long-term system constraints. To address these challenges, this article overviews the existing methods and introduces a novel framework that efficiently integrates model-based optimization and model-free learning techniques. Besides, we suggest some promising future research directions of online computation offloading control in MEC networks.


title: Improving the Accuracy and Consistency of the Scalar Auxiliary Variable (SAV) Method with Relaxation

abstract: The scalar auxiliary variable (SAV) method was introduced by Shen et al. and has been broadly used to solve thermodynamically consistent PDE problems. By utilizing scalar auxiliary variables, the original PDE problems are reformulated into equivalent PDE problems. The advantages of the SAV approach, such as linearity, unconditionally energy stability, and easy-to-implement, are prevalent. However, there is still an open issue unresolved, i.e., the numerical schemes resulted from the SAV method preserve a "modified" energy law according to the auxiliary variables instead of the original variables. Truncation errors are introduced during numerical calculations so that the numerical solutions of the auxiliary variables are no longer equivalent to their original continuous definitions. In other words, even though the SAV scheme satisfies a modified energy law, it does not necessarily satisfy the energy law of the original PDE models. This paper presents one essential relaxation technique to overcome this issue, which we named the relaxed-SAV (RSAV) method. Our RSAV method penalizes the numerical errors of the auxiliary variables by a relaxation technique. In general, the RSAV method keeps all the advantages of the baseline SAV method and improves its accuracy and consistency noticeably. Several examples have been presented to demonstrate the effectiveness of the RSAV approach.


title: GSEIM: A General-purpose Simulator with Explicit and Implicit Methods

abstract: A new simulation package, GSEIM, for solving a set of ordinary differential equations is presented. The organisation of the program is illustrated with the help of a block diagram. Various features of GSEIM are discussed. Two ways of incorporating new elements in GSEIM, viz., as a template and as a subcircuit, are explained by taking a specific example. Simulation examples are described to bring out the capabilities of GSEIM.


title: Towards an Interpretable Data-driven Trigger System for High-throughput Physics Facilities

abstract: Data-intensive science is increasingly reliant on real-time processing capabilities and machine learning workflows, in order to filter and analyze the extreme volumes of data being collected. This is especially true at the energy and intensity frontiers of particle physics where bandwidths of raw data can exceed 100 Tb/s of heterogeneous, high-dimensional data sourced from hundreds of millions of individual sensors. In this paper, we introduce a new data-driven approach for designing and optimizing high-throughput data filtering and trigger systems such as those in use at physics facilities like the Large Hadron Collider (LHC). Concretely, our goal is to design a data-driven filtering system with a minimal run-time cost for determining which data event to keep, while preserving (and potentially improving upon) the distribution of the output as generated by the hand-designed trigger system. We introduce key insights from interpretable predictive modeling and cost-sensitive learning in order to account for non-local inefficiencies in the current paradigm and construct a cost-effective data filtering and trigger model that does not compromise physics coverage.


title: Applying the horizontal visibility graph method to study irreversibility of electromagnetic turbulence in non-thermal plasmas

abstract: One of the fundamental open questions in plasma physics is the role of non-thermal particles distributions in poorly collisional plasma environments, a system commonly found throughout the Universe, e.g. the solar wind and the Earth's magnetosphere correspond to natural plasma physics laboratories in which turbulent phenomena can be studied. Our study perspective is born from the method of Horizontal Visibility Graph (HVG) that has been developed in the last years to analyze time series avoiding the tedium and the high computational cost that other methods offer. Here we build a complex network based on directed HVG technique applied to magnetic field fluctuations time series obtained from Particle In Cell (PIC) simulations of a magnetized collisionless plasma to distinguish the degree distributions and calculate the Kullback-Leibler Divergence (KLD) as a measure of relative entropy of data sets produced by processes that are not in equilibrium. First, we analyze the connectivity probability distribution for the undirected version of HVG finding how the Kappa distribution for low values of $\kappa$ tends to be an uncorrelated time series, while the Maxwell-Boltzmann distribution shows a correlated stochastic processes behavior. Then, we investigate the degree of temporary irreversibility of magnetic fluctuations self-generated by the plasma, comparing the case of a thermal plasma (described by a Maxwell-Botzmann velocity distribution function) with non-thermal Kappa distributions. We have shown that the KLD associated to the HVG is able to distinguish the level of reversibility associated to the thermal equilibrium in the plasma because the dissipative degree of the system increases as the value of $\kappa$ parameter decreases and the distribution function departs from the Maxwell-Boltzmann equilibrium.


title: Device-Cloud Collaborative Learning for Recommendation

abstract: With the rapid development of storage and computing power on mobile devices, it becomes critical and popular to deploy models on devices to save onerous communication latencies and to capture real-time features. While quite a lot of works have explored to facilitate on-device learning and inference, most of them focus on dealing with response delay or privacy protection. Little has been done to model the collaboration between the device and the cloud modeling and benefit both sides jointly. To bridge this gap, we are among the first attempts to study the Device-Cloud Collaborative Learning (DCCL) framework. Specifically, we propose a novel MetaPatch learning approach on the device side to efficiently achieve "thousands of people with thousands of models" given a centralized cloud model. Then, with billions of updated personalized device models, we propose a "model-over-models" distillation algorithm, namely MoMoDistill, to update the centralized cloud model. Our extensive experiments over a range of datasets with different settings demonstrate the effectiveness of such collaboration on both cloud and devices, especially its superiority to model long-tailed users.


title: Entanglement of the Vacuum between Left, Right, Future, and Past: Dirac spinor in Rindler spaces and Kasner spaces

abstract: We study the relations of the positive frequency mode functions of Dirac field in 4-dimensional Minkowski spacetime covered with Rindler and Kasner coordinates, and describe the explicit form of the Minkowski vacuum state with the quantum states in Kasner and Rindler regions, and analytically continue the solutions. As a result, we obtain the correspondence of the positive frequency mode functions in Kasner region and Rindler region in a unified manner which derives vacuum entanglement.


title: Observations of Slow Solar Wind from Equatorial Coronal Holes

abstract: Because of its distinctive compositional properties and variability, low-speed ($\lesssim 450$ km s$^{-1}$) solar wind is widely believed to originate from coronal streamers, unlike high-speed wind, which comes from coronal holes. An alternative scenario is that the bulk of the slow wind (excluding that in the immediate vicinity of the heliospheric current sheet) originates from rapidly diverging flux tubes rooted inside small coronal holes or just within the boundaries of large holes. This viewpoint is based largely on photospheric field extrapolations, which are subject to considerable uncertainties and do not include dynamical effects, making it difficult to be certain whether a source is located just inside or outside a hole boundary, or whether a high-latitude hole will be connected to Earth. To minimize the dependence on field-line extrapolations, we have searched for cases where equatorial coronal holes at central meridian are followed by low-speed streams at Earth. We describe 14 examples from the period 2014--2017, involving Fe XIV 21.1 nm coronal holes located near active regions and having equatorial widths of $\sim$3$^\circ$--10$^\circ$. The associated in situ wind was characterized by speeds $v\sim 300$--450 km s$^{-1}$ and by O$^{7+}$/O$^{6+}$ ratios of $\sim$0.05--0.15, with $v$ showing the usual correlation with proton temperature. In addition, consistent with other recent studies, this slow wind had remarkably high Alfv\'enicity, similar to that in high-speed streams. We conclude that small coronal holes are a major contributor to the slow solar wind during the maximum and early post-maximum phases of the solar cycle.


title: Product structure of graphs with an excluded minor

abstract: This paper shows that $K_t$-minor-free (and $K_{s, t}$-minor-free) graphs $G$ are subgraphs of products of a tree-like graph $H$ (of bounded treewidth) and a complete graph $K_m$. Our results include optimal bounds on the treewidth of $H$ and optimal bounds (to within a constant factor) on $m$ in terms of the number of vertices of $G$ and the treewidth of $G$. These results follow from a more general theorem whose corollaries include a strengthening of the celebrated separator theorem of Alon, Seymour, and Thomas [J. Amer. Math. Soc. 1990] and the Planar Graph Product Structure Theorem of Dujmovi\'c et al. [J. ACM 2020].


title: Search for the rare semi-leptonic decay $J/\psi\to D^{-}e^{+}\nu_{e}+c.c.$

abstract: Using $10.1\times10^{9}$ $J/\psi$ events produced by the Beijing Electron Positron Collider (BEPCII) at a center-of-mass energy $\sqrt{s}=3.097~\rm{GeV}$ and collected with the BESIII detector, we present a search for the rare semi-leptonic decay $J/\psi\to D^{-}e^{+}\nu_{e}+c.c.$. No excess of signal above background is observed, and an upper limit on the branching fraction $\mathcal{B}(J/\psi\to D^{-}e^{+}\nu_{e}+c.c.)<7.1\times10^{-8}$ is obtained at $90\%$ confidence level. This is an improvement of more than two orders of magnitude over the previous best limit.


title: Mutual Information Preserving Back-propagation: Learn to Invert for Faithful Attribution

abstract: Back propagation based visualizations have been proposed to interpret deep neural networks (DNNs), some of which produce interpretations with good visual quality. However, there exist doubts about whether these intuitive visualizations are related to the network decisions. Recent studies have confirmed this suspicion by verifying that almost all these modified back-propagation visualizations are not faithful to the model's decision-making process. Besides, these visualizations produce vague "relative importance scores", among which low values can't guarantee to be independent of the final prediction. Hence, it's highly desirable to develop a novel back-propagation framework that guarantees theoretical faithfulness and produces a quantitative attribution score with a clear understanding. To achieve the goal, we resort to mutual information theory to generate the interpretations, studying how much information of output is encoded in each input neuron. The basic idea is to learn a source signal by back-propagation such that the mutual information between input and output should be as much as possible preserved in the mutual information between input and the source signal. In addition, we propose a Mutual Information Preserving Inverse Network, termed MIP-IN, in which the parameters of each layer are recursively trained to learn how to invert. During the inversion, forward Relu operation is adopted to adapt the general interpretations to the specific input. We then empirically demonstrate that the inverted source signal satisfies completeness and minimality property, which are crucial for a faithful interpretation. Furthermore, the empirical study validates the effectiveness of interpretations generated by MIP-IN.


title: A Novel Approach to Curiosity and Explainable Reinforcement Learning via Interpretable Sub-Goals

abstract: Two key challenges within Reinforcement Learning involve improving (a) agent learning within environments with sparse extrinsic rewards and (b) the explainability of agent actions. We describe a curious subgoal focused agent to address both these challenges. We use a novel method for curiosity produced from a Generative Adversarial Network (GAN) based model of environment transitions that is robust to stochastic environment transitions. Additionally, we use a subgoal generating network to guide navigation. The explainability of the agent's behavior is increased by decomposing complex tasks into a sequence of interpretable subgoals that do not require any manual design. We show that this method also enables the agent to solve challenging procedurally-generated tasks that contain stochastic transitions above other state-of-the-art methods.


title: Quasinormal Modes for Dynamical Black Holes

abstract: Realistic black holes are usually dynamical, noticeable or sluggish. The Vaidya metric is a significant and tractable model for simulating a dynamical black hole. In this study, we consider scalar perturbations in a dynamical Vaidya black hole, and explore the quasinormal modes by employing the matrix method. We find the proper boundary conditions of the quasinormal modes from physical analysis in the background of a dynamical black hole for the first time. The results show that the eigenfrequencies become different at the apparent horizon and null infinity, because the physical interactions propagate with finite velocity in nature. Any variation of the hole does not affect the boundary condition at null infinity in a finite time. The quasinormal modes originated around the horizon would not immediately come down to, but slowly goes to the final state following the mass accretion process of the hole. The precision of the matrix method is quite compelling, which reveals more details of the eigenfrequencies of the quasinormal mode of perturbations in the Vaidya spacetime.


title: Inverse design of glass structure with deep graph neural networks

abstract: Directly manipulating the atomic structure to achieve a specific property is a long pursuit in the field of materials. However, hindered by the disordered, non-prototypical glass structure and the complex interplay between structure and property, such inverse design is dauntingly hard for glasses. Here, combining two cutting-edge techniques, graph neural networks and swap Monte Carlo, we develop a data-driven, property-oriented inverse design route that managed to improve the plastic resistance of Cu-Zr metallic glasses in a controllable way. Swap Monte Carlo, as "sampler", effectively explores the glass landscape, and graph neural networks, with high regression accuracy in predicting the plastic resistance, serves as "decider" to guide the search in configuration space. Via an unconventional strengthening mechanism, a geometrically ultra-stable yet energetically meta-stable state is unraveled, contrary to the common belief that the higher the energy, the lower the plastic resistance. This demonstrates a vast configuration space that can be easily overlooked by conventional atomistic simulations. The data-driven techniques, structural search methods and optimization algorithms consolidate to form a toolbox, paving a new way to the design of glassy materials.


title: Further Evidence for Looplike Fine Structure inside "Unipolar" Active Region Plages

abstract: Earlier studies using extreme-ultraviolet images and line-of-sight magnetograms from the Solar Dynamics Observatory (SDO) have suggested that active region (AR) plages and strong network concentrations often have small, looplike features embedded within them, even though no minority-polarity flux is visible in the corresponding magnetograms. Because of the unexpected nature of these findings, we have searched the SDO database for examples of inverted-Y structures rooted inside "unipolar" plages, with such jetlike structures being interpreted as evidence for magnetic reconnection between small bipoles and the dominant-polarity field. Several illustrative cases are presented from the period 2013--2015, all of which are associated with transient outflows from AR "moss." The triangular or dome-shaped bases have horizontal dimensions of $\sim$2--4 Mm, corresponding to $\sim$1--3 granular diameters. We also note that the spongy-textured Fe IX 17.1 nm moss is not confined to plages, but may extend into regions where the photospheric field is relatively weak or even has mixed polarity. We again find a tendency for bright coronal loops seen in the 17.1, 19.3, and 21.1 nm passbands to show looplike fine structure and compact brightenings at their footpoints. These observations provide further confirmation that present-day magnetograms are significantly underrepresenting the amount of minority-polarity flux inside AR plages and again suggest that footpoint reconnection and small-scale flux cancellation may play a major role in coronal heating, both inside and outside ARs.


title: Irreversibility and biased ensembles in active matter: Insights from stochastic thermodynamics

abstract: Active systems evade the rules of equilibrium thermodynamics by constantly dissipating energy at the level of their microscopic components. This energy flux stems from the conversion of a fuel, present in the environment, into sustained individual motion. It can lead to collective effects without any equilibrium equivalent, such as a phase separation for purely repulsive particles, or a collective motion (flocking) for aligning particles. Some of these effects can be rationalized by using equilibrium tools to recapitulate nonequilibrium transitions. An important challenge is then to delineate systematically to which extent the character of these active transitions is genuinely distinct from equilibrium analogs. We review recent works that use stochastic thermodynamics tools to identify, for active systems, a measure of irreversibility comprising a coarse-grained or informatic entropy production. We describe how this relates to the underlying energy dissipation or thermodynamic entropy production, and how it is influenced by collective behavior. Then, we review the possibility to construct thermodynamic ensembles out-of-equilibrium, where trajectories are biased towards atypical values of nonequilibrium observables. We show that this is a generic route to discovering unexpected phase transitions in active matter systems, which can also inform their design.


title: Energy efficiency of voltage waveform tailoring for the generation of excited species in RF plasma jets operated in He/N$_2$ mixtures

abstract: Based on Tunable Diode Laser Absorption Spectroscopy (TDLAS) measurements of the spatially averaged and peak helium metastable atom densities in a capacitively coupled micro atmospheric pressure plasma jet operated in He/N$_2$ mixtures, the energy efficiency of metastable species (He-I 2$^3$S$_1$) generation is compared for three different scenarios: single frequency operation at (i) 13.56 MHz and (ii) 54.12 MHz, and Voltage Waveform Tailoring (VWT) at (iii) "valleys"-waveforms synthesized from four consecutive harmonics of 13.56 MHz. For each case, the dissipated power is measured based on a careful calibration procedure of voltage and current measurements. The results are compared to PIC/MCC simulation results and very good agreement is found. The computational results show that the choice of the surface coefficients in the simulation is important to reproduce the experimental data correctly. Due to the enhanced control of the spatio-temporal electron power absorption dynamics and, thus, of the electron energy distribution function by VWT, this approach does not only provide better control of the generation of excited and reactive species compared to single frequency excitation, but in case of helium metastables the energy efficiency is also shown to be significantly higher in case of VWT.


title: Computing the Union Join and Subset Graph of Acyclic Hypergraphs in Subquadratic Time

abstract: We investigate the two problems of computing the union join graph as well as computing the subset graph for acyclic hypergraphs and their subclasses. In the union join graph $G$ of an acyclic hypergraph $H$, each vertex of $G$ represents a hyperedge of $H$ and two vertices of $G$ are adjacent if there exits a join tree $T$ for $H$ such that the corresponding hyperedges are adjacent in $T$. The subset graph of a hypergraph $H$ is a directed graph where each vertex represents a hyperedge of $H$ and there is a directed edge from a vertex $u$ to a vertex $v$ if the hyperedge corresponding to $u$ is a subset of the hyperedge corresponding to $v$. For a given hypergraph $H = (V, \mathcal{E})$, let $n = |V|$, $m = |\mathcal{E}|$, and $N = \sum_{E \in \mathcal{E}} |E|$. We show that, if the Strong Exponential Time Hypothesis is true, both problems cannot be solved in $\mathcal{O} \bigl( N^{2 - \varepsilon} \bigr)$ time for $\alpha$-acyclic hypergraphs and any constant $\varepsilon > 0$, even if the created graph is sparse. Additionally, we present algorithms that solve both problems in $\mathcal{O} \bigl( N^2 / \log N + |G| \bigr)$ time for $\alpha$-acyclic hypergraphs, in $\mathcal{O} \bigl( N \log (n + m) + |G| \bigr)$ time for $\beta$-acyclic hypergaphs, and in $\mathcal{O} \bigl( N + |G| \bigr)$ time for $\gamma$-acyclic hypergraphs as well as for interval hypergraphs, where $|G|$ is the size of the computed graph.


title: Decoupled Spatial-Temporal Transformer for Video Inpainting

abstract: Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is still a challenging task even with prosperous deep learning approaches. Recent works introduce the promising Transformer architecture into deep video inpainting and achieve better performance. However, it still suffers from synthesizing blurry texture as well as huge computational cost. Towards this end, we propose a novel Decoupled Spatial-Temporal Transformer (DSTT) for improving video inpainting with exceptional efficiency. Our proposed DSTT disentangles the task of learning spatial-temporal attention into 2 sub-tasks: one is for attending temporal object movements on different frames at same spatial locations, which is achieved by temporally-decoupled Transformer block, and the other is for attending similar background textures on same frame of all spatial positions, which is achieved by spatially-decoupled Transformer block. The interweaving stack of such two blocks makes our proposed model attend background textures and moving objects more precisely, and thus the attended plausible and temporally-coherent appearance can be propagated to fill the holes. In addition, a hierarchical encoder is adopted before the stack of Transformer blocks, for learning robust and hierarchical features that maintain multi-level local spatial structure, resulting in the more representative token vectors. Seamless combination of these two novel designs forms a better spatial-temporal attention scheme and our proposed model achieves better performance than state-of-the-art video inpainting approaches with significant boosted efficiency.


title: Wigner Function for Harmonic Oscillator and The Classical Limit

abstract: The Wigner function is a quantum analogue of the classical joined distribution of position and momentum. As such is should be a good tool to study quantum-classical correspondence. In this paper, the classical limit of the Wigner function is shown using the quantum harmonic oscillator as an example. The Wigner function is found exactly for all states. The semi-classical wavefunctions for highly excited states are used as the approach to the classical limit. Therefore, one can found the classical limit of the Wigner function for highly excited states and shown that it gives the classical microcanonical ensemble.


title: An MHD Modeling of Successive X2.2 and X9.3 Solar Flares of 2017 September 6

abstract: Solar active region 12673 produced two successive X-class flares (X2.2 and X9.3) approximately 3 hours apart in September 2017. The X9.3 was the recorded largest solar flare in Solar Cycle 24. In this study we perform a data-constrained magnetohydrodynamic simulation taking into account the observed photospheric magnetic field to reveal the initiation and dynamics of the X2.2 and X9.3 flares. According to our simulation, the X2.2 flare is first triggered by magnetic reconnection at a local site where at the photosphere the negative polarity intrudes into the opposite-polarity region. This magnetic reconnection expels the innermost field lines upward beneath which the magnetic flux rope is formed through continuous reconnection with external twisted field lines. Continuous magnetic reconnection after the X2.2 flare enhances the magnetic flux rope, which is lifted up and eventually erupts via the torus instability. This gives rise to the X9.3 flare.


title: Classifying herbal medicine origins by temporal and spectral data mining of electronic nose

abstract: The origins of herbal medicines are important for their treatment effect, which could be potentially distinguished by electronic nose system. As the odor fingerprint of herbal medicines from different origins can be tiny, the discrimination of origins can be much harder than that of different categories. Better feature extraction methods are significant for this task to be more accurately done, but there lacks systematic studies on different feature extraction methods. In this study, we classified different origins of three categories of herbal medicines with different feature extraction methods: manual feature extraction, mathematical transformation, deep learning algorithms. With 50 repetitive experiments with bootstrapping, we compared the effectiveness of the extractions with a two-layer neural network w/o dimensionality reduction methods (principal component analysis, linear discriminant analysis) as the three base classifiers. Compared with the conventional aggregated features, the Fast Fourier Transform method and our novel approach (longitudinal-information-in-a-line) showed an significant accuracy improvement(p < 0.05) on all 3 base classifiers and all three herbal medicine categories. Two of the deep learning algorithm we applied also showed partially significant improvement: one-dimensional convolution neural network(1D-CNN) and a novel graph pooling based framework - multivariate time pooling(MTPool).


title: FDG: A Precise Measurement of Fault Diagnosability Gain of Test Cases

abstract: The performance of many Fault Localisation (FL) techniques directly depends on the quality of the used test suites. Consequently, it is extremely useful to be able to precisely measure how much diagnostic power each test case can introduce when added to a test suite used for FL. Such a measure can help us not only to prioritise and select test cases to be used for FL, but also to effectively augment test suites that are too weak to be used with FL techniques. We propose FDG, a new measure of Fault Diagnosability Gain for individual test cases. The design of FDG is based on our analysis of existing metrics that are designed to prioritise test cases for better FL. Unlike other metrics, FDG exploits the ongoing FL results to emphasise the parts of the program for which more information is needed. Our evaluation of FDG with Defects4J shows that it can successfully help the augmentation of test suites for better FL. When given only a few failing test cases (2.3 test cases on average), FDG can effectively augment the given test suite by prioritising the test cases generated automatically by EvoSuite: the augmentation can improve the acc@1 and acc@10 of the FL results by 11.6x and 2.2x on average, after requiring only ten human judgements on the correctness of the assertions EvoSuite generates.


title: Temperature-sensitive spatial distribution of defects in PdSe2 flakes

abstract: Defect engineering plays an important role in tailoring the electronic transport properties of van der Waals materials. However, it is usually achieved through tuning the type and concentration of defects, rather than dynamically reconfiguring their spatial distribution. Here, we report temperature-sensitive spatial redistribution of defects in PdSe2 thin flakes through scanning tunneling microscopy (STM). We observe that the spatial distribution of Se vacancies in PdSe2 flakes exhibits a strong anisotropic characteristic at 80 K, and that this orientation-dependent feature is weakened when temperature is raised. Moreover, we carry out transport measurements on PdSe2 thin flakes and show that the anisotropic features of carrier mobility and phase coherent length are also sensitive to temperature. Combining with theoretical analysis, we conclude that temperature-driven defect spatial redistribution could interpret the temperature-sensitive electrical transport behaviors in PdSe2 thin flakes. Our work highlights that engineering spatial distribution of defects in the van der Waals materials, which has been overlooked before, may open up a new avenue to tailor the physical properties of materials and explore new device functionalities.


title: Generative Causal Explanations for Graph Neural Networks

abstract: This paper presents Gem, a model-agnostic approach for providing interpretable explanations for any GNNs on various graph learning tasks. Specifically, we formulate the problem of providing explanations for the decisions of GNNs as a causal learning task. Then we train a causal explanation model equipped with a loss function based on Granger causality. Different from existing explainers for GNNs, Gem explains GNNs on graph-structured data from a causal perspective. It has better generalization ability as it has no requirements on the internal structure of the GNNs or prior knowledge on the graph learning tasks. In addition, Gem, once trained, can be used to explain the target GNN very quickly. Our theoretical analysis shows that several recent explainers fall into a unified framework of additive feature attribution methods. Experimental results on synthetic and real-world datasets show that Gem achieves a relative increase of the explanation accuracy by up to $30\%$ and speeds up the explanation process by up to $110\times$ as compared to its state-of-the-art alternatives.


title: Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little

abstract: A possible explanation for the impressive performance of masked language model (MLM) pre-training is that such models have learned to represent the syntactic structures prevalent in classical NLP pipelines. In this paper, we propose a different explanation: MLMs succeed on downstream tasks almost entirely due to their ability to model higher-order word co-occurrence statistics. To demonstrate this, we pre-train MLMs on sentences with randomly shuffled word order, and show that these models still achieve high accuracy after fine-tuning on many downstream tasks -- including on tasks specifically designed to be challenging for models that ignore word order. Our models perform surprisingly well according to some parametric syntactic probes, indicating possible deficiencies in how we test representations for syntactic information. Overall, our results show that purely distributional information largely explains the success of pre-training, and underscore the importance of curating challenging evaluation datasets that require deeper linguistic knowledge.


title: Jointly Learning Truth-Conditional Denotations and Groundings using Parallel Attention

abstract: We present a model that jointly learns the denotations of words together with their groundings using a truth-conditional semantics. Our model builds on the neurosymbolic approach of Mao et al. (2019), learning to ground objects in the CLEVR dataset (Johnson et al., 2017) using a novel parallel attention mechanism. The model achieves state of the art performance on visual question answering, learning to detect and ground objects with question performance as the only training signal. We also show that the model is able to learn flexible non-canonical groundings just by adjusting answers to questions in the training set.


title: Influenza Surveillance using Search Engine, SNS, On-line Shopping, Q&A Service and Past Flu Patients

abstract: Influenza, an infectious disease, causes many deaths worldwide. Predicting influenza victims during epidemics is an important task for clinical, hospital, and community outbreak preparation. On-line user-generated contents (UGC), primarily in the form of social media posts or search query logs, are generally used for prediction for reaction to sudden and unusual outbreaks. However, most studies rely only on the UGC as their resource and do not use various UGCs. Our study aims to solve these questions about Influenza prediction: Which model is the best? What combination of multiple UGCs works well? What is the nature of each UGC? We adapt some models, LASSO Regression, Huber Regression, Support Vector Machine regression with Linear kernel (SVR) and Random Forest, to test the influenza volume prediction in Japan during 2015 - 2018. For that, we use on-line five data resources: (1) past flu patients, (2) SNS (Twitter), (3) search engines (Yahoo! Japan), (4) shopping services (Yahoo! Shopping), and (5) Q&A services (Yahoo! Chiebukuro) as resources of each model. We then validate respective resources contributions using the best model, Huber Regression, with all resources except one resource. Finally, we use Bayesian change point method for ascertaining whether the trend of time series on any resources is reflected in the trend of flu patient count or not. Our experiments show Huber Regression model based on various data resources produces the most accurate results. Then, from the change point analysis, we get the result that search query logs and social media posts for three years represents these resources as a good predictor. Conclusions: We show that Huber Regression based on various data resources is strong for outliers and is suitable for the flu prediction. Additionally, we indicate the characteristics of each resource for the flu prediction.


title: Post-buckling Dynamics of Spherical Shells

abstract: We explore the intrinsic dynamics of spherical shells immersed in a fluid in the vicinity of their buckled state, through experiments and 3D axisymmetric simulations. The results are supported by a theoretical model that accurately describes the buckled shell as a two-variable-only oscillator. We quantify the effective "softening" of shells above the buckling threshold, as observed in recent experiments on interactions between encapsulated microbubbles and acoustic waves. The main dissipation mechanism in the neighboring fluid is also evidenced.


title: Root-finding Approaches for Computing Conformal Prediction Set

abstract: Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal level without additional assumptions on their distribution. Its computation deplorably requires a refitting procedure for all replacement candidates of the target response. In regression settings, this corresponds to an infinite number of model fits. Apart from relatively simple estimators that can be written as pieces of linear function of the response, efficiently computing such sets is difficult, and is still considered as an open problem. We exploit the fact that, \emph{often}, conformal prediction sets are intervals whose boundaries can be efficiently approximated by classical root-finding algorithms. We investigate how this approach can overcome many limitations of formerly used strategies; we discuss its complexity and drawbacks.


title: Quantum criticality in dimerised anisotropic spin-1 chains

abstract: Applying the (infinite) density-matrix renormalisation group technique, we explore the effect of an explicit dimerisation on the ground-state phase diagram of the spin-1 $XXZ$ chain with single-ion anisotropy $D$. We demonstrate that the Haldane phase between large-$D$ and antiferromagnetic phases survives up to a critical dimerisation only. As a further new characteristic the dimerisation induces a direct continuous Ising quantum phase transition between the large-$D$ and antiferromagnetic phases with central charge $c=1/2$, which terminates at a critical end-point where $c=7/10$. Calculating the critical exponents of the order parameter, neutral gap and spin-spin-correlation function, we find $\beta=1/8$ (1/24), $\nu=1$ (5/9), and $\eta=1/4$ (3/20), respectively, which proves the Ising (tricritical Ising) universality class in accordance with field-theoretical predictions.


title: Learning Semantic Person Image Generation by Region-Adaptive Normalization

abstract: Human pose transfer has received great attention due to its wide applications, yet is still a challenging task that is not well solved. Recent works have achieved great success to transfer the person image from the source to the target pose. However, most of them cannot well capture the semantic appearance, resulting in inconsistent and less realistic textures on the reconstructed results. To address this issue, we propose a new two-stage framework to handle the pose and appearance translation. In the first stage, we predict the target semantic parsing maps to eliminate the difficulties of pose transfer and further benefit the latter translation of per-region appearance style. In the second one, with the predicted target semantic maps, we suggest a new person image generation method by incorporating the region-adaptive normalization, in which it takes the per-region styles to guide the target appearance generation. Extensive experiments show that our proposed SPGNet can generate more semantic, consistent, and photo-realistic results and perform favorably against the state of the art methods in terms of quantitative and qualitative evaluation. The source code and model are available at https://github.com/cszy98/SPGNet.git.


title: Ion-acoustic shock waves in a magnetized plasma featuring super-thermal distribution

abstract: A theoretical investigation has been made on the propagation of ion-acoustic (IA) shock waves (IASHWs) in a magnetized pair-ion plasma having inertial warm positive and negative ions, and inertialess super-thermal electrons and positrons. The well known Burgers' equation has been derived by employing the reductive perturbation method. The plasma model supports both positive and negative shock structures under consideration of super-thermal electrons and positrons. It is found that the oblique angle ($\delta$) enhances the magnitude of the amplitude of both positive and negative shock profiles. It is also observed that the steepness of the shock profiles decreases with the kinematic viscosity of the ion, and the height of the shock profile increases (decreases) with the mass of the positive (negative) ion. The implications of the results have been briefly discussed for space and laboratory plasmas.


title: A Novel Malware Detection Mechanism based on Features Extracted from Converted Malware Binary Images

abstract: Our computer systems for decades have been threatened by various types of hardware and software attacks of which Malwares have been one of them. This malware has the ability to steal, destroy, contaminate, gain unintended access, or even disrupt the entire system. There have been techniques to detect malware by performing static and dynamic analysis of malware files, but, stealthy malware has circumvented the static analysis method and for dynamic analysis, there have been previous works that propose different methods to detect malware but, in this work we propose a novel technique to detect malware. We use malware binary images and then extract different features from the same and then employ different ML-classifiers on the dataset thus obtained. We show that this technique is successful in differentiating classes of malware based on the features extracted.


title: ADNet: Temporal Anomaly Detection in Surveillance Videos

abstract: Anomaly detection in surveillance videos is an important research problem in computer vision. In this paper, we propose ADNet, an anomaly detection network, which utilizes temporal convolutions to localize anomalies in videos. The model works online by accepting consecutive windows consisting of fixed-number of video clips. Features extracted from video clips in a window are fed to ADNet, which allows to localize anomalies in videos effectively. We propose the AD Loss function to improve abnormal segment detection performance of ADNet. Additionally, we propose to use F1@k metric for temporal anomaly detection. F1@k is a better evaluation metric than AUC in terms of not penalizing minor shifts in temporal segments and punishing short false positive temporal segment predictions. Furthermore, we extend UCF Crime dataset by adding two more anomaly classes and providing temporal anomaly annotations for all classes. Finally, we thoroughly evaluate our model on the extended UCF Crime dataset. ADNet produces promising results with respect to F1@k metric. Dataset extensions and code will be publicly available upon publishing


title: Maintenance scheduling of manufacturing systems based on optimal price of the network

abstract: Goods can exhibit positive externalities impacting decisions of customers in socials networks. Suppliers can integrate these externalities in their pricing strategies to increase their revenue. Besides optimizing the prize, suppliers also have to consider their production and maintenance costs. Predictive maintenance has the potential to reduce the maintenance costs and improve the system availability. To address the joint optimization of pricing with network externalities and predictive maintenance scheduling based on the condition of the system, we propose a bi-level optimization solution based on game theory. In the first level, the manufacturing company decides about the predictive maintenance scheduling of the units and the price of the goods. In the second level, the customers decide about their consumption using an optimization approach in which the objective function depends on their consumption, the consumption levels of other customers who are connected through the graph, and the price of the network which is determined by the supplier. To solve the problem, we propose the leader-multiple-followers game where the supplier as a leader predicts the strategies of the followers. Then, customers as the followers obtain their strategies based on the leader's and other followers' strategies. We demonstrate the effectiveness of our proposed method on a simulated case study. The results demonstrate that knowledge of the social network graph results in an increased revenue compared to the case when the underlying social network graph is not known. Moreover, the results demonstrate that obtaining the predictive maintenance scheduling based on the proposed optimization approach leads to an increased profit compared to the baseline decision-making (perform maintenance at the degradation limit).


title: Decomposed Soft Actor-Critic Method for Cooperative Multi-Agent Reinforcement Learning

abstract: Deep reinforcement learning methods have shown great performance on many challenging cooperative multi-agent tasks. Two main promising research directions are multi-agent value function decomposition and multi-agent policy gradients. In this paper, we propose a new decomposed multi-agent soft actor-critic (mSAC) method, which effectively combines the advantages of the aforementioned two methods. The main modules include decomposed Q network architecture, discrete probabilistic policy and counterfactual advantage function (optinal). Theoretically, mSAC supports efficient off-policy learning and addresses credit assignment problem partially in both discrete and continuous action spaces. Tested on StarCraft II micromanagement cooperative multiagent benchmark, we empirically investigate the performance of mSAC against its variants and analyze the effects of the different components. Experimental results demonstrate that mSAC significantly outperforms policy-based approach COMA, and achieves competitive results with SOTA value-based approach Qmix on most tasks in terms of asymptotic perfomance metric. In addition, mSAC achieves pretty good results on large action space tasks, such as 2c_vs_64zg and MMM2.


title: A comprehensive study of vector leptoquark with $U(1)_{B_3-L_2}$ on the $B$-meson and Muon g-2 anomalies

abstract: Recently reported anomalies in various $B$ meson decays and also in the anomalous magnetic moment of muon $(g-2)_\mu$ motivate us to consider a particular extension of the standard model incorporating new interactions in lepton and quark sectors simultaneously. Our minimal choice would be leptoquark. In particular, we take vector leptoquark ($U_1$) and comprehensively study all related observables including ${(g-2)_{\mu}},\ R_{K^{(*)}},\ R_{D^{(*)}}$, $B \to (K) \ell \ell' $ where $\ell\ell'$ are various combinations of $\mu$ and $\tau$, and also lepton flavor violation in the $\tau$ decays. We find that a hybrid scenario with additional $U(1)_{B_3-L_2}$ gauge boson provides a common explanation of all these anomalies.


title: New Strategies for Solar Cells Beyond the Visible Spectral Range

abstract: The endeavor of the scientific community to maximize the possibility to harvest Sun irradiation for energy production is mainly devoted to the improvement of the power conversion efficiency of devices and to the extension of the spectral range in which solar devices operate. Considering that a significant portion of the Sun irradiation at the ground level is in the infrared, the research on materials and systems that operate in such region is gaining increasing attention. In this review, we will report recent advancements in multijunction solar cells, inorganic-organic perovskite solar cells, organic solar cells, colloidal quantum dot solar cells focusing on the absorption of such devices in the infrared. In addition, the use of upconverting nanostructures will be introduced as a way to indirectly exploit infrared radiation to increase power conversion efficiency of photovoltaic devices. Moreover, we will describe plasmon induced hot electron extraction based solar cells, that are particularly promising in absorbing the infrared portion of the Sun irradiation when the active materials are doped semiconductors, which show intense plasmonic resonances in the infrared. The review includes the optical spectroscopy tools to study the hot electron extraction from doped semiconductor-based heterojunctions.


title: Small World Model for scaling up prediction result based on SEIR model

abstract: Data-driven epidemic simulation helps better policymaking. Compared with macro-scale simulations driven by statistical data, individual-level GPS data can afford finer and spatialized results. However, the big GPS data, usually collected from mobile phone users, cannot cover all populations. Therefore, this study proposes a Small World Model, to map the results from the "small world" (simulation with partially sampled data) to the real world. Based on the basic principles of disease transmission, this study derives two parameters: a time scaling factor to map the simulated period to the real period, and an amount scaling factor to map the simulated infected number to the real infected number. It is believed that this model could convert the simulation of the "small world" into the state of the real world, and analyze the effectiveness of different mobility restriction policies.


title: Stable and Efficient Computation of Generalized Polar Decompositions

abstract: We present methods for computing the generalized polar decomposition of a matrix based on the dynamically weighted Halley (DWH) iteration. This method is well established for computing the standard polar decomposition. A stable implementation is available, where matrix inversion is avoided and QR decompositions are used instead. We establish a natural generalization of this approach for computing generalized polar decompositions with respect to signature matrices. Again the inverse can be avoided by using a generalized QR decomposition called hyperbolic QR decomposition. However, this decomposition does not show the same favorable stability properties as its orthogonal counterpart. We overcome the numerical difficulties by generalizing the CholeskyQR2 method. This method computes the standard QR decomposition in a stable way via two successive Cholesky factorizations. An even better numerical stability is achieved by employing permuted graph bases, yielding residuals of order $10^{-14}$ even for badly conditioned matrices, where other methods fail.


title: Correlations and structure of interfaces in the Ising model. Theory and numerics

abstract: We consider phase separation on the strip for the two-dimensional Ising model in the near-critical region. Within the framework of field theory, we find exact analytic results for certain two- and three-point correlation functions of the order parameter field. The analytic results for order parameter correlations, energy density profile, subleading corrections and passage probability density of the interface are confirmed by accurate Monte Carlo simulations we performed.


title: Quantum Representation of Affine Weyl Groups and Associated Quantum Curves

abstract: We study a quantum (non-commutative) representation of the affine Weyl group mainly of type $E_8^{(1)}$, where the representation is given by birational actions on two variables $x$, $y$ with $q$-commutation relations. Using the tau variables, we also construct quantum "fundamental" polynomials $F(x,y)$ which completely control the Weyl group actions. The geometric properties of the polynomials $F(x,y)$ for the commutative case is lifted distinctively in the quantum case to certain singularity structures as the $q$-difference operators. This property is further utilized as the characterization of the quantum polynomials $F(x,y)$. As an application, the quantum curve associated with topological strings proposed recently by the first named author is rederived by the Weyl group symmetry. The cases of type $D_5^{(1)}$, $E_6^{(1)}$, $E_7^{(1)}$ are also discussed.


title: Graph connectivity based strong quantum nonlocality with genuine entanglement

abstract: Strong nonlocality based on local distinguishability is a stronger form of quantum nonlocality recently introduced in multipartite quantum systems: an orthogonal set of multipartite quantum states is said to be of strong nonlocality if it is locally irreducible for every bipartition of the subsystems. Most of the known results are limited to sets with product states. Shi et al. presented the first result of strongly nonlocal entangled sets in [Phys. Rev. A 102, 042202 (2020)] and there they questioned the existence of strongly nonlocal set with genuine entanglement. In this work, we relate the strong nonlocality of some speical set of genuine entanglement to the connectivities of some graphs. Using this relation, we successfully construct sets of genuinely entangled states with strong nonlocality. As a consequence, our constructions give a negative answer to Shi et al.'s question, which also provide another answer to the open problem raised by Halder et al. [Phys. Rev. Lett. 122, 040403 (2019)]. This work associates a physical quantity named strong nonlocality with a mathematical quantity called graph connectivity.


title: Development of microwave cavities for measurement of muonium hyperfine structure at J-PARC

abstract: The MuSEUM collaboration is planning measurements of the ground-state hyperfine structure (HFS) of muonium at the Japan Proton Accelerator Research Complex (J-PARC), Materials and Life Science Experimental Facility. The high-intensity beam that will soon be available at H-line allows for more precise measurements by one order of magnitude. We plan to conduct two staged measurements. First, we will measure the Mu-HFS in a near-zero magnetic field, and thereafter we will measure it in a strong magnetic field. We have developed two microwave cavities for this purpose. Furthermore, we evaluated systematic uncertainties from such a fluctuation of microwave fields and confirm the requirement of the microwave system, we use a microwave field distribution calculated from the finite element method.


title: Solution of the random field $XY$ magnet on a fully connected graph

abstract: We use large deviation theory to obtain the free energy of the XY model on a fully connected graph on each site of which there is a randomly oriented field of magnitude $h$. The phase diagram is obtained for two symmetric distributions of the random orientations: (a) a uniform distribution and (b) a distribution with cubic symmetry. In both cases, the disorder-averaged ordered state reflects the symmetry of the underlying distribution. The phase boundary has a multicritical point which separates a locus of continuous transitions (for small values of $h$) from a locus of first order transitions (for large $h$). The free energy is a function of a single variable in case (a) and a function of two variables in case (b), leading to different characters of the multicritical points in the two cases. We find that the locus of continuous transitions is given by the same equation for a family of quadriperiodic distributions, which includes the distributions (a) and (b). However, the location of the multicritical point and the nature of ordered state depend on the form of the distribution. The disorder-averaged ground state energy is found exactly, and the specific heat is shown to approach a constant as temperature approaches zero.


title: Emergent vortices and phase separation in systems of chiral active particles with dipolar interactions

abstract: Using Brownian dynamics (BD) simulations we investigate the self-organization of a monolayer of chiral active particles with dipolar interactions. Each particle is driven by both, translational and rotational self-propulsion, and carries a permanent point dipole moment at its center. The direction of the translational propulsion for each particle is chosen to be parallel to its dipole moment. Simulations are performed at high dipolar coupling strength and a density below that related to motility-induced phase separation in simple active Brownian particles. Despite this restriction, we observe a wealth of phenomena including formation of two types of vortices, phase separation, and flocking transitions. To understand the appearance and disappearance of vortices in the many-particle system, we further investigate the dynamics of simple ring structures under the impact of self-propulsion.


title: End-to-end Keyword Spotting using Neural Architecture Search and Quantization

abstract: This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of convolutional neural networks (CNNs) operating on raw audio waveforms. After a suitable KWS model is found with NAS, we conduct quantization of weights and activations to reduce the memory footprint. We conduct extensive experiments on the Google speech commands dataset. In particular, we compare our end-to-end approach to mel-frequency cepstral coefficient (MFCC) based systems. For quantization, we compare fixed bit-width quantization and trained bit-width quantization. Using NAS only, we were able to obtain a highly efficient model with an accuracy of 95.55% using 75.7k parameters and 13.6M operations. Using trained bit-width quantization, the same model achieves a test accuracy of 93.76% while using on average only 2.91 bits per activation and 2.51 bits per weight.


title: Double Robust Semi-Supervised Inference for the Mean: Selection Bias under MAR Labeling with Decaying Overlap

abstract: Semi-supervised (SS) inference has received much attention in recent years. Apart from a moderate-sized labeled data, L, the SS setting is characterized by an additional, much larger sized, unlabeled data, U. The setting of |U| >> |L|, makes SS inference unique and different from the standard missing data problems, owing to natural violation of the so-called "positivity" or "overlap" assumption. However, most of the SS literature implicitly assumes L and U to be equally distributed, i.e., no selection bias in the labeling. Inferential challenges in missing at random (MAR) type labeling allowing for selection bias, are inevitably exacerbated by the decaying nature of the propensity score (PS). We address this gap for a prototype problem, the estimation of the response's mean. We propose a double robust SS (DRSS) mean estimator and give a complete characterization of its asymptotic properties. The proposed estimator is consistent as long as either the outcome or the PS model is correctly specified. When both models are correctly specified, we provide inference results with a non-standard consistency rate that depends on the smaller size |L|. The results are also extended to causal inference with imbalanced treatment groups. Further, we provide several novel choices of models and estimators of the decaying PS, including a novel offset logistic model and a stratified labeling model. We present their properties under both high and low dimensional settings. These may be of independent interest. Lastly, we present extensive simulations and also a real data application.


title: Field induced hysteretic structural phase switching and possible CDW in Re-doped MoTe$_2$

abstract: Novel electronic systems displaying exotic physical properties can be derived from complex topological materials through chemical doping. MoTe$_2$, the candidate type-II Weyl semimetal shows dramatically enhanced superconductivity up to 4.1 K upon Re doping in Mo sites. Based on bulk transport and local scanning tunneling microscopy (STM) here we show that Re doping also leads to the emergence of a possible charge density wave (CDW) phase in Re$_{0.2}$Mo$_{0.8}$Te$_2$. In addition, the tunneling $I-V$ characteristics display non-linearity and hysteresis which is commensurate with a hysteresis observed in the change in tip-height ($z$) as a function of applied voltage $V$. The observations indicate an electric field induced hysteretic switching consistent with piezoelectricity and possible ferroelectricity.


title: NAREOR: The Narrative Reordering Problem

abstract: Many implicit inferences exist in text depending on how it is structured that can critically impact the text's interpretation and meaning. One such structural aspect present in text with chronology is the order of its presentation. For narratives or stories, this is known as the narrative order. Reordering a narrative can impact the temporal, causal, event-based, and other inferences readers draw from it, which in turn can have strong effects both on its interpretation and interestingness. In this paper, we propose and investigate the task of Narrative Reordering (NAREOR) which involves rewriting a given story in a different narrative order while preserving its plot. We present a dataset, NAREORC, with human rewritings of stories within ROCStories in non-linear orders, and conduct a detailed analysis of it. Further, we propose novel task-specific training methods with suitable evaluation metrics. We perform experiments on NAREORC using state-of-the-art models such as BART and T5 and conduct extensive automatic and human evaluations. We demonstrate that although our models can perform decently, NAREOR is a challenging task with potential for further exploration. We also investigate two applications of NAREOR: generation of more interesting variations of stories and serving as adversarial sets for temporal/event-related tasks, besides discussing other prospective ones, such as for pedagogical setups related to language skills like essay writing and applications to medicine involving clinical narratives.


title: Towards Explainable Multi-Party Learning: A Contrastive Knowledge Sharing Framework

abstract: Multi-party learning provides solutions for training joint models with decentralized data under legal and practical constraints. However, traditional multi-party learning approaches are confronted with obstacles such as system heterogeneity, statistical heterogeneity, and incentive design. How to deal with these challenges and further improve the efficiency and performance of multi-party learning has become an urgent problem to be solved. In this paper, we propose a novel contrastive multi-party learning framework for knowledge refinement and sharing with an accountable incentive mechanism. Since the existing naive model parameter averaging method is contradictory to the learning paradigm of neural networks, we simulate the process of human cognition and communication, and analogy multi-party learning as a many-to-one knowledge sharing problem. The approach is capable of integrating the acquired explicit knowledge of each client in a transparent manner without privacy disclosure, and it reduces the dependence on data distribution and communication environments. The proposed scheme achieves significant improvement in model performance in a variety of scenarios, as we demonstrated through experiments on several real-world datasets.


title: A pedagogical discussion of N = 1 four-dimensional supergravity in superspace

abstract: A short introduction to N = 1 supergravity in four dimensions in the superspace approach is given emphasising on all steps to obtain the final Lagrangian. In particular starting from geometrical principles and the introduction of superfields in curved superspace, the action coupling matter and gauge fields to supergravity is derived. This review is based on the book -A supergravity Primer: From geometrical principles to the Final Lagrangian- and on several lectures given at the doctoral school of Strasbourg.


title: Multiscale characterization of interfacial region in flexible rubber composites: initial structure and evolution upon thermal treatment

abstract: To investigate the structural changes upon thermal treatment of resorcinol formaldehyde latex (RFL) interfacial layer in rubber-cord flexible composite, a multiscale approach has been employed. High-resolution AFM mapping showed a significant increase of the modulus of the RF phase from 1.2 GPa to 2.3 GPa and latex phase (L) from 0.3 GPa to 0.8 GPa after a thermal exposure at 100{\deg}C for 10 days. The increase of the RF and L phases elastic modulus was correlated with the increase of the oxygen content in RFL layer based on the measurements by SEM-EDX. Besides by combining finite element simulations and AFM modulus profiling, the presence of an interphase region (over 280 nm) between the RFL and the rubber regions was identified and was not deteriorated by the thermal treatment. Peel adhesion testing revealed that the increase of RF and L phases rigidity after thermal treatment was detrimental for the interfacial adhesion of the rubber composite.


title: BV and Sobolev homeomorphisms between metric measure spaces and the plane

abstract: We show that given a homeomorphism $f:G\rightarrow\Omega$ where $G$ is a open subset of $\mathbb{R}^2$ and $\Omega$ is a open subset of a $2$-Ahlfors regular metric measure space supporting a weak $(1,1)$-Poincar\'e inequality, it holds $f\in BV_{\operatorname{loc}}(G,\Omega)$ if and only $f^{-1}\in BV_{\operatorname{loc}}(\Omega,G)$. Further if $f$ satisfies the Luzin N and N$^{-1}$ conditions then $f\in W^{1,1}_{\operatorname{loc}}(G,\Omega)$ if and only if $f^{-1}\in W^{1,1}_{\operatorname{loc}}(\Omega,G)$.


title: Convergence Rate To Equilibrium For Collisionless Transport Equations With Diffuse Boundary Operators: A New Tauberian Approach

abstract: This paper provides a new tauberian approach to the study of quantitative time asymptotics of collisionless transport semigroups with general diffuse boundary operators. We obtain an (almost) optimal algebraic rate of convergence to equilibrium under very general assumptions on the initial datum and the boundary operator. The rate is prescribed by the maximal gain of integrability that the boundary operator is able to induce. The proof relies on a representation of the collisionless transport semigroups by a (kind of) Dyson-Phillips series and on a fine analysis of the trace on the imaginary axis of Laplace transform of remainders (of large order) of this series. Our construction is systematic and is based on various preliminary results of independent interest.


title: FrankWolfe.jl: a high-performance and flexible toolbox for Frank-Wolfe algorithms and Conditional Gradients

abstract: We present FrankWolfe.jl, an open-source implementation of several popular Frank-Wolfe and Conditional Gradients variants for first-order constrained optimization. The package is designed with flexibility and high-performance in mind, allowing for easy extension and relying on few assumptions regarding the user-provided functions. It supports Julia's unique multiple dispatch feature, and interfaces smoothly with generic linear optimization formulations using MathOptInterface.jl.


title: Massive and massless two-dimensional Dirac particles in electric quantum dots

abstract: In this work we investigate the confining properties of charged particles of a Dirac material in the plane subject to an electrostatic potential well, that is, in an electric quantum dot. Our study focuses on the effect of mass and angular momenta on such confining properties. To have a global picture of confinement, both bound and resonance states are considered. The resonances will be examined by means of the Wigner time delay of the scattering states, as well as through the complex eigenvalues of outgoing states in order to show that they are physically meaningful. By tuning the potential intensity of the well, electron captures and atomic collapses are observed for critical values. In these processes, the bound states of the discrete spectrum become resonances of the continuous spectrum or vice versa. For massive charges, the atomic collapse phenomenon keeps the number of bound levels in the quantum dot below a maximum value. In the massless case, the bound states have zero energy and occur only for some discrete values of the potential depth, as is known. We also show that although the intensity of the resonances for massive particles is not significantly influenced by angular momenta, on the contrary, for massless particles they are quite sensitive to angular momenta, as it is the case of graphene.