title: Scrutinizing New Physics in Semi-leptonic $B_{c}\rightarrow J/\psi \tau\nu$ Decay

abstract: We perform a global analysis of the $b\to c\tau\nu$ data using the recent lattice results on the $B_c\to J/\psi$ vector and axial-vector form factors. To explore the effects from the tensor operator of new physics beyond the standard model, we determine the tensor form factors by using the non-relativistic QCD (NRQCD) relations between tensor and (axial-)vector form factors. Based on the lattice+NRQCD form factors, we fit the Wilson coefficients and the new physics couplings in $R_2$, $S_1$ and $U_1$ leptoquark models by including the recently measured $R(\Lambda_c)$ and imposing the relaxed constraint $\mathcal B(B_c\to J/\psi)<30\%$ in light of the recent studies on LEP1 data and $B_c$ lifetime. We give predictions for the experimental observables including $R(J/\psi)$, $P_\tau(J/\psi)$, $F_L(J/\psi)$ and $\mathcal A_{FB}(J/\psi)$ as well as their $q^2$ distribution in new physics scenarios/models. Our results suggest that the longitudinal $\tau$ polarization fraction $P_\tau(J/\psi)$ and the forward-backward asymmetry $\mathcal A_{FB}(J/\psi)$ are useful for testing the $R_2$ leptoquark model.


title: Segmenting across places: The need for fair transfer learning with satellite imagery

abstract: The increasing availability of high-resolution satellite imagery has enabled the use of machine learning to support land-cover measurement and inform policy-making. However, labelling satellite images is expensive and is available for only some locations. This prompts the use of transfer learning to adapt models from data-rich locations to others. Given the potential for high-impact applications of satellite imagery across geographies, a systematic assessment of transfer learning implications is warranted. In this work, we consider the task of land-cover segmentation and study the fairness implications of transferring models across locations. We leverage a large satellite image segmentation benchmark with 5987 images from 18 districts (9 urban and 9 rural). Via fairness metrics we quantify disparities in model performance along two axes -- across urban-rural locations and across land-cover classes. Findings show that state-of-the-art models have better overall accuracy in rural areas compared to urban areas, through unsupervised domain adaptation methods transfer learning better to urban versus rural areas and enlarge fairness gaps. In analysis of reasons for these findings, we show that raw satellite images are overall more dissimilar between source and target districts for rural than for urban locations. This work highlights the need to conduct fairness analysis for satellite imagery segmentation models and motivates the development of methods for fair transfer learning in order not to introduce disparities between places, particularly urban and rural locations.


title: Permutation-bipartition pairs

abstract: Permutation-partition pairs were introduced by Stahl in 1980. These pairs are generalizations of graphs and graphs on surfaces. They were used to solve some problems for orientable embeddings of graphs. In this paper, we introduce a particular type of permutation-partition pair, called permutation-bipartition pair, which can be seen as generalizations of signed graphs and signed graph embeddings. Some applications are given.


title: Data Augmentation for Electrocardiograms

abstract: Neural network models have demonstrated impressive performance in predicting pathologies and outcomes from the 12-lead electrocardiogram (ECG). However, these models often need to be trained with large, labelled datasets, which are not available for many predictive tasks of interest. In this work, we perform an empirical study examining whether training time data augmentation methods can be used to improve performance on such data-scarce ECG prediction problems. We investigate how data augmentation strategies impact model performance when detecting cardiac abnormalities from the ECG. Motivated by our finding that the effectiveness of existing augmentation strategies is highly task-dependent, we introduce a new method, TaskAug, which defines a flexible augmentation policy that is optimized on a per-task basis. We outline an efficient learning algorithm to do so that leverages recent work in nested optimization and implicit differentiation. In experiments, considering three datasets and eight predictive tasks, we find that TaskAug is competitive with or improves on prior work, and the learned policies shed light on what transformations are most effective for different tasks. We distill key insights from our experimental evaluation, generating a set of best practices for applying data augmentation to ECG prediction problems.


title: Orthogonal-ansatz VQE: Locating excited states without modifying a cost-function

abstract: Most literature in the Variational Quantum Eigensolver (VQE) algorithm focuses on finding the ground state of a physical system, by minimizing a quantum-computed cost-function. When excited states are required, the cost-function is usually modified to include additional terms ensuring orthogonality with the ground state. This generally requires additional quantum circuit executions and measurements, increasing algorithmic complexity. Here we present a design strategy for the variational ansatz which enforces orthogonality in candidate excited states while still fully exploring the remaining subset of Hilbert space. The result is an excited-state VQE solver which trades increasing measurement complexity for increasing circuit complexity. The latter is anticipated to become preferable as quantum error mitigation and correction become more refined. We demonstrate our approach with three distinct ansatze, beginning with a simple single-body example, before generalizing to accommodate the full Hilbert space spanned by all qubits, and a constrained Hilbert space obeying particle number conservation.


title: Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization

abstract: The most advanced abstractive dialogue summarizers lack generalization ability on new domains and the existing researches for domain adaptation in summarization generally rely on large-scale pre-trainings. To explore the lightweight fine-tuning methods for domain adaptation of dialogue summarization, in this paper, we propose an efficient and generalizable Domain-Oriented Prefix-tuning model, which utilizes a domain word initialized prefix module to alleviate domain entanglement and adopts discrete prompts to guide the model to focus on key contents of dialogues and enhance model generalization. We conduct zero-shot experiments and build domain adaptation benchmarks on two multi-domain dialogue summarization datasets, TODSum and QMSum. Adequate experiments and qualitative analysis prove the effectiveness of our methods.


title: Attention guided global enhancement and local refinement network for semantic segmentation

abstract: The encoder-decoder architecture is widely used as a lightweight semantic segmentation network. However, it struggles with a limited performance compared to a well-designed Dilated-FCN model for two major problems. First, commonly used upsampling methods in the decoder such as interpolation and deconvolution suffer from a local receptive field, unable to encode global contexts. Second, low-level features may bring noises to the network decoder through skip connections for the inadequacy of semantic concepts in early encoder layers. To tackle these challenges, a Global Enhancement Method is proposed to aggregate global information from high-level feature maps and adaptively distribute them to different decoder layers, alleviating the shortage of global contexts in the upsampling process. Besides, a Local Refinement Module is developed by utilizing the decoder features as the semantic guidance to refine the noisy encoder features before the fusion of these two (the decoder features and the encoder features). Then, the two methods are integrated into a Context Fusion Block, and based on that, a novel Attention guided Global enhancement and Local refinement Network (AGLN) is elaborately designed. Extensive experiments on PASCAL Context, ADE20K, and PASCAL VOC 2012 datasets have demonstrated the effectiveness of the proposed approach. In particular, with a vanilla ResNet-101 backbone, AGLN achieves the state-of-the-art result (56.23% mean IoU) on the PASCAL Context dataset. The code is available at https://github.com/zhasen1996/AGLN.


title: Application of machine learning for predicting the spread of COVID-19

abstract: The spread of diseases has been studied for many years, but it receives a particular focus recently due to the outbreak and spread of COVID-19. Studies show that the spread of COVID-19 can be characterized by the Susceptible-Infectious-Recovered-Deceased (SIRD) model with containment coefficients (due to quarantine and keeping social distance). This project aims to apply the machine learning technique to predict the severity of COVID-19 and the effect of quarantine, keeping social distance, working from home, and wearing masks on the transmission of the disease. This work deepens our understanding of disease transmission and reveals the importance of following policies.


title: Evidence of fully-gapped superconductivity in NbReSi: A combined $\mu$SR and NMR study

abstract: We report a comprehensive study of the noncentrosymmetric NbReSi superconductor by means of muon-spin rotation and relaxation ($\mu$SR) and nuclear magnetic resonance (NMR) techniques. NbReSi is a bulk superconductor with $T_c = 6.5$ K, characterized by a large upper critical field, which exceeds the Pauli limit. Both the superfluid density $\rho_\mathrm{sc}(T)$ (determined via transverse-field $\mu$SR) and the spin-lattice relaxation rate $T_1^{-1}(T)$ (determined via NMR) suggest a nodeless superconductivity (SC) in NbReSi. We also find signatures of multigap SC, here evidenced by the field-dependent muon-spin relaxation rate and the electronic specific-heat coefficient. The absence of spontaneous magnetic fields below $T_c$, as evinced from zero-field $\mu$SR measurements, indicates a preserved time-reversal symmetry in the superconducting state of NbReSi. Finally, we discuss possible reasons for the unusually large upper critical field of NbReSi, most likely arising from its anisotropic crystal structure.


title: On the slice spectral sequence for quotients of norms of Real bordism

abstract: In this paper, we investigate equivariant quotients of the Real bordism spectrum's multiplicative norm $MU^{((C_{2^n}))}$ by permutation summands. These quotients are of interest because of their close relationship with higher real $K$-theories. We introduce new techniques for computing the equivariant homotopy groups of such quotients. As a new example, we examine the theories $BP^{((C_{2^n}))}\langle m,m\rangle$. These spectra serve as natural equivariant generalizations of connective integral Morava $K$-theories. We provide a complete computation of the $a_{\sigma}$-localized slice spectral sequence of $i^*_{C_{2^{n-1}}}BP^{((C_{2^n}))}\langle m,m\rangle$, where $\sigma$ is the real sign representation of $C_{2^{n-1}}$. To achieve this computation, we establish a correspondence between this localized slice spectral sequence and the $H\mathbb{F}_2$-based Adams spectral sequence in the category of $H\mathbb{F}_2 \wedge H\mathbb{F}_2$-modules. Furthermore, we provide a full computation of the $a_{\lambda}$-localized slice spectral sequence of the height-4 theory $BP^{((C_{4}))}\langle 2,2\rangle$. The $C_4$-slice spectral sequence can be entirely recovered from this computation.


title: Design of wavelength division multiplexing devices based on tunable edge states of valley photonic crystals

abstract: Wavelength division multiplexing (WDM) devices are key elements of Photonic integrated circuits (PICs). Conventional WDM devices based on silicon waveguides and photonic crystals have limited transmittance due to high loss introduced by the strong backward scattering from defects. In addition, it is challenging to reduce the footprint of those devices. Here we theoretically demonstrate a WDM device in the telecommunication range based on all-dielectric silicon topological valley photonic crystal (VPC) structures. We tune its effective refractive index by tuning the physical parameters of the lattice in the silicon substrate, which can continuously tune the working wavelength range of the topological edge states, which allows designing WDM devices with different channels. The WDM device has two channels (1470 nm-1523 nm and 1548 nm-1609 nm), with contrast ratios of 22.4 dB and 24.9 dB, respectively. The principle of manipulating the working bandwidth of the topological edge states can be generally applied in designing different integratable photonic devices, thus it will find broad applications.


title: Homotopy of manifolds stabilized by projective spaces

abstract: We study the homotopy of the connected sum of a manifold with a projective space, viewed as a typical way to stabilize manifolds. In particular, we show a loop homotopy decomposition of a manifold after stabilization by a projective space, and provide concrete examples. To do this, we trace the effect in homotopy theory of surgery on certain product manifolds by showing a loop homotopy decomposition after localization away from the order of the image of the classical $J$-homomorphism.


title: Moment estimates in the first Borel-Cantelli Lemma with applications to mean deviation frequencies

abstract: We quantify the elementary Borel-Cantelli Lemma by higher moments of the overlap count statistic in terms of the weighted summability of the probabilities. Applications include mean deviation frequencies in the Strong Law and the Law of the Iterated Logarithm.


title: QuiKo: A Quantum Beat Generation Application

abstract: In this chapter a quantum music generation application called QuiKo will be discussed. It combines existing quantum algorithms with data encoding methods from quantum machine learning to build drum and audio sample patterns from a database of audio tracks. QuiKo leverages the physical properties and characteristics of quantum computers to generate what can be referred to as Soft Rules proposed by Alexis Kirke. These rules take advantage of the noise produced by quantum devices to develop flexible rules and grammars for quantum music generation. These properties include qubit decoherence and phase kickback due controlled quantum gates within the quantum circuit. QuiKo builds upon the concept of soft rules in quantum music generation and takes it a step further. It attempts to mimic and react to an external musical inputs, similar to the way that human musicians play and compose with one another. Audio signals are used as inputs into the system. Feature extraction is then performed on the signal to identify the harmonic and percussive elements. This information is then encoded onto the quantum circuit. Measurements of the quantum circuit are then taken providing results in the form of probability distributions for external music applications to use to build the new drum patterns.


title: Learning to Schedule Multi-Server Jobs with Fluctuated Processing Speeds

abstract: Multi-server jobs are imperative in modern cloud computing systems. A noteworthy feature of multi-server jobs is that, they usually request multiple computing devices simultaneously for their execution. How to schedule multi-server jobs online with a high system efficiency is a topic of great concern. Firstly, the scheduling decisions have to satisfy the service locality constraints. Secondly, the scheduling decisions needs to be made online without the knowledge of future job arrivals. Thirdly, and most importantly, the actual service rate experienced by a job is usually in fluctuation because of the dynamic voltage and frequency scaling (DVFS) and power oversubscription techniques when multiple types of jobs co-locate. A majority of online algorithms with theoretical performance guarantees are proposed. However, most of them require the processing speeds to be knowable, thereby the job completion times can be exactly calculated. To present a theoretically guaranteed online scheduling algorithm for multi-server jobs without knowing actual processing speeds apriori, in this paper, we propose ESDP (Efficient Sampling-based Dynamic Programming), which learns the distribution of the fluctuated processing speeds over time and simultaneously seeks to maximize the cumulative overall utility. The cumulative overall utility is formulated as the sum of the utilities of successfully serving each multi-server job minus the penalty on the operating, maintaining, and energy cost. ESDP is proved to have a polynomial complexity and a logarithmic regret, which is a State-of-the-Art result. We also validate it with extensive simulations and the results show that the proposed algorithm outperforms several benchmark policies with improvements by up to 73%, 36%, and 28%, respectively.


title: A Siren Song of Open Source Reproducibility

abstract: As reproducibility becomes a greater concern, conferences have largely converged to a strategy of asking reviewers to indicate whether code was attached to a submission. This is part of a larger trend of taking action based on assumed ideals, without studying if those actions will yield the desired outcome. Our argument is that this focus on code for replication is misguided if we want to improve the state of reproducible research. This focus can be harmful -- we should not force code to be submitted. There is a lack of evidence for effective actions taken by conferences to encourage and reward reproducibility. We argue that venues must take more action to advance reproducible machine learning research today.


title: Tight toughness, isolated toughness and binding number bounds for the $\{K_2,C_n\}$-factors

abstract: The $\{K_2,C_n\}$-factor of a graph is a spanning subgraph whose each component is either $K_2$ or $C_n$. In this paper, a sufficient condition with regard to tight toughness, isolated toughness and binding number bounds to guarantee the existence of the $\{K_2,C_{2i+1}| i\geq 2 \}$-factor for any graph is obtained, which answers a problem due to Gao and Wang (J. Oper. Res. Soc. China (2021), https://doi.org/10.1007/s40305-021-00357-6).


title: Collapsing domain walls beyond $Z_2$

abstract: Discrete symmetries are widely imposed in particle theories. It is well-known that the spontaneous breaking of discrete symmetries leads to domain walls. Current studies of domain walls have focused on those from the spontaneous breaking of a $Z_2$ symmetry. Larger discrete symmetries have multiple degenerate vacua, leading to the domain walls in principle different from the simplest $Z_2$ domain wall. We take domain walls from $Z_N$ symmetry breaking as an illustrative study, and study in detail the $Z_3$ case, in which semi-analytical results for the tension and thickness of domain walls are derived. Explicit symmetry breaking terms lead to the dynamics of domain walls collapsing more complicated than the $Z_2$ case. Gravitational wave signals deviate from those from $Z_2$ domain walls.


title: Channel Pruning In Quantization-aware Training: An Adaptive Projection-gradient Descent-shrinkage-splitting Method

abstract: We propose an adaptive projection-gradient descent-shrinkage-splitting method (APGDSSM) to integrate penalty based channel pruning into quantization-aware training (QAT). APGDSSM concurrently searches weights in both the quantized subspace and the sparse subspace. APGDSSM uses shrinkage operator and a splitting technique to create sparse weights, as well as the Group Lasso penalty to push the weight sparsity into channel sparsity. In addition, we propose a novel complementary transformed l1 penalty to stabilize the training for extreme compression.


title: Small-Gain Theorem for Safety Verification under High-Relative-Degree Constraints

abstract: This paper develops a small-gain technique for the safety analysis and verification of interconnected systems with high-relative-degree safety constraints. In this technique, input-to-state safety (ISSf) is used to characterize how the safety of a subsystem is influenced by the external input, and ISSf-barrier functions (ISSf-BFs) with high relative degree are employed to capture the safety of subsystems. With a coordination transform, the relationship between ISSf-BFs and the existing high-relative-degree (or high-order) barrier functions is established in order to simplify the ISSf analysis. With the help of high-relative-degree ISSf-BFs, a small-gain theorem is proposed for safety verification. It is shown that, under the small-gain condition, i) the interconnection of ISSf subsystems is still ISSf; and ii) the overall interconnected system is input-to-state stable (ISS) with respect to the compositional safe set. The effectiveness of the proposed small-gain theorem is illustrated on the output-constrained decentralized control of two inverted pendulums connected by a spring mounted on two carts.


title: Robotic Surgery Remote Mentoring via AR with 3D Scene Streaming and Hand Interaction

abstract: With the growing popularity of robotic surgery, education becomes increasingly important and urgently needed for the sake of patient safety. However, experienced surgeons have limited accessibility due to their busy clinical schedule or working in a distant city, thus can hardly provide sufficient education resources for novices. Remote mentoring, as an effective way, can help solve this problem, but traditional methods are limited to plain text, audio, or 2D video, which are not intuitive nor vivid. Augmented reality (AR), a thriving technique being widely used for various education scenarios, is promising to offer new possibilities of visual experience and interactive teaching. In this paper, we propose a novel AR-based robotic surgery remote mentoring system with efficient 3D scene visualization and natural 3D hand interaction. Using a head-mounted display (i.e., HoloLens), the mentor can remotely monitor the procedure streamed from the trainee's operation side. The mentor can also provide feedback directly with hand gestures, which is in-turn transmitted to the trainee and viewed in surgical console as guidance. We comprehensively validate the system on both real surgery stereo videos and ex-vivo scenarios of common robotic training tasks (i.e., peg-transfer and suturing). Promising results are demonstrated regarding the fidelity of streamed scene visualization, the accuracy of feedback with hand interaction, and the low-latency of each component in the entire remote mentoring system. This work showcases the feasibility of leveraging AR technology for reliable, flexible and low-cost solutions to robotic surgical education, and holds great potential for clinical applications.


title: Programmable Hamiltonian engineering with quadratic quantum Fourier transform

abstract: Quantum Fourier transform (QFT) is a widely used building block for quantum algorithms, whose scalable implementation is challenging in experiments. Here, we propose a protocol of quadratic quantum Fourier transform (QQFT), considering cold atoms confined in an optical lattice. This QQFT is equivalent to QFT in the single-particle subspace, and produces a different unitary operation in the entire Hilbert space. We show this QQFT protocol can be implemented using programmable laser potential with the digital-micromirror-device techniques recently developed in the experiments. The QQFT protocol enables programmable Hamiltonian engineering, and allows quantum simulations of Hamiltonian models, which are difficult to realize with conventional approaches. The flexibility of our approach is demonstrated by performing quantum simulations of one-dimensional Poincar\'{e} crystal physics and two-dimensional topological flat bands, where the QQFT protocol effectively generates the required long-range tunnelings despite the locality of the cold atom system. We find the discrete Poincar\'{e} symmetry and topological properties in the two examples respectively have robustness against a certain degree of noise that is potentially existent in the experimental realization. We expect this approach would open up wide opportunities for optical lattice based programmable quantum simulations.


title: Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape

abstract: 3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is attributed to insufficient ground-truth 3D shapes, unreliable training strategies and limited representation power of 3DMM. To alleviate this issue, this paper proposes a complete solution to capture the personalized shape so that the reconstructed shape looks identical to the corresponding person. Specifically, given a 2D image as the input, we virtually render the image in several calibrated views to normalize pose variations while preserving the original image geometry. A many-to-one hourglass network serves as the encode-decoder to fuse multiview features and generate vertex displacements as the fine-grained geometry. Besides, the neural network is trained by directly optimizing the visual effect, where two 3D shapes are compared by measuring the similarity between the multiview images rendered from the shapes. Finally, we propose to generate the ground-truth 3D shapes by registering RGB-D images followed by pose and shape augmentation, providing sufficient data for network training. Experiments on several challenging protocols demonstrate the superior reconstruction accuracy of our proposal on the face shape.


title: A dataset of ant colonies motion trajectories in indoor and outdoor scenes for social cluster behavior study

abstract: Motion and interaction of social insects (such as ants) have been studied by many researchers to understand the clustering mechanism. Most studies in the field of ant behavior have only focused on indoor environments, while outdoor environments are still underexplored. In this paper, we collect 10 videos of ant colonies from different indoor and outdoor scenes. And we develop an image sequence marking software named VisualMarkData, which enables us to provide annotations of ants in the video. In all 5354 frames, the location information and the identification number of each ant are recorded for a total of 712 ants and 114112 annotations. Moreover, we provide visual analysis tools to assess and validate the technical quality and reproducibility of our data. It is hoped that this dataset will contribute to a deeper exploration on the behavior of the ant colony.


title: Harmonic Centralization of Some Graph Families

abstract: Centrality describes the importance of nodes in a graph and is modeled by various measures. Its global analogue, called centralization, is a general formula for calculating a graph-level centrality score based on the node-level centrality measure. The latter enables us to compare graphs based on the extent to which the connections of a given network are concentrated on a single vertex or group of vertices. One of the measures of centrality in social network analysis is harmonic centrality. It sums the inverse of the geodesic distances of each node to other nodes where it is 0 if there is no path from one node to another, with the sum normalized by dividing it by $m-1$, where $m$ is the number of nodes of the graph. In this paper, we present some results regarding the harmonic centralization of some important families of graphs with the hope that formulas generated herein will be of use when one determines the harmonic centralization of more complex graphs.


title: Federated Unsupervised Domain Adaptation for Face Recognition

abstract: Given labeled data in a source domain, unsupervised domain adaptation has been widely adopted to generalize models for unlabeled data in a target domain, whose data distributions are different. However, existing works are inapplicable to face recognition under privacy constraints because they require sharing of sensitive face images between domains. To address this problem, we propose federated unsupervised domain adaptation for face recognition, FedFR. FedFR jointly optimizes clustering-based domain adaptation and federated learning to elevate performance on the target domain. Specifically, for unlabeled data in the target domain, we enhance a clustering algorithm with distance constrain to improve the quality of predicted pseudo labels. Besides, we propose a new domain constraint loss (DCL) to regularize source domain training in federated learning. Extensive experiments on a newly constructed benchmark demonstrate that FedFR outperforms the baseline and classic methods on the target domain by 3% to 14% on different evaluation metrics.


title: Learning-based Bounded Synthesis for Semi-MDPs with LTL Specifications

abstract: This letter proposes a learning-based bounded synthesis for a semi-Markov decision process (SMDP) with a linear temporal logic (LTL) specification. In the product of the SMDP and the deterministic $K$-co-B\"uchi automaton (d$K$cBA) converted from the LTL specification, we learn both the winning region of satisfying the LTL specification and the dynamics therein based on reinforcement learning and Bayesian inference. Then, we synthesize an optimal policy satisfying the following two conditions. (1) It maximizes the probability of reaching the wining region. (2) It minimizes a long-term risk for the dwell time within the winning region. The minimization of the long-term risk is done based on the estimated dynamics and a value iteration. We show that, if the discount factor is sufficiently close to one, the synthesized policy converges to the optimal policy as the number of the data obtained by the exploration goes to the infinity.


title: The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalization

abstract: Training with an emphasis on "hard-to-learn" components of the data has been proven as an effective method to improve the generalization of machine learning models, especially in the settings where robustness (e.g., generalization across distributions) is valued. Existing literature discussing this "hard-to-learn" concept are mainly expanded either along the dimension of the samples or the dimension of the features. In this paper, we aim to introduce a simple view merging these two dimensions, leading to a new, simple yet effective, heuristic to train machine learning models by emphasizing the worst-cases on both the sample and the feature dimensions. We name our method W2D following the concept of "Worst-case along Two Dimensions". We validate the idea and demonstrate its empirical strength over standard benchmarks.


title: Divergence-aware Federated Self-Supervised Learning

abstract: Self-supervised learning (SSL) is capable of learning remarkable representations from centrally available data. Recent works further implement federated learning with SSL to learn from rapidly growing decentralized unlabeled images (e.g., from cameras and phones), often resulted from privacy constraints. Extensive attention has been paid to SSL approaches based on Siamese networks. However, such an effort has not yet revealed deep insights into various fundamental building blocks for the federated self-supervised learning (FedSSL) architecture. We aim to fill in this gap via in-depth empirical study and propose a new method to tackle the non-independently and identically distributed (non-IID) data problem of decentralized data. Firstly, we introduce a generalized FedSSL framework that embraces existing SSL methods based on Siamese networks and presents flexibility catering to future methods. In this framework, a server coordinates multiple clients to conduct SSL training and periodically updates local models of clients with the aggregated global model. Using the framework, our study uncovers unique insights of FedSSL: 1) stop-gradient operation, previously reported to be essential, is not always necessary in FedSSL; 2) retaining local knowledge of clients in FedSSL is particularly beneficial for non-IID data. Inspired by the insights, we then propose a new approach for model update, Federated Divergence-aware Exponential Moving Average update (FedEMA). FedEMA updates local models of clients adaptively using EMA of the global model, where the decay rate is dynamically measured by model divergence. Extensive experiments demonstrate that FedEMA outperforms existing methods by 3-4% on linear evaluation. We hope that this work will provide useful insights for future research.


title: Efficient Derivative-free Bayesian Inference for Large-Scale Inverse Problems

abstract: We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible, since they typically require $O(10^4)$ model runs, or more. Moreover, the forward model is often given as a black box or is impractical to differentiate. Therefore derivative-free algorithms are highly desirable. We propose a framework, which is built on Kalman methodology, to efficiently perform Bayesian inference in such inverse problems. The basic method is based on an approximation of the filtering distribution of a novel mean-field dynamical system into which the inverse problem is embedded as an observation operator. Theoretical properties of the mean-field model are established for linear inverse problems, demonstrating that the desired Bayesian posterior is given by the steady state of the law of the filtering distribution of the mean-field dynamical system, and proving exponential convergence to it. This suggests that, for nonlinear problems which are close to Gaussian, sequentially computing this law provides the basis for efficient iterative methods to approximate the Bayesian posterior. Ensemble methods are applied to obtain interacting particle system approximations of the filtering distribution of the mean-field model; and practical strategies to further reduce the computational and memory cost of the methodology are presented, including low-rank approximation and a bi-fidelity approach. The effectiveness of the framework is demonstrated in several numerical experiments, including proof-of-concept linear/nonlinear examples and two large-scale applications: learning of permeability parameters in subsurface flow; and learning subgrid-scale parameters in a global climate model from time-averaged statistics.


title: Dual-Stage Approach Toward Hyperspectral Image Super-Resolution

abstract: Hyperspectral image produces high spectral resolution at the sacrifice of spatial resolution. Without reducing the spectral resolution, improving the resolution in the spatial domain is a very challenging problem. Motivated by the discovery that hyperspectral image exhibits high similarity between adjacent bands in a large spectral range, in this paper, we explore a new structure for hyperspectral image super-resolution (DualSR), leading to a dual-stage design, i.e., coarse stage and fine stage. In coarse stage, five bands with high similarity in a certain spectral range are divided into three groups, and the current band is guided to study the potential knowledge. Under the action of alternative spectral fusion mechanism, the coarse SR image is super-resolved in band-by-band. In order to build model from a global perspective, an enhanced back-projection method via spectral angle constraint is developed in fine stage to learn the content of spatial-spectral consistency, dramatically improving the performance gain. Extensive experiments demonstrate the effectiveness of the proposed coarse stage and fine stage. Besides, our network produces state-of-the-art results against existing works in terms of spatial reconstruction and spectral fidelity.


title: Monochromatic vertex-disconnection of graphs

abstract: Let G be a vertex-colored graph. A vertex cut S of G is called a monochromatic vertex cut if the vertices of S are colored with the same color. A graph G is monochromatically vertex-disconnected if any two nonadjacent vertices of G has a monochromatic vertex cut separating them. The monochromatic vertex-disconnection number of G, denoted by mvd(G), is the maximum number of colors that are used to make G monochromatically vertex-disconnected. In this paper, the connection between the graph parameters are studied: mvd(G), connectivity and block decomposition. We determine the value of mvd(G) for some well known graphs, and then characterize G when n-5\leq mvd(G)\leq n and all blocks of G are minimally 2-connected triangle-free graphs. We obtain the maximum size of a graph G with mvd(G)=k for any k. Furthermore, we study the Erd\H{o}s-Gallai-type results for mvd(G), and completely solve them. Finally, we propose an algorithm to compute mvd(G) and give an mvd-coloring of G.


title: Compatible group topologies on a locally quasi-convex abelian group and the Mackey group problem

abstract: For a locally quasi-convex (lqc) abelian group $G$, we give the first description of all compatible group topologies on $G$ and apply this result to the Mackey group problem for lqc groups. We characterize lqc abelian groups which are Mackey groups or admit a Mackey group topology and provide a characterization of two Mackey groups whose product is Mackey. We obtain the first characterization of locally convex spaces which are Mackey groups.


title: Deep neural network goes lighter: A case study of deep compression techniques on automatic RF modulation recognition for Beyond 5G networks

abstract: Automatic RF modulation recognition is a primary signal intelligence (SIGINT) technique that serves as a physical layer authentication enabler and automated signal processing scheme for the beyond 5G and military networks. Most existing works rely on adopting deep neural network architectures to enable RF modulation recognition. The application of deep compression for the wireless domain, especially automatic RF modulation classification, is still in its infancy. Lightweight neural networks are key to sustain edge computation capability on resource-constrained platforms. In this letter, we provide an in-depth view of the state-of-the-art deep compression and acceleration techniques with an emphasis on edge deployment for beyond 5G networks. Finally, we present an extensive analysis of the representative acceleration approaches as a case study on automatic radar modulation classification and evaluate them in terms of the computational metrics.


title: MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective

abstract: NER model has achieved promising performance on standard NER benchmarks. However, recent studies show that previous approaches may over-rely on entity mention information, resulting in poor performance on out-of-vocabulary (OOV) entity recognition. In this work, we propose MINER, a novel NER learning framework, to remedy this issue from an information-theoretic perspective. The proposed approach contains two mutual information-based training objectives: i) generalizing information maximization, which enhances representation via deep understanding of context and entity surface forms; ii) superfluous information minimization, which discourages representation from rote memorizing entity names or exploiting biased cues in data. Experiments on various settings and datasets demonstrate that it achieves better performance in predicting OOV entities.


title: Contrastive Demonstration Tuning for Pre-trained Language Models

abstract: Pretrained language models can be effectively stimulated by textual prompts or demonstrations, especially in low-data scenarios. Recent works have focused on automatically searching discrete or continuous prompts or optimized verbalizers, yet studies for the demonstration are still limited. Concretely, the demonstration examples are crucial for an excellent final performance of prompt-tuning. In this paper, we propose a novel pluggable, extensible, and efficient approach named contrastive demonstration tuning, which is free of demonstration sampling. Furthermore, the proposed approach can be: (i) Plugged into any previous prompt-tuning approaches; (ii) Extended to widespread classification tasks with a large number of categories. Experimental results on 16 datasets illustrate that our method integrated with previous approaches LM-BFF and P-tuning can yield better performance. Code is available in https://github.com/zjunlp/PromptKG/tree/main/research/Demo-Tuning.


title: Star-Convex Constrained Optimization for Visibility Planning with Application to Aerial Inspection

abstract: The visible capability is critical in many robot applications, such as inspection and surveillance, etc. Without the assurance of the visibility to targets, some tasks end up not being complete or even failing. In this paper, we propose a visibility guaranteed planner by star-convex constrained optimization. The visible space is modeled as star convex polytope (SCP) by nature and is generated by finding the visible points directly on point cloud. By exploiting the properties of the SCP, the visibility constraint is formulated for trajectory optimization. The trajectory is confined in the safe and visible flight corridor which consists of convex polytopes and SCPs. We further make a relaxation to the visibility constraints and transform the constrained trajectory optimization problem into an unconstrained one that can be reliably and efficiently solved. To validate the capability of the proposed planner, we present the practical application in site inspection. The experimental results show that the method is efficient, scalable, and visibility guaranteed, presenting the prospect of application to various other applications in the future.


title: Generalised Mathematical Formulations for Non-Linear Optimized Scheduling

abstract: In practice, most of the optimization problems are non-linear requiring certain interactive solutions and approaches to model. In 5G Advanced and Beyond network slicing, mathematically modeling the users, type of service distributions and its adaptive SLAs are complex due to several dependencies. To facilitate the above, in this paper, we present novel Non-linear mathematical formulations and results that will form the base to achieve Optimized Scheduling.


title: A Machine Learning-Based Method for Identifying Critical Distance Relays for Transient Stability Studies

abstract: Modeling protective relays is crucial for performing accurate stability studies as they play a critical role in defining the dynamic responses of power systems during disturbances. Nevertheless, due to the current limitations of stability software and the challenges of keeping track of the changes in the settings information of thousands of protective relays, modeling all the protective relays in bulk power systems is a challenging task. Distance relays are among the critical protection schemes, which are not properly modeled in current practices of stability studies. This paper proposes a machine learning-based method that uses the results of early-terminated stability studies to identify the critical distance relays required to be modeled in those studies. The algorithm used is the random forest (RF) classifier. GE positive sequence load flow analysis (PSLF) software is used to perform stability studies. The model is trained and tested on the Western Electricity Coordinating Council (WECC) system data representing the 2018 summer peak load under different operating conditions and topologies of the system. The results show the great performance of the method in identifying the critical distance relays. The results also show that only modeling the identified critical distance relays suffices to perform accurate stability studies.


title: Local Knowledge and Natural Resource Management in a Peasant Farming Community Facing Rapid Change: A Critical Examination

abstract: Environmental degradation is a major global problem. Its impacts are not just environmental, but also economic, with degradation recognised as a key cause of reduced agricultural productivity and rural poverty in the developing world. The degradation literature typically emphasises common property or open access natural resources, and how perverse incentives or missing institutions lead optimising private actors to degrade them. By contrast, the present paper considers degradation occurring on private farms in peasant communities. This is a critical yet delicate issue, given the poverty of such areas and questions about the role of farmers in either degrading or regenerating rural lands. The paper examines natural resource management by peasant farmers in Tanzania. Its key concern is how the local knowledge informing their management decisions adapts to challenges associated with environmental degradation and market liberalisation. Given their poverty, this question could have direct implications for the capacity of households to meet their livelihood needs. Based on fresh empirical data, the paper finds that differential farmer knowledge helps explain the large differences in how households respond to the degradation challenge. The implication is that some farmers adapt more effectively to emerging challenges than others, despite all being rational, optimising agents who follow the strategies they deem best. The paper thus provides a critique of local knowledge, implying that some farmers experience adaptation slippages while others race ahead with effective adaptations. The paper speaks to the chronic poverty that plagues many rural communities in the developing world. It helps explain the failure of proven sustainable agriculture technologies to disseminate readily beyond early innovators. Its key policy implication is to inform improved capacity building for such communities.


title: Denoising Neural Network for News Recommendation with Positive and Negative Implicit Feedback

abstract: News recommendation is different from movie or e-commercial recommendation as people usually do not grade the news. Therefore, user feedback for news is always implicit (click behavior, reading time, etc). Inevitably, there are noises in implicit feedback. On one hand, the user may exit immediately after clicking the news as he dislikes the news content, leaving the noise in his positive implicit feedback; on the other hand, the user may be recommended multiple interesting news at the same time and only click one of them, producing the noise in his negative implicit feedback. Opposite implicit feedback could construct more integrated user preferences and help each other to minimize the noise influence. Previous works on news recommendation only used positive implicit feedback and suffered from the noise impact. In this paper, we propose a denoising neural network for news recommendation with positive and negative implicit feedback, named DRPN. DRPN utilizes both feedback for recommendation with a module to denoise both positive and negative implicit feedback to further enhance the performance. Experiments on the real-world large-scale dataset demonstrate the state-of-the-art performance of DRPN.


title: Stable categories of spherical modules and torsionfree modules

abstract: Auslander and Bridger introduced the notions of n-spherical modules and n-torsionfree modules. In this paper, we construct an equivalence between the stable category of n-spherical modules and the category of modules of grade at least n, and provide its Gorenstein analogue. As an application, we prove that if R is a Gorenstein local ring of Krull dimension d>0, then there exists a stable equivalence between the category of (d-1)-torsionfree R-modules and the category of d-spherical modules relative to the local cohomology functor.


title: Crime Patterns in Los Angeles County Before and After Covid19 (2018-2021)

abstract: The objective of our research is to present the change in crime rates in Los Angeles post-Covid19. Using data analysis with Geo-Mapping, bubbles, Marimekko, and a time series charts, we can illustrate which areas have the largest crime rate, and how it has changed. Through regression modeling, we can interpret which locations may also have a correlation to crime versus income, race, type of crime, and gender. The story will help to uncover whether the areas associated with crime are due to demographic or income variance. In showing the details of crimes in Los Angeles along with the factors at play we hope to see a compelling relationship between crime rates and recent events from 2020 to the present, along with changes in crime type trends during these periods. We use Excel to clean the data for SAP SAC to model effectively, as well as resources from other studies a comparison.


title: Deformations of log terminal and semi log canonical singularities

abstract: In this paper, we prove that klt singularities are invariant under deformations if the generic fiber is $\mathbb{Q}$-Gorenstein. We also obtain a similar result for slc singularities. These are generalizations of results of Esnault-Viehweg and S. Ishii.


title: Quantum convolution inequalities on Frobenius von Neumann algebras

abstract: In this paper, we introduce Frobenius von Neumann algebras and study quantum convolution inequalities. In this framework, we unify quantum Young's inequality on quantum symmetries such as subfactors, and fusion bi-algebras studied in quantum Fourier analysis. Moreover, we prove quantum entropic convolution inequalities and characterize the extremizers in the subfactor case. We also prove quantum smooth entropic convolution inequalities. We obtain the positivity of comultiplications of subfactor planar algebras, which is stronger than the quantum Schur product theorem. All these inequalities provide analytic obstructions of unitary categorification of fusion rings stronger than Schur product criterion.


title: Unusual Magnetotransport from two dimensional Dirac Fermions in Pd$_{3}$Bi$_{2}$Se$_{2}$

abstract: Pd$_{3}$Bi$_{2}$Se$_{2}$ has been proposed to be topologically non-trivial in nature. However, evidence of its non-trivial behavior is still unexplored. We report the growth and magneto-transport study of Pd$_{3}$Bi$_{2}$Se$_{2}$ thin films, revealing for the first time the contribution of two-dimensional (2D) topological surface states. We observe exceptional non-saturated linear magnetoresistance which results from Dirac fermions inhabiting the lowest Landau level in the quantum limit. The transverse magnetoresistance changes from a semi-classical weak-field $B^{2}$ dependence to a high-field $B$ dependence at a critical field $B^{\star}$. It is found that $B^{\star} \propto T^2$, which is expected from the Landau level splitting of a linear energy dispersion. In addition, the magnetoconductivity shows signatures of 2D weak anti-localization (WAL). These novel magnetotransport signatures evince the presence of 2D Dirac fermions in Pd$_{3}$Bi$_{2}$Se$_{2}$ thin films.


title: Improve Generalization of Driving Policy at Signalized Intersections with Adversarial Learning

abstract: Intersections are quite challenging among various driving scenes wherein the interaction of signal lights and distinct traffic actors poses great difficulty to learn a wise and robust driving policy. Current research rarely considers the diversity of intersections and stochastic behaviors of traffic participants. For practical applications, the randomness usually leads to some devastating events, which should be the focus of autonomous driving. This paper introduces an adversarial learning paradigm to boost the intelligence and robustness of driving policy for signalized intersections with dense traffic flow. Firstly, we design a static path planner which is capable of generating trackable candidate paths for multiple intersections with diversified topology. Next, a constrained optimal control problem (COCP) is built based on these candidate paths wherein the bounded uncertainty of dynamic models is considered to capture the randomness of driving environment. We propose adversarial policy gradient (APG) to solve the COCP wherein the adversarial policy is introduced to provide disturbances by seeking the most severe uncertainty while the driving policy learns to handle this situation by competition. Finally, a comprehensive system is established to conduct training and testing wherein the perception module is introduced and the human experience is incorporated to solve the yellow light dilemma. Experiments indicate that the trained policy can handle the signal lights flexibly meanwhile realizing the smooth and efficient passing with a humanoid paradigm. Besides, APG enables a large-margin improvement of the resistance to the abnormal behaviors and thus ensures a high safety level for the autonomous vehicle.


title: Directly Detecting the Envelopes of Low-mass Planets Embedded In Protoplanetary Discs and The Case For TW Hydrae

abstract: Despite many methods developed to find young massive planets in protoplanetary discs, it is challenging to directly detect low-mass planets that are embedded in discs. On the other hand, the core-accretion theory suggests that there could be a large population of embedded low-mass young planets at the Kelvin-Helmholtz (KH) contraction phase. We adopt both 1-D models and 3-D simulations to calculate the envelopes around low-mass cores (several to tens of $M_{\oplus}$) with different luminosities, and derive their thermal fluxes at radio wavelengths. We find that, when the background disc is optically thin at radio wavelengths, radio observations can see through the disc and probe the denser envelope within the planet's Hill sphere. When the optically thin disc is observed with the resolution reaching one disc scale height, the radio thermal flux from the planetary envelope around a 10 M$_{\oplus}$ core is more than 10 % higher than the flux from the background disc. The emitting region can be extended and elongated. Finally, our model suggests that the au-scale clump at 52 au in the TW Hydrae disc revealed by ALMA is consistent with the envelope of an embedded 10-20 $M_{\oplus}$ planet, which can explain the detected flux, the spectral index dip, and the tentative spirals. The observation is also consistent with the planet undergoing pebble accretion. Future ALMA and ngVLA observations may directly reveal more such low-mass planets, enabling us to study core growth and even reconstruct the planet formation history using the embedded "protoplanet" population.


title: Finding the ET Signal from the Cosmic Noise

abstract: This paper highlights a methodological approach designed to enhance the search for extraterrestrial intelligence (SETI) by hypothesizing that a transmission technosignature would likely have two features: 1) be wideband in the microwave or higher frequency range that originates from a hub within a supposed ET interplanetary navigation/communication (nav/comm) network, and 2) contain x-ray pulsar-based navigation (XNAV) metadata. Potential contributions to the field include improved accuracy in finding transmission technosignatures and other technosignatures in the electromagnetic spectrum, a common standard in reaching a Schelling Point (a mutual realization of how we and ETs can find each other), and operationalizing models such as the Drake Equation.


title: Dispersionless version of the constrained Toda hierarchy and symmetric radial L\"owner equation

abstract: We study the dispersionless version of the recently introduced constrained Toda hierarchy. Like the Toda lattice itself, it admits three equivalent formulations: the formulation in terms of Lax equations, the formulation of the Zakharov-Shabat type and the formulation through the generating equation for the dispersionless limit of logarithm of the tau-function. We show that the dispersionless constrained Toda hierarchy describes conformal maps of reflection-symmetric planar domains to the exterior of the unit disc. We also find finite-dimensional reductions of the hierarchy and show that they are characterized by a differential equation of the L\"owner type which we call the symmetric radial L\"owner equation. It is also shown that solutions to the symmetric radial L\"owner equation are conformal maps of the exterior of the unit circle with two symmetric slits to the exterior of the unit circle.


title: Characters, Commutators and Centers of Sylow Subgroups

abstract: The character table of a finite group G determines whether |P:P'|=p^2 and whether |P:Z(P)|=p^2, where P is a Sylow p-subgroup of G. To prove the latter, we give a detailed classification of those groups in terms of the generalized Fitting subgroup.


title: A Probabilistic Model-Based Robust Waveform Design for MIMO Radar Detection

abstract: This paper addresses robust waveform design for multiple-input-multiple-output (MIMO) radar detection. A probabilistic model is proposed to describe the target uncertainty. Considering that waveform design based on maximizing the probability of detection is intractable, the relative entropy between the distributions of the observations under two hypotheses (viz., the target is present/absent) is employed as the design metric. To tackle the resulting non-convex optimization problem, an efficient algorithm based on minorization-maximization (MM) is derived. Numerical results demonstrate that the waveform synthesized by the proposed algorithm is more robust to model mismatches.


title: Convergence in conformal field theory

abstract: Convergence and analytic extension are of fundamental importance in the mathematical construction and study of conformal field theory. We review some main convergence results, conjectures and problems in the construction and study of conformal field theories using the representation theory of vertex operator algebras. We also review the related analytic extension results, conjectures and problems. We discuss the convergence and analytic extensions of products of intertwining operators (chiral conformal fields) and of $q$-traces and pseudo-$q$-traces of products of intertwining operators. We also discuss the convergence results related to the sewing operation and the determinant line bundle and a higher-genus convergence result. We then explain conjectures and problems on the convergence and analytic extensions in orbifold conformal field theory and in the cohomology theory of vertex operator algebras.


title: Thermal and magnetic field structure of near equatorial coronal holes

abstract: We use full-disk, SOHO/EIT 195 $\AA$ calibrated images to measure latitudinal and day to day variations of area and average photon fluxes of the near equatorial coronal holes. In addition, energy emitted by the coronal holes with their temperature and strength of magnetic field structures are estimated. By analyzing data of 2001-2008, we find that variations of average area (A), photon flux (F), radiative energy (E) and temperature (T) of coronal holes are independent of latitude. Whereas inferred strength of magnetic field structure of the coronal holes is dependent on the latitudes and varies from low near the equator to high near both the poles. Typical average values of estimated physical parameters are: $A \sim 3.8(\pm0.5)\times10^{20}~cm^{2}, F \sim 2.3(\pm0.2)\times10^{13}~photons\;cm^{-2}\;sec^{-1}, E \sim 2.32(\pm0.5)\times 10^{3}~ergscm^{-2}sec^{-1} \ and \ T \sim 0.94(\pm0.1)\times10^{6} ~$ K. Average strength of magnetic field structure of coronal hole at the corona is estimated to be $\sim$ $0.08 \pm 0.02$ Gauss. If coronal holes are anchored in the convection zone, one would expect they should rotate differentially. Hence, thermal wind balance and isorotation of coronal holes with the solar plasma implies the temperature difference between the equator and both the poles. Contrary to this fact, variation of thermal structure of near equatorial coronal holes is independent of latitude leading to a conclusion that coronal holes must rotate rigidly that are likely to be anchored initially below the tachocline confirming our previous study (ApJ, 763, 137, 2013).


title: Crossover in dynamics in the Kob-Andersen binary mixture glass-forming liquid

abstract: Glass-forming liquids are broadly classified as being fragile or strong, depending on the deviation from Arrhenius behavior of their relaxation times. A fragile to strong crossover is observed or inferred in liquids like water and silica, and more recently also in metallic glasses and phase change alloys, leading to the expectation that such a crossover is more widely realised among glass formers. We investigate computationally the well-studied Kob-Andersen model, accessing temperatures well below the mode coupling temperature $T_{MCT}$. We find that relaxation times exhibit a crossover in dynamics around $T_{MCT}$, and discuss whether it bears characteristics of the fragile to strong crossover. Several aspects of dynamical heterogeneity exhibit behavior mirroring the dynamical crossover, whereas thermodynamic quantities do not. In particular, the Adam-Gibbs relation describing the relation between relaxation times and configurational entropy continues to hold below the dynamical crossover, when anharmonic corrections to the vibrational entropy are included.


title: Leaderless Swarm Formation Control: From Global Specifications to Local Control Laws

abstract: This paper introduces a distributed leaderless swarm formation control framework to address the problem of collectively driving a swarm of robots to track a time-varying formation. The swarm's formation is captured by the trajectory of an abstract shape that circumscribes the convex hull of robots' positions and is independent of the number of robots and their ordering in the swarm. For each robot in the swarm, given global specifications in terms of the trajectory of the abstract shape parameters, the proposed framework synthesizes a control law that steers the swarm to track the desired formation using the information available at the robot's local neighbors. For this purpose, we generate a suitable local reference trajectory that the robot controller tracks by solving the input-output linearization problem. Here, we select the swarm output to be the parameters of the abstract shape. For this purpose, we design a dynamic average consensus estimator to estimate the abstract shape parameters. The abstract shape parameters are used as the swarm state feedback to generate a suitable robot trajectory. We demonstrate the effectiveness and robustness of the proposed control framework by providing the simulation of coordinated collective navigation of a group of car-like robots in the presence of robots and communication link failures.


title: PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization

abstract: Few-shot abstractive summarization has become a challenging task in natural language generation. To support it, we designed a novel soft prompts architecture coupled with a prompt pre-training plus fine-tuning paradigm that is effective and tunes only extremely light parameters. The soft prompts include continuous input embeddings across an encoder and a decoder to fit the structure of the generation models. Importantly, a novel inner-prompt placed in the text is introduced to capture document-level information. The aim is to devote attention to understanding the document that better prompts the model to generate document-related content. The first step in the summarization procedure is to conduct prompt pre-training with self-supervised pseudo-data. This teaches the model basic summarizing capabilities. The model is then fine-tuned with few-shot examples. Experimental results on the CNN/DailyMail and XSum datasets show that our method, with only 0.1% of the parameters, outperforms full-model tuning where all model parameters are tuned. It also surpasses Prompt Tuning by a large margin and delivers competitive results against Prefix-Tuning with 3% of the parameters.


title: Lions' representation theorem and applications

abstract: The Representation Theorem of Lions (RTL) is a version of the Lax--Milgram Theorem where completeness of one of the spaces is not complete. In this paper, RTL is deduced from an operator-theoretical version on normed space. The main point of the paper is a theory of derivations, based on RTL, for which well-posedness is proved. One application concerns non-autonomous evolution equations with a new initial-value and a periodic boundary condition for the time variable.


title: Robust Dynamic Average Consensus for a Network of Agents with Time-varying Reference Signals

abstract: This paper presents continuous dynamic average consensus (DAC) algorithms for a group of agents to estimate the average of their time-varying reference signals cooperatively. We propose consensus algorithms that are robust to agents joining and leaving the network, at the same time, avoid the chattering phenomena and guarantee zero steady-state consensus error. Our algorithms are edge-based protocols with smooth functions in their internal structure to avoid the chattering effect. Furthermore, each agent is only capable of performing local computations and can only communicate with its local neighbors. For a balanced and strongly connected underlying communication graph, we provide the convergence analysis to determine the consensus design parameters that guarantee the agents' estimate of their average to asymptotically converge to the average of the time-varying reference signals of the agents. We provide simulation results to validate the proposed consensus algorithms and to perform a performance comparison of the proposed algorithms to existing algorithms in the literature.


title: E^2TAD: An Energy-Efficient Tracking-based Action Detector

abstract: Video action detection (spatio-temporal action localization) is usually the starting point for human-centric intelligent analysis of videos nowadays. It has high practical impacts for many applications across robotics, security, healthcare, etc. The two-stage paradigm of Faster R-CNN inspires a standard paradigm of video action detection in object detection, i.e., firstly generating person proposals and then classifying their actions. However, none of the existing solutions could provide fine-grained action detection to the "who-when-where-what" level. This paper presents a tracking-based solution to accurately and efficiently localize predefined key actions spatially (by predicting the associated target IDs and locations) and temporally (by predicting the time in exact frame indices). This solution won first place in the UAV-Video Track of 2021 Low-Power Computer Vision Challenge (LPCVC).


title: Gamma-Ray Bursts

abstract: Gamma-ray bursts (GRB) are short and intense bursts of $\sim$100 keV$-$1MeV photons, usually followed by long-lasting decaying afterglow emission in a wide range of electromagnetic wavelengths from radio to X-ray and, sometimes, even to GeV gamma-rays. These emissions are believed to originate from a relativistic jet, which is driven due to the collapse of special massive stars and the mergers of compact binaries (i.e., double neutron stars or a neutron star and a black hole). This chapter first briefly introduces the basic observational facts of the GRB phenomena, including the prompt emission, afterglow emission, and host galaxies. Secondly, a general theoretical understanding of the GRB phenomena is described based on a relativistic jet's overall dynamical evolution, including the acceleration, propagation, internal dissipation, and deceleration phases. Here a long-lasting central engine of the GRBs can substantially influence the dynamical evolution of the jet. In addition, a supernova/kilonova emission can appear in the optical afterglow of some nearby GRBs, which can provide an important probe to the nature of the GRB progenitors. Finally, as luminous cosmological phenomena, it is expected to use GRBs to probe the early universe and to constrain the cosmological parameters.


title: Energies of Two-State Systems

abstract: Energies of quantum states are given by the arguments of phase-evolution exponentials. It follows then that an analysis of the energies of a two-state system (TSS) can revolve around phase-emphasized description of states' probability amplitudes in the Schrodinger picture. Here, studying energies of TSSs semi-classically, we suggest an energy-revealing format in which the time-dependence of the probability amplitudes is expressed by phase-evolution factors only. With this fresh energy-studying approach, we first revisit non-driven TSSs, write the conditions for setting a system (in general) in a stationary state, and identify the associated (single) definite energy. Then, more importantly, we revisit driven-TSSs, identify the two stationary states and prove the existence of two quasi-energies associated with each stationary state. Resulting from our phase-keeping framework, we display a "breathing-spiral" type precession-mode of a strongly-driven spin one-half TSS. Further, we exemplify our findings through a set of two coupling-probe computer simulations. For specific examples, we compute and list the energies of several concrete TSSs under typical operating conditions.


title: Mapping Temporary Slums from Satellite Imagery using a Semi-Supervised Approach

abstract: One billion people worldwide are estimated to be living in slums, and documenting and analyzing these regions is a challenging task. As compared to regular slums; the small, scattered and temporary nature of temporary slums makes data collection and labeling tedious and time-consuming. To tackle this challenging problem of temporary slums detection, we present a semi-supervised deep learning segmentation-based approach; with the strategy to detect initial seed images in the zero-labeled data settings. A small set of seed samples (32 in our case) are automatically discovered by analyzing the temporal changes, which are manually labeled to train a segmentation and representation learning module. The segmentation module gathers high dimensional image representations, and the representation learning module transforms image representations into embedding vectors. After that, a scoring module uses the embedding vectors to sample images from a large pool of unlabeled images and generates pseudo-labels for the sampled images. These sampled images with their pseudo-labels are added to the training set to update the segmentation and representation learning modules iteratively. To analyze the effectiveness of our technique, we construct a large geographically marked dataset of temporary slums. This dataset constitutes more than 200 potential temporary slum locations (2.28 square kilometers) found by sieving sixty-eight thousand images from 12 metropolitan cities of Pakistan covering 8000 square kilometers. Furthermore, our proposed method outperforms several competitive semi-supervised semantic segmentation baselines on a similar setting. The code and the dataset will be made publicly available.


title: Investigating Deep Learning Benchmarks for Electrocardiography Signal Processing

abstract: In recent years, deep learning has witnessed its blossom in the field of Electrocardiography (ECG) processing, outperforming traditional signal processing methods in various tasks, for example, classification, QRS detection, wave delineation. Although many neural architectures have been proposed in the literature, there is a lack of systematic studies and open-source libraries for ECG deep learning. In this paper, we propose a deep learning framework, named \texttt{torch\_ecg}, which gathers a large number of neural networks, both from literature and novel, for various ECG processing tasks. It establishes a convenient and modular way for automatic building and flexible scaling of the networks, as well as a neat and uniform way of organizing the preprocessing procedures and augmentation techniques for preparing the input data for the models. Besides, \texttt{torch\_ecg} provides benchmark studies using the latest databases, illustrating the principles and pipelines for solving ECG processing tasks and reproducing results from the literature. \texttt{torch\_ecg} offers the ECG research community a powerful tool meeting the growing demand for the application of deep learning techniques.


title: Unbiased Directed Object Attention Graph for Object Navigation

abstract: Object navigation tasks require agents to locate specific objects in unknown environments based on visual information. Previously, graph convolutions were used to implicitly explore the relationships between objects. However, due to differences in visibility among objects, it is easy to generate biases in object attention. Thus, in this paper, we propose a directed object attention (DOA) graph to guide the agent in explicitly learning the attention relationships between objects, thereby reducing the object attention bias. In particular, we use the DOA graph to perform unbiased adaptive object attention (UAOA) on the object features and unbiased adaptive image attention (UAIA) on the raw images, respectively. To distinguish features in different branches, a concise adaptive branch energy distribution (ABED) method is proposed. We assess our methods on the AI2-Thor dataset. Compared with the state-of-the-art (SOTA) method, our method reports 7.4%, 8.1% and 17.6% increase in success rate (SR), success weighted by path length (SPL) and success weighted by action efficiency (SAE), respectively.


title: Reduction ratio of the IS-algorithm: worst and random cases

abstract: We study the IS-algorithm, a well-known linear-time algorithm for computing the suffix array of a word. This algorithm relies on transforming the input word $w$ into another word, called the reduced word of $w$, that will be at least twice shorter; then, the algorithm recursively computes the suffix array of the reduced word. In this article, we study the reduction ratio of the IS-algorithm, i.e., the ratio between the lengths of the input word and the word obtained after reducing $k$ times the input word. We investigate both worst cases, in which we find precise results, and random cases, where we prove some strong convergence phenomena. Finally, we prove that, if the input word is a randomly chosen word of length $n$, we should not expect much more than $\log(\log(n))$ recursive function calls.


title: Revisiting the Effect of Branch Handling Strategies on Change Recommendation

abstract: Although literature has noted the effects of branch handling strategies on change recommendation based on evolutionary coupling, they have been tested in a limited experimental setting. Additionally, the branches characteristics that lead to these effects have not been investigated. In this study, we revisited the investigation conducted by Kovalenko et al. on the effect to change recommendation using two different branch handling strategies: including changesets from commits on a branch and excluding them. In addition to the setting by Kovalenko et al., we introduced another setting to compare: extracting a changeset for a branch from a merge commit at once. We compared the change recommendation results and the similarity of the extracted co-changes to those in the future obtained using two strategies through 30 open-source software systems. The results show that handling commits on a branch separately is often more appropriate in change recommendation, although the comparison in an additional setting resulted in a balanced performance among the branch handling strategies. Additionally, we found that the merge commit size and the branch length positively influence the change recommendation results.


title: Adaptive Differential Filters for Fast and Communication-Efficient Federated Learning

abstract: Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with differential updates is a commonly used technique. However, sparse model updates can slow down convergence speed or unintentionally skip certain update aspects, e.g., learned features, if error accumulation is not properly addressed. In this work, we propose a new scaling method operating at the granularity of convolutional filters which 1) compensates for highly sparse updates in FL processes, 2) adapts the local models to new data domains by enhancing some features in the filter space while diminishing others and 3) motivates extra sparsity in updates and thus achieves higher compression ratios, i.e., savings in the overall data transfer. Compared to unscaled updates and previous work, experimental results on different computer vision tasks (Pascal VOC, CIFAR10, Chest X-Ray) and neural networks (ResNets, MobileNets, VGGs) in uni-, bidirectional and partial update FL settings show that the proposed method improves the performance of the central server model while converging faster and reducing the total amount of transmitted data by up to 377 times.


title: Congruence Relations Connecting Tate-Shafarevich Groups with Bernoulli-Hurwitz Numbers by Elliptic Gauss Sums in Eisenstein Case

abstract: There are classical congruences between the class number of an imaginary quadratic field and a Bernoulli number or an Euler number. Under the BSD conjecture, Onishi obtained an elliptic generalization of these congruences, which gives congruences between the order of the Tate-Shafarevich group of certain elliptic curves with CM by the Gauss integers ring and Mordell-Weil rank 0, and a coefficient of power series expansion of an elliptic function associated to Gauss integers ring. In this paper, we provide Onishi's type congruences for the Eisenstein integers case.


title: Effects of zigzag edge states on the thermoelectric properties of finite graphene nanoribbons

abstract: Thermoelectric properties of finite graphene nanoribbons (GNRs) coupled to metallic electrodes are theoretically studied in the framework of tight-binding model and Green's function approach. When the zigzag sides are coupled to the electrodes, the electron transport through the localized edge states can occur only if the channel length between electrodes is smaller than the decay length of these localized zigzag edge states. When the armchair edges are coupled to the electrodes, there is an interesting thermoelectric behavior associated with the mid-gap states when the GNR is in the semiconducting phase. Here we show that the thermoelectric behavior of zigzag edge states of GNRs with armchair sides connected to electrodes is similar to that of two parallel quantum dots with similar orbital degeneracy. Furthermore, it is demonstrated that the electrical conductance and power factor given by the zigzag edge states are quite robust against the defect scattering.


title: Probing the electroweak symmetry breaking history with Gravitational waves

abstract: We perform a three dimensional lattice simulation of the electroweak symmetry breaking process through a two-step phase transition, where one of the two steps is a first order phase transition. Our results show that: 1) when the electroweak symmetry breaking is driven by the beyond Standard Model sector around $\sim \mathcal{O}(10^{2-3})$ GeV, the gravitational wave spectra produced from the phase transitions are of broken power-law double-peak shapes; 2) when the electroweak symmetry breaking is induced by a first-order phase transition of a high-scale global U(1) theory, cosmic strings can form and then disappear through particle radiation, and the yielded gravitational wave spectra are of plateau shapes. The two scenarios can be distinguished through probing gravitational wave spectra. Our study suggests that the stochastic gravitational waves provide an alternative way to probe the beyond Standard Model sector relevant to the electroweak symmetry breaking pattern in the early Universe.


title: ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generation

abstract: Existing text-guided image manipulation methods aim to modify the appearance of the image or to edit a few objects in a virtual or simple scenario, which is far from practical application. In this work, we study a novel task on text-guided image manipulation on the entity level in the real world. The task imposes three basic requirements, (1) to edit the entity consistent with the text descriptions, (2) to preserve the text-irrelevant regions, and (3) to merge the manipulated entity into the image naturally. To this end, we propose a new transformer-based framework based on the two-stage image synthesis method, namely \textbf{ManiTrans}, which can not only edit the appearance of entities but also generate new entities corresponding to the text guidance. Our framework incorporates a semantic alignment module to locate the image regions to be manipulated, and a semantic loss to help align the relationship between the vision and language. We conduct extensive experiments on the real datasets, CUB, Oxford, and COCO datasets to verify that our method can distinguish the relevant and irrelevant regions and achieve more precise and flexible manipulation compared with baseline methods. The project homepage is \url{https://jawang19.github.io/manitrans}.


title: What is measured when measuring a thermoelectric coefficient?

abstract: A thermal gradient generates an electric field in any solid hosting mobile electrons. In presence of a finite magnetic field (or Berry curvature) this electric field has a transverse component. These are known as Seebeck and Nernst coefficients. As Callen argued, back in 1948, the Seebeck effect quantifies the entropy carried by a flow of charged particles in absence of thermal gradient. Similarly, the Nernst conductivity, $\alpha_{xy}$, quantifies the entropy carried by a flow of magnetic flux in absence of thermal gradient. The present paper summarizes a picture in which the rough amplitude of the thermoelectric response is given by fundamental units and material-dependent length scales. Therefore, knowledge of material-dependent length scales allows predicting the amplitude of the signal measured by experiments. Specifically, the Nernst conductivity scales with the square of the mean-free-path in metals. Its anomalous component in magnets scales with the square of the fictitious magnetic length. Ephemeral Cooper pairs in the normal state of a superconductor generate a signal, which scales with the square of the superconducting coherence length and smoothly evolves to the signal produced by mobile vortices below the critical temperature.


title: CMOS Circuit Implementation of Spiking Neural Network for Pattern Recognition Using On-chip Unsupervised STDP Learning

abstract: Computation on a large volume of data at high speed and low power requires energy-efficient computing architectures. Spiking neural network (SNN) with bio-inspired spike-timing-dependent plasticity learning (STDP) is a promising solution for energy-efficient neuromorphic systems than conventional artificial neural network (ANN). Previous works on SNN with STDP learning primarily uses memristive devices which are difficult to fabricate. Some reported works on SNN makes use of memristor macro models, which are software-based and cannot give complete insight into circuit implementation challenges. This article presents for the first time, a full circuit-level implementation of the SNN system featuring on-chip unsupervised STDP learning in standard CMOS technology. It does not involve the use of FPGAs, CPUs or GPUs for training the neural network. We demonstrated the complete circuit-level design, implementation and simulation of SNN with on-chip training and inference for pattern classification using 180 nm CMOS technology. A comprehensive comparison of the proposed SNN circuit with the previous related work is also presented. To demonstrate the versatility of the CMOS synapse circuit for application scenarios requiring rate-based learning, we have tuned the pair-based STDP circuit to obtain Bienenstock-Cooper-Munro (BCM) characteristics and applied it to heart rate classification.


title: A Spiking Neural Network Structure Implementing Reinforcement Learning

abstract: At present, implementation of learning mechanisms in spiking neural networks (SNN) cannot be considered as a solved scientific problem despite plenty of SNN learning algorithms proposed. It is also true for SNN implementation of reinforcement learning (RL), while RL is especially important for SNNs because of its close relationship to the domains most promising from the viewpoint of SNN application such as robotics. In the present paper, I describe an SNN structure which, seemingly, can be used in wide range of RL tasks. The distinctive feature of my approach is usage of only the spike forms of all signals involved - sensory input streams, output signals sent to actuators and reward/punishment signals. Besides that, selecting the neuron/plasticity models, I was guided by the requirement that they should be easily implemented on modern neurochips. The SNN structure considered in the paper includes spiking neurons described by a generalization of the LIFAT (leaky integrate-and-fire neuron with adaptive threshold) model and a simple spike timing dependent synaptic plasticity model (a generalization of dopamine-modulated plasticity). My concept is based on very general assumptions about RL task characteristics and has no visible limitations on its applicability. To test it, I selected a simple but non-trivial task of training the network to keep a chaotically moving light spot in the view field of an emulated DVS camera. Successful solution of this RL problem by the SNN described can be considered as evidence in favor of efficiency of my approach.


title: Testing Screening Mechanisms with Mass Profiles of Galaxy Clusters

abstract: We present \textsc{MG-MAMPOSSt}, a license-free code to constrain modified gravity models by reconstructing the mass profile of galaxy clusters with the kinematics of the cluster's member galaxies. We describe the main features of the code and we show the capability of the method when the kinematic information is combined with lensing data. We discuss recent results and forecasts on two classes of models currently implemented in the code, characterized by different screening mechanisms, namely, chameleon and Vainshtein screening. We further explore the impact of possible systematics in view of application to the data from upcoming surveys. This proceedings summarizes the results presented at the ALTECOSMOFUN workshop in September 2021.


title: Search for lepton-flavor-violating decays of the tau lepton at a future muon collider

abstract: Tau leptons can have lepton-flavor-violating (LFV) couplings to a muon or an electron and an Axion-Like Particle (ALP). ALPs are pseudo Nambu-Goldstone bosons associated with spontaneously broken global U(1) symmetries. LFV ALPs have been of a great interest in the last several decades as they can address some of the SM long-lasting problems. Assuming a future muon collider proposed by the Muon Accelerator Program (MAP), we search for LFV decays $\tau\rightarrow\ell a$ ($\ell=e,\mu$) of one of the tau leptons produced in the muon-anti muon annihilation. The ALP mass is assumed to be in the range 100 eV to 1 MeV and three different chiral structures are considered for the LFV coupling. Using a multivariate technique and performing a parameterized simulation based on the ideal target performance, we obtain expected 95$\%$ confidence level upper limits on the LFV couplings tau-electron-ALP and tau-muon-ALP. Limits are computed assuming the center-of-mass energies of 126, 350 and 1500 GeV which the future muon collider is supposed to operate at. We study the two cases of unpolarized and polarized muon beams and show that taking advantage of tau polarization-induced effects, the main background $\tau\rightarrow e/\mu + \nu\bar{\nu}$ can be significantly reduced. Results indicate that current limits on the LFV couplings can be improved by roughly one order of magnitude using the present analysis.


title: On Turing-Turing bifurcation of partial functional differential equations and its induced superposition patterns

abstract: When two Turing modes interact, i.e., Turing-Turing bifurcation occurs, superposition patterns revealing complex dynamical phenomena appear. In this paper, superposition patterns resulting from Turing-Turing bifurcation are investigated in theory. Firstly, the third-order normal form locally topologically equivalent to original partial functional differential equations (PFDEs) is derived. When selecting 1D domain and Neumann boundary conditions, three normal forms describing different spatial patterns are deduced from original third-order normal form. Also, formulas for computing coefficients of these normal forms are given, which are expressed in explicit form of original system parameters. With the aid of three normal forms, spatial patterns of a diffusive predator-prey system with Crowley-Martin functional response near Turing-Turing singularity are investigated. For one set of parameters, diffusive system supports the coexistence of four stable steady states with different single characteristic wavelengths, which demonstrates our previous conjecture. For another set of parameters, superposition patterns, tri-stable patterns that a pair of stable superposition steady states coexists with the stable coexistence equilibrium or another stable steady state, as well as quad-stable patterns that a pair of stable superposition steady states and another pair of stable steady states coexist, arise. Finally, numerical simulations are shown to support theory analysis.


title: HSTR-Net: High Spatio-Temporal Resolution Video Generation For Wide Area Surveillance

abstract: Wide area surveillance has many applications and tracking of objects under observation is an important task, which often needs high spatio-temporal resolution (HSTR) video for better precision. This paper presents the usage of multiple video feeds for the generation of HSTR video as an extension of reference based super resolution (RefSR). One feed captures video at high spatial resolution with low frame rate (HSLF) while the other captures low spatial resolution and high frame rate (LSHF) video simultaneously for the same scene. The main purpose is to create an HSTR video from the fusion of HSLF and LSHF videos. In this paper we propose an end-to-end trainable deep network that performs optical flow estimation and frame reconstruction by combining inputs from both video feeds. The proposed architecture provides significant improvement over existing video frame interpolation and RefSR techniques in terms of objective PSNR and SSIM metrics.


title: Error Guarantees for Least Squares Approximation with Noisy Samples in Domain Adaptation

abstract: Given $n$ samples of a function $f\colon D\to\mathbb C$ in random points drawn with respect to a measure $\varrho_S$ we develop theoretical analysis of the $L_2(D, \varrho_T)$-approximation error. For a parituclar choice of $\varrho_S$ depending on $\varrho_T$, it is known that the weighted least squares method from finite dimensional function spaces $V_m$, $\dim(V_m) = m < \infty$ has the same error as the best approximation in $V_m$ up to a multiplicative constant when given exact samples with logarithmic oversampling. If the source measure $\varrho_S$ and the target measure $\varrho_T$ differ we are in the domain adaptation setting, a subfield of transfer learning. We model the resulting deterioration of the error in our bounds. Further, for noisy samples, our bounds describe the bias-variance trade off depending on the dimension $m$ of the approximation space $V_m$. All results hold with high probability. For demonstration, we consider functions defined on the $d$-dimensional cube given in unifom random samples. We analyze polynomials, the half-period cosine, and a bounded orthonormal basis of the non-periodic Sobolev space $H_{\mathrm{mix}}^2$. Overcoming numerical issues of this $H_{\text{mix}}^2$ basis, this gives a novel stable approximation method with quadratic error decay. Numerical experiments indicate the applicability of our results.


title: Modeling Multi-Granularity Hierarchical Features for Relation Extraction

abstract: Relation extraction is a key task in Natural Language Processing (NLP), which aims to extract relations between entity pairs from given texts. Recently, relation extraction (RE) has achieved remarkable progress with the development of deep neural networks. Most existing research focuses on constructing explicit structured features using external knowledge such as knowledge graph and dependency tree. In this paper, we propose a novel method to extract multi-granularity features based solely on the original input sentences. We show that effective structured features can be attained even without external knowledge. Three kinds of features based on the input sentences are fully exploited, which are in entity mention level, segment level, and sentence level. All the three are jointly and hierarchically modeled. We evaluate our method on three public benchmarks: SemEval 2010 Task 8, Tacred, and Tacred Revisited. To verify the effectiveness, we apply our method to different encoders such as LSTM and BERT. Experimental results show that our method significantly outperforms existing state-of-the-art models that even use external knowledge. Extensive analyses demonstrate that the performance of our model is contributed by the capture of multi-granularity features and the model of their hierarchical structure. Code and data are available at \url{https://github.com/xnliang98/sms}.


title: Guided deep learning by subaperture decomposition: ocean patterns from SAR imagery

abstract: Spaceborne synthetic aperture radar can provide meters scale images of the ocean surface roughness day or night in nearly all weather conditions. This makes it a unique asset for many geophysical applications. Sentinel 1 SAR wave mode vignettes have made possible to capture many important oceanic and atmospheric phenomena since 2014. However, considering the amount of data provided, expanding applications requires a strategy to automatically process and extract geophysical parameters. In this study, we propose to apply subaperture decomposition as a preprocessing stage for SAR deep learning models. Our data centring approach surpassed the baseline by 0.7, obtaining state of the art on the TenGeoPSARwv data set. In addition, we empirically showed that subaperture decomposition could bring additional information over the original vignette, by rising the number of clusters for an unsupervised segmentation method. Overall, we encourage the development of data centring approaches, showing that, data preprocessing could bring significant performance improvements over existing deep learning models.


title: The skyrmion bags in an anisotropy gradient

abstract: Skyrmion bags as spin textures with arbitrary topological charge are expected to be the carriers in racetrack memory. Here, we theoretically and numerically investigated the dynamics of skyrmion bags in an anisotropy gradient. It is found that, without the boundary potential, the dynamics of skyrmion bags are dependent on the spin textures, and the velocity of skyrmionium with $Q = 0$ is faster than other skyrmion bags. However, when the skyrmion bags move along the boundary, the velocities of all skyrmion bags with different $Q$ are same. This can be attributed to the same value of $u/\eta_{xx}$, where the $u$ and $\eta_{xx}$ are the terms related to the magnetization distribution of skyrmion bag. In addition, we theoretically derived the dynamics of skyrmion bags in the two cases using the Thiele approach and discussed the scope of Thiele equation. Within a certain range, the simulation results are in good agreement with the analytically calculated results. Our findings provide an alternative way to manipulate the racetrack memory based on the skyrmion bags.


title: Are Two Heads the Same as One? Identifying Disparate Treatment in Fair Neural Networks

abstract: We show that deep networks trained to satisfy demographic parity often do so through a form of race or gender awareness, and that the more we force a network to be fair, the more accurately we can recover race or gender from the internal state of the network. Based on this observation, we investigate an alternative fairness approach: we add a second classification head to the network to explicitly predict the protected attribute (such as race or gender) alongside the original task. After training the two-headed network, we enforce demographic parity by merging the two heads, creating a network with the same architecture as the original network. We establish a close relationship between existing approaches and our approach by showing (1) that the decisions of a fair classifier are well-approximated by our approach, and (2) that an unfair and optimally accurate classifier can be recovered from a fair classifier and our second head predicting the protected attribute. We use our explicit formulation to argue that the existing fairness approaches, just as ours, demonstrate disparate treatment and that they are likely to be unlawful in a wide range of scenarios under US law.