title: Implications of light $Z'$ on semileptonic $B(B_{s}) \to T\{K_2^*(1430)$ $(f_2'(1525))\} \ell^+\ell^-$ decays at large recoil

abstract: We probe the rare semileptonic decays $B_{(s)} \to K_2^*(1430)(f_2'(1525)) \ell^+\ell^-$ proceeding via $b\to s \ell \ell$ transition in the presence of a light $Z^{\prime}$ boson. We employ the presence of an additional vector type interaction and constrain the new physics coupling parameter using the existing experimental measurements on $R_K$ and $R_{K^*}$ observables. To understand the sensitivity of the new physics coupling, we investigate the impact of this coupling on various physical observables such as differential branching ratio, the forward-backward asymmetry, the lepton polarization asymmetry, the angular observable $P_5^{\prime}$, and the lepton universality parameters such as the ratio of the branching ratio $R_{f_2'(K_2^*)}$ and some important Q parameters of $B_{(s)} \to K_2^*(1430)(f_2'(1525)) \ell^+\ell^-$ processes at large recoil. We find some noticeable differences of the observables in the presence of light $Z^{\prime}$ contribution.


title: Language Model Priming for Cross-Lingual Event Extraction

abstract: We present a novel, language-agnostic approach to "priming" language models for the task of event extraction, providing particularly effective performance in low-resource and zero-shot cross-lingual settings. With priming, we augment the input to the transformer stack's language model differently depending on the question(s) being asked of the model at runtime. For instance, if the model is being asked to identify arguments for the trigger "protested", we will provide that trigger as part of the input to the language model, allowing it to produce different representations for candidate arguments than when it is asked about arguments for the trigger "arrest" elsewhere in the same sentence. We show that by enabling the language model to better compensate for the deficits of sparse and noisy training data, our approach improves both trigger and argument detection and classification significantly over the state of the art in a zero-shot cross-lingual setting.


title: Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusion

abstract: Registration of brain MRI images requires to solve a deformation field, which is extremely difficult in aligning intricate brain tissues, e.g., subcortical nuclei, etc. Existing efforts resort to decomposing the target deformation field into intermediate sub-fields with either tiny motions, i.e., progressive registration stage by stage, or lower resolutions, i.e., coarse-to-fine estimation of the full-size deformation field. In this paper, we argue that those efforts are not mutually exclusive, and propose a unified framework for robust brain MRI registration in both progressive and coarse-to-fine manners simultaneously. Specifically, building on a dual-encoder U-Net, the fixed-moving MRI pair is encoded and decoded into multi-scale deformation sub-fields from coarse to fine. Each decoding block contains two proposed novel modules: i) in Deformation Field Integration (DFI), a single integrated sub-field is calculated, warping by which is equivalent to warping progressively by sub-fields from all previous decoding blocks, and ii) in Non-rigid Feature Fusion (NFF), features of the fixed-moving pair are aligned by DFI-integrated sub-field, and then fused to predict a finer sub-field. Leveraging both DFI and NFF, the target deformation field is factorized into multi-scale sub-fields, where the coarser fields alleviate the estimate of a finer one and the finer field learns to make up those misalignments insolvable by previous coarser ones. The extensive and comprehensive experimental results on both private and public datasets demonstrate a superior registration performance of brain MRI images over progressive registration only and coarse-to-fine estimation only, with an increase by at most 8% in the average Dice.


title: Experimental indications of the 3+1 neutrino model with one sterile neutrino

abstract: The possibility of the validation of the 3+1 neutrino model is considered in the context of the new result of the Neutrino-4 experiment, the direct observation of the oscillation effect at parameter region $\Delta m_{14}^2=(7.3 \pm 0.13_{stat} \pm 1.16_{syst})\text{eV}^2$ and $\sin^2(2\theta_{14}) = 0.36 \pm 0.12_{stat} (2.9\sigma)$, also using LSND anomaly, MiniBooNE anomaly, reactor antineutrino anomaly, and gallium anomaly observed in experiments with radioactive sources GALLEX/GNO and SAGE. We analyze agreement of the neutrino parameter values obtained in the Neutrino-4 experiment with the results of other reactor type experiments NEOS, DANSS, STEREO, PROSPECT, the experiments at accelerators MiniBooNE, LSND, and the IceCube experiment. We present the analysis of the 3+1 neutrino model which demonstrates the agreement among the experiments within current experimental accuracy. Also, current accuracy allows us to make estimations of the effective masses of the neutrinos. The mass of the sterile neutrino obtained in the Neutrino-4 experiment (in assumption $m_2^2 \approx \Delta m_{14}^2$) is $m_4 = (2.70\pm0.22)\text{eV}$. Using the estimations of the mixing angles we calculated the values of the electron, muon and tau neutrinos: $m_{4\nu_e}^{\text{eff}}=(0.82\pm0.18)\text{eV}, m_{4\nu_{\mu}}^{\text{eff}}=(0.41\pm0.26)\text{eV}, m_{4\nu_{\tau}}^{\text{eff}}\leq 0.60\text{eV}$. These results are compared with the values obtained in the experiments in the direct measurement of the neutrino mass KATRIN and GERDA. The Pontecorvo-Maki-Nakagawa-Sakata matrix with four states and the mixing scheme of the flavor neutrinos with the sterile state are presented.


title: A Multi-Agent System for Autonomous Mobile Robot Coordination

abstract: The automation of internal logistics and inventory-related tasks is one of the main challenges of modern-day manufacturing corporations since it allows a more effective application of their human resources. Nowadays, Autonomous Mobile Robots (AMR) are state of the art technologies for such applications due to their great adaptability in dynamic environments, replacing more traditional solutions such as Automated Guided Vehicles (AGV), which are quite limited in terms of flexibility and require expensive facility updates for their installation. The application of Artificial Intelligence (AI) to increase AMRs capabilities has been contributing for the development of more sophisticated and efficient robots. Nevertheless, multi-robot coordination and cooperation for solving complex tasks is still a hot research line with increasing interest. This work proposes a Multi-Agent System for coordinating multiple TIAGo robots in tasks related to the manufacturing ecosystem such as the transportation and dispatching of raw materials, finished products and tools. Furthermore, the system is showcased in a realistic simulation using both Gazebo and Robot Operating System (ROS).


title: A Pixon-Based Method for Reverberation-mapping Analysis in Active Galactic Nuclei

abstract: We present an alternative method for reconstructing a velocity-delay map in reverberation mapping (RM) based on the pixon algorithm initially proposed for image reconstruction by Pina & Puetter (1993). The pixon algorithm allows for a variable pixon basis to adjust resolution of each image pixel according the information content in that pixel, which therefore enables the algorithm to make the best possible use of measured data. The final optimal pixon basis functions would be those that minimize the number of pixons while still providing acceptable descriptions to data within the accuracy allowed by noises. We adapt the pixon algorithm to RM analysis and develop a generic framework to implement the algorithm. Simulation tests and comparisons with the widely used maximum entropy method demonstrate the feasibility and high performance of our pixon-based RM analysis. This paper serves as an introduction to the framework and the application to velocity-unresolved RM. An extension to velocity-resolved cases will be presented in a companion paper.


title: Automated Multi-domain Engineering Design through Linear Graph and Genetic Programming

abstract: This paper proposes a methodology of integrating the Linear Graph (LG) approach with Genetic Programming (GP) for generating an automated multi-domain engineering design approach by using the in-house developed LG MATLAB toolbox and the GP toolbox in MATLAB. The necessary background for the development are presented, and the methodology used in this work to facilitate the construction and evaluation of filter circuits, using LG models, is described. Designing electronic filter circuits through an evolution from electronic components to the completed circuits is demonstrated. The topology and component values of three types of filter circuits: low pass, high pass, and band pass, are designed through this evolutionary approach, for various cut-off frequencies. Furthermore, the paper demonstrates through examples of these evolved filter circuits, the combined GP and LG approach is successful in constructing high order filter circuits that are capable of attenuating undesired frequencies while maintaining desirable ones. The work presented in the paper is a key step towards the integration of LG modeling, through the use of the LGtheory MATLAB Toolbox, with machine learning techniques for the automated design of dynamic multi-domain mechatronic systems.


title: RegMiner: Towards Constructing a Large Regression Dataset from Code Evolution History

abstract: Bug datasets consisting of real-world bugs are important artifacts for researchers and programmers, which lay empirical and experimental foundation for various SE/PL research such as fault localization, software testing, and program repair. All known state-of-the-art datasets are constructed manually, which inevitably limits their scalability, representativeness, and the support for the emerging data-driven research. In this work, we propose an approach to automate the process of harvesting replicable regression bugs from the code evolutionary history. We focus on regression bug dataset, as they (1) manifest how a bug is introduced and fixed (as normal bugs), (2) support regression bug analysis, and (3) incorporate a much stronger specification (i.e., the original passing version) for general bug analysis. Technically, we address an information retrieval problem on code evolution history. Given a code repository, we search for regressions where a test can pass a regression-fixing commit, fail a regressioninducing commit, and pass a working commit. In this work, we address the challenges of (1) identifying potential regression-fixing commits from the code evolution history, (2) migrating the test and its code dependencies over the history, and (3) minimizing the compilation overhead during the regression search. We build our tool, RegMiner, which harvested 537 regressions over 66 projects for 3 weeks, created the largest replicable regression dataset within shortest period, to the best of our knowledge. Moreover, our empirical study on our regression dataset shows a gap between the popular regression fault localization techniques (e.g, delta-debugging) and the real fix, revealing new data-driven research opportunities.


title: Model reduction for the material point method via an implicit neural representation of the deformation map

abstract: This work proposes a model-reduction approach for the material point method on nonlinear manifolds. Our technique approximates the $\textit{kinematics}$ by approximating the deformation map using an implicit neural representation that restricts deformation trajectories to reside on a low-dimensional manifold. By explicitly approximating the deformation map, its spatiotemporal gradients -- in particular the deformation gradient and the velocity -- can be computed via analytical differentiation. In contrast to typical model-reduction techniques that construct a linear or nonlinear manifold to approximate the (finite number of) degrees of freedom characterizing a given spatial discretization, the use of an implicit neural representation enables the proposed method to approximate the $\textit{continuous}$ deformation map. This allows the kinematic approximation to remain agnostic to the discretization. Consequently, the technique supports dynamic discretizations -- including resolution changes -- during the course of the online reduced-order-model simulation. To generate $\textit{dynamics}$ for the generalized coordinates, we propose a family of projection techniques. At each time step, these techniques: (1) Calculate full-space kinematics at quadrature points, (2) Calculate the full-space dynamics for a subset of `sample' material points, and (3) Calculate the reduced-space dynamics by projecting the updated full-space position and velocity onto the low-dimensional manifold and tangent space, respectively. We achieve significant computational speedup via hyper-reduction that ensures all three steps execute on only a small subset of the problem's spatial domain. Large-scale numerical examples with millions of material points illustrate the method's ability to gain an order of magnitude computational-cost saving -- indeed $\textit{real-time simulations}$ -- with negligible errors.


title: Multi-source Few-shot Domain Adaptation

abstract: Multi-source Domain Adaptation (MDA) aims to transfer predictive models from multiple, fully-labeled source domains to an unlabeled target domain. However, in many applications, relevant labeled source datasets may not be available, and collecting source labels can be as expensive as labeling the target data itself. In this paper, we investigate Multi-source Few-shot Domain Adaptation (MFDA): a new domain adaptation scenario with limited multi-source labels and unlabeled target data. As we show, existing methods often fail to learn discriminative features for both source and target domains in the MFDA setting. Therefore, we propose a novel framework, termed Multi-Source Few-shot Adaptation Network (MSFAN), which can be trained end-to-end in a non-adversarial manner. MSFAN operates by first using a type of prototypical, multi-domain, self-supervised learning to learn features that are not only domain-invariant but also class-discriminative. Second, MSFAN uses a small, labeled support set to enforce feature consistency and domain invariance across domains. Finally, prototypes from multiple sources are leveraged to learn better classifiers. Compared with state-of-the-art MDA methods, MSFAN improves the mean classification accuracy over different domain pairs on MFDA by 20.2%, 9.4%, and 16.2% on Office, Office-Home, and DomainNet, respectively.


title: Comparison theorems for Kan, faintly universal and strongly universal derived functors

abstract: We distinguish between faint, weak, strong and strict localizations of categories at morphism families and show that this framework captures the different types of derived functors that are considered in the literature. More precisely, we show that Kan and faint derived functors coincide when we use the classical Kan homotopy category, and when we use the Quillen homotopy category, Kan and strong derived functors coincide. Our comparison results are based on the fact that the Kan homotopy category is a weak localization and that the Quillen homotopy category is a strict localization.


title: Sorting through the noise: Testing robustness of information processing in pre-trained language models

abstract: Pre-trained LMs have shown impressive performance on downstream NLP tasks, but we have yet to establish a clear understanding of their sophistication when it comes to processing, retaining, and applying information presented in their input. In this paper we tackle a component of this question by examining robustness of models' ability to deploy relevant context information in the face of distracting content. We present models with cloze tasks requiring use of critical context information, and introduce distracting content to test how robustly the models retain and use that critical information for prediction. We also systematically manipulate the nature of these distractors, to shed light on dynamics of models' use of contextual cues. We find that although models appear in simple contexts to make predictions based on understanding and applying relevant facts from prior context, the presence of distracting but irrelevant content has clear impact in confusing model predictions. In particular, models appear particularly susceptible to factors of semantic similarity and word position. The findings are consistent with the conclusion that LM predictions are driven in large part by superficial contextual cues, rather than by robust representations of context meaning.


title: Regular decomposition of the edge set of graphs with applications

abstract: We introduce a new method for decomposing the edge set of a graph, and use it to replace the Regularity lemma of Szemer\'edi in some graph embedding problems. An algorithmic version is also given.


title: Indeterminacies and models of homotopy limits

abstract: In \cite{CompTheo} we studied the indeterminacy of the value of a derived functor at an object using different definitions of a derived functor and different types of fibrant replacement. In the present work we focus on derived or homotopy limits, which of course depend on the model structure of the diagram category under consideration. The latter is not necessarily unique, which is an additional source of indeterminacy. In the case of homotopy pullbacks, we introduce the concept of full homotopy pullback by identifying the homotopy pullbacks associated with three different model structures of the category of cospan diagrams, thus increasing the number of canonical representatives. Finally, we define generalized representatives or models of homotopy limits and full homotopy pullbacks. The concept of model is a unifying approach that includes the homotopy pullback used in \cite{JL} and the homotopy fiber square defined in \cite{Hir} in right proper model categories. Properties of the latter are generalized to models in any model category.


title: A new approach to model categorical homotopy fiber sequences

abstract: We propose a simplified definition of Quillen's fibration sequences in a pointed model category that fully captures the theory, although it is completely independent of the concept of action. This advantage arises from the understanding that the homotopy theory of the model category's arrow category contains all homotopical information about its long fibration sequences.


title: Finite and nilpotent strongly verbally closed groups

abstract: We show, in particular, that, if a finite group $H$ is a retract of any finite group containing $H$ as a verbally closed subgroup, then the centre of $H$ is a direct factor of $H$.


title: Channel State Information Based Localization with Deep Learning

abstract: Localization is one of the most important problems in various fields such as robotics and wireless communications. For instance, Unmanned Aerial Vehicles (UAVs) require the information of the position precisely for an adequate control strategy. This problem is handled very efficiently with integrated GPS units for outdoor applications. However, indoor applications require special treatment due to the unavailability of GPS signals. Another aspect of mobile robots such as UAVs is that there is constant wireless communication between the mobile robot and a computational unit. This communication is mainly done for obtaining telemetry information or computation of control actions directly. The responsible integrated units for this transmission are commercial wireless communication chipsets. These units on the receiver side are responsible for getting rid of the diverse effects of the communication channel with various mathematical techniques. These techniques mainly require the Channel State Information (CSI) of the current channel to compensate the channel itself. After the compensation, the chipset has nothing to do with CSI. However, the locations of both the transmitter and receiver have a direct impact on CSI. Even though CSI contains such rich information about the environment, the accessibility of these data is blocked by the commercial wireless chipsets since they are manufactured to provide only the processed information data bits to the user. However, with the IEEE 802.11n standardization, certain chipsets provide access to CSI. Therefore, CSI data became processible and integrable to localization schemes. In this project, a test environment was constructed for the localization task. Two routers with proper chipsets were assigned as transmitter and receiver. They were operationalized for the CSI data collection. Lastly, these data were processed with various deep learning models.


title: Self-Enhancing Multi-filter Sequence-to-Sequence Model

abstract: Representation learning is important for solving sequence-to-sequence problems in natural language processing. Representation learning transforms raw data into vector-form representations while preserving their features. However, data with significantly different features leads to heterogeneity in their representations, which may increase the difficulty of convergence. We design a multi-filter encoder-decoder model to resolve the heterogeneity problem in sequence-to-sequence tasks. The multi-filter model divides the latent space into subspaces using a clustering algorithm and trains a set of decoders (filters) in which each decoder only concentrates on the features from its corresponding subspace. As for the main contribution, we design a self-enhancing mechanism that uses a reinforcement learning algorithm to optimize the clustering algorithm without additional training data. We run semantic parsing and machine translation experiments to indicate that the proposed model can outperform most benchmarks by at least 5\%. We also empirically show the self-enhancing mechanism can improve performance by over 10\% and provide evidence to demonstrate the positive correlation between the model's performance and the latent space clustering.


title: Communication-Efficient Federated Linear and Deep Generalized Canonical Correlation Analysis

abstract: Classic and deep generalized canonical correlation analysis (GCCA) algorithms seek low-dimensional common representations of data entities from multiple ``views'' (e.g., audio and image) using linear transformations and neural networks, respectively. When the views are acquired and stored at different computing agents (e.g., organizations and edge devices) and data sharing is undesired due to privacy or communication cost considerations, federated learning-based GCCA is well-motivated. In federated learning, the views are kept locally at the agents and only derived, limited information exchange with a central server is allowed. However, applying existing GCCA algorithms onto such federated learning settings may incur prohibitively high communication overhead. This work puts forth a communication-efficient federated learning framework for both linear and deep GCCA under the maximum variance (MAX-VAR) formulation. The overhead issue is addressed by aggressively compressing (via quantization) the exchanging information between the computing agents and a central controller. Compared to the unquantized version, our empirical study shows that the proposed algorithm enjoys a substantial reduction of communication overheads with virtually no loss in accuracy and convergence speed. Rigorous convergence analyses are also presented, which is a nontrivial effort. Generic federated optimization results do not cover the special problem structure of GCCA. Our result shows that the proposed algorithms for both linear and deep GCCA converge to critical points at a sublinear rate, even under heavy quantization and stochastic approximations. In addition, in the linear MAX-VAR case, the quantized algorithm approaches a global optimum in a geometric rate under reasonable conditions. Synthetic and real-data experiments are used to showcase the effectiveness of the proposed approach.


title: Incentives in Dominant Resource Fair Allocation under Dynamic Demands

abstract: Every computer system -- from schedulers in clouds (e.g. Amazon) to computer networks to operating systems -- performs resource allocation across system users. The defacto allocation policies are max-min fairness (MMF) for single resources and dominant resource fairness (DRF) for multiple resources which guarantee properties like incentive compatibility, envy-freeness, and Pareto efficiency, assuming user demands are static (time-independent). However, in real-world systems, user demands are dynamic, i.e. time-dependant. As a result, there is now a fundamental mismatch between the goals of computer systems and the properties enabled by classic resource allocation policies. We aim to bridge this mismatch. When demands are dynamic, instant-by-instant MMF can be extremely unfair over longer periods of time, i.e. lead to unbalanced user allocations as previous allocations have no effect in the present. We consider a natural generalization of MMF and DRF for multiple resources and users with dynamic demands: this algorithm ensures that user allocations are as max-min fair as possible up to any time instant, given past allocations. This dynamic mechanism remains Pareto optimal and envy-free, but not incentive compatible. However, our results show that the possible increase in utility by misreporting is bounded and, since this can lead to significant decrease in overall useful allocation, this suggests that it is not a useful strategy. Our main result is to show that our dynamic DRF algorithm is $(1+\rho)$-incentive compatible, where $\rho$ quantifies the relative importance of a resource for different users; we show that this factor is tight even with only two resources. We also present a $3/2$ upper bound and a $\sqrt 2$ lower bound for incentive compatibility when there is only one resource. We also offer extensions for the case when users are weighted to prioritize them differently.


title: Phase mixing for solutions to 1D transport equation in a confining potential

abstract: Consider the linear transport equation in $1$D under an external confining potential $\Phi$: \begin{equation*} \partial_t f + v \partial_x f - \partial_x \Phi \partial_v f = 0. \end{equation*} For $\Phi = \frac{x^2}{2} + \frac{\epsilon x^4}{2}$ (with $\epsilon >0$ small), we prove phase mixing and quantitative decay estimates for $\partial_t \varphi := - \Delta^{-1} \int_{\mathbb{R}} \partial_t f \, \mathrm{d} v$, with an inverse polynomial decay rate $O(\langle t\rangle^{-2})$. In the proof, we develop a commuting vector field approach, suitably adapted to this setting. We will explain why we hope this is relevant for the nonlinear stability of the zero solution for the Vlasov--Poisson system in $1$D under the external potential $\Phi$.


title: Implementing ECC on Data Link Layer of the OSI Reference Model

abstract: The Internet, a rapidly expanding communication infrastructure, poses significant cybersecurity challenges. A few techniques have been developed to provide security in the OSI model's application, presentation, and network layers. Instead of using Media Access Control (MAC), this paper recommends using public key Elliptic Curve Cryptography to serve the Data Link Layer. On a microFourQ-MSP-IAR Embedded Workbench IDE-MSP430 7.12.4, a prototype of the architecture was implemented. When the cost of key generation was compared to the curve, it was shown that they are directly related. The cost of key generation time rises in proportion to the bit length of the curve. Because of the large number of connected devices that may be exposed due to a lack of effective security in the data link layer, significant concerns arise in terms of network privacy, governance, and security. As a result, this research suggests using a public key cryptosystem based on an elliptic curve to secure the data link layer for safe data communication in Internet-connected devices.


title: Deep learning tackles single-cell analysis A survey of deep learning for scRNA-seq analysis

abstract: Since its selection as the method of the year in 2013, single-cell technologies have become mature enough to provide answers to complex research questions. With the growth of single-cell profiling technologies, there has also been a significant increase in data collected from single-cell profilings, resulting in computational challenges to process these massive and complicated datasets. To address these challenges, deep learning (DL) is positioning as a competitive alternative for single-cell analyses besides the traditional machine learning approaches. Here we present a processing pipeline of single-cell RNA-seq data, survey a total of 25 DL algorithms and their applicability for a specific step in the processing pipeline. Specifically, we establish a unified mathematical representation of all variational autoencoder, autoencoder, and generative adversarial network models, compare the training strategies and loss functions for these models, and relate the loss functions of these models to specific objectives of the data processing step. Such presentation will allow readers to choose suitable algorithms for their particular objective at each step in the pipeline. We envision that this survey will serve as an important information portal for learning the application of DL for scRNA-seq analysis and inspire innovative use of DL to address a broader range of new challenges in emerging multi-omics and spatial single-cell sequencing.


title: CoMeT: An Integrated Interval Thermal Simulation Toolchain for 2D, 2.5D, and 3D Processor-Memory Systems

abstract: Processing cores and the accompanying main memory working in tandem enable the modern processors. Dissipating heat produced from computation, memory access remains a significant problem for processors. Therefore, processor thermal management continues to be an active research topic. Most thermal management research takes place using simulations, given the challenges of measuring temperature in real processors. Since core and memory are fabricated on separate packages in most existing processors, with the memory having lower power densities, thermal management research in processors has primarily focused on the cores. Memory bandwidth limitations associated with 2D processors lead to high-density 2.5D and 3D packaging technology. 2.5D packaging places cores and memory on the same package. 3D packaging technology takes it further by stacking layers of memory on the top of cores themselves. Such packagings significantly increase the power density, making processors prone to heating. Therefore, mitigating thermal issues in high-density processors (packaged with stacked memory) becomes an even more pressing problem. However, given the lack of thermal modeling for memories in existing interval thermal simulation toolchains, they are unsuitable for studying thermal management for high-density processors. To address this issue, we present CoMeT, the first integrated Core and Memory interval Thermal simulation toolchain. CoMeT comprehensively supports thermal simulation of high- and low-density processors corresponding to four different core-memory configurations - off-chip DDR memory, off-chip 3D memory, 2.5D, and 3D. CoMeT supports several novel features that facilitate overlying system research. Compared to an equivalent state-of-the-art core-only toolchain, CoMeT adds only a ~5% simulation-time overhead. The source code of CoMeT has been made open for public use under the MIT license.


title: MINIMAL: Mining Models for Data Free Universal Adversarial Triggers

abstract: It is well known that natural language models are vulnerable to adversarial attacks, which are mostly input-specific in nature. Recently, it has been shown that there also exist input-agnostic attacks in NLP models, called universal adversarial triggers. However, existing methods to craft universal triggers are data intensive. They require large amounts of data samples to generate adversarial triggers, which are typically inaccessible by attackers. For instance, previous works take 3000 data samples per class for the SNLI dataset to generate adversarial triggers. In this paper, we present a novel data-free approach, MINIMAL, to mine input-agnostic adversarial triggers from models. Using the triggers produced with our data-free algorithm, we reduce the accuracy of Stanford Sentiment Treebank's positive class from 93.6% to 9.6%. Similarly, for the Stanford Natural Language Inference (SNLI), our single-word trigger reduces the accuracy of the entailment class from 90.95% to less than 0.6\%. Despite being completely data-free, we get equivalent accuracy drops as data-dependent methods.


title: Immunity-induced criticality of the genotype network of influenza A (H3N2) hemagglutinin

abstract: Seasonal influenza kills hundreds of thousands every year, with multiple constantly-changing strains in circulation at any given time. A high mutation rate enables the influenza virus to evade recognition by the human immune system, including immunity acquired through past infection and vaccination. Here, we capture the genetic similarity of influenza strains and their evolutionary dynamics with genotype networks. We show that the genotype networks of influenza A (H3N2) hemagglutinin are characterized by heavy-tailed distributions of module sizes and connectivity, suggesting critical-like behavior. We argue that: (i) genotype networks are driven by mutation and host immunity to explore a subspace of networks predictable in structure, and (ii) genotype networks provide an underlying structure necessary to capture the rich dynamics of multistrain epidemic models. In particular, inclusion of strain-transcending immunity in epidemic models is dependent upon the structure of an underlying genotype network. This interplay suggests a self-organized criticality where the epidemic dynamics of influenza locates critical-like regions of its genotype network. We conclude that this interplay between disease dynamics and network structure might be key for future network analysis of pathogen evolution and realistic multistrain epidemic models.


title: Analysing GSM Insecurity

abstract: In the 1990s, GSM emerged as a cutting-edge technology that promised improved services, mobility, security, and increase in the revenues of companies through improved, secure communication for business transactions. The practical experience, however, has shown global subscribers and companies that mere technological excellence of GSM has not resulted in its success. This paper has been carried out to analyse the existing GSM subscriber activities in both personal and business worlds by implementing a customized GSM baseband protocol stack on a phone. The paper encompasses the tasks of analysing the prevailing GSM insecurity, establishing a conceptual design towards the findings revealed in the practical personal and business environments and knowledge gathered from the literature.


title: Motivating Learners in Multi-Orchestrator Mobile Edge Learning: A Stackelberg Game Approach

abstract: Mobile Edge Learning (MEL) is a learning paradigm that enables distributed training of Machine Learning models over heterogeneous edge devices (e.g., IoT devices). Multi-orchestrator MEL refers to the coexistence of multiple learning tasks with different datasets, each of which being governed by an orchestrator to facilitate the distributed training process. In MEL, the training performance deteriorates without the availability of sufficient training data or computing resources. Therefore, it is crucial to motivate edge devices to become learners and offer their computing resources, and either offer their private data or receive the needed data from the orchestrator and participate in the training process of a learning task. In this work, we propose an incentive mechanism, where we formulate the orchestrators-learners interactions as a 2-round Stackelberg game to motivate the participation of the learners. In the first round, the learners decide which learning task to get engaged in, and then in the second round, the training parameters and the amount of data for training in case of participation such that their utility is maximized. We then study the training round analytically and derive the learners' optimal strategy. Finally, numerical experiments have been conducted to evaluate the performance of the proposed incentive mechanism.


title: Limits and colimits, generators and relations of partial groups

abstract: We analyse limits and colimits in the category $Part$ of partial groups, algebraic structures introduced by A. Chermak. We will prove that $Part$ is both complete and cocomplete and, in addition, that the full subcategory of finite partial groups is both finitely complete and finitely cocomplete. Cocompleteness is then used in order to define quotients of partial groups. We will also identify a category richer than $Set$ (the category of sets and set-maps) and build the free partial groups over objects is such category; this yields a larger class of free partial groups, eventually allowing to prove that every partial group is the quotient of a free partial group.


title: Closed-form solutions for the inverse kinematics of serial robots using conformal geometric algebra

abstract: This work addresses the inverse kinematics of serial robots using conformal geometric algebra. Classical approaches include either the use of homogeneous matrices, which entails high computational cost and execution time or the development of particular geometric strategies that cannot be generalized to arbitrary serial robots. In this work, we present a compact, elegant and intuitive formulation of robot kinematics based on conformal geometric algebra that provides a suitable framework for the closed-form resolution of the inverse kinematic problem for manipulators with a spherical wrist. For serial robots of this kind, the inverse kinematics problem can be split in two subproblems: the position and orientation problems. The latter is solved by appropriately splitting the rotor that defines the target orientation into three simpler rotors, while the former is solved by developing a geometric strategy for each combination of prismatic and revolute joints that forms the position part of the robot. Finally, the inverse kinematics of 7 DoF redundant manipulators with a spherical wrist is solved by extending the geometric solutions obtained in the non-redundant case.


title: Uncertainty quantification in covid-19 spread: lockdown effects

abstract: We develop a Bayesian inference framework to quantify uncertainties in epidemiological models. We use SEIJR and SIJR models involving populations of susceptible, exposed, infective, diagnosed, dead and recovered individuals to infer from covid-19 data rate constants, as well as their variations in response to lockdown measures. To account for confinement, we distinguish two susceptible populations at different risk: confined and unconfined. We show that transmission and recovery rates within them vary in response to facts. A key unknown to predict the evolution of the epidemic is the fraction of the population affected by the virus, including asymptomatic subjects. Our study tracks its time evolution with quantified uncertainty from available official data from the onset of the epidemic, limited, however, by the data quality. We exemplify the technique with data from Spain, country in which late drastic lockdowns were enforced for months. In late actions and in the absence of other measures, spread is delayed but not stopped unless a large enough fraction of the population is confined until the asymptomatic population is depleted. To some extent, confinement could be replaced by strong distancing through masks in adequate circumstances.


title: Cosmology with the sub-millimetre galaxies magnification bias: Tomographic Analysis

abstract: As in Gonzalez-Nuevo et al. 2017 and Bonavera et al. 2019, the high-z sub-millimetre galaxies can be used as background sample for gravitational lensing studies thanks to their magnification bias. In particular, as in Bonavera et al. 2020 the magnification bias can be exploited in order to constrain the free parameters of a Halo Occupation Distribution (HOD) model and some of the main cosmological parameters. In this work the magnification bias has been evaluated as cosmological tool in a tomographic set up. The cross-correlation function (CCF) data have been used to jointly constrain the astrophysical parameters $M_{min}$, $M_{1}$ and $\alpha$ in each one of the selected redshift bins and the $\Omega_{M}$, $\sigma_{8}$, and $H_0$ cosmological ones ($\Lambda$CDM). Moreover, we explore the possible time evolution of the dark energy density introducing also the $\omega_0, \omega_a$ parameters in the joint analysis ($\omega_0$CDM and $\omega_0\omega_a$CDM). The CCF has been measured between a foreground spectroscopic sample of GAMA galaxies that has been divided into four redshift bins (0.1-0.2, 0.2-0.3, 0.3-0.5 and 0.5-0.8) and a sample of H-ATLAS galaxies with photometric redshifts >1.2. The CCF is modelled using a description that depends on HOD and cosmological parameters that are estimated with MCMC in different cases. For the $\Lambda$CDM model, the analysis yields a maximum posterior value at 0.26 with $[0.17,0.41]$ 68\% C.I. for $\Omega_M$ and at 0.87 with $[0.75,1]$ 68\% C.I. for $\sigma_8$. With our current results $H_0$ is not yet constrained. With the $\omega_0$CDM model, the constraints on $\Omega_M$ and $\sigma_8$ are similar, but we found a maximum posterior value for $\omega_0$ at -1 with $[-1.56, -0.47]$ 68\% C.I. In the $\omega_0\omega_a$CDM model, the results are -1.09 with $[-1.72, -0.66]$ 68\% C.I. for $\omega_0$ and -0.19 with $[-1.88, 1.48]$ 68\% C.I. for $\omega_a$.


title: Vehicle Detection and Tracking From Surveillance Cameras in Urban Scenes

abstract: Detecting and tracking vehicles in urban scenes is a crucial step in many traffic-related applications as it helps to improve road user safety among other benefits. Various challenges remain unresolved in multi-object tracking (MOT) including target information description, long-term occlusions and fast motion. We propose a multi-vehicle detection and tracking system following the tracking-by-detection paradigm that tackles the previously mentioned challenges. Our MOT method extends an Intersection-over-Union (IOU)-based tracker with vehicle re-identification features. This allows us to utilize appearance information to better match objects after long occlusion phases and/or when object location is significantly shifted due to fast motion. We outperform our baseline MOT method on the UA-DETRAC benchmark while maintaining a total processing speed suitable for online use cases.


title: The homotopy type of a once-suspended 6-manifold and its applications

abstract: Let $M$ be a closed, oriented, simply connected 6-manifold. After localization away from 2, we give a homotopy decomposition of $\Sigma M$ in terms of spheres, Moore spaces and other recognizable spaces. As applications we calculate generalized cohomology groups of $M$ and determine the homotopy types of gauge groups of certain bundles over $M$.


title: Gaussian ARMA models in the ts.extend package

abstract: This paper introduces and describes the R package ts.extend, which adds probability functions for stationary Gaussian ARMA models and some related utility functions for time-series. We show how to use the package to compute the density and distributions functions for models in this class, and generate random vectors from this model. The package allows the user to use marginal or conditional models using a simple syntax for conditioning variables and marginalised elements. This allows users to simulate time-series vectors from any stationary Gaussian ARMA model, even if some elements are conditional values or omitted values. We also show how to use the package to compute the spectral intensity of a time-series vector and implement the permutation-spectrum test for a time-series vector to detect the presence of a periodic signal.


title: Asteroseismology of low-mass stars: the balance between partial ionisation and Coulomb interactions

abstract: All cool stars with outer convective zones have the potential to exhibit stochastically excited stellar oscillations. In this work, we explore the outer layers of stars less massive than the Sun. In particular, we have computed a set of stellar models raging from 0.4 to 0.9 $M_\odot$ with the aim at determining the impact on stellar oscillations of two physical processes occurring in the envelopes of these stars. Namely, the partial ionisation of chemical elements and the electrostatic interactions between particles in the outer layers. We find that alongside with partial ionisation, Coulomb effects also impact the acoustic oscillation spectrum. We confirm the well-known result that as the mass of a star decreases, the electrostatic interactions between particles become relevant. We found that their impact on stellar oscillations increases with decreasing mass, and for the stars with the lowest masses ($M \lesssim 0.6 M_\odot$), it is shown that Coulomb effects dominate over partial ionisation processes producing a strong scatter on the acoustic modes. The influence of Coulomb interactions on the sound-speed gradient profile produces a strong oscillatory behaviour with diagnostic potential for the future.


title: Comb-based photonic neural population for parallel and nonlinear processing

abstract: It is believed that neural information representation and processing relies on the neural population instead of a single neuron. In neuromorphic photonics, photonic neurons in the form of nonlinear responses have been extensively studied in single devices and temporal nodes. However, to construct a photonic neural population (PNP), the process of scaling up and massive interconnections remain challenging considering the physical complexity and response latency. Here, we propose a comb-based PNP interconnected by carrier coupling with superior scalability. Two unique properties of neural population are theoretically and experimentally demonstrated in the comb-based PNP, including nonlinear response curves and population activities coding. A classification task of three input patterns with dual radio-frequency (RF) tones is successfully implemented in a real-time manner, which manifests the comb-based PNP can make effective use of the ultra-broad bandwidth of photonics for parallel and nonlinear processing.


title: Low-threshold InP quantum dot and InGaP quantum well visible lasers on silicon (001)

abstract: Monolithically combining silicon nitride (SiNx) photonics technology with III-V active devices could open a broad range of on-chip applications spanning a wide wavelength range of ~400-4000 nm. With the development of nitride, arsenide, and antimonide lasers based on quantum well (QW) and quantum dot (QD) active regions, the wavelength palette of integrated III-V lasers on Si currently spans from 400 nm to 11 {\mu}m with a crucial gap in the red-wavelength regime of 630-750 nm. Here, we demonstrate the first red InGaP QW and far-red InP QD lasers monolithically grown on CMOS compatible Si (001) substrates with continuous-wave operation at room temperature. A low-threshold current density of 550 A/cm2 and 690 A/cm2 with emission at 680-730 nm was achieved for QW and QD lasers on Si, respectively. This work takes the first vital step towards integration of visible red lasers on Si allowing the utilization of integrated photonics for applications including biophotonic sensing, quantum computing, and near-eye displays.


title: Verification of Switched Stochastic Systems via Barrier Certificates

abstract: The paper presents a methodology for temporal logic verification of continuous-time switched stochastic systems. Our goal is to find the lower bound on the probability that a complex temporal property is satisfied over a finite time horizon. The required temporal properties of the system are expressed using a fragment of linear temporal logic, called safe-LTL with respect to finite traces. Our approach combines automata-based verification and the use of barrier certificates. It relies on decomposing the automaton associated with the negation of specification into a sequence of simpler reachability tasks and compute upper bounds for these reachability probabilities by means of common or multiple barrier certificates. Theoretical results are illustrated by applying a counter-example guided inductive synthesis framework to find barrier certificates.


title: Integrating Unsupervised Clustering and Label-specific Oversampling to Tackle Imbalanced Multi-label Data

abstract: There is often a mixture of very frequent labels and very infrequent labels in multi-label datatsets. This variation in label frequency, a type class imbalance, creates a significant challenge for building efficient multi-label classification algorithms. In this paper, we tackle this problem by proposing a minority class oversampling scheme, UCLSO, which integrates Unsupervised Clustering and Label-Specific data Oversampling. Clustering is performed to find out the key distinct and locally connected regions of a multi-label dataset (irrespective of the label information). Next, for each label, we explore the distributions of minority points in the cluster sets. Only the minority points within a cluster are used to generate the synthetic minority points that are used for oversampling. Even though the cluster set is the same across all labels, the distributions of the synthetic minority points will vary across the labels. The training dataset is augmented with the set of label-specific synthetic minority points, and classifiers are trained to predict the relevance of each label independently. Experiments using 12 multi-label datasets and several multi-label algorithms show that the proposed method performed very well compared to the other competing algorithms.


title: Equality of opportunity in travel behavior prediction with deep neural networks and discrete choice models

abstract: Although researchers increasingly adopt machine learning to model travel behavior, they predominantly focus on prediction accuracy, ignoring the ethical challenges embedded in machine learning algorithms. This study introduces an important missing dimension - computational fairness - to travel behavior analysis. We first operationalize computational fairness by equality of opportunity, then differentiate between the bias inherent in data and the bias introduced by modeling. We then demonstrate the prediction disparities in travel behavior modeling using the 2017 National Household Travel Survey (NHTS) and the 2018-2019 My Daily Travel Survey in Chicago. Empirically, deep neural network (DNN) and discrete choice models (DCM) reveal consistent prediction disparities across multiple social groups: both over-predict the false negative rate of frequent driving for the ethnic minorities, the low-income and the disabled populations, and falsely predict a higher travel burden of the socially disadvantaged groups and the rural populations than reality. Comparing DNN with DCM, we find that DNN can outperform DCM in prediction disparities because of DNN's smaller misspecification error. To mitigate prediction disparities, this study introduces an absolute correlation regularization method, which is evaluated with synthetic and real-world data. The results demonstrate the prevalence of prediction disparities in travel behavior modeling, and the disparities still persist regarding a variety of model specifics such as the number of DNN layers, batch size and weight initialization. Since these prediction disparities can exacerbate social inequity if prediction results without fairness adjustment are used for transportation policy making, we advocate for careful consideration of the fairness problem in travel behavior modeling, and the use of bias mitigation algorithms for fair transport decisions.


abstract: In this work, we propose Random Walk-steered Majority Undersampling (RWMaU), which undersamples the majority points of a class imbalanced dataset, in order to balance the classes. Rather than marking the majority points which belong to the neighborhood of a few minority points, we are interested to perceive the closeness of the majority points to the minority class. Random walk, a powerful tool for perceiving the proximities of connected points in a graph, is used to identify the majority points which lie close to the minority class of a class-imbalanced dataset. The visit frequencies and the order of visits of the majority points in the walks enable us to perceive an overall closeness of the majority points to the minority class. The ones lying close to the minority class are subsequently undersampled. Empirical evaluation on 21 datasets and 3 classifiers demonstrate substantial improvement in performance of RWMaU over the competing methods.


title: Coreference Resolution for the Biomedical Domain: A Survey

abstract: Issues with coreference resolution are one of the most frequently mentioned challenges for information extraction from the biomedical literature. Thus, the biomedical genre has long been the second most researched genre for coreference resolution after the news domain, and the subject of a great deal of research for NLP in general. In recent years this interest has grown enormously leading to the development of a number of substantial datasets, of domain-specific contextual language models, and of several architectures. In this paper we review the state-of-the-art of coreference in the biomedical domain with a particular attention on these most recent developments.


title: L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning

abstract: Neural architecture search (NAS) has achieved remarkable results in deep neural network design. Differentiable architecture search converts the search over discrete architectures into a hyperparameter optimization problem which can be solved by gradient descent. However, questions have been raised regarding the effectiveness and generalizability of gradient methods for solving non-convex architecture hyperparameter optimization problems. In this paper, we propose L$^{2}$NAS, which learns to intelligently optimize and update architecture hyperparameters via an actor neural network based on the distribution of high-performing architectures in the search history. We introduce a quantile-driven training procedure which efficiently trains L$^{2}$NAS in an actor-critic framework via continuous-action reinforcement learning. Experiments show that L$^{2}$NAS achieves state-of-the-art results on NAS-Bench-201 benchmark as well as DARTS search space and Once-for-All MobileNetV3 search space. We also show that search policies generated by L$^{2}$NAS are generalizable and transferable across different training datasets with minimal fine-tuning.


title: Profiling Neural Blocks and Design Spaces for Mobile Neural Architecture Search

abstract: Neural architecture search automates neural network design and has achieved state-of-the-art results in many deep learning applications. While recent literature has focused on designing networks to maximize accuracy, little work has been conducted to understand the compatibility of architecture design spaces to varying hardware. In this paper, we analyze the neural blocks used to build Once-for-All (MobileNetV3), ProxylessNAS and ResNet families, in order to understand their predictive power and inference latency on various devices, including Huawei Kirin 9000 NPU, RTX 2080 Ti, AMD Threadripper 2990WX, and Samsung Note10. We introduce a methodology to quantify the friendliness of neural blocks to hardware and the impact of their placement in a macro network on overall network performance via only end-to-end measurements. Based on extensive profiling results, we derive design insights and apply them to hardware-specific search space reduction. We show that searching in the reduced search space generates better accuracy-latency Pareto frontiers than searching in the original search spaces, customizing architecture search according to the hardware. Moreover, insights derived from measurements lead to notably higher ImageNet top-1 scores on all search spaces investigated.


title: Improved Soft Duplicate Detection in Search-Based Motion Planning

abstract: Search-based techniques have shown great success in motion planning problems such as robotic navigation by discretizing the state space and precomputing motion primitives. However in domains with complex dynamic constraints, constructing motion primitives in a discretized state space is non-trivial. This requires operating in continuous space which can be challenging for search-based planners as they can get stuck in local minima regions. Previous work on planning in continuous spaces introduced soft duplicate detection which requires search to compute the duplicity of a state with respect to previously seen states to avoid exploring states that are likely to be duplicates, especially in local minima regions. They propose a simple metric utilizing the euclidean distance between states, and proximity to obstacles to compute the duplicity. In this paper, we improve upon this metric by introducing a kinodynamically informed metric, subtree overlap, between two states as the similarity between their successors that can be reached within a fixed time horizon using kinodynamic motion primitives. This captures the intuition that, due to robot dynamics, duplicate states can be far in euclidean distance and result in very similar successor states, while non-duplicate states can be close and result in widely different successors.


title: Vaccine efficacy and SARS CoV 2 control in California and USA during the session 2020 2026: A modeling study

abstract: Besides maintaining health precautions, vaccination has been the only prevention from SARS-CoV-2, though no clinically proved 100% effective vaccine has been developed till date. At this stage, to withhold the debris of this pandemic, experts need to know the impact of the vaccine efficacy rate's threshold and how long this pandemic may extent with vaccines that have different efficacy rates. In this article, a mathematical model study has been done on the importance of vaccination and vaccine efficiency rate during an ongoing pandemic. We simulated a five compartment mathematical model to analyze the pandemic scenario in both California, and whole U.S. We considered four vaccines, Pfizer, Moderna, AstraZeneca, and Johnson and Johnson, which are being used rigorously to control the COVID-19 pandemic, in addition with two special cases: a vaccine with 100% efficacy rate and no vaccine under use. Both the infection and death rates are very high in California. Our model suggests that the pandemic situation in California will be under control in the last quartile of the year 2023 if frequent vaccination is continued with the Pfizer vaccine. During this time, six waves will happen from the beginning of the immunization where the case fatality and recovery rates will be 1.697% and 98.30%, respectively. However, according to the considered model, this period might be extended to the mid of 2024 when vaccines with lower efficacy rates are used. The more effective a vaccine, the less people suffer from this malign infection. Although specific groups of people get prioritized initially, mass vaccination is needed to control the spread of the disease.


title: A new graph decomposition method for bipartite graphs

abstract: Given a sufficiently large and sufficiently dense bipartite graph $G=(A, B; E),$ we present a novel method for decomposing the majority of the edges of $G$ into quasirandom graphs so that the vertex sets of these quasirandom graphs partition the majority of $A.$ The method works for relatively small or sparse graphs, and can be used to substitute the Regularity lemma of Szemer\'edi in some graph embedding problems.


title: Staggered mesh method for correlation energy calculations of solids: Random phase approximation in direct ring coupled cluster doubles and adiabatic connection formalisms

abstract: We propose a staggered mesh method for correlation energy calculations of periodic systems under the random phase approximation (RPA), which generalizes the recently developed staggered mesh method for periodic second order M{\o}ller-Plesset perturbation theory (MP2) calculations [Xing, Li, Lin, JCTC 2021]. Compared to standard RPA calculations, the staggered mesh method introduces negligible additional computational cost. It avoids a significant portion of the finite-size error, and can be asymptotically advantageous for quasi-1D systems and certain quasi-2D and 3D systems with high symmetries. We demonstrate the applicability of the method using two different formalisms: the direct ring coupled cluster doubles (drCCD) theory, and the adiabatic-connection (AC) fluctuation-dissipation theory. In the drCCD formalism, the second order screened exchange (SOSEX) correction can also be readily obtained using the staggered mesh method. In the AC formalism, the staggered mesh method naturally avoids the need of performing "head/wing" corrections to the dielectric operator. The effectiveness of the staggered mesh method for insulating systems is theoretically justified by investigating the finite-size error of each individual perturbative term in the RPA correlation energy, expanded as an infinite series of terms associated with ring diagrams. As a side contribution, our analysis provides a proof that the finite-size error of each perturbative term of standard RPA and SOSEX calculations scales as $\mathcal{O}(N_{\mathbf{k}}^{-1})$, where $N_{\mathbf{k}}$ is the number of grid points in a Monkhorst-Pack mesh.


title: Contrastive Unpaired Translation using Focal Loss for Patch Classification

abstract: Image-to-image translation models transfer images from input domain to output domain in an endeavor to retain the original content of the image. Contrastive Unpaired Translation is one of the existing methods for solving such problems. Significant advantage of this method, compared to competitors, is the ability to train and perform well in cases where both input and output domains are only a single image. Another key thing that differentiates this method from its predecessors is the usage of image patches rather than the whole images. It also turns out that sampling negatives (patches required to calculate the loss) from the same image achieves better results than a scenario where the negatives are sampled from other images in the dataset. This type of approach encourages mapping of corresponding patches to the same location in relation to other patches (negatives) while at the same time improves the output image quality and significantly decreases memory usage as well as the time required to train the model compared to CycleGAN method used as a baseline. Through a series of experiments we show that using focal loss in place of cross-entropy loss within the PatchNCE loss can improve on the model's performance and even surpass the current state-of-the-art model for image-to-image translation.


title: A spanning union of cycles in rectangular grid graphs, thick grid cylinders and Moebius strips

abstract: Motivated to find the answers to some of the questions that have occurred in recent papers dealing with Hamiltonian cycles (abbreviated HCs) in some special classes of grid graphs we started the investigation of spanning unions of cycles, the so-called 2-factors, in these graphs (as a generalizations of HCs). For all the three types of graphs from the title and for any integer $m \geq 2$ we propose an algorithm for obtaining a specially designed (transfer) digraph ${\cal D}^*_m$. The problem of enumeration of 2-factors is reduced to the problem of enumerating oriented walks in this digraph. Computational results we gathered for $m \leq 17$ reveal some interesting properties both for the digraphs ${\cal D}^*_m$ and for the sequences of numbers of 2-factors. We prove some of them for arbitrary $m \geq 2$.


title: Blind Interference Alignment in 6G Optical Wireless Communications

abstract: In recent years, the demand for high speed wireless networking has increased considerably due to the enormous number of devices connected to the Internet. In this context, optical wireless communication (OWC) has received tremendous interest in the context of next generation wireless networks where OWC offers a huge unlicensed bandwidth using optical bands. OWC systems are directional and can naturally provide multiple-input and multiple-output (MIMO) configurations serving multiple users using a high number of transmitters in the indoor environment to ensure coverage. Therefore, multiuser interference must be managed efficiently to enhance the performance of OWC networks considering different metrics. A transmission scheme referred to as blind interference alignment (BIA) is proposed for OWC systems to maximize the multiplexing gain without the need for channel state information (CSI) at the transmitters, which is difficult to achieve in MIMO scenarios. However, standard BIA avoids the need for CSI at the cost of requiring channel coherence time large enough for transmitting the whole transmission block. Moreover, the methodology of BIA results in increased noise with increase in the number of transmitters and users. Therefore, various network topologies such as network centric (NC) and user centric (UC) designs are proposed to relax the limitations of BIA where these topologies divide the receiving area into multiple clusters. The results show a significant enhancement in the performance of topological BIA compared with standard BIA.


title: Emergent behavior and neural dynamics in artificial agents tracking turbulent plumes

abstract: Tracking a turbulent plume to locate its source is a complex control problem because it requires multi-sensory integration and must be robust to intermittent odors, changing wind direction, and variable plume statistics. This task is routinely performed by flying insects, often over long distances, in pursuit of food or mates. Several aspects of this remarkable behavior have been studied in detail in many experimental studies. Here, we take a complementary in silico approach, using artificial agents trained with reinforcement learning to develop an integrated understanding of the behaviors and neural computations that support plume tracking. Specifically, we use deep reinforcement learning (DRL) to train recurrent neural network (RNN) agents to locate the source of simulated turbulent plumes. Interestingly, the agents' emergent behaviors resemble those of flying insects, and the RNNs learn to represent task-relevant variables, such as head direction and time since last odor encounter. Our analyses suggest an intriguing experimentally testable hypothesis for tracking plumes in changing wind direction -- that agents follow local plume shape rather than the current wind direction. While reflexive short-memory behaviors are sufficient for tracking plumes in constant wind, longer timescales of memory are essential for tracking plumes that switch direction. At the level of neural dynamics, the RNNs' population activity is low-dimensional and organized into distinct dynamical structures, with some correspondence to behavioral modules. Our in silico approach provides key intuitions for turbulent plume tracking strategies and motivates future targeted experimental and theoretical developments.

categories: q-bio.NC cs.AI cs.LG cs.NE cs.SY eess.SY


title: Tailoring Zr-based metal organic frameworks by decorating UIO-66 with amino group for adsorption removal of perfluorooctanoic acid from water

abstract: As a persistent pollutant, PFOA places a serious threat to natural ecosystems and human health for its global distribution and residual. Currently, adsorption technology is a promising approach for PFOA removal. MOFs become a concerned adsorbent attributing to its special designability and easy modular synthesis. Aiming at improving hydrophobic interactions to absorb PFOA, this study was designed to introduce amino group to decorate Zr-based MOF UiO-66. And subsequently introduced GO to modify UiO-66-NH2 to explore the influence of hydrophobicity on PFOA adsorption removal. Based on the performance of the characterization of synthesized products, the adsorption removal effect of PFOA and the corresponding adsorption mechanism were discussed. The results indicate the introduction of the amino group could enlarge the pore size, but also display strong hydrophobic effects, significantly enhance the adsorption capacity(maximum capacity was 1653mg/g). This work not only provides the method of introducing amino group to Zr-based MOFs to strengthen the hydrophobic properties in purpose of removing PFOA efficiently, but also proposes the feasible the reference for tailoring MOFs to remove endurable organic pollutants in water.


title: Bidirectional deep learning of polarization transfer in liquid crystals with application to quantum state preparation

abstract: Accurate control of light polarization represents a core building block in polarization metrology, imaging, and optical and quantum communications. Voltage-controlled liquid crystals offer an efficient way of polarization transformation. However, common twisted nematic liquid crystals are notorious for lacking an accurate theoretical model linking control voltages and output polarization. An inverse model, which would predict control voltages required to prepare a target polarization, is even more challenging. Here we report both the direct and inverse models based on deep neural networks, radial basis functions, and linear interpolation. We present an inverse-direct compound model solving the problem of control voltages ambiguity. We demonstrate one order of magnitude improvement in accuracy using deep learning compared to the radial basis function method and two orders of magnitude improvement compared to the linear interpolation. Errors of the deep neural network model also decrease faster than the other methods with an increasing number of training data. The best direct and inverse models reach the average infidelities of $4 \times 10^{-4}$ and $2 \times 10^{-4}$, respectively, which is the accuracy level not reported yet. Furthermore, we demonstrate local and remote preparation of an arbitrary single-photon polarization state using the deep learning models. The results will impact the application of twisted-nematic liquid crystals, increasing their control accuracy across the board. The presented bidirectional learning can be used for optimal classical control of complex photonic devices and quantum circuits beyond interpolation.


title: S+ property for divergence operator $-{\rm div}\ a(z, u(z), \nabla u(z))$ with $p(\cdot)$-growth condition and applications

abstract: We establish a result which provides the criteria for a divergence operator dependent both on the gradient and the function itself, to satisfy the S+ property. The result is complemented by several examples and an application.


title: The Aharonov Bohm effect as a material phenomenon

abstract: An experiment to observe the Aharonov-Bohm effect is discussed. A solenoid which consists of a large number of point magnetic dipoles is considered as the source of a vector potential, which acts on a charged particle, and such potential has an electromagnetic field of zero strength in the region of a nonzero vector potential. A detailed microscopic analysis of the change in the quantum state phase of the entire system, namely, a particle and a set of dipoles, reveals the origin of the apparent nonlocality of the action of the vector potential, and shows the locality of the phase change mechanism. An analysis of an experiment with a solenoid shielded by a superconducting shell is given.


title: Residual velocities of Small Magellanic Cloud star clusters

abstract: We analyzed the largest Small Magellanic Cloud (SMC) cluster sample (32) with proper motions and radial velocity measurements, from which we obtained their space velocity components. By adopting as a reference the recent best-fitted rotating disc of SMC star clusters as a function of the position angle, we computed their residual velocity vectors, and compared their magnitudes ($\Delta$V) with that of a cluster with residual velocity components equal to the velocity dispersions along the three independent SMC rotating disc axes of motion ($\Delta$V = 60 km/s). We found that clusters that belong to SMC tidally induced structures have $\Delta$V > 50 km/s, which suggests that space velocities of clusters in the process of escaping the rotating disc kinematics, are measurably different. Studied clusters pertaining to a northern branch of the Magellanic Bridge, the main Magellanic Bridge, the Counter-Bridge and the West halo give support to these findings. NGC 121, the oldest known SMC cluster, does not belong to any SMC tidal feature, and has $\Delta$V = 64 km/s, slightly above the boundary between bound and kinematically perturbed clusters.


title: Smart Home Energy Management: Sequence-to-Sequence Load Forecasting and Q-Learning

abstract: A smart home energy management system (HEMS) can contribute towards reducing the energy costs of customers; however, HEMS suffers from uncertainty in both energy generation and consumption patterns. In this paper, we propose a sequence to sequence (Seq2Seq) learning-based supply and load prediction along with reinforcement learning-based HEMS control. We investigate how the prediction method affects the HEMS operation. First, we use Seq2Seq learning to predict photovoltaic (PV) power and home devices' load. We then apply Q-learning for offline optimization of HEMS based on the prediction results. Finally, we test the online performance of the trained Q-learning scheme with actual PV and load data. The Seq2Seq learning is compared with VARMA, SVR, and LSTM in both prediction and operation levels. The simulation results show that Seq2Seq performs better with a lower prediction error and online operation performance.


title: Accelerated consensus in multi-agent networks via memory of local averages

abstract: Classical mathematical models of information sharing and updating in multi-agent networks use linear operators. In the paradigmatic DeGroot model, agents update their states with linear combinations of their neighbors' current states. In prior work, an accelerated averaging model employing the use of memory has been suggested to accelerate convergence to a consensus state for undirected networks. There, the DeGroot update on the current states is followed by a linear combination with the previous states. We propose a modification where the DeGroot update is applied to the current and previous states and is then followed by a linear combination step. We show that this simple modification applied to undirected networks permits convergence even for periodic networks. Further, it allows for faster convergence than the DeGroot and accelerated averaging models for suitable networks and model parameters.


title: Unblind the charts: Towards Making Interactive Charts Accessible in Android Applications

abstract: Smartphones are a crucial aspect of routine life in the modern world, and viewing information graphics such as charts becomes common practice for many unassuming tasks. However, for the vision impaired, accessing graphical material presents many difficulties. Android smartphones usually come preinstalled with Google Talkback as a default screen-reader, which attempts to cater for the visually impaired by providing supplementary auditory information when interfacing with supported applications. Still, the crux of this situation is that screen-readers rely on developers correctly implementing the required accessibility guidelines for UI elements, such as charts. Unfortunately, according to the empirical study, more than 88% of the charts found in real-world Android applications are inaccessible to a vision-impaired user, contributing to the wider accessibility issues faced by vision impaired users of smartphones. These accessibility issues can be attributed to a knowledge gap in considering possible disabilities for users, and time costs for developers. To overcome these challenges, this study proposes CAM (Chart Accessibility Module), which aims to reduce time and bridge the knowledge gap required to implement chart accessibility. CAM has two steps, generating chart summary using raw data and feeding it to the screen-reader using the Android Accessibility API for MPAndroidChart library. The user study results show that CAM significantly reduces difficulty and time taken to implement accessibility for application developers.


title: Basil: Breaking up BFT with ACID (transactions)

abstract: This paper presents Basil, the first transactional, leaderless Byzantine Fault Tolerant key-value store. Basil leverages ACID transactions to scalably implement the abstraction of a trusted shared log in the presence of Byzantine actors. Unlike traditional BFT approaches, Basil executes non-conflicting operations in parallel and commits transactions in a single round-trip during fault-free executions. Basil improves throughput over traditional BFT systems by four to five times, and is only four times slower than TAPIR, a non-Byzantine replicated system. Basil's novel recovery mechanism further minimizes the impact of failures: with 30% Byzantine clients, throughput drops by less than 25% in the worst-case.


title: Solvable Lie algebras derived from Lie hyperalgebras

abstract: Recently in \cite{s-n}, we have investigated Lie algebras and abelian Lie algebras derived from Lie hyperalgebras using the fundamental relations $\mathcal{L}$ and $\mathcal{A}$, respectively. In the present paper, continuing this method we obtain solvable Lie algebras from Lie hyperalgebras by $\mathcal{S}_n$-relations. We show that $\bigcap_{n\geq 1}\mathcal{S}^*_n$ is the smallest equivalence relation on a Lie hyperalgebra such that the quotient structure is a solvable Lie algebra. We also provide some necessary and sufficient conditions for transitivity of the relation $\mathcal{S}_n$ using the notion of $\mathcal{S}_n$-part.


title: Algorithmic Information Design in Multi-Player Games: Possibility and Limits in Singleton Congestion

abstract: Most algorithmic studies on multi-agent information design so far have focused on the restricted situation with no inter-agent externalities; a few exceptions investigated truly strategic games such as zero-sum games and second-price auctions but have all focused only on optimal public signaling. This paper initiates the algorithmic information design of both \emph{public} and \emph{private} signaling in a fundamental class of games with negative externalities, i.e., singleton congestion games, with wide application in today's digital economy, machine scheduling, routing, etc. For both public and private signaling, we show that the optimal information design can be efficiently computed when the number of resources is a constant. To our knowledge, this is the first set of efficient \emph{exact} algorithms for information design in succinctly representable many-player games. Our results hinge on novel techniques such as developing certain "reduced forms" to compactly characterize equilibria in public signaling or to represent players' marginal beliefs in private signaling. When there are many resources, we show computational intractability results. To overcome the issue of multiple equilibria, here we introduce a new notion of equilibrium-\emph{oblivious} hardness, which rules out any possibility of computing a good signaling scheme, irrespective of the equilibrium selection rule.


title: Multi-band $s_{++}$ superconductivity in $\textrm{V}_{3}\textrm{Si}$ determined from the response to a controlled disorder

abstract: The London penetration depth, $\lambda(T)$, was measured in a single crystal V$_{3}$Si. The superfluid density obtained from this measurement shows a distinct signature of two almost decoupled superconducting gaps. This alone is insufficient to distinguish between $s_{\pm}$ and $s_{++}$ pairing states, but it can be achieved by studying the effect of a controlled non-magnetic disorder on the superconducting transition temperature, $T_{c}$. For this purpose, the same $\text{V}_{3}\text{Si}$ crystal was sequentially irradiated by 2.5 MeV electrons three times, repeating the measurement between the irradiation runs. A total dose of 10 C/cm$^{2}$ ($6.24\times10^{19}$ electrons/$\textrm{cm}^{2}$) was accumulated, for which $T_{c}$ has changed from 16.4 K in a pristine state to 14.7 K (9.3 $\%$). This substantial suppression is impossible for a single isotropic gap, but also it is not large enough for a sign-changing $s_{\pm}$ pairing state. Our electronic band-structure calculations show how five bands crossing the Fermi energy can be naturally grouped to support two effective gaps, not dissimilar from the iron pnictides physics. We analyze the results using two-gap models for both, $\lambda(T)$ and $T_{c}$, which describe the data very well. Thus, the experimental results and theoretical analysis provide strong support for an $s_{++}$ superconductivity with two unequal gaps, $\Delta_{1}\left(0\right)\approx2.53\;\textrm{meV}$ and $\Delta_{2}\left(0\right)\approx1.42\;\textrm{meV}$, and a very weak inter-band coupling in $\text{V}_{3}\text{Si}$ superconductor.


title: Space-time integral currents of bounded variation

abstract: Motivated by a recent model for elasto-plastic evolutions that are driven by the flow of dislocations, this work develops a theory of space-time integral currents with bounded variation in time, which enables a natural variational approach to the analysis of rate-independent geometric evolutions. Based on this, we further introduce the notion of Lipschitz deformation distance between integral currents, which arises physically as a (simplified) dissipation distance. Several results are obtained: A Helly-type compactness theorem, a deformation theorem, an isoperimetric inequality, and the equivalence of the convergence in deformation distance with the classical notion of weak* (or flat) convergence. Finally, we prove that the Lipschitz deformation distance agrees with the (integral) homogeneous Whitney flat metric for boundaryless currents. Physically, this means that two seemingly different ways to measure the dissipation actually coincide.


title: ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos

abstract: Semantic segmentation in surgical videos is a prerequisite for a broad range of applications towards improving surgical outcomes and surgical video analysis. However, semantic segmentation in surgical videos involves many challenges. In particular, in cataract surgery, various features of the relevant objects such as blunt edges, color and context variation, reflection, transparency, and motion blur pose a challenge for semantic segmentation. In this paper, we propose a novel convolutional module termed as \textit{ReCal} module, which can calibrate the feature maps by employing region intra-and-inter-dependencies and channel-region cross-dependencies. This calibration strategy can effectively enhance semantic representation by correlating different representations of the same semantic label, considering a multi-angle local view centering around each pixel. Thus the proposed module can deal with distant visual characteristics of unique objects as well as cross-similarities in the visual characteristics of different objects. Moreover, we propose a novel network architecture based on the proposed module termed as ReCal-Net. Experimental results confirm the superiority of ReCal-Net compared to rival state-of-the-art approaches for all relevant objects in cataract surgery. Moreover, ablation studies reveal the effectiveness of the ReCal module in boosting semantic segmentation accuracy.


title: AbstractDifferentiation.jl: Backend-Agnostic Differentiable Programming in Julia

abstract: No single Automatic Differentiation (AD) system is the optimal choice for all problems. This means informed selection of an AD system and combinations can be a problem-specific variable that can greatly impact performance. In the Julia programming language, the major AD systems target the same input and thus in theory can compose. Hitherto, switching between AD packages in the Julia Language required end-users to familiarize themselves with the user-facing API of the respective packages. Furthermore, implementing a new, usable AD package required AD package developers to write boilerplate code to define convenience API functions for end-users. As a response to these issues, we present AbstractDifferentiation.jl for the automatized generation of an extensive, unified, user-facing API for any AD package. By splitting the complexity between AD users and AD developers, AD package developers only need to implement one or two primitive definitions to support various utilities for AD users like Jacobians, Hessians and lazy product operators from native primitives such as pullbacks or pushforwards, thus removing tedious -- but so far inevitable -- boilerplate code, and enabling the easy switching and composing between AD implementations for end-users.


title: Joint Parameter and State Estimation of Noisy Discrete-Time Nonlinear Systems: A Supervisory Multi-Observer Approach

abstract: This paper presents two schemes to jointly estimate parameters and states of discrete-time nonlinear systems in the presence of bounded disturbances and noise and where the parameters belong to a known compact set. The schemes are based on sampling the parameter space and designing a state observer for each sample. A supervisor selects one of these observers at each time instant to produce the parameter and state estimates. In the first scheme, the parameter and state estimates are guaranteed to converge within a certain margin of their true values in finite time, assuming that a sufficiently large number of observers is used and a persistence of excitation condition is satisfied in addition to other observer design conditions. This convergence margin is constituted by a part that can be chosen arbitrarily small by the user and a part determined by the noise levels. The second scheme exploits the convergence properties of the parameter estimate to perform subsequent zoom-ins on the parameter subspace to achieve stricter margins for a given number of observers. The strengths of both schemes are demonstrated using a numerical example.


title: Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding

abstract: A large-scale conversational agent can suffer from understanding user utterances with various ambiguities such as ASR ambiguity, intent ambiguity, and hypothesis ambiguity. When ambiguities are detected, the agent should engage in a clarifying dialog to resolve the ambiguities before committing to actions. However, asking clarifying questions for all the ambiguity occurrences could lead to asking too many questions, essentially hampering the user experience. To trigger clarifying questions only when necessary for the user satisfaction, we propose a neural self-attentive model that leverages the hypotheses with ambiguities and contextual signals. We conduct extensive experiments on five common ambiguity types using real data from a large-scale commercial conversational agent and demonstrate significant improvement over a set of baseline approaches.


title: Optimal Precoder Design for MIMO-OFDM-based Joint Automotive Radar-Communication Networks

abstract: Large-scale deployment of connected vehicles with cooperative awareness technologies increases the demand for vehicle-to-everything (V2X) communication spectrum in 5.9 GHz that is mainly allocated for the exchange of safety messages. To supplement V2X communication and support the high data rates needed by broadband applications, the millimeter-wave (mmWave) automotive radar spectrum at 76-81 GHz can be utilized. For this purpose, joint radar-communication systems have been proposed in the literature to perform both functions using the same waveform and hardware. While multiple-input and multiple-output (MIMO) communication with multiple users enables independent data streaming for high throughput, MIMO radar processing provides high-resolution imaging that is crucial for safety-critical systems. However, employing conventional precoding methods designed for communication generates directional beams that impair MIMO radar imaging and target tracking capabilities during data streaming. In this paper, we propose a MIMO joint automotive radar-communication (JARC) framework based on orthogonal frequency division multiplexing (OFDM) waveform. First, we show that the MIMO-OFDM preamble can be exploited for both MIMO radar processing and estimation of the communication channel. Then, we propose an optimal precoder design method that enables high accuracy target tracking while transmitting independent data streams to multiple receivers. The proposed methods provide high-resolution radar imaging and high throughput capabilities for MIMO JARC networks. Finally, we evaluate the efficacy of the proposed methods through numerical simulations.


title: Classification of COVID-19 from CXR Images in a 15-class Scenario: an Attempt to Avoid Bias in the System

abstract: As of June 2021, the World Health Organization (WHO) has reported 171.7 million confirmed cases including 3,698,621 deaths from COVID-19. Detecting COVID-19 and other lung diseases from Chest X-Ray (CXR) images can be very effective for emergency diagnosis and treatment as CXR is fast and cheap. The objective of this study is to develop a system capable of detecting COVID-19 along with 14 other lung diseases from CXRs in a fair and unbiased manner. The proposed system consists of a CXR image selection technique and a deep learning based model to classify 15 diseases including COVID-19. The proposed CXR selection technique aims to retain the maximum variation uniformly and eliminate poor quality CXRs with the goal of reducing the training dataset size without compromising classifier accuracy. More importantly, it reduces the often hidden bias and unfairness in decision making. The proposed solution exhibits a promising COVID-19 detection scheme in a more realistic situation than most existing studies as it deals with 15 lung diseases together. We hope the proposed method will have wider adoption in medical image classification and other related fields.


title: Good-case and Bad-case Latency of Unauthenticated Byzantine Broadcast: A Complete Categorization

abstract: This paper studies the {\em good-case latency} of {\em unauthenticated} Byzantine fault-tolerant broadcast, which measures the time it takes for all non-faulty parties to commit given a non-faulty broadcaster. For both asynchrony and synchrony, we show that $n\geq 4f$ is the tight resilience threshold that separates good-case 2 rounds and 3 rounds. For asynchronous Byzantine reliable broadcast (BRB), we also investigate the {\em bad-case latency} for all non-faulty parties to commit when the broadcaster is faulty but some non-faulty party commits. We provide matching upper and lower bounds on the resilience threshold of bad-case latency for BRB protocols with optimal good-case latency of 2 rounds. In particular, we show 2 impossibility results and propose 4 asynchronous BRB protocols.


title: Shuffle Squares and Reverse Shuffle Squares

abstract: Let $\mathcal{SS}_k(n)$ be the family of {\it shuffle squares} in $[k]^{2n}$, words that can be partitioned into two disjoint identical subsequences. Let $\mathcal{RSS}_k(n)$ be the family of {\it reverse shuffle squares} in $[k]^{2n}$, words that can be partitioned into two disjoint subsequences which are reverses of each other. Henshall, Rampersad, and Shallit conjectured asymptotic formulas for the sizes of $\mathcal{SS}_k(n)$ and $\mathcal{RSS}_k(n)$ based on numerical evidence. We prove that \[ \lvert \mathcal{SS}_k(n) \rvert=\dfrac{1}{n+1}\dbinom{2n}{n}k^n-\dbinom{2n-1}{n+1}k^{n-1}+O_n(k^{n-2}), \] confirming their conjecture for $\mathcal{SS}_k(n)$. We also prove a similar asymptotic formula for reverse shuffle squares that disproves their conjecture for $\lvert \mathcal{RSS}_k(n) \rvert$. As these asymptotic formulas are vacuously true when the alphabet size is small, we study the binary case separately and prove that $|\mathcal{SS}_2(n)| \ge \binom{2n}{n}$.


title: Auditing AI models for Verified Deployment under Semantic Specifications

abstract: Auditing trained deep learning (DL) models prior to deployment is vital for preventing unintended consequences. One of the biggest challenges in auditing is the lack of human-interpretable specifications for the DL models that are directly useful to the auditor. We address this challenge through a sequence of semantically-aligned unit tests, where each unit test verifies whether a predefined specification (e.g., accuracy over 95%) is satisfied with respect to controlled and semantically aligned variations in the input space (e.g., in face recognition, the angle relative to the camera). We enable such unit tests through variations in a semantically-interpretable latent space of a generative model. Further, we conduct certified training for the DL model through a shared latent space representation with the generative model. With evaluations on four different datasets, covering images of chest X-rays, human faces, ImageNet classes, and towers, we show how AuditAI allows us to obtain controlled variations for certified training. Thus, our framework, AuditAI, bridges the gap between semantically-aligned formal verification and scalability. A blog post accompanying the paper is at this link https://developer.nvidia.com/blog/nvidia-research-auditing-ai-models-for-verified-deployment-under-semantic-specifications


title: Learning to Selectively Learn for Weakly-supervised Paraphrase Generation

abstract: Paraphrase generation is a longstanding NLP task that has diverse applications for downstream NLP tasks. However, the effectiveness of existing efforts predominantly relies on large amounts of golden labeled data. Though unsupervised endeavors have been proposed to address this issue, they may fail to generate meaningful paraphrases due to the lack of supervision signals. In this work, we go beyond the existing paradigms and propose a novel approach to generate high-quality paraphrases with weak supervision data. Specifically, we tackle the weakly-supervised paraphrase generation problem by: (1) obtaining abundant weakly-labeled parallel sentences via retrieval-based pseudo paraphrase expansion; and (2) developing a meta-learning framework to progressively select valuable samples for fine-tuning a pre-trained language model, i.e., BART, on the sentential paraphrasing task. We demonstrate that our approach achieves significant improvements over existing unsupervised approaches, and is even comparable in performance with supervised state-of-the-arts.


title: Acceleration and deceleration of quantum dynamics based on inter-trajectory travel with fast-forward scaling theory

abstract: Quantum information processing requires fast manipulations of quantum systems in order to overcome dissipative effects. We propose a method to accelerate quantum dynamics and obtain a target state in a shorter time relative to unmodified dynamics, and apply the theory to a system consisting of two linearly coupled qubits. We extend the technique to accelerate quantum adiabatic evolution in order to rapidly generate a desired target state, thereby realizing a shortcut to adiabaticity. Further, we address experimental limitations to the rate of change of control parameters for quantum devices which often limit one's ability to generate a desired target state with high fidelity. We show that an initial state following decelerated dynamics can reach a target state while varying control parameters more slowly, enabling more experimentally feasible driving schemes.


title: Two Souls in an Adversarial Image: Towards Universal Adversarial Example Detection using Multi-view Inconsistency

abstract: In the evasion attacks against deep neural networks (DNN), the attacker generates adversarial instances that are visually indistinguishable from benign samples and sends them to the target DNN to trigger misclassifications. In this paper, we propose a novel multi-view adversarial image detector, namely Argos, based on a novel observation. That is, there exist two "souls" in an adversarial instance, i.e., the visually unchanged content, which corresponds to the true label, and the added invisible perturbation, which corresponds to the misclassified label. Such inconsistencies could be further amplified through an autoregressive generative approach that generates images with seed pixels selected from the original image, a selected label, and pixel distributions learned from the training data. The generated images (i.e., the "views") will deviate significantly from the original one if the label is adversarial, demonstrating inconsistencies that Argos expects to detect. To this end, Argos first amplifies the discrepancies between the visual content of an image and its misclassified label induced by the attack using a set of regeneration mechanisms and then identifies an image as adversarial if the reproduced views deviate to a preset degree. Our experimental results show that Argos significantly outperforms two representative adversarial detectors in both detection accuracy and robustness against six well-known adversarial attacks. Code is available at: https://github.com/sohaib730/Argos-Adversarial_Detection