title: Schema matching using Gaussian mixture models with Wasserstein distance

abstract: Gaussian mixture models find their place as a powerful tool, mostly in the clustering problem, but with proper preparation also in feature extraction, pattern recognition, image segmentation and in general machine learning. When faced with the problem of schema matching, different mixture models computed on different pieces of data can maintain crucial information about the structure of the dataset. In order to measure or compare results from mixture models, the Wasserstein distance can be very useful, however it is not easy to calculate for mixture distributions. In this paper we derive one of possible approximations for the Wasserstein distance between Gaussian mixture models and reduce it to linear problem. Furthermore, application examples concerning real world data are shown.


title: Bredon homology of wallpaper groups

abstract: In this paper we compute the Bredon homology of wallpaper groups with respect to the family of finite groups and with coefficients in the complex representation ring. We provide explicit bases of the homology groups in terms of irreducible characters of the representation rings of the stabilizers.


title: Payoff landscapes and the robustness of selfish optimization in iterated games

abstract: In iterated games, a player can unilaterally exert influence over the outcome through a careful choice of strategy. A powerful class of such "payoff control" strategies was discovered by Press and Dyson (2012). Their so-called "zero-determinant" (ZD) strategies allow a player to unilaterally enforce a linear relationship between both players' payoffs. It was subsequently shown by Chen and Zinger (2014) that when the slope of this linear relationship is positive, ZD strategies are robustly effective against a selfishly optimizing co-player, in that all adapting paths of the selfish player lead to the maximal payoffs for both players (at least when there are certain restrictions on the game parameters). In this paper, we investigate the efficacy of selfish learning against a fixed player in more general settings, for both ZD and non-ZD strategies. We first prove that in any symmetric $2\times 2$ game, the selfish player's final strategy must be of a certain form and cannot be fully stochastic. We then show that there are prisoner's dilemma interactions for which selfish optimization does not always lead to maximal payoffs against fixed ZD strategies with positive slope. We give examples of selfish adapting paths that lead to locally but not globally optimal payoffs, undermining the robustness of payoff control strategies. For non-ZD strategies, these pathologies arise regardless of the original restrictions on the game parameters. Our results illuminate the difficulty of implementing robust payoff control and selfish optimization, even in the simplest context of playing against a fixed strategy.


title: A Survey of Large-Scale Deep Learning Serving System Optimization: Challenges and Opportunities

abstract: Deep Learning (DL) models have achieved superior performance in many application domains, including vision, language, medical, commercial ads, entertainment, etc. With the fast development, both DL applications and the underlying serving hardware have demonstrated strong scaling trends, i.e., Model Scaling and Compute Scaling, for example, the recent pre-trained model with hundreds of billions of parameters with ~TB level memory consumption, as well as the newest GPU accelerators providing hundreds of TFLOPS. With both scaling trends, new problems and challenges emerge in DL inference serving systems, which gradually trends towards Large-scale Deep learning Serving systems (LDS). This survey aims to summarize and categorize the emerging challenges and optimization opportunities for large-scale deep learning serving systems. By providing a novel taxonomy, summarizing the computing paradigms, and elaborating the recent technique advances, we hope that this survey could shed light on new optimization perspectives and motivate novel works in large-scale deep learning system optimization.


title: Fed2: Feature-Aligned Federated Learning

abstract: Federated learning learns from scattered data by fusing collaborative models from local nodes. However, the conventional coordinate-based model averaging by FedAvg ignored the random information encoded per parameter and may suffer from structural feature misalignment. In this work, we propose Fed2, a feature-aligned federated learning framework to resolve this issue by establishing a firm structure-feature alignment across the collaborative models. Fed2 is composed of two major designs: First, we design a feature-oriented model structure adaptation method to ensure explicit feature allocation in different neural network structures. Applying the structure adaptation to collaborative models, matchable structures with similar feature information can be initialized at the very early training stage. During the federated learning process, we then propose a feature paired averaging scheme to guarantee aligned feature distribution and maintain no feature fusion conflicts under either IID or non-IID scenarios. Eventually, Fed2 could effectively enhance the federated learning convergence performance under extensive homo- and heterogeneous settings, providing excellent convergence speed, accuracy, and computation/communication efficiency.


title: Virtualizing Intermittent Computing

abstract: Intermittent computing requires custom programming models to ensure the correct execution of applications despite power failures. However, existing programming models lead to programs that are hardware-dependent and not reusable. This paper aims at virtualizing intermittent computing to remedy these problems. We introduce PureVM, a virtual machine that abstracts a transiently powered computer, and PureLANG, a continuation-passing-style programming language to develop programs that run on PureVM. This virtualization, for the first time, paves the way for portable and reusable transiently-powered applications.


title: Learning a model of shape selectivity in V4 cells reveals shape encoding mechanisms in the brain

abstract: The mechanisms involved in transforming early visual signals to curvature representations in V4 are unknown. We propose a hierarchical model that reveals V1/V2 encodings that are essential components for this transformation to the reported curvature representations in V4. Then, by relaxing the often-imposed prior of a single Gaussian, V4 shape selectivity is learned in the last layer of the hierarchy from Macaque V4 responses. We found that V4 cells integrate multiple shape parts from the full spatial extent of their receptive fields with similar excitatory and inhibitory contributions. Our results uncover new details in existing data about shape selectivity in V4 neurons that with further experiments can enhance our understanding of processing in this area. Accordingly, we propose designs for a stimulus set that allow removing shape parts without disturbing the curvature signal to isolate part contributions to V4 responses.


title: False Data Injection Threats in Active Distribution Systems: A Comprehensive Survey

abstract: With the proliferation of smart devices and revolutions in communications, electrical distribution systems are gradually shifting from passive, manually-operated and inflexible ones, to a massively interconnected cyber-physical smart grid to address the energy challenges of the future. However, the integration of several cutting-edge technologies has introduced several security and privacy vulnerabilities due to the large-scale complexity and resource limitations of deployments. Recent research trends have shown that False Data Injection (FDI) attacks are becoming one of the most malicious cyber threats within the entire smart grid paradigm. Therefore, this paper presents a comprehensive survey of the recent advances in FDI attacks within active distribution systems and proposes a taxonomy to classify the FDI threats with respect to smart grid targets. The related studies are contrasted and summarized in terms of the attack methodologies and implications on the electrical power distribution networks. Finally, we identify some research gaps and recommend a number of future research directions to guide and motivate prospective researchers.


title: Search for Optimal Systolic Arrays: A Comprehensive Automated Exploration Framework and Lessons Learned

abstract: Systolic arrays have been widely used for accelerating HPC and deep learning applications. There is a plethora of previous works on the performance tuning of systolic arrays, but usually based on a number of oversimplified assumptions (e.g., only considering divisors for loop tiling, pruning based on off-chip data communication) to reduce the design space. In this paper, we present a comprehensive design space exploration tool named Odyssey for systolic array optimization. Odyssey does not rely on artificial assumptions to limit the design space, and yet it is highly efficient and scalable with a hybrid optimization technique. For example, for a 1024x1024x1024 matrix multiplication, it finds designs that reach 90% of the optimal performance in 5 seconds with a single CPU thread. Moreover, using Odyssey, we unveil and quantify the suboptimality introduced by multiple commonly used oversimplifications in prior studies for systolic array design space exploration. For example, Odyssey results show that limiting to divisors for loop tiling leads to a 39% performance loss, and pruning based on off-chip data movement results in a 45% performance loss. We applied Odyssey to explore the architecture trade-offs for matrix multiplication and convolutional neural network, providing inspiration into possible optimizations for these two applications.


title: Banach actions preserving unconditional convergence

abstract: Let $A,X,Y$ be Banach spaces and $A\times X\to Y$, $(a,x)\mapsto ax$, be a continuous bilinear function, called a *Banach action*. We say that this action *preserves unconditional convergence* if for every bounded sequence $(a_n)_{n\in\omega}$ in $A$ and unconditionally convergent series $\sum_{n\in\omega}x_n$ in $X$ the series $\sum_{n\in\omega}a_nx_n$ is unconditionally convergent. We prove that a Banach action $A\times X\to Y$ preserves unconditional convergence if and only if for any linear functional $y^*\in Y^*$ the operator $D_{y^*}:X\to A^*$, $D_{y^*}(x)(a)=y^*(ax)$, is absolutely summing. Combining this characterization with the famous Grothendieck theorem on the absolute summability of operators from $\ell_1$ to $\ell_2$, we prove that a Banach action $A\times X\to Y$ preserves unconditional convergence if $A$ is a Hilbert space possessing an orthonormal basis $(e_n)_{n\in\omega}$ such that for every $x\in X$ the series $\sum_{n\in\omega}e_nx$ is weakly absolutely convergent. Applying known results of Garling on the absolute summability of diagonal operators between sequence spaces, we prove that for (finite or infinite) numbers $p,q,r\in[1,\infty]$ with $\frac1r\le\frac1p+\frac1q$, the coordinatewise multplication $\ell_p\times\ell_q\to\ell_r$ preserves unconditional convergence if and only if one of the following conditions holds: (i) $p\le 2$ and $q\le r$, (ii) $2<p<q\le r$, (iii) $2<p=q<r$, (iv) $r=\infty$, (v) $2\le q<p\le r$, (vi) $q<2<p$ and $\frac1p+\frac1q\ge\frac1r+\frac12$.


title: Understanding BBN: the physics and its history

abstract: Big-bang nucleosynthesis (BBN), today a pillar of modern cosmology, began with the trailblazing 1948 paper of Alpher, Bethe and Gamow. In it, they proposed non-equilibrium nuclear processes in the early Universe ($t \sim 1000\,$sec) and an early radiation-dominated phase to explain the abundances of all the chemical elements. Their model was fundamentally flawed, but initiated a complex and interesting path to the modern theory of BBN, which explains only the abundances of the lightest chemical elements (mostly $^4$He) and the discovery of the cosmic microwave background (CMB). The purpose of this paper is to clarify the basic physics of BBN, adding some new insights, and to describe how the modern theory developed. I finish with a discussion of two misunderstandings about BBN that still persist and the tale of the pre-discovery predictions of the temperature of the CMB and the missed opportunity it turned out to be.


title: Automated Runtime-Aware Scheduling for Multi-Tenant DNN Inference on GPU

abstract: With the fast development of deep neural networks (DNNs), many real-world applications are adopting multiple models to conduct compound tasks, such as co-running classification, detection, and segmentation models on autonomous vehicles. Such multi-tenant DNN inference cases greatly exacerbate the computational complexity and call for comprehensive collaboration for graph-level operator scheduling, runtime-level resource awareness, as well as hardware scheduler support. However, the current scheduling support for such multi-tenant inference is still relatively backward. In this work, we propose a resource-aware scheduling framework for efficient multi-tenant DNN inference on GPU, which automatically coordinates DNN computing in different execution levels. Leveraging the unified scheduling intermediate representation and the automated ML-based searching algorithm, optimal schedules could be generated to wisely adjust model concurrency and interleave DNN model operators, maintaining a continuously balanced resource utilization across the entire inference process, and eventually improving the runtime efficiency. Experiments show that we could consistently achieve 1.3-1.7x speed-up, compared to regular DNN runtime libraries (e.g., CuDNN, TVM) and particular concurrent scheduling methods (e.g., NVIDIA Multi-Stream).


title: Totally real algebraic integers of arboreal height 2

abstract: In arXiv:1302.4423, Salez proved that every totally real algebraic integer is the eigenvalue of some tree. We define the "arboreal height" of a totally real algebraic integer $\lambda$ to be the minimal height of a rooted tree having $\lambda$ as an eigenvalue. In this paper, we prove several results about totally real algebraic integers of arboreal height $2$: We show that all real quadratic integers have arboreal height $\le 2$. We characterize the totally real cubic integers of arboreal height $2$. Finally, we prove that every totally irrational real number field is generated (as a ring over $\mathbb{Q}$) by some $\lambda$ of arboreal height $2$.


title: One-loop calculations in CPT-even Lorentz-breaking scalar QED

abstract: In this paper, we study a CPT-even Lorentz-breaking extension of the scalar QED. For this theory, we calculate the one-loop lower-order contributions in the Lorentz-violating parameters to the two-point functions of scalar and gauge fields. We found that the two background tensors, coming from the two sectors (scalar and gauge) are mixed in the one-loop corrections both in finite and divergent parts. This shows that these two Lorentz-breaking terms cannot be studied in an isolated form. Besides, the results in the gauge sector are confirmed to be transversal.


title: Critical exponents of model with matrix order parameter from resummation of six-loop results for anomalous dimensions

abstract: In this contribution an application of two techniques for resummation of asymptotic series namely Borel-Pade technique and Borel-Leroy technique with conformal mapping to the case of a model with multiple coupling constants will be discussed and the results of application of this methods to the $O(n)$-symmetric $\phi^{4}$ model with an antisymmetric tensor order parameter will be presented.


title: 3D High-Quality Magnetic Resonance Image Restoration in Clinics Using Deep Learning

abstract: Shortening acquisition time and reducing the motion artifacts are two of the most essential concerns in magnetic resonance imaging. As a promising solution, deep learning-based high-quality MR image restoration has been investigated to generate highly-resolved and motion artifact-free MR images from lower resolution images acquired with shortened acquisition time or motion artifact-corrupted images. However, numerous problems still exist to prevent deep learning approaches from becoming practical in the clinic environment. Specifically, most of the prior works focus solely on the network but ignore the impact of various down-sampling strategies on the acquisition time. Besides, the long inference time and high GPU consumption are also the bottlenecks to deploy most of the prior works in clinics. Furthermore, prior studies employ random movement in retrospective motion artifact generation, resulting in uncontrollable severity of motion artifact. More importantly, doctors are unsure whether the generated MR images are trustworthy, making diagnosis difficult. To overcome all these problems, we adopted a unified framework of 2D deep learning neural network for both 3D MRI super-resolution and motion artifact reduction, demonstrating such a framework can achieve better performance in 3D MRI restoration tasks compared to other state-of-the-art methods and remain the GPU consumption and inference time significantly low, thus easier to deploy. We also analyzed several down-sampling strategies based on the acceleration factor, including multiple combinations of in-plane and through-plane down-sampling, and developed a controllable and quantifiable motion artifact generation method. At last, the pixel-wise uncertainty was calculated and used to estimate the accuracy of the generated image, providing additional information for a reliable diagnosis.


title: A Practical guide on Explainable AI Techniques applied on Biomedical use case applications

abstract: Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining detailed explanations of their behaviour. As opaque machine learning models are increasingly being employed to make important predictions in critical environments, the danger is to create and use decisions that are not justifiable or legitimate. Therefore, there is a general agreement on the importance of endowing machine learning models with explainability. EXplainable Artificial Intelligence (XAI) techniques can serve to verify and certify model outputs and enhance them with desirable notions such as trustworthiness, accountability, transparency and fairness. This guide is meant to be the go-to handbook for any audience with a computer science background aiming at getting intuitive insights on machine learning models, accompanied with straight, fast, and intuitive explanations out of the box. This article aims to fill the lack of compelling XAI guide by applying XAI techniques in their particular day-to-day models, datasets and use-cases. Figure 1 acts as a flowchart/map for the reader and should help him to find the ideal method to use according to his type of data. In each chapter, the reader will find a description of the proposed method as well as an example of use on a Biomedical application and a Python notebook. It can be easily modified in order to be applied to specific applications.


title: Maximum likelihood estimation for a stochastic SEIR system for COVID-19

abstract: The parameter estimation of epidemic data-driven models is a crucial task. In some cases, we can formulate a better model by describing uncertainty with appropriate noise terms. However, because of the limited extent and partial information, (in general) this kind of model leads to intractable likelihoods. Here, we illustrate how a stochastic extension of the SEIR model improves the uncertainty quantification of an overestimated MCMC scheme based on its deterministic model to count reported-confirmed COVID-19 cases in Mexico City. Using a particular mechanism to manage missing data, we developed MLE for some parameters of the stochastic model, which improves the description of variance of the actual data.


title: Customizing an Affective Tutoring System Based on Facial Expression and Head Pose Estimation

abstract: In recent years, the main problem in e-learning has shifted from analyzing content to personalization of learning environment by Intelligence Tutoring Systems (ITSs). Therefore, by designing personalized teaching models, learners are able to have a successful and satisfying experience in achieving their learning goals. Affective Tutoring Systems (ATSs) are some kinds of ITS that can recognize and respond to affective states of learner. In this study, we designed, implemented, and evaluated a system to personalize the learning environment based on the facial emotions recognition, head pose estimation, and cognitive style of learners. First, a unit called Intelligent Analyzer (AI) created which was responsible for recognizing facial expression and head angles of learners. Next, the ATS was built which mainly made of two units: ITS, IA. Results indicated that with the ATS, participants needed less efforts to pass the tests. In other words, we observed when the IA unit was activated, learners could pass the final tests in fewer attempts than those for whom the IA unit was deactivated. Additionally, they showed an improvement in terms of the mean passing score and academic satisfaction.


title: Randomized Controlled Trials Under Influence: Covariate Factors and Graph-Based Network Interference

abstract: Randomized controlled trials are not only the golden standard in medicine and vaccine trials but have spread to many other disciplines like behavioral economics, making it an important interdisciplinary tool for scientists. When designing randomized controlled trials, how to assign participants to treatments becomes a key issue. In particular in the presence of covariate factors, the assignment can significantly influence statistical properties and thereby the quality of the trial. Another key issue is the widely popular assumption among experimenters that participants do not influence each other -- which is far from reality in a field study and can, if unaccounted for, deteriorate the quality of the trial. We address both issues in our work. After introducing randomized controlled trials bridging terms from different disciplines, we first address the issue of participant-treatment assignment in the presence of known covariate factors. Thereby, we review a recent assignment algorithm that achieves good worst-case variance bounds. Second, we address social spillover effects. Therefore, we build a comprehensive graph-based model of influence between participants, for which we design our own average treatment effect estimator $\hat \tau_{net}$. We discuss its bias and variance and reduce the problem of variance minimization to a certain instance of minimizing the norm of a matrix-vector product, which has been considered in literature before. Further, we discuss the role of disconnected components in the model's underlying graph.


title: Convergence Analysis For Non Linear System Of Parabolic Variational Inequalities

abstract: This work aims to provide a comprehensive and unified numerical analysis for non linear system of parabolic variational inequalities (PVIs) subject to Dirichlet boundary condition. This analysis enables us to establish an existence of the exact solution to the considered model and to prove the convergence for the approximate solution and its approximate gradient. Our results are applicable for several conforming and non conforming numerical schemes.


title: The gluon Regge trajectory at three loops from planar Yang-Mills theory

abstract: We compute the three-loop leading-colour corrections to the Yang-Mills Regge trajectory and gluon impact factor. Conjecturing that, in analogy with $\mathcal{N}=4$ super Yang-Mills (SYM), in a suitable scheme $N_c$-subleading terms are absent from the three-loop Regge trajectory, we understand our result as the first computation of the pure gauge, or $n_f = 0$, part of the QCD three-loop Regge trajectory. The results are presented both for the bare and renormalised amplitudes and are consistent with predictions from infrared factorisation along with reproducing known results in planar $\mathcal{N}=4$ SYM through a maximal weight truncation. We also include the dependence on a Regge factorisation scale to facilitate future applications in BFKL theory at next-to-next-to leading logarithmic accuracy.


title: A Reduction-Based Strategy for Optimal Control of Bose-Einstein Condensates

abstract: Applications of Bose-Einstein Condensates (BEC) often require that the condensate be prepared in a specific complex state. Optimal control is a reliable framework to prepare such a state while avoiding undesirable excitations, and, when applied to the time-dependent Gross-Pitaevskii Equation (GPE) model of BEC in multiple space dimensions, results in a large computational problem. We propose a control method based on first reducing the problem, using a Galerkin expansion, from a PDE to a low-dimensional Hamiltonian ODE system. We then apply a two-stage hybrid control strategy. At the first stage, we approximate the control using a second Galerkin-like method known as CRAB to derive a finite-dimensional nonlinear programming problem, which we solve with a differential evolution (DE) algorithm. This search method then yields a candidate local minimum which we further refine using a variant of gradient descent. This hybrid strategy allows us to greatly reduce excitations both in the reduced model and the full GPE system.


title: Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method

abstract: Vision-and-Language Navigation (VLN) is a challenging task in the field of artificial intelligence. Although massive progress has been made in this task over the past few years attributed to breakthroughs in deep vision and language models, it remains tough to build VLN models that can generalize as well as humans. In this paper, we provide a new perspective to improve VLN models. Based on our discovery that snapshots of the same VLN model behave significantly differently even when their success rates are relatively the same, we propose a snapshot-based ensemble solution that leverages predictions among multiple snapshots. Constructed on the snapshots of the existing state-of-the-art (SOTA) model $\circlearrowright$BERT and our past-action-aware modification, our proposed ensemble achieves the new SOTA performance in the R2R dataset challenge in Navigation Error (NE) and Success weighted by Path Length (SPL).


title: Optimal Multi-Robot Motion Planning via Parabolic Relaxation

abstract: Multi-robot systems offer enhanced capability over their monolithic counterparts, but they come at a cost of increased complexity in coordination. To reduce complexity and to make the problem tractable, multi-robot motion planning (MRMP) methods in the literature adopt de-coupled approaches that sacrifice either optimality or dynamic feasibility. In this paper, we present a convexification method, namely "parabolic relaxation", to generate optimal and dynamically feasible trajectories for MRMP in the coupled joint-space of all robots. We leverage upon the proposed relaxation to tackle the problem complexity and to attain computational tractability for planning over one hundred robots in extremely clustered environments. We take a multi-stage optimization approach that consists of i) mathematically formulating MRMP as a non-convex optimization, ii) lifting the problem into a higher dimensional space, iii) convexifying the problem through the proposed computationally efficient parabolic relaxation, and iv) penalizing with iterative search to ensure feasibility and recovery of feasible and near-optimal solutions to the original problem. Our numerical experiments demonstrate that the proposed approach is capable of generating optimal and dynamically feasible trajectories for challenging motion planning problems with higher success rate than the state-of-the-art, yet remain computationally tractable for over one hundred robots in a highly dense environment.


title: Surface Pourbaix plots of M@N4-graphene single-atom electrocatalysts from Density Functional Theory thermodynamic modelling

abstract: Single-atom catalysts (SACs) are rapidly developing in various application areas, including electrocatalysis of different reactions, usually taking place under harsh pH-electrode potential conditions. Thus, a full atomic-level understanding of the nature of the active sites under realistic electrochemical conditions is needed, having in mind that the state of SACs active centers could be altered by the adsorption of spectating species. In this contribution, Density Functional Theory is employed to conduct thermodynamic analysis of SACs with metal atoms (Mn, Fe, Co, Ni, Cu, Ru, Rh, Pd, Ag, Ir, Pt, or Au) embedded into N4 moiety in graphene. Various surface electrochemical processes on such SACs are considered, their Pourbaix plots are constructed, and their activity, selectivity, and stability under operating conditions are discussed. It is demonstrated how adsorption of H, O and OH can cause blockage and restructuring of the active sites and alter the electronic structure. Furthermore, when one deals with metals with lower d-band filling, it is shown that metal center oxidation is preferred over the oxidation of carbon lattice. The effect of the state of the metal center on the reactivity of the carbon lattice is discussed in the case of Fe@N4-graphene. Finally, a possible strategy for confirming the changes in the architecture of the SACs' active site by analyzing their vibration spectra is suggested.


title: Automated Detection of Patients in Hospital Video Recordings

abstract: In a clinical setting, epilepsy patients are monitored via video electroencephalogram (EEG) tests. A video EEG records what the patient experiences on videotape while an EEG device records their brainwaves. Currently, there are no existing automated methods for tracking the patient's location during a seizure, and video recordings of hospital patients are substantially different from publicly available video benchmark datasets. For example, the camera angle can be unusual, and patients can be partially covered with bedding sheets and electrode sets. Being able to track a patient in real-time with video EEG would be a promising innovation towards improving the quality of healthcare. Specifically, an automated patient detection system could supplement clinical oversight and reduce the resource-intensive efforts of nurses and doctors who need to continuously monitor patients. We evaluate an ImageNet pre-trained Mask R-CNN, a standard deep learning model for object detection, on the task of patient detection using our own curated dataset of 45 videos of hospital patients. The dataset was aggregated and curated for this work. We show that without fine-tuning, ImageNet pre-trained Mask R-CNN models perform poorly on such data. By fine-tuning the models with a subset of our dataset, we observe a substantial improvement in patient detection performance, with a mean average precision of 0.64. We show that the results vary substantially depending on the video clip.


title: ExCon: Explanation-driven Supervised Contrastive Learning for Image Classification

abstract: Contrastive learning has led to substantial improvements in the quality of learned embedding representations for tasks such as image classification. However, a key drawback of existing contrastive augmentation methods is that they may lead to the modification of the image content which can yield undesired alterations of its semantics. This can affect the performance of the model on downstream tasks. Hence, in this paper, we ask whether we can augment image data in contrastive learning such that the task-relevant semantic content of an image is preserved. For this purpose, we propose to leverage saliency-based explanation methods to create content-preserving masked augmentations for contrastive learning. Our novel explanation-driven supervised contrastive learning (ExCon) methodology critically serves the dual goals of encouraging nearby image embeddings to have similar content and explanation. To quantify the impact of ExCon, we conduct experiments on the CIFAR-100 and the Tiny ImageNet datasets. We demonstrate that ExCon outperforms vanilla supervised contrastive learning in terms of classification, explanation quality, adversarial robustness as well as probabilistic calibration in the context of distributional shift.


title: Identification of Subgroups With Similar Benefits in Off-Policy Policy Evaluation

abstract: Off-policy policy evaluation methods for sequential decision making can be used to help identify if a proposed decision policy is better than a current baseline policy. However, a new decision policy may be better than a baseline policy for some individuals but not others. This has motivated a push towards personalization and accurate per-state estimates of heterogeneous treatment effects (HTEs). Given the limited data present in many important applications, individual predictions can come at a cost to accuracy and confidence in such predictions. We develop a method to balance the need for personalization with confident predictions by identifying subgroups where it is possible to confidently estimate the expected difference in a new decision policy relative to a baseline. We propose a novel loss function that accounts for uncertainty during the subgroup partitioning phase. In experiments, we show that our method can be used to form accurate predictions of HTEs where other methods struggle.


title: On augmented finite element formulation for the Navier--Stokes equations with vorticity and variable viscosity

abstract: We propose and analyse an augmented mixed finite element method for the Navier--Stokes equations written in terms of velocity, vorticity, and pressure with non-constant viscosity and no-slip boundary conditions. The weak formulation includes least-squares terms arising from the constitutive equation and from the incompressibility condition. The theoretical and practical implications of using augmentation is discussed in detail. In addition, we use fixed--point strategies to show the existence and uniqueness of continuous and discrete solutions under the assumption of sufficiently small data. The method is constructed using any compatible finite element pair for velocity and pressure as dictated by Stokes inf-sup stability, while for vorticity any generic discrete space (of arbitrary order) can be used. We establish optimal a priori error estimates. Finally, we provide a set of numerical tests in 2D and 3D illustrating the behaviour of the scheme as well as verifying the theoretical convergence rates.


title: New nickel opacities and their impact on stellar models

abstract: The chemical element nickel is of particular interest in stellar physics. In the layers in which the Fe-peak elements dominate the mean opacity (the so-called Z-bump), Ni is the second contributor to the Rosseland opacity after iron, according to the Opacity Project data. Reliable nickel cross sections are therefore mandatory for building realistic stellar models, especially for main-sequence pulsators such as $\beta$ Cep and slowly pulsating B stars, whose oscillations are triggered by the $\kappa$-mechanism of the Fe-peak elements. Unfortunately, the Opacity Project data for Ni were extrapolated from those of Fe, and previous studies have shown that they were underestimated in comparison to detailed calculations. We investigate the impact of newly computed monochromatic cross sections on the Rosseland mean opacity of Ni and on the structure of main-sequence massive pulsators. We compare our results with the widely used Opacity Project and OPAL data. Monochromatic cross sections for Ni were obtained with the SCO-RCG code. The Toulouse-Geneva evolution code was used to build the stellar models. With the new data, the Rosseland opacities of Ni are roughly the same as those of the Opacity Project or OPAL at high temperatures ($\log\ T>6$). At lower temperatures, significant departures are observed; the ratios are up to six times higher with SCO-RCG. These discrepancies span a wider temperature range in the comparison with OPAL than in comparison with the Opacity Project. For massive star models, the results of the comparison with a structure computed with Opacity Project data show that the Rosseland mean of the global stellar mixture is only marginally altered in the Z-bump. The maximum opacity is shifted towards slightly more superficial layers. A new maximum appears in the temperature derivative of the mean opacity, and the driving of the pulsations should be affected.


title: Radio Frequency Fingerprint Identification for Security in Low-Cost IoT Devices

abstract: Radio frequency fingerprint identification (RFFI) can uniquely classify wireless devices by analyzing the received signal distortions caused by the intrinsic hardware impairments. The state-of-the-art deep learning techniques such as convolutional neural network (CNN) have been adopted to classify IoT devices with high accuracy. However, deep learning-based RFFI requires input data of a fixed size. In addition, many IoT devices work in low signal-to-noise ratio (SNR) scenarios but the low SNR RFFI is rarely investigated. In this paper, the state-of-the-art transformer model is used as the classifier, which can process signals of variable length. Data augmentation is adopted to improve low SNR RFFI performance. A multi-packet inference approach is further proposed to improve the classification accuracy in low SNR scenarios. We take LoRa as a case study and evaluate the system by classifying 10 commercial-off-the-shelf LoRa devices in various SNR conditions. The online augmentation can boost the low SNR RFFI performance by up to 50% and multi-packet inference can further increase it by over 20%.


title: Adaptive Mesh Methods on Compact Manifolds via Optimal Transport and Optimal Information Transport

abstract: Moving mesh methods are designed to redistribute a mesh in a regular way. This applied problem can be considered to overlap with the problem of finding a diffeomorphic mapping between density measures. In applications, an off-the-shelf grid needs to be restructured to have higher grid density in some regions than others. This should be done in a way that avoids tangling, hence, the attractiveness of diffeomorphic mapping techniques. For exact diffeomorphic mapping on the sphere a major tool used is Optimal Transport, which allows for diffeomorphic mapping between even non-continuous source and target densities. However, recently Optimal Information Transport was rigorously developed allowing for exact and inexact diffeomorphic mapping and the solving of a simpler partial differential equation. In this manuscript, we perform the first side-by-side comparison of using Optimal Transport and Optimal Information Transport on the sphere for adaptive mesh problems. We introduce how to generalize these computations to more general manifolds. In this manuscript, we choose to perform this comparison with provably convergent solvers, which is generally challenging for either problem due to the lack of boundary conditions and lack of comparison principle in the partial differential equation formulation. It appears that Optimal Information Transport produces better results and is more easily generalizable for the moving mesh problem. In order to use Optimal Transport for moving mesh methods, further work on the accuracy of Optimal Transport solvers on the sphere and a framework for generalization to other manifolds must be done before this becomes a recommended method in challenging cases.


title: Precise measurement of differential cross sections of the {\Sigma}-p --> {\Lambda} n reaction in momentum range 470-650 MeV/c

abstract: The differential cross sections of the {\Sigma}-p --> {\Lambda} n reaction were measured accurately for the {\Sigma}- momentum (p_{{\Sigma}}) ranging from 470 to 650 MeV/c at the J-PARC Hadron Experimental Facility. Precise angular information about the {\Sigma}-p --> {\Lambda} n reaction was obtained for the first time by detecting approximately 100 reaction events at each angular step of {\Delta}cos{\theta} = 0.1. The obtained differential cross sections show slightly forward-peaking structure in the measured momentum regions.The cross sections integrated for -0.7 < cos{\theta} < 1.0 were obtained as 22.5 +- 0.68 (stat.) +- 0.65 (syst.) mb and 15.8 +-0.83(stat.) +- 0.52 (syst.) mb for 470<p_{{\Sigma}}(MeV/c)<550 and 550<p_{{\Sigma}}(MeV/c)<650, respectively. These results show a drastic improvement compared to past measurements of the hyperon-proton scattering experiments. They will play essential roles in updating the theoretical models of the baryon-baryon interactions.


title: SciCodes: Astronomy Research Software and Beyond

abstract: The Astrophysics Source Code Library (ASCL ascl.net), started in 1999, is a free open registry of software used in refereed astronomy research. Over the past few years, it has spearheaded an effort to form a consortium of scientific software registries and repositories. In 2019 and 2020, ASCL contacted editors and maintainers of discipline and institutional software registries and repositories in math, biology, neuroscience, geophysics, remote sensing, and other fields to develop a list of best practices for these research software resources. At the completion of that project, performed as a Task Force for a FORCE11 working group, members decided to form SciCodes as an ongoing consortium. This presentation covered the consortium's work so far, what it is currently working on, what it hopes to achieve for making scientific research software more discoverable across disciplines, and how the consortium can benefit astronomers.


title: Hypothesis Testing of Mixture Distributions using Compressed Data

abstract: In this paper we revisit the binary hypothesis testing problem with one-sided compression. Specifically we assume that the distribution in the null hypothesis is a mixture distribution of iid components. The distribution under the alternative hypothesis is a mixture of products of either iid distributions or finite order Markov distributions with stationary transition kernels. The problem is studied under the Neyman-Pearson framework in which our main interest is the maximum error exponent of the second type of error. We derive the optimal achievable error exponent and under a further sufficient condition establish the maximum $\epsilon$-achievable error exponent. It is shown that to obtain the latter, the study of the exponentially strong converse is needed. Using a simple code transfer argument we also establish new results for the Wyner-Ahlswede-K{\"o}rner problem in which the source distribution is a mixture of iid components.


title: Complex ellipsoids and complex symmetry

abstract: Several characterizations of complex ellipsoids among convex bodies in Cn, in terms of their sections and projections are proved. Characterizing complex symmetry in similar terms is an important tool.


title: Passive Indoor Localization with WiFi Fingerprints

abstract: This paper proposes passive WiFi indoor localization. Instead of using WiFi signals received by mobile devices as fingerprints, we use signals received by routers to locate the mobile carrier. Consequently, software installation on the mobile device is not required. To resolve the data insufficiency problem, flow control signals such as request to send (RTS) and clear to send (CTS) are utilized. In our model, received signal strength indicator (RSSI) and channel state information (CSI) are used as fingerprints for several algorithms, including deterministic, probabilistic and neural networks localization algorithms. We further investigated localization algorithms performance through extensive on-site experiments with various models of phones at hundreds of testing locations. We demonstrate that our passive scheme achieves an average localization error of 0.8 m when the phone is actively transmitting data frames and 1.5 m when it is not transmitting data frames.


title: Customer Sentiment Analysis using Weak Supervision for Customer-Agent Chat

abstract: Prior work on sentiment analysis using weak supervision primarily focuses on different reviews such as movies (IMDB), restaurants (Yelp), products (Amazon).~One under-explored field in this regard is customer chat data for a customer-agent chat in customer support due to the lack of availability of free public data. Here, we perform sentiment analysis on customer chat using weak supervision on our in-house dataset. We fine-tune the pre-trained language model (LM) RoBERTa as a sentiment classifier using weak supervision. Our contribution is as follows:1) We show that by using weak sentiment classifiers along with domain-specific lexicon-based rules as Labeling Functions (LF), we can train a fairly accurate customer chat sentiment classifier using weak supervision. 2) We compare the performance of our custom-trained model with off-the-shelf google cloud NLP API for sentiment analysis. We show that by injecting domain-specific knowledge using LFs, even with weak supervision, we can train a model to handle some domain-specific use cases better than off-the-shelf google cloud NLP API. 3) We also present an analysis of how customer sentiment in a chat relates to problem resolution.


title: Exploration of Dark Chemical Genomics Space via Portal Learning: Applied to Targeting the Undruggable Genome and COVID-19 Anti-Infective Polypharmacology

abstract: Advances in biomedicine are largely fueled by exploring uncharted territories of human biology. Machine learning can both enable and accelerate discovery, but faces a fundamental hurdle when applied to unseen data with distributions that differ from previously observed ones -- a common dilemma in scientific inquiry. We have developed a new deep learning framework, called {\textit{Portal Learning}}, to explore dark chemical and biological space. Three key, novel components of our approach include: (i) end-to-end, step-wise transfer learning, in recognition of biology's sequence-structure-function paradigm, (ii) out-of-cluster meta-learning, and (iii) stress model selection. Portal Learning provides a practical solution to the out-of-distribution (OOD) problem in statistical machine learning. Here, we have implemented Portal Learning to predict chemical-protein interactions on a genome-wide scale. Systematic studies demonstrate that Portal Learning can effectively assign ligands to unexplored gene families (unknown functions), versus existing state-of-the-art methods, thereby allowing us to target previously "undruggable" proteins and design novel polypharmacological agents for disrupting interactions between SARS-CoV-2 and human proteins. Portal Learning is general-purpose and can be further applied to other areas of scientific inquiry.


title: Ramsey-type results for path covers and path partitions. II. Digraphs

abstract: Recently, the authors gave Ramsey-type results for the path cover/partition number of graphs. In this paper, we continue the research about them focusing on digraphs, and find a relationship between the path cover/partition number and forbidden structures in digraphs. Let $D$ be a weakly connected digraph. A family $\mathcal{P}$ of subdigraphs of $D$ is called a {\it path cover} (resp. a {\it path partition}) of $D$ if $\bigcup _{P\in \mathcal{P}}V(P)=V(D)$ (resp. $\dot\bigcup _{P\in \mathcal{P}}V(P)=V(D)$) and every element of $\mathcal{P}$ is a directed path. The minimum cardinality of a path cover (resp. a path partition) of $D$ is denoted by ${\rm pc}(D)$ (resp. ${\rm pp}(D)$). In this paper, we find forbidden structure conditions assuring us that ${\rm pc}(D)$ (or ${\rm pp}(D)$) is bounded by a constant.


title: Early Stage Growth of Amorphous Thin Film: Average Kinetics, Nanoscale Dynamics and Pressure Dependence

abstract: We used the Coherent Grazing Incidence Small Angle X-Ray Scattering (Co-GISAXS) technique to study the average kinetics and nanoscale dynamics during early-stage a-WSi$_2$ sputter deposition. The kinetic and dynamic properties are examined as a function of pressure, which is known to be a critical factor in determining final surface roughness. Surface growth kinetics and dynamics are characterized by time parameters extracted from the height-height structure factor and correlation functions. The roughness at a given length scale reaches a maximum before relaxing down to a steady state. The lateral length scale dependence and pressure dependence are then compared among measured kinetics and dynamics time parameters. Surfaces grown at lower pressures are smoother, leading to longer correlation times. The time to reach a dynamic steady state and a kinetic steady state show contrasting pressure dependence. A dynamic steady state is reached earlier than the kinetic steady state at high pressure. A more random deposition direction and lower kinetic energy at higher pressures can explain these phenomena, along with the hypothesis that larger nanoclusters form in vapor before arriving at the surface. A continuum model is applied to simulate the overall behavior with mixed success.


title: Analyzing polarized boosted top from stop decay at high luminosity and high energy LHC

abstract: Measuring top polarization is extremely important in understanding any new physics that couples to top quark. Here, we take up the task of extracting polarization of top quark coming from TeV-scale stop decay at the upgraded high luminosity and high energy LHC. We focus on the scenario where the two tops from the stop decay lead to semi-leptonic final state. We take into account all relevant backgrounds and put kinematical cuts to suppress them. We arrive at a signal region where the desired signal can be observed with reasonable significance. Next, we examine, in such signal regions, how well top polarization can be measured. For that we have calculated the degree with which left- and right-handed top quarks can be separated from each other, in terms of $P$-values. We have also performed a comparative study between various centre-of-mass energies and integrated luminosities in terms of their reach in probing top polarization from stop decay.


title: Rank-Constrained Least-Squares: Prediction and Inference

abstract: In this work, we focus on the high-dimensional trace regression model with a low-rank coefficient matrix. We establish a nearly optimal in-sample prediction risk bound for the rank-constrained least-squares estimator under no assumptions on the design matrix. Lying at the heart of the proof is a covering number bound for the family of projection operators corresponding to the subspaces spanned by the design. By leveraging this complexity result, we perform a power analysis for a permutation test on the existence of a low-rank signal under the high-dimensional trace regression model. We show that the permutation test based on the rank-constrained least-squares estimator achieves non-trivial power with no assumptions on the minimum (restricted) eigenvalue of the covariance matrix of the design. Finally, we use alternating minimization to approximately solve the rank-constrained least-squares problem to evaluate its empirical in-sample prediction risk and power of the resulting permutation test in our numerical study.


title: Description of $^{93}$Nb stellar electron-capture rates by the Projected Shell Model

abstract: Capture of electrons by nuclei is an important process in stellar environments where excited nuclear states are thermally populated. However, accurate treatment for excited configurations in electron capture (EC) rates has been an unsolved problem for medium-heavy and heavy nuclei. In this work, we take the $^{93}$Nb $\rightarrow$ $^{93}$Zr EC rates as the example to introduce the Projected-Shell-Model (PSM) in which excited configurations are explicitly included as multi-quasiparticle states. Applying the prevalent assumption that the parent nucleus always stays in its ground state in stellar conditions, we critically compare the obtained PSM results with the recently-measured Gamow-Teller transition data, and with the previous calculations by the conventional shell model and the quasiparticle random-phase approximation. We discuss important ingredients that are required in theoretical models used for stellar EC calculations, and demonstrate effects of the explicit inclusion of excited nuclear states in EC rate calculations, especially when both electron density and environment temperature are high.


title: Heat transport across graphene/hexagonal-BN tilted grain boundaries from phase-field crystal model and molecular dynamics simulations

abstract: We study the interfacial thermal conductance of grain boundaries (GBs) between monolayer graphene and hexagonal boron nitride (h-BN) sheets using a combined atomistic approach. First, realistic samples containing graphene/h-BN GBs with different tilt angles are generated using the phase-field crystal (PFC) model developed recently [P. Hirvonen \textit{et al.}, Phys. Rev. B \textbf{100}, 165412 (2019)] that captures slow diffusive relaxation inaccessible to molecular dynamics (MD) simulations. Then, large-scale MD simulations using the efficient GPUMD package are performed to assess heat transport and rectification properties across the GBs. We find that lattice mismatch between the graphene and h-BN sheets plays a less important role in determining the interfacial thermal conductance as compared to the tilt angle. In addition, we find no significant thermal rectification effects for these GBs.


title: TAL: Two-stream Adaptive Learning for Generalizable Person Re-identification

abstract: Domain generalizable person re-identification aims to apply a trained model to unseen domains. Prior works either combine the data in all the training domains to capture domain-invariant features, or adopt a mixture of experts to investigate domain-specific information. In this work, we argue that both domain-specific and domain-invariant features are crucial for improving the generalization ability of re-id models. To this end, we design a novel framework, which we name two-stream adaptive learning (TAL), to simultaneously model these two kinds of information. Specifically, a domain-specific stream is proposed to capture training domain statistics with batch normalization (BN) parameters, while an adaptive matching layer is designed to dynamically aggregate domain-level information. In the meantime, we design an adaptive BN layer in the domain-invariant stream, to approximate the statistics of various unseen domains. These two streams work adaptively and collaboratively to learn generalizable re-id features. Our framework can be applied to both single-source and multi-source domain generalization tasks, where experimental results show that our framework notably outperforms the state-of-the-art methods.


title: Consensus in the Hegselmann-Krause model

abstract: This paper is concerned with the probability of consensus in a multivariate, spatially explicit version of the Hegselmann-Krause model for the dynamics of opinions. Individuals are located on the vertices of a finite connected graph representing a social network, and are characterized by their opinion, with the set of opinions $\Delta$ being a general bounded convex subset of a finite dimensional normed vector space. Having a confidence threshold $\tau$, two individuals are said to be compatible if the distance (induced by the norm) between their opinions does not exceed the threshold $\tau$. Each vertex $x$ updates its opinion at rate the number of its compatible neighbors on the social network, which results in the opinion at $x$ to be replaced by a convex combination of the opinion at $x$ and the nearby opinions: $\alpha$ times the opinion at $x$ plus $(1 - \alpha)$ times the average opinion of its compatible neighbors. The main objective is to derive a lower bound for the probability of consensus when the opinions are initially independent and identically distributed with values in the opinion set $\Delta$.


title: Deblur-NeRF: Neural Radiance Fields from Blurry Images

abstract: Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs when capturing scenes in the wild, significantly degrades its reconstruction quality. To address this problem, We propose Deblur-NeRF, the first method that can recover a sharp NeRF from blurry input. We adopt an analysis-by-synthesis approach that reconstructs blurry views by simulating the blurring process, thus making NeRF robust to blurry inputs. The core of this simulation is a novel Deformable Sparse Kernel (DSK) module that models spatially-varying blur kernels by deforming a canonical sparse kernel at each spatial location. The ray origin of each kernel point is jointly optimized, inspired by the physical blurring process. This module is parameterized as an MLP that has the ability to be generalized to various blur types. Jointly optimizing the NeRF and the DSK module allows us to restore a sharp NeRF. We demonstrate that our method can be used on both camera motion blur and defocus blur: the two most common types of blur in real scenes. Evaluation results on both synthetic and real-world data show that our method outperforms several baselines. The synthetic and real datasets along with the source code is publicly available at https://limacv.github.io/deblurnerf/


title: A category theory framework for Bayesian learning

abstract: Inspired by the foundational works by Spivak and Fong and Cruttwell et al., we introduce a categorical framework to formalize Bayesian inference and learning. The two key ideas at play here are the notions of Bayesian inversions and the functor GL as constructed by Cruttwell et al.. In this context, we find that Bayesian learning is the simplest case of the learning paradigm. We then obtain categorical formulations of batch and sequential Bayes updates while also verifying that the two coincide in a specific example.


title: Towards Autonomous Driving of Personal Mobility with Small and Noisy Dataset using Tsallis-statistics-based Behavioral Cloning

abstract: Autonomous driving has made great progress and been introduced in practical use step by step. On the other hand, the concept of personal mobility is also getting popular, and its autonomous driving specialized for individual drivers is expected for a new step. However, it is difficult to collect a large driving dataset, which is basically required for the learning of autonomous driving, from the individual driver of the personal mobility. In addition, when the driver is not familiar with the operation of the personal mobility, the dataset will contain non-optimal data. This study therefore focuses on an autonomous driving method for the personal mobility with such a small and noisy, so-called personal, dataset. Specifically, we introduce a new loss function based on Tsallis statistics that weights gradients depending on the original loss function and allows us to exclude noisy data in the optimization phase. In addition, we improve the visualization technique to verify whether the driver and the controller have the same region of interest. From the experimental results, we found that the conventional autonomous driving failed to drive properly due to the wrong operations in the personal dataset, and the region of interest was different from that of the driver. In contrast, the proposed method learned robustly against the errors and successfully drove automatically while paying attention to the similar region to the driver. Attached video is also uploaded on youtube: https://youtu.be/KEq8-bOxYQA


title: Frontier-led Swarming: Robust Multi-Robot Coverage of Unknown Environments

abstract: This paper proposes a novel swarm-based control algorithm for exploration and coverage of unknown environments, while maintaining a formation that permits short-range communication. The algorithm combines two elements: swarm rules for maintaining a close-knit formation and frontier search for driving exploration and coverage. Inspired by natural systems in which large numbers of simple agents (e.g., schooling fish, flocking birds, swarming insects) perform complicated collective behaviors for efficiency and safety, the first element uses three simple rules to maintain a swarm formation. The second element provides a means to select promising regions to explore (and cover) by minimising a cost function involving robots' relative distance to frontier cells and the frontier's size. We tested the performance of our approach on heterogeneous and homogeneous groups of mobile robots in different environments. We measure both coverage performance and swarm formation statistics as indicators of the robots' ability to explore effectively while maintaining a formation conducive to short-range communication. Through a series of comparison experiments, we demonstrate that our proposed strategy has superior performance to recently presented map coverage methodologies and conventional swarming methods.


title: Enhanced sensitivity of an all-dielectric refractive index sensor with optical bound state in the continuum

abstract: The sensitivity of a refractive index sensor based on an optical bound state in the continuum is considered. Applying Zel'dovich perturbation theory we derived an analytic expression for bulk sensitivity of an all-dielectic sensor utilizing symmetry protected in-$\Gamma$ optical bound states in a dielectric grating. The upper sensitivity limit is obtained. A recipe is proposed for obtaining the upper sensitivity limit by optimizing the design of the grating. The results are confirmed through direct numerical simulations.


title: Data Augmentation For Medical MR Image Using Generative Adversarial Networks

abstract: Computer-assisted diagnosis (CAD) based on deep learning has become a crucial diagnostic technology in the medical industry, effectively improving diagnosis accuracy. However, the scarcity of brain tumor Magnetic Resonance (MR) image datasets causes the low performance of deep learning algorithms. The distribution of transformed images generated by traditional data augmentation (DA) intrinsically resembles the original ones, resulting in a limited performance in terms of generalization ability. This work improves Progressive Growing of GANs with a structural similarity loss function (PGGAN-SSIM) to solve image blurriness problems and model collapse. We also explore other GAN-based data augmentation to demonstrate the effectiveness of the proposed model. Our results show that PGGAN-SSIM successfully generates 256x256 realistic brain tumor MR images which fill the real image distribution uncovered by the original dataset. Furthermore, PGGAN-SSIM exceeds other GAN-based methods, achieving promising performance improvement in Frechet Inception Distance (FID) and Multi-scale Structural Similarity (MS-SSIM).


title: Handedness Correlation from Quark Polarization

abstract: Jet handedness as a measure of quark and/or gluon polarizations has been proposed for nearly 30 years. It was demonstrated by measuring the correlation of jet handedness in the electron positron annihilation process. Once parameters are determined, the method could be used to measure quark and/or gluon polarizations in other experiments. The reported data provided evidence for the jet handedness and handedness correlation. However, the jet handedness correlation measured in the electron positron annihilation process from the opposite jets contradicts theoretical prediction by a sign. In order to explain this, we present a chromo-hydrogen-like model in this paper. According to calculations, both jet handedness and handedness correlation depend on not only the polarization of the fragmenting valence quark but also the polarization of the sea quark. It is the appearance of the sea quark polarization that can solve the contradiction. In other words, measurements of jet handedness and handedness correlation can be used to determine the sea quark polarization.


title: Pairwise scattering and bound states of spherical microorganisms

abstract: The dynamic interactions between pairs of swimming microorganisms underpin the collective behaviour of larger suspensions, but accurately calculating pairwise collisions has typically required the use of numerical simulations in which hydrodynamic interactions are fully resolved. In this paper, we utilise analytical expressions for forces and torques acting on two closely separated spherical squirmers -- accurate to second order in the ratio of cell-cell spacing to squirmer radius -- in order to calculate their scattering dynamics. Attention is limited to squirmers whose orientation vectors lie in the same plane. We characterise the outgoing angles of pairs of bottom-heavy squirmers in terms of their incoming angles, the squirmer parameter $\beta$, and the strength of the external gravitational field, discovering transient scattering, stationary bound states, pairwise swimming motion, and circular orbits. These results compare well with full numerical solutions obtained using boundary element methods, highlighting the utility of lubrication theory. We expect these results will be useful for the foundations of mesoscale continuum models for suspensions of spherical microorganisms.


title: Localization of space-inhomogeneous three-state quantum walks

abstract: Mathematical analysis on the existence of eigenvalues is essential because it is equivalent to the occurrence of localization, which is an exceptionally crucial property of quantum walks. We construct the method for the eigenvalue problem via the transfer matrix for space-inhomogeneous $n$-state quantum walks in one dimension with $n-2$ self-loops, which is an extension of the technique in a previous study (Quantum Inf. Process 20(5), 2021). This method reveals the necessary and sufficient condition for the eigenvalue problem of a two-phase three-state quantum walk with one defect whose time evolution varies in the negative part, positive part, and at the origin.


title: PSG: Prompt-based Sequence Generation for Acronym Extraction

abstract: Acronym extraction aims to find acronyms (i.e., short-forms) and their meanings (i.e., long-forms) from the documents, which is important for scientific document understanding (SDU@AAAI-22) tasks. Previous works are devoted to modeling this task as a paragraph-level sequence labeling problem. However, it lacks the effective use of the external knowledge, especially when the datasets are in a low-resource setting. Recently, the prompt-based method with the vast pre-trained language model can significantly enhance the performance of the low-resourced downstream tasks. In this paper, we propose a Prompt-based Sequence Generation (PSG) method for the acronym extraction task. Specifically, we design a template for prompting the extracted acronym texts with auto-regression. A position extraction algorithm is designed for extracting the position of the generated answers. The results on the acronym extraction of Vietnamese and Persian in a low-resource setting show that the proposed method outperforms all other competitive state-of-the-art (SOTA) methods.


title: Self-supervised Feature-Gate Coupling for Dynamic Network Pruning

abstract: Gating modules have been widely explored in dynamic network pruning to reduce the run-time computational cost of deep neural networks while preserving the representation of features. Despite the substantial progress, existing methods remain ignoring the consistency between feature and gate distributions, which may lead to distortion of gated features. In this paper, we propose a feature-gate coupling (FGC) approach aiming to align distributions of features and gates. FGC is a plug-and-play module, which consists of two steps carried out in an iterative self-supervised manner. In the first step, FGC utilizes the $k$-Nearest Neighbor method in the feature space to explore instance neighborhood relationships, which are treated as self-supervisory signals. In the second step, FGC exploits contrastive learning to regularize gating modules with generated self-supervisory signals, leading to the alignment of instance neighborhood relationships within the feature and gate spaces. Experimental results validate that the proposed FGC method improves the baseline approach with significant margins, outperforming the state-of-the-arts with better accuracy-computation trade-off. Code is publicly available.


title: Long-time behavior of a nonlocal dispersal logistic model with seasonal succession

abstract: This paper is devoted to a nonlocal dispersal logistic model with seasonal succession in one-dimensional bounded habitat, where the seasonal succession accounts for the effect of two different seasons. Firstly, we provide the persistence-extinction criterion for the species, which is different from that for local diffusion model. Then we show the asymptotic profile of the time-periodic positive solution as the species persists in long run.


title: Iwasawa Invariants for Symmetric Square Representations

abstract: Let $p\geq 5$ be a prime, and $\mathfrak{p}$ a prime of $\bar{\mathbb{Q}}$ above $p$. Let $g_1$ and $g_2$ be $\mathfrak{p}$-ordinary, $\mathfrak{p}$-distinguished and $p$-stabilized cuspidal newforms of nebentype characters $\epsilon_1, \epsilon_2$ respectively, and weight $k\geq 2$, whose associated newforms have level prime to $p$. Assume that the residual representations at $\mathfrak{p}$ associated to $g_1$ and $g_2$ are absolutely irreducible and isomorphic. Then, the imprimitive $p$-adic L-functions associated with the symmetric square representations are shown to exhibit a congruence modulo $\mathfrak{p}$. Furthermore, the analytic and algebraic Iwasawa invariants associated to these representations of the $g_i$ are shown to be related. Along the way, we give a complete proof of the integrality of the $\mathfrak{p}$-adic L-function, normalized with Hida's canonical period. This fills a gap in the literature, since, despite the result being widely accepted, no complete proof seems to ever have been written down. On the algebraic side, we establish the corresponding congruence for Greenberg's Selmer groups, and verify that the Iwasawa main conjectures for the twisted symmetric square representations for $g_1$ and $g_2$ are compatible with the congruences.


title: Tailoring High-Frequency Magnonics in Monolayer Chromium Trihalides

abstract: Monolayer chromium trihalides, the archetypal two dimensional (2D) magnetic materials, are readily suggested as a promising platform for high frequency magnonics. Here we detail the spin wave properties of monolayer CrBr$_3$ and CrI$_3$, using spin dynamics simulations parametrized from the first principles. We reveal that spin wave dispersion can be tuned in a broad range of frequencies by strain, paving the way towards flexo magnonic applications. We further show that ever present halide vacancies in these monolayers host sufficiently strong Dzyaloshinskii Moriya interaction to scatter spin waves, which promotes design of spin-wave guides by defect engineering. Finally we discuss the spectra of spin-waves propagating across a moir\'e periodic modulation of magnetic parameters in a van der Waals heterobilayer, and show that the nanoscale moir\'e periodicities in such samples are ideal for realization of a magnonic crystal in the terahertz frequency range. Recalling the additional tunability of magnetic 2D materials by electronic gating, our results situate these systems among the front-runners for prospective high frequency magnonic applications.


title: SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguation

abstract: Acronym disambiguation means finding the correct meaning of an ambiguous acronym from the dictionary in a given sentence, which is one of the key points for scientific document understanding (SDU@AAAI-22). Recently, many attempts have tried to solve this problem via fine-tuning the pre-trained masked language models (MLMs) in order to obtain a better acronym representation. However, the acronym meaning is varied under different contexts, whose corresponding phrase representation mapped in different directions lacks discrimination in the entire vector space. Thus, the original representations of the pre-trained MLMs are not ideal for the acronym disambiguation task. In this paper, we propose a Simple framework for Contrastive Learning of Acronym Disambiguation (SimCLAD) method to better understand the acronym meanings. Specifically, we design a continual contrastive pre-training method that enhances the pre-trained model's generalization ability by learning the phrase-level contrastive distributions between true meaning and ambiguous phrases. The results on the acronym disambiguation of the scientific domain in English show that the proposed method outperforms all other competitive state-of-the-art (SOTA) methods.


title: Faster algorithms for circuits in the Cayley-Menger algebraic matroid

abstract: A classical problem in Distance Geometry, with multiple practical applications (in molecular structure determination, sensor network localization etc.) is to find the possible placements of the vertices of a graph with given edge lengths. For minimally rigid graphs, the double-exponential Gr\"obner Bases algorithm with an elimination order can be applied, in theory, but it is impractical even for small instances. By relating the problem to the computation of circuit polynomials in the Cayley-Menger ideal, we recently proposed an algebraic-combinatorial approach and an elimination algorithm for circuit polynomials [23]. It is guided by a tree structure whose leaves correspond to complete $K_4$ graphs and whose nodes perform algebraic resultant operations. In this paper we uncover further combinatorial structure in the Cayley-Menger algebraic matroid that leads to an extension of our algorithm. In particular, we generalize the combinatorial resultant operation of [23] to take advantage of the non-circuit generators and irreducible polynomials in the Cayley-Menger ideal and use them as leaves of the tree guiding the elimination. Our new method has been implemented in Mathematica and allows previously unobtainable calculations to be carried out. In particular, the $K_{3,3}$-plus-one circuit polynomial, with over one million terms in 10 variables and whose calculation crashed after several days with the previous method of [23], succeeded now in approx. 30 minutes.


title: Improved Efficiency of Open Quantum System Simulations Using Matrix Products States in the Interaction Picture

abstract: Modeling open quantum systems -- quantum systems coupled to a bath -- is of value in condensed matter theory, cavity quantum electrodynamics, nanosciences and biophysics. The real-time simulation of open quantum systems was advanced significantly by the recent development of chain mapping techniques and the use of matrix product states that exploit the intrinsic entanglement structure in open quantum systems. The computational cost of simulating open quantum systems, however, remains high when the bath is excited to high-lying quantum states. We develop an approach to reduce the computational costs in such cases. The interaction representation for the open quantum system is used to distribute excitations among the bath degrees of freedom so that the occupation of each bath oscillator is ensured to be low. The interaction picture also causes the matrix dimensions to be much smaller in a matrix product state of a chain-mapped open quantum system than in the Schr\"odinger picture. Using the interaction representation accelerates the calculations by 1-2 orders of magnitude over existing matrix-product-state method. In the regime of strong system-bath coupling and high temperatures, the speedup can be as large as 3 orders of magnitude. The approach developed here is especially promising to simulate the dynamics of open quantum systems in the high-temperature and strong-coupling regimes.


title: A General Framework for Defending Against Backdoor Attacks via Influence Graph

abstract: In this work, we propose a new and general framework to defend against backdoor attacks, inspired by the fact that attack triggers usually follow a \textsc{specific} type of attacking pattern, and therefore, poisoned training examples have greater impacts on each other during training. We introduce the notion of the {\it influence graph}, which consists of nodes and edges respectively representative of individual training points and associated pair-wise influences. The influence between a pair of training points represents the impact of removing one training point on the prediction of another, approximated by the influence function \citep{koh2017understanding}. Malicious training points are extracted by finding the maximum average sub-graph subject to a particular size. Extensive experiments on computer vision and natural language processing tasks demonstrate the effectiveness and generality of the proposed framework.


title: How Can Creativity Occur in Multi-Agent Systems?

abstract: Complex systems show how surprising and beautiful phenomena can emerge from structures or agents following simple rules. With the recent success of deep reinforcement learning (RL), a natural path forward would be to use the capabilities of multiple deep RL agents to produce emergent behavior of greater benefit and sophistication. In general, this has proved to be an unreliable strategy without significant computation due to the difficulties inherent in multi-agent RL training. In this paper, we propose some criteria for creativity in multi-agent RL. We hope this proposal will give artists applying multi-agent RL a starting point, and provide a catalyst for further investigation guided by philosophical discussion.


title: The CSIRO Crown-of-Thorn Starfish Detection Dataset

abstract: Crown-of-Thorn Starfish (COTS) outbreaks are a major cause of coral loss on the Great Barrier Reef (GBR) and substantial surveillance and control programs are underway in an attempt to manage COTS populations to ecologically sustainable levels. We release a large-scale, annotated underwater image dataset from a COTS outbreak area on the GBR, to encourage research on Machine Learning and AI-driven technologies to improve the detection, monitoring, and management of COTS populations at reef scale. The dataset is released and hosted in a Kaggle competition that challenges the international Machine Learning community with the task of COTS detection from these underwater images.


title: BMO embeddings, chord-arc curves, and Riemann mapping parametrization

abstract: We consider the space of chord-arc curves on the plane passing through the infinity with their parametrization $\gamma$ on the real line, and embed this space into the product of the BMO Teichm\"uller spaces. The fundamental theorem we prove about this representation is that $\log \gamma'$ also gives a biholomorphic homeomorphism into the complex Banach space of BMO functions. Using these two equivalent complex structures, we develop a clear exposition on the analytic dependence of involved mappings between certain subspaces. Especially, we examine the parametrization of a chord-arc curve by using the Riemann mapping and its dependence on the arc-length parametrization. As a consequence, we can solve a conjecture of Katznelson, Nag, and Sullivan in 1990 by showing that this dependence is not continuous.


title: Topological categories related to Fredholm operators: I. Classifying spaces

abstract: In 1970s Segal outlined proofs of two theorems relating spaces of Fredholm and self-adjoint Fredholm operators with Quillen's constructions used to define higher algebraic K-theory. In the present paper we provide detailed proofs of these theorems of Segal (different from the ones outlined by Segal) and then transplant some further ideas of Quillen to the real of Fredholm and self-adjoint Fredholm operators. The main results may be considered as partial analogues of the equivalence of Quillen's two definition of higher algebraic K-theory. Along the way we relate spaces of Fredholm and self-adjoint Fredholm operators with more concrete classifying spaces. These results are partially motivated by applications to the index theory in a related paper.


title: Braking and Body Angles Control of an Insect-Computer Hybrid Robot by Electrical Stimulation of Beetle Flight Muscle in Free Flight

abstract: While engineers put lots of effort, resources, and time in building insect scale micro aerial vehicles (MAVs) that fly like insects, insects themselves are the real masters of flight. What if we would use living insect as platform for MAV instead? Here, we reported a flight control via electrical stimulation of a flight muscle of an insect-computer hybrid robot, which is the interface of a mountable wireless backpack controller and a living beetle. The beetle uses indirect flight muscles to drive wing flapping and three major direct flight muscles (basalar, subalar and third axilliary (3Ax) muscles) to control the kinematics of the wings for flight maneuver. While turning control was already achieved by stimulating basalar and 3Ax muscles, electrical stimulation of subalar muscles resulted in braking and elevation control in flight. We also demonstrated around 20 degrees of contralateral yaw and roll by stimulating individual subalar muscle. Stimulating both subalar muscles lead to an increase of 20 degrees in pitch and decelerate the flight by 1.5 m/s2 as well as an induce an elevation of 2 m/s2.


title: A propagation of chaos result for weakly interacting nonlinear Snell envelopes

abstract: In this article, we establish a propagation of chaos result for weakly interacting nonlinear Snell envelopes which converge to a class of mean-field reflected backward stochastic differential equations (BSDEs) with jumps and right-continuous and left-limited obstacle, where the mean-field interaction in terms of the distribution of the $Y$-component of the solution enters both the driver and the lower obstacle. Under mild Lipschitz and integrability conditions on the coefficients, we prove existence and uniqueness of the solution to both the mean-field reflected BSDEs with jumps and the corresponding system of weakly interacting particles and provide a propagation of chaos result for the whole solution $(Y,Z,U,K)$, which requires new technical results due to the dependence of the obstacle on the solution and the presence of jumps.


title: Learning Context-Aware Embedding for Person Search

abstract: Person Search is a relevant task that aims to jointly solve Person Detection and Person Re-identification(re-ID). Though most previous methods focus on learning robust individual features for retrieval, it's still hard to distinguish confusing persons because of illumination, large pose variance, and occlusion. Contextual information is practically available in person search task which benefits searching in terms of reducing confusion. To this end, we present a novel contextual feature head named Attention Context-Aware Embedding(ACAE) which enhances contextual information. ACAE repeatedly reviews the person features within and across images to find similar pedestrian patterns, allowing it to implicitly learn to find possible co-travelers and efficiently model contextual relevant instances' relations. Moreover, we propose Image Memory Bank to improve the training efficiency. Experimentally, ACAE shows extensive promotion when built on different one-step methods. Our overall methods achieve state-of-the-art results compared with previous one-step methods.


title: GPU-accelerated path tracker for polyhedral homotopy

abstract: The polyhedral homotopy method of Huber and Sturmfels is a particularly efficient and robust numerical method for solving system of (Laurent) polynomial equations. A central component in an implementation of this method is an efficient and scalable path tracker. While the implementation issues in a scalable path tracker for computer clusters or multi-core CPUs have been solved thoroughly, designing good GPU-based implementations is still an active research topic. This paper addresses the core issue of efficiently evaluate a multivariate system of Laurent polynomials together with all its partial derivatives. We propose a simple approach that maps particularly well onto the parallel computing architectures of modern GPUs. As a by-product, we also simplify and accelerate the path tracker by consolidating the computation of Euler and Newton directions.


title: Limiting curvature models of gravity

abstract: In this paper we discuss a limiting curvature condition and its application to cosmological and black hole solutions.


title: TinyDefectNet: Highly Compact Deep Neural Network Architecture for High-Throughput Manufacturing Visual Quality Inspection

abstract: A critical aspect in the manufacturing process is the visual quality inspection of manufactured components for defects and flaws. Human-only visual inspection can be very time-consuming and laborious, and is a significant bottleneck especially for high-throughput manufacturing scenarios. Given significant advances in the field of deep learning, automated visual quality inspection can lead to highly efficient and reliable detection of defects and flaws during the manufacturing process. However, deep learning-driven visual inspection methods often necessitate significant computational resources, thus limiting throughput and act as a bottleneck to widespread adoption for enabling smart factories. In this study, we investigated the utilization of a machine-driven design exploration approach to create TinyDefectNet, a highly compact deep convolutional network architecture tailored for high-throughput manufacturing visual quality inspection. TinyDefectNet comprises of just ~427K parameters and has a computational complexity of ~97M FLOPs, yet achieving a detection accuracy of a state-of-the-art architecture for the task of surface defect detection on the NEU defect benchmark dataset. As such, TinyDefectNet can achieve the same level of detection performance at 52$\times$ lower architectural complexity and 11x lower computational complexity. Furthermore, TinyDefectNet was deployed on an AMD EPYC 7R32, and achieved 7.6x faster throughput using the native Tensorflow environment and 9x faster throughput using AMD ZenDNN accelerator library. Finally, explainability-driven performance validation strategy was conducted to ensure correct decision-making behaviour was exhibited by TinyDefectNet to improve trust in its usage by operators and inspectors.


title: SwiftSRGAN -- Rethinking Super-Resolution for Efficient and Real-time Inference

abstract: In recent years, there have been several advancements in the task of image super-resolution using the state of the art Deep Learning-based architectures. Many super-resolution-based techniques previously published, require high-end and top-of-the-line Graphics Processing Unit (GPUs) to perform image super-resolution. With the increasing advancements in Deep Learning approaches, neural networks have become more and more compute hungry. We took a step back and, focused on creating a real-time efficient solution. We present an architecture that is faster and smaller in terms of its memory footprint. The proposed architecture uses Depth-wise Separable Convolutions to extract features and, it performs on-par with other super-resolution GANs (Generative Adversarial Networks) while maintaining real-time inference and a low memory footprint. A real-time super-resolution enables streaming high resolution media content even under poor bandwidth conditions. While maintaining an efficient trade-off between the accuracy and latency, we are able to produce a comparable performance model which is one-eighth (1/8) the size of super-resolution GANs and computes 74 times faster than super-resolution GANs.


title: Random average sampling and reconstruction in shift-invariant subspaces of mixed Lebesgue spaces

abstract: In this paper, the problem of reconstruction of signals in mixed Lebesgue spaces from their random average samples has been studied. Probabilistic sampling inequalities for certain subsets of shift-invariant spaces have been derived. It is shown that the probabilities increase to one when the sample size increases. Further, explicit reconstruction formulae for signals in these subsets have been obtained for which the numerical simulations have also been performed.


title: Proceedings of the CSCW 2021 Workshop -- Investigating and Mitigating Biases in Crowdsourced Data

abstract: This volume contains the position papers presented at CSCW 2021 Workshop - Investigating and Mitigating Biases in Crowdsourced Data, held online on 23rd October 2021, at the 24th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2021). The workshop explored how specific crowdsourcing workflows, worker attributes, and work practices contribute to biases in data. The workshop also included discussions on research directions to mitigate labelling biases, particularly in a crowdsourced context, and the implications of such methods for the workers.


title: What Seismic Minimum Reveals About Solar Magnetism Below the Surface?

abstract: The Sun's magnetic field varies in multiple time scales. Observations show that the minimum between cycles 24 and 25 was the second consecutive minimum which was deeper and wider than several earlier minima. Since the active regions observed at the Sun's surface are manifestations of the magnetic field generated in the interior, it is crucial to investigate/understand the dynamics below the surface. In this context, we report, by probing the solar interior with helioseismic techniques applied to long-term oscillations data from the Global Oscillation Network Group (GONG), that the seismic minima in deeper layers have been occurring about a year earlier than that at the surface for the last two consecutive solar cycles. Our findings also demonstrate a decrease in strong magnetic fields at the base of the convection zone, the primary driver of the surface magnetic activity. We conclude that the magnetic fields located in the core and near-surface shear layers, in addition to the tachocline fields, play an important role in modifying the oscillation frequencies. This provides evidence that further strengthens the existence of a relic magnetic field in the Sun's core since its formation.


title: Is the Rush to Machine Learning Jeopardizing Safety? Results of a Survey

abstract: Machine learning (ML) is finding its way into safety-critical systems (SCS). Current safety standards and practice were not designed to cope with ML techniques, and it is difficult to be confident that SCSs that contain ML components are safe. Our hypothesis was that there has been a rush to deploy ML techniques at the expense of a thorough examination as to whether the use of ML techniques introduces safety problems that we are not yet adequately able to detect and mitigate against. We thus conducted a targeted literature survey to determine the research effort that has been expended in applying ML to SCS compared with that spent on evaluating the safety of SCSs that deploy ML components. This paper presents the (surprising) results of the survey.


title: Estimating earthquake-induced tsunami height probabilities without sampling

abstract: Given a distribution of earthquake-induced seafloor elevations, we present a method to compute the probability of the resulting tsunamis reaching a certain size on shore. Instead of sampling, the proposed method relies on optimization to compute the most likely fault slips that result in a seafloor deformation inducing a large tsunami wave. We model tsunamis induced by bathymetry change using the shallow water equations on an idealized slice through the sea. The earthquake slip model is based on a sum of multivariate log-normal distributions, and follows the Gutenberg-Richter law for moment magnitudes 7--9. For a model problem inspired by the Tohoku-Oki 2011 earthquake and tsunami, we quantify annual probabilities of differently sized tsunami waves. Our method also identifies the most effective tsunami mechanisms. These mechanisms have smoothly varying fault slip patches that lead to an expansive but moderately large bathymetry change. The resulting tsunami waves are compressed as they approach shore and reach close-to-vertical leading wave edge close to shore.


title: Quasi one-dimensional diffuse laser cooling of atoms

abstract: We demonstrate experimentally the generation of one-dimensional cold gases of $^{87}$Rb atoms by diffuse laser cooling (DLC). A horizontal slender vacuum glass tube with length of 105~cm and diameter of 2~cm is used in our experiment. The diffuse laser light inside the tube, which is generated by multi-reflection of injected lasers, cools the background vapor atoms. With 250~mW of cooling light and 50~mW of repumping light, an evenly distributed meter-long profile of atom cloud is obtained. We observe a factor 4 improvement on the atomic OD for a typical cooling duration of 170~ms and a sub-Doppler atomic temperature of 25~$\mu$k. The maximum number of detected cold atoms remain constant for a free-fall duration of 30~ms. Such samples are ideal for many quantum optical experiments involving electromagnetically induced transparency, electronically highly excited (Rydberg) atoms and quantum precision measurements.


title: Square-root Floquet topological phases and time crystals

abstract: Periodically driven (Floquet) phases are attractive due to their ability to host unique physical phenomena with no static counterparts. We propose a general approach in nontrivially devising a square-root version of existing Floquet phases, applicable both in noninteracting and interacting setting. The resulting systems are found to yield richer physics that is otherwise absent in the original counterparts and is robust against parameter imperfection. These include the emergence of Floquet topological superconductors with arbitrarily many zero, $\pi$, and $\pi/2$ edge modes, as well as $4T$-period Floquet time crystals in disordered and disorder-free systems ($T$ being the driving period). Remarkably, our approach can be repeated indefinitely to obtain a 2nth-root version of a given system, thus allowing for the discovery and systematic construction of a family of exotic Floquet phases.


title: Key Varieties for Prime $\mathbb{Q}$-Fano Threefolds Related with $\mathbb{P}^{2}\times\mathbb{P}^{2}$-Fibrations. Part II

abstract: We construct a $15$-dimensional affine variety $\Pi_{\mathbb{A}}^{15}$ with a ${\rm GL}_{2}$- and $(\mathbb{C}^{*})^{4}$-actions. We denote by $\Pi_{\mathbb{A}}^{14}$ the affine variety obtained from $\Pi_{\mathbb{A}}^{15}$ by setting one specified variable to $1$ (we refer the precise definition to Definition 1.1 of the paper). Let $\Pi_{\mathbb{P}}^{13}$ be several weighted projectivizations of $\Pi_{\mathbb{A}}^{14}$, and $\Pi_{\mathbb{P}}^{14}$ the weighted cone over $\Pi_{\mathbb{P}}^{13}$ with a weight one coordinate added. We show that $\Pi_{\mathbb{P}}^{13}$ or $\Pi_{\mathbb{P}}^{14}$ produce, as weighted complete intersections, examples of prime $\mathbb{Q}$-Fano threefolds of codimension four belonging to the eight classes No.308, 501, 512, 550, 577, 872, 878, and 1766 of the graded ring database. The construction of $\Pi_{\mathbb{A}}^{15}$ is based on a certain type of unprojection and is inspired by R.Taylor's thesis submitted to University of Warwick. We also show that a partial projectivization of $\Pi_{\mathbb{A}}^{15}$ has a $\mathbb{P}^{2}\times\mathbb{P}^{2}$-fibration over the affine space $\mathbb{A}^{10}$. To show this, we introduce another $13$-dimensional affine variety $H_{\mathbb{A}}^{13}$ whose product with an open subset of $\mathbb{A}^{2}$ is isomorphic to a sextic cover of an open subset of $\Pi_{\mathbb{A}}^{15}$.


title: Low Frequency Quasi Periodic Oscillations and Shocks in Accretion onto Black Hole

abstract: Low-frequency quasi-periodic oscillations (LFQPOs) have been routinely observed in black hole X-ray binaries (BHXRBs). These LFQPOs can be explained by axisymmetric shock oscillation in accretion flow around a rotating black hole. We address the physical origin of Type-C LFQPOs in BHXRBs observed by the Rossi X-ray Timing Explorer satellite considering a minimum number of free parameters, namely, specific energy and specific angular momentum of the infalling matter for a given set of BH mass and spin parameter. We apply the solution for a large number of BH candidates to further strengthen the scenario of an anti-correlation between the QPO frequency and the location of the shock. Our study also confirms that Compton cooling can be sufficient to explain the observed QPOs.


title: Sparse DETR: Efficient End-to-End Object Detection with Learnable Sparsity

abstract: DETR is the first end-to-end object detector using a transformer encoder-decoder architecture and demonstrates competitive performance but low computational efficiency on high resolution feature maps. The subsequent work, Deformable DETR, enhances the efficiency of DETR by replacing dense attention with deformable attention, which achieves 10x faster convergence and improved performance. Deformable DETR uses the multiscale feature to ameliorate performance, however, the number of encoder tokens increases by 20x compared to DETR, and the computation cost of the encoder attention remains a bottleneck. In our preliminary experiment, we observe that the detection performance hardly deteriorates even if only a part of the encoder token is updated. Inspired by this observation, we propose Sparse DETR that selectively updates only the tokens expected to be referenced by the decoder, thus help the model effectively detect objects. In addition, we show that applying an auxiliary detection loss on the selected tokens in the encoder improves the performance while minimizing computational overhead. We validate that Sparse DETR achieves better performance than Deformable DETR even with only 10% encoder tokens on the COCO dataset. Albeit only the encoder tokens are sparsified, the total computation cost decreases by 38% and the frames per second (FPS) increases by 42% compared to Deformable DETR. Code is available at https://github.com/kakaobrain/sparse-detr