title: Development of monitoring systems for anomaly detection using ASTD specifications

abstract: Anomaly-based intrusion detection systems are essential defenses against cybersecurity threats because they can identify anomalies in current activities. However, these systems have difficulties providing entity processing independence through a programming language. In addition, a degradation of the detection process is caused by the complexity of scheduling the training and detection processes, which are required to keep the anomaly detection system continuously updated. This paper shows how to use the algebraic state-transition diagram (ASTD) language to develop flexible anomaly detection systems. This paper provides a model for detecting point anomalies using the unsupervised non-parametric technique Kernel Density Estimation to estimate the probability density of event occurrence. The proposed model caters for both the training and the detection phase continuously. The ASTD language streamlines the modeling of detection systems thanks to its process algebraic operators that provide a solution to overcome these challenges. By delegating the combination of anomaly-based detection processes to the ASTD language, the effort and complexity are reduced during detection models development. Finally, using a qualitative evaluation, this study demonstrates that the algebraic operators in the ASTD specification language overcome these challenges.


title: Early results from GLASS-JWST. X: Rest-frame UV-optical properties of galaxies at 7 < z < 9

abstract: We present the first James Webb Space Telescope/NIRCam-led determination of $7<z<9$ galaxy properties based on broadband imaging from 0.8 to 5~$\mathrm{\mu m}$ as part of the GLASS-JWST Early Release Science program. This is the deepest dataset acquired at these wavelengths to date, with an angular resolution $\lesssim0.14$ arcsec. We robustly identify 13 galaxies with $S/N\gtrsim8$ in F444W from 8 arcmin$^2$ of data at $m_{AB}\leq 28$ from a combination of dropout and photometric redshift selection. From simulated data modeling, we estimate the dropout sample purity to be $\gtrsim90\%$. We find that the number density of these F444W-selected sources is broadly consistent with expectations from the UV luminosity function determined from Hubble Space Telescope data. We characterize galaxy physical properties using a Bayesian Spectral Energy Distribution fitting method, finding median stellar mass $10^{8.5}M_\odot$ and age 140 Myr, indicating they started ionizing their surroundings at redshift $z>9.5$. Their star formation main sequence is consistent with predictions from simulations. Lastly, we introduce an analytical framework to constrain main-sequence evolution at $z>7$ based on galaxy ages and basic assumptions, through which we find results consistent with expectations from cosmological simulations. While this work only gives a glimpse of the properties of typical galaxies that are thought to drive the reionization of the universe, it clearly shows the potential of JWST to unveil unprecedented details on galaxy formation in the first billion years.


title: Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds

abstract: This paper presents a multi-layer motion planning and control architecture for autonomous racing, capable of avoiding static obstacles, performing active overtakes, and reaching velocities above 75 $m/s$. The used offline global trajectory generation and the online model predictive controller are highly based on optimization and dynamic models of the vehicle, where the tires and camber effects are represented in an extended version of the basic Pacejka Magic Formula. The proposed single-track model is identified and validated using multi-body motorsport libraries which allow simulating the vehicle dynamics properly, especially useful when real experimental data are missing. The fundamental regularization terms and constraints of the controller are tuned to reduce the rate of change of the inputs while assuring an acceptable velocity and path tracking. The motion planning strategy consists of a Fren\'et-Frame-based planner which considers a forecast of the opponent produced by a Kalman filter. The planner chooses the collision-free path and velocity profile to be tracked on a 3 seconds horizon to realize different goals such as following and overtaking. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s^{2}$.


title: A Conditional Linear Combination Test with Many Weak Instruments

abstract: We consider a linear combination of jackknife Anderson-Rubin (AR), jackknife Lagrangian multiplier (LM), and orthogonalized jackknife LM tests for inference in IV regressions with many weak instruments and heteroskedasticity. Following I.Andrews (2016), we choose the weights in the linear combination based on a decision-theoretic rule that is adaptive to the identification strength. Under both weak and strong identifications, the proposed test controls asymptotic size and is admissible among certain class of tests. Under strong identification, our linear combination test has optimal power against local alternatives among the class of invariant or unbiased tests which are constructed based on jackknife AR and LM tests. Simulations and an empirical application to Angrist and Krueger's (1991) dataset confirm the good power properties of our test.


title: M-theory on $AdS_4\times S^7$ at 1-loop and beyond

abstract: We study graviton scattering on $AdS_4\times S^7$, which is dual to the stress tensor multiplet four-point function in the maximally supersymmetric 3d $U(N)_1\times U(N)_{-1}$ ABJM theory. We compute 1-loop corrections to this holographic correlator coming from Witten diagrams with supergravity $R$ and higher derivative $R^4$ vertices, up to contact term ambiguities, and find that the flat space limit matches the corresponding terms in the 11d M-theory S-matrix. We then use supersymmetric localization to show that all the 1-loop contact terms vanish, as was previously observed for the $AdS_4\times S^7/\mathbb{Z}_2$ theory dual to $U(N)_2\times U(N)_{-2}$ ABJM. Finally, we use the recent localization results of Gaiotto and Abajian, as inspired by twisted M-theory, to compute all the short OPE coefficients in correlators of the stress tensor multiplet and the next lowest half-BPS operator, which we find saturate the bootstrap bounds on these mixed correlators for all $N$.


title: Moduli of representations of one-point extensions

abstract: We study moduli spaces of (semi-)stable representations of one-point extensions of quivers by rigid representations. This class of moduli spaces unifies Grassmannians of subrepresentations of rigid representations and moduli spaces of representations of generalized Kronecker quivers. With homological methods, we find numerical criteria for non-emptiness and results on basic geometric properties, construct generating semi-invariants, expand the Gel'fand MacPherson correspondence, and derive a formula for the Poincare polynomial in singular cohomology of these moduli spaces.


title: Study of unzipping transitions in an adsorbed polymer by a periodic force

abstract: Using Monte Carlo simulations, we study the dynamic transitions in the unzipping of an adsorbed homogeneous polymer on a surface (or wall). We consider three different types of surfaces. One end of the polymer is always kept anchored, and other end monomer is subjected to a periodic force with frequency $\omega$ and amplitude $g_0$. We observe that the force-distance isotherms show hysteresis loops in all the three cases. For all the three cases, it is found that the area of the hysteresis loop, $A_{loop}$, scales as $1/\omega$ in the higher frequency regime, and as $g_0^{\alpha} \omega^{\beta}$ with exponents $\alpha = 1$ and $\beta = 1.25$ in the lower frequency regime. The values of exponents $\alpha$ and $\beta$ are similar to the exponents obtained in the earlier Monte Carlo simulation studies of DNA chains and a Langevin dynamics simulation study of longer DNA chains.


title: Deep neural networks on diffeomorphism groups for optimal shape reparameterization

abstract: One of the fundamental problems in shape analysis is to align curves or surfaces before computing geodesic distances between their shapes. Finding the optimal reparametrization realizing this alignment is a computationally demanding task, typically done by solving an optimization problem on the diffeomorphism group. In this paper, we propose an algorithm for constructing approximations of orientation-preserving diffeomorphisms by composition of elementary diffeomorphisms. The algorithm is implemented using PyTorch, and is applicable for both unparametrized curves and surfaces. Moreover, we show universal approximation properties for the constructed architectures, and obtain bounds for the Lipschitz constants of the resulting diffeomorphisms.


title: Central limit theorems and asymptotic independence for local $U$-statistics on diverging halfspaces

abstract: We consider the stochastic behavior of a class of local $U$-statistics of Poisson processes$-$which include subgraph and simplex counts as special cases, and amounts to quantifying clustering behavior$-$for point clouds lying in diverging halfspaces. We provide limit theorems for distributions with light and heavy tails. In particular, we prove finite-dimensional central limit theorems. In the light tail case we investigate tails that decay at least as slow as exponential and at least as fast as Gaussian. These results also furnish as a corollary that $U$-statistics for halfspaces diverging at different angles are asymptotically independent, and that there is no asymptotic independence for heavy-tailed densities. Using state-of-the-art bounds derived from recent breakthroughs combining Stein's method and Malliavin calculus, we quantify the rate of this convergence in terms of Kolmogorov distance. We also investigate the behavior of local $U$-statistics of a Poisson Process conditioned to lie in diverging halfspace and show how the rate of convergence in the Kolmogorov distance is faster the lighter the tail of the density is.


title: Towards Global Optimality in Cooperative MARL with the Transformation And Distillation Framework

abstract: Decentralized execution is one core demand in cooperative multi-agent reinforcement learning (MARL). Recently, most popular MARL algorithms have adopted decentralized policies to enable decentralized execution and use gradient descent as their optimizer. However, there is hardly any theoretical analysis of these algorithms taking the optimization method into consideration, and we find that various popular MARL algorithms with decentralized policies are suboptimal in toy tasks when gradient descent is chosen as their optimization method. In this paper, we theoretically analyze two common classes of algorithms with decentralized policies -- multi-agent policy gradient methods and value-decomposition methods to prove their suboptimality when gradient descent is used. In addition, we propose the Transformation And Distillation (TAD) framework, which reformulates a multi-agent MDP as a special single-agent MDP with a sequential structure and enables decentralized execution by distilling the learned policy on the derived ``single-agent" MDP. This approach uses a two-stage learning paradigm to address the optimization problem in cooperative MARL, maintaining its performance guarantee. Empirically, we implement TAD-PPO based on PPO, which can theoretically perform optimal policy learning in the finite multi-agent MDPs and shows significant outperformance on a large set of cooperative multi-agent tasks.


title: The $P_{\psi s}^{\Lambda}(4338)$ pentaquark and its partners in the molecular picture

abstract: The LHCb collaboration has detected a new hidden-charm pentaquark with the quantum numbers of a $\Lambda$ baryon: the $P_{\psi s}^{\Lambda}(4338)$. In the molecular picture this pentaquark will be interpreted as a $\bar{D} \Xi_c$ molecule. Here we briefly comment on the relation of the new $P_{\psi s}^{\Lambda}(4338)$ with the $P^{\Lambda}_{\psi s}(4459)$. We find that the $P_{\psi s}^{\Lambda}(4338)$ and $P_{\psi s}^{\Lambda}(4459)$ both accept a common molecular description in terms of the same parameters, which predicts the existence of a few additional $P_{\psi}^N$, $P_{\psi s}^{\Lambda}$, $P_{\psi s}^{\Sigma}$ and $P_{\psi s s}^{\Xi}$ pentaquarks composed of a charmed antimeson and an antitriplet charmed baryon. The most robust of these predicted pentaquarks is a $P_{\psi s}^{\Lambda}$ with a mass in the $(4235-4255)\,{\rm MeV}$ range, while other two interesting ones are a $P_{\psi}^{N}(4150)$ and a $P_{\psi}^{\Sigma}(4335)$, the later basically at the same mass as the $P_{\psi}^{\Lambda}(4338)$, with which it might mix owing to isospin symmetry breaking effects.


title: Imprints of ultralight axions on the gravitational wave and pulsar timing measurement

abstract: The axion or axion-like particle motivated from a natural solution of strong CP problem or string theory is a promising dark matter candidate. We study the new observational effects of ultralight axion-like particles by the space-borne gravitational wave detector and the radio telescope. Taking the neutron star-black hole binary as an example, we demonstrate that the gravitational waveform could be obviously modified by the slow depletion of the axion cloud around the black hole formed through the superradiance process. We compare these new effects on the binary with the well-studied effects from dynamical friction with dark matter and dipole radiation in model-independent ways. Finally, we discuss the constraints from LIGO/Virgo and study the detectability of the ultralight axion particles at LISA and TianQin.


title: VTrackIt: A Synthetic Self-Driving Dataset with Infrastructure and Pooled Vehicle Information

abstract: Artificial intelligence solutions for Autonomous Vehicles (AVs) have been developed using publicly available datasets such as Argoverse, ApolloScape, Level5, and NuScenes. One major limitation of these datasets is the absence of infrastructure and/or pooled vehicle information like lane line type, vehicle speed, traffic signs, and intersections. Such information is necessary and not complementary to eliminating high-risk edge cases. The rapid advancements in Vehicle-to-Infrastructure and Vehicle-to-Vehicle technologies show promise that infrastructure and pooled vehicle information will soon be accessible in near real-time. Taking a leap in the future, we introduce the first comprehensive synthetic dataset with intelligent infrastructure and pooled vehicle information for advancing the next generation of AVs, named VTrackIt. We also introduce the first deep learning model (InfraGAN) for trajectory predictions that considers such information. Our experiments with InfraGAN show that the comprehensive information offered by VTrackIt reduces the number of high-risk edge cases. The VTrackIt dataset is available upon request under the Creative Commons CC BY-NC-SA 4.0 license at http://vtrackit.irda.club.


title: Dirac-boson stars

abstract: In this paper, we construct \textit{Dirac-boson stars} (DBSs) model composed of a scalar field and two Dirac fields. The scalar field and both Dirac fields are in the ground state. We consider the solution families of the DBSs for the synchronized frequency $\tilde{\omega}$ and the nonsynchronized frequency $\tilde{\omega}_D$ cases, respectively. We find several different solutions when the Dirac mass $\tilde{\mu}_D$ and scalar field frequency $\tilde{\omega}_S$ are taken in some particular ranges. In contrast, no similar case has been found in previous studies of multistate boson stars. Moreover, we discuss the characteristics of each type of solution family of the DBSs and present the relationship between the ADM mass $M$ of the DBSs and the synchronized frequency $\tilde{\omega}$ or the nonsynchronized frequency $\tilde{\omega}_D$. Finally, we calculate the binding energy $E_B$ of the DBSs and investigate the relationship of $E_B$ with the synchronized frequency $\tilde{\omega}$ or the nonsynchronized frequency $\tilde{\omega}_D$.


title: InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images

abstract: We present a method for learning to generate unbounded flythrough videos of natural scenes starting from a single view, where this capability is learned from a collection of single photographs, without requiring camera poses or even multiple views of each scene. To achieve this, we propose a novel self-supervised view generation training paradigm, where we sample and rendering virtual camera trajectories, including cyclic ones, allowing our model to learn stable view generation from a collection of single views. At test time, despite never seeing a video during training, our approach can take a single image and generate long camera trajectories comprised of hundreds of new views with realistic and diverse content. We compare our approach with recent state-of-the-art supervised view generation methods that require posed multi-view videos and demonstrate superior performance and synthesis quality.


title: Block turbo decoding with ORBGRAND

abstract: Guessing Random Additive Noise Decoding (GRAND) is a family of universal decoding algorithms suitable for decoding any moderate redundancy code of any length. We establish that, through the use of list decoding, soft-input variants of GRAND can replace the Chase algorithm as the component decoder in the turbo decoding of product codes. In addition to being able to decode arbitrary product codes, rather than just those with dedicated hard-input component code decoders, results show that ORBGRAND achieves a coding gain of up to 0.7dB over the Chase algorithm with same list size.


title: Movable cones of complete intersections of multidegree one on products of projective spaces

abstract: We study Calabi-Yau manifolds which are complete intersections of hypersurfaces of multidegree $1$ in an $m$-fold product of $n$-dimensional projective spaces. Using the theory of Coxeter groups, we show that the birational automorphism group of such a Calabi-Yau manifold $X$ is infinite and a free product of copies of $\mathbb{Z}$ . Moreover, we give an explicit description of the boundary of the movable cone $\overline{\operatorname{Mov}}(X)$. In the end, we consider examples for the general and non-general case and picture the movable cone and the fundamental domain for the action of $\operatorname{Bir}(X)$.


title: Modeling the Photometric Variability of Alpha$^2$ CVn with a Dynamical Magnetosphere

abstract: Alpha$^2$ Canum Venaticorum (AM CVn) is a strongly magnetic star with peculiar chemical signatures and periodic variability that have been long attributed to the diffusion of magnetic elements through the photosphere, leading to chemical spots across the stellar surface. However, recent studies of other magnetic hot stars are consistent with magnetospheric clouds above the surface. Here we take a renewed approach to modeling AM CVn with a simplified dynamical magnetosphere (DM) and a tilted, offset magnetic dipole to reproduce its Transiting Exoplanet Survey Satellite (TESS) variability. Our dipole model also reproduces well the magnetic surface map of AM CVn from Silvester, Kochukhov, & Wade (2014). Its ultraviolet variability, from IUE archival spectra, is also consistent with traditional reddening models. We further discuss the implications of a magnetosphere on other observable quantities from the system to conclude that it is unlikely to be present in AM CVn.


title: Learn Continuously, Act Discretely: Hybrid Action-Space Reinforcement Learning For Optimal Execution

abstract: Optimal execution is a sequential decision-making problem for cost-saving in algorithmic trading. Studies have found that reinforcement learning (RL) can help decide the order-splitting sizes. However, a problem remains unsolved: how to place limit orders at appropriate limit prices? The key challenge lies in the "continuous-discrete duality" of the action space. On the one hand, the continuous action space using percentage changes in prices is preferred for generalization. On the other hand, the trader eventually needs to choose limit prices discretely due to the existence of the tick size, which requires specialization for every single stock with different characteristics (e.g., the liquidity and the price range). So we need continuous control for generalization and discrete control for specialization. To this end, we propose a hybrid RL method to combine the advantages of both of them. We first use a continuous control agent to scope an action subset, then deploy a fine-grained agent to choose a specific limit price. Extensive experiments show that our method has higher sample efficiency and better training stability than existing RL algorithms and significantly outperforms previous learning-based methods for order execution.


title: Cavity quantum optomechanical nonlinearities and position measurement beyond the breakdown of the linearized approximation

abstract: Several optomechanics experiments are now entering the highly sought nonlinear regime where optomechanical interactions are large even for low light levels. Within this regime, new quantum phenomena and improved performance may be achieved, however, a corresponding theoretical formalism of cavity quantum optomechanics that captures the nonlinearities of both the radiation-pressure interaction and the cavity response is needed to unlock these capabilities. Here, we develop such a nonlinear cavity quantum optomechanical framework, which we then utilize to propose how position measurement can be performed beyond the breakdown of the linearized approximation. Our proposal utilizes optical general-dyne detection, ranging from single to dual homodyne, to obtain mechanical position information imprinted onto both the optical amplitude and phase quadratures and enables both pulsed and continuous modes of operation. These cavity optomechanical nonlinearities are now being confronted in a growing number of experiments, and our framework will allow a range of advances to be made in e.g. quantum metrology, explorations of the standard quantum limit, and quantum measurement and control.


title: A Faster Quantum Algorithm for Semidefinite Programming via Robust IPM Framework

abstract: This paper studies a fundamental problem in convex optimization, which is to solve semidefinite programming (SDP) with high accuracy. This paper follows from the existing robust SDP-based interior point method analysis due to [Huang, Jiang, Song, Tao and Zhang, FOCS 2022]. While, the previous work only provides an efficient implementation in the classical setting. This work provides a novel quantum implementation. We give a quantum second-order algorithm with high-accuracy in both the optimality and the feasibility of its output, and its running time depending on $\log(1/\epsilon)$ on well-conditioned instances. Due to the limitation of quantum itself or first-order method, all the existing quantum SDP solvers either have polynomial error dependence or low-accuracy in the feasibility.


title: CQE in OWL 2 QL: A "Longest Honeymoon" Approach (extended version)

abstract: Controlled Query Evaluation (CQE) has been recently studied in the context of Semantic Web ontologies. The goal of CQE is concealing some query answers so as to prevent external users from inferring confidential information. In general, there exist multiple, mutually incomparable ways of concealing answers, and previous CQE approaches choose in advance which answers are visible and which are not. In this paper, instead, we study a dynamic CQE method, namely, we propose to alter the answer to the current query based on the evaluation of previous ones. We aim at a system that, besides being able to protect confidential data, is maximally cooperative, which intuitively means that it answers affirmatively to as many queries as possible; it achieves this goal by delaying answer modifications as much as possible. We also show that the behavior we get cannot be intensionally simulated through a static approach, independent of query history. Interestingly, for OWL 2 QL ontologies and policy expressed through denials, query evaluation under our semantics is first-order rewritable, and thus in AC0 in data complexity. This paves the way for the development of practical algorithms, which we also preliminarily discuss in the paper.


title: Enhancing quantum exchanges between two oscillators

abstract: We explore the extent to which two quantum oscillators can exchange their quantum states efficiently through a three-level system which can be spin levels of colored centers in solids. High transition probabilities are obtained using Hamiltonian engineering and quantum control techniques. Starting from a weak coupling approximation, we derive conditions on the spin-oscillator interaction Hamiltonian that enable a high-fidelity exchange of quanta. We find that these conditions cannot be fulfilled for arbitrary spin-oscillator coupling. To overcome this limitation, we illustrate how a time-dependent control field applied to the three-level system can lead to an effective dynamic that performs the desired exchange of excitation. In the (ultra) strong coupling regime, an important loss of fidelity is induced by the dispersion of the excitation onto many Fock states of the oscillators. We show that this detrimental effect can be substantially reduced by suitable control fields, which are computed with optimal control numerical algorithms.


title: A Hybrid Numerical Algorithm for Evaluating n-th Order Tridiagonal Determinants

abstract: The principal minors of a tridiagonal matrix satisfy two-term and three-term recurrences [1, 2]. Based on these facts, the current article presents a new efficient and reliable hybrid numerical algorithm for evaluating general n-th order tridiagonal determinants in linear time. The hybrid numerical algorithm avoid all symbolic computations. The algorithm is suited for implementation using computer languages such as FORTRAN, PASCAL, ALGOL, MAPLE, MACSYMA and MATHEMATICA. Some illustrative examples are given. Test results indicate the superiority of the hybrid numerical algorithm.


title: SPRT-based Efficient Best Arm Identification in Stochastic Bandits

abstract: This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the exponential family of bandits face computational challenges. To mitigate these challenges, the BAI problem is viewed and analyzed as a sequential composite hypothesis testing task, and a framework is proposed that adopts the likelihood ratio-based tests known to be effective for sequential testing. Based on this test statistic, a BAI algorithm is designed that leverages the canonical sequential probability ratio tests for arm selection and is amenable to tractable analysis for the exponential family of bandits. This algorithm has two key features: (1) its sample complexity is asymptotically optimal, and (2) it is guaranteed to be $\delta-$PAC. Existing efficient approaches focus on the Gaussian setting and require Thompson sampling for the arm deemed the best and the challenger arm. Additionally, this paper analytically quantifies the computational expense of identifying the challenger in an existing approach. Finally, numerical experiments are provided to support the analysis.


title: Network Revenue Management with Demand Learning and Fair Resource-Consumption Balancing

abstract: In addition to maximizing the total revenue, decision-makers in lots of industries would like to guarantee balanced consumption across different resources. For instance, in the retailing industry, ensuring a balanced consumption of resources from different suppliers enhances fairness and helps main a healthy channel relationship; in the cloud computing industry, resource-consumption balance helps increase customer satisfaction and reduce operational costs. Motivated by these practical needs, this paper studies the price-based network revenue management (NRM) problem with both demand learning and fair resource-consumption balancing. We introduce the regularized revenue, i.e., the total revenue with a balancing regularization, as our objective to incorporate fair resource-consumption balancing into the revenue maximization goal. We propose a primal-dual-type online policy with the Upper-Confidence-Bound (UCB) demand learning method to maximize the regularized revenue. We adopt several innovative techniques to make our algorithm a unified and computationally efficient framework for the continuous price set and a wide class of balancing regularizers. Our algorithm achieves a worst-case regret of $\widetilde O(N^{5/2}\sqrt{T})$, where $N$ denotes the number of products and $T$ denotes the number of time periods. Numerical experiments in a few NRM examples demonstrate the effectiveness of our algorithm in simultaneously achieving revenue maximization and fair resource-consumption balancing


title: Effect of Shock Strength on the Radiation of Focusing Shock Wave

abstract: High temperature radiating Air is produced experimentally by focusing a shock wave with the help of a spherically converging test section attached to a shock tube. The converging section concentrates the shock to a point with minimum diffusion losses. A shift in radiation towards the UV region was observed with an increase in the strength of the focusing shock wave. The atomic and molecular emission was observed from the radiation spectrum. Along with the emission from molecules of Air, emissions from contaminations were also observed. The temperature of the radiating gas was estimated using the blackbody radiation curve and was observed to be 13000 K.


title: Lagrangian Method for Q-Function Learning (with Applications to Machine Translation)

abstract: This paper discusses a new approach to the fundamental problem of learning optimal Q-functions. In this approach, optimal Q-functions are formulated as saddle points of a nonlinear Lagrangian function derived from the classic Bellman optimality equation. The paper shows that the Lagrangian enjoys strong duality, in spite of its nonlinearity, which paves the way to a general Lagrangian method to Q-function learning. As a demonstration, the paper develops an imitation learning algorithm based on the duality theory, and applies the algorithm to a state-of-the-art machine translation benchmark. The paper then turns to demonstrate a symmetry breaking phenomenon regarding the optimality of the Lagrangian saddle points, which justifies a largely overlooked direction in developing the Lagrangian method.


title: On non-supersymmetric fixed points in five dimensions

abstract: We generalize recent results regarding the phase space of the mass deformed $E_1$ fixed point to a full class of five-dimensional superconformal field theories, known as $X_{1,N}$. As in the $E_1$ case, a phase transition occurs as a supersymmetry preserving and a supersymmetry breaking mass deformations are appropriately tuned. The order of such phase transition could not be unequivocally determined in the $E_1$ case. For $X_{1,N}$ instead, we can show that at large $N$ there exists a regime where the phase transition is second order. Our findings give supporting evidence for the existence of non-supersymmetric fixed points in five dimensions.


title: Adaptive Soft Contrastive Learning

abstract: Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual samples are treated as independent categories. However, presuming all the samples are different contradicts the natural grouping of similar samples in common visual datasets, e.g., multiple views of the same dog. To bridge the gap, this paper proposes an adaptive method that introduces soft inter-sample relations, namely Adaptive Soft Contrastive Learning (ASCL). More specifically, ASCL transforms the original instance discrimination task into a multi-instance soft discrimination task, and adaptively introduces inter-sample relations. As an effective and concise plug-in module for existing self-supervised learning frameworks, ASCL achieves the best performance on several benchmarks in terms of both performance and efficiency. Code is available at https://github.com/MrChenFeng/ASCL_ICPR2022.


title: Generalized Identifiability Bounds for Mixture Models with Grouped Samples

abstract: Recent work has shown that finite mixture models with $m$ components are identifiable, while making no assumptions on the mixture components, so long as one has access to groups of samples of size $2m-1$ which are known to come from the same mixture component. In this work we generalize that result and show that, if every subset of $k$ mixture components of a mixture model are linearly independent, then that mixture model is identifiable with only $(2m-1)/(k-1)$ samples per group. We further show that this value cannot be improved. We prove an analogous result for a stronger form of identifiability known as "determinedness" along with a corresponding lower bound. This independence assumption almost surely holds if mixture components are chosen randomly from a $k$-dimensional space. We describe some implications of our results for multinomial mixture models and topic modeling.


title: High dimensional stochastic linear contextual bandit with missing covariates

abstract: Recent works in bandit problems adopted lasso convergence theory in the sequential decision-making setting. Even with fully observed contexts, there are technical challenges that hinder the application of existing lasso convergence theory: 1) proving the restricted eigenvalue condition under conditionally sub-Gaussian noise and 2) accounting for the dependence between the context variables and the chosen actions. This paper studies the effect of missing covariates on regret for stochastic linear bandit algorithms. Our work provides a high-probability upper bound on the regret incurred by the proposed algorithm in terms of covariate sampling probabilities, showing that the regret degrades due to missingness by at most $\zeta_{min}^2$, where $\zeta_{min}$ is the minimum probability of observing covariates in the context vector. We illustrate our algorithm for the practical application of experimental design for collecting gene expression data by a sequential selection of class discriminating DNA probes.


title: METER-ML: A Multi-Sensor Earth Observation Benchmark for Automated Methane Source Mapping

abstract: Reducing methane emissions is essential for mitigating global warming. To attribute methane emissions to their sources, a comprehensive dataset of methane source infrastructure is necessary. Recent advancements with deep learning on remotely sensed imagery have the potential to identify the locations and characteristics of methane sources, but there is a substantial lack of publicly available data to enable machine learning researchers and practitioners to build automated mapping approaches. To help fill this gap, we construct a multi-sensor dataset called METER-ML containing 86,599 georeferenced NAIP, Sentinel-1, and Sentinel-2 images in the U.S. labeled for the presence or absence of methane source facilities including concentrated animal feeding operations, coal mines, landfills, natural gas processing plants, oil refineries and petroleum terminals, and wastewater treatment plants. We experiment with a variety of models that leverage different spatial resolutions, spatial footprints, image products, and spectral bands. We find that our best model achieves an area under the precision recall curve of 0.915 for identifying concentrated animal feeding operations and 0.821 for oil refineries and petroleum terminals on an expert-labeled test set, suggesting the potential for large-scale mapping. We make METER-ML freely available at https://stanfordmlgroup.github.io/projects/meter-ml/ to support future work on automated methane source mapping.


title: Ten Lessons for Data Sharing With a Data Commons

abstract: A data commons is a cloud-based data platform with a governance structure that allows a community to manage, analyze and share its data. Data commons provide a research community with the ability to manage and analyze large datasets using the elastic scalability provided by cloud computing and to share data securely and compliantly, and, in this way, accelerate the pace of research. Over the past decade, a number of data commons have been developed and we discuss some of the lessons learned from this effort.


title: Comment on "On the Extraction of Purely Motor EEG Neural Correlates during an Upper Limb Visuomotor Task"

abstract: Bibian et al. show in their recent paper (Bibi\'an et al. 2021) that eye and head movements can affect the EEG-based classification in a reaching motor task. These movements can generate artefacts that can cause an overoptimistic estimation of the classification accuracy. They speculate that such artefacts jeopardise the interpretation of the results from several motor decoding studies including our study (Ofner et al. 2017). While we endorse their warning about artefacts in general, we do have doubts whether their work supports such a statement with respect to our study. We provide in this commentary a more nuanced contextualization of our work presented in Ofner et al. and the type of artefacts investigated in Bibian et al.


title: Rethinking Few-Shot Object Detection on a Multi-Domain Benchmark

abstract: Most existing works on few-shot object detection (FSOD) focus on a setting where both pre-training and few-shot learning datasets are from a similar domain. However, few-shot algorithms are important in multiple domains; hence evaluation needs to reflect the broad applications. We propose a Multi-dOmain Few-Shot Object Detection (MoFSOD) benchmark consisting of 10 datasets from a wide range of domains to evaluate FSOD algorithms. We comprehensively analyze the impacts of freezing layers, different architectures, and different pre-training datasets on FSOD performance. Our empirical results show several key factors that have not been explored in previous works: 1) contrary to previous belief, on a multi-domain benchmark, fine-tuning (FT) is a strong baseline for FSOD, performing on par or better than the state-of-the-art (SOTA) algorithms; 2) utilizing FT as the baseline allows us to explore multiple architectures, and we found them to have a significant impact on down-stream few-shot tasks, even with similar pre-training performances; 3) by decoupling pre-training and few-shot learning, MoFSOD allows us to explore the impact of different pre-training datasets, and the right choice can boost the performance of the down-stream tasks significantly. Based on these findings, we list possible avenues of investigation for improving FSOD performance and propose two simple modifications to existing algorithms that lead to SOTA performance on the MoFSOD benchmark. The code is available at https://github.com/amazon-research/few-shot-object-detection-benchmark.


title: Generalized Hilbert Operator Acting on Bloch Type Spaces

abstract: Let $\mu$ be a positive Borel measure on the interval [0,1). For $\alpha>0$, the Hankel matrix $\mathcal{H}_{\mu,\alpha}=(\mu_{n,k,\alpha})_{n,k\geq 0}$ with entries $\mu_{n,k,\alpha}=\int_{[0,1)}\frac{\Gamma(n+\alpha)}{n!\Gamma(\alpha)}t^{n+k}d\mu(t)$ formally induces the operator $$\mathcal{H}_{\mu,\alpha}(f)(z)=\sum_{n=0}^{\infty}\left(\sum_{k=0}^{\infty} \mu_{n, k,\alpha} a_{k}\right)z^{n} $$ on the space of all analytic functions $f(z)=\sum_{k=0}^{\infty}a_{k}z^{k}$ in the unit disc $\mathbb{D}$. In this paper, we characterize the measures $\mu$ for which $\mathcal{H}_{\mu,\alpha}$ ($\alpha\geq 2$) is a bounded (resp., compact) operator from the Bloch type space $\mathscr{B}_{\beta}$ ($0<\beta<\infty$) into $\mathscr{B}_{\alpha-1}$. We also give a necessary condition for which $\mathcal{H}_{\mu,\alpha}$ is a bounded operator by acting on Bloch type spaces for general cases.


title: Silent Spring: Prototype Pollution Leads to Remote Code Execution in Node.js

abstract: Prototype pollution is a dangerous vulnerability affecting prototype-based languages like JavaScript and the Node.js platform. It refers to the ability of an attacker to inject properties into an object's root prototype at runtime and subsequently trigger the execution of legitimate code gadgets that access these properties on the object's prototype, leading to attacks such as Denial of Service (DoS), privilege escalation, and Remote Code Execution (RCE). While there is anecdotal evidence that prototype pollution leads to RCE, current research does not tackle the challenge of gadget detection, thus only showing feasibility of DoS attacks, mainly against Node.js libraries. In this paper, we set out to study the problem in a holistic way, from the detection of prototype pollution to detection of gadgets, with the ambitious goal of finding end-to-end exploits beyond DoS, in full-fledged Node.js applications. We build the first multi-staged framework that uses multi-label static taint analysis to identify prototype pollution in Node.js libraries and applications, as well as a hybrid approach to detect universal gadgets, notably, by analyzing the Node.js source code. We implement our framework on top of GitHub's static analysis framework CodeQL to find 11 universal gadgets in core Node.js APIs, leading to code execution. Furthermore, we use our methodology in a study of 15 popular Node.js applications to identify prototype pollutions and gadgets. We manually exploit eight RCE vulnerabilities in three high-profile applications such as NPM CLI, Parse Server, and Rocket.Chat. Our results provide alarming evidence that prototype pollution in combination with powerful universal gadgets lead to RCE in Node.js.


title: Decentralized scheduling through an adaptive, trading-based multi-agent system

abstract: In multi-agent reinforcement learning systems, the actions of one agent can have a negative impact on the rewards of other agents. One way to combat this problem is to let agents trade their rewards amongst each other. Motivated by this, this work applies a trading approach to a simulated scheduling environment, where the agents are responsible for the assignment of incoming jobs to compute cores. In this environment, reinforcement learning agents learn to trade successfully. The agents can trade the usage right of computational cores to process high-priority, high-reward jobs faster than low-priority, low-reward jobs. However, due to combinatorial effects, the action and observation spaces of a simple reinforcement learning agent in this environment scale exponentially with key parameters of the problem size. However, the exponential scaling behavior can be transformed into a linear one if the agent is split into several independent sub-units. We further improve this distributed architecture using agent-internal parameter sharing. Moreover, it can be extended to set the exchange prices autonomously. We show that in our scheduling environment, the advantages of a distributed agent architecture clearly outweigh more aggregated approaches. We demonstrate that the distributed agent architecture becomes even more performant using agent-internal parameter sharing. Finally, we investigate how two different reward functions affect autonomous pricing and the corresponding scheduling.


title: Verifying Fairness in Quantum Machine Learning

abstract: Due to the beyond-classical capability of quantum computing, quantum machine learning is applied independently or embedded in classical models for decision making, especially in the field of finance. Fairness and other ethical issues are often one of the main concerns in decision making. In this work, we define a formal framework for the fairness verification and analysis of quantum machine learning decision models, where we adopt one of the most popular notions of fairness in the literature based on the intuition -- any two similar individuals must be treated similarly and are thus unbiased. We show that quantum noise can improve fairness and develop an algorithm to check whether a (noisy) quantum machine learning model is fair. In particular, this algorithm can find bias kernels of quantum data (encoding individuals) during checking. These bias kernels generate infinitely many bias pairs for investigating the unfairness of the model. Our algorithm is designed based on a highly efficient data structure -- Tensor Networks -- and implemented on Google's TensorFlow Quantum. The utility and effectiveness of our algorithm are confirmed by the experimental results, including income prediction and credit scoring on real-world data, for a class of random (noisy) quantum decision models with 27 qubits ($2^{27}$-dimensional state space) tripling ($2^{18}$ times more than) that of the state-of-the-art algorithms for verifying quantum machine learning models.


title: Low cost prediction of probability distributions of molecular properties for early virtual screening

abstract: While there is a general focus on predictions of values, mathematically more appropriate is prediction of probability distributions: with additional possibilities like prediction of uncertainty, higher moments and quantiles. For the purpose of the computer-aided drug design field, this article applies Hierarchical Correlation Reconstruction approach, previously applied in the analysis of demographic, financial and astronomical data. Instead of a single linear regression to predict values, it uses multiple linear regressions to independently predict multiple moments, finally combining them into predicted probability distribution, here of several ADMET properties based on substructural fingerprint developed by Klekota\&Roth. Discussed application example is inexpensive selection of a percentage of molecules with properties nearly certain to be in a predicted or chosen range during virtual screening. Such an approach can facilitate the interpretation of the results as the predictions characterized by high rate of uncertainty are automatically detected. In addition, for each of the investigated predictive problems, we detected crucial structural features, which should be carefully considered when optimizing compounds towards particular property. The whole methodology developed in the study constitutes therefore a great support for medicinal chemists, as it enable fast rejection of compounds with the lowest potential of desired physicochemical/ADMET characteristic and guides the compound optimization process.


title: Explaining Dynamic Graph Neural Networks via Relevance Back-propagation

abstract: Graph Neural Networks (GNNs) have shown remarkable effectiveness in capturing abundant information in graph-structured data. However, the black-box nature of GNNs hinders users from understanding and trusting the models, thus leading to difficulties in their applications. While recent years witness the prosperity of the studies on explaining GNNs, most of them focus on static graphs, leaving the explanation of dynamic GNNs nearly unexplored. It is challenging to explain dynamic GNNs, due to their unique characteristic of time-varying graph structures. Directly using existing models designed for static graphs on dynamic graphs is not feasible because they ignore temporal dependencies among the snapshots. In this work, we propose DGExplainer to provide reliable explanation on dynamic GNNs. DGExplainer redistributes the output activation score of a dynamic GNN to the relevances of the neurons of its previous layer, which iterates until the relevance scores of the input neuron are obtained. We conduct quantitative and qualitative experiments on real-world datasets to demonstrate the effectiveness of the proposed framework for identifying important nodes for link prediction and node regression for dynamic GNNs.


title: Generalized Hilbert Operator Acting on Weighted Bergman Spaces and on Dirichlet Spaces

abstract: Let $\mu$ be a positive Borel measure on the interval [0,1). For $\beta > 0$, The generalized Hankel matrix $\mathcal{H}_{\mu,\beta}= (\mu_{n,k,\beta})_{n,k\geq0}$ with entries $\mu_{n,k,\beta}= \int_{[0.1)}\frac{\Gamma(n+\beta)}{n!\Gamma(\beta)} t^{n+k}d\mu(t)$, induces formally the operator $$\mathcal{H}_{\mu,\beta}(f)(z)=\sum_{n=0}^\infty \left(\sum_{k=0}^\infty \mu_{n,k,\beta}a_k\right)z^n$$ on the space of all analytic function $f(z)=\sum_{k=0}^ \infty a_k z^n$ in the unit disc $\mathbb{D}$. In this paper, we characterize those positive Borel measures on $[0,1)$ such that $\mathcal{H}_{\mu,\beta}(f)(z)= \int_{[0,1)} \frac{f(t)}{{(1-tz)^\beta}} d\mu(t)$ for all in weighted Bergman Spaces $A_{\alpha}^p(0<p<\infty,\; \alpha>-1)$, and among them we describe those for which $\mathcal{H}_{\mu,\beta}(\beta>0)$ is a bounded(resp.,compact) operator on weighted Bergman spaces and Dirichlet spaces.


title: Provable Defense Against Geometric Transformations

abstract: Geometric image transformations that arise in the real world, such as scaling and rotation, have been shown to easily deceive deep neural networks (DNNs). Hence, training DNNs to be certifiably robust to these perturbations is critical. However, no prior work has been able to incorporate the objective of deterministic certified robustness against geometric transformations into the training procedure, as existing verifiers are exceedingly slow. To address these challenges, we propose the first provable defense for deterministic certified geometric robustness. Our framework leverages a novel GPU-optimized verifier that can certify images between 60$\times$ to 42,600$\times$ faster than existing geometric robustness verifiers, and thus unlike existing works, is fast enough for use in training. Across multiple datasets, our results show that networks trained via our framework consistently achieve state-of-the-art deterministic certified geometric robustness and clean accuracy. Furthermore, for the first time, we verify the geometric robustness of a neural network for the challenging, real-world setting of autonomous driving.


title: Population synthesis of pulsar wind nebulae and pulsar halos in the Milky Way -- Predicted contributions to the very-high-energy sky

abstract: The discovery of extended gamma-ray emission toward a number of middle-aged pulsars suggests the possibility of long-lived particle confinement beyond the classical pulsar wind nebula (PWN) stage. How this emerging source class can be extrapolated to a Galactic population remains unclear. We aim to evaluate how pulsar halos fit in existing TeV observations, under the assumption that all middle-aged pulsars develop halos similar to those observed toward the J0633+1746 or B0656+14 pulsars. We modeled the populations of supernova remnants, PWNe, and pulsar halos in the Milky Way. The PWN-halo evolutionary sequence is described in a simple yet coherent framework, and both kinds of objects are assumed to share the same particle injection properties. We then assessed the contribution of the different source classes to the very-high-energy emission from the Galaxy. The synthetic population can be made consistent with the flux distribution of all known objects, including unidentified objects, for a reasonable set of parameters. The fraction of the populations predicted to be detectable in surveys of the Galactic plane with HESS. and HAWC is then found to be in good agreement with their actual outcome, with a number of detectable halos ranging from 30 to 80% of the number of detectable PWNe. Prospects for CTA involve the detection of 250-300 sources in the Galactic Plane Survey, including 170 PWNe and up to 100 halos. The extent of diffusion suppression in halos has a limited impact on such prospects but its magnitude has a strong influence. The level of diffuse emission from unresolved populations in each survey is found to be dominated by halos and comparable to large-scale interstellar radiation powered by cosmic rays above 0.1-1TeV. Pulsar halos are shown to be viable counterparts to a fraction of the currently unidentified sources if they develop around most middle-aged pulsars (abridged).


title: Ab initio calculation of the $\beta$ decay spectrum of $^6$He

abstract: We calculate the $\beta$ spectrum in the decay of $^6$He using Quantum Monte Carlo methods with nuclear interactions derived from chiral Effective Field Theory and consistent weak vector and axial currents. We work at second order in the multipole expansion, retaining terms suppressed by $\mathcal O(q^2/m_\pi^2)$, where $q$ denotes low-energy scales such as the reaction's $\mathcal Q$-value or the electron energy, and $m_\pi$ the pion mass. We go beyond the impulse approximation by including the effects of two-body vector and axial currents. We estimate the theoretical error on the spectrum by using four potential models in the Norfolk family of local two- and three-nucleon interactions, which have different cut-off, fit two-nucleon data up to different energies and use different observables to determine the couplings in the three-body force. We find the theoretical uncertainty on the $\beta$ spectrum, normalized by the total rate, to be well below the permille level, and to receive contributions of comparable size from first and second order corrections in the multipole expansion. We consider corrections to the $\beta$ decay spectrum induced by beyond-the-Standard Model charged-current interactions in the Standard Model Effective Field Theory, with and without sterile neutrinos, and discuss the sensitivity of the next generation of experiments to these interactions.


title: Higher angular momentum pairing states in Sr$_2$RuO$_4$ in the presence of longer-range interactions

abstract: The superconducting symmetry of Sr$_2$RuO$_4$ remains a puzzle. Time-reversal symmetry breaking $d_{x^2-y^2} + ig_{xy(x^2-y^2)}$ pairing has been proposed for reconciling multiple key experiments. However, its stability remains unclear. In this work, we theoretically study the superconducting instabilities in Sr$_2$RuO$_4$, including the effects of spin-orbit coupling (SOC), in the presence of both local and longer-range interactions within a random phase approximation. We show that the inclusion of second nearest neighbor repulsions, together with non-local SOC in the $B_{2g}$ channel or orbital-anisotropy of the non-local interactions, can have a significant impact on the stability of both $d_{x^2-y^2}$- and $g$-wave pairing channels. We analyze the properties, such as Knight shift and spontaneous edge current, of the realized $d_{x^2-y^2} + ig$, $s^{\prime}+id_{xy}$ and mixed helical pairings in different parameter spaces and find that the $d_{x^2-y^2} + ig$ solution is in better agreement with the experimental data.


title: Secure and Lightweight Strong PUF Challenge Obfuscation with Keyed Non-linear FSR

abstract: We propose a secure and lightweight key based challenge obfuscation for strong PUFs. Our architecture is designed to be resilient against learning attacks. Our obfuscation mechanism uses non-linear feedback shift registers (NLFSRs). Responses are directly provided to the user, without error correction or extra post-processing steps. We also discuss the cost of protecting our architecture against power analysis attacks with clock randomization, and Boolean masking. Security against learning attacks is assessed using avalanche criterion, and deep-neural network attacks. We designed a testchip in 65 nm CMOS. When compared to the baseline arbiter PUF implementation, the cost increase of our proposed architecture is 1.27x, and 2.2x when using clock randomization, and Boolean masking, respectively.


title: Network analysis of the human structural connectome including the brainstem

abstract: The underlying anatomical structure is fundamental to the study of brain networks, but the role of brainstem from a structural perspective is not very well understood. We conduct a computational and graph-theoretical study of the human structural connectome incorporating a variety of subcortical structures including the brainstem. Our computational scheme involves the use of Python DIPY and Nibabel libraries to develop structural connectomes using 100 healthy adult subjects. We then compute degree, eigenvector, and betweenness centralities to identify several highly connected structures and find that the brainstem ranks highest across all examined metrics, a result that holds even when the connectivity matrix is normalized by volume. We also investigated some global topological features in the connectomes, such as the balance of integration and segregation, and found that the domination of the brainstem generally causes networks to become less integrated and segregated. Our results highlight the importance of including the brainstem in structural network analyses.


title: Systematic construction of quantum contextuality scenarios with rank advantage

abstract: A set of quantum measurements exhibits quantum contextuality when any consistent value assignment to the measurement outcomes leads to a contradiction with quantum theory. In the original Kochen-Specker-type of argument the measurement projectors are assumed to be rays, that is, of unit rank. Only recently a contextuality scenario has been identified where state-independent contextuality requires measurements with projectors of rank two. Using the disjunctive graph product, we provide a systematic method to construct contextuality scenarios which require non-unit rank. We construct explicit examples requiring ranks greater than rank one up to rank five.


title: Multi-Faceted Distillation of Base-Novel Commonality for Few-shot Object Detection

abstract: Most of existing methods for few-shot object detection follow the fine-tuning paradigm, which potentially assumes that the class-agnostic generalizable knowledge can be learned and transferred implicitly from base classes with abundant samples to novel classes with limited samples via such a two-stage training strategy. However, it is not necessarily true since the object detector can hardly distinguish between class-agnostic knowledge and class-specific knowledge automatically without explicit modeling. In this work we propose to learn three types of class-agnostic commonalities between base and novel classes explicitly: recognition-related semantic commonalities, localization-related semantic commonalities and distribution commonalities. We design a unified distillation framework based on a memory bank, which is able to perform distillation of all three types of commonalities jointly and efficiently. Extensive experiments demonstrate that our method can be readily integrated into most of existing fine-tuning based methods and consistently improve the performance by a large margin.


title: The centre of the Dunkl total angular momentum algebra

abstract: For a finite dimensional representation $V$ of a finite reflection group $W$, we consider the rational Cherednik algebra $\mathsf{H}_{t,c}(V,W)$ associated with $(V,W)$ at the parameters $t\neq 0$ and $c$. The Dunkl total angular momentum algebra $O_{t,c}(V,W)$ arises as the centraliser algebra of the Lie superalgebra $\mathfrak{osp}(1|2)$ containing a Dunkl deformation of the Dirac operator, inside the tensor product of $\mathsf{H}_{t,c}(V,W)$ and the Clifford algebra generated by $V$. We show that, for every value of the parameter $c$, the centre of $O_{t,c}(V,W)$ is isomorphic to a univariate polynomial ring. Notably, the generator of the centre changes depending on whether or not $(-1)_V$ is an element of the group $W$. Using this description of the centre, and using the projection of the pseudo scalar from the Clifford algebra into $O_{t,c}(V,W)$, we establish results analogous to ``Vogan's conjecture'' for a family of operators depending on suitable elements of the double cover $\tilde{W}$.


title: Learning to identify cracks on wind turbine blade surfaces using drone-based inspection images

abstract: Wind energy is expected to be one of the leading ways to achieve the goals of the Paris Agreement but it in turn heavily depends on effective management of its operations and maintenance (O&M) costs. Blade failures account for one-third of all O&M costs thus making accurate detection of blade damages, especially cracks, very important for sustained operations and cost savings. Traditionally, damage inspection has been a completely manual process thus making it subjective, error-prone, and time-consuming. Hence in this work, we bring more objectivity, scalability, and repeatability in our damage inspection process, using deep learning, to miss fewer cracks. We build a deep learning model trained on a large dataset of blade damages, collected by our drone-based inspection, to correctly detect cracks. Our model is already in production and has processed more than a million damages with a recall of 0.96. We also focus on model interpretability using class activation maps to get a peek into the model workings. The model not only performs as good as human experts but also better in certain tricky cases. Thus, in this work, we aim to increase wind energy adoption by decreasing one of its major hurdles - the O\&M costs resulting from missing blade failures like cracks.


title: TaDaa: real time Ticket Assignment Deep learning Auto Advisor for customer support, help desk, and issue ticketing systems

abstract: This paper proposes TaDaa: Ticket Assignment Deep learning Auto Advisor, which leverages the latest Transformers models and machine learning techniques quickly assign issues within an organization, like customer support, help desk and alike issue ticketing systems. The project provides functionality to 1) assign an issue to the correct group, 2) assign an issue to the best resolver, and 3) provide the most relevant previously solved tickets to resolvers. We leverage one ticketing system sample dataset, with over 3k+ groups and over 10k+ resolvers to obtain a 95.2% top 3 accuracy on group suggestions and a 79.0% top 5 accuracy on resolver suggestions. We hope this research will greatly improve average issue resolution time on customer support, help desk, and issue ticketing systems.


title: Hydrodynamic impacts of short laser pulses on plasmas

abstract: We determine conditions allowing to simplify the description of the impact of a short and arbitrarily intense laser pulse onto a cold plasma at rest. If both the initial plasma density and pulse profile have plane simmetry, then suitable matched upper bounds on the maximum and the relative variations of the initial density, as well as the intensity and duration of the pulse, ensure a strictly hydrodynamic evolution of the electron fluid (without wave-breaking or vacuum-heating) during its whole interaction with the pulse, while ions can be regarded as immobile. We use a recently developed fully relativistic plane model whereby the system of the (Lorentz-Maxwell and continuity) PDEs is reduced into a family of highly nonlinear but decoupled systems of non-autonomous Hamilton equations with one degree of freedom, with the light-like coordinate $\xi=ct\!-\!z$ instead of time $t$ as an independent variable, and new apriori estimates (eased by use of a Liapunov function) of the solutions in terms of the input data (initial density and pulse profile). If the laser spot radius $R$ is finite but not too small the same conclusions hold for the part of the plasma close to the axis $\vec{z}$ of cylindrical symmetry. These results may help in drastically simplifying the study of extreme acceleration mechanisms of electrons.


title: Which Bath-Hamiltonians Matter for Thermal Operations?

abstract: In this article we explore the set of thermal operations from a mathematical and topological point of view. First we introduce the concept of Hamiltonians with resonant spectrum with respect to some reference Hamiltonian, followed by proving that when defining thermal operations it suffices to only consider bath Hamiltonians which satisfy this resonance property. Next we investigate continuity of the set of thermal operations in certain parameters, such as energies of the system and temperature of the bath. We will see that the set of thermal operations changes discontinuously with respect to the Hausdorff metric at any Hamiltonian which has so-called degenerate Bohr spectrum, regardless of the temperature. Finally we find a semigroup representation of the (enhanced) thermal operations in two dimensions by characterizing any such operation via three real parameters, thus allowing for a visualization of this set. Using this, in the qubit case we show commutativity of the (enhanced) thermal operations as well as convexity of the thermal operations without the closure. The latter is done by specifying the elements of this set exactly.


title: On the morphodynamics of a wide class of large-scale meandering rivers: Insights gained by coupling LES with sediment-dynamics

abstract: In meandering rivers, interactions between flow, sediment transport, and bed topography affect diverse processes, including bedform development and channel migration. Predicting how these interactions affect the spatial patterns and magnitudes of bed deformation in meandering rivers is essential for various river engineering and geoscience problems. Computational fluid dynamics simulations can predict river morphodynamics at fine temporal and spatial scales but have traditionally been challenged by the large scale of natural rivers. We conducted coupled large-eddy simulation (LES) and bed morphodynamics simulations to create a unique database of hydro-morphodynamic datasets for 42 meandering rivers with a variety of planform shapes and large-scale geometrical features that mimic natural meanders. For each simulated river, the database includes (i) bed morphology, (ii) three-dimensional mean velocity field, and (iii) bed shear stress distribution under bankfull flow conditions. The calculated morphodynamics results at dynamic equilibrium revealed the formation of scour and deposition patterns near the outer and inner banks, respectively, while the location of point bars and scour regions around the apexes of the meander bends is found to vary as a function of the radius of curvature of the bends to the width ratio. A new mechanism is proposed that explains this seemingly paradoxical finding. The high-fidelity simulation results generated in this work provide researchers and scientists with a rich numerical database for morphodynamics and bed shear stress distributions in large-scale meandering rivers to enable systematic investigation of the underlying phenomena and support a range of river engineering applications.


title: Self-Supervised-RCNN for Medical Image Segmentation with Limited Data Annotation

abstract: Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data annotation is time-consuming and expensive, especially for segmentation tasks. To solve the problem of learning with limited labeled medical image data, an alternative deep learning training strategy based on self-supervised pretraining on unlabeled MRI scans is proposed in this work. Our pretraining approach first, randomly applies different distortions to random areas of unlabeled images and then predicts the type of distortions and loss of information. To this aim, an improved version of Mask-RCNN architecture has been adapted to localize the distortion location and recover the original image pixels. The effectiveness of the proposed method for segmentation tasks in different pre-training and fine-tuning scenarios is evaluated based on the Osteoarthritis Initiative dataset. Using this self-supervised pretraining method improved the Dice score by 20% compared to training from scratch. The proposed self-supervised learning is simple, effective, and suitable for different ranges of medical image analysis tasks including anomaly detection, segmentation, and classification.


title: Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesis

abstract: Recently, diffusion models have shown remarkable results in image synthesis by gradually removing noise and amplifying signals. Although the simple generative process surprisingly works well, is this the best way to generate image data? For instance, despite the fact that human perception is more sensitive to the low frequencies of an image, diffusion models themselves do not consider any relative importance of each frequency component. Therefore, to incorporate the inductive bias for image data, we propose a novel generative process that synthesizes images in a coarse-to-fine manner. First, we generalize the standard diffusion models by enabling diffusion in a rotated coordinate system with different velocities for each component of the vector. We further propose a blur diffusion as a special case, where each frequency component of an image is diffused at different speeds. Specifically, the proposed blur diffusion consists of a forward process that blurs an image and adds noise gradually, after which a corresponding reverse process deblurs an image and removes noise progressively. Experiments show that the proposed model outperforms the previous method in FID on LSUN bedroom and church datasets. Code is available at https://github.com/sangyun884/blur-diffusion.


title: Synthesizing a $\hat{\sigma}_z$ spin-dependent force for optical, metastable, and ground state trapped-ion qubits

abstract: A single bichromatic field near-resonant to a qubit transition is typically used for $\hat{\sigma}_x$ or $\hat{\sigma}_y$ M{\o}lmer-S{\o}rensen type interactions in trapped ion systems. Using this field configuration, it is also possible to synthesize a $\hat{\sigma}_z$ spin-dependent force by merely adjusting the beat-note frequency. Here, we expand on previous work and present a comprehensive theoretical and experimental investigation of this scheme with a laser near-resonant to a quadrupole transition in $^{88}$Sr$^+$. Further, we characterise its robustness to optical phase and qubit frequency offsets, and demonstrate its versatility by entangling optical, metastable, and ground state qubits.


title: Stable finiteness of ample groupoid algebras, traces and applications

abstract: In this paper we study stable finiteness of ample groupoid algebras with applications to inverse semigroup algebras and Leavitt path algebras, recovering old results and proving some new ones. In addition, we develop a theory of (faithful) traces on ample groupoid algebras, mimicking the $C^\ast$-algebra theory but taking advantage of the fact that our functions are simple and so do not have integrability issues, even in the non-Hausdorff setting. The theory of traces is closely connected with the theory of invariant means on Boolean inverse semigroups. We include an appendix on stable finiteness of more general semigroup algebras, improving on an earlier result of Munn, which is independent of the rest of the paper.


title: Spatial mixing and the random-cluster dynamics on lattices

abstract: An important paradigm in the understanding of mixing times of Glauber dynamics for spin systems is the correspondence between spatial mixing properties of the models and bounds on the mixing time of the dynamics. This includes, in particular, the classical notions of weak and strong spatial mixing, which have been used to show the best known mixing time bounds in the high-temperature regime for the Glauber dynamics for the Ising and Potts models. Glauber dynamics for the random-cluster model does not naturally fit into this spin systems framework because its transition rules are not local. In this paper, we present various implications between weak spatial mixing, strong spatial mixing, and the newer notion of spatial mixing within a phase, and mixing time bounds for the random-cluster dynamics in finite subsets of $\mathbb Z^d$ for general $d\ge 2$. These imply a host of new results, including optimal $O(N\log N)$ mixing for the random cluster dynamics on torii and boxes on $N$ vertices in $\mathbb Z^d$ at all high temperatures and at sufficiently low temperatures, and for large values of $q$ quasi-polynomial (or quasi-linear when $d=2$) mixing time bounds from random phase initializations on torii at the critical point (where by contrast the mixing time from worst-case initializations is exponentially large). In the same parameter regimes, these results translate to fast sampling algorithms for the Potts model on $\mathbb Z^d$ for general $d$.


title: Learning to Singulate Layers of Cloth using Tactile Feedback

abstract: Robotic manipulation of cloth has applications ranging from fabrics manufacturing to handling blankets and laundry. Cloth manipulation is challenging for robots largely due to their high degrees of freedom, complex dynamics, and severe self-occlusions when in folded or crumpled configurations. Prior work on robotic manipulation of cloth relies primarily on vision sensors alone, which may pose challenges for fine-grained manipulation tasks such as grasping a desired number of cloth layers from a stack of cloth. In this paper, we propose to use tactile sensing for cloth manipulation; we attach a tactile sensor (ReSkin) to one of the two fingertips of a Franka robot and train a classifier to determine whether the robot is grasping a specific number of cloth layers. During test-time experiments, the robot uses this classifier as part of its policy to grasp one or two cloth layers using tactile feedback to determine suitable grasping points. Experimental results over 180 physical trials suggest that the proposed method outperforms baselines that do not use tactile feedback and has better generalization to unseen cloth compared to methods that use image classifiers. Code, data, and videos are available at https://sites.google.com/view/reskin-cloth.


title: On Brian\c{c}on-Skoda theorem for foliations

abstract: We generalize Mattei's result relative to the Brian\c{c}on-Skoda theorem for foliations to the family of foliations of the second type. We use this generalization to establish relationships between the Milnor and Tjurina numbers of foliations of second type, inspired by the results obtained by Liu for complex hypersurfaces and we determine a lower bound for the global Tjurina number of an algebraic curve.


title: Fault Tolerant Coloring of the Asynchronous Cycle

abstract: We present a wait-free algorithm for proper coloring the n nodes of the asynchronous cycle $C_n$, where each crash-prone node starts with its (unique) identifier as input. The algorithm is independent of $n \geq 3$, and runs in $\mathrm{O}(\log^* n)$ rounds in $C_n$. This round-complexity is optimal thanks to a known matching lower bound, which applies even to synchronous (failure-free) executions. The range of colors used by our algorithm, namely $\{0, ..., 4\}$, is optimal too, thanks to a known lower bound on the minimum number of names for which renaming is solvable wait-free in shared-memory systems, whenever $n$ is a power of a prime. Indeed, our model coincides with the shared-memory model whenever $n = 3$, and the minimum number of names for which renaming is possible in 3-process shared-memory systems is 5.


title: Uniqueness and nondegeneracy for Dirichlet fractional problems in bounded domains via asymptotic methods

abstract: We consider positive solutions of a fractional Lane-Emden type problem in a bounded domain with Dirichlet conditions. We show that uniqueness and nondegeneracy hold for the asymptotically linear problem in general domains. Furthermore, we also prove that all the known uniqueness and nondegeneracy results in the local case extend to the nonlocal regime when the fractional parameter s is sufficiently close to 1.


title: An Infinite 2-Dimensional Array Associated With Electric Circuits

abstract: Except for Koshy who devotes seven pages to applications of Fibonacci Numbers to electric circuits, most books and the Fibonacci Quarterly have been relatively silent on applications of graphs and electric circuits to Fibonacci numbers. This paper continues a recent trend of papers studying the interplay of graphs, circuits, and Fibonacci numbers by presenting and studying the Circuit Array, an infinite 2-dimensional array whose entries are electric resistances labelling edge values of circuits associated with a family of graphs. The Circuit Array has several features distinguishing it from other more familiar arrays such as the Binomial Array and Wythoff Array. For example, it can be proven modulo a strongly supported conjecture that the numerators of its left-most diagonal do not satisfy any linear, homogeneous, recursion, with constant coefficients (LHRCC). However, we conjecture with supporting numerical evidence an asymptotic formula involving $\pi$ satisfied by the left-most diagonal of the Circuit Array.


title: Target-Driven Structured Transformer Planner for Vision-Language Navigation

abstract: Vision-language navigation is the task of directing an embodied agent to navigate in 3D scenes with natural language instructions. For the agent, inferring the long-term navigation target from visual-linguistic clues is crucial for reliable path planning, which, however, has rarely been studied before in literature. In this article, we propose a Target-Driven Structured Transformer Planner (TD-STP) for long-horizon goal-guided and room layout-aware navigation. Specifically, we devise an Imaginary Scene Tokenization mechanism for explicit estimation of the long-term target (even located in unexplored environments). In addition, we design a Structured Transformer Planner which elegantly incorporates the explored room layout into a neural attention architecture for structured and global planning. Experimental results demonstrate that our TD-STP substantially improves previous best methods' success rate by 2% and 5% on the test set of R2R and REVERIE benchmarks, respectively. Our code is available at https://github.com/YushengZhao/TD-STP .


title: Algorithm Certainty Analysis of Spatial Data for Terrain Model

abstract: The terrain survey techniques of photogrammetry, LIDAR, Sonar or seismic studies are subject to limitation of shadow zones. It is not possible to capture the terrain pattern and requires interpolation and extrapolation for conformal mapping of spatial coordinates for generation of terrain model. The discrete data is mapped through a function set whose domain returns the analytic test in Riemann map. The algorithm adopted in analysis for such mapping does not have a certainty score or probability of degree of correctness conforming to the physical landscape of shadow zones. The aim of the paper is to establish a generator of certainty degree of the mapping along with a continuous terrain model generator. The confirmed mapping of terrain presents a continuous spatial coordinate set which form the boundary of the shadow zone with discrete spatial coordinates. The discrete set is normalized in Gaussian distribution through a Poisson distribution transition. The continuous data set is represented by Laurentian series in which the function will be analytic and can be mapped to Riemann surface with singularities within the annulus and outside the annulus of approximate space sub set (Euclidean space).The singularities will be discarded through Picard's theorem and analytic test at poles with Cauchy's residual theorem is done. The resulting set of spatial coordinates will restructure within Riemann number sphere which will be mapped on the plane as stereographic projection. The Gaussian distribution which forms the basis of analysis will provide with the tool for generating the probability of certainty of every terrain model idealised to conform to the physical landscape.


title: Human Treelike Tubular Structure Segmentation: A Comprehensive Review and Future Perspectives

abstract: Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure provides insights into disease diagnosis, treatment planning, and prognosis. Manually labelling extensive data by radiologists is often time-consuming and error-prone. As a result, automated or semi-automated computational models have become a popular research field of medical imaging in the past two decades, and many have been developed to date. In this survey, we aim to provide a comprehensive review of currently publicly available datasets, segmentation algorithms, and evaluation metrics. In addition, current challenges and future research directions are discussed.


title: Invariance properties of limiting point processes and applications to clusters of extremes

abstract: Motivated by examples from extreme value theory we introduce the general notion of a cluster process as a limiting point process of returns of a certain event in a time series. We explore general invariance properties of cluster processes which are implied by stationarity of the underlying time series under minimal assumptions. Of particular interest are the cluster size distributions, where we introduce the two notions of inspected and typical cluster sizes and derive general properties of and connections between them. While the extremal index commonly used in extreme value theory is often interpreted as the inverse of a "mean cluster size", we point out that this only holds true for the expected value of the typical cluster size, caused by an effect very similar to the inspection paradox in renewal theory.


title: Toward a Generic Mapping Language for Transformations between RDF and Data Interchange Formats

abstract: While there exist approaches to integrate heterogeneous data using semantic models, such semantic models can typically not be used by existing software tools. Many software tools - especially in engineering - only have options to import and export data in more established data interchange formats such as XML or JSON. Thus, if an information which is included in a semantic model needs to be used in a such a software tool, automatic approaches for mapping semantic information into an interchange format are needed. We aim to develop a generic mapping approach that allows users to create transformations of semantic information into a data interchange format with an arbitrary structure which can be defined by a user. This mapping approach is currently being elaborated. In this contribution, we report our initial steps targeted to transformations from RDF into XML. At first, a mapping language is introduced which allows to define automated mappings from ontologies to XML. Furthermore, a mapping algorithm capable of executing mappings defined in this language is presented. An evaluation is done with a use case in which engineering information needs to be used in a 3D modeling tool.


title: Finitely presented inverse semigroups with finitely many idempotents in each $\mathcal D$-class and non-Hausdorff universal groupoids

abstract: The complex algebra of an inverse semigroup with finitely many idempotents in each $\mathcal D$-class is stably finite by a result of Munn. This can be proved fairly easily using $C^*$-algebras for inverse semigroups satisfying this condition that have a Hausdorff universal groupoid, or more generally for direct limits of inverse semigroups satisfying this condition and having Hausdorff universal groupoids. It is not difficult to see that a finitely presented inverse semigroup with a non-Hausdorff universal groupoid cannot be a direct limit of inverse semigroups with Hausdorff universal groupoids. We construct here countably many non-isomorphic finitely presented inverse semigroups with finitely many idempotents in each $\mathcal D$-class and non-Hausdorff universal groupoids. At this time there is not a clear $C^*$-algebraic technique to prove these inverse semigroups have stably finite complex algebras.


title: Resistance values under transformations in regular triangular grids

abstract: In [Evans, Francis 2022; Hendel] the authors investigated resistance distance in triangular grid graphs and observed several types of asymptotic behavior. This paper extends their work by studying the initial, non-asymptotic, behavior found when equivalent circuit transformations are performed, reducing the rows in the triangular grid graph one row at a time. The main conjecture characterizes, after reducing an arbitrary number of times an initial triangular grid all of whose edge resistances are identically one, when edge resistance values are less than, equal to, or greater than one. A special case of the conjecture is proven. The main theorem identifies patterns of repeating edge resistances arising in diagonals of a triangular grid reduced $s$ times provided the original grid has at least $4s$ rows of triangles. This paper also improves upon the notation, concepts, and proof techniques introduced by the authors previously.


title: Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selection

abstract: Variational inference has recently emerged as a popular alternative to the classical Markov chain Monte Carlo (MCMC) in large-scale Bayesian inference. The core idea is to trade statistical accuracy for computational efficiency. In this work, we study these statistical and computational trade-offs in variational inference via a case study in inferential model selection. Focusing on Gaussian inferential models (or variational approximating families) with diagonal plus low-rank precision matrices, we initiate a theoretical study of the trade-offs in two aspects, Bayesian posterior inference error and frequentist uncertainty quantification error. From the Bayesian posterior inference perspective, we characterize the error of the variational posterior relative to the exact posterior. We prove that, given a fixed computation budget, a lower-rank inferential model produces variational posteriors with a higher statistical approximation error, but a lower computational error; it reduces variance in stochastic optimization and, in turn, accelerates convergence. From the frequentist uncertainty quantification perspective, we consider the precision matrix of the variational posterior as an uncertainty estimate, which involves an additional statistical error originating from the sampling uncertainty of the data. As a consequence, for small datasets, the inferential model need not be full-rank to achieve optimal estimation error (even with unlimited computation budget).


title: Divide and Conquer: 3D Point Cloud Instance Segmentation With Point-Wise Binarization

abstract: Instance segmentation on point clouds is crucially important for 3D scene understanding. Most SOTAs adopt distance clustering, which is typically effective but does not perform well in segmenting adjacent objects with the same semantic label (especially when they share neighboring points). Due to the uneven distribution of offset points, these existing methods can hardly cluster all instance points. To this end, we design a novel divide-and-conquer strategy named PBNet that binarizes each point and clusters them separately to segment instances. Our binary clustering divides offset instance points into two categories: high and low density points (HPs vs. LPs). Adjacent objects can be clearly separated by removing LPs, and then be completed and refined by assigning LPs via a neighbor voting method. To suppress potential over-segmentation, we propose to construct local scenes with the weight mask for each instance. As a plug-in, the proposed binary clustering can replace traditional distance clustering and lead to consistent performance gains on many mainstream baselines. A series of experiments on ScanNetV2 and S3DIS datasets indicate the superiority of our model. In particular, PBNet ranks first on the ScanNetV2 official benchmark challenge, achieving the highest mAP. Code will be available publicly at https://github.com/weiguangzhao/PBNet.


title: A Locally Corrected Multiblob Method with Hydrodynamically Matched Grids for the Stokes Mobility Problem

abstract: Inexpensive numerical methods are key to enable simulations of systems of a large number of particles of different shapes in Stokes flow. Several approximate methods have been introduced for this purpose. We study the accuracy of the multiblob method for solving the Stokes mobility problem in free space, where the 3D geometry of a particle surface is discretised with spherical blobs and the pair-wise interaction between blobs is described by the RPY-tensor. The paper aims to investigate and improve on the magnitude of the error in the solution velocities of the Stokes mobility problem using a combination of two different techniques: an optimally chosen grid of blobs and a pair-correction inspired by Stokesian dynamics. Optimisation strategies to determine a grid with a certain number of blobs are presented with the aim of matching the hydrodynamic response of a single accurately described ideal particle, alone in the fluid. Small errors in this self-interaction are essential as they determine the basic error level in a system of well-separated particles. With a good match, reasonable accuracy can be obtained even with coarse blob-resolutions of the particle surfaces. The error in the self-interaction is however sensitive to the exact choice of grid parameters and simply hand-picking a suitable blob geometry can lead to errors several orders of magnitude larger in size. The pair-correction is local and cheap to apply, and reduces on the error for more closely interacting particles. Two different types of geometries are considered: spheres and axisymmetric rods with smooth caps. The error in solutions to mobility problems is quantified for particles of varying inter-particle distances for systems containing a few particles, comparing to an accurate solution based on a second kind BIE-formulation where the quadrature error is controlled by employing quadrature by expansion (QBX).


title: Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentation

abstract: Averaging predictions of a deep ensemble of networks is apopular and effective method to improve predictive performance andcalibration in various benchmarks and Kaggle competitions. However, theruntime and training cost of deep ensembles grow linearly with the size ofthe ensemble, making them unsuitable for many applications. Averagingensemble weights instead of predictions circumvents this disadvantageduring inference and is typically applied to intermediate checkpoints ofa model to reduce training cost. Albeit effective, only few works haveimproved the understanding and the performance of weight averaging.Here, we revisit this approach and show that a simple weight fusion (WF)strategy can lead to a significantly improved predictive performance andcalibration. We describe what prerequisites the weights must meet interms of weight space, functional space and loss. Furthermore, we presenta new test method (called oracle test) to measure the functional spacebetween weights. We demonstrate the versatility of our WF strategy acrossstate of the art segmentation CNNs and Transformers as well as real worlddatasets such as BDD100K and Cityscapes. We compare WF with similarapproaches and show our superiority for in- and out-of-distribution datain terms of predictive performance and calibration.


title: Target Identification and Bayesian Model Averaging with Probabilistic Hierarchical Factor Probabilities

abstract: Target detection in hyperspectral imagery is the process of locating pixels from an image which are likely to contain target, typically done by comparing one or more spectra for the desired target material to each pixel in the image. Target identification is the process of target detection incorporating an additional process to identify more specifically the material that is present in each pixel that scored high in detection. Detection is generally a 2-class problem of target vs. background, and identification is a many class problem including target, background, and additional know materials. The identification process we present is probabilistic and hierarchical which provides transparency to the process and produces trustworthy output. In this paper we show that target identification has a much lower false alarm rate than detection alone, and provide a detailed explanation of a robust identification method using probabilistic hierarchical classification that handles the vague categories of materials that depend on users which are different than the specific physical categories of chemical constituents. Identification is often done by comparing mixtures of materials including the target spectra to mixtures of materials that do not include the target spectra, possibly with other steps. (band combinations, feature checking, background removal, etc.) Standard linear regression does not handle these problems well because the number of regressors (identification spectra) is greater than the number of feature variables (bands), and there are multiple correlated spectra. Our proposed method handles these challenges efficiently and provides additional important practical information in the form of hierarchical probabilities computed from Bayesian model averaging.


title: Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay

abstract: Few-shot class-incremental learning (FSCIL) has been proposed aiming to enable a deep learning system to incrementally learn new classes with limited data. Recently, a pioneer claims that the commonly used replay-based method in class-incremental learning (CIL) is ineffective and thus not preferred for FSCIL. This has, if truth, a significant influence on the fields of FSCIL. In this paper, we show through empirical results that adopting the data replay is surprisingly favorable. However, storing and replaying old data can lead to a privacy concern. To address this issue, we alternatively propose using data-free replay that can synthesize data by a generator without accessing real data. In observing the the effectiveness of uncertain data for knowledge distillation, we impose entropy regularization in the generator training to encourage more uncertain examples. Moreover, we propose to relabel the generated data with one-hot-like labels. This modification allows the network to learn by solely minimizing the cross-entropy loss, which mitigates the problem of balancing different objectives in the conventional knowledge distillation approach. Finally, we show extensive experimental results and analysis on CIFAR-100, miniImageNet and CUB-200 to demonstrate the effectiveness of our proposed one.


title: Gravitational Equivalence Theorem and Double-Copy for Kaluza-Klein Graviton Scattering Amplitudes

abstract: We analyze the structure of scattering amplitudes of the Kaluza-Klein (KK) gravitons and of the KK gravitational Goldstone bosons in the compactified 5d General Relativity (GR). Using a general $R_{\xi}$ gauge-fixing, we study the geometric Higgs mechanism for the massive spin-2 KK gravitons. We newly propose and prove a Gravitational Equivalence Theorem (GRET) to connect the scattering amplitudes of longitudinal KK gravitons to that of the KK gravitational Goldstone bosons, which formulates the geometric gravitational Higgs mechanism at the scattering $S$-matrix level. We demonstrate that the GRET provides a general energy-cancellation mechanism guaranteeing the $N$-point longitudinal KK graviton scattering amplitudes to have their leading energy dependence cancelled down by a large power factor of $E^{2N}$ ($N \geq 4$) up to any loop order. We propose an extended double-copy approach to construct the massive KK graviton (Goldstone) amplitudes from the KK gauge boson (Goldstone) amplitudes. With these we establish a new correspondence between the two types of energy cancellations in the four-point longitudinal KK amplitudes at tree level: $E^4\to E^0$ in the KK gauge theory and $E^{10} \to E^2$ in the KK GR theory.


title: Numerical integration of stochastic contact Hamiltonian systems via stochastic Herglotz variational principle

abstract: In this work we construct a stochastic contact variational integrator and its discrete version via stochastic Herglotz variational principle for stochastic contact Hamiltonian systems. A general structure-preserving stochastic contact method is devised, and the stochastic contact variational integrators are established. The implementation of this approach is validated by the numerical experiments.


title: Search for invisible Higgs bosons produced via vector boson fusion at the LHC using the ATLAS detector

abstract: Despite dark matter abundance, its nature remains elusive. Many searches of dark matter particles are carried out using different technologies either via direct detection, indirect detection, or collider searches. In this work, the invisible Higgs sector was investigated, where Higgs bosons are produced via the vector boson fusion (VBF) process and subsequently decay into invisible particles. The hypothesis under consideration is that the Higgs boson might decay into a pair of weakly interacting massive particles (WIMPs), which are candidates for dark matter. The observed number of events are found to be in agreement with the background expectation from Standard Model (SM). Assuming a 125 GeV Higgs boson with SM production cross section, the observed and expected upper limits on the branching fraction of its decay into invisible particles are found to be 0.13 at 95\% confidence level. Combination of searches for an invisibly decaying Higgs boson produced via the main Higgs production modes at the LHC using 2011-2018 data is conducted and discussed.