title: Radial Oscillations and Dynamical Instability Analysis for Linear-Quadratic GUP-modified White Dwarfs

abstract: A modification to the Heisenberg uncertainty principle is called the generalized uncertainty principle (GUP), which emerged due to the introduction of a minimum measurable length, common among phenomenological approaches to quantum gravity. One approach to GUP is called linear-quadratic GUP (LQGUP) which satisfies both the minimum measurable length and the maximum measurable momentum, resulting to an infinitesimal phase space volume proportional to the first-order momentum $(1 - \alpha p)^{-4} d^3x d^3p$, where $\alpha$ is the still-unestablished GUP parameter. In this study, we explore the mass-radius relations of white dwarfs whose equation of state has been modified by LQGUP, and provide them with radial perturbations to investigate the dynamical instability arising from the oscillations. We find from the mass-radius relations that the main effect of LQGUP is to worsen the gravitational collapse by decreasing the mass of the relatively massive white dwarfs (including their limiting mass, while increasing their limiting radius). This effect gets more prominent with larger values of $\alpha$. We then compare the results with available observational data. To further investigate the impact of the GUP parameter, a dynamical instability analysis of the white dwarf was conducted, and we find that instability sets in for all values of $\alpha$. With increasing $\alpha$, we also find that the central density at which instability occurs decreases, resulting to a lower maximum mass. This is in contrast to quadratic GUP, where instability only sets in below a critical value of the quadratic GUP parameter.


title: Towards Proactive Information Retrieval in Noisy Text with Wikipedia Concepts

abstract: Extracting useful information from the user history to clearly understand informational needs is a crucial feature of a proactive information retrieval system. Regarding understanding information and relevance, Wikipedia can provide the background knowledge that an intelligent system needs. This work explores how exploiting the context of a query using Wikipedia concepts can improve proactive information retrieval on noisy text. We formulate two models that use entity linking to associate Wikipedia topics with the relevance model. Our experiments around a podcast segment retrieval task demonstrate that there is a clear signal of relevance in Wikipedia concepts while a ranking model can improve precision by incorporating them. We also find Wikifying the background context of a query can help disambiguate the meaning of the query, further helping proactive information retrieval.


title: Ancilla-driven blind quantum computation for clients with different quantum capabilities

abstract: Blind quantum computation (BQC) allows a client with limited quantum power to delegate his quantum computational task to a powerful server and still keep his input, output, and algorithm private. There are mainly two kinds of models about BQC, namely circuit-based and measurement-based models. In addition, a hybrid model called ancilla-driven universal blind quantum computing (ADBQC) was proposed by combining the properties of both circuit-based and measurement-based models, where all unitary operations on the register qubits can be realized with the aid of single ancillae coupled to the register qubits. However, in the ADBQC model, the quantum capability of the client is strictly limited to preparing single qubits. If a client can only perform single-qubit measurements or a few simple quantum gates, he may also want to delegate his computation to a remote server via ADBQC. This paper solves the problem and extends the existing model by proposing two types of ADBQC protocols for clients with different quantum capabilities, such as performing single-qubit measurements or single-qubit gates. Furthermore, in the proposed two ADBQC protocols, clients can detect whether servers are honest or not with a high probability by using corresponding verifiable techniques.


title: Unsupervised visualization of image datasets using contrastive learning

abstract: Visualization methods based on the nearest neighbor graph, such as t-SNE or UMAP, are widely used for visualizing high-dimensional data. Yet, these approaches only produce meaningful results if the nearest neighbors themselves are meaningful. For images represented in pixel space this is not the case, as distances in pixel space are often not capturing our sense of similarity and therefore neighbors are not semantically close. This problem can be circumvented by self-supervised approaches based on contrastive learning, such as SimCLR, relying on data augmentation to generate implicit neighbors, but these methods do not produce two-dimensional embeddings suitable for visualization. Here, we present a new method, called t-SimCNE, for unsupervised visualization of image data. T-SimCNE combines ideas from contrastive learning and neighbor embeddings, and trains a parametric mapping from the high-dimensional pixel space into two dimensions. We show that the resulting 2D embeddings achieve classification accuracy comparable to the state-of-the-art high-dimensional SimCLR representations, thus faithfully capturing semantic relationships. Using t-SimCNE, we obtain informative visualizations of the CIFAR-10 and CIFAR-100 datasets, showing rich cluster structure and highlighting artifacts and outliers.


title: Graphs, Constraints, and Search for the Abstraction and Reasoning Corpus

abstract: The Abstraction and Reasoning Corpus (ARC) aims at benchmarking the performance of general artificial intelligence algorithms. The ARC's focus on broad generalization and few-shot learning has made it difficult to solve using pure machine learning. A more promising approach has been to perform program synthesis within an appropriately designed Domain Specific Language (DSL). However, these too have seen limited success. We propose Abstract Reasoning with Graph Abstractions (ARGA), a new object-centric framework that first represents images using graphs and then performs a search for a correct program in a DSL that is based on the abstracted graph space. The complexity of this combinatorial search is tamed through the use of constraint acquisition, state hashing, and Tabu search. An extensive set of experiments demonstrates the promise of ARGA in tackling some of the complicated object-centric tasks of the ARC rather efficiently, producing programs that are correct and easy to understand.


title: Random Orthogonalization for Federated Learning in Massive MIMO Systems

abstract: We propose a novel communication design, termed random orthogonalization, for federated learning (FL) in a massive multiple-input and multiple-output (MIMO) wireless system. The key novelty of random orthogonalization comes from the tight coupling of FL and two unique characteristics of massive MIMO -- channel hardening and favorable propagation. As a result, random orthogonalization can achieve natural over-the-air model aggregation without requiring transmitter side channel state information (CSI) for the uplink phase of FL, while significantly reducing the channel estimation overhead at the receiver. We extend this principle to the downlink communication phase and develop a simple but highly effective model broadcast method for FL. We also relax the massive MIMO assumption by proposing an enhanced random orthogonalization design for both uplink and downlink FL communications, that does not rely on channel hardening or favorable propagation. Theoretical analyses with respect to both communication and machine learning performance are carried out. In particular, an explicit relationship among the convergence rate, the number of clients, and the number of antennas is established. Experimental results validate the effectiveness and efficiency of random orthogonalization for FL in massive MIMO.


title: The random Weierstrass zeta function I. Existence, uniqueness, fluctuations

abstract: We describe a construction of random meromorphic functions with prescribed simple poles with unit residues at a given stationary point process. We characterize those stationary processes with finite second moment for which, after subtracting the mean, the random function becomes stationary. These random meromorphic functions can be viewed as random analogues of the Weierstrass zeta function from the theory of elliptic functions, or equivalently as electric fields generated by an infinite random distribution of point charges.


title: Exhaustive search for optimal molecular geometries using imaginary-time evolution on a quantum computer

abstract: We propose a nonvariational scheme for geometry optimization of molecules for the first-quantized eigensolver, a recently proposed framework for quantum chemistry using the probabilistic imaginary-time evolution (PITE) on a quantum computer. While the electrons in a molecule are treated in the scheme as quantum mechanical particles, the nuclei are treated as classical point charges. We encode both electronic states and candidate molecular geometries as a superposition of many-qubit states, leading to quantum advantage. The histogram formed by outcomes of repeated measurements gives the global minimum of the energy surface. We demonstrate that the circuit depth scales as O (n_e^2 poly(log n_e)) for the electron number n_e, which can be reduced to O (n_e poly(log n_e)) if extra O (n_e log n_e) qubits are available. We corroborate the scheme via numerical simulations. The new efficient scheme will be helpful for achieving scalability of practical quantum chemistry on quantum computers. As a special case of the scheme, a classical system composed only of charged particles is admitted. We also examine the scheme adapted to variational calculations that prioritize saving circuit depths for noisy intermediate-scale quantum (NISQ) devices.


title: Is Dogecoin a Viable Investment? Insights from Network and Bubble Effects

abstract: We find that three factors: Dogecoin network externalities, momentum, and tweet sentiment that capture the time-series expected Dogecoin returns. Dogecoin returns are exposed to Dogecoin network factors. We construct the network factors to capture the user adoption of Dogecoin. Moreover, there is a strong time-series momentum effect, and proxies for investor attention strongly forecast future Dogecoin returns. Lastly, we examine potential underlying mechanisms of the Dogecoin price bubble.


title: Partial Identification with Proxy of Latent Confoundings via Sum-of-ratios Fractional Programming

abstract: Due to the unobservability of confoundings, there has been widespread concern about how to compute causality quantitatively. To address this challenge, proxy-based negative control approaches have been commonly adopted, where auxiliary outcome variables $\bm{W}$ are introduced as the proxy of confoundings $\bm{U}$. However, these approaches rely on strong assumptions such as reversibility, completeness, or bridge functions. These assumptions lack intuitive empirical interpretation and solid verification techniques, hence their applications in the real world are limited. For instance, these approaches are inapplicable when the transition matrix $P(\bm{W} \mid \bm{U})$ is irreversible. In this paper, we focus on a weaker assumption called the partial observability of $P(\bm{W} \mid \bm{U})$. We develop a more general single-proxy negative control method called Partial Identification via Sum-of-ratios Fractional Programming (PI-SFP). It is a global optimization algorithm based on the branch-and-bound strategy, aiming to provide the valid bound of the causal effect. In the simulation, PI-SFP provides promising numerical results and fills in the blank spots that can not be handled in the previous literature, such as we have partial information of $P(\bm{W} \mid \bm{U})$.


title: Finite Temperature Considerations in the Structure of Quadratic GUP-modified White Dwarfs

abstract: In quantum gravity phenomenology, the effect of the generalized uncertainty principle (GUP) on white dwarfs has been given much attention in the literature. However, these studies assume a zero temperature equation of state (EoS), consequently excluding young white dwarfs whose initial temperatures are substantially high. To that cause, this paper calculates the Chandrasekhar EoS and resulting mass-radius relations of finite temperature white dwarfs modified by the quadratic GUP, an approach that extends Heisenberg's uncertainty principle by a quadratic term in momenta. The EoS was first approximated by treating the quadratic GUP parameter as perturbative, causing the EoS to exhibit expected thermal deviations at low pressures, and conflicting behaviors at high pressures, depending on the order of approximation. We then proceeded with a full numerical simulation of the modified EoS, and showed that in general, finite temperatures cause the EoS at low pressures to soften, while the quadratic GUP stiffens the EoS at high pressures. This modified EoS was then applied to the Tolman-Oppenheimer-Volkoff equations and its classical approximation to obtain the modified mass-radius relations for general relativistic and Newtonian white dwarfs. The relations for both cases were found to exhibit the expected thermal deviations at small masses, where low-mass white dwarfs are shifted to the high-mass regime at large radii, while high-mass white dwarfs acquire larger masses, beyond the Chandrasekhar limit. Additionally, we find that for sufficiently large values of the GUP parameter and temperature, we obtain mass-radius relations that are completely removed from the ideal case, as high-mass deviations due to GUP and low-mass deviations due to temperature are no longer mutually exclusive.


title: MotionDeltaCNN: Sparse CNN Inference of Frame Differences in Moving Camera Videos

abstract: Convolutional neural network inference on video input is computationally expensive and requires high memory bandwidth. Recently, DeltaCNN managed to reduce the cost by only processing pixels with significant updates over the previous frame. However, DeltaCNN relies on static camera input. Moving cameras add new challenges in how to fuse newly unveiled image regions with already processed regions efficiently to minimize the update rate - without increasing memory overhead and without knowing the camera extrinsics of future frames. In this work, we propose MotionDeltaCNN, a sparse CNN inference framework that supports moving cameras. We introduce spherical buffers and padded convolutions to enable seamless fusion of newly unveiled regions and previously processed regions -- without increasing memory footprint. Our evaluation shows that we outperform DeltaCNN by up to 90% for moving camera videos.


title: Does the lockstep growth between black holes and bulges create their mass relation?

abstract: Recent studies have revealed a strong relation between sample-averaged black-hole (BH) accretion rate (BHAR) and star formation rate (SFR) among bulge-dominated galaxies, i.e., "lockstep" BH-bulge growth, in the distant universe. This relation might be closely related to the BH-bulge mass correlation observed in the local universe. To understand further BH-bulge coevolution, we present ALMA CO(2-1) or CO(3-2) observations of 7 star-forming bulge-dominated galaxies at z=0.5-2.5. Using the ALMA data, we detect significant ($>3\sigma$) CO emission from 4 objects. For our sample of 7 galaxies, we measure (or constrain with upper limits) their CO line fluxes and estimate molecular gas masses ($M_{gas}$). We also estimate their stellar masses ($M_{star}$) and SFRs by modelling their spectral energy distributions (SEDs). Using these physical properties, we derive the gas-depletion timescales ($t_{dep} = M_{gas}/SFR$) and compare them with the bulge/BH growth timescales ($t_{grow} = M_{star}/SFR \sim M_{BH}/BHAR$). Our sample generally has $t_{dep}$ shorter than $t_{grow}$ by a median factor of $\gtrsim 4$, indicating that the cold gas will be depleted before significant bulge/BH growth takes place. This result suggests that the BH-bulge lockstep growth is mainly responsible for maintaining their mass relation, not creating it. We note that our sample is small and limited to $z<2.5$; JWST and ALMA will be able to probe to higher redshifts in the near future.


title: Collision-Induced Dissociation at TRIUMF's Ion Trap for Atomic and Nuclear science

abstract: The performance of high-precision mass spectrometry of radioactive isotopes can often be hindered by large amounts of contamination, including molecular species, stemming from the production of the radioactive beam. In this paper, we report on the development of Collision-Induced Dissociation (CID) as a means of background reduction for experiments at TRIUMF's Ion Trap for Atomic and Nuclear science (TITAN). This study was conducted to characterize the quality and purity of radioactive ion beams and the reduction of molecular contaminants to allow for mass measurements of radioactive isotopes to be done further from nuclear stability. This is the first demonstration of CID at an ISOL-type radioactive ion beam facility, and it is shown that molecular contamination can be reduced up to an order of magnitude.


title: IntTower: the Next Generation of Two-Tower Model for Pre-Ranking System

abstract: Scoring a large number of candidates precisely in several milliseconds is vital for industrial pre-ranking systems. Existing pre-ranking systems primarily adopt the \textbf{two-tower} model since the ``user-item decoupling architecture'' paradigm is able to balance the \textit{efficiency} and \textit{effectiveness}. However, the cost of high efficiency is the neglect of the potential information interaction between user and item towers, hindering the prediction accuracy critically. In this paper, we show it is possible to design a two-tower model that emphasizes both information interactions and inference efficiency. The proposed model, IntTower (short for \textit{Interaction enhanced Two-Tower}), consists of Light-SE, FE-Block and CIR modules. Specifically, lightweight Light-SE module is used to identify the importance of different features and obtain refined feature representations in each tower. FE-Block module performs fine-grained and early feature interactions to capture the interactive signals between user and item towers explicitly and CIR module leverages a contrastive interaction regularization to further enhance the interactions implicitly. Experimental results on three public datasets show that IntTower outperforms the SOTA pre-ranking models significantly and even achieves comparable performance in comparison with the ranking models. Moreover, we further verify the effectiveness of IntTower on a large-scale advertisement pre-ranking system. The code of IntTower is publicly available\footnote{https://github.com/archersama/IntTower}


title: A Note on Stress-Energy Tensor and Variational Principle for Null Strings

abstract: A straightforward application of the variational principle to null strings meets difficulties since string's world-sheets are degenerate. It is known that the variational principle in this case can be formulted with the help of two-vector density on the string world-sheet which plays a role of Lagrange multipliers. It is shown that recently suggested stress-energy tensor of null strings can be derived by variation over the background metric of the action used to describe tensionless limit in the string theory. One of the Lagrange multipliers is related to the energy of the null string.


title: Constraining the origin of stellar binary black hole mergers by detections of their lensed host galaxies and gravitational wave signals

abstract: A significant number of stellar binary black hole (sBBH) mergers may be lensed and detected by the third generation gravitational wave (GW) detectors. Their lensed host galaxies may be detectable, which thus helps to accurately localize these sources and provide a new approach to study the origin of sBBHs. In this paper, we investigate the detectability of the lensed host galaxies for the lensed sBBH mergers. We find that the detection fraction of the host galaxies to the lensed GW events can be significantly different for a survey with a given limiting magnitude if sBBHs are produced by different mechanisms, such as the evolution of massive binary stars, the dynamical interactions in dense star clusters, and that assisted by active galactic nuclei or massive black holes. Furthermore, we illustrate that the statistical spatial distribution of those lensed sBBHs in its hosts resulting from different sBBH formation channels can be different from each other. Therefore, with the third generation GW detectors and future large scale galaxy surveys, it is possible to independently constrain the sBBH origin via the detection fraction of those lensed events with identifiable lensing host signatures and/or even constrain the contribution fractions from different sBBH formation mechanisms


title: On the Hagedorn Temperature in Holographic Confining Gauge Theories

abstract: The divergence of the string partition function due to the exponential growth of states is a well-understood issue in flat spacetime. It can be interpreted as the appearance of tachyon modes above a certain temperature, known as the Hagedorn temperature $T_H$. In the literature, one can find some intuitions about its generalization to curved spacetimes, where computations are extremely hard and explicit results cannot be provided in general. In this paper, we present a genus-zero estimate of $T_H$, at leading order in $\alpha'$, for string theories on curved backgrounds holographically dual to confining gauge theories. This is a particularly interesting case, since the holographic correspondence equates $T_H$ with the Hagedorn temperature of the dual gauge theories. For concreteness we focus on Type IIA string theory on a well known background dual to an $SU(N)$ Yang-Mills theory. The resulting Hagedorn temperature turns out to be proportional to the square root of the Yang-Mills confining string tension. The related coefficient, which at leading order is analytically determined, is the same as the one for Type II theories in flat space. While the calculation is performed in a specific model, the result applies in full generality to confining gauge theories with a top-down holographic dual.


title: Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directions

abstract: Abstractive dialogue summarization is to generate a concise and fluent summary covering the salient information in a dialogue among two or more interlocutors. It has attracted great attention in recent years based on the massive emergence of social communication platforms and an urgent requirement for efficient dialogue information understanding and digestion. Different from news or articles in traditional document summarization, dialogues bring unique characteristics and additional challenges, including different language styles and formats, scattered information, flexible discourse structures and unclear topic boundaries. This survey provides a comprehensive investigation on existing work for abstractive dialogue summarization from scenarios, approaches to evaluations. It categorizes the task into two broad categories according to the type of input dialogues, i.e., open-domain and task-oriented, and presents a taxonomy of existing techniques in three directions, namely, injecting dialogue features, designing auxiliary training tasks and using additional data.A list of datasets under different scenarios and widely-accepted evaluation metrics are summarized for completeness. After that, the trends of scenarios and techniques are summarized, together with deep insights on correlations between extensively exploited features and different scenarios. Based on these analyses, we recommend future directions including more controlled and complicated scenarios, technical innovations and comparisons, publicly available datasets in special domains, etc.


title: A survey for variable young stars with small telescopes: VII -- Spot Properties on YSOs in IC5070

abstract: We present measurements of spot properties on 31 young stellar objects, based on multi-band data from the HOYS (Hunting Outbursting Young Stars) project. On average the analysis for each object is based on 270 data points during 80 days in at least 3 bands. All the young low-mass stars in our sample show periodic photometric variations. We determine spot temperatures and coverage by comparing the measured photometric amplitudes in optical bands with simulated amplitudes based on atmosphere models, including a complete error propagation. 21 objects in our sample feature cool spots, with spot temperatures 500 - 2500 K below the stellar effective temperature ($T_{\rm eff}$), and a coverage of 0.05 - 0.4. Six more have hot spots, with temperatures up to 3000 K above $T_{\rm eff}$ and coverage below 0.15. The remaining four stars have ambiguous solutions or are AA Tau-type contaminants. All of the stars with large spots (i.e. high coverage $>0.1$) are relatively cool with $T_{\rm eff} < 4500$ K, which could be a result of having deeper convection zones. Apart from that, spot properties show no significant trends with rotation period, infrared excess, or stellar properties. Most notably, we find hot spots in stars that do not show $K-W2$ infrared excess, indicating the possibility of accretion across an inner disk cavity or the presence of plage.


title: Efficient calculation of three-dimensional tensor networks

abstract: We have proposed an efficient algorithm to calculate physical quantities in the translational invariant three-dimensional tensor networks, which is particularly relevant to the study of the three-dimensional classical statistical models and the (2+1)-dimensional quantum lattice models. In the context of a classical model, we determine the partition function by solving the dominant eigenvalue problem of the transfer matrix, whose left and right dominant eigenvectors are represented by two projected entangled simplex states. These two projected entangled simplex states are not Hermitian conjugate to each other but are appropriately arranged so that their inner product can be computed much more efficiently than in the usual prescription. For the three-dimensional Ising model, the calculated internal energy and spontaneous magnetization agree with the published results in the literature. The possible improvement and extension to other models are also discussed.


title: Learning to simulate realistic limit order book markets from data as a World Agent

abstract: Multi-agent market simulators usually require careful calibration to emulate real markets, which includes the number and the type of agents. Poorly calibrated simulators can lead to misleading conclusions, potentially causing severe loss when employed by investment banks, hedge funds, and traders to study and evaluate trading strategies. In this paper, we propose a world model simulator that accurately emulates a limit order book market -- it requires no agent calibration but rather learns the simulated market behavior directly from historical data. Traditional approaches fail short to learn and calibrate trader population, as historical labeled data with details on each individual trader strategy is not publicly available. Our approach proposes to learn a unique "world" agent from historical data. It is intended to emulate the overall trader population, without the need of making assumptions about individual market agent strategies. We implement our world agent simulator models as a Conditional Generative Adversarial Network (CGAN), as well as a mixture of parametric distributions, and we compare our models against previous work. Qualitatively and quantitatively, we show that the proposed approaches consistently outperform previous work, providing more realism and responsiveness.


title: Loop-by-loop Differential Equations for Dual (Elliptic) Feynman Integrals

abstract: We present a loop-by-loop method for computing the differential equations of Feynman integrals using the recently developed dual form formalism. We give explicit prescriptions for the loop-by-loop fibration of multi-loop dual forms. Then, we test our formalism on a simple, but non-trivial, example: the two-loop three-mass elliptic sunrise family of integrals. We obtain an epsilon-form differential equation within the correct function space in a sequence of relatively simple algebraic steps. In particular, none of these steps relies on the analysis of $q$-series. Then, we discuss interesting properties satisfied by our dual basis as well as its simple relation to the known epsilon-form basis of Feynman integrands. The underlying K3-geometry of the three-loop four-mass sunrise integral is also discussed. Finally, we speculate on how to construct a "good" loop-by-loop basis at three-loop.


title: First Order Logic on Pathwidth Revisited Again

abstract: Courcelle's celebrated theorem states that all MSO-expressible properties can be decided in linear time on graphs of bounded treewidth. Unfortunately, the hidden constant implied by this theorem is a tower of exponentials whose height increases with each quantifier alternation in the formula. More devastatingly, this cannot be improved, under standard assumptions, even if we consider the much more restricted problem of deciding FO-expressible properties on trees. In this paper we revisit this well-studied topic and identify a natural special case where the dependence of Courcelle's theorem can, in fact, be improved. Specifically, we show that all FO-expressible properties can be decided with an elementary dependence on the input formula, if the input graph has bounded pathwidth (rather than treewidth). This is a rare example of treewidth and pathwidth having different complexity behaviors. Our result is also in sharp contrast with MSO logic on graphs of bounded pathwidth, where it is known that the dependence has to be non-elementary, under standard assumptions. Our work builds upon, and generalizes, a corresponding meta-theorem by Gajarsk{\'{y}} and Hlin{\v{e}}n{\'{y}} for the more restricted class of graphs of bounded tree-depth.


title: SA-DNet: A on-demand semantic object registration network adapting to non-rigid deformation

abstract: As an essential processing step before the fusing of infrared and visible images, the performance of image registration determines whether the two images can be fused at correct spatial position. In the actual scenario, the varied imaging devices may lead to a change in perspective or time gap between shots, making significant non-rigid spatial relationship in infrared and visible images. Even if a large number of feature points are matched, the registration accuracy may still be inadequate, affecting the result of image fusion and other vision tasks. To alleviate this problem, we propose a Semantic-Aware on-Demand registration network (SA-DNet), which mainly purpose is to confine the feature matching process to the semantic region of interest (sROI) by designing semantic-aware module (SAM) and HOL-Deep hybrid matching module (HDM). After utilizing TPS to transform infrared and visible images based on the corresponding feature points in sROI, the registered images are fused using image fusion module (IFM) to achieve a fully functional registration and fusion network. Moreover, we point out that for different demands, this type of approach allows us to select semantic objects for feature matching as needed and accomplishes task-specific registration based on specific requirements. To demonstrate the robustness of SA-DNet for non-rigid distortions, we conduct extensive experiments by comparing SA-DNet with five state-of-the-art infrared and visible image feature matching methods, and the experimental results show that our method adapts better to the presence of non-rigid distortions in the images and provides semantically well-registered images.


title: Sampling using Adaptive Regenerative Processes

abstract: Enriching Brownian motion with regenerations from a fixed regeneration distribution $\mu$ at a particular regeneration rate $\kappa$ results in a Markov process that has a target distribution $\pi$ as its invariant distribution. For the purpose of Monte Carlo inference, implementing such a scheme requires firstly selection of regeneration distribution $\mu$, and secondly computation of a specific constant $C$. Both of these tasks can be very difficult in practice for good performance. We introduce a method for adapting the regeneration distribution, by adding point masses to it. This allows the process to be simulated with as few regenerations as possible and obviates the need to find said constant $C$. Moreover, the choice of fixed $\mu$ is replaced with the choice of the initial regeneration distribution, which is considerably less difficult. We establish convergence of this resulting self-reinforcing process and explore its effectiveness at sampling from a number of target distributions. The examples show that adapting the regeneration distribution guards against poor choices of fixed regeneration distribution and can reduce the error of Monte Carlo estimates of expectations of interest, especially when $\pi$ is skewed.


title: Successor Sets of Discrete-time Nonlinear Systems Using Hybrid Zonotopes

abstract: This paper presents identities for calculating over-approximated successor sets of discrete-time nonlinear systems using hybrid zonotopes. The proposed technique extends the state-update set construct, previously developed for linear hybrid systems, to nonlinear systems. Forward reachability of nonlinear systems can then be performed using only projection, intersection, and Cartesian product set operations with the state-update set. It is shown that use of an over-approximation of the state-update set yields over-approximations of successor sets. A technique to over-approximate a nonlinear function using a special ordered set approximation, equivalently represented as a hybrid zonotope, is then presented. A numerical example of a nonlinear system controlled by a piecewise-affine control law demonstrates that the approach provides a computationally-efficient and tight over-approximation of the closed-loop reachable set.


abstract: Online convex optimization (OCO) is a widely used framework in online learning. In each round, the learner chooses a decision in a convex set and an adversary chooses a convex loss function, and then the learner suffers the loss associated with their current decision. However, in many applications the learner's loss depends not only on the current decision but on the entire history of decisions until that point. The OCO framework and its existing generalizations do not capture this, and they can only be applied to many settings of interest after a long series of approximation arguments. They also leave open the question of whether the dependence on memory is tight because there are no non-trivial lower bounds. In this work we introduce a generalization of the OCO framework, "Online Convex Optimization with Unbounded Memory", that captures long-term dependence on past decisions. We introduce the notion of $p$-effective memory capacity, $H_p$, that quantifies the maximum influence of past decisions on present losses. We prove an $O(\sqrt{H_p T})$ upper bound on the policy regret and a matching (worst-case) lower bound. As a special case, we prove the first non-trivial lower bound for OCO with finite memory \citep{anavaHM2015online}, which could be of independent interest, and also improve existing upper bounds. We demonstrate the broad applicability of our framework by using it to derive regret bounds, and to improve and simplify existing regret bound derivations, for a variety of online learning problems including online linear control and an online variant of performative prediction.


title: MaSS: Multi-attribute Selective Suppression

abstract: The recent rapid advances in machine learning technologies largely depend on the vast richness of data available today, in terms of both the quantity and the rich content contained within. For example, biometric data such as images and voices could reveal people's attributes like age, gender, sentiment, and origin, whereas location/motion data could be used to infer people's activity levels, transportation modes, and life habits. Along with the new services and applications enabled by such technological advances, various governmental policies are put in place to regulate such data usage and protect people's privacy and rights. As a result, data owners often opt for simple data obfuscation (e.g., blur people's faces in images) or withholding data altogether, which leads to severe data quality degradation and greatly limits the data's potential utility. Aiming for a sophisticated mechanism which gives data owners fine-grained control while retaining the maximal degree of data utility, we propose Multi-attribute Selective Suppression, or MaSS, a general framework for performing precisely targeted data surgery to simultaneously suppress any selected set of attributes while preserving the rest for downstream machine learning tasks. MaSS learns a data modifier through adversarial games between two sets of networks, where one is aimed at suppressing selected attributes, and the other ensures the retention of the rest of the attributes via general contrastive loss as well as explicit classification metrics. We carried out an extensive evaluation of our proposed method using multiple datasets from different domains including facial images, voice audio, and video clips, and obtained promising results in MaSS' generalizability and capability of suppressing targeted attributes without negatively affecting the data's usability in other downstream ML tasks.


title: Semiclassical kinetic theory for systems with non-trivial quantum geometry and the expectation value of physical quantities

abstract: Starting from the Keldysh theory, for a general low energy $N$-band Hamiltonian in the clean limit, we perform a manifestly $\smash{U(1) \times SU(N)}$ gauge invariant semiclassical expansion. A generalized Berry curvature tensor is shown to control a redistribution of spectral weights. New expressions for certain physical quantities ensue, establishing the limits of a previously proposed correction to the density of states. In the two-band case, we derive a completely general semiclassical kinetic theory including all $O(\hbar)$ quantum corrections. As an application, we show how one can recover, out of a single simple calculation, the chiral anomaly, intrinsic anomalous Hall conductivity and chiral magnetic effect, in all generality. The demonstrated flexibility and efficiency of our formalism derives from the insulation it provides from the underlying complexity of the quantum kinetics, notwithstanding its rigorous connection to this deeper level.


title: Exploring players' experience of humor and snark in a grade 3-6 history practices game

abstract: In this paper we use an existing history learning game with an active audience as a research platform for exploring how humor and "snarkiness" in the dialog script affect students' progression and attitudes about the game. We conducted a 2x2 randomized experiment with 11,804 anonymous 3rd-6th grade students. Using one-way ANOVA and Kruskall-Wallis tests, we find that changes to the script produced measurable results in the self-reported perceived humor of the game and the likeability of the player character. Different scripts did not produce significant differences in player completion of the game, or how much of the game was played. Perceived humor and enjoyment of the game and its main character contributed significantly to progress in the game, as did self-perceived reading skill.


title: Prospects for detecting transient quasi-monochromatic gravitational waves from glitching pulsars with current and future detectors

abstract: Pulsars are rotating neutron stars that emit periodic electromagnetic radiation. While pulsars generally slow down as they lose energy, some also experience glitches: spontaneous increases of their rotational frequency. According to several models, these glitches can also lead to the emission of long-duration transient gravitational waves (GWs). We present detection prospects for such signals by comparing indirect energy upper limits on GW strain for known glitches with the sensitivity of current and future ground-based GW detectors. We first consider the optimistic case of generic constraints based on the glitch size and find that realistic matched-filter searches in the fourth LIGO-Virgo-KAGRA observing run(O4) could make a detection, or set constraints below these indirect upper limits, for equivalents of 36 out of 726 previously observed glitches, and 74 in the O5 run. With the third-generation Einstein Telescope or Cosmic Explorer, 35-40% of glitches would be accessible. When specialising to a scenario where transient mountains produce the post-glitch GW emission, following the Yim & Jones model, the indirect upper limits are stricter. Out of the smaller set of 119 glitches with measured healing parameter, as needed for predictions under that model, only 6 glitches would have been within reach for O4 and 14 for O5, with a similar percentage as before with third generation detectors. We also discuss how this model matches the observed glitch population.


title: The scattering phase: seen at last

abstract: The scattering phase, defined as $ \log \det S ( \lambda ) / 2\pi i $ where $ S ( \lambda ) $ is the (unitary) scattering matrix, is the analogue of the counting function for eigenvalues when dealing with exterior domains and is closely related to Krein's spectral shift function. We revisit classical results on asymptotics of the scattering phase and point out that it is never monotone in the case of strong trapping of waves. Perhaps more importantly, we provide the first numerical calculations of scattering phases for non-radial scatterers. They show that the asymptotic Weyl law is accurate even at low frequencies and reveal effects of trapping such as lack of monotonicity. This is achieved by using the recent high level multiphysics finite element software FreeFEM.


title: Uncertainty estimation for out-of-distribution detection in computational histopathology

abstract: In computational histopathology algorithms now outperform humans on a range of tasks, but to date none are employed for automated diagnoses in the clinic. Before algorithms can be involved in such high-stakes decisions they need to "know when they don't know", i.e., they need to estimate their predictive uncertainty. This allows them to defer potentially erroneous predictions to a human pathologist, thus increasing their safety. Here, we evaluate the predictive performance and calibration of several uncertainty estimation methods on clinical histopathology data. We show that a distance-aware uncertainty estimation method outperforms commonly used approaches, such as Monte Carlo dropout and deep ensembles. However, we observe a drop in predictive performance and calibration on novel samples across all uncertainty estimation methods tested. We also investigate the use of uncertainty thresholding to reject out-of-distribution samples for selective prediction. We demonstrate the limitations of this approach and suggest areas for future research.


title: On inhomogeneous heat equation with inverse square potential

abstract: We study inhomogeneous heat equation with inverse square potential, namely, \[\partial_tu + \mathcal{L}_a u= \pm |\cdot|^{-b} |u|^{\alpha}u,\] where $\mathcal{L}_a=-\Delta + a |x|^{-2}.$ We establish some fixed-time decay estimate for $e^{-t\mathcal{L}_a}$ associated with inhomogeneous nonlinearity $|\cdot|^{-b}$ in Lebesgue spaces. We then develop local theory in $L^q-$ scaling critical and super-critical regime and small data global well-posedness in critical Lebegue spaces. We further study asymptotic behaviour of global solutions by using self-similar solutions, provided the initial data satisfies certain bounds. Our method of proof is inspired from the work of Slimene-Tayachi-Weissler (2017) where they considered the classical case, i.e. $a=0$.


title: Leveraging Cluster Analysis to Understand Educational Game Player Experiences and Support Design

abstract: The ability for an educational game designer to understand their audience's play styles and resulting experience is an essential tool for improving their game's design. As a game is subjected to large-scale player testing, the designers require inexpensive, automated methods for categorizing patterns of player-game interactions. In this paper we present a simple, reusable process using best practices for data clustering, feasible for use within a small educational game studio. We utilize the method to analyze a real-time strategy game, processing game telemetry data to determine categories of players based on their in-game actions, the feedback they received, and their progress through the game. An interpretive analysis of these clusters results in actionable insights for the game's designers.


title: A four compartment epidemic model with retarded transition rates

abstract: We study an epidemic model for a constant population by taking into account four compartments of the individuals characterizing their states of health. Each individual is in one of the compartments susceptible (S); incubated - infected yet not infectious (C), infected and infectious (I), and recovered - immune (R). An infection is 'visible' only when an individual is in state I. Upon infection, an individual performs the transition pathway S to C to I to R to S remaining in each compartments C, I, and R for certain random waiting times, respectively. The waiting times for each compartment are independent and drawn from specific probability density functions (PDFs) introducing memory into the model. We derive memory evolution equations involving convolutions (time derivatives of general fractional type). We obtain formulae for the endemic equilibrium and a condition of its existence for cases when the waiting time PDFs have existing means. We analyze the stability of healthy and endemic equilibria and derive conditions for which the endemic state becomes oscillatory (Hopf) unstable. We implement a simple multiple random walker's approach (microscopic model of Brownian motion of Z independent walkers) with random SCIRS waiting times into computer simulations. Infections occur with a certain probability by collisions of walkers in compartments I and S. We compare the endemic states predicted in the macroscopic model with the numerical results of the simulations and find accordance of high accuracy. We conclude that a simple random walker's approach offers an appropriate microscopic description for the macroscopic model.


title: Measure-Theoretic Probability of Complex Co-occurrence and E-Integral

abstract: Complex high-dimensional co-occurrence data are increasingly popular from a complex system of interacting physical, biological and social processes in discretely indexed modifiable areal units or continuously indexed locations of a study region for landscape-based mechanism. Modeling, predicting and interpreting complex co-occurrences are very general and fundamental problems of statistical and machine learning in a broad variety of real-world modern applications. Probability and conditional probability of co-occurrence are introduced by being defined in a general setting with set functions to develop a rigorous measure-theoretic foundation for the inherent challenge of data sparseness. The data sparseness is a main challenge inherent to probabilistic modeling and reasoning of co-occurrence in statistical inference. The behavior of a class of natural integrals called E-integrals is investigated based on the defined conditional probability of co-occurrence. The results on the properties of E-integral are presented. The paper offers a novel measure-theoretic framework where E-integral as a basic measure-theoretic concept can be the starting point for the expectation functional approach preferred by Whittle (1992) and Pollard (2001) to the development of probability theory for the inherent challenge of co-occurrences emerging in modern high-dimensional co-occurrence data problems and opens the doors to more sophisticated and interesting research in complex high-dimensional co-occurrence data science.


title: Computing MEMs and Relatives on Repetitive Text Collections

abstract: We consider the problem of computing the Maximal Exact Matches (MEMs) of a given pattern $P[1 .. m]$ on a large repetitive text collection $T[1 .. n]$, which is represented as a (hopefully much smaller) run-length context-free grammar of size $g_{rl}$. We show that the problem can be solved in time $O(m^2 \log^\epsilon n)$, for any constant $\epsilon > 0$, on a data structure of size $O(g_{rl})$. Further, on a locally consistent grammar of size $O(\delta\log\frac{n}{\delta})$, the time decreases to $O(m\log m(\log m + \log^\epsilon n))$. The value $\delta$ is a function of the substring complexity of $T$ and $\Omega(\delta\log\frac{n}{\delta})$ is a tight lower bound on the compressibility of repetitive texts $T$, so our structure has optimal size in terms of $n$ and $\delta$. We extend our results to several related problems, such as finding $k$-MEMs, MUMs, rare MEMs, and applications.


title: Entanglement in the full state vector of boson sampling

abstract: The full state vector of boson sampling is generated by passing S single photons through beam splitters of M modes. The initial Fock state is expressed withgeneralized coherent states, and an exact application of the unitary evolution becomes possible. Due to the favorable polynomial scaling in M , we can investigate Renyi entanglement entropies for moderate particle and huge mode numbers. We find (almost) Renyi index independent symmetric Page curves with maximum entropy at equal partition. Furthermore, the maximum entropy as a function of mode index saturates as a function of M in the collision-free subspace case. The asymptotic value of the entropy increases linearly with S. Furthermore, we show that the build-up of the entanglement leads to a cusp at subsystem size equal to S in the asymmetric entanglement curve. The maximum entanglement is reached surprisingly early before the mode population is distributed over the whole system.


title: Mid-attribute speaker generation using optimal-transport-based interpolation of Gaussian mixture models

abstract: In this paper, we propose a method for intermediating multiple speakers' attributes and diversifying their voice characteristics in ``speaker generation,'' an emerging task that aims to synthesize a nonexistent speaker's naturally sounding voice. The conventional TacoSpawn-based speaker generation method represents the distributions of speaker embeddings by Gaussian mixture models (GMMs) conditioned with speaker attributes. Although this method enables the sampling of various speakers from the speaker-attribute-aware GMMs, it is not yet clear whether the learned distributions can represent speakers with an intermediate attribute (i.e., mid-attribute). To this end, we propose an optimal-transport-based method that interpolates the learned GMMs to generate nonexistent speakers with mid-attribute (e.g., gender-neutral) voices. We empirically validate our method and evaluate the naturalness of synthetic speech and the controllability of two speaker attributes: gender and language fluency. The evaluation results show that our method can control the generated speakers' attributes by a continuous scalar value without statistically significant degradation of speech naturalness.


title: Controllable Fake Document Infilling for Cyber Deception

abstract: Recent works in cyber deception study how to deter malicious intrusion by generating multiple fake versions of a critical document to impose costs on adversaries who need to identify the correct information. However, existing approaches are context-agnostic, resulting in sub-optimal and unvaried outputs. We propose a novel context-aware model, Fake Document Infilling (FDI), by converting the problem to a controllable mask-then-infill procedure. FDI masks important concepts of varied lengths in the document, then infills a realistic but fake alternative considering both the previous and future contexts. We conduct comprehensive evaluations on technical documents and news stories. Results show that FDI outperforms the baselines in generating highly believable fakes with moderate modification to protect critical information and deceive adversaries.


title: Online Damage Recovery for Physical Robots with Hierarchical Quality-Diversity

abstract: In real-world environments, robots need to be resilient to damages and robust to unforeseen scenarios. Quality-Diversity (QD) algorithms have been successfully used to make robots adapt to damages in seconds by leveraging a diverse set of learned skills. A high diversity of skills increases the chances of a robot to succeed at overcoming new situations since there are more potential alternatives to solve a new task.However, finding and storing a large behavioural diversity of multiple skills often leads to an increase in computational complexity. Furthermore, robot planning in a large skill space is an additional challenge that arises with an increased number of skills. Hierarchical structures can help reducing this search and storage complexity by breaking down skills into primitive skills. In this paper, we introduce the Hierarchical Trial and Error algorithm, which uses a hierarchical behavioural repertoire to learn diverse skills and leverages them to make the robot adapt quickly in the physical world. We show that the hierarchical decomposition of skills enables the robot to learn more complex behaviours while keeping the learning of the repertoire tractable. Experiments with a hexapod robot show that our method solves a maze navigation tasks with 20% less actions in simulation, and 43% less actions in the physical world, for the most challenging scenarios than the best baselines while having 78% less complete failures.


title: Dense FixMatch: a simple semi-supervised learning method for pixel-wise prediction tasks

abstract: We propose Dense FixMatch, a simple method for online semi-supervised learning of dense and structured prediction tasks combining pseudo-labeling and consistency regularization via strong data augmentation. We enable the application of FixMatch in semi-supervised learning problems beyond image classification by adding a matching operation on the pseudo-labels. This allows us to still use the full strength of data augmentation pipelines, including geometric transformations. We evaluate it on semi-supervised semantic segmentation on Cityscapes and Pascal VOC with different percentages of labeled data and ablate design choices and hyper-parameters. Dense FixMatch significantly improves results compared to supervised learning using only labeled data, approaching its performance with 1/4 of the labeled samples.


title: An Efficient Ratio Detector for Ambient Backscatter Communication

abstract: Ambient backscatter communication (AmBC) leverages the existing ambient radio frequency (RF) environment to implement communication with battery-free devices. One critical challenge of AmBC systems is signal recovery because the transmitted information bits are embedded in the ambient RF signals and these are unknown and uncontrollable. To address this problem, most existing approaches use averaging-based energy detectors and consequently the data rate is low and there is an error floor. Here we propose a new detection strategy based on the ratio between signals received from a multiple-antenna Reader. The advantage of using the ratio is that ambient RF signals are removed directly from the embedded signals without averaging and hence it can increase data rates and avoid the error floor. Different from original ratio detectors that use the magnitude ratio of the signals between two Reader antennas, in our proposed approach, we utilize the complex ratio so that phase information is preserved and propose an accurate linear channel model approximation. This allows the application of existing linear detection techniques from which we can obtain a minimum distance detector and closed-form expressions for bit error rate (BER). In addition, averaging, coding and interleaving can also be included to further enhance the BER. The results are also general, allowing any number of Reader antennas to be utilized in the approach. Numerical results demonstrate that the proposed approach performs better than approaches based on energy detection and original ratio detectors.


title: Finite-time analysis of single-timescale actor-critic

abstract: Actor-critic methods have achieved significant success in many challenging applications. However, its finite-time convergence is still poorly understood in the most practical single-timescale form. Existing works on analyzing single-timescale actor-critic have been limited to i.i.d. sampling or tabular setting for simplicity. We investigate the more practical online single-timescale actor-critic algorithm on continuous state space, where the critic assumes linear function approximation and updates with a single Markovian sample per actor step. Previous analysis has been unable to establish the convergence for such a challenging scenario. We demonstrate that the online single-timescale actor-critic method provably finds an $\epsilon$-approximate stationary point with $\widetilde{\mathcal{O}}(\epsilon^{-2})$ sample complexity under standard assumptions, which can be further improved to $\mathcal{O}(\epsilon^{-2})$ under the i.i.d. sampling. Our novel framework systematically evaluates and controls the error propagation between the actor and critic. It offers a promising approach for analyzing other single-timescale reinforcement learning algorithms as well.


title: Few-Shot Learning of Compact Models via Task-Specific Meta Distillation

abstract: We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as the model architecture used for final deployment. In this paper, we challenge this basic assumption. For final deployment, we often need the model to be small. But small models usually do not have enough capacity to effectively adapt to new tasks. In the mean time, we often have access to the large dataset and extensive computing power during meta-training since meta-training is typically performed on a server. In this paper, we propose task-specific meta distillation that simultaneously learns two models in meta-learning: a large teacher model and a small student model. These two models are jointly learned during meta-training. Given a new task during meta-testing, the teacher model is first adapted to this task, then the adapted teacher model is used to guide the adaptation of the student model. The adapted student model is used for final deployment. We demonstrate the effectiveness of our approach in few-shot image classification using model-agnostic meta-learning (MAML). Our proposed method outperforms other alternatives on several benchmark datasets.


title: Zero-shot point cloud segmentation by transferring geometric primitives

abstract: We investigate transductive zero-shot point cloud semantic segmentation, where the network is trained on seen objects and able to segment unseen objects. The 3D geometric elements are essential cues to imply a novel 3D object type. However, previous methods neglect the fine-grained relationship between the language and the 3D geometric elements. To this end, we propose a novel framework to learn the geometric primitives shared in seen and unseen categories' objects and employ a fine-grained alignment between language and the learned geometric primitives. Therefore, guided by language, the network recognizes the novel objects represented with geometric primitives. Specifically, we formulate a novel point visual representation, the similarity vector of the point's feature to the learnable prototypes, where the prototypes automatically encode geometric primitives via back-propagation. Besides, we propose a novel Unknown-aware InfoNCE Loss to fine-grained align the visual representation with language. Extensive experiments show that our method significantly outperforms other state-of-the-art methods in the harmonic mean-intersection-over-union (hIoU), with the improvement of 17.8\%, 30.4\%, 9.2\% and 7.9\% on S3DIS, ScanNet, SemanticKITTI and nuScenes datasets, respectively. Codes are available (https://github.com/runnanchen/Zero-Shot-Point-Cloud-Segmentation)


title: Predicting Winning Regions in Parity Games via Graph Neural Networks (Extended Abstract)

abstract: Solving parity games is a major building block for numerous applications in reactive program verification and synthesis. While they can be solved efficiently in practice, no known approach has a polynomial worst-case runtime complexity. We present a incomplete polynomial-time approach to determining the winning regions of parity games via graph neural networks. Our evaluation on 900 randomly generated parity games shows that this approach is effective and efficient in practice. It correctly determines the winning regions of $\sim$60\% of the games in our data set and only incurs minor errors in the remaining ones. We believe that this approach can be extended to efficiently solve parity games as well.


title: Generalizing in the Real World with Representation Learning

abstract: Machine learning (ML) formalizes the problem of getting computers to learn from experience as optimization of performance according to some metric(s) on a set of data examples. This is in contrast to requiring behaviour specified in advance (e.g. by hard-coded rules). Formalization of this problem has enabled great progress in many applications with large real-world impact, including translation, speech recognition, self-driving cars, and drug discovery. But practical instantiations of this formalism make many assumptions - for example, that data are i.i.d.: independent and identically distributed - whose soundness is seldom investigated. And in making great progress in such a short time, the field has developed many norms and ad-hoc standards, focused on a relatively small range of problem settings. As applications of ML, particularly in artificial intelligence (AI) systems, become more pervasive in the real world, we need to critically examine these assumptions, norms, and problem settings, as well as the methods that have become de-facto standards. There is much we still do not understand about how and why deep networks trained with stochastic gradient descent are able to generalize as well as they do, why they fail when they do, and how they will perform on out-of-distribution data. In this thesis I cover some of my work towards better understanding deep net generalization, identify several ways assumptions and problem settings fail to generalize to the real world, and propose ways to address those failures in practice.


title: RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction

abstract: Bilingual lexicon induction induces the word translations by aligning independently trained word embeddings in two languages. Existing approaches generally focus on minimizing the distances between words in the aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates. In addition, the mapping function is globally shared by all words, whose performance might be hindered by the deviations in the distributions of different languages. In this work, we propose a novel ranking-oriented induction model RAPO to learn personalized mapping function for each word. RAPO is capable of enjoying the merits from the unique characteristics of a single word and the cross-language isomorphism simultaneously. Extensive experimental results on public datasets including both rich-resource and low-resource languages demonstrate the superiority of our proposal. Our code is publicly available in \url{https://github.com/Jlfj345wf/RAPO}.


title: Research of an optimization model for servicing a network of ATMs and information payment terminals

abstract: The steadily high demand for cash contributes to the expansion of the network of Bank payment terminals. To optimize the amount of cash in payment terminals, it is necessary to minimize the cost of servicing them and ensure that there are no excess funds in the network. The purpose of this work is to create a cash management system in the network of payment terminals. The article discusses the solution to the problem of determining the optimal amount of funds to be loaded into the terminals, and the effective frequency of collection, which allows to get additional income by investing the released funds. The paper presents the results of predicting daily cash withdrawals at ATMs using a triple exponential smoothing model, a recurrent neural network with long short-term memory, and a model of singular spectrum analysis. These forecasting models allowed us to obtain a sufficient level of correct forecasts with good accuracy and completeness. The results of forecasting cash withdrawals were used to build a discrete optimal control model, which was used to develop an optimal schedule for adding funds to the payment terminal. It is proved that the efficiency and reliability of the proposed model is higher than that of the classical Baumol-Tobin inventory management model: when tested on the time series of three ATMs, the discrete optimal control model did not allow exhaustion of funds and allowed to earn on average 30% more than the classical model.


title: Team OS's System for Dialogue Robot Competition 2022

abstract: This paper describes our dialogue robot system, OSbot, developed for Dialogue Robot Competition 2022. The dialogue flow is based on state transitions described manually and the transition conditions use the results of keyword extraction and sentiment analysis. The transitions can be easily viewed and edited by managing them on a spreadsheet. The keyword extraction is based on named entity extraction and our predefined keyword set. The sentiment analysis is text-based and uses SVM, which was trained with the multimodal dialogue corpus Hazumi. We quickly checked and edited a dialogue flow by using a logging function. In the competition's preliminary round, our system ended up in third place.


title: Differentially Private Diffusion Models

abstract: While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge, providing access to synthetic data instead. We build on the recent success of diffusion models (DMs) and introduce Differentially Private Diffusion Models (DPDMs), which enforce privacy using differentially private stochastic gradient descent (DP-SGD). We investigate the DM parameterization and the sampling algorithm, which turn out to be crucial ingredients in DPDMs, and propose noise multiplicity, a powerful modification of DP-SGD tailored to the training of DMs. We validate our novel DPDMs on image generation benchmarks and achieve state-of-the-art performance in all experiments. Moreover, on standard benchmarks, classifiers trained on DPDM-generated synthetic data perform on par with task-specific DP-SGD-trained classifiers, which has not been demonstrated before for DP generative models. Project page and code: https://nv-tlabs.github.io/DPDM.


title: An Intermediate-field Fast Radio Burst Model and the Quasi-periodic Oscillation

abstract: Quasi-periodic oscillation (QPO) signals are discovered in some fast radio bursts (FRBs) such as FRB 20191221A, as well as in the X-ray burst associated with the galactic FRB from SGR 1935+2154. We revisit the intermediate-field FRB model where the radio waves are generated as fast-magnetosonic waves through magnetic reconnection near the light cylinder. The current sheet in the magnetar wind is compressed by a low frequency pulse emitted from the inner magnetosphere to trigger magnetic reconnection. By incorporating the wave dynamics of the magnetosphere, we demonstrate how the FRB frequency, the single pulse width, and luminosity are determined by the period, magnetic field, QPO frequency and quake energetics of the magnetar. We find that this model can naturally and self-consistently interpret the X-ray/radio event from SGR 1935+2154 and the QPO in FRB 20191221A. It can also explain the observed wide energy range of repeating FRBs in a narrow bandwidth.


title: Compiling Petri Net Mutual Reachability in Presburger

abstract: Petri nets are a classical model of concurrency widely used and studied in formal verification with many applications in modeling and analyzing hardware and software, data bases, and reactive systems. The reachability problem is central since many other problems reduce to reachability questions. The reachability problem is known to be decidable but its complexity is extremely high (non primitive recursive). In 2011, a variant of the reachability problem, called the mutual reachability problem, that consists in deciding if two configurations are mutually reachable was proved to be exponential-space complete. Recently, this problem found several unexpected applications in particular in the theory of population protocols. While the mutual reachability problem is known to be definable in the Preburger arithmetic, the best known upper bound of such a formula was recently proved to be non-elementary (tower). In this paper we provide a way to compile the mutual reachability relation of a Petri net with $d$ counters into a quantifier-free Presburger formula given as a doubly exponential disjunction of $O(d)$ linear constraints of exponential size. We also provide some first results about Presburger formulas encoding bottom configurations.


title: Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature

abstract: Lay summarisation aims to jointly summarise and simplify a given text, thus making its content more comprehensible to non-experts. Automatic approaches for lay summarisation can provide significant value in broadening access to scientific literature, enabling a greater degree of both interdisciplinary knowledge sharing and public understanding when it comes to research findings. However, current corpora for this task are limited in their size and scope, hindering the development of broadly applicable data-driven approaches. Aiming to rectify these issues, we present two novel lay summarisation datasets, PLOS (large-scale) and eLife (medium-scale), each of which contains biomedical journal articles alongside expert-written lay summaries. We provide a thorough characterisation of our lay summaries, highlighting differing levels of readability and abstractiveness between datasets that can be leveraged to support the needs of different applications. Finally, we benchmark our datasets using mainstream summarisation approaches and perform a manual evaluation with domain experts, demonstrating their utility and casting light on the key challenges of this task.


title: Explanations Based on Item Response Theory (eXirt): A Model-Specific Method to Explain Tree-Ensemble Model in Trust Perspective

abstract: In recent years, XAI researchers have been formalizing proposals and developing new methods to explain black box models, with no general consensus in the community on which method to use to explain these models, with this choice being almost directly linked to the popularity of a specific method. Methods such as Ciu, Dalex, Eli5, Lofo, Shap and Skater emerged with the proposal to explain black box models through global rankings of feature relevance, which based on different methodologies, generate global explanations that indicate how the model's inputs explain its predictions. In this context, 41 datasets, 4 tree-ensemble algorithms (Light Gradient Boosting, CatBoost, Random Forest, and Gradient Boosting), and 6 XAI methods were used to support the launch of a new XAI method, called eXirt, based on Item Response Theory - IRT and aimed at tree-ensemble black box models that use tabular data referring to binary classification problems. In the first set of analyses, the 164 global feature relevance ranks of the eXirt were compared with 984 ranks of the other XAI methods present in the literature, seeking to highlight their similarities and differences. In a second analysis, exclusive explanations of the eXirt based on Explanation-by-example were presented that help in understanding the model trust. Thus, it was verified that eXirt is able to generate global explanations of tree-ensemble models and also local explanations of instances of models through IRT, showing how this consolidated theory can be used in machine learning in order to obtain explainable and reliable models.


title: A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning

abstract: Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries, which are expensive and impractical for low-resource languages. To disengage from these dependencies, researchers have explored training multilingual models on English-only resources and transferring them to low-resource languages. However, its effect is limited by the gap between embedding clusters of different languages. To address this issue, we propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embeddings without semantic loss, thereby improving cross-lingual transferability. Experimental results on mBERT and XLM-R demonstrate that our method significantly outperforms previous works on the zero-shot cross-lingual text classification task and can obtain a better multilingual alignment.


title: Identification of the dynamic force and moment characteristics of annular gaps using linear independent rotor whirling motions

abstract: Nowadays, most studies on the dynamic properties of annular gaps focus only on the force characteristics due to translational motions, while the tilt and moment coefficients are less well studied. Therefore, there is hardly any reliable experimental data for the additional coefficients that can be used for validation purpose. To improve this, a test rig first presented by Kuhr (2022) is used to experimentally determine the dynamic force and moment characteristics of three annuli of different lengths. By using active magnetic bearings, the rotor is excited with user-defined frequencies and the rotor position and the forces and moments induced by the flow field in the annulus are measured. To obtain accurate and reliable experimental data, extensive preliminary studies are carried out to determine the known characteristics of the test rig rotor and the added mass and inertia imposed by the test rig. Subsequently, an elaborate uncertainty quantification is carried out to quantify the measurement uncertainties. The experimental results, i.e. the 48 rotordynamic coefficients, are compared to a new calculation method. It is shown that the presented experimental data agree well with the calculation method, especially for the additional rotordynamic tilt and moment coefficients. Furthermore, it is shown that the annulus length significantly influences the coefficients of the first sub-matrix. A dependence of the additional coefficients on the length is recognisable, but less pronounced. Even for the shortest investigated annulus, i.e. L = 1, the stiffness coefficients due to the forces from the angular motion of the rotor are of the same order of magnitude as the stiffness coefficients due to the forces from the translational motion. This supports recent results, indicating that the additional coefficients become relevant much earlier than assumed throughout the literature, cf. Childs (1993).


title: The smallest 5-chromatic tournament

abstract: A coloring of a digraph is a partition of its vertex set such that each class induces a digraph with no directed cycles. A digraph is $k$-chromatic if $k$ is the minimum number of classes in such partition, and a digraph is oriented if there is at most one arc between each pair of vertices. Clearly, the smallest $k$-chromatic digraph is the complete digraph on $k$ vertices, but determining the order of the smallest $k$-chromatic oriented graphs is a challenging problem. It is known that the smallest $2$-, $3$- and $4$-chromatic oriented graphs have $3$, $7$ and $11$ vertices, respectively. In 1994, Neumann-Lara conjectured that a smallest $5$-chromatic oriented graph has $17$ vertices. We solve this conjecture and show that the correct order is $19$.


title: Wijesekera-style constructive modal logics

abstract: We define a family of propositional constructive modal logics corresponding each to a different classical modal system. The logics are defined in the style of Wijesekera's constructive modal logic, and are both proof-theoretically and semantically motivated. On the one hand, they correspond to the single-succedent restriction of standard sequent calculi for classical modal logics. On the other hand, they are obtained by incorporating the hereditariness of intuitionistic Kripke models into the classical satisfaction clauses for modal formulas. We show that, for the considered classical logics, the proof-theoretical and the semantical approach return the same constructive systems.


title: Viable wormhole solution in Bopp-Podolsky electrodynamics

abstract: Following a recent approach in which the gravitational field equations in curved spacetimes were presented in the Bopp--Podolsky electrodynamics, we obtained an approximate and spherically symmetric wormhole solution in this context. The calculations were carried out up to the linear approximation in both the spacetime geometry and the radial electric field. The solution presents a new parameter that comes from the Lagrangian of the model. Such a parameter was constrained by using the shadow radius of Sagittarius A*, recently revealed by the Event Horizon Telescope Collaboration. Remarkably, the wormhole presented here is viable when its shadow is compared to the Sagittarius A* shadow.


title: A variant of Wilson's functional equation on semigroups

abstract: We determine the complex-valued solutions of the following functional equation \[f(xy)+\mu (y)f(\sigma (y)x) = 2f(x)g(y),\quad x,y\in S,\] where $S$ is a semigroup and $\sigma$ an automorphism, $\mu :S\rightarrow \mathbb{C}$ is a multiplicative function such that $\mu (x\sigma (x))=1$ for all $x\in S$.


title: Automatic Detection of Fake Key Attacks in Secure Messaging

abstract: Popular instant messaging applications such as WhatsApp and Signal provide end-to-end encryption for billions of users. They rely on a centralized, application-specific server to distribute public keys and relay encrypted messages between the users. Therefore, they prevent passive attacks but are vulnerable to some active attacks. A malicious or hacked server can distribute fake keys to users to perform man-in-the-middle or impersonation attacks. While typical secure messaging applications provide a manual method for users to detect these attacks, this burdens users, and studies show it is ineffective in practice. This paper presents KTACA, a completely automated approach for key verification that is oblivious to users and easy to deploy. We motivate KTACA by designing two approaches to automatic key verification. One approach uses client auditing (KTCA) and the second uses anonymous key monitoring (AKM). Both have relatively inferior security properties, leading to KTACA, which combines these approaches to provide the best of both worlds. We provide a security analysis of each defense, identifying which attacks they can automatically detect. We implement the active attacks to demonstrate they are possible, and we also create a prototype implementation of all the defenses to measure their performance and confirm their feasibility. Finally, we discuss the strengths and weaknesses of each defense, the overhead on clients and service providers, and deployment considerations.


title: Measurement induced quantum walks on an IBM Quantum Computer

abstract: We study a quantum walk of a single particle that is subject to stroboscopic projective measurements on a graph with two sites. This two-level system is the minimal model of a measurement induced quantum walk. The mean first detected transition and return time are computed on an IBM quantum computer as a function of the hopping matrix element between the sites and the on-site potential. The experimentally monitored quantum walk reveals the theoretically predicted behavior, such as the quantization of the first detected return time and the strong increase of the mean first detected transition time near degenerate points, with high accuracy.


title: Coherent spin dynamics of hyperfine-coupled vanadium impurities in silicon carbide

abstract: Progress with quantum technology has for a large part been realized with the nitrogen-vacancy centre in diamond. Part of its properties, however, are nonideal and this drives research into other spin-active crystal defects. Several of these come with much stronger energy scales for spin-orbit and hyperfine coupling, but how this affects their spin coherence is little explored. Vanadium in silicon carbide is such a system, with technological interest for its optical emission at a telecom wavelength and compatibility with semiconductor industry. Here we show coherent spin dynamics of an ensemble of vanadium defects around a clock-transition, studied while isolated from, or coupled to neighbouring nuclear spins. We find spin dephasing times up to 7.2 $\mu$s, and via spin-echo studies coherence lifetimes that go well beyond tens of microseconds. We demonstrate operation points where strong coupling to neighbouring nuclear spins does not compromise the coherence of the central vanadium spin, which identifies how these can be applied as a coherent spin register. Our findings are relevant for understanding a wide class of defects with similar energy scales and crystal symmetries, that are currently explored in diamond, silicon carbide, and hexagonal boron nitride.


title: Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition

abstract: Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model biases arise from biased training data. As a consequence, previous works on bias mitigation largely focused on pre-processing the training data, adding penalties to prevent bias from effecting the model during training, or post-processing predictions to debias them, yet these approaches have shown limited success on hard problems such as face recognition. In our work, we discover that biases are actually inherent to neural network architectures themselves. Following this reframing, we conduct the first neural architecture search for fairness, jointly with a search for hyperparameters. Our search outputs a suite of models which Pareto-dominate all other high-performance architectures and existing bias mitigation methods in terms of accuracy and fairness, often by large margins, on the two most widely used datasets for face identification, CelebA and VGGFace2. Furthermore, these models generalize to other datasets and sensitive attributes. We release our code, models and raw data files at https://github.com/dooleys/FR-NAS.


title: Massive particle interferometry with lattice solitons

abstract: We discuss an interferometric scheme employing interference of bright solitons formed as specific bound states of attracting bosons on a lattice. We revisit the proposal of Castin and Weiss [Phys. Rev. Lett. vol. 102, 010403 (2009)] for using the scattering of a quantum matter-wave soliton on a barrier in order to create a coherent superposition state of the soliton being entirely to the left of the barrier and being entirely to the right of the barrier. In that proposal, it was assumed that the scattering is perfectly elastic, i.e.\ that the center-of-mass kinetic energy of the soliton is lower than the chemical potential of the soliton. Here we relax this assumption: By employing a combination of Bethe ansatz and DMRG based analysis of the dynamics of the appropriate many-body system, we find that the interferometric fringes persist even when the center-of-mass kinetic energy of the soliton is above the energy needed for its complete dissociation into constituent atoms.


title: Tidal Stripping of a White Dwarf by an Intermediate-Mass Black Hole

abstract: During the inspiralling of a white dwarf (WD) into an intermediate-mass black hole (~ 10^{2-5} M_sun), both gravitational waves (GWs) and electromagnetic (EM) radiation are emitted. Once the eccentric orbit's pericenter radius approaches the tidal radius, the WD would be tidally stripped upon each pericenter passage. The accretion of these stripped mass would produce EM radiation. It is suspected that the recently discovered new types of transients, namely the quasi-periodic eruptions and the fast ultraluminous X-ray bursts, might originate from such systems. Modeling these flares requires a prediction of the amount of stripped mass from the WD and the details of the mass supply to the accretion disk. We run hydrodynamical simulations to study the orbital parameter dependence of the stripped mass. We find that our results match the analytical estimate that the stripped mass is proportional to z^{5/2}, where z is the excess depth by which the WD overfills its instantaneous Roche lobe at the pericenter. The corresponding fallback rate of the stripped mass is calculated, which may be useful in interpreting the individual flaring light curve in candidate EM sources. We further calculate the long-term mass-loss evolution of a WD during its inspiral and the detectability of the GW and EM signals. The EM signal from the mass-loss stage can be easily detected: the limiting distance is ~ 320(M_h/10^4 M_sun)^{1/2} Mpc for Einstein Probe. The GW signal, for the space-borne detectors such as Laser Interferometer Space Antenna or TianQin, can be detected only within the Local Supercluster (~ 33 Mpc).


title: MMGA: Multimodal Learning with Graph Alignment

abstract: Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very general and important form of data, cannot be easily interacted with other modalities because of its non-regular nature. In this paper, we propose MMGA (Multimodal learning with Graph Alignment), a novel multimodal pre-training framework to incorporate information from graph (social network), image and text modalities on social media to enhance user representation learning. In MMGA, a multi-step graph alignment mechanism is proposed to add the self-supervision from graph modality to optimize the image and text encoders, while using the information from the image and text modalities to guide the graph encoder learning. We conduct experiments on the dataset crawled from Instagram. The experimental results show that MMGA works well on the dataset and improves the fans prediction task's performance. We release our dataset, the first social media multimodal dataset with graph, of 60,000 users labeled with specific topics based on 2 million posts to facilitate future research.


title: Finding the Needle in a Haystack: On the Automatic Identification of Accessibility User Reviews

abstract: In recent years, mobile accessibility has become an important trend with the goal of allowing all users the possibility of using any app without many limitations. User reviews include insights that are useful for app evolution. However, with the increase in the amount of received reviews, manually analyzing them is tedious and time-consuming, especially when searching for accessibility reviews. The goal of this paper is to support the automated identification of accessibility in user reviews, to help technology professionals in prioritizing their handling, and thus, creating more inclusive apps. Particularly, we design a model that takes as input accessibility user reviews, learns their keyword-based features, in order to make a binary decision, for a given review, on whether it is about accessibility or not. The model is evaluated using a total of 5,326 mobile app reviews. The findings show that (1) our model can accurately identify accessibility reviews, outperforming two baselines, namely keyword-based detector and a random classifier; (2) our model achieves an accuracy of 85% with relatively small training dataset; however, the accuracy improves as we increase the size of the training dataset.


title: Number-Adaptive Prototype Learning for 3D Point Cloud Semantic Segmentation

abstract: 3D point cloud semantic segmentation is one of the fundamental tasks for 3D scene understanding and has been widely used in the metaverse applications. Many recent 3D semantic segmentation methods learn a single prototype (classifier weights) for each semantic class, and classify 3D points according to their nearest prototype. However, learning only one prototype for each class limits the model's ability to describe the high variance patterns within a class. Instead of learning a single prototype for each class, in this paper, we propose to use an adaptive number of prototypes to dynamically describe the different point patterns within a semantic class. With the powerful capability of vision transformer, we design a Number-Adaptive Prototype Learning (NAPL) model for point cloud semantic segmentation. To train our NAPL model, we propose a simple yet effective prototype dropout training strategy, which enables our model to adaptively produce prototypes for each class. The experimental results on SemanticKITTI dataset demonstrate that our method achieves 2.3% mIoU improvement over the baseline model based on the point-wise classification paradigm.


title: SQ Lower Bounds for Learning Single Neurons with Massart Noise

abstract: We study the problem of PAC learning a single neuron in the presence of Massart noise. Specifically, for a known activation function $f: \mathbb{R} \to \mathbb{R}$, the learner is given access to labeled examples $(\mathbf{x}, y) \in \mathbb{R}^d \times \mathbb{R}$, where the marginal distribution of $\mathbf{x}$ is arbitrary and the corresponding label $y$ is a Massart corruption of $f(\langle \mathbf{w}, \mathbf{x} \rangle)$. The goal of the learner is to output a hypothesis $h: \mathbb{R}^d \to \mathbb{R}$ with small squared loss. For a range of activation functions, including ReLUs, we establish super-polynomial Statistical Query (SQ) lower bounds for this learning problem. In more detail, we prove that no efficient SQ algorithm can approximate the optimal error within any constant factor. Our main technical contribution is a novel SQ-hard construction for learning $\{ \pm 1\}$-weight Massart halfspaces on the Boolean hypercube that is interesting on its own right.


title: Deconstructing the Calculus of Relations with Tape Diagrams

abstract: Rig categories with finite biproducts are categories with two monoidal products, where one is a biproduct and the other distributes over it. In this work we present tape diagrams, a sound and complete diagrammatic language for these categories, that can be intuitively thought as string diagrams of string diagrams. We test the effectiveness of our approach against the positive fragment of Tarski's calculus of relations.


title: HMM vs. CTC for Automatic Speech Recognition: Comparison Based on Full-Sum Training from Scratch

abstract: In this work, we compare from-scratch sequence-level cross-entropy (full-sum) training of Hidden Markov Model (HMM) and Connectionist Temporal Classification (CTC) topologies for automatic speech recognition (ASR). Besides accuracy, we further analyze their capability for generating high-quality time alignment between the speech signal and the transcription, which can be crucial for many subsequent applications. Moreover, we propose several methods to improve convergence of from-scratch full-sum training by addressing the alignment modeling issue. Systematic comparison is conducted on both Switchboard and LibriSpeech corpora across CTC, posterior HMM with and w/o transition probabilities, and standard hybrid HMM. We also provide a detailed analysis of both Viterbi forced-alignment and Baum-Welch full-sum occupation probabilities.


title: Upper limits on the Polarized Isotropic Stochastic Gravitational-Wave Background from Advanced LIGO-Virgo's First Three Observing Runs

abstract: Parity violation is expected to generate an asymmetry between the amplitude of left and right-handed gravitational-wave modes which leads to a circularly polarized stochastic gravitational-wave background (SGWB). Due to the three independent baselines in the LIGO-Virgo network, we focus on the amplitude difference in strain power characterized by Stokes' parameters and do maximum-likelihood estimation to constrain the polarization degree of SGWB. Our results indicate that there is no evidence for the circularly polarized SGWB in the data. Furthermore, by modeling the SGWB as a power-law spectrum, we place upper limit on the normalized energy density $\Omega_\text{gw}(25\,\text{Hz})<5.3\times10^{-9}$ at $95\%$ confidence level after marginalizing over the polarization degree and spectral index.


title: Randomized Cholesky QR factorizations

abstract: This article proposes and analyzes several variants of the randomized Cholesky QR factorization of a matrix $X$. Instead of computing the R factor from $X^T X$, as is done by standard methods, we obtain it from a small, efficiently computable random sketch of $X$, thus saving computational cost and improving numerical stability. The proposed direct variant of the randomized Cholesky QR requires only half the flops and the same communication cost as the classical Cholesky QR. At the same time, it is more robust since it is guaranteed to be stable whenever the input matrix is numerically full-rank. The rank-revealing randomized Cholesky QR variant has the ability to sort out the linearly dependent columns of $X$, which allows to have an unconditional numerical stability and reduce the computational cost when $X$ is rank-deficient. We also depict a column-oriented randomized Cholesky QR that establishes the connection with the randomized Gram-Schmidt process, and a reduced variant that outputs a low-dimensional projection of the Q factor rather than the full factor and therefore yields drastic computational savings. It is shown that performing minor operations in higher precision in the proposed algorithms can allow stability with working unit roundoff independent of the dominant matrix dimension. This feature may be of particular interest for a QR factorization of tall-and-skinny matrices on low-precision architectures.


title: Decomposition and conformal mapping techniques for the quadrature of nearly singular integrals

abstract: Gauss-Legendre quadrature and the trapezoidal rule are powerful tools for numerical integration of analytic functions. For nearly singular problems, however, these standard methods become unacceptably slow. We discuss and generalize some existing methods for improving on these schemes when the location of the nearby singularity is known. We conclude with an application to some nearly singular surface integrals of viscous flow.


title: A note on Kakeya sets of horizontal and $SL(2)$ lines

abstract: We consider unions of $SL(2)$ lines in $\mathbb{R}^{3}$. These are lines of the form $$L = (a,b,0) + \mathrm{span}(c,d,1),$$ where $ad - bc = 1$. We show that if $\mathcal{L}$ is a Kakeya set of $SL(2)$ lines, then the union $\cup \mathcal{L}$ has Hausdorff dimension $3$. This answers a question of Wang and Zahl. The $SL(2)$ lines can be identified with horizontal lines in the first Heisenberg group, and we obtain the main result as a corollary of a more general statement concerning unions of horizontal lines. This statement is established via a point-line duality principle between horizontal and conical lines in $\mathbb{R}^{3}$, combined with recent work on restricted families of projections to planes, due to Gan, Guo, Guth, Harris, Maldague, and Wang. Our result also has a corollary for Nikodym sets associated with horizontal lines, which answers a special case of a question of Kim.


title: Double Attention-based Lightweight Network for Plant Pest Recognition

abstract: Timely recognition of plant pests from field images is significant to avoid potential losses of crop yields. Traditional convolutional neural network-based deep learning models demand high computational capability and require large labelled samples for each pest type for training. On the other hand, the existing lightweight network-based approaches suffer in correctly classifying the pests because of common characteristics and high similarity between multiple plant pests. In this work, a novel double attention-based lightweight deep learning architecture is proposed to automatically recognize different plant pests. The lightweight network facilitates faster and small data training while the double attention module increases performance by focusing on the most pertinent information. The proposed approach achieves 96.61%, 99.08% and 91.60% on three variants of two publicly available datasets with 5869, 545 and 500 samples, respectively. Moreover, the comparison results reveal that the proposed approach outperforms existing approaches on both small and large datasets consistently.