title: Stochastic Geometric Mechanics for Fluid Dynamics

abstract: Stochastic geometric mechanics (SGM) is known for its potential utility in quantifying uncertainty in global climate modelling of the Earth's ocean and atmosphere while also preserving the fundamental advective transport properties of ideal fluid flow. The present chapter describes the mathematical development of the framework of stochastic geometric mechanics in the context of fluid flow and wave dynamics obtained from Lie group-invariant variational principles.

categories: physics.flu-dyn math-ph math.MP physics.ao-ph


title: Enhanced dissipation and blow-up suppression for the three dimensional Keller-Segel equation with a non-shear incompressible flow

abstract: In this paper, we consider the Cauchy problem for the three dimensional parabolic-elliptic Keller-Segel equation with a large non-shear incompressible flow. Without advection, there exist solution with arbitrarily mass which blow up in finite time. Firstly, we introduce a three dimensional non-shear incompressible flow and study the enhanced dissipation of such flows by resolvent estimate method. Next, we show that the enhanced dissipation of such flow can suppress blow-up of solution to three dimensional parabolic-elliptic Keller-Segel equation and establish global classical solution with large initial data.


title: Conservativity of Type Theory over Higher-order Arithmetic

abstract: We investigate how much type theory is able to prove about the natural numbers. A classical result in this area shows that dependent type theory without any universes is conservative over Heyting Arithmetic (HA). We build on this result by showing that type theories with one level of universes are conservative over Higher-order Heyting Arithmetic (HAH). Although this clearly depends on the specific type theory, we show that the interpretation of logic also plays a major role. For proof-irrelevant interpretations, we will see that strong versions of type theory prove exactly the same higher-order arithmetical formulas as HAH. Conversely, proof-relevant interpretations prove strictly more second-order arithmetical formulas than HAH, however they still prove exactly the same first-order arithmetical formulas. Along the way, we investigate the different interpretations of logic in type theory, and to what extent dependent type theories can be seen as extensions of higher-order logic. We apply our results by proving De Jongh's theorem for type theory.


title: Energy Space Newton Differentiability for Solution Maps of Unilateral and Bilateral Obstacle Problems

abstract: We prove that the solution operator of the classical unilateral obstacle problem on a nonempty open bounded set $\Omega \subset \mathbb{R}^d$, $d \in \mathbb{N}$, is Newton differentiable as a function from $L^p(\Omega)$ to $H_0^1(\Omega)$ whenever $\max(1, 2d/(d+2)) < p \leq \infty$. By exploiting this Newton differentiability property, results on angled subspaces in $H^{-1}(\Omega)$, and a formula for orthogonal projections onto direct sums, we further show that the solution map of the classical bilateral obstacle problem is Newton differentiable as a function from $L^p(\Omega)$ to $H_0^1(\Omega)\cap L^q(\Omega)$ whenever $\max(1, d/2) < p \leq \infty$ and $1 \leq q <\infty$. For both the unilateral and the bilateral case, we provide explicit formulas for the Newton derivative. As a concrete application example for our results, we consider the numerical solution of an optimal control problem with $H_0^1(\Omega)$-controls and box-constraints by means of a semismooth Newton method.


title: A flexible and efficient approach for missing transverse momentum reconstruction

abstract: Missing transverse momentum is a crucial observable for physics at hadron colliders, being the only constraint on the kinematics of "invisible" objects such as neutrinos and hypothetical dark matter particles. Computing missing transverse momentum at the highest possible precision, particularly in experiments at the energy frontier, can be a challenging procedure due to ambiguities in the distribution of energy and momentum between many reconstructed particle candidates. This paper describes a novel solution for efficiently encoding information required for the computation of missing transverse momentum given arbitrary selection criteria for the constituent reconstructed objects. Pileup suppression using information from both the calorimeter and the inner detector is an integral component of the reconstruction procedure. Energy calibration and systematic variations are naturally supported. Following this strategy, the ATLAS Collaboration has been able to optimise the use of missing transverse momentum in diverse analyses throughout Runs 2 and 3 of the Large Hadron Collider and for future analyses.


title: Towards quantitative precision for ECG analysis: Leveraging state space models, self-supervision and patient metadata

abstract: Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance performance beyond the existing state-of-the-art, which is predominantly based on convolutional models. Firstly, we explore more expressive architectures by exploiting structured state space models (SSMs). These models have shown promise in capturing long-term dependencies in time series data. By incorporating SSMs into our approach, we not only achieve better performance, but also gain insights into long-standing questions in the field. Specifically, for standard diagnostic tasks, we find no advantage in using higher sampling rates such as 500Hz compared to 100Hz. Similarly, extending the input size of the model beyond 3 seconds does not lead to significant improvements. Secondly, we demonstrate that self-supervised learning using contrastive predictive coding can further improve the performance of SSMs. By leveraging self-supervision, we enable the model to learn more robust and representative features, leading to improved analysis accuracy. Lastly, we depart from synthetic benchmarking scenarios and incorporate basic demographic metadata alongside the ECG signal as input. This inclusion of patient metadata departs from the conventional practice of relying solely on the signal itself. Remarkably, this addition consistently yields positive effects on predictive performance. We firmly believe that all three components should be considered when developing next-generation ECG analysis algorithms.


title: Departure from the statistical equilibrium of large scales in three-dimensional hydrodynamic turbulence

abstract: We study the statistically steady states of the forced dissipative three-dimensional homogeneous isotropic turbulence at scales larger than the forcing scale in real separation space. The probability density functions (PDFs) of longitudinal velocity difference at large separations are close to but deviate from Gaussian, measured by their non-zero odd parts. Under the assumption that forcing controls the large-scale dynamics, we propose a conjugate regime to Kolmogorov's inertial range, independent of the forcing scale, to capture the odd parts of PDFs. The analytical expressions of the third-order longitudinal structure functions derived from the K\'arm\'an-Howarth-Monin equation prove that the odd-part PDFs of velocity differences at large separations are small but non-zero, and show that the odd-order longitudinal structure functions have a universal power-law decay with exponent $-2$ as the separation tends to infinity regardless of the particular forcing form, implying a significant coupling between large and small scales. Thus, dynamics of large scales depart from the absolute equilibrium, and we can partially recover small-scale information without explicitly resolving small-scale dynamics. The departure from the statistical equilibrium is quantified and found to be viscosity independent. Even though this departure is small, it is significant and should be considered when studying the large scales of the forced three-dimensional homogeneous isotropic turbulence.


title: A Hybrid Membership Latent Distance Model for Unsigned and Signed Integer Weighted Networks

abstract: Graph representation learning (GRL) has become a prominent tool for furthering the understanding of complex networks providing tools for network embedding, link prediction, and node classification. In this paper, we propose the Hybrid Membership-Latent Distance Model (HM-LDM) by exploring how a Latent Distance Model (LDM) can be constrained to a latent simplex. By controlling the edge lengths of the corners of the simplex, the volume of the latent space can be systematically controlled. Thereby communities are revealed as the space becomes more constrained, with hard memberships being recovered as the simplex volume goes to zero. We further explore a recent likelihood formulation for signed networks utilizing the Skellam distribution to account for signed weighted networks and extend the HM-LDM to the signed Hybrid Membership-Latent Distance Model (sHM-LDM). Importantly, the induced likelihood function explicitly attracts nodes with positive links and deters nodes from having negative interactions. We demonstrate the utility of HM-LDM and sHM-LDM on several real networks. We find that the procedures successfully identify prominent distinct structures, as well as how nodes relate to the extracted aspects providing favorable performances in terms of link prediction when compared to prominent baselines. Furthermore, the learned soft memberships enable easily interpretable network visualizations highlighting distinct patterns.


title: Electronuclear Quantum Criticality

abstract: We present here a rare example of electronuclear quantum criticality in a metal. The compound YbCu4.6Au0.4 is located at an unconventional quantum critical point (QCP). In this material the relevant Kondo and RKKY exchange interactions are very weak, of the order of 1 K. Furthermore, there is strong competition between antiferromagnetic and ferromagnetic correlations, possibly due to geometrical frustration within the fcc Yb sublattice. This causes strong spin fluctuations which prevent the system to order magnetically. Because of the very low Kondo temperature the Yb3+ 4f-electrons couple weakly with the conduction electrons allowing the coupling to the nuclear moments of the 171Yb and 173Yb isotopes to become important. Thus, the quantum critical fluctuations observed at the QCP do not originate from purely electronic states but from entangled electronuclear states. This is evidenced by the anomalous temperature and field dependence of the specific heat at low temperatures.


title: Benefits of Deterministic and Stochastic Tendency Adjustments in a Climate Model

abstract: We develop and compare model-error representation schemes derived from data assimilation increments and nudging tendencies in multi-decadal simulations of the community atmosphere model, version 6. Each scheme applies a bias correction during simulation run-time to the zonal and meridional winds. We quantify to which extent such online adjustment schemes improve the model climatology and variability on daily to seasonal timescales. Generally, we observe a ca. 30% improvement to annual upper-level zonal winds, with largest improvements in boreal spring (ca. 35%) and winter (ca. 47%). Despite only adjusting the wind fields, we additionally observe a ca. 20% improvement to annual precipitation over land, with the largest improvements in boreal fall (ca. 36%) and winter (ca. 25%), and a ca. 50% improvement to annual sea level pressure, globally. With mean state adjustments alone, the dominant pattern of boreal low-frequency variability over the Atlantic (the North Atlantic Oscillation) is significantly improved. Additional stochasticity further increases the modal explained variances, which brings it closer to the observed value. A streamfunction tendency decomposition reveals that the improvement is due to an adjustment to the high- and low-frequency eddy-eddy interaction terms. In the Pacific, the mean state adjustment alone led to an erroneous deepening of the Aleutian low, but this was remedied with the addition of stochastically selected tendencies. Finally, from a practical standpoint, we discuss the performance of using data assimilation increments versus nudging tendencies for an online model-error representation.


title: Linearized partial data Calder\'on problem for Biharmonic operators

abstract: We consider a linearized partial data Calder\'on problem for biharmonic operators extending the analogous result for harmonic operators. We construct special solutions and utilize Segal-Bargmann transform to recover lower order perturbations.


title: The geometry and arithmetic of bielliptic Picard curves

abstract: We study the geometry and arithmetic of the curves $C \colon y^3 = x^4 + ax^2 + b$ and their associated Prym abelian surfaces $P$. We prove a Torelli theorem in this context and give a geometric proof of the fact that $P$ has quaternionic multiplication (QM) by the quaternion order of discriminant $6$. This allows us to describe the Galois action on the geometric endomorphism algebra of $P$. As an application, we classify the torsion subgroups of the Mordell-Weil groups $P(\mathbb{Q})$, as both abelian groups and $\text{End}(P)$-modules.


title: KGConv, a Conversational Corpus grounded in Wikidata

abstract: We present KGConv, a large, conversational corpus of 71k conversations where each question-answer pair is grounded in a Wikidata fact. Conversations contain on average 8.6 questions and for each Wikidata fact, we provide multiple variants (12 on average) of the corresponding question using templates, human annotations, hand-crafted rules and a question rewriting neural model. We provide baselines for the task of Knowledge-Based, Conversational Question Generation. KGConv can further be used for other generation and analysis tasks such as single-turn question generation from Wikidata triples, question rewriting, question answering from conversation or from knowledge graphs and quiz generation.


title: TaskLAMA: Probing the Complex Task Understanding of Language Models

abstract: Structured Complex Task Decomposition (SCTD) is the problem of breaking down a complex real-world task (such as planning a wedding) into a directed acyclic graph over individual steps that contribute to achieving the task, with edges specifying temporal dependencies between them. SCTD is an important component of assistive planning tools, and a challenge for commonsense reasoning systems. We probe how accurately SCTD can be done with the knowledge extracted from Large Language Models (LLMs). We introduce a high-quality human-annotated dataset for this problem and novel metrics to fairly assess performance of LLMs against several baselines. Our experiments reveal that LLMs are able to decompose complex tasks into individual steps effectively, with a relative improvement of 15% to 280% over the best baseline. We also propose a number of approaches to further improve their performance, with a relative improvement of 7% to 37% over the base model. However, we find that LLMs still struggle to predict pairwise temporal dependencies, which reveals a gap in their understanding of complex tasks.


title: MSFlow: Multi-Scale Flow-based Framework for Unsupervised Anomaly Detection

abstract: Unsupervised anomaly detection (UAD) attracts a lot of research interest and drives widespread applications, where only anomaly-free samples are available for training. Some UAD applications intend to further locate the anomalous regions without any anomaly information. Although the absence of anomalous samples and annotations deteriorates the UAD performance, an inconspicuous yet powerful statistics model, the normalizing flows, is appropriate for anomaly detection and localization in an unsupervised fashion. The flow-based probabilistic models, only trained on anomaly-free data, can efficiently distinguish unpredictable anomalies by assigning them much lower likelihoods than normal data. Nevertheless, the size variation of unpredictable anomalies introduces another inconvenience to the flow-based methods for high-precision anomaly detection and localization. To generalize the anomaly size variation, we propose a novel Multi-Scale Flow-based framework dubbed MSFlow composed of asymmetrical parallel flows followed by a fusion flow to exchange multi-scale perceptions. Moreover, different multi-scale aggregation strategies are adopted for image-wise anomaly detection and pixel-wise anomaly localization according to the discrepancy between them. The proposed MSFlow is evaluated on three anomaly detection datasets, significantly outperforming existing methods. Notably, on the challenging MVTec AD benchmark, our MSFlow achieves a new state-of-the-art with a detection AUORC score of up to 99.7%, localization AUCROC score of 98.8%, and PRO score of 97.1%. The reproducible code is available at https://github.com/cool-xuan/msflow.


title: Convexity constraints on linear background models for electron energy-loss spectra

abstract: In this paper convexity constraints are derived for a background model of electron energy loss spectra (EELS) that is linear in the fitting parameters. The model outperforms a power-law both on experimental and simulated backgrounds, especially for wide energy ranges, and thus improves elemental quantification results. Owing to the model's linearity, the constraints can be imposed through fitting by quadratic programming. This has important advantages over conventional nonlinear power-law fitting such as high speed and a guaranteed unique solution without need for initial parameters. As such, the need for user input is significantly reduced, which is essential for unsupervised treatment of large data sets. This is demonstrated on a demanding spectrum image of a semiconductor device sample with a high number of elements over a wide energy range.

categories: physics.data-an cond-mat.mtrl-sci physics.comp-ph physics.ins-det


title: Transcendence of certain sequences of algebraic numbers

abstract: Using Schmidt's Subspace Theorem, this paper improves and extends an existing transcendence result for sequences of algebraic numbers. The theorems thus produced correspond to a central theorem on the irrationality of sequences due to Erd\H{o}s.


title: Asymptotics of Reciprocal Supernorm Partition Statistics

abstract: We consider two multiplicative statistics on the set of integer partitions: the norm of a partition, which is the product of its parts, and the supernorm of a partition, which is the product of the prime numbers $p_i$ indexed by its parts $i$. We introduce and study new statistics that are sums of reciprocals of supernorms on three statistical ensembles of partitions, labelled by their size $|\lambda|=n$, their perimeter equaling $n$, and their largest part equaling $n$. We show that the cumulative statistics of the reciprocal supernorm for each of the three ensembles are asymptotic to $e^{\gamma} \log n$ as $n \to \infty$.


title: Gravitational Self Force from Scattering Amplitudes in Curved Space

abstract: We employ scattering amplitudes in curved space to model the dynamics of a light probe particle with mass $m$ orbiting in the background spacetime induced by a heavy gravitational source with mass $M$. Observables are organized as an expansion in $m/M$ to all orders in $G$ -- the gravitational self-force expansion. An essential component of our analysis is the backreaction of the heavy source which we capture by including the associated light degrees of freedom. As illustration we consider a Schwarzschild background and verify geodesic motion as well as the first-order self-force correction to two-body scattering through ${\cal O}(G^3)$. Amplitudes in curved space offer several advantages, and further developments along these lines may advance the computation of gravitational-wave signals for extreme-mass-ratio inspirals.


title: Calligraphs and sphere realizations

abstract: We introduce a recursive procedure for computing the number of realizations of a minimally rigid graph on the sphere up to rotations. We accomplish this by combining two ingredients. The first is a framework that allows us to think of such realizations as of elements of a moduli space of stable rational curves with marked points. The second is the idea of splitting a minimally rigid graph into two subgraphs, called calligraphs, that admit one degree of freedom and that share only a single edge and a further vertex. This idea has been recently employed for realizations of graphs in the plane up to isometries. The key result is that we can associate to a calligraph a triple of natural numbers with a special property: whenever a minimally rigid graph is split into two calligraphs, the number of realizations of the former equals the product of the two triples of the latter, where this product is specified by a fixed quadratic form. These triples and quadratic form codify the fact that we express realizations as intersections of two curves on the blowup of a sphere along two pairs of complex conjugate points.


title: Approximate Monotone Local Search for Weighted Problems

abstract: In a recent work, Esmer et al. describe a simple method - Approximate Monotone Local Search - to obtain exponential approximation algorithms from existing parameterized exact algorithms, polynomial-time approximation algorithms and, more generally, parameterized approximation algorithms. In this work, we generalize those results to the weighted setting. More formally, we consider monotone subset minimization problems over a weighted universe of size $n$ (e.g., Vertex Cover, $d$-Hitting Set and Feedback Vertex Set). We consider a model where the algorithm is only given access to a subroutine that finds a solution of weight at most $\alpha \cdot W$ (and of arbitrary cardinality) in time $c^k \cdot n^{O(1)}$ where $W$ is the minimum weight of a solution of cardinality at most $k$. In the unweighted setting, Esmer et al. determine the smallest value $d$ for which a $\beta$-approximation algorithm running in time $d^n \cdot n^{O(1)}$ can be obtained in this model. We show that the same dependencies also hold in a weighted setting in this model: for every fixed $\varepsilon>0$ we obtain a $\beta$-approximation algorithm running in time $O\left((d+\varepsilon)^{n}\right)$, for the same $d$ as in the unweighted setting. Similarly, we also extend a $\beta$-approximate brute-force search (in a model which only provides access to a membership oracle) to the weighted setting. Using existing approximation algorithms and exact parameterized algorithms for weighted problems, we obtain the first exponential-time $\beta$-approximation algorithms that are better than brute force for a variety of problems including Weighted Vertex Cover, Weighted $d$-Hitting Set, Weighted Feedback Vertex Set and Weighted Multicut.


title: Compositional maps for registration in complex geometries

abstract: We develop and analyze a parametric registration procedure for manifolds associated with the solutions to parametric partial differential equations in two-dimensional domains. Given the domain $\Omega \subset \mathbb{R}^2$ and the manifold $M=\{ u_{\mu} : \mu\in P\}$ associated with the parameter domain $P \subset \mathbb{R}^P$ and the parametric field $\mu\mapsto u_{\mu} \in L^2(\Omega)$, our approach takes as input a set of snapshots from $M$ and returns a parameter-dependent mapping $\Phi: \Omega \times P \to \Omega$, which tracks coherent features (e.g., shocks, shear layers) of the solution field and ultimately simplifies the task of model reduction. We consider mappings of the form $\Phi=\texttt{N}(\mathbf{a})$ where $\texttt{N}:\mathbb{R}^M \to {\rm Lip}(\Omega; \mathbb{R}^2)$ is a suitable linear or nonlinear operator; then, we state the registration problem as an unconstrained optimization statement for the coefficients $\mathbf{a}$. We identify minimal requirements for the operator $\texttt{N}$ to ensure the satisfaction of the bijectivity constraint; we propose a class of compositional maps that satisfy the desired requirements and enable non-trivial deformations over curved (non-straight) boundaries of $\Omega$; we develop a thorough analysis of the proposed ansatz for polytopal domains and we discuss the approximation properties for general curved domains. We perform numerical experiments for a parametric inviscid transonic compressible flow past a cascade of turbine blades to illustrate the many features of the method.


title: On-Device Learning with Binary Neural Networks

abstract: Existing Continual Learning (CL) solutions only partially address the constraints on power, memory and computation of the deep learning models when deployed on low-power embedded CPUs. In this paper, we propose a CL solution that embraces the recent advancements in CL field and the efficiency of the Binary Neural Networks (BNN), that use 1-bit for weights and activations to efficiently execute deep learning models. We propose a hybrid quantization of CWR* (an effective CL approach) that considers differently forward and backward pass in order to retain more precision during gradient update step and at the same time minimizing the latency overhead. The choice of a binary network as backbone is essential to meet the constraints of low power devices and, to the best of authors' knowledge, this is the first attempt to prove on-device learning with BNN. The experimental validation carried out confirms the validity and the suitability of the proposed method.


title: Understanding the Privacy Risks of Popular Search Engine Advertising Systems

abstract: We present the first extensive measurement of the privacy properties of the advertising systems used by privacy-focused search engines. We propose an automated methodology to study the impact of clicking on search ads on three popular private search engines which have advertising-based business models: StartPage, Qwant, and DuckDuckGo, and we compare them to two dominant data-harvesting ones: Google and Bing. We investigate the possibility of third parties tracking users when clicking on ads by analyzing first-party storage, redirection domain paths, and requests sent before, when, and after the clicks. Our results show that privacy-focused search engines fail to protect users' privacy when clicking ads. Users' requests are sent through redirectors on 4% of ad clicks on Bing, 86% of ad clicks on Qwant, and 100% of ad clicks on Google, DuckDuckGo, and StartPage. Even worse, advertising systems collude with advertisers across all search engines by passing unique IDs to advertisers in most ad clicks. These IDs allow redirectors to aggregate users' activity on ads' destination websites in addition to the activity they record when users are redirected through them. Overall, we observe that both privacy-focused and traditional search engines engage in privacy-harming behaviors allowing cross-site tracking, even in privacy-enhanced browsers.


title: Sequential phase-locked optical gating of free electrons

abstract: Recent progress in coherent quantum interactions between free-electron pulses and laser-induced near-field light have revolutionized electron wavepacket shaping. Building on these advancements, we numerically explore the potential of sequential interactions between slow electrons and localized dipolar plasmons in a sequential phase-locked interaction scheme. Taking advantage of the prolonged interaction time between slow electrons and optical near-fields, we aim to explore the effect of plasmon dynamics on the free-electron wavepacket modulation. Our results demonstrate that the initial optical phase of the localized dipolar plasmon at the starting point of the interaction, along with the phase offset between the interaction zones, can serve as control parameters in manipulating the transverse and longitudinal recoil of the electron wavefunction. Moreover, it is shown that the polarization state of light is an additional control knop for tailoring the longitudinal and transverse recoils. We show that a sequential phase-locking method can be employed to precisely manipulate the longitudinal and transverse recoil of the electron wavepacket, leading to selective acceleration or deceleration of the electron energy along specific diffraction angles. These findings have important implications for the development of novel techniques for ultrafast electron-light interferometry, shaping the electron wave packet, and quantum information processing.


title: Turing instabilities are not enough to ensure pattern formation

abstract: Symmetry-breaking instabilities play an important role in understanding the mechanisms underlying the diversity of patterns observed in nature, such as in Turing's reaction--diffusion theory, which connects cellular signalling and transport with the development of growth and form. Extensive literature focuses on the linear stability analysis of homogeneous equilibria in these systems, culminating in a set of conditions for transport-driven instabilities that are commonly presumed to initiate self-organisation. We demonstrate that a selection of simple, canonical transport models with only mild multistable non-linearities can satisfy the Turing instability conditions while also robustly exhibiting only transient patterns. Hence, a Turing-like instability is insufficient for the existence of a patterned state. \ak{While it is known that linear theory can fail to predict the formation of patterns, we demonstrate that such failures can appear robustly in systems with multiple stable homogeneous equilibria.} Given that biological systems \ak{such as} gene regulatory networks and spatially distributed ecosystems often exhibit a high degree of multistability and nonlinearity, this raises important questions of how to analyse prospective mechanisms for self-organisation.


title: Longest-chain Attacks: Difficulty Adjustment and Timestamp Verifiability

abstract: We study an adversary who attacks a Proof-of-Work (POW) blockchain by selfishly constructing an alternative longest chain. We characterize optimal strategies employed by the adversary when a difficulty adjustment rule al\`a Bitcoin applies. As time (namely the times-tamp specified in each block) in most permissionless POW blockchains is somewhat subjective, we focus on two extreme scenarios: when time is completely verifiable, and when it is completely unverifiable. We conclude that an adversary who faces a difficulty adjustment rule will find a longest-chain attack very challenging when timestamps are verifiable. POW blockchains with frequent difficulty adjustments relative to time reporting flexibility will be substantially more vulnerable to longest-chain attacks. Our main fining provides guidance on the design of difficulty adjustment rules and demonstrates the importance of timestamp verifiability.


title: Spatio-temporal MLP-graph network for 3D human pose estimation

abstract: Graph convolutional networks and their variants have shown significant promise in 3D human pose estimation. Despite their success, most of these methods only consider spatial correlations between body joints and do not take into account temporal correlations, thereby limiting their ability to capture relationships in the presence of occlusions and inherent ambiguity. To address this potential weakness, we propose a spatio-temporal network architecture composed of a joint-mixing multi-layer perceptron block that facilitates communication among different joints and a graph weighted Jacobi network block that enables communication among various feature channels. The major novelty of our approach lies in a new weighted Jacobi feature propagation rule obtained through graph filtering with implicit fairing. We leverage temporal information from the 2D pose sequences, and integrate weight modulation into the model to enable untangling of the feature transformations of distinct nodes. We also employ adjacency modulation with the aim of learning meaningful correlations beyond defined linkages between body joints by altering the graph topology through a learnable modulation matrix. Extensive experiments on two benchmark datasets demonstrate the effectiveness of our model, outperforming recent state-of-the-art methods for 3D human pose estimation.


title: Linearly convergent nonoverlapping domain decomposition methods for quasilinear parabolic equations

abstract: We prove linear convergence for a new family of modified Dirichlet--Neumann methods applied to quasilinear parabolic equations, as well as the convergence of the Robin--Robin method. Such nonoverlapping domain decomposition methods are commonly employed for the parallelization of partial differential equation solvers. Convergence has been extensively studied for elliptic equations, but in the case of parabolic equations there are hardly any convergence results that are not relying on strong regularity assumptions. Hence, we construct a new framework for analyzing domain decomposition methods applied to quasilinear parabolic problems, based on fractional time derivatives and time-dependent Steklov--Poincar\'e operators. The convergence analysis is conducted without assuming restrictive regularity assumptions on the solutions or the numerical iterates. We also prove that these continuous convergence results extend to the discrete case obtained when combining domain decompositions with space-time finite elements.


title: Practice of Alibaba Cloud on Elastic Resource Provisioning for Large-scale Microservices Cluster

abstract: Cloud-native architecture is becoming increasingly crucial for today's cloud computing environments due to the need for speed and flexibility in developing applications. It utilizes microservice technology to break down traditional monolithic applications into light-weight and self-contained microservice components. However, as microservices grow in scale and have dynamic inter-dependencies, they also pose new challenges in resource provisioning that cannot be fully addressed by traditional resource scheduling approaches. The various microservices with different resource needs and latency requirements can create complex calling chains, making it difficult to provide fine-grained and accurate resource allocation to each component while maintaining the overall quality of service in the chain. In this work, we aim to address the research problem on how to efficiently provision resources for the growing scale of microservice platform and ensure the performance of latency-critical microservices. To address the problem, we present in-depth analyses of Alibaba's microservice cluster and propose optimized resource provisioning algorithms to enhance resource utilization while ensuring the latency requirement. First, we analyze the distinct features of microservices in Alibaba's cluster compared to traditional applications. Then we present Alibaba's resource capacity provisioning workflow and framework to address challenges in resource provisioning for large-scale and latency-critical microservice clusters. Finally, we propose enhanced resource provisioning algorithms over Alibaba's current practice by making both proactive and reactive scheduling decisions based on different workloads patterns, which can improve resource usage by 10-15% in Alibaba's clusters, while maintaining the necessary latency for microservices.


title: 3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking

abstract: Markerless methods for animal posture tracking have been rapidly developing recently, but frameworks and benchmarks for tracking large animal groups in 3D are still lacking. To overcome this gap in the literature, we present 3D-MuPPET, a framework to estimate and track 3D poses of up to 10 pigeons at interactive speed using multiple camera views. We train a pose estimator to infer 2D keypoints and bounding boxes of multiple pigeons, then triangulate the keypoints to 3D. For identity matching of individuals in all views, we first dynamically match 2D detections to global identities in the first frame, then use a 2D tracker to maintain IDs across views in subsequent frames. We achieve comparable accuracy to a state of the art 3D pose estimator in terms of median error and Percentage of Correct Keypoints. Additionally, we benchmark the inference speed of 3D-MuPPET, with up to 9.45 fps in 2D and 1.89 fps in 3D, and perform quantitative tracking evaluation, which yields encouraging results. Finally, we showcase two novel applications for 3D-MuPPET. First, we train a model with data of single pigeons and achieve comparable results in 2D and 3D posture estimation for up to 5 pigeons. Second, we show that 3D-MuPPET also works in outdoors without additional annotations from natural environments. Both use cases simplify the domain shift to new species and environments, largely reducing annotation effort needed for 3D posture tracking. To the best of our knowledge we are the first to present a framework for 2D/3D animal posture and trajectory tracking that works in both indoor and outdoor environments for up to 10 individuals. We hope that the framework can open up new opportunities in studying animal collective behaviour and encourages further developments in 3D multi-animal posture tracking.


title: When Can You Tile an Integer Rectangle with Integer Squares?

abstract: This paper characterizes when an $m \times n$ rectangle, where $m$ and $n$ are integers, can be tiled (exactly packed) by squares where each has an integer side length of at least 2. In particular, we prove that tiling is always possible when both $m$ and $n$ are sufficiently large (at least 10). When one dimension $m$ is small, the behavior is eventually periodic in $n$ with period 1, 2, or 3. When both dimensions $m,n$ are small, the behavior is determined computationally by an exhaustive search.


title: Data-driven Discovery of Invariant Measures

abstract: Invariant measures encode the long-time behaviour of a dynamical system. In this work, we propose an optimization-based method to discover invariant measures directly from data gathered from a system. Our method does not require an explicit model for the dynamics and allows one to target specific invariant measures, such as physical and ergodic measures. Moreover, it applies to both deterministic and stochastic dynamics in either continuous or discrete time. We provide convergence results and illustrate the performance of our method on data from the logistic map and a stochastic double-well system, for which invariant measures can be found by other means. We then use our method to approximate the physical measure of the chaotic attractor of the R\"ossler system, and we extract unstable periodic orbits embedded in this attractor by identifying discrete-time periodic points of a suitably defined Poincar\'e map. This final example is truly data-driven and shows that our method can significantly outperform previous approaches based on model identification.


title: ZundEig: The Structure of the Proton in Liquid Water From Unsupervised Learning

abstract: The structure of the excess proton in liquid water has been the subject of lively debate from both experimental and theoretical fronts for the last century. Fluctuations of the proton are typically interpreted in terms of limiting states referred to as the Eigen and Zundel species. Here we put these ideas under the microscope taking advantage of recent advances in unsupervised learning that use local atomic descriptors to characterize environments of acidic water combined with advanced clustering techniques. Our agnostic approach leads to the observation of only a single charged cluster and two neutral ones. We demonstrate that the charged cluster involving the excess proton, is best seen as an ionic topological defect in water's hydrogen bond network forming a single local minimum on the global free-energy landscape. This charged defect is a highly fluxional moiety where the idealized Eigen and Zundel species are neither limiting configurations nor distinct thermodynamic states. Instead, the ionic defect enhances the presence of neutral water defects through strong interactions with the network. We dub the combination of the charged and neutral defect clusters as ZundEig demonstrating that the fluctuations between these local environments provide a general framework for rationalizing more descriptive notions of the proton in the existing literature.


title: Universal control of a bosonic mode via drive-activated native cubic interactions

abstract: Linear bosonic modes offer a hardware-efficient alternative for quantum information processing but require access to some nonlinearity for universal control. The lack of nonlinearity in photonics has led to encoded measurement-based quantum computing, which rely on linear operations but requires access to resourceful ('nonlinear') quantum states, such as cubic phase states. In contrast, superconducting microwave circuits offer engineerable nonlinearities but suffer from static Kerr nonlinearity. Here, we demonstrate universal control of a bosonic mode composed of a superconducting nonlinear asymmetric inductive element (SNAIL) resonator, enabled by native nonlinearities in the SNAIL element. We suppress static nonlinearities by operating the SNAIL in the vicinity of its Kerr-free point and dynamically activate nonlinearities up to third order by fast flux pulses. We experimentally realize a universal set of generalized squeezing operations, as well as the cubic phase gate, and exploit them to deterministically prepare a cubic phase state in 60 ns. Our results initiate the experimental field of universal continuous-variables quantum computing.


title: Elucidating the Exposure Bias in Diffusion Models

abstract: Diffusion models have demonstrated impressive generative capabilities, but their \textit{exposure bias} problem, described as the input mismatch between training and sampling, lacks in-depth exploration. In this paper, we systematically investigate the exposure bias problem in diffusion models by first analytically modelling the sampling distribution, based on which we then attribute the prediction error at each sampling step as the root cause of the exposure bias issue. Furthermore, we discuss potential solutions to this issue and propose an intuitive metric for it. Along with the elucidation of exposure bias, we propose a simple, yet effective, training-free method called Epsilon Scaling to alleviate the exposure bias. We show that Epsilon Scaling explicitly moves the sampling trajectory closer to the vector field learned in the training phase by scaling down the network output, mitigating the input mismatch between training and sampling. Experiments on various diffusion frameworks (ADM, DDIM, EDM, LDM, DiT, PFGM++) verify the effectiveness of our method. Remarkably, our ADM-ES, as a state-of-the-art stochastic sampler, obtains 2.17 FID on CIFAR-10 under 100-step unconditional generation. The code is available at \url{https://github.com/forever208/ADM-ES} and \url{https://github.com/forever208/EDM-ES}.


title: Constraining Axion and ALP Dark Matter from Misalignment during Reheating

abstract: We explore the phenomenology of QCD axion and axion-like particle (ALP) dark matter production via misalignment during inflationary reheating. We investigate scenarios involving inflaton oscillating in a generic potential $\sim \phi^n$, considering inflaton decay and annihilation for reheating. For low reheating temperatures, the parameter space leading to the correct relic abundance can be enlarged beyond the standard case. Depending on the type of inflaton-matter couplings and the value of $n$, we find that certain parts of the extended parameter space are already constrained by ADMX, CAPP, and MUSE experiments. Future Haloscope experiments are expected to impose stringent constraints. We highlight the potential to utilize axion experiments in constraining the dynamics of reheating.


title: Occlusion-Aware Deep Convolutional Neural Network via Homogeneous Tanh-transforms for Face Parsing

abstract: Face parsing infers a pixel-wise label map for each semantic facial component. Previous methods generally work well for uncovered faces, however, they overlook facial occlusion and ignore some contextual areas outside a single face, especially when facial occlusion has become a common situation during the COVID-19 epidemic. Inspired by the lighting phenomena in everyday life, where illumination from four distinct lamps provides a more uniform distribution than a single central light source, we propose a novel homogeneous tanh-transform for image preprocessing, which is made up of four tanh-transforms. These transforms fuse the central vision and the peripheral vision together. Our proposed method addresses the dilemma of face parsing under occlusion and compresses more information from the surrounding context. Based on homogeneous tanh-transforms, we propose an occlusion-aware convolutional neural network for occluded face parsing. It combines information in both Tanh-polar space and Tanh-Cartesian space, capable of enhancing receptive fields. Furthermore, we introduce an occlusion-aware loss to focus on the boundaries of occluded regions. The network is simple, flexible, and can be trained end-to-end. To facilitate future research of occluded face parsing, we also contribute a new cleaned face parsing dataset. This dataset is manually purified from several academic or industrial datasets, including CelebAMask-HQ, Short-video Face Parsing, and the Helen dataset, and will be made public. Experiments demonstrate that our method surpasses state-of-the-art methods in face parsing under occlusion.


title: Federated Neuro-Symbolic Learning

abstract: Neuro-symbolic learning (NSL) models complex symbolic rule patterns into latent variable distributions by neural networks, which reduces rule search space and generates unseen rules to improve downstream task performance. Centralized NSL learning involves directly acquiring data from downstream tasks, which is not feasible for federated learning (FL). To address this limitation, we shift the focus from such a one-to-one interactive neuro-symbolic paradigm to one-to-many Federated Neuro-Symbolic Learning framework (FedNSL) with latent variables as the FL communication medium. Built on the basis of our novel reformulation of the NSL theory, FedNSL is capable of identifying and addressing rule distribution heterogeneity through a simple and effective Kullback-Leibler (KL) divergence constraint on rule distribution applicable under the FL setting. It further theoretically adjusts variational expectation maximization (V-EM) to reduce the rule search space across domains. This is the first incorporation of distribution-coupled bilevel optimization into FL. Extensive experiments based on both synthetic and real-world data demonstrate significant advantages of FedNSL compared to five state-of-the-art methods. It outperforms the best baseline by 17% and 29% in terms of unbalanced average training accuracy and unseen average testing accuracy, respectively.


title: Adaptivity in Local Kernel Based Methods for Approximating the Action of Linear Operators

abstract: Building on the successes of local kernel methods for approximating the solutions to partial differential equations (PDE) and the evaluation of definite integrals (quadrature/cubature), a local estimate of the error in such approximations is developed. This estimate is useful for determining locations in the solution domain where increased node density (equivalently, reduction in the spacing between nodes) can decrease the error in the solution. An adaptive procedure for adding nodes to the domain for both the approximation of derivatives and the approximate evaluation of definite integrals is described. This method efficiently computes the error estimate at a set of prescribed points and adds new nodes for approximation where the error is too large. Computational experiments demonstrate close agreement between the error estimate and actual absolute error in the approximation. Such methods are necessary or desirable when approximating solutions to PDE (or in the case of quadrature/cubature), where the initial data and subsequent solution (or integrand) exhibit localized features that require significant refinement to resolve and where uniform increases in the density of nodes across the entire computational domain is not possible or too burdensome.


title: Dynamical heterogeneity and universality of power-grids

abstract: While weak, tuned asymmetry can improve, strong heterogeneity destroys synchronization in the electric power system. We study the level of heterogeneity, by comparing large high voltage (HV) power-grids of Europe and North America. We provide an analysis of power capacities and loads of various energy sources from the databases and found heavy tailed distributions with similar characteristics. Graph topological measures, community structures also exhibit strong similarities, while the cable admittance distributions can be well fitted with the same power-laws (PL), related to the length distributions. The community detection analysis shows the level of synchronization in different domains of the European HV power grids, by solving a set of swing equations. We provide numerical evidence for frustrated synchronization and Chimera states and point out the relation of topology and level of synchronization in the subsystems. We also provide empirical data analysis of the frequency heterogeneities within the Hungarian HV network and find q-Gaussian distributions related to super-statistics of time-lagged fluctuations, which agree well with former results on the Nordic Grid.

categories: physics.soc-ph cond-mat.stat-mech nlin.CD physics.data-an


title: Enhancing Robot Learning through Learned Human-Attention Feature Maps

abstract: Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the environment, we think that embedding auxiliary information about focus point into robot learning would enhance efficiency and robustness of the learning process. In this paper, we propose a novel approach to model and emulate the human attention with an approximate prediction model. We then leverage this output and feed it as a structured auxiliary feature map into downstream learning tasks. We validate this idea by learning a prediction model from human-gaze recordings of manual driving in the real world. We test our approach on two learning tasks - object detection and imitation learning. Our experiments demonstrate that the inclusion of predicted human attention leads to improved robustness of the trained models to out-of-distribution samples and faster learning in low-data regime settings. Our work highlights the potential of incorporating structured auxiliary information in representation learning for robotics and opens up new avenues for research in this direction. All code and data are available online.


title: Cs evaporation in a negative ion source and Cs cleaning tests by plasma sputtering

abstract: The compact radio frequency negative ion source NIO1 (Negative Ion Optimization phase 1) has been designed, built and operated by Consorzio RFX and INFN-LNL in order to study and optimize the production and acceleration of H- ions in continuous operation. In 2020 Cs was evaporated in the source to increase the total extracted ion current. After an initial reduction of extracted electron to ion ratio and subsequently an increase of extracted negative ion current, the source performances progressively worsened, because of the excessive amount of Cs evaporated in the source; the extracted electron to ion ratio increased from below 1 to more than 10, while ion current density reduced from max. 67 A/m2 ion current to not more than 30 A/m2). The paper presents the experimental observations collected during Cs evaporation (reduction of plasma light, Cs emission and H$\beta$/H$\gamma$ ratio, etc.) that can help stopping the process before an excessive amount of Cs is introduced in the source. The paper also reports the cleaning techniques tested to remove the Cs excess by the action of hydrogen or argon plasmas; while argon was predictably more effective in surface sputtering, a 3 h Ar plasma treatment was not sufficient to recover from overcesiation.


title: Explaining Pulsar Timing Array Observations with Primordial Gravitational Waves in Parity-Violating Gravity

abstract: The pulsar timing array (PTA) collaborations have recently suggested the presence of a gravitational wave background at nano-Hertz frequencies. In this paper, we explore potential inflationary interpretation of this signal within the context of a simple and health parity-violating gravity model termed the Nieh-Yan modified Teleparallel Gravity. Through this model, two inflationary scenarios are evaluated, both yielding significant polarized primordial gravitational waves (PGWs) that align well with the results from PTA observations. Furthermore, the resulting PGWs can display strong circular polarization and significant anisotropies in the PTA frequency band, which are distinct features to be verified by observations of both PTA and the cosmic microwave background.The detection of such a distinctive background of PGWs is expected to provide strong evidence supporting our scenarios and insights into inflationary dynamics and gravity theory.


title: Predicting the Onset of Quantum Synchronization Using Machine Learning

abstract: We have applied a machine learning algorithm to predict the emergence of environment-induced spontaneous synchronization between two qubits in an open system setting. In particular, we have considered three different models, encompassing global and local dissipation regimes, to describe the open system dynamics of the qubits. We have utilized the $k$-nearest neighbors algorithm to estimate the long time synchronization behavior of the qubits only using the early time expectation values of qubit observables in these three distinct models. Our findings clearly demonstrate the possibility of determining the occurrence of different synchronization phenomena with high precision even at the early stages of the dynamics using a machine learning-based approach. Moreover, we show the robustness of our approach against potential measurement errors in experiments by considering random errors in qubit expectation values. We believe that the presented results can prove to be useful in experimental studies on the determination of quantum synchronization.


title: High-order quasi-Helmholtz Projectors: Definition, Analyses, Algorithms

abstract: The accuracy of the electric field integral equation (EFIE) can be substantially improved using high-order discretizations. However, this equation suffers from ill-conditioning and deleterious numerical effects in the low-frequency regime, often jeopardizing its solution. This can be fixed using quasi-Helmholtz decompositions, in which the source and testing elements are separated into their solenoidal and non-solenoidal contributions, then rescaled in order to avoid both the low-frequency conditioning breakdown and the loss of numerical accuracy. However, standard quasi-Helmholtz decompositions require handling discretized differential operators that often worsen the mesh-refinement ill-conditioning and require the finding of the topological cycles of the geometry, which can be expensive when modeling complex scatterers, especially in high-order. This paper solves these drawbacks by presenting the first extension of the quasi-Helmholtz projectors to high-order discretizations and their application to the stabilization of the EFIE when discretized with high-order basis functions. Our strategy will not require the identification of the cycles and will provide constant condition numbers for decreasing frequencies. Theoretical considerations will be accompanied by numerical results showing the effectiveness of our method in complex scenarios.


title: Well-posedness and Low Mach Number Limit of the Free Boundary Problem for the Euler--Fourier System

abstract: We consider the free boundary problem for the Euler--Fourier system that describes the motion of compressible, inviscid and heat-conducting fluids. The effect of surface tension is neglected and there is no heat flux across the free boundary. We prove the local well-posedness of the problem in Lagrangian coordinates under the Taylor sign condition. The solution is produced as the limit of solutions to a sequence of tangentially-smoothed approximate problems, where the so-called corrector is crucially introduced beforehand in the temperature equation so that the approximate initial data satisfying the corresponding compatibility conditions can be constructed. To overcome the strong coupling effect between the Euler part and the Fourier part in solving the linearized approximate problem, the temperature equation is further regularized by a pseudo-parabolic equation. Moreover, we prove the uniform estimates with respect to the Mach number of the solutions to the free-boundary Euler--Fourier system with large temperature variations, which allow us to justify the convergence towards the free-boundary inviscid low Mach number limit system by the strong compactness argument.


title: High repetition rate sub ns-electron pulses from Resonant Pulsed Rydberg Field Ionization

abstract: Using Resonant Pulsed Rydberg Field-ionization (RPRFI) technique, we generate low-energy electron bunches at high repetition rates. By combining continuous-wave laser excitation with a pulsed electric field, this method selectively ionizes Rydberg-Stark states in cesium atoms, producing sub-ns long electron bunches (down to $\sim 250\:\textrm{ps}$) at a repetition rate of $\sim 10\:\textrm{MHz}$. The method is demonstrated to offer significant advantages in terms of flexibility in the ionization repetition rate and pulse delay adjustments. The RPRFI method holds promise for applications in high-resolution electron microscopy and spectroscopy, potentially for overcoming the limitations of traditional electron sources in terms of brightness and energy spread.


title: A Framework for Responsible Development of Automated Student Feedback with Generative AI

abstract: Providing rich feedback to students is essential for supporting student learning. Recent advances in generative AI, particularly within large language modelling (LLM), provide the opportunity to deliver repeatable, scalable and instant automatically generated feedback to students, making abundant a previously scarce and expensive learning resource. Such an approach is feasible from a technical perspective due to these recent advances in Artificial Intelligence (AI) and Natural Language Processing (NLP); while the potential upside is a strong motivator, doing so introduces a range of potential ethical issues that must be considered as we apply these technologies. The attractiveness of AI systems is that they can effectively automate the most mundane tasks; but this risks introducing a "tyranny of the majority", where the needs of minorities in the long tail are overlooked because they are difficult to automate. Developing machine learning models that can generate valuable and authentic feedback requires the input of human domain experts. The choices we make in capturing this expertise -- whose, which, when, and how -- will have significant consequences for the nature of the resulting feedback. How we maintain our models will affect how that feedback remains relevant given temporal changes in context, theory, and prior learning profiles of student cohorts. These questions are important from an ethical perspective; but they are also important from an operational perspective. Unless they can be answered, our AI generated systems will lack the trust necessary for them to be useful features in the contemporary learning environment. This article will outline the frontiers of automated feedback, identify the ethical issues involved in the provision of automated feedback and present a framework to assist academics to develop such systems responsibly.


title: Switching of ferrotoroidal domains via an intermediate mixed state in the multiferroic Y-type hexaferrite Ba$_{0.5}$Sr$_{1.5}$Mg$_2$Fe$_{12}$O$_{22}$

abstract: We report a detailed study of the magnetic field switching of ferrotoroidal/multiferroic domains in the Y-type hexaferrite compound Ba$_{0.5}$Sr$_{1.5}$Mg$_2$Fe$_{12}$O$_{22}$. By combining data from SQUID magnetometry, magneto-current measurements, and resonant X-ray scattering experiments, we arrive at a complete description of the deterministic switching, which involves the formation of a temperature-dependent mixed state in low magnetic fields. This mechanism is likely to be shared by other members of the hexaferrite family, and presents a challenge for the development of high-speed read-write memory devices based on these materials.


title: Second-order methods for quartically-regularised cubic polynomials, with applications to high-order tensor methods

abstract: There has been growing interest in high-order tensor methods for nonconvex optimization, with adaptive regularization, as they possess better/optimal worst-case evaluation complexity globally and faster convergence asymptotically. These algorithms crucially rely on repeatedly minimizing nonconvex multivariate Taylor-based polynomial sub-problems, at least locally. Finding efficient techniques for the solution of these sub-problems, beyond the second-order case, has been an open question. This paper proposes a second-order method, Quadratic Quartic Regularisation (QQR), for efficiently minimizing nonconvex quartically-regularized cubic polynomials, such as the AR$p$ sub-problem [3] with $p=3$. Inspired by [35], QQR approximates the third-order tensor term by a linear combination of quadratic and quartic terms, yielding (possibly nonconvex) local models that are solvable to global optimality. In order to achieve accuracy $\epsilon$ in the first-order criticality of the sub-problem, we show that the error in the QQR method decreases either linearly or by at least $\mathcal{O}(\epsilon^{4/3})$ for locally convex iterations, while in the sufficiently nonconvex case, by at least $\mathcal{O}(\epsilon)$; thus improving, on these types of iterations, the general cubic-regularization bound. Preliminary numerical experiments indicate that two QQR variants perform competitively with state-of-the-art approaches such as ARC (also known as AR$p$ with $p=2$), achieving either a lower objective value or iteration counts.


title: Distrustful quantum steering

abstract: Quantum steering is an asymmetric form of quantum nonlocality where one can trust the measurements of one of the parties. In this work, inspired by practical considerations we investigate the scenario if one can not fully trust their measurement devices but only up to some precision. We first find the effect of such an imprecision on standard device-dependent quantum tomography. We then utilise this result to compute the variation in the local bound of any general steering inequality depending on the amount of trust one puts in one of the party's measurement devices. This is particularly important as we show that even a small distrust on Alice might cause the parties to observe steerability even if the quantum state is unsteerable. Furthermore, this effect becomes more relevant when observing higher dimensional quantum steering.


title: Another Look at the Linear Probability Model and Nonlinear Index Models

abstract: We reassess the use of linear models to approximate response probabilities of binary outcomes, focusing on average partial effects (APE). We confirm that linear projection parameters coincide with APEs in certain scenarios. Through simulations, we identify other cases where OLS does or does not approximate APEs and find that having large fraction of fitted values in [0, 1] is neither necessary nor sufficient. We also show nonlinear least squares estimation of the ramp model is consistent and asymptotically normal and is equivalent to using OLS on an iteratively trimmed sample to reduce bias. Our findings offer practical guidance for empirical research.


title: AI Framework for Early Diagnosis of Coronary Artery Disease: An Integration of Borderline SMOTE, Autoencoders and Convolutional Neural Networks Approach

abstract: The accuracy of coronary artery disease (CAD) diagnosis is dependent on a variety of factors, including demographic, symptom, and medical examination, ECG, and echocardiography data, among others. In this context, artificial intelligence (AI) can help clinicians identify high-risk patients early in the diagnostic process, by synthesizing information from multiple factors. To this aim, Machine Learning algorithms are used to classify patients based on their CAD disease risk. In this study, we contribute to this research filed by developing a methodology for balancing and augmenting data for more accurate prediction when the data is imbalanced and the sample size is small. The methodology can be used in a variety of other situations, particularly when data collection is expensive and the sample size is small. The experimental results revealed that the average accuracy of our proposed method for CAD prediction was 95.36, and was higher than random forest (RF), decision tree (DT), support vector machine (SVM), logistic regression (LR), and artificial neural network (ANN).


title: Global structure of the spectrum of periodic Non-hermitian Jacobi operators

abstract: The global structure of the spectrum of periodic non-Hermitian Jacobi operators is described by the discriminant and its stationary points. We also give necessary and sufficient conditions for real spectrum and single interval spectrum.


title: On the implied volatility of European and Asian call options under the stochastic volatility Bachelier model

abstract: In this paper we study the short-time behavior of the at-the-money implied volatility for European and arithmetic Asian call options with fixed strike price. The asset price is assumed to follow the Bachelier model with a general stochastic volatility process. Using techniques of the Malliavin calculus such as the anticipating It\^o's formula we first compute the level of the implied volatility when the maturity converges to zero. Then, we find a short maturity asymptotic formula for the skew of the implied volatility that depends on the roughness of the volatility model. We apply our general results to the SABR and fractional Bergomi models, and provide some numerical simulations that confirm the accurateness of the asymptotic formula for the skew.


title: The Terzina instrument onboard the NUSES space mission

abstract: In this paper we will introduce the Terzina instrument, which is one of the two scientific payloads of the NUSES satellite mission. NUSES serves as a technological pathfinder, hosting a suite of innovative instruments designed for the in-orbit detection of cosmic rays, neutrinos, and gamma rays across various energy ranges. The Terzina instrument itself is a compact telescope equipped with Schmidt-Cassegrain optics. Its primary objective is to detect Cherenkov radiation emitted by Extensive Air Showers generated by the interaction of high-energy (> 100 PeV) cosmic rays with the Earth's atmosphere. Terzina represents a critical step forward in the development of future space-based instruments aimed at detecting upward-moving showers induced by tau-leptons and muons resulting from the interaction of high-energy astrophysical neutrinos with the Earth. In this paper, we will delve into the key technical aspects of the Terzina instrument, its capabilities, and its potential for detection.


title: Switchable in-plane anomalous Hall effect by magnetization orientation in monolayer $\mathrm{Mn}_{3}\mathrm{Si}_{2}\mathrm{Te}_{6}$

abstract: In-plane anomalous Hall effect (IPAHE) is an unconventional anomalous Hall effect (AHE) with the Hall current flows in the plane spanned by the magnetization or magnetic field and the electric field. Here,we predict a stable two-dimensional ferromagnetic monolayer $\mathrm{Mn}_{3}\mathrm{Si}_{2}\mathrm{Te}_{6}$ with collinear ordering of Mn moments in the basal plane. Moreover, we reveal that the monolayer $\mathrm{Mn}_{3}\mathrm{Si}_{2}\mathrm{Te}_{6}$ possesses a substantial periodic IPAHE due to the threefold rotational symmetry, which can be switched by changing the magnetization orientation by external magnetic fields. In addition, we briefly discuss the impacts of moderate strains on the electronic states and AHE, which lead to a near quantized Hall conductivity. Our work provides a potential platform for realizing a sizable and controllable IPAHE that greatly facilatates the application of energy-efficient spintronic devices.


title: Imperceptible Adversarial Attack on Deep Neural Networks from Image Boundary

abstract: Although Deep Neural Networks (DNNs), such as the convolutional neural networks (CNN) and Vision Transformers (ViTs), have been successfully applied in the field of computer vision, they are demonstrated to be vulnerable to well-sought Adversarial Examples (AEs) that can easily fool the DNNs. The research in AEs has been active, and many adversarial attacks and explanations have been proposed since they were discovered in 2014. The mystery of the AE's existence is still an open question, and many studies suggest that DNN training algorithms have blind spots. The salient objects usually do not overlap with boundaries; hence, the boundaries are not the DNN model's attention. Nevertheless, recent studies show that the boundaries can dominate the behavior of the DNN models. Hence, this study aims to look at the AEs from a different perspective and proposes an imperceptible adversarial attack that systemically attacks the input image boundary for finding the AEs. The experimental results have shown that the proposed boundary attacking method effectively attacks six CNN models and the ViT using only 32% of the input image content (from the boundaries) with an average success rate (SR) of 95.2% and an average peak signal-to-noise ratio of 41.37 dB. Correlation analyses are conducted, including the relation between the adversarial boundary's width and the SR and how the adversarial boundary changes the DNN model's attention. This paper's discoveries can potentially advance the understanding of AEs and provide a different perspective on how AEs can be constructed.


title: IndGIC: Supervised Action Recognition under Low Illumination

abstract: Technologies of human action recognition in the dark are gaining more and more attention as huge demand in surveillance, motion control and human-computer interaction. However, because of limitation in image enhancement method and low-lighting video datasets, e.g. labeling cost, existing methods meet some problems. Some video-based approached are effect and efficient in specific datasets but cannot generalize to most cases while others methods using multiple sensors rely heavily to prior knowledge to deal with noisy nature from video stream. In this paper, we proposes action recognition method using deep multi-input network. Furthermore, we proposed a Independent Gamma Intensity Corretion (Ind-GIC) to enhance poor-illumination video, generating one gamma for one frame to increase enhancement performance. To prove our method is effective, there is some evaluation and comparison between our method and existing methods. Experimental results show that our model achieves high accuracy in on ARID dataset.


title: Enhancing Mobile Face Anti-Spoofing: A Robust Framework for Diverse Attack Types under Screen Flash

abstract: Face anti-spoofing (FAS) is crucial for securing face recognition systems. However, existing FAS methods with handcrafted binary or pixel-wise labels have limitations due to diverse presentation attacks (PAs). In this paper, we propose an attack type robust face anti-spoofing framework under light flash, called ATR-FAS. Due to imaging differences caused by various attack types, traditional FAS methods based on single binary classification network may result in excessive intra-class distance of spoof faces, leading to a challenge of decision boundary learning. Therefore, we employed multiple networks to reconstruct multi-frame depth maps as auxiliary supervision, and each network experts in one type of attack. A dual gate module (DGM) consisting of a type gate and a frame-attention gate is introduced, which perform attack type recognition and multi-frame attention generation, respectively. The outputs of DGM are utilized as weight to mix the result of multiple expert networks. The multi-experts mixture enables ATR-FAS to generate spoof-differentiated depth maps, and stably detects spoof faces without being affected by different types of PAs. Moreover, we design a differential normalization procedure to convert original flash frames into differential frames. This simple but effective processing enhances the details in flash frames, aiding in the generation of depth maps. To verify the effectiveness of our framework, we collected a large-scale dataset containing 12,660 live and spoof videos with diverse PAs under dynamic flash from the smartphone screen. Extensive experiments illustrate that the proposed ATR-FAS significantly outperforms existing state-of-the-art methods. The code and dataset will be available at https://github.com/Chaochao-Lin/ATR-FAS.


title: Masquerade: Simple and Lightweight Transaction Reordering Mitigation in Blockchains

abstract: Blockchains offer strong security gurarantees, but cannot protect users against the ordering of transactions. Players such as miners, bots and validators can reorder various transactions and reap significant profits, called the Maximal Extractable Value (MEV). In this paper, we propose an MEV aware protocol design called Masquerade, and show that it will increase user satisfaction and confidence in the system. We propose a strict per-transaction level of ordering to ensure that a transaction is committed either way even if it is revealed. In this protocol, we introduce the notion of a "token" to mitigate the actions taken by an adversary in an attack scenario. Such tokens can be purchased voluntarily by users, who can then choose to include the token numbers in their transactions. If the users include the token in their transactions, then our protocol requires the block-builder to order the transactions strictly according to token numbers. We show through extensive simulations that this reduces the probability that the adversaries can benefit from MEV transactions as compared to existing current practices.


title: Muon precession from the aspect of Dirac equations

abstract: In this paper, we would like to compute the muon anomalous precession frequency through solving the wave functions of the Dirac equations straightforwardly. The precession of a (anti-)muon with an anomalous magnetic momentum term is calculated together with the quantum corrections. Lorentz violation terms up to the lowest non-trivial order is introduced, and their effects on anomalous precession are evaluated perturbatively.


title: Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with Symmetries

abstract: An accurate data-based prediction of the long-term evolution of Hamiltonian systems requires a network that preserves the appropriate structure under each time step. Every Hamiltonian system contains two essential ingredients: the Poisson bracket and the Hamiltonian. Hamiltonian systems with symmetries, whose paradigm examples are the Lie-Poisson systems, have been shown to describe a broad category of physical phenomena, from satellite motion to underwater vehicles, fluids, geophysical applications, complex fluids, and plasma physics. The Poisson bracket in these systems comes from the symmetries, while the Hamiltonian comes from the underlying physics. We view the symmetry of the system as primary, hence the Lie-Poisson bracket is known exactly, whereas the Hamiltonian is regarded as coming from physics and is considered not known, or known approximately. Using this approach, we develop a network based on transformations that exactly preserve the Poisson bracket and the special functions of the Lie-Poisson systems (Casimirs) to machine precision. We present two flavors of such systems: one, where the parameters of transformations are computed from data using a dense neural network (LPNets), and another, where the composition of transformations is used as building blocks (G-LPNets). We also show how to adapt these methods to a larger class of Poisson brackets. We apply the resulting methods to several examples, such as rigid body (satellite) motion, underwater vehicles, a particle in a magnetic field, and others. The methods developed in this paper are important for the construction of accurate data-based methods for simulating the long-term dynamics of physical systems.


title: Scaling Limits of Stochastic Transport Equations on Manifolds

abstract: In this work, we generalize some results on scaling limits of stochastic transport equations on torus, developed recently by Flandoli, Galeati and Luo, to manifolds. We consider the stochastic transport equations driven by colored space-time noise(smooth in space, white in time) on a compact Riemannian manifold without boundary. By tuning the noises properly, we obtain different scaling limits depending on the initial data. With space white noise as initial data, the solutions converge in distribution to the solution of a stochastic heat equation with additive noise. With regular initial data, the solutions of transport equation converge to the solution of the deterministic heat equation, accompanied by qualitative estimates on the convergence rate. We can get the same rate as on torus in the estimates, but at the cost of either imposing stronger bounds on the initial data or sacrificing some regularity.


title: Bayesian Survey of the Dense Matter Equation of State built upon Skyrme effective interactions

abstract: The non-relativistic model of nuclear matter with zero-range Skyrme interactions is employed within a Bayesian approach in order to study the behavior of neutron stars (NSs) equation of state (EOS). A minimal number of constraints from nuclear physics and ab initio calculations of pure neutron matter (PNM) are imposed together with causality and a lower limit on the maximum mass of NS to all our models. Our key result is that accounting for correlations among the values that the energy per neutron in PNM takes at various densities, and that are typically disregarded, efficiently constrains the behavior of the EOS at high densities. A series of global NS properties, e.g., maximum mass, central density of the maximum mass configuration, minimum NS mass that allows for direct URCA, radii of intermediate and massive NS, appear to be correlated with the value of effective neutron mass in PNM at 0.16 fm$^{-3}$. Together with similar studies in the literature our work contributes to a better understanding of the NS EOS as well as its link with the properties of dense nuclear matter.


title: Historical patterns of rice farming explain modern-day language use in China and Japan more than modernization and urbanization

abstract: We used natural language processing to analyze a billion words to study cultural differences on Weibo, one of China's largest social media platforms. We compared predictions from two common explanations about cultural differences in China (economic development and urban-rural differences) against the less-obvious legacy of rice versus wheat farming. Rice farmers had to coordinate shared irrigation networks and exchange labor to cope with higher labor requirements. In contrast, wheat relied on rainfall and required half as much labor. We test whether this legacy made southern China more interdependent. Across all word categories, rice explained twice as much variance as economic development and urbanization. Rice areas used more words reflecting tight social ties, holistic thought, and a cautious, prevention orientation. We then used Twitter data comparing prefectures in Japan, which largely replicated the results from China. This provides crucial evidence of the rice theory in a different nation, language, and platform.


title: Detect, Augment, Compose, and Adapt: Four Steps for Unsupervised Domain Adaptation in Object Detection

abstract: Unsupervised domain adaptation (UDA) plays a crucial role in object detection when adapting a source-trained detector to a target domain without annotated data. In this paper, we propose a novel and effective four-step UDA approach that leverages self-supervision and trains source and target data concurrently. We harness self-supervised learning to mitigate the lack of ground truth in the target domain. Our method consists of the following steps: (1) identify the region with the highest-confidence set of detections in each target image, which serve as our pseudo-labels; (2) crop the identified region and generate a collection of its augmented versions; (3) combine these latter into a composite image; (4) adapt the network to the target domain using the composed image. Through extensive experiments under cross-camera, cross-weather, and synthetic-to-real scenarios, our approach achieves state-of-the-art performance, improving upon the nearest competitor by more than 2% in terms of mean Average Precision (mAP). The code is available at https://github.com/MohamedTEV/DACA.


title: Searching for gravitational-wave bursts with space-borne detectors

abstract: The millihertz gravitational wave band is expected to be opened by space-borne detectors like TianQin. Various mechanisms can produce short outbursts of gravitational waves, whose actual waveform can be hard to model. In order to identify such gravitational wave bursts and not to misclassify them as noise transients, we proposed a proof-of-principle energy excess method, that utilized the signal-insensitive channel to veto noise transients. We perform a test on simulated data, and for bursts with a signal-to-noise ratio of 20, even with the contamination of noise transient, our methods can reach a detection efficiency of 97.4% under a false alarm rate of once per year. However, more frequent occurrences of noise transients would lower the detection efficiency.


title: Pionic and radiative transitions from $T_{c\bar{s}0}^+(2900)$ to $D_{s1}^+(2460)$ as a probe of the structure of $D_{s1}^+(2460)$

abstract: In this work, we evaluated the widths of the pionic and radiative transitions from the $T_{c\bar{s}0}^{+}(2900)$ to the $D_{s1}^{+}(2460)$ in the $D_{s1}^{+}(2460)$ molecular frame and the $D_{s1}^{+}(2460)$ charmed-strange meson frame. Our estimations demonstrate that the transition widths in the $D_{s1}^{+}(2460)$ molecular frame are much larger than those in the the $D_{s1}^{+}(2460)$ charmed-strange meson frame. Specifically, the ratio of the widths of $\Gamma(T_{c\bar{s}0}^{+}(2900)\to D_{s1}^{+} \pi^{0})$ and $\Gamma(T_{c\bar{s}0}^{+}(2900)\to D^{+(0)}K^{0(+)})$ is estimated to be around 0.1 in the $D_{s1}^{+}(2460)$ charmed-strange meson frame, whereas the lower limit of this ratio is 0.67 in the $D_{s1}^{+}(2460)$ molecular frame. Thus, the aforementioned ratio could be employed as a tool for testing the nature of the $D_{s1}^{+}(2460)$.


title: Quantum steering with imprecise measurements

abstract: We study quantum steering experiments without assuming that the trusted party can perfectly control their measurement device. Instead, we introduce a scenario in which these measurements are subject to small imprecision. We show that small measurement imprecision can have a large detrimental influence in terms of false positives for steering inequalities, and that this effect can become even more relevant for high-dimensional systems. We then introduce a method for taking generic measurement imprecision into account in tests of bipartite steering inequalities. The revised steering bounds returned by this method are analytical, easily computable, and are even optimal for well-known families of arbitrary-dimensional steering tests. Furthermore, it applies equally well to generalised quantum steering scenarios, where the shared quantum state does not need to be separable, but is instead limited by some other entanglement property.


title: Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detection

abstract: New 3+1D high-resolution radar sensors are gaining importance for 3D object detection in the automotive domain due to their relative affordability and improved detection compared to classic low-resolution radar sensors. One limitation of high-resolution radar sensors, compared to lidar sensors, is the sparsity of the generated point cloud. This sparsity could be partially overcome by accumulating radar point clouds of subsequent time steps. This contribution analyzes limitations of accumulating radar point clouds on the View-of-Delft dataset. By employing different ego-motion estimation approaches, the dataset's inherent constraints, and possible solutions are analyzed. Additionally, a learning-based instance motion estimation approach is deployed to investigate the influence of dynamic motion on the accumulated point cloud for object detection. Experiments document an improved object detection performance by applying an ego-motion estimation and dynamic motion correction approach.


title: Spin-orbit insulating phase in SnTe cubic nanowires: consequences on the topological surface states

abstract: We investigate the electronic, structural and topological properties of the SnTe and PbTe cubic nanowires using ab-initio calculations. Using standard and linear-scale density functional theory, we go from the ultrathin limit up to the nanowires thicknesses observed experimentally. Finite-size effects in the ultra-thin limit produce an electric quadrupole and associated structural distortions, these distortions increase the band gap but they get reduced with the size of the nanowires and become less and less relevant. Ultrathin SnTe cubic nanowires are trivial band gap insulators, we demonstrate that by increasing the thickness there is an electronic transition to a spin-orbit insulating phase due to trivial surface states in the regime of thin nanowires. These trivial surface states with a spin-orbit gap of a few meV appear at the same k-point of the topological surface states. Going to the limit of thick nanowires, we should observe the transition to the topological crystalline insulating phase with the presence of two massive surface Dirac fermions hybridized with the persisting trivial surface states. Therefore, we have the co-presence of massive Dirac surface states and trivial surface states close to the Fermi level in the same region of the k-space. According to our estimation, the cubic SnTe nanowires are trivial insulators below the critical thickness tc1=10 nm, and they become spin-orbit insulators between tc1=10 nm and tc2=17 nm, while they transit to the topological phase above the critical thickness of tc2=17 nm. These critical thickness values are in the range of the typical experimental thicknesses, making the thickness a relevant parameter for the synthesis of topological cubic nanowires. Pb(1-x)Sn(x)Te nanowires would have both these critical thicknesses tc1 and tc2 at larger values depending on the doping concentration.


title: Rayleigh-B\'enard instability in a horizontal porous layer with anomalous diffusion

abstract: The analysis of the Rayleigh-B\'enard instability due to the mass diffusion in a fluid-saturated horizontal porous layer is reconsidered. The standard diffusion theory based on the variance of the molecular position growing linearly in time is generalised to anomalous diffusion, where the variance is modelled as a power-law function of time. A model of anomalous diffusion based on a time-dependent mass diffusion coefficient is adopted, together with Darcy's law, for momentum transfer, and the Boussinesq approximation, for the description of the buoyant flow. A linear stability analysis is carried out for a basic state where the solute has a potentially unstable concentration distribution varying linearly in the vertical direction and the fluid is at rest. It is shown that any, even slight, departure from the standard diffusion process has a dramatic effect on the onset conditions of the instability. This circumstance reveals a strong sensitivity to the anomalous diffusion index. It is shown that subdiffusion yields instability for every positive mass diffusion Rayleigh number, while superdiffusion brings stabilisation no matter how large is the Rayleigh number. A discussion of the linear stability analysis based on the Galilei-variant fractional-derivative model of subdiffusion is eventually carried out.


title: A Scalable Approach for Analysing Multi-Agent Systems with Heterogeneous Stochastic Packet Loss

abstract: An important aspect in jointly analysing networked control systems and their communication is to model the networking in a sufficiently rich but at the same time mathematically tractable way. As such, this paper improves on a recently proposed scalable approach for analysing multi-agent systems with stochastic packet loss by allowing for heterogeneous transmission probabilities and temporal correlation in the communication model. The key idea is to consider the transmission probabilities as uncertain, which facilitates the use of tools from robust control. Due to being formulated in terms of linear matrix inequalities that grow linearly with the number of agents, the result is applicable to very large multi-agent systems, which is demonstrated by numerical simulations with up to 10000 agents.


title: Thermodynamics-inspired Macroscopic States of Bounded Swarms

abstract: The collective behavior of swarms is extremely difficult to estimate or predict, even when the local agent rules are known and simple. The presented work seeks to leverage the similarities between fluids and swarm systems to generate a thermodynamics-inspired characterization of the collective behavior of robotic swarms. While prior works have borrowed tools from fluid dynamics to design swarming behaviors, they have usually avoided the task of generating a fluids-inspired macroscopic state (or macrostate) description of the swarm. This work will bridge the gap by seeking to answer the following question: is it possible to generate a small set of thermodynamics-inspired macroscopic properties that may later be used to quantify all possible collective behaviors of swarm systems? In this paper, we present three macroscopic properties analogous to pressure, temperature, and density of a gas, to describe the behavior of a swarm that is governed by only attractive and repulsive agent interactions. These properties are made to satisfy an equation similar to the ideal gas law, and also generalized to satisfy the virial equation of state for real gases. Finally, we investigate how swarm specifications such as density and average agent velocity affect the system macrostate.


title: Observation of a vector charmoniumlike state at 4.7 ${\rm GeV}/c^2$ and search for $Z_{cs}$ in $e^+e^-\to K^+K^-J/\psi$

abstract: Using data samples with an integrated luminosity of 5.85~fb$^{-1}$ collected at center-of-mass energies from 4.61 to 4.95 GeV with the BESIII detector operating at the BEPCII storage ring, we measure the cross section for the process $e^+e^-\to K^+K^-J/\psi$. A new resonance with a mass of $M = 4708_{-15}^{+17}\pm21$ MeV/$c^{2}$ and a width of $\Gamma = 126_{-23}^{+27}\pm30$ MeV is observed in the energy-dependent line shape of the $e^+e^-\to K^+K^-J/\psi$ cross section with a significance over $5\sigma$. The $K^{+}J/\psi$ system is also investigated to search for charged charmoniumlike states, but no significant $Z_{cs}^+$ states are observed. Upper limits on the Born cross sections for $e^+e^-\to K^{-} Z_{cs}(3985)^{+}/K^{-} Z_{cs}(4000)^{+} + c.c.$ with $Z_{cs}(3985)^{\pm}/Z_{cs}(4000)^{\pm}\to K^{\pm} J/\psi$ are reported at 90\% confidence levels. The ratio of branching fractions $\frac{\mathcal{B}(Z_{cs}(3985)^{+}\to K^+ J/\psi)}{\mathcal{B}(Z_{cs}(3985)^{+}\to (\bar{D}^{0}D_s^{*+} + \bar{D}^{*0}D_s^+))}$ is measured to be less than 0.03 at 90\% confidence level.


title: Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation

abstract: Large language models (LLMs) have emerged as a new paradigm for Text-to-SQL task. However, the absence of a systematical benchmark inhibits the development of designing effective, efficient and economic LLM-based Text-to-SQL solutions. To address this challenge, in this paper, we first conduct a systematical and extensive comparison over existing prompt engineering methods, including question representation, example selection and example organization, and with these experimental results, we elaborate their pros and cons. Based on these findings, we propose a new integrated solution, named DAIL-SQL, which refreshes the Spider leaderboard with 86.6% execution accuracy and sets a new bar. To explore the potential of open-source LLM, we investigate them in various scenarios, and further enhance their performance with supervised fine-tuning. Our explorations highlight open-source LLMs' potential in Text-to-SQL, as well as the advantages and disadvantages of the supervised fine-tuning. Additionally, towards an efficient and economic LLM-based Text-to-SQL solution, we emphasize the token efficiency in prompt engineering and compare the prior studies under this metric. We hope that our work provides a deeper understanding of Text-to-SQL with LLMs, and inspires further investigations and broad applications.


title: Heterogeneous Multi-Task Gaussian Cox Processes

abstract: This paper presents a novel extension of multi-task Gaussian Cox processes for modeling multiple heterogeneous correlated tasks jointly, e.g., classification and regression, via multi-output Gaussian processes (MOGP). A MOGP prior over the parameters of the dedicated likelihoods for classification, regression and point process tasks can facilitate sharing of information between heterogeneous tasks, while allowing for nonparametric parameter estimation. To circumvent the non-conjugate Bayesian inference in the MOGP modulated heterogeneous multi-task framework, we employ the data augmentation technique and derive a mean-field approximation to realize closed-form iterative updates for estimating model parameters. We demonstrate the performance and inference on both 1D synthetic data as well as 2D urban data of Vancouver.


title: Flexible parametrization of graph-theoretical features from individual-specific networks for prediction

abstract: Statistical techniques are needed to analyse data structures with complex dependencies such that clinically useful information can be extracted. Individual-specific networks, which capture dependencies in complex biological systems, are often summarized by graph-theoretical features. These features, which lend themselves to outcome modelling, can be subject to high variability due to arbitrary decisions in network inference and noise. Correlation-based adjacency matrices often need to be sparsified before meaningful graph-theoretical features can be extracted, requiring the data analysts to determine an optimal threshold.. To address this issue, we propose to incorporate a flexible weighting function over the full range of possible thresholds to capture the variability of graph-theoretical features over the threshold domain. The potential of this approach, which extends concepts from functional data analysis to a graph-theoretical setting, is explored in a plasmode simulation study using real functional magnetic resonance imaging (fMRI) data from the Autism Brain Imaging Data Exchange (ABIDE) Preprocessed initiative. The simulations show that our modelling approach yields accurate estimates of the functional form of the weight function, improves inference efficiency, and achieves a comparable or reduced root mean square prediction error compared to competitor modelling approaches. This assertion holds true in settings where both complex functional forms underlie the outcome-generating process and a universal threshold value is employed. We demonstrate the practical utility of our approach by using resting-state fMRI data to predict biological age in children. Our study establishes the flexible modelling approach as a statistically principled, serious competitor to ad-hoc methods with superior performance.


title: AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models

abstract: Large Vision-Language Models (LVLMs) such as MiniGPT-4 and LLaVA have demonstrated the capability of understanding images and achieved remarkable performance in various visual tasks. Despite their strong abilities in recognizing common objects due to extensive training datasets, they lack specific domain knowledge and have a weaker understanding of localized details within objects, which hinders their effectiveness in the Industrial Anomaly Detection (IAD) task. On the other hand, most existing IAD methods only provide anomaly scores and necessitate the manual setting of thresholds to distinguish between normal and abnormal samples, which restricts their practical implementation. In this paper, we explore the utilization of LVLM to address the IAD problem and propose AnomalyGPT, a novel IAD approach based on LVLM. We generate training data by simulating anomalous images and producing corresponding textual descriptions for each image. We also employ an image decoder to provide fine-grained semantic and design a prompt learner to fine-tune the LVLM using prompt embeddings. Our AnomalyGPT eliminates the need for manual threshold adjustments, thus directly assesses the presence and locations of anomalies. Additionally, AnomalyGPT supports multi-turn dialogues and exhibits impressive few-shot in-context learning capabilities. With only one normal shot, AnomalyGPT achieves the state-of-the-art performance with an accuracy of 86.1%, an image-level AUC of 94.1%, and a pixel-level AUC of 95.3% on the MVTec-AD dataset. Code is available at https://github.com/CASIA-IVA-Lab/AnomalyGPT.