title: Simplicial Lattice Study of the 2d Ising CFT

abstract: I derive a formulation of the 2-dimensional critical Ising model on non-uniform simplicial lattices. Surprisingly, the derivation leads to a set of geometric constraints that a lattice must satisfy in order for the model to have a well-defined continuum limit. I perform Monte Carlo simulations of the critical Ising model on discretizations of several non-trivial manifolds including a twisted torus and a 2-sphere and I show that the simulations are in agreement with the 2d Ising CFT in the continuum limit. I discuss the inherent benefits of using non-uniform simplicial lattices to study quantum field theory and how the methods developed here can potentially be generalized for use with other theories.


title: Null-controllability for a fourth order parabolic equation under general boundary conditions

abstract: In this paper, we consider a fourth order inner-controlled parabolic equation on an open bounded subset of $R^d$, or a smooth compact manifold with boundary, along with general boundary operators fulfilling the Lopatinskii-Sapiro condition. We derive a spectral inequality for the solution of the parabolic system that yields a null-controllability result. The spectral inequality is a consequence of an interpolation inequality obtained via a Carleman inequality for the bi-Laplace operator under the considered boundary conditions.


title: Using a Nearest-Neighbour, BERT-Based Approach for Scalable Clone Detection

abstract: Code clones can detrimentally impact software maintenance and manually detecting them in very large codebases is impractical. Additionally, automated approaches find detection of Type 3 and Type 4 (inexact) clones very challenging. While the most recent artificial deep neural networks (for example BERT-based artificial neural networks) seem to be highly effective in detecting such clones, their pairwise comparison of every code pair in the target system(s) is inefficient and scales poorly on large codebases. We therefore introduce SSCD, a BERT-based clone detection approach that targets high recall of Type 3 and Type 4 clones at scale (in line with our industrial partner's requirements). It does so by computing a representative embedding for each code fragment and finding similar fragments using a nearest neighbour search. SSCD thus avoids the pairwise-comparison bottleneck of other Neural Network approaches while also using parallel, GPU-accelerated search to tackle scalability. This paper details the approach and an empirical assessment towards configuring and evaluating that approach in industrial setting. The configuration analysis suggests that shorter input lengths and text-only based neural network models demonstrate better efficiency in SSCD, while only slightly decreasing effectiveness. The evaluation results suggest that SSCD is more effective than state-of-the-art approaches like SAGA and SourcererCC. It is also highly efficient: in its optimal setting, SSCD effectively locates clones in the entire 320 million LOC BigCloneBench (a standard clone detection benchmark) in just under three hours.


title: Instrumental variable estimation of the proportional hazards model by presmoothing

abstract: We consider instrumental variable estimation of the proportional hazards model of Cox (1972). The instrument and the endogenous variable are discrete but there can be (possibly continuous) exogenous covariables. By making a rank invariance assumption, we can reformulate the proportional hazards model into a semiparametric version of the instrumental variable quantile regression model of Chernozhukov and Hansen (2005). A na\"ive estimation approach based on conditional moment conditions generated by the model would lead to a highly nonconvex and nonsmooth objective function. To overcome this problem, we propose a new presmoothing methodology. First, we estimate the model nonparametrically - and show that this nonparametric estimator has a closed-form solution in the leading case of interest of randomized experiments with one-sided noncompliance. Second, we use the nonparametric estimator to generate ``proxy'' observations for which exogeneity holds. Third, we apply the usual partial likelihood estimator to the ``proxy'' data. While the paper focuses on the proportional hazards model, our presmoothing approach could be applied to estimate other semiparametric formulations of the instrumental variable quantile regression model. Our estimation procedure allows for random right-censoring. We show asymptotic normality of the resulting estimator. The approach is illustrated via simulation studies and an empirical application to the Illinois


title: Integral equation methods for acoustic scattering by fractals

abstract: We study sound-soft time-harmonic acoustic scattering by general scatterers, including fractal scatterers, in 2D and 3D space. For an arbitrary compact scatterer $\Gamma$ we reformulate the Dirichlet boundary value problem for the Helmholtz equation as a first kind integral equation (IE) on $\Gamma$ involving the Newton potential. The IE is well-posed, except possibly at a countable set of frequencies, and reduces to existing single-layer boundary IEs when $\Gamma$ is the boundary of a bounded Lipschitz open set, a screen, or a multi-screen. When $\Gamma$ is uniformly of $d$-dimensional Hausdorff dimension in a sense we make precise (a $d$-set), the operator in our equation is an integral operator on $\Gamma$ with respect to $d$-dimensional Hausdorff measure, with kernel the Helmholtz fundamental solution, and we propose a piecewise-constant Galerkin discretization of the IE, which converges in the limit of vanishing mesh width. When $\Gamma$ is the fractal attractor of an iterated function system of contracting similarities we prove convergence rates under assumptions on $\Gamma$ and the IE solution, and describe a fully discrete implementation using recently proposed quadrature rules for singular integrals on fractals. We present numerical results for a range of examples and make our software available as a Julia code.


title: BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye View

abstract: 3D Single Object Tracking (SOT) is a fundamental task of computer vision, proving essential for applications like autonomous driving. It remains challenging to localize the target from surroundings due to appearance variations, distractors, and the high sparsity of point clouds. To address these issues, prior Siamese and motion-centric trackers both require elaborate designs and solving multiple subtasks. In this paper, we propose BEVTrack, a simple yet effective baseline method. By estimating the target motion in Bird's-Eye View (BEV) to perform tracking, BEVTrack demonstrates surprising simplicity from various aspects, i.e., network designs, training objectives, and tracking pipeline, while achieving superior performance. Besides, to achieve accurate regression for targets with diverse attributes (e.g., sizes and motion patterns), BEVTrack constructs the likelihood function with the learned underlying distributions adapted to different targets, rather than making a fixed Laplacian or Gaussian assumption as in previous works. This provides valuable priors for tracking and thus further boosts performance. While only using a single regression loss with a plain convolutional architecture, BEVTrack achieves state-of-the-art performance on three large-scale datasets, KITTI, NuScenes, and Waymo Open Dataset while maintaining a high inference speed of about 200 FPS. The code will be released at https://github.com/xmm-prio/BEVTrack.


title: AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections

abstract: Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with facial expression control and still has challenges in generating high-quality results. Towards applicable video avatars, we present an animatable 3D-aware GAN that generates portrait images with controllable facial expression, head pose, and shoulder movements. It is a generative model trained on unstructured 2D image collections without using 3D or video data. For the new task, we base our method on the generative radiance manifold representation and equip it with learnable facial and head-shoulder deformations. A dual-camera rendering and adversarial learning scheme is proposed to improve the quality of the generated faces, which is critical for portrait images. A pose deformation processing network is developed to generate plausible deformations for challenging regions such as long hair. Experiments show that our method, trained on unstructured 2D images, can generate diverse and high-quality 3D portraits with desired control over different properties.


title: On the origin of circular dichroism in angular resolved photoemission from graphene, graphite, and WSe$_2$ family of materials

abstract: Circular dichroism in angle-resolved photoemission (CD-ARPES) is one of the promising techniques for obtaining experimental insight into topological properties of novel materials, in particular to the orbital angular momentum (OAM) in dispersive bands, which might be related, albeit certainly in a non-trivial way, to the momentum resolved Berry curvature of the bands. Therefore, it is important to understand how non-vanishing CD-ARPES signal arises in graphene, a material where Dirac bands are made from C $|2p_z\rangle$ orbitals that carry zero OAM, spin-orbit-coupling (SOC) can be neglected, and Berry curvature effectively vanishes. Dubs et al., Phys. Rev. B 32, 8389 (1985) have demonstrated non-vanishing cricular dichroism in angular distribution (CDAD) from an oriented $p_z$ orbital, and this process can be responsible for the experimentally observed CD-ARPES in graphene. In this paper, we derive the CD-ARPES from $p_z$ orbitals by elementary means, using only simple algebraic formulas and tabulated numerical values, and show that it leads to significant CD-ARPES signal over the entire vacuum ultraviolet and soft x-ray energy range, with an exception of the photon energy region near $h\nu \approx 40$ eV. We also demonstrate that another process, emerging from the finite electron inelastic mean free path, also leads to CD-ARPES of the potentially similar order of magnitude, as previously discussed by Moser, J. Electron Spectrosc. Relat. Phenom. 214, 29 (2017). We present calculated CDAD maps for selected orbitals and briefly discuss the consequences of the findings for CD-ARPES, focusing on graphene, graphite and WSe$_2$.


title: Incorporating Dictionaries into a Neural Network Architecture to Extract COVID-19 Medical Concepts From Social Media

abstract: We investigate the potential benefit of incorporating dictionary information into a neural network architecture for natural language processing. In particular, we make use of this architecture to extract several concepts related to COVID-19 from an on-line medical forum. We use a sample from the forum to manually curate one dictionary for each concept. In addition, we use MetaMap, which is a tool for extracting biomedical concepts, to identify a small number of semantic concepts. For a supervised concept extraction task on the forum data, our best model achieved a macro $F_1$ score of 90\%. A major difficulty in medical concept extraction is obtaining labelled data from which to build supervised models. We investigate the utility of our models to transfer to data derived from a different source in two ways. First for producing labels via weak learning and second to perform concept extraction. The dataset we use in this case comprises COVID-19 related tweets and we achieve an $F_1$ score 81\% for symptom concept extraction trained on weakly labelled data. The utility of our dictionaries is compared with a COVID-19 symptom dictionary that was constructed directly from Twitter. Further experiments that incorporate BERT and a COVID-19 version of BERTweet demonstrate that the dictionaries provide a commensurate result. Our results show that incorporating small domain dictionaries to deep learning models can improve concept extraction tasks. Moreover, models built using dictionaries generalize well and are transferable to different datasets on a similar task.


title: Leveraging BERT Language Models for Multi-Lingual ESG Issue Identification

abstract: Environmental, Social, and Governance (ESG) has been used as a metric to measure the negative impacts and enhance positive outcomes of companies in areas such as the environment, society, and governance. Recently, investors have increasingly recognized the significance of ESG criteria in their investment choices, leading businesses to integrate ESG principles into their operations and strategies. The Multi-Lingual ESG Issue Identification (ML-ESG) shared task encompasses the classification of news documents into 35 distinct ESG issue labels. In this study, we explored multiple strategies harnessing BERT language models to achieve accurate classification of news documents across these labels. Our analysis revealed that the RoBERTa classifier emerged as one of the most successful approaches, securing the second-place position for the English test dataset, and sharing the fifth-place position for the French test dataset. Furthermore, our SVM-based binary model tailored for the Chinese language exhibited exceptional performance, earning the second-place rank on the test dataset.


title: Exchanging-based Multimodal Fusion with Transformer

abstract: We study the problem of multimodal fusion in this paper. Recent exchanging-based methods have been proposed for vision-vision fusion, which aim to exchange embeddings learned from one modality to the other. However, most of them project inputs of multimodalities into different low-dimensional spaces and cannot be applied to the sequential input data. To solve these issues, in this paper, we propose a novel exchanging-based multimodal fusion model MuSE for text-vision fusion based on Transformer. We first use two encoders to separately map multimodal inputs into different low-dimensional spaces. Then we employ two decoders to regularize the embeddings and pull them into the same space. The two decoders capture the correlations between texts and images with the image captioning task and the text-to-image generation task, respectively. Further, based on the regularized embeddings, we present CrossTransformer, which uses two Transformer encoders with shared parameters as the backbone model to exchange knowledge between multimodalities. Specifically, CrossTransformer first learns the global contextual information of the inputs in the shallow layers. After that, it performs inter-modal exchange by selecting a proportion of tokens in one modality and replacing their embeddings with the average of embeddings in the other modality. We conduct extensive experiments to evaluate the performance of MuSE on the Multimodal Named Entity Recognition task and the Multimodal Sentiment Analysis task. Our results show the superiority of MuSE against other competitors. Our code and data are provided at https://github.com/RecklessRonan/MuSE.


title: Spectrum of the molecular tetraquarks: Unraveling the $T_{cs0}(2900)$ and $T_{c\bar{s}0}^a(2900)$

abstract: We relate the interactions of the $\bar{D}^{(\ast)} K^\ast$ and $D^{(\ast)} K^\ast$ systems to those of $D^{(\ast)}D^{(\ast)}$ and $D^{(\ast)}\bar{D}^{(\ast)}$ respectively, considering the residual strong interactions at the near-threshold energy is too weak to excite the strange quarks inside the hadrons. We propose an effective model to describe the low-energy S-wave interactions that are undertaken by the light $u$, $d$ quarks between two separated heavy hadrons. We find that the existence of molecules in the heavy-(anti)heavy sectors will naturally lead to the emergence of molecular states in $\bar{D}^{(\ast)} K^\ast$ and $D^{(\ast)} K^\ast$ systems. The recently observed $T_{cs0}(2900)$ and $T_{c\bar{s}0}^a(2900)$ can be well identified as the $0(0^+)$ and $1(0^+)$ partners of $T_{cc}(3875)$ and $Z_c(3900)$ in the charmed strange sector, respectively. We also predict their members under the {\it heavy} ($c$ and $s$) quark symmetry and SU(2) flavor symmetry. Most of them are very good molecule candidates, for example, (i) the $0(1^+)$ states in $D^\ast D^\ast$, $\bar{D}K^\ast$, $\bar{D}^\ast K^\ast$; (ii) the $0^{(+)}(2^{+(+)})$ states in $D^\ast \bar{D}^\ast$, $\bar{D}^\ast K^\ast$, $D^\ast K^\ast$; (iii) the $1^-(0^{++})$ state in $D^\ast\bar{D}^\ast$ and $1(1^+)$ state in $D^\ast K^\ast$. The $0^+(0^{++})$ state in $D\bar{D}$ and the $0(1^+)$ state in $DK^\ast$ might also exist as virtual states, and the $0(1^+)$ $DK^\ast$ can serve as a key to infer the existence of $0^+(0^{++})$ $D\bar{D}$. The $D_s\pi$ invariant mass spectrum of $T_{c\bar{s}0}^a(2900)$ is also studied within the coupled-channel approach, and the molecular interpretation of $T_{c\bar{s}0}^a(2900)$ is consistent with the experimental data. Searching for the predicted states in experiments is crucial to discriminate the different pictures for interpreting these near-threshold exotica.


title: Commutators for the maximal and sharp functions with weighted Lipschitz functions on weighted Morrey spaces

abstract: We study the boundedness of commutators of the Hardy-Littlewood maximal function and the sharp maximal function on weighted Morrey spaces when the symbols of the commutators belong to weighted Lipschitz spaces. Some new characterizations for weighted Lipschitz functions are obtained in term of the boundedness of the commutators.


title: Personalized Federated Deep Reinforcement Learning-based Trajectory Optimization for Multi-UAV Assisted Edge Computing

abstract: In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments, optimizing their flight trajectories to maximize communication system throughput. Deep reinforcement learning (DRL)-based trajectory optimization algorithms may suffer from poor training performance due to intricate terrain features and inadequate training data. To overcome this limitation, some studies have proposed leveraging federated learning (FL) to mitigate the data isolation problem and expedite convergence. Nevertheless, the efficacy of global FL models can be negatively impacted by the high heterogeneity of local data, which could potentially impede the training process and even compromise the performance of local agents. This work proposes a novel solution to address these challenges, namely personalized federated deep reinforcement learning (PF-DRL), for multi-UAV trajectory optimization. PF-DRL aims to develop individualized models for each agent to address the data scarcity issue and mitigate the negative impact of data heterogeneity. Simulation results demonstrate that the proposed algorithm achieves superior training performance with faster convergence rates, and improves service quality compared to other DRL-based approaches.


title: Estimating stellar population and emission line properties in S-PLUS galaxies

abstract: We present tests of a new method to simultaneously estimate stellar population and emission line (EL) properties of galaxies out of S-PLUS photometry. The technique uses the AlStar code, updated with an empirical prior which greatly improves its ability to estimate ELs using only the survey's 12 bands. The tests compare the output of (noise-perturbed) synthetic photometry of SDSS galaxies to properties derived from previous full spectral fitting and detailed EL analysis. For realistic signal-to-noise ratios, stellar population properties are recovered to better than 0.2 dex in masses, mean ages, metallicities and $\pm 0.2$ mag for the extinction. More importantly, ELs are recovered remarkably well for a photometric survey. We obtain input $-$ output dispersions of 0.05--0.2 dex for the equivalent widths of $[\mathrm{O}\,\rm{II}]$, $[\mathrm{O}\,\rm{III}]$, H$\beta$, H$\alpha$, $[\mathrm{N}\,\rm{II}]$, and $[\mathrm{S}\,\rm{II}]$, and even better for lines stronger than $\sim 5$ $\mathring{A}$. These excellent results are achieved by combining two empirical facts into a prior which restricts the EL space available for the fits: (1) Because, for the redshifts explored here, H$\alpha$ and $[\mathrm{N}\,\rm{II}]$ fall in a single narrow band (J0660), their combined equivalent width is always well recovered, even when $[\mathrm{N}\,\rm{II}]$/H$\alpha$ is not. (2) We know from SDSS that $W_{H\alpha+[\mathrm{N}\,\rm{II}]}$ correlates with $[\mathrm{N}\,\rm{II}]$/H$\alpha$, which can be used to tell if a galaxy belongs to the left or right wings in the classical BPT diagnostic diagram. Example applications to integrated light and spatially resolved data are also presented, including a comparison with independent results obtained with MUSE-based integral field spectroscopy.


title: Sparse Function-space Representation of Neural Networks

abstract: Deep neural networks (NNs) are known to lack uncertainty estimates and struggle to incorporate new data. We present a method that mitigates these issues by converting NNs from weight space to function space, via a dual parameterization. Importantly, the dual parameterization enables us to formulate a sparse representation that captures information from the entire data set. This offers a compact and principled way of capturing uncertainty and enables us to incorporate new data without retraining whilst retaining predictive performance. We provide proof-of-concept demonstrations with the proposed approach for quantifying uncertainty in supervised learning on UCI benchmark tasks.


title: Finite dimensional backstepping controller design

abstract: We introduce a finite dimensional version of backstepping controller design for stabilizing solutions of PDEs from boundary. Our controller uses only a finite number of Fourier modes of the state of solution, as opposed to the classical backstepping controller which uses all (infinitely many) modes. We apply our method to the reaction-diffusion equation, which serves only as a canonical example but the method is applicable also to other PDEs whose solutions can be decomposed into a slow finite-dimensional part and a fast tail, where the former dominates the evolution in large time. One of the main goals is to estimate the sufficient number of modes needed to stabilize the plant at a prescribed rate. In addition, we find the minimal number of modes that guarantee the stabilization at a certain (unprescribed) decay rate. Theoretical findings are supported with numerical solutions.


title: Delving into Ipsilateral Mammogram Assessment under Multi-View Network

abstract: In many recent years, multi-view mammogram analysis has been focused widely on AI-based cancer assessment. In this work, we aim to explore diverse fusion strategies (average and concatenate) and examine the model's learning behavior with varying individuals and fusion pathways, involving Coarse Layer and Fine Layer. The Ipsilateral Multi-View Network, comprising five fusion types (Pre, Early, Middle, Last, and Post Fusion) in ResNet-18, is employed. Notably, the Middle Fusion emerges as the most balanced and effective approach, enhancing deep-learning models' generalization performance by +2.06% (concatenate) and +5.29% (average) in VinDr-Mammo dataset and +2.03% (concatenate) and +3% (average) in CMMD dataset on macro F1-Score. The paper emphasizes the crucial role of layer assignment in multi-view network extraction with various strategies.


title: Average-atom Ziman resistivity calculations in expanded metallic plasmas: effect of mean ionization definition

abstract: We present calculations of electrical resistivity for expanded boron, aluminum, titanium and copper plasmas using the Ziman formulation in the framework of the average-atom model. Our results are compared to experimental data, as well as with other theoretical calculations, relying on the Ziman and Kubo-Greenwood formulations, and based on average-atom models or quantum-molecular-dynamics simulations. The impact of the definition of ionization, paying a particular attention to the consistency between the latter and the perfect free electron gas assumption made in the formalism, is discussed. We propose a definition of the mean ionization generalizing to expanded plasmas the idea initially put forward for dense plasmas, consisting in dropping the contribution of quasi-bound states from the ionization due to continuum ones. It is shown that our recommendation for the calculation of the quasi-bound density of states provides the best agreement with measurements.


title: Space charge and screening of a supercritical impurity cluster in monolayer graphene

abstract: Coulomb impurity of charge $Ze$ is known to destabilize the ground state of undoped graphene with respect to creation of screening space charge if $Z$ exceeds a critical value of $1/2\alpha$ set by material's fine structure constant $\alpha$. Recent experimental advances made it possible to explore this transition in a controlled manner by tuning $Z$ across the critical point. Combined with relatively large value of $\alpha$ this opens a possibility to study graphene's screening response to a supercritical impurity $Z\alpha\gg1$ when the screening charge is large, and the Thomas-Fermi analysis, that we revisit, is adequate. The character of screening in this regime is controlled by the dimensionless screening parameter $Z\alpha^{2}$. Specifically, for circular impurity cluster most of the screening charge in the weak-screening regime $Z\alpha^{2}\ll1$ is found to reside outside the cluster. The strong-screening regime $Z\alpha^{2}\gg1$ provides a realization of the Thomson atom: most of the screening charge is inside the cluster nearly perfectly neutralizing the source charge with the exception of a transition layer near cluster's edge where the rest of the space charge is localized.


title: Run for Cover: Dominating Set via Mobile Agents

abstract: Research involving computing with mobile agents is a fast-growing field, given the advancement of technology in automated systems, e.g., robots, drones, self-driving cars, etc. Therefore, it is pressing to focus on solving classical network problems using mobile agents. In this paper, we study one such problem -- finding small dominating sets of a graph $G$ using mobile agents. Dominating set is interesting in the field of mobile agents as it opens up a way for solving various robotic problems, e.g., guarding, covering, facility location, transport routing, etc. In this paper, we first present two algorithms for computing a {\em minimal dominating set}: (i) an $O(m)$ time algorithm if the robots start from a single node (i.e., gathered initially), (ii) an $O(\ell\Delta\log(\lambda)+n\ell+m)$ time algorithm, if the robots start from multiple nodes (i.e., positioned arbitrarily), where $m$ is the number of edges and $\Delta$ is the maximum degree of $G$, $\ell$ is the number of clusters of the robot initially and $\lambda$ is the maximum ID-length of the robots. Then we present a $\ln (\Delta)$ approximation algorithm for the {\em minimum} dominating set which takes $O(n\Delta\log (\lambda))$ rounds.


title: Principle of minimal singularity for Green's functions

abstract: Analytic continuations of integer-valued parameters can lead to profound insights, such as angular momentum in Regge theory, the number of replicas in spin glasses, the number of internal degrees of freedom, the spacetime dimension in dimensional regularization and Wilson's renormalization group. In this work, we consider a new kind of analytic continuation of correlation functions, inspired by two recent approaches to underdetermined Dyson-Schwinger equations in $D$-dimensional spacetime. If the Green's functions $G_n=\langle\phi^n\rangle$ admit analytic continuation to complex values of $n$, the two different approaches are unified by a novel principle for self-consistent problems: Singularities in the complex plane should be minimal. This principle manifests as the merging of different branches of Green's functions in the quartic theories. For $D=0$, we obtain the closed-form solutions of the general $g\phi^m$ theories, including the cases with complex coupling constant $g$ or non-integer power $m$. For $D=1$, we derive rapidly convergent results for the Hermitian quartic and non-Hermitian cubic theories by minimizing the complexity of the singularity at $n=\infty$.


title: On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence

abstract: Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies to name a few. Motivated by the data privacy concerns invoked by these applications, we study the problem of BAI with fixed confidence under $\epsilon$-global Differential Privacy (DP). First, to quantify the cost of privacy, we derive a lower bound on the sample complexity of any $\delta$-correct BAI algorithm satisfying $\epsilon$-global DP. Our lower bound suggests the existence of two privacy regimes depending on the privacy budget $\epsilon$. In the high-privacy regime (small $\epsilon$), the hardness depends on a coupled effect of privacy and a novel information-theoretic quantity, called the Total Variation Characteristic Time. In the low-privacy regime (large $\epsilon$), the sample complexity lower bound reduces to the classical non-private lower bound. Second, we propose AdaP-TT, an $\epsilon$-global DP variant of the Top Two algorithm. AdaP-TT runs in arm-dependent adaptive episodes and adds Laplace noise to ensure a good privacy-utility trade-off. We derive an asymptotic upper bound on the sample complexity of AdaP-TT that matches with the lower bound up to multiplicative constants in the high-privacy regime. Finally, we provide an experimental analysis of AdaP-TT that validates our theoretical results.


title: Meromorphic Projective Structures, Opers and Monodromy

abstract: The complex projective structures considered is this article are compact curves locally modeled on $\mathbb{CP}^1$. To such a geometric object, modulo marked isomorphism, the monodromy map associates an algebraic one: a representation of its fundamental group into $\operatorname{PGL}(2,\mathbb{C})$, modulo conjugacy. This correspondence is neither surjective nor injective. Nonetheless, it is a local diffeomorphism [Hejhal, 1975]. We generalize this theorem to projective structures admitting poles (without apparent singularity and with fixed residues): the corresponding monodromy map (including Stokes data) is a local biholomorphism.


title: Signatures and characterization of dominating Kerr nonlinearity between two driven systems with application to a suspended magnetic beam

abstract: We consider a model of two harmonically driven damped harmonic oscillators that are coupled linearly and with a cross-Kerr coupling. We show how to distinguish this combination of coupling types from the case where a coupling of optomechanical type is present. This can be useful for the characterization of various nonlinear systems, such as mechanical oscillators, qubits, and hybrid systems. We then consider a hybrid system with linear and cross-Kerr interactions and a relatively high damping in one of the modes. We derive a quantum Hamiltonian of a doubly clamped magnetic beam, showing that the cross-Kerr coupling is prominent there. We discuss, in the classical limit, measurements of its linear response as well as the specific higher-harmonic responses. These frequency-domain measurements can allow estimating the magnitude of the cross-Kerr coupling or its magnon population.


title: On statistical arbitrage under a conditional factor model of equity returns

abstract: We consider a conditional factor model for a multivariate portfolio of United States equities in the context of analysing a statistical arbitrage trading strategy. A state space framework underlies the factor model whereby asset returns are assumed to be a noisy observation of a linear combination of factor values and latent factor risk premia. Filter and state prediction estimates for the risk premia are retrieved in an online way. Such estimates induce filtered asset returns that can be compared to measurement observations, with large deviations representing candidate mean reversion trades. Further, in that the risk premia are modelled as time-varying quantities, non-stationarity in returns is de facto captured. We study an empirical trading strategy respectful of transaction costs, and demonstrate performance over a long history of 29 years, for both a linear and a non-linear state space model. Our results show that the model is competitive relative to the results of other methods, including simple benchmarks and other cutting-edge approaches as published in the literature. Also of note, while strategy performance degradation is noticed through time -- especially for the most recent years -- the strategy continues to offer compelling economics, and has scope for further advancement.


title: Language Models for Novelty Detection in System Call Traces

abstract: Due to the complexity of modern computer systems, novel and unexpected behaviors frequently occur. Such deviations are either normal occurrences, such as software updates and new user activities, or abnormalities, such as misconfigurations, latency issues, intrusions, and software bugs. Regardless, novel behaviors are of great interest to developers, and there is a genuine need for efficient and effective methods to detect them. Nowadays, researchers consider system calls to be the most fine-grained and accurate source of information to investigate the behavior of computer systems. Accordingly, this paper introduces a novelty detection methodology that relies on a probability distribution over sequences of system calls, which can be seen as a language model. Language models estimate the likelihood of sequences, and since novelties deviate from previously observed behaviors by definition, they would be unlikely under the model. Following the success of neural networks for language models, three architectures are evaluated in this work: the widespread LSTM, the state-of-the-art Transformer, and the lower-complexity Longformer. However, large neural networks typically require an enormous amount of data to be trained effectively, and to the best of our knowledge, no massive modern datasets of kernel traces are publicly available. This paper addresses this limitation by introducing a new open-source dataset of kernel traces comprising over 2 million web requests with seven distinct behaviors. The proposed methodology requires minimal expert hand-crafting and achieves an F-score and AuROC greater than 95% on most novelties while being data- and task-agnostic. The source code and trained models are publicly available on GitHub while the datasets are available on Zenodo.


title: The scaling law of the arrival time of spin systems that present pretty good transmission

abstract: The pretty good transmission scenario implies that the probability of sending one excitation from one extreme of a spin chain to the other can reach values arbitrarily close to the unity just by waiting a time long enough. The conditions that ensure the appearance of this scenario are known for chains with different interactions and lengths. Sufficient conditions for the presence of pretty good transmission depend on the spectrum of the Hamiltonian of the spin chain. Some works suggest that the time $t_{\varepsilon}$ at which the pretty good transmission takes place scales as $1/(|\varepsilon|)^{f(N)}$, where $\varepsilon$ is the difference between the probability that a single excitation propagates from one extreme of the chain to the other and the unity, while $f(N)$ is an unknown function of the chain length. In this paper, we show that the exponent is not a simple function of the chain length but a power law of the number of linearly independent irrational eigenvalues of the one-excitation block of the Hamiltonian that enter into the expression of the probability of transmission of one excitation. We explicitly provide examples of a chain showing that the exponent changes when the couplings between the spins change while the length remains fixed. For centrosymmetric spin chains the exponent is at most $N/2$.


title: Convergent finite difference schemes for stochastic transport equations

abstract: We present difference schemes for stochastic transport equations with low-regularity velocity fields. We establish $L^2$ stability and convergence of the difference approximations under conditions that are less strict than those required for deterministic transport equations. The $L^2$ estimate, crucial for the analysis, is obtained through a discrete duality argument and a comprehensive examination of a class of backward parabolic difference schemes.


title: Edukoi: developing an interactive sonification tool for astronomy between entertainment and education

abstract: Edukoi is a software that aims to make interactive sonification suitable to convey and extract information. The program design is a modification of the software Herakoi, which sonifies images in real time mapping pitch to colour using a motion-aware approach for allowing users to interact with images through sound. The pitch-colour association of Hearkoi, albeit pleasing from the entertainment side, is not efficient for communicating specific information regarding colours and hues to listeners. Hence we modified it to create an instrument to be used by visually impaired and sighted children to explore images through sound and extract accurate information. We aim at building a flexible software that can be used in middle-schools for both art and science teaching. We tested its effectiveness using astronomical images, given the great fascination that astronomy always has on kids of all ages and backgrounds. Astronomy is also considered a very visual science, a characteristic that prevents students from learning this subject and having a related career. With this project we aim to challenge this belief and give to students the possibility to explore astronomical data through sound. Here we discuss our experiment, the choices we made regarding sound mappings, and what psychophysiological aspects we aim to evaluate to validate and improve Edukoi.


title: Continual Cross-Dataset Adaptation in Road Surface Classification

abstract: Accurate road surface classification is crucial for autonomous vehicles (AVs) to optimize driving conditions, enhance safety, and enable advanced road mapping. However, deep learning models for road surface classification suffer from poor generalization when tested on unseen datasets. To update these models with new information, also the original training dataset must be taken into account, in order to avoid catastrophic forgetting. This is, however, inefficient if not impossible, e.g., when the data is collected in streams or large amounts. To overcome this limitation and enable fast and efficient cross-dataset adaptation, we propose to employ continual learning finetuning methods designed to retain past knowledge while adapting to new data, thus effectively avoiding forgetting. Experimental results demonstrate the superiority of this approach over naive finetuning, achieving performance close to fresh retraining. While solving this known problem, we also provide a general description of how the same technique can be adopted in other AV scenarios. We highlight the potential computational and economic benefits that a continual-based adaptation can bring to the AV industry, while also reducing greenhouse emissions due to unnecessary joint retraining.


title: Distributionally Robust Machine Learning with Multi-source Data

abstract: Classical machine learning methods may lead to poor prediction performance when the target distribution differs from the source populations. This paper utilizes data from multiple sources and introduces a group distributionally robust prediction model defined to optimize an adversarial reward about explained variance with respect to a class of target distributions. Compared to classical empirical risk minimization, the proposed robust prediction model improves the prediction accuracy for target populations with distribution shifts. We show that our group distributionally robust prediction model is a weighted average of the source populations' conditional outcome models. We leverage this key identification result to robustify arbitrary machine learning algorithms, including, for example, random forests and neural networks. We devise a novel bias-corrected estimator to estimate the optimal aggregation weight for general machine-learning algorithms and demonstrate its improvement in the convergence rate. Our proposal can be seen as a distributionally robust federated learning approach that is computationally efficient and easy to implement using arbitrary machine learning base algorithms, satisfies some privacy constraints, and has a nice interpretation of different sources' importance for predicting a given target covariate distribution. We demonstrate the performance of our proposed group distributionally robust method on simulated and real data with random forests and neural networks as base-learning algorithms.


title: Detecting quantum speedup of random walks with machine learning

abstract: We explore the use of machine-learning techniques to detect quantum speedup in random walks on graphs. Specifically, we investigate the performance of three different neural-network architectures (variations on fully connected and convolutional neural networks) for identifying linear, cyclic, and random graphs that yield quantum speedups in terms of the hitting time for reaching a target node after starting in another node of the graph. Our results indicate that carefully building the data set for training can improve the performance of the neural networks, but all architectures we test struggle to classify large random graphs and generalize from training on one graph size to testing on another. If classification accuracy can be improved further, valuable insights about quantum advantage may be gleaned from these neural networks, not only for random walks, but more generally for quantum computing and quantum transport.


title: Bayesian Bi-clustering of Neural Spiking Activity with Latent Structures

abstract: Modern neural recording techniques allow neuroscientists to obtain spiking activity of multiple neurons from different brain regions over long time periods, which requires new statistical methods to be developed for understanding structure of the large-scale data. In this paper, we develop a bi-clustering method to cluster the neural spiking activity spatially and temporally, according to their low-dimensional latent structures. The spatial (neuron) clusters are defined by the latent trajectories within each neural population, while the temporal (state) clusters are defined by (populationally) synchronous local linear dynamics shared with different periods. To flexibly extract the bi-clustering structure, we build the model non-parametrically, and develop an efficient Markov chain Monte Carlo (MCMC) algorithm to sample the posterior distributions of model parameters. Validating our proposed MCMC algorithm through simulations, we find the method can recover unknown parameters and true bi-clustering structures successfully. We then apply the proposed bi-clustering method to multi-regional neural recordings under different experiment settings, where we find that simultaneously considering latent trajectories and spatial-temporal clustering structures can provide us with a more accurate and interpretable result. Overall, the proposed method provides scientific insights for large-scale (counting) time series with elongated recording periods, and it can potentially have application beyond neuroscience.


title: Improving equilibrium propagation without weight symmetry through Jacobian homeostasis

abstract: Equilibrium propagation (EP) is a compelling alternative to the backpropagation of error algorithm (BP) for computing gradients of neural networks on biological or analog neuromorphic substrates. Still, the algorithm requires weight symmetry and infinitesimal equilibrium perturbations, i.e., nudges, to estimate unbiased gradients efficiently. Both requirements are challenging to implement in physical systems. Yet, whether and how weight asymmetry affects its applicability is unknown because, in practice, it may be masked by biases introduced through the finite nudge. To address this question, we study generalized EP, which can be formulated without weight symmetry, and analytically isolate the two sources of bias. For complex-differentiable non-symmetric networks, we show that the finite nudge does not pose a problem, as exact derivatives can still be estimated via a Cauchy integral. In contrast, weight asymmetry introduces bias resulting in low task performance due to poor alignment of EP's neuronal error vectors compared to BP. To mitigate this issue, we present a new homeostatic objective that directly penalizes functional asymmetries of the Jacobian at the network's fixed point. This homeostatic objective dramatically improves the network's ability to solve complex tasks such as ImageNet 32x32. Our results lay the theoretical groundwork for studying and mitigating the adverse effects of imperfections of physical networks on learning algorithms that rely on the substrate's relaxation dynamics.


title: Rayleigh-Jeans thermalization vs beam cleaning in multimode optical fibers

abstract: Classical nonlinear waves exhibit, as a general rule, an irreversible process of thermalization toward the Rayleigh-Jeans equilibrium distribution. On the other hand, several recent experiments revealed a remarkable effect of spatial organization of an optical beam that propagates through a graded-index multimode optical fiber (MMF), a phenomenon termed beam self-cleaning. Our aim here is to evidence the qualitative impact of disorder (weak random mode coupling) on the process of Rayleigh-Jeans thermalization by considering two different experimental configurations. In a first experiment, we launch speckle beams in a relatively long MMF. Our results report a clear and definite experimental demonstration of Rayleigh-Jeans thermalization through light propagation in MMFs, over a broad range of kinetic energy (i.e., degree of spatial coherence) of the injected speckle beam. In particular, the property of energy equipartition among the modes is clearly observed in the condensed regime. The experimental results also evidence the double turbulence cascade process: while the power flows toward the fundamental mode (inverse cascade), the energy flows toward the higher-order modes (direct cascade). In a 2nd experiment, a coherent laser beam is launched into a relatively short MMF length. It reveals an effect of beam cleaning driven by an incipient process of Rayleigh-Jeans thermalization. As discussed through numerical simulations, the fast process of Rayleigh-Jeans thermalization observed in the 1st experiment can be attributed due to a random phase dynamics among the modes, which is favoured by the injection of a speckle beam and the increased impact of disorder in the long fiber system.


title: Unveiling the electronic properties of BiP$_3$ triphosphide from bulk to graphene-based heterostructure by first-principles calculations

abstract: Triphosphides, with a chemical formula of XP$_3$ (X is a group IIIA, IVA, or VA element), have recently attracted much attention due to their great potential in several applications. Here, using density functional theory calculations, we describe for the first time the structural and electronic properties of the bulk bismuth triphosphide (BiP$_3$). Phonon spectra and molecular dynamics simulations confirm that the 3D crystal of BiP$_3$ is a metal thermodynamically stable with no bandgap. Unlike the bulk, the mono-, bi-, tri-, and tetra-layers of BiP$_3$ are semiconductors with a bandgap ranging from 1.4 to 0.06 eV. However, stackings with more than five layers exhibit metallic behavior equal to the bulk. The results show that quantum confinement is a powerful tool for tuning the electronic properties of BiP$_3$ triphosphide, making it suitable for technological applications. Building on this, the electronic properties of van der Waals heterostructure constructed by graphene (G) and the BiP$_3$ monolayer (m-BiP$_3$) were investigated. Our results show that the Dirac cone in graphene remains intact in this heterostructure. At the equilibrium interlayer distance, the G/m-BiP$_3$ forms an n-type contact with a Schottky barrier height of 0.5 eV. It is worth noting that the SHB in the G/m-BiP$_3$ heterostructure can be adjusted by changing the interlayer distance or applying a transverse electric field. Thus, we show that few-layers BiP$_3$ is an interesting material for realizing nanoelectronic and optoelectronic devices and is an excellent option for designing Schottky nanoelectronic devices.


title: Advanced Underwater Image Restoration in Complex Illumination Conditions

abstract: Underwater image restoration has been a challenging problem for decades since the advent of underwater photography. Most solutions focus on shallow water scenarios, where the scene is uniformly illuminated by the sunlight. However, the vast majority of uncharted underwater terrain is located beyond 200 meters depth where natural light is scarce and artificial illumination is needed. In such cases, light sources co-moving with the camera, dynamically change the scene appearance, which make shallow water restoration methods inadequate. In particular for multi-light source systems (composed of dozens of LEDs nowadays), calibrating each light is time-consuming, error-prone and tedious, and we observe that only the integrated illumination within the viewing volume of the camera is critical, rather than the individual light sources. The key idea of this paper is therefore to exploit the appearance changes of objects or the seafloor, when traversing the viewing frustum of the camera. Through new constraints assuming Lambertian surfaces, corresponding image pixels constrain the light field in front of the camera, and for each voxel a signal factor and a backscatter value are stored in a volumetric grid that can be used for very efficient image restoration of camera-light platforms, which facilitates consistently texturing large 3D models and maps that would otherwise be dominated by lighting and medium artifacts. To validate the effectiveness of our approach, we conducted extensive experiments on simulated and real-world datasets. The results of these experiments demonstrate the robustness of our approach in restoring the true albedo of objects, while mitigating the influence of lighting and medium effects. Furthermore, we demonstrate our approach can be readily extended to other scenarios, including in-air imaging with artificial illumination or other similar cases.


title: Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models

abstract: The rise of deepfake images, especially of well-known personalities, poses a serious threat to the dissemination of authentic information. To tackle this, we present a thorough investigation into how deepfakes are produced and how they can be identified. The cornerstone of our research is a rich collection of artificial celebrity faces, titled DeepFakeFace (DFF). We crafted the DFF dataset using advanced diffusion models and have shared it with the community through online platforms. This data serves as a robust foundation to train and test algorithms designed to spot deepfakes. We carried out a thorough review of the DFF dataset and suggest two evaluation methods to gauge the strength and adaptability of deepfake recognition tools. The first method tests whether an algorithm trained on one type of fake images can recognize those produced by other methods. The second evaluates the algorithm's performance with imperfect images, like those that are blurry, of low quality, or compressed. Given varied results across deepfake methods and image changes, our findings stress the need for better deepfake detectors. Our DFF dataset and tests aim to boost the development of more effective tools against deepfakes.


title: New insight on the nature of cosmic reionizers from the CEERS survey

abstract: The Epoch of Reionization (EoR) began when galaxies grew in abundance and luminosity, so their escaping Lyman continuum (LyC) radiation started ionizing the surrounding neutral intergalactic medium (IGM). Despite significant recent progress, the nature and role of cosmic reionizers are still unclear: in order to define them, it would be necessary to directly measure their LyC escape fraction ($f_{esc}$). However, this is impossible during the EoR due to the opacity of the IGM. Consequently, many efforts at low and intermediate redshift have been made to determine measurable indirect indicators in high-redshift galaxies so that their $f_{esc}$ can be predicted. This work presents the analysis of the indirect indicators of 62 spectroscopically confirmed star-forming galaxies at $6 \leq z \leq 9$ from the Cosmic Evolution Early Release Science (CEERS) survey, combined with 12 sources with public data from other JWST-ERS campaigns. From the NIRCam and NIRSpec observations, we measured their physical and spectroscopic properties. We discovered that on average $6<z<9$ star-forming galaxies are compact in the rest-frame UV ($r_e \sim $ 0.4 kpc), are blue sources (UV-$\beta$ slope $\sim $ -2.17), and have a predicted $f_{esc}$ of about 0.13. A comparison of our results to models and predictions as well as an estimation of the ionizing budget suggests that low-mass galaxies with UV magnitudes fainter than $M_{1500} = -18$ that we currently do not characterize with JWST observations probably played a key role in the process of reionization.


title: Mars orientation and rotation angles

abstract: The rotation and orientation of Mars is commonly described using two different sets of angles, namely the Euler angles wrt the Mars orbit plane and the right ascension, declination, and prime meridian location angles wrt the Earth equator at J2000 (as adopted by the IAU). We propose a formulation for both these sets of angles, which consists of the sum of a second degree polynomial and of periodic and Poisson series. Such a formulation is shown here to enable accurate (and physically sound) transformation from one set of angles to the other. The transformation formulas are provided and discussed in this paper. In particular, we point that the quadratic and Poisson terms are key ingredients to reach a transformation precision of 0.1 mas, even 30 years away from the reference epoch of the rotation model (e.g. J2000). Such a precision is required to accurately determine the smaller and smaller geophysical signals observed in the high-accuracy data acquired from the surface of Mars. In addition, we present good practices to build an accurate Martian rotation model over a long time span (30 years around J2000) or over a shorter one (e.g. lifetime of a space mission). We recommend to consider the J2000 mean orbit of Mars as the reference plane for Euler angles. An accurate rotation model should make use of up-to-date models for the rigid and liquid nutations, relativistic corrections in rotation, and polar motion induced by the external torque. Our transformation model and recommendations can be used to define the future IAU solution for the rotation and orientation of Mars using right ascension, declination, and prime meridian location. In particular, thanks to its quadratic terms, our transformation model does not introduce arbitrary and non-physical terms of very long period and large amplitudes, thus providing unbiased values of the rates and epoch values of the angles.


title: Improving students' code correctness and test completeness by informal specifications

abstract: The quality of software produced by students is often poor. How to teach students to develop good quality software has long been a topic in computer science education and research. We must conclude that we still do not have a good answer to this question. Specifications are necessary to determine the correctness of software, to develop error-free software and to write complete tests. Several attempts have been made to teach students to write specifications before writing code. So far, that has not proven to be very successful: Students do not like to write a specification and do not see the benefits of writing specifications. In this paper we focus on the use of informal specifications. Instead of teaching students how to write specifications, we teach them how to use informal specifications to develop correct software. The results were surprising: the number of errors in software and the completeness of tests both improved considerably and, most importantly, students really appreciate the specifications. We think that if students appreciate specification, we have a key to teach them how to specify and to appreciate its value.


title: Unconventional photo-induced charge-density-wave dynamics in 2H-NbSe$_{2}$

abstract: We investigated temperature ($T$) dependent ultrafast near-infrared (NIR) transient reflectivity dynamics in coexisting superconducting (SC) and charge density wave (CDW) phases of two-dimensional 2H-NbSe$_{2}$ using NIR and visible excitations. With visible pump-photon excitation (400 nm) we find a slow high-energy quasiparticle relaxation channel which is present in all phases. In the CDW phase, we observe a distinctive transient response component, irrespective of the pump-photon energy. The component is marked by the absence of coherent amplitude mode oscillations and a relatively slow, picosecond rise time, which is different than in most of the typical CDW materials. In the SC phase, another tiny component emerges that is associated with optical suppression of the SC phase. The transient reflectivity relaxation in the CDW phase is dominated by phonon diffusive processes with an estimated low-$T$ heat diffusion constant anisotropy of $\sim30$. Strong excitation of the CDW phase reveals a weakly non-thermal CDW order parameter (OP) suppression. Unlike CDW systems with a larger gap, where the optical OP suppression involves only a small fraction of phonon degrees of freedom, the OP suppression in 2H-NbSe$_{2}$ is characterised by the excitation of a large amount of phonon degrees of freedom and significantly slower dynamics.


title: The Worst-Case Complexity of Symmetric Strategy Improvement

abstract: Symmetric strategy improvement is an algorithm introduced by Schewe et al. (ICALP 2015) that can be used to solve two-player games on directed graphs such as parity games and mean payoff games. In contrast to the usual well-known strategy improvement algorithm, it iterates over strategies of both players simultaneously. The symmetric version solves the known worst-case examples for strategy improvement quickly, however its worst-case complexity remained open. We present a class of worst-case examples for symmetric strategy improvement on which this symmetric version also takes exponentially many steps. Remarkably, our examples exhibit this behaviour for any choice of improvement rule, which is in contrast to classical strategy improvement where hard instances are usually hand-crafted for a specific improvement rule. We present a generalized version of symmetric strategy iteration depending less rigidly on the interplay of the strategies of both players. However, it turns out it has the same shortcomings.


title: Dense Object Grounding in 3D Scenes

abstract: Localizing objects in 3D scenes according to the semantics of a given natural language is a fundamental yet important task in the field of multimedia understanding, which benefits various real-world applications such as robotics and autonomous driving. However, the majority of existing 3D object grounding methods are restricted to a single-sentence input describing an individual object, which cannot comprehend and reason more contextualized descriptions of multiple objects in more practical 3D cases. To this end, we introduce a new challenging task, called 3D Dense Object Grounding (3D DOG), to jointly localize multiple objects described in a more complicated paragraph rather than a single sentence. Instead of naively localizing each sentence-guided object independently, we found that dense objects described in the same paragraph are often semantically related and spatially located in a focused region of the 3D scene. To explore such semantic and spatial relationships of densely referred objects for more accurate localization, we propose a novel Stacked Transformer based framework for 3D DOG, named 3DOGSFormer. Specifically, we first devise a contextual query-driven local transformer decoder to generate initial grounding proposals for each target object. Then, we employ a proposal-guided global transformer decoder that exploits the local object features to learn their correlation for further refining initial grounding proposals. Extensive experiments on three challenging benchmarks (Nr3D, Sr3D, and ScanRefer) show that our proposed 3DOGSFormer outperforms state-of-the-art 3D single-object grounding methods and their dense-object variants by significant margins.


title: A combinatorial view on star moments of regular directed graphs and trees

abstract: We investigate the method of moments for $d$-regular digraphs and the limiting $d$-regular directed tree $T_d$ as the number of vertices tends to infinity, in the same spirit as McKay (Linear Algebra Appl., 1981) for the undirected setting. In particular, we provide a combinatorial derivation of the formula for the star moments (from a root vertex $o\in T_d$) $$M_d(w)\qquad:=\sum_{\substack{v_0,v_1\ldots,v_{k-1},v_k\in T_d\\v_0=v_k=o}} A^{w_1}(v_0,v_1)A^{w_2}(v_1,v_2) \cdots A^{w_k}(v_{k-1},v_k)$$ with $A$ the adjacency matrix of $T_d$, where $w:=w_1\cdots w_k$ is any word on the alphabet $\{1,{*}\}$ and $A^*$ is the adjoint matrix of $A$. Our analysis highlights a connection between the non-zero summands of $M_d(w)$ and the non-crossing partitions of $\{1,\ldots,k\}$ which are in some sense compatible with $w$.


title: Asymptotically harmonic manifolds of dimension 3 with minimal horospheres

abstract: In [14], it was shown that, if M is a 3-dimensional asymptotically harmonic with minimal horospheres, then M is flat. However, there is a gap in the proof of this paper. In this paper, we provide the correct proof of the result. Thus we complete the classification of asymptotically harmonic manifolds of dimension 3: An asymptotically harmonic manifold of dimension 3 is either a flat or real hyperbolic space.


title: Ciii]$\lambda1909$ emission as an alternative to Ly$\alpha$ in the reionization era: the dependence of Ciii] and Ly$\alpha$ at $3<z<4$ from the VANDELS survey

abstract: The velocity offset of Ly$\alpha$ emission from a galaxy's systemic redshift is an excellent tracer of conditions that enable the escape of Ly$\alpha$ photons from the galaxy, and potentially hydrogen ionizing Lyman continuum photons. However at $z\geq6$, Ly$\alpha$ is often heavily attenuated by the neutral intergalactic medium. Here we investigate the utility of Ciii],$\lambda\lambda1907,1909$ emission, usually the brightest UV line after Ly$\alpha$, as a proxy estimating the Ly$\alpha$ velocity offset ($\Delta v_{\rm{Ly}\alpha}$). To do so, we use analogues of reionization era galaxies based upon 52 star-forming galaxies with robust Ciii] detections drawn from the VANDELS survey. Our sample spans a broad UV magnitude range of $-18.5 < M_{\rm{UV}} < -22.0$, with a sample average value of EW(Ciii]) $=5.3$\,{\AA}. We find a slight increase of EW(Ciii]) with increasing EW(Ly$\alpha$), but find a large range of EW(Ciii]) $\sim$1-13\,{\AA} particularly at EW(Ly$\alpha$) $<10$\,{\AA}. Using the Ciii] line peak as the systemic redshift, we calculate $\Delta v_{\rm{Ly}\alpha}$ and recover the previously reported trend of decreasing $\Delta v_{\rm{Ly}\alpha}$ with increasing EW(Ly$\alpha$). Interestingly, we find an anti-correlation between $\Delta v_{\rm{Ly}\alpha}$ and EW(Ciii]), which also displays a dependence on the UV absolute magnitude. We derive a multi-variate fit to obtain $\Delta v_{\rm{Ly}\alpha}$ using both EW(Ciii]) and $M_{\rm{UV}}$, finding that $\Delta v_{\rm{Ly}\alpha}$ is more strongly dependent on EW(Ciii]), with a weaker but non-negligible dependence on $M_{\rm{UV}}$. We find that for a fixed EW(Ciii]), UV-bright Ly$\alpha$ emitting galaxies show smaller values of $\Delta v_{\rm{Ly}\alpha}$,which suggests that such galaxies may be undergoing more bursty star-formation compared to the UV-fainter ones, akin to a population of extremely UV-bright galaxies identified at $z>10$.


title: Algebraic Temporal Blocking for Sparse Iterative Solvers on Multi-Core CPUs

abstract: Sparse linear iterative solvers are essential for many large-scale simulations. Much of the runtime of these solvers is often spent in the implicit evaluation of matrix polynomials via a sequence of sparse matrix-vector products. A variety of approaches has been proposed to make these polynomial evaluations explicit (i.e., fix the coefficients), e.g., polynomial preconditioners or s-step Krylov methods. Furthermore, it is nowadays a popular practice to approximate triangular solves by a matrix polynomial to increase parallelism. Such algorithms allow to evaluate the polynomial using a so-called matrix power kernel (MPK), which computes the product between a power of a sparse matrix A and a dense vector x, or a related operation. Recently we have shown that using the level-based formulation of sparse matrix-vector multiplications in the Recursive Algebraic Coloring Engine (RACE) framework we can perform temporal cache blocking of MPK to increase its performance. In this work, we demonstrate the application of this cache-blocking optimization in sparse iterative solvers. By integrating the RACE library into the Trilinos framework, we demonstrate the speedups achieved in preconditioned) s-step GMRES, polynomial preconditioners, and algebraic multigrid (AMG). For MPK-dominated algorithms we achieve speedups of up to 3x on modern multi-core compute nodes. For algorithms with moderate contributions from subspace orthogonalization, the gain reduces significantly, which is often caused by the insufficient quality of the orthogonalization routines. Finally, we showcase the application of RACE-accelerated solvers in a real-world wind turbine simulation (Nalu-Wind) and highlight the new opportunities and perspectives opened up by RACE as a cache-blocking technique for MPK-enabled sparse solvers.


title: How Metal/Insulator Interfaces Enable the Enhancement of the Hydrogen Evolution Reaction Kinetics in Two Ways

abstract: Laterally nanostructured surfaces give rise to a new dimension of understanding and improving electrochemical reactions. In this study, we present a peculiar mechanism appearing at a metal/insulator interface, which can significantly enhance the Hydrogen Evolution Reaction (HER) from water reduction by altering the local reaction conditions in two ways: facilitated adsorption of hydrogen on the metal catalyst surface and improved transfer of ions through the double layer. The mechanism is uncovered using electrodes consisting of well-defined nanometer-sized metal arrays (Au, Cu, Pt) embedded in an insulator layer (silicon nitride), varying various parameters of both the electrode (size of the metal patches, catalyst material) and the electrolyte (cationic species, cation concentration, pH). In addition, simulations of the electrochemical double layer are carried out, which support the elaborated mechanism. Knowledge of this mechanism will enable new design principles for novel composite electrocatalytic systems.


title: DCP-Net: A Distributed Collaborative Perception Network for Remote Sensing Semantic Segmentation

abstract: Onboard intelligent processing is widely applied in emergency tasks in the field of remote sensing. However, it is predominantly confined to an individual platform with a limited observation range as well as susceptibility to interference, resulting in limited accuracy. Considering the current state of multi-platform collaborative observation, this article innovatively presents a distributed collaborative perception network called DCP-Net. Firstly, the proposed DCP-Net helps members to enhance perception performance by integrating features from other platforms. Secondly, a self-mutual information match module is proposed to identify collaboration opportunities and select suitable partners, prioritizing critical collaborative features and reducing redundant transmission cost. Thirdly, a related feature fusion module is designed to address the misalignment between local and collaborative features, improving the quality of fused features for the downstream task. We conduct extensive experiments and visualization analyses using three semantic segmentation datasets, including Potsdam, iSAID and DFC23. The results demonstrate that DCP-Net outperforms the existing methods comprehensively, improving mIoU by 2.61%~16.89% at the highest collaboration efficiency, which promotes the performance to a state-of-the-art level.


title: Investigating the Permeability Evolution of Artificial Rock During Ductile and Brittle Deformation Under Pressurized Flow

abstract: The drilling of geothermal energy, CO2 sequestration, and wastewater injection all involve the pressurized flow of fluids through porous rock, which can cause deformation and fracture of the material. Despite the widespread use of these industrial methods, there is a lack of experimental data on the connection between the pore pressure rise, the deformation and permeability changes in real rock. In order to address this gap in the literature, this study developed an artificial rock material that can be deformed and fractured at low pressures. By controlling the porosity, permeability, and strength of the material during the sintering process, it is possible to mimic various types of rock. The artificial rock was designed to accommodate radial flow and deformation, allowing for the tracking of deformation by monitoring the flux and driving pressure and thus calculating the permeability changes under various pressure conditions. The study was able to examine the impact of both ductile and brittle deformation on the permeability during pressurized flow, which were captured by two models that were adjusted to this scenario. This study provides a link between pressurized flow, rock formation permeability and ductile to brittle deformation, that can constrain risk assessment to geothermal energy and CO2


title: FSD: An Initial Chinese Dataset for Fake Song Detection

abstract: Singing voice synthesis and singing voice conversion have significantly advanced, revolutionizing musical experiences. However, the rise of "Deepfake Songs" generated by these technologies raises concerns about authenticity. Unlike Audio DeepFake Detection (ADD), the field of song deepfake detection lacks specialized datasets or methods for song authenticity verification. In this paper, we initially construct a Chinese Fake Song Detection (FSD) dataset to investigate the field of song deepfake detection. The fake songs in the FSD dataset are generated by five state-of-the-art singing voice synthesis and singing voice conversion methods. Our initial experiments on FSD revealed the ineffectiveness of existing speech-trained ADD models for the task of song deepFake detection. Thus, we employ the FSD dataset for the training of ADD models. We subsequently evaluate these models under two scenarios: one with the original songs and another with separated vocal tracks. Experiment results show that song-trained ADD models exhibit a 38.58% reduction in average equal error rate compared to speech-trained ADD models on the FSD test set.


title: Augmenting Black-box LLMs with Medical Textbooks for Clinical Question Answering

abstract: Large-scale language models (LLMs) like ChatGPT have demonstrated impressive abilities in generating responses based on human instructions. However, their use in the medical field can be challenging due to their lack of specific, in-depth knowledge. In this study, we present a system called LLMs Augmented with Medical Textbooks (LLM-AMT) designed to enhance the proficiency of LLMs in specialized domains. LLM-AMT integrates authoritative medical textbooks into the LLMs' framework using plug-and-play modules. These modules include a Query Augmenter, a Hybrid Textbook Retriever, and a Knowledge Self-Refiner. Together, they incorporate authoritative medical knowledge. Additionally, an LLM Reader aids in contextual understanding. Our experimental results on three medical QA tasks demonstrate that LLMAMT significantly improves response quality, with accuracy gains ranging from 11.6% to 16.6%. Notably, with GPT-4-Turbo as the base model, LLM-AMT outperforms the specialized Med-PaLM 2 model pre-trained on a massive amount of medical corpus by 2-3%. We found that despite being 100x smaller in size, medical textbooks as a retrieval corpus is proven to be a more effective knowledge database than Wikipedia in the medical domain, boosting performance by 7.8%-13.7%.


title: Potential Outcomes and Decision Theoretic Foundations for Statistical Causality: Response to Richardson and Robins

abstract: I thank Thomas Richardson and James Robins for their discussion of my paper, and discuss the similarities and differences between their approach to causal modelling, based on single world intervention graphs, and my own decision-theoretic approach.


title: Experimental Evaluation of Air-to-Ground VHF Band Communication for UAV Relays

abstract: Unmanned Aerial Vehicles (UAVs) are a disruptive technology that is transforming a range of industries. Because they operate in the sky, UAVs are able to take advantage of strong Line-of-Sight (LoS) channels for radio propagation, allowing them to communicate over much larger distances than equivalent hardware located at ground level. This has attracted the attention of organisations such as the Irish Defence Forces (DF), with whom we are developing a UAV-based radio relay system as part of the MISTRAL project. This relay system will support digital Very High Frequency (VHF) band communication between ground personnel, while they are deployed on missions. In this paper we report on the initial set of experimental measurements which were carried out to verify the feasibility of VHF signal relaying via UAV. In our experiments, a UAV carrying a lightweight Software-Defined Radio (SDR) receiver is positioned at a height of 500 meters above ground, while two 5W transmitters travel in vehicles on the ground. The SDR receiver measures the received signal power, while the Global Positioning System (GPS) coordinates of the vehicles are logged. This is combined to measure the signal pathloss over distance. Our results show that the signal is received successfully at distances of over 50 kilometers away. While the signals still appear to suffer from a degree of obstacle blockage and multipath effects, these communication ranges are a substantial improvement over the ground communication baseline, and validate the use of UAVs to support wide area emergency communication.


title: Distributionally Robust Model-based Reinforcement Learning with Large State Spaces

abstract: Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To overcome these issues, we study distributionally robust Markov decision processes with continuous state spaces under the widely used Kullback-Leibler, chi-square, and total variation uncertainty sets. We propose a model-based approach that utilizes Gaussian Processes and the maximum variance reduction algorithm to efficiently learn multi-output nominal transition dynamics, leveraging access to a generative model (i.e., simulator). We further demonstrate the statistical sample complexity of the proposed method for different uncertainty sets. These complexity bounds are independent of the number of states and extend beyond linear dynamics, ensuring the effectiveness of our approach in identifying near-optimal distributionally-robust policies. The proposed method can be further combined with other model-free distributionally robust reinforcement learning methods to obtain a near-optimal robust policy. Experimental results demonstrate the robustness of our algorithm to distributional shifts and its superior performance in terms of the number of samples needed.


title: Sample Size in Natural Language Processing within Healthcare Research

abstract: Sample size calculation is an essential step in most data-based disciplines. Large enough samples ensure representativeness of the population and determine the precision of estimates. This is true for most quantitative studies, including those that employ machine learning methods, such as natural language processing, where free-text is used to generate predictions and classify instances of text. Within the healthcare domain, the lack of sufficient corpora of previously collected data can be a limiting factor when determining sample sizes for new studies. This paper tries to address the issue by making recommendations on sample sizes for text classification tasks in the healthcare domain. Models trained on the MIMIC-III database of critical care records from Beth Israel Deaconess Medical Center were used to classify documents as having or not having Unspecified Essential Hypertension, the most common diagnosis code in the database. Simulations were performed using various classifiers on different sample sizes and class proportions. This was repeated for a comparatively less common diagnosis code within the database of diabetes mellitus without mention of complication. Smaller sample sizes resulted in better results when using a K-nearest neighbours classifier, whereas larger sample sizes provided better results with support vector machines and BERT models. Overall, a sample size larger than 1000 was sufficient to provide decent performance metrics. The simulations conducted within this study provide guidelines that can be used as recommendations for selecting appropriate sample sizes and class proportions, and for predicting expected performance, when building classifiers for textual healthcare data. The methodology used here can be modified for sample size estimates calculations with other datasets.


title: The geometry of antisymplectic involutions, II

abstract: We continue our study of fixed loci of antisymplectic involutions on projective hyper-K\"ahler manifolds of $\mathrm{K3}^{[n]}$-type induced by an ample class of square 2 in the Beauville-Bogomolov-Fujiki lattice. We prove that if the divisibility of the ample class is 2, then one connected component of the fixed locus is a Fano manifold of index 3, thus generalizing to higher dimensions the case of the LLSvS 8-fold associated to a cubic fourfold. We also show that, in the case of the LLSvS 8-fold associated to a cubic fourfold, the second component of the fixed locus is of general type, thus answering a question by Manfred Lehn.


title: The role of supernovae inside AGN jets in UHECR acceleration

abstract: Jets of active galactic nuclei are potential accelerators of ultra high-energy cosmic rays. Supernovae can occur inside these jets and contribute to cosmic ray acceleration, particularly of heavy nuclei, but that contribution has been hardly investigated so far. We carried out a first dedicated exploration of the role of supernovae inside extragalactic jets in the production of ultra high-energy cosmic rays. We characterized the energy budget of supernova-jet interactions, and the maximum possible energies of the particles accelerated in those events, likely dominated by heavy nuclei. This allowed us to assess whether these interactions can be potential acceleration sites of ultra high-energy cosmic rays, or at least of their seeds. For that, we estimated the cosmic ray luminosity for different galaxy types, and compared the injection rate of cosmic ray seeds into the jet with that due to galactic cosmic ray entrainment. Since the supernova is fueled for a long time by the luminosity of the jet, the energy of a supernova-jet interaction can be several orders of magnitude greater than that of an isolated supernova. Thus, despite the low rate of supernovae expected to occur in the jet, they could still provide more seeds for accelerating ultra high-energy particles than cosmic ray entrainment from the host galaxy. Moreover, these interactions can create sufficiently efficient accelerators to be a source of cosmic rays with energies $\gtrsim 10$~EeV. Supernova-jet interactions can contribute significantly to the production of ultra high-energy cosmic rays, either directly by accelerating these particles themselves or indirectly by providing pre-accelerated seeds.


title: Dialog Action-Aware Transformer for Dialog Policy Learning

abstract: Recent works usually address Dialog policy learning DPL by training a reinforcement learning (RL) agent to determine the best dialog action. However, existing works on deep RL require a large volume of agent-user interactions to achieve acceptable performance. In this paper, we propose to make full use of the plain text knowledge from the pre-trained language model to accelerate the RL agent's learning speed. Specifically, we design a dialog action-aware transformer encoder (DaTrans), which integrates a new fine-tuning procedure named masked last action task to encourage DaTrans to be dialog-aware and distils action-specific features. Then, DaTrans is further optimized in an RL setting with ongoing interactions and evolves through exploration in the dialog action space toward maximizing long-term accumulated rewards. The effectiveness and efficiency of the proposed model are demonstrated with both simulator evaluation and human evaluation.


title: Magnetic and structural properties of the iron silicide superconductor LaFeSiH

abstract: The magnetic and structural properties of the recently discovered pnictogen/chalcogen-free superconductor LaFeSiH ($T_c\simeq10$~K) have been investigated by $^{57}$Fe synchrotron M{\"o}ssbauer source (SMS) spectroscopy, x-ray and neutron powder diffraction and $^{29}$Si nuclear magnetic resonance spectroscopy (NMR). No sign of long range magnetic order or local moments has been detected in any of the measurements and LaFeSiH remains tetragonal down to 2 K. The activated temperature dependence of both the NMR Knight shift and the relaxation rate $1/T_1$ is analogous to that observed in strongly overdoped Fe-based superconductors. These results, together with the temperature-independent NMR linewidth, show that LaFeSiH is an homogeneous metal, far from any magnetic or nematic instability, and with similar Fermi surface properties as strongly overdoped iron pnictides. This raises the prospect of enhancing the $T_c$ of LaFeSiH by reducing its carrier concentration through appropriate chemical substitutions. Additional SMS spectroscopy measurements under hydrostatic pressure up to 18.8~GPa found no measurable hyperfine field.


title: Compressing and forecasting atomic material simulations with descriptors

abstract: Atomic simulations of material microstructure require significant resources to generate, store and analyze. Here, atomic descriptor functions are proposed as a general latent space to compress atomic microstructure, ideal for use in large-scale simulations. Descriptors can regress a broad range of properties, including character-dependent dislocation densities, stress states or radial distribution functions. A vector autoregressive model can generate trajectories over yield points, resample from new initial conditions and forecast trajectory futures. A forecast confidence, essential for practical application, is derived by propagating forecasts through the Mahalanobis outlier distance, providing a powerful tool to assess coarse-grained models. Application to nanoparticles and yielding of dislocation networks confirms low uncertainty forecasts are accurate and resampling allows for the propagation of smooth microstructure distributions. Yielding is associated with a collapse in the intrinsic dimension of the descriptor manifold, which is discussed in relation to the yield surface.


title: Self-Similarity-Based and Novelty-based loss for music structure analysis

abstract: Music Structure Analysis (MSA) is the task aiming at identifying musical segments that compose a music track and possibly label them based on their similarity. In this paper we propose a supervised approach for the task of music boundary detection. In our approach we simultaneously learn features and convolution kernels. For this we jointly optimize -- a loss based on the Self-Similarity-Matrix (SSM) obtained with the learned features, denoted by SSM-loss, and -- a loss based on the novelty score obtained applying the learned kernels to the estimated SSM, denoted by novelty-loss. We also demonstrate that relative feature learning, through self-attention, is beneficial for the task of MSA. Finally, we compare the performances of our approach to previously proposed approaches on the standard RWC-Pop, and various subsets of SALAMI.


title: Augmenting Chest X-ray Datasets with Non-Expert Annotations

abstract: The advancement of machine learning algorithms in medical image analysis requires the expansion of training datasets. A popular and cost-effective approach is automated annotation extraction from free-text medical reports, primarily due to the high costs associated with expert clinicians annotating chest X-ray images. However, it has been shown that the resulting datasets are susceptible to biases and shortcuts. Another strategy to increase the size of a dataset is crowdsourcing, a widely adopted practice in general computer vision with some success in medical image analysis. In a similar vein to crowdsourcing, we enhance two publicly available chest X-ray datasets by incorporating non-expert annotations. However, instead of using diagnostic labels, we annotate shortcuts in the form of tubes. We collect 3.5k chest drain annotations for CXR14, and 1k annotations for 4 different tube types in PadChest. We train a chest drain detector with the non-expert annotations that generalizes well to expert labels. Moreover, we compare our annotations to those provided by experts and show "moderate" to "almost perfect" agreement. Finally, we present a pathology agreement study to raise awareness about ground truth annotations. We make our annotations and code available.


title: Simulating quantum backflow on a quantum computer

abstract: Quantum backflow is a counterintuitive effect in which the probability density of a free particle moves in the direction opposite to the particle's momentum. If the particle is electrically charged, then the effect can be viewed as the contrast between the direction of electric current and that of the momentum. To date, there has been no direct experimental observation of quantum backflow. However, the effect has been simulated numerically (using classical computers) and optically (using classical light). In this study, we present the first simulation of quantum backflow using a real quantum computer.


title: Understanding the first measurement of $\mathcal{B}(B\to K \nu \bar{\nu})$

abstract: Recently, Belle II reported on the first measurement of $\mathcal{B}(B^\pm\to K^\pm \nu\bar{\nu})$ which appears to be almost $3\sigma$ larger than predicted in the Standard Model. We point out the important correlation with $\mathcal{B}(B\to K^{\ast} \nu\bar{\nu})$ so that the measurement of that decay mode could help restraining the possible options for building the model of New Physics. We then try to interpret this new experimental result in terms of physics beyond the Standard Model by using SMEFT and find that a scenario with coupling only to $\tau$ can accommodate the current experimental constraints but fails in getting a desired $R_{D^{(\ast )}}^\mathrm{exp}/R_{D^{(\ast )}}^\mathrm{SM}$, unless one turns the other SMEFT operators that are not related to $b\to s\ell\ell$ or/and $b\to s\nu\nu$.


title: Towards Autonomous Cyber Operation Agents: Exploring the Red Case

abstract: Recently, reinforcement and deep reinforcement learning (RL/DRL) have been applied to develop autonomous agents for cyber network operations(CyOps), where the agents are trained in a representative environment using RL and particularly DRL algorithms. The training environment must simulate CyOps with high fidelity, which the agent aims to learn and accomplish. A good simulator is hard to achieve due to the extreme complexity of the cyber environment. The trained agent must also be generalizable to network variations because operational cyber networks change constantly. The red agent case is taken to discuss these two issues in this work. We elaborate on their essential requirements and potential solution options, illustrated by some preliminary experimentations in a Cyber Gym for Intelligent Learning (CyGIL) testbed.


title: Encoding Seasonal Climate Predictions for Demand Forecasting with Modular Neural Network

abstract: Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial to improve its resilience. Representing mid to long-term seasonal climate forecasts is challenging as seasonal climate predictions are uncertain, and encoding spatio-temporal relationship of climate forecasts with demand is complex. We propose a novel modeling framework that efficiently encodes seasonal climate predictions to provide robust and reliable time-series forecasting for supply chain functions. The encoding framework enables effective learning of latent representations -- be it uncertain seasonal climate prediction or other time-series data (e.g., buyer patterns) -- via a modular neural network architecture. Our extensive experiments indicate that learning such representations to model seasonal climate forecast results in an error reduction of approximately 13\% to 17\% across multiple real-world data sets compared to existing demand forecasting methods.


title: Fast and accurate electromagnetic modeling of non-insulated and metal-insulated REBCO magnets

abstract: REBCO high-temperature superconductors are promising for fully superconducting high-field magnets, including ultra-high field magnets. Non-insulated (NI) and metal-insulated (MI) windings are a good solution for protection against electro-thermal quench. Design and optimization requires numerical modelling of REBCO inserts for high-field magnets. Here, we detail a fast and accurate two-dimensional (2D) cross-sectional model for the electromagnetic response of NI and MI coils, which is based on the Minimum Electro Magnetic Entropy Production (MEMEP). Benchmarking with an $A-V$ formulation method on a double pancake coil shows good agreement. We also analyse a fully superconducting 32 T magnet with a REBCO insert and a low-temperature superconducing (LTS) outsert. In particular, we analyze the current density, the screening curren induced field (SCIF), and the AC loss. We have shown that metal-insulated coils enable transfer of angular current in the radial direction, and hence magnet protection, while keeping the same screening currents and AC loss of isolated coils, even at relatively high ramp rates of 1 A/s. Surprisingly, soldered coils with low resistance between turns present relatively low AC loss for over-current configuration, which might enable higher generated magnetic fields. The numerical method presented here can be applied to optimize high-field magnets regarding SCIF in MI or NI magnets. It also serves as the basis for future electro-thermal modelling and multi-physics modeling that also includes mechanical properties.


title: RoBoSS: A Robust, Bounded, Sparse, and Smooth Loss Function for Supervised Learning

abstract: In the domain of machine learning algorithms, the significance of the loss function is paramount, especially in supervised learning tasks. It serves as a fundamental pillar that profoundly influences the behavior and efficacy of supervised learning algorithms. Traditional loss functions, while widely used, often struggle to handle noisy and high-dimensional data, impede model interpretability, and lead to slow convergence during training. In this paper, we address the aforementioned constraints by proposing a novel robust, bounded, sparse, and smooth (RoBoSS) loss function for supervised learning. Further, we incorporate the RoBoSS loss function within the framework of support vector machine (SVM) and introduce a new robust algorithm named $\mathcal{L}_{rbss}$-SVM. For the theoretical analysis, the classification-calibrated property and generalization ability are also presented. These investigations are crucial for gaining deeper insights into the performance of the RoBoSS loss function in the classification tasks and its potential to generalize well to unseen data. To empirically demonstrate the effectiveness of the proposed $\mathcal{L}_{rbss}$-SVM, we evaluate it on $88$ real-world UCI and KEEL datasets from diverse domains. Additionally, to exemplify the effectiveness of the proposed $\mathcal{L}_{rbss}$-SVM within the biomedical realm, we evaluated it on two medical datasets: the electroencephalogram (EEG) signal dataset and the breast cancer (BreaKHis) dataset. The numerical results substantiate the superiority of the proposed $\mathcal{L}_{rbss}$-SVM model, both in terms of its remarkable generalization performance and its efficiency in training time.


title: STGIN: Spatial-Temporal Graph Interaction Network for Large-scale POI Recommendation

abstract: In Location-Based Services, Point-Of-Interest(POI) recommendation plays a crucial role in both user experience and business opportunities. Graph neural networks have been proven effective in providing personalized POI recommendation services. However, there are still two critical challenges. First, existing graph models attempt to capture users' diversified interests through a unified graph, which limits their ability to express interests in various spatial-temporal contexts. Second, the efficiency limitations of graph construction and graph sampling in large-scale systems make it difficult to adapt quickly to new real-time interests. To tackle the above challenges, we propose a novel Spatial-Temporal Graph Interaction Network. Specifically, we construct subgraphs of spatial, temporal, spatial-temporal, and global views respectively to precisely characterize the user's interests in various contexts. In addition, we design an industry-friendly framework to track the user's latest interests. Extensive experiments on the real-world dataset show that our method outperforms state-of-the-art models. This work has been successfully deployed in a large e-commerce platform, delivering a 1.1% CTR and 6.3% RPM improvement.


title: Wightman function and stochastic gravity noise kernel in impulsive plane wave spacetimes

abstract: In this paper we study quantum field theory in impulsive plane wave spacetimes. We first analyze the geodesics and the formation of conjugate planes in these spacetimes. The behaviors of the world function and the van Vleck determinant near conjugate plane are also considered. For the quantum field, we work out the mode functions, their Bogoliubov transformations, and the construction of the Wightman functions. By examining the Wightman function near and on the conjugate plane, we show how the twofold and fourfold singularity structure of the Wigthman function arise when crossing this plane. Lastly, we come to the stochastic gravity noise kernel which is also the correlation function of the stress energy tensor of the quantum field. Its explicit form is given in terms of the world function and the van Vleck determinant. We investigate its limits for small and large geodesic distances. The leading divergent term of the noise kernel on the conjugate plane are expressed in terms of derivatives of delta functions. Similar to that of the Wightman functions, we also examine how the singularity structure of the noise kernel near the lightcone changes when crossing the conjugate plane.


title: MA-VAE: Multi-head Attention-based Variational Autoencoder Approach for Anomaly Detection in Multivariate Time-series Applied to Automotive Endurance Powertrain Testing

abstract: A clear need for automatic anomaly detection applied to automotive testing has emerged as more and more attention is paid to the data recorded and manual evaluation by humans reaches its capacity. Such real-world data is massive, diverse, multivariate and temporal in nature, therefore requiring modelling of the testee behaviour. We propose a variational autoencoder with multi-head attention (MA-VAE), which, when trained on unlabelled data, not only provides very few false positives but also manages to detect the majority of the anomalies presented. In addition to that, the approach offers a novel way to avoid the bypass phenomenon, an undesirable behaviour investigated in literature. Lastly, the approach also introduces a new method to remap individual windows to a continuous time series. The results are presented in the context of a real-world industrial data set and several experiments are undertaken to further investigate certain aspects of the proposed model. When configured properly, it is 9% of the time wrong when an anomaly is flagged and discovers 67% of the anomalies present. Also, MA-VAE has the potential to perform well with only a fraction of the training and validation subset, however, to extract it, a more sophisticated threshold estimation method is required.