title: Random Natural Gradient

abstract: Hybrid quantum-classical algorithms appear to be the most promising approach for near-term quantum applications. An important bottleneck is the classical optimization loop, where the multiple local minima and the emergence of barren plateaux make these approaches less appealing. To improve the optimization the Quantum Natural Gradient (QNG) method [Quantum 4, 269 (2020)] was introduced - a method that uses information about the local geometry of the quantum state-space. While the QNG-based optimization is promising, in each step it requires more quantum resources, since to compute the QNG one requires $O(m^2)$ quantum state preparations, where $m$ is the number of parameters in the parameterized circuit. In this work we propose two methods that reduce the resources/state preparations required for QNG, while keeping the advantages and performance of the QNG-based optimization. Specifically, we first introduce the Random Natural Gradient (RNG) that uses random measurements and the classical Fisher information matrix (as opposed to the quantum Fisher information used in QNG). The essential quantum resources reduce to linear $O(m)$ and thus offer a quadratic "speed-up", while in our numerical simulations it matches QNG in terms of accuracy. We give some theoretical arguments for RNG and then benchmark the method with the QNG on both classical and quantum problems. Secondly, inspired by stochastic-coordinate methods, we propose a novel approximation to the QNG which we call Stochastic-Coordinate Quantum Natural Gradient that optimizes only a small (randomly sampled) fraction of the total parameters at each iteration. This method also performs equally well in our benchmarks, while it uses fewer resources than the QNG.


title: On the $\mathrm{v}$-number of Gorenstein ideals and Frobenius powers

abstract: In this paper, we show the equality of the (local) $\mathrm{v}$-number and Castelnuovo-Mumford regularity of certain classes of Gorenstein algebras, including the class of Gorenstein monomial algebras. Also, for the same classes of algebras with the assumption of level, we show that the (local) $\mathrm{v}$-number serves as an upper bound for the regularity. Moreover, we investigate the $\mathrm{v}$-number of Frobenius powers of graded ideals in prime characteristic setup. In this study, we demonstrate that the $\mathrm{v}$-numbers of Frobenius powers of graded ideals have an asymptotically linear behaviour. In the case of unmixed monomial ideals, we provide a method for computing the $\mathrm{v}$-number without prior knowledge of the associated primes.


title: Stochastic quantization of two-dimensional $P(\Phi)$ Quantum Field Theory

abstract: We give a simple and self-contained construction of of the $P(\Phi)$ Euclidean Quantum Field Theory in the plane and verify the Osterwalder-Schrader axioms: translational and rotational invariance, reflection positivity and regularity. In the intermediate steps of the construction we study measures on spheres. In order to control the infinite volume limit we use the parabolic stochastic quantization equation and the energy method. To prove the translational and rotational invariance of the limit measure we take advantage of the fact that the symmetry groups of the plane and the sphere have the same dimension.


title: The geometric exceptional set in Manin's conjecture for Batyrev and Tschinkel's example

abstract: Batyrev and Tschinkel's example is a Fermat cubic surface bundle $X$ which is a Fano $5$-fold. It is the first example for which Manin's conjecture can never hold for a proper closed exceptional set. Lehmann, Sengupta, and Tanimoto proposed a conjectural geometric description of the exceptional set in Manin's conjecture and showed that it is always contained in a thin set. Over a field of characteristic $0$, we construct finitely many thin maps such that any thin map $f:Y\rightarrow X$ with equal or larger $a$- and $b$-values in lexicographical order factors rationally through one of them. In particular, these define a thin set which coincides with the conjectural exceptional set.


title: Modelling Sentiment Analysis: LLMs and data augmentation techniques

abstract: This paper provides different approaches for a binary sentiment classification on a small training dataset. LLMs that provided state-of-the-art results in sentiment analysis and similar domains are being used, such as BERT, RoBERTa and XLNet.


title: A Nearly Linear-Time Distributed Algorithm for Exact Maximum Matching

abstract: In this paper, we propose a randomized $\tilde{O}(\mu(G))$-round algorithm for the maximum cardinality matching problem in the CONGEST model, where $\mu(G)$ means the maximum size of a matching of the input graph $G$. The proposed algorithm substantially improves the current best worst-case running time. The key technical ingredient is a new randomized algorithm of finding an augmenting path of length $\ell$ with high probability within $\tilde{O}(\ell)$ rounds, which positively settles an open problem left in the prior work by Ahmadi and Kuhn [DISC'20]. The idea of our augmenting path algorithm is based on a recent result by Kitamura and Izumi [IEICE Trans.'22], which efficiently identifies a sparse substructure of the input graph containing an augmenting path, following a new concept called \emph{alternating base trees}. Their algorithm, however, resorts to a centralized approach of collecting the entire information of the substructure into a single vertex for constructing an augmenting path. The technical highlight of this paper is to provide a fully-decentralized counterpart of such a centralized method. To develop the algorithm, we prove several new structural properties of alternating base trees, which are of independent interest.


title: Benchmarking a Neutral-Atom Quantum Computer

abstract: In this study, we simulated the algorithmic performance of a small neutral atom quantum computer and compared its performance when operating with all-to-all versus nearest-neighbor connectivity. This comparison was made using a suite of algorithmic benchmarks developed by the Quantum Economic Development Consortium. Circuits were simulated with a noise model consistent with experimental data from Nature 604, 457 (2022). We find that all-to-all connectivity improves simulated circuit fidelity by $10\%-15\%$, compared to nearest-neighbor connectivity.


title: What is Lost in Knowledge Distillation?

abstract: Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge distillation (KD), have been proposed to address the issue; however, the compression process could be lossy. Motivated by this, our work investigates how a distilled student model differs from its teacher, if the distillation process causes any information losses, and if the loss follows a specific pattern. Our experiments aim to shed light on the type of tasks might be less or more sensitive to KD by reporting data points on the contribution of different factors, such as the number of layers or attention heads. Results such as ours could be utilized when determining effective and efficient configurations to achieve optimal information transfers between larger (teacher) and smaller (student) models.


title: Fukaya category on a symplectic manifold with a B-field

abstract: We describe the formulation of Fukaya categories of symplectic manifolds with $B$-fields. In addition, we give a formula for how the $A_\infty$ structure maps change as we deform an object by a Lagrangian isotopy.


title: A new fast numerical method for the generalized Rosen-Zener model

abstract: In quantum mechanics, the Rosen-Zener model represents a two-level quantum system. Its generalization to multiple degenerate sets of states leads to larger non-autonomous linear system of ordinary differential equations (ODEs). We propose a new method for computing the solution operator of this system of ODEs. This new method is based on a recently introduced expression of the solution in terms of an infinite matrix equation, which can be efficiently approximated by combining truncation, fixed point iterations, and low-rank approximation. This expression is possible thanks to the so-called $\star$-product approach for linear ODEs. In the numerical experiments, the new method's computing time scales linearly with the model's size. We provide a first partial explanation of this linear behavior.


title: I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models

abstract: Video synthesis has recently made remarkable strides benefiting from the rapid development of diffusion models. However, it still encounters challenges in terms of semantic accuracy, clarity and spatio-temporal continuity. They primarily arise from the scarcity of well-aligned text-video data and the complex inherent structure of videos, making it difficult for the model to simultaneously ensure semantic and qualitative excellence. In this report, we propose a cascaded I2VGen-XL approach that enhances model performance by decoupling these two factors and ensures the alignment of the input data by utilizing static images as a form of crucial guidance. I2VGen-XL consists of two stages: i) the base stage guarantees coherent semantics and preserves content from input images by using two hierarchical encoders, and ii) the refinement stage enhances the video's details by incorporating an additional brief text and improves the resolution to 1280$\times$720. To improve the diversity, we collect around 35 million single-shot text-video pairs and 6 billion text-image pairs to optimize the model. By this means, I2VGen-XL can simultaneously enhance the semantic accuracy, continuity of details and clarity of generated videos. Through extensive experiments, we have investigated the underlying principles of I2VGen-XL and compared it with current top methods, which can demonstrate its effectiveness on diverse data. The source code and models will be publicly available at \url{https://i2vgen-xl.github.io}.


title: Galaxy Spectra neural Network (GaSNet). II. Using Deep Learning for Spectral Classification and Redshift Predictions

abstract: Large sky spectroscopic surveys have reached the scale of photometric surveys in terms of sample sizes and data complexity. These huge datasets require efficient, accurate, and flexible automated tools for data analysis and science exploitation. We present the Galaxy Spectra Network/GaSNet-II, a supervised multi-network deep learning tool for spectra classification and redshift prediction. GaSNet-II can be trained to identify a customized number of classes and optimize the redshift predictions for classified objects in each of them. It also provides redshift errors, using a network-of-networks that reproduces a Monte Carlo test on each spectrum, by randomizing their weight initialization. As a demonstration of the capability of the deep learning pipeline, we use 260k Sloan Digital Sky Survey spectra from Data Release 16, separated into 13 classes including 140k galactic, and 120k extragalactic objects. GaSNet-II achieves 92.4% average classification accuracy over the 13 classes (larger than 90% for the majority of them), and an average redshift error of approximately 0.23% for galaxies and 2.1% for quasars. We further train/test the same pipeline to classify spectra and predict redshifts for a sample of 200k 4MOST mock spectra and 21k publicly released DESI spectra. On 4MOST mock data, we reach 93.4% accuracy in 10-class classification and an average redshift error of 0.55% for galaxies and 0.3% for active galactic nuclei. On DESI data, we reach 96% accuracy in (star/galaxy/quasar only) classification and an average redshift error of 2.8% for galaxies and 4.8% for quasars, despite the small sample size available. GaSNet-II can process ~40k spectra in less than one minute, on a normal Desktop GPU. This makes the pipeline particularly suitable for real-time analyses of Stage-IV survey observations and an ideal tool for feedback loops aimed at night-by-night survey strategy optimization.


title: Multi-resolution Time-Series Transformer for Long-term Forecasting

abstract: The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls the ability of transformers to learn the temporal patterns at different frequencies: shorter patches are effective for learning localized, high-frequency patterns, whereas mining long-term seasonalities and trends requires longer patches. Inspired by this observation, we propose a novel framework, Multi-resolution Time-Series Transformer (MTST), which consists of a multi-branch architecture for simultaneous modeling of diverse temporal patterns at different resolutions. In contrast to many existing time-series transformers, we employ relative positional encoding, which is better suited for extracting periodic components at different scales. Extensive experiments on several real-world datasets demonstrate the effectiveness of MTST in comparison to state-of-the-art forecasting techniques.


title: Contactless Fingerprint Biometric Anti-Spoofing: An Unsupervised Deep Learning Approach

abstract: Contactless fingerprint recognition offers a higher level of user comfort and addresses hygiene concerns more effectively. However, it is also more vulnerable to presentation attacks such as photo paper, paper-printout, and various display attacks, which makes it more challenging to implement in biometric systems compared to contact-based modalities. Limited research has been conducted on presentation attacks in contactless fingerprint systems, and these studies have encountered challenges in terms of generalization and scalability since both bonafide samples and presentation attacks are utilized during training model. Although this approach appears promising, it lacks the ability to handle unseen attacks, which is a crucial factor for developing PAD methods that can generalize effectively. We introduced an innovative anti-spoofing approach that combines an unsupervised autoencoder with a convolutional block attention module to address the limitations of existing methods. Our model is exclusively trained on bonafide images without exposure to any spoofed samples during the training phase. It is then evaluated against various types of presentation attack images in the testing phase. The scheme we proposed has achieved an average BPCER of 0.96\% with an APCER of 1.6\% for presentation attacks involving various types of spoofed samples.


title: HyperS2V: A Framework for Structural Representation of Nodes in Hyper Networks

abstract: In contrast to regular (simple) networks, hyper networks possess the ability to depict more complex relationships among nodes and store extensive information. Such networks are commonly found in real-world applications, such as in social interactions. Learning embedded representations for nodes involves a process that translates network structures into more simplified spaces, thereby enabling the application of machine learning approaches designed for vector data to be extended to network data. Nevertheless, there remains a need to delve into methods for learning embedded representations that prioritize structural aspects. This research introduces HyperS2V, a node embedding approach that centers on the structural similarity within hyper networks. Initially, we establish the concept of hyper-degrees to capture the structural properties of nodes within hyper networks. Subsequently, a novel function is formulated to measure the structural similarity between different hyper-degree values. Lastly, we generate structural embeddings utilizing a multi-scale random walk framework. Moreover, a series of experiments, both intrinsic and extrinsic, are performed on both toy and real networks. The results underscore the superior performance of HyperS2V in terms of both interpretability and applicability to downstream tasks.


title: What Makes a Fantastic Passenger-Car Driver in Urban Contexts?

abstract: The accurate evaluation of the quality of driving behavior is crucial for optimizing and implementing autonomous driving technology in practice. However, there is no comprehensive understanding of good driving behaviors currently. In this paper, we sought to understand driving behaviors from the perspectives of both drivers and passengers. We invited 10 expert drivers and 14 novice drivers to complete a 5.7-kilometer urban road driving task. After the experiments, we conducted semi-structured interviews with 24 drivers and 48 of their passengers (two passengers per driver). Through the analysis of interview data, we found passengers' assessing logic of driving behaviors, divers' considerations and efforts to achieve good driving, and gaps between these perspectives. Our research provided insights into a systematic evaluation of autonomous driving and the design implications for future autonomous vehicles.


title: Spin and Susceptibility Effects of Electromagnetic Self-Force in Effective Field Theory

abstract: The classic Abraham-Lorentz-Dirac self-force of point-like particles is generalized within an effective field theory setup to include linear spin and susceptibility effects described perturbatively, in that setup, by effective couplings in the action. Electromagnetic self-interactions of the point-like particle are integrated out using the in-in supersymmetric worldline quantum field theory formalism. Divergences are regularized with dimensional regularization and the resulting equations of motion are in terms only of an external electromagnetic field and the particle degrees of freedom.


title: Subsquares in random Latin squares and rectangles

abstract: A $k \times n$ partial Latin rectangle is \textit{$C$-sparse} if the number of nonempty entries in each row and column is at most $C$ and each symbol is used at most $C$ times. We prove that the probability a uniformly random $k \times n$ Latin rectangle, where $k < (1/2 - \alpha)n$, contains a $\beta n$-sparse partial Latin rectangle with $\ell$ nonempty entries is $(\frac{1 \pm \varepsilon}{n})^\ell$ for sufficiently large $n$ and sufficiently small $\beta$. Using this result, we prove that a uniformly random order-$n$ Latin square asymptotically almost surely has no Latin subsquare of order greater than $c\sqrt{n\log n}$ for an absolute constant $c$.


title: Kernel-, mean- and noise-marginalised Gaussian processes for exoplanet transits and $H_0$ inference

abstract: Using a fully Bayesian approach, Gaussian Process regression is extended to include marginalisation over the kernel choice and kernel hyperparameters. In addition, Bayesian model comparison via the evidence enables direct kernel comparison. The calculation of the joint posterior was implemented with a transdimensional sampler which simultaneously samples over the discrete kernel choice and their hyperparameters by embedding these in a higher-dimensional space, from which samples are taken using nested sampling. Kernel recovery and mean function inference were explored on synthetic data from exoplanet transit light curve simulations. Subsequently, the method was extended to marginalisation over mean functions and noise models and applied to the inference of the present-day Hubble parameter, $H_0$, from real measurements of the Hubble parameter as a function of redshift, derived from the cosmologically model-independent cosmic chronometer and $\Lambda$CDM-dependent baryon acoustic oscillation observations. The inferred $H_0$ values from the cosmic chronometers, baryon acoustic oscillations and combined datasets are $H_0= 66 \pm 6\, \mathrm{km}\,\mathrm{s}^{-1}\,\mathrm{Mpc}^{-1}$, $H_0= 67 \pm 10\, \mathrm{km}\,\mathrm{s}^{-1}\,\mathrm{Mpc}^{-1}$ and $H_0= 69 \pm 6\, \mathrm{km}\,\mathrm{s}^{-1}\,\mathrm{Mpc}^{-1}$, respectively. The kernel posterior of the cosmic chronometers dataset prefers a non-stationary linear kernel. Finally, the datasets are shown to be not in tension with $\ln R=12.17\pm 0.02$.

categories: astro-ph.CO astro-ph.EP astro-ph.IM cs.LG stat.ML


title: High-fidelity 3D Reconstruction of Plants using Neural Radiance Field

abstract: Accurate reconstruction of plant phenotypes plays a key role in optimising sustainable farming practices in the field of Precision Agriculture (PA). Currently, optical sensor-based approaches dominate the field, but the need for high-fidelity 3D reconstruction of crops and plants in unstructured agricultural environments remains challenging. Recently, a promising development has emerged in the form of Neural Radiance Field (NeRF), a novel method that utilises neural density fields. This technique has shown impressive performance in various novel vision synthesis tasks, but has remained relatively unexplored in the agricultural context. In our study, we focus on two fundamental tasks within plant phenotyping: (1) the synthesis of 2D novel-view images and (2) the 3D reconstruction of crop and plant models. We explore the world of neural radiance fields, in particular two SOTA methods: Instant-NGP, which excels in generating high-quality images with impressive training and inference speed, and Instant-NSR, which improves the reconstructed geometry by incorporating the Signed Distance Function (SDF) during training. In particular, we present a novel plant phenotype dataset comprising real plant images from production environments. This dataset is a first-of-its-kind initiative aimed at comprehensively exploring the advantages and limitations of NeRF in agricultural contexts. Our experimental results show that NeRF demonstrates commendable performance in the synthesis of novel-view images and is able to achieve reconstruction results that are competitive with Reality Capture, a leading commercial software for 3D Multi-View Stereo (MVS)-based reconstruction. However, our study also highlights certain drawbacks of NeRF, including relatively slow training speeds, performance limitations in cases of insufficient sampling, and challenges in obtaining geometry quality in complex setups.


title: Black-Box Prompt Optimization: Aligning Large Language Models without Model Training

abstract: Large language models (LLMs) have shown impressive success in various applications. However, these models are often not well aligned with human intents, which calls for additional treatments on them; that is, the alignment problem. To make LLMs better follow user instructions, existing alignment methods primarily focus on further training them. However, the extra training of LLMs is usually expensive in terms of GPU computing; even worse, some LLMs are not accessible for user-demanded training, such as GPTs. In this work, we take a different perspective -- Black-Box Prompt Optimization (BPO) -- to perform alignments. The idea is to optimize user prompts to suit LLMs' input understanding, so as to best realize users' intents without updating LLMs' parameters. BPO leverages human preferences to optimize prompts, thus making it superior to LLM (e.g., ChatGPT) as a prompt engineer. Moreover, BPO is model-agnostic, and the empirical results demonstrate that the BPO-aligned ChatGPT yields a 22% increase in the win rate against its original version and 10% for GPT-4. Notably, the BPO-aligned LLMs can outperform the same models aligned by PPO and DPO, and it also brings additional performance gains when combining BPO with PPO or DPO. Code and datasets are released at https://github.com/thu-coai/BPO.


title: Free-space loss model of Lambertian reflection for guided-mode lidar

abstract: The growing use of photonic integrated circuits in lidar sensors has made the speckle and phase distribution of the reflected optical power relevant for coupling into the guided-modes of these systems. Current models for lidar coupling into photodetectors do not account for such effects, so here we derive an alternate model that does handle the free-space loss in lidar sensors with guided-mode receivers. This model is both presented and experimentally-validated for the idealized situation of Lambertian scattering from targets at normal incidence, for which we observe a close agreement between the loss predictions of the model with experiment.


title: A Simple Interpretable Transformer for Fine-Grained Image Classification and Analysis

abstract: We present a novel usage of Transformers to make image classification interpretable. Unlike mainstream classifiers that wait until the last fully connected layer to incorporate class information to make predictions, we investigate a proactive approach, asking each class to search for itself in an image. We realize this idea via a Transformer encoder-decoder inspired by DEtection TRansformer (DETR). We learn "class-specific" queries (one for each class) as input to the decoder, enabling each class to localize its patterns in an image via cross-attention. We name our approach INterpretable TRansformer (INTR), which is fairly easy to implement and exhibits several compelling properties. We show that INTR intrinsically encourages each class to attend distinctively; the cross-attention weights thus provide a faithful interpretation of the prediction. Interestingly, via "multi-head" cross-attention, INTR could identify different "attributes" of a class, making it particularly suitable for fine-grained classification and analysis, which we demonstrate on eight datasets. Our code and pre-trained models are publicly accessible at the Imageomics Institute GitHub site: https://github.com/Imageomics/INTR.


title: Computing Approximate $\ell_p$ Sensitivities

abstract: Recent works in dimensionality reduction for regression tasks have introduced the notion of sensitivity, an estimate of the importance of a specific datapoint in a dataset, offering provable guarantees on the quality of the approximation after removing low-sensitivity datapoints via subsampling. However, fast algorithms for approximating $\ell_p$ sensitivities, which we show is equivalent to approximate $\ell_p$ regression, are known for only the $\ell_2$ setting, in which they are termed leverage scores. In this work, we provide efficient algorithms for approximating $\ell_p$ sensitivities and related summary statistics of a given matrix. In particular, for a given $n \times d$ matrix, we compute $\alpha$-approximation to its $\ell_1$ sensitivities at the cost of $O(n/\alpha)$ sensitivity computations. For estimating the total $\ell_p$ sensitivity (i.e. the sum of $\ell_p$ sensitivities), we provide an algorithm based on importance sampling of $\ell_p$ Lewis weights, which computes a constant factor approximation to the total sensitivity at the cost of roughly $O(\sqrt{d})$ sensitivity computations. Furthermore, we estimate the maximum $\ell_1$ sensitivity, up to a $\sqrt{d}$ factor, using $O(d)$ sensitivity computations. We generalize all these results to $\ell_p$ norms for $p > 1$. Lastly, we experimentally show that for a wide class of matrices in real-world datasets, the total sensitivity can be quickly approximated and is significantly smaller than the theoretical prediction, demonstrating that real-world datasets have low intrinsic effective dimensionality.


title: Statistical Inference on Simulation Output: Batching as an Inferential Device

abstract: We present {batching} as an omnibus device for statistical inference on simulation output. We consider the classical context of a simulationist performing statistical inference on an estimator $\theta_n$ (of an unknown fixed quantity $\theta$) using only the output data $(Y_1,Y_2,\ldots,Y_n)$ gathered from a simulation. By \emph{statistical inference}, we mean approximating the sampling distribution of the error $\theta_n-\theta$ toward: (A) estimating an ``assessment'' functional $\psi$, e.g., bias, variance, or quantile; or (B) constructing a $(1-\alpha)$-confidence region on $\theta$. We argue that batching is a remarkably simple and effective inference device that is especially suited for handling dependent output data such as what one frequently encounters in simulation contexts. We demonstrate that if the number of batches and the extent of their overlap are chosen correctly, batching retains bootstrap's attractive theoretical properties of {strong consistency} and {higher-order accuracy}. For constructing confidence regions, we characterize two limiting distributions associated with a Studentized statistic. Our extensive numerical experience confirms theoretical insight, especially about the effects of batch size and batch overlap.


title: "Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

abstract: Intuitive interaction has long been seen as a highly user-friendly method. There are attempts to implement intuitive interfaces in vehicles in both research and industrial, such as voice commands. However, there is a lack of exploration in the in-vehicle multi-modal intuitive interaction, especially under a dynamic driving scenario. In this research, we conducted a design workshop (N=6) to understand user's needs and designers' considerations on the in-vehicle multi-modal intuitive interface, based on which we implemented our design on both a simulator and a real autonomous vehicle using Wizard-of-Oz. We conducted a user experiment (N=12) on the simulator to explore determinants of users' acceptance, experience, and behavior. We figured that acceptance was significantly influenced by six determinants. Drivers' behavior has an obvious pattern of change. Drivers have been proven to have less workload but distractions were also reported. Our findings offered empirical evidence which could give insights into future vehicle design.


title: Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems

abstract: We consider stochastic optimization problems with heavy-tailed noise with structured density. For such problems, we show that it is possible to get faster rates of convergence than $\mathcal{O}(K^{-2(\alpha - 1)/\alpha})$, when the stochastic gradients have finite moments of order $\alpha \in (1, 2]$. In particular, our analysis allows the noise norm to have an unbounded expectation. To achieve these results, we stabilize stochastic gradients, using smoothed medians of means. We prove that the resulting estimates have negligible bias and controllable variance. This allows us to carefully incorporate them into clipped-SGD and clipped-SSTM and derive new high-probability complexity bounds in the considered setup.


title: Coarse correlated equilibria in linear quadratic mean field games and application to an emission abatement game

abstract: Coarse correlated equilibria (CCE) are a good alternative to Nash equilibria (NE), as they arise more naturally as outcomes of learning algorithms and they may exhibit higher payoffs than NE. CCEs include a device which allows players' strategies to be correlated without any cooperation, only through information sent by a mediator. We develop a methodology to concretely compute mean field CCEs in a linear-quadratic mean field game framework. We compare their performance to mean field control solutions and mean field NE (usually named MFG solutions). Our approach is implemented in the mean field version of an emission abatement game between greenhouse gas emitters. In particular, we exhibit a simple and tractable class of mean field CCEs which allows to outperform very significantly the mean field NE payoff and abatement levels, bridging the gap between the mean field NE and the social optimum obtained by mean field control.


title: Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization

abstract: We identify a new phenomenon in neural network optimization which arises from the interaction of depth and a particular heavy-tailed structure in natural data. Our result offers intuitive explanations for several previously reported observations about network training dynamics. In particular, it implies a conceptually new cause for progressive sharpening and the edge of stability; we also highlight connections to other concepts in optimization and generalization including grokking, simplicity bias, and Sharpness-Aware Minimization. Experimentally, we demonstrate the significant influence of paired groups of outliers in the training data with strong opposing signals: consistent, large magnitude features which dominate the network output throughout training and provide gradients which point in opposite directions. Due to these outliers, early optimization enters a narrow valley which carefully balances the opposing groups; subsequent sharpening causes their loss to rise rapidly, oscillating between high on one group and then the other, until the overall loss spikes. We describe how to identify these groups, explore what sets them apart, and carefully study their effect on the network's optimization and behavior. We complement these experiments with a mechanistic explanation on a toy example of opposing signals and a theoretical analysis of a two-layer linear network on a simple model. Our finding enables new qualitative predictions of training behavior which we confirm experimentally. It also provides a new lens through which to study and improve modern training practices for stochastic optimization, which we highlight via a case study of Adam versus SGD.


title: Models towards Risk Behavior Prediction and Analysis: A Netherlands Case study

abstract: In many countries financial service providers have to elicit their customers risk preferences, when offering products and services. For instance, in the Netherlands pension funds will be legally obliged to factor in their clients risk preferences when devising their investment strategies. Therefore, assessing and measuring the risk preferences of individuals is critical for the analysis of individuals' behavior and policy prescriptions. In the psychology and economics, a number of methods to elicit risk preferences have been developed using hypothetical scenarios and economic experiments. These methods of eliciting individual risk preferences are usually applied to small samples because they are expensive and the implementation can be complex and not suitable when large cohorts need to be measured. A large number of supervised learning models ranging from linear regression to support vector machines are used to predict risk preference measures using socio-economic register data such as age, gender, migration background and other demographic variables in combination with data on income, wealth, pension fund contributions, and other financial data. The employed machine learning models cover a range of assumptions and properties as well as a diverse set of regression metrics. The optimum model is selected using the metrics and interpretability of the model. The optimal models are lasso regression and gradient boosting machines with mean average percentage error of about 30%. This is important as it helps to estimate risk attitudes without actually measuring them. It should be noted that with the current accuracy the tested models are not ready for deployment for applications that require high accuracy. However, the results do indicate which models should be used in situations that do not require the most accurate predictions such as augmentation data for pensions' recommendation.


title: Raman Spectroscopy Reveals Photobiomodulation-Induced {\alpha}-Helix to {\beta}-Sheet Transition in Tubulins: Potential Implications for Alzheimer's and Other Neurodegenerative Diseases

abstract: In this study, we employed a Raman spectroscopic analysis of the amide I band of polymerized samples of tubulin exposed to pulsed low-intensity NIR radiation (810 nm, 10 Hz, 22.5 J/cm$^{2}$ dose). Peaks in the Raman fingerprint region (300$\unicode{x2013}$1900 cm$^{-1}$), in particular, in the amide I band (1600$\unicode{x2013}$1700 cm$^{-1}$), can be used to quantify the percentage of protein secondary structures. Under this band, hidden signals of $\mathrm{C}$=$\mathrm{O}$ stretching, belonging to different structures, are superimposed$\unicode{x2014}$producing a complex signal as a result. An accurate decomposition of the amide I band is therefore required for the reliable analysis of the conformation of proteins, which we achieved through a straightforward method employing a Voigt profile. This approach was validated through secondary structure analyses of unexposed control samples, for which comparisons with other values available in the literature could be conducted. Subsequently, using this validated method, we present novel findings of statistically significant alterations in the secondary structures of NIR-exposed tubulin, characterized by a notable decrease in alpha-helix content and a concurrent increase in beta-sheets compared to the control samples. The alpha-helix to beta-sheet transition suggests that PBM reduces microtubule stability and introduces dynamism to allow for the remodeling and, consequently, refreshing of microtubule structures. This newly discovered mechanism could have implications for reducing the risks associated with brain aging, including neurodegenerative diseases like Alzheimer's disease.


title: Perturbed examples reveal invariances shared by language models

abstract: The rapid growth in natural language processing (NLP) research has led to numerous new models, outpacing our understanding of how they compare to established ones. One major reason for this difficulty is saturating benchmarks, which may not well reflect differences in model performance in the wild. In this work, we introduce a novel framework to compare two NLP models by revealing their shared invariance to interpretable input perturbations targeting a specific linguistic capability. Via experiments on models from the same and different architecture families, this framework offers insights about how changes in models (e.g., distillation, size increase) affect linguistic capabilities. Furthermore, our framework enables evaluation of invariances between commercial black-box models (e.g., InstructGPT family) and models that are better understood (e.g., GPT-2). Across experiments, we observe that large language models share many invariances encoded by models of various sizes, whereas the invariances by large models are only shared by other large models. Possessing a wide variety of invariances may be key to the recent successes of large language models, and our framework can shed light on the types of invariances retained or emerging in new models. We make the code publicly available.


title: Exploring Climate with Obliquity in a Variable-eccentricity Earth-like World

abstract: Exploring planetary systems similar to our solar system can provide a means to explore a large range of possibly temperate climates on Earth-like worlds. Rather than run hundreds of simulations with different eccentricities at fixed obliquities, our variable-eccentricity approach provides a means to cover an incredibly large parameter space. Herein Jupiter's orbital radius is moved substantially inward in two different scenarios, causing a forcing on Earth's eccentricity. In one case, the eccentricity of Earth varies from 0 to 0.27 over ~7000 yr for three different fixed obliquities (0{\deg}, 23{\deg}, and 45{\deg}). In another case, the eccentricity varies from 0 to 0.53 over ~9400 yr in a single case with zero obliquity. In all cases, we find that the climate remains stable, but regional habitability changes through time in unique ways. At the same time, the moist greenhouse state is approached but only when at the highest eccentricities.


title: $q$-Independence of the $C^{*}$-algebra of "Continuous Functions" on a Quantum $2\times 2$-Matrix Ball

abstract: For $0<q<1,$ let $\mathrm{Pol}(\mathrm{Mat}_{2})_q$ be the $q$-analogue of regular functions on the open matrix ball of $2\times 2$-matrices introduced by L. Vaksman. We show that the universal enveloping $C^{*}$-algebras of $\mathrm{Pol}(\mathrm{Mat}_{2})_{q},$ $0<q<1,$ are isomorphic for all values of $q.$


title: Cosmic magnification in beyond-Horndeski gravity

abstract: The cosmic magnification is able to probe the geometry of large scale structure on cosmological scales, thereby providing another window for probing theories of the late-time accelerated expansion of the Universe. It holds the potential to reveal new information on the nature of dark energy and modified gravity. By using the angular power spectrum, we investigated cosmic magnification in beyond-Horndeski gravity. We incorporated the known relativistic corrections and considered only large scales, where relativistic effects are known to become substantial. We probed both the total relativistic signal, and the individual relativistic signals. Our results suggest that surveys at low redshifts ($z \,{\lesssim}\, 0.5$) will be able to measure directly the total relativistic signal in the total magnification angular power spectrum, without the need for multi-tracer analysis (to beat down cosmic variance); similarly, for the Doppler signal, at the given $z$. However, for the integrated-Sachs-Wolfe, the time-delay, and the (gravitational) potential signals, respectively, it will require surveys at high redshifts ($z \,{\gtrsim}\, 3$). For both aforementioned sets of signals, their amplitudes at the given $z$ will ordinarily surpass cosmic variance, and hence, are able to be detected directly; whereas at other $z$, multi-tracer techniques will need to be taken into account. We also found that the beyond-Horndeski gravity boosts relativistic effects; consequently, the cosmic magnification. Conversely, relativistic effects enhance the potential of the total magnification angular power spectrum to detect the imprint of beyond-Horndeski gravity.


title: Buckyballs directly probe inter-valley coherence and intra-valley pairing in moire heterostructures

abstract: Moire materials like twisted bilayer graphene have emerged as a rich playground of strongly correlated physics, where the effect of interactions can be drastically enhanced by tuning the non-interacting density of states via twist angle. A key feature of bilayer graphene at small twist angles is that the two valleys of graphene are effectively decoupled at the non-interacting level, leading to an emergent U(1) symmetry corresponding to the conservation of valley-charge. Theoretical studies invariably find that short-ranged interactions tend to break this symmetry, leading to inter-valley coherence (IVC). However, there is no direct experimental probe of this ubiquitous ordering tendency. Here, I propose an experimental signature of IVC order by coupling with a closely related system where valley-mixing is guaranteed - the pentagonal disclinations of graphene. Such disclinations are naturally found in fullerenes. The tunneling current between twisted bilayer graphene and an appropriately oriented large buckyball has a sharp signature of the onset of IVC order. Successfully integrating these fullerenes in a scanning tunneling microscope would allow spatial resolution of the IVC order parameter on a sub-moire scale. Experimentally constraining the broken symmetries and order parameters in the multitude of emerging correlated insulators is a crucial first step to understanding the superconductivity that develops on doping these exotic `normal' states.


title: HADES: Fast Singularity Detection with Local Measure Comparison

abstract: We introduce Hades, an unsupervised algorithm to detect singularities in data. This algorithm employs a kernel goodness-of-fit test, and as a consequence it is much faster and far more scaleable than the existing topology-based alternatives. Using tools from differential geometry and optimal transport theory, we prove that Hades correctly detects singularities with high probability when the data sample lives on a transverse intersection of equidimensional manifolds. In computational experiments, Hades recovers singularities in synthetically generated data, branching points in road network data, intersection rings in molecular conformation space, and anomalies in image data.

categories: cs.LG cs.AI math.AT math.DG math.ST stat.TH


title: Measure transport via polynomial density surrogates

abstract: We discuss an algorithm to compute transport maps that couple the uniform measure on $[0,1]^d$ with a specified target distribution $\pi$ on $[0,1]^d$. The primary objectives are either to sample from or to compute expectations w.r.t. $\pi$. The method is based on leveraging a polynomial surrogate of the target density, which is obtained by a least-squares or interpolation approximation. We discuss the design and construction of suitable sparse approximation spaces, and provide a complete error and cost analysis for target densities belonging to certain smoothness classes. Further, we explore the relation between our proposed algorithm and related approaches that aim to find suitable transports via optimization over a class of parametrized transports. Finally, we discuss the efficient implementation of our algorithm and report on numerical experiments which confirm our theory.


title: Multiple and spectrally robust photonic magic angles in reconfigurable {\alpha}-MoO3 trilayers

abstract: The assembling of twisted stacks of van der Waals (vdW) materials had led to the discovery of a profusion of remarkable physical phenomena in recent years, as it provides a means to accurately control and harness electronic band structures. This has given birth to the so-called field of twistronics. An analogous concept has been developed for highly confined polaritons, or nanolight, in twisted bilayers of strongly anisotropic vdW materials, extending the field to the twistoptics realm. In this case, the emergence of a topological transition of the polaritonic dispersion at a given twist angle (photonic magic angle) results in the propagation of nanolight along one specific direction (canalization regime), holding promises for unprecedented control of the flow of energy at the nanoscale. However, there is a fundamental limitation in twistoptics that critically impedes such control: there is only one photonic magic angle (and thus canalization direction) in a twisted bilayer and it is fixed for each incident frequency. Here, we overcome this limitation by demonstrating the existence of multiple spectrally robust photonic magic angles in reconfigurable twisted vdW trilayers. As a result, we show that canalization of nanolight can be programmed at will along any desired in-plane direction in a single device, and, importantly, within broad spectral ranges of up to 70 cm-1. Our findings lay the foundation for robust and widely tunable twistoptics, opening the door for applications in nanophotonics where on-demand control of energy at the nanoscale is crucial, such as thermal management, nanoimaging or entanglement of quantum emitters.


title: The early evolution of young massive clusters. II. The kinematic history of NGC 6618 / M 17

abstract: The fraction of massive stars in young stellar clusters is of importance as they are the dominant sources of both mechanical and radiative feedback, strongly influencing the thermal and dynamical state of their birth environments. It turns out that a significant fraction of massive stars escape from their parent cluster via dynamical interactions of single stars and/or multiple stellar systems. M 17 is the nearest giant H II region hosting a very young and massive cluster: NGC 6618. Our aim is to identify stars brighter than G < 21 mag that belong to NGC 6618, including the (massive) stars that may have escaped since its formation, and to determine the cluster distance and age. We identified 42 members of NGC 6618 of which eight have a spectral type of O, with a mean distance of 1675 pc and a transversal velocity dispersion of about 3 km/s , and a radial velocity dispersion of 6 km/s. Another ten O stars are associated with NGC 6618, but they cannot be classified as members due to poor astrometry or high extinction. We have also identified six O star runaways. The relative transverse velocity of these runaways ranges from 10 to 70 km/s and their kinematic age ranges from about 100 to 750 kyr. Given the already established young age of NGC 6618 (< 1 Myr), this implies that massive stars are being ejected from the cluster already directly after or during the cluster formation process. When constructing the initial mass function, one has to take into account the massive stars that have already escaped from the cluster, that is, about 30% of the O stars of the original population of NGC 6618. The trajectories of the O runaways can be traced back to the central 0.25 pc region of NGC 6618. The good agreement between the evolutionary and kinematic age of the runaways implies that the latter provides an independent way to estimate (a lower limit to) the age of the cluster.


title: Cloud-cloud collisions triggering star formation in galaxy simulations

abstract: Cloud-cloud collisions (CCCs) are expected to compress gas and trigger star formation. However, it is not well understood how the collisions and the induced star formation affect galactic-scale properties. By developing an on-the-fly algorithm to identify CCCs at each timestep in a galaxy simulation and a model that relates CCC-triggered star formation to collision speeds, we perform simulations of isolated galaxies to study the evolution of galaxies and giant molecular clouds (GMCs) with prescriptions of self-consistent CCC-driven star formation and stellar feedback. We find that the simulation with the CCC-triggered star formation produces slightly higher star formation rates and a steeper Kennicutt-Schmidt relation than that with a more standard star formation recipe, although collision speeds and frequencies are insensitive to the star formation models. In the simulation with the CCC model, about 70 per cent of the stars are born via CCCs, and colliding GMCs with masses of $\approx 10^{5.5}\,M_{\odot}$ are the main drivers of CCC-driven star formation. In the simulation with the standard star formation recipe, about 50 per cent of stars are born in colliding GMCs even without the CCC-triggered star formation model. These results suggest that CCCs may be one of the most important star formation processes in galaxy evolution. Furthermore, we find that a post-processing analysis of CCCs, as used in previous studies in galaxy simulations, may lead to slightly greater collision speeds and significantly lower collision frequencies than the on-the-fly analysis.


title: Physics PhD student perspectives on the importance and difficulty of finding a research group

abstract: Joining a research group is one of the most important events on a graduate student's path to becoming an independent physics researcher and earning a PhD. However, graduate students' perspectives on the experience of finding a research group are not well-documented in the literature. Understanding these perspectives is crucial for evaluating whether departments are providing students with adequate support while they search for a research group, and how difficulties during this process contribute to attrition. Semi-structured interviews with N=20 first and second year physics PhD students reveal that incoming graduate students see joining a research group as a significant decision, and recognize that it may impact whether they will be able to complete the program. We found that students who struggled to find a group felt isolated and worried about falling behind their peers, whereas students who were able to immerse themselves in a positive group environment reported increased sense of belonging in their programs. The process of finding a research group often held differential importance for students identifying as women and non-binary, who at times reported having to deprioritize their preferred research topic in order to be part of a more inclusive working environment. Although incoming graduate students characterized joining a research group as a significant decision, they often felt unprepared to make it. Moreover, they perceived an overall lack of guidance and structure from their departments, and characterized coursework as a barrier to searching for a group. Our findings suggest that providing students with better support during their group search process could help improve retention, particularly for traditionally underrepresented students, and improve students' overall satisfaction in their graduate programs.


title: Enhancing LLM Intelligence with ARM-RAG: Auxiliary Rationale Memory for Retrieval Augmented Generation

abstract: Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However, unlike humans, frozen LLMs do not improve over time; they neither acquire new knowledge nor learn from their successes or failures. Some approaches to improving the intelligence of LLMs include fine-tuning models based on problem-solving performance (Zelikman et al., 2022), and building bigger and more sophisticated models (Bubeck et al., 2023). However, these methods have the drawback of requiring substantial data and computational resources to retrain existing models. In this paper, we explore the use of Retrieval Augmented Generation, also known as RAG (Lewis et al., 2021) to improve problem-solving performance. We propose ARM-RAG (Auxiliary Rationale Memory for Retrieval Augmented Generation), a system that learns from its successes without incurring high training costs. We demonstrate that the storage and subsequent retrieval of reasoning chains have a positive influence on performance in grade-school math problems.


title: Non-Linear pricing with differential machine learning

abstract: The objective of this research was to evaluate and gain experience with application of two methods used for pricing and sensitivity analysis of exotic financial derivative instruments, namely, automatic adjoint differentiation (AAD) and deep learning. The work was inspired by publication of Danske Bank quantitative analysts Antoine Savine and Brian Huge in which the authors introduced a novel approach to building extremely efficient pricing and risk approximators for arbitrary financial derivative instruments.


title: On Leakage in Machine Learning Pipelines

abstract: Machine learning (ML) provides powerful tools for predictive modeling. ML's popularity stems from the promise of sample-level prediction with applications across a variety of fields from physics and marketing to healthcare. However, if not properly implemented and evaluated, ML pipelines may contain leakage typically resulting in overoptimistic performance estimates and failure to generalize to new data. This can have severe negative financial and societal implications. Our aim is to expand understanding associated with causes leading to leakage when designing, implementing, and evaluating ML pipelines. Illustrated by concrete examples, we provide a comprehensive overview and discussion of various types of leakage that may arise in ML pipelines.


title: Polyregular functions on unordered trees of bounded height

abstract: We consider injective first-order interpretations that input and output trees of bounded height. The corresponding functions have polynomial output size, since a first-order interpretation can use a k-tuple of input nodes to represent a single output node. We prove that the equivalence problem for such functions is decidable, i.e. given two such interpretations, one can decide whether, for every input tree, the two output trees are isomorphic. We also give a calculus of typed functions and combinators which derives exactly injective first-order interpretations for unordered trees of bounded height. The calculus is based on a type system, where the type constructors are products, coproducts and a monad of multisets. Thanks to our results about tree-to-tree interpretations, the equivalence problem is decidable for this calculus. As an application, we show that the equivalence problem is decidable for first-order interpretations between classes of graphs that have bounded tree-depth. In all cases studied in this paper, first-order logic and MSO have the same expressive power, and hence all results apply also to MSO interpretations.


title: A First Look At NAT64 Deployment In-The-Wild

abstract: IPv6 is a fundamentally different Internet Protocol than IPv4, and IPv6-only networks cannot, by default, communicate with the IPv4 Internet. This lack of interoperability necessitates complex mechanisms for incremental deployment and bridging networks so that non-dual-stack systems can interact with the whole Internet. NAT64 is one such bridging mechanism by which a network allows IPv6-only clients to connect to the entire Internet, leveraging DNS to identify IPv4-only networks, inject IPv6 response addresses pointing to an internal gateway, and seamlessly translate connections. To date, our understanding of NAT64 deployments is limited; what little information exists is largely qualitative, taken from mailing lists and informal discussions. In this work, we present a first look at the active measurement of NAT64 deployment on the Internet focused on deployment prevalence, configuration, and security. We seek to measure NAT64 via two distinct large-scale measurements: 1) open resolvers on the Internet, and 2) client measurements from RIPE Atlas. For both datasets, we broadly find that despite substantial anecdotal reports of NAT64 deployment, measurable deployments are exceedingly sparse. While our measurements do not preclude the large-scale deployment of NAT64, they do point to substantial challenges in measuring deployments with our existing best-known methods. Finally, we also identify problems in NAT64 deployments, with gateways not following the RFC specification and also posing potential security risks.


title: Dissipation anomaly and anomalous dissipation in incompressible fluid flows

abstract: Dissipation anomaly, a phenomenon predicted by Kolmogorov's theory of turbulence, is the persistence of a non-vanishing energy dissipation for solutions of the Navier-Stokes equations as the viscosity goes to zero. Anomalous dissipation, predicted by Onsager, is a failure of solutions of the limiting Euler equations to preserve the energy balance. Motivated by a recent dissipation anomaly construction for the 3D Navier-Stokes equations by Bru\`e and De Lellis (2023), we prove the existence of various scenarios in the limit of vanishing viscosity: the total and partial loss of the energy due to dissipation anomaly, absolutely continuous dissipation anomaly, anomalous dissipation without dissipation anomaly, and the existence of infinitely many limiting solutions of the Euler equations in the limit of vanishing viscosity. We also discover a relation between dissipation anomaly and the discontinuity of the energy of the limit solution. Finally, expanding on the obtained total dissipation anomaly construction, we show the existence of dissipation anomaly for long time averages, relevant for turbulent flows, proving that the Doering-Foias (2002) upper bound is sharp.


title: The role of sign indefinite invariants in shaping turbulent cascades

abstract: We highlight a non-canonical yet natural choice of variables for an efficient derivation of a kinetic equation for the energy density in non-isotropic systems, including internal gravity waves on a vertical plane, inertial and Rossby waves. The existence of a second quadratic invariant simplifies the kinetic equation and leads to extra conservation laws for resonant interactions. We analytically determine the scaling of the radial turbulent energy spectrum. Our findings suggest the existence of an inverse energy cascade of internal gravity waves, from small to large scales, in practically relevant scenarios.

categories: physics.flu-dyn math-ph math.MP physics.geo-ph


title: Approximation of Subgraph Counts in the Uniform Attachment Model

abstract: We use Stein's method to obtain distributional approximations of subgraph counts in the uniform attachment model or random directed acyclic graph; we provide also estimates of rates of convergence. In particular, we give uni- and multi-variate Poisson approximations to the counts of cycles, and normal approximations to the counts of unicyclic subgraphs; we also give a partial result for the counts of trees. We further find a class of multicyclic graphs whose subgraph counts are a.s. bounded as $n\to\infty$.


title: On the Normalisation of the Modular Forms in Modular Invariant Theories of Flavour

abstract: The problem of normalisation of the modular forms in modular invariant lepton and quark flavour models is discussed. Modular invariant normalisations of the modular forms are proposed.


title: Resource analysis of quantum algorithms for coarse-grained protein folding models

abstract: Protein folding processes are a vital aspect of molecular biology that is hard to simulate with conventional computers. Quantum algorithms have been proven superior for certain problems and may help tackle this complex life science challenge. We analyze the resource requirements for simulating protein folding on a quantum computer, assessing this problem's feasibility in the current and near-future technological landscape. We calculate the minimum number of qubits, interactions, and two-qubit gates necessary to build a heuristic quantum algorithm with the specific information of a folding problem. Particularly, we focus on the resources needed to build quantum operations based on the Hamiltonian linked to the protein folding models for a given amino acid count. Such operations are a fundamental component of these quantum algorithms, guiding the evolution of the quantum state for efficient computations. Specifically, we study course-grained folding models on the lattice and the fixed backbone side-chain conformation model and assess their compatibility with the constraints of existing quantum hardware given different bit-encodings. We conclude that the number of qubits required falls within current technological capabilities. However, the limiting factor is the high number of interactions in the Hamiltonian, resulting in a quantum gate count unavailable today.


title: Laser-driven ion and electron acceleration from near-critical density gas targets: towards high-repetition rate operation in the 1 PW, sub-100 fs laser interaction regime

abstract: Ion acceleration from gaseous targets driven by relativistic-intensity lasers was demonstrated as early as the late 90s, yet most of the experiments conducted to date have involved picosecond-duration, Nd:glass lasers operating at low repetition rate. Here, we present measurements on the interaction of ultraintense ($\sim 10^{20}\,\rm W\,cm^{-2}$, 1 PW), ultrashort ($\sim 70\,\rm fs$) Ti:Sa laser pulses with near-critical ($\sim 10^{20}\,\rm cm^{-3}$) helium gas jets, a debris-free targetry compatible with high ($\sim 1\,\rm Hz$) repetition rate operation. We provide evidence of $\alpha$ particles being forward accelerated up to $\sim 2.7\,\rm MeV$ energy with a total flux of $\sim 10^{11}\,\rm sr^{-1}$ as integrated over $>0.1 \,\rm MeV$ energies and detected within a $0.5\,\rm mrad$ solid angle. We also report on on-axis emission of relativistic electrons with an exponentially decaying spectrum characterized by a $\sim 10\,\rm MeV$ slope, i.e., five times larger than the standard ponderomotive scaling. The total charge of these electrons with energy above 2 MeV is estimated to be of $\sim 1 \,\rm nC$, corresponding to $\sim 0.1\,\%$ of the laser drive energy. In addition, we observe the formation of a plasma channel, extending longitudinally across the gas density maximum and expanding radially with time. These results are well captured by large-scale particle-in-cell simulations, which reveal that the detected fast ions most likely originate from reflection off the rapidly expanding channel walls. The latter process is predicted to yield ion energies in the MeV range, which compare well with the measurements. Finally, direct laser acceleration is shown to be the dominant mechanism behind the observed electron energization.


title: Multi-band description of the upper critical field of bulk FeSe

abstract: The upper critical field of multi-band superconductors can be an essential quantity to unravel the nature of superconducting pairing and its interplay with the electronic structure. Here we experimentally map out the complete upper critical field phase diagram of FeSe for different magnetic field orientations at temperatures down to 0.3 K using both resistivity and torque measurements. The temperature dependence of the upper critical field reflects that of a multi-band superconductor and requires a two-band description in the clean limit with band coupling parameters favouring interband over intraband interactions. Despite the relatively small Maki parameter in FeSe of $\alpha \sim 1.6$, the multi-band description of the upper critical field is consistent with the stabilization of a FFLO state below $T/T_{\rm c}\sim 0.3$. We find that the anomalous behaviour of the upper critical field is linked to a departure from the single-band picture, and FeSe provides a clear example where multi-band effects and the strong anisotropy of the superconducting gap need to be taken into account.


title: SpaDeLeF: A Dataset for Hierarchical Classification of Lexical Functions for Collocations in Spanish

abstract: In natural language processing (NLP), lexical function is a concept to unambiguously represent semantic and syntactic features of words and phrases in text first crafted in the Meaning-Text Theory. Hierarchical classification of lexical functions involves organizing these features into a tree-like hierarchy of categories or labels. This is a challenging task as it requires a good understanding of the context and the relationships among words and phrases in text. It also needs large amounts of labeled data to train language models effectively. In this paper, we present a dataset of most frequent Spanish verb-noun collocations and sentences where they occur, each collocation is assigned to one of 37 lexical functions defined as classes for a hierarchical classification task. Each class represents a relation between the noun and the verb in a collocation involving their semantic and syntactic features. We combine the classes in a tree-based structure, and introduce classification objectives for each level of the structure. The dataset was created by dependency tree parsing and matching of the phrases in Spanish news. We provide baselines and data splits for each objective.


title: Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter

abstract: The compact muon solenoid (CMS) experiment is a general-purpose detector for high-energy collision at the large hadron collider (LHC) at CERN. It employs an online data quality monitoring (DQM) system to promptly spot and diagnose particle data acquisition problems to avoid data quality loss. In this study, we present semi-supervised spatio-temporal anomaly detection (AD) monitoring for the physics particle reading channels of the hadronic calorimeter (HCAL) of the CMS using three-dimensional digi-occupancy map data of the DQM. We propose the GraphSTAD system, which employs convolutional and graph neural networks to learn local spatial characteristics induced by particles traversing the detector, and global behavior owing to shared backend circuit connections and housing boxes of the channels, respectively. Recurrent neural networks capture the temporal evolution of the extracted spatial features. We have validated the accuracy of the proposed AD system in capturing diverse channel fault types using the LHC Run-2 collision data sets. The GraphSTAD system has achieved production-level accuracy and is being integrated into the CMS core production system--for real-time monitoring of the HCAL. We have also provided a quantitative performance comparison with alternative benchmark models to demonstrate the promising leverage of the presented system.


title: Applying projective functors to arbitrary holonomic simple modules

abstract: We prove that applying a projective functor to a holonomic simple module over a semi-simple finite dimensional complex Lie algebra produces a module that has an essential semi-simple submodule of finite length. This implies that holonomic simple supermodules over certain Lie superalgebras are quotients of modules that are induced from simple modules over the even part. We also provide some further insight into the structure of Lie algebra modules that are obtained by applying projective functors to simple modules.


title: JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models

abstract: Image captioning studies heavily rely on automatic evaluation metrics such as BLEU and METEOR. However, such n-gram-based metrics have been shown to correlate poorly with human evaluation, leading to the proposal of alternative metrics such as SPICE for English; however, no equivalent metrics have been established for other languages. Therefore, in this study, we propose an automatic evaluation metric called JaSPICE, which evaluates Japanese captions based on scene graphs. The proposed method generates a scene graph from dependencies and the predicate-argument structure, and extends the graph using synonyms. We conducted experiments employing 10 image captioning models trained on STAIR Captions and PFN-PIC and constructed the Shichimi dataset, which contains 103,170 human evaluations. The results showed that our metric outperformed the baseline metrics for the correlation coefficient with the human evaluation.


title: Selective Visual Representations Improve Convergence and Generalization for Embodied AI

abstract: Embodied AI models often employ off the shelf vision backbones like CLIP to encode their visual observations. Although such general purpose representations encode rich syntactic and semantic information about the scene, much of this information is often irrelevant to the specific task at hand. This introduces noise within the learning process and distracts the agent's focus from task-relevant visual cues. Inspired by selective attention in humans-the process through which people filter their perception based on their experiences, knowledge, and the task at hand-we introduce a parameter-efficient approach to filter visual stimuli for embodied AI. Our approach induces a task-conditioned bottleneck using a small learnable codebook module. This codebook is trained jointly to optimize task reward and acts as a task-conditioned selective filter over the visual observation. Our experiments showcase state-of-the-art performance for object goal navigation and object displacement across 5 benchmarks, ProcTHOR, ArchitecTHOR, RoboTHOR, AI2-iTHOR, and ManipulaTHOR. The filtered representations produced by the codebook are also able generalize better and converge faster when adapted to other simulation environments such as Habitat. Our qualitative analyses show that agents explore their environments more effectively and their representations retain task-relevant information like target object recognition while ignoring superfluous information about other objects. Code and pretrained models are available at our project website: https://embodied-codebook.github.io.


title: Quantization-aware Neural Architectural Search for Intrusion Detection

abstract: Deploying machine learning-based intrusion detection systems (IDSs) on hardware devices is challenging due to their limited computational resources, power consumption, and network connectivity. Hence, there is a significant need for robust, deep learning models specifically designed with such constraints in mind. In this paper, we present a design methodology that automatically trains and evolves quantized neural network (NN) models that are a thousand times smaller than state-of-the-art NNs but can efficiently analyze network data for intrusion at high accuracy. In this regard, the number of LUTs utilized by this network when deployed to an FPGA is between 2.3x and 8.5x smaller with performance comparable to prior work.


title: Linear to circular conversion in the polarized radio emission of a magnetar

abstract: Radio emission from magnetars provides a unique probe of the relativistic, magnetized plasma within the near-field environment of these ultra-magnetic neutron stars. The transmitted waves can undergo birefringent and dispersive propagation effects that result in frequency-dependent conversions of linear to circularly polarized radiation and vice-versa, thus necessitating classification when relating the measured polarization to the intrinsic properties of neutron star and fast radio burst (FRB) emission sites. We report the detection of such behavior in 0.7-4 GHz observations of the P = 5.54 s radio magnetar XTE J1810$-$197 following its 2018 outburst. The phenomenon is restricted to a narrow range of pulse phase centered around the magnetic meridian. Its temporal evolution is closely coupled to large-scale variations in magnetic topology that originate from either plastic motion of an active region on the magnetar surface or free precession of the neutron star crust. Our model of the effect deviates from simple theoretical expectations for radio waves propagating through a magnetized plasma. Birefringent self-coupling between the transmitted wave modes, line-of-sight variations in the magnetic field direction and differences in particle charge or energy distributions above the magnetic pole are explored as possible explanations. We discuss potential links between the immediate magneto-ionic environments of magnetars and those of FRB progenitors.


title: JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value Extraction

abstract: Product attribute value extraction is an important task in e-Commerce which can help several downstream applications such as product search and recommendation. Most previous models handle this task using sequence labeling or question answering method which rely on the sequential position information of values in the product text and are vulnerable to data discrepancy between training and testing. This limits their generalization ability to real-world scenario in which each product can have multiple descriptions across various shopping platforms with different composition of text and style. They also have limited zero-shot ability to new values. In this paper, we propose a multi-task learning model with value generation/classification and attribute prediction called JPAVE to predict values without the necessity of position information of values in the text. Furthermore, the copy mechanism in value generator and the value attention module in value classifier help our model address the data discrepancy issue by only focusing on the relevant part of input text and ignoring other information which causes the discrepancy issue such as sentence structure in the text. Besides, two variants of our model are designed for open-world and closed-world scenarios. In addition, copy mechanism introduced in the first variant based on value generation can improve its zero-shot ability for identifying unseen values. Experimental results on a public dataset demonstrate the superiority of our model compared with strong baselines and its generalization ability of predicting new values.


title: The Near-surface Shear Layer (NSSL) of the Sun: A Theoretical Model

abstract: We present a theoretical model of the near-surface shear layer (NSSL) of the Sun. Convection cells deeper down are affected by the Sun's rotation, but this is not the case in a layer just below the solar surface due to the smallness of the convection cells there. Based on this idea, we show that the thermal wind balance equation (the basic equation in the theory of the meridional circulation which holds inside the convection zone) can be solved to obtain the structure of the NSSL, matching observational data remarkably well.


title: Plasma density distribution and its perturbation by probes in axially symmetrical plasma

abstract: An analysis of plasma density distributions at arbitrary ion-atom collisionality for one-dimensional axially symmetrical cylindrical and annular plasmas is presented. Perturbations of plasma densities caused by a cylindrical probe are studied for arbitrary ion-atom collisionality. Analytical expressions for the plasma characteristics near the probe for low collisionality have been obtained. The plasma was modeled by the hydrodynamic neutral plasma equations, taking into account ionization, ion inertia, and a nonlinear ion frictional force, which dominates the plasma transport at low gas pressures. Significant plasma density depletion around the probe has been observed for a wide range of ion-atom collisionality. The presented results predict underestimation of plasma density obtained from the classical Langmuir probe procedure, and should provide a better understanding of electrostatic, magnetic, and microwave probes inserted into plasmas at low gas pressure.


title: Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Study

abstract: Large Multimodal Models (LMMs) have demonstrated impressive performance across various vision and language tasks, yet their potential applications in recommendation tasks with visual assistance remain unexplored. To bridge this gap, we present a preliminary case study investigating the recommendation capabilities of GPT-4V(ison), a recently released LMM by OpenAI. We construct a series of qualitative test samples spanning multiple domains and employ these samples to assess the quality of GPT-4V's responses within recommendation scenarios. Evaluation results on these test samples prove that GPT-4V has remarkable zero-shot recommendation abilities across diverse domains, thanks to its robust visual-text comprehension capabilities and extensive general knowledge. However, we have also identified some limitations in using GPT-4V for recommendations, including a tendency to provide similar responses when given similar inputs. This report concludes with an in-depth discussion of the challenges and research opportunities associated with utilizing GPT-4V in recommendation scenarios. Our objective is to explore the potential of extending LMMs from vision and language tasks to recommendation tasks. We hope to inspire further research into next-generation multimodal generative recommendation models, which can enhance user experiences by offering greater diversity and interactivity. All images and prompts used in this report will be accessible at https://github.com/PALIN2018/Evaluate_GPT-4V_Rec.


title: Analytic theory of Legendre-type transformations for a Frobenius manifold

abstract: Let $M$ be an $n$-dimensional Frobenius manifold. Fix $\kappa\in\{1,\dots,n\}$. Assuming certain invertibility, Dubrovin introduced the Legendre-type transformation $S_\kappa$, which transforms $M$ to an $n$-dimensional Frobenius manifold $S_\kappa(M)$. In this paper, we show that these $S_\kappa(M)$ share the same monodromy data at the Fuchsian singular point of the Dubrovin connection, and that for the case when $M$ is semisimple they also share the same Stokes matrix and the same central connection matrix. A straightforward application of the monodromy identification is the following: if we know the monodromy data of some semisimple Frobenius manifold $M$, we immediately obtain those of its Legendre-type transformations. Another application gives the identification between the $\kappa$th partition function of a semisimple Frobenius manifold $M$ and the topological partition function of $S_{\kappa}(M)$.


title: Pathological Character of Modifications to Coincident General Relativity: Cosmological Strong Coupling and Ghosts in $f(\Q)$ Theories

abstract: The intrinsic presence of ghosts in the symmetric teleparallel framework is elucidated. We illustrate our general arguments in $f(\mathbb{Q})$ theories by studying perturbations in the three inequivalent spatially flat cosmologies. Two of these branches exhibit reduced linear spectra, signalling they are infinitely strongly coupled. For the remaining branch we unveil the presence of seven gravitational degrees of freedom and show that at least one of them is a ghost. Our results rule out $f(\mathbb{Q})$ cosmologies and clarify the number of propagating degrees of freedom in these theories.


title: More on the spin-2 analogue of the massive BF model

abstract: The addition of mass terms in general breaks gauge symmetries which can be recovered usually via Stueckelberg fields. The massive BF model describes massive spin-1 particles while preserving the $U(1)$ symmetry without Stueckelberg fields. Replacing the spin-1 curvature (field strength) by the Riemann tensor one can define its spin-2 analogue (massive``BR'' model). Here we investigate the canonical structure of the free mBR model in terms of gauge invariants in arbitrary dimensions and compare with the massive BF model. We also investigate non linear completions of the mBR model in arbitrary dimensions. In $D=3$ we find a non linear completion in the form of a bimetric model which is a sub case of a new class of bimetric models whose decoupling limit is ghost free at leading order. Their spectrum consists only of massive spin-2 particles. In arbitrary dimensions $D\ge 3$ we show that the consistency of a possible single metric completion of the mBR model is related with the consistency of a higher rank description of massless spin-1 particles in arbitrary backgrounds.


title: Derived Categories of Permutahedral and Stellahedral Varieties

abstract: We utilize the coherent-constructible correspondence to construct full strongly exceptional collections of nef line bundles in the derived category of a toric variety through the combinatorics of constructible sheaves built from polytopes. To show that sequences are full, we build exact complexes of line bundles that categorify the relations in the McMullen polytope algebra. We compute the homomorphisms between certain constructible sheaves on polytopes and use this to reduce the question of exceptionality to showing that certain set differences of polytopes are contractible. As an application of our method, we construct full strongly exceptional collections of nef line bundles for the toric varieties associated to the permutahedron, stellahedron, and the type $B_n$ Coxeter permutahedron. The line bundles in our collections are indexed by base polytopes of loopless Schubert matroids, independence polytopes of all Schubert matroids, and feasible polytopes of loopless Schubert delta matroids, respectively. Our collections satisfy a number of nice properties: First, the quiver with relations that encodes the endomorphism algebra of the tilting sheaf can be described matroid-theoretically as a slight extension of the notion of weak maps and inclusion of matroids; Second, our collections are invariant under the natural symmetries of the corresponding fans; Finally, the induced semi-orthogonal decomposition of the derived categories refines the cuspidal semi-orthogonal decomposition as studied by Castravet and Tevelev. This gives a full strongly exceptional collection of nef line bundles for the cuspidal parts of the derived categories of our varieties indexed by loopless and coloopless Schubert matroids and Schubert delta matroids.


title: Sharp Thresholds Imply Circuit Lower Bounds: from random 2-SAT to Planted Clique

abstract: We show that sharp thresholds for Boolean functions directly imply average-case circuit lower bounds. More formally we show that any Boolean function exhibiting a sharp enough threshold at \emph{arbitrary} critical density cannot be computed by Boolean circuits of bounded depth and polynomial size. Our general result implies new average-case bounded depth circuit lower bounds in a variety of settings. (a) ($k$-cliques) For $k=\Theta(n)$, we prove that any circuit of depth $d$ deciding the presence of a size $k$ clique in a random graph requires exponential-in-$n^{\Theta(1/d)}$ size. To the best of our knowledge, this is the first average-case exponential size lower bound for bounded depth (not necessarily monotone) circuits solving the fundamental $k$-clique problem (for any $k=k_n$). (b)(random 2-SAT) We prove that any circuit of depth $d$ deciding the satisfiability of a random 2-SAT formula requires exponential-in-$n^{\Theta(1/d)}$ size. To the best of our knowledge, this is the first bounded depth circuit lower bound for random $k$-SAT for any value of $k \geq 2.$ Our results also provide the first rigorous lower bound in agreement with a conjectured, but debated, ``computational hardness'' of random $k$-SAT around its satisfiability threshold. (c)(Statistical estimation -- planted $k$-clique) Over the recent years, multiple statistical estimation problems have also been proven to exhibit a ``statistical'' sharp threshold, called the All-or-Nothing (AoN) phenomenon. We show that AoN also implies circuit lower bounds for statistical problems. As a simple corollary of that, we prove that any circuit of depth $d$ that solves to information-theoretic optimality a ``dense'' variant of the celebrated planted $k$-clique problem requires exponential-in-$n^{\Theta(1/d)}$ size.


title: Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselves

abstract: Misunderstandings arise not only in interpersonal communication but also between humans and Large Language Models (LLMs). Such discrepancies can make LLMs interpret seemingly unambiguous questions in unexpected ways, yielding incorrect responses. While it is widely acknowledged that the quality of a prompt, such as a question, significantly impacts the quality of the response provided by LLMs, a systematic method for crafting questions that LLMs can better comprehend is still underdeveloped. In this paper, we present a method named `Rephrase and Respond' (RaR), which allows LLMs to rephrase and expand questions posed by humans and provide responses in a single prompt. This approach serves as a simple yet effective prompting method for improving performance. We also introduce a two-step variant of RaR, where a rephrasing LLM first rephrases the question and then passes the original and rephrased questions together to a different responding LLM. This facilitates the effective utilization of rephrased questions generated by one LLM with another. Our experiments demonstrate that our methods significantly improve the performance of different models across a wide range to tasks. We further provide a comprehensive comparison between RaR and the popular Chain-of-Thought (CoT) methods, both theoretically and empirically. We show that RaR is complementary to CoT and can be combined with CoT to achieve even better performance. Our work not only contributes to enhancing LLM performance efficiently and effectively but also sheds light on a fair evaluation of LLM capabilities. Data and codes are available at https://github.com/uclaml/Rephrase-and-Respond.


title: Elastic and resonance structures of the nucleon from hadronic tensor in lattice QCD: implications for neutrino-nucleon scattering and hadron physics

abstract: Understanding the transitions of nucleons into various resonance structures through electromagnetic interactions plays a pivotal role in advancing our comprehension of the strong interactions within the domain of quark confinement. Furthermore, gaining precise insights into the elastic and resonance structures of nucleons is indispensable for deciphering the physics from neutrino-nucleus scattering cross sections experimental data, which remain theoretically challenging, even in the context of neutrino-nucleon interactions whose profound understanding is imperative for the neutrino oscillation experiments. One promising avenue involves the direct evaluation of the lepton-nucleon scattering cross sections across quasi-elastic, resonance, shallow-inelastic, and deep inelastic regions, which can be achieved through the hadronic tensor formalism in lattice QCD. In this work, we present the determination of the nucleon's Sachs electric form factor using the hadronic tensor formalism and verify that it is consistent with that from the conventional three-point function calculation. We additionally obtain the transition form factor from the nucleon to its first radial excited state within a finite volume. Consequently, we identify the latter with the nucleon-to-Roper transition form factor $G_E^*(Q^2)$, determine the corresponding longitudinal helicity amplitude $S_{1/2}(Q^2)$ and compare our findings with experimental measurements, for the first time using the hadronic tensor formalism. The limitations and systematic improvements of the approach are also discussed.


title: Deep Hashing via Householder Quantization

abstract: Hashing is at the heart of large-scale image similarity search, and recent methods have been substantially improved through deep learning techniques. Such algorithms typically learn continuous embeddings of the data. To avoid a subsequent costly binarization step, a common solution is to employ loss functions that combine a similarity learning term (to ensure similar images are grouped to nearby embeddings) and a quantization penalty term (to ensure that the embedding entries are close to binarized entries, e.g., -1 or 1). Still, the interaction between these two terms can make learning harder and the embeddings worse. We propose an alternative quantization strategy that decomposes the learning problem in two stages: first, perform similarity learning over the embedding space with no quantization; second, find an optimal orthogonal transformation of the embeddings so each coordinate of the embedding is close to its sign, and then quantize the transformed embedding through the sign function. In the second step, we parametrize orthogonal transformations using Householder matrices to efficiently leverage stochastic gradient descent. Since similarity measures are usually invariant under orthogonal transformations, this quantization strategy comes at no cost in terms of performance. The resulting algorithm is unsupervised, fast, hyperparameter-free and can be run on top of any existing deep hashing or metric learning algorithm. We provide extensive experimental results showing that this approach leads to state-of-the-art performance on widely used image datasets, and, unlike other quantization strategies, brings consistent improvements in performance to existing deep hashing algorithms.


title: Fate of Chiral Symmetries in the Quark-Gluon Plasma from an Instanton-Based Random Matrix Model of QCD

abstract: We propose a new way of understanding how chiral symmetry is realized in the high temperature phase of QCD. Based on the finding that a simple free instanton gas precisely describes the details of the lowest part of the spectrum of the lattice overlap Dirac operator, we propose an instanton-based random matrix model of QCD with dynamical quarks. Simulations of this model reveal that even for small quark mass the Dirac spectral density has a singularity at the origin, caused by a dilute gas of free instantons. Even though the interaction, mediated by light dynamical quarks creates small instanton-antiinstanton molecules, those do not influence the singular part of the spectrum, and this singular part is shown to dominate Banks-Casher type sums in the chiral limit. By generalizing the Banks-Casher formula for the singular spectrum, we show that in the chiral limit the chiral condensate vanishes if there are at least two massless flavors. Our model also indicates a possible way of resolving a long-standing debate, as it suggests that for two massless quark flavors the $U(1)_{A}$ symmetry is likely to remain broken up to arbitrarily high finite temperatures.


title: Localised Gravity and Resolved Braneworlds

abstract: Deriving an effective massless field theory for fluctuations about a braneworld spacetime requires analysis of the transverse-space-wavefunction's second-order differential equation. There can be two strikingly different types of effective theory. For a supersymmetric braneworld, one involves a technically consistent embedding of a supergravity theory on the worldvolume; the other can produce, in certain situations, a genuine localisation of gravity near the worldvolume but not via a technically consistent embedding. So, in the latter situation, the theory's dynamics remains higher-dimensional but there can still be a lower-dimensional effective-theory interpretation of the dynamics at low worldvolume momenta / large worldvolume distances. This paper examines the conditions for such a gravity localisation to be possible. Localising gravity about braneworld spacetimes requires finding solutions to transverse-space self-adjoint Sturm-Liouville problems admitting a normalisable zero mode in the noncompact transverse space. This in turn requires analysis of Sturm-Liouville problems with radial singular endpoints following a formalism originating in the work of Hermann Weyl. Examples of such gravity-localising braneworld systems are found and analysed in this formalism with underlying "skeleton" braneworlds of Salam-Sezgin, resolved D3-brane and Randall-Sundrum II types.


title: A Bayesian Approach for Simultaneously Radial Kernel Parameter Tuning in the Partition of Unity Method

abstract: In this paper, Bayesian optimisation is used to simultaneously search the optimal values of the shape parameter and the radius in radial basis function partition of unity interpolation problem. It is a probabilistic iterative approach that models the error function with a step-by-step self-updated Gaussian process, whereas partition of unity leverages a mesh-free method that allows us to reduce cost-intensive computations when the number of scattered data is very large, as the entire domain is decomposed into several smaller subdomains of variable radius. Numerical experiments on the scattered data interpolation problem show that the combination of these two tools sharply reduces the search time with respect to other techniques such as the leave one out cross validation.


title: Harnessing excitons at the nanoscale -- photoelectrical platform for quantitative sensing and imaging

abstract: Excitons -- quasiparticles formed by the binding of an electron and a hole through electrostatic attraction -- hold promise in the fields of quantum light confinement and optoelectronic sensing. Atomically thin transition metal dichalcogenides (TMDs) provide a versatile platform for hosting and manipulating excitons, given their robust Coulomb interactions and exceptional sensitivity to dielectric environments. In this study, we introduce a cryogenic scanning probe photoelectrical sensing platform, termed exciton-resonant microwave impedance microscopy (ER-MIM). ER-MIM enables ultra-sensitive probing of exciton polarons and their Rydberg states at the nanoscale. Utilizing this technique, we explore the interplay between excitons and material properties, including carrier density, in-plane electric field, and dielectric screening. Furthermore, we employ deep learning for automated data analysis and quantitative extraction of electrical information, unveiling the potential of exciton-assisted nano-electrometry. Our findings establish an invaluable sensing platform and readout mechanism, advancing our understanding of exciton excitations and their applications in the quantum realm.


title: Video Instance Matting

abstract: Conventional video matting outputs one alpha matte for all instances appearing in a video frame so that individual instances are not distinguished. While video instance segmentation provides time-consistent instance masks, results are unsatisfactory for matting applications, especially due to applied binarization. To remedy this deficiency, we propose Video Instance Matting~(VIM), that is, estimating alpha mattes of each instance at each frame of a video sequence. To tackle this challenging problem, we present MSG-VIM, a Mask Sequence Guided Video Instance Matting neural network, as a novel baseline model for VIM. MSG-VIM leverages a mixture of mask augmentations to make predictions robust to inaccurate and inconsistent mask guidance. It incorporates temporal mask and temporal feature guidance to improve the temporal consistency of alpha matte predictions. Furthermore, we build a new benchmark for VIM, called VIM50, which comprises 50 video clips with multiple human instances as foreground objects. To evaluate performances on the VIM task, we introduce a suitable metric called Video Instance-aware Matting Quality~(VIMQ). Our proposed model MSG-VIM sets a strong baseline on the VIM50 benchmark and outperforms existing methods by a large margin. The project is open-sourced at https://github.com/SHI-Labs/VIM.


title: Detection of the CMB lensing -- galaxy bispectrum

abstract: We present a first measurement of the galaxy-galaxy-CMB lensing bispectrum. The signal is detected at $26\sigma$ and $22\sigma$ significance using two samples from the unWISE galaxy catalog at mean redshifts $\bar{z}=0.6$ and $1.1$ and lensing reconstructions from Planck PR4. We employ a compressed bispectrum estimator based on the cross-correlation between the square of the galaxy overdensity field and CMB lensing reconstructions. We present a series of consistency tests to ensure the cosmological origin of our signal and rule out potential foreground contamination. We compare our results to model predictions from a halo model previously fit to only two-point spectra, finding reasonable agreement when restricting our analysis to large scales. Such measurements of the CMB lensing galaxy bispectrum will have several important cosmological applications, including constraining the uncertain higher-order bias parameters that currently limit lensing cross-correlation analyses.


title: Minimal triangulations of circle bundles

abstract: A triangulation of a circle bundle $ E \xrightarrow[\text{}]{\pi} B$ is a triangulation of $E$ and $B$ such that $\pi$ is a simplicial map. In the paper we address the following questions: Which circle bundles can be triangulated over a given triangulation of the base? What are the minimal triangulations of a bundle? A complete solution for semisimplicial triangulations was given by N. Mn\"{e}v. Our results deals with classical triangulations, that is, simplicial complexes. We give an exact answer for a wide family of triangulated spheres (including the boundary of the $3$-simplex, the boundary of the octahedron, the suspension over an $n$-gon, icosahedron). In the general case we present a sufficient criterion for existence of a triangulation. Some minimality results follow straightforwadly.