title: Multiscale cortical morphometry reveals pronounced regional and scale-dependent variations across the lifespan

abstract: Motivation: Characterising the changes in cortical morphology across the lifespan is fundamental for a range of research and clinical applications. Most studies to date have found a monotonic decrease in commonly used morphometrics, such as cortical thickness and volume, across the entire brain with increasing age. Any regional variations reported are subtle changes in the rate of decrease. However, these descriptions of morphological changes have been limited to a single length scale, or resolution. Here, we delineate the morphological changes associated with the healthy lifespan in multiscale morphometrics. Methods: Using MRI from subjects aged 6-88 years from NKI and CamCAN, we computed morphometrics at spatial scales ranging from 0.32 mm to 3 mm. We used generalised additive mixed models to account for site differences when extracting age trajectories. In a proof-of-principle application, we compared brain age estimations based on a single metric (pial surface area) computed at a single scale vs. multiple scales. Results: On the level of whole cortical hemispheres, lifespan trajectories show diverging and even opposing trends at different spatial scales, in contrast to the monotonic decreases of volume and thickness described so far. Pronounced regional differences between lobes also became apparent in scales over 0.7 mm. Using two complementary scales improved brain age estimates in RMSE by about 5 years. Conclusion: Our study provides a comprehensive multiscale description of lifespan effects on cortical morphology in an age range from 6-88 years. In future, this can be used as a normative model to compare individuals or cohorts, hence identifying morphological abnormalities. Our results reveal the complementary information contained in different spatial scales, suggesting that morphometrics should not be considered mere scalars, but functions of length scale.


title: Bitformer: An efficient Transformer with bitwise operation-based attention for Big Data Analytics at low-cost low-precision devices

abstract: In the current landscape of large models, the Transformer stands as a cornerstone, playing a pivotal role in shaping the trajectory of modern models. However, its application encounters challenges attributed to the substantial computational intricacies intrinsic to its attention mechanism. Moreover, its reliance on high-precision floating-point operations presents specific hurdles, particularly evident in computation-intensive scenarios such as edge computing environments. These environments, characterized by resource-constrained devices and a preference for lower precision, necessitate innovative solutions. To tackle the exacting data processing demands posed by edge devices, we introduce the Bitformer model, an inventive extension of the Transformer paradigm. Central to this innovation is a novel attention mechanism that adeptly replaces conventional floating-point matrix multiplication with bitwise operations. This strategic substitution yields dual advantages. Not only does it maintain the attention mechanism's prowess in capturing intricate long-range information dependencies, but it also orchestrates a profound reduction in the computational complexity inherent in the attention operation. The transition from an $O(n^2d)$ complexity, typical of floating-point operations, to an $O(n^2T)$ complexity characterizing bitwise operations, substantiates this advantage. Notably, in this context, the parameter $T$ remains markedly smaller than the conventional dimensionality parameter $d$. The Bitformer model in essence endeavors to reconcile the indomitable requirements of modern computing landscapes with the constraints posed by edge computing scenarios. By forging this innovative path, we bridge the gap between high-performing models and resource-scarce environments, thus unveiling a promising trajectory for further advancements in the field.


title: Non-Gaussian correlations in the steady-state of driven-dissipative clouds of two-level atoms

abstract: We report experimental measurements of the second-order coherence function $g^{(2)}(\tau)$ of the light emitted by a laser-driven dense ensemble of $^{87}$Rb atoms. We observe a clear departure from the Siegert relation valid for Gaussian chaotic light. Measuring intensity and first-order coherence, we conclude that the violation is not due to the emergence of a coherent field. This indicates that the light obeys non-Gaussian statistics, stemming from non-Gaussian correlations in the atomic medium. More specifically, the steady-state of this driven-dissipative many-body system sustains high-order correlations in the absence of first-order coherence. These findings call for new theoretical and experimental explorations to uncover their origin and they open new perspectives for the realization of non-Gaussian states of light.


title: Quantum Sensing of Magnetic Fields with Molecular Spins

abstract: Spins are prototypical systems with the potential to probe magnetic fields down to the atomic scale limit. Exploiting their quantum nature through appropriate sensing protocols allows to enlarge their applicability to fields not always accessible by classical sensors. Here we first show that quantum sensing protocols for AC magnetic fields can be implemented on molecular spin ensembles embedded into hybrid quantum circuits. We then show that, using only echo detection at microwave frequency and no optical readout, Dynamical Decoupling protocols synchronized with the AC magnetic fields can enhance the sensitivity up to $S = 10^{-10}-10^{-9}T/\sqrt{Hz}$ with a low (4-5) number of applied pulses. These results paves the way for the development of strategies to exploit molecular spins as quantum sensors.


title: The Potsdam astroComb (POCO) Part I: Mode crossing effect in feedback resonators

abstract: We investigate theoretically and experimentally the mode interaction in an integrated Silicon Nitride (Si3N4) microring resonator with interferometric coupling realized by a feedback loop as an adjustable optical path path length connecting the ring to the bus waveguide at two coupling sections. From the transmission spectra recorded at different optical path lengths, two resonances, 1596.5~nm and 1570.5~nm, were selected for detailed investigation. Both resonances show the possibility of adjusting the resonance width and depth. However, the transmission spectra around the first resonance also show the effect of mode interaction. This is also well captured in the theoretical model, from which we can derive a coupling rate for the mode interaction of $3.4~\textrm{rad}~\textrm{ns}^{-1}$.


title: The Bifurcation Coalescence Problem for Feedforward Coalescence Networks

abstract: Consider two networks and combine them through the coalescence operation to get a larger network. Is it possible to study the steady-state bifurcations of the coalescence network by studying the steady-state bifurcations of the component networks? We conclude that this is not possible for general coalescence networks. We show, however, that in the case of feedforward coalescence networks this is possible and we cover the simplest cases. In particular, we prove how the growth rate of the bifurcation branches in the feedforward coalescence network depends on the connections from one network to the other.


title: Applying Dimensionality Reduction as Precursor to LSTM-CNN Models for Classifying Imagery and Motor Signals in ECoG-Based BCIs

abstract: Motor impairments, frequently caused by neurological incidents like strokes or traumatic brain injuries, present substantial obstacles in rehabilitation therapy. This research aims to elevate the field by optimizing motor imagery classification algorithms within Brain-Computer Interfaces (BCIs). By improving the efficiency of BCIs, we offer a novel approach that holds significant promise for enhancing motor rehabilitation outcomes. Utilizing unsupervised techniques for dimensionality reduction, namely Uniform Manifold Approximation and Projection (UMAP) coupled with K-Nearest Neighbors (KNN), we evaluate the necessity of employing supervised methods such as Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNNs) for classification tasks. Importantly, participants who exhibited high KNN scores following UMAP dimensionality reduction also achieved high accuracy in supervised deep learning (DL) models. Due to individualized model requirements and massive neural training data, dimensionality reduction becomes an effective preprocessing step that minimizes the need for extensive data labeling and supervised deep learning techniques. This approach has significant implications not only for targeted therapies in motor dysfunction but also for addressing regulatory, safety, and reliability concerns in the rapidly evolving BCI field.


title: Naturalness of Attention: Revisiting Attention in Code Language Models

abstract: Language models for code such as CodeBERT offer the capability to learn advanced source code representation, but their opacity poses barriers to understanding of captured properties. Recent attention analysis studies provide initial interpretability insights by focusing solely on attention weights rather than considering the wider context modeling of Transformers. This study aims to shed some light on the previously ignored factors of the attention mechanism beyond the attention weights. We conduct an initial empirical study analyzing both attention distributions and transformed representations in CodeBERT. Across two programming languages, Java and Python, we find that the scaled transformation norms of the input better capture syntactic structure compared to attention weights alone. Our analysis reveals characterization of how CodeBERT embeds syntactic code properties. The findings demonstrate the importance of incorporating factors beyond just attention weights for rigorously understanding neural code models. This lays the groundwork for developing more interpretable models and effective uses of attention mechanisms in program analysis.


title: Energy and Time-Aware Inference Offloading for DNN-based Applications in LEO Satellites

abstract: In recent years, Low Earth Orbit (LEO) satellites have witnessed rapid development, with inference based on Deep Neural Network (DNN) models emerging as the prevailing technology for remote sensing satellite image recognition. However, the substantial computation capability and energy demands of DNN models, coupled with the instability of the satellite-ground link, pose significant challenges, burdening satellites with limited power intake and hindering the timely completion of tasks. Existing approaches, such as transmitting all images to the ground for processing or executing DNN models on the satellite, is unable to effectively address this issue. By exploiting the internal hierarchical structure of DNNs and treating each layer as an independent subtask, we propose a satellite-ground collaborative computation partial offloading approach to address this challenge. We formulate the problem of minimizing the inference task execution time and onboard energy consumption through offloading as an integer linear programming (ILP) model. The complexity in solving the problem arises from the combinatorial explosion in the discrete solution space. To address this, we have designed an improved optimization algorithm based on branch and bound. Simulation results illustrate that, compared to the existing approaches, our algorithm improve the performance by 10%-18%


title: Jordan correspondence and block distribution of characters

abstract: We complete the determination of the $\ell$-block distribution of characters for quasi-simple exceptional groups of Lie type up to some minor ambiguities relating to non-uniqueness of Jordan decomposition. For this, we first determine the $\ell$-block distribution for finite reductive groups whose ambient algebraic group defined in characteristic different from $\ell$ has connected centre. As a consequence we derive a compatibility between $\ell$-blocks, $e$-Harish-Chandra series and Jordan decomposition. Further we apply our results to complete the proof of Robinson's conjecture on defects of characters.


title: On remoteness functions of k-NIM with k+1 piles in normal and in mis\`ere versions

abstract: Given integer $n$ and $k$ such that $0 < k \leq n$ and $n$ piles of stones, two players alternate turns. By one move it is allowed to choose any $k$ piles and remove exactly one stone from each. The player who has to move but cannot is the loser. in the normal version of the game and (s)he is the winner in the mis\`ere version. Cases $k=1$ and $k = n$ are trivial. For $k=2$ the game was solved for $n \leq 6$. For $n \leq 4$ the Sprague-Grundy function was efficiently computed (for both versions). For $n = 5,6$ a polynomial algorithm computing P-positions was obtained for the normal version. \newline Then, for the case $k = n-1$, a very simple explicit rule that determines the Smith remoteness function was found for the normal version of the game: the player who has to move keeps a pile with the minimum even number of stones; if all piles have odd number of stones then (s)he keeps a maximum one, while the $n-1$ remaining piles are reduced by one stone each in accordance with the rules of the game. \newline Computations show that the same rule works efficiently for the mis\`ere version too. The exceptions are sparse and are listed in Section 2. Denote a position by $x = (x_1, \dots, x_n)$. Due to symmetry, we can assume wlog that $x_1 \leq \ldots \leq x_n$. Our computations partition all exceptions into the following three families: $x_1$ is even, $x_1 = 1$, and $x_1 \geq 3$ is odd. In all three cases we suggest explicit formulas that cover all found exceptions, but this is not proven.


title: Hybrid Whale-Mud-Ring Optimization for Precise Color Skin Cancer Image Segmentation

abstract: Timely identification and treatment of rapidly progressing skin cancers can significantly contribute to the preservation of patients' health and well-being. Dermoscopy, a dependable and accessible tool, plays a pivotal role in the initial stages of skin cancer detection. Consequently, the effective processing of digital dermoscopy images holds significant importance in elevating the accuracy of skin cancer diagnoses. Multilevel thresholding is a key tool in medical imaging that extracts objects within the image to facilitate its analysis. In this paper, an enhanced version of the Mud Ring Algorithm hybridized with the Whale Optimization Algorithm, named WMRA, is proposed. The proposed approach utilizes bubble-net attack and mud ring strategy to overcome stagnation in local optima and obtain optimal thresholds. The experimental results show that WMRA is powerful against a cluster of recent methods in terms of fitness, Peak Signal to Noise Ratio (PSNR), and Mean Square Error (MSE).


title: The SOPHIE search for northern extrasolar planets-XIX. A system including a cold sub-Neptune potentially transiting a V = 6.5 star HD88986

abstract: Transiting planets with orbital periods longer than 40 d are extremely rare among the 5000+ planets discovered so far. The lack of discoveries of this population poses a challenge to research into planetary demographics, formation, and evolution. Here, we present the detection and characterization of HD88986b, a potentially transiting sub-Neptune, possessing the longest orbital period among known transiting small planets (< 4 R$_{\oplus}$) with a precise mass measurement ($\sigma_M/M$ > 25%). Additionally, we identified the presence of a massive companion in a wider orbit around HD88986. Our analysis reveals that HD88986b, based on two potential single transits on sector 21 and sector 48 which are both consistent with the predicted transit time from the RV model, is potentially transiting. The joint analysis of RV and photometric data show that HD88986b has a radius of 2.49$\pm$0.18 R$_{\oplus}$, a mass of 17.2$^{+4.0}_{-3.8}$ M$_{\oplus}$, and it orbits every 146.05$^{+0.43}_{-0.40}$ d around a subgiant HD88986 which is one of the closest and brightest exoplanet host stars (G2V type, R=1.543 $\pm$0.065 R$_{\odot}$, V=$6.47\pm 0.01$ mag, distance=33.37$\pm$0.04 pc). The nature of the outer, massive companion is still to be confirmed; a joint analysis of RVs, Hipparcos, and Gaia astrometric data shows that with a 3$\sigma$ confidence interval, its semi-major axis is between 16.7 and 38.8 au and its mass is between 68 and 284 M$_{Jup}$. HD88986b's wide orbit suggests the planet did not undergo significant mass loss due to extreme-ultraviolet radiation from its host star. Therefore, it probably maintained its primordial composition, allowing us to probe its formation scenario. Furthermore, the cold nature of HD88986b (460$\pm$8 K), thanks to its long orbital period, will open up exciting opportunities for future studies of cold atmosphere composition characterization.


title: Ordinary parts and local-global compatibility at $\ell=p$

abstract: We prove local-global compatibility results at $\ell=p$ for the torsion automorphic Galois representations constructed by Scholze, generalising the work of Caraiani--Newton. In particular, we verify, up to a nilpotent ideal, the local-global compatibility conjecture at $\ell=p$ of Gee--Newton in the case of imaginary CM fields under some technical assumptions. The key new ingredient is a local-global compatibility result for $Q$-ordinary self-dual automorphic representations for arbitrary parabolic subgroups.


title: Photon Number Resolving Detection with a Single-Photon Detector and Adaptive Storage Loop

abstract: Photon number resolving (PNR) measurements are beneficial or even necessary for many applications in quantum optics. Unfortunately, PNR detectors are usually large, slow, expensive, and difficult to operate. However, if the input signal is multiplexed, photon "click" detectors, that lack an intrinsic photon number resolving capability, can still be used to realize photon number resolution. Here, we investigate the operation of a single click detector, together with a storage line with tunable outcoupling. Using adaptive feedback to adjust the storage outcoupling rate, the dynamic range of the detector can in certain situations be extended by up to an order of magnitude relative to a purely passive setup. An adaptive approach can thus allow for photon number variance below the quantum shot noise limit under a wider range of conditions than using a passive multiplexing approach. This can enable applications in quantum enhanced metrology and quantum computing.


title: Linearity of compact $R$-analytic groups

abstract: We prove that any compact $R$-analytic group is linear when $R$ is a pro-$p$ domain of characteristic zero.


title: Learning-Based Relaxation of Completeness Requirements for Data Entry Forms

abstract: Data entry forms use completeness requirements to specify the fields that are required or optional to fill for collecting necessary information from different types of users. However, some required fields may not be applicable for certain types of users anymore. Nevertheless, they may still be incorrectly marked as required in the form; we call such fields obsolete required fields. Since obsolete required fields usually have not-null validation checks before submitting the form, users have to enter meaningless values in such fields in order to complete the form submission. These meaningless values threaten the quality of the filled data. To avoid users filling meaningless values, existing techniques usually rely on manually written rules to identify the obsolete required fields and relax their completeness requirements. However, these techniques are ineffective and costly. In this paper, we propose LACQUER, a learning-based automated approach for relaxing the completeness requirements of data entry forms. LACQUER builds Bayesian Network models to automatically learn conditions under which users had to fill meaningless values. To improve its learning ability, LACQUER identifies the cases where a required field is only applicable for a small group of users, and uses SMOTE, an oversampling technique, to generate more instances on such fields for effectively mining dependencies on them. Our experimental results show that LACQUER can accurately relax the completeness requirements of required fields in data entry forms with precision values ranging between 0.76 and 0.90 on different datasets. LACQUER can prevent users from filling 20% to 64% of meaningless values, with negative predictive values between 0.72 and 0.91. Furthermore, LACQUER is efficient; it takes at most 839 ms to predict the completeness requirement of an instance.


title: Orbital-Free Density Functional Theory with Continuous Normalizing Flows

abstract: Orbital-free density functional theory (OF-DFT) provides an alternative approach for calculating the molecular electronic energy, relying solely on the electron density. In OF-DFT, both the ground-state density is optimized variationally to minimize the total energy functional while satisfying the normalization constraint. In this work, we introduce a novel approach by parameterizing the electronic density with a normalizing flow ansatz, which is also optimized by minimizing the total energy functional. Our model successfully replicates the electronic density for a diverse range of chemical systems, including a one-dimensional diatomic molecule, specifically Lithium hydride with varying interatomic distances, as well as comprehensive simulations of hydrogen and water molecules, all conducted in Cartesian space.


title: Varieties of truth definitions

abstract: We study the structure of the partial order induced by the definability relation on definitions of truth for the language of arithmetic. Formally, a definition of truth is any sentence $\alpha$ which extends a weak arithmetical theory (which we take to be EA) such that for some formula $\Theta$ and any arithmetical sentence $\varphi$, $\Theta(\ulcorner\varphi\urcorner)\equiv \varphi$ is provable in $\alpha$. We say that a sentence $\beta$ is definable in a sentence $\alpha$, if there exists an unrelativized translation from the language of $\beta$ to the language of $\alpha$ which is identity on the arithmetical symbols and such that the translation of $\beta$ is provable in $\alpha$. Our main result is that the structure consisting of truth definitions which are conservative over the basic arithmetical theory forms a countable universal distributive lattice. Additionally, we generalize the result of Pakhomov and Visser showing that the set of (G\"odel codes of) definitions of truth is not $\Sigma_2$-definable in the standard model of arithmetic. We conclude by remarking that no $\Sigma_2$-sentence, satisfying certain further natural conditions, can be a definition of truth for the language of arithmetic.


title: Imprint of massive neutrinos on Persistent Homology of large-scale structure

abstract: Exploiting the Persistent Homology technique and an associated complementary representation which enables us to construct a synergistic pipeline for different topological features quantified by Betti curves in reducing the degeneracy between cosmological parameters, we investigate the footprint of summed massive neutrinos ($M_{\nu}$) in different density fields simulated by the publicly available Quijote suite. Evolution of topological features in the context of super-level filtration on three-dimensional density fields, reveals remarkable indicators for constraining the $M_{\nu}$ and $\sigma_8$. The abundance of 2-holes is more sensitive to the presence of $M_{\nu}$, also the persistence of topological features plays a crucial role in cosmological inference and reducing the degeneracy associated with $M_{\nu}$ simulation rather than their birth thresholds when either the total matter density ($m$) field or those part including only cold dark matter+baryons ($cb$) is utilized. Incorporating the Betti-1 and Betti-2 for $cb$ part of $M^+_{\nu}$ simulation marginalized over the thresholds implies $5\%$ variation compared to the massless neutrinos simulation. The constraint on $M_{\nu}$ from $\beta_k$ and its joint analysis with birth threshold and persistency of topological features for total mass density field smoothed by $R=5$ Mpc h$^{-1}$ at zero redshift reach to $0.0172$ eV and $0.0152$ eV, at $1\sigma$ confidence interval, respectively.


title: The Gauss map for bielliptic Prym varieties

abstract: We completely describe the degree of the Gauss map of the theta divisor of bielliptic Prym varieties. We characterize bielliptic Prym varieties whose Gauss degree is the same as Jacobians. We also construct bielliptic Prym varieties with a very low Gauss degree. In dimension $5$, we obtain a complete description of the Gauss degree on the Andreotti-Mayer locus.


title: Flag transitive geometries with trialities and no dualities coming from Suzuki groups

abstract: Recently, Leemans and Stokes constructed an infinite family of incidence geometries admitting trialities but no dualities from the groups PSL(2,q) (where $q=p^{3n}$ with $p$ a prime and $n>0$ a positive integer). Unfortunately these geometries are not flag transitive. In this paper, we construct the first infinite family of incidence geometries of rank three that are flag transitive and have trialities but no dualities. These geometries are constructed using chamber systems of Suzuki groups Sz(q) (where $q=2^{2e+1}$ with $e$ a positive integer and $2e+1$ is divisible by 3) and the trialities come from field automorphisms. We also construct an infinite family of regular hypermaps with automorphism group Sz(q) that admit trialities but no dualities.


title: Outerplanar and Forest Storyplans

abstract: We study the problem of gradually representing a complex graph as a sequence of drawings of small subgraphs whose union is the complex graph. The sequence of drawings is called \emph{storyplan}, and each drawing in the sequence is called a \emph{frame}. In an outerplanar storyplan, every frame is outerplanar; in a forest storyplan, every frame is acyclic. We identify graph families that admit such storyplans and families for which such storyplans do not always exist. In the affirmative case, we present efficient algorithms that produce straight-line storyplans.


title: On factorization hierarchy of equations for banana Feynman amplitudes

abstract: We present a review of the relations between various equations for maximal cut banana Feynman diagrams, i.e. amplitudes with propagators substituted with $\delta$-functions. We consider both equal and generic masses. There are three types of equation to consider: those in coordinate space, their Fourier transform and Picard-Fuchs equations originating from the parametric representation. First, we review the properties of the corresponding differential operators themselves, mainly their factorization properties at the equal mass locus and their form at special values of the dimension. Then we study the relation between the Fourier transform of the coordinate space equations and the Picard-Fuchs equations and show that they are related by factorization as well. The equations in question are the counterparts of the Virasoro constraints in the much-better studied theory of eigenvalue matrix models and are the first step towards building a full-fledged theory of Feynman integrals, which will reveal their hidden integrable structure.


title: On the Galois structure of units in totally real $p$-rational number fields

abstract: The theory of factor-equivalence of integral lattices gives a far reaching relationship between the Galois module structure of units of the ring of integers of a number field and its arithmetic. For a number field $K$ that is Galois over $\mathbb{Q}$ or an imaginary quadratic field, we prove a necessary and sufficient condition on the quotients of class numbers of subfields of $K$, for the quotient $E_{K}$ of the group of units of the ring of integers of $K$ by the subgroup of roots of unity to be factor equivalent to the standard cyclic Galois module. By using strong arithmetic properties of totally real $p$-rational number fields, we prove that the non-abelian $p$-rational $p$-extensions of $\mathbb{Q}$ do not have Minkowski units, which extends a result of Burns to non-abelian number fields. We also study the relative Galois module structure of $E_{L}$ for varying Galois extensions $L/F$ of totally real $p$-rational number fields whose Galois groups are isomorphic to a fixed finite group $G$. In that case, we prove that there is a finite set $\Omega$ of $\mathbb{Z}_p[G]$-lattices such that for every $L$, $\mathbb{Z}_{p} \otimes_{\mathbb{Z}} E_{L}$ is factor equivalent to $\mathbb{Z}_{p}[G]^{n} \oplus X$ as $\mathbb{Z}_p[G]$-lattices for some $X \in \Omega$ and an integer $n \geq 0$.


title: Assessing the Probability of Extremely Low Wind Energy Production in Europe at Sub-seasonal to Seasonal Time Scales

abstract: The European energy system will undergo major transformations in the coming decades to implement mitigation measures and comply with the Paris Agreement. In particular, the share of weather-dependent wind generation will increase significantly in the European energy mix. The most extreme fluctuations of the production at all time scales need to be taken into account in the design of the power system. In particular, extreme long-lasting low wind energy production events constitute a specific challenge, as most flexibility solutions do not apply at time scales beyond a few days. However, the probability and amplitude of such events has to a large extent eluded quantitative study so far due to lack of sufficiently long data. In this letter, using a 1000-year climate simulation, we study rare events of wind energy production that last from a few weeks to a few months over the January-February period, at the scale of a continent (Europe) and a country (France). The results show that the fluctuations of the capacity factor over Europe exhibit nearly Gaussian statistics at all time scales. A similar result holds over France for events longer than about two weeks and return times up to a few decades. In that case, the return time curves follow a universal curve. Furthermore, a simple Gaussian process with the same covariance structure as the data gives good estimates of the amplitude of the most extreme events. This method allows to estimate return times for rare events from shorter but more accurate data sources. We demonstrate this possibility with reanalysis data.


title: $\beta$ Pictoris b through the eyes of the upgraded CRIRES+

abstract: Context: High-resolution spectrographs fed by adaptive optics (AO) provide a unique opportunity to characterize directly imaged exoplanets. Observations with such instruments allow us to probe the atmospheric composition, spin rotation, and radial velocity of the planet, thereby helping to reveal information on its formation and migration history. The recent upgrade of the Cryogenic High-Resolution Infrared Echelle Spectrograph (CRIRES+) at the VLT makes it a highly suitable instrument for characterizing directly imaged exoplanets. Aims: In this work, we report on observations of $\beta$ Pictoris b with CRIRES+ and use them to constrain the planets atmospheric properties and update the estimation of its spin rotation. Methods: The data were reduced using the open-source \textit{pycrires} package. We subsequently forward-modeled the stellar, planetary, and systematic contribution to the data to detect molecules in the planet's atmosphere. We also used atmospheric retrievals to provide new constraints on its atmosphere. Results: We confidently detected water and carbon monoxide in the atmosphere of $\beta$ Pictoris b and retrieved a slightly sub-solar carbon-to-oxygen ratio, which is in agreement with previous results. The interpretation is hampered by our limited knowledge of the C/O ratio of the host star. We also obtained a much improved constraint on its spin rotation of $19.9 \pm 1.0$ km/s, which gives a rotation period of $8.7 \pm 0.8$ hours, assuming no obliquity. We find that there is a degeneracy between the metallicity and clouds, but this has minimal impact on the retrieved C/O, $v\sin{i}$, and radial velocity. Our results show that CRIRES+ is performing well and stands as a highly useful instrument for characterizing directly imaged planets.


title: Improvements on Device Independent and Semi-Device Independent Protocols of Randomness Expansion

abstract: To generate genuine random numbers, random number generators based on quantum theory are essential. However, ensuring that the process used to produce randomness meets desired security standards can pose challenges for traditional quantum random number generators. This thesis delves into Device Independent (DI) and Semi-Device Independent (semi-DI) protocols of randomness expansion, based on a minimal set of experimentally verifiable security assumptions. The security in DI protocols relies on the violation of Bell inequalities, which certify the quantum behavior of devices. The semi-DI protocols discussed in this thesis require the characterization of only one device - a power meter. These protocols exploit the fact that quantum states can be prepared such that they cannot be distinguished with certainty, thereby creating a randomness resource. In this study, we introduce enhanced DI and semi-DI protocols that surpass existing ones in terms of output randomness rate, security, or in some instances, both. Our analysis employs the Entropy Accumulation Theorem (EAT) to determine the extractable randomness for finite rounds. A notable contribution is the introduction of randomness expansion protocols that recycle input randomness, significantly enhancing finite round randomness rates for DI protocols based on the CHSH inequality violation. In the final section of the thesis, we delve into Generalized Probability Theories (GPTs), with a focus on Boxworld, the largest GPT capable of producing correlations consistent with relativity. A tractable criterion for identifying a Boxworld channel is presented.


title: Euclid preparation. Modelling spectroscopic clustering on mildly nonlinear scales in beyond-$\Lambda$CDM models

abstract: We investigate the approximations needed to efficiently predict the large-scale clustering of matter and dark matter halos in beyond-$\Lambda$CDM scenarios. We examine the normal branch of the Dvali-Gabadadze-Porrati model, the Hu-Sawicki $f(R)$ model, a slowly evolving dark energy, an interacting dark energy model and massive neutrinos. For each, we test approximations for the perturbative kernel calculations, including the omission of screening terms and the use of perturbative kernels based on the Einstein-de Sitter universe; we explore different infrared-resummation schemes, tracer bias models and a linear treatment of massive neutrinos; we employ two models for redshift space distortions, the Taruya-Nishimishi-Saito prescription and the Effective Field Theory of Large-Scale Structure. This work further provides a preliminary validation of the codes being considered by Euclid for the spectroscopic clustering probe in beyond-$\Lambda$CDM scenarios. We calculate and compare the $\chi^2$ statistic to assess the different modelling choices. This is done by fitting the spectroscopic clustering predictions to measurements from numerical simulations and perturbation theory-based mock data. We compare the behaviour of this statistic in the beyond-$\Lambda$CDM cases, as a function of the maximum scale included in the fit, to the baseline $\Lambda$CDM case. We find that the Einstein-de Sitter approximation without screening is surprisingly accurate for all cases when comparing to the halo clustering monopole and quadrupole obtained from simulations. Our results suggest that the inclusion of multiple redshift bins, higher-order multipoles, higher-order clustering statistics (such as the bispectrum) and photometric probes such as weak lensing, will be essential to extract information on massive neutrinos, modified gravity and dark energy.


title: Lee-Yang and Langer edge singularities from analytic continuation of scaling functions

abstract: We discuss the analytic continuation of scaling function in the 3-dimensional Z(2),O(2) andO(4) universality classes using the Schofield representation of the magnetic equation of state. We show that a determination of the location of Lee-Yang edge singularities and, in the case of Z(2), also the Langer edge singularity yields stable results. Results for the former are in good agreement with Functional Renormalization Group calculations. We also present results for the location of the Langer edge singularity in the 3-d,Z(2) universality class. We find that in terms of the complex scaling variable z the distance of the Langer edge singularity to the critical point agrees within errors with that of the Lee-Yang edge singularity. Furthermore the magnitude of the discontinuity along the Langer branch cut is an order of magnitude smaller than that along the Lee-Yang branch cut.


title: Leveraging CNNs and Ensemble Learning for Automated Disaster Image Classification

abstract: Natural disasters act as a serious threat globally, requiring effective and efficient disaster management and recovery. This paper focuses on classifying natural disaster images using Convolutional Neural Networks (CNNs). Multiple CNN architectures were built and trained on a dataset containing images of earthquakes, floods, wildfires, and volcanoes. A stacked CNN ensemble approach proved to be the most effective, achieving 95% accuracy and an F1 score going up to 0.96 for individual classes. Tuning hyperparameters of individual models for optimization was critical to maximize the models' performance. The stacking of CNNs with XGBoost acting as the meta-model utilizes the strengths of the CNN and ResNet models to improve the overall accuracy of the classification. Results obtained from the models illustrated the potency of CNN-based models for automated disaster image classification. This lays the foundation for expanding these techniques to build robust systems for disaster response, damage assessment, and recovery management.


title: Boosting ensemble refinement with transferable force field corrections: synergistic optimization for molecular simulations

abstract: A novel method combining the ensemble refinement by maximum entropy principle and the force field fitting approach is presented. Its formulation allows to continuously interpolate in between these two methods, which can thus be interpreted as two limiting cases. A cross-validation procedure enables to correctly assess the relative weight of both of them, distinguishing scenarios where the combined approach is meaningful from those in which either ensemble refinement or force field fitting separately prevails. The efficacy of their combination is examined for a realistic case study of RNA oligomers. Within the new scheme, molecular dynamics simulations are integrated with experimental data provided by nuclear-magnetic-resonance measures. We show that force field corrections are in general superior when applied to the appropriate force field terms, but are automatically discarded by the method when applied to inappropriate force field terms.

categories: physics.chem-ph physics.bio-ph physics.comp-ph q-bio.BM


title: Volumetric 3D Point Cloud Attribute Compression: Learned polynomial bilateral filter for prediction

abstract: We extend a previous study on 3D point cloud attribute compression scheme that uses a volumetric approach: given a target volumetric attribute function $f : \mathbb{R}^3 \mapsto \mathbb{R}$, we quantize and encode parameters $\theta$ that characterize $f$ at the encoder, for reconstruction $f_{\hat{\theta}}(\mathbf(x))$ at known 3D points $\mathbf(x)$ at the decoder. Specifically, parameters $\theta$ are quantized coefficients of B-spline basis vectors $\mathbf{\Phi}_l$ (for order $p \geq 2$) that span the function space $\mathcal{F}_l^{(p)}$ at a particular resolution $l$, which are coded from coarse to fine resolutions for scalability. In this work, we focus on the prediction of finer-grained coefficients given coarser-grained ones by learning parameters of a polynomial bilateral filter (PBF) from data. PBF is a pseudo-linear filter that is signal-dependent with a graph spectral interpretation common in the graph signal processing (GSP) field. We demonstrate PBF's predictive performance over a linear predictor inspired by MPEG standardization over a wide range of point cloud datasets.


title: LM-Cocktail: Resilient Tuning of Language Models via Model Merging

abstract: The pre-trained language models are continually fine-tuned to better support downstream applications. However, this operation may result in significant performance degeneration on general tasks beyond the targeted domain. To overcome this problem, we propose LM-Cocktail which enables the fine-tuned model to stay resilient in general perspectives. Our method is conducted in the form of model merging, where the fine-tuned language model is merged with the pre-trained base model or the peer models from other domains through weighted average. Despite simplicity, LM-Cocktail is surprisingly effective: the resulted model is able to achieve a strong empirical performance in the whole scope of general tasks while preserving a superior capacity in its targeted domain. We conduct comprehensive experiments with LLama and BGE model on popular benchmarks, including FLAN, MMLU, MTEB, whose results validate the efficacy of our proposed method. The code and checkpoints are available at https://github.com/FlagOpen/FlagEmbedding/tree/master/LM_Cocktail.


title: DiffusionMat: Alpha Matting as Sequential Refinement Learning

abstract: In this paper, we introduce DiffusionMat, a novel image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes. Diverging from conventional methods that utilize trimaps merely as loose guidance for alpha matte prediction, our approach treats image matting as a sequential refinement learning process. This process begins with the addition of noise to trimaps and iteratively denoises them using a pre-trained diffusion model, which incrementally guides the prediction towards a clean alpha matte. The key innovation of our framework is a correction module that adjusts the output at each denoising step, ensuring that the final result is consistent with the input image's structures. We also introduce the Alpha Reliability Propagation, a novel technique designed to maximize the utility of available guidance by selectively enhancing the trimap regions with confident alpha information, thus simplifying the correction task. To train the correction module, we devise specialized loss functions that target the accuracy of the alpha matte's edges and the consistency of its opaque and transparent regions. We evaluate our model across several image matting benchmarks, and the results indicate that DiffusionMat consistently outperforms existing methods. Project page at~\url{https://cnnlstm.github.io/DiffusionMat


title: Limiting flux in quantum thermodynamics

abstract: In quantum systems, entropy production is typically defined as the quantum relative entropy between two states. This definition provides an upper bound for any flux (of particles, energy, entropy, etc.) of bounded observables, which proves especially useful near equilibrium. However, this bound tends to be irrelevant in general nonequilibrium situations. We propose a new upper bound for such fluxes in terms of quantum relative entropy, applicable even far from equilibrium and in the strong coupling regime. Additionally, we compare this bound with Monte Carlo simulations of random qubits with coherence, as well as with a model of two interacting nuclear spins.


title: ab initio informed inelastic neutron scattering for time-resolved local dynamics in molten MgCl2

abstract: Ion dynamics that drive the transport and thermophysical properties of molten salts are poorly understood due to challenges in precisely quantifying the spatial and temporal fluctuations of specific ions in highly disordered systems. While the Van Hove correlation function (VHF) obtained from inelastic neutron scattering (INS) probes these dynamics directly, its interpretation is limited by the inherent species-averaging of experiments, which obscures analysis of key ion transport and solvation mechanisms. Here, ab initio molecular dynamics (AIMD) is used to model the VHF, unravel its partial contributions, and elucidate its underlying ionic transport mechanisms. Slow decorrelation is revealed for oppositely charged ions (Mg2+ and Cl-) caused by ion exchange across the solvation shell between adjoining ionocovalent complexes. Furthermore, transport coefficients are accurately recovered and connections between macroscopic properties and ion dynamics are revealed. This study demonstrates the potential of ab initio-informed VHF to resolve long-standing challenges in uncovering relationships between picosecond-scale ion dynamics, mechanisms, and emergent physical properties of molten salts.


title: Speak Like a Native: Prompting Large Language Models in a Native Style

abstract: In-context learning (ICL) with large language models (LLMs) has become the modern tool of choice for many natural language processing tasks. However, how the text style of in-context examples influences the performance of LLMs still remains under-explored. This paper presents a novel and effective approach, named \textbf{AlignedCoT}, to improve the reasoning capability of LLMs by aligning the in-context examples with the native style of LLMs. ``Native'' refers to the inherent characteristic of LLMs which can be probed by zero-shot scenarios. We conduct extensive and comprehensive experiments on several benchmarks on mathematical question-answering and common-sense reasoning. The empirical results demonstrate that our AlignedCoT significantly improves performance over the carefully handcrafted demonstrations. Specifically, with AlignedCoT, we observe an average +3.2\% improvement for \texttt{gpt-3.5-turbo} compared to the carefully handcrafted CoT on multi-step reasoning benchmarks. Furthermore, we use AlignedCoT to rewrite the CoT text style in the training set, which improves the performance of Retrieval Augmented Generation by 3.6\%. Our source code and dataset are available at https://github.com/yangzhch6/AlignedCoT.


title: Learned Nonlinear Predictor for Critically Sampled 3D Point Cloud Attribute Compression

abstract: We study 3D point cloud attribute compression via a volumetric approach: assuming point cloud geometry is known at both encoder and decoder, parameters $\theta$ of a continuous attribute function $f: \mathbb{R}^3 \mapsto \mathbb{R}$ are quantized to $\hat{\theta}$ and encoded, so that discrete samples $f_{\hat{\theta}}(\mathbf{x}_i)$ can be recovered at known 3D points $\mathbf{x}_i \in \mathbb{R}^3$ at the decoder. Specifically, we consider a nested sequences of function subspaces $\mathcal{F}^{(p)}_{l_0} \subseteq \cdots \subseteq \mathcal{F}^{(p)}_L$, where $\mathcal{F}_l^{(p)}$ is a family of functions spanned by B-spline basis functions of order $p$, $f_l^*$ is the projection of $f$ on $\mathcal{F}_l^{(p)}$ and encoded as low-pass coefficients $F_l^*$, and $g_l^*$ is the residual function in orthogonal subspace $\mathcal{G}_l^{(p)}$ (where $\mathcal{G}_l^{(p)} \oplus \mathcal{F}_l^{(p)} = \mathcal{F}_{l+1}^{(p)}$) and encoded as high-pass coefficients $G_l^*$. In this paper, to improve coding performance over [1], we study predicting $f_{l+1}^*$ at level $l+1$ given $f_l^*$ at level $l$ and encoding of $G_l^*$ for the $p=1$ case (RAHT($1$)). For the prediction, we formalize RAHT(1) linear prediction in MPEG-PCC in a theoretical framework, and propose a new nonlinear predictor using a polynomial of bilateral filter. We derive equations to efficiently compute the critically sampled high-pass coefficients $G_l^*$ amenable to encoding. We optimize parameters in our resulting feed-forward network on a large training set of point clouds by minimizing a rate-distortion Lagrangian. Experimental results show that our improved framework outperformed the MPEG G-PCC predictor by $11$ to $12\%$ in bit rate reduction.


title: Belted sum decompositions of fully augmented links

abstract: Given two orientable, cusped hyperbolic 3-manifolds containing certain thrice-punctured spheres, Adams gave a diagrammatic definition for a third such manifold, their belted sum. Fully augmented links, or FALs, are hyperbolic links constructed by augmenting a link diagram. This work considers belted sum decompositions in which all manifolds involved are FAL complements. To do so, we provide explicit classifications of thrice punctured spheres in FAL complements, making them easily recognizable. These classifications are used to characterize belted sum prime FALs geometrically, combinatorially and diagrammatically. Finally we prove that, in the context of belted sums, every FAL complement canonically decomposes into FALs which are either prime or two-fold covers of the Whitehead link.


title: Linear Log-Normal Attention with Unbiased Concentration

abstract: Transformer models have achieved remarkable results in a wide range of applications. However, their scalability is hampered by the quadratic time and memory complexity of the self-attention mechanism concerning the sequence length. This limitation poses a substantial obstacle when dealing with long documents or high-resolution images. In this work, we study the self-attention mechanism by analyzing the distribution of the attention matrix and its concentration ability. Furthermore, we propose instruments to measure these quantities and introduce a novel self-attention mechanism, Linear Log-Normal Attention, designed to emulate the distribution and concentration behavior of the original self-attention. Our experimental results on popular natural language benchmarks reveal that our proposed Linear Log-Normal Attention outperforms other linearized attention alternatives, offering a promising avenue for enhancing the scalability of transformer models.


title: Blind analysis in Physics experiments: Is this trip necessary?

abstract: Based on the work of Klein and Roodman [\cite{JoshK}] we present an alternate conclusion as to the charm of blind analysis in physics experiments.


title: Finding eigenvectors with a quantum variational algorithm

abstract: This paper presents a hybrid variational quantum algorithm that finds a random eigenvector of a unitary matrix with a known quantum circuit. The algorithm is based on the SWAP test on trial states generated by a parametrized quantum circuit. The eigenvector is described by a compact set of classical parameters that can be used to reproduce the found approximation to the eigenstate on demand. This variational eigenvector finder can be adapted to solve the generalized eigenvalue problem, to find the eigenvectors of normal matrices and to perform quantum principal component analysis (QPCA) on unknown input mixed states. These algorithms can all be run with low depth quantum circuits, suitable for an efficient implementation on noisy intermediate state quantum computers (NISQC) and, with some restrictions, on linear optical systems. Limitations and potential applications are discussed.


title: Piecewise Polynomial Regression of Tame Functions via Integer Programming

abstract: Tame functions are a class of nonsmooth, nonconvex functions, which feature in a wide range of applications: functions encountered in the training of deep neural networks with all common activations, value functions of mixed-integer programs, or wave functions of small molecules. We consider approximating tame functions with piecewise polynomial functions. We bound the quality of approximation of a tame function by a piecewise polynomial function with a given number of segments on any full-dimensional cube. We also present the first mixed-integer programming formulation of piecewise polynomial regression. Together, these can be used to estimate tame functions. We demonstrate promising computational results.


title: Superfluid vortex dynamics with an elliptical boundary

abstract: Recent advances in cold-atom platforms have made real-time dynamics accessible, renewing interest in the motion of superfluid vortices in two-dimensional domains. Here we show that the energy and the trajectories of arbitrary vortex configurations may be computed on a complicated (curved or bounded) surface, provided that one knows a conformal map that links the latter to a simpler domain (like the full plane, or a circular boundary). We also prove that Hamilton's equations based on the vortex energy agree with the complex dynamical equations for the vortex dynamics, demonstrating that the vortex trajectories are constant-energy curves. We use these ideas to study the dynamics of vortices in a two-dimensional incompressible superfluid with an elliptical boundary, and we derive an analytical expression for the complex potential describing the hydrodynamic flow throughout the fluid. For a vortex inside an elliptical boundary, the orbits are nearly self-similar ellipses.


title: Enigma: Privacy-Preserving Execution of QAOA on Untrusted Quantum Computers

abstract: Quantum computers can solve problems that are beyond the capabilities of conventional computers. As quantum computers are expensive and hard to maintain, the typical model for performing quantum computation is to send the circuit to a quantum cloud provider. This leads to privacy concerns for commercial entities as an untrusted server can learn protected information from the provided circuit. Current proposals for Secure Quantum Computing (SQC) either rely on emerging technologies (such as quantum networks) or incur prohibitive overheads (for Quantum Homomorphic Encryption). The goal of our paper is to enable low-cost privacy-preserving quantum computation that can be used with current systems. We propose Enigma, a suite of privacy-preserving schemes specifically designed for the Quantum Approximate Optimization Algorithm (QAOA). Unlike previous SQC techniques that obfuscate quantum circuits, Enigma transforms the input problem of QAOA, such that the resulting circuit and the outcomes are unintelligible to the server. We introduce three variants of Enigma. Enigma-I protects the coefficients of QAOA using random phase flipping and fudging of values. Enigma-II protects the nodes of the graph by introducing decoy qubits, which are indistinguishable from primary ones. Enigma-III protects the edge information of the graph by modifying the graph such that each node has an identical number of connections. For all variants of Enigma, we demonstrate that we can still obtain the solution for the original problem. We evaluate Enigma using IBM quantum devices and show that the privacy improvements of Enigma come at only a small reduction in fidelity (1%-13%).


title: Medical Image Retrieval Using Pretrained Embeddings

abstract: A wide range of imaging techniques and data formats available for medical images make accurate retrieval from image databases challenging. Efficient retrieval systems are crucial in advancing medical research, enabling large-scale studies and innovative diagnostic tools. Thus, addressing the challenges of medical image retrieval is essential for the continued enhancement of healthcare and research. In this study, we evaluated the feasibility of employing four state-of-the-art pretrained models for medical image retrieval at modality, body region, and organ levels and compared the results of two similarity indexing approaches. Since the employed networks take 2D images, we analyzed the impacts of weighting and sampling strategies to incorporate 3D information during retrieval of 3D volumes. We showed that medical image retrieval is feasible using pretrained networks without any additional training or fine-tuning steps. Using pretrained embeddings, we achieved a recall of 1 for various tasks at modality, body region, and organ level.


title: Efficient Numerical Integration in Reproducing Kernel Hilbert Spaces via Leverage Scores Sampling

abstract: In this work we consider the problem of numerical integration, i.e., approximating integrals with respect to a target probability measure using only pointwise evaluations of the integrand. We focus on the setting in which the target distribution is only accessible through a set of $n$ i.i.d. observations, and the integrand belongs to a reproducing kernel Hilbert space. We propose an efficient procedure which exploits a small i.i.d. random subset of $m<n$ samples drawn either uniformly or using approximate leverage scores from the initial observations. Our main result is an upper bound on the approximation error of this procedure for both sampling strategies. It yields sufficient conditions on the subsample size to recover the standard (optimal) $n^{-1/2}$ rate while reducing drastically the number of functions evaluations, and thus the overall computational cost. Moreover, we obtain rates with respect to the number $m$ of evaluations of the integrand which adapt to its smoothness, and match known optimal rates for instance for Sobolev spaces. We illustrate our theoretical findings with numerical experiments on real datasets, which highlight the attractive efficiency-accuracy tradeoff of our method compared to existing randomized and greedy quadrature methods. We note that, the problem of numerical integration in RKHS amounts to designing a discrete approximation of the kernel mean embedding of the target distribution. As a consequence, direct applications of our results also include the efficient computation of maximum mean discrepancies between distributions and the design of efficient kernel-based tests.


title: ADriver-I: A General World Model for Autonomous Driving

abstract: Typically, autonomous driving adopts a modular design, which divides the full stack into perception, prediction, planning and control parts. Though interpretable, such modular design tends to introduce a substantial amount of redundancy. Recently, multimodal large language models (MLLM) and diffusion techniques have demonstrated their superior performance on comprehension and generation ability. In this paper, we first introduce the concept of interleaved vision-action pair, which unifies the format of visual features and control signals. Based on the vision-action pairs, we construct a general world model based on MLLM and diffusion model for autonomous driving, termed ADriver-I. It takes the vision-action pairs as inputs and autoregressively predicts the control signal of the current frame. The generated control signals together with the historical vision-action pairs are further conditioned to predict the future frames. With the predicted next frame, ADriver-I performs further control signal prediction. Such a process can be repeated infinite times, ADriver-I achieves autonomous driving in the world created by itself. Extensive experiments are conducted on nuScenes and our large-scale private datasets. ADriver-I shows impressive performance compared to several constructed baselines. We hope our ADriver-I can provide some new insights for future autonomous driving and embodied intelligence.


title: Asymptotics of Redistricting the $n\times n$ grid

abstract: How many ways are there to redistrict the $n\times n$ grid into $n$ districts of equal size? How many of these redistricting plans are compact? In this article we give asymptotic bounds on the number of plans, showing there are exponentially many in $n^2$. We then use the lower bound to show that most plans are as least compact as possible.


title: Differentiating by prime numbers

abstract: We introduce $p$-derivations and give a few basic ways in which they act like derivatives by numbers.


title: A Unified Framework for Trace-induced Quantum Kernels

abstract: Quantum kernel methods are promising candidates for achieving a practical quantum advantage for certain machine learning tasks. Similar to classical machine learning, an exact form of a quantum kernel is expected to have a great impact on the model performance. In this work we combine all trace-induced quantum kernels, including the commonly-used global fidelity and local projected quantum kernels, into a common framework. We show how generalized trace-induced quantum kernels can be constructed as combinations of the fundamental building blocks we coin "Lego" kernels, which impose an inductive bias on the resulting quantum models. We relate the expressive power and generalization ability to the number of non-zero weight Lego kernels and propose a systematic approach to increase the complexity of a quantum kernel model, leading to a new form of the local projected kernels that require fewer quantum resources in terms of the number of quantum gates and measurement shots. We show numerically that models based on local projected kernels can achieve comparable performance to the global fidelity quantum kernel. Our work unifies existing quantum kernels and provides a systematic framework to compare their properties.


title: Tachyon condensation in a chromomagnetic center-vortex background

abstract: The chromomagnetic vacuum of SU(2) gluodynamics is considered in the background of a finite radius flux tube (center-vortex) with homogeneous field inside and zero field outside. In this background there are tachyonic modes. These modes cause an instability. It is assumed that the selfinteraction of these modes stops the creation of gluons and that a condensate will be formed. For constant condensates, the minimum of the effective potential is found on the tree level. In the background of these condensates, all tachyonic modes acquire nonzero, real masses which will result in a real effective potential of this system. Considering only the tachyonic modes and adding the energy of the background field, the total energy is found to have a minimum at some value of the background field, which depends on the coupling of the initial SU(2) model. For small coupling, this dependence is polynomial in distinction from the Savvidy vacuum where it is exponentially suppressed. The minimum of this energy will deepens with shrinking radius of the flux tube. It can be expected that this process can be stopped by adding quantum effects. Using the high temperature expansion of the effective potential, it can be expected that the symmetry, which is broken by the condensate, will be restored at sufficiently high temperature.


title: A discrete mean value of the Riemann zeta function

abstract: In this work, we estimate the sum \begin{align*} \sum_{0 < \Im(\rho) \leq T} \zeta(\rho+\alpha)X(\rho) Y(1\!-\! \rho) \end{align*} over the nontirival zeros $\rho$ of the Riemann zeta funtion where $\alpha$ is a complex number with $\alpha\ll 1/\log T$ and $X(\cdot)$ and $Y(\cdot)$ are some Dirichlet polynomials. Moreover, we estimate the discrete mean value above for higher derivatives where $\zeta(\rho+\alpha)$ is replaced by $\zeta^{(m)}(\rho)$ for all $m\in\mathbb{N}$. The formulae we obtain generalize a number of previous results in the literature. As an application, assuming the Riemann Hypothesis we obtain the lower bound \begin{align*} \sum_{0 < \Im(\rho) < T} | \zeta^{(m)}(\rho)|^{2k} \gg T(\log T)^{k^2+2km+1} \quad \quad (k,m\in\mathbb{N}) \end{align*} which was previously known under the Generalized Riemann Hypothesis, in the case $m=1$.


title: The transient IDEMIX model as a nonorographic gravity wave parameterization in an atmospheric circulation model

abstract: The Internal wave Dissipation, Energy and Mixing (IDEMIX) model presents a novel way of parameterizing internal gravity waves in the atmosphere. Using a continuous full wave spectrum in the energy balance equation and integrating over all vertical wavenumbers and frequencies results in prognostic equations for the energy density of gravity waves in multiple azimuthal compartments. It includes their non-dissipative interaction with the mean flow, allowing for an evolving and local description of momentum flux and gravity wave drag. A saturation mechanism maintains the wave field within convective stability limits, and an energetically consistent closure for critical-layer effects controls how much wave flux propagates from the troposphere into the middle atmosphere. IDEMIX can simulate zonal gravity wave drag around the mesopause, similar to a traditional gravity wave parameterization and to a state-of-the-art wave ray tracing model in an atmospheric circulation model. In addition, IDEMIX shows a reversal of the gravity wave drag around the mesopause region due to changes in the momentum flux there. When compared to empirical model data, IDEMIX captures well the summer hemisphere flow reversal, the cold summer mesospheric pole and the alternate positive and negative structures in the meridional mean flow.


title: Universally Optimal Multivariate Crossover Designs

abstract: In this article, universally optimal multivariate crossover designs are studied. The multiple response crossover design is motivated by a $3 \times 3$ crossover setup, where the effect of $3$ doses of an oral drug are studied on gene expressions related to mucosal inflammation. Subjects are assigned to three treatment sequences and response measurements on 5 different gene expressions are taken from each subject in each of the $3$ time periods. To model multiple or $g$ responses, where $g>1$, in a crossover setup, a multivariate fixed effect model with both direct and carryover treatment effects is considered. It is assumed that there are non zero within response correlations, while between response correlations are taken to be zero. The information matrix corresponding to the direct effects is obtained and some results are studied. The information matrix in the multivariate case is shown to differ from the univariate case, particularly in the completely symmetric property. For the $g>1$ case, with $t$ treatments and $p$ periods, for $p=t \geq 3$, the design represented by a Type $I$ orthogonal array of strength $2$ is proved to be universally optimal over the class of binary designs, for the direct treatment effects.


title: Horizon brightened accelerated radiation in the background of braneworld black holes

abstract: The concept of horizon brightened acceleration radiation (HBAR) has brought to us a distinct mechanism of particle production in curved spacetime. In this manuscript we examine the HBAR phenomena for a braneworld black hole (BBH) which emerges as an effective theory in our $(3+1)$ dimensional universe due to the higher dimensional gravitational effects. Despite being somewhat similar to the Reissner-Nordstr$\ddot{\rm o}$m solution in general relativity, the BBH is unique with respect to its charge term which is rather the tidal charge. In this background, we study the transition probability of the atom due to the atom-field interaction and the associated HBAR entropy. Both the quantities acquire modifications over the standard Schwarzschild results and turn out to be the function of the tidal charge. This modifications appear solely due to the bulk gravitational effects as induced on the 3-brane. Studying the Wien's displacement, we observe an important feature that the wavelengths of HBAR corresponding to the Schwarzschild and the BBH, deviate from each other depending on their masses. This deviation is found to be more pronounced for the mass values slightly greater or comparable to the Planck mass.


title: Minimal limit key polynomials

abstract: In this paper, we extend the theory of minimal limit key polynomials of valuations on the polynomial ring $\kx$. We use the theory of cuts on ordered abelian groups to show that the previous results on bounded sets of key polynomials of rank-one valuations, extend to vertically bounded sets of key polynomials of valuations of an arbitrary rank. We discuss as well properties of minimal limit key polynomials in the vertically unbounded case.


title: Transfer Learning-based Real-time Handgun Detection

abstract: Traditional surveillance systems rely on human attention, limiting their effectiveness. This study employs convolutional neural networks and transfer learning to develop a real-time computer vision system for automatic handgun detection. Comprehensive analysis of online handgun detection methods is conducted, emphasizing reducing false positives and learning time. Transfer learning is demonstrated as an effective approach. Despite technical challenges, the proposed system achieves a precision rate of 84.74%, demonstrating promising performance comparable to related works, enabling faster learning and accurate automatic handgun detection for enhanced security. This research advances security measures by reducing human monitoring dependence, showcasing the potential of transfer learning-based approaches for efficient and reliable handgun detection.


title: Inverse energy cascade in ocean macroscopic turbulence: Kolmogorov self-similarity in surface drifter observations and Richardson-Obhukov constant

abstract: We combine two point velocity and position data from surface drifter observations in the Benguela upwelling region off the coast of Namibia. The compensated third order longitudinal velocity structure function $\left\langle{\Delta u_{\ell}^{\rm 3}}\right\rangle/s$ shows a positive plateau for inertial separations $s$ roughly between $9~\rm{km}$ and $120~\rm{km}$ revealing an inverse energy cascade with energy transfer rate $\varepsilon\simeq 1.2 \pm 0.1 \cdot 10^{-7} m^3/s^2$. Deviations from Gaussianity of the corresponding probability distribution $P(\Delta u_{\ell} |s)$ of two-point velocity increments $\Delta u_{\ell}$ for given pair separation $s$ show up in the n$^{th}$ antisymetric structure functions $S_{-}^{(n)}(r)=\int u^n(P(u)-P(-u)d u$, which scale in agreement with Kolmogorov's prediction, $S_{-}^{(n)}(r)\sim r^{(n/3)}$, for $n=2,4,6$. The combination of $\varepsilon$ with Richardson dispersion $\left\langle s^2(t)\right\rangle=g\varepsilon t^3$, where $\left\langle s^2(t)\right\rangle$ is mean squared pair separation at time $ t$, reveals a Richardson-Obhukov constant of $g\simeq 0.11\pm 0.03$.


title: Driven-Dissipative Bose-Einstein Condensation and the Upper Critical Dimension

abstract: Driving and dissipation can stabilize Bose-Einstein condensates. Using Keldysh field theory, we analyze this phenomenon for Markovian systems that can comprise on-site two-particle driving, on-site single-particle and two-particle loss, as well as edge-correlated pumping. Above the upper critical dimension, mean-field theory shows that pumping and two-particle driving induce condensation right at the boundary between the stable and unstable regions of the non-interacting theory. With nonzero two-particle driving, the condensate is gapped. This picture is consistent with the recent observation that, without symmetry constraints beyond invariance under single-particle basis transformations, all gapped quadratic bosonic Liouvillians belong to the same phase. For systems below the upper critical dimension, the edge-correlated pumping penalizes high-momentum fluctuations, rendering the theory renormalizable. We perform the one-loop renormalization group analysis, finding a condensation transition inside the unstable region of the non-interacting theory. Interestingly, its critical behavior is determined by a Wilson-Fisher-like fixed point with universal correlation-length exponent $\nu=0.6$ in three dimensions.


title: Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Object

abstract: Image style transfer occupies an important place in both computer graphics and computer vision. However, most current methods require reference to stylized images and cannot individually stylize specific objects. To overcome this limitation, we propose the "Soulstyler" framework, which allows users to guide the stylization of specific objects in an image through simple textual descriptions. We introduce a large language model to parse the text and identify stylization goals and specific styles. Combined with a CLIP-based semantic visual embedding encoder, the model understands and matches text and image content. We also introduce a novel localized text-image block matching loss that ensures that style transfer is performed only on specified target objects, while non-target regions remain in their original style. Experimental results demonstrate that our model is able to accurately perform style transfer on target objects according to textual descriptions without affecting the style of background regions. Our code will be available at https://github.com/yisuanwang/Soulstyler.


title: Detection of the relativistic Shapiro delay in a highly inclined millisecond pulsar binary PSR J1012$-$4235

abstract: PSR J1012$-$4235 is a 3.1ms pulsar in a wide binary (37.9 days) with a white dwarf companion. We detect, for the first time, a strong relativistic Shapiro delay signature in PSR J1012$-$4235. Our detection is the result of a timing analysis of data spanning 13 years and collected with the Green Bank, Parkes, and MeerKAT Radio Telescopes and the Fermi $\gamma$-ray space telescope. We measured the orthometric parameters for Shapiro delay and obtained a 22$\sigma$ detection of the $h_{\rm 3}$ parameter of 1.222(54) $\mu$s and a 200$\sigma$ detection of $\varsigma$ of 0.9646(49). With the assumption of general relativity, these measurements constrain the pulsar mass ($M_{\rm p}=1.44^{+0.13}_{-0.12}$M$_{\odot}$), the mass of the white dwarf companion ($M_{\rm c} = 0.270^{+0.016}_{-0.015}$M$_{\odot}$ ), and the orbital inclination ($i=88.06^{+0.28}_{-0.25} \deg$). Including the early $\gamma$-ray data in our timing analysis facilitated a precise measurement of the proper motion of the system of 6.58(5) mas yr$^{-1}$. We also show that the system has unusually small kinematic corrections to the measurement of the orbital period derivative, and therefore has the potential to yield stringent constraints on the variation of the gravitational constant in the future.


title: High order universal portfolios

abstract: The Cover universal portfolio (UP from now on) has many interesting theoretical and numerical properties and was investigated for a long time. Building on it, we explore what happens when we add this UP to the market as a new synthetic asset and construct by recurrence higher order UPs. We investigate some important theoretical properties of the high order UPs and show in particular that they are indeed different from the Cover UP and are capable to break the time permutation invariance. We show that under some perturbation regime the second high order UP has better Sharp ratio than the standard UP and briefly investigate arbitrage opportunities thus created. Numerical experiences on a benchmark from the literature confirm that high order UPs improve Cover's UP performances.


title: Drilling Down into the Discourse Structure with LLMs for Long Document Question Answering

abstract: We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the task of zero-shot long document evidence retrieval, owing to their unprecedented performance across various NLP tasks. However, currently the LLMs can consume limited context lengths as input, thus providing document chunks as inputs might overlook the global context while missing out on capturing the inter-segment dependencies. Moreover, directly feeding the large input sets can incur significant computational costs, particularly when processing the entire document (and potentially incurring monetary expenses with enterprise APIs like OpenAI's GPT variants). To address these challenges, we propose a suite of techniques that exploit the discourse structure commonly found in documents. By utilizing this structure, we create a condensed representation of the document, enabling a more comprehensive understanding and analysis of relationships between different parts. We retain $99.6\%$ of the best zero-shot approach's performance, while processing only $26\%$ of the total tokens used by the best approach in the information seeking evidence retrieval setup. We also show how our approach can be combined with \textit{self-ask} reasoning agent to achieve best zero-shot performance in complex multi-hop question answering, just $\approx 4\%$ short of zero-shot performance using gold evidence.


title: Exploring Physically-Motivated Models to Fit Gamma-Ray Burst Spectra

abstract: We explore fitting gamma-ray burst spectra with three physically-motivated models, and thus revisit the viability of synchrotron radiation as the primary source of GRB prompt emission. We pick a sample of 100 bright GRBs observed by the Fermi Gamma-ray Burst Monitor (GBM), based on their energy flux values. In addition to the standard empirical spectral models used in previous GBM spectroscopy catalogs, we also consider three physically-motivated models; (a) a Thermal Synchrotron model, (b) a Band model with a High-energy Cutoff, and (c) a Smoothly Broken Power Law (SBPL) model with a Multiplicative Broken Power Law (MBPL). We then adopt the Bayesian information criterion (BIC) to compare the fits obtained and choose the best model. We find that 42% of the GRBs from the fluence spectra and 23% of GRBs from the peak-flux spectra have one of the three physically-motivated models as their preferred one. From the peak-flux spectral fits, we find that the low-energy index distributions from the empirical model fits for long GRBs peak around the synchrotron value of -2/3, while the two low-energy indices from the SBPL+MBPL fits of long GRBs peak close to the -2/3 and -3/2 values expected for a synchrotron spectrum below and above the cooling frequency.


title: On the normal modes of coupled harmonic oscillators

abstract: We discuss in detail a well known method for obtaining the frequencies of the normal modes of coupled harmonic oscillators that is based on the simultaneous diagonalization of two symmetric matrices. We apply it to some simple illustrative examples recently chosen for the presentation of an alternative approach based on a set of constants of the motion. We show that the traditional method is simpler, even in the case of equal frequencies. We also discuss a problem that commonly appears in elementary courses on quantum mechanics that also requires the diagonalization of two symmetric matrices.


title: Learning from similar systems and online data-driven LQR using iterative randomised data compression

abstract: The problem of data-driven recursive computation of receding horizon LQR control through a randomized combination of online/current and historical/recorded data is considered. It is assumed that large amounts of historical input-output data from a system, which is similar but not identical to the current system under consideration, is available. This (possibly large) data set is compressed through a novel randomized subspace algorithm to directly synthesize an initial solution of the standard LQR problem, which however is sub-optimal due to the inaccuracy of the historical model. The first instance of this input is used to actuate the current system and the corresponding instantaneous output is used to iteratively re-solve the LQR problem through a computationally inexpensive randomized rank-one update of the old compressed data. The first instance of the re-computed input is applied to the system at the next instant, output recorded and the entire procedure is repeated at each subsequent instant. As more current data becomes available, the algorithm learns automatically from the new data while simultaneously controlling the system in near optimal manner. The proposed algorithm is computationally inexpensive due to the initial and repeated compression of old and newly available data. Moreover, the simultaneous learning and control makes this algorithm particularly suited for adapting to unknown, poorly modeled and time-varying systems without any explicit exploration stage. Simulations demonstrate the effectiveness of the proposed algorithm vs popular exploration/exploitation approaches to LQR control.


title: Combinatorial Optimization with Policy Adaptation using Latent Space Search

abstract: Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a versatile framework for designing heuristics across a broad spectrum of problem domains. However, despite notable progress, RL has not yet supplanted industrial solvers as the go-to solution. Current approaches emphasize pre-training heuristics that construct solutions but often rely on search procedures with limited variance, such as stochastically sampling numerous solutions from a single policy or employing computationally expensive fine-tuning of the policy on individual problem instances. Building on the intuition that performant search at inference time should be anticipated during pre-training, we propose COMPASS, a novel RL approach that parameterizes a distribution of diverse and specialized policies conditioned on a continuous latent space. We evaluate COMPASS across three canonical problems - Travelling Salesman, Capacitated Vehicle Routing, and Job-Shop Scheduling - and demonstrate that our search strategy (i) outperforms state-of-the-art approaches on 11 standard benchmarking tasks and (ii) generalizes better, surpassing all other approaches on a set of 18 procedurally transformed instance distributions.


title: WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space

abstract: Modern learning-based approaches to 3D-aware image synthesis achieve high photorealism and 3D-consistent viewpoint changes for the generated images. Existing approaches represent instances in a shared canonical space. However, for in-the-wild datasets a shared canonical system can be difficult to define or might not even exist. In this work, we instead model instances in view space, alleviating the need for posed images and learned camera distributions. We find that in this setting, existing GAN-based methods are prone to generating flat geometry and struggle with distribution coverage. We hence propose WildFusion, a new approach to 3D-aware image synthesis based on latent diffusion models (LDMs). We first train an autoencoder that infers a compressed latent representation, which additionally captures the images' underlying 3D structure and enables not only reconstruction but also novel view synthesis. To learn a faithful 3D representation, we leverage cues from monocular depth prediction. Then, we train a diffusion model in the 3D-aware latent space, thereby enabling synthesis of high-quality 3D-consistent image samples, outperforming recent state-of-the-art GAN-based methods. Importantly, our 3D-aware LDM is trained without any direct supervision from multiview images or 3D geometry and does not require posed images or learned pose or camera distributions. It directly learns a 3D representation without relying on canonical camera coordinates. This opens up promising research avenues for scalable 3D-aware image synthesis and 3D content creation from in-the-wild image data. See https://katjaschwarz.github.io/wildfusion for videos of our 3D results.


title: Ball Mill Fault Prediction Based on Deep Convolutional Auto-Encoding Network

abstract: Ball mills play a critical role in modern mining operations, making their bearing failures a significant concern due to the potential loss of production efficiency and economic consequences. This paper presents an anomaly detection method based on Deep Convolutional Auto-encoding Neural Networks (DCAN) for addressing the issue of ball mill bearing fault detection. The proposed approach leverages vibration data collected during normal operation for training, overcoming challenges such as labeling issues and data imbalance often encountered in supervised learning methods. DCAN includes the modules of convolutional feature extraction and transposed convolutional feature reconstruction, demonstrating exceptional capabilities in signal processing and feature extraction. Additionally, the paper describes the practical deployment of the DCAN-based anomaly detection model for bearing fault detection, utilizing data from the ball mill bearings of Wuhan Iron & Steel Resources Group and fault data from NASA's bearing vibration dataset. Experimental results validate the DCAN model's reliability in recognizing fault vibration patterns. This method holds promise for enhancing bearing fault detection efficiency, reducing production interruptions, and lowering maintenance costs.


title: Likelihood Geometry of Reflexive Polytopes

abstract: We study the problem of maximum likelihood (ML) estimation for statistical models defined by reflexive polytopes. Our focus is on the maximum likelihood degree of these models as an algebraic measure of complexity of the corresponding optimization problem. We compute the ML degrees of all 4319 classes of three-dimensional reflexive polytopes, and observe some surprising behavior in terms of the presence of gaps between ML degrees and degrees of the associated toric varieties. We interpret these drops in the context of discriminants and prove formulas for the ML degree for families of reflexive polytopes, including the hypercube and its dual, the cross polytope, in arbitrary dimension. In particular, we determine a family of embeddings for the $d$-cube that implies ML degree one. Finally, we discuss generalized constructions of families of reflexive polytopes in terms of their ML degrees.


title: $h$-vectors of edge rings of odd-cycle compositions

abstract: Let $\mathbb{K}[G]$ be the edge ring of a finite simple graph $G$. Investigating properties of the $h$-vector of $\mathbb{K}[G]$ is of great interest in combinatorial commutative algebra. However, there are few families of graphs for which the $h$-vector has been explicitly determined. In this paper, we compute the $h$-vectors of a certain family of graphs that satisfy the odd-cycle condition, generalizing a result of the second and third named authors. As a corollary, we obtain a characterization of the graphs in this family whose edge rings are almost Gorenstein.


title: XAGen: 3D Expressive Human Avatars Generation

abstract: Recent advances in 3D-aware GAN models have enabled the generation of realistic and controllable human body images. However, existing methods focus on the control of major body joints, neglecting the manipulation of expressive attributes, such as facial expressions, jaw poses, hand poses, and so on. In this work, we present XAGen, the first 3D generative model for human avatars capable of expressive control over body, face, and hands. To enhance the fidelity of small-scale regions like face and hands, we devise a multi-scale and multi-part 3D representation that models fine details. Based on this representation, we propose a multi-part rendering technique that disentangles the synthesis of body, face, and hands to ease model training and enhance geometric quality. Furthermore, we design multi-part discriminators that evaluate the quality of the generated avatars with respect to their appearance and fine-grained control capabilities. Experiments show that XAGen surpasses state-of-the-art methods in terms of realism, diversity, and expressive control abilities. Code and data will be made available at https://showlab.github.io/xagen.


title: Large-Sample Properties of the Synthetic Control Method under Selection on Unobservables

abstract: We analyze the synthetic control (SC) method in panel data settings with many units. We assume the treatment assignment is based on unobserved heterogeneity and pre-treatment information, allowing for both strictly and sequentially exogenous assignment processes. We show that the critical property that determines the behavior of the SC method is the ability of input features to approximate the unobserved heterogeneity. Our results imply that the SC method delivers asymptotically normal estimators for a large class of linear panel data models as long as the number of pre-treatment periods is sufficiently large, making it a natural alternative to the Difference-in-Differences.


title: Aufbau Suppressed Coupled Cluster Theory for Electronically Excited States

abstract: We introduce an approach to improve single-reference coupled cluster theory in settings where the Aufbau determinant is absent from or plays only a small role in the true wave function. Using a de-excitation operator that can be efficiently hidden within a similarity transform, we create a coupled cluster wave function in which de-excitations work to suppress the Aufbau determinant and produce wave functions dominated by other determinants. Thanks to an invertible and fully exponential form, the approach is systematically improvable, size consistent, size extensive, and, interestingly, size intensive in a granular way that should make the adoption of some ground state techniques such as local correlation relatively straightforward. In this initial study, we apply the general formalism to create a state-specific method for orbital-relaxed singly excited states. We find that this approach matches the accuracy of similar-cost equation-of-motion methods in valence excitations while offering improved accuracy for charge transfer states. We also find the approach to be more accurate than excited-state-specific perturbation theory in both types of states.


title: Physical Reasoning and Object Planning for Household Embodied Agents

abstract: In this study, we explore the sophisticated domain of task planning for robust household embodied agents, with a particular emphasis on the intricate task of selecting substitute objects. We introduce the CommonSense Object Affordance Task (COAT), a novel framework designed to analyze reasoning capabilities in commonsense scenarios. This approach is centered on understanding how these agents can effectively identify and utilize alternative objects when executing household tasks, thereby offering insights into the complexities of practical decision-making in real-world environments.Drawing inspiration from human decision-making, we explore how large language models tackle this challenge through three meticulously crafted commonsense question-and-answer datasets, featuring refined rules and human annotations. Our evaluation of state-of-the-art language models on these datasets sheds light on three pivotal considerations: 1) aligning an object's inherent utility with the task at hand, 2) navigating contextual dependencies (societal norms, safety, appropriateness, and efficiency), and 3) accounting for the current physical state of the object. To maintain accessibility, we introduce five abstract variables reflecting an object's physical condition, modulated by human insights to simulate diverse household scenarios. Our contributions include insightful Object-Utility mappings addressing the first consideration and two extensive QA datasets (15k and 130k questions) probing the intricacies of contextual dependencies and object states. The datasets, along with our findings, are accessible at: \url{https://github.com/com-phy-affordance/COAT}. This research not only advances our understanding of physical commonsense reasoning in language models but also paves the way for future improvements in household agent intelligence.


title: Hadronic Mono-$W'$ Probes of Dark Matter at Colliders

abstract: Particle collisions at the energy frontier can probe the nature of invisible dark matter via production in association with recoiling visible objects. We propose a new potential production mode, in which dark matter is produced by the decay of a heavy dark Higgs boson radiated from a heavy $W'$ boson. In such a model, motivated by left-right symmetric theories, dark matter would not be pair produced in association with other recoiling objects due to its lack of direct coupling to quarks or gluons. We study the hadronic decay mode via $W'\rightarrow tb$ and estimate the LHC exclusion sensitivity at 95\% confidence level to be $10^2-10^5$ fb for $W'$ boson masses between 250 and 1750 GeV.


title: Nucleation phenomena and extreme vulnerability of spatial k-core systems

abstract: K-core percolation is a fundamental dynamical process in complex networks with applications that span numerous real-world systems. Earlier studies focus primarily on random networks without spatial constraints and reveal intriguing mixed-order transitions. However, real-world systems, ranging from transportation and communication networks to complex brain networks, are not random but are spatially embedded. Here, we study k-core percolation on two-dimensional spatially embedded networks and show that, in contrast to regular percolation, the length of connections can control the transition type, leading to four different types of phase transitions associated with novel phenomena and a rich phase diagram. A key finding is the existence of a metastable phase in which microscopic localized damage, independent of system size, can cause a macroscopic phase transition, a result which cannot be achieved in traditional percolation. In this case, local failures can spontaneously propagate the damage radially until the system entirely collapses, a phenomenon analogous to the nucleation process. These findings suggest novel features and extreme vulnerabilities of spatially embedded k-core network systems, and highlight the necessity to take into account the characteristic length of links when designing robust spatial networks. Furthermore, our insight about the microscopic processes and their origin during the mixed order and first order abrupt transitions in k-core networks could shed light on the mechanisms of many systems where such transitions occur.


title: $\sigma$-PCA: a unified neural model for linear and nonlinear principal component analysis

abstract: Linear principal component analysis (PCA), nonlinear PCA, and linear independent component analysis (ICA) -- those are three methods with single-layer autoencoder formulations for learning special linear transformations from data. Linear PCA learns orthogonal transformations that orient axes to maximise variance, but it suffers from a subspace rotational indeterminacy: it fails to find a unique rotation for axes that share the same variance. Both nonlinear PCA and linear ICA reduce the subspace indeterminacy from rotational to permutational by maximising statistical independence under the assumption of unit variance. The main difference between them is that nonlinear PCA only learns rotations while linear ICA learns not just rotations but any linear transformation with unit variance. The relationship between all three can be understood by the singular value decomposition of the linear ICA transformation into a sequence of rotation, scale, rotation. Linear PCA learns the first rotation; nonlinear PCA learns the second. The scale is the inverse of the standard deviations. The problem is that, in contrast to linear PCA, conventional nonlinear PCA cannot be used directly on the data to learn the first rotation, the first being special as it reduces dimensionality and orders by variances. In this paper, as solution to this problem, we propose $\sigma$-PCA: a unified neural model for linear and nonlinear PCA as single-layer autoencoders. Essentially, we propose a modification that allows nonlinear PCA to learn not just the second, but also the first rotation -- by maximising both variance and statistical independence. And so, like linear PCA, nonlinear PCA can now learn a semi-orthogonal transformation that reduces dimensionality and orders by variances, but, unlike linear PCA, nonlinear PCA can also eliminate the subspace rotational indeterminacy.


title: PaSS: Parallel Speculative Sampling

abstract: Scaling the size of language models to tens of billions of parameters has led to impressive performance on a wide range of tasks. At generation, these models are used auto-regressively, requiring a forward pass for each generated token, and thus reading the full set of parameters from memory. This memory access forms the primary bottleneck for generation and it worsens as the model size increases. Moreover, executing a forward pass for multiple tokens in parallel often takes nearly the same time as it does for just one token. These two observations lead to the development of speculative sampling, where a second smaller model is used to draft a few tokens, that are then validated or rejected using a single forward pass of the large model. Unfortunately, this method requires two models that share the same tokenizer and thus limits its adoption. As an alternative, we propose to use parallel decoding as a way to draft multiple tokens from a single model with no computational cost, nor the need for a second model. Our approach only requires an additional input token that marks the words that will be generated simultaneously. We show promising performance (up to $30\%$ speed-up) while requiring only as few as $O(d_{emb})$ additional parameters.


title: Some Upper Bounds on Ramsey Numbers Involving $C_4$

abstract: We obtain some new upper bounds on the Ramsey numbers of the form $R(\underbrace{C_4,\ldots,C_4}_m,G_1,\ldots,G_n)$, where $m\ge 1$ and $G_1,\ldots,G_n$ are arbitrary graphs. We focus on the cases of $G_i$'s being complete, star $K_{1,k}$ or book graphs $B_k$, where $B_k=K_2+kK_1$. If $k\ge 2$, then our main upper bound theorem implies that $$R(C_4,B_k) \le R(C_4,K_{1,k})+\left\lceil\sqrt{R(C_4,K_{1,k})}\right\rceil+1.$$ Our techniques are used to obtain new upper bounds in several concrete cases, including: $R(C_4,K_{11})\leq 43$, $R(C_4,K_{12})\leq 51$, $R(C_4,K_3,K_4)\leq 29$, $R(C_4, K_4,K_4)\leq 66$, $R(C_4,K_3,K_3,K_3)\leq 57$, $R(C_4,C_4,K_3,K_4)\leq 75$, and $R(C_4,C_4,K_4,K_4)\leq 177$, and also $R(C_4,B_{17})\leq 28$.