title: How does the primate brain combine generative and discriminative computations in vision?

abstract: Vision is widely understood as an inference problem. However, two contrasting conceptions of the inference process have each been influential in research on biological vision as well as the engineering of machine vision. The first emphasizes bottom-up signal flow, describing vision as a largely feedforward, discriminative inference process that filters and transforms the visual information to remove irrelevant variation and represent behaviorally relevant information in a format suitable for downstream functions of cognition and behavioral control. In this conception, vision is driven by the sensory data, and perception is direct because the processing proceeds from the data to the latent variables of interest. The notion of "inference" in this conception is that of the engineering literature on neural networks, where feedforward convolutional neural networks processing images are said to perform inference. The alternative conception is that of vision as an inference process in Helmholtz's sense, where the sensory evidence is evaluated in the context of a generative model of the causal processes giving rise to it. In this conception, vision inverts a generative model through an interrogation of the evidence in a process often thought to involve top-down predictions of sensory data to evaluate the likelihood of alternative hypotheses. The authors include scientists rooted in roughly equal numbers in each of the conceptions and motivated to overcome what might be a false dichotomy between them and engage the other perspective in the realm of theory and experiment. The primate brain employs an unknown algorithm that may combine the advantages of both conceptions. We explain and clarify the terminology, review the key empirical evidence, and propose an empirical research program that transcends the dichotomy and sets the stage for revealing the mysterious hybrid algorithm of primate vision.


title: $\mathcal{Z}$-stability of crossed products by topological full groups

abstract: We introduce the property of having good subgroups for actions of countable discrete groups on compact metrizable spaces. We show that it implies comparison for actions of amenable groups and amenable actions of groups containing the free group on two generators. As a result, free actions on finite-dimensional spaces of topological full groups of many \'etale groupoids are almost finite whenever the group is amenable, or have comparison if instead it contains a free group on two generators and the action is minimal and amenable. In particular, free minimal actions give rise to classifiable crossed products in both of the above cases.


title: Effects of a Generalized Uncertainty Principle on the MIT Bag Model Equation of State

abstract: The Generalized Uncertainty Principle (GUP) is motivated by the premise that spacetime fluctuations near the Planck scale impose a lower bound on the achievable resolution of distances, leading to a minimum length. Inspired by a semiclassical method that integrates the GUP into the partition function by deforming its phase space, we induce a modification on the thermodynamic quantities of the MIT bag model that we propose serves as an effective semiclassical description of deconfined quark matter in a space with minimal length. We investigate the consequences of this deformation on the zero-temperature limit, revealing a saturation limit for the energy density, pressure and baryon number density and an overall decrease of the thermodynamic quantities which suggests an enhanced stability against gravitational collapse. These findings extend existing research on GUP-deformed Fermi gases. Ultimately, our description introduces effects of quantum gravity in the equations of state for compact stars in a mathematically simple manner, suggesting potential for extension to more complex systems.


title: Computing Fringe Presentations of Multigraded Persistence Modules

abstract: Minimal free resolutions and minimal free presentations are standard ways to represent the isomorphism type of a persistence module in software. This description is a multi-parameter generalization of the barcode known in one-parameter persistence. Another multi-parameter generalization of this concept is given by fringe presentations (Miller: 2020), which represents the module as the image of a morphism from a free to an injective module. In this paper, we demonstrate a way to calculate the matrix representing a fringe presentation of a given persistence module from a minimal free resolution of it.


title: Sea ice detection using concurrent multispectral and synthetic aperture radar imagery

abstract: Synthetic Aperture Radar (SAR) imagery is the primary data type used for sea ice mapping due to its spatio-temporal coverage and the ability to detect sea ice independent of cloud and lighting conditions. Automatic sea ice detection using SAR imagery remains problematic due to the presence of ambiguous signal and noise within the image. Conversely, ice and water are easily distinguishable using multispectral imagery (MSI), but in the polar regions the ocean's surface is often occluded by cloud or the sun may not appear above the horizon for many months. To address some of these limitations, this paper proposes a new tool trained using concurrent multispectral Visible and SAR imagery for sea Ice Detection (ViSual\_IceD). ViSual\_IceD is a convolution neural network (CNN) that builds on the classic U-Net architecture by containing two parallel encoder stages, enabling the fusion and concatenation of MSI and SAR imagery containing different spatial resolutions. The performance of ViSual\_IceD is compared with U-Net models trained using concatenated MSI and SAR imagery as well as models trained exclusively on MSI or SAR imagery. ViSual\_IceD outperforms the other networks, with a F1 score 1.60\% points higher than the next best network, and results indicate that ViSual\_IceD is selective in the image type it uses during image segmentation. Outputs from ViSual\_IceD are compared to sea ice concentration products derived from the AMSR2 Passive Microwave (PMW) sensor. Results highlight how ViSual\_IceD is a useful tool to use in conjunction with PMW data, particularly in coastal regions. As the spatial-temporal coverage of MSI and SAR imagery continues to increase, ViSual\_IceD provides a new opportunity for robust, accurate sea ice coverage detection in polar regions.


title: Attention to detail: inter-resolution knowledge distillation

abstract: The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide images. In particular, digitizing biopsies at high resolutions is a time-consuming process, which is necessary due to the worsening results from the decrease in image detail. To alleviate this issue, recent literature has proposed using knowledge distillation to enhance the model performance at reduced image resolutions. In particular, soft labels and features extracted at the highest magnification level are distilled into a model that takes lower-magnification images as input. However, this approach fails to transfer knowledge about the most discriminative image regions in the classification process, which may be lost when the resolution is decreased. In this work, we propose to distill this information by incorporating attention maps during training. In particular, our formulation leverages saliency maps of the target class via grad-CAMs, which guides the lower-resolution Student model to match the Teacher distribution by minimizing the l2 distance between them. Comprehensive experiments on prostate histology image grading demonstrate that the proposed approach substantially improves the model performance across different image resolutions compared to previous literature.


title: An Application of HEP Track Seeding to Astrophysical Data

abstract: We apply methods of particle track reconstruction in High Energy Physics (HEP) to the search for distinct stellar populations in the Milky Way, using the Gaia EDR3 data set. This was motivated by analogies between the 3D space points in HEP detectors and the positions of stars (which are also points in a coordinate space) and the way collections of space points correspond to particle trajectories in the HEP, while collections of stars from distinct populations (such as stellar streams) can resemble tracks. Track reconstruction consists of multiple steps, the first one being seeding. In this note, we describe our implementation and results of the seeding step to the search for distinct stellar populations, and we indicate how the next steps will proceed. Our seeding method uses machine learning tools from the FAISS library, such as the k-nearest neighbors (kNN) search.


title: Orbital hall effect: from intrinsic mechanism to experimental evidence

abstract: Comparing with the spin of electron, the electronic orbitals, which have been long ignored in non-equilibrium transport, are getting more and more attentions, due to the prediction and experimental verification of orbital Hall effect (OHE) recently. In this report, the recent advances, including intrinsic mechanisms, direct and indirect experimental observations of OHE, are reviewed comprehensively. The orbital current, generated by OHE, shows much more fundamental features than spin current in explaining Hall conductivity and manipulating magnetization electronically. Theoretically, in momentum space, the OHE is proposed to originate from electric-field driven non-equilibrium orbital texture, based on tight-binding model. However, current experimental works still stay on the level to reveal how the OHE behaves after orbital current is generated, and the unambiguous experimental evidence to verify the generation mechanism of OHE is still missing, limiting the interpretation of OHE. Angle-resolved photoemission spectroscopy with polarized incident photon, on the other hand, could be used to identify the orbital textures on energy band and reveal the non-equilibrium nature of orbital-momentum locking behind OHE, which may help to provide the direct experimental evidence to examine the intrinsic mechanism of OHE, and reveal the nature of wave packet with non-vanishing orbital angular momentum.


title: Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery

abstract: Purpose: Depth estimation in robotic surgery is vital in 3D reconstruction, surgical navigation and augmented reality visualization. Although the foundation model exhibits outstanding performance in many vision tasks, including depth estimation (e.g., DINOv2), recent works observed its limitations in medical and surgical domain-specific applications. This work presents a low-ranked adaptation (LoRA) of the foundation model for surgical depth estimation. Methods: We design a foundation model-based depth estimation method, referred to as Surgical-DINO, a low-rank adaptation of the DINOv2 for depth estimation in endoscopic surgery. We build LoRA layers and integrate them into DINO to adapt with surgery-specific domain knowledge instead of conventional fine-tuning. During training, we freeze the DINO image encoder, which shows excellent visual representation capacity, and only optimize the LoRA layers and depth decoder to integrate features from the surgical scene. Results: Our model is extensively validated on a MICCAI challenge dataset of SCARED, which is collected from da Vinci Xi endoscope surgery. We empirically show that Surgical-DINO significantly outperforms all the state-of-the-art models in endoscopic depth estimation tasks. The analysis with ablation studies has shown evidence of the remarkable effect of our LoRA layers and adaptation. Conclusion: Surgical-DINO shed some light on the successful adaptation of the foundation models into the surgical domain for depth estimation. There is clear evidence in the results that zero-shot prediction on pre-trained weights in computer vision datasets or naive fine-tuning is not sufficient to use the foundation model in the surgical domain directly. Code is available at https://github.com/BeileiCui/SurgicalDINO.


title: Creation of a tweezer array for cold atoms utilizing a generative neural network

abstract: Optical tweezers have become essential tools for dynamically manipulating objects, ranging from microspheres or biological molecules to neutral atoms. In this study, we demonstrate the creation of tweezer arrays using a generative neural network, which allows for the trapping of neutral atoms with tunable atom arrays. We have successfully loaded cold strontium atoms into various optical tweezer patterns generated by a spatial light modulator (SLM) integrated with generative models. Our approach shortens the process time to control the SLM wtih minimal time delay, eliminating the need for repeated re-optimization of the hologram for the SLM.


title: Complexity of equal 0-surgeries

abstract: We say that two knots are friends if they share the same 0-surgery. Two friends with different sliceness status would provide a counterexample to the 4-dimensional smooth Poincar\'e conjecture. Here we create a census of all friends with small crossing numbers c and tetrahedral complexities t, and compute their smooth 4-genera. In particular, we compute the minimum of c(K)+c(K') and of t(K)+t(K') among all friends K and K'. Along the way, we classify all 0-surgeries of knots of at most 15 crossings.


title: Deciphering the Hidden Structures of HH 216 and Pillar IV in M16: Results from JWST and HST

abstract: To probe the star formation process, we present an observational investigation of the Pillar IV and an ionized knot HH 216 in the Eagle Nebula (M16). Pillar IV is known to host a Class I protostar that drives a bipolar outflow. The outflow has produced the bow shock, HH 216, which is associated with the red-shifted outflow lobe. The James Webb Space Telescope's near- and mid-infrared images (resolution $\sim$0.07 arcsec - 0.7 arcsec) reveal the protostar as a single, isolated object (below 1000 AU). The outer boundary of Pillar IV is depicted with the 3.3 $\mu$m Polycyclic aromatic hydrocarbon (PAH) emission. HH 216 is traced with the 4.05 $\mu$m Br$\alpha$ and the radio continuum emission, however it is undetected with 4.693 $\mu$m H$_{2}$ emission. HH 216 seems to be associated with both thermal and non-thermal radio emissions. High-resolution images reveal entangled ionized structures (below 3000 AU) of HH 216, which appear to be located toward termination shocks. New knots in 4.693 $\mu$m H$_{2}$ emission are detected, and are mainly found on Pillar IV's northern side. This particular result supports the previously proposed episodic accretion in the powering source of HH 216. One part of the ionized jet (extent $\sim$0.16 pc) is discovered on the southern side of the driving source. Using the $^{12}$CO($J$ = 1-0), $^{12}$CO($J$ = 3-2), and $^{13}$CO($J$ = 1-0) emission, observational signposts of Cloud-Cloud Collision (or interacting clouds) toward Pillar IV are investigated. Overall, our results suggest that the interaction of molecular cloud components around 23 and 26 km s$^{-1}$ might have influenced star formation activity in Pillar IV.


title: Simulating critical anion chemistry with indirect excitons

abstract: We study the effect of geometric constraints on the formation of indirect excitonic complexes with excess charge by considering the problem of two identical electrons moving in half-space subject to mutual Coulomb repulsion and the Coulomb attraction to a heavy hole of charge $Z$ residing on a flat impenetrable surface. We find that $Z=1$ is the critical charge necessary for binding, as compared to $Z_c\approx0.911$ in the unconstrained system. This suggests that interlayer electron--hole systems may serve as a flexible and experimentally accessible platform to study electronic behavior close to the critical nuclear charge necessary for binding.


title: Implications of comprehensive nuclear and astrophysics data on the equations of state of neutron star matter

abstract: The equations of state (EoSs) governing neutron star (NS) matter obtained for both non-relativistic and relativistic mean-field models are systematically confronted with a diverse set of terrestrial data and astrophysical observations within the Bayesian framework. The terrestrial data, spans from bulk properties of finite nuclei to the heavy-ion collisions, constrain the symmetric nuclear matter EoS and the symmetry energy up to twice the saturation density ($\rho_0$= 0.16 fm$^{-3}$). The astrophysical observations encompass the NS radius, the tidal deformability, and the lower bound on maximum mass. Three distinct posterior distributions of EoSs are generated by gradually updating the priors with different constraints: (i) only the maximum NS mass, (ii) incorporating additional terrestrial data, (iii) combining both the terrestrial data and astrophysical observations. These EoS distributions are then compared using the Kullback-Liebler divergence which highlights the significant constraints imposed on the EoSs by the currently available lower bound of NS maximum mass and terrestrial data. The remaining astrophysical observations marginally refine the EoS within the density range $\sim$ 2-3$\rho_0$. It is observed that the relativistic mean field model yields stiffer EoS around the saturation density, but predict smaller values of the speed of sound and proton fraction in the interior of massive stars.


title: Automatic UAV-based Airport Pavement Inspection Using Mixed Real and Virtual Scenarios

abstract: Runway and taxiway pavements are exposed to high stress during their projected lifetime, which inevitably leads to a decrease in their condition over time. To make sure airport pavement condition ensure uninterrupted and resilient operations, it is of utmost importance to monitor their condition and conduct regular inspections. UAV-based inspection is recently gaining importance due to its wide range monitoring capabilities and reduced cost. In this work, we propose a vision-based approach to automatically identify pavement distress using images captured by UAVs. The proposed method is based on Deep Learning (DL) to segment defects in the image. The DL architecture leverages the low computational capacities of embedded systems in UAVs by using an optimised implementation of EfficientNet feature extraction and Feature Pyramid Network segmentation. To deal with the lack of annotated data for training we have developed a synthetic dataset generation methodology to extend available distress datasets. We demonstrate that the use of a mixed dataset composed of synthetic and real training images yields better results when testing the training models in real application scenarios.


title: Dynamic Capital Requirements for Markov Decision Processes

abstract: We build on the theory of capital requirements (CRs) to create a new framework for modeling dynamic risk preferences. The key question is how to evaluate the risk of a payoff stream sequentially as new information is revealed. In our model, we associate each payoff stream with a disbursement strategy and a premium schedule to form a triple of stochastic processes. We characterize risk preferences in terms of a single set that we call the risk frontier which characterizes acceptable triples. We then propose the generalized capital requirement (GCR) which evaluates the risk of a payoff stream by minimizing the premium schedule over acceptable triples. We apply this model to a risk-aware decision maker (DM) who controls a Markov decision process (MDP) and wants to find a policy to minimize the GCR of its payoff stream. The resulting GCR-MDP recovers many well-known risk-aware MDPs as special cases. To make this approach computationally viable, we obtain the temporal decomposition of the GCR in terms of the risk frontier. Then, we connect the temporal decomposition with the notion of an information state to compactly capture the dependence of DM's risk preferences on the problem history, where augmented dynamic programming can be used to compute an optimal policy. We report numerical experiments for the GCR-minimizing newsvendor.


title: Topology-Driven Parallel Trajectory Optimization in Dynamic Environments

abstract: Ground robots navigating in complex, dynamic environments must compute collision-free trajectories to avoid obstacles safely and efficiently. Nonconvex optimization is a popular method to compute a trajectory in real-time. However, these methods often converge to locally optimal solutions and frequently switch between different local minima, leading to inefficient and unsafe robot motion. In this work, We propose a novel topology-driven trajectory optimization strategy for dynamic environments that plans multiple distinct evasive trajectories to enhance the robot's behavior and efficiency. A global planner iteratively generates trajectories in distinct homotopy classes. These trajectories are then optimized by local planners working in parallel. While each planner shares the same navigation objectives, they are locally constrained to a specific homotopy class, meaning each local planner attempts a different evasive maneuver. The robot then executes the feasible trajectory with the lowest cost in a receding horizon manner. We demonstrate, on a mobile robot navigating among pedestrians, that our approach leads to faster and safer trajectories than existing planners.


title: Cospectral vertices, walk-regular planar graphs and the echolocation problem

abstract: We study cospectral vertices on finite graphs in relation to the echolocation problem on Riemannian manifolds. First, We prove a computationally simple criterion to determine whether two vertices are cospectral. Then, we use this criterion in conjunction with a computer search to find minimal examples of various types of graphs on which cospectral but non-similar vertices exist, including minimal walk-regular non-vertex-transitive graphs, which turn out to be non-planar. Moreover, as our main result, we classify all finite walk-regular planar graphs, proving that such graphs must be vertex-transitive.


title: Almost Bijective Parametrization of $3 \times 3$ Copositive Matrices

abstract: In this work we take a deep dive into the cone of copositive $3 \times 3$ matrices. In doing so we visualize the cone, make geometric observations about it, and prove them. We then use these observations to parametrize the set. In the process we run into issues with surjectivity, and overcome them by resolving singularities and slightly shifting our original approach. We do all of this to ultimately arrive at a novel parametrization of the $3 \times 3$ copositive matrix cone which is surjective and almost injective, which we call almost bijective.


title: From decay of correlations to recurrence times in systems with contracting directions

abstract: Classic results by L.-S. Young show that the decay of correlations for systems that admit inducing schemes can be obtained through the recurrence rates of the inducing scheme. Reciprocal results were obtained for non-invertible systems (without contracting directions). Here, we obtain reciprocal results also for invertible systems (with contracting directions).


title: Numerical semigroups, polyhedra, and posets IV: walking the faces of the Kunz cone

abstract: A numerical semigroup is a cofinite subset of $\mathbb Z_{\ge 0}$ containing $0$ and closed under addition. Each numerical semigroup $S$ with smallest positive element $m$ corresponds to an integer point in the Kunz cone $\mathcal C_m \subseteq \mathbb R^{m-1}$, and the face of $\mathcal C_m$ containing that integer points determines certain algebraic properties of $S$. In this paper, we introduce the Kunz fan, a pure, polyhedral cone complex comprised of a faithful projection of certain faces of $\mathcal C_m$. We characterize several aspects of the Kunz fan in terms of the combinatorics of Kunz nilsemigroups, which are known to index the faces of $\mathcal C_m$, and our results culminate in a method of "walking" the face lattice of the Kunz cone in a manner analogous to that of a Gr\"obner walk. We apply our results in several contexts, including a wealth of computational data obtained from the aforementioned "walks" and a proof of a recent conjecture concerning which numerical semigroups achieve the highest minimal presentation cardinality.


title: Braided multitwists

abstract: We provide a characterization for multitwists satisfying the braid relation in the mapping class group of an orientable surface.


title: Examining Kempe equivalence via commutative algebra

abstract: Kempe equivalence is a classical and important notion on vertex coloring in graph theory. In the present paper, we introduce several ideals associated with graphs and provide a method to determine whether two $k$-colorings are Kempe equivalent via commutative algebra. Moreover, we give a way to compute all $k$-colorings of a graph up to Kempe equivalence by virtue of the algebraic technique on Gr\"{o}bner bases. As a consequence, the number of $k$-Kempe classes can be computed by using Hilbert functions. Finally, we introduce several algebraic algorithms related to Kempe equivalence.


title: Scheme for Deterministic Loading of Laser-Cooled Molecules into Optical Tweezers

abstract: We propose to repeatedly load laser-cooled molecules into optical tweezers, and transfer them to storage states that are rotationally excited by two additional quanta. Collisional loss of molecules in these storage states is suppressed, and a dipolar blockade prevents the accumulation of more than one molecule. Applying three cycles loads tweezers with single molecules at an 80% success rate, limited by residual collisional loss. This improved loading efficiency reduces the time needed for rearrangement of tweezer arrays, which would otherwise limit the scalability of neutral molecule quantum computers.

categories: physics.atom-ph cond-mat.quant-gas physics.chem-ph quant-ph


title: Bounded degree graphs and hypergraphs with no full rainbow matchings

abstract: Given a multi-hypergraph $G$ that is edge-colored into color classes $E_1, \ldots, E_n$, a full rainbow matching is a matching of $G$ that contains exactly one edge from each color class $E_i$. One way to guarantee the existence of a full rainbow matching is to have the size of each color class $E_i$ be sufficiently large compared to the maximum degree of $G$. In this paper, we apply a simple iterative method to construct edge-colored multi-hypergraphs with a given maximum degree, large color classes, and no full rainbow matchings. First, for every $r \ge 1$ and $\Delta \ge 2$, we construct edge-colored $r$-uniform multi-hypergraphs with maximum degree $\Delta$ such that each color class has size $|E_i| \ge r\Delta - 1$ and there is no full rainbow matching, which demonstrates that a theorem of Aharoni, Berger, and Meshulam (2005) is best possible. Second, we construct properly edge-colored multigraphs with no full rainbow matchings which disprove conjectures of Delcourt and Postle (2022). Finally, we apply results on full rainbow matchings to list edge-colorings and prove that a color degree generalization of Galvin's theorem (1995) does not hold.


title: Can We Trust the Unlabeled Target Data? Towards Backdoor Attack and Defense on Model Adaptation

abstract: Model adaptation tackles the distribution shift problem with a pre-trained model instead of raw data, becoming a popular paradigm due to its great privacy protection. Existing methods always assume adapting to a clean target domain, overlooking the security risks of unlabeled samples. In this paper, we explore the potential backdoor attacks on model adaptation launched by well-designed poisoning target data. Concretely, we provide two backdoor triggers with two poisoning strategies for different prior knowledge owned by attackers. These attacks achieve a high success rate and keep the normal performance on clean samples in the test stage. To defend against backdoor embedding, we propose a plug-and-play method named MixAdapt, combining it with existing adaptation algorithms. Experiments across commonly used benchmarks and adaptation methods demonstrate the effectiveness of MixAdapt. We hope this work will shed light on the safety of learning with unlabeled data.


title: GE-AdvGAN: Improving the transferability of adversarial samples by gradient editing-based adversarial generative model

abstract: Adversarial generative models, such as Generative Adversarial Networks (GANs), are widely applied for generating various types of data, i.e., images, text, and audio. Accordingly, its promising performance has led to the GAN-based adversarial attack methods in the white-box and black-box attack scenarios. The importance of transferable black-box attacks lies in their ability to be effective across different models and settings, more closely aligning with real-world applications. However, it remains challenging to retain the performance in terms of transferable adversarial examples for such methods. Meanwhile, we observe that some enhanced gradient-based transferable adversarial attack algorithms require prolonged time for adversarial sample generation. Thus, in this work, we propose a novel algorithm named GE-AdvGAN to enhance the transferability of adversarial samples whilst improving the algorithm's efficiency. The main approach is via optimising the training process of the generator parameters. With the functional and characteristic similarity analysis, we introduce a novel gradient editing (GE) mechanism and verify its feasibility in generating transferable samples on various models. Moreover, by exploring the frequency domain information to determine the gradient editing direction, GE-AdvGAN can generate highly transferable adversarial samples while minimizing the execution time in comparison to the state-of-the-art transferable adversarial attack algorithms. The performance of GE-AdvGAN is comprehensively evaluated by large-scale experiments on different datasets, which results demonstrate the superiority of our algorithm. The code for our algorithm is available at: https://github.com/LMBTough/GE-advGAN


title: Bilinear expansions of KP multipair correlators in BKP correlators

abstract: We present the relationship between the Schur function and the projective Schur functions for the general case where when no restrictions are imposed on either the argument or the partition with which the Schur function is labeled. This work is a continuation of our joint works with John Harnad.


title: Novel photon detectors

abstract: The paper reviews recent progress in photodetectors, discussing vacuum-based detectors, semiconductor sensors, and gas-based detectors. The emphasis in this review is on the detection of low light levels, enhanced timing resolution, and spectral range of photon detectors, as well as the development of photosensors for extreme conditions, for operation in cryogenic and high radiation-level environments.


title: LinguAlchemy: Fusing Typological and Geographical Elements for Unseen Language Generalization

abstract: Pretrained language models (PLMs) have become remarkably adept at task and language generalization. Nonetheless, they often fail when faced with unseen languages. In this work, we present LinguAlchemy, a regularization method that incorporates various linguistic information covering typological, geographical, and phylogenetic features to align PLMs representation to the corresponding linguistic information on each language. Our LinguAlchemy significantly improves the performance of mBERT and XLM-R on low-resource languages in multiple downstream tasks such as intent classification, news classification, and semantic relatedness compared to fully finetuned models and displaying a high degree of unseen language generalization. We further introduce AlchemyScale and AlchemyTune, extension of LinguAlchemy which adjusts the linguistic regularization weights automatically, alleviating the need for hyperparameter search.


title: RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks

abstract: We present a novel unconditional video generative model designed to address long-term spatial and temporal dependencies. To capture these dependencies, our approach incorporates a hybrid explicit-implicit tri-plane representation inspired by 3D-aware generative frameworks developed for three-dimensional object representation and employs a singular latent code to model an entire video sequence. Individual video frames are then synthesized from an intermediate tri-plane representation, which itself is derived from the primary latent code. This novel strategy reduces computational complexity by a factor of $2$ as measured in FLOPs. Consequently, our approach facilitates the efficient and temporally coherent generation of videos. Moreover, our joint frame modeling approach, in contrast to autoregressive methods, mitigates the generation of visual artifacts. We further enhance the model's capabilities by integrating an optical flow-based module within our Generative Adversarial Network (GAN) based generator architecture, thereby compensating for the constraints imposed by a smaller generator size. As a result, our model is capable of synthesizing high-fidelity video clips at a resolution of $256\times256$ pixels, with durations extending to more than $5$ seconds at a frame rate of 30 fps. The efficacy and versatility of our approach are empirically validated through qualitative and quantitative assessments across three different datasets comprising both synthetic and real video clips.


title: A new "gold standard": perturbative triples corrections in unitary coupled cluster theory and prospects for quantum computing

abstract: A major difficulty in quantum simulation is the adequate treatment of a large collection of entangled particles, synonymous with electron correlation in electronic structure theory, with coupled cluster (CC) theory being the leading framework in dealing with this problem. Augmenting computationally affordable low-rank approximations in CC theory with a perturbative account of higher-rank excitations is a tractable and effective way of accounting for the missing electron correlation in those approximations. This is perhaps best exemplified by the "gold standard" CCSD(T) method, which bolsters the baseline CCSD with effects of triple excitations using considerations from many-body perturbation theory (MBPT). Despite this established success, such a synergy between MBPT and the unitary analog of CC theory (UCC) has not been explored. In this work, we propose a similar approach wherein converged UCCSD amplitudes, which can be obtained on a quantum computer, are leveraged by a classical computer to evaluate energy corrections associated with triple excitations - leading to the UCCSD[T] and UCCSD(T*) methods. The rationale behind these choices is shown to be rigorous by studying the properties of finite-order UCC energy functionals. Although our efforts do not support the addition of the fifth-order contribution as in the (T) correction, comparisons are nevertheless made using a hybrid UCCSD(T) approach. We assess the performance of these approaches on a collection of small molecules, and demonstrate the benefits of harnessing the inherent synergy between MBPT and UCC theories.


title: Dynamic Analysis of electrostatically actuated fixed-fixed microbeams with midplane-stretching effects

abstract: We explore the undamped response of step-voltage driven parallel plates and fixed-fixed microbeams. We consider a third order correction in the parallel plate system as a reduced order system to model mid-plane stretching in fixed-fixed beams. In both cases, we employ energy methods to determine the threshold values displacement and voltage. This is the point beyond which there is no oscillatory motion. The dynamic pull-in parameters of the corresponding microactuator model are identified as these critical values. We thoroughly analyze the effects of mid-plane stretching in fixed-fixed microbeams. Additionally, the phase portraits for these actuators are also thoroughly examined. Empirical relations for the oscillation period/switching time for these microactuators are also developed. These results correlate to a high accuracy to previously published results.


title: Schauder estimates for parabolic equations with degenerate or singular weights

abstract: We establish some $C^{0,\alpha}$ and $C^{1,\alpha}$ regularity estimates for a class of weighted parabolic problems in divergence form. The main novelty is that the weights may vanish or explode on a characteristic hyperplane $\Sigma$ as a power $a > -1$ of the distance to $\Sigma$. The estimates we obtain are sharp with respect to the assumptions on coefficients and data. Our methods rely on a regularization of the equation and some uniform regularity estimates combined with a Liouville theorem and an approximation argument. As a corollary of our main result, we obtain similar $C^{1,\alpha}$ estimates when the degeneracy/singularity of the weight occurs on a regular hypersurface of cylindrical type.


title: Electron-vacancy scattering in SrNbO$_3$ and SrTiO$_3$: A DFT-NEGF study

abstract: Oxygen vacancies are often attributed to changes in the electronic transport for perovskite oxide materials (ABO$_3$). Here, we use density functional theory (DFT) coupled with non-equilibrium Green's functions (NEGF) to systematically investigate the influence of O vacancies and also A and B-site vacancies, on the electronic transport as characterised by a scattering cross-section. We consider SrNbO$_3$ and n-type SrTiO$_3$ and contrast results for bulk and thin film (slab) geometries. By varying the electron doping in SrTiO$_3$ we get insight into how the electron-vacancy scattering vary for different experimental conditions. We observe a significant increase in the scattering cross-section (in units of square-lattice parameter, $a^2$) from ca. $0.5-2.5a^2$ per vacancy in SrNbO$_3$ and heavily doped SrTiO$_3$ to more than $9a^2$ in SrTiO$_3$ with 0.02 free carriers per unit cell. Furthermore, the scattering strength of O vacancies is enhanced in TiO$_2$ terminated surfaces by more than 6 times in lowly doped SrTiO$_3$ compared to other locations in slabs and bulk systems. Interestingly, we also find that Sr vacancies go from being negligible scattering centers in SrNbO$_3$ and heavily doped SrTiO$_3$, to having a large scattering cross-section in weakly doped SrTiO$_3$. We therefore conclude that the electron-vacancy scattering in these systems is sensitive to the combination of electron concentration and vacancy location.


title: Wavelet-Inspired Multiscale Graph Convolutional Recurrent Network for Traffic Forecasting

abstract: Traffic forecasting is the foundation for intelligent transportation systems. Spatiotemporal graph neural networks have demonstrated state-of-the-art performance in traffic forecasting. However, these methods do not explicitly model some of the natural characteristics in traffic data, such as the multiscale structure that encompasses spatial and temporal variations at different levels of granularity or scale. To that end, we propose a Wavelet-Inspired Graph Convolutional Recurrent Network (WavGCRN) which combines multiscale analysis (MSA)-based method with Deep Learning (DL)-based method. In WavGCRN, the traffic data is decomposed into time-frequency components with Discrete Wavelet Transformation (DWT), constructing a multi-stream input structure; then Graph Convolutional Recurrent networks (GCRNs) are employed as encoders for each stream, extracting spatiotemporal features in different scales; and finally the learnable Inversed DWT and GCRN are combined as the decoder, fusing the information from all streams for traffic metrics reconstruction and prediction. Furthermore, road-network-informed graphs and data-driven graph learning are combined to accurately capture spatial correlation. The proposed method can offer well-defined interpretability, powerful learning capability, and competitive forecasting performance on real-world traffic data sets.


title: Bursting with Feedback: The Relationship between Feedback Model and Bursty Star Formation Histories in Dwarf Galaxies

abstract: We use high-resolution cosmological simulations to compare the effect of bursty star formation histories on dwarf galaxy structure for two different subgrid supernovae (SNe) feedback models in dwarf galaxies with stellar masses from $5000 <$ M$_*$/M$_\odot$ $< 10^{9}$. Our simulations are run using two distinct supernova feedback models: superbubble and blastwave. We show that both models are capable of producing galaxies that are cored and reproduce observed scaling relations for metallicity, luminosity, mass, and size. We show that continuous bursty star formation and the resulting stellar feedback are able to sustain dark matter cores in the higher dwarf galaxy mass regime, while the majority of ultra-faint and classical dwarfs retain cuspy central dark matter density profiles. We find that both subgrid SN models are able to create bursty star formation histories. We find that effective core formation peaks at M$_*$/M$_\odot$ $\simeq 5 \times 10^{-3}$ for both feedback models. Galaxies simulated with superbubble feedback peak at lower mean burstiness values relative to blastwave feedback, indicating that core formation in the superbubble sample may be less motivated by the burstiness of star formation.


title: Page-curve-like entanglement dynamics in open quantum systems

abstract: The entanglement entropy of a black hole, and that of its Hawking radiation, are expected to follow the so-called Page curve: After an increase in line with Hawking's calculation, it is expected to decrease back to zero once the black hole has fully evaporated, as demanded by unitarity. Recently, a simple system-plus-bath model has been proposed which shows a similar behaviour. Here, we make a general argument as to why such a Page-curve-like entanglement dynamics should be expected to hold generally for system-plus-bath models at small coupling and low temperatures, when the system is initialised in a pure state far from equilibrium. The interaction with the bath will then generate entanglement entropy, but it eventually has to decrease to the value prescribed by the corresponding mean-force Gibbs state. Under those conditions, it is close to the system ground state. We illustrate this on two paradigmatic open-quantum-system models, the exactly solvable harmonic quantum Brownian motion and the spin-boson model, which we study numerically. In the first example we find that the intermediate entropy of an initially localised impurity is higher for more localised initial states. In the second example, for an impurity initialised in the excited state, the Page time--when the entropy reaches its maximum--occurs when the excitation has half decayed.


title: JWST/NIRCam Transmission Spectroscopy of the Nearby Sub-Earth GJ 341b

abstract: We present a JWST/NIRCam transmission spectrum from $3.9-5.0$ $\mu$m of the recently-validated sub-Earth GJ 341b ($\mathrm{R_P} = 0.92$ $\mathrm{R_{\oplus}}$, $\mathrm{T_{eq}} = 540$ K) orbiting a nearby bright M1 star ($\mathrm{d} = 10.4$ pc, $\mathrm{K_{mag}}=5.6$). We use three independent pipelines to reduce the data from the three JWST visits and perform several tests to check for the significance of an atmosphere. Overall, our analysis does not uncover evidence of an atmosphere. Our null hypothesis tests find that none of our pipelines' transmission spectra can rule out a flat line, although there is weak evidence for a Gaussian feature in two spectra from different pipelines (at 2.3 and $2.9\sigma$). However, the candidate features are seen at different wavelengths (4.3 $\mu$m vs 4.7 $\mu$m), and our retrieval analysis finds that different gas species can explain these features in the two reductions (CO$_2$ at $3.1\sigma$ compared to O$_3$ at $2.9\sigma$), suggesting that they are not real astrophysical signals. Our forward model analysis rules out a low mean molecular weight atmosphere ($< 350\times$ solar metallicity) to at least $3\sigma$, and disfavors CH$_4$-dominated atmospheres at $1-3\sigma$, depending on the reduction. Instead, the forward models find our transmission spectra are consistent with no atmosphere, a hazy atmosphere, or an atmosphere containing a species that does not have prominent molecular bands across the NIRCam/F444W bandpass, such as a water-dominated atmosphere. Our results demonstrate the unequivocal need for two or more transit observations analyzed with multiple reduction pipelines, alongside rigorous statistical tests, to determine the robustness of molecular detections for small exoplanet atmospheres.


title: Safeguarding DeFi Smart Contracts against Oracle Deviations

abstract: This paper presents OVer, a framework designed to automatically analyze the behavior of decentralized finance (DeFi) protocols when subjected to a "skewed" oracle input. OVer firstly performs symbolic analysis on the given contract and constructs a model of constraints. Then, the framework leverages an SMT solver to identify parameters that allow its secure operation. Furthermore, guard statements may be generated for smart contracts that may use the oracle values, thus effectively preventing oracle manipulation attacks. Empirical results show that OVer can successfully analyze all 10 benchmarks collected, which encompass a diverse range of DeFi protocols. Additionally, this paper also illustrates that current parameters utilized in the majority of benchmarks are inadequate to ensure safety when confronted with significant oracle deviations.


title: On natural complexes in Iwasawa theory

abstract: We consider two natural complexes that appear in recent formulations of equivariant Iwasawa main conjectures for extensions of not necessarily totally real fields. We show that both complexes are isomorphic in the derived category of Iwasawa modules if the weak Leopoldt conjecture holds for the relevant $\mathbb{Z}_p$-extension.


title: Quantifying the contributions to diffusion in complex materials

abstract: Using machine learning with a variational formula for diffusivity, we recast diffusion as a sum of individual contributions to diffusion--called "kinosons"--and compute their statistical distribution to model a complex multicomponent alloy. Calculating kinosons is orders of magnitude more efficient than computing whole trajectories, and elucidates kinetic mechanisms for diffusion. The distribution of kinosons with temperature leads to new accurate analytic models for macroscale diffusivity. This combination of machine learning with diffusion theory promises insight into other complex materials.


title: Computing Data Distribution from Query Selectivities

abstract: We are given a set $\mathcal{Z}=\{(R_1,s_1),\ldots, (R_n,s_n)\}$, where each $R_i$ is a \emph{range} in $\Re^d$, such as rectangle or ball, and $s_i \in [0,1]$ denotes its \emph{selectivity}. The goal is to compute a small-size \emph{discrete data distribution} $\mathcal{D}=\{(q_1,w_1),\ldots, (q_m,w_m)\}$, where $q_j\in \Re^d$ and $w_j\in [0,1]$ for each $1\leq j\leq m$, and $\sum_{1\leq j\leq m}w_j= 1$, such that $\mathcal{D}$ is the most \emph{consistent} with $\mathcal{Z}$, i.e., $\mathrm{err}_p(\mathcal{D},\mathcal{Z})=\frac{1}{n}\sum_{i=1}^n\! \lvert{s_i-\sum_{j=1}^m w_j\cdot 1(q_j\in R_i)}\rvert^p$ is minimized. In a database setting, $\mathcal{Z}$ corresponds to a workload of range queries over some table, together with their observed selectivities (i.e., fraction of tuples returned), and $\mathcal{D}$ can be used as compact model for approximating the data distribution within the table without accessing the underlying contents. In this paper, we obtain both upper and lower bounds for this problem. In particular, we show that the problem of finding the best data distribution from selectivity queries is $\mathsf{NP}$-complete. On the positive side, we describe a Monte Carlo algorithm that constructs, in time $O((n+\delta^{-d})\delta^{-2}\mathop{\mathrm{polylog}})$, a discrete distribution $\tilde{\mathcal{D}}$ of size $O(\delta^{-2})$, such that $\mathrm{err}_p(\tilde{\mathcal{D}},\mathcal{Z})\leq \min_{\mathcal{D}}\mathrm{err}_p(\mathcal{D},\mathcal{Z})+\delta$ (for $p=1,2,\infty$) where the minimum is taken over all discrete distributions. We also establish conditional lower bounds, which strongly indicate the infeasibility of relative approximations as well as removal of the exponential dependency on the dimension for additive approximations. This suggests that significant improvements to our algorithm are unlikely.


title: On the Power of Graph Neural Networks and Feature Augmentation Strategies to Classify Social Networks

abstract: This paper studies four Graph Neural Network architectures (GNNs) for a graph classification task on a synthetic dataset created using classic generative models of Network Science. Since the synthetic networks do not contain (node or edge) features, five different augmentation strategies (artificial feature types) are applied to nodes. All combinations of the 4 GNNs (GCN with Hierarchical and Global aggregation, GIN and GATv2) and the 5 feature types (constant 1, noise, degree, normalized degree and ID -- a vector of the number of cycles of various lengths) are studied and their performances compared as a function of the hidden dimension of artificial neural networks used in the GNNs. The generalisation ability of these models is also analysed using a second synthetic network dataset (containing networks of different sizes).Our results point towards the balanced importance of the computational power of the GNN architecture and the the information level provided by the artificial features. GNN architectures with higher computational power, like GIN and GATv2, perform well for most augmentation strategies. On the other hand, artificial features with higher information content, like ID or degree, not only consistently outperform other augmentation strategies, but can also help GNN architectures with lower computational power to achieve good performance.


title: Constraining parametric deviations from the Kerr spacetime using black hole ringdowns of GW150914 and GW190521

abstract: The ringdown phase of a binary black hole merger is modelled by the quasi-normal modes of a perturbed Kerr black hole. According to the black hole no-hair theorem, the emitted ringdown spectra are constrained by the mass and spin of the remnant black hole and thus offer an excellent test of the Kerr-nature of black holes. As a parameterization of beyond-Kerr effects, we employ the Johannsen-Psaltis metric ansatz. We analyze the ringdown of two binary black hole merger events- GW150914 and GW190521 to constrain the deviation from Kerr. We find that both events are consistent with the Kerr metric and due to the larger signal-to-noise ratio and the presence of the additional subdominant mode in the ringdown phase, we find a factor of ~2 improvement in constraints on the deviation parameter in the case of GW190521 as compared to GW150914. Moreover, we find that the deviation parameter is anti-correlated to the spin of the remnant black hole. We also explore the effect of priors for other physical parameters on the Kerr deviation.


title: Knots in $\mathbb{R}P^3$

abstract: The paper studies knots in three dimensional projective space. Our technique for this purpose is to associate a virtual link to a link in projective space so that equivalent projective links go to equivalent virtual links (modulo a special flype move). We can then apply techniques in virtual knot theory to obtain a Jones polynomial for projective links that is equivalent to the known Jones polynomial for them and to apply virtual Khovanov homology and the virtual Rasmussen invariant of Dye, Kaestner, and Kauffman to projective links.


title: Improving the energy density and flexibility of PMN-0.3PT based piezoelectric generator by composite designing

abstract: Ceramics based piezoelectric generators are known for their high energy density and poor flexibility. In this work, v_r-PMN-0.3PT/PDMS 2-2 composite with optimum PMN-0.3PT content (v_r) was designed that demonstrated enhanced output energy density and superior mechanical flexibility under dynamic mechanical excitation. v_r-PMN-0.3PT/PDMS 2-2 composite with different PMN-PT reinforcement content (v_r) and two different reinforcement configurations were fabricated and characterized for effective electro-elastic properties and energy harvesting response. Parallelly, using the finite element method and analytical models, effective electromechanical properties were calculated. Composites with parallel connectivity of the reinforcement phase demonstrated enhanced piezoelectric charge coefficient even with low PMN-0.3PT content whereas the relative permittivity and elastic modulus exhibited a linearly increasing trend with reinforcement volume fraction. At a compressive load of 50 N and 5 Hz frequency, a piezoelectric generator (PG) based on a v_r = 0.2, v_r- PMN-0.3PT/PDMS 2-2 composite with parallel connectivity produced a maximum short-circuit current density of 69 nA/cm2 and an open-circuit electric field of 189 V/cm, translating to a maximum output power density of ~13 {\mu}W/cm3 higher than that of pristine PMN-0.3 PT based piezoelectric generator. Estimated mechanical flexibility was found to be ~53 % higher than that of pristine PMN-0.3PT.


title: Fast High Dynamic Range Radiance Fields for Dynamic Scenes

abstract: Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially with nonuniform illumination. Some previous NeRF methods attempt to introduce high-dynamic-range (HDR) techniques but mainly target static scenes. To extend HDR NeRF methods to wider applications, we propose a dynamic HDR NeRF framework, named HDR-HexPlane, which can learn 3D scenes from dynamic 2D images captured with various exposures. A learnable exposure mapping function is constructed to obtain adaptive exposure values for each image. Based on the monotonically increasing prior, a camera response function is designed for stable learning. With the proposed model, high-quality novel-view images at any time point can be rendered with any desired exposure. We further construct a dataset containing multiple dynamic scenes captured with diverse exposures for evaluation. All the datasets and code are available at \url{https://guanjunwu.github.io/HDR-HexPlane/}.


title: W*-superrigidity for cocycle twisted group von Neumann algebras

abstract: We construct countable groups $G$ with the following new degree of W*-superrigidity: if $L(G)$ is virtually isomorphic, in the sense of admitting a bifinite bimodule, with any other group von Neumann algebra $L(\Lambda)$, then the groups $G$ and $\Lambda$ must be virtually isomorphic. Moreover, we allow both group von Neumann algebras to be twisted by an arbitrary $2$-cocycle. We also give examples of II$_1$ factors $N$ that are indecomposable in every sense: they are not virtually isomorphic to any cocycle twisted groupoid von Neumann algebra.


title: Finite-size effects in the two-dimensional BCS-BEC crossover

abstract: We study the finite-size effects on the BCS-BEC crossover in two dimensions, occurring in confined fermionic superfluids. We analyze several thermodynamic properties, such as the chemical potential, the energy gap and the superfluid density, taking into account unavoidable quantum fluctuations, and, by means of renormalization group procedure, we detect the putative Berezinskii-Kosterlitz-Thouless phase transition at finite-size.


title: The velocity field and Birkhoff-Rott integral for non-decaying, non-periodic vortex sheets

abstract: The Birkhoff-Rott integral expresses the fluid velocity on a vortex sheet. This integral converges if certain quantities decay at horizontal infinity, but can also be summed over periodic images in the horizontally periodic case. However, non-decaying, non-periodic cases are also of interest, such as the interaction of periodic wavetrains with non-commensurate periods (i.e. spatially quasiperiodic solutions), or non-periodic disturbances to periodic wavetrains. We therefore develop a more general single formula for the Birkhoff-Rott integral, which unifies and extends the cases of decay and periodicity. We verify that under some reasonable conditions this new version of the Birkhoff-Rott integral is the restriction to the vortex sheet of an incompressible, irrotational velocity field, with continuous normal component but with a jump in tangential velocity across the vortex sheet. We give a number of examples of non-decaying, non-periodic sheet positions and sheet strengths for which our assumptions may be verified. While we develop this in the case of two-dimensional fluids, the methodology applies equally well to three-dimensional fluids.


title: MatSynth: A Modern PBR Materials Dataset

abstract: We introduce MatSynth, a dataset of 4,000+ CC0 ultra-high resolution PBR materials. Materials are crucial components of virtual relightable assets, defining the interaction of light at the surface of geometries. Given their importance, significant research effort was dedicated to their representation, creation and acquisition. However, in the past 6 years, most research in material acquisiton or generation relied either on the same unique dataset, or on company-owned huge library of procedural materials. With this dataset we propose a significantly larger, more diverse, and higher resolution set of materials than previously publicly available. We carefully discuss the data collection process and demonstrate the benefits of this dataset on material acquisition and generation applications. The complete data further contains metadata with each material's origin, license, category, tags, creation method and, when available, descriptions and physical size, as well as 3M+ renderings of the augmented materials, in 1K, under various environment lightings. The MatSynth dataset is released through the project page at: https://www.gvecchio.com/matsynth.


title: Numerical thermalization in 2D PIC simulations: Practical estimates for low temperature plasma simulations

abstract: The process of numerical thermalization in particle-in-cell (PIC) simulations has been studied extensively. It is analogous to Coulomb collisions in real plasmas, causing particle velocity distributions (VDFs) to evolve towards a Maxwellian as macroparticles experience polarization drag and resonantly interact with the fluctuation spectrum. This paper presents a practical tutorial on the effects of numerical thermalization in 2D PIC applications. Scenarios of interest include simulations which must be run for many thousands of plasma periods and contain a population of cold electrons that leave the simulation space very slowly. This is particularly relevant to many low temperature plasma discharges and materials processing applications. We present numerical drag and diffusion coefficients and their associated timescales for a variety of grid resolutions, discussing the circumstances under which the electron VDF is modified by numerical thermalization. Though the effects described here have been known for many decades, direct comparison of analytically derived, velocity-dependent numerical relaxation timescales to those of other relevant processes has not often been applied in practice due to complications that arise in calculating thermalization rates in 1D simulations. Using these comparisons, we estimate the impact of numerical thermalization in several example low temperature plasma applications including capacitively coupled plasma (CCP) discharges, inductively coupled plasma (ICP) discharges, beam plasmas, and hollow cathode discharges. Finally, we discuss possible strategies for mitigating numerical relaxation effects in 2D PIC simulations.


title: Around Homology Planes: Old and new

abstract: We survey some old and new results about acyclic (affine) complex surfaces, also called homology planes. We ask several questions and leave open directions for future research.


title: Investigating Data Contamination for Pre-training Language Models

abstract: Language models pre-trained on web-scale corpora demonstrate impressive capabilities on diverse downstream tasks. However, there is increasing concern whether such capabilities might arise from evaluation datasets being included in the pre-training corpus -- a phenomenon known as \textit{data contamination} -- in a manner that artificially increases performance. There has been little understanding of how this potential contamination might influence LMs' performance on downstream tasks. In this paper, we explore the impact of data contamination at the pre-training stage by pre-training a series of GPT-2 models \textit{from scratch}. We highlight the effect of both text contamination (\textit{i.e.}\ input text of the evaluation samples) and ground-truth contamination (\textit{i.e.}\ the prompts asked on the input and the desired outputs) from evaluation data. We also investigate the effects of repeating contamination for various downstream tasks. Additionally, we examine the prevailing n-gram-based definitions of contamination within current LLM reports, pinpointing their limitations and inadequacy. Our findings offer new insights into data contamination's effects on language model capabilities and underscore the need for independent, comprehensive contamination assessments in LLM studies.


title: Photometric redshifts and intrinsic alignments: degeneracies and biases in 3$\times$2pt analysis

abstract: We present a systematic study of cosmological parameter bias in weak lensing and large-scale structure analyses for upcoming imaging surveys induced by the interplay of intrinsic alignments (IA) and photometric redshift (photo-z) model mis-specification error. We first examine the degeneracies between the parameters of the Tidal Alignment - Tidal Torquing (TATT) model for IA and of a photo-z model including a mean shift ($\Delta \bar{z}$) and variance ($\sigma_{z}$) for each tomographic bin of lenses and sources, under a variety of underlying true IA behaviors. We identify strong degeneracies between: (1) the redshift scaling of the tidal alignment amplitude and the mean shift and variances of source bins, (2) the redshift scaling of the tidal torquing amplitude and the variance of the lowest-$z$ source bin, and (3) the IA source density weighting and the mean shift and variance of several source bins. We then use this information to guide our exploration of the level of cosmological parameter bias which can be induced given incorrect modelling of IA, photo-z, or both. We find that marginalizing over all the parameters of TATT is generally sufficient to preclude cosmological parameter bias in the scenarios we consider. However, this does not necessarily mean that IA and photo-z parameters are themselves unbiased, nor does it mean that the best-fit model is a good fit to the data. We also find scenarios where the inferred parameters produce $\chi^2_{\rm DOF}$ values indicative of a good fit but cosmological parameter bias is significant, particularly when the IA source density weighting parameter is not marginalized over.


title: Simulation-Based Inference with Neural Posterior Estimation applied to X-ray spectral fitting: Demonstration of working principles down to the Poisson regime

abstract: Neural networks are being extensively used for modelling data, especially in the case where no likelihood can be formulated. Although in the case of X-ray spectral fitting, the likelihood is known, we aim to investigate the neural networks ability to recover the model parameters but also their associated uncertainties, and compare its performance with standard X-ray spectral fitting, whether following a frequentist or Bayesian approach. We apply Simulation-Based Inference with Neural Posterior Estimation (SBI-NPE) to X-ray spectra. We train a network with simulated spectra, and then it learns the mapping between the simulated spectra and their parameters and returns the posterior distribution. The model parameters are sampled from a predefined prior distribution. To maximize the efficiency of the training of the neural network, yet limiting the size of the training sample to speed up the inference, we introduce a way to reduce the range of the priors, either through a classifier or a coarse and quick inference of one or multiple observations. SBI-NPE is demonstrated to work equally well as standard X-ray spectral fitting, both in the Gaussian and Poisson regimes, both on simulated and real data, yielding fully consistent results in terms of best fit parameters and posterior distributions. The inference time is comparable to or smaller than the one needed for Bayesian inference. On the other hand, once properly trained, an amortized SBI-NPE network generates the posterior distributions in no time. We show that SBI-NPE is less sensitive to local minima trapping than standard fit statistic minimization techniques. We find that the neural network can be trained equally well on dimension-reduced spectra, via a Principal Component Decomposition, leading to a shorter inference time. Neural posterior estimation thus adds up as a complementary tool for X-ray spectral fitting (abridged).


title: On prime Cayley graphs

abstract: The decomposition of complex networks into smaller, interconnected components is a central challenge in network theory with a wide range of potential applications. In this paper, we utilize tools from group theory and ring theory to study this problem when the network is a Cayley graph. In particular, we answer the following question: Which Cayley graphs are prime?


title: The spin-flip-induced quadrupole resonance in odd-$A$ exotic atoms

abstract: We examine the possible existence of quadrupole resonances in exotic atoms containing odd-$A$ nuclei. We find that the spin-flip of the de-exciting exotic particle can induce a resonance, altering the orbital angular momentum of the nucleus by one quanta. This process results in an excited nucleus with a suppression in x-ray photon emissions during the exotic atom cascade. We provide specific cases of antiprotonic atoms of stable elements where this resonance effect is expected to occur. The study of this phenomena may provide insight into the strong interaction of deeply bound antiprotonic states in the proximity of the unpaired nucleon, and serve as a tool for probing short-lived excited nuclear states.


title: Rotational covariance restricts available quantum states

abstract: Quantum states of angular momentum and spin generally are not invariant under rotations of the reference frame. Therefore, they can be used as a resource of relative orientation, which is encoded in the asymmetry of the state under consideration. In this paper we introduce the analytical characterization of the rotational information by parameterizing the group characteristic function by polynomial functions. By doing so, we show that the set of states achievable through $SU(2)$-covariant channels admits an analytical characterization and can be studied through the use of semidefinite optimization techniques. We demonstrate the developed methods via examples.


title: Suppressed Kondo screening in two-dimensional altermagnets

abstract: We have studied the Kondo effect of a spin-1/2 impurity coupled to a two-dimensional altermagnet host material. To attain the low-temperature many-body Kondo physics of the system, we have performed a numerical renormalization group calculations that allows us to access the spectral properties of the system at zero temperature. The impurity spectral function and the Kondo temperature were calculated for different set of parameters, including Rashba spin-orbit coupling (RSOC) and an external magnetic field. Interestingly, in the RSOC and altermagnetic fields, the hybridization function is spin independent, despite the characteristic broken time-reversal symmetry of the altermagnet. This is because the alternating sign of the spin splitting of the bands in the momentum space renders equal contributions for both spin components of the hybridization function. Our results demonstrate that, although the hybridization function is time-reversal symmetric, the Kondo temperature is substantially suppressed by the altermagnet coupling. Moreover, we have investigated the effect of an external magnetic field applied in the altermagnet along different directions. Interestingly, we observe an important restraining of the Kondo peak which depends strongly on the direction of the field. This anisotropic effect is, however, masked if strong Zeeman splitting takes place at the impurity, as it shatters the Kondo-singlet state.


title: DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

abstract: In the era of large language models, Mixture-of-Experts (MoE) is a promising architecture for managing computational costs when scaling up model parameters. However, conventional MoE architectures like GShard, which activate the top-$K$ out of $N$ experts, face challenges in ensuring expert specialization, i.e. each expert acquires non-overlapping and focused knowledge. In response, we propose the DeepSeekMoE architecture towards ultimate expert specialization. It involves two principal strategies: (1) finely segmenting the experts into $mN$ ones and activating $mK$ from them, allowing for a more flexible combination of activated experts; (2) isolating $K_s$ experts as shared ones, aiming at capturing common knowledge and mitigating redundancy in routed experts. Starting from a modest scale with 2B parameters, we demonstrate that DeepSeekMoE 2B achieves comparable performance with GShard 2.9B, which has 1.5 times the expert parameters and computation. In addition, DeepSeekMoE 2B nearly approaches the performance of its dense counterpart with the same number of total parameters, which set the upper bound of MoE models. Subsequently, we scale up DeepSeekMoE to 16B parameters and show that it achieves comparable performance with LLaMA2 7B, with only about 40% of computations. Further, our preliminary efforts to scale up DeepSeekMoE to 145B parameters consistently validate its substantial advantages over the GShard architecture, and show its performance comparable with DeepSeek 67B, using only 28.5% (maybe even 18.2%) of computations.


title: Diffeomorphism covariance and the quantum Schwarzschild interior

abstract: We introduce a notion of residual diffeomorphism covariance in quantum Kantowski-Sachs (KS), describing the interior of a Schwarzschild black hole. We solve for the family of Hamiltonian constraint operators satisfying the associated covariance condition, as well as parity invariance, preservation of the Bohr Hilbert space of Loop Quantum KS and a correct (na\"ive) classical limit. We further explore imposing minimality of the number of terms, and compare the solution with other Hamiltonian constraints proposed for Loop Quantum KS in the literature. In particular, we discuss a lapse recently commonly chosen due to the resulting decoupling of evolution of the two degrees of freedom and exact solubility of the model. We show that such a lapse choice can indeed be quantized as an operator densely defined on the Bohr Hilbert space, and that any such operator must include an infinite number of shift operators.


title: Probing for Lorentz Invariance Violation in Pantheon Plus Dominated Cosmology

abstract: The Hubble tension in cosmology is not showing signs of alleviation and thus, it is important to look for alternative approaches to it. One such example would be the eventual detection of a time delay between simultaneously emitted high-energy and low-energy photons in gamma-ray bursts (GRB). This would signal a possible Lorentz Invariance Violation (LIV) and in the case of non-zero quantum gravity time delay, it can be used to study cosmology as well. In this work, we use various astrophysical datasets (BAO, Pantheon Plus and the CMB distance priors), combined with two GRB time delay datasets with their respective models for the {\em {intrinsic time delay}}. Since the intrinsic time delay is considered the largest source of uncertainty in such studies, finding a better model is important. Our results yield as quantum gravity energy bound $E_{QG}\ge 10^{17}$ GeV and $E_{QG}\ge 10^{18}$ GeV respectively. The difference between standard approximation (constant intrinsic lag) and the extended (non-constant) approximations is minimal in most cases we coincide. However, the biggest effect on the results comes from the prior on the parameter $\frac{c}{H_0 r_d}$, emphasizing once again that at current precision, cosmological datasets are the dominant factor in determining the cosmology. We estimate the energies at which cosmology gets significantly affected by the time delay dataset


title: Signature of anyonic statistics in the integer quantum Hall regime

abstract: Anyons are exotic low-dimensional quasiparticles whose unconventional quantum statistics extends the binary particle division into fermions and bosons. The fractional quantum Hall regime provides a natural host, with first convincing anyon signatures recently observed through interferometry and cross-correlations of colliding beams. However, the fractional regime is rife with experimental complications, such as an anomalous tunneling density of states, which impede the manipulation of anyons. Here we show experimentally that the canonical integer quantum Hall regime can provide a robust anyon platform. Exploiting the Coulomb interaction between two co-propagating quantum Hall channels, an electron injected into one channel splits into two fractional charges behaving as abelian anyons. Their unconventional statistics is revealed by negative cross-correlations between dilute quasiparticle beams. Similarly to fractional quantum Hall observations, we show that the negative signal stems from a time-domain braiding process, here involving the incident fractional quasiparticles and spontaneously generated electron-hole pairs. Beyond the dilute limit, a theoretical understanding is achieved via the edge magnetoplasmon description of interacting integer quantum Hall channels. Our findings establish that, counter-intuitively, the integer quantum Hall regime provides a platform of choice for exploring and manipulating quasiparticles with fractional quantum statistics.


title: Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses

abstract: Neural operators, which can act as implicit solution operators of hidden governing equations, have recently become popular tools for learning the responses of complex real-world physical systems. Nevertheless, most neural operator applications have thus far been data-driven and neglect the intrinsic preservation of fundamental physical laws in data. In this work, we introduce a novel integral neural operator architecture called the Peridynamic Neural Operator (PNO) that learns a nonlocal constitutive law from data. This neural operator provides a forward model in the form of state-based peridynamics, with objectivity and momentum balance laws automatically guaranteed. As applications, we demonstrate the expressivity and efficacy of our model in learning complex material behaviors from both synthetic and experimental data sets. We show that, owing to its ability to capture complex responses, our learned neural operator achieves improved accuracy and efficiency compared to baseline models that use predefined constitutive laws. Moreover, by preserving the essential physical laws within the neural network architecture, the PNO is robust in treating noisy data. The method shows generalizability to different domain configurations, external loadings, and discretizations.


title: GroundingGPT:Language Enhanced Multi-modal Grounding Model

abstract: Multi-modal large language models have demonstrated impressive performance across various tasks in different modalities. However, existing multi-modal models primarily emphasize capturing global information within each modality while neglecting the importance of perceiving local information across modalities. Consequently, these models lack the ability to effectively understand the fine-grained details of input data, limiting their performance in tasks that require a more nuanced understanding. To address this limitation, there is a compelling need to develop models that enable fine-grained understanding across multiple modalities, thereby enhancing their applicability to a wide range of tasks. In this paper, we propose GroundingGPT, a language enhanced multi-modal grounding model. Beyond capturing global information like other multi-modal models, our proposed model excels at tasks demanding a detailed understanding of local information within the input. It demonstrates precise identification and localization of specific regions in images or moments in videos. To achieve this objective, we design a diversified dataset construction pipeline, resulting in a multi-modal, multi-granularity dataset for model training. The code, dataset, and demo of our model can be found at https: //github.com/lzw-lzw/GroundingGPT.


title: Chain of History: Learning and Forecasting with LLMs for Temporal Knowledge Graph Completion

abstract: Temporal Knowledge Graph Completion (TKGC) is a complex task involving the prediction of missing event links at future timestamps by leveraging established temporal structural knowledge. This paper aims to provide a comprehensive perspective on harnessing the advantages of Large Language Models (LLMs) for reasoning in temporal knowledge graphs, presenting an easily transferable pipeline. In terms of graph modality, we underscore the LLMs' prowess in discerning the structural information of pivotal nodes within the historical chain. As for the generation mode of the LLMs utilized for inference, we conduct an exhaustive exploration into the variances induced by a range of inherent factors in LLMs, with particular attention to the challenges in comprehending reverse logic. We adopt a parameter-efficient fine-tuning strategy to harmonize the LLMs with the task requirements, facilitating the learning of the key knowledge highlighted earlier. Comprehensive experiments are undertaken on several widely recognized datasets, revealing that our framework exceeds or parallels existing methods across numerous popular metrics. Additionally, we execute a substantial range of ablation experiments and draw comparisons with several advanced commercial LLMs, to investigate the crucial factors influencing LLMs' performance in structured temporal knowledge inference tasks.


title: Invariance principle for the KPZ equation arising in stochastic flows of kernels

abstract: We consider a generalized model of random walk in dynamical random environment, and we show that the multiplicative-noise stochastic heat equation (SHE) describes the fluctuations of the quenched density at a certain precise location in the tail. The distribution of transition kernels is fixed rather than changing under the diffusive rescaling of space-time, i.e., there is no critical tuning of the model parameters when scaling to the stochastic PDE limit. The proof is done by pushing the methods developed in [arxiv 2304.14279, arXiv 2311.09151] to their maximum, substantially weakening the assumptions and obtaining fairly sharp conditions under which one expects to see the SHE arise in a wide variety of random walk models in random media. In particular we are able to get rid of conditions such as nearest-neighbor interaction as well as spatial independence of quenched transition kernels. Moreover, we observe an entire hierarchy of moderate deviation exponents at which the SHE can be found, confirming a physics prediction of J. Hass.


title: On the Albanese morphism of varieties with Frobenius stable Kodaira dimension zero

abstract: We show that in positive characteristic, the Albanese morphism of normal proper varieties $X$ with $\kappa_S(X, \omega_X) = 0$ is separable, surjective, has connected fibers, and the generic fiber $F$ also satisfies $\kappa(F, \omega_F) = 0$. As a corollary, we deduce a new case of Iitaka's subadditivity conjecture for fibrations over abelian varieties, when the generic fiber has non-nilpotent Hasse-Witt matrix.


title: Modeling the Asymptotic Behavior of Higher-Order Aftershocks with Deep Learning

abstract: Aftershocks of aftershocks - and their aftershock cascades - substantially contribute to the increased seismicity rate and the associated elevated seismic hazard after the occurrence of a large earthquake. Current state-of-the-art earthquake forecasting models therefore describe earthquake occurrence using self-exciting point processes, where events can recursively trigger more events according to empirical laws. To estimate earthquake probabilities within future time horizons of interest, a large number of possible realizations of a process are simulated, which is typically associated with long computation times that increase with the desired resolution of the forecast in space, time, or magnitude range. We here propose a machine learning approach to estimate the temporal evolution of the rate of higher-order aftershocks. For this, we train a deep neural network to predict the output of the simulation-based approach, given a parametric description of the rate of direct aftershocks. A comparison of the two approaches reveals that they perform very similarly in describing synthetic datasets generated with the simulation-based approach. Our method has two major benefits over the traditional approach. It is faster by several orders of magnitude, and it is not susceptible to being influenced by the presence or absence of individual `extreme' realizations of the process, and thus enables accurate earthquake forecasting in near-real-time.


title: Wireless Ear EEG to Monitor Drowsiness

abstract: Neural wearables can enable life-saving drowsiness and health monitoring for pilots and drivers. While existing in-cabin sensors may provide alerts, wearables can enable monitoring across more environments. Current neural wearables are promising but most require wet-electrodes and bulky electronics. This work showcases in-ear, dry-electrode earpieces used to monitor drowsiness with compact hardware. The employed system integrates additive-manufacturing for dry, user-generic earpieces, existing wireless electronics, and offline classification algorithms. Thirty-five hours of electrophysiological data were recorded across nine subjects performing drowsiness-inducing tasks. Three classifier models were trained with user-specific, leave-one-trial-out, and leave-one-user-out splits. The support-vector-machine classifier achieved an accuracy of 93.2% while evaluating users it has seen before and 93.3% when evaluating a never-before-seen user. These results demonstrate wireless, dry, user-generic earpieces used to classify drowsiness with comparable accuracies to existing state-of-the-art, wet electrode in-ear and scalp systems. Further, this work illustrates the feasibility of population-trained classification in future electrophysiological applications.


title: Lepton pair production in muon-nucleus scattering

abstract: The MUonE experiment aims at providing a novel determination of the leading hadronic contribution to the muon anomalous magnetic moment through the study of elastic muon-electron scattering. Since the initial-state electrons are bound in a low-$Z$ atomic target, the interaction between the incoming muons and the nuclei is expected to be the main source of experimental background. In this article, we study the production of a real lepton pair from the muon-nucleus scattering, discussing its numerical impact in the MUonE kinematic configuration. The process is described as a scattering of a muon in an external Coulomb field with the addition of a form factor to describe the nuclear charge distribution. The calculation is implemented in the fully differential Monte Carlo event generator MESMER, without introducing any approximation on the angular variables.


title: Twisted TMDs in the small-angle limit: exponentially flat and trivial bands

abstract: Recent experiments discovered fractional Chern insulator states at zero magnetic field in twisted bilayer MoTe$_2$ [C23,Z23] and WSe$_2$ [MD23]. In this article, we study the MacDonald Hamiltonian for twisted transition metal dichalcogenides (TMDs) and analyze the low-lying spectrum in TMDs in the limit of small twisting angles. Unlike in twisted bilayer graphene Hamiltonians, we show that TMDs do not exhibit flat bands. The flatness in TMDs for small twisting angles is due to spatial confinement by a matrix-valued potential. We show that by generalizing semiclassical techniques developed by Simon [Si83] and Helffer-Sj\"ostrand [HS84] to matrix-valued potentials, there exists a wide range of model parameters such that the low-lying bands are of exponentially small width in the twisting angle, topologically trivial, and obey a harmonic oscillator-type spacing with explicit parameters.

categories: math-ph cond-mat.mes-hall cond-mat.str-el math.AP math.MP math.SP


title: Nanofluidic platform for studying the first-order phase transitions in superfluid helium-3

abstract: The symmetry-breaking first-order phase transition between superfluid phases $^3$He-A and $^3$He-B can be triggered extrinsically by ionising radiation or heterogeneous nucleation arising from the details of the sample cell construction. However, the role of potential homogeneous intrinsic nucleation mechanisms remains elusive. Discovering and resolving the intrinsic processes may have cosmological consequences, since an analogous first-order phase transition, and the production of gravitational waves, has been predicted for the very early stages of the expanding Universe in many extensions of the Standard Model of particle physics. Here we introduce a new approach for probing the phase transition in superfluid $^3$He. The setup consists of a novel stepped-height nanofluidic sample container with close to atomically smooth walls. The $^3$He is confined in five tiny nanofabricated volumes and assayed non-invasively by NMR. Tuning of the state of $^3$He by confinement is used to isolate each of these five volumes so that the phase transitions in them can occur independently and free from any obvious sources of heterogeneous nucleation. The small volumes also ensure that the transitions triggered by ionising radiation are strongly suppressed. Here we present the preliminary measurements using this setup, showing both strong supercooling of $^3$He-A and superheating of $^3$He-B, with stochastic processes dominating the phase transitions between the two. The objective is to study the nucleation as a function of temperature and pressure over the full phase diagram, to both better test the proposed extrinsic mechanisms and seek potential parallel intrinsic mechanisms.

categories: cond-mat.supr-con astro-ph.CO cond-mat.mes-hall cond-mat.quant-gas cond-mat.stat-mech physics.ins-det


title: Secrets of RLHF in Large Language Models Part II: Reward Modeling

abstract: Reinforcement Learning from Human Feedback (RLHF) has become a crucial technology for aligning language models with human values and intentions, enabling models to produce more helpful and harmless responses. Reward models are trained as proxies for human preferences to drive reinforcement learning optimization. While reward models are often considered central to achieving high performance, they face the following challenges in practical applications: (1) Incorrect and ambiguous preference pairs in the dataset may hinder the reward model from accurately capturing human intent. (2) Reward models trained on data from a specific distribution often struggle to generalize to examples outside that distribution and are not suitable for iterative RLHF training. In this report, we attempt to address these two issues. (1) From a data perspective, we propose a method to measure the strength of preferences within the data, based on a voting mechanism of multiple reward models. Experimental results confirm that data with varying preference strengths have different impacts on reward model performance. We introduce a series of novel methods to mitigate the influence of incorrect and ambiguous preferences in the dataset and fully leverage high-quality preference data. (2) From an algorithmic standpoint, we introduce contrastive learning to enhance the ability of reward models to distinguish between chosen and rejected responses, thereby improving model generalization. Furthermore, we employ meta-learning to enable the reward model to maintain the ability to differentiate subtle differences in out-of-distribution samples, and this approach can be utilized for iterative RLHF optimization.


title: Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint

abstract: Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is unable to provide fine-grained supervision for complex reasoning tasks, and can not focus on the few key tokens that lead to the incorrectness. To address it, we propose a new RL method named RLMEC that incorporates a generative model as the reward model, which is trained by the erroneous solution rewriting task under the minimum editing constraint, and can produce token-level rewards for RL training. Based on the generative reward model, we design the token-level RL objective for training and an imitation-based regularization for stabilizing RL process. And the both objectives focus on the learning of the key tokens for the erroneous solution, reducing the effect of other unimportant tokens. The experiment results on mathematical tasks and question-answering tasks have demonstrated the effectiveness of our approach. Our code and data are available at https://github.com/RUCAIBox/RLMEC.


title: Borrowing from historical control data in a Bayesian time-to-event model with flexible baseline hazard function

abstract: There is currently a focus on statistical methods which can use historical trial information to help accelerate the discovery, development and delivery of medicine. Bayesian methods can be constructed so that the borrowing is "dynamic" in the sense that the similarity of the data helps to determine how much information is used. In the time to event setting with one historical data set, a popular model for a range of baseline hazards is the piecewise exponential model where the time points are fixed and a borrowing structure is imposed on the model. Although convenient for implementation this approach effects the borrowing capability of the model. We propose a Bayesian model which allows the time points to vary and a dependency to be placed between the baseline hazards. This serves to smooth the posterior baseline hazard improving both model estimation and borrowing characteristics. We explore a variety of prior structures for the borrowing within our proposed model and assess their performance against established approaches. We demonstrate that this leads to improved type I error in the presence of prior data conflict and increased power. We have developed accompanying software which is freely available and enables easy implementation of the approach.


title: Endpoint estimates for higher order Marcinkiewicz multipliers

abstract: We consider Marcinkiewicz multipliers of any lacunary order defined by means of uniformly bounded variation on each lacunary Littlewood-Paley interval of some fixed order $\tau\geq 1$. We prove the optimal endpoint bounds for such multipliers as a corollary of a more general endpoint estimate for a class of multipliers introduced by Coifman, Rubio de Francia and Semmes and further studied by Tao and Wright. Our methods also yield the best possible endpoint mapping property for higher order H\"ormander-Mihlin multipliers, namely multipliers which are singular on every point of a lacunary set of order $\tau$. These results can be considered as endpoint versions of corresponding results of Sj\"ogren and Sj\"olin. Finally our methods generalize a weak square function characterization of the space $L\log^{1/2}L$ in terms of a square function introduced by Tao and Wright: we realize such a weak characterization as the dual of the Chang-Wilson-Wolff inequality, thus giving corresponding weak square function characterizations for the spaces $L\log^{\tau/2}L$ for general integer orders $\tau\geq 1$.


title: Post-Newtonian effects in compact binaries with a dark matter spike: A Lagrangian approach

abstract: We present a simple but powerful Lagrangian method that can be used to study the post-Newtonian evolution of a compact binary system with environment, including a dark matter spike, around it, and obtain the resulting gravitational wave emission. This formalism allows one to incorporate post-Newtonian effects up to any desired known order, as well as any other environmental effect around the binary, as long as their dissipation power or force formulae are known. In particular, in this work, we employ this method to study a black hole-black hole binary system of mass ratio $10^5$, by including post-Newtonian effects of order 1PN and 2.5PN as well as the effect of relativistic dynamical friction. We obtain the modified orbits and the corresponding modified gravitational waveform. Finally, we contrast these modifications against the LISA sensitivity curve in frequency space and show that this observatory can detect the associated signals.


title: On the stabilizer of the graph of linear functions over finite fields

abstract: In this paper we will study the action of $\mathbb{F}_{q^n}^{2 \times 2}$ on the graph of an $\mathbb{F}_q$-linear function of $\mathbb{F}_{q^n}$ into itself. In particular we will see that, under certain combinatorial assumptions, its stabilizer (together with the sum and product of matrices) is a field. We will also see some examples for which this does not happen. Moreover, we will establish a connection between such a stabilizer and the right idealizer of the rank-metric code defined by the linear function and give some structural results in the case in which the polynomials are partially scattered.


title: XGBoost Learning of Dynamic Wager Placement for In-Play Betting on an Agent-Based Model of a Sports Betting Exchange

abstract: We present first results from the use of XGBoost, a highly effective machine learning (ML) method, within the Bristol Betting Exchange (BBE), an open-source agent-based model (ABM) designed to simulate a contemporary sports-betting exchange with in-play betting during track-racing events such as horse races. We use the BBE ABM and its array of minimally-simple bettor-agents as a synthetic data generator which feeds into our XGBoost ML system, with the intention that XGBoost discovers profitable dynamic betting strategies by learning from the more profitable bets made by the BBE bettor-agents. After this XGBoost training, which results in one or more decision trees, a bettor-agent with a betting strategy determined by the XGBoost-learned decision tree(s) is added to the BBE ABM and made to bet on a sequence of races under various conditions and betting-market scenarios, with profitability serving as the primary metric of comparison and evaluation. Our initial findings presented here show that XGBoost trained in this way can indeed learn profitable betting strategies, and can generalise to learn strategies that outperform each of the set of strategies used for creation of the training data. To foster further research and enhancements, the complete version of our extended BBE, including the XGBoost integration, has been made freely available as an open-source release on GitHub.


title: Probing the Diversity of Type Ia Supernova Light Curves in the Open Supernova Catalog

abstract: The ever-growing sample of observed supernovae enhances our capacity for comprehensive supernova population studies, providing a richer dataset for understanding the diverse characteristics of Type Ia supernovae and possibly that of their progenitors. Here, we present a data-driven analysis of observed Type Ia supernova photometric light curves collected in the Open Supernova Catalog. Where available, we add the environmental information from the host galaxy. We focus on identifying sub-classes of Type Ia supernovae without imposing the pre-defined sub-classes found in the literature to date. To do so, we employ an implicit-rank minimizing autoencoder neural network for developing low-dimensional data representations, providing a compact representation of the supernova light curve diversity. When we analyze light curves alone, we find that one of our resulting latent variables is strongly correlated with redshift, allowing us to approximately ``de-redshift'' the other latent variables describing each event. After doing so, we find that three of our latent variables account for $\sim$95\% of the variance in our sample, and provide a natural separation between 91T and 91bg thermonuclear supernovae. Of note, the 02cx subclass is not unambiguously delineated from the 91bg sample in our results, nor do either the over-luminous 91T or the under-luminous 91bg/02cx samples form a clearly distinct population from the broader sample of ``other'' SN Ia events. We identify the physical characteristics of supernova light curves which best distinguish SNe 91T from SNe 91bg \& 02cx, and discuss prospects for future refinements and applications to other classes of supernovae as well as other transients.