title: Explicit numerical approximations for McKean-Vlasov stochastic differential equations in finite and infinite time

abstract: By using the stochastic particle method, the truncated Euler-Maruyama (TEM) method is proposed for numerically solving McKean-Vlasov stochastic differential equations (MV-SDEs), possibly with both drift and diffusion coefficients having super-linear growth in the state variable. Firstly, the result of the propagation of chaos in the L^q (q\geq 2) sense is obtained under general assumptions. Then, the standard 1/2-order strong convergence rate in the L^q sense of the proposed method corresponding to the particle system is derived by utilizing the stopping time analysis technique. Furthermore, long-time dynamical properties of MV-SDEs, including the moment boundedness, stability, and the existence and uniqueness of the invariant probability measure, can be numerically realized by the TEM method. Additionally, it is proven that the numerical invariant measure converges to the underlying one of MV-SDEs in the L^2-Wasserstein metric. Finally, the conclusions obtained in this paper are verified through examples and numerical simulations.


title: Efficient Parameter Optimisation for Quantum Kernel Alignment: A Sub-sampling Approach in Variational Training

abstract: Quantum machine learning with quantum kernels for classification problems is a growing area of research. Recently, quantum kernel alignment techniques that parameterise the kernel have been developed, allowing the kernel to be trained and therefore aligned with a specific dataset. While quantum kernel alignment is a promising technique, it has been hampered by considerable training costs because the full kernel matrix must be constructed at every training iteration. Addressing this challenge, we introduce a novel method that seeks to balance efficiency and performance. We present a sub-sampling training approach that uses a subset of the kernel matrix at each training step, thereby reducing the overall computational cost of the training. In this work, we apply the sub-sampling method to synthetic datasets and a real-world breast cancer dataset and demonstrate considerable reductions in the number of circuits required to train the quantum kernel while maintaining classification accuracy.


title: Lotto: Secure Participant Selection against Adversarial Servers in Federated Learning

abstract: In Federated Learning (FL), common privacy-enhancing techniques, such as secure aggregation and distributed differential privacy, rely on the critical assumption of an honest majority among participants to withstand various attacks. In practice, however, servers are not always trusted, and an adversarial server can strategically select compromised clients to create a dishonest majority, thereby undermining the system's security guarantees. In this paper, we present Lotto, an FL system that addresses this fundamental, yet underexplored issue by providing secure participant selection against an adversarial server. Lotto supports two selection algorithms: random and informed. To ensure random selection without a trusted server, Lotto enables each client to autonomously determine their participation using verifiable randomness. For informed selection, which is more vulnerable to manipulation, Lotto approximates the algorithm by employing random selection within a refined client pool. Our theoretical analysis shows that Lotto effectively aligns the proportion of server-selected compromised participants with the base rate of dishonest clients in the population. Large-scale experiments further reveal that Lotto achieves time-to-accuracy performance comparable to that of insecure selection methods, indicating a low computational overhead for secure selection.


title: The outflow of the protostar in B335: I

abstract: The isolated globule B335 contains a single, low luminosity Class 0 protostar associated with a bipolar nebula and outflow system seen nearly perpendicular to its axis. We observed the innermost regions of this outflow as part of JWST/NIRCam GTO program 1187, primarily intended for wide-field slitless spectroscopy of background stars behind the globule. We find a system of expanding shock fronts with kinematic ages of only a few decades emerging symmetrically from the position of the embedded protostar, which is not directly detected at NIRCam wavelengths. The innermost and youngest of the shock fronts studied here shows strong emission from CO. The next older shock front shows less CO and the third shock front shows only H_2 emission in our data. This third and most distant of these inner shock fronts shows substantial evolution of its shape since it was last observed with high spatial resolution in 1996 with Keck/NIRC. This may be evidence of a faster internal shock catching up with a slower one and of the two shocks merging.


title: SpatialVisVR: An Immersive, Multiplexed Medical Image Viewer With Contextual Similar-Patient Search

abstract: In contemporary pathology, multiplexed immunofluorescence (mIF) and multiplex immunohistochemistry (mIHC) present both significant opportunities and challenges. These methodologies shed light on intricate tumor microenvironment interactions, emphasizing the need for intuitive visualization tools to analyze vast biological datasets effectively. As electronic health records (EHR) proliferate and physicians face increasing information overload, the integration of advanced technologies becomes imperative. SpatialVisVR emerges as a versatile VR platform tailored for comparing medical images, with adaptability for data privacy on embedded hardware. Clinicians can capture pathology slides in real-time via mobile devices, leveraging SpatialVisVR's deep learning algorithm to match and display similar mIF images. This interface supports the manipulation of up to 100 multiplexed protein channels, thereby assisting in immuno-oncology decision-making. Ultimately, SpatialVisVR aims to streamline diagnostic processes, advocating for a comprehensive and efficient approach to immuno-oncology research and treatment.


title: iPolicy: Incremental Policy Algorithms for Feedback Motion Planning

abstract: This paper presents policy-based motion planning for robotic systems. The motion planning literature has been mostly focused on open-loop trajectory planning which is followed by tracking online. In contrast, we solve the problem of path planning and controller synthesis simultaneously by solving the related feedback control problem. We present a novel incremental policy (iPolicy) algorithm for motion planning, which integrates sampling-based methods and set-valued optimal control methods to compute feedback controllers for the robotic system. In particular, we use sampling to incrementally construct the state space of the system. Asynchronous value iterations are performed on the sampled state space to synthesize the incremental policy feedback controller. We show the convergence of the estimates to the optimal value function in continuous state space. Numerical results with various different dynamical systems (including nonholonomic systems) verify the optimality and effectiveness of iPolicy.


title: MsDC-DEQ-Net: Deep Equilibrium Model (DEQ) with Multi-scale Dilated Convolution for Image Compressive Sensing (CS)

abstract: Compressive sensing (CS) is a technique that enables the recovery of sparse signals using fewer measurements than traditional sampling methods. To address the computational challenges of CS reconstruction, our objective is to develop an interpretable and concise neural network model for reconstructing natural images using CS. We achieve this by mapping one step of the iterative shrinkage thresholding algorithm (ISTA) to a deep network block, representing one iteration of ISTA. To enhance learning ability and incorporate structural diversity, we integrate aggregated residual transformations (ResNeXt) and squeeze-and-excitation (SE) mechanisms into the ISTA block. This block serves as a deep equilibrium layer, connected to a semi-tensor product network (STP-Net) for convenient sampling and providing an initial reconstruction. The resulting model, called MsDC-DEQ-Net, exhibits competitive performance compared to state-of-the-art network-based methods. It significantly reduces storage requirements compared to deep unrolling methods, using only one iteration block instead of multiple iterations. Unlike deep unrolling models, MsDC-DEQ-Net can be iteratively used, gradually improving reconstruction accuracy while considering computation trade-offs. Additionally, the model benefits from multi-scale dilated convolutions, further enhancing performance.


title: Dynamical mass of the Ophiuchus intermediate-mass stellar system S1 with DYNAMO-VLBA

abstract: We report dynamical mass measurements of the individual stars in the most luminous and massive stellar member of the nearby Ophiuchus star-forming region, the young tight binary system S1. We combine 28 archival datasets with seven recent, proprietary VLBA observations obtained as part of the \textit{Dynamical Masses of Young Stellar Multiple Systems with the VLBA} project (DYNAMO--VLBA), to constrain the astrometric and orbital parameters of the system, and recover high accuracy dynamical masses. The primary component, S1A, is found to have a mass of 4.11$\pm$0.10~M$_\odot$, significantly less than the typical value, $\sim$~6~M$_\odot$ previously reported in the literature. We show that the spectral energy distribution of S1A can be reproduced by a reddened blackbody with a temperature between roughly 14,000~K and 17,000~K. According to evolutionary models, this temperature range corresponds to stellar masses between 4~M$_\odot$ and 6~M$_\odot$ so the SED is not a priori inconsistent with the dynamical mass of S1A. The luminosity of S1 derived from SED-fitting, however, is only consistent with models for stellar masses above 5~M$_\odot$. Thus, we cannot reconcile the evolutionary models with the dynamical mass measurement of S1A: the models consistent with the location of S1A in the HR diagram correspond to masses at least 25\% higher than the dynamical mass. For the secondary component, S1B, a mass of 0.831~$\pm$~0.014~M$_\odot $ is determined, consistent with a low-mass young star. While the radio flux of S1A remains roughly constant throughout the orbit, the flux of S1B is found to be higher near the apastron.


title: Violation of LGtI inequalities in the light of NO$\nu$A and T2K anomaly

abstract: The recent anomaly observed in NO$\nu$A and T2K experiments, in standard three-flavor neutrino oscillation could potentially signal physics extending beyond the standard model (SM). For the NSI parameters that can accommodate this anomaly, we explore the violation of Leggett-Garg type inequalities (LGtI) within the context of three-flavor neutrino oscillations. Our analysis focuses on LGtI violations in scenarios involving complex NSI with $\epsilon_{e\mu}$ or $\epsilon_{e\tau}$ coupling in long baseline accelerator experiments for normal and inverted mass ordering. LGtI violation is significantly enhanced in normal ordering (NO) for $\epsilon_{e\tau}$ scenario, whereas it suppresses for $\epsilon_{e\mu}$ scenario for T2K, NO$\nu$A, and DUNE experiment set-up. We find that for inverted ordering (IO), in the DUNE experimental set-up above $6$ GeV, the LGtI violation can be an indication of $\epsilon_{e\tau}$ new physics scenario.


title: Quantum criticality in chains of planar rotors with dipolar interactions

abstract: In this contribution we perform a density matrix renormalization group study of chains of planar rotors interacting via dipolar interactions. By exploring the ground state from weakly to strongly interacting rotors, we find the occurrence of a quantum phase transition between a disordered and a dipole-ordered quantum state. We show that the nature of the ordered state changes from ferroelectric to antiferroelectric when the relative orientation of the rotor planes varies and that this change requires no modification of the overall symmetry. The observed quantum phase transitions are characterized by critical exponents and central charges which reveal different universality classes ranging from that of the (1+1)D Ising model to the 2D classical XY model.

categories: physics.chem-ph cond-mat.stat-mech physics.atm-clus quant-ph


title: On the Selection of Intermediate Length Representative Periods for Capacity Expansion

abstract: As the decarbonization of power systems accelerates, there has been increasing interest in capacity expansion models for their role in guiding this transition. Representative period selection is an important component of capacity expansion modeling, enabling computational tractability of optimization while ensuring fidelity between the representative periods and the full year. However, little attention has been devoted to selecting representative periods longer than a single day. This prevents the capacity expansion model from directly simulating interday energy sharing, which is of key importance as energy generation becomes more variable and storage more important. To this end, we propose a novel method for selecting representative periods of any length. The method is validated using a capacity expansion model and production cost model based on California's decarbonization goals. We demonstrate that the representative period length has a substantial impact in the results of the capacity expansion investment plan.


title: Energy-Preserving Reduced Operator Inference for Efficient Design and Control

abstract: Many-query computations, in which a computational model for an engineering system must be evaluated many times, are crucial in design and control. For systems governed by partial differential equations (PDEs), typical high-fidelity numerical models are high-dimensional and too computationally expensive for the many-query setting. Thus, efficient surrogate models are required to enable low-cost computations in design and control. This work presents a physics-preserving reduced model learning approach that targets PDEs whose quadratic operators preserve energy, such as those arising in governing equations in many fluids problems. The approach is based on the Operator Inference method, which fits reduced model operators to state snapshot and time derivative data in a least-squares sense. However, Operator Inference does not generally learn a reduced quadratic operator with the energy-preserving property of the original PDE. Thus, we propose a new energy-preserving Operator Inference (EP-OpInf) approach, which imposes this structure on the learned reduced model via constrained optimization. Numerical results using the viscous Burgers' and Kuramoto-Sivashinksy equation (KSE) demonstrate that EP-OpInf learns efficient and accurate reduced models that retain this energy-preserving structure.


title: Nonlinear functional regression by functional deep neural network with kernel embedding

abstract: With the rapid development of deep learning in various fields of science and technology, such as speech recognition, image classification, and natural language processing, recently it is also widely applied in the functional data analysis (FDA) with some empirical success. However, due to the infinite dimensional input, we need a powerful dimension reduction method for functional learning tasks, especially for the nonlinear functional regression. In this paper, based on the idea of smooth kernel integral transformation, we propose a functional deep neural network with an efficient and fully data-dependent dimension reduction method. The architecture of our functional net consists of a kernel embedding step: an integral transformation with a data-dependent smooth kernel; a projection step: a dimension reduction by projection with eigenfunction basis based on the embedding kernel; and finally an expressive deep ReLU neural network for the prediction. The utilization of smooth kernel embedding enables our functional net to be discretization invariant, efficient, and robust to noisy observations, capable of utilizing information in both input functions and responses data, and have a low requirement on the number of discrete points for an unimpaired generalization performance. We conduct theoretical analysis including approximation error and generalization error analysis, and numerical simulations to verify these advantages of our functional net.


title: Polarisation of radio-frequency magnetic fields in magnetic induction measurements with an atomic magnetometer

abstract: We explore properties of the radio-frequency atomic magnetometer, specifically its sensitivity to the polarisation of an oscillating magnetic field. This aspect can be particularly relevant to configurations where the sensor monitors fields created by more than one source. The discussion, illustrated by theoretical and experimental studies, is done in the context of the signals produced by electrically conductive and magnetically permeable plates in magnetic induction tomography measurements. We show that different components of the secondary magnetic fields create the object response depending on the properties of the material, with the polarisation of the rf field varying across the object's surface. We argue that the ability of the sensor to simultaneously detect different field components enables the optimisation of measurement strategies for different object compositions.


title: Rational Approximation of Golden Angles: Accelerated Reconstructions with Simple and Numerically Reproducible Radial Sampling

abstract: Purpose: To develop a generic radial sampling scheme that combines the advantages of golden ratio sampling with simplicity of equidistant angular patterns. The irrational angle between consecutive spokes in golden ratio based sampling schemes enables a flexible retrospective choice of temporal resolution, while preserving good coverage of k-space for each individual bin. Nevertheless, irrational increments prohibit precomputation of the point-spread function (PSF), can lead to numerical problems, and require more complex processing steps. To avoid these problems, a new sampling scheme based on a rational approximation of golden angles (RAGA) is developed. Methods: The theoretical properties of RAGA sampling are mathematically derived. Sidelobe-to-peak ratios (SPR) are numerically computed and compared to the corresponding golden ratio sampling schemes. The sampling scheme is implemented in the BART toolbox and in a radial gradient-echo sequence. Feasibility is shown for quantitative imaging in a phantom and a cardiac scan of a healthy volunteer. Results: RAGA sampling can accurately approximate golden ratio sampling and has almost identical PSF and SPR. In contrast to golden ratio sampling, each frame can be reconstructed with the same equidistant trajectory using different sampling masks, and the angle of each acquired spoke can be encoded as a small index, which simplifies processing of the acquired data. Conclusion: RAGA sampling provides the advantages of golden ratio sampling while simplifying data processing, rendering it a valuable tool for dynamic and quantitative MRI.


title: Inversion Ring in Chromonic Twisted Hedgehogs: Theory and Experiment

abstract: Twisted hedgehogs are defects in spherical cavities with homeotropic anchoring for the nematic director that arise when twist distortions are sufficiently less energetic than splay (and bend) distortions. They bear a characteristic inversion ring, where the director texture changes the sense it spirals about the center of the cavity. This paper applies a quartic twist theory recently proposed to describe the elasticity of chromonics to explain a series of inversion rings observed in aqueous solutions of SSY at two different concentrations. The theory features a phenomenological length a, whose measure is extracted from the data and shown to be fairly independent of the cavity radius, as expected for a material constant.


title: A novel approach to cosmological particle production

abstract: In this work we present a novel approach to the study of cosmological particle production in asymptotically Minkowski spacetimes. We emphasize that it is possible to determine the amount of particle production by focusing on the mathematical properties of the mode function equations,i.e. their singularities and monodromies, sidestepping the need to solve those equations. We consider in detail creation of scalar and spin 1/2 particles in four dimensional asymptotically Minkowski flat FLRW spacetimes. We explain that when the mode function equation for scalar fields has only regular singular points, the corresponding scale factors are asymptotically Minkowski. For Dirac spin 1/2 fields, the requirement of mode function equations with only regular points is more restrictive, and picks up a subset of the aforementioned scale factors. For the scalar case, we argue that there are two different regimes of particle production; while most of the literature has focused on only one of these regimes, the other regime presents enhanced particle production. On the other hand, for Dirac fermions we find a single regime of particle production. Finally, we very briefly comment on the possibility of studying particle production in spacetimes that don't asymptote to Minkowski, by considering mode function equations with irregular singular points.


title: Knots in circle bundles are determined by their complements

abstract: We resolve a case of the oriented knot complement conjecture by showing that knots in an orientable circle bundle $N$ over a genus $g \geq 2$ surface $S$ are determined by their complements. We apply this to the setting of canonical knots in the unit and projective tangent bundles, which are knots that are the set of tangents to a closed curve on $S$. We show that canonical knots have homeomorphic complements if and only if their shadows differ by Reidemeister moves, (de)stabilizations, loops/cusps added by transvections, and mapping classes of $S$.


title: Particle-Wise Higher-Order SPH Field Approximation for DVR

abstract: When employing Direct Volume Rendering (DVR) for visualizing volumetric scalar fields, classification is generally performed on a piecewise constant or piecewise linear approximation of the field on a viewing ray. Smoothed Particle Hydrodynamics (SPH) data sets define volumetric scalar fields as the sum of individual particle contributions, at highly varying spatial resolution. We present an approach for approximating SPH scalar fields along viewing rays with piece-wise polynomial functions of higher order. This is done by approximating each particle contribution individually and then efficiently summing the results, thus generating a higher-order representation of the field with a resolution adapting to the data resolution in the volume.


title: Robust Bichromatic Classification using Two Lines

abstract: Given two sets $\mathit{R}$ and $\mathit{B}$ of at most $\mathit{n}$ points in the plane, we present efficient algorithms to find a two-line linear classifier that best separates the "red" points in $\mathit{R}$ from the "blue" points in $B$ and is robust to outliers. More precisely, we find a region $\mathit{W}_\mathit{B}$ bounded by two lines, so either a halfplane, strip, wedge, or double wedge, containing (most of) the blue points $\mathit{B}$, and few red points. Our running times vary between optimal $O(n\log n)$ and $O(n^4)$, depending on the type of region $\mathit{W}_\mathit{B}$ and whether we wish to minimize only red outliers, only blue outliers, or both.


title: Quasinormal modes of rapidly rotating Ellis-Bronnikov wormholes

abstract: We present for the first time a study of the quasinormal modes of rapidly rotating Ellis-Bronnikov wormholes in General Relativity. We compute the spectrum of the wormholes using a spectral decomposition of the metric perturbations on a numerical background. We focus on the $M_z=2,3$ sector of the perturbations, and show that the triple isospectrality of the symmetric and static Ellis-Bronnikov wormhole is broken due to rotation, giving rise to a much richer spectrum than the spectrum of Kerr black holes. We do not find any instabilities for $M_z=2,3$ perturbations.


title: Model predictive altitude and velocity control in ergodic potential field directed multi-UAV search

abstract: This research addresses the challenge of executing multi-UAV survey missions over diverse terrains characterized by varying elevations. The approach integrates advanced two-dimensional ergodic search technique with model predictive control of UAV altitude and velocity. Optimization of altitude and velocity is performed along anticipated UAV ground routes, considering multiple objectives and constraints. This yields a flight regimen tailored to the terrain, as well as the motion and sensing characteristics of the UAVs. The proposed UAV motion control strategy is assessed through simulations of realistic search missions and actual terrain models. Results demonstrate the successful integration of model predictive altitude and velocity control with a two-dimensional potential field-guided ergodic search. Adjusting UAV altitudes to near-ideal levels facilitates the utilization of sensing ranges, thereby enhancing the effectiveness of the search. Furthermore, the control algorithm is capable of real-time computation, encouraging its practical application in real-world scenarios.


title: New detailed characterization of the residual luminescence emitted by the GAGG:Ce scintillator crystals for the HERMES Pathfinder mission

abstract: The HERMES (High Energy Rapid Modular Ensemble of Satellites) Pathfinder mission aims to develop a constellation of nanosatellites to study astronomical transient sources, such as gamma-ray bursts, in the X and soft $\gamma$ energy range, exploiting a novel inorganic scintillator. This study presents the results obtained describing, with an empirical model, the unusually intense and long-lasting residual emission of the GAGG:Ce scintillating crystal after irradiating it with high energy protons (70 MeV) and ultraviolet light ($\sim$ 300 nm). From the model so derived, the consequences of this residual luminescence for the detector performance in operational conditions has been analyzed. It was demonstrated that the current generated by the residual emission peaks at 1-2 pA, thus ascertaining the complete compatibility of this detector with the HERMES Pathfinder nanosatellites.


title: Charged-current non-standard neutrino interactions at Daya Bay

abstract: The full data set of the Daya Bay reactor neutrino experiment is used to probe the effect of the charged current non-standard interactions (CC-NSI) on neutrino oscillation experiments. Two different approaches are applied and constraints on the corresponding CC-NSI parameters are obtained with the neutrino flux taken from the Huber-Mueller model with a $5\%$ uncertainty. For the quantum mechanics-based approach (QM-NSI), the constraints on the CC-NSI parameters $\epsilon_{e\alpha}$ and $\epsilon_{e\alpha}^{s}$ are extracted with and without the assumption that the effects of the new physics are the same in the production and detection processes, respectively. The approach based on the weak effective field theory (WEFT-NSI) deals with four types of CC-NSI represented by the parameters $[\varepsilon_{X}]_{e\alpha}$. For both approaches, the results for the CC-NSI parameters are shown for cases with various fixed values of the CC-NSI and the Dirac CP-violating phases, and when they are allowed to vary freely. We find that constraints on the QM-NSI parameters $\epsilon_{e\alpha}$ and $\epsilon_{e\alpha}^{s}$ from the Daya Bay experiment alone can reach the order $\mathcal{O}(0.01)$ for the former and $\mathcal{O}(0.1)$ for the latter, while for WEFT-NSI parameters $[\varepsilon_{X}]_{e\alpha}$, we obtain $\mathcal{O}(0.1)$ for both cases.


title: State Derivative Normalization for Continuous-Time Deep Neural Networks

abstract: The importance of proper data normalization for deep neural networks is well known. However, in continuous-time state-space model estimation, it has been observed that improper normalization of either the hidden state or hidden state derivative of the model estimate, or even of the time interval can lead to numerical and optimization challenges with deep learning based methods. This results in a reduced model quality. In this contribution, we show that these three normalization tasks are inherently coupled. Due to the existence of this coupling, we propose a solution to all three normalization challenges by introducing a normalization constant at the state derivative level. We show that the appropriate choice of the normalization constant is related to the dynamics of the to-be-identified system and we derive multiple methods of obtaining an effective normalization constant. We compare and discuss all the normalization strategies on a benchmark problem based on experimental data from a cascaded tanks system and compare our results with other methods of the identification literature.


title: Deep Reinforcement Learning for Local Path Following of an Autonomous Formula SAE Vehicle

abstract: With the continued introduction of driverless events to Formula:Society of Automotive Engineers (F:SAE) competitions around the world, teams are investigating all aspects of the autonomous vehicle stack. This paper presents the use of Deep Reinforcement Learning (DRL) and Inverse Reinforcement Learning (IRL) to map locally-observed cone positions to a desired steering angle for race track following. Two state-of-the-art algorithms not previously tested in this context: soft actor critic (SAC) and adversarial inverse reinforcement learning (AIRL), are used to train models in a representative simulation. Three novel reward functions for use by RL algorithms in an autonomous racing context are also discussed. Tests performed in simulation and the real world suggest that both algorithms can successfully train models for local path following. Suggestions for future work are presented to allow these models to scale to a full F:SAE vehicle.


title: Class-wise Generalization Error: an Information-Theoretic Analysis

abstract: Existing generalization theories of supervised learning typically take a holistic approach and provide bounds for the expected generalization over the whole data distribution, which implicitly assumes that the model generalizes similarly for all the classes. In practice, however, there are significant variations in generalization performance among different classes, which cannot be captured by the existing generalization bounds. In this work, we tackle this problem by theoretically studying the class-generalization error, which quantifies the generalization performance of each individual class. We derive a novel information-theoretic bound for class-generalization error using the KL divergence, and we further obtain several tighter bounds using the conditional mutual information (CMI), which are significantly easier to estimate in practice. We empirically validate our proposed bounds in different neural networks and show that they accurately capture the complex class-generalization error behavior. Moreover, we show that the theoretical tools developed in this paper can be applied in several applications beyond this context.


title: H2G2-Net: A Hierarchical Heterogeneous Graph Generative Network Framework for Discovery of Multi-Modal Physiological Responses

abstract: Discovering human cognitive and emotional states using multi-modal physiological signals draws attention across various research applications. Physiological responses of the human body are influenced by human cognition and commonly used to analyze cognitive states. From a network science perspective, the interactions of these heterogeneous physiological modalities in a graph structure may provide insightful information to support prediction of cognitive states. However, there is no clue to derive exact connectivity between heterogeneous modalities and there exists a hierarchical structure of sub-modalities. Existing graph neural networks are designed to learn on non-hierarchical homogeneous graphs with pre-defined graph structures; they failed to learn from hierarchical, multi-modal physiological data without a pre-defined graph structure. To this end, we propose a hierarchical heterogeneous graph generative network (H2G2-Net) that automatically learns a graph structure without domain knowledge, as well as a powerful representation on the hierarchical heterogeneous graph in an end-to-end fashion. We validate the proposed method on the CogPilot dataset that consists of multi-modal physiological signals. Extensive experiments demonstrate that our proposed method outperforms the state-of-the-art GNNs by 5%-20% in prediction accuracy.


title: MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance

abstract: The deployment of multimodal large language models (MLLMs) has brought forth a unique vulnerability: susceptibility to malicious attacks through visual inputs. This paper investigates the novel challenge of defending MLLMs against such attacks. Compared to large language models (LLMs), MLLMs include an additional image modality. We discover that images act as a ``foreign language" that is not considered during safety alignment, making MLLMs more prone to producing harmful responses. Unfortunately, unlike the discrete tokens considered in text-based LLMs, the continuous nature of image signals presents significant alignment challenges, which poses difficulty to thoroughly cover all possible scenarios. This vulnerability is exacerbated by the fact that most state-of-the-art MLLMs are fine-tuned on limited image-text pairs that are much fewer than the extensive text-based pretraining corpus, which makes the MLLMs more prone to catastrophic forgetting of their original abilities during safety fine-tuning. To tackle these challenges, we introduce MLLM-Protector, a plug-and-play strategy that solves two subtasks: 1) identifying harmful responses via a lightweight harm detector, and 2) transforming harmful responses into harmless ones via a detoxifier. This approach effectively mitigates the risks posed by malicious visual inputs without compromising the original performance of MLLMs. Our results demonstrate that MLLM-Protector offers a robust solution to a previously unaddressed aspect of MLLM security.


title: Locally-homogeneous Riemann-Cartan geometries with the largest symmetry group

abstract: The symmetry frame formalism is an effective tool for computing the symmetries of a Riemann-Cartan geometry and, in particular, in metric teleparallel geometries. In the case of non-vanishing torsion in a four dimensional Riemann-Cartan geometry, the Minkowski geometry is the only geometry admitting ten affine frame symmetries. Excluding this almost trivial geometry, the maximal number of affine frame symmetries is seven. A natural question is to ask what four dimensional geometries admit a seven-dimensional group of affine frame symmetries. Such geometries are locally homogeneous and admit the largest isotropy group permitted, and hence are called maximally isotropic. Using the symmetry frame formalism to compute affine frame symmetries along with the additional structure of the torsion tensor, we employ the Cartan-Karlhede algorithm to determine all possible seven-dimensional symmetry groups for Riemann-Cartan geometries.


title: OSIRIS-GR: General relativistic activation of the polar cap of a compact neutron star

abstract: We present ab initio global general-relativistic Particle-in-cell (GR-PIC) simulations of compact millisecond neutron star magnetospheres in the axisymmetric aligned rotator configuration. We investigate the role of GR and plasma supply on the polar cap particle acceleration efficiency - the precursor of coherent radio emission - employing a new module for the PIC code OSIRIS, designed to model plasma dynamics around compact objects with fully self-consistent GR effects. We provide a detailed description of the main sub-algorithms of the novel PIC algorithm, including a charge-conserving current deposit scheme for curvilinear coordinates. We demonstrate efficient particle acceleration in the polar caps of compact neutron stars with denser magnetospheres, numerically validating the spacelike current extension provided by force-free models. We show that GR relaxes the minimum required poloidal magnetospheric current for the transition of the polar cap to the accelerator regime, thus justifying the observation of weak pulsars beyond the expected death line. We denote that spin-down luminosity intermittency and radio pulse nullings for older pulsars might arise from the interplay between the polar and outer gaps. Also, narrower radio beams are expected for weaker low-obliquity pulsars.


title: Introducing Bode: A Fine-Tuned Large Language Model for Portuguese Prompt-Based Task

abstract: Large Language Models (LLMs) are increasingly bringing advances to Natural Language Processing. However, low-resource languages, those lacking extensive prominence in datasets for various NLP tasks, or where existing datasets are not as substantial, such as Portuguese, already obtain several benefits from LLMs, but not to the same extent. LLMs trained on multilingual datasets normally struggle to respond to prompts in Portuguese satisfactorily, presenting, for example, code switching in their responses. This work proposes a fine-tuned LLaMA 2-based model for Portuguese prompts named Bode in two versions: 7B and 13B. We evaluate the performance of this model in classification tasks using the zero-shot approach with in-context learning, and compare it with other LLMs. Our main contribution is to bring an LLM with satisfactory results in the Portuguese language, as well as to provide a model that is free for research or commercial purposes.


title: K\"ahler metrics and toric Lagrangian fibrations

abstract: We extend the Abreu-Guillemin theory of invariant K\"ahler metrics from toric symplectic manifolds to any symplectic manifold admitting a toric action of a symplectic torus bundle. We show that these are precisely the symplectic manifolds admitting a Lagrangian fibration with elliptic singularities. The base of such a toric Lagrangian fibration is a codimension 0 submanifold with corners of an integral affine manifold, called a Delzant subspace. This concept generalizes the Delzant polytope associated with a compact symplectic toric manifold. Given a Delzant subspace of finite type, we provide a Delzant-type construction of a Lagrangian fibration with the moment image being the specified Delzant subspace. We establish a 1:1 correspondence between invariant K\"ahler metrics and a pair consisting of an elliptic connection on the total space of the fibration and a hybrid $b$-metric on the base Delzant subspace, both with specified residues over the facets. Finally, we characterize extremal invariant K\"ahler metrics as those whose scalar curvature descends to an affine function on the base integral affine manifold. We show that this provides a method for finding and constructing extremal K\"ahler metrics.


title: Lift-Connected Surface Codes

abstract: We use the recently introduced lifted product to construct a family of Quantum Low Density Parity Check Codes (QLDPC codes). The codes we obtain can be viewed as stacks of surface codes that are interconnected, leading to the name lift-connected surface (LCS) codes. LCS codes offer a wide range of parameters - a particularly striking feature is that they show interesting properties that are favorable compared to the standard surface code already at moderate numbers of physical qubits in the order of tens. We present and analyze the construction and provide numerical simulation results for the logical error rate under code capacity and phenomenological noise. These results show that LCS codes attain thresholds that are comparable to corresponding (non-connected) copies of surface codes, while the logical error rate can be orders of magnitude lower, even for representatives with the same parameters. This provides a code family showing the potential of modern product constructions at already small qubit numbers. Their amenability to 3D-local connectivity renders them particularly relevant for near-term implementations.


title: Decoding the thermal history of the merging cluster Cygnus A

abstract: We report on a detailed spatial and spectral analysis of the large-scale X-ray emission from the merging cluster Cygnus A. We use 2.2 Ms Chandra and 40 ks XMM-Newton archival datasets to determine the thermodynamic properties of the intracluster gas in the merger region between the two sub-clusters in the system. These profiles exhibit temperature enhancements that imply significant heating along the merger axis. Possible sources for this heating include the shock from the ongoing merger, past activity of the powerful AGN in the core, or a combination of both. To distinguish between these scenarios, we compare the observed X-ray properties of Cygnus A with simple, spherical cluster models. These models are constructed using azimuthally averaged density and temperature profiles determined from the undisturbed regions of the cluster and folded through MARX to produce simulated Chandra observations. The thermodynamic properties in the merger region from these simulated X-ray observations were used as a baseline for comparison with the actual observations. We identify two distinct components in the temperature structure along the merger axis, a smooth, large-scale temperature excess we attribute to the ongoing merger, and a series of peaks where the temperatures are enhanced by 0.5-2.5 keV. If these peaks are attributable to the central AGN, the location and strength of these features imply that Cygnus A has been active for the past 300 Myr injecting a total of $\sim$10$^{62}$ erg into the merger region. This corresponds to $\sim$10% of the energy deposited by the merger shock.


title: Plug-in Diffusion Model for Sequential Recommendation

abstract: Pioneering efforts have verified the effectiveness of the diffusion models in exploring the informative uncertainty for recommendation. Considering the difference between recommendation and image synthesis tasks, existing methods have undertaken tailored refinements to the diffusion and reverse process. However, these approaches typically use the highest-score item in corpus for user interest prediction, leading to the ignorance of the user's generalized preference contained within other items, thereby remaining constrained by the data sparsity issue. To address this issue, this paper presents a novel Plug-in Diffusion Model for Recommendation (PDRec) framework, which employs the diffusion model as a flexible plugin to jointly take full advantage of the diffusion-generating user preferences on all items. Specifically, PDRec first infers the users' dynamic preferences on all items via a time-interval diffusion model and proposes a Historical Behavior Reweighting (HBR) mechanism to identify the high-quality behaviors and suppress noisy behaviors. In addition to the observed items, PDRec proposes a Diffusion-based Positive Augmentation (DPA) strategy to leverage the top-ranked unobserved items as the potential positive samples, bringing in informative and diverse soft signals to alleviate data sparsity. To alleviate the false negative sampling issue, PDRec employs Noise-free Negative Sampling (NNS) to select stable negative samples for ensuring effective model optimization. Extensive experiments and analyses on four datasets have verified the superiority of the proposed PDRec over the state-of-the-art baselines and showcased the universality of PDRec as a flexible plugin for commonly-used sequential encoders in different recommendation scenarios. The code is available in https://github.com/hulkima/PDRec.


title: A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertainty

abstract: Exploration is a significant challenge in practical reinforcement learning (RL), and uncertainty-aware exploration that incorporates the quantification of epistemic and aleatory uncertainty has been recognized as an effective exploration strategy. However, capturing the combined effect of aleatory and epistemic uncertainty for decision-making is difficult. Existing works estimate aleatory and epistemic uncertainty separately and consider the composite uncertainty as an additive combination of the two. Nevertheless, the additive formulation leads to excessive risk-taking behavior, causing instability. In this paper, we propose an algorithm that clarifies the theoretical connection between aleatory and epistemic uncertainty, unifies aleatory and epistemic uncertainty estimation, and quantifies the combined effect of both uncertainties for a risk-sensitive exploration. Our method builds on a novel extension of distributional RL that estimates a parameterized return distribution whose parameters are random variables encoding epistemic uncertainty. Experimental results on tasks with exploration and risk challenges show that our method outperforms alternative approaches.


title: Contragredient Lie algebras in symmetric categories

abstract: We define contragredient Lie algebras in symmetric categories, generalizing the construction of Lie algebras of the form $\mathfrak{g}(A)$ for a Cartan matrix $A$ from the category of vector spaces to an arbitrary symmetric tensor category. The main complication resides in the fact that, in contrast to the classical case, a general symmetric tensor category can admit tori (playing the role of Cartan subalgebras) which are non-abelian and have a sophisticated representation theory. Using this construction, we obtain and describe new examples of Lie algebras in the universal Verlinde category in characteristic $p\geq5$. We also show that some previously known examples can be obtained with our construction.


title: Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction

abstract: Human trajectory forecasting is a critical challenge in fields such as robotics and autonomous driving. Due to the inherent uncertainty of human actions and intentions in real-world scenarios, various unexpected occurrences may arise. To uncover latent motion patterns in human behavior, we introduce a novel memory-based method, named Motion Pattern Priors Memory Network. Our method involves constructing a memory bank derived from clustered prior knowledge of motion patterns observed in the training set trajectories. We introduce an addressing mechanism to retrieve the matched pattern and the potential target distributions for each prediction from the memory bank, which enables the identification and retrieval of natural motion patterns exhibited by agents, subsequently using the target priors memory token to guide the diffusion model to generate predictions. Extensive experiments validate the effectiveness of our approach, achieving state-of-the-art trajectory prediction accuracy. The code will be made publicly available.


title: Bayesian changepoint detection via logistic regression and the topological analysis of image series

abstract: We present a Bayesian method for multivariate changepoint detection that allows for simultaneous inference on the location of a changepoint and the coefficients of a logistic regression model for distinguishing pre-changepoint data from post-changepoint data. In contrast to many methods for multivariate changepoint detection, the proposed method is applicable to data of mixed type and avoids strict assumptions regarding the distribution of the data and the nature of the change. The regression coefficients provide an interpretable description of a potentially complex change. For posterior inference, the model admits a simple Gibbs sampling algorithm based on P\'olya-gamma data augmentation. We establish conditions under which the proposed method is guaranteed to recover the true underlying changepoint. As a testing ground for our method, we consider the problem of detecting topological changes in time series of images. We demonstrate that the proposed method, combined with a novel topological feature embedding, performs well on both simulated and real image data.


title: Approximation Algorithms for the Weighted Nash Social Welfare via Convex and Non-Convex Programs

abstract: In an instance of the weighted Nash Social Welfare problem, we are given a set of $m$ indivisible items, $\mathscr{G}$, and $n$ agents, $\mathscr{A}$, where each agent $i \in \mathscr{A}$ has a valuation $v_{ij}\geq 0$ for each item $j\in \mathscr{G}$. In addition, every agent $i$ has a non-negative weight $w_i$ such that the weights collectively sum up to $1$. The goal is to find an assignment $\sigma:\mathscr{G}\rightarrow \mathscr{A}$ that maximizes $\prod_{i\in \mathscr{A}} \left(\sum_{j\in \sigma^{-1}(i)} v_{ij}\right)^{w_i}$, the product of the weighted valuations of the players. When all the weights equal $\frac1n$, the problem reduces to the classical Nash Social Welfare problem, which has recently received much attention. In this work, we present a $5\cdot\exp\left(2\cdot D_{\text{KL}}(\mathbf{w}\, ||\, \frac{\vec{\mathbf{1}}}{n})\right) = 5\cdot\exp\left(2\log{n} + 2\sum_{i=1}^n w_i \log{w_i}\right)$-approximation algorithm for the weighted Nash Social Welfare problem, where $D_{\text{KL}}(\mathbf{w}\, ||\, \frac{\vec{\mathbf{1}}}{n})$ denotes the KL-divergence between the distribution induced by $\mathbf{w}$ and the uniform distribution on $[n]$. We show a novel connection between the convex programming relaxations for the unweighted variant of Nash Social Welfare presented in \cite{cole2017convex, anari2017nash}, and generalize the programs to two different mathematical programs for the weighted case. The first program is convex and is necessary for computational efficiency, while the second program is a non-convex relaxation that can be rounded efficiently. The approximation factor derives from the difference in the objective values of the convex and non-convex relaxation.


title: Optimal strategy for trail running with nutrition and fatigue factors

abstract: This paper presents an extension of Keller's classical model to address the dynamics of long-distance trail running, a sport characterized by varying terrains, changing elevations, and the critical influence of in-race nutrition uptake. The optimization of the generalized Keller's model is achieved through rigorous application of optimal control theory, specifically the Pontryagin Maximum Principle. This theoretical framework allows us to derive optimal control strategies that enhance the runner's performance, taking into account the constraints imposed by the changing terrain, nutritional dynamics, and the evolving fatigue factor. To validate the practical applicability of the model, simulations are performed using real-world data obtained from various mountain races. The scenarios cover various trail conditions and elevation profiles. The performance of the model is systematically evaluated against these scenarios, demonstrating its ability to capture the complexities inherent in long-distance trail running and providing valuable insight into optimal race strategies. The error in the total race-time prediction is of the order of several percent, which may give the runner a reliable tool for choosing an optimal strategy before the actual race.


title: Analytically-Driven Resource Management for Cloud-Native Microservices

abstract: Resource management for cloud-native microservices has attracted a lot of recent attention. Previous work has shown that machine learning (ML)-driven approaches outperform traditional techniques, such as autoscaling, in terms of both SLA maintenance and resource efficiency. However, ML-driven approaches also face challenges including lengthy data collection processes and limited scalability. We present Ursa, a lightweight resource management system for cloud-native microservices that addresses these challenges. Ursa uses an analytical model that decomposes the end-to-end SLA into per-service SLA, and maps per-service SLA to individual resource allocations per microservice tier. To speed up the exploration process and avoid prolonged SLA violations, Ursa explores each microservice individually, and swiftly stops exploration if latency exceeds its SLA. We evaluate Ursa on a set of representative and end-to-end microservice topologies, including a social network, media service and video processing pipeline, each consisting of multiple classes and priorities of requests with different SLAs, and compare it against two representative ML-driven systems, Sinan and Firm. Compared to these ML-driven approaches, Ursa provides significant advantages: It shortens the data collection process by more than 128x, and its control plane is 43x faster than ML-driven approaches. At the same time, Ursa does not sacrifice resource efficiency or SLAs. During online deployment, Ursa reduces the SLA violation rate by 9.0% up to 49.9%, and reduces CPU allocation by up to 86.2% compared to ML-driven approaches.


title: Towards ASR Robust Spoken Language Understanding Through In-Context Learning With Word Confusion Networks

abstract: In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In real-world scenarios, prior to input into an LLM, an automated speech recognition (ASR) system generates an output transcript hypothesis, where inherent errors can degrade subsequent SLU tasks. Here we introduce a method that utilizes the ASR system's lattice output instead of relying solely on the top hypothesis, aiming to encapsulate speech ambiguities and enhance SLU outcomes. Our in-context learning experiments, covering spoken question answering and intent classification, underline the LLM's resilience to noisy speech transcripts with the help of word confusion networks from lattices, bridging the SLU performance gap between using the top ASR hypothesis and an oracle upper bound. Additionally, we delve into the LLM's robustness to varying ASR performance conditions and scrutinize the aspects of in-context learning which prove the most influential.


title: Computation of Fourier coefficients of automorphic forms of type $G_2$

abstract: In a recent work, we found formulas for the Fourier coefficients of automorphic forms of type $G_2$: holomorphic Siegel modular forms on $\mathrm{Sp}_6$ that are theta lifts from $G_2^c$, and cuspidal quaternionic modular forms on split $G_2$. We have implemented these formulas in the mathematical software SAGE. In this paper, we explain the formulas of our recent paper and the SAGE implementation. We also deduce some theoretical consequences of our SAGE computations.


title: On the optimality of the radical-pair quantum compass

abstract: Quantum sensing enables the ultimate precision attainable in parameter estimation. Circumstantial evidence suggests that certain organisms, most notably migratory songbirds, also harness quantum-enhanced magnetic field sensing via a radical-pair-based chemical compass for the precise detection of the weak geomagnetic field. However, what underpins the acuity of such a compass operating in a noisy biological setting, at physiological temperatures, remains an open question. Here, we address the fundamental limits of inferring geomagnetic field directions from radical-pair spin dynamics. Specifically, we compare the compass precision, as derived from the directional dependence of the radical-pair recombination yield, to the ultimate precision potentially realisable by a quantum measurement on the spin system under steady-state conditions. To this end, we probe the quantum Fisher information and associated Cram\'er--Rao bound in spin models of realistic complexity, accounting for complex inter-radical interactions, a multitude of hyperfine couplings, and asymmetric recombination kinetics, as characteristic for the magnetosensory protein cryptochrome. We compare several models implicated in cryptochrome magnetoreception and unveil their optimality through the precision of measurements ostensibly accessible to nature. Overall, the comparison provides insight into processes honed by nature to realise optimality whilst constrained to operating with mere reaction yields. Generally, the inference of compass orientation from recombination yields approaches optimality in the limits of complexity, yet plateaus short of the theoretical optimal precision bounds by up to one or two orders of magnitude, thus underscoring the potential for improving on design principles inherent to natural systems.


title: Mixing "Magnetic'' and "Electric'' Ehlers--Harrison transformations: The Electromagnetic Swirling Spacetime and Novel Type I Backgrounds

abstract: In this paper, we obtain a complete list of stationary and axisymmetric spacetimes, generated from a Minkowski spacetime using the Ernst technique. We do so by operating on the associated seed potentials with a composition of Ehlers and Harrison transformations. In particular, assigning an additional ``electric'' or ``magnetic'' tag to the transformations, we investigate the new spacetimes obtained either via a composition of magnetic Ehlers and Harrison transformations (first part) or via a magnetic-electric combination (second part). In the first part, the resulting type D spacetime, dubbed electromagnetic swirling universe, features key properties, separately found in swirling and (Bonnor--)Melvin spacetimes, the latter recovered in appropriate limits. A detailed analysis of the geometry is included, and subtle issues are addressed. A detailed proof that the spacetime belongs to the Kundt family, is included, and a notable relation to the planar-Reissner-Nordstr\"om-NUT black hole is also meticulously worked out. This relation is further exploited to reverse-engineer the form of the solution in the presence of a nontrivial cosmological constant. A Schwarzschild black hole embedded into the new background is also discussed. In the second part, we present four novel stationary and axisymmetric asymptotically nonflat type I spacetimes, which are naively expected to be extensions of the Melvin or swirling solution including a NUT parameter or electromagnetic charges. We actually find that they are, under conditions, free of curvature and topological singularities, with the physical meaning of the electric transformation parameters in these backgrounds requiring further investigation.


title: Hopf bracoids

abstract: The present article is devoted to introduce the notion of Hopf bracoid in the braided monoidal framework as the quantum version of skew bracoids, which have been presented by Martin-Lyons and Paul J. Truman. Taking into account that Hopf braces are particular examples of Hopf bracoids, in this paper we generalize many properties of Hopf braces to the Hopf bracoid setting and we obtain a categorical isomorphism between certain full subcategories of the Hopf bracoids category and the 1-cocycles category.


title: Searching for Bumps in the Cosmological Road: Do Type Ia Supernovae with Early Excesses Have Biased Hubble Residuals?

abstract: Flux excesses in the early time light curves of Type Ia supernovae (SNe\,Ia) are predicted by multiple theoretical models and have been observed in a number of nearby SNe\,Ia over the last decade. However, the astrophysical processes that cause these excesses may affect their use as standardizable candles for cosmological parameter measurements. In this paper, we perform a systematic search for early-time excesses in SNe\,Ia observed by the Zwicky Transient Facility (ZTF) to study whether SNe\,Ia with these excesses yield systematically different Hubble residuals. We analyze two compilations of ZTF SN\,Ia light curves from its first year of operations: 127 high-cadence light curves from \citet{Yao19} and 305 light curves from the ZTF cosmology data release of \citet{Dhawan22}. We detect significant early-time excesses for 17 SNe\,Ia in these samples and find that the excesses have an average $g-r$ color of $0.06\pm0.09$~mag; we do not find a clear preference for blue excesses as predicted by several models. Using the SALT3 model, we measure Hubble residuals for these two samples and find that excess-having SNe\,Ia may have lower Hubble residuals (HR) after correcting for shape, color, and host-galaxy mass, at $\sim$2-3$\sigma$ significance; our baseline result is $\Delta HR = -0.056 \pm 0.026$~mag ($2.2 \sigma$). We compare the host-galaxy masses of excess-having and no-excess SNe\,Ia and find they are consistent, though at marginal significance excess-having SNe\,Ia may prefer lower-mass hosts. Additional discoveries of early excess SNe\,Ia will be a powerful way to understand potential biases in SN\,Ia cosmology and probe the physics of SN\,Ia progenitors.


title: Digital Prototype Filter Alternatives for Processing Frequency-Stacked Mobile Subbands Deploying a Single ADC for Beamforming Satellites

abstract: This article presents a two-stage approach for the processing of frequency-stacked mobile subbands. The frequency stacking is performed in the analog domain to enable the use of a wideband analog-to-digital converter (ADC), instead of employing multiple narrowband ADCs, to support multiple antenna elements for digital satellite beamforming. This analog front end provides a common broadband digital interface to the on-board processor and can be configured to support multiple satellite missions, reducing the cost of commissioning a digital processor for individual satellite missions. This article proposes a framework on the specification of digital prototype filter for the analysis of frequency-stacked mobile subbands. The computational complexity of the analysis operation, with two digital filter alternatives, are evaluated. A series of results, taken from our European Space Agency sponsored project, are presented here to demonstrate the applicability of the proposed two stage approach, reporting on the savings in power consumption when an Nth-band all-pass-based recursive filter having an infinite impulse response is used as the digital prototype filter.


title: The categories of corings and coalgebras over a ring are locally countably presentable

abstract: For any commutative ring $R$, we show that the categories of $R$-coalgebras and cocommutative $R$-coalgebras are locally $\aleph_1$-presentable, while the categories of $R$-flat $R$-coalgebras are $\aleph_1$-accessible. Similarly, for any associative ring $R$, the category of $R$-corings is locally $\aleph_1$-presentable, while the category of $R$-$R$-bimodule flat $R$-corings is $\aleph_1$-accessible. The cardinality of the ring $R$ can be arbitrarily large. We also discuss $R$-corings with surjective counit and flat kernel. The proofs are straightforward applications of an abstract category-theoretic principle going back to Ulmer. For right or two-sided $R$-module flat $R$-corings, our cardinality estimate for the accessibility rank is not as good. A generalization to comonoid objects in accessible monoidal categories is also considered.


title: The Dark Energy Survey: Cosmology Results With ~1500 New High-redshift Type Ia Supernovae Using The Full 5-year Dataset

abstract: We present cosmological constraints from the sample of Type Ia supernovae (SN Ia) discovered during the full five years of the Dark Energy Survey (DES) Supernova Program. In contrast to most previous cosmological samples, in which SN are classified based on their spectra, we classify the DES SNe using a machine learning algorithm applied to their light curves in four photometric bands. Spectroscopic redshifts are acquired from a dedicated follow-up survey of the host galaxies. After accounting for the likelihood of each SN being a SN Ia, we find 1635 DES SNe in the redshift range $0.10<z<1.13$ that pass quality selection criteria sufficient to constrain cosmological parameters. This quintuples the number of high-quality $z>0.5$ SNe compared to the previous leading compilation of Pantheon+, and results in the tightest cosmological constraints achieved by any SN data set to date. To derive cosmological constraints we combine the DES supernova data with a high-quality external low-redshift sample consisting of 194 SNe Ia spanning $0.025<z<0.10$. Using SN data alone and including systematic uncertainties we find $\Omega_{\rm M}=0.352\pm 0.017$ in flat $\Lambda$CDM. Supernova data alone now require acceleration ($q_0<0$ in $\Lambda$CDM) with over $5\sigma$ confidence. We find $(\Omega_{\rm M},w)=(0.264^{+0.074}_{-0.096},-0.80^{+0.14}_{-0.16})$ in flat $w$CDM. For flat $w_0w_a$CDM, we find $(\Omega_{\rm M},w_0,w_a)=(0.495^{+0.033}_{-0.043},-0.36^{+0.36}_{-0.30},-8.8^{+3.7}_{-4.5})$. Including Planck CMB data, SDSS BAO data, and DES $3\times2$-point data gives $(\Omega_{\rm M},w)=(0.321\pm0.007,-0.941\pm0.026)$. In all cases dark energy is consistent with a cosmological constant to within $\sim2\sigma$. In our analysis, systematic errors on cosmological parameters are subdominant compared to statistical errors; paving the way for future photometrically classified supernova analyses.


title: Dagma-DCE: Interpretable, Non-Parametric Differentiable Causal Discovery

abstract: We introduce Dagma-DCE, an interpretable and model-agnostic scheme for differentiable causal discovery. Current non- or over-parametric methods in differentiable causal discovery use opaque proxies of ``independence'' to justify the inclusion or exclusion of a causal relationship. We show theoretically and empirically that these proxies may be arbitrarily different than the actual causal strength. Juxtaposed to existing differentiable causal discovery algorithms, \textsc{Dagma-DCE} uses an interpretable measure of causal strength to define weighted adjacency matrices. In a number of simulated datasets, we show our method achieves state-of-the-art level performance. We additionally show that \textsc{Dagma-DCE} allows for principled thresholding and sparsity penalties by domain-experts. The code for our method is available open-source at https://github.com/DanWaxman/DAGMA-DCE, and can easily be adapted to arbitrary differentiable models.


title: SPFormer: Enhancing Vision Transformer with Superpixel Representation

abstract: In this work, we introduce SPFormer, a novel Vision Transformer enhanced by superpixel representation. Addressing the limitations of traditional Vision Transformers' fixed-size, non-adaptive patch partitioning, SPFormer employs superpixels that adapt to the image's content. This approach divides the image into irregular, semantically coherent regions, effectively capturing intricate details and applicable at both initial and intermediate feature levels. SPFormer, trainable end-to-end, exhibits superior performance across various benchmarks. Notably, it exhibits significant improvements on the challenging ImageNet benchmark, achieving a 1.4% increase over DeiT-T and 1.1% over DeiT-S respectively. A standout feature of SPFormer is its inherent explainability. The superpixel structure offers a window into the model's internal processes, providing valuable insights that enhance the model's interpretability. This level of clarity significantly improves SPFormer's robustness, particularly in challenging scenarios such as image rotations and occlusions, demonstrating its adaptability and resilience.


title: The Fate of Primary Iron Sulfides in the CM1 Carbonaceous Chondrites: Effects of Advanced Aqueous Alteration on Primary Components

abstract: We have carried out a SEM-EPMA-TEM study to determine the textures and compositions of relict primary iron sulfides and their alteration products in a suite of moderately to heavily-altered CM1 carbonaceous chondrites. We observed four textural groups of altered primary iron sulfides: 1) pentlandite+phyllosilicate (2P) grains, characterized by pentlandite with submicron lenses of phyllosilicates, 2) pyrrhotite+pentlandite+magnetite (PPM) grains, characterized by pyrrhotite-pentlandite exsolution textures with magnetite veining and secondary pentlandite, 3) pentlandite+serpentine (PS) grains, characterized by relict pentlandite exsolution, serpentine, and secondary pentlandite, and 4) pyrrhotite+pentlandite+magnetite+serpentine (PPMS) grains, characterized by features of both the PPM and PS grains. We have determined that all four groups were initially primary iron sulfides, which formed from crystallization of immiscible sulfide melts within silicate chondrules in the solar nebula. The fact that such different alteration products could result from the same precursor sulfides within even the same meteorite sample further underscores the complexity of the aqueous alteration environment for the CM chondrites. The different alteration reactions for each textural group place constraints on the mechanisms and conditions of alteration with evidence for acidic environments, oxidizing environments, and changing fluid compositions (Ni-bearing and Si-Mg-bearing).


title: Solutions to the Landau-Lifshitz-Gilbert equation in the frequency space: Discretization schemes for the dynamic-matrix approach

abstract: The dynamic matrix method addresses the Landau-Lifshitz-Gilbert (LLG) equation in the frequency domain by transforming it into an eigenproblem. Subsequent numerical solutions are derived from the eigenvalues and eigenvectors of the dynamic matrix. In this work we explore discretization methods needed to obtain a matrix representation of the dynamic operator, a fundamental counterpart of the dynamic matrix. Our approach opens a new set of linear algebra tools for the dynamic matrix method and expose the approximations and limitations intrinsic to it. Moreover, our discretization algorithms can be applied to various discretization schemes, extending beyond micromagnetism problems. We present some application examples, including a technique to obtain the dynamic matrix directly from the magnetic free energy function of an ensemble of macrospins, and an algorithmic method to calculate numerical micromagnetic kernels, including plane wave kernels. We also show how to exploit symmetries and reduce the numerical size of micromagnetic dynamic-matrix problems by a change of basis. This procedure significantly reduces the size of the dynamic matrix by several orders of magnitude while maintaining high numerical precision. Additionally, we calculate analytical approximations for the dispersion relations in magnonic crystals. This work contributes to the understanding of the current magnetization dynamics methods, and could help the development and formulations of novel analytical and numerical methods for solving the LLG equation within the frequency domain.


title: Verbal width in arithmetic Chevalley groups

abstract: We prove that the width of any word in a simply connected Chevalley group of rank at least 2 over the ring that is a localisation of the ring of integers in a number field is bounded by a constant that depends only on the root system and on the degree of the number field.


title: Towards a zk-SNARK compiler for Wolfram language

abstract: Zero-knowledge proofs (zk-Proofs) are communication protocols by which a prover can demonstrate to a verifier that it possesses a solution to a given public problem without revealing the content of the solution. Arbitrary computations can be transformed into an interactive zk-Proof so anyone is convinced that it was executed correctly without knowing what was executed on, having huge implications for digital currency. Despite this, interactive proofs are not suited for blockchain applications but novel protocols such as zk-SNARKs have made zero-knowledge ledgers like Zcash possible. This project builds upon Wolfram's ZeroKnowledgeProofs paclet and implements a zk-SNARK compiler based on Pinocchio protocol.


title: Joint analysis of the iron emission in the optical and near-infrared spectrum of I Zw 1

abstract: Constraining the physical conditions of the ionized media in the vicinity of an active supermassive black hole (SMBH) is crucial to understanding how these complex systems operate. Metal emission lines such as iron (Fe) are useful probes to trace the gaseous media's abundance, activity, and evolution in these accreting systems. Among these, the FeII emission has been the focus of many prior studies to investigate the energetics, kinematics, and composition of the broad-emission line region (BELR) from where these emission lines are produced. In this work, we present the first simultaneous FeII modeling in the optical and near-infrared (NIR) regions. We use CLOUDY photoionization code to simulate both spectral regions in the wavelength interval 4000-12000 Angstroms. We compare our model predictions with the observed line flux ratios for IZw1 - a prototypical strong FeII-emitting active galactic nuclei (AGN). This allows putting constraints on the BLR cloud density and metal content that is optimal for the production of the FeII emission, which can be extended to IZw1-like sources, by examining a broad parameter space. We demonstrate the salient and distinct features of the FeII pseudo-continuum in the optical and NIR, giving special attention to the effect of micro-turbulence on the intensity of the FeII emission.


title: Locally Adaptive Neural 3D Morphable Models

abstract: We present the Locally Adaptive Morphable Model (LAMM), a highly flexible Auto-Encoder (AE) framework for learning to generate and manipulate 3D meshes. We train our architecture following a simple self-supervised training scheme in which input displacements over a set of sparse control vertices are used to overwrite the encoded geometry in order to transform one training sample into another. During inference, our model produces a dense output that adheres locally to the specified sparse geometry while maintaining the overall appearance of the encoded object. This approach results in state-of-the-art performance in both disentangling manipulated geometry and 3D mesh reconstruction. To the best of our knowledge LAMM is the first end-to-end framework that enables direct local control of 3D vertex geometry in a single forward pass. A very efficient computational graph allows our network to train with only a fraction of the memory required by previous methods and run faster during inference, generating 12k vertex meshes at $>$60fps on a single CPU thread. We further leverage local geometry control as a primitive for higher level editing operations and present a set of derivative capabilities such as swapping and sampling object parts. Code and pretrained models can be found at https://github.com/michaeltrs/LAMM.


title: Fast and Optimal Weight Update for Pruned Large Language Models

abstract: Pruning large language models (LLMs) is a challenging task due to their enormous size. The primary difficulty is fine-tuning the model after pruning, which is needed to recover the lost performance caused by dropping weights. Recent approaches have either ignored fine-tuning entirely, focusing on efficient pruning criteria, or attempted layer-wise weight updates, preserving the behavior of each layer. However, even layer-wise weight updates can be costly for LLMs, and previous works have resorted to various approximations. In our paper, we propose a fast and optimal weight update algorithm for pruned layers based on the Alternating Direction Method of Multipliers (ADMM). Coupled with a simple iterative pruning mask selection, our algorithm achieves state-of-the-art pruning performance across a wide range of LLMs. Code is available at https://github.com/fmfi-compbio/admm-pruning.


title: Penalized Distributed Lag Interaction Model: Air Pollution, Birth Weight and Neighborhood Vulnerability

abstract: Maternal exposure to air pollution during pregnancy has a substantial public health impact. Epidemiological evidence supports an association between maternal exposure to air pollution and low birth weight. A popular method to estimate this association while identifying windows of susceptibility is a distributed lag model (DLM), which regresses an outcome onto exposure history observed at multiple time points. However, the standard DLM framework does not allow for modification of the association between repeated measures of exposure and the outcome. We propose a distributed lag interaction model that allows modification of the exposure-time-response associations across individuals by including an interaction between a continuous modifying variable and the exposure history. Our model framework is an extension of a standard DLM that uses a cross-basis, or bi-dimensional function space, to simultaneously describe both the modification of the exposure-response relationship and the temporal structure of the exposure data. Through simulations, we showed that our model with penalization out-performs a standard DLM when the true exposure-time-response associations vary by a continuous variable. Using a Colorado, USA birth cohort, we estimated the association between birth weight and ambient fine particulate matter air pollution modified by an area-level metric of health and social adversities from Colorado EnviroScreen.


title: Digital-analog quantum learning on Rydberg atom arrays

abstract: We propose hybrid digital-analog learning algorithms on Rydberg atom arrays, combining the potentially practical utility and near-term realizability of quantum learning with the rapidly scaling architectures of neutral atoms. Our construction requires only single-qubit operations in the digital setting and global driving according to the Rydberg Hamiltonian in the analog setting. We perform a comprehensive numerical study of our algorithm on both classical and quantum data, given respectively by handwritten digit classification and unsupervised quantum phase boundary learning. We show in the two representative problems that digital-analog learning is not only feasible in the near term, but also requires shorter circuit depths and is more robust to realistic error models as compared to digital learning schemes. Our results suggest that digital-analog learning opens a promising path towards improved variational quantum learning experiments in the near term.


title: Unsupervised Federated Domain Adaptation for Segmentation of MRI Images

abstract: Automatic semantic segmentation of magnetic resonance imaging (MRI) images using deep neural networks greatly assists in evaluating and planning treatments for various clinical applications. However, training these models is conditioned on the availability of abundant annotated data to implement the end-to-end supervised learning procedure. Even if we annotate enough data, MRI images display considerable variability due to factors such as differences in patients, MRI scanners, and imaging protocols. This variability necessitates retraining neural networks for each specific application domain, which, in turn, requires manual annotation by expert radiologists for all new domains. To relax the need for persistent data annotation, we develop a method for unsupervised federated domain adaptation using multiple annotated source domains. Our approach enables the transfer of knowledge from several annotated source domains to adapt a model for effective use in an unannotated target domain. Initially, we ensure that the target domain data shares similar representations with each source domain in a latent embedding space, modeled as the output of a deep encoder, by minimizing the pair-wise distances of the distributions for the target domain and the source domains. We then employ an ensemble approach to leverage the knowledge obtained from all domains. We provide theoretical analysis and perform experiments on the MICCAI 2016 multi-site dataset to demonstrate our method is effective.


title: Analytical solution of the Poiseuille flow of a De Kee viscoplastic fluid

abstract: We provide an explicit analytical solution of the planar Poiseuille flow of a viscoplastic fluid governed by the constitutive equation proposed by De Kee and Turcotte (Chem. Eng. Commun. 6 (1980) 273-282). Formulae for the velocity and the flow rate are derived, making use of the Lambert W function. It is shown that a solution does not always exist because the flow curve is bounded from above and hence the rheological model can accommodate stresses only up to a certain limit. In fact, the flow curve reaches a peak at a critical shear rate, beyond which it exhibits a negative slope, giving rise to unstable solutions.


title: Temperature dependence of microwave losses in lumped-element resonators made from superconducting nanowires with high kinetic inductance

abstract: We study the response of several microwave resonators made from superconducting NbTiN thin-film meandering nanowires with large kinetic inductance, having different circuit topology and coupling to the transmission line. Reflection measurements reveal the parameters of the circuit and analysis of their temperature dependence in the range 1.7-6 K extract the superconducting energy gap and critical temperature. The lumped-element LC resonator, valid in our frequency range of interest, allows us to predict the quasiparticle contribution to internal loss, independent of circuit topology and characteristic impedance. Our analysis shows that the internal quality factor is limited not by thermal-equilibrium quasiparticles, but an additional temperature-dependent source of internal microwave loss.


title: An a posteriori error analysis based on equilibrated stresses for finite element approximations of frictional contact

abstract: We consider the unilateral contact problem between an elastic body and a rigid foundation in a description that includes both Tresca and Coulomb friction conditions. For this problem, we present an a posteriori error analysis based on an equilibrated stress reconstruction in the Arnold--Falk--Winther space that includes a guaranteed upper bound distinguishing the different components of the error. This analysis is the starting point for the development of an adaptive algorithm including a stopping criterion for the generalized Newton method. This algorithm is then used to perform numerical simulations that validate the theoretical results.


title: The Dark Energy Survey Supernova Program: Cosmological Analysis and Systematic Uncertainties

abstract: We present the full Hubble diagram of photometrically-classified Type Ia supernovae (SNe Ia) from the Dark Energy Survey supernova program (DES-SN). DES-SN discovered more than 20,000 SN candidates and obtained spectroscopic redshifts of 7,000 host galaxies. Based on the light-curve quality, we select 1635 photometrically-identified SNe Ia with spectroscopic redshift 0.10$< z <$1.13, which is the largest sample of supernovae from any single survey and increases the number of known $z>0.5$ supernovae by a factor of five. In a companion paper, we present cosmological results of the DES-SN sample combined with 194 spectroscopically-classified SNe Ia at low redshift as an anchor for cosmological fits. Here we present extensive modeling of this combined sample and validate the entire analysis pipeline used to derive distances. We show that the statistical and systematic uncertainties on cosmological parameters are $\sigma_{\Omega_M,{\rm stat+sys}}^{\Lambda{\rm CDM}}=$0.017 in a flat $\Lambda$CDM model, and $(\sigma_{\Omega_M},\sigma_w)_{\rm stat+sys}^{w{\rm CDM}}=$(0.082, 0.152) in a flat $w$CDM model. Combining the DES SN data with the highly complementary CMB measurements by Planck Collaboration (2020) reduces uncertainties on cosmological parameters by a factor of 4. In all cases, statistical uncertainties dominate over systematics. We show that uncertainties due to photometric classification make up less than 10% of the total systematic uncertainty budget. This result sets the stage for the next generation of SN cosmology surveys such as the Vera C. Rubin Observatory's Legacy Survey of Space and Time.


title: On Non-Noetherian Iwasawa Theory

abstract: We prove a general structure theorem for finitely presented torsion modules over a class of commutative rings that need not be Noetherian. As a first application, we then use this result to study the Weil- \'etale cohomology groups of $\mathbb{G}_m$ for curves over finite fields.


title: Simple tilts of length hearts and simple-minded mutation

abstract: We characterise when a simple Happel-Reiten-Smalo tilt of a length heart is again a length heart in terms of approximation theory and the existence of a stability condition with a phase gap. We apply simple-minded reduction to provide a sufficient condition for infinite iterability of simple-minded mutation/simple tilting. We use simple-minded mutation pairs to provide a common framework to show that mutation of simple-minded collections (resp. $w$-simple-minded systems, for $w \geq 1$) gives simple-minded collections (resp. $w$-simple-minded systems) under mild conditions, in the process providing a unified proof of results of A. Dugas and P. Jorgensen. Finally, we show that under mild conditions, mutation of simple-minded collections is compatible with mutation of $w$-simple-minded systems via a singularity category construction due to H. Jin.


title: Hashing Modulo Context-Sensitive $\alpha$-Equivalence

abstract: The notion of $\alpha$-equivalence between $\lambda$-terms is commonly used to identify terms that are considered equal. However, due to the primitive treatment of free variables, this notion falls short when comparing subterms occurring within a larger context. Depending on the usage of the Barendregt convention (choosing different variable names for all involved binders), it will equate either too few or too many subterms. We introduce a formal notion of context-sensitive $\alpha$-equivalence, where two open terms can be compared within a context that resolves their free variables. We show that this equivalence coincides exactly with the notion of bisimulation equivalence. Furthermore, we present an efficient $O(n\log n)$ runtime hashing scheme that identifies $\lambda$-terms modulo context-sensitive $\alpha$-equivalence, generalizing over traditional bisimulation partitioning algorithms and improving upon a previously established $O(n\log^2 n)$ bound for a hashing modulo ordinary $\alpha$-equivalence by Maziarz et al. Hashing $\lambda$-terms is useful in many applications that require common subterm elimination and structure sharing. We have employed the algorithm to obtain a large-scale, densely packed, interconnected graph of mathematical knowledge from the Coq proof assistant for machine learning purposes.


title: Graph2Tac: Online Representation Learning of Formal Math Concepts

abstract: In proof assistants, the physical proximity between two formal mathematical concepts is a strong predictor of their mutual relevance. Furthermore, lemmas with close proximity regularly exhibit similar proof structures. We show that this locality property can be exploited through online learning techniques to obtain solving agents that far surpass offline learners when asked to prove theorems in an unseen mathematical setting. We extensively benchmark two such online solvers implemented in the Tactician platform for the Coq proof assistant: First, Tactician's online $k$-nearest neighbor solver, which can learn from recent proofs, shows a $1.72\times$ improvement in theorems proved over an offline equivalent. Second, we introduce a graph neural network, Graph2Tac, with a novel approach to build hierarchical representations for new definitions. Graph2Tac's online definition task realizes a $1.5\times$ improvement in theorems solved over an offline baseline. The $k$-NN and Graph2Tac solvers rely on orthogonal online data, making them highly complementary. Their combination improves $1.27\times$ over their individual performances. Both solvers outperform all other general-purpose provers for Coq, including CoqHammer, Proverbot9001, and a transformer baseline by at least $1.48\times$ and are available for practical use by end-users.


title: The Tactician's Web of Large-Scale Formal Knowledge

abstract: The Tactician's Web is a platform offering a large web of strongly interconnected, machine-checked, formal mathematical knowledge conveniently packaged for machine learning, analytics, and proof engineering. Built on top of the Coq proof assistant, the platform exports a dataset containing a wide variety of formal theories, presented as a web of definitions, theorems, proof terms, tactics, and proof states. Theories are encoded both as a semantic graph (rendered below) and as human-readable text, each with a unique set of advantages and disadvantages. Proving agents may interact with Coq through the same rich data representation and can be automatically benchmarked on a set of theorems. Tight integration with Coq provides the unique possibility to make agents available to proof engineers as practical tools.


title: Critical embeddings

abstract: Hayut and first author isolated the notion of a critical cardinal in [1]. In this work we answer several questions raised in the original paper. We show that it is consistent for a critical cardinals to not have any ultrapower elementary embeddings, as well as that it is consistent that no target model is closed. We also prove that if $\kappa$ is a critical point by any ultrapower embedding, then it is the critical point by a normal ultrapower embedding. The paper contains several open questions of interest in the study of critical cardinals.


title: Optimizing Dataflow Systems for Scalable Interactive Visualization

abstract: Supporting the interactive exploration of large datasets is a popular and challenging use case for data management systems. Traditionally, the interface and the back-end system are built and optimized separately, and interface design and system optimization require different skill sets that are difficult for one person to master. To enable analysts to focus on visualization design, we contribute VegaPlus, a system that automatically optimizes interactive dashboards to support large datasets. To achieve this, VegaPlus leverages two core ideas. First, we introduce an optimizer that can reason about execution plans in Vega, a back-end DBMS, or a mix of both environments. The optimizer also considers how user interactions may alter execution plan performance, and can partially or fully rewrite the plans when needed. Through a series of benchmark experiments on seven different dashboard designs, our results show that VegaPlus provides superior performance and versatility compared to standard dashboard optimization techniques.


title: Linked factor analysis

abstract: Factor models are widely used in the analysis of high-dimensional data in several fields of research. Estimating a factor model, in particular its covariance matrix, from partially observed data vectors is very challenging. In this work, we show that when the data are structurally incomplete, the factor model likelihood function can be decomposed into the product of the likelihood functions of multiple partial factor models relative to different subsets of data. If these multiple partial factor models are linked together by common parameters, then we can obtain complete maximum likelihood estimates of the factor model parameters and thereby the full covariance matrix. We call this framework Linked Factor Analysis (LINFA). LINFA can be used for covariance matrix completion, dimension reduction, data completion, and graphical dependence structure recovery. We propose an efficient Expectation-Maximization algorithm for maximum likelihood estimation, accelerated by a novel group vertex tessellation (GVT) algorithm which identifies a minimal partition of the vertex set to implement an efficient optimization in the maximization steps. We illustrate our approach in an extensive simulation study and in the analysis of calcium imaging data collected from mouse visual cortex.


title: DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

abstract: The rapid development of open-source large language models (LLMs) has been truly remarkable. However, the scaling law described in previous literature presents varying conclusions, which casts a dark cloud over scaling LLMs. We delve into the study of scaling laws and present our distinctive findings that facilitate scaling of large scale models in two commonly used open-source configurations, 7B and 67B. Guided by the scaling laws, we introduce DeepSeek LLM, a project dedicated to advancing open-source language models with a long-term perspective. To support the pre-training phase, we have developed a dataset that currently consists of 2 trillion tokens and is continuously expanding. We further conduct supervised fine-tuning (SFT) and Direct Preference Optimization (DPO) on DeepSeek LLM Base models, resulting in the creation of DeepSeek Chat models. Our evaluation results demonstrate that DeepSeek LLM 67B surpasses LLaMA-2 70B on various benchmarks, particularly in the domains of code, mathematics, and reasoning. Furthermore, open-ended evaluations reveal that DeepSeek LLM 67B Chat exhibits superior performance compared to GPT-3.5.


title: Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactively

abstract: The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs). SAM excels in segmentation tasks across diverse domains, while CLIP is renowned for its zero-shot recognition capabilities. This paper presents an in-depth exploration of integrating these two models into a unified framework. Specifically, we introduce the Open-Vocabulary SAM, a SAM-inspired model designed for simultaneous interactive segmentation and recognition, leveraging two unique knowledge transfer modules: SAM2CLIP and CLIP2SAM. The former adapts SAM's knowledge into the CLIP via distillation and learnable transformer adapters, while the latter transfers CLIP knowledge into SAM, enhancing its recognition capabilities. Extensive experiments on various datasets and detectors show the effectiveness of Open-Vocabulary SAM in both segmentation and recognition tasks, significantly outperforming the naive baselines of simply combining SAM and CLIP. Furthermore, aided with image classification data training, our method can segment and recognize approximately 22,000 classes.


title: A braided monoidal $(\infty,2)$-category of Soergel bimodules

abstract: The Hecke algebras for all symmetric groups taken together form a braided monoidal category that controls all quantum link invariants of type A and, by extension, the standard canon of topological quantum field theories in dimension 3 and 4. Here we provide the first categorification of this Hecke braided monoidal category, which takes the form of an $\mathbb{E}_2$-monoidal $(\infty,2)$-category whose hom-$(\infty,1)$-categories are $k$-linear, stable, idempotent-complete, and equipped with $\mathbb{Z}$-actions. This categorification is designed to control homotopy-coherent link homology theories and to-be-constructed topological quantum field theories in dimension 4 and 5. Our construction is based on chain complexes of Soergel bimodules, with monoidal structure given by parabolic induction and braiding implemented by Rouquier complexes, all modelled homotopy-coherently. This is part of a framework which allows to transfer the toolkit of the categorification literature into the realm of $\infty$-categories and higher algebra. Along the way, we develop families of factorization systems for $(\infty,n)$-categories, enriched $\infty$-categories, and $\infty$-operads, which may be of independent interest. As a service aimed at readers less familiar with homotopy-coherent mathematics, we include a brief introduction to the necessary $\infty$-categorical technology in the form of an appendix.


title: Denoising Vision Transformers

abstract: We delve into a nuanced but significant challenge inherent to Vision Transformers (ViTs): feature maps of these models exhibit grid-like artifacts, which detrimentally hurt the performance of ViTs in downstream tasks. Our investigations trace this fundamental issue down to the positional embeddings at the input stage. To address this, we propose a novel noise model, which is universally applicable to all ViTs. Specifically, the noise model dissects ViT outputs into three components: a semantics term free from noise artifacts and two artifact-related terms that are conditioned on pixel locations. Such a decomposition is achieved by enforcing cross-view feature consistency with neural fields in a per-image basis. This per-image optimization process extracts artifact-free features from raw ViT outputs, providing clean features for offline applications. Expanding the scope of our solution to support online functionality, we introduce a learnable denoiser to predict artifact-free features directly from unprocessed ViT outputs, which shows remarkable generalization capabilities to novel data without the need for per-image optimization. Our two-stage approach, termed Denoising Vision Transformers (DVT), does not require re-training existing pre-trained ViTs and is immediately applicable to any Transformer-based architecture. We evaluate our method on a variety of representative ViTs (DINO, MAE, DeiT-III, EVA02, CLIP, DINOv2, DINOv2-reg). Extensive evaluations demonstrate that our DVT consistently and significantly improves existing state-of-the-art general-purpose models in semantic and geometric tasks across multiple datasets (e.g., +3.84 mIoU). We hope our study will encourage a re-evaluation of ViT design, especially regarding the naive use of positional embeddings.


title: Phantom Fluid Cosmology -or- Ghosts for Gordon

abstract: The quanta of phantom dark energy models are negative energy particles, whose maximum magnitude of energy $|E|$ must be less than a cutoff $\Lambda\lesssim 20\,$MeV. They are produced by spontaneous decay of the vacuum into phantoms plus normal particles. I review general cosmological constraints that have been derived from the effects of such phantom fluid production, and a possible application: the generation of boosted dark matter or radiation that could be directly detected. Recent excess events from the DAMIC experiment can be well-fit by such processes.