title: Invertibility in nonassociative ordered rings and in weak-quasi-topological nonassociative rings

abstract: Invertibility is important in ring theory because it enables division and facilitates solving equations. Moreover, rings can be endowed with extra ''structure'' such as order and topology that add new properties. The two main theorems of this article are contributions to invertibility in the context of ordered and weak-quasi-topological rings. Specifically, the first theorem asserts that the interval $]0,1]$ in any suitable partially ordered ring consists entirely of invertible elements. The second theorem asserts that if $f$ is a norm from a ring to a partially ordered ring endowed with interval topology, then under certain conditions, the subset of elements such that $f(1-a) < 1$ consists entirely of invertible elements. The second theorem relies on the assumption of sequential Cauchy completeness of the topology induced by the norm $f$, which as we recall, takes values in an ordered ring endowed with the interval topology (an example of a coarse topology). The fact that a ring endowed with the topology associated with a seminorm into an ordered ring endowed with the interval topology is a locally convex quasi-topological group with an additional continuity property of the product is dealt with in a separate section. A brief application to frame theory is also included.


title: Study of WH production through vector boson scattering and extraction of the relative sign of the W and Z couplings to the Higgs boson in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: A search for the production of a W boson and a Higgs boson through vector boson scattering (VBS) is presented, using CMS data from proton-proton collisions at $\sqrt{s}$ = 13 TeV collected from 2016 to 2018. The integrated luminosity of the data sample is 138 fb$^{-1}$. Selected events must be consistent with the presence of two jets originating from VBS, the leptonic decay of the W boson to an electron or muon, and a Higgs boson decaying into a pair of b quarks, reconstructed as either a single merged jet or two resolved jets. A measurement of the process as predicted by the standard model (SM) is performed alongside a study of beyond-the-SM (BSM) scenarios. The SM analysis sets an observed (expected) 95% confidence level upper limit of 14.3 (9.0) on the ratio of the measured VBS WH cross section to that expected by the SM. The BSM analysis, conducted within the so-called $\kappa$ framework, excludes all scenarios with $\lambda_\mathrm{WZ}$ $\lt$ 0 that are consistent with current measurements, where $\lambda_\mathrm{WZ}$ = $\kappa_\mathrm{W}/\kappa_\mathrm{Z}$ and $\kappa_\mathrm{W}$ and $\kappa_\mathrm{Z}$ are the HWW and HZZ coupling modifiers, respectively. The signficance of the exclusion is beyond 5 standard deviations, and it is consistent with the SM expectation of $\lambda_\mathrm{WZ}$ = 1.


title: Automatic Jailbreaking of the Text-to-Image Generative AI Systems

abstract: Recent AI systems have shown extremely powerful performance, even surpassing human performance, on various tasks such as information retrieval, language generation, and image generation based on large language models (LLMs). At the same time, there are diverse safety risks that can cause the generation of malicious contents by circumventing the alignment in LLMs, which are often referred to as jailbreaking. However, most of the previous works only focused on the text-based jailbreaking in LLMs, and the jailbreaking of the text-to-image (T2I) generation system has been relatively overlooked. In this paper, we first evaluate the safety of the commercial T2I generation systems, such as ChatGPT, Copilot, and Gemini, on copyright infringement with naive prompts. From this empirical study, we find that Copilot and Gemini block only 12% and 17% of the attacks with naive prompts, respectively, while ChatGPT blocks 84% of them. Then, we further propose a stronger automated jailbreaking pipeline for T2I generation systems, which produces prompts that bypass their safety guards. Our automated jailbreaking framework leverages an LLM optimizer to generate prompts to maximize degree of violation from the generated images without any weight updates or gradient computation. Surprisingly, our simple yet effective approach successfully jailbreaks the ChatGPT with 11.0% block rate, making it generate copyrighted contents in 76% of the time. Finally, we explore various defense strategies, such as post-generation filtering and machine unlearning techniques, but found that they were inadequate, which suggests the necessity of stronger defense mechanisms.


title: Varaha: A promising sampler for obtaining gravitational wave posteriors

abstract: Nested sampling has been the workhorse for estimating parameters of compact binaries from the gravitational wave signals. It operates using a set of live points and accepts/rejects points drawn from prior such that the live point with the lowest likelihood is replaced by a point with a higher likelihood value. Each such iteration shrinks the volume enclosed by the live point of lowest likelihood by a known factor. The estimated sampling density along with the likelihood values of the new and old live points quantifies the probability mass enclosed by them. Although robust, nested sampling often discards a majority of the sampled points~($\sim 99.9\%$) at which likelihood was calculated. However, for small dimensional problems, which happens to be the case for compact binaries, the sampling density of all the sampled points can be explicitly calculated thereby removing the need to discard samples. The points' sampling density and likelihood values constitute the posterior distribution. Avoiding the wastage implies significant improvement in the sampling efficiency. In a previous method, we presented a recipe to reconstruct the live volume; the volume that encloses most of the posterior probability mass. We build on this method and present a methodology that explicitly records the sampling density of all the points. For small dimensions, the presented sampler is significantly more efficient than the canonical nested samplers and is embarrassingly parallel.


title: On deformation quantization of the space of connections on a two manifold and Chern Simons Gauge Theory

abstract: We use recent progress on Chern-Simons gauge theory in three dimensions [18] to give explicit, closed form formulas for the star product on some functions on the affine space ${\mathcal A}(\Sigma)$ of (smooth) connections on the trivialized principal $G$-bundle on a compact, oriented two manifold $\Sigma.$ These formulas give a close relation between knot invariants, such as the Kauffman bracket polynomial, and the Jones and HOMFLY polynomials, arising in Chern Simons gauge theory, and deformation quantization of ${\mathcal A}(\Sigma).$ This relation echoes the relation between the manifold invariants of Witten [20] and Reshetikhin-Turaev [16] and {\em geometric} quantization of this space (or its symplectic quotient by the action of the gauge group). In our case this relation arises from explicit algebraic formulas arising from the (mathematically well-defined) functional integrals of [18].


title: ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling

abstract: We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in compositionality, alongside the use of task-specific 2D diffusion models as priors for optimization. First, we extend a foundational model with a lightweight expression-aware and ID-aware architecture, and create 2D priors for geometry and texture generation, via fine-tuning only 0.2% of its available training parameters. Then, we jointly leverage a neural parametric representation for the expressions of each subject and a multi-stage generation of highly detailed geometry and albedo texture. This combination of strong face identity embeddings and our neural representation enables accurate reconstruction of not only facial features but also accessories and hair and can be meshed to provide render-ready assets for gaming and telepresence. Our results achieve an unprecedented level of identity-consistent and high-quality texture and geometry generation, generalizing to a ``world'' of unseen 3D identities, without relying on large 3D captured datasets of human assets.


title: A Preliminary Empirical Study on Prompt-based Unsupervised Keyphrase Extraction

abstract: Pre-trained large language models can perform natural language processing downstream tasks by conditioning on human-designed prompts. However, a prompt-based approach often requires "prompt engineering" to design different prompts, primarily hand-crafted through laborious trial and error, requiring human intervention and expertise. It is a challenging problem when constructing a prompt-based keyphrase extraction method. Therefore, we investigate and study the effectiveness of different prompts on the keyphrase extraction task to verify the impact of the cherry-picked prompts on the performance of extracting keyphrases. Extensive experimental results on six benchmark keyphrase extraction datasets and different pre-trained large language models demonstrate that (1) designing complex prompts may not necessarily be more effective than designing simple prompts; (2) individual keyword changes in the designed prompts can affect the overall performance; (3) designing complex prompts achieve better performance than designing simple prompts when facing long documents.


title: Exact solutions of some singular integro-differential equations related to adhesive contact problems of elasticity theory

abstract: The problem of constructing an exact solution of singular integro-differential equations related to problems of adhesive interaction between elastic thin semi-infinite homogeneous patch and elastic plate is investigated. For the patch loaded with horizontal forces the usual model of the uniaxial stress state is valid. Using the methods of the theory of analytic functions and integral transformation the singular integro-differential equation is reduced to the Riemann boundary value problem of the theory of analytic functions. The exact solution of this problem and asymptotic estimates of tangential contact stresses are obtained.


title: FRCNet Frequency and Region Consistency for Semi-supervised Medical Image Segmentation

abstract: Limited labeled data hinder the application of deep learning in medical domain. In clinical practice, there are sufficient unlabeled data that are not effectively used, and semi-supervised learning (SSL) is a promising way for leveraging these unlabeled data. However, existing SSL methods ignore frequency domain and region-level information and it is important for lesion regions located at low frequencies and with significant scale changes. In this paper, we introduce two consistency regularization strategies for semi-supervised medical image segmentation, including frequency domain consistency (FDC) to assist the feature learning in frequency domain and multi-granularity region similarity consistency (MRSC) to perform multi-scale region-level local context information feature learning. With the help of the proposed FDC and MRSC, we can leverage the powerful feature representation capability of them in an effective and efficient way. We perform comprehensive experiments on two datasets, and the results show that our method achieves large performance gains and exceeds other state-of-the-art methods.


title: Local Curvature Descent: Squeezing More Curvature out of Standard and Polyak Gradient Descent

abstract: We contribute to the growing body of knowledge on more powerful and adaptive stepsizes for convex optimization, empowered by local curvature information. We do not go the route of fully-fledged second-order methods which require the expensive computation of the Hessian. Instead, our key observation is that, for some problems (e.g., when minimizing the sum of squares of absolutely convex functions), certain local curvature information is readily available, and can be used to obtain surprisingly powerful matrix-valued stepsizes, and meaningful theory. In particular, we develop three new methods$\unicode{x2013}$LCD1, LCD2 and LCD3$\unicode{x2013}$where the abbreviation stands for local curvature descent. While LCD1 generalizes gradient descent with fixed stepsize, LCD2 generalizes gradient descent with Polyak stepsize. Our methods enhance these classical gradient descent baselines with local curvature information, and our theory recovers the known rates in the special case when no curvature information is used. Our last method, LCD3, is a variable metric version of LCD2; this feature leads to a closed-form expression for the iterates. Our empirical results are encouraging, and show that the local curvature descent improves upon gradient descent.


title: Arma: Byzantine Fault Tolerant Consensus with Horizontal Scalability

abstract: Arma is a Byzantine Fault Tolerant (BFT) consensus system designed to achieve horizontal scalability across all hardware resources: network bandwidth, CPU, and disk I/O. As opposed to preceding BFT protocols, Arma separates the dissemination and validation of client transactions from the consensus process, restricting the latter to totally ordering only metadata of batches of transactions. This separation enables each party to distribute compute and storage resources for transaction validation, dissemination and disk I/O among multiple machines, resulting in horizontal scalability. Additionally, Arma ensures censorship resistance by imposing a maximum time limit on the inclusion of client transactions. We built and evaluated two Arma prototypes. The first is an independent system handling over 200,000 transactions per second, the second integrated into Hyperledger Fabric, speeding its consensus by an order of magnitude.


title: Fractal analysis of Guthrie-Nymann's set and its generalisations

abstract: In this paper, we study the fractal properties of the boundary of the Cantorval connected with Guthrie-Nymann's series. In particular, we prove that such a Cantorval can be represented as a union of open intervals and a Cantor set having zero Lebesgue measure and a fractional Hausdorff dimension. Moreover, we extend the result to a countable family of Cantorvals with a similar structure.


title: Reflected Flow Matching

abstract: Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards the conditional velocity field. However, on constrained domains, the learned velocity model may lead to undesirable flows that result in highly unnatural samples, e.g., oversaturated images, due to both flow matching error and simulation error. To address this, we add a boundary constraint term to CNFs, which leads to reflected CNFs that keep trajectories within the constrained domains. We propose reflected flow matching (RFM) to train the velocity model in reflected CNFs by matching the conditional velocity fields in a simulation-free manner, similar to the vanilla FM. Moreover, the analytical form of conditional velocity fields in RFM avoids potentially biased approximations, making it superior to existing score-based generative models on constrained domains. We demonstrate that RFM achieves comparable or better results on standard image benchmarks and produces high-quality class-conditioned samples under high guidance weight.


title: A consolidated and accessible security proof for finite-size decoy-state quantum key distribution

abstract: In recent years, quantum key distribution (QKD) has evolved from a scientific research field to a commercially viable security solution, supported by mathematically formulated security proofs. However, since the knowledge required for a full understanding of a security proof is scattered across numerous publications, it has proven difficult to gain a comprehensive understanding of each step involved in the process and their limitations without considerable effort and attention to detail. Our paper aims to address this issue by presenting an accessible and comprehensive security proof for the finite-size 1-decoy (and 2-decoy) BB84 protocol in Renner's entropic uncertainty relation framework. We extensively consolidate and unify concepts from many works, thoroughly discussing the underlying assumptions and resolving technical inconsistencies. This work can serve as a foundation for the discussion of QKD security and for the identification of potential vulnerabilities and device imperfections. Our step-by-step approach and consistent notation assumes no prior exposure to security proofs, making it a robust and comprehensible reference, while maintaining theoretical rigor. Therefore, our contribution represents a significant advancement towards a broader understanding of QKD security proofs.


title: Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity

abstract: Constructing high-quality query-response pairs from custom corpus is crucial for supervised fine-tuning (SFT) large language models (LLMs) in many applications, like creating domain-specific AI assistants or roleplaying agents. However, sourcing this data through human annotation is costly, and existing automated methods often fail to capture the diverse range of contextual granularity and tend to produce homogeneous data. To tackle these issues, we introduce a novel method named AugCon, capable of automatically generating context-driven SFT data across multiple levels of granularity with high diversity, quality and fidelity. AugCon begins by generating queries using the Context-Split-Tree (CST), an innovative approach for recursively deriving queries and splitting context to cover full granularity. Then, we train a scorer through contrastive learning to collaborate with CST to rank and refine queries. Finally, a synergistic integration of self-alignment and self-improving is introduced to obtain high-fidelity responses. Extensive experiments are conducted incorporating both human and automatic evaluations, encompassing a test scenario and four widely-used benchmarks in English and Chinese. The results highlight the significant advantages of AugCon in producing high diversity, quality, and fidelity SFT data against several state-of-the-art methods. All of our code, dataset, and fine-tuned model will be available at: https://github.com/quanshr/AugCon.


title: A Study on Unsupervised Anomaly Detection and Defect Localization using Generative Model in Ultrasonic Non-Destructive Testing

abstract: In recent years, the deterioration of artificial materials used in structures has become a serious social issue, increasing the importance of inspections. Non-destructive testing is gaining increased demand due to its capability to inspect for defects and deterioration in structures while preserving their functionality. Among these, Laser Ultrasonic Visualization Testing (LUVT) stands out because it allows the visualization of ultrasonic propagation. This makes it visually straightforward to detect defects, thereby enhancing inspection efficiency. With the increasing number of the deterioration structures, challenges such as a shortage of inspectors and increased workload in non-destructive testing have become more apparent. Efforts to address these challenges include exploring automated inspection using machine learning. However, the lack of anomalous data with defects poses a barrier to improving the accuracy of automated inspection through machine learning. Therefore, in this study, we propose a method for automated LUVT inspection using an anomaly detection approach with a diffusion model that can be trained solely on negative examples (defect-free data). We experimentally confirmed that our proposed method improves defect detection and localization compared to general object detection algorithms used previously.


title: On Bits and Bandits: Quantifying the Regret-Information Trade-off

abstract: In interactive decision-making tasks, information can be acquired by direct interactions, through receiving indirect feedback, and from external knowledgeable sources. We examine the trade-off between the information an agent accumulates and the regret it suffers. We show that information from external sources, measured in bits, can be traded off for regret, measured in reward. We invoke information-theoretic methods for obtaining regret lower bounds, that also allow us to easily re-derive several known lower bounds. We then generalize a variety of interactive decision-making tasks with external information to a new setting. Using this setting, we introduce the first Bayesian regret lower bounds that depend on the information an agent accumulates. These lower bounds also prove the near-optimality of Thompson sampling for Bayesian problems. Finally, we demonstrate the utility of these bounds in improving the performance of a question-answering task with large language models, allowing us to obtain valuable insights.


title: A comparison of the Coco-Russo scheme and $\protect\mathghost$-FEM for elliptic equations in arbitrary domains

abstract: In this paper, a comparative study between the Coco-Russo scheme (based on finite-difference scheme) and the $\mathghost$-FEM (based on finite-element method) is presented when solving the Poisson equation in arbitrary domains. The comparison between the two numerical methods is carried out by presenting analytical results from the literature \cite{cocoStissi,astuto2024nodal}, together with numerical tests in various geometries and boundary conditions.


title: An erbium-doped waveguide amplifier on thin film lithium niobate with an output power exceeding 100 mW

abstract: We demonstrate high-power thin film lithium niobate (TFLN) erbium-doped waveguide amplifier (EDWA) with a maximum on-chip output power of 113 mW and a gain of 16 dB. The on-chip integrated EDWA is composed of large mode area (LMA) waveguide structures with a total length of 7 cm and a footprint of 1x1 cm2. Particularly, we connect segmented LMA waveguides with waveguide tapers to achieve on-chip mode conversion which maintains single-mode propagation all over the EDWA even at the waveguide bends. The design leads to significant increase of the amplified signal power by orders of magnitude and will open an avenue for applications such as on-chip high-power lasers and amplifiers system.


title: MentalManip: A Dataset For Fine-grained Analysis of Mental Manipulation in Conversations

abstract: Mental manipulation, a significant form of abuse in interpersonal conversations, presents a challenge to identify due to its context-dependent and often subtle nature. The detection of manipulative language is essential for protecting potential victims, yet the field of Natural Language Processing (NLP) currently faces a scarcity of resources and research on this topic. Our study addresses this gap by introducing a new dataset, named ${\rm M{\small ental}M{\small anip}}$, which consists of $4,000$ annotated movie dialogues. This dataset enables a comprehensive analysis of mental manipulation, pinpointing both the techniques utilized for manipulation and the vulnerabilities targeted in victims. Our research further explores the effectiveness of leading-edge models in recognizing manipulative dialogue and its components through a series of experiments with various configurations. The results demonstrate that these models inadequately identify and categorize manipulative content. Attempts to improve their performance by fine-tuning with existing datasets on mental health and toxicity have not overcome these limitations. We anticipate that ${\rm M{\small ental}M{\small anip}}$ will stimulate further research, leading to progress in both understanding and mitigating the impact of mental manipulation in conversations.


title: Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity

abstract: Federated learning (FL) has emerged as a new paradigm for privacy-preserving collaborative training. Under domain skew, the current FL approaches are biased and face two fairness problems. 1) Parameter Update Conflict: data disparity among clients leads to varying parameter importance and inconsistent update directions. These two disparities cause important parameters to potentially be overwhelmed by unimportant ones of dominant updates. It consequently results in significant performance decreases for lower-performing clients. 2) Model Aggregation Bias: existing FL approaches introduce unfair weight allocation and neglect domain diversity. It leads to biased model convergence objective and distinct performance among domains. We discover a pronounced directional update consistency in Federated Learning and propose a novel framework to tackle above issues. First, leveraging the discovered characteristic, we selectively discard unimportant parameter updates to prevent updates from clients with lower performance overwhelmed by unimportant parameters, resulting in fairer generalization performance. Second, we propose a fair aggregation objective to prevent global model bias towards some domains, ensuring that the global model continuously aligns with an unbiased model. The proposed method is generic and can be combined with other existing FL methods to enhance fairness. Comprehensive experiments on Digits and Office-Caltech demonstrate the high fairness and performance of our method.


title: Three-edge-coloring projective planar cubic graphs: A generalization of the Four Color Theorem

abstract: We prove that every cyclically 4-edge-connected cubic graph that can be embedded in the projective plane, with the single exception of the Petersen graph, is 3-edge-colorable. In other words, the only (non-trivial) snark that can be embedded in the projective plane is the Petersen graph. This implies that a 2-connected cubic (multi)graph that can be embedded in the projective plane is not 3-edge-colorable if and only if it can be obtained from the Petersen graph by replacing each vertex by a 2-edge-connected planar cubic (multi)graph. This result is a nontrivial generalization of the Four Color Theorem, and its proof requires a combination of extensive computer verification and computer-free extension of existing proofs on colorability. An unexpected consequence of this result is a coloring-flow duality statement for the projective plane: A cubic graph embedded in the projective plane is 3-edge-colorable if and only if its dual multigraph is 5-vertex-colorable. Moreover, we show that a 2-edge connected graph embedded in the projective plane admits a nowhere-zero 4-flow unless it is Peteren-like (in which case it does not admit nowhere-zero 4-flows). This proves a strengthening of the Tutte 4-flow conjecture for graphs on the projective plane. Some of our proofs require extensive computer verification. The necessary source codes, together with the input and output files and the complete set of more than 6000 reducible configurations are available on Github (https://github.com/edge-coloring) which can be considered as an Addendum to this paper. Moreover, we provide pseudocodes for all our computer verifications.


title: Cost-Effective Online Multi-LLM Selection with Versatile Reward Models

abstract: With the rapid advancement of large language models (LLMs), the diversity of multi-LLM tasks and the variability in their pricing structures have become increasingly important, as costs can vary greatly between different LLMs. To tackle these challenges, we introduce the \textit{C2MAB-V}, a \underline{C}ost-effective \underline{C}ombinatorial \underline{M}ulti-armed \underline{B}andit with \underline{V}ersatile reward models for optimal LLM selection and usage. This online model differs from traditional static approaches or those reliant on a single LLM without cost consideration. With multiple LLMs deployed on a scheduling cloud and a local server dedicated to handling user queries, \textit{C2MAB-V} facilitates the selection of multiple LLMs over a combinatorial search space, specifically tailored for various collaborative task types with different reward models. Based on our designed online feedback mechanism and confidence bound technique, \textit{C2MAB-V} can effectively address the multi-LLM selection challenge by managing the exploration-exploitation trade-off across different models, while also balancing cost and reward for diverse tasks. The NP-hard integer linear programming problem for selecting multiple LLMs with trade-off dilemmas is addressed by: i) decomposing the integer problem into a relaxed form by the local server, ii) utilizing a discretization rounding scheme that provides optimal LLM combinations by the scheduling cloud, and iii) continual online updates based on feedback. Theoretically, we prove that \textit{C2MAB-V} offers strict guarantees over versatile reward models, matching state-of-the-art results for regret and violations in some degenerate cases. Empirically, we show that \textit{C2MAB-V} effectively balances performance and cost-efficiency with nine LLMs for three application scenarios.


title: Attaining Human`s Desirable Outcomes in Human-AI Interaction via Structural Causal Games

abstract: In human-AI interaction, a prominent goal is to attain human`s desirable outcome with the assistance of AI agents, which can be ideally delineated as a problem of seeking the optimal Nash Equilibrium that matches the human`s desirable outcome. However, reaching the outcome is usually challenging due to the existence of multiple Nash Equilibria that are related to the assisting task but do not correspond to the human`s desirable outcome. To tackle this issue, we employ a theoretical framework called structural causal game (SCG) to formalize the human-AI interactive process. Furthermore, we introduce a strategy referred to as pre-policy intervention on the SCG to steer AI agents towards attaining the human`s desirable outcome. In more detail, a pre-policy is learned as a generalized intervention to guide the agents` policy selection, under a transparent and interpretable procedure determined by the SCG. To make the framework practical, we propose a reinforcement learning-like algorithm to search out this pre-policy. The proposed algorithm is tested in both gridworld environments and realistic dialogue scenarios with large language models, demonstrating its adaptability in a broader class of problems and potential effectiveness in real-world situations.


title: Anti-plane segregation and diffusion in dense, bidisperse granular shear flow

abstract: Many dense granular systems are non-monodisperse, consisting of particles of different sizes, and will segregate based on size during flow. This phenomenon is an important aspect of many industrial and geophysical processes, necessitating predictive continuum models. This paper systematically studies a key aspect of the three-dimensional nature of segregation and diffusion in flowing, dense, bidisperse granular mixtures -- namely, segregation and diffusion acting along the direction perpendicular to the plane of shearing, which we refer to as the anti-plane modes of segregation and diffusion. To this end, we consider discrete-element method (DEM) simulations of flows of dense, bidisperse mixtures of frictional spheres in an idealized configuration that isolates anti-plane segregation and diffusion. We find that previously-developed constitutive equations, calibrated to DEM simulation results from flows in which both the segregation and diffusion processes occur within the plane of shearing, do not capture aspects of the anti-plane segregation dynamics. Accordingly, we utilize DEM simulation results to inform and calibrate constitutive equations for the segregation and diffusion fluxes in their anti-plane modes. Predictions of the resulting continuum model for the anti-plane segregation dynamics are tested against additional DEM simulation results across different cases, while parameters such as the shear strain rate and mixture composition are varied, and we find that the calibrated model predictions match well with the DEM simulation results. Finally, we suggest a strategy for generalizing the constitutive forms for the segregation and diffusion fluxes to obtain three-dimensional constitutive equations that account for both the in-plane and anti-plane modes of the segregation and diffusion processes.


title: Parker Solar Probe Observations of Energetic Particles in the Flank of a Coronal Mass Ejection Close to the Sun

abstract: We present an event observed by Parker Solar Probe at $\sim$0.2 au on March 2, 2022 in which imaging and \emph{in situ} measurements coincide. During this event, PSP passed through structures on the flank of a streamer blowout CME including an isolated flux tube in front of the CME, a turbulent sheath, and the CME itself. Imaging observations and \emph{in situ} helicity and principal variance signatures consistently show the presence of flux ropes internal to the CME. In both the sheath, and the CME interval, the distributions are more isotropic, the spectra are softer, and the abundance ratios of Fe/O and He/H are lower than those in the isolated flux tube, and yet elevated relative to typical plasma and SEP abundances. These signatures in the sheath and the CME indicate that both flare populations and those from the plasma are accelerated to form the observed energetic particle enhancements. In contrast, the isolated flux tube shows large streaming, hard spectra and large Fe/O and He/H ratios, indicating flare sources. Energetic particle fluxes are most enhanced within the CME interval from suprathermal through energetic particle energies ($\sim$ keV to $>10$ MeV), indicating particle acceleration, and confinement local to the closed magnetic structure. The flux-rope morphology of the CME helps to enable local modulation and trapping of energetic particles, particularly along helicity channels and other plasma boundaries. Thus, the CME acts to build-up energetic particle populations, allowing them to be fed into subsequent higher energy particle acceleration throughout the inner heliosphere where a compression or shock forms on the CME front.


title: CapS-Adapter: Caption-based MultiModal Adapter in Zero-Shot Classification

abstract: Recent advances in vision-language foundational models, such as CLIP, have demonstrated significant strides in zero-shot classification. However, the extensive parameterization of models like CLIP necessitates a resource-intensive fine-tuning process. In response, TIP-Adapter and SuS-X have introduced training-free methods aimed at bolstering the efficacy of downstream tasks. While these approaches incorporate support sets to maintain data distribution consistency between knowledge cache and test sets, they often fall short in terms of generalization on the test set, particularly when faced with test data exhibiting substantial distributional variations. In this work, we present CapS-Adapter, an innovative method that employs a caption-based support set, effectively harnessing both image and caption features to exceed existing state-of-the-art techniques in training-free scenarios. CapS-Adapter adeptly constructs support sets that closely mirror target distributions, utilizing instance-level distribution features extracted from multimodal large models. By leveraging CLIP's single and cross-modal strengths, CapS-Adapter enhances predictive accuracy through the use of multimodal support sets. Our method achieves outstanding zero-shot classification results across 19 benchmark datasets, improving accuracy by 2.19\% over the previous leading method. Our contributions are substantiated through extensive validation on multiple benchmark datasets, demonstrating superior performance and robust generalization capabilities. Our code is made publicly available at https://github.com/WLuLi/CapS-Adapter.


title: Knot theory and cluster algebras II: The knot cluster

abstract: To every knot (or link) diagram K, we associate a cluster algebra A that contains a cluster x with the property that every cluster variable in x specializes to the Alexander polynomial of K. We call x the knot cluster of A. Furthermore, there exists a cluster automorphism of A of order two that maps the initial cluster to the cluster x. We realize this connection between knot theory and cluster algebras in two ways. In our previous work, we constructed indecomposable representations T(i) of the initial quiver Q of the cluster algebra A. Modulo the removal of 2-cycles, the quiver Q is the incidence quiver of the segments in K, and the representation T(i) of Q is built by taking successive boundaries of K cut open at the i-th segment. The relation to the Alexander polynomial stems from an isomorphism between the submodule lattice of T(i) and the lattice of Kauffman states of K relative to segment i. In the current article, we identify the knot cluster x in A via a sequence of mutations that we construct from a sequence of bigon reductions and generalized Reidemeister III moves on the diagram K. On the level of diagrams, this sequence first reduces K to the Hopf link, then reflects the Hopf link to its mirror image, and finally rebuilds (the mirror image of) K by reversing the reduction. We show that every diagram of a prime link admits such a sequence. We further prove that the cluster variables in x have the same F-polynomials as the representations T(i). This establishes the important fact that our representations T(i) do indeed correspond to cluster variables in A. But it even establishes the much stronger result that these cluster variables are all compatible, in the sense that they form a cluster. We also prove that the representations T(i) have the following symmetry property. For all vertices i,j of Q, the dimension of T(i) at j is equal to the dimension of T(j) at i.


title: The Construction of Large-scale Structure Catalogs for the Dark Energy Spectroscopic Instrument

abstract: We present the technical details on how large-scale structure (LSS) catalogs are constructed from redshifts measured from spectra observed by the Dark Energy Spectroscopic Instrument (DESI). The LSS catalogs provide the information needed to determine the relative number density of DESI tracers as a function of redshift and celestial coordinates and, e.g., determine clustering statistics. We produce catalogs that are weighted subsamples of the observed data, each matched to a weighted `random' catalog that forms an unclustered sampling of the probability density that DESI could have observed those data at each location. Precise knowledge of the DESI observing history and associated hardware performance allows for a determination of the DESI footprint and the number of times DESI has covered it at sub-arcsecond level precision. This enables the completeness of any DESI sample to be modeled at this same resolution. The pipeline developed to create LSS catalogs has been designed to easily allow robustness tests and enable future improvements. We describe how it allows ongoing work improving the match between galaxy and random catalogs, such as including further information when assigning redshifts to randoms, accounting for fluctuations in target density, accounting for variation in the redshift success rate, and accommodating blinding schemes.


title: Training-Conditional Coverage Bounds under Covariate Shift

abstract: Training-conditional coverage guarantees in conformal prediction concern the concentration of the error distribution, conditional on the training data, below some nominal level. The conformal prediction methodology has recently been generalized to the covariate shift setting, namely, the covariate distribution changes between the training and test data. In this paper, we study the training-conditional coverage properties of a range of conformal prediction methods under covariate shift via a weighted version of the Dvoretzky-Kiefer-Wolfowitz (DKW) inequality tailored for distribution change. The result for the split conformal method is almost assumption-free, while the results for the full conformal and jackknife+ methods rely on strong assumptions including the uniform stability of the training algorithm.


title: An Evolutionary Framework for Connect-4 as Test-Bed for Comparison of Advanced Minimax, Q-Learning and MCTS

abstract: A major challenge in decision making domains with large state spaces is to effectively select actions which maximize utility. In recent years, approaches such as reinforcement learning (RL) and search algorithms have been successful to tackle this issue, despite their differences. RL defines a learning framework that an agent explores and interacts with. Search algorithms provide a formalism to search for a solution. However, it is often difficult to evaluate the performances of such approaches in a practical way. Motivated by this problem, we focus on one game domain, i.e., Connect-4, and develop a novel evolutionary framework to evaluate three classes of algorithms: RL, Minimax and Monte Carlo tree search (MCTS). The contribution of this paper is threefold: i) we implement advanced versions of these algorithms and provide a systematic comparison with their standard counterpart, ii) we develop a novel evaluation framework, which we call the Evolutionary Tournament, and iii) we conduct an extensive evaluation of the relative performance of each algorithm to compare our findings. We evaluate different metrics and show that MCTS achieves the best results in terms of win percentage, whereas Minimax and Q-Learning are ranked in second and third place, respectively, although the latter is shown to be the fastest to make a decision.


title: Protect-Your-IP: Scalable Source-Tracing and Attribution against Personalized Generation

abstract: With the advent of personalized generation models, users can more readily create images resembling existing content, heightening the risk of violating portrait rights and intellectual property (IP). Traditional post-hoc detection and source-tracing methods for AI-generated content (AIGC) employ proactive watermark approaches; however, these are less effective against personalized generation models. Moreover, attribution techniques for AIGC rely on passive detection but often struggle to differentiate AIGC from authentic images, presenting a substantial challenge. Integrating these two processes into a cohesive framework not only meets the practical demands for protection and forensics but also improves the effectiveness of attribution tasks. Inspired by this insight, we propose a unified approach for image copyright source-tracing and attribution, introducing an innovative watermarking-attribution method that blends proactive and passive strategies. We embed copyright watermarks into protected images and train a watermark decoder to retrieve copyright information from the outputs of personalized models, using this watermark as an initial step for confirming if an image is AIGC-generated. To pinpoint specific generation techniques, we utilize powerful visual backbone networks for classification. Additionally, we implement an incremental learning strategy to adeptly attribute new personalized models without losing prior knowledge, thereby enhancing the model's adaptability to novel generation methods. We have conducted experiments using various celebrity portrait series sourced online, and the results affirm the efficacy of our method in source-tracing and attribution tasks, as well as its robustness against knowledge forgetting.


title: Content and Salient Semantics Collaboration for Cloth-Changing Person Re-Identification

abstract: Cloth-changing person Re-IDentification (Re-ID) aims at recognizing the same person with clothing changes across non-overlapping cameras. Conventional person Re-ID methods usually bias the model's focus on cloth-related appearance features rather than identity-sensitive features associated with biological traits. Recently, advanced cloth-changing person Re-ID methods either resort to identity-related auxiliary modalities (e.g., sketches, silhouettes, keypoints and 3D shapes) or clothing labels to mitigate the impact of clothes. However, relying on unpractical and inflexible auxiliary modalities or annotations limits their real-world applicability. In this paper, we promote cloth-changing person Re-ID by effectively leveraging abundant semantics present within pedestrian images without the need for any auxiliaries. Specifically, we propose the Content and Salient Semantics Collaboration (CSSC) framework, facilitating cross-parallel semantics interaction and refinement. Our framework is simple yet effective, and the vital design is the Semantics Mining and Refinement (SMR) module. It extracts robust identity features about content and salient semantics, while mitigating interference from clothing appearances effectively. By capitalizing on the mined abundant semantic features, our proposed approach achieves state-of-the-art performance on three cloth-changing benchmarks as well as conventional benchmarks, demonstrating its superiority over advanced competitors.


title: Regularized Projection Matrix Approximation with Applications to Community Detection

abstract: This paper introduces a regularized projection matrix approximation framework aimed at recovering cluster information from the affinity matrix. The model is formulated as a projection approximation problem incorporating an entrywise penalty function. We explore three distinct penalty functions addressing bounded, positive, and sparse scenarios, respectively, and derive the Alternating Direction Method of Multipliers (ADMM) algorithm to solve the problem. Then, we provide a theoretical analysis establishing the convergence properties of the proposed algorithm. Extensive numerical experiments on both synthetic and real-world datasets demonstrate that our regularized projection matrix approximation approach significantly outperforms state-of-the-art methods in terms of clustering performance.


title: MCGMapper: Light-Weight Incremental Structure from Motion and Visual Localization With Planar Markers and Camera Groups

abstract: Structure from Motion (SfM) and visual localization in indoor texture-less scenes and industrial scenarios present prevalent yet challenging research topics. Existing SfM methods designed for natural scenes typically yield low accuracy or map-building failures due to insufficient robust feature extraction in such settings. Visual markers, with their artificially designed features, can effectively address these issues. Nonetheless, existing marker-assisted SfM methods encounter problems like slow running speed and difficulties in convergence; and also, they are governed by the strong assumption of unique marker size. In this paper, we propose a novel SfM framework that utilizes planar markers and multiple cameras with known extrinsics to capture the surrounding environment and reconstruct the marker map. In our algorithm, the initial poses of markers and cameras are calculated with Perspective-n-Points (PnP) in the front-end, while bundle adjustment methods customized for markers and camera groups are designed in the back-end to optimize the 6-DOF pose directly. Our algorithm facilitates the reconstruction of large scenes with different marker sizes, and its accuracy and speed of map building are shown to surpass existing methods. Our approach is suitable for a wide range of scenarios, including laboratories, basements, warehouses, and other industrial settings. Furthermore, we incorporate representative scenarios into simulations and also supply our datasets with pose labels to address the scarcity of quantitative ground-truth datasets in this research field. The datasets and source code are available on GitHub.


title: Image-Text-Image Knowledge Transferring for Lifelong Person Re-Identification with Hybrid Clothing States

abstract: With the continuous expansion of intelligent surveillance networks, lifelong person re-identification (LReID) has received widespread attention, pursuing the need of self-evolution across different domains. However, existing LReID studies accumulate knowledge with the assumption that people would not change their clothes. In this paper, we propose a more practical task, namely lifelong person re-identification with hybrid clothing states (LReID-Hybrid), which takes a series of cloth-changing and cloth-consistent domains into account during lifelong learning. To tackle the challenges of knowledge granularity mismatch and knowledge presentation mismatch that occurred in LReID-Hybrid, we take advantage of the consistency and generalization of the text space, and propose a novel framework, dubbed $Teata$, to effectively align, transfer and accumulate knowledge in an "image-text-image" closed loop. Concretely, to achieve effective knowledge transfer, we design a Structured Semantic Prompt (SSP) learning to decompose the text prompt into several structured pairs to distill knowledge from the image space with a unified granularity of text description. Then, we introduce a Knowledge Adaptation and Projection strategy (KAP), which tunes text knowledge via a slow-paced learner to adapt to different tasks without catastrophic forgetting. Extensive experiments demonstrate the superiority of our proposed $Teata$ for LReID-Hybrid as well as on conventional LReID benchmarks over advanced methods.


title: A CMDP-within-online framework for Meta-Safe Reinforcement Learning

abstract: Meta-reinforcement learning has widely been used as a learning-to-learn framework to solve unseen tasks with limited experience. However, the aspect of constraint violations has not been adequately addressed in the existing works, making their application restricted in real-world settings. In this paper, we study the problem of meta-safe reinforcement learning (Meta-SRL) through the CMDP-within-online framework to establish the first provable guarantees in this important setting. We obtain task-averaged regret bounds for the reward maximization (optimality gap) and constraint violations using gradient-based meta-learning and show that the task-averaged optimality gap and constraint satisfaction improve with task-similarity in a static environment or task-relatedness in a dynamic environment. Several technical challenges arise when making this framework practical. To this end, we propose a meta-algorithm that performs inexact online learning on the upper bounds of within-task optimality gap and constraint violations estimated by off-policy stationary distribution corrections. Furthermore, we enable the learning rates to be adapted for every task and extend our approach to settings with a competing dynamically changing oracle. Finally, experiments are conducted to demonstrate the effectiveness of our approach.


title: Multiple imputation of missing covariates when using the Fine-Gray model

abstract: The Fine-Gray model for the subdistribution hazard is commonly used for estimating associations between covariates and competing risks outcomes. When there are missing values in the covariates included in a given model, researchers may wish to multiply impute them. Assuming interest lies in estimating the risk of only one of the competing events, this paper develops a substantive-model-compatible multiple imputation approach that exploits the parallels between the Fine-Gray model and the standard (single-event) Cox model. In the presence of right-censoring, this involves first imputing the potential censoring times for those failing from competing events, and thereafter imputing the missing covariates by leveraging methodology previously developed for the Cox model in the setting without competing risks. In a simulation study, we compared the proposed approach to alternative methods, such as imputing compatibly with cause-specific Cox models. The proposed method performed well (in terms of estimation of both subdistribution log hazard ratios and cumulative incidences) when data were generated assuming proportional subdistribution hazards, and performed satisfactorily when this assumption was not satisfied. The gain in efficiency compared to a complete-case analysis was demonstrated in both the simulation study and in an applied data example on competing outcomes following an allogeneic stem cell transplantation. For individual-specific cumulative incidence estimation, assuming proportionality on the correct scale at the analysis phase appears to be more important than correctly specifying the imputation procedure used to impute the missing covariates.


title: Borel fields and measured fields of Polish spaces, Banach spaces, von Neumann algebras and C*-algebras

abstract: Several recent articles in operator algebras make a nontrivial use of the theory of measurable fields of von Neumann algebras $(M_x)_{x \in X}$ and related structures. This includes the associated field $(\text{Aut}\ M_x)_{x \in X}$ of automorphism groups and more general measurable fields of Polish groups with actions on Polish spaces. Nevertheless, a fully rigorous and at the same time sufficiently broad and flexible theory of such Borel fields and measurable fields is not available in the literature. We fill this gap in this paper and include a few counterexamples to illustrate the subtlety: for instance, for a Borel field $(M_x)_{x \in X}$ of von Neumann algebras, the field of Polish groups $(\text{Aut}\ M_x)_{x \in X}$ need not be Borel.


title: Intelligence as Computation

abstract: This paper proposes a specific conceptualization of intelligence as computation. This conceptualization is intended to provide a unified view for all disciplines of intelligence research. Already, it unifies several conceptualizations currently under investigation, including physical, neural, embodied, morphological, and mechanical intelligences. To achieve this, the proposed conceptualization explains the differences among existing views by different computational paradigms, such as digital, analog, mechanical, or morphological computation. Viewing intelligence as a composition of computations from different paradigms, the challenges posed by previous conceptualizations are resolved. Intelligence is hypothesized as a multi-paradigmatic computation relying on specific computational principles. These principles distinguish intelligence from other, non-intelligent computations. The proposed conceptualization implies a multi-disciplinary research agenda that is intended to lead to unified science of intelligence.


title: Demystify Mamba in Vision: A Linear Attention Perspective

abstract: Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba model shares surprising similarities with linear attention Transformer, which typically underperform conventional Transformer in practice. By exploring the similarities and disparities between the effective Mamba and subpar linear attention Transformer, we provide comprehensive analyses to demystify the key factors behind Mamba's success. Specifically, we reformulate the selective state space model and linear attention within a unified formulation, rephrasing Mamba as a variant of linear attention Transformer with six major distinctions: input gate, forget gate, shortcut, no attention normalization, single-head, and modified block design. For each design, we meticulously analyze its pros and cons, and empirically evaluate its impact on model performance in vision tasks. Interestingly, the results highlight the forget gate and block design as the core contributors to Mamba's success, while the other four designs are less crucial. Based on these findings, we propose a Mamba-Like Linear Attention (MLLA) model by incorporating the merits of these two key designs into linear attention. The resulting model outperforms various vision Mamba models in both image classification and high-resolution dense prediction tasks, while enjoying parallelizable computation and fast inference speed. Code is available at https://github.com/LeapLabTHU/MLLA.


title: Link Prediction on Textual Edge Graphs

abstract: Textual-edge Graphs (TEGs), characterized by rich text annotations on edges, are increasingly significant in network science due to their ability to capture rich contextual information among entities. Existing works have proposed various edge-aware graph neural networks (GNNs) or let language models directly make predictions. However, they often fall short of fully capturing the contextualized semantics on edges and graph topology, respectively. This inadequacy is particularly evident in link prediction tasks that require a comprehensive understanding of graph topology and semantics between nodes. In this paper, we present a novel framework - Link2Doc, designed especially for link prediction on textual-edge graphs. Specifically, we propose to summarize neighborhood information between node pairs as a human-written document to preserve both semantic and topology information. A self-supervised learning model is then utilized to enhance GNN's text-understanding ability from language models. Empirical evaluations, including link prediction, edge classification, parameter analysis, runtime comparison, and ablation studies, on four real-world datasets demonstrate that Link2Doc achieves generally better performance against existing edge-aware GNNs and pre-trained language models in predicting links on TEGs.


title: Salter's question on the image of the Burau representation of $B_3$

abstract: In 1974, Birman posed the question of under what conditions a matrix with Laurent polynomial entries is in the image of the Burau representation. In 1984, Squier observed that the matrices in the image are contained in a unitary group. In 2021, Salter formulated a specific question: whether the central quotient of the Burau image group is the central quotient of a certain subgroup of the unitary group. We solve this question negatively in the simplest nontrivial case, $n=3$, algorithmically constructing a counterexample.


title: Efficient Probabilistic Modeling of Crystallization at Mesoscopic Scale

abstract: Crystallization processes at the mesoscopic scale, where faceted, dendritic growth, and multigrain formation can be observed, are of particular interest within materials science and metallurgy. These processes are highly nonlinear, stochastic, and sensitive to small perturbations of system parameters and initial conditions. Methods for the simulation of these processes have been developed using discrete numerical models, but these are computationally expensive. This work aims to scale crystal growth simulation with a machine learning emulator. Specifically, autoregressive latent variable models are well suited for modeling the joint distribution over system parameters and the crystallization trajectories. However, successfully training such models is challenging due to the stochasticity and sensitivity of the system. Existing approaches consequently fail to produce diverse and faithful crystallization trajectories. In this paper, we introduce the Crystal Growth Neural Emulator (CGNE), a probabilistic model for efficient crystal growth emulation at the mesoscopic scale that overcomes these challenges. We validate CGNE results using the morphological properties of the crystals produced by numerical simulation. CGNE delivers a factor of 11 improvement in inference time and performance gains compared with recent state-of-the-art probabilistic models for dynamical systems.


title: Totally Greedy Sequences Defined by Second-Order Linear Recurrences With Constant Coefficients

abstract: The change-making problem consists of representing a certain amount of money with the least possible number of coins, from a given, pre-established set of denominations. The greedy algorithm works by choosing the coins of largest possible denomination first. This greedy strategy does not always produce the least number of coins, except when the set of denominations obeys certain properties. We call a set of denominations with these properties a greedy set. If the set of denominations is an infinite sequence, we call it totally greedy if every prefix subset is greedy. In this paper we investigate some totally greedy sequences arising from second-order linear recurrences with constant coefficients, as well as their subsequences, and we prove sufficient conditions under which these sequences are totally greedy.


title: The devil is in discretization discrepancy. Robustifying Differentiable NAS with Single-Stage Searching Protocol

abstract: Neural Architecture Search (NAS) has been widely adopted to design neural networks for various computer vision tasks. One of its most promising subdomains is differentiable NAS (DNAS), where the optimal architecture is found in a differentiable manner. However, gradient-based methods suffer from the discretization error, which can severely damage the process of obtaining the final architecture. In our work, we first study the risk of discretization error and show how it affects an unregularized supernet. Then, we present that penalizing high entropy, a common technique of architecture regularization, can hinder the supernet's performance. Therefore, to robustify the DNAS framework, we introduce a novel single-stage searching protocol, which is not reliant on decoding a continuous architecture. Our results demonstrate that this approach outperforms other DNAS methods by achieving 75.3% in the searching stage on the Cityscapes validation dataset and attains performance 1.1% higher than the optimal network of DCNAS on the non-dense search space comprising short connections. The entire training process takes only 5.5 GPU days due to the weight reuse, and yields a computationally efficient architecture. Additionally, we propose a new dataset split procedure, which substantially improves results and prevents architecture degeneration in DARTS.


title: What Cannot Be Implemented on Weak Memory?

abstract: We present a general methodology for establishing the impossibility of implementing certain concurrent objects on different (weak) memory models. The key idea behind our approach lies in characterizing memory models by their mergeability properties, identifying restrictions under which independent memory traces can be merged into a single valid memory trace. In turn, we show that the mergeability properties of the underlying memory model entail similar mergeability requirements on the specifications of objects that can be implemented on that memory model. We demonstrate the applicability of our approach to establish the impossibility of implementing standard distributed objects with different restrictions on memory traces on three memory models: strictly consistent memory, total store order, and release-acquire. These impossibility results allow us to identify tight and almost tight bounds for some objects, as well as new separation results between weak memory models, and between well-studied objects based on their implementability on weak memory models.


title: Decision support for sustainable forest harvest planning using multi-scenario multiobjective robust optimization

abstract: Sustainable forest management requires handling uncertainty introduced from various sources, considering different conflicting economic, environmental, and social objectives, and involving multiple decision-making periods. This study proposes an interactive and intuitive decision-support approach for sustainable, robust forest harvest scheduling in multiple periods in a short-term (6-12 months) planning horizon. The approach includes a novel multi-scenario multiobjective mixed-integer optimization problem that allows forest planners to separately study the trade-offs between demand satisfactions for multiple assortments in different planning periods. Moreover, it provides an intuitive robust analysis to support forest planners in dealing with uncertainty and investigating potential variations of the outcomes as the consequences of uncertainty in tactical forest planning problems. We validate the proposed decision-support approach in a Swedish case study with 250 forest stands, three assortments (pine, spruce, deciduous trees), and a twelve-month harvest planning horizon. We demonstrate how the proposed approach supports a forest practitioner in trade-offs and robust analyses and finding the most preferred robust solution.


title: RA: A machine based rational agent, Part 2, Preliminary test

abstract: A preliminary test of the software package RA is presented. The main focus of this test is to assess RA`s reasoning capabilities that are based on the formal system PECR. Particular attention is given to the finite computational resources of the real-world machine that define the environment within which programs are to be executed.


title: Self-Decomposable Laws Associated with General Tempered Stable (GTS) Distribution and their Simulation Applications

abstract: The paper describes the self-decomposable distribution and the background driving L\'evy process (BDLP) associated with the Generalized Tempered Stable (GTS) distribution. Two distributions are provided: the background driving L\'evy process (BDLP) of the GTS distribution and the self-decomposable distribution generated by the GTS distribution as BDLP. The derived self-decomposable distribution and the GTS distribution are used as stationary distribution in the Ornstein-Uhlenbeck type process. A simulation method, based on sampling the random integral representation, is applied to mimic S&P 500 Index and Bitcoin daily cumulative return process.


title: Rough geometric integration

abstract: We introduce a notion of distributional $k$-forms on $d$-dimensional manifolds which can be integrated against suitably regular $k$-submanifolds. Our approach combines ideas from Whitney's geometric integration [Whi57] with those of sewing approaches to rough integration [Gub04, FdLP06].


title: DPHGNN: A Dual Perspective Hypergraph Neural Networks

abstract: Message passing on hypergraphs has been a standard framework for learning higher-order correlations between hypernodes. Recently-proposed hypergraph neural networks (HGNNs) can be categorized into spatial and spectral methods based on their design choices. In this work, we analyze the impact of change in hypergraph topology on the suboptimal performance of HGNNs and propose DPHGNN, a novel dual-perspective HGNN that introduces equivariant operator learning to capture lower-order semantics by inducing topology-aware spatial and spectral inductive biases. DPHGNN employs a unified framework to dynamically fuse lower-order explicit feature representations from the underlying graph into the super-imposed hypergraph structure. We benchmark DPHGNN over eight benchmark hypergraph datasets for the semi-supervised hypernode classification task and obtain superior performance compared to seven state-of-the-art baselines. We also provide a theoretical framework and a synthetic hypergraph isomorphism test to express the power of spatial HGNNs and quantify the expressivity of DPHGNN beyond the Generalized Weisfeiler Leman (1-GWL) test. Finally, DPHGNN was deployed by our partner e-commerce company for the Return-to-Origin (RTO) prediction task, which shows ~7% higher macro F1-Score than the best baseline.


title: Four-nucleon clustering near the QCD critical point: theory versus experiment

abstract: This letter relates theoretical predictions made previously with recently announced RHIC BES-II experimental data on multi-baryon fluctuations. We conclude that new statistically significant effect is observed, and its features are in good agreement with predictions.


title: An efficient optimization model and tabu search-based global optimization approach for continuous p-dispersion problem

abstract: Continuous p-dispersion problems with and without boundary constraints are NP-hard optimization problems with numerous real-world applications, notably in facility location and circle packing, which are widely studied in mathematics and operations research. In this work, we concentrate on general cases with a non-convex multiply-connected region that are rarely studied in the literature due to their intractability and the absence of an efficient optimization model. Using the penalty function approach, we design a unified and almost everywhere differentiable optimization model for these complex problems and propose a tabu search-based global optimization (TSGO) algorithm for solving them. Computational results over a variety of benchmark instances show that the proposed model works very well, allowing popular local optimization methods (e.g., the quasi-Newton methods and the conjugate gradient methods) to reach high-precision solutions due to the differentiability of the model. These results further demonstrate that the proposed TSGO algorithm is very efficient and significantly outperforms several popular global optimization algorithms in the literature, improving the best-known solutions for several existing instances in a short computational time. Experimental analyses are conducted to show the influence of several key ingredients of the algorithm on computational performance.


title: Bringing UFUs Back into the Air With FUEL: A Framework for Evaluating the Effectiveness of Unrestricted File Upload Vulnerability Scanners

abstract: Unrestricted file upload (UFU) is a class of web security vulnerabilities that can have a severe impact on web applications if uploaded files are not sufficiently validated or securely handled. A review of related work shows an increased interest in finding new methods to discover such vulnerabilities. However, each publication evaluates its new vulnerability scanner against a different set of artificial or real-world applications available at the time of writing. Thus, we identify the need for a comprehensive testing framework to allow a reproducible comparison between existing and future UFU vulnerability scanners. Our contributions include the File Upload Exploitation Lab (FUEL), which models 15 distinct UFU vulnerabilities in isolated scenarios to enable a reproducible evaluation of UFU scanners' capabilities. The results of evaluating four black-box UFU scanners against FUEL show that no scanner manages to identify all UFU vulnerabilities, leaving real-world websites at risk of compromise due to false negatives. Our work aims to solve this problem by extending an existing UFU scanner with multiple new detection and exploitation techniques, which we call Fuxploider-NG, to increase its accuracy from ~50% to over 90%, thereby surpassing the capabilities of existing UFU scanners and showcasing the importance of FUEL as a UFU vulnerability evaluation framework. To foster open science and future work in this area, we open-source FUEL and Fuxploider-NG.


title: Error Performance Analysis of UAV-Mounted RIS for NOMA Systems with Practical Constraints

abstract: Uncrewed aerial vehicles (UAVs) have attracted recent attention for sixth-generation (6G) networks due to their low cost and flexible deployment. In order to maximize the ever-increasing data rates, spectral efficiency, and wider coverage, technologies such as reconfigurable intelligent surface (RIS) and non-orthogonal multiple access (NOMA) are adapted with UAVs (UAV-RIS NOMA). However, the error performance of UAV-RIS NOMA has not been considered, yet. In this letter, we investigate the error probability of UAV-RIS NOMA systems. We also consider the practical constraints of hardware impairments (HWI) at the transceivers, inter-cell interference (ICI), and imperfect successive interference cancellation (SIC). The analytical derivations are validated by Monte-Carlo simulations. Our results demonstrate that our proposed system achieves higher performance gain (more than 5 dB with increasing the number of RIS elements) with less error probability compared to UAVs without RIS. Moreover, it is found that the HWI, ICI, and imperfect SIC have shown a negative impact on the system performance.


title: Surface Code Stabilizer Measurements for Rydberg Atoms

abstract: We consider stabilizer measurements for surface codes with neutral atoms and identify gate protocols that minimize logical error rates in the presence of a fundamental error source -- spontaneous emission from Rydberg states. We demonstrate that logical error rates are minimized by protocols that prevent the propagation of Rydberg leakage errors and not by protocols that minimize the physical two-qubit error rate. We provide laser-pulse-level gate protocols to counter these errors. These protocols significantly reduce the logical error rate for implementations of surface codes involving one or two species of atoms. Our work demonstrates the importance of optimizing quantum gates for logical errors in addition to gate fidelities and opens the way to the efficient realization of surface codes with neutral atoms.


title: Mimicry and the Emergence of Cooperative Communication

abstract: In many situations, communication between agents is a critical component of cooperative multi-agent systems, however, it can be difficult to learn or evolve. In this paper, we investigate a simple way in which the emergence of communication may be facilitated. Namely, we explore the effects of when agents can mimic preexisting, externally generated useful signals. The key idea here is that these signals incentivise listeners to develop positive responses, that can then also be invoked by speakers mimicking those signals. This investigation starts with formalising this problem, and demonstrating that this form of mimicry changes optimisation dynamics and may provide the opportunity to escape non-communicative local optima. We then explore the problem empirically with a simulation in which spatially situated agents must communicate to collect resources. Our results show that both evolutionary optimisation and reinforcement learning may benefit from this intervention.


title: Graph neural networks with configuration cross-attention for tensor compilers

abstract: With the recent popularity of neural networks comes the need for efficient serving of inference workloads. A neural network inference workload can be represented as a computational graph with nodes as operators transforming multidimensional tensors. The tensors can be transposed and/or tiled in a combinatorially large number of ways, some configurations leading to accelerated inference. We propose TGraph, a neural graph architecture that allows screening for fast configurations of the target computational graph, thus representing an artificial intelligence (AI) tensor compiler in contrast to the traditional heuristics-based compilers. The proposed solution improves mean Kendall's $\tau$ across layout collections of TpuGraphs from 29.8% of the reliable baseline to 67.4% of TGraph. We estimate the potential CO$_2$ emission reduction associated with our work to be equivalent to over 50% of the total household emissions in the areas hosting AI-oriented data centers.


title: Constraining the physical properties of large-scale jets from black hole X-ray binaries and their impact on the local environment with blast-wave dynamical models

abstract: Relativistic discrete ejecta launched by black hole X-ray binaries (BH XRBs) can be observed to propagate up to parsec-scales from the central object. Observing the final deceleration phase of these jets is crucial to estimate their physical parameters and to reconstruct their full trajectory, with implications for the jet powering mechanism, composition and formation. In this paper we present the results of the modelling of the motion of the ejecta from three BH XRBs: MAXI J1820+070, MAXI J1535$-$571 and XTE J1752$-$223, for which high-resolution radio and X-ray observations of jets propagating up to $\sim$15 arcsec ($\sim$0.6 pc at 3 kpc) from the core have been published in the recent years. For each jet, we modeled its entire motion with a dynamical blast-wave model, inferring robust values for the jet Lorentz factor, inclination angle and ejection time. Under several assumptions associated to the ejection duration, the jet opening angle and the available accretion power, we are able to derive stringent constraints on the maximum jet kinetic energy for each source (between $10^{43}$ and $10^{44}$ erg, including also H1743$-$322), as well as placing interesting upper limits on the density of the ISM through which the jets are propagating (from $n_{\rm ISM} \lesssim 0.4$ cm$^{-3}$ down to $n_{\rm ISM} \lesssim 10^{-4}$ cm$^{-3}$). Overall, our results highlight the potential of applying models derived from gamma-ray bursts to the physics of jets from BH XRBs and support the emerging picture of these sources as preferentially embedded in low-density environments.


title: Few-shot Tuning of Foundation Models for Class-incremental Learning

abstract: For the first time, we explore few-shot tuning of vision foundation models for class-incremental learning. Unlike existing few-shot class incremental learning (FSCIL) methods, which train an encoder on a base session to ensure forward compatibility for future continual learning, foundation models are generally trained on large unlabelled data without such considerations. This renders prior methods from traditional FSCIL incompatible for FSCIL with the foundation model. To this end, we propose Consistency-guided Asynchronous Contrastive Tuning (CoACT), a new approach to continually tune foundation models for new classes in few-shot settings. CoACT comprises three components: (i) asynchronous contrastive tuning, which learns new classes by including LoRA modules in the pre-trained encoder, while enforcing consistency between two asynchronous encoders; (ii) controlled fine-tuning, which facilitates effective tuning of a subset of the foundation model; and (iii) consistency-guided incremental tuning, which enforces additional regularization during later sessions to reduce forgetting of the learned classes. We perform an extensive study on 16 diverse datasets and demonstrate the effectiveness of CoACT, outperforming the best baseline method by 2.47% on average and with up to 12.52% on individual datasets. Additionally, CoACT shows reduced forgetting and robustness in low-shot experiments. As an added bonus, CoACT shows up to 13.5% improvement in standard FSCIL over the current SOTA on benchmark evaluations. We make our code publicly available at https://github.com/ShuvenduRoy/CoACT-FSCIL.


title: Magnetized compressible turbulence with a fluctuation dynamo and Reynolds numbers over a million

abstract: Supersonic magnetohydrodynamic (MHD) turbulence is a ubiquitous state for many astrophysical plasmas. However, even the basic statistics for this type of turbulence remains uncertain. We present results from supersonic MHD turbulence simulations at unparalleled resolutions, with plasma Reynolds numbers of over a million. In the kinetic energy spectrum we find a break between the scales that are dominated by kinetic energy, with spectral index $-2$, and those that become strongly magnetized, with spectral index $-3/2$. By analyzing the Helmholtz decomposed kinetic energy spectrum, we find that the compressible modes are not passively mixed through the cascade of the incompressible modes. At high magnetic Reynolds number, above $10^5$, we find a power law in the magnetic energy spectrum with spectral index $-9/5$. On the strongly magnetized, subsonic scales the plasma tends to self-organize into locally relaxed regions, where there is strong alignment between the current density, magnetic field, velocity field and vorticity field, depleting both the nonlinearities and magnetic terms in the MHD equations, which we attribute to plasma relaxation on scales where the magnetic fluctuations evolve on shorter timescales than the velocity fluctuations. This process constrains the cascade to inhomogenous, volume-poor, fractal surfaces between relaxed regions, which has significant repercussions for understanding the nature of magnetized turbulence in astrophysical plasmas and the saturation of the fluctuation dynamo.

categories: astro-ph.GA astro-ph.SR physics.comp-ph physics.flu-dyn physics.plasm-ph


title: Tuning the Electronic and Optical Properties of Two-Dimensional Diboron-Porphyrin by Strain Engineering: A Density Functional Theory Investigation

abstract: In the present work, we have carried out DFT simulations to investigate the electronic and optical properties of a porphyrin-based 2D crystal named 2D Diboron-Porphyrin (2DDP). We showed that it is possible to use strain to tune the 2DDP electronic properties (from semiconductor to metal) depending on the direction of the applied strain. 2DDP exhibits optical activity from the infrared to the ultraviolet region. Similarly to electronic bands, strain can also modulate the optical activity response. 2DDP can be a promising candidate for some electro-opto-mechanical applications.


title: Competing for pixels: a self-play algorithm for weakly-supervised segmentation

abstract: Weakly-supervised segmentation (WSS) methods, reliant on image-level labels indicating object presence, lack explicit correspondence between labels and regions of interest (ROIs), posing a significant challenge. Despite this, WSS methods have attracted attention due to their much lower annotation costs compared to fully-supervised segmentation. Leveraging reinforcement learning (RL) self-play, we propose a novel WSS method that gamifies image segmentation of a ROI. We formulate segmentation as a competition between two agents that compete to select ROI-containing patches until exhaustion of all such patches. The score at each time-step, used to compute the reward for agent training, represents likelihood of object presence within the selection, determined by an object presence detector pre-trained using only image-level binary classification labels of object presence. Additionally, we propose a game termination condition that can be called by either side upon exhaustion of all ROI-containing patches, followed by the selection of a final patch from each. Upon termination, the agent is incentivised if ROI-containing patches are exhausted or disincentivised if an ROI-containing patch is found by the competitor. This competitive setup ensures minimisation of over- or under-segmentation, a common problem with WSS methods. Extensive experimentation across four datasets demonstrates significant performance improvements over recent state-of-the-art methods. Code: https://github.com/s-sd/spurl/tree/main/wss


title: On the M.Kac problem with augmented data

abstract: Let ${\Omega}$ be a bounded plane domain. As is known, the spectrum $0<\lambda_1<\lambda_2\leqslant\dots$ of its Dirichlet Laplacian $L=-\Delta{\upharpoonright}[H^2({\Omega})\cap H^1_0({\Omega})]$ does not determine ${\Omega}$ (up to isometry). By this, a reasonable version of the M.Kac problem is to augment the spectrum with relevant data that provide the determination. To give the spectrum is to represent $L$ in the form $\tilde L=\Phi L\Phi^*={\rm diag\,}\{\lambda_1,\lambda_2,\dots\}$ in the space ${\bf l}_2$, where $\Phi:L_2({\Omega})\to{\bf l}_2$ is the Fourier transform. Let ${\mathscr K}=\{h\in L_2({\Omega})\,|\,\,\Delta h=0\,\,{\rm in}\,\,{\Omega}\}$ be the harmonic function subspace, $\tilde{\mathscr K}=\Phi{\mathscr K}\subset{\bf l}_2$. We show that, in a generic case, the pair $\tilde L,\tilde {\mathscr K}$ determines ${\Omega}$ up to isometry, what holds not only for the plain domains (drums) but for the compact Riemannian manifolds of arbitrary dimension, metric, and topology. Thus, the subspace $\tilde{\mathscr K}\subset{\bf l}_2$ augments the spectrum, making the problem uniquely solvable.


title: Bayesian Inference with Deep Weakly Nonlinear Networks

abstract: We show at a physics level of rigor that Bayesian inference with a fully connected neural network and a shaped nonlinearity of the form $\phi(t) = t + \psi t^3/L$ is (perturbatively) solvable in the regime where the number of training datapoints $P$ , the input dimension $N_0$, the network layer widths $N$, and the network depth $L$ are simultaneously large. Our results hold with weak assumptions on the data; the main constraint is that $P < N_0$. We provide techniques to compute the model evidence and posterior to arbitrary order in $1/N$ and at arbitrary temperature. We report the following results from the first-order computation: 1. When the width $N$ is much larger than the depth $L$ and training set size $P$, neural network Bayesian inference coincides with Bayesian inference using a kernel. The value of $\psi$ determines the curvature of a sphere, hyperbola, or plane into which the training data is implicitly embedded under the feature map. 2. When $LP/N$ is a small constant, neural network Bayesian inference departs from the kernel regime. At zero temperature, neural network Bayesian inference is equivalent to Bayesian inference using a data-dependent kernel, and $LP/N$ serves as an effective depth that controls the extent of feature learning. 3. In the restricted case of deep linear networks ($\psi=0$) and noisy data, we show a simple data model for which evidence and generalization error are optimal at zero temperature. As $LP/N$ increases, both evidence and generalization further improve, demonstrating the benefit of depth in benign overfitting.

categories: stat.ML cs.AI cs.LG math.PR physics.data-an


title: Let Silence Speak: Enhancing Fake News Detection with Generated Comments from Large Language Models

abstract: Fake news detection plays a crucial role in protecting social media users and maintaining a healthy news ecosystem. Among existing works, comment-based fake news detection methods are empirically shown as promising because comments could reflect users' opinions, stances, and emotions and deepen models' understanding of fake news. Unfortunately, due to exposure bias and users' different willingness to comment, it is not easy to obtain diverse comments in reality, especially for early detection scenarios. Without obtaining the comments from the ``silent'' users, the perceived opinions may be incomplete, subsequently affecting news veracity judgment. In this paper, we explore the possibility of finding an alternative source of comments to guarantee the availability of diverse comments, especially those from silent users. Specifically, we propose to adopt large language models (LLMs) as a user simulator and comment generator, and design GenFEND, a generated feedback-enhanced detection framework, which generates comments by prompting LLMs with diverse user profiles and aggregating generated comments from multiple subpopulation groups. Experiments demonstrate the effectiveness of GenFEND and further analysis shows that the generated comments cover more diverse users and could even be more effective than actual comments.


title: Computational Investigation of Reactivity Parameters, UV-Vis and IR Spectra, NLO Properties, and Temperature-Dependent Thermodynamic Characteristics of Schiff-Based Interdigitated 5O.m (m=14,16) Liquid Crystalline Compounds: A DFT Analysis

abstract: The article studies the different physical, vibrational, nonlinear optical, and thermodynamical properties of higher homologs 5O.m (m = 14,16) liquid crystalline compounds using density functional theory. The optimized structure of 5O.m (m= 14,16) liquid crystals was obtained by using density functional theory (DFT) with B3LYP functional and standard basis set 6-31G (d, p). The Infrared spectra (IR), various physical properties such as HOMO-LUMO, nonlinear optical properties (NLO), reactivity parameters, relative energy gaps, and electrostatic potential function are computed and analyzed using the optimized structure of 5O liquid crystal. The time-dependent density functional theory (TD-DFT) has been used to analyze and obtain UV-Vis spectra for both LC compounds. It is observed that the 5O.m (m=14,16) liquid crystals are showing the lower value of HOMO-LUMO energy gaps as 4.17ev which resulted in some highly fascinating optical and physical properties. Using DFT excellent agreement is observed between all spectrum patterns and the simulated UV-Vis and IR spectra. This article, however, also discussed temperature-dependent thermodynamical properties such as zero-point vibrational energy (ZPVE), total thermal energy, total specific heat capacity, rotational constants, and total entropy which enable us to understand the phase transition behavior and specific transition temperatures of different phases


title: Random walks on edge colored random graphs

abstract: We consider random walks on edge coloured random graphs, where the colour of an edge reflects the cost of using it. In the simplest instance, the edges are coloured red or blue. Blue edges are free to use, whereas red edges incur a unit cost every time they are traversed.


title: Fast and Globally Consistent Normal Orientation based on the Winding Number Normal Consistency

abstract: Estimating a consistently oriented normal vector field for an unoriented point cloud enables a number of important downstream applications in computer graphics. While normal estimation for a small patch of points can be done with simple techniques like principal component analysis (PCA), orienting these normals to be globally consistent has been a notoriously difficult problem. Some recent methods exploit various properties of the winding number formula to achieve global consistency with state-of-the-art performance. Despite their exciting progress, these algorithms either have high space/time complexity, or do not produce accurate and consistently oriented normals for imperfect data. In this paper, we derive a novel property from the winding number formula to tackle this problem: the normal consistency property of the winding number formula. We refer to this property as the winding number normal consistency (WNNC). The derived property is based on the simple observation that the normals (negative gradients) sampled from the winding number field should be codirectional to the normals used to compute the winding number field. We further propose to turn the WNNC property into a normal update formula, which leads to an embarrassingly simple yet effective iterative algorithm that allows fast and high-quality convergence to a globally consistent normal vector field. Furthermore, our proposed algorithm only involves repeatedly evaluating the winding number formula and its derivatives, which can be accelerated and parallelized using treecode-based approximation algorithms due to their special structures. Exploiting this fact, we implement a GPU-accelerated treecode-based solver. Our GPU (and even CPU) implementation can be significantly faster than the recent state-of-the-art methods for normal orientation from raw points.


title: Compressing Lengthy Context With UltraGist

abstract: Compressing lengthy context is a critical but technically challenging problem. In this paper, we propose a new method called UltraGist, which is distinguished for its high-quality compression of lengthy context due to the innovative design of the compression and learning algorithm. UltraGist brings forth the following important benefits. Firstly, it notably contributes to the flexibility of compression, as it can be effectively learned to support a broad range of context lengths and compression ratios. Secondly, it helps to produce fine-grained compression for the lengthy context, where each small segment of the context is progressively processed on top of a tailored cross-attention mechanism. Thirdly, it makes the training process sample-efficient and thus maximizes the use of training data. Finally, it facilitates the efficient running of compression for dynamic context, as the compression result can be progressively generated and hence incrementally updated. UltraGist is evaluated on a wide variety of tasks associated with lengthy context, such as document QA and summarization, few-shot learning, multi-session conversation, et al. Whilst the existing methods fail to handle these challenging scenarios, our approach is able to preserve a near-lossless compression performance throughout all the evaluations. Our data, model, and code have been released at \url{https://github.com/namespace-Pt/UltraGist}.


title: A probabilistic approach to continuous differentiability of optimal stopping boundaries

abstract: We obtain the first probabilistic proof of continuous differentiability of time-dependent optimal boundaries in optimal stopping problems. The underlying stochastic dynamics is a one-dimensional, time-inhomogeneous diffusion. The gain function is also time-inhomogeneous and not necessarily smooth. Moreover, we include state-dependent discount rate and the time-horizon can be either finite or infinite. Our arguments of proof are of a local nature that allows us to obtain the result under more general conditions than those used in the PDE literature. As a byproduct of our main result we also obtain the first probabilistic proof of the link between the value function of an optimal stopping problem and the solution of the Stefan's problem.


title: Geometric translations of $(\varphi,\Gamma)$-modules for $\mathrm{GL}_2(\mathbb{Q}_p)$

abstract: We study ``change of weights'' maps between loci of the stack of $(\varphi,\Gamma)$-modules over the Robba ring with integral Hodge-Tate-Sen weights. We show that in the $\mathrm{GL}_2(\mathbb{Q}_p)$ case these maps can realize translations of $(\varphi,\Gamma)$-modules geometrically. The motivation is to investigate translations of locally analytic representations under the categorical $p$-adic Langlands correspondence.


title: Parametrization of Formal Norm Compatible Sequences

abstract: We give a classification of power series parametrizing Lubin-Tate trace compatible sequences. This proof answers a question posed in the literature by Berger and Fourquaux. Lubin-Tate trace compatible sequences are a generalization of norm compatible sequences, which arise in Iwasawa theory and local class field theory. The result we prove generalizes the interpolation theorem proved by Coleman in the classical norm compatible sequence case. We also, jointly with Victor Kolyvagin, give a method for finding such series explicitly in certain special cases.


title: A unified law of robustness for Bregman divergence losses

abstract: In contemporary deep learning practice, models are often trained to near zero loss i.e. to nearly interpolate the training data. However, the number of parameters in the model is usually far more than the number of data points $n$, the theoretical minimum needed for interpolation: a phenomenon referred to as overparameterization. In an interesting piece of work that contributes to the considerable research that has been devoted to understand overparameterization, Bubeck, and Sellke showed that for a broad class of covariate distributions (specifically those satisfying a natural notion of concentration of measure), overparameterization is necessary for robust interpolation i.e. if the interpolating function is required to be Lipschitz. However, their robustness results were proved only in the setting of regression with square loss. In practice, however many other kinds of losses are used, e.g. cross entropy loss for classification. In this work, we generalize Bubeck and Selke's result to Bregman divergence losses, which form a common generalization of square loss and cross-entropy loss. Our generalization relies on identifying a bias variance-type decomposition that lies at the heart of the proof and Bubeck and Sellke.


title: A Survey of Multimodal Large Language Model from A Data-centric Perspective

abstract: Human beings perceive the world through diverse senses such as sight, smell, hearing, and touch. Similarly, multimodal large language models (MLLMs) enhance the capabilities of traditional large language models by integrating and processing data from multiple modalities including text, vision, audio, video, and 3D environments. Data plays a pivotal role in the development and refinement of these models. In this survey, we comprehensively review the literature on MLLMs from a data-centric perspective. Specifically, we explore methods for preparing multimodal data during the pretraining and adaptation phases of MLLMs. Additionally, we analyze the evaluation methods for datasets and review benchmarks for evaluating MLLMs. Our survey also outlines potential future research directions. This work aims to provide researchers with a detailed understanding of the data-driven aspects of MLLMs, fostering further exploration and innovation in this field.


title: Around subgroups of Artin groups: derived subgroups and acylindrical hyperbolicity in the even FC-case

abstract: We generalize to (certain) Artin groups some results previously known for right-angled Artin groups (RAAGs). First, we generalize a result by Droms, B. Servatius, and H. Servatius, and prove that the derived subgroup of an Artin group is free if and only if the group is coherent. Second, coherent Artin groups over non complete graphs split as free amalgamated products along free abelian subgroups, and we extend to arbitrary Artin groups admitting such a splitting a recent result by Casals-Ruiz and the first author on finitely generated normal subgroups of RAAGs. Finally, we use splittings of even Artin groups of FC-type to generalize results of Minasyan and Osin on acylindrical hyperbolicity of their subgroups.


title: Pick up the PACE: A Parameter-Free Optimizer for Lifelong Reinforcement Learning

abstract: A key challenge in lifelong reinforcement learning (RL) is the loss of plasticity, where previous learning progress hinders an agent's adaptation to new tasks. While regularization and resetting can help, they require precise hyperparameter selection at the outset and environment-dependent adjustments. Building on the principled theory of online convex optimization, we present a parameter-free optimizer for lifelong RL, called PACE, which requires no tuning or prior knowledge about the distribution shifts. Extensive experiments on Procgen, Atari, and Gym Control environments show that PACE works surprisingly well$\unicode{x2013}$mitigating loss of plasticity and rapidly adapting to challenging distribution shifts$\unicode{x2013}$despite the underlying optimization problem being nonconvex and nonstationary.