title: Topological Phase Diagram of Optimally Shaken Honeycomb Lattices: A Dual Perspective from Stroboscopic and Non-Stroboscopic Floquet Hamiltonians

abstract: We present a direct comparison between the stroboscopic and non-stroboscopic effective approaches for ultracold atoms in shaken honeycomb lattices, focusing specifically on the optimal driving introduced by A. Verdeny and F. Mintert [Phys. Rev. A 92, 063615 (2015)]. In the fast-driving regime, we compare the effective non-stroboscopic Hamiltonian derived through a perturbative expansion with a non-perturbative calculation of the stroboscopic Floquet Hamiltonian, obtained through a simple non-perturbative numerical approach. We show that while some of the tunneling parameters are inherently model-dependent, the topological properties of the system remains robust, as expected. Using the same numerical approach we compute the topological phase diagram, arguing that it is most effectively represented in terms of the physical parameters characterizing the driving and the bare Hamiltonian -- parameters directly accessible in experiments -- rather than the emergent tunneling parameters, that depend on the model representation.


title: A Spatiotemporal Illumination Model for 3D Image Fusion in Optical Coherence Tomography

abstract: Optical coherence tomography (OCT) is a non-invasive, micrometer-scale imaging modality that has become a clinical standard in ophthalmology. By raster-scanning the retina, sequential cross-sectional image slices are acquired to generate volumetric data. In-vivo imaging suffers from discontinuities between slices that show up as motion and illumination artifacts. We present a new illumination model that exploits continuity in orthogonally raster-scanned volume data. Our novel spatiotemporal parametrization adheres to illumination continuity both temporally, along the imaged slices, as well as spatially, in the transverse directions. Yet, our formulation does not make inter-slice assumptions, which could have discontinuities. This is the first optimization of a 3D inverse model in an image reconstruction context in OCT. Evaluation in 68 volumes from eyes with pathology showed reduction of illumination artifacts in 88\% of the data, and only 6\% showed moderate residual illumination artifacts. The method enables the use of forward-warped motion corrected data, which is more accurate, and enables supersampling and advanced 3D image reconstruction in OCT.


title: Intrinsic anomalous Hall effects in altermagnets

abstract: We study the anomalous Hall effect arising from the altermagnetic order and spin-orbit interaction in doped FeSb$_2$. To investigate the anomalous transport, we have constructed a tight-binding model of FeSb$_2$. We separately considered the constraints imposed on the model parameters by the spin symmetry group and magnetic symmetry group at zero and finite spin-orbit interaction, respectively. The resulting model includes the effect of exchange splitting and is applicable at both zero and finite spin-orbit interaction. In the case of spin symmetry, the analysis covers the spin-only subgroup arising from collinear magnetism, as well as non-trivial symmetry elements. This allows us to explore changes in the hopping amplitudes as symmetry is reduced by spin-orbit interaction from the spin group to the magnetic group. While the anomalous Hall effect is forbidden by spin symmetry, it is allowed by the symmetries of the magnetic group. The intrinsic Hall conductivity is shown to vanish linearly with spin-orbit interaction. This non-analytic behavior is universal to altermagnets. It originates from the singularity of the Berry curvature localized along lines on a Fermi surface confined to symmetry planes. These planes host spin degeneracy protected by spin symmetry, which is lifted by spin-orbit interaction.


title: Discrete Morse theory for open complexes

abstract: We develop a discrete Morse theory for open simplicial complexes $K=X\setminus T$ where $X$ is a simplicial complex and $T$ a subcomplex of $X$. A discrete Morse function $f$ on $K$ gives rise to a discrete Morse function on the order complex $S_K$ of $K$, and the topology change determined by $f$ on $K$ can be understood by analyzing the the topology change determined by the discrete Morse function on $S_K$. This topology change is given by a structure theorem on the level subcomplexes of $S_K$. Finally, we show that the Borel-Moore homology of $K$, a homology theory for locally compact spaces, is isomorphic to the homology induced by a gradient vector field on $K$ and deduce corresponding weak Morse inequalities.


title: Still mystery after all these years -- Unconventional superconductivity of Sr2RuO4 --

abstract: This review describes recent significant research developments made on the layered perovskite Sr2RuO4 and discusses current issues from both experimental and theoretical perspectives. Since the discovery of superconductivity in Sr2RuO4 in 1994, studies using high-quality single crystals quickly revealed it to be an archetypal unconventional superconductor among strongly correlated electron systems. In particular, it was thought that the spin-triplet chiral p-wave superconducting state, which breaks time-reversal symmetry, was a prominent possibility. In 2019, however, a new development overturned the past experimental results, and spin-singlet-like behavior became conclusive. Furthermore, innovation in uniaxial strain devices has stimulated researchers to explore changes in the superconducting state by controlling the symmetry and dimensionality of the Fermi surfaces and enhancing the superconducting transition temperature Tc from 1.5 K to 3.5 K. A spin-singlet chiral d-wave superconducting state is consistent with most of these recent experimental results. Nevertheless, there are still unnatural aspects that remain to be explained. The focus of this review is on unraveling this mystery. Unlike many other unconventional superconductors, the normal state of Sr2RuO4 exhibits typical Fermi liquid behavior. Nevertheless, to elucidate its superconducting state, it may be essential to go beyond the traditional framework of unconventional superconductivity and recast the theory explicitly considering the multi-orbital aspects of its electronic states. In this review, we describe the frontiers of superconductivity research in Sr2RuO4 and discuss how the remaining issues may be resolved.


title: DualView: Data Attribution from the Dual Perspective

abstract: Local data attribution (or influence estimation) techniques aim at estimating the impact that individual data points seen during training have on particular predictions of an already trained Machine Learning model during test time. Previous methods either do not perform well consistently across different evaluation criteria from literature, are characterized by a high computational demand, or suffer from both. In this work we present DualView, a novel method for post-hoc data attribution based on surrogate modelling, demonstrating both high computational efficiency, as well as good evaluation results. With a focus on neural networks, we evaluate our proposed technique using suitable quantitative evaluation strategies from the literature against related principal local data attribution methods. We find that DualView requires considerably lower computational resources than other methods, while demonstrating comparable performance to competing approaches across evaluation metrics. Futhermore, our proposed method produces sparse explanations, where sparseness can be tuned via a hyperparameter. Finally, we showcase that with DualView, we can now render explanations from local data attributions compatible with established local feature attribution methods: For each prediction on (test) data points explained in terms of impactful samples from the training set, we are able to compute and visualize how the prediction on (test) sample relates to each influential training sample in terms of features recognized and by the model. We provide an Open Source implementation of DualView online, together with implementations for all other local data attribution methods we compare against, as well as the metrics reported here, for full reproducibility.


title: Vacancy-Induced Topological Fano Resonance in Kane-Mele Nanoribbons: Design, Control, and Sensing Applications

abstract: The concept of topological Fano resonance, characterized by an ultrasharp asymmetric line shape, is a promising candidate for robust sensing applications due to its sensitivity to external parameters and immunity to structural disorder. In this study, the vacancy-induced topological Fano resonance in a nanoribbon made up of a hexagonal lattice with armchair sides is examined by introducing several on-site vacancies, which are deliberately created at regular distances, along a zigzag chain that stretches across the width of the ribbon. The presence of the on-site vacancies can create localized energy states within the electronic band structure, leading to the formation of an impurity band, which can result in Fano resonance phenomena by forming a conductivity channel between the edge modes on both armchair sides of the ribbon. Consequently, an ultracompact tunable on-chip integrated topological Fano resonance derived from the graphene-based nanomechanical phononic crystals is proposed. The Fano resonance arises from the interference between topologically protected even and odd edge modes at the interface between trivial and nontrivial insulators in a nanoribbon structure governed by the Kane-Mele model describing the quantum spin Hall effect in hexagonal lattices. The simulation of the topological Fano resonance is performed analytically using the Lippmann-Schwinger scattering formulation. One of the advantages of the present study is that the related calculations are carried out analytically, and in addition to the simplicity and directness, it reproduces the results obtained from the Landauer-B\"{u}ttiker formulation very well both quantitatively and qualitatively. The findings open up possibilities for the design of highly sensitive and accurate robust sensors for detecting extremely tiny forces, masses, and spatial positions.


title: TASTE V. A new ground-based investigation of orbital decay in the ultra-hot Jupiter WASP-12b

abstract: The discovery of the first transiting hot Jupiters (HJs; giant planets on orbital periods shorter than $P\sim10$ days) was announced more than twenty years ago. As both ground- and space-based follow-up observations are piling up, we are approaching the temporal baseline required to detect secular variations in their orbital parameters. In particular, several recent studies focused on constraining the efficiency of the tidal decay mechanism to better understand the evolutionary time scales of HJ migration and engulfment. This can be achieved by measuring a monotonic decrease of orbital period $\mathrm{d}P/\mathrm{d}t<0$ due to mechanical energy being dissipated by tidal friction. WASP-12b was the first HJ for which a tidal decay scenario appeared convincing, even though alternative explanations have been hypothesized. Here we present a new analysis based on 28 unpublished high-precision transit light curves gathered over a twelve-year baseline and combined with all the available archival data, and an updated set of stellar parameters from HARPS-N high-resolution spectra, which are consistent with a main sequence scenario, close to the hydrogen exhaustion in the core. Our values of $\mathrm{d}P/\mathrm{d}t$ = $-30.72 \pm 2.67$ and $Q_{\ast}^{'}$ = $(2.13 \pm 0.18) \times 10^{5}$ are statistically consistent with previous studies, and indicate that WASP-12 is undergoing fast tidal dissipation. We additionally report the presence of an excess scatter in the timing data and discuss its possible origin.


title: Evaluating Image Review Ability of Vision Language Models

abstract: Large-scale vision language models (LVLMs) are language models that are capable of processing images and text inputs by a single model. This paper explores the use of LVLMs to generate review texts for images. The ability of LVLMs to review images is not fully understood, highlighting the need for a methodical evaluation of their review abilities. Unlike image captions, review texts can be written from various perspectives such as image composition and exposure. This diversity of review perspectives makes it difficult to uniquely determine a single correct review for an image. To address this challenge, we introduce an evaluation method based on rank correlation analysis, in which review texts are ranked by humans and LVLMs, then, measures the correlation between these rankings. We further validate this approach by creating a benchmark dataset aimed at assessing the image review ability of recent LVLMs. Our experiments with the dataset reveal that LVLMs, particularly those with proven superiority in other evaluative contexts, excel at distinguishing between high-quality and substandard image reviews.


title: Almost sure convergence rates of adaptive increasingly rare Markov chain Monte Carlo

abstract: We consider adaptive increasingly rare Markov chain Monte Carlo (AIR MCMC), which is an adaptive MCMC method, where the adaptation concerning the past happens less and less frequently over time. Under a contraction assumption for a Wasserstein-like function we deduce upper bounds of the convergence rate of Monte Carlo sums taking a renormalisation factor into account that is close to the one that appears in a law of the iterated logarithm. We demonstrate the applicability of our results by considering different settings, among which are those of simultaneous geometric and uniform ergodicity. All proofs are carried out on an augmented state space, including the classical non-augmented setting as a special case. In contrast to other adaptive MCMC limit theory, some technical assumptions, like diminishing adaptation, are not needed.


title: Polylogarithmic Time Algorithms for Shortest Path Forests in Programmable Matter

abstract: In this paper, we study the computation of shortest paths within the \emph{geometric amoebot model}, a commonly used model for programmable matter. Shortest paths are essential for various tasks and therefore have been heavily investigated in many different contexts. For example, in the programmable matter context, which is the focus of this paper, Kostitsyna et al. have utilized shortest path trees to transform one amoebot structure into another [DISC, 2023]. We consider the \emph{reconfigurable circuit extension} of the model where this amoebot structure is able to interconnect amoebots by so-called circuits. These circuits permit the instantaneous transmission of simple signals between connected amoebots. We propose two distributed algorithms for the \emph{shortest path forest problem} where, given a set of $k$ sources and a set of $\ell$ destinations, the amoebot structure has to compute a forest that connects each destination to its closest source on a shortest path. For hole-free structures, the first algorithm constructs a shortest path tree for a single source within $O(\log \ell)$ rounds, and the second algorithm a shortest path forest for an arbitrary number of sources within $O(\log n \log^2 k)$ rounds. The former algorithm also provides an $O(1)$ rounds solution for the \emph{single pair shortest path problem} (SPSP) and an $O(\log n)$ rounds solution for the \emph{single source shortest path problem} (SSSP) since these problems are special cases of the considered problem.


title: Brownian oscillator with time-dependent strength: a delta function protocol

abstract: We consider a classical Brownian oscillator of mass $m$ driven from an arbitrary initial state by varying the stiffness $k(t)$ of the harmonic potential according to the protocol $k(t)=k_0+a\,\delta(t)$, involving the Dirac delta function. The microscopic work performed on the oscillator is shown to be $W=(a^2/2m)\,q^2-a q v$, where $q$ and $v$ are the coordinate and velocity in the initial state. If the initial distribution of $q$ and $v$ is the equilibrium one with temperature $T$, the average work is $\langle W \rangle=a^2T/(2m\,k_0)$ and the distribution $f(W)$ has the form of the product of exponential and modified Bessel functions. The distribution is asymmetric and diverges as $W\to 0$. The system's response for $t>0$ is evaluated for specific models.


title: On General fiber product rings, Poincar\'e series and their structure

abstract: The present paper deals with the investigation of the structure of general fiber product rings $R\times_TS$, where $R$, $S$ and $T$ are local rings with common residue field. We show that the Poincar\'e series of any $R$-module over the fiber product ring $R\times_TS$ is bounded by a rational function. In addition, we give a description of ${\rm depth}(R\times_TS)$, which is an open problem in this theory. As a biproduct, using the characterization of the Betti numbers over $R\times_TS$ obtained, we provide certain cases of the Cohen-Macaulayness of $R\times_TS$ and, in particular, we show that $R\times_TS$ is always non-regular. Some positive answers for the Buchsbaum-Eisenbud-Horrocks and Total rank conjectures over $R\times_TS$ are also established.


title: Development of a cylindrical mirror analyzer electron spectrometer and associated data acquisition system to study inner shell electron emission following ion-atom collision

abstract: In this paper we report on the development and performance of a cylindrical mirror analyser electron spectrometer for ion atom collision experiments. A low cost data acquisition system using Arduino microcontroller has also been developed and tested. We have measured the Auger emission spectra for various gaseous targets in collision with 1 MeV proton beams. Relative total Auger emission cross sections have also been measured for N2 molecular target as a function of proton energy.


title: Rate-Splitting Multiple Access for Transmissive Reconfigurable Intelligent Surface Transceiver Empowered ISAC System

abstract: In this paper, a novel transmissive reconfigurable intelligent surface (TRIS) transceiver empowered integrated sensing and communications (ISAC) system is proposed for future multi-demand terminals. To address interference management, we implement rate-splitting multiple access (RSMA), where the common stream is independently designed for the sensing service. We introduce the sensing quality of service (QoS) criteria based on this structure and construct an optimization problem with the sensing QoS criteria as the objective function to optimize the sensing stream precoding matrix and the communication stream precoding matrix. Due to the coupling of optimization variables, the formulated problem is a non-convex optimization problem that cannot be solved directly. To tackle the above-mentioned challenging problem, alternating optimization (AO) is utilized to decouple the optimization variables. Specifically, the problem is decoupled into three subproblems about the sensing stream precoding matrix, the communication stream precoding matrix, and the auxiliary variables, which is solved alternatively through AO until the convergence is reached. For solving the problem, successive convex approximation (SCA) is applied to deal with the sum-rate threshold constraints on communications, and difference-of-convex (DC) programming is utilized to solve rank-one non-convex constraints. Numerical simulation results verify the superiority of the proposed scheme in terms of improving the communication and sensing QoS.


title: 3D Vascular Segmentation Supervised by 2D Annotation of Maximum Intensity Projection

abstract: Vascular structure segmentation plays a crucial role in medical analysis and clinical applications. The practical adoption of fully supervised segmentation models is impeded by the intricacy and time-consuming nature of annotating vessels in the 3D space. This has spurred the exploration of weakly-supervised approaches that reduce reliance on expensive segmentation annotations. Despite this, existing weakly supervised methods employed in organ segmentation, which encompass points, bounding boxes, or graffiti, have exhibited suboptimal performance when handling sparse vascular structure. To alleviate this issue, we employ maximum intensity projection (MIP) to decrease the dimensionality of 3D volume to 2D image for efficient annotation, and the 2D labels are utilized to provide guidance and oversight for training 3D vessel segmentation model. Initially, we generate pseudo-labels for 3D blood vessels using the annotations of 2D projections. Subsequently, taking into account the acquisition method of the 2D labels, we introduce a weakly-supervised network that fuses 2D-3D deep features via MIP to further improve segmentation performance. Furthermore, we integrate confidence learning and uncertainty estimation to refine the generated pseudo-labels, followed by fine-tuning the segmentation network. Our method is validated on five datasets (including cerebral vessel, aorta and coronary artery), demonstrating highly competitive performance in segmenting vessels and the potential to significantly reduce the time and effort required for vessel annotation. Our code is available at: https://github.com/gzq17/Weakly-Supervised-by-MIP.


title: Modified RRT* for Path Planning in Autonomous Driving

abstract: Essential tasks in autonomous driving includes environment perception, detection and tracking, path planning and action control. This paper focus on path planning, which is one of the challenging task as it needs to find optimal path in highly complex and dynamic environments. Usually, a driving scenario has large number of obstacles in their route. In this paper, we propose a two-stage path planning algorithm named Angle-based Directed Rapidly exploring Random Trees (AD-RRT*) to address the problem of optimal path in complex environment. The proposed algorithm uses A* algorithm for global path planning and modifies RRT* to bound the samples using angle. The efficiency of the proposed algorithm is evaluated through experiments in different scenarios based on the location and number of obstacles. The proposed algorithm showed higher rate of convergence with reduced time and less number of nodes than the base RRT* algorithm.


title: Factor Machine: Mixed-signal Architecture for Fine-Grained Graph-Based Computing

abstract: This paper proposes the design and implementation strategy of a novel computing architecture, the Factor Machine. The work is a step towards a general-purpose parallel system operating in a non-sequential manner, exploiting processing/memory co-integration and replacing the traditional Turing/von Neumann model of a computer system with a framework based on "factorised computation". This architecture is inspired by neural information processing principles and aims to progress the development of brain-like machine intelligence systems, through providing a computing substrate designed from the ground up to enable efficient implementations of algorithms based on relational networks. The paper provides a rationale for such machine, in the context of the history of computing, and more recent developments in neuromorphic hardware, reviews its general features, and proposes a mixed-signal hardware implementation, based on using analogue circuits to carry out computation and localised and sparse communication between the compute units.


title: Gravitational vacua in Newman-Penrose formalism

abstract: In this paper, we derive the generic solution of the Newman-Penrose equations in the Newman-Unti gauge with vanishing curvature tensor. The obtained solutions are the vacua of the gravitational theory which are connected to the derivations in metric formalism from exponentiating the infinitesimal BMS generators in the BMS gauge in \cite{Compere:2016jwb,Compere:2016hzt} by a radial transformation. The coordinate transformations in the Newman-Unti gauge connecting each vacuum are also obtained. We confirm that the supertranslation charge of the gravitational vacua with respect to global considerations vanishes exactly not only in the Einstein theory but also when including the Holst, Pontryagin, and Gauss-Bonnet terms which verifies that the gravitational vacua are not affected by those trivial or boundary terms.


title: SSTKG: Simple Spatio-Temporal Knowledge Graph for Intepretable and Versatile Dynamic Information Embedding

abstract: Knowledge graphs (KGs) have been increasingly employed for link prediction and recommendation using real-world datasets. However, the majority of current methods rely on static data, neglecting the dynamic nature and the hidden spatio-temporal attributes of real-world scenarios. This often results in suboptimal predictions and recommendations. Although there are effective spatio-temporal inference methods, they face challenges such as scalability with large datasets and inadequate semantic understanding, which impede their performance. To address these limitations, this paper introduces a novel framework - Simple Spatio-Temporal Knowledge Graph (SSTKG), for constructing and exploring spatio-temporal KGs. To integrate spatial and temporal data into KGs, our framework exploited through a new 3-step embedding method. Output embeddings can be used for future temporal sequence prediction and spatial information recommendation, providing valuable insights for various applications such as retail sales forecasting and traffic volume prediction. Our framework offers a simple but comprehensive way to understand the underlying patterns and trends in dynamic KG, thereby enhancing the accuracy of predictions and the relevance of recommendations. This work paves the way for more effective utilization of spatio-temporal data in KGs, with potential impacts across a wide range of sectors.


title: The Prime Geodesic Theorem and Bounds for Character Sums

abstract: We establish the prime geodesic theorem for the modular surface with exponent $\frac{2}{3}+\varepsilon$, improving upon the long-standing exponent $\frac{25}{36}+\varepsilon$ of Soundararajan-Young (2013). This was previously known conditionally on the generalised Lindel\"{o}f hypothesis for quadratic Dirichlet $L$-functions. Our argument goes through a well-trodden trail via the automorphic machinery, and refines the techniques of Iwaniec (1984) and Cai (2002) to a maximum extent. A key ingredient is an asymptotic for bilinear forms with a counting function in Kloosterman sums via hybrid Weyl-strength subconvex bounds for quadratic Dirichlet $L$-functions due to Young (2017), zero density estimates due to Heath-Brown (1995) near the edge of the critical strip, and an asymptotic for averages of Zagier $L$-series due to Balkanova-Frolenkov-Risager (2022). Furthermore, we strengthen our exponent to $\frac{5}{8}+\varepsilon$ conditionally on the generalised Lindel\"{o}f hypothesis for quadratic Dirichlet $L$-functions, which breaks the existing barrier.


title: Molecule Generation and Optimization for Efficient Fragrance Creation

abstract: This research introduces a Machine Learning-centric approach to replicate olfactory experiences, validated through experimental quantification of perfume perception. Key contributions encompass a hybrid model connecting perfume molecular structure to human olfactory perception. This model includes an AI-driven molecule generator (utilizing Graph and Generative Neural Networks), quantification and prediction of odor intensity, and refinery of optimal solvent and molecule combinations for desired fragrances. Additionally, a thermodynamic-based model establishes a link between olfactory perception and liquid-phase concentrations. The methodology employs Transfer Learning and selects the most suitable molecules based on vapor pressure and fragrance notes. Ultimately, a mathematical optimization problem is formulated to minimize discrepancies between new and target olfactory experiences. The methodology is validated by reproducing two distinct olfactory experiences using available experimental data.


title: A note on minimal mass blow up for inhomogeneous NLS

abstract: We revisit the work of \cite{raphael2011existence} on the minimal mass blow up solution for $iu_{t}+\Delta u=-k(x)|u|^{2}u$, and extend the construction of such a solution to the $k\in C^{2}$ case.


title: Gel'fand-LevitanTransformations to remove and to add bound states for the half-line matrix Schr\"odinger equation with the general selfadjoint boundary condition

abstract: We develop transformations to remove and to add bound states, and to decrease or increase the multiplicity of a bound state,for the half-line matrix Schr\"odinger equation with the general selfadjoint boundary condition. We use the Gel'fand-Levitan method. When a bound state is added or removed from the spectrum, and when the multiplicity of a bound state is decreased or increased, it is shown how the following quantities transform: the regular and the Jost solutions, the potential, the boundary matrices, the Jost matrix, the scattering matrix, and other relevant quantities. The Gel'fand-Levitan normalization matrices are defined for the bound states by taking into consideration the multiplicities of the bound states.


title: A search for top-squark pair production, in final states containing a top quark, a charm quark and missing transverse momentum, using the 139 fb$^{-1}$ of $pp$ collision data collected by the ATLAS detector

abstract: This paper presents a search for top-squark pair production in final states with a top quark, a charm quark and missing transverse momentum. The data were collected with the ATLAS detector during LHC Run 2 and corresponds to an integrated luminosity of 139fb$^{-1}$ of proton-proton collisions at a centre-of-mass energy of $\sqrt{s}$ = 13 TeV. The analysis is motivated by an extended Minimal Supersymmetric Standard Model featuring a non-minimal flavour violation in the second- and third-generation squark sector. The top squark in this model has two possible decay modes, either $\tilde{t}_1 \rightarrow c\tilde{\chi}_1^0$ or $\tilde{t}_1\rightarrow t\tilde{\chi}_1^0$, where the $\tilde{\chi}_1^0$ is undetected. The analysis is optimised assuming that both of the decay modes are equally probable, leading to the most likely final state of $tc + E_{\text{T}}^{\text{miss}}$. Good agreement is found between the Standard Model expectation and the data in the search regions. Exclusion limits at 95% CL are obtained in the $m(\tilde{t}_1)$ vs $m(\tilde{\chi}_1^0)$ plane and, in addition, limits on the branching ratio of the $\tilde{t}_1\rightarrow t\tilde{\chi}_1^0$ decay as a function of $m(\tilde{t}_1)$ are also produced. Top-squark masses of up to 800 GeV are excluded for scenarios with light neutralinos, and top-squark masses up to 600 GeV are excluded in scenarios where the neutralino and the top squark are almost mass degenerate.


title: Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers

abstract: We present a novel bi-directional Transformer architecture (BiXT) which scales linearly with input size in terms of computational cost and memory consumption, but does not suffer the drop in performance or limitation to only one input modality seen with other efficient Transformer-based approaches. BiXT is inspired by the Perceiver architectures but replaces iterative attention with an efficient bi-directional cross-attention module in which input tokens and latent variables attend to each other simultaneously, leveraging a naturally emerging attention-symmetry between the two. This approach unlocks a key bottleneck experienced by Perceiver-like architectures and enables the processing and interpretation of both semantics ('what') and location ('where') to develop alongside each other over multiple layers -- allowing its direct application to dense and instance-based tasks alike. By combining efficiency with the generality and performance of a full Transformer architecture, BiXT can process longer sequences like point clouds, text or images at higher feature resolutions and achieves competitive performance across a range of tasks like point cloud part segmentation, semantic image segmentation, image classification, hierarchical sequence modeling and document retrieval. Our experiments demonstrate that BiXT models outperform larger competitors by leveraging longer sequences more efficiently on vision tasks like classification and segmentation, and perform on par with full Transformer variants on sequence modeling and document retrieval -- but require $28\%$ fewer FLOPs and are up to $8.4\times$ faster.


title: Thermal Radiation at the Nanoscale and Applications

abstract: There has been a paradigm shift from the well-known laws of thermal radiation derived over a century ago, valid only when the length scales involved are much larger than the thermal wavelength (around 10 $\mu$m at room temperature), to a general framework known as fluctuational electrodynamics that allows calculations of radiative heat transfer for arbitrary sizes and length scales. Near-field radiative heat transfer and thermal emission in systems of sub-wavelength size can exhibit super-Planckian behaviour, i.e. flux rates several orders of magnitude larger than that predicted by the Stefan-Boltzmann (or blackbody) limit. These effects can be combined with novel materials, e.g. low-dimensional or topological systems, to yield even larger modifications and spectral and/or directional selectivity. We introduce briefly the context and the main steps that have led to the current boom of ideas and applications. We then discuss the original and impactful works gathered in the associated Special Topic collection, which provides an overview of the flourishing field of nanoscale thermal radiation.


title: Many-Stage Optimal Stabilized Runge-Kutta Methods for Hyperbolic Partial Differential Equations

abstract: A novel optimization procedure for the generation of stability polynomials of stabilized explicit Runge-Kutta methods is devised. Intended for semidiscretizations of hyperbolic partial differential equations, the herein developed approach allows the optimization of stability polynomials with more than hundred stages. A potential application of these high degree stability polynomials are problems with locally varying characteristic speeds as found in non-uniformly refined meshes and different wave speeds. To demonstrate the applicability of the stability polynomials we construct 2N storage many-stage Runge-Kutta methods that match their designed second order of accuracy when applied to a range of linear and nonlinear hyperbolic PDEs with smooth solutions. The methods are constructed to reduce the amplification of round off errors which becomes a significant concern for these many-stage methods.


title: Fast deep learning based reconstruction for limited angle tomography

abstract: A major challenge in computed tomography is reconstructing objects from incomplete data. An increasingly popular solution for these problems is to incorporate deep learning models into reconstruction algorithms. This study introduces a novel approach by integrating a Fourier neural operator (FNO) into the Filtered Backprojection (FBP) reconstruction method, yielding the FNO back projection (FNO-BP) network. We employ moment conditions for sinogram extrapolation to assist the model in mitigating artefacts from limited data. Notably, our deep learning architecture maintains a runtime comparable to classical filtered back projection (FBP) reconstructions, ensuring swift performance during both inference and training. We assess our reconstruction method in the context of the Helsinki Tomography Challenge 2022 and also compare it against regular FBP methods.


title: Federated Bayesian Network Ensembles

abstract: Federated learning allows us to run machine learning algorithms on decentralized data when data sharing is not permitted due to privacy concerns. Ensemble-based learning works by training multiple (weak) classifiers whose output is aggregated. Federated ensembles are ensembles applied to a federated setting, where each classifier in the ensemble is trained on one data location. In this article, we explore the use of federated ensembles of Bayesian networks (FBNE) in a range of experiments and compare their performance with locally trained models and models trained with VertiBayes, a federated learning algorithm to train Bayesian networks from decentralized data. Our results show that FBNE outperforms local models and provides a significant increase in training speed compared with VertiBayes while maintaining a similar performance in most settings, among other advantages. We show that FBNE is a potentially useful tool within the federated learning toolbox, especially when local populations are heavily biased, or there is a strong imbalance in population size across parties. We discuss the advantages and disadvantages of this approach in terms of time complexity, model accuracy, privacy protection, and model interpretability.


title: Joint mode switching and resource allocation in wireless-powered RIS-aided multiuser communication systems

abstract: This paper investigates a wireless-powered hybrid reflecting intelligent surface (hybrid RIS)-assisted multiple access system, where the RIS can harvest energy from energy station (ES) transmitted radio frequency signal (RF), and each reflecting element can flexibly switch between active mode, passive mode, and idle mode. The objective is to minimize the maximum energy consumption of the users by jointly optimizing the operating modes of each reflecting element, the amplification factor of active elements, the transmit power, and transmission time allocation, subject to quality-of-service (QoS) of each user and the available energy constraint of RIS. In the formulated optimization problem, the operating modes of each reflecting element are highly coupled with the amplification coefficient of the active reflecting elements, making it a challenging mixed-integer programming problem. To solve this problem, a hierarchical optimization method based on deep reinforcement learning is proposed, where the operating modes of each reflecting element and the amplification coefficient of active elements are obtained by solving the outer sub-problem using proximal policy optimization (PPO), and the transmit power and transmission time allocation are obtained by solving the inner sub-problem using convex optimization methods. Simulation results show that compared to the baseline scheme, the proposed scheme can reduce user energy consumption by $70 \%$.


title: Connectivity Labeling in Faulty Colored Graphs

abstract: Fault-tolerant connectivity labelings are schemes that, given an $n$-vertex graph $G=(V,E)$ and $f\geq 1$, produce succinct yet informative labels for the elements of the graph. Given only the labels of two vertices $u,v$ and of the elements in a faulty-set $F$ with $|F|\leq f$, one can determine if $u,v$ are connected in $G-F$, the surviving graph after removing $F$. For the edge or vertex faults models, i.e., $F\subseteq E$ or $F\subseteq V$, a sequence of recent work established schemes with $poly(f,\log n)$-bit labels. This paper considers the color faults model, recently introduced in the context of spanners [Petruschka, Sapir and Tzalik, ITCS'24], which accounts for known correlations between failures. Here, the edges (or vertices) of the input $G$ are arbitrarily colored, and the faulty elements in $F$ are colors; a failing color causes all edges (vertices) of that color to crash. Our main contribution is settling the label length complexity for connectivity under one color fault ($f=1$). The existing implicit solution, by applying the state-of-the-art scheme for edge faults of [Dory and Parter, PODC'21], might yield labels of $\Omega(n)$ bits. We provide a deterministic scheme with labels of $\tilde{O}(\sqrt{n})$ bits in the worst case, and a matching lower bound. Moreover, our scheme is universally optimal: even schemes tailored to handle only colorings of one specific graph topology cannot produce asymptotically smaller labels. We extend our labeling approach to yield a routing scheme avoiding a single forbidden color. We also consider the centralized setting, and show an $\tilde{O}(n)$-space oracle, answering connectivity queries under one color fault in $\tilde{O}(1)$ time. Turning to $f\geq 2$ color faults, we give a randomized labeling scheme with $\tilde{O}(n^{1-1/2^f})$-bit labels, along with a lower bound of $\Omega(n^{1-1/(f+1)})$ bits.


title: Nonlocal to local convergence of phase field systems with inertial term

abstract: This paper deals with a nonlocal model for a hyperbolic phase field system coupling the standard energy balance equation for temperature with a dynamic for the phase variable: the latter includes an inertial term and a nonlocal convolution-type operator where the family of kernels depends on a small parameter. We rigorously study the asymptotic convergence of the system as the approximating parameter tends to zero and we obtain at the limit the local system with the elliptic laplacian operator acting on the phase variable. Our analysis is based on some asymptotic properties on nonlocal-to-local convergence that have been recently and successfully applied to families of Cahn--Hilliard models.


title: Enabling Weak LLMs to Judge Response Reliability via Meta Ranking

abstract: Despite the strong performance of large language models (LLMs) across a wide range of tasks, they still have reliability issues. Previous studies indicate that strong LLMs like GPT-4-turbo excel in evaluating the reliability of responses from LLMs, but face efficiency and local deployment issues. Thus, to enable weak LLMs to effectively assess the reliability of LLM responses, we propose a novel cross-query-comparison-based method called $\textit{Meta Ranking}$ (MR). Unlike previous few-shot methods that solely based on in-context learning capabilities in LLMs, MR assesses reliability by pairwisely ranking the target query-response pair with multiple reference query-response pairs. We found that MR is highly effective in error detection for LLM responses, where weak LLMs, such as Phi-2, could surpass strong baselines like GPT-3.5-turbo, requiring only five reference samples and significantly improving efficiency. We further demonstrate that MR can enhance strong LLMs' performance in two practical applications: model cascading and instruction tuning. In model cascading, we combine open- and closed-source LLMs to achieve performance comparable to GPT-4-turbo with lower costs. In instruction tuning, we use MR for iterative training data filtering, significantly reducing data processing time and enabling LLaMA-7B and Phi-2 to surpass Alpaca-13B with fewer training tokens. These results underscore the high potential of MR in both efficiency and effectiveness.


title: Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models

abstract: In this paper, we explore the challenges associated with establishing an end-to-end fact-checking pipeline in a real-world context, covering over 90 languages. Our real-world experimental benchmarks demonstrate that fine-tuning Transformer models specifically for fact-checking tasks, such as claim detection and veracity prediction, provide superior performance over large language models (LLMs) like GPT-4, GPT-3.5-Turbo, and Mistral-7b. However, we illustrate that LLMs excel in generative tasks such as question decomposition for evidence retrieval. Through extensive evaluation, we show the efficacy of fine-tuned models for fact-checking in a multilingual setting and complex claims that include numerical quantities.


title: Local certification of forbidden subgraphs

abstract: Detecting specific structures in a network has been a very active theme of research in distributed computing for at least a decade. In this paper, we start the study of subgraph detection from the perspective of local certification. Remember that a local certification is a distributed mechanism enabling the nodes of a network to check the correctness of the current configuration, thanks to small pieces of information called certificates. Our main question is: For a given graph $H$, what is the minimum certificate size that allows checking that the network does not contain $H$ as a (possibly induced) subgraph? We show a variety of lower and upper bounds, uncovering an interesting interplay between the optimal certificate size, the size of the forbidden subgraph, and the locality of the verification. Along the way we introduce several new technical tools, in particular what we call the \emph{layered map}, which is not specific to forbidden subgraphs and that we expect to be useful for certifying many other properties.


title: MLFEF: Machine Learning Fusion Model with Empirical Formula to Explore the Momentum in Competitive Sports

abstract: Tennis is so popular that coaches and players are curious about factors other than skill, such as momentum. This article will try to define and quantify momentum, providing a basis for real-time analysis of tennis matches. Based on the tennis Grand Slam men's singles match data in recent years, we built two models, one is to build a model based on data-driven, and the other is to build a model based on empirical formulas. For the data-driven model, we first found a large amount of public data including public data on tennis matches in the past five years and personal information data of players. Then the data is preprocessed, and feature engineered, and a fusion model of SVM, Random Forrest algorithm and XGBoost was established. For the mechanism analysis model, important features were selected based on the suggestions of many tennis players and enthusiasts, the sliding window algorithm was used to calculate the weight, and different methods were used to visualize the momentum. For further analysis of the momentum fluctuation, it is based on the popular CUMSUM algorithm in the industry as well as the RUN Test, and the result shows the momentum is not random and the trend might be random. At last, the robustness of the fusion model is analyzed by Monte Carlo simulation.


title: Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like One

abstract: The widespread adoption of large language models (LLMs) underscores the urgent need to ensure their fairness. However, LLMs frequently present dominant viewpoints while ignoring alternative perspectives from minority parties, resulting in potential biases. We hypothesize that these fairness-violating behaviors occur because LLMs express their viewpoints using a human personality that represents the majority of training data. In response to this, we validate that prompting LLMs with specific roles can allow LLMs to express diverse viewpoints. Building on this insight and observation, we develop FairThinking, a pipeline designed to automatically generate roles that enable LLMs to articulate diverse perspectives for fair expressions. To evaluate FairThinking, we create a dataset with a thousand items covering three fairness-related topics and conduct experiments on GPT-3.5, GPT-4, Llama2, and Mistral to demonstrate its superior performance.


title: Transformer-based Causal Language Models Perform Clustering

abstract: Even though large language models (LLMs) have demonstrated remarkable capability in solving various natural language tasks, the capability of an LLM to follow human instructions is still a concern. Recent works have shown great improvements in the instruction-following capability via additional training for instruction-following tasks. However, the mechanisms responsible for effective instruction-following capabilities remain inadequately understood. Here, we introduce a simplified instruction-following task and use synthetic datasets to analyze a Transformer-based causal language model. Our findings suggest that the model learns task-specific information by clustering data within its hidden space, with this clustering process evolving dynamically during learning. We also demonstrate how this phenomenon assists the model in handling unseen instances, and validate our results in a more realistic setting. Furthermore, we present inspired applications regarding pre-training and alignment.


title: Accelerated gradient flows for large bending deformations of nonlinear plates

abstract: In this paper, we propose and analyze a series of novel algorithms based on projection-free accelerated gradient flows to minimize bending energies for nonlinear plates with non-convex metric constraints. We discuss the stability and constraint consistency in a semi-discrete setting for both bilayer and prestrained plates. Our proposed algorithms demonstrate substantial improvements, in both efficiency and accuracy, over current state-of-the-art methods based on gradient flows.


title: Cross talk of a large-scale depleted monolithic active pixel sensor (DMAPS) in 180 nm CMOS technology

abstract: Monolithic pixel detectors combine readout electronics and sensor in a single entity of silicon, which simplifies the production procedure and lowers the material budget compared to conventional hybrid pixel detector concepts. Benefiting from the advances in commercial CMOS processes towards large biasing voltage capabilities and the increasing availability of high-resistivity substrates, depleted monolithic active pixel sensors (DMAPS) are able to cope with the high-rate and high-radiation environments faced in modern high-energy physics experiments. TJ-Monopix2 is the latest iteration of a DMAPS development line designed in 180 nm TowerSemicondutor technology, which features a large scale (2 x 2) cm$^2$ chip divided into (512 x 512) pixels with a pitch of (33 x 33) um$^2$. All in-pixel electronics are separated from its small collection electrode and process modifications are implemented to improve charge collection efficiency especially after irradiation. The latest laboratory measurements and investigations of a threshold variation observed for TJ-Monopix2 in typical operating conditions are presented.


title: Exploring the Representation of Large Positive Integers as Sums of Prime Powers and Integer Powers: Analysis with Positive Density Subsets

abstract: In this paper, we use the transference principle to investigate the representation of sufficiently large positive integers as the sum of prime powers and integer powers, where the primes are drawn from a positive density subset of the set of all primes , and the integer powers are drawn from a positive density subset of k-th powers.


title: Sharp interface limit for a quasi-linear large deviation rate function

abstract: We discuss the sharp interface limit, leading to a mean curvature flow energy, for the rate function of the large deviation principle of a Glauber+Kawasaki process with speed change. We provide an explicit formula of the limiting functional given by the mobility and the transport coefficient.


title: Extinction, persistence and growing in a degenerate logistic model with impulses

abstract: This paper deals with an impulsive degenerate logistic model, where pulses are introduced for modeling interventions or disturbances, and degenerate logistic term may describe refugees or protections zones for the species. Firstly, the principal eigenvalue depending on impulse rate, which is regarded as a threshold value, is introduced and characterized. Secondly, the asymptotic behavior of the population is fully investigated and sufficient conditions for the species to be extinct, persist or grow unlimitedly are given. Our results extend those of well-understood logistic and Malthusian models. Finally, numerical simulations emphanzise our theoretical results highlighting that medium impulse rate is more favorable for species to persist, small rate results in extinction and large rate leads the species to an unlimited growth.


title: Nuclear matter radii from molecular rotations using ultra-high-resolution spectroscopy

abstract: The rotational constant parametrizes the relative spacing between a molecule's rotational energy levels. It depends on the molecule's classical moments of inertia, which, in all studies, are expressed by treating the constituent nuclei as point masses separated by the bond length. We point out that treating the finite nuclear size leads to a correction to the rotational constant at the Hz level, which is resolvable with recently developed ultra-high-resolution molecular spectrometers. Nuclear-model-independent measurements of nuclear matter radii can thus be envisioned in the future using such apparatuses, advancing beyond the existing hadronic scattering experiments and further developing the intersection of nuclear and molecular physics. In the present time, it appears that the computational ability of ab initio quantum chemistry might be the limiting factor to the technical readiness of the approach. To test the premises of the proposed method, we call for benchmark experiments using HD+ that are feasible with state-of-the-art experiment and theory.


title: Angularly Sparse Channel Estimation in Dual-Wideband Tera-Hertz (THz) Hybrid MIMO Systems Relying on Bayesian Learning

abstract: Bayesian learning aided massive antenna array based THz MIMO systems are designed for spatial-wideband and frequency-wideband scenarios, collectively termed as the dual-wideband channels. Essentially, numerous antenna modules of the THz system result in a significant delay in the transmission/ reception of signals in the time-domain across the antennas, which leads to spatial-selectivity. As a further phenomenon, the wide bandwidth of THz communication results in substantial variation of the effective angle of arrival/ departure (AoA/ AoD) with respect to the subcarrier frequency. This is termed as the beam squint effect, which renders the channel state information (CSI) estimation challenging in such systems. To address this problem, initially, a pilot-aided (PA) Bayesian learning (PA-BL) framework is derived for the estimation of the Terahertz (THz) MIMO channel that relies exclusively on the pilot beams transmitted. Since the framework designed can successfully operate in an ill-posed model, it can verifiably lead to reduced pilot transmissions in comparison to conventional methodologies. The above paradigm is subsequently extended to additionally incorporate data symbols to derive a Data-Aided (DA) BL approach that performs joint data detection and CSI estimation. We will demonstrate that it is capable of improving the dual-wideband channels estimate, despite further reducing the training overhead. The Bayesian Cramer-Rao bounds (BCRLBs) are also obtained for explicitly characterizing the lower bounds on the mean squared error (MSE) of the PA-BL and DA-BL frameworks. Our simulation results show the improved normalized MSE (NMSE) and bit-error rate (BER) performance of the proposed estimation schemes and confirm that they approach their respective BCRLB benchmarks.


title: Geometric and arithmetic theta correspondences

abstract: Geometric/arithmetic theta correspondences provide correspondences between automorphic forms and cohomology classes/algebraic cycles on Shimura varieties. We give an introduction focusing on the example of unitary groups and highlight recent advances in the arithmetic theory (also known as the Kudla program) and their applications. These are expanded lecture notes for the IHES 2022 Summer School on the Langlands Program.


title: Probing the nature of rotation in the Pleiades, Alpha Persei, and Hyades clusters

abstract: Unraveling the internal kinematics of open clusters is crucial for understanding their formation and evolution. However, there is a dearth of research on this topic, primarily due to the lack of high-quality kinematic data. Using the exquisite-precision astrometric parameters and radial velocities provided by Gaia data release 3, we investigate the internal rotation in three of the most nearby and best-studied open clusters, namely the Pleiades, Alpha Persei, and Hyades clusters. Statistical analyses of the residual motions of the member stars clearly indicate the presence of three-dimensional rotation in the three clusters. The mean rotation velocities of the Pleiades, Alpha Persei, and Hyades clusters within their tidal radii are estimated to be 0.24 (0.04), 0.43 (0.08), and 0.09 (0.03) km s-1, respectively. Similar to the Praesepe cluster that we have studied before, the rotation of the member stars within the tidal radii of these three open clusters can be well interpreted by Newton's theorem. No expansion or contraction is detected in the three clusters either. Furthermore, we find that the mean rotation velocity of open clusters may be positively correlated with the cluster mass, and the rotation is likely to diminish as open clusters age.


title: Endowing Pre-trained Graph Models with Provable Fairness

abstract: Pre-trained graph models (PGMs) aim to capture transferable inherent structural properties and apply them to different downstream tasks. Similar to pre-trained language models, PGMs also inherit biases from human society, resulting in discriminatory behavior in downstream applications. The debiasing process of existing fair methods is generally coupled with parameter optimization of GNNs. However, different downstream tasks may be associated with different sensitive attributes in reality, directly employing existing methods to improve the fairness of PGMs is inflexible and inefficient. Moreover, most of them lack a theoretical guarantee, i.e., provable lower bounds on the fairness of model predictions, which directly provides assurance in a practical scenario. To overcome these limitations, we propose a novel adapter-tuning framework that endows pre-trained graph models with provable fairness (called GraphPAR). GraphPAR freezes the parameters of PGMs and trains a parameter-efficient adapter to flexibly improve the fairness of PGMs in downstream tasks. Specifically, we design a sensitive semantic augmenter on node representations, to extend the node representations with different sensitive attribute semantics for each node. The extended representations will be used to further train an adapter, to prevent the propagation of sensitive attribute semantics from PGMs to task predictions. Furthermore, with GraphPAR, we quantify whether the fairness of each node is provable, i.e., predictions are always fair within a certain range of sensitive attribute semantics. Experimental evaluations on real-world datasets demonstrate that GraphPAR achieves state-of-the-art prediction performance and fairness on node classification task. Furthermore, based on our GraphPAR, around 90\% nodes have provable fairness.


title: SCARF: Securing Chips with a Robust Framework against Fabrication-time Hardware Trojans

abstract: The globalization of the semiconductor industry has introduced security challenges to Integrated Circuits (ICs), particularly those related to the threat of Hardware Trojans (HTs) - malicious logic that can be introduced during IC fabrication. While significant efforts are directed towards verifying the correctness and reliability of ICs, their security is often overlooked. In this paper, we propose a comprehensive approach to enhance IC security from the front-end to back-end stages of design. Initially, we outline a systematic method to transform existing verification assets into potent security checkers by repurposing verification assertions. To further improve security, we introduce an innovative technique for integrating online monitors during physical synthesis - a back-end insertion providing an additional layer of defense. Experimental results demonstrate a significant increase in security, measured by our introduced metric, Security Coverage (SC), with a marginal rise in area and power consumption, typically under 20\%. The insertion of online monitors during physical synthesis enhances security metrics by up to 33.5\%. This holistic approach offers a comprehensive and resilient defense mechanism across the entire spectrum of IC design.


title: Equivariant Hopf bifurcation arising in circular-distributed predator-prey interaction with taxis

abstract: In this paper, we study the Rosenzweig-MacArthur predator-prey model with predator-taxis and time delay defined on a disk. Theoretically, we studied the equivariant Hopf bifurcation around the positive constant steady-state solution. Standing and rotating waves have been investigated through the theory of isotropic subgroups and Lyapunov-Schmidt reduction. The existence conditions, the formula for the periodic direction and the periodic variation of bifurcation periodic solutions are obtained. Numerically, we select appropriate parameters and conduct numerical simulations to illustrate the theoretical results and reveal quite complicated dynamics on the disk. Different types of rotating and standing waves, as well as more complex spatiotemporal patterns with random initial values, are new dynamic phenomena that do not occur in one-dimensional intervals.


title: Integrating Dynamic Weighted Approach with Fictitious Play and Pure Counterfactual Regret Minimization for Equilibrium Finding

abstract: Developing efficient algorithms to converge to Nash Equilibrium is a key focus in game theory. The use of dynamic weighting has been especially advantageous in normal-form games, enhancing the rate of convergence. For instance, the Greedy Regret Minimization (RM) algorithm has markedly outperformed earlier techniques. Nonetheless, its dependency on mixed strategies throughout the iterative process introduces complexity to dynamic weighting, which in turn restricts its use in extensive-form games. In this study, we introduce two novel dynamic weighting algorithms: Dynamic Weighted Fictitious Play (DW-FP) and Dynamic Weighted Pure Counterfactual Regret Minimization (DW-PCFR). These algorithms, utilizing pure strategies in each iteration, offer key benefits: (i) Addressing the complexity of dynamic weight computation in Greedy RM, thereby facilitating application in extensive-form games; (ii) Incorporating the low-memory usage and ease-of-use features of FP and CFR; (iii) They guarantee a convergence lower bound of $\mathcal{O}\left(T^{-\frac{1}{2}}\right)$, with a tendency to achieve a convergence rate of $\mathcal{O}(T^{-1})$ as runtime increases. This research not only theoretically affirms the convergence capabilities of these algorithms but also empirically demonstrates their superiority over existing leading algorithms across all our tests.


title: Towards Cosmography of the Local Universe

abstract: Anisotropies in the distance-redshift relation of cosmological sources are expected due to large-scale inhomogeneities in the local Universe. When the observed sources are tracing a large-scale matter flow in a general spacetime geometry, the distance-redshift relation with its anisotropies can be described with a geometrical prediction that generalises the well-known Friedmann-Lema\^itre-Robertson-Walker result. Furthermore, it turns out that a finite set of multipole coefficients contain the full information about a finite-order truncation of the distance-redshift relation of a given observer. The multipoles of the distance-redshift relation are interesting new cosmological observables that have a direct physical interpretation in terms of kinematical quantities of the underlying matter flow. Using light cones extracted from $N$-body simulations we quantify the anisotropies expected in a $\Lambda$ cold dark matter cosmology by running a Markov chain Monte Carlo analysis on the observed data. In this observational approach the survey selection implements an implicit smoothing scale over which the effective rest frame of matter is fitted. The perceived anisotropy therefore depends significantly on the redshift range and distribution of sources. We find that the multipoles of the expansion rate, as well as the observer's velocity with respect to the large-scale matter flow, can be determined robustly with our approach.


title: Classifications of cusps appearing on plane curves

abstract: In this paper, we deal with plane curves with cusps. It is well known that there are various types of cusps. Among them, we investigate criteria for $(n, n+1)$ cusps with respect to several differential conditions and relations between these singularities and evolutes of fronts. We give complete classifications with respect to $(4, 5)$-cusps.


title: Electroweak three-body decays in the presence of two- and three-body bound states

abstract: Recently, formalism has been derived for studying electroweak transition amplitudes for three-body systems both in infinite and finite volumes. The formalism provides exact relations that the infinite-volume amplitudes must satisfy, as well as a relationship between physical amplitudes and finite-volume matrix elements, which can be constrained from lattice QCD calculations. This formalism poses additional challenges when compared with the analogous well-studied two-body equivalent one, including the necessary step of solving integral equations of singular functions. In this work, we provide some non-trivial analytical and numerical tests on the aforementioned formalism. In particular, we consider a case where the three-particle system can have three-body bound states as well as bound states in the two-body subsystem. For kinematics below the three-body threshold, we demonstrate that the scattering amplitudes satisfy unitarity. We also check that for these kinematics the finite-volume matrix elements are accurately described by the formalism for two-body systems up to exponentially suppressed corrections. Finally, we verify that in the case of the three-body bound state, the finite-volume matrix element is equal to the infinite-volume coupling of the bound state, up to exponentially suppressed errors.


title: Defending Against Weight-Poisoning Backdoor Attacks for Parameter-Efficient Fine-Tuning

abstract: Recently, various parameter-efficient fine-tuning (PEFT) strategies for application to language models have been proposed and successfully implemented. However, this raises the question of whether PEFT, which only updates a limited set of model parameters, constitutes security vulnerabilities when confronted with weight-poisoning backdoor attacks. In this study, we show that PEFT is more susceptible to weight-poisoning backdoor attacks compared to the full-parameter fine-tuning method, with pre-defined triggers remaining exploitable and pre-defined targets maintaining high confidence, even after fine-tuning. Motivated by this insight, we developed a Poisoned Sample Identification Module (PSIM) leveraging PEFT, which identifies poisoned samples through confidence, providing robust defense against weight-poisoning backdoor attacks. Specifically, we leverage PEFT to train the PSIM with randomly reset sample labels. During the inference process, extreme confidence serves as an indicator for poisoned samples, while others are clean. We conduct experiments on text classification tasks, five fine-tuning strategies, and three weight-poisoning backdoor attack methods. Experiments show near 100% success rates for weight-poisoning backdoor attacks when utilizing PEFT. Furthermore, our defensive approach exhibits overall competitive performance in mitigating weight-poisoning backdoor attacks.


title: Automating Boundary Filling in Cubical Agda

abstract: When working in a proof assistant, automation is key to discharging routine proof goals such as equations between algebraic expressions. Homotopy Type Theory allows the user to reason about higher structures, such as topological spaces, using higher inductive types (HITs) and univalence. Cubical Agda is an extension of Agda with computational support for HITs and univalence. A difficulty when working in Cubical Agda is dealing with the complex combinatorics of higher structures, an infinite-dimensional generalisation of equational reasoning. To solve these higher-dimensional equations consists in constructing cubes with specified boundaries. We develop a simplified cubical language in which we isolate and study two automation problems: contortion solving, where we attempt to "contort" a cube to fit a given boundary, and the more general Kan solving, where we search for solutions that involve pasting multiple cubes together. Both problems are difficult in the general case - Kan solving is even undecidable - so we focus on heuristics that perform well on practical examples. We provide a solver for the contortion problem using a reformulation of contortions in terms of poset maps, while we solve Kan problems using constraint satisfaction programming. We have implemented our algorithms in an experimental Haskell solver that can be used to automatically solve goals presented by Cubical Agda. We illustrate this with a case study establishing the Eckmann-Hilton theorem using our solver, as well as various benchmarks - providing the ground for further study of proof automation in cubical type theories.


title: Where is the answer? Investigating Positional Bias in Language Model Knowledge Extraction

abstract: Large language models require updates to remain up-to-date or adapt to new domains by fine-tuning them with new documents. One key is memorizing the latest information in a way that the memorized information is extractable with a query prompt. However, LLMs suffer from a phenomenon called perplexity curse; despite minimizing document perplexity during fine-tuning, LLMs struggle to extract information through a prompt sentence. In this new knowledge acquisition and extraction, we find a very intriguing fact that LLMs can accurately answer questions about the first sentence, but they struggle to extract information described in the middle or end of the documents used for fine-tuning. Our study suggests that the auto-regressive training causes this issue; each token is prompted by reliance on all previous tokens, which hinders the model from recalling information from training documents by question prompts. To conduct the in-depth study, we publish both synthetic and real datasets, enabling the evaluation of the QA performance w.r.t. the position of the corresponding answer in a document. Our investigation shows that even a large model suffers from the perplexity curse, but regularization such as denoising auto-regressive loss can enhance the information extraction from diverse positions. These findings will be (i) a key to improving knowledge extraction from LLMs and (ii) new elements to discuss the trade-off between RAG and fine-tuning in adapting LLMs to a new domain.


title: A frequentist test of proportional colocalization after selecting relevant genetic variants

abstract: Colocalization analyses assess whether two traits are affected by the same or distinct causal genetic variants in a single gene region. A class of Bayesian colocalization tests are now routinely used in practice; for example, for genetic analyses in drug development pipelines. In this work, we consider an alternative frequentist approach to colocalization testing that examines the proportionality of genetic associations with each trait. The proportional colocalization approach uses markedly different assumptions to Bayesian colocalization tests, and therefore can provide valuable complementary evidence in cases where Bayesian colocalization results are inconclusive or sensitive to priors. We propose a novel conditional test of proportional colocalization, prop-coloc-cond, that aims to account for the uncertainty in variant selection, in order to recover accurate type I error control. The test can be implemented straightforwardly, requiring only summary data on genetic associations. Simulation evidence and an empirical investigation into GLP1R gene expression demonstrates how tests of proportional colocalization can offer important insights in conjunction with Bayesian colocalization tests.


title: Large $N$ Schur index of $\mathcal N=4$ SYM from semiclassical D3 brane

abstract: We consider the refined Schur superconformal index of 4d $\mathcal N=4$ $U(N)$ SYM and the first term of its giant-graviton expansion, first predicted in arXiv:2001.11667 using indirect superconformal algebra considerations and analytic continuation of fugacities. This correction is the leading non-perturbative correction to the index at large $N$ and we reproduce it from the semiclassical partition function of quantum D3 brane wrapped on $S^{1}\times S^{3}$ in a twisted modification of the $AdS_{5}\times S^{5}$ string background, depending on the index R-symmetry fugacity. Our calculation does not exploit directly supersymmetry. It is based on the determination of the partition function of the various bosonic and fermionic fluctuations on the wrapped brane whose action is conformal with specific constant holonomies along thermal cycle. We show how those partition functions may be obtained by adapting the operator counting method of Cardy to the twisted background.


title: Second-order flows for approaching stationary points of a class of non-convex energies via convex-splitting schemes

abstract: The use of accelerated gradient flows is an emerging field in optimization, scientific computing and beyond. This paper contributes to the theoretical underpinnings of a recently-introduced computational paradigm known as second-order flows, which demonstrate significant performance particularly for the minimization of non-convex energy functionals defined on Sobolev spaces, and are characterized by novel dissipative hyperbolic partial differential equations. Our approach hinges upon convex-splitting schemes, a tool which is not only pivotal for clarifying the well-posedness of second-order flows, but also yields a versatile array of robust numerical schemes through temporal and spatial discretization. We prove the convergence to stationary points of such schemes in the semi-discrete setting. Further, we establish their convergence to time-continuous solutions as the time-step tends to zero, and perform a comprehensive error analysis in the fully discrete case. Finally, these algorithms undergo thorough testing and validation in approaching stationary points of non-convex variational models in applied sciences, such as the Ginzburg-Landau energy in phase-field modeling and a specific case of the Landau-de Gennes energy of the Q-tensor model for liquid crystals.


title: BIDER: Bridging Knowledge Inconsistency for Efficient Retrieval-Augmented LLMs via Key Supporting Evidence

abstract: Retrieval-augmented large language models (LLMs) have demonstrated efficacy in knowledge-intensive tasks such as open-domain QA, addressing inherent challenges in knowledge update and factual inadequacy. However, inconsistencies between retrieval knowledge and the necessary knowledge for LLMs, leading to a decline in LLM's answer quality. This paper introduces BIDER, an approach that refines retrieval documents into Key Supporting Evidence (KSE) through knowledge synthesis, supervised fine-tuning (SFT), and preference alignment. We train BIDER by learning from crafting KSE, while maximizing its output to align with LLM's information acquisition preferences through reinforcement learning. Evaluations across five datasets show BIDER boosts LLMs' answer quality by 7% while reducing input content length in retrieval documents by 80%, outperforming existing methods. The proposed KSE simulation effectively equips LLMs with essential information for accurate question answering.


title: Learning Discretized Bayesian Networks with GOMEA

abstract: Bayesian networks model relationships between random variables under uncertainty and can be used to predict the likelihood of events and outcomes while incorporating observed evidence. From an eXplainable AI (XAI) perspective, such models are interesting as they tend to be compact. Moreover, captured relations can be directly inspected by domain experts. In practice, data is often real-valued. Unless assumptions of normality can be made, discretization is often required. The optimal discretization, however, depends on the relations modelled between the variables. This complicates learning Bayesian networks from data. For this reason, most literature focuses on learning conditional dependencies between sets of variables, called structure learning. In this work, we extend an existing state-of-the-art structure learning approach based on the Gene-pool Optimal Mixing Evolutionary Algorithm (GOMEA) to jointly learn variable discretizations. The proposed Discretized Bayesian Network GOMEA (DBN-GOMEA) obtains similar or better results than the current state-of-the-art when tasked to retrieve randomly generated ground-truth networks. Moreover, leveraging a key strength of evolutionary algorithms, we can straightforwardly perform DBN learning multi-objectively. We show how this enables incorporating expert knowledge in a uniquely insightful fashion, finding multiple DBNs that trade-off complexity, accuracy, and the difference with a pre-determined expert network.


title: Fine grinding localized updates via gauge equivariant flows in the 2D Schwinger model

abstract: State-of-the-art simulations of discrete gauge theories are based on Markov chains with local changes in the field space, which however at very fine lattice spacings are notoriously difficult due to separated topological sectors of the gauge field. Hybrid Monte Carlo (HMC) algorithms, which are very efficient at coarser lattice spacings, suffer from increasing autocorrelation times. This makes simulation of lattice QCD close to the continuum infeasible even with exa-scale computing. An approach, which can overcome long autocorrelation times, is based on trivializing maps, where a new gauge proposal is given by mapping a configuration from a trivial space to the target one, distributed via the associated Boltzmann factor. Using gauge equivariant coupling layers, the map can be approximated via machine learning techniques. However the deviations scale with the volume in case of local theories and extensive distributions, rendering a global update unfeasible for realistic box sizes. In this proceeding, we will discuss the potential of localized updates in case of the 2D Schwinger Model. Using gauge-equivariant flow maps, a local update can be fine grained towards finer lattice spacing. Based on this we will present results on simulating the 2D Schwinger Model with dynamical Nf=2 Wilson fermions at fine lattice spacings using scalable global correction steps and compare the performance to the HMC.


title: Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning

abstract: Retrieval Augmented Generation (RAG) has emerged as an effective solution for mitigating hallucinations in Large Language Models (LLMs). The retrieval stage in RAG typically involves a pre-trained embedding model, which converts queries and passages into vectors to capture their semantics. However, a standard pre-trained embedding model may exhibit sub-optimal performance when applied to specific domain knowledge, necessitating fine-tuning. This paper addresses scenarios where the embeddings are only available from a black-box model. We introduce Model augmented fine-tuning (Mafin) -- a novel approach for fine-tuning a black-box embedding model by augmenting it with a trainable embedding model. Our results demonstrate that Mafin significantly enhances the performance of the black-box embeddings by only requiring the training of a small augmented model. We validate the effectiveness of our method on both labeled and unlabeled datasets, illustrating its broad applicability and efficiency.


title: On dual risk models with proportional gains and dependencies

abstract: In this work, we consider extensions of the dual risk model with proportional gains by introducing a dependence structure between gain sizes and gain interrarrival times. Among others, we further consider the case where the proportional parameter is randomly chosen, the case where it is a uniformly random variable, as well as the case where we may have upwards as well as downwards jumps. Moreover, we consider the case with causal dependence structure, as well as the case where the dependence is based on the generalized Farlie-Gumbel-Morgenstern copula. The ruin probability and the distribution of the time to ruin are investigated.


title: Examining Monitoring System: Detecting Abnormal Behavior In Online Examinations

abstract: Cheating in online exams has become a prevalent issue over the past decade, especially during the COVID-19 pandemic. To address this issue of academic dishonesty, our "Exam Monitoring System: Detecting Abnormal Behavior in Online Examinations" is designed to assist proctors in identifying unusual student behavior. Our system demonstrates high accuracy and speed in detecting cheating in real-time scenarios, providing valuable information, and aiding proctors in decision-making. This article outlines our methodology and the effectiveness of our system in mitigating the widespread problem of cheating in online exams.


title: Anomalous Diffusion, Prethermalization, and Particle Binding in an Interacting Flat Band System

abstract: We study the broadening of initially localized wave packets in a quasi one-dimensional diamond ladder with interacting, spinless fermions. The lattice possesses a flat band causing localization. We place special focus on the transition away from the flat band many-body localized case by adding very weak dispersion. By doing so, we allow propagation of the wave packet on significantly different timescales which causes anomalous diffusion. Due to the temporal separation of dynamic processes, an interaction-induced, prethermal equilibrium becomes apparent. A physical picture of light and heavy modes for this prethermal behavior can be obtained within Born-Oppenheimer approximation via basis transformation of the original Hamiltonian. This reveals a detachment between light, symmetric and heavy, anti-symmetric particle species. We show that the prethermal state is characterized by heavy particles binding together mediated by the light particles.


title: Revisiting Data Augmentation in Deep Reinforcement Learning

abstract: Various data augmentation techniques have been recently proposed in image-based deep reinforcement learning (DRL). Although they empirically demonstrate the effectiveness of data augmentation for improving sample efficiency or generalization, which technique should be preferred is not always clear. To tackle this question, we analyze existing methods to better understand them and to uncover how they are connected. Notably, by expressing the variance of the Q-targets and that of the empirical actor/critic losses of these methods, we can analyze the effects of their different components and compare them. We furthermore formulate an explanation about how these methods may be affected by choosing different data augmentation transformations in calculating the target Q-values. This analysis suggests recommendations on how to exploit data augmentation in a more principled way. In addition, we include a regularization term called tangent prop, previously proposed in computer vision, but whose adaptation to DRL is novel to the best of our knowledge. We evaluate our proposition and validate our analysis in several domains. Compared to different relevant baselines, we demonstrate that it achieves state-of-the-art performance in most environments and shows higher sample efficiency and better generalization ability in some complex environments.


title: A Riemannian rank-adaptive method for higher-order tensor completion in the tensor-train format

abstract: In this paper a new Riemannian rank adaptive method (RRAM) is proposed for the low-rank tensor completion problem (LRTCP) formulated as a least-squares optimization problem on the algebraic variety of tensors of bounded tensor-train (TT) rank. The method iteratively optimizes over fixed-rank smooth manifolds using a Riemannian conjugate gradient algorithm from Steinlechner (2016) and gradually increases the rank by computing a descent direction in the tangent cone to the variety. Additionally, a numerical method to estimate the amount of rank increase is proposed based on a theoretical result for the stationary points of the low-rank tensor approximation problem and a definition of an estimated TT-rank. Furthermore, when the iterate comes close to a lower-rank set, the RRAM decreases the rank based on the TT-rounding algorithm from Oseledets (2011) and a definition of a numerical rank. We prove that the TT-rounding algorithm can be considered as an approximate projection onto the lower-rank set which satisfies a certain angle condition to ensure that the image is sufficiently close to that of an exact projection. Several numerical experiments are given to illustrate the use of the RRAM and its subroutines in {\Matlab}. Furthermore, in all experiments the proposed RRAM outperforms the state-of-the-art RRAM for tensor completion in the TT format from Steinlechner (2016) in terms of computation time.


title: MultiFIX: An XAI-friendly feature inducing approach to building models from multimodal data

abstract: In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly beneficial. Furthermore, it is important to understand how each modality impacts the final prediction, especially in high-stake domains, so that these models can be used in a trustworthy and responsible manner. We propose MultiFIX: a new interpretability-focused multimodal data fusion pipeline that explicitly induces separate features from different data types that can subsequently be combined to make a final prediction. An end-to-end deep learning architecture is used to train a predictive model and extract representative features of each modality. Each part of the model is then explained using explainable artificial intelligence techniques. Attention maps are used to highlight important regions in image inputs. Inherently interpretable symbolic expressions, learned with GP-GOMEA, are used to describe the contribution of tabular inputs. The fusion of the extracted features to predict the target label is also replaced by a symbolic expression, learned with GP-GOMEA. Results on synthetic problems demonstrate the strengths and limitations of MultiFIX. Lastly, we apply MultiFIX to a publicly available dataset for the detection of malignant skin lesions.


title: Colorizing Monochromatic Radiance Fields

abstract: Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessary in representing the world, reproducing color from monochromatic radiance fields becomes crucial. To achieve this goal, instead of manipulating the monochromatic radiance fields directly, we consider it as a representation-prediction task in the Lab color space. By first constructing the luminance and density representation using monochromatic images, our prediction stage can recreate color representation on the basis of an image colorization module. We then reproduce a colorful implicit model through the representation of luminance, density, and color. Extensive experiments have been conducted to validate the effectiveness of our approaches. Our project page: https://liquidammonia.github.io/color-nerf.


title: ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning

abstract: Recently, many versatile Multi-modal Large Language Models (MLLMs) have emerged continuously. However, their capacity to query information depicted in visual charts and engage in reasoning based on the queried contents remains under-explored. In this paper, to comprehensively and rigorously benchmark the ability of the off-the-shelf MLLMs in the chart domain, we construct ChartX, a multi-modal evaluation set covering 18 chart types, 7 chart tasks, 22 disciplinary topics, and high-quality chart data. Besides, we develop ChartVLM to offer a new perspective on handling multi-modal tasks that strongly depend on interpretable patterns, such as reasoning tasks in the field of charts or geometric images. We evaluate the chart-related ability of mainstream MLLMs and our ChartVLM on the proposed ChartX evaluation set. Extensive experiments demonstrate that ChartVLM surpasses both versatile and chart-related large models, achieving results comparable to GPT-4V. We believe that our study can pave the way for further exploration in creating a more comprehensive chart evaluation set and developing more interpretable multi-modal models. Both ChartX and ChartVLM are available at: https://github.com/UniModal4Reasoning/ChartVLM


title: Subspace methods for the simulation of molecular response properties on a quantum computer

abstract: We explore Davidson methods for obtaining excitation energies and other linear response properties within quantum self-consistent linear response (q-sc-LR) theory. Davidson-type methods allow for obtaining only a few selected excitation energies without explicitly constructing the electronic Hessian since they only require the ability to perform Hessian-vector multiplications. We apply the Davidson method to calculate the excitation energies of hydrogen chains (up to H$_{10}$) and analyze aspects of statistical noise for computing excitation energies on quantum simulators. Additionally, we apply Davidson methods for computing linear response properties such as static polarizabilities for H$_2$, LiH, H$_2$O, OH$^-$, and NH$_3$, and show that unitary coupled cluster outperforms classical projected coupled cluster for molecular systems with strong correlation. Finally, we formulate the Davidson method for damped (complex) linear response, with application to the nitrogen K-edge X-ray absorption of ammonia, and the $C_6$ coefficients of H$_2$, LiH, H$_2$O, OH$^-$, and NH$_3$.


title: Adversarial Feature Alignment: Balancing Robustness and Accuracy in Deep Learning via Adversarial Training

abstract: Deep learning models continue to advance in accuracy, yet they remain vulnerable to adversarial attacks, which often lead to the misclassification of adversarial examples. Adversarial training is used to mitigate this problem by increasing robustness against these attacks. However, this approach typically reduces a model's standard accuracy on clean, non-adversarial samples. The necessity for deep learning models to balance both robustness and accuracy for security is obvious, but achieving this balance remains challenging, and the underlying reasons are yet to be clarified. This paper proposes a novel adversarial training method called Adversarial Feature Alignment (AFA), to address these problems. Our research unveils an intriguing insight: misalignment within the feature space often leads to misclassification, regardless of whether the samples are benign or adversarial. AFA mitigates this risk by employing a novel optimization algorithm based on contrastive learning to alleviate potential feature misalignment. Through our evaluations, we demonstrate the superior performance of AFA. The baseline AFA delivers higher robust accuracy than previous adversarial contrastive learning methods while minimizing the drop in clean accuracy to 1.86% and 8.91% on CIFAR10 and CIFAR100, respectively, in comparison to cross-entropy. We also show that joint optimization of AFA and TRADES, accompanied by data augmentation using a recent diffusion model, achieves state-of-the-art accuracy and robustness.


title: Structure of activity in multiregion recurrent neural networks

abstract: Neural circuits are composed of multiple regions, each with rich dynamics and engaging in communication with other regions. The combination of local, within-region dynamics and global, network-level dynamics is thought to provide computational flexibility. However, the nature of such multiregion dynamics and the underlying synaptic connectivity patterns remain poorly understood. Here, we study the dynamics of recurrent neural networks with multiple interconnected regions. Within each region, neurons have a combination of random and structured recurrent connections. Motivated by experimental evidence of communication subspaces between cortical areas, these networks have low-rank connectivity between regions, enabling selective routing of activity. These networks exhibit two interacting forms of dynamics: high-dimensional fluctuations within regions and low-dimensional signal transmission between regions. To characterize this interaction, we develop a dynamical mean-field theory to analyze such networks in the limit where each region contains infinitely many neurons, with cross-region currents as key order parameters. Regions can act as both generators and transmitters of activity, roles that we show are in conflict. Specifically, taming the complexity of activity within a region is necessary for it to route signals to and from other regions. Unlike previous models of routing in neural circuits, which suppressed the activities of neuronal groups to control signal flow, routing in our model is achieved by exciting different high-dimensional activity patterns through a combination of connectivity structure and nonlinear recurrent dynamics. This theory provides insight into the interpretation of both multiregion neural data and trained neural networks.


title: Amplifying Training Data Exposure through Fine-Tuning with Pseudo-Labeled Memberships

abstract: Neural language models (LMs) are vulnerable to training data extraction attacks due to data memorization. This paper introduces a novel attack scenario wherein an attacker adversarially fine-tunes pre-trained LMs to amplify the exposure of the original training data. This strategy differs from prior studies by aiming to intensify the LM's retention of its pre-training dataset. To achieve this, the attacker needs to collect generated texts that are closely aligned with the pre-training data. However, without knowledge of the actual dataset, quantifying the amount of pre-training data within generated texts is challenging. To address this, we propose the use of pseudo-labels for these generated texts, leveraging membership approximations indicated by machine-generated probabilities from the target LM. We subsequently fine-tune the LM to favor generations with higher likelihoods of originating from the pre-training data, based on their membership probabilities. Our empirical findings indicate a remarkable outcome: LMs with over 1B parameters exhibit a four to eight-fold increase in training data exposure. We discuss potential mitigations and suggest future research directions.


title: Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Data

abstract: AI-driven precision oncology has the transformative potential to reshape cancer treatment by leveraging the power of AI models to analyze the interaction between complex patient characteristics and their corresponding treatment outcomes. New technological platforms have facilitated the timely acquisition of multimodal data on tumor biology at an unprecedented resolution, such as single-cell multi-omics data, making this quality and quantity of data available for data-driven improved clinical decision-making. In this work, we propose a modular machine learning framework designed for personalized counterfactual cancer treatment suggestions based on an ensemble of machine learning experts trained on diverse multi-omics technologies. These specialized counterfactual experts per technology are consistently aggregated into a more powerful expert with superior performance and can provide both confidence and an explanation of its decision. The framework is tailored to address critical challenges inherent in data-driven cancer research, including the high-dimensional nature of the data, and the presence of treatment assignment bias in the retrospective observational data. The framework is showcased through comprehensive demonstrations using data from in-vitro and in-vivo treatment responses from a cohort of patients with ovarian cancer. Our method aims to empower clinicians with a reality-centric decision-support tool including probabilistic treatment suggestions with calibrated confidence and personalized explanations for tailoring treatment strategies to multi-omics characteristics of individual cancer patients.


title: On Coupling Constraints in Linear Bilevel Optimization

abstract: It is well-known that coupling constraints in linear bilevel optimization can lead to disconnected feasible sets, which is not possible without coupling constraints. However, there is no difference between linear bilevel problems with and without coupling constraints w.r.t. their complexity-theoretical hardness. In this note, we prove that, although there is a clear difference between these two classes of problems in terms of their feasible sets, the classes are equivalent on the level of optimal solutions. To this end, given a general linear bilevel problem with coupling constraints, we derive a respective problem without coupling constraints and prove that it has the same optimal solutions (when projected back to the original variable space).


title: Pan-Mamba: Effective pan-sharpening with State Space Model

abstract: Pan-sharpening involves integrating information from low-resolution multi-spectral and high-resolution panchromatic images to generate high-resolution multi-spectral counterparts. While recent advancements in the state space model, particularly the efficient long-range dependency modeling achieved by Mamba, have revolutionized computer vision community, its untapped potential in pan-sharpening motivates our exploration. Our contribution, Pan-Mamba, represents a novel pan-sharpening network that leverages the efficiency of the Mamba model in global information modeling. In Pan-Mamba, we customize two core components: channel swapping Mamba and cross-modal Mamba, strategically designed for efficient cross-modal information exchange and fusion. The former initiates a lightweight cross-modal interaction through the exchange of partial panchromatic and multi-spectral channels, while the latter facilities the information representation capability by exploiting inherent cross-modal relationships. Through extensive experiments across diverse datasets, our proposed approach surpasses state-of-the-art methods, showcasing superior fusion results in pan-sharpening. To the best of our knowledge, this work is the first attempt in exploring the potential of the Mamba model and establishes a new frontier in the pan-sharpening techniques. The source code is available at \url{https://github.com/alexhe101/Pan-Mamba}.