title: Continuous Tensor Relaxation for Finding Diverse Solutions in Combinatorial Optimization Problems

abstract: Finding the best solution is a common objective in combinatorial optimization (CO). In practice, directly handling constraints is often challenging, incorporating them into the objective function as the penalties. However, balancing these penalties to achieve the desired solution is time-consuming. Additionally, formulated objective functions and constraints often only approximate real-world scenarios, where the optimal solution is not necessarily the best solution for the original real-world problem. One solution is to obtain (i) penalty-diversified solutions with varying penalty strengths for the former issue and (ii) variation-diversified solutions with different characteristics for the latter issue. Users can then post-select the desired solution from these diverse solutions. However, efficiently finding these diverse solutions is more difficult than identifying one. This study introduces Continual Tensor Relaxation Annealing (CTRA) for unsupervised-learning (UL)-based CO solvers, a computationally efficient framework for finding these diverse solutions in a single training run. The key idea is to leverage representation learning capability to automatically and efficiently learn common representations and parallelization. Numerical experiments show that CTRA enables UL-based solvers to find these diverse solutions much faster than repeatedly running existing UL-based solvers.


title: The explanatory power of activity flow models of brain function

abstract: Tremendous neuroscientific progress has recently been made by mapping brain connectivity, complementing extensive knowledge of task-evoked brain activation patterns. However, despite evidence that they are related, these connectivity and activity lines of research have mostly progressed separately. Here I review the notable productivity and future promise of combining connectivity and task-evoked activity estimates into activity flow models. These data-driven computational models simulate the generation of task-evoked activations (including those linked to behavior), producing empirically-supported explanations of the origin of neurocognitive functions based on the flow of task-evoked activity over empirical brain connections. Critically, by incorporating causal principles and extensive empirical constraints from brain data, this approach can provide more mechanistic accounts of neurocognitive phenomena than purely predictive (as opposed to explanatory) models or models optimized primarily for task performance (e.g., standard artificial neural networks). The variety of activity-flow-based explanations reported so far are covered here along with important methodological and theoretical considerations when discovering new activity-flow-based explanations. Together, these considerations illustrate the promise of activity flow modeling for the future of neuroscience and ultimately for the development of novel clinical treatments (e.g., using brain stimulation) for brain disorders.


title: RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstruction

abstract: In the field of resource-constrained robots and the need for effective place recognition in multi-robotic systems, this article introduces RecNet, a novel approach that concurrently addresses both challenges. The core of RecNet's methodology involves a transformative process: it projects 3D point clouds into range images, compresses them using an encoder-decoder framework, and subsequently reconstructs the range image, restoring the original point cloud. Additionally, RecNet utilizes the latent vector extracted from this process for efficient place recognition tasks. This approach not only achieves comparable place recognition results but also maintains a compact representation, suitable for sharing among robots to reconstruct their collective maps. The evaluation of RecNet encompasses an array of metrics, including place recognition performance, the structural similarity of the reconstructed point clouds, and the bandwidth transmission advantages, derived from sharing only the latent vectors. Our proposed approach is assessed using both a publicly available dataset and field experiments$^1$, confirming its efficacy and potential for real-world applications.


title: An Extended ADMM for Three-block Nonconvex Nonseparable Problem with Applications

abstract: We consider a three-block alternating direction method of multipliers (ADMM) for solving the nonconvex nonseparable optimization problem with linear constraint. Inspired by [1], the third variable is updated twice in each iteration to ensure the global convergence. Based on the powerful Kurdyka-Lojasiewicz property, we prove that the sequence generated by the ADMM converges globally to the critical point of the augmented Lagrangian function. We also point out the convergence of proposed ADMM with swapping the update order of the first and second variables, and with adding a proximal term to the first variable for more general nonseparable problems, respectively. Moreover, we make numerical experiments on three nonconvex problems: multiple measurement vector (MMV), robust PCA (RPCA) and nonnegative matrix completion (NMC). The results show the efficiency and outperformance of proposed ADMM.


title: Thermocrystallization of lattice dipolar bosons coupled to a high-finesse cavity

abstract: Investigating finite temperature effects on quantum phases is key to their experimental realization. Finite temperature, and the interplay between quantum and thermal fluctuations can undermine properties and/or key features of quantum systems but they can also bring upon interesting phenomena. In this paper, we present a comprehensive investigation of the finite temperature phase diagram of two-dimensional lattice dipolar bosons coupled to a high-finesse optical cavity. Interestingly, we observe that checkerboard density-density correlations are enhanced at finite temperature. Indeed, we found that finite temperature drives a superfluid ground state into a normal state which will then develop checkerboard order at higher temperatures. We show that this effect is solely due to the cavity-mediated interactions. We also confirm that the supersolid checkerboard phase survives for a wide range of filling factors up to temperature scale of the order of half hopping amplitude, while the checkerboard diagonal order can survive up to temperatures of a few hopping amplitudes.


title: Operator Dimension Parity Fractionalization

abstract: Lorentz invariant quantum field theories (QFTs) in four spacetime dimensions (4D) have a $\mathbb{Z}_4$ symmetry provided there exists a basis of operators in the QFT where all operators have even operator dimension, $d$, including those with $d > 4$. The $\mathbb{Z}_4$ symmetry is the extension of operator dimension parity by fermion number parity. If the $\mathbb{Z}_4$ is anomaly-free, such QFTs can be related to 3D topological superconductors. Additionally, imposing the $\mathbb{Z}_4$ symmetry on the Standard Model effective field theory severely restricts the allowed processes that violate baryon and lepton numbers.


title: Sample-Efficient Clustering and Conquer Procedures for Parallel Large-Scale Ranking and Selection

abstract: We propose novel "clustering and conquer" procedures for the parallel large-scale ranking and selection (R&S) problem, which leverage correlation information for clustering to break the bottleneck of sample efficiency. In parallel computing environments, correlation-based clustering can achieve an $\mathcal{O}(p)$ sample complexity reduction rate, which is the optimal reduction rate theoretically attainable. Our proposed framework is versatile, allowing for seamless integration of various prevalent R&S methods under both fixed-budget and fixed-precision paradigms. It can achieve improvements without the necessity of highly accurate correlation estimation and precise clustering. In large-scale AI applications such as neural architecture search, a screening-free version of our procedure surprisingly surpasses fully-sequential benchmarks in terms of sample efficiency. This suggests that leveraging valuable structural information, such as correlation, is a viable path to bypassing the traditional need for screening via pairwise comparison--a step previously deemed essential for high sample efficiency but problematic for parallelization. Additionally, we propose a parallel few-shot clustering algorithm tailored for large-scale problems.


title: Numerical solution to a Parabolic-ODE Solow model with spatial diffusion and technology-induced motility

abstract: This work studies a parabolic-ODE PDE's system which describes the evolution of the physical capital "$k$" and technological progress "$A$", using a meshless in one and two dimensional bounded domain with regular boundary. The well-known Solow model is extended by considering the spatial diffusion of both capital anf technology. Moreover, we study the case in which no spatial diffusion of the technology progress occurs. For such models, we propound schemes based on the Generalized Finite Difference method and proof the convergence of the numerical solution to the continuous one. Several examples show the dynamics of the model for a wide range of parameters. These examples illustrate the accuary of the numerical method.


title: Co-orchestration of Multiple Instruments to Uncover Structure-Property Relationships in Combinatorial Libraries

abstract: The rapid growth of automated and autonomous instrumentations brings forth an opportunity for the co-orchestration of multimodal tools, equipped with multiple sequential detection methods, or several characterization tools to explore identical samples. This can be exemplified by the combinatorial libraries that can be explored in multiple locations by multiple tools simultaneously, or downstream characterization in automated synthesis systems. In the co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, the orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Here, we propose and implement a co-orchestration approach for conducting measurements with complex observables such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure, and integrated into iterative workflow via multi-task Gaussian Processes (GP). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GP. We illustrated this method for different modalities of piezoresponse force microscopy and micro-Raman on combinatorial $Sm-BiFeO_3$ library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of measured signals. The analysis code that supports the funding is publicly available at https://github.com/Slautin/2024_Co-orchestration.


title: Neighborly boxes and bipartite coverings; constructions and conjectures

abstract: Two axis-aligned boxes in $\mathbb{R}^d$ are \emph{$k$-neighborly} if their intersection has dimension at least $d-k$ and at most $d-1$. The maximum number of pairwise $k$-neighborly boxes in $\mathbb{R}^d$ is denoted by $n(k,d)$. It is known that $n(k,d)=\Theta(d^k)$, for fixed $1\leqslant k\leqslant d$, but exact formulas are known only in three cases: $k=1$, $k=d-1$, and $k=d$. In particular, the formula $n(1,d)=d+1$ is equivalent to the famous theorem of Graham and Pollak on bipartite partitions of cliques. In this paper we are dealing with the case $k=2$. We give a new construction of $k$-neighborly \emph{codes} giving better lower bounds on $n(2,d)$. The construction is recursive in nature and uses a kind of ``algebra'' on \emph{lists} of ternary strings, which encode neighborly boxes in a familiar way. Moreover, we conjecture that our construction is optimal and gives an explicit formula for $n(2,d)$. This supposition is supported by some numerical experiments and some partial results on related open problems which are recalled.


title: Less is More: Physical-enhanced Radar-Inertial Odometry

abstract: Radar offers the advantage of providing additional physical properties related to observed objects. In this study, we design a physical-enhanced radar-inertial odometry system that capitalizes on the Doppler velocities and radar cross-section information. The filter for static radar points, correspondence estimation, and residual functions are all strengthened by integrating the physical properties. We conduct experiments on both public datasets and our self-collected data, with different mobile platforms and sensor types. Our quantitative results demonstrate that the proposed radar-inertial odometry system outperforms alternative methods using the physical-enhanced components. Our findings also reveal that using the physical properties results in fewer radar points for odometry estimation, but the performance is still guaranteed and even improved, thus aligning with the ``less is more'' principle.


title: Optimize Individualized Energy Delivery for Septic Patients Using Predictive Deep Learning Models: A Real World Study

abstract: Background and Objectives: We aim to establish deep learning models to optimize the individualized energy delivery for septic patients. Methods and Study Design: We conducted a study of adult septic patients in Intensive Care Unit (ICU), collecting 47 indicators for 14 days. After data cleaning and preprocessing, we used stats to explore energy delivery in deceased and surviving patients. We filtered out nutrition-related features and divided the data into three metabolic phases: acute early, acute late, and rehabilitation. Models were built using data before September 2020 and validated on the rest. We then established optimal energy target models for each phase using deep learning. Results: A total of 277 patients and 3115 data were included in this study. The models indicated that the optimal energy targets in the three phases were 900kcal/d, 2300kcal/d, and 2000kcal/d, respectively. Excessive energy intake increased mortality rapidly in the early period of the acute phase. Insufficient energy in the late period of the acute phase significantly raised the mortality of septic patients. For the rehabilitation phase, too much or too little energy delivery both associated with high mortality. Conclusion: Our study established time-series prediction models for septic patients to optimize energy delivery in the ICU. This approach indicated the feasibility of developing nutritional tools for critically ill patients. We recommended permissive underfeeding only in the early acute phase. Later, increased energy intake may improve survival and settle energy debts caused by underfeeding.


title: Three-body scattering area for particles with infinite or zero scattering length in two dimensions

abstract: We derive the asymptotic expansions of the wave function of three particles having equal mass with finite-range interactions and infinite or zero two-dimensional scattering length colliding at zero energy and zero orbital angular momentum, from which a three-body parameter $D$ is defined. The dimension of $D$ is length squared, and we call $D$ three-body scattering area. We find that the ground state energy per particle of a zero-temperature dilute Bose gas with these interactions is approximately $\frac{\hbar^2 D }{6m}\rho^2$, where $\rho$ is the number density of the bosons, $m$ is the mass of each boson, and $\hbar$ is Planck's constant over $2\pi$. Such a Bose gas is stable at $D\geq 0$ in the thermodynamic limit, and metastable at $D<0$ in the harmonic trap if the number of bosons is less than $N_{cr}\approx 3.6413 \sqrt{\frac{\hbar}{m\omega |D|}}$, where $\omega$ is the angular frequency of the harmonic trap. If the two-body interaction supports bound states, $D$ typically acquires a negative imaginary part, and we find the relation between this imaginary part and the amplitudes of the pair-boson production processes. We derive a formula for the three-body recombination rate constant of the many-boson system in terms of the imaginary part of $D$.

categories: cond-mat.quant-gas nucl-th physics.atom-ph quant-ph


title: Cell Painting Gallery: an open resource for image-based profiling

abstract: Image-based or morphological profiling is a rapidly expanding field wherein cells are "profiled" by extracting hundreds to thousands of unbiased, quantitative features from images of cells that have been perturbed by genetic or chemical perturbations. The Cell Painting assay is the most popular imaged-based profiling assay wherein six small-molecule dyes label eight cellular compartments and thousands of measurements are made, describing quantitative traits such as size, shape, intensity, and texture within the nucleus, cytoplasm, and whole cell (Cimini et al., 2023). We have created the Cell Painting Gallery, a publicly available collection of Cell Painting datasets, with granular dataset descriptions and access instructions. It is hosted by AWS on the Registry of Open Data (RODA). As of January 2024, the Cell Painting Gallery holds 656 terabytes (TB) of image and associated numerical data. It includes the largest publicly available Cell Painting dataset, in terms of perturbations tested (Joint Undertaking for Morphological Profiling or JUMP (Chandrasekaran et al., 2023)), along with many other canonical datasets using Cell Painting, close derivatives of Cell Painting (such as LipocyteProfiler (Laber et al., 2023) and Pooled Cell Painting (Ramezani et al., 2023)).


title: The Lax pairs and conserved quantities of the delay Lotka-Volterra equation

abstract: The delay Lotka-Volterra equation is a delay-differential extension of the well known Lotka-Volterra equation, and is known to have N-soliton solutions. In this paper, Backlund transformations, Lax pairs and infinite conserved quantities of the delay Lotka-Volterra equation and its discrete analogue are constructed. The conserved quantities of the delay Lotka-Volterra equation turn out to be complicated and described by using the time-ordered product of linear operators.


title: GPT-4V as Traffic Assistant: An In-depth Look at Vision Language Model on Complex Traffic Events

abstract: The recognition and understanding of traffic incidents, particularly traffic accidents, is a topic of paramount importance in the realm of intelligent transportation systems and intelligent vehicles. This area has continually captured the extensive focus of both the academic and industrial sectors. Identifying and comprehending complex traffic events is highly challenging, primarily due to the intricate nature of traffic environments, diverse observational perspectives, and the multifaceted causes of accidents. These factors have persistently impeded the development of effective solutions. The advent of large vision-language models (VLMs) such as GPT-4V, has introduced innovative approaches to addressing this issue. In this paper, we explore the ability of GPT-4V with a set of representative traffic incident videos and delve into the model's capacity of understanding these complex traffic situations. We observe that GPT-4V demonstrates remarkable cognitive, reasoning, and decision-making ability in certain classic traffic events. Concurrently, we also identify certain limitations of GPT-4V, which constrain its understanding in more intricate scenarios. These limitations merit further exploration and resolution.


title: Preserving the Hermiticity of the One-Body Density Matrix for a Non-Interacting Fermi Gas

abstract: The one-body density matrix (ODM) for a d-dimensional zero temperature non-interacting Fermi gas can be approximately obtained in the semiclassical regime through different $\hbar$-expansion techniques. One would expect that each method of approximating the ODM should yield equivalent density matrices which are both Hermitian and idempotent to any order in $\hbar$. However, the Kirzhnits and Wigner-Kirkwood methods do not yield these properties, while the method of Grammaticos and Voros does. Here we show explicitly, for arbitrary $d\geq 1$-dimensions through an appropriate change into symmetric coordinates, that each method is indeed identical, Hermitian, and idempotent. This change of variables resolves the inconsistencies between the various methods, showing that the non-Hermitian and non-idempotent behaviour of the Kirzhnits and Wigner-Kirkwood methods is an artifact of performing a non-symmetric truncation to the semiclassical $\hbar$-expansions. Our work also provides the first explicit derivation of the $d\geq 1$-dimensional Grammaticos and Voros ODM, originally proposed by Redjati et al. based on their $d = 1, 2, 3, 4$ expressions.

categories: math-ph cond-mat.quant-gas math.MP quant-ph


title: Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models

abstract: Current vision large language models (VLLMs) exhibit remarkable capabilities yet are prone to generate harmful content and are vulnerable to even the simplest jailbreaking attacks. Our initial analysis finds that this is due to the presence of harmful data during vision-language instruction fine-tuning, and that VLLM fine-tuning can cause forgetting of safety alignment previously learned by the underpinning LLM. To address this issue, we first curate a vision-language safe instruction-following dataset VLGuard covering various harmful categories. Our experiments demonstrate that integrating this dataset into standard vision-language fine-tuning or utilizing it for post-hoc fine-tuning effectively safety aligns VLLMs. This alignment is achieved with minimal impact on, or even enhancement of, the models' helpfulness. The versatility of our safety fine-tuning dataset makes it a valuable resource for safety-testing existing VLLMs, training new models or safeguarding pre-trained VLLMs. Empirical results demonstrate that fine-tuned VLLMs effectively reject unsafe instructions and substantially reduce the success rates of several black-box adversarial attacks, which approach zero in many cases. The code and dataset are available at https://github.com/ys-zong/VLGuard.


title: Implicit Neural Representation of Tileable Material Textures

abstract: We explore sinusoidal neural networks to represent periodic tileable textures. Our approach leverages the Fourier series by initializing the first layer of a sinusoidal neural network with integer frequencies with a period $P$. We prove that the compositions of sinusoidal layers generate only integer frequencies with period $P$. As a result, our network learns a continuous representation of a periodic pattern, enabling direct evaluation at any spatial coordinate without the need for interpolation. To enforce the resulting pattern to be tileable, we add a regularization term, based on the Poisson equation, to the loss function. Our proposed neural implicit representation is compact and enables efficient reconstruction of high-resolution textures with high visual fidelity and sharpness across multiple levels of detail. We present applications of our approach in the domain of anti-aliased surface.


title: On the Exploitation of DCT-Traces in the Generative-AI Domain

abstract: Deepfakes represent one of the toughest challenges in the world of Cybersecurity and Digital Forensics, especially considering the high-quality results obtained with recent generative AI-based solutions. Almost all generative models leave unique traces in synthetic data that, if analyzed and identified in detail, can be exploited to improve the generalization limitations of existing deepfake detectors. In this paper we analyzed deepfake images in the frequency domain generated by both GAN and Diffusion Model engines, examining in detail the underlying statistical distribution of Discrete Cosine Transform (DCT) coefficients. Recognizing that not all coefficients contribute equally to image detection, we hypothesize the existence of a unique "discriminative fingerprint", embedded in specific combinations of coefficients. To identify them, Machine Learning classifiers were trained on various combinations of coefficients. In addition, the Explainable AI (XAI) LIME algorithm was used to search for intrinsic discriminative combinations of coefficients. Finally, we performed a robustness test to analyze the persistence of traces by applying JPEG compression. The experimental results reveal the existence of traces left by the generative models that are more discriminative and persistent at JPEG attacks.


title: Wavelet-Decoupling Contrastive Enhancement Network for Fine-Grained Skeleton-Based Action Recognition

abstract: Skeleton-based action recognition has attracted much attention, benefiting from its succinctness and robustness. However, the minimal inter-class variation in similar action sequences often leads to confusion. The inherent spatiotemporal coupling characteristics make it challenging to mine the subtle differences in joint motion trajectories, which is critical for distinguishing confusing fine-grained actions. To alleviate this problem, we propose a Wavelet-Attention Decoupling (WAD) module that utilizes discrete wavelet transform to effectively disentangle salient and subtle motion features in the time-frequency domain. Then, the decoupling attention adaptively recalibrates their temporal responses. To further amplify the discrepancies in these subtle motion features, we propose a Fine-grained Contrastive Enhancement (FCE) module to enhance attention towards trajectory features by contrastive learning. Extensive experiments are conducted on the coarse-grained dataset NTU RGB+D and the fine-grained dataset FineGYM. Our methods perform competitively compared to state-of-the-art methods and can discriminate confusing fine-grained actions well.


title: Query-decision Regression between Shortest Path and Minimum Steiner Tree

abstract: Considering a graph with unknown weights, can we find the shortest path for a pair of nodes if we know the minimal Steiner trees associated with some subset of nodes? That is, with respect to a fixed latent decision-making system (e.g., a weighted graph), we seek to solve one optimization problem (e.g., the shortest path problem) by leveraging information associated with another optimization problem (e.g., the minimal Steiner tree problem). In this paper, we study such a prototype problem called \textit{query-decision regression with task shifts}, focusing on the shortest path problem and the minimum Steiner tree problem. We provide theoretical insights regarding the design of realizable hypothesis spaces for building scoring models, and present two principled learning frameworks. Our experimental studies show that such problems can be solved to a decent extent with statistical significance.


title: A Data Generation Perspective to the Mechanism of In-Context Learning

abstract: In-Context Learning (ICL) empowers Large Language Models (LLMs) with the capacity to learn in context, achieving downstream generalization without gradient updates but with a few in-context examples. Despite the encouraging empirical success, the underlying mechanism of ICL remains unclear, and existing research offers various viewpoints of understanding. These studies propose intuition-driven and ad-hoc technical solutions for interpreting ICL, illustrating an ambiguous road map. In this paper, we leverage a data generation perspective to reinterpret recent efforts and demonstrate the potential broader usage of popular technical solutions, approaching a systematic angle. For a conceptual definition, we rigorously adopt the terms of skill learning and skill recognition. The difference between them is skill learning can learn new data generation functions from in-context data. We also provide a comprehensive study on the merits and weaknesses of different solutions, and highlight the uniformity among them given the perspective of data generation, establishing a technical foundation for future research to incorporate the strengths of different lines of research.


title: AstroSat Observation of Recent Outburst in the Be/X-ray Binary LS V +4417/RX J0440.9+4431

abstract: A Be/X-ray binary system known as RX J0440.9+4431 (or LS V +44 17) is a potential member of the uncommon gamma-ray binary class. With an orbital period of 150 days, this system consists of a neutron star and a Be star companion. The MAXI observatory discovered an X-ray outburst from the source in December of 2022. Early in January, the outburst reached its peak, which was then followed by a decrease and a subsequent rebrightening. The X-ray flux exceeded 1 Crab in the 15-50 keV range at this second peak. AstroSat observations were conducted close to the peak of the second outburst, from January 11 to January 12, 2023. We report here the results of our search for 3-80 keV X-ray emission in the data of the AstroSat's LAXPC detector. It is found that the pulse period of the source is around 208 seconds. The source is found to be emitting more in the softer part of the X-ray energy range. The spectral characteristics can be described by employing a power-law model with an exponential cutoff, along with a blackbody component, interstellar absorption and an additional 6.4 keV iron fluorescence line.


title: Multifractal nature of seismic sequences distributed along the Pacific Ring of Fire

abstract: A multifractal methodology was utilized to analyze a set of seismic sequences distributed along the Pacific Ring of Fire, sourced from the National Earthquake Information Center (NEIC) catalog. The analysis employed the Multifractal Detrended Moving Average Analysis (MFDMA) method to characterize the multi-scale behavior using various geometrical parameters of the multifractal spectrum. The findings of this study can be summarized as follows: firstly, our research suggests that seismic sequences along the Ring of Fire exhibit distinct dynamics; and secondly, it indicates that long-range correlations may influence larger magnitude earthquakes, as demonstrated by the correlation with the $b_{\rm GR}$ index. These results contribute to an enhanced understanding of the multifractal characteristics of seismic activity and their implications for earthquake dynamics.


title: Near-horizon geometries and black hole thermodynamics in higher-derivative AdS$_5$ supergravity

abstract: Higher-derivative corrections in the AdS/CFT correspondence allow us to capture finer details of the dual CFT and to explore the holographic dictionary beyond the infinite N and strong coupling limits. Following an effective field theory approach, we investigate extremal AdS black hole solutions in five-dimensional supergravity with higher-derivative corrections. We provide a general analysis of near-horizon geometries of rotating extremal black holes and show how to obtain their corresponding charges and chemical potentials. We discuss the near-horizon solutions of the two-derivative theory, which we write using a novel parametrization that eases our computation of the higher-derivative corrections. The charges and thermodynamic properties of the black hole are computed while clarifying the ambiguities in their definitions. The charges and potentials turn out to satisfy a near-horizon version of the first law of thermodynamics whose interpretation we make clear. In the supersymmetric case, the results are shown to match the field theory prediction as well as previous results obtained from the on-shell action.


title: Position: Graph Foundation Models are Already Here

abstract: Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph domain, aiming to develop graph models trained on extensive and diverse data to enhance their applicability across various tasks and domains. Developing GFMs presents unique challenges over traditional Graph Neural Networks (GNNs), which are typically trained from scratch for specific tasks on particular datasets. The primary challenge in constructing GFMs lies in effectively leveraging vast and diverse graph data to achieve positive transfer. Drawing inspiration from existing foundation models in the CV and NLP domains, we propose a novel perspective for the GFM development by advocating for a ``graph vocabulary'', in which the basic transferable units underlying graphs encode the invariance on graphs. We ground the graph vocabulary construction from essential aspects including network analysis, expressiveness, and stability. Such a vocabulary perspective can potentially advance the future GFM design in line with the neural scaling laws. All relevant resources with GFM design can be found here.


title: CoFiNet: Unveiling Camouflaged Objects with Multi-Scale Finesse

abstract: Camouflaged Object Detection (COD) is a critical aspect of computer vision aimed at identifying concealed objects, with applications spanning military, industrial, medical and monitoring domains. To address the problem of poor detail segmentation effect, we introduce a novel method for camouflage object detection, named CoFiNet. Our approach primarily focuses on multi-scale feature fusion and extraction, with special attention to the model's segmentation effectiveness for detailed features, enhancing its ability to effectively detect camouflaged objects. CoFiNet adopts a coarse-to-fine strategy. A multi-scale feature integration module is laveraged to enhance the model's capability of fusing context feature. A multi-activation selective kernel module is leveraged to grant the model the ability to autonomously alter its receptive field, enabling it to selectively choose an appropriate receptive field for camouflaged objects of different sizes. During mask generation, we employ the dual-mask strategy for image segmentation, separating the reconstruction of coarse and fine masks, which significantly enhances the model's learning capacity for details. Comprehensive experiments were conducted on four different datasets, demonstrating that CoFiNet achieves state-of-the-art performance across all datasets. The experiment results of CoFiNet underscore its effectiveness in camouflage object detection and highlight its potential in various practical application scenarios.


title: Machine Intelligence in Africa: a survey

abstract: In the last 5 years, the availability of large audio datasets in African countries has opened unlimited opportunities to build machine intelligence (MI) technologies that are closer to the people and speak, learn, understand, and do businesses in local languages, including for those who cannot read and write. Unfortunately, these audio datasets are not fully exploited by current MI tools, leaving several Africans out of MI business opportunities. Additionally, many state-of-the-art MI models are not culture-aware, and the ethics of their adoption indexes are questionable. The lack thereof is a major drawback in many applications in Africa. This paper summarizes recent developments in machine intelligence in Africa from a multi-layer multiscale and culture-aware ethics perspective, showcasing MI use cases in 54 African countries through 400 articles on MI research, industry, government actions, as well as uses in art, music, the informal economy, and small businesses in Africa. The survey also opens discussions on the reliability of MI rankings and indexes in the African continent as well as algorithmic definitions of unclear terms used in MI.


title: Prediction-for-CompAction: navigation in social environments using generalized cognitive maps

abstract: The ultimate navigation efficiency of mobile robots in human environments will depend on how we will appraise them: merely as impersonal machines or as human-like agents. In the latter case, an agent may take advantage of the cooperative collision avoidance, given that it possesses recursive cognition, i.e.,the agent's decisions depend on the decisions made by humans that in turn depend on the agent's decisions. To deal with this high-level cognitive skill, we propose a neural network architecture implementing Prediction-for-CompAction paradigm. The network predicts possible human-agent collisions and compacts the time dimension by projecting a given dynamic situation into a static map. Thereby emerging compact cognitive map can be readily used as a "dynamic GPS" for planning actions or mental evaluation of the convenience of cooperation in a given context. We provide numerical evidence that cooperation yields additional room for more efficient navigation in cluttered pedestrian flows, and the agent can choose path to the target significantly shorter than a robot treated by humans as a functional machine. Moreover, the navigation safety, i.e., the chances to avoid accidental collisions, increases under cooperation. Remarkably, these benefits yield no additional load to the mean society effort. Thus, the proposed strategy is socially compliant, and the humanoid agent can behave as "one of us".


title: Long time behavior of small solutions in the viscous Klein-Gordon equation

abstract: For a viscous Klein-Gordon equation with quadratic nonlinearity, we prove that small solutions exist on exponentially long time scale. Our approach is based on the space-time resonance method in a diffusive setting. It allow to identify, through a simple computation, which of the non-linear effects are critical. The main technical challenge is to handle the interaction of two oscillating and diffusive modes.


title: New treatment of red/blue shifts of emitted photons in terms of Kerr-Newman black hole parameters

abstract: This study presents a method for determining the mass, angular momentum, and charge of Kerr-Newman black holes by analyzing the red/blue shifts of photons emitted by geodesic neutral massive objects. We derive the equations of motion for photons in the Kerr-Newman spacetime. We obtain explicit expressions for redshift/blueshift photons emitted by an object orbiting a Kerr-Newman black hole. Finally, using the Boyer-Lindquist coordinates, we express the red/blue shifts in terms of the metric parameters.


title: Pairing properties of an odd-frequency superfluid Fermi gas

abstract: We theoretically investigate strong-coupling properties of an odd-frequency Fermi superfluid. This pairing state has the unique property that Cooper pairs are formed between fermions, not at the same time, but at different times. To see whether or not such unequal-time pairs still exhibit bosonic behavior, we examine the space-time structure of the odd-frequency Cooper-pair wavefunction at $T=0$, by employing the combined path-integral formalism with the BCS-Eagles-Leggett-type superfluid theory. In the strong-coupling regime, the odd-frequency pair wavefunction still has different space-time structure from that in the ordinary even-frequency $s$-wave superfluid state, their $\textit{magnitudes}$ are found to become close to each other, except for the equal-time pairing component. In this regime, we also evaluate the superfluid phase transition temperature $T_{\rm c}$ within the framework of the strong-coupling theory developed by Nozi\`eres and Schmitt-Rink. The calculated $T_{\rm c}$ in the strong-coupling regime of the odd-frequency system is found to be well described by the Bose-Einstein condensation of tightly bound Bose molecules. Our results indicates that, in spite of vanishing equal-time pairing, odd-frequency Cooper pairs still behave like bosons in the strong-coupling regime, as in the even-frequency $s$-wave superfluid case.


title: Largest bipartite sub-matchings of a random ordered matching or a problem with socks

abstract: Let $M$ be an ordered matching of size $n$, that is, a partition of the set $[2n]$ into 2-element subsets. The sock number of $M$ is the maximum size of a sub-matching of $M$ in which all left-ends of the edges precede all the right-ends (such matchings are also called bipartite). The name of this parameter comes from an amusing "real-life" problem posed by Bosek, concerning an on-line pairing of randomly picked socks from a drying machine. Answering one of Bosek's questions we prove that the sock number of a random matching of size $n$ is asymptotically equal to $n/2$. Moreover, we prove that the expected average number of socks waiting for their match during the whole process is equal to $\frac{2n+1}{6}$. Analogous results are obtained if socks come not in pairs, but in sets of size $r\geq 2$, which corresponds to a similar problem for random ordered $r$-matchings. We also attempt to enumerate matchings with a given sock number.


title: MSPM: A Multi-Site Physiological Monitoring Dataset for Remote Pulse, Respiration, and Blood Pressure Estimation

abstract: Visible-light cameras can capture subtle physiological biomarkers without physical contact with the subject. We present the Multi-Site Physiological Monitoring (MSPM) dataset, which is the first dataset collected to support the study of simultaneous camera-based vital signs estimation from multiple locations on the body. MSPM enables research on remote photoplethysmography (rPPG), respiration rate, and pulse transit time (PTT); it contains ground-truth measurements of pulse oximetry (at multiple body locations) and blood pressure using contacting sensors. We provide thorough experiments demonstrating the suitability of MSPM to support research on rPPG, respiration rate, and PTT. Cross-dataset rPPG experiments reveal that MSPM is a challenging yet high quality dataset, with intra-dataset pulse rate mean absolute error (MAE) below 4 beats per minute (BPM), and cross-dataset pulse rate MAE below 2 BPM in certain cases. Respiration experiments find a MAE of 1.09 breaths per minute by extracting motion features from the chest. PTT experiments find that across the pairs of different body sites, there is high correlation between remote PTT and contact-measured PTT, which facilitates the possibility for future camera-based PTT research.


title: Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks

abstract: A few recent studies have demonstrated that leveraging centrally pre-trained models can offer advantageous initializations for federated learning (FL). However, existing pre-training methods do not generalize well when faced with an arbitrary set of downstream FL tasks. Specifically, they often (i) achieve limited average accuracy, particularly when there are unseen downstream labels, and (ii) result in significant accuracy variance, failing to provide a balanced performance across clients. To address these challenges, we propose CoPreFL, a collaborative/distributed pre-training approach which provides a robust initialization for downstream FL tasks. The key idea of CoPreFL is a model-agnostic meta-learning (MAML) procedure that tailors the global model to closely mimic heterogeneous and unseen FL scenarios, resulting in a pre-trained model that is rapidly adaptable to arbitrary FL tasks. Our MAML procedure incorporates performance variance into the meta-objective function, balancing performance across clients rather than solely optimizing for accuracy. Through extensive experiments, we demonstrate that CoPreFL obtains significant improvements in both average accuracy and variance across arbitrary downstream FL tasks with unseen/seen labels, compared with various pre-training baselines. We also show how CoPreFL is compatible with different well-known FL algorithms applied by the downstream tasks, enhancing performance in each case.


title: Fast social-like learning of complex behaviors based on motor motifs

abstract: Social learning is widely observed in many species. Less experienced agents copy successful behaviors, exhibited by more experienced individuals. Nevertheless, the dynamical mechanisms behind this process remain largely unknown. Here we assume that a complex behavior can be decomposed into a sequence of $n$ motor motifs. Then a neural network capable of activating motor motifs in a given sequence can drive an agent. To account for $(n-1)!$ possible sequences of motifs in a neural network, we employ the winner-less competition approach. We then consider a teacher-learner situation: one agent exhibits a complex movement, while another one aims at mimicking the teacher's behavior. Despite the huge variety of possible motif sequences we show that the learner, equipped with the provided learning model, can rewire ``on the fly'' its synaptic couplings in no more than $(n-1)$ learning cycles and converge exponentially to the durations of the teacher's motifs. We validate the learning model on mobile robots. Experimental results show that indeed the learner is capable of copying the teacher's behavior composed of six motor motifs in a few learning cycles. The reported mechanism of learning is general and can be used for replicating different functions, including, for example, sound patterns or speech.


title: Invisible Finger: Practical Electromagnetic Interference Attack on Touchscreen-based Electronic Devices

abstract: Touchscreen-based electronic devices such as smart phones and smart tablets are widely used in our daily life. While the security of electronic devices have been heavily investigated recently, the resilience of touchscreens against various attacks has yet to be thoroughly investigated. In this paper, for the first time, we show that touchscreen-based electronic devices are vulnerable to intentional electromagnetic interference (IEMI) attacks in a systematic way and how to conduct this attack in a practical way. Our contribution lies in not just demonstrating the attack, but also analyzing and quantifying the underlying mechanism allowing the novel IEMI attack on touchscreens in detail. We show how to calculate both the minimum amount of electric field and signal frequency required to induce touchscreen ghost touches. We further analyze our IEMI attack on real touchscreens with different magnitudes, frequencies, duration, and multitouch patterns. The mechanism of controlling the touchscreen-enabled electronic devices with IEMI signals is also elaborated. We design and evaluate an out-of-sight touchscreen locator and touch injection feedback mechanism to assist a practical IEMI attack. Our attack works directly on the touchscreen circuit regardless of the touchscreen scanning mechanism or operating system. Our attack can inject short-tap, long-press, and omni-directional gestures on touchscreens from a distance larger than the average thickness of common tabletops. Compared with the state-of-the-art touchscreen attack, ours can accurately inject different types of touch events without the need for sensing signal synchronization, which makes our attack more robust and practical. In addition, rather than showing a simple proof-of-concept attack, we present and demonstrate the first ready-to-use IEMI based touchscreen attack vector with end-to-end attack scenarios.


title: Ab initio description of monopole resonances in light- and medium-mass nuclei: I. Technical aspects and uncertainties of ab initio PGCM calculations

abstract: Giant resonances (GRs) are a striking manifestation of collective motions in mesoscopic systems such as atomic nuclei. Until recently, theoretical investigations have essentially relied on the (quasiparticle) random phase approximation ((Q)RPA), and extensions of it, based on phenomenological energy density functionals (EDFs). As part of a current effort to describe GRs within an ab initio theoretical scheme, the present work promotes the use of the projected generator coordinate method (PGCM). This method, which can handle anharmonic effects while satisfying symmetries of the nuclear Hamiltonian, displays a favorable (i.e. mean-field-like) scaling with system's size. Presently focusing on the isoscalar giant monopole resonance (GMR) of light- and medium-mass nuclei, PGCM's potential to deliver wide-range ab initio studies of GRs in closed- and open-shell nuclei encompassing pairing, deformation, and shape coexistence effects is demonstrated. The comparison with consistent QRPA calculations highlights PGCM's unique attributes and sheds light on the intricate interplay of nuclear collective excitations. The present paper is the first in a series of four and focuses on technical aspects and uncertainty quantification of ab initio PGCM calculations of GMR using the doubly open-shell $^{46}$Ti as an illustrative example. The second paper displays results for a set of nuclei of physical interest and proceeds to the comparison with consistent (deformed) ab initio QRPA calculations. While the third paper analyzes useful moments of the monopolar strength function and different ways to access them within PGCM calculations, the fourth paper focuses on the effect of the symmetry restoration on the monopole strength function.


title: Vanilla Bayesian Optimization Performs Great in High Dimensions

abstract: High-dimensional problems have long been considered the Achilles' heel of Bayesian optimization algorithms. Spurred by the curse of dimensionality, a large collection of algorithms aim to make it more performant in this setting, commonly by imposing various simplifying assumptions on the objective. In this paper, we identify the degeneracies that make vanilla Bayesian optimization poorly suited to high-dimensional tasks, and further show how existing algorithms address these degeneracies through the lens of lowering the model complexity. Moreover, we propose an enhancement to the prior assumptions that are typical to vanilla Bayesian optimization algorithms, which reduces the complexity to manageable levels without imposing structural restrictions on the objective. Our modification - a simple scaling of the Gaussian process lengthscale prior with the dimensionality - reveals that standard Bayesian optimization works drastically better than previously thought in high dimensions, clearly outperforming existing state-of-the-art algorithms on multiple commonly considered real-world high-dimensional tasks.


title: Federated Learning with Differential Privacy

abstract: Federated learning (FL), as a type of distributed machine learning, is capable of significantly preserving client's private data from being shared among different parties. Nevertheless, private information can still be divulged by analyzing uploaded parameter weights from clients. In this report, we showcase our empirical benchmark of the effect of the number of clients and the addition of differential privacy (DP) mechanisms on the performance of the model on different types of data. Our results show that non-i.i.d and small datasets have the highest decrease in performance in a distributed and differentially private setting.


title: Observability of cyclotron resonance in the hydrodynamic regime of bilayer graphene

abstract: We offer theoretical predictions for the frequency of the resonant frequency of transport for the hydrodynamic description of bilayer graphene, as well as provide quantification for the relative strength of this signal throughout phase space. Our calculations are based on classical fluid dynamics equations derived from the Boltzmann equation for bilayer graphene in arXiv:1901.07039, and suggest that while this resonance is accessible to current experimental techniques, the same mechanism which causes the hydrodynamic resonance to differ from the Fermi liquid value is responsible for a significant broadening of the peak.


title: Longitudinal Control Volumes: A Novel Centralized Estimation and Control Framework for Distributed Multi-Agent Sorting Systems

abstract: Centralized control of a multi-agent system improves upon distributed control especially when multiple agents share a common task e.g., sorting different materials in a recycling facility. Traditionally, each agent in a sorting facility is tuned individually which leads to suboptimal performance if one agent is less efficient than the others. Centralized control overcomes this bottleneck by leveraging global system state information, but it can be computationally expensive. In this work, we propose a novel framework called Longitudinal Control Volumes (LCV) to model the flow of material in a recycling facility. We then employ a Kalman Filter that incorporates local measurements of materials into a global estimation of the material flow in the system. We utilize a model predictive control algorithm that optimizes the rate of material flow using the global state estimate in real-time. We show that our proposed framework outperforms distributed control methods by 40-100% in simulation and physical experiments.


title: Malaria incidence and prevalence: An ecological analysis through Six Sigma approach

abstract: Malaria is the leading cause of death globally, especially in sub-Saharan African countries claiming over 400,000 deaths globally each year, underscoring the critical need for continued efforts to combat this preventable and treatable disease. The objective of this study is to provide statistical guidance on the optimal preventive and control measures against malaria. Data have been collected from reliable sources, such as World Health Organization, UNICEF, Our World in Data, and STATcompiler. Data were categorized according to the factors and sub-factors related to deaths caused by malaria. These factors and sub-factors were determined based on root cause analysis and data sources. Using JMP 16 Pro software, both linear and multiple linear regression were conducted to analyze the data. The analyses aimed to establish a linear relationship between the dependent variable (malaria deaths in the overall population) and independent variables, such as life expectancy, malaria prevalence in children, net usage, indoor residual spraying usage, literate population, and population with inadequate sanitation in each selected sample country. The statistical analysis revealed that using insecticide treated nets (ITNs) by children and individuals significantly decreased the death count, as 1,000 individuals sleeping under ITNs could reduce the death count by eight. Based on the statistical analysis, this study suggests more rigorous research on the usage of ITNs.


title: Epidemics on Networks

abstract: Despite centuries of work on containment and mitigation strategies, infectious diseases are still a major problem facing humanity. This work is concerned with simulating heterogeneous contact structures and understanding how the structure of the underlying network affects the spread of the disease. For example, it has been empirically demonstrated and validated that scale free networks do not have an epidemic threshold. Understanding the relationship between network structure and disease dynamics can help to develop better mitigation strategies and more effective interventions.


title: Image Fusion via Vision-Language Model

abstract: Image fusion integrates essential information from multiple source images into a single composite, emphasizing the highlighting structure and textures, and refining imperfect areas. Existing methods predominantly focus on pixel-level and semantic visual features for recognition. However, they insufficiently explore the deeper semantic information at a text-level beyond vision. Therefore, we introduce a novel fusion paradigm named image Fusion via vIsion-Language Model (FILM), for the first time, utilizing explicit textual information in different source images to guide image fusion. In FILM, input images are firstly processed to generate semantic prompts, which are then fed into ChatGPT to obtain rich textual descriptions. These descriptions are fused in the textual domain and guide the extraction of crucial visual features from the source images through cross-attention, resulting in a deeper level of contextual understanding directed by textual semantic information. The final fused image is created by vision feature decoder. This paradigm achieves satisfactory results in four image fusion tasks: infrared-visible, medical, multi-exposure, and multi-focus image fusion. We also propose a vision-language dataset containing ChatGPT-based paragraph descriptions for the ten image fusion datasets in four fusion tasks, facilitating future research in vision-language model-based image fusion. Code and dataset will be released.


title: Role of Mentorship, Career Conceptualization, and Leadership in Developing Women's Physics Identity and Belonging

abstract: The percentage of women receiving bachelors degrees in physics in the U.S. lags well behind that of men, and women leave the major at higher rates. Achieving equity in physics will mean that women stay in physics at the same rates as men, but this will require changes in the culture and support structures. A strong sense of belonging can lead to higher retention rates so interventions meant to increase dimensions of physics identity (interest, recognition, performance, and competence) may increase persistence overall and increase women's retention differentially. We describe our model in which mentorship, an understanding of career options (career conceptualization), and leadership are inputs into the development of these dimensions of physics identity. This paper includes preliminary results from a qualitative study that aims to better understand how career conceptualization, leadership, and mentorship contribute to the development of physics identity and belonging. We report results from a survey of 15 undergraduate physics students which was followed up by interviews with 5 of those students. The students were from a small private liberal arts college in the midwest region of the U.S. and a large public university in the southeast region of the U.S. classified as a Hispanic-serving institution (HSI). With respect to mentorship, we found that it could provide critical support for students' engagement in the physics community. Leadership experiences have not previously been positioned as an important input into identity, yet we found that they helped women in physics feel more confident, contributing to their recognition of themselves as physics people. While the data on how career conceptualization contributed to the building of identity is limited, there are some connections to recognition and competence, and it will be an interesting avenue of future exploration.


title: Wall-wake laws for the mean velocity and the turbulence

abstract: A new wall-wake law is proposed for the streamwise turbulence in the outer region of a turbulent boundary layer. The formulation pairs the logarithmic part of the profile (with a slope A_1 and additive constant B_1) to an outer linear part, and it accurately describes over 95% of the boundary layer profile at high Reynolds numbers. Once the slope A_1 is fixed, B_1 is the only free parameter determining the fit. Most importantly, B_1 is shown to be proportional to the wake factor in the wall-wake law for the mean velocity, revealing a previously unsuspected connection between the turbulence and the mean flow.


title: Silicon nitride bent asymmetric coupled waveguides with partial Euler bends

abstract: Waveguide geometries combining bent asymmetric coupled structures and adiabatic transitions shaped as partial Euler bends are put forward and theoretically analyzed in this work. Designs aiming to reduce the radiation loss, with application in curved waveguide sections and Q-enhanced microresonators, and polarization selection geometries, both for the silicon nitride platform, are studied using highly accurate numerical techniques.


title: Distributional Reduction: Unifying Dimensionality Reduction and Clustering with Gromov-Wasserstein

abstract: Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or organizing points into meaningful clusters (clustering). In this work, we revisit these approaches under the lens of optimal transport and exhibit relationships with the Gromov-Wasserstein problem. This unveils a new general framework, called distributional reduction, that recovers DR and clustering as special cases and allows addressing them jointly within a single optimization problem. We empirically demonstrate its relevance to the identification of low-dimensional prototypes representing data at different scales, across multiple image and genomic datasets.


title: Recommendations on Statistical Randomness Test Batteries for Cryptographic Purposes

abstract: Security in different applications is closely related to the goodness of the sequences generated for such purposes. Not only in Cryptography but also in other areas, it is necessary to obtain long sequences of random numbers or that, at least, behave as such. To decide whether the generator used produces sequences that are random, unpredictable and independent, statistical checks are needed. Different batteries of hypothesis tests have been proposed for this purpose. In this work, a survey of the main test batteries is presented, indicating their pros and cons, giving some guidelines for their use and presenting some practical examples.


title: Simultaneous Calibration and Navigation (SCAN) of Multiple Ultrasonic Local Positioning Systems

abstract: This paper proposes a Simultaneous Calibration and Navigation (SCAN) algorithm of a multiple Ultrasonic Local Positioning Systems (ULPSs) that cover an extensive indoor area. The idea is the development of the same concept than SLAM (Simultaneous Localization and Mapping), in which a Mobile Robot (MR) estimates the map while it is navigating. The MR calibrates the beacons of several ULPSs while it is moving inside the localization area. The concept of calibration is the estimation of the position of the beacons referenced to a known map. The scenario is composed of some calibrated ULPSs that we denote as Globally Referenced Ultrasonic Local Positioning Systems (GRULPSs) that are located in strategic points like entrances covering the start and the end of a possible trajectory in the environment. Additionally, there are several non-calibrated ULPSs named Locally Referenced Ultrasonic Local Positioning Systems (LRULPSs) that are placed around the localization area. The proposal uses a MR with odometer for calibrating the beacons of the LRULPSs while it is navigating on their coverage area and go from one GRULPS to another. The algorithm is based on multiple filters running in parallel (one filter for each LRULPS and another one for the GRULPSs) that estimate the global and local trajectories of the MR (one trajectory for each local reference system of the LRULPSs) fusing the information related to the Ultrasound Signals (US) and the odometer of the MR. The position of the beacons of the LRULPSs are obtained by a transformation vector for each LRULPS that converts the local coordinates to the global reference system. Extended Kalman Filter (EKF), Unscented Kalman Filter (UKF) and H-Inf Filter have been tested, in simulations and real experiments, in order to compare their performance in this case.


title: Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey

abstract: Large-scale pre-trained vision models (PVMs) have shown great potential for adaptability across various downstream vision tasks. However, with state-of-the-art PVMs growing to billions or even trillions of parameters, the standard full fine-tuning paradigm is becoming unsustainable due to high computational and storage demands. In response, researchers are exploring parameter-efficient fine-tuning (PEFT), which seeks to exceed the performance of full fine-tuning with minimal parameter modifications. This survey provides a comprehensive overview and future directions for visual PEFT, offering a systematic review of the latest advancements. First, we provide a formal definition of PEFT and discuss model pre-training methods. We then categorize existing methods into three categories: addition-based, partial-based, and unified-based. Finally, we introduce the commonly used datasets and applications and suggest potential future research challenges. A comprehensive collection of resources is available at https://github.com/synbol/Awesome-Parameter-Efficient-Transfer-Learning.


title: Language Writ Large: LLMs, ChatGPT, Grounding, Meaning and Understanding

abstract: Apart from what (little) OpenAI may be concealing from us, we all know (roughly) how ChatGPT works (its huge text database, its statistics, its vector representations, and their huge number of parameters, its next-word training, and so on). But none of us can say (hand on heart) that we are not surprised by what ChatGPT has proved to be able to do with these resources. This has even driven some of us to conclude that ChatGPT actually understands. It is not true that it understands. But it is also not true that we understand how it can do what it can do. I will suggest some hunches about benign biases: convergent constraints that emerge at LLM scale that may be helping ChatGPT do so much better than we would have expected. These biases are inherent in the nature of language itself, at LLM scale, and they are closely linked to what it is that ChatGPT lacks, which is direct sensorimotor grounding to connect its words to their referents and its propositions to their meanings. These convergent biases are related to (1) the parasitism of indirect verbal grounding on direct sensorimotor grounding, (2) the circularity of verbal definition, (3) the mirroring of language production and comprehension, (4) iconicity in propositions at LLM scale, (5) computational counterparts of human categorical perception in category learning by neural nets, and perhaps also (6) a conjecture by Chomsky about the laws of thought. The exposition will be in the form of a dialogue with ChatGPT-4.


title: Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models

abstract: Recently, large language models (LLMs) have shown remarkable capabilities including understanding context, engaging in logical reasoning, and generating responses. However, this is achieved at the expense of stringent computational and memory requirements, hindering their ability to effectively support long input sequences. This survey provides an inclusive review of the recent techniques and methods devised to extend the sequence length in LLMs, thereby enhancing their capacity for long-context understanding. In particular, we review and categorize a wide range of techniques including architectural modifications, such as modified positional encoding and altered attention mechanisms, which are designed to enhance the processing of longer sequences while avoiding a proportional increase in computational requirements. The diverse methodologies investigated in this study can be leveraged across different phases of LLMs, i.e., training, fine-tuning and inference. This enables LLMs to efficiently process extended sequences. The limitations of the current methodologies is discussed in the last section along with the suggestions for future research directions, underscoring the importance of sequence length in the continued advancement of LLMs.


title: Revisiting Generative Adversarial Networks for Binary Semantic Segmentation on Imbalanced Datasets

abstract: Anomalous crack region detection is a typical binary semantic segmentation task, which aims to detect pixels representing cracks on pavement surface images automatically by algorithms. Although existing deep learning-based methods have achieved outcoming results on specific public pavement datasets, the performance would deteriorate dramatically on imbalanced datasets. The input datasets used in such tasks suffer from severely between-class imbalanced problems, hence, it is a core challenge to obtain a robust performance on diverse pavement datasets with generic deep learning models. To address this problem, in this work, we propose a deep learning framework based on conditional Generative Adversarial Networks (cGANs) for the anomalous crack region detection tasks at the pixel level. In particular, the proposed framework containing a cGANs and a novel auxiliary network is developed to enhance and stabilize the generator's performance under two alternative training stages, when estimating a multiscale probability feature map from heterogeneous and imbalanced inputs iteratively. Moreover, several attention mechanisms and entropy strategies are incorporated into the cGANs architecture and the auxiliary network separately to mitigate further the performance deterioration of model training on severely imbalanced datasets. We implement extensive experiments on six accessible pavement datasets. The experimental results from both visual and quantitative evaluation show that the proposed framework can achieve state-of-the-art results on these datasets efficiently and robustly without acceleration of computation complexity.


title: ExTTNet: A Deep Learning Algorithm for Extracting Table Texts from Invoice Images

abstract: In this work, product tables in invoices are obtained autonomously via a deep learning model, which is named as ExTTNet. Firstly, text is obtained from invoice images using Optical Character Recognition (OCR) techniques. Tesseract OCR engine [37] is used for this process. Afterwards, the number of existing features is increased by using feature extraction methods to increase the accuracy. Labeling process is done according to whether each text obtained as a result of OCR is a table element or not. In this study, a multilayer artificial neural network model is used. The training has been carried out with an Nvidia RTX 3090 graphics card and taken $162$ minutes. As a result of the training, the F1 score is $0.92$.


title: Novel approaches for the reliable and efficient numerical evaluation of the Landau operator

abstract: When applying Hamiltonian operator splitting methods for the time integration of multi-species Vlasov-Maxwell-Landau systems, the reliable and efficient numerical approximation of the Landau equation represents a fundamental component of the entire algorithm. Substantial computational issues arise from the treatment of the physically most relevant three-dimensional case with Coulomb interaction. This work is concerned with the introduction and numerical comparison of novel approaches for the evaluation of the Landau collision operator. In the spirit of collocation, common tools are the identification of fundamental integrals, series expansions of the integral kernel and the density function on the main part of the velocity domain, and interpolation as well as quadrature approximation nearby the singularity of the kernel. Focusing on the favourable choice of the Fourier spectral method, their practical implementation uses the reduction to basic integrals, fast Fourier techniques, and summations along certain directions. Moreover, an important observation is that a significant percentage of the overall computational effort can be transferred to precomputations which are independent of the density function. For the purpose of exposition and numerical validation, the cases of constant, regular, and singular integral kernels are distinguished, and the procedure is adapted accordingly to the increasing complexity of the problem. With regard to the time integration of the Landau equation, the most expedient approach is applied in such a manner that the conservation of mass is ensured.


title: Magnetochiral Tunneling in Paramagnetic Co$_{1/3}$NbS$_2$

abstract: Electric currents have the intriguing ability to induce magnetization in nonmagnetic crystals with sufficiently low crystallographic symmetry. Some associated phenomena include the non-linear anomalous Hall effect in polar crystals and the nonreciprocal directional dichroism in chiral crystals when magnetic fields are applied. In this work, we demonstrate that the same underlying physics is also manifested in the electronic tunneling process between the surface of a nonmagnetic chiral material and a magnetized scanning probe. In the paramagnetic but chiral metallic compound Co$_{1/3}$NbS$_2$, the magnetization induced by the tunneling current is shown to become detectable by its coupling to the magnetization of the tip itself. This results in a contrast across different chiral domains, achieving atomic-scale spatial resolution of structural chirality. To support the proposed mechanism, we used first-principles theory to compute the chirality-dependent current-induced magnetization and Berry curvature in the bulk of the material. Our demonstration of this magnetochiral tunneling effect opens up a new avenue for investigating atomic-scale variations in the local crystallographic symmetry and electronic structure across the structural domain boundaries of low-symmetry nonmagnetic crystals.


title: Don't Label Twice: Quantity Beats Quality when Comparing Binary Classifiers on a Budget

abstract: We study how to best spend a budget of noisy labels to compare the accuracy of two binary classifiers. It's common practice to collect and aggregate multiple noisy labels for a given data point into a less noisy label via a majority vote. We prove a theorem that runs counter to conventional wisdom. If the goal is to identify the better of two classifiers, we show it's best to spend the budget on collecting a single label for more samples. Our result follows from a non-trivial application of Cram\'er's theorem, a staple in the theory of large deviations. We discuss the implications of our work for the design of machine learning benchmarks, where they overturn some time-honored recommendations. In addition, our results provide sample size bounds superior to what follows from Hoeffding's bound.


title: Palindrome Partitions and the Calkin-Wilf Tree

abstract: There is a well-known bijection between finite binary sequences and integer partitions. Sequences of length r correspond to partitions of perimeter r+1. Motivated by work on rational numbers in the Calkin-Wilf tree, we classify partitions whose corresponding binary sequence is a palindrome. We give a generating function that counts these partitions, and describe how to efficiently generate all of them. Atypically for partitions generating functions, we find an unusual significance to prime degrees. Specifically, we prove there are nontrivial palindrome partitions of n except when n=3 or n+1 is prime. We find an interesting new ''branching diagram" for partitions, similar to Young's lattice, with an action of the Klein four group corresponding to natural operations on the binary sequences.


title: Contrasting twisted bilayer graphene and transition metal dichalcogenides for fractional Chern insulators: an emergent gauge picture

abstract: The recent experimental discovery of the zero-field fractional Chern insulator (FCI) in twisted $\mathrm{MoTe_2}$ moir\'e superlattices has sparked immense interest in this exotic topological quantum state. The FCI has also been observed in previous experiments in magic angle twisted bilayer graphene (TBG) under a finite magnetic field of about 5 Tesla. Generally, the stabilization of FCI requires fine-tuning the topological band to satisfy certain conditions. It would still be helpful to have an intuitive picture to understand the different behaviors in twisted $\mathrm{MoTe_2}$ and TBG. Here, we compare them through the lens of emergent gauge fields. In TBG, the system can be mapped to two Dirac fermions coupled to emergent gauge fields with opposite signs. In contrast, the twisted $\mathrm{MoTe_2}$ reduces to a hole with parabolic dispersion coupled to an emergent gauge field. This contrasting gauge structure provides a new perspective on the observed difference: the zero-field FCI is stable in $\mathrm{MoTe_2}$ but absent in TBG. Based on this understanding, we will explore potential strategies for stabilizing FCI in both moir\'e superlattices.


title: Collaboration of Digital Twins through Linked Open Data: Architecture with FIWARE as Enabling Technology

abstract: The collaboration of the real world and the virtual world, known as Digital Twin, has become a trend with numerous successful use cases. However, there are challenges mentioned in the literature that must be addressed. One of the most important issues is the difficulty of collaboration of Digital Twins due to the lack of standardization in their implementation. This article continues a previous work that proposed a generic architecture based on the FIWARE components to build Digital Twins in any field. Our work proposes the use of Linked Open Data as a mechanism to facilitate the communication of Digital Twins. We validate our proposal with a use case of an urban Digital Twin that collaborates with a parking Digital Twin. We conclude that Linked Open Data in combination with the FIWARE ecosystem is a real reference option to deploy Digital Twins and to enable the collaboration between Digital Twins.


title: Rotating Black Holes in a Viable Lorentz-Violating Gravity: Finding Exact Solutions Without Tears

abstract: We introduce a two-step procedure for finding Kerr-type rotating black hole solutions without tears. Considering the low-energy sector of Horava gravity as a viable Lorentz-violating gravity in four dimensions which admits a different speed of gravity, we find the exact rotating black hole solutions (with or without cosmological constant). We find that the singular region extends to r < 0 region from the ring singularity at r = 0 in Boyer-Lindquist coordinates. There are two Killing horizons where g^rr = 0 and the black hole thermodynamics laws are still valid. We find the rotating black hole solutions with electromagnetic charges only when we consider the noble electromagnetic couplings, in such a way that the speed of light is the same as the speed of gravity. With the noble choice of couplings, our Lorentz-violating gravity can be consistent with the recently-observed time delay of the coincident GW and GRB signals. Furthermore, in Appendices, we show that (a) the uniqueness of the invariant line element ds^2 under Diff_F, contrary to LV action, (b) the solutions are the Petrov type I with four distinct principal null vectors, and (c) the Hamilton-Jacobi equation for the geodesic particles are not separable.


title: Teacher-Student Learning based Low Complexity Relay Selection in Wireless Powered Communications

abstract: Radio Frequency Energy Harvesting (RF-EH) networks are key enablers of massive Internet-of-things by providing controllable and long-distance energy transfer to energy-limited devices. Relays, helping either energy or information transfer, have been demonstrated to significantly improve the performance of these networks. This paper studies the joint relay selection, scheduling, and power control problem in multiple-source-multiple-relay RF-EH networks under nonlinear EH conditions. We first obtain the optimal solution to the scheduling and power control problem for the given relay selection. Then, the relay selection problem is formulated as a classification problem, for which two convolutional neural network (CNN) based architectures are proposed. While the first architecture employs conventional 2D convolution blocks and benefits from skip connections between layers; the second architecture replaces them with inception blocks, to decrease trainable parameter size without sacrificing accuracy for memory-constrained applications. To decrease the runtime complexity further, teacher-student learning is employed such that the teacher network is larger, and the student is a smaller size CNN-based architecture distilling the teacher's knowledge. A novel dichotomous search-based algorithm is employed to determine the best architecture for the student network. Our simulation results demonstrate that the proposed solutions provide lower complexity than the state-of-art iterative approaches without compromising optimality.


title: Frequency Explains the Inverse Correlation of Large Language Models' Size, Training Data Amount, and Surprisal's Fit to Reading Times

abstract: Recent studies have shown that as Transformer-based language models become larger and are trained on very large amounts of data, the fit of their surprisal estimates to naturalistic human reading times degrades. The current work presents a series of analyses showing that word frequency is a key explanatory factor underlying these two trends. First, residual errors from four language model families on four corpora show that the inverse correlation between model size and fit to reading times is the strongest on the subset of least frequent words, which is driven by excessively accurate predictions of larger model variants. Additionally, training dynamics reveal that during later training steps, all model variants learn to predict rare words and that larger model variants do so more accurately, which explains the detrimental effect of both training data amount and model size on fit to reading times. Finally, a feature attribution analysis demonstrates that larger model variants are able to accurately predict rare words based on both an effectively longer context window size as well as stronger local associations compared to smaller model variants. Taken together, these results indicate that Transformer-based language models' surprisal estimates diverge from human-like expectations due to the superhumanly complex associations they learn for predicting rare words.


title: Long induced paths in expanders

abstract: We prove that any bounded degree regular graph with sufficiently strong spectral expansion contains an induced path of linear length. This is the first such result for expanders, strengthening an analogous result in the random setting by Dragani\'c, Glock and Krivelevich. More generally, we find long induced paths in sparse graphs that satisfy a mild upper-uniformity edge-distribution condition.


title: Cooling and heating regions of Joule-Thomson expansion for AdS black holes: Maxwell-power-Yang-Mills and Kerr Sen black holes

abstract: In this paper, we explore the Joule-Thomson expansion (JTE) process for the Einstein-Power-Young-Mills (EPYM) and the AdS Kerr Sen (AKS) black holes. We study the effect of free parameters on the Joule-Thomson coefficient (JTC), the inversion curve, and the $T_i^{min}/T_{c}$. The isenthalpic curves of the AKS black hole show cooling or heating behavior depending on the inversion curve, which is affected by the mass and the parameters $b$ and $a$ of the black hole. If we assume the parameter $b$ to be zero, the results reduce to the Kerr-AdS black holes[1]. In [2,3], for the Einstein-Power-Yang-Mills AdS black hole with $q>1$ and $n=2$, the $T_i^{min}/T_{c}$ is $1/2$. But in this paper, for the AdS-Maxwell-power-Yang-Mills black hole, when $q>1$, the $T_i^{min}/T_{c}$ is almost equal to $1/2$ for the increase of Maxwell's charge $C$, and when $q=1/2$, the $T_i^{min}/T_{c}$ is equal to $1/2$ for all values of $C$. Also, when $1/2<q<1$, the $T_i^{min}/T_{c}$ is close to the value of $1/2$, and finally when $0<q<1/2$, the values of $T_i^{min}/T_{c}$ move away from the value of $1/2$, that is, they become smaller. For the AKS black hole, we found that for free parameters $a=0.00951$ and $b=0.00475$, the $T_i^{min}/T_{c}$ is almost $1/2$. Finally, we compare our findings with others in the literature and summarize our results in Tables 1-5.


title: XTSFormer: Cross-Temporal-Scale Transformer for Irregular Time Event Prediction

abstract: Event prediction aims to forecast the time and type of a future event based on a historical event sequence. Despite its significance, several challenges exist, including the irregularity of time intervals between consecutive events, the existence of cycles, periodicity, and multi-scale event interactions, as well as the high computational costs for long event sequences. Existing neural temporal point processes (TPPs) methods do not capture the multi-scale nature of event interactions, which is common in many real-world applications such as clinical event data. To address these issues, we propose the cross-temporal-scale transformer (XTSFormer), designed specifically for irregularly timed event data. Our model comprises two vital components: a novel Feature-based Cycle-aware Time Positional Encoding (FCPE) that adeptly captures the cyclical nature of time, and a hierarchical multi-scale temporal attention mechanism. These scales are determined by a bottom-up clustering algorithm. Extensive experiments on several real-world datasets show that our XTSFormer outperforms several baseline methods in prediction performance.


title: Central Limit Theorem for R\'enyi Divergence of Infinite Order

abstract: For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the R\'enyi divergence of infinite order. In terms of densities $p_n$ of $Z_n$, this is a strengthened variant of the local limit theorem taking the form $\sup_x (p_n(x) - \varphi(x))/\varphi(x) \rightarrow 0$ as $n \rightarrow \infty$.


title: Open dynamics of entanglement in mesoscopic bosonic systems

abstract: A key issue in Quantum Information is finding an adequate description of mesoscopic systems that is simpler than full quantum formalism yet retains crucial information about non-classical phenomena like entanglement. In particular, the study of fully bosonic systems undergoing open evolution is of great importance for the advancement of photonic quantum computing and communication. In this paper, we propose a mesoscopic description of such systems based on boson number correlations. This description allows for tracking Markovian open evolution of entanglement of both non-Gaussian and Gaussian states and their sub-Poissonian statistics. It can be viewed as a generalization of the reduced state of the field formalism [Entropy 2019, 21(7), 705], which by itself does not contain information about entanglement. As our approach adopts the structure of the description of two particles in terms of first quantization, it allows for broad intuitive usage of known tools. Using the proposed formalism, we show the robustness of entanglement against low-temperature damping for four-mode bright squeezed vacuum state and beam-splitted single photon. We also present a generalization of the Mandel Q parameter. Building upon this, we show that the entanglement of the state obtained by beam splitting of a single occupied mode is fully inherited from sub-Poissonian statistics of the input state.


title: On some extensions of strongly unit nil-clean rings

abstract: An element $x \in R$ is considered (strongly) nil-clean if it can be expressed as the sum of an idempotent $e \in R$ and a nilpotent $b \in R$ (where $eb = be$). If for any $x \in R$, there exists a unit $u \in R$ such that $ux$ is (strongly) nil-clean, then $R$ is called a (strongly) unit nil-clean ring. It is worth noting that any unit-regular ring is strongly unit nil-clean. In this note, we provide a characterization of the unit regularity of a group ring, along with an additional condition. We also fully characterize the unit-regularity of the group ring $\mathbb{Z}_nG$ for every $n > 1$. Additionally, we discuss strongly unit nil-cleanness in the context of Morita contexts, matrix rings, and group rings.


title: Data Quality Matters: Suicide Intention Detection on Social Media Posts Using a RoBERTa-CNN Model

abstract: Suicide remains a global health concern for the field of health, which urgently needs innovative approaches for early detection and intervention. In this paper, we focus on identifying suicidal intentions in SuicideWatch Reddit posts and present a novel approach to suicide detection using the cutting-edge RoBERTa-CNN model, a variant of RoBERTa (Robustly optimized BERT approach). RoBERTa is used for various Natural Language Processing (NLP) tasks, including text classification and sentiment analysis. The effectiveness of the RoBERTa lies in its ability to capture textual information and form semantic relationships within texts. By adding the Convolution Neural Network (CNN) layer to the original model, the RoBERTa enhances its ability to capture important patterns from heavy datasets. To evaluate the RoBERTa-CNN, we experimented on the Suicide and Depression Detection dataset and obtained solid results. For example, RoBERTa-CNN achieves 98% mean accuracy with the standard deviation (STD) of 0.0009. It also reaches over 97.5% mean AUC value with an STD of 0.0013. In the meanwhile, RoBERTa-CNN outperforms competitive methods, demonstrating the robustness and ability to capture nuanced linguistic patterns for suicidal intentions. Therefore, RoBERTa-CNN can detect suicide intention on text data very well.


title: MixedNUTS: Training-Free Accuracy-Robustness Balance via Nonlinearly Mixed Classifiers

abstract: Adversarial robustness often comes at the cost of degraded accuracy, impeding the real-life application of robust classification models. Training-based solutions for better trade-offs are limited by incompatibilities with already-trained high-performance large models, necessitating the exploration of training-free ensemble approaches. Observing that robust models are more confident in correct predictions than in incorrect ones on clean and adversarial data alike, we speculate amplifying this "benign confidence property" can reconcile accuracy and robustness in an ensemble setting. To achieve so, we propose "MixedNUTS", a training-free method where the output logits of a robust classifier and a standard non-robust classifier are processed by nonlinear transformations with only three parameters, which are optimized through an efficient algorithm. MixedNUTS then converts the transformed logits into probabilities and mixes them as the overall output. On CIFAR-10, CIFAR-100, and ImageNet datasets, experimental results with custom strong adaptive attacks demonstrate MixedNUTS's vastly improved accuracy and near-SOTA robustness -- it boosts CIFAR-100 clean accuracy by 7.86 points, sacrificing merely 0.87 points in robust accuracy.


title: A Stein characterisation of the distribution of the product of correlated normal random variables

abstract: We obtain a Stein characterisation of the distribution of the product of two correlated normal random variables with non-zero means, and more generally the distribution of the sum of independent copies of such random variables. Our Stein characterisation is shown to naturally generalise a number of other Stein characterisations in the literature. From our Stein characterisation we derive recursive formulas for the moments of the product of two correlated normal random variables, and more generally the sum of independent copies of such random variables, which allows for efficient computation of higher order moments.


title: Characterization of the Distortion-Perception Tradeoff for Finite Channels with Arbitrary Metrics

abstract: Whenever inspected by humans, reconstructed signals should not be distinguished from real ones. Typically, such a high perceptual quality comes at the price of high reconstruction error, and vice versa. We study this distortion-perception (DP) tradeoff over finite-alphabet channels, for the Wasserstein-$1$ distance induced by a general metric as the perception index, and an arbitrary distortion matrix. Under this setting, we show that computing the DP function and the optimal reconstructions is equivalent to solving a set of linear programming problems. We provide a structural characterization of the DP tradeoff, where the DP function is piecewise linear in the perception index. We further derive a closed-form expression for the case of binary sources.


title: On asymptotic expansions of ergodic integrals for $\Z^d$-extensions of translation flows

abstract: We obtain expansions of ergodic integrals for $\Z^d$-covers of compact self-similar translation flows, and as a consequence we obtain a form of weak rational ergodicity with optimal rates. As examples, we consider the so-called self-similar $(s,1)$-staircase flows ($\Z$-extensions of self-similar translations flows of genus-$2$ surfaces), and a variation of the Ehrenfest wind-tree model.


title: Perturbative QCD contribution to transverse single spin asymmetries in Drell-Yan and SIDIS

abstract: In a previous publication [Beni\' c et al., Phys. Rev. D104 (2021) 094027], we have computed the perturbative QCD contribution to transverse single spin asymmetries (SSAs) in semi-inclusive Deep Inelastic Scattering (SIDIS) involving the $g_T(x)$ distribution. In this paper, we first present a more efficient derivation of the asymmetries which is applicable to both transverse and longitudinal SSAs, and correct some inconsistencies in our previous calculation. We then adapt the method to compute transverse SSAs in Drell-Yan proportional to $g_T(x)$ and its gluonic counterpart, and discuss the crossing symmetry between the results for SIDIS and Drell-Yan. Finally, we present numerical results for various asymmetries measurable at the EIC, RHIC, COMPASS and Fermilab (SpinQuest), including also part of the genuine twist-three corrections to $g_T(x)$ from a recent global analysis. We find that the asymmetries can reach percent-level magnitude, if the kinematics predominantly probes the large-$x$ (valence) region of the polarized proton, but remain at sub-percent levels otherwise.


title: Federated Learning with New Knowledge: Fundamentals, Advances, and Futures

abstract: Federated Learning (FL) is a privacy-preserving distributed learning approach that is rapidly developing in an era where privacy protection is increasingly valued. It is this rapid development trend, along with the continuous emergence of new demands for FL in the real world, that prompts us to focus on a very important problem: Federated Learning with New Knowledge. The primary challenge here is to effectively incorporate various new knowledge into existing FL systems and evolve these systems to reduce costs, extend their lifespan, and facilitate sustainable development. In this paper, we systematically define the main sources of new knowledge in FL, including new features, tasks, models, and algorithms. For each source, we thoroughly analyze and discuss how to incorporate new knowledge into existing FL systems and examine the impact of the form and timing of new knowledge arrival on the incorporation process. Furthermore, we comprehensively discuss the potential future directions for FL with new knowledge, considering a variety of factors such as scenario setups, efficiency, and security. There is also a continuously updating repository for this topic: https://github.com/conditionWang/FLNK.


title: The binary actions of simple groups with a single conjugacy class of involutions

abstract: We continue our investigation of binary actions of simple groups. In this paper, we demonstrate a connection between the graph $\Gamma(\mathcal{C})$ based on the conjugacy class $\mathcal{C}$ of the group $G$, which was introduced in our previous work, and the notion of a strongly embedded subgroup of $G$. We exploit this connection to prove a result concerning the binary actions of finite simple groups that contain a single conjugacy class of involutions.


title: Co-estimation of core and lithospheric magnetic fields by a maximum entropy method

abstract: Satellite observations of the geomagnetic field contain signals generated in Earth's interior by electrical currents in the core and by magnetized rocks in the lithosphere. At short wavelengths the lithospheric signal dominates, obscuring the signal from the core. Here we present details of a method to co-estimate separate models for the core and lithospheric fields, which are allowed to overlap in spherical harmonic degree, that makes use of prior information to aid the separation. Using a maximum entropy method we estimate probabilistic models for the time-dependent core field and the static lithospheric field that satisfy constraints provided by satellite observations while being consistent with prior knowledge of the spatial covariance and expected magnitude of each field at its source surface.


title: Computing Euler factors of genus 2 curves at odd primes of almost good reduction

abstract: We present an efficient algorithm to compute the Euler factor of a genus 2 curve C/Q at an odd prime p that is of bad reduction for C but of good reduction for the Jacobian of C (a prime of ``almost good'' reduction). Our approach is based on the theory of cluster pictures introduced by Dokchitser, Dokchitser, Maistret, and Morgan, which allows us to reduce the problem to a short, explicit computation over Z and Fp, followed by a point-counting computation on two elliptic curves over Fp, or a single elliptic curve over Fp^2. A key feature of our approach is that we avoid the need to compute a regular model for C. This allows us to efficiently compute many examples that are infeasible to handle using the algorithms currently available in computer algebra systems such as Magma and Pari/GP.


title: One-inflated zero-truncated count regression models

abstract: We find that in zero-truncated count data (y=1,2,...), individuals often gain information at first observation (y=1), leading to a common but unaddressed phenomenon of "one-inflation". The current standard, the zero-truncated negative binomial (ZTNB) model, is misspecified under one-inflation, causing bias and inconsistency. To address this, we introduce the one-inflated zero-truncated negative binomial (OIZTNB) regression model. The importance of our model is highlighted through simulation studies, and through the discovery of one-inflation in four datasets that have traditionally championed ZTNB. We recommended OIZTNB over ZTNB for most data, and provide estimation, marginal effects, and testing in the accompanying R package oneinfl.