title: Manipulating a Continuous Instrumental Variable in an Observational Study of Premature Babies: Algorithm, Partial Identification Bounds, and Inference under Randomization and Biased Randomization Assumptions

abstract: Regionalization of intensive care for premature babies refers to a triage system of mothers with high-risk pregnancies to hospitals of varied capabilities based on risks faced by infants. Due to the limited capacity of high-level hospitals, which are equipped with advanced expertise to provide critical care, understanding the effect of delivering premature babies at such hospitals on infant mortality for different subgroups of high-risk mothers could facilitate the design of an efficient perinatal regionalization system. Towards answering this question, Baiocchi et al. (2010) proposed to strengthen an excess-travel-time-based, continuous instrumental variable (IV) in an IV-based, matched-pair design by switching focus to a smaller cohort amenable to being paired with a larger separation in the IV dose. Three elements changed with the strengthened IV: the study cohort, compliance rate and latent complier subgroup. Here, we introduce a non-bipartite, template matching algorithm that embeds data into a target, pair-randomized encouragement trial which maintains fidelity to the original study cohort while strengthening the IV. We then study randomization-based and IV-dependent, biased-randomization-based inference of partial identification bounds for the sample average treatment effect (SATE) in an IV-based matched pair design, which deviates from the usual effect ratio estimand in that the SATE is agnostic to the IV and who is matched to whom, although a strengthened IV design could narrow the partial identification bounds. Based on our proposed strengthened-IV design, we found that delivering at a high-level NICU reduced preterm babies' mortality rate compared to a low-level NICU for $81,766 \times 2 = 163,532$ mothers and their preterm babies and the effect appeared to be minimal among non-black, low-risk mothers.


title: Causal Diffusion Autoencoders: Toward Counterfactual Generation via Diffusion Probabilistic Models

abstract: Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant research effort to improve image sample quality, there is little work on representation-controlled generation using diffusion models. Specifically, causal modeling and controllable counterfactual generation using DPMs is an underexplored area. In this work, we propose CausalDiffAE, a diffusion-based causal representation learning framework to enable counterfactual generation according to a specified causal model. Our key idea is to use an encoder to extract high-level semantically meaningful causal variables from high-dimensional data and model stochastic variation using reverse diffusion. We propose a causal encoding mechanism that maps high-dimensional data to causally related latent factors and parameterize the causal mechanisms among latent factors using neural networks. To enforce the disentanglement of causal variables, we formulate a variational objective and leverage auxiliary label information in a prior to regularize the latent space. We propose a DDIM-based counterfactual generation procedure subject to do-interventions. Finally, to address the limited label supervision scenario, we also study the application of CausalDiffAE when a part of the training data is unlabeled, which also enables granular control over the strength of interventions in generating counterfactuals during inference. We empirically show that CausalDiffAE learns a disentangled latent space and is capable of generating high-quality counterfactual images.


title: Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission

abstract: Deep learning-based joint source-channel coding (deep JSCC) has been demonstrated as an effective approach for wireless image transmission. Nevertheless, current research has concentrated on minimizing a standard distortion metric such as Mean Squared Error (MSE), which does not necessarily improve the perceptual quality. To address this issue, we propose DiffJSCC, a novel framework that leverages pre-trained text-to-image diffusion models to enhance the realism of images transmitted over the channel. The proposed DiffJSCC utilizes prior deep JSCC frameworks to deliver an initial reconstructed image at the receiver. Then, the spatial and textual features are extracted from the initial reconstruction, which, together with the channel state information (e.g., signal-to-noise ratio, SNR), are passed to a control module to fine-tune the pre-trained Stable Diffusion model. Extensive experiments on the Kodak dataset reveal that our method significantly surpasses both conventional methods and prior deep JSCC approaches on perceptual metrics such as LPIPS and FID scores, especially with poor channel conditions and limited bandwidth. Notably, DiffJSCC can achieve highly realistic reconstructions for 768x512 pixel Kodak images with only 3072 symbols (<0.008 symbols per pixel) under 1dB SNR. Our code will be released in https://github.com/mingyuyng/DiffJSCC.


title: Neutral Pivoting: Strong Bias Correction for Shared Information

abstract: In the absence of historical data for use as forecasting inputs, decision makers often ask a panel of judges to predict the outcome of interest, leveraging the wisdom of the crowd (Surowiecki 2005). Even if the crowd is large and skilled, shared information can bias the simple mean of judges' estimates. Addressing the issue of bias, Palley and Soll (2019) introduces a novel approach called pivoting. Pivoting can take several forms, most notably the powerful and reliable minimal pivot. We build on the intuition of the minimal pivot and propose a more aggressive bias correction known as the neutral pivot. The neutral pivot achieves the largest bias correction of its class that both avoids the need to directly estimate crowd composition or skill and maintains a smaller expected squared error than the simple mean for all considered settings. Empirical assessments on real datasets confirm the effectiveness of the neutral pivot compared to current methods.


title: Ultimate charge transport regimes in doping-controlled graphene laminates: phonon-assisted processes revealed by the linear magnetoresistance

abstract: Understanding and controlling the electrical properties of solution-processed 2D materials is key to further printed electronics progress. Here we demonstrate that the thermolysis of the aromatic intercalants utilized in nanosheet exfoliation for graphene laminates opens the route to achieving high intrinsic mobility and simultaneously controlling doping type ($n$- and $p$-) and concentration over a wide range. We establish that the intra-flake mobility is high by observing a linear magnetoresistance of such solution-processed graphene laminates and using it to devolve the inter-flake tunneling and intra-layer magnetotransport. Consequently, we determine the temperature dependences of the inter- and intra-layer characteristics, which both appear to be dominated by phonon-assisted processes at temperature $T>$20 Kelvin. In particular, we identify the efficiency of phonon-assisted tunneling as the main limiting factor for electrical conductivity in graphene laminates at room temperature. We also demonstrate a thermoelectric sensitivity of around 50 ${\mu}$V K$^{-1}$ in a solution-processed metal-free graphene-based thermocouple.


title: How LLMs Aid in UML Modeling: An Exploratory Study with Novice Analysts

abstract: Since the emergence of GPT-3, Large Language Models (LLMs) have caught the eyes of researchers, practitioners, and educators in the field of software engineering. However, there has been relatively little investigation regarding the performance of LLMs in assisting with requirements analysis and UML modeling. This paper explores how LLMs can assist novice analysts in creating three types of typical UML models: use case models, class diagrams, and sequence diagrams. For this purpose, we designed the modeling tasks of these three UML models for 45 undergraduate students who participated in a requirements modeling course, with the help of LLMs. By analyzing their project reports, we found that LLMs can assist undergraduate students as novice analysts in UML modeling tasks, but LLMs also have shortcomings and limitations that should be considered when using them.


title: On some relationships between the centers and the derived ideal in Leibniz 3-algebras

abstract: One of the classic results of group theory is the so-called Schur theorem. It states that if the central factor-group $G/\zeta(G)$ of a group $G$ is finite, then its derived subgroup $[G,G]$ is also finite. This result has numerous generalizations and modifications in group theory. At the same time, similar investigations were conducted in other algebraic structures. In 2016, L.A. Kurdachenko, J. Otal and O.O. Pypka proved an analogue of Schur theorem for Leibniz algebras: if central factor-algebra $L/\zeta(L)$ of Leibniz algebra $L$ has finite dimension, then its derived ideal $[L,L]$ is also finite-dimensional. Moreover, they also proved a slightly modified analogue of Schur theorem: if the codimensions of the left $\zeta^{l}(L)$ and right $\zeta^{r}(L)$ centers of Leibniz algebra $L$ are finite, then its derived ideal $[L,L]$ is also finite-dimensional. One of the generalizations of Leibniz algebras is the so-called Leibniz $n$-algebras. Therefore, the question of proving analogs of the above results for this type of algebras naturally arises. In this article, we prove the analogues of the two mentioned theorems for Leibniz 3-algebras.


title: On some relationships between the center and the derived subalgebra in Poisson (2-3)-algebras

abstract: One of the classic results of group theory is the so-called Schur theorem. It states that if the central factor-group $G/\zeta(G)$ of a group $G$ is finite, then its derived subgroup $[G,G]$ is also finite. This result has numerous generalizations and modifications in group theory. At the same time, similar investigations were conducted in other algebraic structures, namely in modules, linear groups, topological groups, $n$-groups, associative algebras, Lie algebras, Lie $n$-algebras, Lie rings, Leibniz algebras. In 2021, L.A. Kurdachenko, O.O. Pypka and I.Ya. Subbotin proved an analogue of Schur theorem for Poisson algebras: if the center of the Poisson algebra $P$ has finite codimension, then $P$ includes an ideal $K$ of finite dimension such that $P/K$ is abelian. In this paper, we continue similar studies for another algebraic structure. An analogue of Schur theorem for Poisson (2-3)-algebras is proved.


title: Segmentation Quality and Volumetric Accuracy in Medical Imaging

abstract: Current medical image segmentation relies on the region-based (Dice, F1-score) and boundary-based (Hausdorff distance, surface distance) metrics as the de-facto standard. While these metrics are widely used, they lack a unified interpretation, particularly regarding volume agreement. Clinicians often lack clear benchmarks to gauge the "goodness" of segmentation results based on these metrics. Recognizing the clinical relevance of volumetry, we utilize relative volume prediction error (vpe) to directly assess the accuracy of volume predictions derived from segmentation tasks. Our work integrates theoretical analysis and empirical validation across diverse datasets. We delve into the often-ambiguous relationship between segmentation quality (measured by Dice) and volumetric accuracy in clinical practice. Our findings highlight the critical role of incorporating volumetric prediction accuracy into segmentation evaluation. This approach empowers clinicians with a more nuanced understanding of segmentation performance, ultimately improving the interpretation and utility of these metrics in real-world healthcare settings.


title: Fourier Coefficients and Algebraic Cusp Forms on $\mathrm{U}(2,n)$

abstract: We establish a theory of scalar Fourier coefficients for a class of non-holomorphic, automorphic forms on the quaternionic real Lie group $\mathrm{U}(2,n)$. By studying the theta lifts of holomorphic modular forms from $\mathrm{U}(1,1)$, we apply this theory to obtain examples of non-holomorphic cusp forms on $\mathrm{U}(2,n)$ whose Fourier coefficients are algebraic numbers.


title: Tensor hypercontraction for fully self-consistent imaginary-time GF2 and GWSOX methods: theory, implementation, and role of the Green's function second-order exchange for intermolecular interactions

abstract: We apply tensor hypercontraction (THC) to reduce the computational scaling of expensive fully self-consistent Green's function methods. We present an efficient MPI-parallel algorithm and its implementation for evaluating the correlated second-order exchange term (SOX). This approach enabled us to conduct the largest fully self-consistent calculations with over 1100 atomic orbitals (AOs), with negligible errors attributed to THC fitting. Utilizing our THC implementation for scGW, scGF2, and scGWSOX (GW plus the SOX term iterated to achieve full Green's function self-consistency), we evaluated energies of intermolecular interactions. This approach allowed us to circumvent issues related to reference dependence and ambiguity in energy evaluation, which are common challenges in non-self-consistent calculations. We demonstrate that scGW exhibits a slight overbinding tendency for large systems, contrary to the underbinding observed with non-self-consistent RPA. Conversely, scGWSOX exhibits a slight underbinding tendency for such systems. This behavior is both physical and systematic and is caused by exclusion-principle violating diagrams or corresponding corrections. Our analysis elucidates the role played by these different diagrams, which is crucial for the construction of rigorous, accurate, and systematic methods. Finally, we explicitly show that all perturbative fully self-consistent Green's function methods are size-extensive.

categories: physics.chem-ph cond-mat.mtrl-sci physics.atm-clus physics.bio-ph


title: An Attention-Based Deep Learning Architecture for Real-Time Monocular Visual Odometry: Applications to GPS-free Drone Navigation

abstract: Drones are increasingly used in fields like industry, medicine, research, disaster relief, defense, and security. Technical challenges, such as navigation in GPS-denied environments, hinder further adoption. Research in visual odometry is advancing, potentially solving GPS-free navigation issues. Traditional visual odometry methods use geometry-based pipelines which, while popular, often suffer from error accumulation and high computational demands. Recent studies utilizing deep neural networks (DNNs) have shown improved performance, addressing these drawbacks. Deep visual odometry typically employs convolutional neural networks (CNNs) and sequence modeling networks like recurrent neural networks (RNNs) to interpret scenes and deduce visual odometry from video sequences. This paper presents a novel real-time monocular visual odometry model for drones, using a deep neural architecture with a self-attention module. It estimates the ego-motion of a camera on a drone, using consecutive video frames. An inference utility processes the live video feed, employing deep learning to estimate the drone's trajectory. The architecture combines a CNN for image feature extraction and a long short-term memory (LSTM) network with a multi-head attention module for video sequence modeling. Tested on two visual odometry datasets, this model converged 48% faster than a previous RNN model and showed a 22% reduction in mean translational drift and a 12% improvement in mean translational absolute trajectory error, demonstrating enhanced robustness to noise.


title: On the Rashomon ratio of infinite hypothesis sets

abstract: Given a classification problem and a family of classifiers, the Rashomon ratio measures the proportion of classifiers that yield less than a given loss. Previous work has explored the advantage of a large Rashomon ratio in the case of a finite family of classifiers. Here we consider the more general case of an infinite family. We show that a large Rashomon ratio guarantees that choosing the classifier with the best empirical accuracy among a random subset of the family, which is likely to improve generalizability, will not increase the empirical loss too much. We quantify the Rashomon ratio in two examples involving infinite classifier families in order to illustrate situations in which it is large. In the first example, we estimate the Rashomon ratio of the classification of normally distributed classes using an affine classifier. In the second, we obtain a lower bound for the Rashomon ratio of a classification problem with a modified Gram matrix when the classifier family consists of two-layer ReLU neural networks. In general, we show that the Rashomon ratio can be estimated using a training dataset along with random samples from the classifier family and we provide guarantees that such an estimation is close to the true value of the Rashomon ratio.


title: MMA-UNet: A Multi-Modal Asymmetric UNet Architecture for Infrared and Visible Image Fusion

abstract: Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the multi-modal images, causing the loss of shallow information or bias towards a single modality in certain regions of the fusion results. In this study, we analyzed the spatial distribution differences of information in different modalities and proved that encoding features within the same network is not conducive to achieving simultaneous deep feature space alignment for multi-modal images. To overcome this issue, a Multi-Modal Asymmetric UNet (MMA-UNet) was proposed. We separately trained specialized feature encoders for different modal and implemented a cross-scale fusion strategy to maintain the features from different modalities within the same representation space, ensuring a balanced information fusion process. Furthermore, extensive fusion and downstream task experiments were conducted to demonstrate the efficiency of MMA-UNet in fusing infrared and visible image information, producing visually natural and semantically rich fusion results. Its performance surpasses that of the state-of-the-art comparison fusion methods.


title: Sharp $\ell^q(L^p)$ decoupling for paraboloids

abstract: In this short expository note, we prove the following result, which is a special case of the main theorem in arXiv:2011.09451. For each $n \ge 2$ and $p, q \in [2, \infty]$, we prove upper bounds of $\ell^q(L^p)$ decoupling constants for paraboloids in $\mathbb R^n$, as well as presenting extremisers for each case. Both are sharp up to $\varepsilon$-losses.


title: UMass-BioNLP at MEDIQA-M3G 2024: DermPrompt -- A Systematic Exploration of Prompt Engineering with GPT-4V for Dermatological Diagnosis

abstract: This paper presents our team's participation in the MEDIQA-ClinicalNLP2024 shared task B. We present a novel approach to diagnosing clinical dermatology cases by integrating large multimodal models, specifically leveraging the capabilities of GPT-4V under a retriever and a re-ranker framework. Our investigation reveals that GPT-4V, when used as a retrieval agent, can accurately retrieve the correct skin condition 85% of the time using dermatological images and brief patient histories. Additionally, we empirically show that Naive Chain-of-Thought (CoT) works well for retrieval while Medical Guidelines Grounded CoT is required for accurate dermatological diagnosis. Further, we introduce a Multi-Agent Conversation (MAC) framework and show its superior performance and potential over the best CoT strategy. The experiments suggest that using naive CoT for retrieval and multi-agent conversation for critique-based diagnosis, GPT-4V can lead to an early and accurate diagnosis of dermatological conditions. The implications of this work extend to improving diagnostic workflows, supporting dermatological education, and enhancing patient care by providing a scalable, accessible, and accurate diagnostic tool.


title: Fast Iterative Solver For Neural Network Method: I. 1D Diffusion Problems

abstract: The discretization of the deep Ritz method [18] for the Poisson equation leads to a high-dimensional non-convex minimization problem, that is difficult and expensive to solve numerically. In this paper, we consider the shallow Ritz approximation to one-dimensional diffusion problems and introduce an effective and efficient iterative method, a damped block Newton (dBN) method, for solving the resulting non-convex minimization problem. The method employs the block Gauss-Seidel method as an outer iteration by dividing the parameters of a shallow neural network into the linear parameters (the weights and bias of the output layer) and the non-linear parameters (the weights and bias of the hidden layer). Per each outer iteration, the linear and the non-linear parameters are updated by exact inversion and one step of a damped Newton method, respectively. Inverses of the coefficient matrix and the Hessian matrix are tridiagonal and diagonal, respectively, and hence the cost of each dBN iteration is $\mathcal{O}(n)$. To move the breakpoints (the non-linear parameters) more efficiently, we propose an adaptive damped block Newton (AdBN) method by combining the dBN with the adaptive neuron enhancement (ANE) method [25]. Numerical examples demonstrate the ability of dBN and AdBN not only to move the breakpoints quickly and efficiently but also to achieve a nearly optimal order of convergence for AdBN. These iterative solvers are capable of outperforming BFGS for select examples.


title: Duet expectile preferences

abstract: We introduce a novel axiom of co-loss aversion for a preference relation over the space of acts, represented by measurable functions on a suitable measurable space. This axiom means that the decision maker, facing the sum of two acts, dislikes the situation where both acts realize as losses simultaneously. Our main result is that, under strict monotonicity and continuity, the axiom of co-loss aversion characterizes preference relations represented by a new class of functionals, which we call the duet expectiles. A duet expectile involves two endogenous probability measures, and it becomes a usual expectile, a statistical quantity popular in regression and risk measures, when these two probability measures coincide. We discuss properties of duet expectiles and connections with fundamental concepts including probabilistic sophistication, risk aversion, and uncertainty aversion.


title: Generative Diffusion-based Downscaling for Climate

abstract: Downscaling, or super-resolution, provides decision-makers with detailed, high-resolution information about the potential risks and impacts of climate change, based on climate model output. Machine learning algorithms are proving themselves to be efficient and accurate approaches to downscaling. Here, we show how a generative, diffusion-based approach to downscaling gives accurate downscaled results. We focus on an idealised setting where we recover ERA5 at $0.25\degree$~resolution from coarse grained version at $2\degree$~resolution. The diffusion-based method provides superior accuracy compared to a standard U-Net, particularly at the fine scales, as highlighted by a spectral decomposition. Additionally, the generative approach provides users with a probability distribution which can be used for risk assessment. This research highlights the potential of diffusion-based downscaling techniques in providing reliable and detailed climate predictions.


title: Leveraging Cross-Modal Neighbor Representation for Improved CLIP Classification

abstract: CLIP showcases exceptional cross-modal matching capabilities due to its training on image-text contrastive learning tasks. However, without specific optimization for unimodal scenarios, its performance in single-modality feature extraction might be suboptimal. Despite this, some studies have directly used CLIP's image encoder for tasks like few-shot classification, introducing a misalignment between its pre-training objectives and feature extraction methods. This inconsistency can diminish the quality of the image's feature representation, adversely affecting CLIP's effectiveness in target tasks. In this paper, we view text features as precise neighbors of image features in CLIP's space and present a novel CrOss-moDal nEighbor Representation(CODER) based on the distance structure between images and their neighbor texts. This feature extraction method aligns better with CLIP's pre-training objectives, thereby fully leveraging CLIP's robust cross-modal capabilities. The key to construct a high-quality CODER lies in how to create a vast amount of high-quality and diverse texts to match with images. We introduce the Auto Text Generator(ATG) to automatically generate the required texts in a data-free and training-free manner. We apply CODER to CLIP's zero-shot and few-shot image classification tasks. Experiment results across various datasets and models confirm CODER's effectiveness. Code is available at:https://github.com/YCaigogogo/CVPR24-CODER.


title: Development of an Estimation Method for the Seismic Motion Reproducibility of a Three-dimensional Ground Structure Model by combining Surface-observed Seismic Motion and Three-dimensional Seismic Motion Analysis

abstract: The ground structure can substantially influence seismic ground motion underscoring the need to develop a ground structure model with sufficient reliability in terms of ground motion estimation for earthquake damage mitigation. While many methods for generating ground structure models have been proposed and used in practice, there remains room for enhancing their reliability. In this study, amid many candidate 3D ground structure models generated from geotechnical engineering knowledge, we propose a method for selecting a credible 3D ground structure model capable of reproducing observed earthquake ground motion, utilizing seismic ground motion data solely observed at the ground surface and employing 3D seismic ground motion analysis. Through a numerical experiment, we illustrate the efficacy of this approach. By conducting $10^2$-$10^3$ cases of fast 3D seismic wave propagation analyses using graphic processing units (GPUs), we demonstrate that a credible 3D ground structure model is selected according to the quantity of seismic motion information. We show the effectiveness of the proposed method by showing that the accuracy of seismic motions using ground structure models that were selected from the pool of candidate models is higher than that using ground structure models that were not selected from the pool of candidate models.


title: Dual-Functional Waveform Design with Local Sidelobe Suppression via OTFS Signaling

abstract: Integrated sensing and communication (ISAC) is viewed as a key technology in future wireless networks. One of the main challenges in realizing ISAC is developing dual-functional waveforms that can communicate with communication receivers and perform radar sensing simultaneously. In this paper, we consider the joint design of a dual-functional orthogonal time-frequency space (OTFS) signal and a receiving filter for the ISAC system. The problem of ISAC waveform design is formulated as the minimization of the weighted integrated sidelobe level (WISL) of the ambiguity function and the interference term from ISAC waveform, with constraints on signal-to-noise ratio loss. The majorization-minimization algorithm combined with alternating iterative minimization is implemented to solve the optimization problem. Simulation results show that the WISL and the interference term can be significantly decreased to guarantee achievable data rates and detection performance.


title: Suppressed self-diffusion of nanoscale constituents of a complex liquid

abstract: The ability to understand and ultimately control the transformations and properties of various nanoscale systems, from proteins to synthetic nanomaterial assemblies, hinges on the ability to directly elucidate their dynamics on their characteristic length and time scales. Here, we use MHz X-ray photon correlation spectroscopy (XPCS) to directly elucidate the characteristic microsecond-dynamics of density fluctuations of semiconductor nanocrystals (NCs), not only in a colloidal dispersion but also in a liquid phase consisting of densely packed, yet mobile, NCs with no long-range order. By carefully disentangling X-ray induced effects, we find the wavevector-dependent fluctuation rates in the liquid phase are suppressed relative to those in the colloidal phase and to those in experiments and hydrodynamic theories of densely packed repulsive particles. We show that the suppressed rates are due to a substantial decrease in the self-diffusion of NCs in the liquid phase, which we attribute to explicit attractive interactions. Via comparison with simulations, we find that the extracted strength of the attractions explains the stability of the liquid phase, in contrast to the gelation observed via XPCS in many other charged colloidal systems. This work opens the door to elucidating fast, condensed phase dynamics in a variety of complex fluids and other nanoscale soft matter systems, such as densely packed proteins and non-equilibrium self-assembly processes.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.stat-mech physics.chem-ph


title: Middle Architecture Criteria

abstract: Mid-level ontologies are used to integrate terminologies and data across disparate domains. There are, however, no clear, defensible criteria for determining whether a given ontology should count as mid-level, because we lack a rigorous characterization of what the middle level of generality is supposed to contain. Attempts to provide such a characterization have failed, we believe, because they have focused on the goal of specifying what is characteristic of those single ontologies that have been advanced as mid-level ontologies. Unfortunately, single ontologies of this sort are generally a mixture of top- and mid-level, and sometimes even of domain-level terms. To gain clarity, we aim to specify the necessary and sufficient conditions for a collection of one or more ontologies to inhabit what we call a mid-level architecture.


title: The Common Core Ontologies

abstract: The Common Core Ontologies (CCO) are designed as a mid-level ontology suite that extends the Basic Formal Ontology. CCO has since been increasingly adopted by a broad group of users and applications and is proposed as the first standard mid-level ontology. Despite these successes, documentation of the contents and design patterns of the CCO has been comparatively minimal. This paper is a step toward providing enhanced documentation for the mid-level ontology suite through a discussion of the contents of the eleven ontologies that collectively comprise the Common Core Ontology suite.


title: Modular, Resilient, and Scalable System Design Approaches -- Lessons learned in the years after DARPA Subterranean Challenge

abstract: Field robotics applications, such as search and rescue, involve robots operating in large, unknown areas. These environments present unique challenges that compound the difficulties faced by a robot operator. The use of multi-robot teams, assisted by carefully designed autonomy, help reduce operator workload and allow the operator to effectively coordinate robot capabilities. In this work, we present a system architecture designed to optimize both robot autonomy and the operator experience in multi-robot scenarios. Drawing on lessons learned from our team's participation in the DARPA SubT Challenge, our architecture emphasizes modularity and interoperability. We empower the operator by allowing for adjustable levels of autonomy ("sliding mode autonomy"). We enhance the operator experience by using intuitive, adaptive interfaces that suggest context-aware actions to simplify control. Finally, we describe how the proposed architecture enables streamlined development of new capabilities for effective deployment of robot autonomy in the field.


title: Adversarial Examples: Generation Proposal in the Context of Facial Recognition Systems

abstract: In this paper we investigate the vulnerability that facial recognition systems present to adversarial examples by introducing a new methodology from the attacker perspective. The technique is based on the use of the autoencoder latent space, organized with principal component analysis. We intend to analyze the potential to craft adversarial examples suitable for both dodging and impersonation attacks, against state-of-the-art systems. Our initial hypothesis, which was not strongly favoured by the results, stated that it would be possible to separate between the "identity" and "facial expression" features to produce high-quality examples. Despite the findings not supporting it, the results sparked insights into adversarial examples generation and opened new research avenues in the area.


title: Un an\'alisis bibliom\'etrico de la producci\'on cient\'ifica acerca del agrupamiento de trayectorias GPS

abstract: Clustering algorithms or methods for GPS trajectories are in constant evolution due to the interest aroused in part of the scientific community. With the development of clustering algorithms considered traditional, improvements to these algorithms and even unique methods considered as "novelty" for science have emerged. This work aims to analyze the scientific production that exists around the topic "GPS trajectory clustering" by means of bibliometrics. Therefore, a total of 559 articles from the main collection of Scopus were analyzed, previously filtering the generated sample to discard any article that does not have a direct relationship with the topic to be analyzed. This analysis establishes an ideal environment for other disciplines and researchers, since it provides a current state of the trend of the subject of study in their field of research. -- Los algoritmos o m\'etodos de agrupamiento para trayectorias GPS se encuentran en constante evoluci\'on debido al inter\'es que despierta en parte de la comunidad cient\'ifica. Con el desarrollo de los algoritmos de agrupamiento considerados tradicionales han surgido mejoras a estos algoritmos e incluso m\'etodos \'unicos considerados como "novedad" para la ciencia. Este trabajo tiene como objetivo analizar la producci\'on cient\'ifica que existe alrededor del tema "agrupamiento de trayectorias GPS" mediante la bibliometr\'ia. Por lo tanto, fueron analizados un total de 559 art\'iculos de la colecci\'on principal de Scopus, realizando previamente un filtrado de la muestra generada para descartar todo aquel art\'iculo que no tenga una relaci\'on directa con el tema a analizar. Este an\'alisis establece un ambiente ideal para otras disciplinas e investigadores, ya que entrega un estado actual de la tendencia que lleva la tem\'atica de estudio en su campo de investigaci\'on.


title: Large Multi-modality Model Assisted AI-Generated Image Quality Assessment

abstract: Traditional deep neural network (DNN)-based image quality assessment (IQA) models leverage convolutional neural networks (CNN) or Transformer to learn the quality-aware feature representation, achieving commendable performance on natural scene images. However, when applied to AI-Generated images (AGIs), these DNN-based IQA models exhibit subpar performance. This situation is largely due to the semantic inaccuracies inherent in certain AGIs caused by uncontrollable nature of the generation process. Thus, the capability to discern semantic content becomes crucial for assessing the quality of AGIs. Traditional DNN-based IQA models, constrained by limited parameter complexity and training data, struggle to capture complex fine-grained semantic features, making it challenging to grasp the existence and coherence of semantic content of the entire image. To address the shortfall in semantic content perception of current IQA models, we introduce a large Multi-modality model Assisted AI-Generated Image Quality Assessment (MA-AGIQA) model, which utilizes semantically informed guidance to sense semantic information and extract semantic vectors through carefully designed text prompts. Moreover, it employs a mixture of experts (MoE) structure to dynamically integrate the semantic information with the quality-aware features extracted by traditional DNN-based IQA models. Comprehensive experiments conducted on two AI-generated content datasets, AIGCQA-20k and AGIQA-3k show that MA-AGIQA achieves state-of-the-art performance, and demonstrate its superior generalization capabilities on assessing the quality of AGIs. Code is available at https://github.com/wangpuyi/MA-AGIQA.


title: Likelihood Based Inference in Fully and Partially Observed Exponential Family Graphical Models with Intractable Normalizing Constants

abstract: Probabilistic graphical models that encode an underlying Markov random field are fundamental building blocks of generative modeling to learn latent representations in modern multivariate data sets with complex dependency structures. Among these, the exponential family graphical models are especially popular, given their fairly well-understood statistical properties and computational scalability to high-dimensional data based on pseudo-likelihood methods. These models have been successfully applied in many fields, such as the Ising model in statistical physics and count graphical models in genomics. Another strand of models allows some nodes to be latent, so as to allow the marginal distribution of the observable nodes to depart from exponential family to capture more complex dependence. These approaches form the basis of generative models in artificial intelligence, such as the Boltzmann machines and their restricted versions. A fundamental barrier to likelihood-based (i.e., both maximum likelihood and fully Bayesian) inference in both fully and partially observed cases is the intractability of the likelihood. The usual workaround is via adopting pseudo-likelihood based approaches, following the pioneering work of Besag (1974). The goal of this paper is to demonstrate that full likelihood based analysis of these models is feasible in a computationally efficient manner. The chief innovation lies in using a technique of Geyer (1991) to estimate the intractable normalizing constant, as well as its gradient, for intractable graphical models. Extensive numerical results, supporting theory and comparisons with pseudo-likelihood based approaches demonstrate the applicability of the proposed method.


title: Single crystal growth, chemical defects, magnetic and transport properties of antiferromagnetic topological insulators (Ge$_{1-\delta-x}$Mn$_x$)$_2$Bi$_2$Te$_5$ ($x\leq 0.47$, $0.11 \leq \delta \leq 0.20$)

abstract: Magnetic topological insulators provide a platform for emergent phenomena arising from the interplay between magnetism and band topology. Here we report the single crystal growth, crystal structure, magnetic and transport properties, as well as the neutron scattering studies of topological insulator series (Ge$_{1-\delta-x}$Mn$_x$)$_2$Bi$_2$Te$_5$ ($x\leq 0.47$, $0.11 \leq \delta \leq 0.20$). Upon doping up to $x = 0.47$, the lattice parameter $c$ decreases by 0.8\%, while the lattice parameter $a$ remains nearly unchanged. Significant Ge vacancies and Ge/Bi site mixing are revealed via elemental analysis as well as refinements of the neutron and X-ray diffraction data, resulting in holes dominating the charge transport. At $x = 0.47$, below 10.8 K, a bilayer A-type antiferromagnetic ordered state emerges, featuring an ordered moment of 3.0(3) $\mu_{B}$/Mn at 5 K, with the $c$ axis as the easy axis. Magnetization data unveil a much stronger interlayer antiferromagnetic exchange interaction and a much smaller uniaxial anisotropy compared to MnBi$_{2}$Te$_{4}$. We attribute the former to the shorter superexchange path and the latter to the smaller ligand-field splitting in (Ge$_{1-\delta-x}$Mn$_x$)$_2$Bi$_2$Te$_5$. Our study demonstrates that this series of materials holds promise for the investigation of the Layer Hall effect and quantum metric nonlinear Hall effect.


title: RFL-CDNet: Towards Accurate Change Detection via Richer Feature Learning

abstract: Change Detection is a crucial but extremely challenging task of remote sensing image analysis, and much progress has been made with the rapid development of deep learning. However, most existing deep learning-based change detection methods mainly focus on intricate feature extraction and multi-scale feature fusion, while ignoring the insufficient utilization of features in the intermediate stages, thus resulting in sub-optimal results. To this end, we propose a novel framework, named RFL-CDNet, that utilizes richer feature learning to boost change detection performance. Specifically, we first introduce deep multiple supervision to enhance intermediate representations, thus unleashing the potential of backbone feature extractor at each stage. Furthermore, we design the Coarse-To-Fine Guiding (C2FG) module and the Learnable Fusion (LF) module to further improve feature learning and obtain more discriminative feature representations. The C2FG module aims to seamlessly integrate the side prediction from the previous coarse-scale into the current fine-scale prediction in a coarse-to-fine manner, while LF module assumes that the contribution of each stage and each spatial location is independent, thus designing a learnable module to fuse multiple predictions. Experiments on several benchmark datasets show that our proposed RFL-CDNet achieves state-of-the-art performance on WHU cultivated land dataset and CDD dataset, and the second-best performance on WHU building dataset. The source code and models are publicly available at https://github.com/Hhaizee/RFL-CDNet.


title: Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

abstract: Big Artificial Intelligence (AI) models have emerged as a crucial element in various intelligent applications at the edge, such as voice assistants in smart homes and autonomous robotics in smart factories. Training big AI models, e.g., for personalized fine-tuning and continual model refinement, poses significant challenges to edge devices due to the inherent conflict between limited computing resources and intensive workload associated with training. Despite the constraints of on-device training, traditional approaches usually resort to aggregating training data and sending it to a remote cloud for centralized training. Nevertheless, this approach is neither sustainable, which strains long-range backhaul transmission and energy-consuming datacenters, nor safely private, which shares users' raw data with remote infrastructures. To address these challenges, we alternatively observe that prevalent edge environments usually contain a diverse collection of trusted edge devices with untapped idle resources, which can be leveraged for edge training acceleration. Motivated by this, in this article, we propose collaborative edge training, a novel training mechanism that orchestrates a group of trusted edge devices as a resource pool for expedited, sustainable big AI model training at the edge. As an initial step, we present a comprehensive framework for building collaborative edge training systems and analyze in-depth its merits and sustainable scheduling choices following its workflow. To further investigate the impact of its parallelism design, we empirically study a case of four typical parallelisms from the perspective of energy demand with realistic testbeds. Finally, we discuss open challenges for sustainable collaborative edge training to point to future directions of edge-centric big AI model training.


title: A Novel Scheme for Coded Caching with Coded Placement in Small Memory Regime

abstract: This paper presents a novel achievable scheme for coded caching systems with $N$ files and $K$ users, specifically when $N \leq K$. This new scheme employs linear coding both during the placement phase - where cache contents are linear combinations of files from the library - and the delivery phase. The multi-step delivery phase enables users to decode the cached coded content and eliminate interference effectively. In the small memory regime, the proposed scheme outperforms existing methods, particularly when $K$ and $N$ values are similar, it maintains manageable sub-packetization levels, and operates over a finite field of size $3$ regardless of the system parameters.


title: Make the Most of Your Data: Changing the Training Data Distribution to Improve In-distribution Generalization Performance

abstract: Can we modify the training data distribution to encourage the underlying optimization method toward finding solutions with superior generalization performance on in-distribution data? In this work, we approach this question for the first time by comparing the inductive bias of gradient descent (GD) with that of sharpness-aware minimization (SAM). By studying a two-layer CNN, we prove that SAM learns easy and difficult features more uniformly, particularly in early epochs. That is, SAM is less susceptible to simplicity bias compared to GD. Based on this observation, we propose USEFUL, an algorithm that clusters examples based on the network output early in training and upsamples examples with no easy features to alleviate the pitfalls of the simplicity bias. We show empirically that modifying the training data distribution in this way effectively improves the generalization performance on the original data distribution when training with (S)GD by mimicking the training dynamics of SAM. Notably, we demonstrate that our method can be combined with SAM and existing data augmentation strategies to achieve, to the best of our knowledge, state-of-the-art performance for training ResNet18 on CIFAR10, STL10, CINIC10, Tiny-ImageNet; ResNet34 on CIFAR100; and VGG19 and DenseNet121 on CIFAR10.


title: Conformal Ranked Retrieval

abstract: Given the wide adoption of ranked retrieval techniques in various information systems that significantly impact our daily lives, there is an increasing need to assess and address the uncertainty inherent in their predictions. This paper introduces a novel method using the conformal risk control framework to quantitatively measure and manage risks in the context of ranked retrieval problems. Our research focuses on a typical two-stage ranked retrieval problem, where the retrieval stage generates candidates for subsequent ranking. By carefully formulating the conformal risk for each stage, we have developed algorithms to effectively control these risks within their specified bounds. The efficacy of our proposed methods has been demonstrated through comprehensive experiments on three large-scale public datasets for ranked retrieval tasks, including the MSLR-WEB dataset, the Yahoo LTRC dataset and the MS MARCO dataset.


title: Interfaces as transport barriers in two-dimensional Cahn-Hilliard-Navier-Stokes turbulence

abstract: We investigate the role of interfaces as transport barriers in binary-fluid turbulence by employing Lagrangian tracer particles. The Cahn-Hilliard-Navier-Stokes (CHNS) system of partial differential equations provides a natural theoretical framework for our investigations. For specificity, we utilize the two-dimensional (2D) CHNS system. We capture efficiently interfaces and their fluctuations in 2D binary-fluid turbulence by using extensive pseudospectral direct numerical simulations (DNSs) of the 2D CHNS equations. We begin with $n$ tracers within a droplet of one phase and examine their dispersal into the second phase. The tracers remain within the droplet for a long time before emerging from it, so interfaces act as transport barriers in binary-fluid turbulence. We show that the fraction of the number of particles inside the droplet decays exponentially and is characterized by a decay time $\tau_{\xi}\sim R_0^{3/2}$ that increases with $R_0$, the radius of the initially circular droplet. Furthermore, we demonstrate that the average first-passage time $\langle \tau \rangle$ for tracers inside a droplet is orders of magnitude larger than it is for transport out of a hypothetical circle with the same radius as the initially circular droplet. We examine the roles of the Okubo-Weiss parameter $\Lambda$, the fluctuations of the droplet perimeter, and the probability distribution function of $\cos(\theta)$, with $\theta$ the angle between the fluid velocity and the normal to a droplet interface, in trapping tracers inside droplets. We mention possible generalisations of our study.


title: Characterization of dim light response in DVS pixel: Discontinuity of event triggering time

abstract: Dynamic Vision Sensors (DVS) have recently generated great interest because of the advantages of wide dynamic range and low latency compared with conventional frame-based cameras. However, the complicated behaviors in dim light conditions are still not clear, restricting the applications of DVS. In this paper, we analyze the typical DVS circuit, and find that there exists discontinuity of event triggering time. In dim light conditions, the discontinuity becomes prominent. We point out that the discontinuity depends exclusively on the changing speed of light intensity. Experimental results on real event data validate the analysis and the existence of discontinuity that reveals the non-first-order behaviors of DVS in dim light conditions.


title: PWEXP: An R Package Using Piecewise Exponential Model for Study Design and Event/Timeline Prediction

abstract: Parametric assumptions such as exponential distribution are commonly used in clinical trial design and analysis. However, violation of distribution assumptions can introduce biases in sample size and power calculations. Piecewise exponential (PWE) hazard model partitions the hazard function into segments each with constant hazards and is easy for interpretation and computation. Due to its piecewise property, PWE can fit a wide range of survival curves and accurately predict the future number of events and analysis time in event-driven clinical trials, thus enabling more flexible and reliable study designs. Compared with other existing approaches, the PWE model provides a superior balance of flexibility and robustness in model fitting and prediction. The proposed PWEXP package is designed for estimating and predicting PWE hazard models for right-censored data. By utilizing well-established criteria such as AIC, BIC, and cross-validation log-likelihood, the PWEXP package chooses the optimal number of change-points and determines the optimal position of change-points. With its particular goodness-of-fit, the PWEXP provides accurate and robust hazard estimation, which can be used for reliable power calculation at study design and timeline prediction at study conduct. The package also offers visualization functions to facilitate the interpretation of survival curve fitting results.


title: Compressing Latent Space via Least Volume

abstract: This paper introduces Least Volume-a simple yet effective regularization inspired by geometric intuition-that can reduce the necessary number of latent dimensions needed by an autoencoder without requiring any prior knowledge of the intrinsic dimensionality of the dataset. We show that the Lipschitz continuity of the decoder is the key to making it work, provide a proof that PCA is just a linear special case of it, and reveal that it has a similar PCA-like importance ordering effect when applied to nonlinear models. We demonstrate the intuition behind the regularization on some pedagogical toy problems, and its effectiveness on several benchmark problems, including MNIST, CIFAR-10 and CelebA.


title: High-quality Surface Reconstruction using Gaussian Surfels

abstract: We propose a novel point-based representation, Gaussian surfels, to combine the advantages of the flexible optimization procedure in 3D Gaussian points and the surface alignment property of surfels. This is achieved by directly setting the z-scale of 3D Gaussian points to 0, effectively flattening the original 3D ellipsoid into a 2D ellipse. Such a design provides clear guidance to the optimizer. By treating the local z-axis as the normal direction, it greatly improves optimization stability and surface alignment. While the derivatives to the local z-axis computed from the covariance matrix are zero in this setting, we design a self-supervised normal-depth consistency loss to remedy this issue. Monocular normal priors and foreground masks are incorporated to enhance the quality of the reconstruction, mitigating issues related to highlights and background. We propose a volumetric cutting method to aggregate the information of Gaussian surfels so as to remove erroneous points in depth maps generated by alpha blending. Finally, we apply screened Poisson reconstruction method to the fused depth maps to extract the surface mesh. Experimental results show that our method demonstrates superior performance in surface reconstruction compared to state-of-the-art neural volume rendering and point-based rendering methods.


title: Limits of Sequential Local Algorithms on the Random $k$-XORSAT Problem

abstract: The random $k$-XORSAT problem is a random constraint satisfaction problem of $n$ Boolean variables and $m=rn$ clauses, which a random instance can be expressed as a $G\mathbb{F}(2)$ linear system of the form $Ax=b$, where $A$ is a random $m \times n$ matrix with $k$ ones per row, and $b$ is a random vector. It is known that there exist two distinct thresholds $r_{core}(k) < r_{sat}(k)$ such that as $n \rightarrow \infty$ for $r < r_{sat}(k)$ the random instance has solutions with high probability, while for $r_{core} < r < r_{sat}(k)$ the solution space shatters into an exponential number of clusters. Sequential local algorithms are a natural class of algorithms which assign values to variables one by one iteratively. In each iteration, the algorithm runs some heuristics, called local rules, to decide the value assigned, based on the local neighborhood of the selected variables under the factor graph representation of the instance. We prove that for any $r > r_{core}(k)$ the sequential local algorithms with certain local rules fail to solve the random $k$-XORSAT with high probability. They include (1) the algorithm using the Unit Clause Propagation as local rule for $k \ge 9$, and (2) the algorithms using any local rule that can calculate the exact marginal probabilities of variables in instances with factor graphs that are trees, for $k\ge 13$. The well-known Belief Propagation and Survey Propagation are included in (2). Meanwhile, the best known linear-time algorithm succeeds with high probability for $r < r_{core}(k)$. Our results support the intuition that $r_{core}(k)$ is the sharp threshold for the existence of a linear-time algorithm for random $k$-XORSAT.


title: Luminous giants populate the dense Cosmic Web: The radio luminosity-environmental density relation for radio galaxies in action

abstract: Giant radio galaxies (GRGs, giant RGs, or giants) are megaparsec-scale, jet-driven outflows from accretion disks of supermassive black holes, and represent the most extreme pathway by which galaxies can impact the Cosmic Web around them. A long-standing but unresolved question is why giants are so much larger than other radio galaxies. It has been proposed that, in addition to having higher jet powers than most RGs, giants might live in especially low-density Cosmic Web environments. In this work, we aim to test this hypothesis by pinpointing Local Universe giants and other RGs in physically principled, Bayesian large-scale structure reconstructions. More specifically, we localised a LOFAR Two-metre Sky Survey (LoTSS) DR2-dominated sample of luminous ($l_\nu(\nu = 150\ \mathrm{MHz}) \geq 10^{24}\ \mathrm{W\ Hz^{-1}}$) giants and a control sample of LoTSS DR1 RGs, both with spectroscopic redshifts up to $z_\mathrm{max} = 0.16$, in the BORG SDSS Cosmic Web reconstructions. We measured the Cosmic Web density for each RG; for the control sample, we then quantified the relation between RG radio luminosity and Cosmic Web density. With the BORG SDSS tidal tensor, we also measured for each RG whether the gravitational dynamics of its Cosmic Web environment resemble those of clusters, filaments, sheets, or voids. Luminous giants populate large-scale environments that tend to be denser than those of general RGs. This shows that -- at least at high jet powers -- low-density environments are no prerequisite for giant growth. This result is corroborated by gravitational dynamics classification and a cluster catalogue crossmatching analysis. This work presents more than a thousand inferred megaparsec-scale densities around radio galaxies. Our findings are consistent with the view that giants are regular, rather than mechanistically special, members of the radio galaxy population.


title: Two-level adiabatic transition probability for small avoided crossings generated by tangential intersections

abstract: In this paper, the asymptotic behaviors of the transition probability for two-level avoided crossings are studied under the limit where two parameters (adiabatic parameter and energy gap parameter) tend to zero. This is a continuation of our previous works where avoided crossings are generated by tangential intersections and obey a non-adiabatic regime. The main results elucidate not only the asymptotic expansion of transition probability but also a quantum interference caused by several avoided crossings and a coexistence of two-parameter regimes arising from different vanishing orders.


title: MRScore: Evaluating Radiology Report Generation with LLM-based Reward System

abstract: In recent years, automated radiology report generation has experienced significant growth. This paper introduces MRScore, an automatic evaluation metric tailored for radiology report generation by leveraging Large Language Models (LLMs). Conventional NLG (natural language generation) metrics like BLEU are inadequate for accurately assessing the generated radiology reports, as systematically demonstrated by our observations within this paper. To address this challenge, we collaborated with radiologists to develop a framework that guides LLMs for radiology report evaluation, ensuring alignment with human analysis. Our framework includes two key components: i) utilizing GPT to generate large amounts of training data, i.e., reports with different qualities, and ii) pairing GPT-generated reports as accepted and rejected samples and training LLMs to produce MRScore as the model reward. Our experiments demonstrate MRScore's higher correlation with human judgments and superior performance in model selection compared to traditional metrics. Our code and datasets will be available on GitHub.


title: Medical Vision-Language Pre-Training for Brain Abnormalities

abstract: Vision-language models have become increasingly powerful for tasks that require an understanding of both visual and linguistic elements, bridging the gap between these modalities. In the context of multimodal clinical AI, there is a growing need for models that possess domain-specific knowledge, as existing models often lack the expertise required for medical applications. In this paper, we take brain abnormalities as an example to demonstrate how to automatically collect medical image-text aligned data for pretraining from public resources such as PubMed. In particular, we present a pipeline that streamlines the pre-training process by initially collecting a large brain image-text dataset from case reports and published journals and subsequently constructing a high-performance vision-language model tailored to specific medical tasks. We also investigate the unique challenge of mapping subfigures to subcaptions in the medical domain. We evaluated the resulting model with quantitative and qualitative intrinsic evaluations. The resulting dataset and our code can be found here https://github.com/masoud-monajati/MedVL_pretraining_pipeline


title: Verco: Learning Coordinated Verbal Communication for Multi-agent Reinforcement Learning

abstract: In recent years, multi-agent reinforcement learning algorithms have made significant advancements in diverse gaming environments, leading to increased interest in the broader application of such techniques. To address the prevalent challenge of partial observability, communication-based algorithms have improved cooperative performance through the sharing of numerical embedding between agents. However, the understanding of the formation of collaborative mechanisms is still very limited, making designing a human-understandable communication mechanism a valuable problem to address. In this paper, we propose a novel multi-agent reinforcement learning algorithm that embeds large language models into agents, endowing them with the ability to generate human-understandable verbal communication. The entire framework has a message module and an action module. The message module is responsible for generating and sending verbal messages to other agents, effectively enhancing information sharing among agents. To further enhance the message module, we employ a teacher model to generate message labels from the global view and update the student model through Supervised Fine-Tuning (SFT). The action module receives messages from other agents and selects actions based on current local observations and received messages. Experiments conducted on the Overcooked game demonstrate our method significantly enhances the learning efficiency and performance of existing methods, while also providing an interpretable tool for humans to understand the process of multi-agent cooperation.


title: A Value-Oriented Investigation of Photoshop's Generative Fill

abstract: The creative industry is both concerned and enthusiastic about how generative AI will reshape creativity. How might these tools interact with the workflow values of creative artists? In this paper, we adopt a value-sensitive design framework to examine how generative AI, particularly Photoshop's Generative Fill (GF), helps or hinders creative professionals' values. We obtained 566 unique posts about GF from online forums for creative professionals who use Photoshop in their current work practices. We conducted reflexive thematic analysis focusing on usefulness, ease of use, and user values. Users found GF useful in doing touch-ups, expanding images, and generating composite images. GF helped users' values of productivity by making work efficient but created a value tension around creativity: it helped reduce barriers to creativity but hindered distinguishing 'human' from algorithmic art. Furthermore, GF hindered lived experiences shaping creativity and hindered the honed prideful skills of creative work.


title: Prolate-oblate shape transitions and O(6) symmetry in even-even nuclei: A theoretical overview

abstract: Prolate to oblate shape transitions have been predicted in an analytic way in the framework of the Interacting Boson Model (IBM), determining O(6) as the symmetry at the critical point. Parameter-independent predictions for prolate to oblate transitions in various regions on the nuclear chart have been made in the framework of the proxy-SU(3) and pseudo-SU(3) symmetries, corroborated by recent non-relativistic and relativistic mean field calculations along series of nuclear isotopes, with parameters fixed throughout, as well as by shell model calculations taking advantage of the quasi-SU(3) symmetry. Experimental evidence for regions of prolate to oblate shape transitions is in agreement with regions in which nuclei bearing the O(6) dynamical symmetry of the IBM have been identified, lying below major shell closures. In addition, gradual oblate to prolate transitions are seen when crossing major nuclear shell closures, in analogy to experimental observations in alkali clusters.


title: KnapsackLB: Enabling Performance-Aware Layer-4 Load Balancing

abstract: Layer-4 load balancer (LB) is a key building block of online services. In this paper, we empower such LBs to adapt to different and dynamic performance of backend instances (DIPs). Our system, KNAPSACKLB, is generic (can work with variety of LBs), does not require agents on DIPs, LBs or clients, and scales to large numbers of DIPs. KNAPSACKLB uses judicious active probes to learn a mapping from LB weights to the response latency of each DIP, and then applies Integer Linear Programming (ILP) to calculate LB weights that optimize latency, using an iterative method to scale the computation to large numbers of DIPs. Using testbed experiments and simulations, we show that KNAPSACKLB load balances traffic as per the performance and cuts average latency by up to 45% compared to existing designs.


title: Logical Characterizations of Weighted Complexity Classes

abstract: Fagin's seminal result characterizing $\mathsf{NP}$ in terms of existential second-order logic started the fruitful field of descriptive complexity theory. In recent years, there has been much interest in the investigation of quantitative (weighted) models of computations. In this paper, we start the study of descriptive complexity based on weighted Turing machines over arbitrary semirings. We provide machine-independent characterizations (over ordered structures) of the weighted complexity classes $\mathsf{NP}[\mathcal{S}], \mathsf{FP}[\mathcal{S}]$, $\mathsf{FPLOG}[\mathcal{S}]$, $\mathsf{FPSPACE}[\mathcal{S}]$, and $\mathsf{FPSPACE}_{poly}[\mathcal{S}]$ in terms of definability in suitable weighted logics for an arbitrary semiring $\mathcal{S}$. In particular, we prove weighted versions of Fagin's theorem (even for arbitrary structures, not necessarily ordered, provided that the semiring is idempotent and commutative), the Immerman--Vardi's theorem (originally for $\mathsf{P}$) and the Abiteboul--Vianu--Vardi's theorem (originally for $\mathsf{PSPACE}$). We also address a recent open problem proposed by Eiter and Kiesel.


title: Temporal Scaling Law for Large Language Models

abstract: Recently, Large Language Models (LLMs) have been widely adopted in a wide range of tasks, leading to increasing attention towards the research on how scaling LLMs affects their performance. Existing works, termed Scaling Laws, have discovered that the final test loss of LLMs scales as power-laws with model size, computational budget, and dataset size. However, the temporal change of the test loss of an LLM throughout its pre-training process remains unexplored, though it is valuable in many aspects, such as selecting better hyperparameters \textit{directly} on the target LLM. In this paper, we propose the novel concept of Temporal Scaling Law, studying how the test loss of an LLM evolves as the training steps scale up. In contrast to modeling the test loss as a whole in a coarse-grained manner, we break it down and dive into the fine-grained test loss of each token position, and further develop a dynamic hyperbolic-law. Afterwards, we derive the much more precise temporal scaling law by studying the temporal patterns of the parameters in the dynamic hyperbolic-law. Results on both in-distribution (ID) and out-of-distribution (OOD) validation datasets demonstrate that our temporal scaling law accurately predicts the test loss of LLMs across training steps. Our temporal scaling law has broad practical applications. First, it enables direct and efficient hyperparameter selection on the target LLM, such as data mixture proportions. Secondly, viewing the LLM pre-training dynamics from the token position granularity provides some insights to enhance the understanding of LLM pre-training.


title: Euclidean Methods on Dirac Quantization and Gauge Representation

abstract: Geometrical interpretation on U(1) gage theory of Dirac monopole, introduced here from the line integral\cite{Brandt} form of vector potentials, shows the gauge representation be multi-valued. In this paper, we construct Euclidean form of U(1) gauge theory on Dirac monopole based on the geometrical interpretation, derive the Dirac quantization condition geometrically. Even several theoretical methods which leads to Dirac quantization $eg=l/2$ has been developed, these are only possible under the postulate that gauge representation is single-valued. Using the line integration representation of vector potential, we derived the gauge equation which satisfies under the `phase gauge transformation' ($\mathbf{A}\to\mathbf{A}'=\mathbf{A}, \ \psi\to\psi'=e^{ie\Lambda}\psi$), also showed that the Dirac quantization condition can be derived by the geometrical boundary condition on this gauge equation, without any supposing of canonical quantization condition. We finally explain geometrical meaning of constant phase of gauge and how the Dirac quantization holds single valued gauge representation.


title: Quantum resistant multi-signature scheme with optimal communication round: A Blockchain-based approach

abstract: Blockchain is a decentralized network to increase trust, integrity, and transparency of transactions. With the exponential growth of transactions in the realm of Blockchain, especially in Bitcoin, Blockchain size increases as all transactions must be stored and verified. In Bitcoin, validating M of N transactions involves the necessity of M authentic signatures out of the total N transactions. This procedure is so time-consuming and needs a significant storage capacity. To address these issues, several multi signature schemes have been proposed, enabling users to interactively generate a common signature on a single message. Recently, some lattice based multi signature schemes have been presented to deal with the threats of quantum computers. However, none of them have met all desirable features of multi signature schemes like aggregate public key, low numbers of communication rounds, or resistant to quantum computers. Within this paper, we present a new multi signature scheme based on lattices, known as Razhims, that has aggregate public key, necessitates solely a single round of communication, and is resistant to quantum computers. In Razhims, the aggregate public key size and the final signature size are equal to the public key size and the final signature size of a standard signature respectively, and are independent of the number of signers.


title: Reconfigurable collective resonances induced by liquid crystals in dielectric metasurfaces

abstract: Dielectric metasurfaces can show multi-resonant response with high Q-factors in the visible range due to multipole coupling. This work suggests that these collective resonances in all-dielectric metasurfaces can be modified if adjacent to an anisotropic liquid crystal medium, opening a new path toward the dynamic metasurface effects. Using numerical full-wave simulations and the multipole decomposition technique for reflection and transmission coefficients we study the influence of the surrounding anisotropic medium on the resonant response of metasurfaces composed of disk-shaped dielectric nanoparticles. First, we consider tuning and switching the resonances induced by the polarization of the incident beam in metasurfaces placed in a medium with different orientations of LC molecules. Secondly, we study the case when the tuning of resonances is carried out by applying an external voltage that changes the orientation of LC molecules and thereby changes the refractive index of the surrounding medium. The results obtained demonstrate the possibility of directly tuning the resonant response of dielectric metasurfaces in an anisotropic environment, which is important for the development of optical nanodevices with dynamic switching of functional modes in the visible range.


title: BiLO: Bilevel Local Operator Learning for PDE inverse problems

abstract: We propose a new neural network based method for solving inverse problems for partial differential equations (PDEs) by formulating the PDE inverse problem as a bilevel optimization problem. At the upper level, we minimize the data loss with respect to the PDE parameters. At the lower level, we train a neural network to locally approximate the PDE solution operator in the neighborhood of a given set of PDE parameters, which enables an accurate approximation of the descent direction for the upper level optimization problem. The lower level loss function includes the L2 norms of both the residual and its derivative with respect to the PDE parameters. We apply gradient descent simultaneously on both the upper and lower level optimization problems, leading to an effective and fast algorithm. The method, which we refer to as BiLO (Bilevel Local Operator learning), is also able to efficiently infer unknown functions in the PDEs through the introduction of an auxiliary variable. Through extensive experiments over multiple PDE systems, we demonstrate that our method enforces strong PDE constraints, is robust to sparse and noisy data, and eliminates the need to balance the residual and the data loss, which is inherent to the soft PDE constraints in many existing methods.


title: Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities

abstract: Cross-lingual continual pre-training of large language models (LLMs) initially trained on English corpus allows us to leverage the vast amount of English language resources and reduce the pre-training cost. In this study, we constructed Swallow, an LLM with enhanced Japanese capability, by extending the vocabulary of Llama 2 to include Japanese characters and conducting continual pre-training on a large Japanese web corpus. Experimental results confirmed that the performance on Japanese tasks drastically improved through continual pre-training, and the performance monotonically increased with the amount of training data up to 100B tokens. Consequently, Swallow achieved superior performance compared to other LLMs that were trained from scratch in English and Japanese. An analysis of the effects of continual pre-training revealed that it was particularly effective for Japanese question answering tasks. Furthermore, to elucidate effective methodologies for cross-lingual continual pre-training from English to Japanese, we investigated the impact of vocabulary expansion and the effectiveness of incorporating parallel corpora. The results showed that the efficiency gained through vocabulary expansion had no negative impact on performance, except for the summarization task, and that the combined use of parallel corpora enhanced translation ability.


title: HIPer: A Human-Inspired Scene Perception Model for Multifunctional Mobile Robots

abstract: Taking over arbitrary tasks like humans do with a mobile service robot in open-world settings requires a holistic scene perception for decision-making and high-level control. This paper presents a human-inspired scene perception model to minimize the gap between human and robotic capabilities. The approach takes over fundamental neuroscience concepts, such as a triplet perception split into recognition, knowledge representation, and knowledge interpretation. A recognition system splits the background and foreground to integrate exchangeable image-based object detectors and SLAM, a multi-layer knowledge base represents scene information in a hierarchical structure and offers interfaces for high-level control, and knowledge interpretation methods deploy spatio-temporal scene analysis and perceptual learning for self-adjustment. A single-setting ablation study is used to evaluate the impact of each component on the overall performance for a fetch-and-carry scenario in two simulated and one real-world environment.


title: A General Framework for Random Effects Models for Binary, Ordinal, Count Type and Continuous Dependent Variables Including Variable Selection

abstract: A general random effects model is proposed that allows for continuous as well as discrete distributions of the responses. Responses can be unrestricted continuous, bounded continuous, binary, ordered categorical or given in the form of counts. The distribution of the responses is not restricted to exponential families, which is a severe restriction in generalized mixed models. Generalized mixed models use fixed distributions for responses, for example the Poisson distribution in count data, which has the disadvantage of not accounting for overdispersion. By using a response function and a thresholds function the proposed mixed thresholds model can account for a variety of alternative distributions that often show better fits than fixed distributions used within the generalized linear model framework. A particular strength of the model is that it provides a tool for joint modeling, responses may be of different types, some can be discrete, others continuous. In addition to introducing the mixed thresholds model parameter sparsity is addressed. Random effects models can contain a large number of parameters, in particular if effects have to be assumed as measurement-specific. Methods to obtain sparser representations are proposed and illustrated. The methods are shown to work in the thresholds model but could also be adapted to other modeling approaches.


title: CLFT: Camera-LiDAR Fusion Transformer for Semantic Segmentation in Autonomous Driving

abstract: Critical research about camera-and-LiDAR-based semantic object segmentation for autonomous driving significantly benefited from the recent development of deep learning. Specifically, the vision transformer is the novel ground-breaker that successfully brought the multi-head-attention mechanism to computer vision applications. Therefore, we propose a vision-transformer-based network to carry out camera-LiDAR fusion for semantic segmentation applied to autonomous driving. Our proposal uses the novel progressive-assemble strategy of vision transformers on a double-direction network and then integrates the results in a cross-fusion strategy over the transformer decoder layers. Unlike other works in the literature, our camera-LiDAR fusion transformers have been evaluated in challenging conditions like rain and low illumination, showing robust performance. The paper reports the segmentation results over the vehicle and human classes in different modalities: camera-only, LiDAR-only, and camera-LiDAR fusion. We perform coherent controlled benchmark experiments of CLFT against other networks that are also designed for semantic segmentation. The experiments aim to evaluate the performance of CLFT independently from two perspectives: multimodal sensor fusion and backbone architectures. The quantitative assessments show our CLFT networks yield an improvement of up to 10% for challenging dark-wet conditions when comparing with Fully-Convolutional-Neural-Network-based (FCN) camera-LiDAR fusion neural network. Contrasting to the network with transformer backbone but using single modality input, the all-around improvement is 5-10%.


title: GPT for Games: A Scoping Review (2020-2023)

abstract: This paper introduces a scoping review of 55 articles to explore GPT's potential for games, offering researchers a comprehensive understanding of the current applications and identifying both emerging trends and unexplored areas. We identify five key applications of GPT in current game research: procedural content generation, mixed-initiative game design, mixed-initiative gameplay, playing games, and game user research. Drawing from insights in each of these application areas, we propose directions for future research in each one. This review aims to lay the groundwork by illustrating the state of the art for innovative GPT applications in games, promising to enrich game development and enhance player experiences with cutting-edge AI innovations.


title: Discovery of Giant Unit-Cell Super-Structure in the Infinite-Layer Nickelate PrNiO$_2$

abstract: Spectacular quantum phenomena such as superconductivity often emerge in flat-band systems where Coulomb interactions overpower electron kinetics. Engineering strategies for flat-band physics is therefore of great importance. Here, using high-energy grazing-incidence x-ray diffraction, we demonstrate how in-situ temperature annealing of the infinite-layer nickelate PrNiO$_2$ induces a giant superlattice structure. The annealing effect has a maximum well above room temperature. By covering a large scattering volume, we show a rare period-six in-plane (bi-axial) symmetry and a period-four symmetry in the out-of-plane direction. This giant unit-cell superstructure likely stems from ordering of diffusive oxygen. The stability of this superlattice structure suggests a connection to an energetically favorable electronic state of matter. As such, our study provides a new pathway - different from Moir\'e structures - to ultra-small Brillouin zone electronics.


title: Modified Trapezoidal Product Cubature Rules. Definiteness, Monotonicity and a Posteriori Error Estimates

abstract: We study two modifications of the trapezoidal product cubature formulae, approximating double integrals over the square domain $[a,b]^2=[a,b]\times [a,b]$. Our modified cubature formulae use mixed type data: except evaluations of the integrand on the points forming a uniform grid on $[a,b]^2$, they involve two or four univariate integrals. An useful property of these cubature formulae is that they are definite of order $(2,2)$, that is, they provide one-sided approximation to the double integral for real-valued integrands from the class $$ \mathcal{C}^{2,2}[a,b]=\{f(x,y)\,:\,\frac{\partial^4 f}{\partial x^2\partial y^2}\ \text{continuous and does not change sign in}\ (a,b)^2\}. $$ For integrands from $\mathcal{C}^{2,2}[a,b]$ we prove monotonicity of the remainders and derive a-posteriori error estimates.


title: Plastic instability of annular crystalline membrane in circular confinement

abstract: Understanding the mechanical instabilities of two-dimensional membranes has strong connection to the subjects of structure instabilities, morphology control and materials failures. In this work, we investigate the plastic mechanism developed in the annular crystalline membrane system for adapting to the shrinking space, which is caused by the controllable gradual expansion of the inner boundary. In the process of plastic deformation, we find the continuous generation of dislocations at the inner boundary, and their collective migration to the outer boundary; this neat dynamic scenario of dislocation current captures the complicated reorganization process of the particles. We also reveal the characteristic vortex structure arising from the interplay of topological defects and the displacement field. These results may find applications in the precise control of structural instabilities in packings of particulate matter and covalently bonded systems.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.mtrl-sci physics.comp-ph


title: Torsion and Chern-Simons gravity in 4D space-times from a Geometrodynamical four-form

abstract: In Hermann Minkowski's pioneering formulation of special relativity, the space-time geometry in any inertial frame is described by the line-element $ds^2= \eta_{\mu \nu} dx^\mu dx^\nu$. It is interesting to note that not only the Minkowski metric $\eta_{\mu \nu} $ is invariant under proper Lorentz transformations, the totally antisymmetric Levi-Civita tensor $e_{\mu \nu \alpha \beta} $ too is. In general relativity (GR), $\eta_{\mu \nu} $ of the flat space-time gets generalized to a dynamical, space-time dependent metric tensor $ g_{\mu \nu} $ that characterizes a curved space-time geometry. In the present study, it is put forward that the flat space-time Levi-Civita tensor gets elevated to a dynamical four-form field $\tilde {w} $ in curved space-time manifolds, i.e. $e_{\mu \nu \alpha \beta} \rightarrow w_{\mu \nu \alpha \beta} (x) = \phi (x) \ e_{\mu \nu \alpha \beta} $ so that $\tilde {w} = {1\over {4!}} \ w_{\mu \nu \rho \sigma} \ \tilde{d} x^\mu \wedge \tilde{d} x^\nu \wedge \tilde{d} x^\rho \wedge \tilde{d} x^\sigma$. It is shown that this geometrodynamical four-form field, extends GR by leading naturally to a torsion in the theory as well as to a Chern-Simons gravity. In order to subject the hypothesized four-form field $\tilde {w}$ to observational evidence, we first argue that the associated scalar-density $\phi (x)$ corresponds to an axion-like pseudo-scalar field in the Minkowski space-time, and that it can also masquerade as dark matter. Thereafter, we provide a simple semi-classical analysis in which a self-gravitating Bose-Einstein condensate of such ultra-light pseudo-scalars leads to the formation of a supermassive black hole.


title: Personalized Federated Learning via Sequential Layer Expansion in Representation Learning

abstract: Federated learning ensures the privacy of clients by conducting distributed training on individual client devices and sharing only the model weights with a central server. However, in real-world scenarios, the heterogeneity of data among clients necessitates appropriate personalization methods. In this paper, we aim to address this heterogeneity using a form of parameter decoupling known as representation learning. Representation learning divides deep learning models into 'base' and 'head' components. The base component, capturing common features across all clients, is shared with the server, while the head component, capturing unique features specific to individual clients, remains local. We propose a new representation learning-based approach that suggests decoupling the entire deep learning model into more densely divided parts with the application of suitable scheduling methods, which can benefit not only data heterogeneity but also class heterogeneity. In this paper, we compare and analyze two layer scheduling approaches, namely forward (\textit{Vanilla}) and backward (\textit{Anti}), in the context of data and class heterogeneity among clients. Our experimental results show that the proposed algorithm, when compared to existing personalized federated learning algorithms, achieves increased accuracy, especially under challenging conditions, while reducing computation costs.


title: Radial distribution and its spherical harmonics expansion in liquid CO2 at 250 K and 50 bar based on pressure-constant Monte Carlo simulation using Kihara Potential Model

abstract: The purpose of this article is to compute the radial distribution function of liquid CO2 at 250 K and 50 bar and its expansion coefficients by spherical harmonics as a function of intermolecular distance up to 20 angstroms for all possible combinations of angular indices l, l prime, and m less than or equal to 8, in contrast to past works of limited combinations. The positions and orientations of CO2 molecules were determined by pressure-constant Monte Carlo simulation using a Kihara potential model. It was found that the radial distribution function had an intense peak at 4.05 angstroms and a broad band at around 7.85 angstroms. The expansion coefficients had prominent structures below approximately 7.5 angstroms, showing positive and/or negative peaks, which indicated that the orientational correlations of the central molecule were intense with the molecules present in that region. It was also found that the peaks of some expansion coefficients were not small even when l = 8. The implication of the values of the expansion coefficients as well as their positive/negative peaks, relating to orientational correlation, are yet to be investigated further.


title: Dynamical Mode Recognition of Coupled Flame Oscillators by Supervised and Unsupervised Learning Approaches

abstract: Combustion instability in gas turbines and rocket engines, as one of the most challenging problems in combustion research, arises from the complex interactions among flames, which are also influenced by chemical reactions, heat and mass transfer, and acoustics. Identifying and understanding combustion instability is essential to ensure the safe and reliable operation of many combustion systems, where exploring and classifying the dynamical behaviors of complex flame systems is a core take. To facilitate fundamental studies, the present work concerns dynamical mode recognition of coupled flame oscillators made of flickering buoyant diffusion flames, which have gained increasing attention in recent years but are not sufficiently understood. The time series data of flame oscillators are generated by fully validated reacting flow simulations. Due to limitations of expertise-based models, a data-driven approach is adopted. In this study, a nonlinear dimensional reduction model of variational autoencoder (VAE) is used to project the simulation data onto a 2-dimensional latent space. Based on the phase trajectories in latent space, both supervised and unsupervised classifiers are proposed for datasets with well known labeling and without, respectively. For labeled datasets, we establish the Wasserstein-distance-based classifier (WDC) for mode recognition; for unlabeled datasets, we develop a novel unsupervised classifier (GMM-DTWC) combining dynamic time warping (DTW) and Gaussian mixture model (GMM). Through comparing with conventional approaches for dimensionality reduction and classification, the proposed supervised and unsupervised VAE-based approaches exhibit a prominent performance for distinguishing dynamical modes, implying their potential extension to dynamical mode recognition of complex combustion problems.


title: Empirical Analysis of Dialogue Relation Extraction with Large Language Models

abstract: Dialogue relation extraction (DRE) aims to extract relations between two arguments within a dialogue, which is more challenging than standard RE due to the higher person pronoun frequency and lower information density in dialogues. However, existing DRE methods still suffer from two serious issues: (1) hard to capture long and sparse multi-turn information, and (2) struggle to extract golden relations based on partial dialogues, which motivates us to discover more effective methods that can alleviate the above issues. We notice that the rise of large language models (LLMs) has sparked considerable interest in evaluating their performance across diverse tasks. To this end, we initially investigate the capabilities of different LLMs in DRE, considering both proprietary models and open-source models. Interestingly, we discover that LLMs significantly alleviate two issues in existing DRE methods. Generally, we have following findings: (1) scaling up model size substantially boosts the overall DRE performance and achieves exceptional results, tackling the difficulty of capturing long and sparse multi-turn information; (2) LLMs encounter with much smaller performance drop from entire dialogue setting to partial dialogue setting compared to existing methods; (3) LLMs deliver competitive or superior performances under both full-shot and few-shot settings compared to current state-of-the-art; (4) LLMs show modest performances on inverse relations but much stronger improvements on general relations, and they can handle dialogues of various lengths especially for longer sequences.


title: Observations of Galaxies at $z\gtrsim10$ Allow to Test Cosmological Models with Features in the Initial Power Spectrum

abstract: The initial power spectrum of density perturbations, generated during the inflationary epoch, is now constrained by observations on scales $\lambda>5$~Mpc and has a power-law form. The peculiarities of the inflationary process can lead to the appearance of non-power-law contributions to this spectrum, such as peaks. The exact size and shape of the peak cannot be predicted in advance. In this paper, we propose methods for searching for such peaks in the region of the spectrum with $\lambda<5$~Mpc. Perturbations on these scales enter the nonlinear stage at $z\gtrsim10$, which is now becoming accessible to observations. Our studies of numerical models of large-scale structure with peaks in the initial spectrum have shown that spectral features on scales with $\lambda>0.1$~Mpc manifest in the clustering of galaxies, as well as affect their mass function, sizes, and density. Studying these characteristics of distant galaxies will allow us to constrain cosmological models with peaks.


title: Flock2: A model for orientation-based social flocking

abstract: The aerial flocking of birds, or murmurations, have fascinated observers while presenting many challenges to behavioral study and simulation. We examine how the periphery of murmurations remain well bounded and cohesive. We also investigate agitation waves, which occur when a flock is disturbed, developing a plausible model for how they might emerge spontaneously. To understand these behaviors a new model is presented for orientation-based social flocking. Previous methods model inter-bird dynamics by considering the neighborhood around each bird, and introducing forces for avoidance, alignment, and cohesion as three dimensional vectors that alter acceleration. Our method introduces orientation-based social flocking that treats social influences from neighbors more realistically as a desire to turn, indirectly controlling the heading in an aerodynamic model. While our model can be applied to any flocking social bird we simulate flocks of starlings, Sturnus vulgaris, and demonstrate the possibility of orientation waves in the absence of predators. Our model exhibits spherical and ovoidal flock shapes matching observation. Comparisons of our model to Reynolds' on energy consumption and frequency analysis demonstrates more realistic motions, significantly less energy use in turning, and a plausible mechanism for emergent orientation waves.


title: From Optimization to Generalization: Fair Federated Learning against Quality Shift via Inter-Client Sharpness Matching

abstract: Due to escalating privacy concerns, federated learning has been recognized as a vital approach for training deep neural networks with decentralized medical data. In practice, it is challenging to ensure consistent imaging quality across various institutions, often attributed to equipment malfunctions affecting a minority of clients. This imbalance in image quality can cause the federated model to develop an inherent bias towards higher-quality images, thus posing a severe fairness issue. In this study, we pioneer the identification and formulation of this new fairness challenge within the context of the imaging quality shift. Traditional methods for promoting fairness in federated learning predominantly focus on balancing empirical risks across diverse client distributions. This strategy primarily facilitates fair optimization across different training data distributions, yet neglects the crucial aspect of generalization. To address this, we introduce a solution termed Federated learning with Inter-client Sharpness Matching (FedISM). FedISM enhances both local training and global aggregation by incorporating sharpness-awareness, aiming to harmonize the sharpness levels across clients for fair generalization. Our empirical evaluations, conducted using the widely-used ICH and ISIC 2019 datasets, establish FedISM's superiority over current state-of-the-art federated learning methods in promoting fairness. Code is available at https://github.com/wnn2000/FFL4MIA.


title: T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretraining

abstract: Contrastive language-audio pretraining~(CLAP) has been developed to align the representations of audio and language, achieving remarkable performance in retrieval and classification tasks. However, current CLAP struggles to capture temporal information within audio and text features, presenting substantial limitations for tasks such as audio retrieval and generation. To address this gap, we introduce T-CLAP, a temporal-enhanced CLAP model. We use Large Language Models~(LLMs) and mixed-up strategies to generate temporal-contrastive captions for audio clips from extensive audio-text datasets. Subsequently, a new temporal-focused contrastive loss is designed to fine-tune the CLAP model by incorporating these synthetic data. We conduct comprehensive experiments and analysis in multiple downstream tasks. T-CLAP shows improved capability in capturing the temporal relationship of sound events and outperforms state-of-the-art models by a significant margin.


title: Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors

abstract: Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot learning, recent studies indicate that current LLMs still struggle with zero and few-shot RE. Previous studies are mainly dedicated to design prompt formats and select good examples for improving ICL-based RE. Although both factors are vital for ICL, if one can fundamentally boost the ICL capability of LLMs in RE, the zero and few-shot RE performance via ICL would be significantly improved. To this end, we introduce \textsc{Micre} (\textbf{M}eta \textbf{I}n-\textbf{C}ontext learning of LLMs for \textbf{R}elation \textbf{E}xtraction), a new meta-training framework for zero and few-shot RE where an LLM is tuned to do ICL on a diverse collection of RE datasets (i.e., learning to learn in context for RE). Through meta-training, the model becomes more effectively to learn a new RE task in context by conditioning on a few training examples with no parameter updates or task-specific templates at inference time, enabling better zero and few-shot task generalization. We experiment \textsc{Micre} on various LLMs with different model scales and 12 public RE datasets, and then evaluate it on unseen RE benchmarks under zero and few-shot settings. \textsc{Micre} delivers comparable or superior performance compared to a range of baselines including supervised fine-tuning and typical in-context learning methods. We find that the gains are particular significant for larger model scales, and using a diverse set of the meta-training RE datasets is key to improvements. Empirically, we show that \textsc{Micre} can transfer the relation semantic knowledge via relation label name during inference on target RE datasets.