title: Trainable Noise Model as an XAI evaluation method: application on Sobol for remote sensing image segmentation

abstract: eXplainable Artificial Intelligence (XAI) has emerged as an essential requirement when dealing with mission-critical applications, ensuring transparency and interpretability of the employed black box AI models. The significance of XAI spans various domains, from healthcare to finance, where understanding the decision-making process of deep learning algorithms is essential. Most AI-based computer vision models are often black boxes; hence, providing explainability of deep neural networks in image processing is crucial for their wide adoption and deployment in medical image analysis, autonomous driving, and remote sensing applications. Recently, several XAI methods for image classification tasks have been introduced. On the contrary, image segmentation has received comparatively less attention in the context of explainability, although it is a fundamental task in computer vision applications, especially in remote sensing. Only some research proposes gradient-based XAI algorithms for image segmentation. This paper adapts the recent gradient-free Sobol XAI method for semantic segmentation. To measure the performance of the Sobol method for segmentation, we propose a quantitative XAI evaluation method based on a learnable noise model. The main objective of this model is to induce noise on the explanation maps, where higher induced noise signifies low accuracy and vice versa. A benchmark analysis is conducted to evaluate and compare performance of three XAI methods, including Seg-Grad-CAM, Seg-Grad-CAM++ and Seg-Sobol using the proposed noise-based evaluation technique. This constitutes the first attempt to run and evaluate XAI methods using high-resolution satellite images.


title: Active Caustics

abstract: Heavy particles in vortical fluid flow cluster strongly, forming singular structures termed caustics for their resemblance to focal surfaces in optics. We show here that such extreme aggregation onto low-dimensional submanifolds can arise without inertia for self-propelled particles (SPPs). We establish that a singular perturbation is at the heart of caustic formation by SPPs around a single vortex, and our numerical studies of SPPs in two-dimensional Navier-Stokes turbulence shows intense caustics in the straining regions of the flow, peaking at intermediate levels of self-propulsion. Our work offers a route to singularly high local concentrations in a macroscopically dilute suspension of zero-Reynolds number swimmers, with potentially game-changing implications for communication and sexual reproduction. An intriguing open direction is whether the active turbulence of a suspension of swimming microbes could serve to generate caustics in its own concentration.


title: AI-Generated Images as Data Source: The Dawn of Synthetic Era

abstract: The advancement of visual intelligence is intrinsically tethered to the availability of large-scale data. In parallel, generative Artificial Intelligence (AI) has unlocked the potential to create synthetic images that closely resemble real-world photographs. This prompts a compelling inquiry: how much visual intelligence could benefit from the advance of generative AI? This paper explores the innovative concept of harnessing these AI-generated images as new data sources, reshaping traditional modeling paradigms in visual intelligence. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability, the rapid generation of vast datasets, and the effortless simulation of edge cases. Built on the success of generative AI models, we examine the potential of their generated data in a range of applications, from training machine learning models to simulating scenarios for computational modeling, testing, and validation. We probe the technological foundations that support this groundbreaking use of generative AI, engaging in an in-depth discussion on the ethical, legal, and practical considerations that accompany this transformative paradigm shift. Through an exhaustive survey of current technologies and applications, this paper presents a comprehensive view of the synthetic era in visual intelligence. A project associated with this paper can be found at https://github.com/mwxely/AIGS .


title: Can Large Language Models Transform Natural Language Intent into Formal Method Postconditions?

abstract: Informal natural language that describes code functionality, such as code comments or function documentation, may contain substantial information about a programs intent. However, there is typically no guarantee that a programs implementation and natural language documentation are aligned. In the case of a conflict, leveraging information in code-adjacent natural language has the potential to enhance fault localization, debugging, and code trustworthiness. In practice, however, this information is often underutilized due to the inherent ambiguity of natural language which makes natural language intent challenging to check programmatically. The emergent abilities of Large Language Models (LLMs) have the potential to facilitate the translation of natural language intent to programmatically checkable assertions. However, it is unclear if LLMs can correctly translate informal natural language specifications into formal specifications that match programmer intent. Additionally, it is unclear if such translation could be useful in practice. In this paper, we describe nl2postcond, the problem of leveraging LLMs for transforming informal natural language to formal method postconditions, expressed as program assertions. We introduce and validate metrics to measure and compare different nl2postcond approaches, using the correctness and discriminative power of generated postconditions. We then use qualitative and quantitative methods to assess the quality of nl2postcond postconditions, finding that they are generally correct and able to discriminate incorrect code. Finally, we find that nl2postcond via LLMs has the potential to be helpful in practice; nl2postcond generated postconditions were able to catch 64 real-world historical bugs from Defects4J.


title: Quantum algorithm for the Vlasov simulation of the large-scale structure formation with massive neutrinos

abstract: Investigating the cosmological implication of the fact that neutrino has finite mass is of importance for fundamental physics. In particular, massive neutrino affects the formation of the large-scale structure (LSS) of the universe, and, conversely, observations of the LSS can give constraints on the neutrino mass. Numerical simulations of the LSS formation including massive neutrino along with conventional cold dark matter is thus an important task. For this, calculating the neutrino distribution in the phase space by solving the Vlasov equation is a suitable approach, but it requires solving the PDE in the $(6+1)$-dimensional space and is thus computationally demanding: Configuring $n_\mathrm{gr}$ grid points in each coordinate and $n_t$ time grid points leads to $O(n_\mathrm{gr}^6)$ memory space and $O(n_tn_\mathrm{gr}^6)$ queries to the coefficients in the discretized PDE. We propose a quantum algorithm for this task. Linearizing the Vlasov equation by neglecting the relatively weak self-gravity of the neutrino, we perform the Hamiltonian simulation to produce quantum states that encode the phase space distribution of neutrino. We also propose a way to extract the power spectrum of the neutrino density perturbations as classical data from the quantum state by quantum amplitude estimation with accuracy $\epsilon$ and query complexity of order $\widetilde{O}((n_\mathrm{gr} + n_t)/\epsilon)$. Our method also reduces the space complexity to $O(\mathrm{polylog}(n_\mathrm{gr}/\epsilon))$ in terms of the qubit number, while using quantum random access memories with $O(n_\mathrm{gr}^3)$ entries. As far as we know, this is the first quantum algorithm for the LSS simulation that outputs the quantity of practical interest with guaranteed accuracy.


title: Skin the sheep not only once: Reusing Various Depth Datasets to Drive the Learning of Optical Flow

abstract: Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow still adopt synthetic dataset for supervised training or utilize photometric consistency across temporally adjacent video frames to drive the unsupervised learning, where the former typically has issues of generalizability while the latter usually performs worse than the supervised ones. To tackle such challenges, we propose to leverage the geometric connection between optical flow estimation and stereo matching (based on the similarity upon finding pixel correspondences across images) to unify various real-world depth estimation datasets for generating supervised training data upon optical flow. Specifically, we turn the monocular depth datasets into stereo ones via synthesizing virtual disparity, thus leading to the flows along the horizontal direction; moreover, we introduce virtual camera motion into stereo data to produce additional flows along the vertical direction. Furthermore, we propose applying geometric augmentations on one image of an optical flow pair, encouraging the optical flow estimator to learn from more challenging cases. Lastly, as the optical flow maps under different geometric augmentations actually exhibit distinct characteristics, an auxiliary classifier which trains to identify the type of augmentation from the appearance of the flow map is utilized to further enhance the learning of the optical flow estimator. Our proposed method is general and is not tied to any particular flow estimator, where extensive experiments based on various datasets and optical flow estimation models verify its efficacy and superiority.


title: Mutations and derived equivalences for commutative noetherian rings

abstract: The representation theory of a commutative noetherian ring is tightly controlled by its prime spectrum. In this article we use the prime spectrum to describe mutation of cosilting objects in the derived category of a commutative noetherian ring.


title: EMBERSim: A Large-Scale Databank for Boosting Similarity Search in Malware Analysis

abstract: In recent years there has been a shift from heuristics-based malware detection towards machine learning, which proves to be more robust in the current heavily adversarial threat landscape. While we acknowledge machine learning to be better equipped to mine for patterns in the increasingly high amounts of similar-looking files, we also note a remarkable scarcity of the data available for similarity-targeted research. Moreover, we observe that the focus in the few related works falls on quantifying similarity in malware, often overlooking the clean data. This one-sided quantification is especially dangerous in the context of detection bypass. We propose to address the deficiencies in the space of similarity research on binary files, starting from EMBER - one of the largest malware classification data sets. We enhance EMBER with similarity information as well as malware class tags, to enable further research in the similarity space. Our contribution is threefold: (1) we publish EMBERSim, an augmented version of EMBER, that includes similarity-informed tags; (2) we enrich EMBERSim with automatically determined malware class tags using the open-source tool AVClass on VirusTotal data and (3) we describe and share the implementation for our class scoring technique and leaf similarity method.


title: The influence of the magnetic field on the nucleation and properties of 0-degree domain boundaries in uniaxial films with inhomogeneous magnetoelectric interaction

abstract: The paper investigates the behavior of 0 degree domain boundaries arising in uniaxial magnetic films with flexomagnetoelectric effect in a magnetic field. It is shown that at certain orientations of the magnetic field, it is possible to significantly enhance (or weaken) the degree of manifestation of the flexomagnetoelectric effect in the studied films. In addition, by varying the magnitude and directions of the magnetic field, it is possible to significantly lower (up to zero) the value of the critical electric field of the origin of this inhomogeneity. It is also established that a 0 degree domain boundary of non-Anelian type, in which induced bound charges do not create a resultant field (field shielding), when a magnetic field directed perpendicular to the plane of rotation of magnetic moments is applied, a flexomagnetoelectric effect occurs, which increases with increasing magnitude of the magnetic field.


title: Extending CAM-based XAI methods for Remote Sensing Imagery Segmentation

abstract: Current AI-based methods do not provide comprehensible physical interpretations of the utilized data, extracted features, and predictions/inference operations. As a result, deep learning models trained using high-resolution satellite imagery lack transparency and explainability and can be merely seen as a black box, which limits their wide-level adoption. Experts need help understanding the complex behavior of AI models and the underlying decision-making process. The explainable artificial intelligence (XAI) field is an emerging field providing means for robust, practical, and trustworthy deployment of AI models. Several XAI techniques have been proposed for image classification tasks, whereas the interpretation of image segmentation remains largely unexplored. This paper offers to bridge this gap by adapting the recent XAI classification algorithms and making them usable for muti-class image segmentation, where we mainly focus on buildings' segmentation from high-resolution satellite images. To benchmark and compare the performance of the proposed approaches, we introduce a new XAI evaluation methodology and metric based on "Entropy" to measure the model uncertainty. Conventional XAI evaluation methods rely mainly on feeding area-of-interest regions from the image back to the pre-trained (utility) model and then calculating the average change in the probability of the target class. Those evaluation metrics lack the needed robustness, and we show that using Entropy to monitor the model uncertainty in segmenting the pixels within the target class is more suitable. We hope this work will pave the way for additional XAI research for image segmentation and applications in the remote sensing discipline.


title: Pushing thermal conductivity to its lower limit in crystals with simple structures

abstract: Materials with low thermal conductivity usually have complex crystal structures. Herein we experimentally find that a simple crystal structure material AgTlI2 (I4/mcm) owns an extremely low thermal conductivity of 0.25 W/mK at room temperature. To understand this anomaly, we perform in-depth theoretical studies based on ab initio molecular dynamics simulations and anharmonic lattice dynamics. We find that the unique atomic arrangement and weak chemical bonding provide a permissive environment for strong oscillations of Ag atoms, leading to a considerable rattling behavior and giant lattice anharmonicity. This feature is also verified by the experimental probability density function refinement of single-crystal diffraction. The particularly strong anharmonicity breaks down the conventional phonon gas model, giving rise to non-negligible wavelike phonon behaviors in AgTlI2 at 300 K. Intriguingly, unlike many strongly anharmonic materials where a small propagative thermal conductivity is often accompanied by a large diffusive thermal conductivity, we find an unusual coexistence of ultralow propagative and diffusive thermal conductivities in AgTlI2 based on the thermal transport unified theory. This study underscores the potential of simple crystal structures in achieving low thermal conductivity and encourages further experimental research to enrich the family of materials with ultralow thermal conductivity.


title: Preserving Phonemic Distinctions for Ordinal Regression: A Novel Loss Function for Automatic Pronunciation Assessment

abstract: Automatic pronunciation assessment (APA) manages to quantify the pronunciation proficiency of a second language (L2) learner in a language. Prevailing approaches to APA normally leverage neural models trained with a regression loss function, such as the mean-squared error (MSE) loss, for proficiency level prediction. Despite most regression models can effectively capture the ordinality of proficiency levels in the feature space, they are confronted with a primary obstacle that different phoneme categories with the same proficiency level are inevitably forced to be close to each other, retaining less phoneme-discriminative information. On account of this, we devise a phonemic contrast ordinal (PCO) loss for training regression-based APA models, which aims to preserve better phonemic distinctions between phoneme categories meanwhile considering ordinal relationships of the regression target output. Specifically, we introduce a phoneme-distinct regularizer into the MSE loss, which encourages feature representations of different phoneme categories to be far apart while simultaneously pulling closer the representations belonging to the same phoneme category by means of weighted distances. An extensive set of experiments carried out on the speechocean762 benchmark dataset suggest the feasibility and effectiveness of our model in relation to some existing state-of-the-art models.


title: Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

abstract: Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using deep neural networks for deghosting. However, the methods typically rely on sufficient data with HDR ground-truths, which are difficult and costly to collect. In this work, to eliminate the need for labeled data, we propose SelfHDR, a self-supervised HDR reconstruction method that only requires dynamic multi-exposure images during training. Specifically, SelfHDR learns a reconstruction network under the supervision of two complementary components, which can be constructed from multi-exposure images and focus on HDR color as well as structure, respectively. The color component is estimated from aligned multi-exposure images, while the structure one is generated through a structure-focused network that is supervised by the color component and an input reference (\eg, medium-exposure) image. During testing, the learned reconstruction network is directly deployed to predict an HDR image. Experiments on real-world images demonstrate our SelfHDR achieves superior results against the state-of-the-art self-supervised methods, and comparable performance to supervised ones. Codes are available at https://github.com/cszhilu1998/SelfHDR


title: Observations of rogue seas in the Southern Ocean

abstract: We report direct observations of surface waves from a stereo camera system along with concurrent measurements of wind speed during an expedition across the Southern Ocean in the austral winter aboard South African icebreaker S.A.~Agulhas~II. Records include water surface elevation across a range of wave conditions, spanning from early stages of wave growth to full development. We give experimental evidence of rogue seas, i.e., sea states characterizided by heavy tails of the probability density function well beyond the expectation based on bound mode theory. These conditions emerge during wave growth, where strong wind forcing and high nonlinearity drive wave dynamics. Quasi-resonance wave-wave interactions, which are known to sustain the generation of large amplitude rogue waves, capture this behaviour. Wave statistics return to normality as the wind forcing ceases and waves switch to a full developed condition.


title: SelfGraphVQA: A Self-Supervised Graph Neural Network for Scene-based Question Answering

abstract: The intersection of vision and language is of major interest due to the increased focus on seamless integration between recognition and reasoning. Scene graphs (SGs) have emerged as a useful tool for multimodal image analysis, showing impressive performance in tasks such as Visual Question Answering (VQA). In this work, we demonstrate that despite the effectiveness of scene graphs in VQA tasks, current methods that utilize idealized annotated scene graphs struggle to generalize when using predicted scene graphs extracted from images. To address this issue, we introduce the SelfGraphVQA framework. Our approach extracts a scene graph from an input image using a pre-trained scene graph generator and employs semantically-preserving augmentation with self-supervised techniques. This method improves the utilization of graph representations in VQA tasks by circumventing the need for costly and potentially biased annotated data. By creating alternative views of the extracted graphs through image augmentations, we can learn joint embeddings by optimizing the informational content in their representations using an un-normalized contrastive approach. As we work with SGs, we experiment with three distinct maximization strategies: node-wise, graph-wise, and permutation-equivariant regularization. We empirically showcase the effectiveness of the extracted scene graph for VQA and demonstrate that these approaches enhance overall performance by highlighting the significance of visual information. This offers a more practical solution for VQA tasks that rely on SGs for complex reasoning questions.


title: Selective Feature Adapter for Dense Vision Transformers

abstract: Fine-tuning pre-trained transformer models, e.g., Swin Transformer, are successful in numerous downstream for dense prediction vision tasks. However, one major issue is the cost/storage of their huge amount of parameters, which becomes increasingly challenging to handle with the growing amount of vision tasks. In this paper, we propose an effective approach to alleviate the issue, namely selective feature adapter (SFA). It achieves state-of-the-art (SoTA) performance under any given budget of trainable parameters, and demonstrates comparable or better performance than fully fine-tuned models across various dense tasks. Specifically, SFA consists of external adapters and internal adapters which are sequentially operated over a transformer model. For external adapters, we properly select the places and amount of additional multilayer perception (MLP). For internal adapters, we transform a few task-important parameters inside the transformer, which are automatically discovered through a simple yet effective lottery ticket algorithm. Our experiments show that the dual adapter module, a.k.a SFA, is essential to achieve the best trade-off on dense vision tasks, such as segmentation, detection and depth-estimation, outperforming other adapters with a single module.


title: Semi-Aerodynamic Model Aided Invariant Kalman Filtering for UAV Full-State Estimation

abstract: Due to the state trajectory-independent features of invariant Kalman filtering (InEKF), it has attracted widespread attention in the research community for its significantly improved state estimation accuracy and convergence under disturbance. In this paper, we formulate the full-source data fusion navigation problem for fixed-wing unmanned aerial vehicle (UAV) within a framework based on error state right-invariant extended Kalman filtering (ES-RIEKF) on Lie groups. We merge measurements from a multi-rate onboard sensor network on UAVs to achieve real-time estimation of pose, air flow angles, and wind speed. Detailed derivations are provided, and the algorithm's convergence and accuracy improvements over established methods like Error State EKF (ES-EKF) and Nonlinear Complementary Filter (NCF) are demonstrated using real-flight data from UAVs. Additionally, we introduce a semi-aerodynamic model fusion framework that relies solely on ground-measurable parameters. We design and train an Long Short Term Memory (LSTM) deep network to achieve drift-free prediction of the UAV's angle of attack (AOA) and side-slip angle (SA) using easily obtainable onboard data like control surface deflections, thereby significantly reducing dependency on GNSS or complicated aerodynamic model parameters. Further, we validate the algorithm's robust advantages under GNSS denied, where flight data shows that the maximum positioning error stays within 30 meters over a 130-second denial period. To the best of our knowledge, this study is the first to apply ES-RIEKF to full-source navigation applications for fixed-wing UAVs, aiming to provide engineering references for designers. Our implementations using MATLAB/Simulink will open source.


title: Zero-Shot Refinement of Buildings' Segmentation Models using SAM

abstract: Foundation models have excelled in various tasks but are often evaluated on general benchmarks. The adaptation of these models for specific domains, such as remote sensing imagery, remains an underexplored area. In remote sensing, precise building instance segmentation is vital for applications like urban planning. While Convolutional Neural Networks (CNNs) perform well, their generalization can be limited. For this aim, we present a novel approach to adapt foundation models to address existing models' generalization dropback. Among several models, our focus centers on the Segment Anything Model (SAM), a potent foundation model renowned for its prowess in class-agnostic image segmentation capabilities. We start by identifying the limitations of SAM, revealing its suboptimal performance when applied to remote sensing imagery. Moreover, SAM does not offer recognition abilities and thus fails to classify and tag localized objects. To address these limitations, we introduce different prompting strategies, including integrating a pre-trained CNN as a prompt generator. This novel approach augments SAM with recognition abilities, a first of its kind. We evaluated our method on three remote sensing datasets, including the WHU Buildings dataset, the Massachusetts Buildings dataset, and the AICrowd Mapping Challenge. For out-of-distribution performance on the WHU dataset, we achieve a 5.47\% increase in IoU and a 4.81\% improvement in F1-score. For in-distribution performance on the WHU dataset, we observe a 2.72\% and 1.58\% increase in True-Positive-IoU and True-Positive-F1 score, respectively. Our code is publicly available at this Repo (https://github.com/geoaigroup/GEOAI-ECRS2023), hoping to inspire further exploration of foundation models for domain-specific tasks within the remote sensing community.


title: Benchmarking and Improving Generator-Validator Consistency of Language Models

abstract: As of September 2023, ChatGPT correctly answers "what is 7+8" with 15, but when asked "7+8=15, True or False" it responds with "False". This inconsistency between generating and validating an answer is prevalent in language models (LMs) and erodes trust. In this paper, we propose a framework for measuring the consistency between generation and validation (which we call generator-validator consistency, or GV-consistency), finding that even GPT-4, a state-of-the-art LM, is GV-consistent only 76% of the time. To improve the consistency of LMs, we propose to finetune on the filtered generator and validator responses that are GV-consistent, and call this approach consistency fine-tuning. We find that this approach improves GV-consistency of Alpaca-30B from 60% to 93%, and the improvement extrapolates to unseen tasks and domains (e.g., GV-consistency for positive style transfers extrapolates to unseen styles like humor). In addition to improving consistency, consistency fine-tuning improves both generator quality and validator accuracy without using any labeled data. Evaluated across 6 tasks, including math questions, knowledge-intensive QA, and instruction following, our method improves the generator quality by 16% and the validator accuracy by 6.3% across all tasks.


title: Dark Matter Search with Cherenkov Telescope Array

abstract: Many models of dark matter (DM) are now widely considered and probed intensively with accelerators, underground detectors, and astrophysical experiments. Among the various approaches, high-energy astrophysical observations are extremely useful to complement laboratory searches for some DM candidates. In the near future, the Cherenkov Telescope Array (CTA) should enable us to access much heavier weakly interacting massive particles, as well as a broad range of other DM candidates. In this talk, we describe DM searches with CTA.


title: Uncertain random geometric programming problems

abstract: In this paper, we introduce a deterministic formulation for the geometric programming problem, wherein the coefficients are represented as independent linear-normal uncertain random variables. To address the challenges posed by this combination of uncertainty and randomness, we introduce the concept of an uncertain random variable and present a novel framework known as the linear-normal uncertain random variable. Our main focus in this work is the development of three distinct transformation techniques: the optimistic value criteria, pessimistic value criteria, and expected value criteria. These approaches allow us to convert a linear-normal uncertain random variable into a more manageable random variable. This transition facilitates the transformation from an uncertain random geometric programming problem to a stochastic geometric programming problem. Furthermore, we provide insights into an equivalent deterministic representation of the transformed geometric programming problem, enhancing the clarity and practicality of the optimization process. To demonstrate the effectiveness of our proposed approach, we present a numerical example.


title: On the Geometry of Virtual Nonlinear Nonholonomic Constraints

abstract: Virtual constraints are relations imposed on a control system that become invariant via feedback control, as opposed to physical constraints acting on the system. Nonholonomic systems are mechanical systems with non-integrable constraints on the velocities. In this work, we introduce the notion of virtual nonlinear nonholonomic constraints in a geometric framework which is a controlled invariant submanifold and we show the existence and uniqueness of a control law preserving this submanifold. We illustrate the theory with various examples and present simulation results for an application.


title: Multi-class Network Intrusion Detection with Class Imbalance via LSTM & SMOTE

abstract: Monitoring network traffic to maintain the quality of service (QoS) and to detect network intrusions in a timely and efficient manner is essential. As network traffic is sequential, recurrent neural networks (RNNs) such as long short-term memory (LSTM) are suitable for building network intrusion detection systems. However, in the case of a few dataset examples of the rare attack types, even these networks perform poorly. This paper proposes to use oversampling techniques along with appropriate loss functions to handle class imbalance for the detection of various types of network intrusions. Our deep learning model employs LSTM with fully connected layers to perform multi-class classification of network attacks. We enhance the representation of minority classes: i) through the application of the Synthetic Minority Over-sampling Technique (SMOTE), and ii) by employing categorical focal cross-entropy loss to apply a focal factor to down-weight examples of the majority classes and focus more on hard examples of the minority classes. Extensive experiments on KDD99 and CICIDS2017 datasets show promising results in detecting network intrusions (with many rare attack types, e.g., Probe, R2L, DDoS, PortScan, etc.).


title: An equioscillation theorem for multivariate Chebyshev approximation

abstract: The equioscillation theorem interleaves the Haar condition, the existence and uniqueness and strong uniqueness of the optimal Chebyshev approximation and its characterization by the equioscillation condition in a way that cannot extend to multivariate approximation: Rice~[\emph{Transaction of the AMS}, 1963] says ''A form of alternation is still present for functions of several variables. However, there is apparently no simple method of distinguishing between the alternation of a best approximation and the alternation of other approximating functions. This is due to the fact that there is no natural ordering of the critical points.'' In addition, in the context of multivariate approximation the Haar condition is typically not satisfied and strong uniqueness may hold or not. The present paper proposes an multivariate equioscillation theorem, which includes such a simple alternation condition on error extrema, existence and a sufficient condition for strong uniqueness. To this end, the relationship between the properties interleaved in the univariate equioscillation theorem is clarified: first, a weak Haar condition is proposed, which simply implies existence. Second, the equioscillation condition is shown to be equivalent to the optimality condition of convex optimization, hence characterizing optimality independently from uniqueness. It is reformulated as the synchronized oscillations between the error extrema and the components of a related Haar matrix kernel vector, in a way that applies to multivariate approximation. Third, an additional requirement on the involved Haar matrix and its kernel vector, called strong equioscillation, is proved to be sufficient for the strong uniqueness of the solution. These three disconnected conditions give rise to a multivariate equioscillation theorem, where existence, characterization by equioscillation and strong uniqueness are separated, without involving the too restrictive Haar condition. Remarkably, relying on optimality condition of convex optimization gives rise to a quite simple proof. Instances of multivariate problems with strongly unique, non-strong but unique and non-unique solutions are presented to illustrate the scope of the theorem.


title: LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

abstract: The video-language (VL) pretraining has achieved remarkable improvement in multiple downstream tasks. However, the current VL pretraining framework is hard to extend to multiple modalities (N modalities, N>=3) beyond vision and language. We thus propose LanguageBind, taking the language as the bind across different modalities because the language modality is well-explored and contains rich semantics. Specifically, we freeze the language encoder acquired by VL pretraining, then train encoders for other modalities with contrastive learning. As a result, all modalities are mapped to a shared feature space, implementing multi-modal semantic alignment. While LanguageBind ensures that we can extend VL modalities to N modalities, we also need a high-quality dataset with alignment data pairs centered on language. We thus propose VIDAL-10M with Video, Infrared, Depth, Audio and their corresponding Language, naming as VIDAL-10M. In our VIDAL-10M, all videos are from short video platforms with complete semantics rather than truncated segments from long videos, and all the video, depth, infrared, and audio modalities are aligned to their textual descriptions. LanguageBind has achieved superior performance on a wide range of 15 benchmarks covering video, audio, depth, and infrared. Moreover, multiple experiments have provided evidence for the effectiveness of LanguageBind in achieving indirect alignment and complementarity among diverse modalities. Code address: https://github.com/PKU-YuanGroup/LanguageBind


title: Score-based Data Assimilation for a Two-Layer Quasi-Geostrophic Model

abstract: Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical systems, often exceeding millions of dimensions. This work assesses the scalability of score-based data assimilation (SDA), a novel data assimilation method, in the context of such systems. We propose modifications to the score network architecture aimed at significantly reducing memory consumption and execution time. We demonstrate promising results for a two-layer quasi-geostrophic model.


title: Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations?

abstract: To decipher the algorithm underlying the human brain's language representation, previous work probed brain responses to language input with pre-trained artificial neural network (ANN) models fine-tuned on NLU tasks. However, full fine-tuning generally updates the entire parametric space and distorts pre-trained features, cognitively inconsistent with the brain's robust multi-task learning ability. Prompt-tuning, in contrast, protects pre-trained weights and learns task-specific embeddings to fit a task. Could prompt-tuning generate representations that better account for the brain's language representations than fine-tuning? If so, what kind of NLU task leads a pre-trained model to better decode the information represented in the human brain? We investigate these questions by comparing prompt-tuned and fine-tuned representations in neural decoding, that is predicting the linguistic stimulus from the brain activities evoked by the stimulus. We find that on none of the 10 NLU tasks, full fine-tuning significantly outperforms prompt-tuning in neural decoding, implicating that a more brain-consistent tuning method yields representations that better correlate with brain data. Moreover, we identify that tasks dealing with fine-grained concept meaning yield representations that better decode brain activation patterns than other tasks, especially the syntactic chunking task. This indicates that our brain encodes more fine-grained concept information than shallow syntactic information when representing languages.


title: Multipartite Entanglement in Bright Frequency Combs from Microresonators

abstract: We present a theoretical model of multimode quantum correlations in bright frequency combs generated in continuous-wave regime by microresonators above threshold. Our analysis shows how these correlations emerge from cascading four-wave mixing processes fed by the input pump as well as the generated bright beams. Logarithmic negativity criterion is employed to quantify entanglement between partitions of modes, demonstrating the transition from a bipartite regime just above the oscillation threshold to the multipartite one at higher input pump powers. Due to its generality, our model can be safely used to describe other kinds of non-linear $\chi$ (3) cavities.


title: Nonlocal Contributions to the Turbulent Cascade in Magnetohydrodynamic Turbulence

abstract: We present evidence for nonlocal contributions to the turbulent energy cascade in magnetohydrodynamic (MHD) plasmas. Therefore, we revisit a well-known result derived directly from the MHD equations, i.e., the Politano and Pouquet (P&P) law for the transfer of kinetic and magnetic energy in scale. We propose adding a term that accounts for nonlocal transfer and represents the influence of fluctuations from large scales due to the Alfv\'en effect. Supported by direct numerical simulations of homogeneous and isotropic MHD turbulence, we verify that in some plasma configurations, neglecting the additional nonlocal term might consistently overestimate energy dissipation rates and, thus, the contributions of turbulent energy dissipation potentially affecting solar wind heating; a central puzzle in space plasma physics that motivates the present work.


title: End-To-End Optimization of the Layout of a Gamma Ray Observatory

abstract: In this document we describe a model of an array of water Cherenkov detectors proposed to study ultra-high-energy gamma rays in the southern hemisphere, and a continuous model of secondary particles produced on the ground from gamma and proton showers. We use the model of the detector and the parametrization of showers for the identification of the most promising configuration of detector elements, using a likelihood ratio test statistic to classify showers and a stochastic gradient descent technique to maximize a utility function describing the measurement precision on the gamma-ray flux.


title: A method of generating bespoke optimised keyboard layouts that significantly reduce typing effort for Twitter users

abstract: This study addresses the problem of generating an optimised keyboard layout for single-finger typing on a smartphone. It offers Twitter users a tweet-typing experience that requires less effort and time. Bodies of tweet text for 85 popular Twitter users are used. While existing studies have produced optimisations that may generally benefit a variety of users, this study is unique in the sense that a bespoke optimised keyboard layout is generated for each Twitter user based on their own tweets, thereby uniquely benefiting them more than other users. The optimisation process is based on moving only six letter keys from their positions on the QWERTY keyboard, and therefore strikes an effective balance between the typing efficiency improvements offered by an optimised keyboard layout and the effort required to learn to use it. It is shown that a Twitter user will enjoy a reduction in typing effort of at least 13.4%. The typical user will benefit from a 15.8% reduction, while the highest typing effort reduction is nearly 25%. The method presented in this study could therefore be used in practical ways to offer any Twitter user a uniquely-improved tweeting experience.


title: Variational Gaussian approximation of the Kushner optimal filter

abstract: In estimation theory, the Kushner equation provides the evolution of the probability density of the state of a dynamical system given continuous-time observations. Building upon our recent work, we propose a new way to approximate the solution of the Kushner equation through tractable variational Gaussian approximations of two proximal losses associated with the propagation and Bayesian update of the probability density. The first is a proximal loss based on the Wasserstein metric and the second is a proximal loss based on the Fisher metric. The solution to this last proximal loss is given by implicit updates on the mean and covariance that we proposed earlier. These two variational updates can be fused and shown to satisfy a set of stochastic differential equations on the Gaussian's mean and covariance matrix. This Gaussian flow is consistent with the Kalman-Bucy and Riccati flows in the linear case and generalize them in the nonlinear one.


title: High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise

abstract: High-probability analysis of stochastic first-order optimization methods under mild assumptions on the noise has been gaining a lot of attention in recent years. Typically, gradient clipping is one of the key algorithmic ingredients to derive good high-probability guarantees when the noise is heavy-tailed. However, if implemented na\"ively, clipping can spoil the convergence of the popular methods for composite and distributed optimization (Prox-SGD/Parallel SGD) even in the absence of any noise. Due to this reason, many works on high-probability analysis consider only unconstrained non-distributed problems, and the existing results for composite/distributed problems do not include some important special cases (like strongly convex problems) and are not optimal. To address this issue, we propose new stochastic methods for composite and distributed optimization based on the clipping of stochastic gradient differences and prove tight high-probability convergence results (including nearly optimal ones) for the new methods. Using similar ideas, we also develop new methods for composite and distributed variational inequalities and analyze the high-probability convergence of these methods.


title: Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos

abstract: Breast lesion segmentation in ultrasound (US) videos is essential for diagnosing and treating axillary lymph node metastasis. However, the lack of a well-established and large-scale ultrasound video dataset with high-quality annotations has posed a persistent challenge for the research community. To overcome this issue, we meticulously curated a US video breast lesion segmentation dataset comprising 572 videos and 34,300 annotated frames, covering a wide range of realistic clinical scenarios. Furthermore, we propose a novel frequency and localization feature aggregation network (FLA-Net) that learns temporal features from the frequency domain and predicts additional lesion location positions to assist with breast lesion segmentation. We also devise a localization-based contrastive loss to reduce the lesion location distance between neighboring video frames within the same video and enlarge the location distances between frames from different ultrasound videos. Our experiments on our annotated dataset and two public video polyp segmentation datasets demonstrate that our proposed FLA-Net achieves state-of-the-art performance in breast lesion segmentation in US videos and video polyp segmentation while significantly reducing time and space complexity. Our model and dataset are available at https://github.com/jhl-Det/FLA-Net.


title: Emergent dipole moment conservation and subdiffusion in tilted chains

abstract: We study the transport dynamics of an interacting tilted (Stark) chain. We show that the crossover between diffusive and subdiffusive dynamics is governed by $F\sqrt{L}$, where $F$ is the strength of the field, and $L$ is the wave-length of the excitation. While the subdiffusive dynamics persist for large fields, the corresponding transport coefficient is exponentially suppressed with $F$ so that the finite-time dynamics appear almost frozen. We explain the crossover scale between the diffusive and subdiffusive transport by bounding the dynamics of the dipole moment for arbitrary initial state. We also prove its emergent conservation at infinite temperature. Consequently, the studied chain is one of the simplest experimentally realizable models for which numerical data are consistent with the hydrodynamics of fractons.


title: A unifying representation of path integrals for fractional Brownian motions

abstract: Fractional Brownian motion (fBm) is an experimentally-relevant, non-Markovian Gaussian stochastic process with long-ranged correlations between the increments, parametrised by the so-called Hurst exponent $H$; depending on its value the process can be sub-diffusive $(0 < H < 1/2)$, diffusive $(H = 1/2)$ or super-diffusive $(1/2 < H < 1)$. There exist three alternative equally often used definitions of fBm -- due to L\'evy and due to Mandelbrot and van Ness (MvN), which differ by the interval on which the time variable is formally defined. Respectively, the covariance functions of these fBms have different functional forms. Moreover, the MvN fBms have stationary increments, while for the L\'evy fBm this is not the case. One may therefore be tempted to conclude that these are, in fact, different processes which only accidentally bear the same name. Recently determined explicit path integral representations also appear to have very different functional forms, which only reinforces the latter conclusion. Here we develope a unifying equivalent path integral representation of all three fBms in terms of Riemann-Liouville fractional integrals, which links the fBms and proves that they indeed belong to the same family. We show that the action in such a representation involves the fractional integral of the same form and order (dependent on whether $H < 1/2$ or $H > 1/2$) for all three cases, and differs only by the integration limits.


title: On rigidity of Pham-Brieskorn surfaces

abstract: It is well known that, over an algebraically closed field $k$ of characteristic zero, for any three integers $a,b,c\geq 2$, any Pham-Brieskorn surface $B_{(a,b,c)}:= k[X,Y,Z]/(X^a + Y^b + Z^c)$ is rigid when at most one of $a,b,c$ is 2 and stably rigid when $\frac{1}{a} + \frac{1}{b} + \frac{1}{c}\leq 1$. In this paper we consider Pham-Brieskorn domains over an arbitrary field $k$ of characteristic $p\geq 0$ and give sufficient conditions on $(a,b,c)$ for which any Pham-Brieskorn domain $B_{(a,b,c)}$ is rigid. This gives an alternative approach to showing that there does not exist any non-trivial exponential map on $k[X,Y,Z,T]/(X^mY+T^{p^rq} + Z^{p^e})= k[x,y,z,t]$, for $m,q>1$, $p\nmid mq$ and $e>r\geq 1$, fixing $y$, a crucial result used in the paper "On the cancellation problem for the affine space $\mathbb{A}^3$ in characteristic $p$" by first author, to show that the Zariski Cancellation Problem (ZCP) does not hold for the affine $3$-space. We also provide a sufficient condition for $B_{(a,b,c)}$ to be stably rigid. Along the way we prove that for integers $a,b,c\geq 2$ with $gcd(a,b,c) = 1$ and for $F(Y)\in k[Y]$, the ring $k[X,Y,Z]/(X^aY^b + Z^c+ F(Y))$ is a rigid domain.


title: Conditional Instrumental Variable Regression with Representation Learning for Causal Inference

abstract: This paper studies the challenging problem of estimating causal effects from observational data, in the presence of unobserved confounders. The two-stage least square (TSLS) method and its variants with a standard instrumental variable (IV) are commonly used to eliminate confounding bias, including the bias caused by unobserved confounders, but they rely on the linearity assumption. Besides, the strict condition of unconfounded instruments posed on a standard IV is too strong to be practical. To address these challenging and practical problems of the standard IV method (linearity assumption and the strict condition), in this paper, we use a conditional IV (CIV) to relax the unconfounded instrument condition of standard IV and propose a non-linear CIV regression with Confounding Balancing Representation Learning, CBRL.CIV, for jointly eliminating the confounding bias from unobserved confounders and balancing the observed confounders, without the linearity assumption. We theoretically demonstrate the soundness of CBRL.CIV. Extensive experiments on synthetic and two real-world datasets show the competitive performance of CBRL.CIV against state-of-the-art IV-based estimators and superiority in dealing with the non-linear situation.


title: Route Design in Sheepdog System--Traveling Salesman Problem Formulation and Evolutionary Computation Solution--

abstract: In this study, we consider the guidance control problem of the sheepdog system, which involves the guidance of the flock using the characteristics of the sheepdog and sheep. Sheepdog systems require a strategy to guide sheep agents to a target value using a small number of sheepdog agents, and various methods have been proposed. Previous studies have proposed a guidance control law to guide a herd of sheep reliably, but the movement distance of a sheepdog required for guidance has not been considered. Therefore, in this study, we propose a novel guidance algorithm in which a supposedly efficient route for guiding a flock of sheep is designed via Traveling Salesman Problem and evolutionary computation. Numerical simulations were performed to confirm whether sheep flocks could be guided and controlled using the obtained guidance routes. We specifically revealed that the proposed method reduces both the guidance failure rate and the guidance distance.


title: Audio-visual child-adult speaker classification in dyadic interactions

abstract: Interactions involving children span a wide range of important domains from learning to clinical diagnostic and therapeutic contexts. Automated analyses of such interactions are motivated by the need to seek accurate insights and offer scale and robustness across diverse and wide-ranging conditions. Identifying the speech segments belonging to the child is a critical step in such modeling. Conventional child-adult speaker classification typically relies on audio modeling approaches, overlooking visual signals that convey speech articulation information, such as lip motion. Building on the foundation of an audio-only child-adult speaker classification pipeline, we propose incorporating visual cues through active speaker detection and visual processing models. Our framework involves video pre-processing, utterance-level child-adult speaker detection, and late fusion of modality-specific predictions. We demonstrate from extensive experiments that a visually aided classification pipeline enhances the accuracy and robustness of the classification. We show relative improvements of 2.38% and 3.97% in F1 macro score when one face and two faces are visible, respectively.


title: Some geometric applications of the discrete heat flow

abstract: We present two geometric applications of heat flow methods on the discrete hypercube $\{-1,1\}^n$. First, we prove that if $X$ is a finite-dimensional normed space, then the bi-Lipschitz distortion required to embed $\{-1,1\}^n$ equipped with the Hamming metric into $X$ satisfies $$\mathsf{c}_X\big(\{-1,1\}^n\big) \gtrsim \sup_{p\in[1,2]} \frac{n}{\mathsf{T}_p(X) \min\{n,\mathrm{dim}(X)\}^{1/p}},$$ where $\mathsf{T}_p(X)$ is the Rademacher type $p$ constant of $X$. This estimate yields a mutual refinement of distortion lower bounds which follow from works of Oleszkiewicz (1996) and Ivanisvili, van Handel and Volberg (2020) for low-dimensional spaces $X$. The proof relies on an extension of an important inequality of Pisier (1986) on the biased hypercube combined with an application of the Borsuk-Ulam theorem from algebraic topology. Secondly, we introduce a new metric invariant called metric stable type as a functional inequality on the discrete hypercube and prove that it coincides with the classical linear notion of stable type for normed spaces. We also show that metric stable type yields bi-Lipschitz nonembeddability estimates for weighted hypercubes.


title: Actuarial Implications and Modeling of Yellow Virus on Sugar Beet After the EU's Ban on Neonicotinoids and Climate Change

abstract: Following the EU's decision to ban neonicotinoids, this article investigates the impacts of yellow virus on sugar beet yields under the ban and under current and future climates. Using a model that factors in key variables such as sowing dates, phenological stages, first aphid flight and aphid abundance, simulations are performed using long-period climate datasets as inputs. Coupled with incidence and sugar yield loss assumptions, this model allows to reconstruct the impact of yellow virus on sugar beet yields using a so called 'as if' approach. By simulating the effects of viruses over a longer period of time, as if neonicotinoids weren't used in the past, this methodology allows an accurate assessment of risks associated with yellow viruses, as well as impact of future agroecological mesures. The study eventually provides an actuarial rating for an insurance policy that compensates the losses triggered by those viruses.


title: DeepDecipher: Accessing and Investigating Neuron Activation in Large Language Models

abstract: As large language models (LLMs) become more capable, there is an urgent need for interpretable and transparent tools. Current methods are difficult to implement, and accessible tools to analyze model internals are lacking. To bridge this gap, we present DeepDecipher - an API and interface for probing neurons in transformer models' MLP layers. DeepDecipher makes the outputs of advanced interpretability techniques for LLMs readily available. The easy-to-use interface also makes inspecting these complex models more intuitive. This paper outlines DeepDecipher's design and capabilities. We demonstrate how to analyze neurons, compare models, and gain insights into model behavior. For example, we contrast DeepDecipher's functionality with similar tools like Neuroscope and OpenAI's Neuron Explainer. DeepDecipher enables efficient, scalable analysis of LLMs. By granting access to state-of-the-art interpretability methods, DeepDecipher makes LLMs more transparent, trustworthy, and safe. Researchers, engineers, and developers can quickly diagnose issues, audit systems, and advance the field.


title: Ab-Initio Vibro-Polaritonic Spectra in Strongly Coupled Cavity-Molecule Systems

abstract: Recent experiments have revealed the profound effect of strong light-matter interactions in optical cavities on the electronic ground state of molecular systems. This phenomenon, known as vibrational strong coupling (VSC), can modify reaction rates and induce the formation of molecular vibrational polaritons, hybrid states involving both photon modes and vibrational modes of molecules. We present an ab-initio methodology, based on the cavity Born-Oppenheimer Hartree-Fock ansatz, which is specifically powerful for ensembles of molecules, to calculate vibro-polaritonic IR spectra. This method allows a comprehensive analysis of these hybrid states. Our semi-classical approach, validated against full quantum simulations, reproduces key features of the vibro-polaritonic spectra. The underlying analytic gradients also pave the way for optimizing cavity-coupled molecular systems and performing semi-classical dynamics simulations


title: On the Recursive Behaviour of the Number of Irreducible Polynomials with Certain Properties over Finite Fields

abstract: Let $\mathbb{F}_q$ be the field with $q$ elements and of characteristic $p$. For $a\in\mathbb{F}_p$ consider the set \begin{equation*} S_a(n)=\{f\in\mathbb{F}_q[x]\mid\operatorname{deg}(f)=n,~f\text{ irreducible, monic and} \operatorname{Tr}(f)=a\}. \end{equation*} In a recent paper, Robert Granger proved for $q=2$ and $n\ge 2$ that $|S_1(n)|-|S_0(n)|= 0$ if $2\nmid n$ and $|S_1(n)|-|S_0(n)|=|S_1(n/2)|$ if $2\mid n$. We will prove a generalization of this result for all finite fields. This is possible due to an observation about the size of certain subsets of monic irreducible polynomials arising in the context of a group action of subgroups of $\operatorname{PGL}_2(\mathbb{F}_q)$ on monic polynomials. Additionally, it enables us to apply these methods to prove two further results that are very similar in nature.


title: Size effects on dislocation starvation in Cu nanopillars : A molecular dynamics simulations study

abstract: Size plays an important role on the deformation mechanism of nanopillars. With decreasing size, many FCC nanopillars exhibit dislocation starvation state which is responsible for their high strength. However, many details about the dislocation starvation mechanism like how often it occurs, and how much is its contribution to the total plastic strain, are still elusive. Similarly, the size below which the dislocation starvation occurs in the nanopillars is not clearly established. In this context, the atomistic simulations have been performed on the compressive deformation of $<$110$>$ Cu nanopillars with size (d) ranging from 5 to 21.5 nm. The molecular dynamics (MD) simulation results indicate that the nanopillars deform by the slip of extended dislocations and exhibit dislocation starvation mainly at small sizes ( $<$ 20 nm). The frequency of the occurrence of dislocation starvation is highest in small size nanowires and it decreases with increasing size. Above the nanopillar size of 20 nm, no dislocation starvation has been observed. Further, we define the dislocation starvation strain and based on this, it has been shown that, the contribution of dislocation starvation state to the total plastic strain decreases from 70\% in small size nanopillars to below 5\% in large size pillars. The present results suggest that the dislocation starvation is a dominant phenomena in small size nanopillars.


title: Relativistic magnetohydrodynamics of a spinful and vortical fluid: Entropy current analysis

abstract: We generalize a recently introduced formulation of relativistic spinful and vortical fluid to relativistic magnetohydrodynamics (MHD). We refer to it as the "Spinful-Vortical MHD" (SVMHD). The aim is to scrutinize the interplay between the vorticity, magnetic field, and spin, which is treated as a quantum object, in contrast to other formulations of spin hydrodynamics. To this purpose, we first perform a standard entropy current analysis up to first-order gradient expansion, $\mathcal{O}\left(\partial\right)$ as well as $\mathcal{O}\left(\hbar\partial\right)$, where $\hbar$ is the Planck constant. In contrast to alternative formulations of spin MHD, in the absence of vorticity, the zeroth-order energy-momentum tensor includes an additional magneto-vorticity mixed term and reduces, as expected, to the energy-momentum tensor of MHD. We show that in the first-order of gradient expansion, $36$ dissipative transport coefficients appear. They satisfy certain constraints that guarantee the positive definiteness of the entropy production rate. We then modify the formulation of SVMHD by replacing the magnetic part of the thermal vorticity tensor with its electric part. Carrying out the same analysis as in the standard formulation, we show that in this case, the first-order constitutive relations consist of $11$ nondissipative Hall-like coefficients, apart from $25$ dissipative coefficients. This difference arises from different behavior of the electric and magnetic part of the thermal vorticity under time-reversal transformation.


title: Towards Stable Backdoor Purification through Feature Shift Tuning

abstract: It has been widely observed that deep neural networks (DNN) are vulnerable to backdoor attacks where attackers could manipulate the model behavior maliciously by tampering with a small set of training samples. Although a line of defense methods is proposed to mitigate this threat, they either require complicated modifications to the training process or heavily rely on the specific model architecture, which makes them hard to deploy into real-world applications. Therefore, in this paper, we instead start with fine-tuning, one of the most common and easy-to-deploy backdoor defenses, through comprehensive evaluations against diverse attack scenarios. Observations made through initial experiments show that in contrast to the promising defensive results on high poisoning rates, vanilla tuning methods completely fail at low poisoning rate scenarios. Our analysis shows that with the low poisoning rate, the entanglement between backdoor and clean features undermines the effect of tuning-based defenses. Therefore, it is necessary to disentangle the backdoor and clean features in order to improve backdoor purification. To address this, we introduce Feature Shift Tuning (FST), a method for tuning-based backdoor purification. Specifically, FST encourages feature shifts by actively deviating the classifier weights from the originally compromised weights. Extensive experiments demonstrate that our FST provides consistently stable performance under different attack settings. Without complex parameter adjustments, FST also achieves much lower tuning costs, only 10 epochs. Our codes are available at https://github.com/AISafety-HKUST/stable_backdoor_purification.


title: A Dual Attentive Generative Adversarial Network for Remote Sensing Image Change Detection

abstract: Remote sensing change detection between bi-temporal images receives growing concentration from researchers. However, comparing two bi-temporal images for detecting changes is challenging, as they demonstrate different appearances. In this paper, we propose a dual attentive generative adversarial network for achieving very high-resolution remote sensing image change detection tasks, which regards the detection model as a generator and attains the optimal weights of the detection model without increasing the parameters of the detection model through generative-adversarial strategy, boosting the spatial contiguity of predictions. Moreover, We design a multi-level feature extractor for effectively fusing multi-level features, which adopts the pre-trained model to extract multi-level features from bi-temporal images and introduces aggregate connections to fuse them. To strengthen the identification of multi-scale objects, we propose a multi-scale adaptive fusion module to adaptively fuse multi-scale features through various receptive fields and design a context refinement module to explore contextual dependencies. Moreover, the DAGAN framework utilizes the 4-layer convolution network as a discriminator to identify whether the synthetic image is fake or real. Extensive experiments represent that the DAGAN framework has better performance with 85.01% mean IoU and 91.48% mean F1 score than advanced methods on the LEVIR dataset.


title: Gravity with torsion as deformed $BF$ theory

abstract: We study a family of (possibly non topological) deformations of $BF$ theory for the Lie algebra obtained by quadratic extension of $\mathfrak{so}(3,1)$ by an orthogonal module. The resulting theory, called quadratically extended General Relativity (qeGR), is shown to be classically equivalent to certain models of gravity with dynamical torsion. The classical equivalence is shown to promote to a stronger notion of equivalence within the Batalin--Vilkovisky formalism. In particular, both Palatini--Cartan gravity and a deformation thereof by a dynamical torsion term, called (quadratic) generalised Holst theory, are recovered from the standard Batalin--Vilkovisky formulation of qeGR by elimination of generalised auxiliary fields.


title: Enhancing Workflow Security in Multi-Cloud Environments through Monitoring and Adaptation upon Cloud Service and Network Security Violations

abstract: Cloud computing has emerged as a crucial solution for handling data- and compute-intensive workflows, offering scalability to address dynamic demands. However, ensuring the secure execution of workflows in the untrusted multi-cloud environment poses significant challenges, given the sensitive nature of the involved data and tasks. The lack of comprehensive approaches for detecting attacks during workflow execution, coupled with inadequate measures for reacting to security and privacy breaches has been identified in the literature. To close this gap, in this work, we propose an approach that focuses on monitoring cloud services and networks to detect security violations during workflow executions. Upon detection, our approach selects the optimal adaptation action to minimize the impact on the workflow. To mitigate the uncertain cost associated with such adaptations and their potential impact on other tasks in the workflow, we employ adaptive learning to determine the most suitable adaptation action. Our approach is evaluated based on the performance of the detection procedure and the impact of the selected adaptations on the workflows.


title: IGA Using Offset-based Overlapping Domain Parameterizations

abstract: Isogeometric analysis (IGA) is a numerical method that connects computer-aided design (CAD) with finite element analysis (FEA). In CAD the computational domain is usually represented by B-spline or NURBS patches. Given a NURBS parameterization of the domain, an isogeometric discretization is defined on the domain using the same NURBS basis as for the domain parameterization. Ideally, such an isogeometric discretization allows an exact representation of the underlying CAD model. CAD models usually represent only the boundary of the object, thus, for planar domains, it is given as a collection of curves. Finding a suitable parameterization of the interior is one of the major issues in IGA, similar to the mesh generation process in FEA. The objective of this parameterization problem is to obtain a set of patches, which exactly represent the boundary of the domain and which are parameterized regularly and without self-intersections. This can be achieved by segmenting the domain into patches which are matching along interfaces, or by covering the domain with overlapping patches. In this paper we follow the second approach. To construct from a given boundary a planar parameterization suitable for IGA, we propose an offset-based domain parameterization algorithm. Given a boundary curve, we obtain an inner curve by generalized offsetting. Those two curves define a ring-shaped patch, which has a hole that can be covered by a multi-cell domain. Consequently, the domain is represented as a union of two overlapping subdomains which are both regularly parameterized. On such a configuration, one can employ the overlapping multi-patch method introduced in (Kargaran, J\"uttler, Kleiss, Mantzaflaris, Takacs; CMAME, 2019), to solve PDEs on the given domain. The performance of the proposed method is reported in several numerical examples, considering different shapes of the domain.


title: AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrieval

abstract: Machine-based prediction of real-world events is garnering attention due to its potential for informed decision-making. Whereas traditional forecasting predominantly hinges on structured data like time-series, recent breakthroughs in language models enable predictions using unstructured text. In particular, (Zou et al., 2022) unveils AutoCast, a new benchmark that employs news articles for answering forecasting queries. Nevertheless, existing methods still trail behind human performance. The cornerstone of accurate forecasting, we argue, lies in identifying a concise, yet rich subset of news snippets from a vast corpus. With this motivation, we introduce AutoCast++, a zero-shot ranking-based context retrieval system, tailored to sift through expansive news document collections for event forecasting. Our approach first re-ranks articles based on zero-shot question-passage relevance, honing in on semantically pertinent news. Following this, the chosen articles are subjected to zero-shot summarization to attain succinct context. Leveraging a pre-trained language model, we conduct both the relevance evaluation and article summarization without needing domain-specific training. Notably, recent articles can sometimes be at odds with preceding ones due to new facts or unanticipated incidents, leading to fluctuating temporal dynamics. To tackle this, our re-ranking mechanism gives preference to more recent articles, and we further regularize the multi-passage representation learning to align with human forecaster responses made on different dates. Empirical results underscore marked improvements across multiple metrics, improving the performance for multiple-choice questions (MCQ) by 48% and true/false (TF) questions by up to 8%. Code is available at https://github.com/BorealisAI/Autocast-plus-plus.


title: Adaptive Multi-NeRF: Exploit Efficient Parallelism in Adaptive Multiple Scale Neural Radiance Field Rendering

abstract: Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training and rendering process hinders the widespread adoption of this promising technique for real-time rendering applications. To address this issue, we present an effective adaptive multi-NeRF method designed to accelerate the neural rendering process for large scenes with unbalanced workloads due to varying scene complexities. Our method adaptively subdivides scenes into axis-aligned bounding boxes using a tree hierarchy approach, assigning smaller NeRFs to different-sized subspaces based on the complexity of each scene portion. This ensures the underlying neural representation is specific to a particular part of the scene. We optimize scene subdivision by employing a guidance density grid, which balances representation capability for each Multilayer Perceptron (MLP). Consequently, samples generated by each ray can be sorted and collected for parallel inference, achieving a balanced workload suitable for small MLPs with consistent dimensions for regular and GPU-friendly computations. We aosl demonstrated an efficient NeRF sampling strategy that intrinsically adapts to increase parallelism, utilization, and reduce kernel calls, thereby achieving much higher GPU utilization and accelerating the rendering process.


title: Fortran performance optimisation and auto-parallelisation by leveraging MLIR-based domain specific abstractions in Flang

abstract: MLIR has become popular since it was open sourced in 2019. A sub-project of LLVM, the flexibility provided by MLIR to represent Intermediate Representations (IR) as dialects at different abstraction levels, to mix these, and to leverage transformations between dialects provides opportunities for automated program optimisation and parallelisation. In addition to general purpose compilers built upon MLIR, domain specific abstractions have also been developed. In this paper we explore complimenting the Flang MLIR general purpose compiler by combining with the domain specific Open Earth Compiler's MLIR stencil dialect. Developing transformations to discover and extracts stencils from Fortran, this specialisation delivers between a 2 and 10 times performance improvement for our benchmarks on a Cray supercomputer compared to using Flang alone. Furthermore, by leveraging existing MLIR transformations we develop an auto-parallelisation approach targeting multi-threaded and distributed memory parallelism, and optimised execution on GPUs, without any modifications to the serial Fortran source code.


title: Reduction and efficient solution of MILP models of mixed Hamming packings yielding improved upper bounds

abstract: Mixed Hamming packings are considered: the maximal cardinality given a minimum codeword Hamming distance of mixed codes is addressed via mixed integer programming models. Adopting the concept of contact graph from classical continuous sphere packing problems, a reduction technique for the models is introduced, which enables their efficient solution. Several best known upper bounds are improved and some of them are found to be sharp.


title: Enhanced LFTSformer: A Novel Long-Term Financial Time Series Prediction Model Using Advanced Feature Engineering and the DS Encoder Informer Architecture

abstract: This study presents a groundbreaking model for forecasting long-term financial time series, termed the Enhanced LFTSformer. The model distinguishes itself through several significant innovations: (1) VMD-MIC+FE Feature Engineering: The incorporation of sophisticated feature engineering techniques, specifically through the integration of Variational Mode Decomposition (VMD), Maximal Information Coefficient (MIC), and feature engineering (FE) methods, enables comprehensive perception and extraction of deep-level features from complex and variable financial datasets. (2) DS Encoder Informer: The architecture of the original Informer has been modified by adopting a Stacked Informer structure in the encoder, and an innovative introduction of a multi-head decentralized sparse attention mechanism, referred to as the Distributed Informer. This modification has led to a reduction in the number of attention blocks, thereby enhancing both the training accuracy and speed. (3) GC Enhanced Adam \& Dynamic Loss Function: The deployment of a Gradient Clipping-enhanced Adam optimization algorithm and a dynamic loss function represents a pioneering approach within the domain of financial time series prediction. This novel methodology optimizes model performance and adapts more dynamically to evolving data patterns. Systematic experimentation on a range of benchmark stock market datasets demonstrates that the Enhanced LFTSformer outperforms traditional machine learning models and other Informer-based architectures in terms of prediction accuracy, adaptability, and generality. Furthermore, the paper identifies potential avenues for future enhancements, with a particular focus on the identification and quantification of pivotal impacting events and news. This is aimed at further refining the predictive efficacy of the model.


title: Synthetic CT Generation via Variant Invertible Network for All-digital Brain PET Attenuation Correction

abstract: Attenuation correction (AC) is essential for the generation of artifact-free and quantitatively accurate positron emission tomography (PET) images. However, AC of PET faces challenges including inter-scan motion and erroneous transformation of structural voxel-intensities to PET attenuation-correction factors. Nowadays, the problem of AC for quantitative PET have been solved to a large extent after the commercial availability of devices combining PET with computed tomography (CT). Meanwhile, considering the feasibility of a deep learning approach for PET AC without anatomical imaging, this paper develops a PET AC method, which uses deep learning to generate continuously valued CT images from non-attenuation corrected PET images for AC on brain PET imaging. Specifically, an invertible network combined with the variable augmentation strategy that can achieve the bidirectional inference processes is proposed for synthetic CT generation (IVNAC). To evaluate the performance of the proposed algorithm, we conducted a comprehensive study on a total of 1440 data from 37 clinical patients using comparative algorithms (such as Cycle-GAN and Pix2pix). Perceptual analysis and quantitative evaluations illustrate that the invertible network for PET AC outperforms other existing AC models, which demonstrates the potential of the proposed method and the feasibility of achieving brain PET AC without CT.


title: BYOM: Building Your Own Multi-Task Model For Free

abstract: Recently, various merging methods have been proposed to build a multi-task model from task-specific finetuned models without retraining. However, existing methods suffer from a large performance deterioration compared to using multiple task-specific models. In this paper, we propose to inject task-specific knowledge into the merged model and design two parameter-efficient approaches (BYOM-FFT and BYOM-LoRA) to Build Your Own Multi-task model. BYOM-FFT is for merging fully finetuned models, while BYOM-LoRA is for LoRA-finetuned models. Both methods are data-free and computation-efficient. Extensive experiments on computer vision and natural language processing tasks show that the proposed BYOM methods outperform existing merging methods by a large margin. Moreover, BYOM-FFT is general and can be integrated into existing merging methods to further boost performance.


title: Magneto- and barocaloric properties of the ferro-antiferromagnetic sawtooth chain

abstract: Materials that are susceptible to pressure and external magnetic fields allow the combined use of both for caloric processes. Here we report investigations of the ferromagnetic-antiferromagnetic sawtooth chain that due to its critical behavior not only allows for both barocaloric as well as magnetocaloric processes but also features very large cooling rates in the vicinity of the quantum critical point.


title: Deterioration modeling of sewer pipes via discrete-time Markov chains: A large-scale case study in the Netherlands

abstract: Sewer pipe network systems are an important part of civil infrastructure, and in order to find a good trade-off between maintenance costs and system performance, reliable sewer pipe degradation models are essential. In this paper, we present a large-scale case study in the city of Breda in the Netherlands. Our dataset has information on sewer pipes built since the 1920s and contains information on different covariates. We also have several types of damage, but we focus our attention on infiltrations, surface damage, and cracks. Each damage has an associated severity index ranging from 1 to 5. To account for the characteristics of sewer pipes, we defined 6 cohorts of interest. Two types of discrete-time Markov chains (DTMC), which we called Chain `Multi' and `Single' (where Chain `Multi' contains additional transitions compared to Chain `Single'), are commonly used to model sewer pipe degradation at the pipeline level, and we want to evaluate which suits better our case study. To calibrate the DTMCs, we define an optimization process using Sequential Least-Squares Programming to find the DTMC parameter that best minimizes the root mean weighted square error. Our results show that for our case study, there is no substantial difference between Chain `Multi' and `Single', but the latter has fewer parameters and can be easily trained. Our DTMCs are useful to compare the cohorts via the expected values, e.g., concrete pipes carrying mixed and waste content reach severe levels of surface damage more quickly compared to concrete pipes carrying rainwater, which is a phenomenon typically identified in practice.


title: Ring Attention with Blockwise Transformers for Near-Infinite Context

abstract: Transformers have emerged as the architecture of choice for many state-of-the-art AI models, showcasing exceptional performance across a wide range of AI applications. However, the memory demands imposed by Transformers limit their ability to handle long sequences, thereby posing challenges in utilizing videos, actions, and other long-form sequences and modalities in complex environments. We present a novel approach, Ring Attention with Blockwise Transformers (Ring Attention), which leverages blockwise computation of self-attention and feedforward to distribute long sequences across multiple devices while fully overlapping the communication of key-value blocks with the computation of blockwise attention. Our approach enables training and inference of sequences that are up to device count times longer than those achievable by prior memory-efficient Transformers, without resorting to approximations or incurring additional communication and computation overheads. Extensive experiments on language modeling and reinforcement learning tasks demonstrate the effectiveness of our approach in allowing millions of tokens context size and improving performance.


title: Holographic Dual of Quantum Spin Chain as Chern-Simons-Scalar Theory

abstract: We construct a holographic dual theory of one-dimensional anisotropic Heisenberg spin chain, which includes two Chern-Simons gauge fields and a charged scalar field. Thermodynamic quantities of the spin chain at low temperatures, which are exactly calculated from the integrability, are completely reproduced by the dual theory on three-dimensional black hole backgrounds and the exact matching of the parameters between the dual theory and the spin chain is obtained. The holographic dual theory provides a new theoretical framework to analyze the quantum spin chain and one-dimensional quantum many-body systems.


title: Microscopic Analysis of Lattice Distortion Effects in Rashba Systems

abstract: We theoretically study the effects of dynamical lattice distortion in a three-dimensional Rashba system based on a tight-binding model. Considering an $sp$-electron system on a tetragonal lattice with broken inversion symmetry, lattice distortions are incorporated through hopping-integral and crystal-axis modulations. The effective Hamiltonian for the $p_z$- or $s$-derived band is found to have Rashba modulation terms, which induce various types of spin currents, such as Rashba, quadrupolar, perpendicular, and helicity currents. The results are compared with those obtained by the method of local coordinate transformation.


title: FiGURe: Simple and Efficient Unsupervised Node Representations with Filter Augmentations

abstract: Unsupervised node representations learnt using contrastive learning-based methods have shown good performance on downstream tasks. However, these methods rely on augmentations that mimic low-pass filters, limiting their performance on tasks requiring different eigen-spectrum parts. This paper presents a simple filter-based augmentation method to capture different parts of the eigen-spectrum. We show significant improvements using these augmentations. Further, we show that sharing the same weights across these different filter augmentations is possible, reducing the computational load. In addition, previous works have shown that good performance on downstream tasks requires high dimensional representations. Working with high dimensions increases the computations, especially when multiple augmentations are involved. We mitigate this problem and recover good performance through lower dimensional embeddings using simple random Fourier feature projections. Our method, FiGURe achieves an average gain of up to 4.4%, compared to the state-of-the-art unsupervised models, across all datasets in consideration, both homophilic and heterophilic. Our code can be found at: https://github.com/microsoft/figure.


title: SimplePIM: A Software Framework for Productive and Efficient Processing-in-Memory

abstract: Data movement between memory and processors is a major bottleneck in modern computing systems. The processing-in-memory (PIM) paradigm aims to alleviate this bottleneck by performing computation inside memory chips. Real PIM hardware (e.g., the UPMEM system) is now available and has demonstrated potential in many applications. However, programming such real PIM hardware remains a challenge for many programmers. This paper presents a new software framework, SimplePIM, to aid programming real PIM systems. The framework processes arrays of arbitrary elements on a PIM device by calling iterator functions from the host and provides primitives for communication among PIM cores and between PIM and the host system. We implement SimplePIM for the UPMEM PIM system and evaluate it on six major applications. Our results show that SimplePIM enables 66.5% to 83.1% reduction in lines of code in PIM programs. The resulting code leads to higher performance (between 10% and 37% speedup) than hand-optimized code in three applications and provides comparable performance in three others. SimplePIM is fully and freely available at https://github.com/CMU-SAFARI/SimplePIM.


title: Waveform Manipulation Against DNN-based Modulation Classification Attacks

abstract: In this paper we propose a method for defending against an eavesdropper that uses a Deep Neural Network (DNN) for learning the modulation of wireless communication signals. Our method is based on manipulating the emitted waveform with the aid of a continuous time frequency-modulated (FM) obfuscating signal that is mixed with the modulated data. The resulting waveform allows a legitimate receiver (LRx) to demodulate the data but it increases the test error of a pre-trained or adversarially-trained DNN classifier at the eavesdropper. The scheme works for analog modulation and digital single carrier and multi carrier orthogonal frequency division multiplexing (OFDM) waveforms, while it can implemented in frame-based wireless protocols. The results indicate that careful selection of the parameters of the obfuscating waveform can drop classification performance at the eavesdropper to less than 10% in AWGN and fading channels with no performance loss at the LRx.


title: Generalized open-loop Nash equilibria in linear-quadratic difference games with coupled-affine inequality constraints

abstract: In this note, we study a class of deterministic finite-horizon linear-quadratic difference games with coupled-affine inequality constraints involving both state and control variables. We show that the necessary conditions for the existence of generalized open-loop Nash equilibria in this game class lead to two strongly coupled discrete-time linear complementarity systems. Subsequently, we derive the sufficient conditions by establishing an equivalence between the solutions of these systems and the convexity of players' objective functions. These existence conditions are then reformulated as a solution to a linear complementarity problem, providing a numerical method for computing these equilibria. We illustrate our results using a network flow game with constraints.


title: Computing the Mittag-Leffler Function of a Matrix Argument

abstract: It is well-known that the two-parameter Mittag-Leffler (ML) function plays a key role in Fractional Calculus. In this paper, we address the problem of computing this function, when its argument is a square matrix. Effective methods for solving this problem involve the computation of higher order derivatives or require the use of mixed precision arithmetic. In this paper, we provide an alternative method that is derivative-free and works entirely using IEEE standard double precision arithmetic. If certain conditions are satisfied, our method uses a Taylor series representation for the ML function; if not, it switches to a Schur-Parlett technique that will be combined with the Cauchy integral formula. A detailed discussion on the choice of a convenient contour is included. Theoretical and numerical issues regarding the performance of the proposed algorithm are discussed. A set of numerical experiments shows that our novel approach is competitive with the state-of-the-art method for IEEE double precision arithmetic, in terms of accuracy and CPU time. For matrices whose Schur decomposition has large blocks with clustered eigenvalues, our method far outperforms the other. Since our method does not require the efficient computation of higher order derivatives, it has the additional advantage of being easily extended to other matrix functions (e.g., special functions).


title: MFOS: Model-Free & One-Shot Object Pose Estimation

abstract: Existing learning-based methods for object pose estimation in RGB images are mostly model-specific or category based. They lack the capability to generalize to new object categories at test time, hence severely hindering their practicability and scalability. Notably, recent attempts have been made to solve this issue, but they still require accurate 3D data of the object surface at both train and test time. In this paper, we introduce a novel approach that can estimate in a single forward pass the pose of objects never seen during training, given minimum input. In contrast to existing state-of-the-art approaches, which rely on task-specific modules, our proposed model is entirely based on a transformer architecture, which can benefit from recently proposed 3D-geometry general pretraining. We conduct extensive experiments and report state-of-the-art one-shot performance on the challenging LINEMOD benchmark. Finally, extensive ablations allow us to determine good practices with this relatively new type of architecture in the field.


title: Spectro-spatial hyperspectral image reconstruction from interferometric acquisitions

abstract: In the last decade, novel hyperspectral cameras have been developed with particularly desirable characteristics of compactness and short acquisition time, retaining their potential to obtain spectral/spatial resolution competitive with respect to traditional cameras. However, a computational effort is required to recover an interpretable data cube. In this work we focus our attention on imaging spectrometers based on interferometry, for which the raw acquisition is an image whose spectral component is expressed as an interferogram. Previous works have focused on the inversion of such acquisition on a pixel-by-pixel basis within a Bayesian framework, leaving behind critical information on the spatial structure of the image data cube. In this work, we address this problem by integrating a spatial regularization for image reconstruction, showing that the combination of spectral and spatial regularizers leads to enhanced performances with respect to the pixelwise case. We compare our results with Plug-and-Play techniques, as its strategy to inject a set of denoisers from the literature can be implemented seamlessly with our physics-based formulation of the optimization problem.


title: Chemical Evolution in Galactic Nuclear Discs

abstract: Nuclear Stellar Discs have been observed in the vast majority of barred disc galaxies including the Milky Way. Their intense star formation is sustained by the intense gas inflows driven by their surrounding bars and frequently supports a large-scale galactic fountain. Despite their central role in galaxy evolution, their chemical evolution remains largely unexplored. Here we present the first systematic, multizonal modelling of the chemical evolution of these nuclear stellar discs. We argue that the chemical composition of nuclear stellar discs is best understood relative to the bar tips from which their gas is drawn. We make predictions of the detailed abundance profiles within the nuclear stellar disc under different accretion scenarios from the galactic bar and show by which observable differences they can be decided. We show that with their difference to normal disc star formation, nuclear discs offer a unique laboratory to break parameter degeneracies in chemical evolution models. This allows us to identify the effects of the main gas parameters and disentangle them from the global enrichment history. We show this for the example of the ejection fractions from the outer and nuclear disk.


title: A Collaborative System of Systems Simulation of Urban Air Mobility

abstract: The implementation of Urban Air Mobility represents a complex challenge in aviation due to the high degree of innovation required across various domains to realize it. From the use of advanced aircraft powered by novel technologies, the management of the air space to enable high density operations, to the operation of vertidromes serving as a start and end point of the flights, Urban Air Mobility paradigm necessitates significant innovation in many aspects of civil aviation as we know it today. In order to understand and assess the many facets of this new paradigm, a Collaborative Agent-Based Simulation is developed to holistically evaluate the System of Systems through the modeling of the stakeholders and their interactions as per the envisioned Concept of Operations. To this end, models of vertidrome air-side operations, unmanned/manned air space management, demand estimation and passenger mode choice, vehicle operator cost and revenues, vehicle design, and fleet management are brought together into a System of Systems Simulation of Urban Air Mobility. Through collaboration, higher fidelity models of each domain can be integrated into a single environment achieving fidelity levels not easily achievable otherwise. Furthermore, the integration enables the capture of cross-domain effects and allows domain-specific studies to be evaluated at a holistic level. This work demonstrates the Collaborative Simulation and the process of building it through the integration of several geographically distributed tools into an Agent-Based Simulation without the need for sharing code.


title: Pressure drop non-linearities in material extrusion additive manufacturing: a novel approach for pressure monitoring and numerical modeling

abstract: Fused Filament Fabrication is an additive manufacturing technique in which molten thermoplastic polymers are extruded through a nozzle. Therefore, the interplay between the viscoelastic nature of the polymer melt, temperature, printing conditions and nozzle shape may lead to inconsistent extrusion. To improve the extrusion control and optimize the print-head performance, a better understanding of the flow process of the polymer melt both in the nozzle and the liquefier is needed. However, several challenges need to be overcome due to the complexity of gathering experimental data on the melt pressure in the nozzle and the lack of numerical models able to capture the full rheology of the molten polymer. This research introduces an innovative approach for monitoring the pressure within a material extrusion 3D printer's nozzle. This method involves utilizing a pin in direct contact with the molten material, which then transmits the applied force from the material to an externally mounted load cell. The setup provides reliable, repeatable pressure data in steady-state conditions for two nozzle geometries and at different extrusion flows and temperatures. Moreover, the Giesekus model enabled capturing the viscoelastic rheometric features of the melt, and the numerical predictions have been compared with the experimental data. Results show that the numerical model accurately describes the flow conditions in the nozzle and allows the estimation of the behaviour of the melt in the liquefier zone, the area of the print-head where the filament is molten. It could be concluded that the backflow, which is the backward flow of the molten polymer in the gap between the filament and the liquefier towards the cold end, caused significant non-linearities in the total pressure drop measured in the feeders, which were related to normal forces induced by shear in that region.


title: On the cardinality and dimension of the slices of Okamoto's functions

abstract: The graphs of Okamoto's functions, denoted by $K_q$, are self-affine fractal curves contained in $[0,1]^2$, parameterised by $q \in (1,2)$. In this paper we consider the cardinality and dimension of the intersection of these curves with horizontal lines. Our first theorem proves that if $q$ is sufficiently close to $2$, then $K_q$ admits a horizontal slice with exactly three elements. Our second theorem proves that if a horizontal slice of $K_q$ contains an uncountable number of elements then it has positive Hausdorff dimension provided $q$ is in a certain subset of $(1,2)$. Finally, we prove that if $q$ is a $k$-Bonacci number for some $k \in \mathbb{N}_{\geq 3}$, then the set of $y \in [0,1]$ such that the horizontal slice at height $y$ has $(2m+1)$ elements has positive Hausdorff dimension for any $m \in \mathbb{N}$. We also show that, under the same assumption on $q$, there is some horizontal slice whose cardinality is countably infinite.