title: Diagnostics Using Nuclear Plant Cyber Attack Analysis Toolkit

abstract: A Python interface is developed for the GPWR Simulator to automatically simulate cyber-spoofing of different steam generator parameters and plant operation. Specifically, steam generator water level, feedwater flowrate, steam flowrate, valve position, and steam generator controller parameters, including controller gain and time constant, can be directly attacked using command inject, denial of service, and man-in-the-middle type attacks. Plant operation can be initialized to any of the initial conditions provided by the GPWR simulator. Several different diagnostics algorithms have been implemented for anomaly detection, including physics-based diagnostics with Kalman filtering, data-driven diagnostics, noise profiling, and online sensor validation. Industry-standard safety analysis code RELAP5 is also available as a part of the toolkit. Diagnostics algorithms are analyzed based on accuracy and efficiency. Our observations indicate that physics-based diagnostics with Kalman filtering are the most robust. An experimental quantum kernel has been added to the framework for preliminary testing. Our first impressions suggest that while quantum kernels can be accurate, just like any other kernels, their applicability is problem/data dependent, and can be prone to overfitting.


title: Unlocking Spatial Comprehension in Text-to-Image Diffusion Models

abstract: We propose CompFuser, an image generation pipeline that enhances spatial comprehension and attribute assignment in text-to-image generative models. Our pipeline enables the interpretation of instructions defining spatial relationships between objects in a scene, such as `An image of a gray cat on the left of an orange dog', and generate corresponding images. This is especially important in order to provide more control to the user. CompFuser overcomes the limitation of existing text-to-image diffusion models by decoding the generation of multiple objects into iterative steps: first generating a single object and then editing the image by placing additional objects in their designated positions. To create training data for spatial comprehension and attribute assignment we introduce a synthetic data generation process, that leverages a frozen large language model and a frozen layout-based diffusion model for object placement. We compare our approach to strong baselines and show that our model outperforms state-of-the-art image generation models in spatial comprehension and attribute assignment, despite being 3x to 5x smaller in parameters.


title: Active Open-Vocabulary Recognition: Let Intelligent Moving Mitigate CLIP Limitations

abstract: Active recognition, which allows intelligent agents to explore observations for better recognition performance, serves as a prerequisite for various embodied AI tasks, such as grasping, navigation and room arrangements. Given the evolving environment and the multitude of object classes, it is impractical to include all possible classes during the training stage. In this paper, we aim at advancing active open-vocabulary recognition, empowering embodied agents to actively perceive and classify arbitrary objects. However, directly adopting recent open-vocabulary classification models, like Contrastive Language Image Pretraining (CLIP), poses its unique challenges. Specifically, we observe that CLIP's performance is heavily affected by the viewpoint and occlusions, compromising its reliability in unconstrained embodied perception scenarios. Further, the sequential nature of observations in agent-environment interactions necessitates an effective method for integrating features that maintains discriminative strength for open-vocabulary classification. To address these issues, we introduce a novel agent for active open-vocabulary recognition. The proposed method leverages inter-frame and inter-concept similarities to navigate agent movements and to fuse features, without relying on class-specific knowledge. Compared to baseline CLIP model with 29.6% accuracy on ShapeNet dataset, the proposed agent could achieve 53.3% accuracy for open-vocabulary recognition, without any fine-tuning to the equipped CLIP model. Additional experiments conducted with the Habitat simulator further affirm the efficacy of our method.


title: Proofs of Equalities NP = coNP = PSPACE: Simplification

abstract: In this paper we present simplified proofs of our results NP = coNP = PSPACE.


title: Scene Summarization: Clustering Scene Videos into Spatially Diverse Frames

abstract: We propose scene summarization as a new video-based scene understanding task. It aims to summarize a long video walkthrough of a scene into a small set of frames that are spatially diverse in the scene, which has many impotant applications, such as in surveillance, real estate, and robotics. It stems from video summarization but focuses on long and continuous videos from moving cameras, instead of user-edited fragmented video clips that are more commonly studied in existing video summarization works. Our solution to this task is a two-stage self-supervised pipeline named SceneSum. Its first stage uses clustering to segment the video sequence. Our key idea is to combine visual place recognition (VPR) into this clustering process to promote spatial diversity. Its second stage needs to select a representative keyframe from each cluster as the summary while respecting resource constraints such as memory and disk space limits. Additionally, if the ground truth image trajectory is available, our method can be easily augmented with a supervised loss to enhance the clustering and keyframe selection. Extensive experiments on both real-world and simulated datasets show our method outperforms common video summarization baselines by 50%


title: Advancing Attack-Resilient Scheduling of Integrated Energy Systems with Demand Response via Deep Reinforcement Learning

abstract: Optimally scheduling multi-energy flow is an effective method to utilize renewable energy sources (RES) and improve the stability and economy of integrated energy systems (IES). However, the stable demand-supply of IES faces challenges from uncertainties that arise from RES and loads, as well as the increasing impact of cyber-attacks with advanced information and communication technologies adoption. To address these challenges, this paper proposes an innovative model-free resilience scheduling method based on state-adversarial deep reinforcement learning (DRL) for integrated demand response (IDR)-enabled IES. The proposed method designs an IDR program to explore the interaction ability of electricity-gas-heat flexible loads. Additionally, a state-adversarial Markov decision process (SA-MDP) model characterizes the energy scheduling problem of IES under cyber-attack. The state-adversarial soft actor-critic (SA-SAC) algorithm is proposed to mitigate the impact of cyber-attacks on the scheduling strategy. Simulation results demonstrate that our method is capable of adequately addressing the uncertainties resulting from RES and loads, mitigating the impact of cyber-attacks on the scheduling strategy, and ensuring a stable demand supply for various energy sources. Moreover, the proposed method demonstrates resilience against cyber-attacks. Compared to the original soft actor-critic (SAC) algorithm, it achieves a 10\% improvement in economic performance under cyber-attack scenarios.


abstract: Existing video-based action recognition systems typically require dense annotation and struggle in environments when there is significant distribution shift relative to the training data. Current methods for video domain adaptation typically fine-tune the model using fully annotated data on a subset of target domain data or align the representation of the two domains using bootstrapping or adversarial learning. Inspired by the pivotal role of objects in recent supervised object-centric action recognition models, we present Object-based (yet Class-agnostic) Video Domain Adaptation (ODAPT), a simple yet effective framework for adapting the existing action recognition systems to new domains by utilizing a sparse set of frames with class-agnostic object annotations in a target domain. Our model achieves a +6.5 increase when adapting across kitchens in Epic-Kitchens and a +3.1 increase adapting between Epic-Kitchens and the EGTEA dataset. ODAPT is a general framework that can also be combined with previous unsupervised methods, offering a +5.0 boost when combined with the self-supervised multi-modal method MMSADA and a +1.7 boost when added to the adversarial-based method TA$^3$N on Epic-Kitchens.


title: LayerCollapse: Adaptive compression of neural networks

abstract: Handling the ever-increasing scale of contemporary deep learning and transformer-based models poses a significant challenge. Overparameterized Transformer networks outperform prior art in Natural Language processing and Computer Vision. These models contain hundreds of millions of parameters, demanding significant computational resources and making them prone to overfitting. In this work we present LayerCollapse, a form of structured pruning to reduce the depth of fully connected layers. We develop a novel regularizer allowing for post-training compression without finetuning, while having limited impact on performance. LayerCollapse controls model expressiveness with regularization on the activations between fully connected layers, modulating the linearity of activation functions. A linear activation function reduces the rank of the transformation to the rank of the corresponding linear transformation. We demonstrate the effectiveness of LayerCollapse by showing its compression capabilities in sentimental analysis and image classification benchmarks. Moreover we show LayerCollapse is an effective compression aware regularization method in a language modeling benchmark.


title: LALM: Long-Term Action Anticipation with Language Models

abstract: Understanding human activity is a crucial yet intricate task in egocentric vision, a field that focuses on capturing visual perspectives from the camera wearer's viewpoint. While traditional methods heavily rely on representation learning trained on extensive video data, there exists a significant limitation: obtaining effective video representations proves challenging due to the inherent complexity and variability in human activities.Furthermore, exclusive dependence on video-based learning may constrain a model's capability to generalize across long-tail classes and out-of-distribution scenarios. In this study, we introduce a novel approach for long-term action anticipation using language models (LALM), adept at addressing the complex challenges of long-term activity understanding without the need for extensive training. Our method incorporates an action recognition model to track previous action sequences and a vision-language model to articulate relevant environmental details. By leveraging the context provided by these past events, we devise a prompting strategy for action anticipation using large language models (LLMs). Moreover, we implement Maximal Marginal Relevance for example selection to facilitate in-context learning of the LLMs. Our experimental results demonstrate that LALM surpasses the state-of-the-art methods in the task of long-term action anticipation on the Ego4D benchmark. We further validate LALM on two additional benchmarks, affirming its capacity for generalization across intricate activities with different sets of taxonomies. These are achieved without specific fine-tuning.


title: Contrastive Vision-Language Alignment Makes Efficient Instruction Learner

abstract: We study the task of extending the large language model (LLM) into a vision-language instruction-following model. This task is crucial but challenging since the LLM is trained on text modality only, making it hard to effectively digest the visual modality. To address this, existing methods typically train a visual adapter to align the representation between a pre-trained vision transformer (ViT) and the LLM by a generative image captioning loss. However, we find that the generative objective can only produce weak alignment for vision and language, making the aligned vision-language model very hungry for the instruction fine-tuning data. In this paper, we propose CG-VLM that applies both Contrastive and Generative alignment objectives to effectively align the representation of ViT and LLM. Different from image level and sentence level alignment in common contrastive learning settings, CG-VLM aligns the image-patch level features and text-token level embeddings, which, however, is very hard to achieve as no explicit grounding patch-token relation provided in standard image captioning datasets. To address this issue, we propose to maximize the averaged similarity between pooled image-patch features and text-token embeddings. Extensive experiments demonstrate that the proposed CG-VLM produces strong vision-language alignment and is an efficient instruction learner. For example, using only 10% instruction tuning data, we reach 95% performance of state-of-the-art method LLaVA [29] on the zero-shot ScienceQA-Image benchmark.


title: DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback

abstract: Despite their wide-spread success, Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user's input text. We introduce DreamSync, a model-agnostic training algorithm by design that improves T2I models to be faithful to the text input. DreamSync builds off a recent insight from TIFA's evaluation framework -- that large vision-language models (VLMs) can effectively identify the fine-grained discrepancies between generated images and the text inputs. DreamSync uses this insight to train T2I models without any labeled data; it improves T2I models using its own generations. First, it prompts the model to generate several candidate images for a given input text. Then, it uses two VLMs to select the best generation: a Visual Question Answering model that measures the alignment of generated images to the text, and another that measures the generation's aesthetic quality. After selection, we use LoRA to iteratively finetune the T2I model to guide its generation towards the selected best generations. DreamSync does not need any additional human annotation. model architecture changes, or reinforcement learning. Despite its simplicity, DreamSync improves both the semantic alignment and aesthetic appeal of two diffusion-based T2I models, evidenced by multiple benchmarks (+1.7% on TIFA, +2.9% on DSG1K, +3.4% on VILA aesthetic) and human evaluation.


title: Model Reduction of a Piecewise Linear Flexible Mechanical Oscillator

abstract: We study the reduced order modeling of a nonlinear flexible oscillator in which a Bernoulli-Euler beam with a permanent tip magnet is subjected to a position-triggered electromagnetic kick force. This results in non-smooth boundary conditions capable of exciting many degrees of freedom. The system is modeled as piecewise linear with the different boundary conditions determining different regions of a hybrid phase space. With kick strength as parameter, its bifurcation diagram is found to exhibit a range of periodic and chaotic behaviors. Proper orthogonal decomposition (POD) is used to estimate the system's intrinsic dimensionality. However, conventional POD's purely statistical analysis of spatial covariance does not guarantee accuracy of reduced order models (ROMs). We therefore augment POD by employing a previously-developed energy closure criterion that selects ROM dimension by ensuring approximate energy balance on the reduced subspace. This physics-based criterion yields accurate ROMs with 8 degrees of freedom. Remarkably, we show that ROMs formulated at particular values of the kick strength can nevertheless reconstruct the entire bifurcation structure of the original system. Our results demonstrate that energy closure analysis outperforms variance-based estimates of effective dimension for nonlinear structural systems, and is capable of providing ROMs that are robust even across stability transitions.


title: Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic Scenes

abstract: In this paper, we study multi-label atomic activity recognition. Despite the notable progress in action recognition, it is still challenging to recognize atomic activities due to a deficiency in a holistic understanding of both multiple road users' motions and their contextual information. In this paper, we introduce Action-slot, a slot attention-based approach that learns visual action-centric representations, capturing both motion and contextual information. Our key idea is to design action slots that are capable of paying attention to regions where atomic activities occur, without the need for explicit perception guidance. To further enhance slot attention, we introduce a background slot that competes with action slots, aiding the training process in avoiding unnecessary focus on background regions devoid of activities. Yet, the imbalanced class distribution in the existing dataset hampers the assessment of rare activities. To address the limitation, we collect a synthetic dataset called TACO, which is four times larger than OATS and features a balanced distribution of atomic activities. To validate the effectiveness of our method, we conduct comprehensive experiments and ablation studies against various action recognition baselines. We also show that the performance of multi-label atomic activity recognition on real-world datasets can be improved by pretraining representations on TACO. We will release our source code and dataset. See the videos of visualization on the project page: https://hcis-lab.github.io/Action-slot/


title: Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines

abstract: Large pre-trained models can dramatically reduce the amount of task-specific data required to solve a problem, but they often fail to capture domain-specific nuances out of the box. The Web likely contains the information necessary to excel on any specific application, but identifying the right data a priori is challenging. This paper shows how to leverage recent advances in NLP and multi-modal learning to augment a pre-trained model with search engine retrieval. We propose to retrieve useful data from the Web at test time based on test cases that the model is uncertain about. Different from existing retrieval-augmented approaches, we then update the model to address this underlying uncertainty. We demonstrate substantial improvements in zero-shot performance, e.g. a remarkable increase of 15 percentage points in accuracy on the Stanford Cars and Flowers datasets. We also present extensive experiments that explore the impact of noisy retrieval and different learning strategies.


title: Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching

abstract: The lightweight "local-match-global" matching introduced by SRe2L successfully creates a distilled dataset with comprehensive information on the full 224x224 ImageNet-1k. However, this one-sided approach is limited to a particular backbone, layer, and statistics, which limits the improvement of the generalization of a distilled dataset. We suggest that sufficient and various "local-match-global" matching are more precise and effective than a single one and has the ability to create a distilled dataset with richer information and better generalization. We call this perspective "generalized matching" and propose Generalized Various Backbone and Statistical Matching (G-VBSM) in this work, which aims to create a synthetic dataset with densities, ensuring consistency with the complete dataset across various backbones, layers, and statistics. As experimentally demonstrated, G-VBSM is the first algorithm to obtain strong performance across both small-scale and large-scale datasets. Specifically, G-VBSM achieves a performance of 38.7% on CIFAR-100 with 128-width ConvNet, 47.6% on Tiny-ImageNet with ResNet18, and 31.4% on the full 224x224 ImageNet-1k with ResNet18, under images per class (IPC) 10, 50, and 10, respectively. These results surpass all SOTA methods by margins of 3.9%, 6.5%, and 10.1%, respectively.


title: C3Net: Compound Conditioned ControlNet for Multimodal Content Generation

abstract: We present Compound Conditioned ControlNet, C3Net, a novel generative neural architecture taking conditions from multiple modalities and synthesizing multimodal contents simultaneously (e.g., image, text, audio). C3Net adapts the ControlNet architecture to jointly train and make inferences on a production-ready diffusion model and its trainable copies. Specifically, C3Net first aligns the conditions from multi-modalities to the same semantic latent space using modality-specific encoders based on contrastive training. Then, it generates multimodal outputs based on the aligned latent space, whose semantic information is combined using a ControlNet-like architecture called Control C3-UNet. Correspondingly, with this system design, our model offers an improved solution for joint-modality generation through learning and explaining multimodal conditions instead of simply taking linear interpolations on the latent space. Meanwhile, as we align conditions to a unified latent space, C3Net only requires one trainable Control C3-UNet to work on multimodal semantic information. Furthermore, our model employs unimodal pretraining on the condition alignment stage, outperforming the non-pretrained alignment even on relatively scarce training data and thus demonstrating high-quality compound condition generation. We contribute the first high-quality tri-modal validation set to validate quantitatively that C3Net outperforms or is on par with first and contemporary state-of-the-art multimodal generation. Our codes and tri-modal dataset will be released.


title: Synchronizing Vision and Language: Bidirectional Token-Masking AutoEncoder for Referring Image Segmentation

abstract: Referring Image Segmentation (RIS) aims to segment target objects expressed in natural language within a scene at the pixel level. Various recent RIS models have achieved state-of-the-art performance by generating contextual tokens to model multimodal features from pretrained encoders and effectively fusing them using transformer-based cross-modal attention. While these methods match language features with image features to effectively identify likely target objects, they often struggle to correctly understand contextual information in complex and ambiguous sentences and scenes. To address this issue, we propose a novel bidirectional token-masking autoencoder (BTMAE) inspired by the masked autoencoder (MAE). The proposed model learns the context of image-to-language and language-to-image by reconstructing missing features in both image and language features at the token level. In other words, this approach involves mutually complementing across the features of images and language, with a focus on enabling the network to understand interconnected deep contextual information between the two modalities. This learning method enhances the robustness of RIS performance in complex sentences and scenes. Our BTMAE achieves state-of-the-art performance on three popular datasets, and we demonstrate the effectiveness of the proposed method through various ablation studies.


title: Rethinking Image Editing Detection in the Era of Generative AI Revolution

abstract: The accelerated advancement of generative AI significantly enhance the viability and effectiveness of generative regional editing methods. This evolution render the image manipulation more accessible, thereby intensifying the risk of altering the conveyed information within original images and even propagating misinformation. Consequently, there exists a critical demand for robust capable of detecting the edited images. However, the lack of comprehensive dataset containing images edited with abundant and advanced generative regional editing methods poses a substantial obstacle to the advancement of corresponding detection methods. We endeavor to fill the vacancy by constructing the GRE dataset, a large-scale generative regional editing dataset with the following advantages: 1) Collection of real-world original images, focusing on two frequently edited scenarios. 2) Integration of a logical and simulated editing pipeline, leveraging multiple large models in various modalities. 3) Inclusion of various editing approaches with distinct architectures. 4) Provision of comprehensive analysis tasks. We perform comprehensive experiments with proposed three tasks: edited image classification, edited method attribution and edited region localization, providing analysis of distinct editing methods and evaluation of detection methods in related fields. We expect that the GRE dataset can promote further research and exploration in the field of generative region editing detection.


title: Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commerce

abstract: Over the past decade, significant advances have been made in the field of image search for e-commerce applications. Traditional image-to-image retrieval models, which focus solely on image details such as texture, tend to overlook useful semantic information contained within the images. As a result, the retrieved products might possess similar image details, but fail to fulfil the user's search goals. Moreover, the use of image-to-image retrieval models for products containing multiple images results in significant online product feature storage overhead and complex mapping implementations. In this paper, we report the design and deployment of the proposed Multi-modal Item Embedding Model (MIEM) to address these limitations. It is capable of utilizing both textual information and multiple images about a product to construct meaningful product features. By leveraging semantic information from images, MIEM effectively supplements the image search process, improving the overall accuracy of retrieval results. MIEM has become an integral part of the Shopee image search platform. Since its deployment in March 2023, it has achieved a remarkable 9.90% increase in terms of clicks per user and a 4.23% boost in terms of orders per user for the image search feature on the Shopee e-commerce platform.


title: PEAN: A Diffusion-Based Prior-Enhanced Attention Network for Scene Text Image Super-Resolution

abstract: Scene text image super-resolution (STISR) aims at simultaneously increasing the resolution and readability of low-resolution scene text images, thus boosting the performance of the downstream recognition task. Two factors in scene text images, visual structure and semantic information, affect the recognition performance significantly. To mitigate the effects from these factors, this paper proposes a Prior-Enhanced Attention Network (PEAN). Specifically, an attention-based modulation module is leveraged to understand scene text images by neatly perceiving the local and global dependence of images, despite the shape of the text. Meanwhile, a diffusion-based module is developed to enhance the text prior, hence offering better guidance for the SR network to generate SR images with higher semantic accuracy. Additionally, a multi-task learning paradigm is employed to optimize the network, enabling the model to generate legible SR images. As a result, PEAN establishes new SOTA results on the TextZoom benchmark. Experiments are also conducted to analyze the importance of the enhanced text prior as a means of improving the performance of the SR network. Code will be made available at https://github.com/jdfxzzy/PEAN.


title: QuadraNet: Improving High-Order Neural Interaction Efficiency with Hardware-Aware Quadratic Neural Networks

abstract: Recent progress in computer vision-oriented neural network designs is mostly driven by capturing high-order neural interactions among inputs and features. And there emerged a variety of approaches to accomplish this, such as Transformers and its variants. However, these interactions generate a large amount of intermediate state and/or strong data dependency, leading to considerable memory consumption and computing cost, and therefore compromising the overall runtime performance. To address this challenge, we rethink the high-order interactive neural network design with a quadratic computing approach. Specifically, we propose QuadraNet -- a comprehensive model design methodology from neuron reconstruction to structural block and eventually to the overall neural network implementation. Leveraging quadratic neurons' intrinsic high-order advantages and dedicated computation optimization schemes, QuadraNet could effectively achieve optimal cognition and computation performance. Incorporating state-of-the-art hardware-aware neural architecture search and system integration techniques, QuadraNet could also be well generalized in different hardware constraint settings and deployment scenarios. The experiment shows thatQuadraNet achieves up to 1.5$\times$ throughput, 30% less memory footprint, and similar cognition performance, compared with the state-of-the-art high-order approaches.


title: HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpainting

abstract: Diffusion models have achieved remarkable success in generating realistic images but suffer from generating accurate human hands, such as incorrect finger counts or irregular shapes. This difficulty arises from the complex task of learning the physical structure and pose of hands from training images, which involves extensive deformations and occlusions. For correct hand generation, our paper introduces a lightweight post-processing solution called $\textbf{HandRefiner}$. HandRefiner employs a conditional inpainting approach to rectify malformed hands while leaving other parts of the image untouched. We leverage the hand mesh reconstruction model that consistently adheres to the correct number of fingers and hand shape, while also being capable of fitting the desired hand pose in the generated image. Given a generated failed image due to malformed hands, we utilize ControlNet modules to re-inject such correct hand information. Additionally, we uncover a phase transition phenomenon within ControlNet as we vary the control strength. It enables us to take advantage of more readily available synthetic data without suffering from the domain gap between realistic and synthetic hands. Experiments demonstrate that HandRefiner can significantly improve the generation quality quantitatively and qualitatively. The code is available at https://github.com/wenquanlu/HandRefiner .


title: CommunityAI: Towards Community-based Federated Learning

abstract: Federated Learning (FL) has emerged as a promising paradigm to train machine learning models collaboratively while preserving data privacy. However, its widespread adoption faces several challenges, including scalability, heterogeneous data and devices, resource constraints, and security concerns. Despite its promise, FL has not been specifically adapted for community domains, primarily due to the wide-ranging differences in data types and context, devices and operational conditions, environmental factors, and stakeholders. In response to these challenges, we present a novel framework for Community-based Federated Learning called CommunityAI. CommunityAI enables participants to be organized into communities based on their shared interests, expertise, or data characteristics. Community participants collectively contribute to training and refining learning models while maintaining data and participant privacy within their respective groups. Within this paper, we discuss the conceptual architecture, system requirements, processes, and future challenges that must be solved. Finally, our goal within this paper is to present our vision regarding enabling a collaborative learning process within various communities.


title: Transformer Based Model for Predicting Rapid Impact Compaction Outcomes: A Case Study of Utapao International Airport

abstract: This paper introduces a novel deep learning approach to predict the engineering properties of the ground improved by Rapid Impact Compaction (RIC), which is a ground improvement technique that uses a drop hammer to compact the soil and fill layers. The proposed approach uses transformer-based neural networks to capture the complex nonlinear relationships between the input features, such as the hammer energy, drop height, and number of blows, and the output variables, such as the cone resistance. The approach is applied to a real-world dataset from a trial test section for the new apron construction of the Utapao International Airport in Thailand. The results show that the proposed approach outperforms the existing methods in terms of prediction accuracy and efficiency and provides interpretable attention maps that reveal the importance of different features for RIC prediction. The paper also discusses the limitations and future directions of applying deep learning methods to RIC prediction.


title: Guided Prompting in SAM for Weakly Supervised Cell Segmentation in Histopathological Images

abstract: Cell segmentation in histopathological images plays a crucial role in understanding, diagnosing, and treating many diseases. However, data annotation for this is expensive since there can be a large number of cells per image, and expert pathologists are needed for labelling images. Instead, our paper focuses on using weak supervision -- annotation from related tasks -- to induce a segmenter. Recent foundation models, such as Segment Anything (SAM), can use prompts to leverage additional supervision during inference. SAM has performed remarkably well in natural image segmentation tasks; however, its applicability to cell segmentation has not been explored. In response, we investigate guiding the prompting procedure in SAM for weakly supervised cell segmentation when only bounding box supervision is available. We develop two workflows: (1) an object detector's output as a test-time prompt to SAM (D-SAM), and (2) SAM as pseudo mask generator over training data to train a standalone segmentation model (SAM-S). On finding that both workflows have some complementary strengths, we develop an integer programming-based approach to reconcile the two sets of segmentation masks, achieving yet higher performance. We experiment on three publicly available cell segmentation datasets namely, ConSep, MoNuSeg, and TNBC, and find that all SAM-based solutions hugely outperform existing weakly supervised image segmentation models, obtaining 9-15 pt Dice gains.


title: Skilful Precipitation Nowcasting Using NowcastNet

abstract: Designing early warning system for precipitation requires accurate short-term forecasting system. Climate change has led to an increase in frequency of extreme weather events, and hence such systems can prevent disasters and loss of life. Managing such events remain a challenge for both public and private institutions. Precipitation nowcasting can help relevant institutions to better prepare for such events as they impact agriculture, transport, public health and safety, etc. Physics-based numerical weather prediction (NWP) is unable to perform well for nowcasting because of large computational turn-around time. Deep-learning based models on the other hand are able to give predictions within seconds. We use recently proposed NowcastNet, a physics-conditioned deep generative network, to forecast precipitation for different regions of Europe using satellite images. Both spatial and temporal transfer learning is done by forecasting for the unseen regions and year. Model makes realistic predictions and is able to outperform baseline for such a prediction task.


title: In search of the perfect fit: interpretation, flexible modelling, and the existing generalisations of the normal distribution

abstract: Many generalised distributions exist for modelling data with vastly diverse characteristics. However, very few of these generalisations of the normal distribution have shape parameters with clear roles that determine, for instance, skewness and tail shape. In this chapter, we review existing skewing mechanisms and their properties in detail. Using the knowledge acquired, we add a skewness parameter to the body-tail generalised normal distribution \cite{BTGN}, that yields the \ac{FIN} with parameters for location, scale, body-shape, skewness, and tail weight. Basic statistical properties of the \ac{FIN} are provided, such as the \ac{PDF}, cumulative distribution function, moments, and likelihood equations. Additionally, the \ac{FIN} \ac{PDF} is extended to a multivariate setting using a student t-copula, yielding the \ac{MFIN}. The \ac{MFIN} is applied to stock returns data, where it outperforms the t-copula multivariate generalised hyperbolic, Azzalini skew-t, hyperbolic, and normal inverse Gaussian distributions.


title: M$^{2}$Chat: Empowering VLM for Multimodal LLM Interleaved Text-Image Generation

abstract: While current LLM chatbots like GPT-4V bridge the gap between human instructions and visual representations to enable text-image generations, they still lack efficient alignment methods for high-fidelity performance on multiple downstream tasks. In this paper, we propose \textbf{$M^{2}Chat$}, a novel unified multimodal LLM framework for generating interleaved text-image conversation across various scenarios. Specifically, we propose an $M^{3}Adapter$ that efficiently integrates granular low-level visual information and high-level semantic features from multi-modality prompts. Upon the well-aligned fused feature, $M^{3}Adapter$ tailors a learnable gating strategy to balance the model creativity and consistency across various tasks adaptively. Moreover, to further enhance the effectiveness of $M^{3}Adapter$ while preserving the coherence of semantic context comprehension, we introduce a two-stage $M^{3}FT$ fine-tuning strategy. This strategy optimizes disjoint groups of parameters for image-text alignment and visual-instruction respectively. Extensive experiments demonstrate our $M^{2}Chat$ surpasses state-of-the-art counterparts across diverse benchmarks, showcasing its prowess in interleaving generation, storytelling, and multimodal dialogue systems. The demo and code are available at \red{https://mattie-e.github.io/M2Chat.github.io}.


title: Linear normalised hash function for clustering gene sequences and identifying reference sequences from multiple sequence alignments

abstract: The aim of this study was to develop a method that would identify the cluster centroids and the optimal number of clusters for a given sensitivity level and could work equally well for the different sequence datasets. A novel method that combines the linear mapping hash function and multiple sequence alignment (MSA) was developed. This method takes advantage of the already sorted by similarity sequences from the MSA output, and identifies the optimal number of clusters, clusters cut-offs, and clusters centroids that can represent reference gene vouchers for the different species. The linear mapping hash function can map an already ordered by similarity distance matrix to indices to reveal gaps in the values around which the optimal cut-offs of the different clusters can be identified. The method was evaluated using sets of closely related (16S rRNA gene sequences of Nocardia species) and highly variable (VP1 genomic region of Enterovirus 71) sequences and outperformed existing unsupervised machine learning clustering methods and dimensionality reduction methods. This method does not require prior knowledge of the number of clusters or the distance between clusters, handles clusters of different sizes and shapes, and scales linearly with the dataset. The combination of MSA with the linear mapping hash function is a computationally efficient way of gene sequence clustering and can be a valuable tool for the assessment of similarity, clustering of different microbial genomes, identifying reference sequences, and for the study of evolution of bacteria and viruses.


title: Defining Reference Sequences for Nocardia Species by Similarity and Clustering Analyses of 16S rRNA Gene Sequence Data

abstract: The intra- and inter-species genetic diversity of bacteria and the absence of 'reference', or the most representative, sequences of individual species present a significant challenge for sequence-based identification. The aims of this study were to determine the utility, and compare the performance of several clustering and classification algorithms to identify the species of 364 sequences of 16S rRNA gene with a defined species in GenBank, and 110 sequences of 16S rRNA gene with no defined species, all within the genus Nocardia. A total of 364 16S rRNA gene sequences of Nocardia species were studied. In addition, 110 16S rRNA gene sequences assigned only to the Nocardia genus level at the time of submission to GenBank were used for machine learning classification experiments. Different clustering algorithms were compared with a novel algorithm or the linear mapping (LM) of the distance matrix. Principal Components Analysis was used for the dimensionality reduction and visualization. Results: The LM algorithm achieved the highest performance and classified the set of 364 16S rRNA sequences into 80 clusters, the majority of which (83.52%) corresponded with the original species. The most representative 16S rRNA sequences for individual Nocardia species have been identified as 'centroids' in respective clusters from which the distances to all other sequences were minimized; 110 16S rRNA gene sequences with identifications recorded only at the genus level were classified using machine learning methods. Simple kNN machine learning demonstrated the highest performance and classified Nocardia species sequences with an accuracy of 92.7% and a mean frequency of 0.578.


title: Dating of a Latin astrolabe

abstract: We have determined the most probable date for the catalog of 34 stars that was used in the construction of a Latin astrolabe originally owned by the Dominican preacher friars and presently at Mus\'ee des Arts pr\'ecieux Paul-Dupuy (Toulouse, France). To this end we digitized a photograph of the rete and the rule of the astrolabe, computed the equatorial coordinates of the ends of the 34 star pointers of the rete, and produced a list of 113 reference stars taken from several lists of stars on astrolabes. We then compared the coordinates of the ends of the pointers and those of the reference stars for dates between 1400 and 1700. The most probable date for this astrolabe is 1550.


title: Discovering Galaxy Features via Dataset Distillation

abstract: In many applications, Neural Nets (NNs) have classification performance on par or even exceeding human capacity. Moreover, it is likely that NNs leverage underlying features that might differ from those humans perceive to classify. Can we "reverse-engineer" pertinent features to enhance our scientific understanding? Here, we apply this idea to the notoriously difficult task of galaxy classification: NNs have reached high performance for this task, but what does a neural net (NN) "see" when it classifies galaxies? Are there morphological features that the human eye might overlook that could help with the task and provide new insights? Can we visualize tracers of early evolution, or additionally incorporated spectral data? We present a novel way to summarize and visualize galaxy morphology through the lens of neural networks, leveraging Dataset Distillation, a recent deep-learning methodology with the primary objective to distill knowledge from a large dataset and condense it into a compact synthetic dataset, such that a model trained on this synthetic dataset achieves performance comparable to a model trained on the full dataset. We curate a class-balanced, medium-size high-confidence version of the Galaxy Zoo 2 dataset, and proceed with dataset distillation from our accurate NN-classifier to create synthesized prototypical images of galaxy morphological features, demonstrating its effectiveness. Of independent interest, we introduce a self-adaptive version of the state-of-the-art Matching Trajectory algorithm to automate the distillation process, and show enhanced performance on computer vision benchmarks.


title: Latent Alignment with Deep Set EEG Decoders

abstract: The variability in EEG signals between different individuals poses a significant challenge when implementing brain-computer interfaces (BCI). Commonly proposed solutions to this problem include deep learning models, due to their increased capacity and generalization, as well as explicit domain adaptation techniques. Here, we introduce the Latent Alignment method that won the Benchmarks for EEG Transfer Learning (BEETL) competition and present its formulation as a deep set applied on the set of trials from a given subject. Its performance is compared to recent statistical domain adaptation techniques under various conditions. The experimental paradigms include motor imagery (MI), oddball event-related potentials (ERP) and sleep stage classification, where different well-established deep learning models are applied on each task. Our experimental results show that performing statistical distribution alignment at later stages in a deep learning model is beneficial to the classification accuracy, yielding the highest performance for our proposed method. We further investigate practical considerations that arise in the context of using deep learning and statistical alignment for EEG decoding. In this regard, we study class-discriminative artifacts that can spuriously improve results for deep learning models, as well as the impact of class-imbalance on alignment. We delineate a trade-off relationship between increased classification accuracy when alignment is performed at later modeling stages, and susceptibility to class-imbalance in the set of trials that the statistics are computed on.


title: Generation of a Compendium of Transcription Factor Cascades and Identification of Potential Therapeutic Targets using Graph Machine Learning

abstract: Transcription factors (TFs) play a vital role in the regulation of gene expression thereby making them critical to many cellular processes. In this study, we used graph machine learning methods to create a compendium of TF cascades using data extracted from the STRING database. A TF cascade is a sequence of TFs that regulate each other, forming a directed path in the TF network. We constructed a knowledge graph of 81,488 unique TF cascades, with the longest cascade consisting of 62 TFs. Our results highlight the complex and intricate nature of TF interactions, where multiple TFs work together to regulate gene expression. We also identified 10 TFs with the highest regulatory influence based on centrality measurements, providing valuable information for researchers interested in studying specific TFs. Furthermore, our pathway enrichment analysis revealed significant enrichment of various pathways and functional categories, including those involved in cancer and other diseases, as well as those involved in development, differentiation, and cell signaling. The enriched pathways identified in this study may have potential as targets for therapeutic intervention in diseases associated with dysregulation of transcription factors. We have released the dataset, knowledge graph, and graphML methods for the TF cascades, and created a website to display the results, which can be accessed by researchers interested in using this dataset. Our study provides a valuable resource for understanding the complex network of interactions between TFs and their regulatory roles in cellular processes.


title: Description Generation using Variational Auto-Encoders for precursor microRNA

abstract: Micro RNAs (miRNA) are a type of non-coding RNA, which are involved in gene regulation and can be associated with diseases such as cancer, cardiovascular and neurological diseases. As such, identifying the entire genome of miRNA can be of great relevance. Since experimental methods for novel precursor miRNA (pre-miRNA) detection are complex and expensive, computational detection using ML could be useful. Existing ML methods are often complex black boxes, which do not create an interpretable structural description of pre-miRNA. In this paper, we propose a novel framework, which makes use of generative modeling through Variational Auto-Encoders to uncover the generative factors of pre-miRNA. After training the VAE, the pre-miRNA description is developed using a decision tree on the lower dimensional latent space. Applying the framework to miRNA classification, we obtain a high reconstruction and classification performance, while also developing an accurate miRNA description.


title: GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation

abstract: Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems mainly stem from 2D diffusion models lacking 3D awareness during the lifting. In this work, we present GeoDream, a novel method that incorporates explicit generalized 3D priors with 2D diffusion priors to enhance the capability of obtaining unambiguous 3D consistent geometric structures without sacrificing diversity or fidelity. Specifically, we first utilize a multi-view diffusion model to generate posed images and then construct cost volume from the predicted image, which serves as native 3D geometric priors, ensuring spatial consistency in 3D space. Subsequently, we further propose to harness 3D geometric priors to unlock the great potential of 3D awareness in 2D diffusion priors via a disentangled design. Notably, disentangling 2D and 3D priors allows us to refine 3D geometric priors further. We justify that the refined 3D geometric priors aid in the 3D-aware capability of 2D diffusion priors, which in turn provides superior guidance for the refinement of 3D geometric priors. Our numerical and visual comparisons demonstrate that GeoDream generates more 3D consistent textured meshes with high-resolution realistic renderings (i.e., 1024 $\times$ 1024) and adheres more closely to semantic coherence.


title: Self-Infilling Code Generation

abstract: This work introduces self-infilling code generation, a general framework that incorporates infilling operations into auto-regressive decoding. Our approach capitalizes on the observation that recent infilling-capable code language models can self-infill: whereas infilling operations aim to fill in the middle based on a predefined prefix and suffix, self-infilling sequentially generates both such surrounding context and the infilled content. We utilize this capability to introduce novel interruption and looping mechanisms in conventional decoding, evolving it into a non-monotonic process. Interruptions allow for postponing the generation of specific code until a definitive suffix is established, enhancing control over the output. Meanwhile, the looping mechanism, which leverages the complementary nature of self-infilling and left-to-right decoding, can iteratively update and synchronize each piece of generation cyclically. Extensive experiments are conducted to demonstrate that our proposed decoding process is effective in enhancing both regularity and quality across several code generation benchmarks.


title: Homogeneous Artificial Neural Network

abstract: The paper proposes an artificial neural network (ANN) being a global approximator for a special class of functions, which are known as generalized homogeneous. The homogeneity means a symmetry of a function with respect to a group of transformations having topological characterization of a dilation. In this paper, a class of the so-called linear dilations is considered. A homogeneous universal approximation theorem is proven. Procedures for an upgrade of an existing ANN to a homogeneous one are developed. Theoretical results are supported by examples from the various domains (computer science, systems theory and automatic control).

categories: cs.LG cs.AI cs.NA cs.NE cs.SY eess.SY math.NA math.OC


title: Feasibility of an Acoustophoresis-based System for a High-Throughput Cell Washing: Application to Bioproduction

abstract: Background These last decades have seen the emergence and development of cell-based therapies, notably those based on mesenchymal stromal cells (MSCs). The advancement of these promising treatments requires increasing the throughput of processed cell for industrialization in order to reduce production costs. Among the various bioproduction challenges, downstream processing (DSP), including medium exchange, cell washing, cell harvesting and volume reduction, remains a critical step on which improvements are needed. Typically, these processes are performed by centrifugation. However, this approach limits the automation, especially in small batch productions where it is performed manually in open system. Methods An acoustophoresis-based system was developed for cell washing. The cells were transferred from one stream to another via the acoustic forces and were collected in a different medium. The optimal flow rates of the different streams were assessed using Red Blood Cells (RBCs) suspended in an albumin solution. Finally, the impact of acoustic washing on adipose tissue-derived MSCs (AD-MSCs) transcriptome was investigated by RNA-sequencing. Results With a single passage through the acoustic device at input flow rate of 45 mL/h, the albumin removal was up to 90% while recovering 99% of RBCs. To further increase the protein removal, a loop washing in two steps was performed and has allowed an albumin removal $\ge$99% and a RBCs/AD-MSCs recovery of 99%. After loop washing of AD-MSCs, only 2 genes, HES4 and MIR-3648-1, were differently expressed compared to the input. Conclusion In this study, we developed a continuous cell washing system based on acoustophoresis. The process allows a high cell throughput while inducing little gene expression changes. These results highly suggest that cell washing based on acoustophoresis is a relevant and promising solution for numerous applications in cell manufacturing.


title: GeoDeformer: Geometric Deformable Transformer for Action Recognition

abstract: Vision transformers have recently emerged as an effective alternative to convolutional networks for action recognition. However, vision transformers still struggle with geometric variations prevalent in video data. This paper proposes a novel approach, GeoDeformer, designed to capture the variations inherent in action video by integrating geometric comprehension directly into the ViT architecture. Specifically, at the core of GeoDeformer is the Geometric Deformation Predictor, a module designed to identify and quantify potential spatial and temporal geometric deformations within the given video. Spatial deformations adjust the geometry within individual frames, while temporal deformations capture the cross-frame geometric dynamics, reflecting motion and temporal progression. To demonstrate the effectiveness of our approach, we incorporate it into the established MViTv2 framework, replacing the standard self-attention blocks with GeoDeformer blocks. Our experiments at UCF101, HMDB51, and Mini-K200 achieve significant increases in both Top-1 and Top-5 accuracy, establishing new state-of-the-art results with only a marginal increase in computational cost. Additionally, visualizations affirm that GeoDeformer effectively manifests explicit geometric deformations and minimizes geometric variations. Codes and checkpoints will be released.


title: Sea Level Rise by Climate Change. An order-of-magnitude approach to an environmental problem

abstract: A figure, taken from a science literacy test, illustrates the distribution of water across various locations on Earth, represented as though the entire volume is contained in 100 buckets. Using this figure , and other basic, readily available geographic information one can deduce the approximate value of about 70m for the rise in sea level due to the melting of all Earth's land ice, a value often discussed in media and public discourse.


title: GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces

abstract: The advent of neural 3D Gaussians has recently brought about a revolution in the field of neural rendering, facilitating the generation of high-quality renderings at real-time speeds. However, the explicit and discrete representation encounters challenges when applied to scenes featuring reflective surfaces. In this paper, we present GaussianShader, a novel method that applies a simplified shading function on 3D Gaussians to enhance the neural rendering in scenes with reflective surfaces while preserving the training and rendering efficiency. The main challenge in applying the shading function lies in the accurate normal estimation on discrete 3D Gaussians. Specifically, we proposed a novel normal estimation framework based on the shortest axis directions of 3D Gaussians with a delicately designed loss to make the consistency between the normals and the geometries of Gaussian spheres. Experiments show that GaussianShader strikes a commendable balance between efficiency and visual quality. Our method surpasses Gaussian Splatting in PSNR on specular object datasets, exhibiting an improvement of 1.57dB. When compared to prior works handling reflective surfaces, such as Ref-NeRF, our optimization time is significantly accelerated (23h vs. 0.58h). Please click on our project website to see more results.


title: AutArch: An AI-assisted workflow for object detection and automated recording in archaeological catalogues

abstract: The context of this paper is the creation of large uniform archaeological datasets from heterogeneous published resources, such as find catalogues - with the help of AI and Big Data. The paper is concerned with the challenge of consistent assemblages of archaeological data. We cannot simply combine existing records, as they differ in terms of quality and recording standards. Thus, records have to be recreated from published archaeological illustrations. This is only a viable path with the help of automation. The contribution of this paper is a new workflow for collecting data from archaeological find catalogues available as legacy resources, such as archaeological drawings and photographs in large unsorted PDF files; the workflow relies on custom software (AutArch) supporting image processing, object detection, and interactive means of validating and adjusting automatically retrieved data. We integrate artificial intelligence (AI) in terms of neural networks for object detection and classification into the workflow, thereby speeding up, automating, and standardising data collection. Objects commonly found in archaeological catalogues - such as graves, skeletons, ceramics, ornaments, stone tools and maps - are detected. Those objects are spatially related and analysed to extract real-life attributes, such as the size and orientation of graves based on the north arrow and the scale. We also automate recording of geometric whole-outlines through contour detection, as an alternative to landmark-based geometric morphometrics. Detected objects, contours, and other automatically retrieved data can be manually validated and adjusted. We use third millennium BC Europe (encompassing cultures such as 'Corded Ware' and 'Bell Beaker', and their burial practices) as a 'testing ground' and for evaluation purposes; this includes a user study for the workflow and the AutArch software.


title: Asymmetric autocatalytic reactions and their stationary distribution

abstract: We consider a general class of autocatalytic reactions, that has been shown to display stochastically switching behaviour (Discreteness Induced Transitions) in some parameter regimes. This behaviour was shown to occur when either the overall species count is low, or when the rate of inflow and outflow of species is relatively much smaller than the rate of autocatalytic reactions. The long-term behaviour of this class was analyzed in \cite{KBW20} with an analytic formula for the stationary distribution in the symmetric case. We focus on the case of asymmetric autocatalytic reactions and provide a formula for an approximate stationary distribution of the model. We show this distribution has different properties corresponding to the distinct behaviour of the process in the three parameter regimes. In the Discreteness Induced Transitions regime, the formula provides the fraction of time spent at each of the stable points.


title: Asymptotic Log-concavity of Dominant Lower Bruhat Intervals via Brunn--Minkowski Inequality

abstract: Bj\"orner and Ekedahl [Ann. of Math. (2), 170.2(2009), pp. 799--817] pioneered the study of length-counting sequences associated with parabolic lower Bruhat intervals in crystallographic Coxeter groups. In this paper, we study the asymptotic behavior of these sequences in affine Weyl groups. Let $W$ be an affine Weyl group with corresponding Weyl group $W_f$ and ${}^{f}{W}$ be the set of minimal representatives for the right cosets $W_f \backslash W$. Let $t_{\lambda}$ be the translation by a dominant coroot lattice element $\lambda$ and ${}^{f}{b}_i^{t_{\lambda}}$ be the number of elements of length $i$ below $t_\lambda$ in the Bruhat order on ${}^{f}{W}$. We show that the sequence $({}^{f}{b}_i^{t_{\lambda}})_i$ is ''asymptotically log-concave'' in the following sense: The sequence of discrete measures $(\mathfrak{m}_k)_k$ constructed from the $k$-fold dilated sequence $({}^{f}{b}_i^{t_{k\lambda}})_i$, as $k$ tends to infinity, converges weakly to a continuous measure obtained from a polytope $P^\lambda$. Moreover, the sequence of step functions $(S_k)_k$ of $({}^{f}{b}_i^{t_{k\lambda}})_i$ converges uniformly to the density function of this continuous measure. By Brunn--Minkowski inequality, this density is log-concave.


title: Optimizing the Generation and Transmission Capacity of Offshore Wind Parks under Weather Uncertainty

abstract: Offshore wind power in the North Sea is considered a main pillar in Europe's future energy system. A key challenge lies in determining the optimal spatial capacity allocation of offshore wind parks in combination with the dimensioning and layout of the connecting high-voltage direct current grid infrastructure. To determine economically cost optimal configurations, we apply an integrated capacity and transmission expansion problem within a pan-European electricity market and transmission grid model with a high spatial and temporal granularity. By conducting scenario analysis for the year 2030 with a gradually increasing CO2 price, possible offshore expansion paths are derived and presented. Special emphasis is laid on the effects of weather uncertainty by incorporating data from 21 historical weather years in the analysis. Two key findings are (i) an expansion in addition to the existing offshore wind capacity of 0 GW (136 EUR/tCO2), 12 GW (159 EUR/tCO2) and 30 GW (186 EUR/tCO2) dependent on the underlying CO2 price. (ii) A strong sensitivity of the results towards the underlying weather data highlighting the importance of incorporating multiple weather years.

categories: eess.SY cs.SY econ.GN physics.ao-ph q-fin.EC


title: VBench: Comprehensive Benchmark Suite for Video Generative Models

abstract: Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align with human perceptions; 2) An ideal evaluation system should provide insights to inform future developments of video generation. To this end, we present VBench, a comprehensive benchmark suite that dissects "video generation quality" into specific, hierarchical, and disentangled dimensions, each with tailored prompts and evaluation methods. VBench has three appealing properties: 1) Comprehensive Dimensions: VBench comprises 16 dimensions in video generation (e.g., subject identity inconsistency, motion smoothness, temporal flickering, and spatial relationship, etc). The evaluation metrics with fine-grained levels reveal individual models' strengths and weaknesses. 2) Human Alignment: We also provide a dataset of human preference annotations to validate our benchmarks' alignment with human perception, for each evaluation dimension respectively. 3) Valuable Insights: We look into current models' ability across various evaluation dimensions, and various content types. We also investigate the gaps between video and image generation models. We will open-source VBench, including all prompts, evaluation methods, generated videos, and human preference annotations, and also include more video generation models in VBench to drive forward the field of video generation.


title: Improving Interpretation Faithfulness for Vision Transformers

abstract: Vision Transformers (ViTs) have achieved state-of-the-art performance for various vision tasks. One reason behind the success lies in their ability to provide plausible innate explanations for the behavior of neural architectures. However, ViTs suffer from issues with explanation faithfulness, as their focal points are fragile to adversarial attacks and can be easily changed with even slight perturbations on the input image. In this paper, we propose a rigorous approach to mitigate these issues by introducing Faithful ViTs (FViTs). Briefly speaking, an FViT should have the following two properties: (1) The top-$k$ indices of its self-attention vector should remain mostly unchanged under input perturbation, indicating stable explanations; (2) The prediction distribution should be robust to perturbations. To achieve this, we propose a new method called Denoised Diffusion Smoothing (DDS), which adopts randomized smoothing and diffusion-based denoising. We theoretically prove that processing ViTs directly with DDS can turn them into FViTs. We also show that Gaussian noise is nearly optimal for both $\ell_2$ and $\ell_\infty$-norm cases. Finally, we demonstrate the effectiveness of our approach through comprehensive experiments and evaluations. Results show that FViTs are more robust against adversarial attacks while maintaining the explainability of attention, indicating higher faithfulness.


title: 4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling

abstract: Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance, 3D structure, and motion. For example, text-to-image models and their 3D-aware variants are trained on internet-scale image datasets and can be used to produce scenes with realistic appearance and 3D structure -- but no motion. Text-to-video models are trained on relatively smaller video datasets and can produce scenes with motion, but poorer appearance and 3D structure. While these models have complementary strengths, they also have opposing weaknesses, making it difficult to combine them in a way that alleviates this three-way tradeoff. Here, we introduce hybrid score distillation sampling, an alternating optimization procedure that blends supervision signals from multiple pre-trained diffusion models and incorporates benefits of each for high-fidelity text-to-4D generation. Using hybrid SDS, we demonstrate synthesis of 4D scenes with compelling appearance, 3D structure, and motion.


title: Fault-Tolerant Quantum Memory using Low-Depth Random Circuit Codes

abstract: Low-depth random circuit codes possess many desirable properties for quantum error correction but have so far only been analyzed in the code capacity setting where it is assumed that encoding gates and syndrome measurements are noiseless. In this work, we design a fault-tolerant distillation protocol for preparing encoded states of one-dimensional random circuit codes even when all gates and measurements are subject to noise. This is sufficient for fault-tolerant quantum memory since these encoded states can then be used as ancillas for Steane error correction. We show through numerical simulations that our protocol can correct erasure errors up to an error rate of $2\%$. In addition, we also extend results in the code capacity setting by developing a maximum likelihood decoder for depolarizing noise similar to work by Darmawan et al. As in their work, we formulate the decoding problem as a tensor network contraction and show how to contract the network efficiently by exploiting the low-depth structure. Replacing the tensor network with a so-called ''tropical'' tensor network, we also show how to perform minimum weight decoding. With these decoders, we are able to numerically estimate the depolarizing error threshold of finite-rate random circuit codes and show that this threshold closely matches the hashing bound even when the decoding is sub-optimal.


title: Accurate halo mass functions from the simplest excursion set theory

abstract: Excursion set theory is a powerful and widely used tool for describing the distribution of dark matter haloes, but it is normally applied with simplifying approximations. We use numerical sampling methods to study the mass functions predicted by the theory without approximations. With a spherical top-hat window and a constant $\delta=1.5$ threshold, the theory accurately predicts mass functions with the $M_{200}$ mass definition, both unconditional and conditional, in simulations of a range of matter-dominated cosmologies. For $\Lambda$CDM at the present epoch, predictions lie between the $M_\mathrm{200m}$ and $M_\mathrm{200c}$ mass functions. In contrast, with the same window function, a nonconstant threshold based on ellipsoidal collapse predicts uniformly too few haloes. This work indicates a new way to simply and accurately evaluate halo mass functions, clustering bias, and assembly histories for a range of cosmologies. We provide a simple fitting function that accurately represents the predictions of the theory for a wide range of parameters.


title: Closing the dark photon window to thermal dark matter

abstract: The nature of dark matter remains a central question in particle physics, cosmology, and astrophysics. The prevailing hypothesis postulates that dark matter consists of particles that interact only weakly with Standard Model particles. However, the knowledge of dark matter properties beyond these interactions is limited. This study explores a scenario involving a dark photon as a mediator between dark matter and the Standard Model, akin to the photon's role in electromagnetism. Recent cosmological and experimental evidence impose constraints on this scenario, focusing on results from direct detection experiments such as PICO-60, XENON-1T, and PANDAX-4T. The results reveal severe constraints, effectively closing the window for laboratory searches for dark photons as mediators between the Standard Model and the dark sector (dark electrons) in the secluded dark matter scenario. The findings underscore the need for alternative explanations and offer fresh perspectives on the ongoing quest to understand dark matter and its interactions since they are nearly independent of the dark electron fraction content for the total dark matter. This analysis significantly narrows down the parameter space for thermal dark matter scenarios involving a dark photon portal, reinforcing the urgency of exploring alternative models and designing new experiments to unravel the mysteries surrounding the nature of dark matter.


title: A simultaneous solution to the Hubble tension and observed bulk flow within 250 ${h^{-1}}$ Mpc

abstract: The $\Lambda$ cold dark matter ($\Lambda$CDM) standard cosmological model is in severe tension with several cosmological observations. Foremost is the Hubble tension, which exceeds $5\sigma$ confidence. Galaxy number counts show the Keenan-Barger-Cowie (KBC) supervoid, a significant underdensity out to 300~Mpc that cannot be reconciled with $\Lambda$CDM cosmology. Haslbauer et al. previously showed that a high local Hubble constant arises naturally due to gravitationally driven outflows from the observed KBC supervoid. The main prediction of this model is that peculiar velocities are typically much larger than expected in the $\Lambda$CDM framework. This agrees with the recent discovery by Watkins et al. that galaxies in the CosmicFlows-4 catalogue have significantly faster bulk flows than expected in the $\Lambda$CDM model on scales of $100-250 \, h^{-1}$~Mpc. The rising bulk flow curve is unexpected in standard cosmology, causing $4.8\sigma$ tension at $200 \, h^{-1}$~Mpc. In this work, we determine what the semi-analytic void model of Haslbauer et al. predicts for the bulk flows on these scales. We find qualitative agreement with the observations, especially if our vantage point is chosen to match the observed bulk flow on a scale of $50 \, h^{-1}$~Mpc. This represents a highly non-trivial success of a previously published model that was not constrained by bulk flow measurements, but which was shown to solve the Hubble tension and explain the KBC void consistently with the peculiar velocity of the Local Group. Our results suggest that several cosmological tensions can be simultaneously resolved if structure grows more efficiently than in the $\Lambda$CDM paradigm on scales of tens to hundreds of Mpc.


title: Bounding the Dimension-5 Seesaw Portal with Non-Pointing Photon Searches

abstract: The addition of $d=5$ operators to the Seesaw model leads to the Dimension-5 Seesaw Portal. Here, two new operators provide interactions for the heavy sterile neutrinos. In particular, the Higgs boson can have a large branching ratio into two heavy neutrinos, meaning that these states can be searched for at the LHC. Moreover, the heavy neutrinos can now decay dominantly into light neutrinos and photons. If the heavy neutrinos are long-lived, then searches for delayed, non-pointing photons can constrain the model. In this work, we carry out a detailed recast of an ATLAS search for such displaced photons, triggered by a charged lepton produced in association to the Higgs, placing bounds on the branching ratio for Higgs decay into two heavy neutrinos as low as 2%.


title: On the IR Divergences in de Sitter Space: loops, resummation and the semi-classical wavefunction

abstract: In this paper, we revisit the infrared (IR) divergences in de Sitter (dS) space using the wavefunction method, and explicitly explore how the resummation of higher-order loops leads to the stochastic formalism. In light of recent developments of the cosmological bootstrap, we track the behaviour of these nontrivial IR effects from perturbation theory to the non-perturbative regime. Specifically, we first examine the perturbative computation of wavefunction coefficients, and show that there is a clear distinction between classical components from tree-level diagrams and quantum ones from loop processes. Cosmological correlators at loop level receive contributions from tree-level wavefunction coefficients, which we dub classical loops. This distinction significantly simplifies the analysis of loop-level IR divergences, as we find the leading contributions always come from these classical loops. Then we compare with correlators from the perturbative stochastic computation, and find the results there are essentially the ones from classical loops, while quantum loops are only present as subleading corrections. This demonstrates that the leading IR effects are contained in the semi-classical wavefunction which is a resummation of all the tree-level diagrams. With this insight, we go beyond perturbation theory and present a new derivation of the stochastic formalism using the saddle-point approximation. We show that the Fokker-Planck equation follows as a consequence of two effects: the drift from the Schr\"odinger equation that describes the bulk time evolution, and the diffusion from the Polchinski's equation which corresponds to the exact renormalization group flow of the coarse-grained theory on the boundary. Our analysis highlights the precise and simple link between the stochastic formalism and the semi-classical wavefunction.


title: Sachdev-Ye-Kitaev model on a noisy quantum computer

abstract: We study the SYK model -- an important toy model for quantum gravity on IBM's superconducting qubit quantum computers. By using a graph-coloring algorithm to minimize the number of commuting clusters of terms in the qubitized Hamiltonian, we find the gate complexity of the time evolution using the first-order product formula for $N$ Majorana fermions is $\mathcal{O}(N^5 J^{2}t^2/\epsilon)$ where $J$ is the dimensionful coupling parameter, $t$ is the evolution time, and $\epsilon$ is the desired precision. With this improved resource requirement, we perform the time evolution for $N=6, 8$ with maximum two-qubit circuit depth of 343. We perform different error mitigation schemes on the noisy hardware results and find good agreement with the exact diagonalization results on classical computers and noiseless simulators. In particular, we compute return probability after time $t$ and out-of-time order correlators (OTOC) which is a standard observable of quantifying the chaotic nature of quantum systems.


title: On Time-Dependent Backgrounds In 1+1 Dimensional String Theory

abstract: In perturbative string theory, one is generally interested in asymptotic observables, such as the S-matrix in flat spacetime, and boundary correlation functions in anti-de Sitter spacetime. However, there are backgrounds in which such observables do not exist. We study examples of such backgrounds in 1+1 dimensional string theory. In these examples, the Liouville wall accelerates and can become spacelike in the past and/or future. When that happens, the corresponding null infinity, at which the standard scattering states are defined, is shielded by the Liouville wall. We compute scattering and particle production amplitudes in these backgrounds in the region in parameter space where the wall remains timelike, and discuss the continuation of this picture to the spacelike regime. We also discuss the physics from the point of view of the dynamics of free fermions in backgrounds with a time-dependent Fermi surface.


title: Observational redshift from general spherically symmetric black holes

abstract: In this work, we obtain an expression for the total observational frequency shift of photons emitted by massive geodesic particles circularly orbiting a black hole in a general spherically symmetric background. Our general relations are presented in terms of the metric components and their derivatives that characterize the black hole parameters. As a concrete example of this general relativistic approach, a special case is studied by applying the formalism to a nonsingular black hole conformally related to the Schwarzchild solution that possesses a length scale parameter $l$ and an integer parameter $N$ in addition to the black hole mass. Besides, we express the nonsingular black hole mass in terms of the observational redshift/blueshift. Finally, we investigate the effects of the free parameters of the conformal gravity theory on the observational frequency shift and compare results with those of the standard Schwarzschild black hole.


title: Machine Learning the Operator Content of the Critical Self-Dual Ising-Higgs Gauge Model

abstract: We study the critical properties of the Ising-Higgs gauge theory in $(2+1)D$ along the self-dual line which have recently been a subject of debate. For the first time, using machine learning techniques, we determine the low energy operator content of the associated field theory. Our approach enables us to largely refute the existence of an emergent current operator and with it the standing conjecture that this transition is of the $XY^*$ universality class. We contrast these results with the ones obtained for the $(2+1)D$ Ashkin-Teller transverse field Ising model where we find the expected current operator. Our numerical technique extends the recently proposed Real-Space Mutual Information allowing us to extract sub-leading non-linear operators. This allows a controlled and computationally scalable approach to target CFT spectrum and discern universality classes beyond $(1+1)D$ from Monte Carlo data.

categories: cond-mat.str-el cond-mat.dis-nn cond-mat.stat-mech hep-lat hep-th


title: Constraining the Higgs Trilinear Coupling from an $SU(2)$ Quadruplet with Bounded-from-Below Conditions

abstract: Integrating out a heavy scalar can cause the Higgs trilinear coupling to deviate from its Standard Model value: a good example is provided by an $SU(2)$ quadruplet. Constraints on the full theory, however, can limit the size of the deviation. We show that the bounded-from-below conditions for the Standard Model extended by an $SU(2)$ quadruplet strongly constrain the $\mathbb{Z}_{2}$-breaking Higgs portal and can bound the Higgs trilinear coupling close to its Standard Model value. For TeV-scale quadruplet masses in models with custodial symmetry violation, these constraints can be a few times stronger than constraints from electroweak precision measurements. For the custodial quadruplet, these are the strongest theoretical constraints available.


title: Filament formation due to diffusive instabilities in dusty protoplanetary disks

abstract: We report the finding of a new, local diffusion instability in a protoplanetary disk, which can operate in a dust fluid, subject to mass diffusion, shear viscosity, and dust-gas drag, provided diffusivity, viscosity, or both decrease sufficiently rapidly with increasing dust surface mass density. We devise a vertically averaged, axisymmetric hydrodynamic model to describe a dense, mid-plane dust layer in a protoplanetary disk. The gas is modeled as a passive component, imposing an effective, diffusion-dependent pressure, mass diffusivity, and viscosity onto the otherwise collisionless dust fluid, via turbulence excited by the gas alone, or dust and gas in combination. In particular, we argue that such conditions are met when the dust-gas mixture generates small-scale turbulence through the streaming instability, as supported by recent measurements of dust mass diffusion slopes in simulations. We hypothesize that the newly discovered instability may be the origin of filamentary features, almost ubiquitously found in simulations of the streaming instability. In addition, our model allows for growing oscillatory modes, which operate in a similar fashion as the axisymmetric viscous overstability in dense planetary rings. However, it remains speculative if the required conditions for such modes can be met in protoplanetary disks.


title: GausSN: Bayesian Time-Delay Estimation for Strongly Lensed Supernovae

abstract: We present GausSN, a Bayesian semi-parametric Gaussian Process (GP) model for time-delay estimation with resolved systems of gravitationally lensed supernovae (glSNe). GausSN models the underlying light curve non-parametrically using a GP. Without assuming a template light curve for each SN type, GausSN fits for the time delays of all images using data in any number of wavelength filters simultaneously. We also introduce a novel time-varying magnification model to capture the effects of microlensing alongside time-delay estimation. In this analysis, we model the time-varying relative magnification as a sigmoid function, as well as a constant for comparison to existing time-delay estimation approaches. We demonstrate that GausSN provides robust time-delay estimates for simulations of glSNe from the Nancy Grace Roman Space Telescope and the Vera C. Rubin Observatory's Legacy Survey of Space and Time (Rubin-LSST). We find that up to 43.6% of time-delay estimates from Roman and 52.9% from Rubin-LSST have fractional errors of less than 5%. We then apply GausSN to SN Refsdal and find the time delay for the fifth image is consistent with the original analysis, regardless of microlensing treatment. Therefore, GausSN maintains the level of precision and accuracy achieved by existing time-delay extraction methods with fewer assumptions about the underlying shape of the light curve than template-based approaches, while incorporating microlensing into the statistical error budget rather than requiring post-processing to account for its systematic uncertainty. GausSN is scalable for time-delay cosmography analyses given current projections of glSNe discovery rates from Rubin-LSST and Roman.


title: Confinement and D5 branes

abstract: In this work we present new solutions of type IIB supergravity based on wrapped D5 branes. We propose that two of these backgrounds are holographically dual to Quantum Field Theories that confine. The high energy regime of the field theories is that of a Little String Theory. We study various observables (Wilson and 't Hooft loops, Entanglement entropy, density of degrees of freedom and the spectrum of spin-two glueballs, among others). We also present two new black membrane backgrounds and analyse some thermodynamic aspects of these solutions.


title: Spherically symmetric vacuum solutions in 1-Parameter New General Relativity and their phenomenology

abstract: In this work, we study spherically symmetric vacuum solutions in 1-parameter New General Relativity (NGR), a specific theory in teleparallel gravity which is constructed from the three possible quadratic scalars obtained from torsion with arbitrary coefficients satisfying the requirements for the absence of ghosts. In this class of modified theories of gravity, the observable effects of gravity result from the torsion rather than the curvature of the spacetime. Unlike in GR, where the fundamental quantity is the metric from which the Levi-Civita connection is derived, in teleparallel theories of gravity the fundamental variable is the tetrad, from which one constructs the metric and the teleparallel connection. We consider the most general tetrad for spherical symmetry and we derive the corresponding field equations. Under adequate assumptions, we find three different branches of vacuum solutions and discuss their associated phenomenology. In particular, we analyze the photon sphere, the classical tests of GR such as the light deflection, the Shapiro delay, and the perihelion shift, and also the Komar mass, while providing a detailed comparison with their Schwarzschild spacetime counterparts. Finally, we analyze how the observational imprints from accretion disks and shadows are affected in comparison with their GR counterparts, and conclude that the free parameters of the model might induce additional attractive or repulsive effects to the propagation of photons, depending on their values.


title: The HI covering fraction of Lyman Limit Systems in FIRE haloes

abstract: Atomic hydrogen (HI) serves a crucial role in connecting galactic-scale properties such as star formation with the large-scale structure of the Universe. While recent numerical simulations have successfully matched the observed covering fraction of HI near Lyman Break Galaxies (LBGs) and in the foreground of luminous quasars at redshifts $z \lesssim 3$, the low-mass end remains as-of-yet unexplored in observational and computational surveys. We employ a cosmological, hydrodynamical simulation (FIREbox) supplemented with zoom-in simulations (MassiveFIRE) from the Feedback In Realistic Environments (FIRE) project to investigate the HI covering fraction of Lyman Limit Systems ($N_{\mathrm{HI}} \gtrsim 10^{17.2}$ cm$^{-2}$) across a wide range of redshifts ($z=0-6$) and halo masses ($10^8-10^{13} M_{\odot}$ at $z=0$, $10^8-10^{11} M_{\odot}$ at $z=6$) in the absence of feedback from active galactic nuclei (AGN). We find that the covering fraction inside haloes exhibits a strong increase with redshift, with only a weak dependence on halo mass for higher-mass haloes. For massive haloes ($M_{\mathrm{vir}} \sim 10^{11}-10^{12} M_{\odot}$), the radial profiles showcase scale-invariance and remain independent of mass. The radial dependence is well-captured by a fitting function. The covering fractions in our simulations are in good agreement with measurements of the covering fraction in LBGs. Our comprehensive analysis unveils a complex dependence with redshift and halo mass for haloes with $M_{\mathrm{vir}} \lesssim 10^{10} M_{\odot}$ that future observations aim to constrain, providing key insights into the physics of structure formation and gas assembly.


title: Numerical testing of mirror diffusion of cosmic rays

abstract: The tension between recent observations and theories on cosmic ray (CR) diffusion necessitates exploration of new CR diffusion mechanisms. We perform the first numerical study on the mirror diffusion of CRs that is recently proposed by Lazarian & Xu (2021). We demonstrate that the perpendicular superdiffusion of turbulent magnetic fields and magnetic mirroring that naturally arise in magnetohydrodynamic (MHD) turbulence are the two essential physical ingredients for the mirror diffusion to happen. In supersonic, subsonic, and incompressible MHD turbulence, with the pitch angles of CRs repeatedly crossing $90^\circ$ due to the mirror reflection, we find that the mirror diffusion strongly enhances the confinement of CRs, and their pitch-angle-dependent parallel mean free path can be much smaller than the injection scale of turbulence. With the stochastic change of pitch angles due to gyroresonant scattering, CRs stochastically undergo slow mirror diffusion at relatively large pitch angles and fast scattering diffusion at smaller pitch angles, resulting in a L\'{e}vy-flight-like propagation.


title: Echoes in the Noise: Posterior Samples of Faint Galaxy Surface Brightness Profiles with Score-Based Likelihoods and Priors

abstract: Examining the detailed structure of galaxy populations provides valuable insights into their formation and evolution mechanisms. Significant barriers to such analysis are the non-trivial noise properties of real astronomical images and the point spread function (PSF) which blurs structure. Here we present a framework which combines recent advances in score-based likelihood characterization and diffusion model priors to perform a Bayesian analysis of image deconvolution. The method, when applied to minimally processed \emph{Hubble Space Telescope} (\emph{HST}) data, recovers structures which have otherwise only become visible in next-generation \emph{James Webb Space Telescope} (\emph{JWST}) imaging.


title: Subsystem CSS codes, a tighter stabilizer-to-CSS mapping, and Goursat's Lemma

abstract: The CSS code construction is a powerful framework used to express features of a quantum code in terms of a pair of underlying classical codes. Its subsystem extension allows for similar expressions, but the general case has not been fully explored. Extending previous work of Aly et. al. [quant-ph/0610153], we determine subsystem CSS code parameters, express codewords, and develop a Steane-type decoder using only data from the two underlying classical codes. We show that any subsystem stabilizer code can be ``doubled'' to yield a subsystem CSS code with twice the number of physical, logical, and gauge qudits and up to twice the code distance. This mapping preserves locality and is tighter than the Majorana-based mapping of Bravyi, Leemhuis, and Terhal [New J. Phys. 12 083039 (2010)]. Using Goursat's Lemma, we show that every subsystem stabilizer code can be constructed from two nested subsystem CSS codes satisfying certain constraints, and we characterize subsystem stabilizer codes based on the nested codes' properties.


title: A closer look at the $U(1)_{B-L}$ explanation of the ATOMKI nuclear anomalies

abstract: We revisit the gauged $U(1)_{B-L}$ explanation of the ATOMKI nuclear anomalies, in which the new gauge boson is the hypothetical $X(17)$ particle. It is known that the vanilla $B-L$ scenario is unable to account for appropriate couplings, namely the suppression of the couplings of $X(17)$ to neutrinos, which motivates adding vector-like leptons. The simplest case, in which the new fields have $B-L$ charges equal to $1$, is highly disfavoured since it requires large mixing with the Standard Model fields. One solution recently put forward is to consider large $B-L$ charges to counterbalance small mixing. We show that, in this scenario, and after taking into account several phenomenological constraints, the dominant contribution to the muon anomalous magnetic moment $(g-2)_\mu$ is expected to be extremely large and with a negative sign, being thus excluded by experiment.


title: Exact fixed-point tensor network construction for rational conformal field theory

abstract: The novel concept of entanglement renormalization and its corresponding tensor network renormalization technique have been highly successful in developing a controlled real space renormalization group (RG) scheme. Numerically approximate fixed-point (FP) tensors are widely used to extract the conformal data of the underlying conformal field theory (CFT) describing critical phenomena. In this paper, we present an explicit analytical construction of the FP tensor for 2D rational CFT. We define it as a correlation function between the "boundary-changing operators" on triangles. Our construction fully captures all the real-space RG conditions. We also provide a concrete example using the Ising model to compute the scaling dimensions explicitly based on the corresponding FP tensor. Interestingly, our construction of FP tensors is closely related to a strange correlator, where the holographic picture naturally emerges. Our results also open a new door towards understanding CFT in higher dimensions.


title: Digging into the Interior of Hot Cores with ALMA: Spiral Accretion into the High-mass Protostellar Core G336.01-0.82

abstract: We observed the high-mass star-forming core G336.01-0.82 at 1.3 mm and 0.05'' (~150 au) angular resolution with the Atacama Large Millimeter/submillimeter Array (ALMA) as part of the Digging into the Interior of Hot Cores with ALMA (DIHCA) survey. These high-resolution observations reveal two spiral streamers feeding a circumstellar disk at opposite sides in great detail. Molecular line emission from CH$_3$OH shows velocity gradients along the streamers consistent with infall. Similarly, a flattened envelope model with rotation and infall implies a mass larger than 10 M$_\odot$ for the central source and a centrifugal barrier of 300 au. The location of the centrifugal barrier is consistent with local peaks in the continuum emission. We argue that gas brought by the spiral streamers is accumulating at the centrifugal barrier, which can result in future accretion burst events. A total high infall rate of ~$4\times10^{-4}$ M$_\odot$ yr$^{-1}$ is derived by matching models to the observed velocity gradient along the streamers. Their contribution account for 20-50% the global infall rate of the core, indicating streamers play an important role in the formation of high-mass stars.


title: Towards out-of-distribution generalization in large-scale astronomical surveys: robust networks learn similar representations

abstract: The generalization of machine learning (ML) models to out-of-distribution (OOD) examples remains a key challenge in extracting information from upcoming astronomical surveys. Interpretability approaches are a natural way to gain insights into the OOD generalization problem. We use Centered Kernel Alignment (CKA), a similarity measure metric of neural network representations, to examine the relationship between representation similarity and performance of pre-trained Convolutional Neural Networks (CNNs) on the CAMELS Multifield Dataset. We find that when models are robust to a distribution shift, they produce substantially different representations across their layers on OOD data. However, when they fail to generalize, these representations change less from layer to layer on OOD data. We discuss the potential application of similarity representation in guiding model design, training strategy, and mitigating the OOD problem by incorporating CKA as an inductive bias during training.


title: Using Mg II Doublet to Predict the Lyman Continuum Escape Fraction from 14 HETDEX Galaxies

abstract: Indirect diagnostics of Lyman continuum (LyC) escape are needed to constrain which sources reionized the universe. We used Mg II to predict the LyC escape fraction (fesc(LyC)) in 14 galaxies selected from the Hobby-Eberly Telescope Dark Energy Experiment solely based upon their Mg II properties. Using the Low Resolution Spectrograph on HET, we identified 7 and 5 possible LyC leakers depending on the method, with fesc(LyC) ranging from 3 to 80%. Interestingly, our targets display diverse [O III]/[O II] ratios (O32), with strong inferred LyC candidates showing lower O32 values than previous confirmed LyC leaker samples. Additionally, a correlation between dust and fesc(LyC) was identified. Upcoming Hubble Space Telescope/Cosmic Origins Spectrograph LyC observations of our sample will test if Mg II and dust are predictors of fesc(LyC), providing insights for future JWST studies of high-redshift galaxies.


title: Calibration and evaluation of a motion measurement system for PET imaging studies

abstract: Positron Emission Tomography (PET) enables functional imaging of deep brain structures, but the bulk and weight of current systems preclude their use during many natural human activities, such as locomotion. The proposed long-term solution is to construct a robotic system that can support an imaging system surrounding the subject's head, and then move the system to accommodate natural motion. This requires a system to measure the motion of the head with respect to the imaging ring, for use by both the robotic system and the image reconstruction software. We report here the design, calibration, and experimental evaluation of a parallel string encoder mechanism for sensing this motion. Our results indicate that with kinematic calibration, the measurement system can achieve accuracy within 0.5mm, especially for small motions.