title: Detail-Enhancing Framework for Reference-Based Image Super-Resolution

abstract: Recent years have witnessed the prosperity of reference-based image super-resolution (Ref-SR). By importing the high-resolution (HR) reference images into the single image super-resolution (SISR) approach, the ill-posed nature of this long-standing field has been alleviated with the assistance of texture transferred from reference images. Although the significant improvement in quantitative and qualitative results has verified the superiority of Ref-SR methods, the presence of misalignment before texture transfer indicates room for further performance improvement. Existing methods tend to neglect the significance of details in the context of comparison, therefore not fully leveraging the information contained within low-resolution (LR) images. In this paper, we propose a Detail-Enhancing Framework (DEF) for reference-based super-resolution, which introduces the diffusion model to generate and enhance the underlying detail in LR images. If corresponding parts are present in the reference image, our method can facilitate rigorous alignment. In cases where the reference image lacks corresponding parts, it ensures a fundamental improvement while avoiding the influence of the reference image. Extensive experiments demonstrate that our proposed method achieves superior visual results while maintaining comparable numerical outcomes.


title: Dynamic Mueller matrix polarimetry using generalized measurements

abstract: Mueller matrices provide a complete description of a medium's response to excitation by polarized light, and their characterization is important across a broad range of applications from ellipsometry in material science to polarimetry in biochemistry, medicine and astronomy. Here we introduce single-shot Mueller matrix polarimetry based on generalized measurements performed with a Poincar\'e beam. We determine the Mueller matrix of a homogeneous medium with unknown optical activity by detecting its optical response to a Poincar\'e beam, which across its profile contains all polarization states, and analyze the resulting polarization pattern in terms of four generalized measurements, which are implemented as a path-displaced Sagnac interferometer. We illustrate the working of our Mueller matrix polarimetry on the example of tilted and rotated wave plates and find excellent agreement with predictions as well as alternative Stokes measurements. After initial calibration, the alignment of the device stays stable for up to 8 hours, promising suitability for the dynamic characterization of Mueller matrices that change in time.


title: Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

abstract: Activity and parameter sparsity are two standard methods of making neural networks computationally more efficient. Event-based architectures such as spiking neural networks (SNNs) naturally exhibit activity sparsity, and many methods exist to sparsify their connectivity by pruning weights. While the effect of weight pruning on feed-forward SNNs has been previously studied for computer vision tasks, the effects of pruning for complex sequence tasks like language modeling are less well studied since SNNs have traditionally struggled to achieve meaningful performance on these tasks. Using a recently published SNN-like architecture that works well on small-scale language modeling, we study the effects of weight pruning when combined with activity sparsity. Specifically, we study the trade-off between the multiplicative efficiency gains the combination affords and its effect on task performance for language modeling. To dissect the effects of the two sparsities, we conduct a comparative analysis between densely activated models and sparsely activated event-based models across varying degrees of connectivity sparsity. We demonstrate that sparse activity and sparse connectivity complement each other without a proportional drop in task performance for an event-based neural network trained on the Penn Treebank and WikiText-2 language modeling datasets. Our results suggest sparsely connected event-based neural networks are promising candidates for effective and efficient sequence modeling.


title: Quantum algorithms for N-1 security in power grids

abstract: In recent years, the supply and demand of electricity has significantly increased. As a result, the interconnecting grid infrastructure has required (and will continue to require) further expansion, while allowing for rapid resolution of unforeseen failures. Energy grid operators strive for networks that satisfy different levels of security requirements. In the case of N-1 security for medium voltage networks, the goal is to ensure the continued provision of electricity in the event of a single-link failure. However, the process of determining if networks are N-1 secure is known to scale polynomially in the network size. This poses restrictions if we increase our demand of the network. In that case, more computationally hard cases will occur in practice and the computation time also increases significantly. In this work, we explore the potential of quantum computers to provide a more scalable solution. In particular, we consider gate-based quantum computing, quantum annealing, and photonic quantum computing.


title: CultiVerse: Towards Cross-Cultural Understanding for Paintings with Large Language Model

abstract: The integration of new technology with cultural studies enhances our understanding of cultural heritage but often struggles to connect with diverse audiences. It is challenging to align personal interpretations with the intended meanings across different cultures. Our study investigates the important factors in appreciating art from a cross-cultural perspective. We explore the application of Large Language Models (LLMs) to bridge the cultural and language barriers in understanding Traditional Chinese Paintings (TCPs). We present CultiVerse, a visual analytics system that utilizes LLMs within a mixed-initiative framework, enhancing interpretative appreciation of TCP in a cross-cultural dialogue. CultiVerse addresses the challenge of translating the nuanced symbolism in art, which involves interpreting complex cultural contexts, aligning cross-cultural symbols, and validating cultural acceptance. CultiVerse integrates an interactive interface with the analytical capability of LLMs to explore a curated TCP dataset, facilitating the analysis of multifaceted symbolic meanings and the exploration of cross-cultural serendipitous discoveries. Empirical evaluations affirm that CultiVerse significantly improves cross-cultural understanding, offering deeper insights and engaging art appreciation.


title: Porting HPC Applications to AMD Instinct$^\text{TM}$ MI300A Using Unified Memory and OpenMP

abstract: AMD Instinct$^\text{TM}$ MI300A is the world's first data center accelerated processing unit (APU) with memory shared between the AMD "Zen 4" EPYC$^\text{TM}$ cores and third generation CDNA$^\text{TM}$ compute units. A single memory space offers several advantages: i) it eliminates the need for data replication and costly data transfers, ii) it substantially simplifies application development and allows an incremental acceleration of applications, iii) is easy to maintain, and iv) its potential can be well realized via the abstractions in the OpenMP 5.2 standard, where the host and the device data environments can be unified in a more performant way. In this article, we provide a blueprint of the APU programming model leveraging unified memory and highlight key distinctions compared to the conventional approach with discrete GPUs. OpenFOAM, an open-source C++ library for computational fluid dynamics, is presented as a case study to emphasize the flexibility and ease of offloading a full-scale production-ready application on MI300 APUs using directive-based OpenMP programming.


title: Reduced-order modeling for second-order computational homogenization with applications to geometrically parameterized elastomeric metamaterials

abstract: The structural properties of mechanical metamaterials are typically studied with two-scale methods based on computational homogenization. Because such materials have a complex microstructure, enriched schemes such as second-order computational homogenization are required to fully capture their non-linear behavior, which arises from non-local interactions due to the buckling or patterning of the microstructure. In the two-scale formulation, the effective behavior of the microstructure is captured with a representative volume element (RVE), and a homogenized effective continuum is considered on the macroscale. Although an effective continuum formulation is introduced, solving such two-scale models concurrently is still computationally demanding due to the many repeated solutions for each RVE at the microscale level. In this work, we propose a reduced-order model for the microscopic problem arising in second-order computational homogenization, using proper orthogonal decomposition and a novel hyperreduction method that is specifically tailored for this problem and inspired by the empirical cubature method. Two numerical examples are considered, in which the performance of the reduced-order model is carefully assessed by comparing its solutions with direct numerical simulations (entirely resolving the underlying microstructure) and the full second-order computational homogenization model. The reduced-order model is able to approximate the result of the full computational homogenization well, provided that the training data is representative for the problem at hand. Any remaining errors, when compared with the direct numerical simulation, can be attributed to the inherent approximation errors in the computational homogenization scheme. Regarding run times for one thread, speed-ups on the order of 100 are achieved with the reduced-order model as compared to direct numerical simulations.


title: MetaRM: Shifted Distributions Alignment via Meta-Learning

abstract: The success of Reinforcement Learning from Human Feedback (RLHF) in language model alignment is critically dependent on the capability of the reward model (RM). However, as the training process progresses, the output distribution of the policy model shifts, leading to the RM's reduced ability to distinguish between responses. This issue is further compounded when the RM, trained on a specific data distribution, struggles to generalize to examples outside of that distribution. These two issues can be united as a challenge posed by the shifted distribution of the environment. To surmount this challenge, we introduce MetaRM, a method leveraging meta-learning to align the RM with the shifted environment distribution. MetaRM is designed to train the RM by minimizing data loss, particularly for data that can improve the differentiation ability to examples of the shifted target distribution. Extensive experiments demonstrate that MetaRM significantly improves the RM's distinguishing ability in iterative RLHF optimization, and also provides the capacity to identify subtle differences in out-of-distribution samples.


title: Fractional domain wall statistics in spin chains with anomalous symmetries

abstract: We study the statistics of domain wall excitations in quantum spin chains. We focus on systems with finite symmetry groups represented by matrix product unitaries (MPUs), i.e. finite depth quantum circuits. Such symmetries can be anomalous, in which case gapped phases which they support must break the symmetry. The lowest lying excitations of those systems are thus domain wall excitations. We investigate the behavior of these domain walls under exchange, and find that they can exhibit non-trivial exchange statistics. This statistics is completely determined by the anomaly of the symmetry, and we provide a direct relation between the known classification of MPU symmetry actions on ground states and the domain wall statistics. Already for the simplest case of a $\mathbb Z_2$ symmetry, we obtain that the presence of an anomalous MPU symmetry gives rise to domain wall excitations which behave neither as bosons nor as fermions, but rather exhibit fractional statistics. Finally, we show that the exchange statistics of domain walls is a physically accessible quantity, by devising explicit measurement operators through which it can be determined.


title: Intersection Types via Finite-Set Declarations

abstract: The lambda-cube is a famous pure type system (PTS) cube of eight powerful explicit type systems that include the simple, polymorphic and dependent type theories. The lambda-cube only types Strongly Normalising (SN) terms but not all of them. It is well known that even the most powerful system of the lambda-cube can only type the same pure untyped lambda-terms that are typable by the higher-order polymorphic implicitly typed lambda-calculus Fomega, and that there is an untyped {\lambda}-term U' that is SN but is not typable in Fomega or the lambda-cube. Hence, neither system can type all the SN terms it expresses. In this paper, we present the f-cube, an extension of the lambda-cube with finite-set declarations (FSDs) like y\in{C1,...,Cn} : B which means that y is of type B and can only be one of C1,..., Cn. The novelty of our FSDs is that they allow to represent intersection types as Pi-types. We show how to translate and type the term U' in the f-cube using an encoding of intersection types based on FSDs. Notably, our translation works without needing anything like the usual troublesome intersection-introduction rule that proves a pure untyped lambda-term M has an intersection of k types using k independent sub-derivations. As such, our approach is useful for language implementers who want the power of intersection types without the pain of the intersection-introduction rule.


title: Modeling Linear and Non-linear Layers: An MILP Approach Towards Finding Differential and Impossible Differential Propagations

abstract: Symmetric key cryptography stands as a fundamental cornerstone in ensuring security within contemporary electronic communication frameworks. The cryptanalysis of classical symmetric key ciphers involves traditional methods and techniques aimed at breaking or analyzing these cryptographic systems. In the evaluation of new ciphers, the resistance against linear and differential cryptanalysis is commonly a key design criterion. The wide trail design technique for block ciphers facilitates the demonstration of security against linear and differential cryptanalysis. Assessing the scheme's security against differential attacks often involves determining the minimum number of active SBoxes for all rounds of a cipher. The propagation characteristics of a cryptographic component, such as an SBox, can be expressed using Boolean functions. Mixed Integer Linear Programming (MILP) proves to be a valuable technique for solving Boolean functions. We formulate a set of inequalities to model a Boolean function, which is subsequently solved by an MILP solver. To efficiently model a Boolean function and select a minimal set of inequalities, two key challenges must be addressed. We propose algorithms to address the second challenge, aiming to find more optimized linear and non-linear components. Our approaches are applied to modeling SBoxes (up to six bits) and EXOR operations with any number of inputs. Additionally, we introduce an MILP-based automatic tool for exploring differential and impossible differential propagations within a cipher. The tool is successfully applied to five lightweight block ciphers: Lilliput, GIFT64, SKINNY64, Klein, and MIBS.


title: Geometric Insights into Focal Loss: Reducing Curvature for Enhanced Model Calibration

abstract: The key factor in implementing machine learning algorithms in decision-making situations is not only the accuracy of the model but also its confidence level. The confidence level of a model in a classification problem is often given by the output vector of a softmax function for convenience. However, these values are known to deviate significantly from the actual expected model confidence. This problem is called model calibration and has been studied extensively. One of the simplest techniques to tackle this task is focal loss, a generalization of cross-entropy by introducing one positive parameter. Although many related studies exist because of the simplicity of the idea and its formalization, the theoretical analysis of its behavior is still insufficient. In this study, our objective is to understand the behavior of focal loss by reinterpreting this function geometrically. Our analysis suggests that focal loss reduces the curvature of the loss surface in training the model. This indicates that curvature may be one of the essential factors in achieving model calibration. We design numerical experiments to support this conjecture to reveal the behavior of focal loss and the relationship between calibration performance and curvature.


title: $1/f^{\alpha}$ noise in the Robin Hood model

abstract: We consider the Robin Hood dynamics, a one-dimensional extremal self-organized critical model that describes the evolution of low-temperature creep. One of the key quantities is the time evolution of the state variable (force noise). To understand the temporal correlations, we compute the power spectra of the local force fluctuations and apply finite-size scaling to get scaling functions and critical exponents. We find a signature of the $1/f^{\alpha}$ noise for the local force with a nontrivial value of the spectral exponent $0< \alpha < 2$. We also examine temporal fluctuations in the position of the extremal site and a local activity signal. We present results for different local interaction rules of the model.


title: Study of vector and axial-vector form factors and the decay parameters for the semileptonic hyperon decays

abstract: Using the standard parametrization of the dipole form, we have studied the vulnerability of $Q^2$ on the vector form factors ($f_i^{B_iB_f}(Q^2)$) and axial-vector form factors ($g_i^{B_iB_f}(Q^2)$), $i=1,2,3$ computed for the semileptonic $B_i \rightarrow B_f l \bar{\nu}$ decays for hyperons in the framework of chiral constituent quark model ($\chi$CQM). Both, strangeness changing as well as strangeness conserving decays have been examined. We also present the dependence of the ratio of hyperon semileptonic decay constants $g_1(Q^2)/f_1(Q^2)$ for these decays. Further, we calculate the CKM matrix elements $V_{ud}$ from strangeness conserving and $V_{us}$ from strangeness changing hyperon decays.


title: Transverse distortion and single-spin asymmetries for low-lying octet baryons

abstract: Being the fountainhead of transverse distortion and asymmetries in accordance to $``SSA=GPD \ast FSI\,"$, we study the spin flip generalized parton distribution. We demonstrate this transverse deformation by using the quark-scalar diquark model and unveil a comparison among the low-lying strange baryons for distinct feasible combinations of quark-diquark pairs. Final-state interaction originating the correlation of a target spin and a virtual photon to the generated pion plane in semi-inclusive deep inelastic scattering has also been analyzed.


title: Quark spin-orbit correlations in spin-0 and spin-1 mesons using the light-front quark model

abstract: We have investigated the spin-orbital angular momentum correlations for the active quark inside the light and heavy mesons for both the spin-0 and spin-1 cases. These correlations can be derived from the generalised transverse momentum dependent distributions (GTMDs) as well as the generalised parton distributions (GPDs). We employ the overlap representation of light-front wave functions in the light-front quark model (LFQM) to calculate our analytical results. The dependence of spin-orbit correlations (SOCs) on the longitudinal momentum fraction $x$ as well as the transverse momentum dependence $\mathbf{k}_{\perp}$ has been graphically presented. Even though the SOCs have already been studied for the spin-0 pions and kaons in other approaches, no calculations for the other light and heavy spin-0 mesons have been reported in literature. Further, the correlations for any of the light and heavy spin-1 mesons have been studied for the first time in the present work.


title: A Modelling Framework for Energy-Management and Eco-Driving Problems using Convex Relaxations

abstract: This paper presents a convex optimization framework for eco-driving and vehicle energy management problems. We will first show that several types of eco-driving and vehicle energy management problems can be modelled using the same notions of energy storage buffers and energy storage converters that are connected to a power network. It will be shown that these problems can be formulated as optimization problems with linear cost functions and linear dynamics, and nonlinear constraints representing the power converters. We will show that under some mild conditions, the (non-convex) optimization problem has the same (globally) optimal solution as a convex relaxation. This means that the problems can be solved efficiently and that the solution is guaranteed to be globally optimal. Finally, a numerical example of the eco-driving problem is used to illustrate this claim.


title: MMTryon: Multi-Modal Multi-Reference Control for High-Quality Fashion Generation

abstract: This paper introduces MMTryon, a multi-modal multi-reference VIrtual Try-ON (VITON) framework, which can generate high-quality compositional try-on results by taking a text instruction and multiple garment images as inputs. Our MMTryon addresses three problems overlooked in prior literature: 1) Support of multiple try-on items. Existing methods are commonly designed for single-item try-on tasks (e.g., upper/lower garments, dresses). 2)Specification of dressing style. Existing methods are unable to customize dressing styles based on instructions (e.g., zipped/unzipped, tuck-in/tuck-out, etc.) 3) Segmentation Dependency. They further heavily rely on category-specific segmentation models to identify the replacement regions, with segmentation errors directly leading to significant artifacts in the try-on results. To address the first two issues, our MMTryon introduces a novel multi-modality and multi-reference attention mechanism to combine the garment information from reference images and dressing-style information from text instructions. Besides, to remove the segmentation dependency, MMTryon uses a parsing-free garment encoder and leverages a novel scalable data generation pipeline to convert existing VITON datasets to a form that allows MMTryon to be trained without requiring any explicit segmentation. Extensive experiments on high-resolution benchmarks and in-the-wild test sets demonstrate MMTryon's superiority over existing SOTA methods both qualitatively and quantitatively. MMTryon's impressive performance on multi-item and style-controllable virtual try-on scenarios and its ability to try on any outfit in a large variety of scenarios from any source image, opens up a new avenue for future investigation in the fashion community.


title: RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models

abstract: Prediction of road users' behaviors in the context of autonomous driving has gained considerable attention by the scientific community in the last years. Most works focus on predicting behaviors based on kinematic information alone, a simplification of the reality since road users are humans, and as such they are highly influenced by their surrounding context. In addition, a large plethora of research works rely on powerful Deep Learning techniques, which exhibit high performance metrics in prediction tasks but may lack the ability to fully understand and exploit the contextual semantic information contained in the road scene, not to mention their inability to provide explainable predictions that can be understood by humans. In this work, we propose an explainable road users' behavior prediction system that integrates the reasoning abilities of Knowledge Graphs (KG) and the expressiveness capabilities of Large Language Models (LLM) by using Retrieval Augmented Generation (RAG) techniques. For that purpose, Knowledge Graph Embeddings (KGE) and Bayesian inference are combined to allow the deployment of a fully inductive reasoning system that enables the issuing of predictions that rely on legacy information contained in the graph as well as on current evidence gathered in real time by onboard sensors. Two use cases have been implemented following the proposed approach: 1) Prediction of pedestrians' crossing actions; 2) Prediction of lane change maneuvers. In both cases, the performance attained surpasses the current state of the art in terms of anticipation and F1-score, showing a promising avenue for future research in this field.


title: Quantum Global Minimum Finder based on Variational Quantum Search

abstract: The search for global minima is a critical challenge across multiple fields including engineering, finance, and artificial intelligence, particularly with non-convex functions that feature multiple local optima, complicating optimization efforts. We introduce the Quantum Global Minimum Finder (QGMF), an innovative quantum computing approach that efficiently identifies global minima. QGMF combines binary search techniques to shift the objective function to a suitable position and then employs Variational Quantum Search to precisely locate the global minimum within this targeted subspace. Designed with a low-depth circuit architecture, QGMF is optimized for Noisy Intermediate-Scale Quantum (NISQ) devices, utilizing the logarithmic benefits of binary search to enhance scalability and efficiency. This work demonstrates the impact of QGMF in advancing the capabilities of quantum computing to overcome complex non-convex optimization challenges effectively.


title: Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning

abstract: We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte Carlo Tree Search (MCTS) to iteratively collect preference data, utilizing its look-ahead ability to break down instance-level rewards into more granular step-level signals. To enhance consistency in intermediate steps, we combine outcome validation and stepwise self-evaluation, continually updating the quality assessment of newly generated data. The proposed algorithm employs Direct Preference Optimization (DPO) to update the LLM policy using this newly generated step-level preference data. Theoretical analysis reveals the importance of using on-policy sampled data for successful self-improving. Extensive evaluations on various arithmetic and commonsense reasoning tasks demonstrate remarkable performance improvements over existing models. For instance, our approach outperforms the Mistral-7B Supervised Fine-Tuning (SFT) baseline on GSM8K, MATH, and ARC-C, with substantial increases in accuracy to $81.8\%$ (+$5.9\%$), $34.7\%$ (+$5.8\%$), and $76.4\%$ (+$15.8\%$), respectively. Additionally, our research delves into the training and inference compute tradeoff, providing insights into how our method effectively maximizes performance gains. Our code is publicly available at https://github.com/YuxiXie/MCTS-DPO.


title: Predictive Accuracy-Based Active Learning for Medical Image Segmentation

abstract: Active learning is considered a viable solution to alleviate the contradiction between the high dependency of deep learning-based segmentation methods on annotated data and the expensive pixel-level annotation cost of medical images. However, most existing methods suffer from unreliable uncertainty assessment and the struggle to balance diversity and informativeness, leading to poor performance in segmentation tasks. In response, we propose an efficient Predictive Accuracy-based Active Learning (PAAL) method for medical image segmentation, first introducing predictive accuracy to define uncertainty. Specifically, PAAL mainly consists of an Accuracy Predictor (AP) and a Weighted Polling Strategy (WPS). The former is an attached learnable module that can accurately predict the segmentation accuracy of unlabeled samples relative to the target model with the predicted posterior probability. The latter provides an efficient hybrid querying scheme by combining predicted accuracy and feature representation, aiming to ensure the uncertainty and diversity of the acquired samples. Extensive experiment results on multiple datasets demonstrate the superiority of PAAL. PAAL achieves comparable accuracy to fully annotated data while reducing annotation costs by approximately 50% to 80%, showcasing significant potential in clinical applications. The code is available at https://github.com/shijun18/PAAL-MedSeg.


title: Fuzzy Intelligent System for Student Software Project Evaluation

abstract: Developing software projects allows students to put knowledge into practice and gain teamwork skills. However, assessing student performance in project-oriented courses poses significant challenges, particularly as the size of classes increases. The current paper introduces a fuzzy intelligent system designed to evaluate academic software projects using object-oriented programming and design course as an example. To establish evaluation criteria, we first conducted a survey of student project teams (n=31) and faculty (n=3) to identify key parameters and their applicable ranges. The selected criteria - clean code, use of inheritance, and functionality - were selected as essential for assessing the quality of academic software projects. These criteria were then represented as fuzzy variables with corresponding fuzzy sets. Collaborating with three experts, including one professor and two course instructors, we defined a set of fuzzy rules for a fuzzy inference system. This system processes the input criteria to produce a quantifiable measure of project success. The system demonstrated promising results in automating the evaluation of projects. Our approach standardizes project evaluations and helps to reduce the subjective bias in manual grading.


title: Robust Semi-supervised Learning via $f$-Divergence and $\alpha$-R\'enyi Divergence

abstract: This paper investigates a range of empirical risk functions and regularization methods suitable for self-training methods in semi-supervised learning. These approaches draw inspiration from various divergence measures, such as $f$-divergences and $\alpha$-R\'enyi divergences. Inspired by the theoretical foundations rooted in divergences, i.e., $f$-divergences and $\alpha$-R\'enyi divergence, we also provide valuable insights to enhance the understanding of our empirical risk functions and regularization techniques. In the pseudo-labeling and entropy minimization techniques as self-training methods for effective semi-supervised learning, the self-training process has some inherent mismatch between the true label and pseudo-label (noisy pseudo-labels) and some of our empirical risk functions are robust, concerning noisy pseudo-labels. Under some conditions, our empirical risk functions demonstrate better performance when compared to traditional self-training methods.


title: The Maxwell evolution equation of electromagnetic resonators: a mathematical proof with explicit derivation

abstract: In a recent publication [1], the authors employ electromagnetic quasinormal-mode theory to establish an "exact" Maxwell evolution (EME) equation governing resonator dynamics. This resulting equation bears resemblance to the classical evolution equation proposed heuristically in the temporal coupled-mode theory (CMT), yet it also presents differences. One significant difference is that the driving force in the EME equation is proportional to the derivative of the incident field, whereas in the CMT evolution equation, it is proportional to the incident field itself. This unexpected finding was substantiated by a numerical test and a mathematical demonstration in [1]. The test remains undisputed in this study. However, the demonstration unfortunately relies on unjustified shortcuts. We promptly highlight these shortcuts while proposing an alternative demonstration that is direct and indisputable. The new demonstration provides a firm mathematical foundation for the EME equation and reinforces its credibility.


title: Counterfactual Explanations for Deep Learning-Based Traffic Forecasting

abstract: Deep learning models are widely used in traffic forecasting and have achieved state-of-the-art prediction accuracy. However, the black-box nature of those models makes the results difficult to interpret by users. This study aims to leverage an Explainable AI approach, counterfactual explanations, to enhance the explainability and usability of deep learning-based traffic forecasting models. Specifically, the goal is to elucidate relationships between various input contextual features and their corresponding predictions. We present a comprehensive framework that generates counterfactual explanations for traffic forecasting and provides usable insights through the proposed scenario-driven counterfactual explanations. The study first implements a deep learning model to predict traffic speed based on historical traffic data and contextual variables. Counterfactual explanations are then used to illuminate how alterations in these input variables affect predicted outcomes, thereby enhancing the transparency of the deep learning model. We investigated the impact of contextual features on traffic speed prediction under varying spatial and temporal conditions. The scenario-driven counterfactual explanations integrate two types of user-defined constraints, directional and weighting constraints, to tailor the search for counterfactual explanations to specific use cases. These tailored explanations benefit machine learning practitioners who aim to understand the model's learning mechanisms and domain experts who seek insights for real-world applications. The results showcase the effectiveness of counterfactual explanations in revealing traffic patterns learned by deep learning models, showing its potential for interpreting black-box deep learning models used for spatiotemporal predictions in general.


title: The Nucleus of a Compact Lie Group, and Support of Singularity Categories

abstract: In this paper we adapt the notion of the nucleus defined by Benson, Carlson, and Robinson to compact Lie groups in non-modular characteristic. We show that it describes the singularities of the projective scheme of the cohomology of its classifying space. A notion of support for singularity categories of ring spectra (in the sense of Greenlees and Stevenson) is established, and is shown to be precisely the nucleus in this case, consistent with a conjecture of Benson and Greenlees for finite groups.


title: Bulk-Boundary Correspondence in Ergodic and Nonergodic One-Dimensional Stochastic Processes

abstract: Bulk-boundary correspondence is a fundamental principle in topological physics. In recent years, there have been considerable efforts in extending the idea of geometry and topology to classical stochastic systems far from equilibrium. However, it has been unknown whether or not the bulk-boundary correspondence can be extended to the steady states of stochastic processes accompanied by additional constraints such as the conservation of probability. The present study reveals the general form of bulk-boundary correspondence in classical stochastic processes. Specifically, we prove a correspondence between the winding number and the number of localized steady states in both ergodic and nonergodic systems. Furthermore, we extend the argument of the bulk-boundary correspondence to a many-body stochastic model called the asymmetric simple exclusion process (ASEP). These results would provide a guiding principle for exploring topological origin of localization in various stochastic processes including biological systems.


title: U.S. Election Hardens Hate Universe

abstract: Local or national politics can trigger potentially dangerous hate in someone. But with a third of the world's population eligible to vote in elections in 2024 alone, we lack understanding of how individual-level hate multiplies up to hate behavior at the collective global scale. Here we show, based on the most recent U.S. election, that offline events are associated with a rapid adaptation of the global online hate universe that hardens (strengthens) both its network-of-networks structure and the 'flavors' of hate content that it collectively produces. Approximately 50 million potential voters in hate communities are drawn closer to each other and to the broad mainstream of approximately 2 billion others. It triggers new hate content at scale around immigration, ethnicity, and antisemitism that aligns with conspiracy theories about Jewish-led replacement before blending in hate around gender identity/sexual orientation, and religion. Telegram acts as a key hardening agent - yet is overlooked by U.S. Congressional hearings and new E.U. legislation. Because the hate universe has remained robust since 2020, anti-hate messaging surrounding not only upcoming elections but also other events like the war in Gaza, should pivot to blending multiple hate 'flavors' while targeting previously untouched social media structures.


title: Metallic local-moment magnetocalorics as a route to cryogenic refrigeration

abstract: Commercial adiabatic demagnetisation refrigerators still employ the same hydrated salts that were first introduced over 85 years ago. The inherent limitations of these insulating magnetocalorics - poor thermal conductivity at sub-Kelvin temperatures, low entropy density, corrosiveness - can be overcome by a new generation of rare-earth based metallic magnetocalorics. Here, we present the metallic magnetocaloric YbNi1.6 Sn as an attractive alternative to conventional refrigerants. YbNi1.6Sn retains high entropy into the 100 mK regime and avoids the noble metal constituents of alternative refrigerants. Demagnetisation tests demonstrate that YbNi1.6Sn enables economical and durable alternatives to traditional cooling devices for temperatures reaching below 120 mK. We find that the magnetocaloric properties of this material are facilitated by unusually small Kondo and RKKY interactions, which position YbNi1.6Sn in the extreme local moment limit on the generalised Kondo lattice phase diagram.


title: Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning

abstract: Ultrasound robots are increasingly used in medical diagnostics and early disease screening. However, current ultrasound robots lack the intelligence to understand human intentions and instructions, hindering autonomous ultrasound scanning. To solve this problem, we propose a novel Ultrasound Embodied Intelligence system that equips ultrasound robots with the large language model (LLM) and domain knowledge, thereby improving the efficiency of ultrasound robots. Specifically, we first design an ultrasound operation knowledge database to add expertise in ultrasound scanning to the LLM, enabling the LLM to perform precise motion planning. Furthermore, we devise a dynamic ultrasound scanning strategy based on a \textit{think-observe-execute} prompt engineering, allowing LLMs to dynamically adjust motion planning strategies during the scanning procedures. Extensive experiments demonstrate that our system significantly improves ultrasound scan efficiency and quality from verbal commands. This advancement in autonomous medical scanning technology contributes to non-invasive diagnostics and streamlined medical workflows.


title: Saturation Level of Ion Weibel Instability and Isotropization Length Scale in Electron-Ion Weibel-Mediated Shocks

abstract: Ion Weibel instability is considered to be the dominant physics for the dissipation in high-Mach number astrophysical shocks such as supernova remnant shocks and gamma-ray burst shocks. We study the instability dependence on various parameters using theory and particle-in-cell simulations. We demonstrate that electron physics determines the saturation level of the Weibel-generated magnetic field, even though the instability is driven by the ions. We discuss the application to astrophysical and laboratory laser experiment environments to clarify the roles of the ion Weibel instability. We develop a model for the isotropization length scale in Weibel-mediated shocks and compare its value to other characteristic length scales of each system. We find that electron heating to near equipartition is crucial for the formation of ultra-relativistic Weibel-mediated shocks. On the other hand, our results imply that non-relativistic shocks in typical interstellar medium are not purely mediated by the Weibel instability.


title: On the class of systems which are disjoint from every ergodic system

abstract: In this note we give a fairly direct proof of a recent theorem of Gorska, Lemanczyk and de la Rue which characterises the class of measure preserving transformations that are disjoint from every ergodic measure preserving transformation. Our proof works just as well for any countable acting group.


title: On the best constants of Schur multipliers of second order divided difference functions

abstract: We give a new proof of the boundedness of bilinear Schur multipliers of second order divided difference functions, as obtained earlier by Potapov, Skripka and Sukochev in their proof of Koplienko's conjecture on the existence of higher order spectral shift functions. Our proof is based on recent methods involving bilinear transference and the H\"ormander-Mikhlin-Schur multiplier theorem. Our approach provides a significant sharpening of the known asymptotic bounds of bilinear Schur multipliers of second order divided difference functions. Furthermore, we give a new lower bound of these bilinear Schur multipliers, giving again a fundamental improvement on the best known bounds obtained by Coine, Le Merdy, Potapov, Sukochev and Tomskova. More precisely, we prove that for $f \in C^2(\mathbb{R})$ and $1 < p, p_1, p_2 < \infty$ with $\frac{1}{p} = \frac{1}{p_1} + \frac{1}{p_2}$ we have \[ \Vert M_{f^{[2]}}: S_{p_1} \times S_{p_2} \rightarrow S_p \Vert \lesssim \Vert f'' \Vert_\infty D(p, p_1, p_2), \] where the constant $D(p, p_1, p_2)$ is specified in Theorem 7.1 and $D(p, 2p, 2p) \approx p^4 p^\ast$ with $p^\ast$ the H\"older conjugate of $p$. We further show that for $f(\lambda) = \lambda \vert \lambda \vert$, $\lambda \in \mathbb{R}$, for every $1 < p < \infty$ we have \[ p^2 p^\ast \lesssim \Vert M_{f^{[2]}}: S_{2p} \times S_{2p} \rightarrow S_p \Vert. \] Here $f^{[2]}$ is the second order divided difference function of $f$ with $M_{f^{[2]}}$ the associated Schur multiplier. In particular it follows that our estimate $D(p, 2p, 2p)$ is optimal for $p \searrow 1$.


title: BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine

abstract: Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations. Retrieval-augmented generation provided a solution for these models to update knowledge and enhance their performance. In contrast to previous retrieval-augmented LMs, which utilize specialized cross-attention mechanisms to help LLM encode retrieved text, BiomedRAG adopts a simpler approach by directly inputting the retrieved chunk-based documents into the LLM. This straightforward design is easily applicable to existing retrieval and language models, effectively bypassing noise information in retrieved documents, particularly in noise-intensive tasks. Moreover, we demonstrate the potential for utilizing the LLM to supervise the retrieval model in the biomedical domain, enabling it to retrieve the document that assists the LM in improving its predictions. Our experiments reveal that with the tuned scorer,\textsc{ BiomedRAG} attains superior performance across 5 biomedical NLP tasks, encompassing information extraction (triple extraction, relation extraction), text classification, link prediction, and question-answering, leveraging over 9 datasets. For instance, in the triple extraction task, \textsc{BiomedRAG} outperforms other triple extraction systems with micro-F1 scores of 81.42 and 88.83 on GIT and ChemProt corpora, respectively.


title: Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable

abstract: Foundational generative models should be traceable to protect their owners and facilitate safety regulation. To achieve this, traditional approaches embed identifiers based on supervisory trigger-response signals, which are commonly known as backdoor watermarks. They are prone to failure when the model is fine-tuned with nontrigger data. Our experiments show that this vulnerability is due to energetic changes in only a few 'busy' layers during fine-tuning. This yields a novel arbitrary-in-arbitrary-out (AIAO) strategy that makes watermarks resilient to fine-tuning-based removal. The trigger-response pairs of AIAO samples across various neural network depths can be used to construct watermarked subpaths, employing Monte Carlo sampling to achieve stable verification results. In addition, unlike the existing methods of designing a backdoor for the input/output space of diffusion models, in our method, we propose to embed the backdoor into the feature space of sampled subpaths, where a mask-controlled trigger function is proposed to preserve the generation performance and ensure the invisibility of the embedded backdoor. Our empirical studies on the MS-COCO, AFHQ, LSUN, CUB-200, and DreamBooth datasets confirm the robustness of AIAO; while the verification rates of other trigger-based methods fall from ~90% to ~70% after fine-tuning, those of our method remain consistently above 90%.


title: Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing

abstract: With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM routing for challenging reasoning tasks. Our extensive experiments suggest that such routing shows promise but is not feasible in all scenarios, so more robust approaches should be investigated to fill this gap.


title: Feature-Aware Noise Contrastive Learning For Unsupervised Red Panda Re-Identification

abstract: To facilitate the re-identification (Re-ID) of individual animals, existing methods primarily focus on maximizing feature similarity within the same individual and enhancing distinctiveness between different individuals. However, most of them still rely on supervised learning and require substantial labeled data, which is challenging to obtain. To avoid this issue, we propose a Feature-Aware Noise Contrastive Learning (FANCL) method to explore an unsupervised learning solution, which is then validated on the task of red panda re-ID. FANCL employs a Feature-Aware Noise Addition module to produce noised images that conceal critical features and designs two contrastive learning modules to calculate the losses. Firstly, a feature consistency module is designed to bridge the gap between the original and noised features. Secondly, the neural networks are trained through a cluster contrastive learning module. Through these more challenging learning tasks, FANCL can adaptively extract deeper representations of red pandas. The experimental results on a set of red panda images collected in both indoor and outdoor environments prove that FANCL outperforms several related state-of-the-art unsupervised methods, achieving high performance comparable to supervised learning methods.


title: Exploiting Positional Bias for Query-Agnostic Generative Content in Search

abstract: In recent years, neural ranking models (NRMs) have been shown to substantially outperform their lexical counterparts in text retrieval. In traditional search pipelines, a combination of features leads to well-defined behaviour. However, as neural approaches become increasingly prevalent as the final scoring component of engines or as standalone systems, their robustness to malicious text and, more generally, semantic perturbation needs to be better understood. We posit that the transformer attention mechanism can induce exploitable defects through positional bias in search models, leading to an attack that could generalise beyond a single query or topic. We demonstrate such defects by showing that non-relevant text--such as promotional content--can be easily injected into a document without adversely affecting its position in search results. Unlike previous gradient-based attacks, we demonstrate these biases in a query-agnostic fashion. In doing so, without the knowledge of topicality, we can still reduce the negative effects of non-relevant content injection by controlling injection position. Our experiments are conducted with simulated on-topic promotional text automatically generated by prompting LLMs with topical context from target documents. We find that contextualisation of a non-relevant text further reduces negative effects whilst likely circumventing existing content filtering mechanisms. In contrast, lexical models are found to be more resilient to such content injection attacks. We then investigate a simple yet effective compensation for the weaknesses of the NRMs in search, validating our hypotheses regarding transformer bias.


title: Valuations, bijections, and bases

abstract: The aim of this paper is to build a theory of commutative and noncommutative injective valuations of various algebras. The targets of our valuations are (well-)ordered commutative and noncommutative (partial or entire) semigroups including any sub-semigroups of the free monoid $F_n$ on $n$ generators and various quotients. In the case when the (partial) valuation semigroup is finitely generated, we construct a generalization of the standard monomial bases for the so-valued algebra, which seems to be new in noncommutative case. Quite remarkably, for any pair of well-ordered valuations one has canonical bijections between the valuation semigroups, which serve as analogs of the celebrated Jordan-H\"older correspondences and these bijections are "almost" homomorphisms of the involved (partial and entire) semigroups.


title: Floquet geometric entangling gates in ground-state manifolds of Rydberg atoms

abstract: We propose an extension of the Floquet theory for constructing quantum entangling gates in ground-state manifolds of Rydberg atoms. By dynamically controlling periodically modulating the Rabi frequencies of transitions between ground and Rydberg states of atoms, error-resilient two-qubit entangling gates can be implemented in the regime of Rydberg blockade. According to different degrees of Floquet theory utilization, the fidelity of the resulting controlled gates surpasses that of the original reference. Our method only uses encoding in the ground states, and compared to the original scheme using Rydberg state for encoding, it is less susceptible to environmental interference, making it more practical to implement. Therefore, our approach may have broader applications or potential for further expansion of geometric quantum computation with neutral atoms.


title: DmADs-Net: Dense multiscale attention and depth-supervised network for medical image segmentation

abstract: Deep learning has made important contributions to the development of medical image segmentation. Convolutional neural networks, as a crucial branch, have attracted strong attention from researchers. Through the tireless efforts of numerous researchers, convolutional neural networks have yielded numerous outstanding algorithms for processing medical images. The ideas and architectures of these algorithms have also provided important inspiration for the development of later technologies.Through extensive experimentation, we have found that currently mainstream deep learning algorithms are not always able to achieve ideal results when processing complex datasets and different types of datasets. These networks still have room for improvement in lesion localization and feature extraction. Therefore, we have created the Dense Multiscale Attention and Depth-Supervised Network (DmADs-Net).We use ResNet for feature extraction at different depths and create a Multi-scale Convolutional Feature Attention Block to improve the network's attention to weak feature information. The Local Feature Attention Block is created to enable enhanced local feature attention for high-level semantic information. In addition, in the feature fusion phase, a Feature Refinement and Fusion Block is created to enhance the fusion of different semantic information.We validated the performance of the network using five datasets of varying sizes and types. Results from comparative experiments show that DmADs-Net outperformed mainstream networks. Ablation experiments further demonstrated the effectiveness of the created modules and the rationality of the network architecture.


title: Pricing and delta computation in jump-diffusion models with stochastic intensity by Malliavin calculus

abstract: In this paper, the pricing of financial derivatives and the calculation of their delta Greek are investigated as the underlying asset is a jump-diffusion process in which the stochastic intensity component follows the CIR process. Utilizing Malliavin derivatives for pricing financial derivatives and challenging to find the Malliavin weight for accurately calculating delta will be established in such models. Due to the dependence of asset price on the information of the intensity process, conditional expectation attribute to show boundedness of moments of Malliavin weights and the underlying asset is essential. Our approach is validated through numerical experiments, highlighting its effectiveness and potential for risk management and hedging strategies in markets characterized by jump and stochastic intensity dynamics.


title: On Convergence of Discrete Schemes for Computing the Rate-Distortion Function of Continuous Source

abstract: Computing the rate-distortion function for continuous sources is commonly regarded as a standard continuous optimization problem. When numerically addressing this problem, a typical approach involves discretizing the source space and subsequently solving the associated discrete problem. However, existing literature has predominantly concentrated on the convergence analysis of solving discrete problems, usually neglecting the convergence relationship between the original continuous optimization and its associated discrete counterpart. This neglect is not rigorous, since the solution of a discrete problem does not necessarily imply convergence to the solution of the original continuous problem, especially for non-linear problems. To address this gap, our study employs rigorous mathematical analysis, which constructs a series of finite-dimensional spaces approximating the infinite-dimensional space of the probability measure, establishing that solutions from discrete schemes converge to those from the continuous problems.


title: To restart, or not to restart, that is the question

abstract: The mean time taken by a Brownian particle to cover a distance $L$ is $L^2/2D$, with $D$ being its diffusion coefficient. We find that restarts increase this mean time. This is because restarts naturally introduce time overheads which need to be taken into account while addressing the escape properties. In addition, restarts impose a constraint on allowed overhead functions if they are to provide an advantage, that is, a reduced mean escape time. We explicitly study these constraints for Poisson and sharp restarts. Implementing an overhead function to control escape times means that the physical properties of the Brownian particle need to be appropriately modified. When restarts are non-instantaneous, an additional delay is introduced increasing the mean escape time further. Can restarts overcome the delays incurred due to finite return times? To restart, or not to restart, should be the question.


title: A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challenges

abstract: Dynamic Graph Neural Networks (GNNs) combine temporal information with GNNs to capture structural, temporal, and contextual relationships in dynamic graphs simultaneously, leading to enhanced performance in various applications. As the demand for dynamic GNNs continues to grow, numerous models and frameworks have emerged to cater to different application needs. There is a pressing need for a comprehensive survey that evaluates the performance, strengths, and limitations of various approaches in this domain. This paper aims to fill this gap by offering a thorough comparative analysis and experimental evaluation of dynamic GNNs. It covers 81 dynamic GNN models with a novel taxonomy, 12 dynamic GNN training frameworks, and commonly used benchmarks. We also conduct experimental results from testing representative nine dynamic GNN models and three frameworks on six standard graph datasets. Evaluation metrics focus on convergence accuracy, training efficiency, and GPU memory usage, enabling a thorough comparison of performance across various models and frameworks. From the analysis and evaluation results, we identify key challenges and offer principles for future research to enhance the design of models and frameworks in the dynamic GNNs field.


title: Beyond the random phase approximation for calculating Curie temperatures in ferromagnets: application to Fe, Ni, Co and monolayer CrI3

abstract: The magnetic properties of solids are typically analyzed in terms of Heisenberg models where the electronic structure is approximated by interacting localized spins. However, even in such models the evaluation of thermodynamic properties constitutes a major challenge and is usually handled by a mean field decoupling scheme. The random phase approximation (RPA) comprises a common approach and is often applied to evaluate critical temperatures although it is well known that the method is only accurate well below the critical temperature. In the present work we compare the performance of the RPA with a different decoupling scheme proposed by Callen as well as the mean field decoupling of interacting Holstein-Primakoff (HP) magnons. We consider three-dimensional (3D) as well as two-dimensional (2D) model systems where the Curie temperature is governed by anisotropy. In 3D, the Callen method is the most accurate in the classical limit, and we show that the Callen decoupling produces the best agreement with experiments for bcc Fe, fcc Ni and fcc Co with exchange interactions obtained from first principles. In contrast, for low spin systems where a quantum mechanical treatment in pertinent, the HP and RPA methods appear are superior to the Callen decoupling. In 2D systems with magnetic order driven by single-ion anisotropy, it is shown that HP fails rather dramatically and both RPA and Callen approaches severely overestimates Curie temperatures. The most accurate approach is then constructed by combining RPA with the Callen decoupling of single-ion anisotropy, which yields the correct lack of order for S=1/2. We exemplify this by the case of monolayer CrI3 using exchange constant extracted from experiments.


title: Dual-frequency optical-microwave atomic clocks based on cesium atoms

abstract: $^{133}$Cs, which is the only stable cesium (Cs) isotope, is one of the most investigated elements in atomic spectroscopy and was used to realize the atomic clock in 1955. Among all atomic clocks, the cesium atomic clock has a special place, since the current unit of time is based on a microwave transition in the Cs atom. In addition, the long lifetime of the $6{\text{P}}_{3/2}$ state and simple preparation technique of Cs vapor cells have great relevance to quantum and atom optics experiments, which suggests the use of the $6{\text{S}} - 6{\text{P}}$ D2 transition as an optical frequency standard. In this work, using one laser as the local oscillator and Cs atoms as the quantum reference, we realized two atomic clocks in the optical and microwave frequencies, respectively. Both clocks could be freely switched or simultaneously output. The optical clock based on the vapor cell continuously operated with a frequency stability of $3.89 \times {10^{ - 13}}$ at 1 s, decreasing to $2.17 \times {10^{ - 13}}$ at 32 s, which was frequency stabilized by modulation transfer spectroscopy and estimated by an optical comb. Then, applying this stabilized laser for an optically pumped Cs beam atomic clock to reduce the laser frequency noise, we obtained a microwave clock with a frequency stability of $1.84 \times {10^{ - 12}}/\sqrt \tau $, reaching $5.99 \times {10^{ - 15}}$ at $10^5$ s. This study demonstrates an attractive feature for the commercialization and deployment of optical and microwave clocks and will guide further development of integrated atomic clocks with better stability. Thus, this study lays the groundwork for future quantum metrology and laser physics.


title: Enhanced Visual Question Answering: A Comparative Analysis and Textual Feature Extraction Via Convolutions

abstract: Visual Question Answering (VQA) has emerged as a highly engaging field in recent years, attracting increasing research efforts aiming to enhance VQA accuracy through the deployment of advanced models such as Transformers. Despite this growing interest, there has been limited exploration into the comparative analysis and impact of textual modalities within VQA, particularly in terms of model complexity and its effect on performance. In this work, we conduct a comprehensive comparison between complex textual models that leverage long dependency mechanisms and simpler models focusing on local textual features within a well-established VQA framework. Our findings reveal that employing complex textual encoders is not invariably the optimal approach for the VQA-v2 dataset. Motivated by this insight, we introduce an improved model, ConvGRU, which incorporates convolutional layers to enhance the representation of question text. Tested on the VQA-v2 dataset, ConvGRU achieves better performance without substantially increasing parameter complexity.


title: Better Bounded Bisimulation Contractions (Preprint)

abstract: Bisimulations are standard in modal logic and, more generally, in the theory of state-transition systems. The quotient structure of a Kripke model with respect to the bisimulation relation is called a bisimulation contraction. The bisimulation contraction is a minimal model bisimilar to the original model, and hence, for (image-)finite models, a minimal model modally equivalent to the original. Similar definitions exist for bounded bisimulations ($k$-bisimulations) and bounded bisimulation contractions. Two finite models are $k$-bisimilar if and only if they are modally equivalent up to modal depth $k$. However, the quotient structure with respect to the $k$-bisimulation relation does not guarantee a minimal model preserving modal equivalence to depth $k$. In this paper, we remedy this asymmetry to standard bisimulations and provide a novel definition of bounded contractions called rooted $k$-contractions. We prove that rooted $k$-contractions preserve $k$-bisimilarity and are minimal with this property. Finally, we show that rooted $k$-contractions can be exponentially more succinct than standard $k$-contractions.


title: Main sequence of star formation and colour bimodality considering galaxy environment

abstract: This study involves the use of Sloan Digital Sky Survey Data Release 12 (SDSS DR12) also referred to as the Legacy Survey to investigate the influence of the galaxy environment on the main sequence of star formation, colour bimodality and the quenching of star formation rate. We classify the galaxies according to the ratio of their emission lines and based on their environment (isolated and non-isolated). We find that for $z\lesssim 0.09$, the fraction of non-isolated galaxies is greater than isolated galaxies, whereas for $z>0.09$ the opposite result is observed. Quenching is observed to be influenced by the environment at $M_\star < 10^{10.7} M_{\odot}$ (mostly for the star-forming and composite galaxies), while for $M_{\star }\geq 10^{10.7} M_{\odot}$ (mostly for Seyfert galaxies and low-ionization nuclear emission-line regions), the effect of the environment is very weak. We observe the decrease in the slope of the star formation main sequence by $\sim\! 0.02$ dex and the intercept by $\sim\! 0.17$ dex for non-isolated galaxies in comparison to isolated galaxies. We also find that star-forming, composite, Seyfert galaxies and low-ionization nuclear emission-line regions form the evolutionary pathways, where most star-forming galaxies ($\sim\! 60\%$) are found in the blue cloud, both composite ($\sim\! 50\%$) and Seyfert ($\sim\! 49\%$) galaxies in the green valley and low-ionization nuclear emission-line regions ($\sim 60\%$) in the red sequence. The study concludes that the environment in which the galaxies reside influences the shape of the star formation main sequence, quenching and hence colour bimodality especially for star-forming and composite galaxies while for Seyfert and low-ionization nuclear emission-line region galaxies, there is a mild impact.


title: PackVFL: Efficient HE Packing for Vertical Federated Learning

abstract: As an essential tool of secure distributed machine learning, vertical federated learning (VFL) based on homomorphic encryption (HE) suffers from severe efficiency problems due to data inflation and time-consuming operations. To this core, we propose PackVFL, an efficient VFL framework based on packed HE (PackedHE), to accelerate the existing HE-based VFL algorithms. PackVFL packs multiple cleartexts into one ciphertext and supports single-instruction-multiple-data (SIMD)-style parallelism. We focus on designing a high-performant matrix multiplication (MatMult) method since it takes up most of the ciphertext computation time in HE-based VFL. Besides, devising the MatMult method is also challenging for PackedHE because a slight difference in the packing way could predominantly affect its computation and communication costs. Without domain-specific design, directly applying SOTA MatMult methods is hard to achieve optimal. Therefore, we make a three-fold design: 1) we systematically explore the current design space of MatMult and quantify the complexity of existing approaches to provide guidance; 2) we propose a hybrid MatMult method according to the unique characteristics of VFL; 3) we adaptively apply our hybrid method in representative VFL algorithms, leveraging distinctive algorithmic properties to further improve efficiency. As the batch size, feature dimension and model size of VFL scale up to large sizes, PackVFL consistently delivers enhanced performance. Empirically, PackVFL propels existing VFL algorithms to new heights, achieving up to a 51.52X end-to-end speedup. This represents a substantial 34.51X greater speedup compared to the direct application of SOTA MatMult methods.


title: In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol

abstract: As deep generative models advance, we anticipate deepfakes achieving "perfection"-generating no discernible artifacts or noise. However, current deepfake detectors, intentionally or inadvertently, rely on such artifacts for detection, as they are exclusive to deepfakes and absent in genuine examples. To bridge this gap, we introduce the Rebalanced Deepfake Detection Protocol (RDDP) to stress-test detectors under balanced scenarios where genuine and forged examples bear similar artifacts. We offer two RDDP variants: RDDP-WHITEHAT uses white-hat deepfake algorithms to create 'self-deepfakes,' genuine portrait videos with the resemblance of the underlying identity, yet carry similar artifacts to deepfake videos; RDDP-SURROGATE employs surrogate functions (e.g., Gaussian noise) to process both genuine and forged examples, introducing equivalent noise, thereby sidestepping the need of deepfake algorithms. Towards detecting perfect deepfake videos that aligns with genuine ones, we present ID-Miner, a detector that identifies the puppeteer behind the disguise by focusing on motion over artifacts or appearances. As an identity-based detector, it authenticates videos by comparing them with reference footage. Equipped with the artifact-agnostic loss at frame-level and the identity-anchored loss at video-level, ID-Miner effectively singles out identity signals amidst distracting variations. Extensive experiments comparing ID-Miner with 12 baseline detectors under both conventional and RDDP evaluations with two deepfake datasets, along with additional qualitative studies, affirm the superiority of our method and the necessity for detectors designed to counter perfect deepfakes.


title: Spin Hamiltonians in the Modulated Momenta of Light

abstract: Photonic solvers that are able to find the ground states of different spin Hamiltonians can be used to study many interactive physical systems and combinatorial optimization problems. Here, we establish a real-and-momentum space correspondence of spin Hamiltonians by spatial light transport. The real-space spin interaction is determined by modulating the momentum-space flow of light. This principle is formulated as a generalized Plancherel theorem, allowing us to implement a simple optical simulator that can find the ground states for any displacement-dependent spin interactions. Particularly, we use this principle to reveal the exotic magnetic phase diagram from a J1-J2-J3 model, and we also observe the vortex-mediated Berezinskii-Kosterlitz-Thouless dynamics from the XY model. These experiments exhibit high calculation precision by subtly controlling spin interactions from the momentum space of light, offering a promising scheme to explore novel physical effects.


title: The Pyramid of Captions

abstract: We introduce a formal information-theoretic framework for image captioning by regarding it as a representation learning task. Our framework defines three key objectives: task sufficiency, minimal redundancy, and human interpretability. Building upon this foundation, we propose a novel Pyramid of Captions (PoCa) method, which constructs caption pyramids by generating localized captions for zoomed-in image patches and integrating them with global caption information using large language models. This approach leverages intuition that the detailed examination of local patches can reduce error risks and address inaccuracies in global captions, either by correcting the hallucination or adding missing details. Based on our theoretical framework, we formalize this intuition and provide formal proof demonstrating the effectiveness of PoCa under certain assumptions. Empirical tests with various image captioning models and large language models show that PoCa consistently yields more informative and semantically aligned captions, maintaining brevity and interpretability.


title: Time and frequency domain low order, low frequency approximation of mechanical systems

abstract: Control design for linear, time-invariant mechanical systems typically requires an accurate low-order approximation in the low frequency range. For example a series expansion of the transfer function around zero consisting of a mass, velocity, and compliance term. Because computing such a series expansion of the transfer function can be cumbersome, a new method to compute low-order approximations of mechanical systems is developed in this paper. The method does not require an explicit expression for the transfer function, which is not always available for infinite-dimensional systems. The advantages of the proposed method is demonstrated in three examples.


title: Recoverable strain from reverse plasticity

abstract: Recoverable strain is the strain recovered once a stress is removed from a body, in the direction opposite to that in which the stress had acted. To date, the phenomenon has been understood as being elastic in origin: polymer chains stretched in the direction of an imposed stress will recoil after the stress is removed, for example. Any unrecoverable strain is instead attributed to irreversible plastic deformations. Here we study theoretically recoverable and unrecoverable strain within the soft glassy rheology model, aimed at describing the rheology of elastoplastic yield stress fluids and amorphous soft solids. We consider a material subject to the switch-on of a shear stress that is held constant before later being set back to zero, after which the strain recovery is observed. After an initially fast recoil that is indeed elastic in nature, consistent with the usual intuition, we find that significant subsequent strain recovery then arises not via further recoil of elasticity but instead by `reverse plasticity', in a sense that we discuss carefully. Also unexpectedly, although in rare parameter regimes, this plastic part of the strain post switch-off does not always in fact recover in the negative direction, counter to that of the previously imposed stress, but can sometimes continue to accumulate in the forward direction. The recovery is then non-monotonic overall, reminiscent of recent observations of non-monotonic stress relaxation after straining, which have been attributed to complex material memory effects. We elucidate the mechanisms underlying these behaviours in terms of the evolution of the SGR model's population of elastoplastic elements, and suggest connections with the notion of `reversible plasticity', as discussed in the recent physics literature.


title: Colax adjunctions and lax-idempotent pseudomonads

abstract: We prove a generalization of a theorem of Bunge and Gray about forming colax adjunctions out of relative Kan extensions and apply it to the study of the Kleisli 2-category for a lax-idempotent pseudomonad. For instance, we establish the weak completeness of the Kleisli 2-category and describe colax change-of-base adjunctions between Kleisli 2-categories. Our approach covers such examples as the bicategory of small profunctors and the 2-category of lax triangles in a 2-category. The duals of our results provide lax analogues of classical results in two-dimensional monad theory: for instance, establishing the weak cocompleteness of the 2-category of strict algebras and lax morphisms and the existence of colax change-of-base adjunctions.


title: Explainable Automatic Grading with Neural Additive Models

abstract: The use of automatic short answer grading (ASAG) models may help alleviate the time burden of grading while encouraging educators to frequently incorporate open-ended items in their curriculum. However, current state-of-the-art ASAG models are large neural networks (NN) often described as "black box", providing no explanation for which characteristics of an input are important for the produced output. This inexplicable nature can be frustrating to teachers and students when trying to interpret, or learn from an automatically-generated grade. To create a powerful yet intelligible ASAG model, we experiment with a type of model called a Neural Additive Model that combines the performance of a NN with the explainability of an additive model. We use a Knowledge Integration (KI) framework from the learning sciences to guide feature engineering to create inputs that reflect whether a student includes certain ideas in their response. We hypothesize that indicating the inclusion (or exclusion) of predefined ideas as features will be sufficient for the NAM to have good predictive power and interpretability, as this may guide a human scorer using a KI rubric. We compare the performance of the NAM with another explainable model, logistic regression, using the same features, and to a non-explainable neural model, DeBERTa, that does not require feature engineering.


title: A first-order deconfinement phase transition in the early universe and gravitational waves

abstract: We clarify the conditions of the cosmic quantum chromodynamics (QCD) first-order phase transition in the early universe by carefully distinguishing the chiral and deconfinement phase transitions. While the chiral one with light quarks at zero chemical potential is unlikely to be first order based on the recent lattice QCD calculations, the latter one can be naturally extended with one extra rolling scalar to be first order. The argument is also valid for the dark QCD theory with arbitrary $N_c$ with a wide range of phase transition temperatures, which can be from hundreds of MeV up to beyond TeV. Notably, here we derive the general formula for the deconfinement phase transition potential of SU($N_c$) gauge theory characterized by the Polyakov loop. With the effective potential in hand, the gravitational wave spectrum is then determined via the sound shell model, which then enables us to give for the first time the quantitative analysis of the gravitational wave signals coming from the QCD deconfinement phase transition and awaits the check from future space interferometers.


title: On the Relevance of Byzantine Robust Optimization Against Data Poisoning

abstract: The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called {\em workers}). Beyond accuracy, the use of ML in critical domains such as healthcare and autonomous driving calls for robustness against {\em data poisoning}and some {\em faulty workers}. The problem of {\em Byzantine ML} formalizes these robustness issues by considering a distributed ML environment in which workers (storing a portion of the global dataset) can deviate arbitrarily from the prescribed algorithm. Although the problem has attracted a lot of attention from a theoretical point of view, its practical importance for addressing realistic faults (where the behavior of any worker is locally constrained) remains unclear. It has been argued that the seemingly weaker threat model where only workers' local datasets get poisoned is more reasonable. We prove that, while tolerating a wider range of faulty behaviors, Byzantine ML yields solutions that are, in a precise sense, optimal even under the weaker data poisoning threat model. Then, we study a generic data poisoning model wherein some workers have {\em fully-poisonous local data}, i.e., their datasets are entirely corruptible, and the remainders have {\em partially-poisonous local data}, i.e., only a fraction of their local datasets is corruptible. We prove that Byzantine-robust schemes yield optimal solutions against both these forms of data poisoning, and that the former is more harmful when workers have {\em heterogeneous} local data.


title: Is Temperature the Creativity Parameter of Large Language Models?

abstract: Large language models (LLMs) are applied to all sorts of creative tasks, and their outputs vary from beautiful, to peculiar, to pastiche, into plain plagiarism. The temperature parameter of an LLM regulates the amount of randomness, leading to more diverse outputs; therefore, it is often claimed to be the creativity parameter. Here, we investigate this claim using a narrative generation task with a predetermined fixed context, model and prompt. Specifically, we present an empirical analysis of the LLM output for different temperature values using four necessary conditions for creativity in narrative generation: novelty, typicality, cohesion, and coherence. We find that temperature is weakly correlated with novelty, and unsurprisingly, moderately correlated with incoherence, but there is no relationship with either cohesion or typicality. However, the influence of temperature on creativity is far more nuanced and weak than suggested by the "creativity parameter" claim; overall results suggest that the LLM generates slightly more novel outputs as temperatures get higher. Finally, we discuss ideas to allow more controlled LLM creativity, rather than relying on chance via changing the temperature parameter.


title: A study of Galactic Plane Planck Galactic Cold Clumps observed by SCOPE and the JCMT Plane Survey

abstract: We have investigated the physical properties of Planck Galactic Cold Clumps (PGCCs) located in the Galactic Plane, using the JCMT Plane Survey (JPS) and the SCUBA-2 Continuum Observations of Pre-protostellar Evolution (SCOPE) survey. By utilising a suite of molecular-line surveys, velocities and distances were assigned to the compact sources within the PGCCs, placing them in a Galactic context. The properties of these compact sources show no large-scale variations with Galactic environment. Investigating the star-forming content of the sample, we find that the luminosity-to-mass ratio (L/M) is an order of magnitude lower than in other Galactic studies, indicating that these objects are hosting lower levels of star formation. Finally, by comparing ATLASGAL sources that are associated or are not associated with PGCCs, we find that those associated with PGCCs are typically colder, denser, and have a lower L/M ratio, hinting that PGCCs are a distinct population of Galactic Plane sources.


title: GOLD: Geometry Problem Solver with Natural Language Description

abstract: Addressing the challenge of automated geometry math problem-solving in artificial intelligence (AI) involves understanding multi-modal information and mathematics. Current methods struggle with accurately interpreting geometry diagrams, which hinders effective problem-solving. To tackle this issue, we present the Geometry problem sOlver with natural Language Description (GOLD) model. GOLD enhances the extraction of geometric relations by separately processing symbols and geometric primitives within the diagram. Subsequently, it converts the extracted relations into natural language descriptions, efficiently utilizing large language models to solve geometry math problems. Experiments show that the GOLD model outperforms the Geoformer model, the previous best method on the UniGeo dataset, by achieving accuracy improvements of 12.7% and 42.1% in calculation and proving subsets. Additionally, it surpasses the former best model on the PGPS9K and Geometry3K datasets, PGPSNet, by obtaining accuracy enhancements of 1.8% and 3.2%, respectively.


title: The Loewner framework for parametric systems: Taming the curse of dimensionality

abstract: The Loewner framework is an interpolatory approach designed for approximating linear and nonlinear systems. The goal here is to extend this framework to linear parametric systems with an arbitrary number n of parameters. One main innovation established here is the construction of data-based realizations for any number of parameters. Equally importantly, we show how to alleviate the computational burden, by avoiding the explicit construction of large-scale n-dimensional Loewner matrices of size $N \times N$. This reduces the complexity from $O(N^3)$ to about $O(N^{1.4})$, thus taming the curse of dimensionality and making the solution scalable to very large data sets. To achieve this, a new generalized multivariate rational function realization is defined. Then, we introduce the n-dimensional multivariate Loewner matrices and show that they can be computed by solving a coupled set of Sylvester equations. The null space of these Loewner matrices then allows the construction of the multivariate barycentric transfer function. The principal result of this work is to show how the null space of the n-dimensional Loewner matrix can be computed using a sequence of 1-dimensional Loewner matrices, leading to a drastic computational burden reduction. Finally, we suggest two algorithms (one direct and one iterative) to construct, directly from data, multivariate (or parametric) realizations ensuring (approximate) interpolation. Numerical examples highlight the effectiveness and scalability of the method.


title: Study of $B_{(s)}$ meson decays to $D_{0}^{\ast}(2300) ,D_{s0}^{\ast}(2317) , D_{s1}(2460)$ and $D_{s1}(2536)$ within the covariant light-front approach

abstract: In this work, we investigate the form factors of the transitions $B_{(s)} \to D_{0}^{\ast}(2300),D_{s0}^{\ast}(2317),$ $ D_{s1}(2460) $ and $ D_{s1}(2536)$ in the covariant light-front quark model (CLFQM), where these final states are considered as P-wave excited charmed mesons. In order to obtain the form factors for the physical transition processes, we need to extend these form factors from the space-like region to the time-like region. The $q^{2}$-dependence for each transition form factor is also plotted. Then, combined with those form factors, the branching ratios of the two-body nonleptonic decays $B_{(s)}\to D^*_{(s)0}(2300,2317)M, D_{s1}(2460,2536)M$ with $M$ being a light pseudoscalar (vector) meson or a charmed meson are calculated by considering the QCD radiative corrections to the hadronic matrix elements with the QCD factorization approach. Most of our predictions are comparable to the results given by other theoretical approaches and the present available data.


title: Variational inequalities for the Ornstein--Uhlenbeck semigroup: the higher--dimensional case

abstract: We study the $\varrho$-th order variation seminorm of a general Ornstein--Uhlenbeck semigroup $\left(\mathcal H_t\right)_{t>0}$ in $\mathbb R^n$, taken with respect to $t$. We prove that this seminorm defines an operator of weak type $(1,1)$ with respect to the invariant measure when $\varrho> 2$. For large $t$, one has an enhanced version of the standard weak-type $(1,1)$ bound. For small $t$, the proof hinges on vector-valued Calder\'on--Zygmund techniques in the local region, and on the fact that the $t$ derivative of the integral kernel of $\mathcal H_t$ in the global region has a bounded number of zeros in $(0,1]$. A counterexample is given for $\varrho= 2$; in fact, we prove that the second order variation seminorm of $\left(\mathcal H_t\right)_{t>0}$, and therefore also the $\varrho$-th order variation seminorm for any $\varrho\in [1,2)$, is not of strong nor weak type $(p,p)$ for any $p \in [1,\infty)$ with respect to the invariant measure.


title: The Natural Display Topos of Coalgebras

abstract: A classical result of topos theory holds that the category of coalgebras for a Cartesian comonad on a topos is again a topos (Kock and Wraith, 1971). It is natural to refine this result to a topos-theoretic setting that includes universes. To this end, we introduce the notions of natural display topos and natural Cartesian display comonad, and show that the natural model of coalgebras for a natural Cartesian display comonad on a natural display topos is again a natural display topos. As an application, this result extends the approach to universes of Hofmann and Streicher (1997) from presheaf toposes to sheaf toposes with enough points. Whereas natural display toposes provide a categorical semantics for a form of extensional Martin-L\"of type theory, we also prove our main result in the more general setting of natural typoses, which encompasses models of intensional Martin-L\"of type theory. A natural Cartesian display comonad on a natural typos may also be used as a model for dependent type theory with an S4 box operator, or comonadic modality, as introduced by Nanevski et al. (2008). Modal contexts, which have been regarded as tricky to handle semantically, are interpreted as contexts of the natural typos of coalgebras. We sketch an interpretation within this approach. As part of the framework in which the above takes place, we introduce a refinement of the notion of natural model (see Awodey, 2018), which is (strictly 2-)equivalent to the notion of full, split comprehension category (see Jacobs, 1993), rather than the notion of category with attributes (Cartmell 1978).


title: Stochastic Averaging of Radiative Transfer Coefficients for Relativistic Electrons

abstract: Synchrotron emissivities, absorptivities, and Faraday rotation and conversion coefficients are needed in modeling a variety of astrophysical sources, including Event Horizon Telescope (EHT) sources. We develop a method for estimating transfer coefficients that exploits their linear dependence on the electron distribution function, decomposing the distribution function into a sum of parts each of whose emissivity can be calculated easily. We refer to this procedure as stochastic averaging and apply it in two contexts. First, we use it to estimate the emissivity of an isotropic $\kappa$ distribution function with a high energy cutoff. The resulting coefficients can be evaluated efficiently enough to be used directly in ray-tracing calculations, and we provide an example calculation. Second, we use stochastic averaging to assess the effect of subgrid turbulence on the volume-averaged emissivity and along the way provide a prescription for a turbulent emissivity. We find that for parameters appropriate to EHT sources turbulence reduces the emissivity slightly. In the infrared turbulence can dramatically increase the emissivity.


title: Cubiquitous Lattices and Branched Covers bounding rational balls

abstract: Greene and Owens explore cubiquitous lattices as an obstruction to rational homology 3-spheres bounding rational homology 4-balls. The purpose of this article is to better understand which sublattices of $\mathbb{Z}^n$ are cubiquitous with the aim of effectively using their cubiquity obstruction. We develop a geometric obstruction (called the Wu obstruction) to cubiquity and use it as tool to completely classify which sublattices with orthogonal bases are cubiquitous. We then apply this result the double branched covers of alternating connected sums of torus links. Finally, we explore how the Wu obstruction can be used in conjunction with contractions to obstruct the cubiquity of infinite families of lattices.


title: Pseudo-Riemannian symmetric spaces of signature (2,2)

abstract: We study all four-dimensional simply-connected indecomposable non-semisimple pseudo-Riemannian symmetric spaces whose metric has signature (2,2). We present models and compute their isometry groups. We solve the problem of the existence or non-existence of compact quotients by properly acting discrete subgroups of the isometry group. This continues and completes earlier work by Maeta.


title: Using non-DESI data to confirm and strengthen the DESI 2024 spatially-flat $w_0w_a$CDM cosmological parameterization result

abstract: We use a combination of Planck cosmic microwave background (CMB) anisotropy data and non-CMB data that include Pantheon+ type Ia supernovae, Hubble parameter [$H(z)$], growth factor ($f\sigma_8$) measurements, and a collection of baryon acoustic oscillation (BAO) data, but not recent DESI 2024 BAO measurements, to confirm the DESI 2024 (DESI+CMB+PantheonPlus) data compilation support for dynamical dark energy with an evolving equation of state parameter $w(z) = w_0 + w_a z/(1+z)$. From our joint compilation of CMB and non-CMB data, in a spatially-flat cosmological model, we obtain $w_0 = -0.850 \pm 0.059$ and $w_a = -0.59^{+0.26}_{-0.22}$ and find that this dynamical dark energy is favored over a cosmological constant by $\sim 2\sigma$. Our data constraints on the flat $w_0w_a$CDM model are slightly more restrictive than the DESI 2024 constraints, with the DESI 2024 and our values of $w_0$ and $w_a$ differing by $-0.27\sigma$ and $0.44\sigma$, respectively. Our data compilation slightly more strongly favors the flat $w_0w_a$CDM model over the flat $\Lambda$CDM model than does the DESI 2024 data compilation.


title: The M33 Synoptic Stellar Survey. III. Miras and LPVs in griJHKs

abstract: We present the results of a search for Miras and long-period variables (LPVs) in M33 using griJHKs archival observations from the Canada-France-Hawai'i Telescope. We use multiband information and machine learning techniques to identify and characterize these variables. We recover ~1,300 previously-discovered Mira candidates and identify ~13,000 new Miras and LPVs. We detect for the first time a clear first-overtone pulsation sequence among Mira candidates in this galaxy. We use O-rich, fundamental-mode Miras in the LMC and M33 to derive a distance modulus for the latter of 24.629 +/- 0.046 mag.


title: JWST meets Chandra: a large population of Compton thick, feedback-free, and X-ray weak AGN, with a sprinkle of SNe

abstract: We investigate the X-ray properties of a large sample of 71 broad line and narrow line AGN at 2<z<11 discovered by JWST in the GOODS fields, which have the deepest Chandra observations ever obtained. Despite the widespread presence of AGN signatures in their rest-optical and -UV spectra, the vast majority of them is X-ray undetected. The stacked X-ray data of the non-detected sources also results in a non-detection. The upper limit on the X-ray emission for many of these AGN is one or even two orders of magnitude lower than expected from a standard AGN SED. Heavy X-ray absorption by clouds with large (Compton thick) column density and low dust content, such as the Broad Line Region (BLR) clouds, can explain the X-ray weakness. In this scenario the BLR covering factor should be much larger than in low-z AGN or luminous quasar; this is supported by the larger equivalent width of the broad component of Halpha in JWST-selected AGN. We also find that the JWST-discovered AGN lack the prominent, fast outflows characterizing low-z AGN and luminous quasars, suggesting that, in JWST-selected AGN, dense gas lingers in the nuclear region, resulting in large covering factors. We also note that a large fraction of JWST-selected AGN match the definition of NLSy1, typically characterized by a steep X-ray spectrum, and this can further contribute to their observed weakness at high-z. Finally, we discuss that the broad Balmer lines used to identify type 1 AGN cannot be ascribed to Very Massive Stars, Tidal Disruption Events, or Supernovae, although we show that a minority of the faintest broad lines could potentially be associated with the echo of superluminous SNe or TDE. Scenarios in which the broad lines are ascribed to galactic outflows are also untenable. We emphasize that confirming any of the scenarios discussed above will require X-ray missions more sensitive than Chandra. (abridged)


title: KVP10k : A Comprehensive Dataset for Key-Value Pair Extraction in Business Documents

abstract: In recent years, the challenge of extracting information from business documents has emerged as a critical task, finding applications across numerous domains. This effort has attracted substantial interest from both industry and academy, highlighting its significance in the current technological landscape. Most datasets in this area are primarily focused on Key Information Extraction (KIE), where the extraction process revolves around extracting information using a specific, predefined set of keys. Unlike most existing datasets and benchmarks, our focus is on discovering key-value pairs (KVPs) without relying on predefined keys, navigating through an array of diverse templates and complex layouts. This task presents unique challenges, primarily due to the absence of comprehensive datasets and benchmarks tailored for non-predetermined KVP extraction. To address this gap, we introduce KVP10k , a new dataset and benchmark specifically designed for KVP extraction. The dataset contains 10707 richly annotated images. In our benchmark, we also introduce a new challenging task that combines elements of KIE as well as KVP in a single task. KVP10k sets itself apart with its extensive diversity in data and richly detailed annotations, paving the way for advancements in the field of information extraction from complex business documents.


title: Significant tuning of internal mode coupling in doubly clamped MEMS beam resonators by thermal effect

abstract: Intermodal coupling has been demonstrated to be a promising mechanism for the development of advanced micro/nanoelectromechanical devices. However, strong mode coupling remains a key challenge limiting the practical application of intermodal coupling. Furthermore, the insight into physical mechanisms underlying mode coupling and the capability to quantitatively tune the mode coupling is also limited. Here, we experimentally and theoretically demonstrate the significant tunability of mode coupling by using the thermal tuning effect, yet in an asymmetric doubly-clamped MEMS beam resonator, enabling various coupling strength to be implemented for practical applications. In this system, two out-of-plane vibrational modes are mechanically coupled through displacement-induced tension, and their mode coupling strength arises from both hardening and softening nonlinearities of the two modes, thus allowing for the tuning of mode coupling strength by thermally enhancing the softening nonlinearity of the MEMS beam. Our results demonstrate a feasible approach to tune the mode coupling and offer insights into fundamental mechanism of mode coupling in MEMS beam resonators, paving the way for the development of MEMS resonators with enhanced performance and application-specific tunability.