title: Acute kidney injury prediction for non-critical care patients: a retrospective external and internal validation study

abstract: Background: Acute kidney injury (AKI), the decline of kidney excretory function, occurs in up to 18% of hospitalized admissions. Progression of AKI may lead to irreversible kidney damage. Methods: This retrospective cohort study includes adult patients admitted to a non-intensive care unit at the University of Pittsburgh Medical Center (UPMC) (n = 46,815) and University of Florida Health (UFH) (n = 127,202). We developed and compared deep learning and conventional machine learning models to predict progression to Stage 2 or higher AKI within the next 48 hours. We trained local models for each site (UFH Model trained on UFH, UPMC Model trained on UPMC) and a separate model with a development cohort of patients from both sites (UFH-UPMC Model). We internally and externally validated the models on each site and performed subgroup analyses across sex and race. Results: Stage 2 or higher AKI occurred in 3% (n=3,257) and 8% (n=2,296) of UFH and UPMC patients, respectively. Area under the receiver operating curve values (AUROC) for the UFH test cohort ranged between 0.77 (UPMC Model) and 0.81 (UFH Model), while AUROC values ranged between 0.79 (UFH Model) and 0.83 (UPMC Model) for the UPMC test cohort. UFH-UPMC Model achieved an AUROC of 0.81 (95% confidence interval [CI] [0.80, 0.83]) for UFH and 0.82 (95% CI [0.81,0.84]) for UPMC test cohorts; an area under the precision recall curve values (AUPRC) of 0.6 (95% CI, [0.05, 0.06]) for UFH and 0.13 (95% CI, [0.11,0.15]) for UPMC test cohorts. Kinetic estimated glomerular filtration rate, nephrotoxic drug burden and blood urea nitrogen remained the top three features with the highest influence across the models and health centers. Conclusion: Locally developed models displayed marginally reduced discrimination when tested on another institution, while the top set of influencing features remained the same across the models and sites.


title: "Task Success" is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors

abstract: Large-scale generative models are shown to be useful for sampling meaningful candidate solutions, yet they often overlook task constraints and user preferences. Their full power is better harnessed when the models are coupled with external verifiers and the final solutions are derived iteratively or progressively according to the verification feedback. In the context of embodied AI, verification often solely involves assessing whether goal conditions specified in the instructions have been met. Nonetheless, for these agents to be seamlessly integrated into daily life, it is crucial to account for a broader range of constraints and preferences beyond bare task success (e.g., a robot should grasp bread with care to avoid significant deformations). However, given the unbounded scope of robot tasks, it is infeasible to construct scripted verifiers akin to those used for explicit-knowledge tasks like the game of Go and theorem proving. This begs the question: when no sound verifier is available, can we use large vision and language models (VLMs), which are approximately omniscient, as scalable Behavior Critics to catch undesirable robot behaviors in videos? To answer this, we first construct a benchmark that contains diverse cases of goal-reaching yet undesirable robot policies. Then, we comprehensively evaluate VLM critics to gain a deeper understanding of their strengths and failure modes. Based on the evaluation, we provide guidelines on how to effectively utilize VLM critiques and showcase a practical way to integrate the feedback into an iterative process of policy refinement. The dataset and codebase are released at: https://guansuns.github.io/pages/vlm-critic.


title: Variational Shapley Network: A Probabilistic Approach to Self-Explaining Shapley values with Uncertainty Quantification

abstract: Shapley values have emerged as a foundational tool in machine learning (ML) for elucidating model decision-making processes. Despite their widespread adoption and unique ability to satisfy essential explainability axioms, computational challenges persist in their estimation when ($i$) evaluating a model over all possible subset of input feature combinations, ($ii$) estimating model marginals, and ($iii$) addressing variability in explanations. We introduce a novel, self-explaining method that simplifies the computation of Shapley values significantly, requiring only a single forward pass. Recognizing the deterministic treatment of Shapley values as a limitation, we explore incorporating a probabilistic framework to capture the inherent uncertainty in explanations. Unlike alternatives, our technique does not rely directly on the observed data space to estimate marginals; instead, it uses adaptable baseline values derived from a latent, feature-specific embedding space, generated by a novel masked neural network architecture. Evaluations on simulated and real datasets underscore our technique's robust predictive and explanatory performance.


title: Preparing general mixed quantum states on quantum computers

abstract: The preparation of quantum states serves as a pivotal subroutine across various domains, including quantum communication protocols, quantum computing, and the exploration of quantum correlations and other resources within physical systems. Building upon the protocols introduced in previous works [M. B. Pozzobom and J. Maziero, Quantum Inf. Process. 18, 142 (2019)] and [E. R. G\aa rding et al., Entropy 23, 797 (2021)], the authors of [F. Shahbeigi, M. Karimi and V. Karimipour, Phys. Scr. 97, 025101 (2022)] demonstrated the capability to prepare mixed two-qubit X-real states on quantum computers by extending the methodology initially devised for mixed two-qubit Bell-diagonal states. In this article, we delve into an overlooked pattern within these quantum circuits, allowing us to generalize the approach to encompass a broader scope. Presenting an algorithm tailored for the preparation of $d$-dimensional mixed quantum states using quantum information processors, we offer a significant advancement in mixed state preparation methodologies. To validate the efficacy of our algorithm, we conducted comprehensive tests utilizing both X and non-X mixed two-qubit states, as well as arbitrary random density matrices spanning one, two, and three qubits.


title: Quantifying information flow in quantum processes

abstract: We present a framework for quantifying information flow within general quantum processes. For this purpose, we introduce the signaling power of quantum channels and discuss its relevant operational properties. This function supports extensions to higher order maps, enabling the evaluation of information flow in general quantum causal networks and also processes with indefinite causal order. Furthermore, our results offer a rigorous approach to information dynamics in open systems that applies also in the presence of initial system-environment correlations, and allows for the distinction between classical and quantum information backflow.


title: Symmetry shapes thermodynamics of macroscopic quantum systems

abstract: We derive a systematic approach to the thermodynamics of quantum systems based on the underlying symmetry groups. We show that the entropy of a system can be described in terms of group-theoretical quantities that are largely independent of the details of its density matrix. We apply our technique to generic $N$ identical interacting $d$-level quantum systems. Using permutation invariance, we find that, for large $N$, entropy displays a universal large deviation behavior with a rate function $s(\boldsymbol{x})$ that is completely independent of the microscopic details of the model, but depends only on the size of the irreducible representations of the permutation group $\text{S}_N$. In turn, the partition function is shown to satisfy a large deviation principle with a free energy $f(\boldsymbol{x})=e(\boldsymbol{x})-\beta^{-1}s(\boldsymbol{x})$, where $e(\boldsymbol{x})$ is a rate function that only depends on the ground state energy of particular subspaces determined by group representation theory. We apply our theory to the transverse-field Curie-Weiss model, a minimal model of phase transition exhibiting an interplay of thermal and quantum fluctuations.


title: Universal distribution of the number of minima for random walks and L\'evy flights

abstract: We compute exactly the full distribution of the number $m$ of local minima in a one-dimensional landscape generated by a random walk or a L\'evy flight. We consider two different ensembles of landscapes, one with a fixed number of steps $N$ and the other till the first-passage time of the random walk to the origin. We show that the distribution of $m$ is drastically different in the two ensembles (Gaussian in the former case, while having a power-law tail in the latter $m^{-3/2}$ in the latter case). However, the most striking aspect of our results is that, in each case, the distribution is completely universal for all $m$ (and not just for large $m$), i.e., independent of the jump distribution in the random walk. This means that the distributions are exactly identical for L\'evy flights and random walks with finite jump variance. Our analytical results are in excellent agreement with our numerical simulations.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: Resource-Aware Hierarchical Federated Learning in Wireless Video Caching Networks

abstract: Backhaul traffic congestion caused by the video traffic of a few popular files can be alleviated by storing the to-be-requested content at various levels in wireless video caching networks. Typically, content service providers (CSPs) own the content, and the users request their preferred content from the CSPs using their (wireless) internet service providers (ISPs). As these parties do not reveal their private information and business secrets, traditional techniques may not be readily used to predict the dynamic changes in users' future demands. Motivated by this, we propose a novel resource-aware hierarchical federated learning (RawHFL) solution for predicting user's future content requests. A practical data acquisition technique is used that allows the user to update its local training dataset based on its requested content. Besides, since networking and other computational resources are limited, considering that only a subset of the users participate in the model training, we derive the convergence bound of the proposed algorithm. Based on this bound, we minimize a weighted utility function for jointly configuring the controllable parameters to train the RawHFL energy efficiently under practical resource constraints. Our extensive simulation results validate the proposed algorithm's superiority, in terms of test accuracy and energy cost, over existing baselines.


title: Geometric theory of (extended) time-reversal symmetries in stochastic processes -- Part I: finite dimension

abstract: In this article, we analyze three classes of time-reversal of a Markov process with Gaussian noise on a manifold. We first unveil a commutativity constraint for the most general of these time-reversals to be well defined. Then we give a triad of necessary and sufficient conditions for the stochastic process to be time-reversible. While most reversibility conditions in the literature require knowledge of the stationary probability, our conditions do not, and therefore can be analytically checked in a systematic way. We then show that the mathematical objects whose cancellation is required by our reversibility conditions play the role of independent sources of entropy production. Furthermore, we give a geometric interpretation of the so-called irreversible cycle-affinity as the vorticity of a certain vector field for a Riemannian geometry given by the diffusion tensor. We also discuss the relation between the time-reversability of the stochastic process and that of an associated deterministic dynamics: its Stratonovitch average. Finally, we show that a suitable choice of a reference measure - that can be considered as a prior or a gauge, depending on the context - allows to study a stochastic process in a way that is both coordinate-free and independent of the prescription used to define stochastic integrals. When this reference measure plays the role of a gauge choice, we interpret our previous results through the lens of gauge theory and prove them to be gauge-invariant.


title: First-principles phase diagram of an interacting ionic chain

abstract: The widely-used Kohn-Sham implementation of density functional theory (DFT) maps a system of interacting electrons onto an auxiliary non-interacting one and is presumably inaccurate for strongly correlated materials. We present a concrete benchmark for DFT by examining the electronic ground state phase diagram of a strongly interacting chain with uneven, non-integer nuclear charges. The interplay between charge imbalance and Coulomb repulsion yields two competing phases, a band insulator and a Mott insulator. By including infinitesimal lattice distortions, DFT stabilizes the intermediate spontaneously dimerized insulator phase that results from this competition. We assess the phase diagram by mapping the bond length and nuclear charge ratio of the chain to the ionic Hubbard model and performing highly accurate density matrix renormalization group calculations. Our comparative study provides foundational insight into the utility of symmetry-broken DFT as a predictive tool for elucidating phase diagrams with competing orders.


title: A classification of nonzero skew immaculate functions

abstract: This article presents conditions under which the skewed version of immaculate noncommutative symmetric functions are nonzero. The work is motivated by the quest to determine when the matrix definition of a skew immaculate function aligns with the Hopf algberaic definition. We describe a necessary condition for a skew immaculate function to include a non-zero term, as well as a sufficient condition for there to be at least one non-zero term that survives any cancellation. We bring in several classical theorems such as the Pigeonhole Principle from combinatorics and Hall's Matching Theorem from graph theory to prove our theorems.


title: A concise proof of the stable model structure on symmetric spectra

abstract: It is well-known that the stable model structure on symmetric spectra cannot be transferred from the one on sequential spectra through the forgetful functor. We use the fibrant transfer theorem of Guetta--Moser--Sarazola--Verdugo to show it can be transferred between fibrant objects, providing a new, short and conceptual proof of its existence.


title: Classical and Quantum Computing of Shear Viscosity for $2+1D$ SU(2) Gauge Theory

abstract: We perform a nonperturbative calculation of the shear viscosity for $(2+1)$-dimensional SU(2) gauge theory by using the lattice Hamiltonian formulation. The retarded Green's function of the stress-energy tensor is calculated from real time evolution via exact diagonalization of the lattice Hamiltonian with a local Hilbert space truncation, and the shear viscosity is obtained via the Kubo formula. When taking the continuum limit, we account for the renormalization group flow of the coupling but no additional operator renormalization. We find the ratio of the shear viscosity and the entropy density $\frac{\eta}{s}$ is consistent with a well-known holographic result $\frac{1}{4\pi}$ at several temperatures on a $4\times4$ honeycomb lattice with the local electric representation truncated at $j_{\rm max}=\frac{1}{2}$. We also find the ratio of the spectral function and frequency $\frac{\rho^{xy}(\omega)}{\omega}$ exhibits a peak structure when the frequency is small. Both the exact diagonalization method and simple matrix product state classical simulation method beyond $j_{\rm max}=\frac{1}{2}$ on bigger lattices require exponentially growing resources. So we develop a quantum computing method to calculate the retarded Green's function and analyze various systematics of the calculation including $j_{\rm max}$ truncation and finite size effects, Trotter errors and the thermal state preparation efficiency. Our thermal state preparation method still requires resources that grow exponentially with the lattice size, but with a very small prefactor at high temperature. We test our quantum circuit on both the Quantinuum emulator and the IBM simulator for a small lattice and obtain results consistent with the classical computing ones.


title: What is "Typological Diversity" in NLP?

abstract: The NLP research community has devoted increased attention to languages beyond English, resulting in considerable improvements for multilingual NLP. However, these improvements only apply to a small subset of the world's languages. Aiming to extend this, an increasing number of papers aspires to enhance generalizable multilingual performance across languages. To this end, linguistic typology is commonly used to motivate language selection, on the basis that a broad typological sample ought to imply generalization across a broad range of languages. These selections are often described as being 'typologically diverse'. In this work, we systematically investigate NLP research that includes claims regarding 'typological diversity'. We find there are no set definitions or criteria for such claims. We introduce metrics to approximate the diversity of language selection along several axes and find that the results vary considerably across papers. Crucially, we show that skewed language selection can lead to overestimated multilingual performance. We recommend future work to include an operationalization of 'typological diversity' that empirically justifies the diversity of language samples.


title: Estimation of the precision of a structured light system in oil paintings on canvas

abstract: The conservation and authentication of pictorial artworks is considered an important part of the preservation of the cultural heritage. The use of non-destructive testing allows the obtaining of accurate information about the state of pictorial artworks, without direct contact between the equipment used and the sample. In particular, the use of this kind of technology is recommended in obtaining three-dimensional surface digital models, as it provides high-resolution information that constitutes a kind of fingerprint of the samples. In the case of pictorial artworks with some kind of surface relief, one of the most useful technologies is structured light (SL). In this paper the minimum difference in height that can be distinguished with this technology is estimated, establishing experimentally both the error committed in the measurement process and the precision in the use of this technology. The study, focused on the case of oil paintings on canvas, has been developed using a low-cost system to ensure its wide use.


title: Lifetimes of $b$-hadrons and mixing of neutral $B$-mesons: theoretical and experimental status

abstract: In this article, we review the current status of $B$-mixing and $b$-hadron lifetimes both from experimental and theoretical points of view. Furthermore, we discuss the phenomenological potential of these observables for deepening our understanding of quantum chromodynamics (QCD) and for indirect searches for effects beyond the Standard Model (SM). In addition, we present new updated SM predictions for the mixing observables $\Delta M_{d,s}$, $\Delta \Gamma_{d,s}$ and $a_{fs}^{d,s}$. We conclude with an outlook on future prospects for theoretical and experimental improvements.


title: Growth rate of self-sustained QED cascades induced by intense lasers

abstract: It was suggested [A. R. Bell & J. G. Kirk, PRL 101, 200403 (2008)] that an avalanche of electron-positron pairs can be triggered in the laboratory by a standing wave generated by intense laser fields. Here, we present a general solution to the long-standing problem of the avalanche growth rate calculation. We provide a simple formula that we apply to the case of the standing wave created by two circularly polarized lasers and demonstrate that it allows to predict the particle yield for the full range of intensity able to generate an avalanche. We account for the damping of the growth rate due to pair migration from the region of prolific generation and show that above a threshold in intensity, this effect is negligible. The growth rate calculation allows us to predict when abundant pair production will induce a back-reaction on the generating field due to plasma collective effects and screening. Our model shows excellent agreement with self-consistent PIC simulations and can be applied to study the generation of electron-positron pair avalanches in realistic field configurations to plan future experiments at ultra-high-intensity laser facilities.


title: Performance of entanglement purification including maximally entangled mixed states

abstract: Entanglement between distant quantum systems is a critical resource for implementing quantum communication. This property is affected by external agents and can be restored by employing efficient entanglement purification protocols. In this work, we propose an entanglement purification protocol based on two entangling two-qubit operations that replace the usual controlled-NOT (CNOT) gate. These operations arise from a generalized quantum measurement and can be understood as measurement operators in a positive operator-valued measure (POVM). Furthermore, two variants of the core protocol are introduced and shown to be more practical in certain scenarios. The performance of the protocols is studied in terms of the overall success probability of reaching a Bell state and the number of purifiable states. Based on rank-two states, we can obtain analytical expressions for the success probability that we extend and refine using numerical calculations to the case of maximally entangled states (MEMS). We also consider more general rank-three states to show that our procedure is in general more convenient compared to purification protocols based on Bell diagonal states. Finally, we test the protocols using initial random states. In all cases, we find a larger performance and larger amount of purifiable states using our schemes compared to the CNOT-based purification protocol.


title: A short proof of Frobenius for generic fibrations

abstract: We give a simple diagrammatic proof of the Frobenius property for generic fibrations, that does not depend on any additional structure on the interval object such as connections.


title: Intelligent Collective Escape of Swarm Robots Based on a Novel Fish-inspired Self-adaptive Approach with Neurodynamic Models

abstract: Fish schools present high-efficiency group behaviors through simple individual interactions to collective migration and dynamic escape from the predator. The school behavior of fish is usually a good inspiration to design control architecture for swarm robots. In this paper, a novel fish-inspired self-adaptive approach is proposed for collective escape for the swarm robots. In addition, a bio-inspired neural network (BINN) is introduced to generate collision-free escape robot trajectories through the combination of attractive and repulsive forces. Furthermore, to cope with dynamic environments, a neurodynamics-based self-adaptive mechanism is proposed to improve the self-adaptive performance of the swarm robots in the changing environment. Similar to fish escape maneuvers, simulation and experimental results show that the swarm robots are capable of collectively leaving away from the threats. Several comparison studies demonstrated that the proposed approach can significantly improve the effectiveness and efficiency of system performance, and the flexibility and robustness in complex environments.


title: MusicRL: Aligning Music Generation to Human Preferences

abstract: We propose MusicRL, the first music generation system finetuned from human feedback. Appreciation of text-to-music models is particularly subjective since the concept of musicality as well as the specific intention behind a caption are user-dependent (e.g. a caption such as "upbeat work-out music" can map to a retro guitar solo or a techno pop beat). Not only this makes supervised training of such models challenging, but it also calls for integrating continuous human feedback in their post-deployment finetuning. MusicRL is a pretrained autoregressive MusicLM (Agostinelli et al., 2023) model of discrete audio tokens finetuned with reinforcement learning to maximise sequence-level rewards. We design reward functions related specifically to text-adherence and audio quality with the help from selected raters, and use those to finetune MusicLM into MusicRL-R. We deploy MusicLM to users and collect a substantial dataset comprising 300,000 pairwise preferences. Using Reinforcement Learning from Human Feedback (RLHF), we train MusicRL-U, the first text-to-music model that incorporates human feedback at scale. Human evaluations show that both MusicRL-R and MusicRL-U are preferred to the baseline. Ultimately, MusicRL-RU combines the two approaches and results in the best model according to human raters. Ablation studies shed light on the musical attributes influencing human preferences, indicating that text adherence and quality only account for a part of it. This underscores the prevalence of subjectivity in musical appreciation and calls for further involvement of human listeners in the finetuning of music generation models.


title: Medium Resolution 0.97-5.3 micron spectra of Very Young Benchmark Brown Dwarfs with NIRSpec onboard the James Webb Space Telescope

abstract: Spectra of young benchmark brown dwarfs with well-known ages are vital to characterize other brown dwarfs, for which ages are in general not known. These spectra are also crucial to test atmospheric models which have the potential to provide detailed information about the atmospheres of these objects. However, to optimally test atmospheric models, medium-resolution, long-wavelength coverage spectra with well-understood uncertainties are ideal, such as the spectra provided by the NIRSpec instrument onboard the James Webb Space Telescope. In this paper, we present the medium-resolution JWST/NIRSpec spectra of two young brown dwarfs, TWA 28 (M9.0) and TWA 27A (M9.0), and one planetary-mass object, TWA 27B (L6.0), members of the TW Hydrae Association (~10 Myr). We show the richness of the atomic lines and molecular bands present in the spectra. All objects show signs of a circumstellar disk, via near-infrared excess and/or via emission lines. We matched a set of cloudless atmospheric spectra (ATMO), and cloudy atmospheric spectra (BT-Settl) to our NIRSpec spectra, and analyzed which wavelength ranges and spectral features both models reproduce best. Both models derive consistent parameters for the three sources, and predict the existence of CH4 at 3.35 microns in TWA 27B. Nonetheless, in contrast to other slightly older objects with similar spectral type, like PSO 318.5-22 and VHS 1256b, this feature is not present in the spectrum of TWA 27B. The lack of the CH4 feature might suggest that the L/T transition of very young dwarfs starts at later spectral types than for older brown dwarfs.


title: Further Constructions of AMUBs for Non-prime power Composite Dimensions

abstract: Construction of a large class of Mutually Unbiased Bases (MUBs) for non-prime power composite dimensions ($d = k\times s$) is a long standing open problem, which leads to different construction methods for the class Approximate MUBs (AMUBs) by relaxing the criterion that the absolute value of the dot product between two vectors chosen from different bases should be $\leq \frac{\beta}{\sqrt{d}}$. In this chapter, we consider a more general class of AMUBs (ARMUBs, considering the real ones too), compared to our earlier work in [Cryptography and Communications, 14(3): 527--549, 2022]. We note that the quality of AMUBs (ARMUBs) constructed using RBD$(X,A)$ with $|X|= d$, critically depends on the parameters, $|s-k|$, $\mu$ (maximum number of elements common between any pair of blocks), and the set of block sizes. We present the construction of $\mathcal{O}(\sqrt{d})$ many $\beta$-AMUBs for composite $d$ when $|s-k|< \sqrt{d}$, using RBDs having block sizes approximately $\sqrt{d}$, such that $|\braket{\psi^l_i|\psi^m_j}| \leq \frac{\beta}{\sqrt{d}}$ where $\beta = 1 + \frac{|s-k|}{2\sqrt{d}}+ \mathcal{O}(d^{-1}) \leq 2$. Moreover, if real Hadamard matrix of order $k$ or $s$ exists, then one can construct at least $N(k)+1$ (or $N(s)+1$) many $\beta$-ARMUBs for dimension $d$, with $\beta \leq 2 - \frac{|s-k|}{2\sqrt{d}}+ \mathcal{O}(d^{-1})< 2$, where $N(w)$ is the number of MOLS$(w)$. This improves and generalizes some of our previous results for ARMUBs from two points, viz., the real cases are now extended to complex ones too. The earlier efforts use some existing RBDs, whereas here we consider new instances of RBDs that provide better results. Similar to the earlier cases, the AMUBs (ARMUBs) constructed using RBDs are in general very sparse, where the sparsity $(\epsilon)$ is $1 - \mathcal{O}(d^{-\frac{1}{2}})$.


title: Can Generative Agents Predict Emotion?

abstract: Large Language Models (LLMs) have demonstrated a number of human-like abilities, however the empathic understanding and emotional state of LLMs is yet to be aligned to that of humans. In this work, we investigate how the emotional state of generative LLM agents evolves as they perceive new events, introducing a novel architecture in which new experiences are compared to past memories. Through this comparison, the agent gains the ability to understand new experiences in context, which according to the appraisal theory of emotion is vital in emotion creation. First, the agent perceives new experiences as time series text data. After perceiving each new input, the agent generates a summary of past relevant memories, referred to as the norm, and compares the new experience to this norm. Through this comparison we can analyse how the agent reacts to the new experience in context. The PANAS, a test of affect, is administered to the agent, capturing the emotional state of the agent after the perception of the new event. Finally, the new experience is then added to the agents memory to be used in the creation of future norms. By creating multiple experiences in natural language from emotionally charged situations, we test the proposed architecture on a wide range of scenarios. The mixed results suggests that introducing context can occasionally improve the emotional alignment of the agent, but further study and comparison with human evaluators is necessary. We hope that this paper is another step towards the alignment of generative agents.


title: JWST reveals a high fraction of disk breaks at $1\leq z\leq 3$

abstract: We analyzed the deconvolved surface brightness profiles of 247 massive and angularly large disk galaxies at $1\leq z\leq 3$ to study high-redshift disk breaks, using F356W-band images from the Cosmic Evolution Early Release Science survey (CEERS). We found that 12.6% of these galaxies exhibit type I (exponential) profiles, 56.7% exhibit type II (down-bending) profiles, and 34.8% exhibit type III (up-bending) profiles. Moreover, we showed that galaxies that are more massive, centrally concentrated, or redder, tend to show fewer type II and more type III breaks. These fractions and the detected dependencies on galaxy properties are in good agreement with those observed in the Local Universe. In particular, the ratio of the type II disk break radius to the bar radius in barred galaxies typically peaks at a value of 2.25, perhaps due to bar-induced radial migration. However, the timescale for secular evolution may be too lengthy to explain the observed breaks at such high redshifts. Instead, violent disk instabilities may be responsible, where spiral arms and clumps torque fling out the material, leading to the formation of outer exponential disks. Our results provide further evidence for the assertion that the Hubble Sequence was already in place during these early periods.


title: Role of spontaneously generated coherence (SGC) in laser cooling of atoms

abstract: The well-known sub-Doppler polarization gradient cooling in type-I transition ($F_e=F_g+1$) is caused by red-detuned lasers. On the other hand, in type-II transition ($F_e\le F_g$), sub-Doppler cooling takes place through blue-detuned lasers. This opposite behavior for the two types of transitions is due to SGC. In the absence of SGC, both types of transitions show blue-detuned cooling. In this work, we experimentally and theoretically demonstrate blue-detuned cooling for both types of transitions in $^{\textrm{87}}$Rb. For completeness, we compare the temperatures in various configurations.


title: LIPSTICK: Corruptibility-Aware and Explainable Graph Neural Network-based Oracle-Less Attack on Logic Locking

abstract: In a zero-trust fabless paradigm, designers are increasingly concerned about hardware-based attacks on the semiconductor supply chain. Logic locking is a design-for-trust method that adds extra key-controlled gates in the circuits to prevent hardware intellectual property theft and overproduction. While attackers have traditionally relied on an oracle to attack logic-locked circuits, machine learning attacks have shown the ability to retrieve the secret key even without access to an oracle. In this paper, we first examine the limitations of state-of-the-art machine learning attacks and argue that the use of key hamming distance as the sole model-guiding structural metric is not always useful. Then, we develop, train, and test a corruptibility-aware graph neural network-based oracle-less attack on logic locking that takes into consideration both the structure and the behavior of the circuits. Our model is explainable in the sense that we analyze what the machine learning model has interpreted in the training process and how it can perform a successful attack. Chip designers may find this information beneficial in securing their designs while avoiding incremental fixes.


title: CogCoM: Train Large Vision-Language Models Diving into Details through Chain of Manipulations

abstract: Vision-Language Models (VLMs) have demonstrated their broad effectiveness thanks to extensive training in aligning visual instructions to responses. However, such training of conclusive alignment leads models to ignore essential visual reasoning, further resulting in failures in meticulous visual problems and unfaithful responses. Drawing inspiration from human cognition in solving visual problems (e.g., marking, zoom in), this paper introduces Chain of Manipulations, a mechanism that enables VLMs to solve problems step-by-step with evidence. After training, models can solve various visual problems by eliciting intrinsic manipulations (e.g., grounding, zoom in) with results (e.g., boxes, image) actively without involving external tools, while also allowing users to trace error causes. We study the roadmap to implement this mechanism, including (1) a flexible design of manipulations upon extensive analysis, (2) an efficient automated data generation pipeline, (3) a compatible VLM architecture capable of multi-turn multi-image, and (4) a model training process for versatile capabilities. With the design, we also manually annotate 6K high-quality samples for the challenging graphical mathematical problems. Our trained model, \textbf{CogCoM}, equipped with this mechanism with 17B parameters achieves state-of-the-art performance across 9 benchmarks from 4 categories, demonstrating the effectiveness while preserving the interpretability. Our code, model weights, and collected data are publicly available at https://github.com/THUDM/CogCoM.


title: A note on graphs of $k$-colourings

abstract: For a graph $G$, the $k$-colouring graph of $G$ has vertices corresponding to proper $k$-colourings of $G$ and edges between colourings that differ at a single vertex. The graph supports the Glauber dynamics Markov chain for $k$-colourings, and has been extensively studied from both extremal and probabilistic perspectives. In this note, we show that for every graph $G$, there exists $k$ such that $G$ is uniquely determined by its $k$-colouring graph, confirming two conjectures of Asgarli, Krehbiel, Levinson and Russell. We further show that no finite family of generalised chromatic polynomials for $G$, which encode induced subgraph counts of its colouring graphs, uniquely determine $G$.


title: Error budget of parametric resonance entangling gate with a tunable coupler

abstract: We analyze the experimental error budget of parametric resonance gates in a tunable coupler architecture. We identify and characterize various sources of errors, including incoherent, leakage, amplitude, and phase errors. By varying the two-qubit gate time, we explore the dynamics of these errors and their impact on the gate fidelity. To accurately capture the impact of incoherent errors on gate fidelity, we measure the coherence times of qubits under gate operating conditions. Our findings reveal that the incoherent errors, mainly arising from qubit relaxation and dephasing due to white noise, limit the fidelity of the two-qubit gates. Moreover, we demonstrate that leakage to noncomputational states is the second largest contributor to the two-qubit gates infidelity, as characterized using leakage-randomized benchmarking. The error budgeting methodology we developed here can be effectively applied to other types of gate implementations.


title: CAST: Clustering Self-Attention using Surrogate Tokens for Efficient Transformers

abstract: The Transformer architecture has shown to be a powerful tool for a wide range of tasks. It is based on the self-attention mechanism, which is an inherently computationally expensive operation with quadratic computational complexity: memory usage and compute time increase quadratically with the length of the input sequences, thus limiting the application of Transformers. In this work, we propose a novel Clustering self-Attention mechanism using Surrogate Tokens (CAST), to optimize the attention computation and achieve efficient transformers. CAST utilizes learnable surrogate tokens to construct a cluster affinity matrix, used to cluster the input sequence and generate novel cluster summaries. The self-attention from within each cluster is then combined with the cluster summaries of other clusters, enabling information flow across the entire input sequence. CAST improves efficiency by reducing the complexity from $O(N^2)$ to $O(\alpha N)$ where N is the sequence length, and {\alpha} is constant according to the number of clusters and samples per cluster. We show that CAST performs better than or comparable to the baseline Transformers on long-range sequence modeling tasks, while also achieving higher results on time and memory efficiency than other efficient transformers.


title: Novel IMU-based Adaptive Estimator of the Center of Rotation of Joints for Movement Analysis

abstract: The location of the center of rotation (COR) of joints is a key parameter in multiple applications of human motion analysis. The aim of this work was to propose a novel real-time estimator of the center of fixed joints using an inertial measurement unit (IMU). Since the distance to this center commonly varies during the joint motion due to soft tissue artifacts (STA), our approach is aimed at adapting to these small variations when the COR is fixed. Our proposal, called ArVEd, to the best of our knowledge, is the first real-time estimator of the IMU-joint center vector based on one IMU. Previous works are off-line and require a complete measurement batch to be solved and most of them are not tested on the real scenario. The algorithm is based on an Extended Kalman Filter (EKF) that provides an adaptive vector to STA motion variations at each time instant, without requiring a pre-processing stage to reduce the level of noise. ArVEd has been tested through different experiments, including synthetic and real data. The synthetic data are obtained from a simulated spherical pendulum whose COR is fixed, considering both a constant and a variable IMU-joint vector, that simulates translational IMU motions due to STA. The results prove that ArVEd is adapted to obtain a vector per sample with an accuracy of 6.8$\pm$3.9 on the synthetic data, that means an error lower than 3.5% of the simulated IMU-joint vector. Its accuracy is also tested on the real scenario estimating the COR of the hip of 5 volunteers using as reference the results from an optical system. In this case, ArVEd gets an average error of 9.5% of the real vector value. In all the experiments, ArVEd outperforms the published results of the reference algorithms.


title: Algebraic identifiability of partial differential equation models

abstract: Differential equation models are crucial to scientific processes. The values of model parameters are important for analyzing the behaviour of solutions. A parameter is called globally identifiable if its value can be uniquely determined from the input and output functions. To determine if a parameter estimation problem is well-posed for a given model, one must check if the model parameters are globally identifiable. This problem has been intensively studied for ordinary differential equation models, with theory and several efficient algorithms and software packages developed. A comprehensive theory of algebraic identifiability for PDEs has hitherto not been developed due to the complexity of initial and boundary conditions. Here, we provide theory and algorithms, based on differential algebra, for testing identifiability of polynomial PDE models. We showcase this approach on PDE models arising in the sciences.


title: Exact weights and path metrics for triangulated categories and the derived category of persistence modules

abstract: We define exact weights on a triangulated category to be nonnegative functions on objects satisfying a subadditivity condition with respect to exact triangles. Such weights induce a metric on objects in the triangulated category, which we call a path metric. Our exact weights generalize the rank functions of J.\ Chuang and A.\ Lazarev and are analogous to the exact weights for an exact category given by the first author and J.\ Scott and D.\ Stanley. We show that cohomological functors from a triangulated category to an abelian category with an additive weight induce an exact weight on the triangulated category. We prove that triangle equivalences induce an isometry for the path metrics induced by cohomological functors. In the perfectly generated or compactly generated case, we use Brown representability to express the exact weight on the triangulated category. We give three characterizations of exactness for a weight on a triangulated category and show that they are equivalent. We also define Wasserstein distances for triangulated categories. Finally, we apply our work to derived categories of persistence modules and to representations of continuous quivers of type $\mathbb{A}$.


title: Invariant Set Estimation for Piecewise Affine Dynamical Systems Using Piecewise Affine Barrier Function

abstract: This paper introduces an algorithm for approximating the invariant set of closed-loop controlled dynamical systems identified using ReLU neural networks or piecewise affine PWA functions, particularly addressing the challenge of providing safety guarantees for ReLU networks commonly used in safety-critical applications. The invariant set of PWA dynamical system is estimated using ReLU networks or its equivalent PWA function. This method entails formulating the barrier function as a PWA function and converting the search process into a linear optimization problem using vertices. We incorporate a domain refinement strategy to increase flexibility in case the optimization does not find a valid barrier function. Moreover, the objective of optimization is to maximize the invariant set based on the current partition. Our experimental results demonstrate the effectiveness and efficiency of our approach, demonstrating its potential for ensuring the safety of PWA dynamical systems.


title: The spectrum of excisive functors

abstract: We prove a thick subcategory theorem for the category of $d$-excisive functors from finite spectra to spectra. This generalizes the Hopkins-Smith thick subcategory theorem (the $d=1$ case) and the $C_2$-equivariant thick subcategory theorem (the $d=2$ case). We obtain our classification theorem by completely computing the Balmer spectrum of compact $d$-excisive functors. A key ingredient is a non-abelian blueshift theorem for the generalized Tate construction associated to the family of non-transitive subgroups of products of symmetric groups. Also important are the techniques of tensor triangular geometry and striking analogies between functor calculus and equivariant homotopy theory. In particular, we introduce a functor calculus analogue of the Burnside ring and describe its Zariski spectrum \`{a} la Dress. The analogy with equivariant homotopy theory is strengthened further through two applications: We explain the effect of changing coefficients from spectra to ${\mathrm{H}\mathbb{Z}}$-modules and we establish a functor calculus analogue of transchromatic Smith-Floyd theory as developed by Kuhn-Lloyd. Our work offers a new perspective on functor calculus which builds upon the previous approaches of Arone-Ching and Glasman.


title: Direct evidence for cosmic-ray-induced correlated errors in superconducting qubit array

abstract: Correlated errors can significantly impact the quantum error correction, which challenges the assumption that errors occur in different qubits independently in both space and time. Superconducting qubits have been found to suffer correlated errors across multiple qubits, which could be attributable to ionizing radiations and cosmic rays. Nevertheless, the direct evidence and a quantitative understanding of this relationship are currently lacking. In this work, we propose to continuously monitor multi-qubit simultaneous charge-parity jumps to detect correlated errors and find that occur more frequently than multi-qubit simultaneous bit flips. Then, we propose to position two cosmic-ray muon detectors directly beneath the sample box in a dilution refrigerator and successfully observe the correlated errors in a superconducting qubit array triggered by muons. By introducing a lead shielding layer on the refrigerator, we also reveal that the majority of other correlated errors are primarily induced by gamma rays. Furthermore, we find the superconducting film with a higher recombination rate of quasiparticles used in the qubits is helpful in reducing the duration of correlated errors. Our results provide experimental evidence of the impact of gamma rays and muons on superconducting quantum computation and offer practical insights into mitigation strategies for quantum error correction. In addition, we observe the average occurrence rate of muon-induced correlated errors in our processor is approximately 0.40 min$^{-1}$cm$^{-2}$, which is comparable to the muon event rate detected by the muon detector with 0.506 min$^{-1}$cm$^{-2}$. This demonstrates the potential applications of superconducting qubit arrays as low-energy threshold sensors in the field of high-energy physics.


title: Theory of Supervibronic Transitions via Casimir Polaritons

abstract: A remote energy transfer pathway from electronic to vibrational degrees of freedom is identified inside an infrared optical cavity under vibrational strong coupling conditions. This mechanism relies on the dynamical Casimir effect, whereby real infrared photons are generated due to a sudden electronic transition of anisotropic molecules. Moreover, the formation of vibrational polaritons enables the excited photon energy to be transferred to the vibrational degrees of freedom before any dissipation occurs. Both analytic solutions and numerical simulations reveal that the magnitude of this electronic to vibrational energy transfer depends quadratically on the number of molecules and resonantly on the vibration-cavity detuning. During this "supervibronic" transition process, because the vibrational energy gain per molecule can be meaningful in the macroscopic limit, this process may potentially be observed using conventional vibrational strong coupling devices.


title: Prioritizing Safeguarding Over Autonomy: Risks of LLM Agents for Science

abstract: Intelligent agents powered by large language models (LLMs) have demonstrated substantial promise in autonomously conducting experiments and facilitating scientific discoveries across various disciplines. While their capabilities are promising, these agents, called scientific LLM agents, also introduce novel vulnerabilities that demand careful consideration for safety. However, there exists a notable gap in the literature, as there has been no comprehensive exploration of these vulnerabilities. This perspective paper fills this gap by conducting a thorough examination of vulnerabilities in LLM-based agents within scientific domains, shedding light on potential risks associated with their misuse and emphasizing the need for safety measures. We begin by providing a comprehensive overview of the potential risks inherent to scientific LLM agents, taking into account user intent, the specific scientific domain, and their potential impact on the external environment. Then, we delve into the origins of these vulnerabilities and provide a scoping review of the limited existing works. Based on our analysis, we propose a triadic framework involving human regulation, agent alignment, and an understanding of environmental feedback (agent regulation) to mitigate these identified risks. Furthermore, we highlight the limitations and challenges associated with safeguarding scientific agents and advocate for the development of improved models, robust benchmarks, and comprehensive regulations to address these issues effectively.


title: Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks

abstract: State-space models (SSMs), such as Mamba (Gu & Dao, 2023), have been proposed as alternatives to Transformer networks in language modeling, by incorporating gating, convolutions, and input-dependent token selection to mitigate the quadratic cost of multi-head attention. Although SSMs exhibit competitive performance, their in-context learning (ICL) capabilities, a remarkable emergent property of modern language models that enables task execution without parameter optimization, remain underexplored compared to Transformers. In this study, we evaluate the ICL performance of SSMs, focusing on Mamba, against Transformer models across various tasks. Our results show that SSMs perform comparably to Transformers in standard regression ICL tasks, while outperforming them in tasks like sparse parity learning. However, SSMs fall short in tasks involving non-standard retrieval functionality. To address these limitations, we introduce a hybrid model, MambaFormer, that combines Mamba with attention blocks, surpassing individual models in tasks where they struggle independently. Our findings suggest that hybrid architectures offer promising avenues for enhancing ICL in language models.


title: HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

abstract: Automated red teaming holds substantial promise for uncovering and mitigating the risks associated with the malicious use of large language models (LLMs), yet the field lacks a standardized evaluation framework to rigorously assess new methods. To address this issue, we introduce HarmBench, a standardized evaluation framework for automated red teaming. We identify several desirable properties previously unaccounted for in red teaming evaluations and systematically design HarmBench to meet these criteria. Using HarmBench, we conduct a large-scale comparison of 18 red teaming methods and 33 target LLMs and defenses, yielding novel insights. We also introduce a highly efficient adversarial training method that greatly enhances LLM robustness across a wide range of attacks, demonstrating how HarmBench enables codevelopment of attacks and defenses. We open source HarmBench at https://github.com/centerforaisafety/HarmBench.


title: Computing Approximate Nash Equilibria for Integer Programming Games

abstract: We propose a framework to compute approximate Nash equilibria in integer programming games with nonlinear payoffs, i.e., simultaneous and non-cooperative games where each player solves a parametrized mixed-integer nonlinear program. We prove that using absolute approximations of the players' objective functions and then computing its Nash equilibria is equivalent to computing approximate Nash equilibria where the approximation factor is doubled. In practice, we propose an algorithm to approximate the players' objective functions via piecewise linear approximations. Our numerical experiments on a cybersecurity investment game show the computational effectiveness of our approach.


title: Linear-time Minimum Bayes Risk Decoding with Reference Aggregation

abstract: Minimum Bayes Risk (MBR) decoding is a text generation technique that has been shown to improve the quality of machine translations, but is expensive, even if a sampling-based approximation is used. Besides requiring a large number of sampled sequences, it requires the pairwise calculation of a utility metric, which has quadratic complexity. In this paper, we propose to approximate pairwise metric scores with scores calculated against aggregated reference representations. This changes the complexity of utility estimation from $O(n^2)$ to $O(n)$, while empirically preserving most of the quality gains of MBR decoding. We release our source code at https://github.com/ZurichNLP/mbr


title: EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

abstract: Scaling up contrastive language-image pretraining (CLIP) is critical for empowering both vision and multimodal models. We present EVA-CLIP-18B, the largest and most powerful open-source CLIP model to date, with 18-billion parameters. With only 6-billion training samples seen, EVA-CLIP-18B achieves an exceptional 80.7% zero-shot top-1 accuracy averaged across 27 widely recognized image classification benchmarks, outperforming its forerunner EVA-CLIP (5-billion parameters) and other open-source CLIP models by a large margin. Remarkably, we observe a consistent performance improvement with the model size scaling of EVA-CLIP, despite maintaining a constant training dataset of 2-billion image-text pairs from LAION-2B and COYO-700M. This dataset is openly available and much smaller than the in-house datasets (e.g., DFN-5B, WebLI-10B) employed in other state-of-the-art CLIP models. EVA-CLIP-18B demonstrates the potential of EVA-style weak-to-strong visual model scaling. With our model weights made publicly available, we hope to facilitate future research in vision and multimodal foundation models.


title: AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls

abstract: We introduce AnyTool, a large language model agent designed to revolutionize the utilization of a vast array of tools in addressing user queries. We utilize over 16,000 APIs from Rapid API, operating under the assumption that a subset of these APIs could potentially resolve the queries. AnyTool primarily incorporates three elements: an API retriever with a hierarchical structure, a solver aimed at resolving user queries using a selected set of API candidates, and a self-reflection mechanism, which re-activates AnyTool if the initial solution proves impracticable. AnyTool is powered by the function calling feature of GPT-4, eliminating the need for training external modules. We also revisit the evaluation protocol introduced by previous works and identify a limitation in this protocol that leads to an artificially high pass rate. By revising the evaluation protocol to better reflect practical application scenarios, we introduce an additional benchmark, termed AnyToolBench. Experiments across various datasets demonstrate the superiority of our AnyTool over strong baselines such as ToolLLM and a GPT-4 variant tailored for tool utilization. For instance, AnyTool outperforms ToolLLM by +35.4% in terms of average pass rate on ToolBench. Code will be available at https://github.com/dyabel/AnyTool.


title: Large Vocabulary Spontaneous Speech Recognition for Tigrigna

abstract: This thesis proposes and describes a research attempt at designing and developing a speaker independent spontaneous automatic speech recognition system for Tigrigna The acoustic model of the Speech Recognition System is developed using Carnegie Mellon University Automatic Speech Recognition development tool (Sphinx) while the SRIM tool is used for the development of the language model. Keywords Automatic Speech Recognition Tigrigna language


abstract: Let $\mathcal{X}$ be a Banach space. Let $\{\tau_j\}_{j=1}^n, \{\omega_k\}_{k=1}^m\subseteq \mathcal{X}$ and $\{f_j\}_{j=1}^n$, $\{g_k\}_{k=1}^m\subseteq \mathcal{X}^*$ satisfy $ |f_j(\tau_j)|\geq 1$ for all $ 1\leq j \leq n$, $|g_k(\omega_k)|\geq 1 $ for all $1\leq k \leq m$. If $x \in \mathcal{X}\setminus \{0\}$ is such that $x=\theta_\tau\theta_f x=\theta_\omega\theta_g x$, then we show that \begin{align}\label{FKDB} (1) \quad\quad\quad\quad \|\theta_fx\|_0\|\theta_gx\|_0\geq \frac{\bigg[1-(\|\theta_fx\|_0-1)\max\limits_{1\leq j,r \leq n,j\neq r}|f_j(\tau_r)|\bigg]^+\bigg[1-(\|\theta_g x\|_0-1)\max\limits_{1\leq k,s \leq m,k\neq s}|g_k(\omega_s)|\bigg]^+}{\left(\displaystyle\max_{1\leq j \leq n, 1\leq k \leq m}|f_j(\omega_k)|\right)\left(\displaystyle\max_{1\leq j \leq n, 1\leq k \leq m}|g_k(\tau_j)|\right)}. \end{align} We call Inequality (1) as \textbf{Functional Kuppinger-Durisi-B\"{o}lcskei Uncertainty Principle}. Inequality (1) improves the uncertainty principle obtained by Kuppinger, Durisi and B\"{o}lcskei \textit{[IEEE Trans. Inform. Theory (2012)]} (which improved the Donoho-Stark-Elad-Bruckstein uncertainty principle \textit{[SIAM J. Appl. Math. (1989), IEEE Trans. Inform. Theory (2002)]}). We also derive functional form of the uncertainity principle obtained by Studer, Kuppinger, Pope and B\"{o}lcskei \textit{[EEE Trans. Inform. Theory (2012)]}.


title: Chemical Reaction Dynamics under Vibrational Strong Coupling

abstract: In this thesis, we use classical, semi-classical and quantum-mechanical methods to simulate chemical reaction dynamics inside of an optical cavity. Within such a cavity, by selectively coupling vibrational modes of the reactants to the vacuum state of light, recent experiments have observed significant changes in reaction rates and equilibrium constants - all without any external input of energy. We investigate the dynamics of both a single reaction and an ensemble of N identical reactions coupled to the cavity. In our single reactant studies, we find significant modification to the rate of reaction and to its quantum-mechanical equilibrium constant. All of the effects observed in our single molecule studies are however found to diminish as the number of reactants is increased. For any experimentally relevant number of molecules, the cavity effects on the reaction rate and the equilibrium constant are therefore shown to be negligible within all theories considered in this thesis. This thesis therefore does not offer any explanation for the experimental observations. It does however highlight issues with all current theoretical work on this topic, and provides suggestions - in light of the results presented here and in recent literature - as to what might be required to explain these effects.


title: Continuous K-biframes in Hilbert spaces and their tensor products

abstract: A generalization of continuous biframe in a Hilbert space is introduced and a few examples are discussed. Some characterizations and algebraic properties of this biframe are given. Here we also construct various types of continuous K-biframes with the help of a bounded linear operator. Relationship between continuous K-biframe and quotient operator is established. Finally, we define continuous K-biframe for the tensor products of Hilbert spaces and give an example.


title: MAPLES-DR: MESSIDOR Anatomical and Pathological Labels for Explainable Screening of Diabetic Retinopathy

abstract: Reliable automatic diagnosis of Diabetic Retinopathy (DR) and Macular Edema (ME) is an invaluable asset in improving the rate of monitored patients among at-risk populations and in enabling earlier treatments before the pathology progresses and threatens vision. However, the explainability of screening models is still an open question, and specifically designed datasets are required to support the research. We present MAPLES-DR (MESSIDOR Anatomical and Pathological Labels for Explainable Screening of Diabetic Retinopathy), which contains, for 198 images of the MESSIDOR public fundus dataset, new diagnoses for DR and ME as well as new pixel-wise segmentation maps for 10 anatomical and pathological biomarkers related to DR. This paper documents the design choices and the annotation procedure that produced MAPLES-DR, discusses the interobserver variability and the overall quality of the annotations, and provides guidelines on using the dataset in a machine learning context.


title: Maximizing bipolar sensitivity for anomalous Nernst thermopiles in heat flux sensing in amorphous GdCo alloys

abstract: A Heat Flux Sensor (HFS) facilitates the visualization of heat flow, unlike a temperature sensor, and is anticipated to be a key technology in managing waste heat. Recently, an HFS utilizing the Anomalous Nernst Effect (ANE) has been proposed garnering significant interest in enhancing the transverse Seebeck coefficient. However, ideal materials for HFS not only require a large transverse Seebeck coefficient but also meet several criteria including low thermal conductivity and a bipolar nature of the transverse Seebeck coefficient, especially a negative coefficient. In this study, we have investigated ANE in amorphous ferrimagnetic GdCo alloys, revealing their numerous advantages as HFS materials. These include a large transverse Seebeck coefficient, extremely low thermal conductivity, large negative sensitivity, unparalleled bipolar sensitivity, versatility for deposition on various substrates, and a small longitudinal Seebeck coefficient. These qualities position GdCo films as promising candidates for the advancement of HFS technology.


title: Statistical mechanics of elastica for the shape of supercoiled DNA: hyperelliptic elastica of genus three

abstract: This article studies the statistical mechanics of elastica as a model of the shapes of the supercoiled DNA, and shows that its excited states can be characterized by the focusing modified KdV (MKdV) equation due to thermal fluctuation. Following the previous paper (Matsutani and Previato, Physica D 430 (2022) 133073), the hyperelliptic solutions of the focusing modified KdV (MKdV) equation of genus three are considered. There appears a pattern as a repetition of the modulation of figure-eight and the inverse 'S' as a thermal fluctuation of elastica, called the S-eight mode. Our model states that the excited states of elastica due to the thermal effect have the S-eight mode, which reproduces the shapes of the AFM image of the supercoiled DNAs observed by Japaridze et al. (Nano Lett. 17 3, (2017) 1938).

categories: cond-mat.soft math-ph math.MP nlin.SI physics.bio-ph


title: Pinning of crack fronts by hard and soft inclusions: a phase field study

abstract: Through tridimensonal numerical simulations of crack propagating in material with an elastic moduli heterogeneity it is shown that the presence of a simple inclusion can affect dramatically the propagation of the crack. Both the presence of soft and hard inclusions can lead to the arrest of a crack front. Here the mechanism leading to the arrest of the crack are described and shown to depend on the nature of the inclusion. This is also the case in regimes where the presence of the inclusion leads to a slow down of the crack.


title: Generalization of the Landauer-B\"uttiker theory onto the case of dissipative contacts

abstract: We revisit the problem of two-terminal transport of non-interacting Fermi particles in a mesoscopic device. First, we generalize the problem by including into consideration relaxation processes in contacts (which are characterized by the contact self-thermalization rate $\gamma$) and then solve it by using the master equation approach. In the limit $\gamma\rightarrow0$ the obtained results are shown to reproduce those of the Landauer-B\"uttiker theory. Thus, the presented analysis proves analytical correspondence between the Landauer-B\"uttiker and master-equation approaches to quantum transport, -- the problem which resisted solution for decades.


title: The Language of Hyperelastic Materials

abstract: The automated discovery of constitutive laws forms an emerging research area, that focuses on automatically obtaining symbolic expressions describing the constitutive behavior of solid materials from experimental data. Existing symbolic/sparse regression methods rely on the availability of libraries of material models, which are typically hand-designed by a human expert using known models as reference, or deploy generative algorithms with exponential complexity which are only practicable for very simple expressions. In this paper, we propose a novel approach to constitutive law discovery relying on formal grammars as an automated and systematic tool to generate constitutive law expressions. Compliance with physics constraints is partly enforced a priori and partly empirically checked a posteriori. We deploy the approach for two tasks: i) Automatically generating a library of valid constitutive laws for hyperelastic isotropic materials; ii) Performing data-driven discovery of hyperelastic material models from displacement data affected by different noise levels. For the task of automatic library generation, we demonstrate the flexibility and efficiency of the proposed methodology in avoiding hand-crafted features and human intervention. For the data-driven discovery task, we demonstrate the accuracy, robustness and significant generalizability of the proposed methodology.


title: Analysis of Hopfield Model as Associative Memory

abstract: This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen our understanding. Focusing on audio retrieval, the study demonstrates the Hopfield model's associative memory capabilities. Through practical implementation, the network is trained to retrieve different patterns.


title: Inequalities on the essential joint and essential generalized spectral radius

abstract: We prove new inequalities for the essential generalized and the essential joint spectral radius of Hadamard (Schur) weighted geometric means of bounded sets of infinite nonnegative matrices that define operators on suitable Banach sequence spaces and of bounded sets of positive kernel operators on $L^2$. To our knowledge the obtained inequalities are new even in the case of singelton sets.


title: Exploring $\rm Mg^{2+}$ and $\rm Ca^{2+}$ Conductors Via Solid-State Metathesis Reactions

abstract: Magnesium and calcium batteries offer promising energy storage solutions characterised by cost-effectiveness, safety, and high energy density. However, the scarcity of viable electrode and electrolyte materials vastly hinders their advancement. This study utilises solid-state metathetical reactions involving predominantly chalcogen- and pnictogen-based honeycomb layered oxides with alkaline-earth halides/nitrates to synthesise $\rm Mg^{2+}$- and $\rm Ca^{2+}$-based materials previously achievable only under high-temperature/high-pressure conditions, as well as new metastable materials with unique crystal versatility. Particularly, we employ metathetical reactions involving $\rm Li_4MgTeO_6$, $\rm Na_2Mg_2TeO_6$, and $\rm Na_4MgTeO_6$ with $\rm MgCl_2$\,/\,$\rm Mg(NO_3)_2$ or $\rm Ca(NO_3)_2$ at temperatures not exceeding 500 $^\circ$C to produce $\rm Mg_3TeO_6$ polymorphs, ilmenite-type $\rm CaMg_2TeO_6$\,/\,$\rm Mg_2CaTeO_6$, and double perovskite $\rm Ca_2MgTeO_6$. Thus, we demonstrate that these materials, conventionally requiring gigascale pressures and high temperatures (>1000$^\circ$C) for their proper synthesis, are now readily accessible at ambient pressure and considerably lower temperatures. Meanwhile, despite sub-optimal pellet densities, the synthesised ilmenite-type $\rm Mg_3TeO_6$ and double perovskite ${\rm Ca}_2M{\rm TeO_6}$ ($M = \rm Mg, Ca, Zn$)} materials exhibit remarkable bulk ionic conductivity at room temperature, marking them as promising compositional spaces for exploring novel $\rm Mg^{2+}$ and $\rm Ca^{2+}$ conductors. Furthermore, this study extends the applicability of metathetical reactions to attain Mg- or Ca-based bismuthates, antimonates, ruthenates, tungstates, titanates, phosphates, and silicates, thus opening avenues to novel high-entropy multifunctional nanomaterial platforms with utility in energy storage and beyond.


title: Application analysis of ai technology combined with spiral CT scanning in early lung cancer screening

abstract: At present, the incidence and fatality rate of lung cancer in China rank first among all malignant tumors. Despite the continuous development and improvement of China's medical level, the overall 5-year survival rate of lung cancer patients is still lower than 20% and is staged. A number of studies have confirmed that early diagnosis and treatment of early stage lung cancer is of great significance to improve the prognosis of patients. In recent years, artificial intelligence technology has gradually begun to be applied in oncology. ai is used in cancer screening, clinical diagnosis, radiation therapy (image acquisition, at-risk organ segmentation, image calibration and delivery) and other aspects of rapid development. However, whether medical ai can be socialized depends on the public's attitude and acceptance to a certain extent. However, at present, there are few studies on the diagnosis of early lung cancer by AI technology combined with SCT scanning. In view of this, this study applied the combined method in early lung cancer screening, aiming to find a safe and efficient screening mode and provide a reference for clinical diagnosis and treatment.


title: ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learning

abstract: Designing de novo proteins beyond those found in nature holds significant promise for advancements in both scientific and engineering applications. Current methodologies for protein design often rely on AI-based models, such as surrogate models that address end-to-end problems by linking protein structure to material properties or vice versa. However, these models frequently focus on specific material objectives or structural properties, limiting their flexibility when incorporating out-of-domain knowledge into the design process or comprehensive data analysis is required. In this study, we introduce ProtAgents, a platform for de novo protein design based on Large Language Models (LLMs), where multiple AI agents with distinct capabilities collaboratively address complex tasks within a dynamic environment. The versatility in agent development allows for expertise in diverse domains, including knowledge retrieval, protein structure analysis, physics-based simulations, and results analysis. The dynamic collaboration between agents, empowered by LLMs, provides a versatile approach to tackling protein design and analysis problems, as demonstrated through diverse examples in this study. The problems of interest encompass designing new proteins, analyzing protein structures and obtaining new first-principles data -- natural vibrational frequencies -- via physics simulations. The concerted effort of the system allows for powerful automated and synergistic design of de novo proteins with targeted mechanical properties. The flexibility in designing the agents, on one hand, and their capacity in autonomous collaboration through the dynamic LLM-based multi-agent environment on the other hand, unleashes great potentials of LLMs in addressing multi-objective materials problems and opens up new avenues for autonomous materials discovery and design.


title: A closer physico-chemical look to the Layer-by-Layer electrostatic self-assembly of polyelectrolyte multilayers

abstract: The fabrication of polyelectrolyte multilayer films (PEMs) using the Layer-by-Layer (LbL) method is one of the most versatile approaches for manufacturing functional surfaces. This is the result of the possibility to control the assembly process of the LbL films almost at will, by changing the nature of the assembled materials (building blocks), the assembly conditions (pH, ionic strength, temperature, etc.) or even by changing some other operational parameters which may impact in the structure and physico-chemical properties of the obtained multi-layered films. Therefore, the understanding of the impact of the above mentioned parameters on the assembly process of LbL materials plays a critical role in the potential use of the LbL method for the fabrication of new functional materials with technological interest. This review tries to provide a broad physico-chemical perspective to the study of the fabrication process of PEMs by the LbL method, which allows one to take advantage of the many possibilities offered for this approach on the fabrication of new functional nanomaterials.


title: Ionomer structure and component transport in the cathode catalyst layer of PEM fuel cells: A molecular dynamics study

abstract: The transport of water and protons in the cathode catalyst layer (CCL) of proton exchange membrane (PEM) fuel cells is critical for cell performance, but the underlying mechanism is still unclear. Herein, the ionomer structure and the distribution/transport characteristics of water and protons in CCLs are investigated via all-atom molecular dynamics simulations. The results show that at low water contents, isolated water clusters form in ionomer pores, while proton transport is mainly via the charged sites of the ionomer side chains and the Grotthuss mechanism. Moreover, with increasing water content, water clusters are interconnected to form continuous water channels, which provide effective paths for proton transfer via the vehicular and Grotthuss mechanisms. Increasing the ionomer mass content can enhance the dense arrangement of the ionomer, which in turn increases the density of charge sites and improves the proton transport efficiency. When the ionomer mass content is high, the clustering effect reduces the space for water diffusion, increases the proton transport path, and finally decreases the proton transport efficiency. By providing physics insights into the proton transport mechanism, this study is helpful for the structural design and performance improvement of CCLs of PEM fuel cells.


title: Anisotropic frictional model for an object sliding in a granular media

abstract: Several locomotion strategies are based on the anisotropic nature of the forces experienced by the moving body with its environment. We report experiments on the anisotropy of the frictional force experienced by a cylinder moving in a granular medium as a function of the orientation $\alpha$ between the cylinder and its velocity. The component of the force in the direction parallel to the velocity of the cylinder is always higher than the perpendicular component and the force is therefore anisotropic. While the parallel component increases continuously with the cylinder angle $\alpha$, we observe that the perpendicular component reaches a maximum value for an orientation of $\alpha_c \simeq 35^\circ$. In order to rationalise these observations, we have developed a theoretical model which assumes that the mechanical energy required to move the cylinder is dissipated by friction and establishes a relationship between the parallel and perpendicular force components that is consistent with experiments.


title: On the error term in the explicit formula of Riemann-von Mangoldt II

abstract: We give an explicit $O(x/T)$ error term for the truncated Riemann--von Mangoldt explicit formula. For large $x$, this provides a modest improvement over previous work, which we demonstrate via an application to a result on primes between consecutive powers.


title: Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sources

abstract: The diverse agents in multi-agent perception systems may be from different companies. Each company might use the identical classic neural network architecture based encoder for feature extraction. However, the data source to train the various agents is independent and private in each company, leading to the Distribution Gap of different private data for training distinct agents in multi-agent perception system. The data silos by the above Distribution Gap could result in a significant performance decline in multi-agent perception. In this paper, we thoroughly examine the impact of the distribution gap on existing multi-agent perception systems. To break the data silos, we introduce the Feature Distribution-aware Aggregation (FDA) framework for cross-domain learning to mitigate the above Distribution Gap in multi-agent perception. FDA comprises two key components: Learnable Feature Compensation Module and Distribution-aware Statistical Consistency Module, both aimed at enhancing intermediate features to minimize the distribution gap among multi-agent features. Intensive experiments on the public OPV2V and V2XSet datasets underscore FDA's effectiveness in point cloud-based 3D object detection, presenting it as an invaluable augmentation to existing multi-agent perception systems.


title: FPGA Deployment of LFADS for Real-time Neuroscience Experiments

abstract: Large-scale recordings of neural activity are providing new opportunities to study neural population dynamics. A powerful method for analyzing such high-dimensional measurements is to deploy an algorithm to learn the low-dimensional latent dynamics. LFADS (Latent Factor Analysis via Dynamical Systems) is a deep learning method for inferring latent dynamics from high-dimensional neural spiking data recorded simultaneously in single trials. This method has shown a remarkable performance in modeling complex brain signals with an average inference latency in milliseconds. As our capacity of simultaneously recording many neurons is increasing exponentially, it is becoming crucial to build capacity for deploying low-latency inference of the computing algorithms. To improve the real-time processing ability of LFADS, we introduce an efficient implementation of the LFADS models onto Field Programmable Gate Arrays (FPGA). Our implementation shows an inference latency of 41.97 $\mu$s for processing the data in a single trial on a Xilinx U55C.


title: Motion Mapping Cognition: A Nondecomposable Primary Process in Human Vision

abstract: Human intelligence seems so mysterious that we have not successfully understood its foundation until now. Here, I want to present a basic cognitive process, motion mapping cognition (MMC), which should be a nondecomposable primary function in human vision. Wherein, I point out that, MMC process can be used to explain most of human visual functions in fundamental, but can not be effectively modelled by traditional visual processing ways including image segmentation, object recognition, object tracking etc. Furthermore, I state that MMC may be looked as an extension of Chen's theory of topological perception on human vision, and seems to be unsolvable using existing intelligent algorithm skills. Finally, along with the requirements of MMC problem, an interesting computational model, quantized topological matching principle can be derived by developing the idea of optimal transport theory. Above results may give us huge inspiration to develop more robust and interpretable machine vision models.


title: Accelerated boundary integral analysis of energy eigenvalues for confined electron states in quantum semiconductor heterostructures

abstract: This paper presents a novel and efficient approach for the computation of energy eigenvalues in quantum semiconductor heterostructures. Accurate determination of the electronic states in these heterostructures is crucial for understanding their optical and electronic properties, making it a key challenge in semiconductor physics. The proposed method is based on utilizing series expansions of zero-order Bessel functions to numerically solve the Schr\"odinger equation using boundary integral method for bound electron states in a computationally efficient manner. To validate the proposed technique, we applied it to address previously explored issues by other research groups. The results clearly demonstrate the computational efficiency and high precision of our approach. Notably, the proposed technique significantly reduces the computational time compared to the conventional method for searching the energy eigenvalues in quantum structures.


title: Swimmers at Interfaces Enhance Interfacial Transport

abstract: The behavior of fluid interfaces far from equilibrium plays central roles in nature and in industry. Active swimmers trapped at interfaces can alter transport at fluid boundaries with far reaching implications. Swimmers can become trapped at interfaces in diverse configurations and swim persistently in these surface adhered states. The self-propelled motion of bacteria makes them ideal model swimmers to understand such effects. We have recently characterized the swimming of interfacially-trapped Pseudomonas aeruginosa PA01 moving in pusher mode. The swimmers adsorb at the interface with pinned contact lines, which fix the angle of the cell body at the interface and constrain their motion. Thus, most interfacially-trapped bacteria swim along circular paths. Fluid interfaces form incompressible two-dimensional layers, altering leading order interfacial flows generated by the swimmers from those in bulk. In our previous work, we have visualized the interfacial flow around a pusher bacterium and described the flow field using two dipolar hydrodynamic modes; one stresslet mode whose symmetries differ from those in bulk, and another bulk mode unique to incompressible fluid interfaces. Based on this understanding, swimmers-induced tracer displacements and swimmer-swimmer pair interactions are explored using analysis and experiment. The settings in which multiple interfacial swimmers with circular motion can significantly enhance interfacial transport of tracers or promotemixing of other swimmers on the interface are identified through simulations and compared to experiment. This study identifies important factors of general interest regarding swimmers on or near fluid boundaries, and in the design of biomimetic swimmers to enhance transport at interfaces


title: Gaussian Plane-Wave Neural Operator for Electron Density Estimation

abstract: This work studies machine learning for electron density prediction, which is fundamental for understanding chemical systems and density functional theory (DFT) simulations. To this end, we introduce the Gaussian plane-wave neural operator (GPWNO), which operates in the infinite-dimensional functional space using the plane-wave and Gaussian-type orbital bases, widely recognized in the context of DFT. In particular, both high- and low-frequency components of the density can be effectively represented due to the complementary nature of the two bases. Extensive experiments on QM9, MD, and material project datasets demonstrate GPWNO's superior performance over ten baselines.


title: Electrokinetic origin of swirling flow on nanoscale interface

abstract: The zeta ($\zeta$) potential is a pivotal metric for characterizing the electric field topology within an electric double layer - an important phenomenon on phase interface. It underpins critical processes in diverse realms such as chemistry, biomedical engineering, and micro/nanofluidics. Yet, local measurement of $\zeta$ potential at the interface has historically presented challenges, leading researchers to simplify a chemically homogenized surface with a uniform $\zeta$ potential. In the current investigation, we present evidence that, within a microchannel, the spatial distribution of $\zeta$ potential across a chemically homogeneous solid-liquid interface can become two-dimensional (2D) under an imposed flow regime, as disclosed by a state-of-art fluorescence photobleaching electrochemistry analyzer (FLEA) technique. The $\zeta$ potential' s propensity to become increasingly negative downstream, presents an approximately symmetric, V-shaped pattern in the spanwise orientation. Intriguingly, and of notable significance to chemistry and engineering, this 2D $\zeta$ potential framework was found to electrokinetically induce swirling flows in tens of nanometers, aligning with the streamwise axis, bearing a remarkable resemblance to the well-documented hairpin vortices in turbulent boundary layers. Our findings gesture towards a novel perspective on the genesis of vortex structures in nanoscale. Additionally, the FLEA technique emerges as a potent tool for discerning $\zeta$ potential at a local scale with high resolution, potentially accelerating the evolution and applications of novel surface material.


title: Unveiling the Fifth State of Matter: Insights into Ultra-Hot Plasma and its Applications

abstract: In this work, we investigate the dissociation energy of the North (N) and South (S) poles of a quantum magnetic particle, incorporated within both classical and quantum mechanical perspectives. A simple model of a harmonic oscillator is employed to estimate the dissociation energy of the N-S poles, as well as the corresponding breakdown temperature and internal pressure. The results indicate that the separation of magnetic poles occurs in two states: (a) in an ultra-hot plasma medium with extremely high temperatures, such as in the core of a hot star, and (b) at extremely high pressures, such as between internal plates in complex superlattices of layered solids. The breakdown temperature is found to be of the order of $10^7$ to $10^8$ Kelvin, which is only achievable in an ultra-hot plasma environment, known as the fifth phase of matter. Based on this model, the possibility of dissociation of bonds between N and S magnetic poles for solid superlattices under very high pressures between crystal plates is also calculated. The results suggest that the presence of isolated magnetic monopoles in superlattices of solids under ultra-high-pressure conditions is possible. Consequently, the model proposes that the conductivity of magnetic monopole carriers can be applied to the manipulation of nanomaterials for the production of advanced devices, such as new generations of superconductors, new spin devices, and magnetic-electronics, advanced materials with magnetic monopoles, as well as super-dielectrics.


title: Proximal-point-like algorithms for abstract convex minimisation problems

abstract: In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when the set of abstract linear functions forms a linear space. This latter assumption can be relaxed to only require the set of abstract linear functions to be closed under the sum, which is a classical assumption in abstract convexity. We provide numerical examples on the minimisation of nonconvex functions with the presented algorithms.


title: Interplanetary magnetic field $B_y$ controlled Alfv\'{e}n wings at Earth during encounter of a coronal mass ejection

abstract: In the vicinity of Earth's orbit, the typical solar wind Alfv\'{e}n Mach number exceeds 5, and the super-Alfv\'{e}nic solar wind drives a conventional magnetosphere configuration. However, at the ejecta phase of an interplanetary coronal mass ejection (ICME) event, the Alfv\'{e}n Mach number may experience a significant reduction due to the intensified interplanetary magnetic field (IMF) strength and decreased density. On 24 April 2023, an ICME reached Earth's orbit. The solar wind density dropped to as low as 0.3 amu/cc while the IMF strength is about 25 nT. As a result, the solar wind flow transitions to a sub-Alfv\'{e}nic state with an Alfv\'{e}n Mach number of 0.4, providing opportunities to investigate the interaction of planetary magnetospheres with low Mach number solar wind. We carry out global simulations to investigate the responses of Earth's magnetosphere to the sub-Alfv\'{e}nic ICME ejecta. The global magnetohydrodynamic (MHD) simulation results show the formation of Alfv\'{e}n wings as the solar wind becomes sub-Alfv\'{e}nic. Furthermore, the sub-Alfv\'{e}nic period was characterized by the dominance of IMF By component, causing the Alfv\'{e}n wings to extend towards the dawn and dusk sides. In this paper, we present the structures of the magnetic field, plasma flow, and current system around the Alfv\'{e}n wings. The global magnetospheric convection under the sub-Alfv\'{e}nic solar wind condition is discussed in depth. Our results achieve a new level of understanding about the interaction between a magnetized body and sub-Alfv\'{e}nic upstream conditions, and provide guidance for future observations.


title: On the Continuity Equation in Space-Time Algebra: Multivector Waves, Poynting, Diffusion, and a Derivation of Maxwell's Equations by Symmetries

abstract: Historically and to date, the continuity equation has served as a consistency criterion for the development of physical theories. Employing Clifford's geometric algebras, a system of continuity equations for a generalised multivector of the space-time algebra (STA) is constructed. Associated with this continuity system, a system of wave equations is constructed, the Poynting multivector is defined, and decoupling conditions are determined. The diffusion equation is explored from the continuity system, where it is found that for decoupled systems with constant or explicitly-dependent diffusion coefficients the absence of external vector sources implies a loss in the diffusion equation structure being transformed to Helmholtz-like or wave systems. From the symmetry transformations that make the continuity equations system's structure invariant, a system with the structure of Maxwell's field equations is derived. The Maxwellian system allows for the construction of potentials and fields directly linked with the continuity of a generalised multivector in STA. The results found are consistent with the classical electromagnetic theory and hydrodynamics.


title: PRES: Toward Scalable Memory-Based Dynamic Graph Neural Networks

abstract: Memory-based Dynamic Graph Neural Networks (MDGNNs) are a family of dynamic graph neural networks that leverage a memory module to extract, distill, and memorize long-term temporal dependencies, leading to superior performance compared to memory-less counterparts. However, training MDGNNs faces the challenge of handling entangled temporal and structural dependencies, requiring sequential and chronological processing of data sequences to capture accurate temporal patterns. During the batch training, the temporal data points within the same batch will be processed in parallel, while their temporal dependencies are neglected. This issue is referred to as temporal discontinuity and restricts the effective temporal batch size, limiting data parallelism and reducing MDGNNs' flexibility in industrial applications. This paper studies the efficient training of MDGNNs at scale, focusing on the temporal discontinuity in training MDGNNs with large temporal batch sizes. We first conduct a theoretical study on the impact of temporal batch size on the convergence of MDGNN training. Based on the analysis, we propose PRES, an iterative prediction-correction scheme combined with a memory coherence learning objective to mitigate the effect of temporal discontinuity, enabling MDGNNs to be trained with significantly larger temporal batches without sacrificing generalization performance. Experimental results demonstrate that our approach enables up to a 4x larger temporal batch (3.4x speed-up) during MDGNN training.


title: Elastic wave imaging with Maxwell's fish-eye lens

abstract: In this paper, a modified Maxwell's fish-eye lens is proposed in order to achieve super-resolution imaging. This lens possesses elevated refractive index profile compared with the traditional Maxwell's fish-eye lens. The refractive index profile is achieved with variable thickness configuration defined in a sheet plate structure, to realise desired changes in refractive indices. The wave propagation behaviours and the full width at half maximum (FWHM) are obtained from numerical simulations and experimental studies at the focal region of the lens. Super-resolution imaging is observed in a broadband frequency scope, with the FWHM around 0.2{\lambda} from 5 to 10 kHz. This work provides a straightforward and flexible approach to the engineering of the MFEL imaging characteristics and energy distributions for related applications.


title: Progress and Opportunities of Foundation Models in Bioinformatics

abstract: Bioinformatics has witnessed a paradigm shift with the increasing integration of artificial intelligence (AI), particularly through the adoption of foundation models (FMs). These AI techniques have rapidly advanced, addressing historical challenges in bioinformatics such as the scarcity of annotated data and the presence of data noise. FMs are particularly adept at handling large-scale, unlabeled data, a common scenario in biological contexts due to the time-consuming and costly nature of experimentally determining labeled data. This characteristic has allowed FMs to excel and achieve notable results in various downstream validation tasks, demonstrating their ability to represent diverse biological entities effectively. Undoubtedly, FMs have ushered in a new era in computational biology, especially in the realm of deep learning. The primary goal of this survey is to conduct a systematic investigation and summary of FMs in bioinformatics, tracing their evolution, current research status, and the methodologies employed. Central to our focus is the application of FMs to specific biological problems, aiming to guide the research community in choosing appropriate FMs for their research needs. We delve into the specifics of the problem at hand including sequence analysis, structure prediction, function annotation, and multimodal integration, comparing the structures and advancements against traditional methods. Furthermore, the review analyses challenges and limitations faced by FMs in biology, such as data noise, model explainability, and potential biases. Finally, we outline potential development paths and strategies for FMs in future biological research, setting the stage for continued innovation and application in this rapidly evolving field. This comprehensive review serves not only as an academic resource but also as a roadmap for future explorations and applications of FMs in biology.


title: Association between Prefrontal fNIRS signals during Cognitive tasks and College scholastic ability test (CSAT) scores: Analysis using a quantum annealing approach

abstract: Academic achievement is a critical measure of intellectual ability, prompting extensive research into cognitive tasks as potential predictors. Neuroimaging technologies, such as functional near-infrared spectroscopy (fNIRS), offer insights into brain hemodynamics, allowing understanding of the link between cognitive performance and academic achievement. Herein, we explored the association between cognitive tasks and academic achievement by analyzing prefrontal fNIRS signals. A novel quantum annealer (QA) feature selection algorithm was applied to fNIRS data to identify cognitive tasks correlated with CSAT scores. Twelve features (signal mean, median, variance, peak, number of peaks, sum of peaks, slope, minimum, kurtosis, skewness, standard deviation, and root mean square) were extracted from fNIRS signals at two time windows (10- and 60-second) to compare results from various feature variable conditions. The feature selection results from the QA-based and XGBoost regressor algorithms were compared to validate the former's performance. In a three-step validation process using multiple linear regression models, correlation coefficients between the feature variables and the CSAT scores, model fitness (adjusted R2), and model prediction error (RMSE) values were calculated. The quantum annealer demonstrated comparable performance to classical machine learning models, and specific cognitive tasks, including verbal fluency, recognition, and the Corsi block tapping task, were correlated with academic achievement. Group analyses revealed stronger associations between Tower of London and N-back tasks with higher CSAT scores. Quantum annealing algorithms have significant potential in feature selection using fNIRS data, and represents a novel research approach. Future studies should explore predictors of academic achievement and cognitive ability.