title: Asteroseismology applied to constrain structure parameters of {\delta} Scuti stars

abstract: Asteroseismology is a powerful tool to probe the structure of stars. Space-borne instruments like CoRoT, Kepler and TESS have observed the oscillations of numerous stars, among which {\delta} Scutis are particularly interesting owing to their fast rotation rates and complex pulsation mechanisms. In this work, we inferred model-dependent masses, metallicities and ages of 60 {\delta} Scuti stars from their photometric, spectroscopic and asteroseismic observations using least-squares minimization. These statistics have the potential to explain why only a tiny fraction of {\delta} Sct stars pulsate in a very clean manner. We find most of these stars with masses around 1.6 {M_\odot} and metallicities below Z = 0.010. We observed a bimodality in age for these stars, with more than half the sample younger than 30 Myr, while the remaining ones were inferred to be older, i.e., hundreds of Myrs. This work emphasizes the importance of the large-frequency separation ({\Delta\nu}) in studies of {\delta} Scuti stars. We also designed three machine learning (ML) models that hold the potential for inferring these parameters at lower computational cost and much more rapidly. These models further revealed that constraining dipole modes can help in significantly improving age estimation and that radial modes succinctly encode information pertaining to stellar luminosity and temperature. Using the ML models, we also gained qualitative insight into the importance of stellar observables in estimating mass, metallicity, and age. The effective surface temperature T eff strongly affects the inference of all structure parameters and the asteroseismic offset parameter {\epsilon} plays an essential role in the inference of age.


title: State of the Art on Diffusion Models for Visual Computing

abstract: The field of visual computing is rapidly advancing due to the emergence of generative artificial intelligence (AI), which unlocks unprecedented capabilities for the generation, editing, and reconstruction of images, videos, and 3D scenes. In these domains, diffusion models are the generative AI architecture of choice. Within the last year alone, the literature on diffusion-based tools and applications has seen exponential growth and relevant papers are published across the computer graphics, computer vision, and AI communities with new works appearing daily on arXiv. This rapid growth of the field makes it difficult to keep up with all recent developments. The goal of this state-of-the-art report (STAR) is to introduce the basic mathematical concepts of diffusion models, implementation details and design choices of the popular Stable Diffusion model, as well as overview important aspects of these generative AI tools, including personalization, conditioning, inversion, among others. Moreover, we give a comprehensive overview of the rapidly growing literature on diffusion-based generation and editing, categorized by the type of generated medium, including 2D images, videos, 3D objects, locomotion, and 4D scenes. Finally, we discuss available datasets, metrics, open challenges, and social implications. This STAR provides an intuitive starting point to explore this exciting topic for researchers, artists, and practitioners alike.


title: Evidence of mini-jet emission in a large emission zone from a magnetically-dominated gamma-ray burst jet

abstract: The second brightest GRB in history, GRB230307A provides an ideal laboratory to study the details of GRB prompt emission thanks to its extraordinarily high photon statistics and its single broad pulse overall shape characterized by an energy-dependent fast-rise-exponential-decay (FRED) profile. Here we demonstrate that its broad pulse is composed of many rapidly variable short pulses, rather than being the superposition of many short pulses on top of a slow component. Such a feature is consistent with the picture of many mini-jets due to local magnetic reconnection events in a large emission zone far from the GRB central engine, as envisaged in the internal-collision-induced magnetic reconnection and turbulence (ICMART) model, but raises a great challenge to the internal shock models that attribute all variability components to collisions among different shells. Since relativistic mini-jets demand strong magnetization in the outflow, this work provides strong evidence for a Poynting-flux-dominated jet composition of this bright GRB.


title: DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation

abstract: This paper addresses the task of 3D pose estimation for a hand interacting with an object from a single image observation. When modeling hand-object interaction, previous works mainly exploit proximity cues, while overlooking the dynamical nature that the hand must stably grasp the object to counteract gravity and thus preventing the object from slipping or falling. These works fail to leverage dynamical constraints in the estimation and consequently often produce unstable results. Meanwhile, refining unstable configurations with physics-based reasoning remains challenging, both by the complexity of contact dynamics and by the lack of effective and efficient physics inference in the data-driven learning framework. To address both issues, we present DeepSimHO: a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network. Specifically, for an initial hand-object pose estimated by a base network, we forward it to a physics simulator to evaluate its stability. However, due to non-smooth contact geometry and penetration, existing differentiable simulators can not provide reliable state gradient. To remedy this, we further introduce a deep network to learn the stability evaluation process from the simulator, while smoothly approximating its gradient and thus enabling effective back-propagation. Extensive experiments show that our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization. The code is available at https://github.com/rongakowang/DeepSimHO.


title: Robust Safe Reinforcement Learning under Adversarial Disturbances

abstract: Safety is a primary concern when applying reinforcement learning to real-world control tasks, especially in the presence of external disturbances. However, existing safe reinforcement learning algorithms rarely account for external disturbances, limiting their applicability and robustness in practice. To address this challenge, this paper proposes a robust safe reinforcement learning framework that tackles worst-case disturbances. First, this paper presents a policy iteration scheme to solve for the robust invariant set, i.e., a subset of the safe set, where persistent safety is only possible for states within. The key idea is to establish a two-player zero-sum game by leveraging the safety value function in Hamilton-Jacobi reachability analysis, in which the protagonist (i.e., control inputs) aims to maintain safety and the adversary (i.e., external disturbances) tries to break down safety. This paper proves that the proposed policy iteration algorithm converges monotonically to the maximal robust invariant set. Second, this paper integrates the proposed policy iteration scheme into a constrained reinforcement learning algorithm that simultaneously synthesizes the robust invariant set and uses it for constrained policy optimization. This algorithm tackles both optimality and safety, i.e., learning a policy that attains high rewards while maintaining safety under worst-case disturbances. Experiments on classic control tasks show that the proposed method achieves zero constraint violation with learned worst-case adversarial disturbances, while other baseline algorithms violate the safety constraints substantially. Our proposed method also attains comparable performance as the baselines even in the absence of the adversary.


abstract: We present approximation algorithms for the Fault-tolerant $k$-Supplier with Outliers ($\mathsf{F}k\mathsf{SO}$) problem. This is a common generalization of two known problems -- $k$-Supplier with Outliers, and Fault-tolerant $k$-Supplier -- each of which generalize the well-known $k$-Supplier problem. In the $k$-Supplier problem the goal is to serve $n$ clients $C$, by opening $k$ facilities from a set of possible facilities $F$; the objective function is the farthest that any client must travel to access an open facility. In $\mathsf{F}k\mathsf{SO}$, each client $v$ has a fault-tolerance $\ell_v$, and now desires $\ell_v$ facilities to serve it; so each client $v$'s contribution to the objective function is now its distance to the $\ell_v^{\text{th}}$ closest open facility. Furthermore, we are allowed to choose $m$ clients that we will serve, and only those clients contribute to the objective function, while the remaining $n-m$ are considered outliers. Our main result is a $\min\{4t-1,2^t+1\}$-approximation for the $\mathsf{F}k\mathsf{SO}$ problem, where $t$ is the number of distinct values of $\ell_v$ that appear in the instance. At $t=1$, i.e. in the case where the $\ell_v$'s are uniformly some $\ell$, this yields a $3$-approximation, improving upon the $11$-approximation given for the uniform case by Inamdar and Varadarajan [2020], who also introduced the problem. Our result for the uniform case matches tight $3$-approximations that exist for $k$-Supplier, $k$-Supplier with Outliers, and Fault-tolerant $k$-Supplier. Our key technical contribution is an application of the round-or-cut schema to $\mathsf{F}k\mathsf{SO}$. Guided by an LP relaxation, we reduce to a simpler optimization problem, which we can solve to obtain distance bounds for the "round" step, and valid inequalities for the "cut" step.


title: Multi-task Explainable Skin Lesion Classification

abstract: Skin cancer is one of the deadliest diseases and has a high mortality rate if left untreated. The diagnosis generally starts with visual screening and is followed by a biopsy or histopathological examination. Early detection can aid in lowering mortality rates. Visual screening can be limited by the experience of the doctor. Due to the long tail distribution of dermatological datasets and significant intra-variability between classes, automatic classification utilizing computer-aided methods becomes challenging. In this work, we propose a multitask few-shot-based approach for skin lesions that generalizes well with few labelled data to address the small sample space challenge. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network. The output of the segmentation network helps to focus on the most discriminatory features while making a decision by the classification network. To further enhance the classification performance, we have combined segmentation and classification loss in a weighted manner. We have also included the visualization results that explain the decisions made by the algorithm. Three dermatological datasets are used to evaluate the proposed method thoroughly. We also conducted cross-database experiments to ensure that the proposed approach is generalizable across similar datasets. Experimental results demonstrate the efficacy of the proposed work.


title: Modes of massive nucleon transfer appearing in quasifission processes for collisions of superheavy nuclei

abstract: It is challenging to distinguish between fusion-fission and quasifission experimentally. To determine the characteristics of quasifission processes associated with dominant phenomena in heavy-ion collisions is important for estimating precisely the fusion cross section, which is relevant to the synthesis of new elements. We classified fusion-fission and quasifission processes theoretically in the past for an accurate assessment of the fusion cross section. However, no detailed analysis focused on each process was performed. In this work, we aimed to analyze the dynamical characteristics of quasifission processes in terms of the Langevin equation model. We specify the quasifission processes, and analyze the scission configuration. Finally, we clarify the origin of several modes included in quasifission. The calculation framework is the multidimensional dynamical model of nucleus-nucleus collisions based on the Langevin equations. It is shown that several quasifission modes exist leading to different fragment deformations. The time scale of the quasifission process differs for several different modes. Each scission configuration and total kinetic energy also differ. The different quasifission modes are caused by the neck relaxation controlling the mass drift toward symmetry. This means that it is possible to discuss the time-dependent functional form of the neck parameter $\epsilon$ for the quasifission process in the framework of the dynamical model based on Langevin equations.


title: Bridging the Gap between Newton-Raphson Method and Regularized Policy Iteration

abstract: Regularization is one of the most important techniques in reinforcement learning algorithms. The well-known soft actor-critic algorithm is a special case of regularized policy iteration where the regularizer is chosen as Shannon entropy. Despite some empirical success of regularized policy iteration, its theoretical underpinnings remain unclear. This paper proves that regularized policy iteration is strictly equivalent to the standard Newton-Raphson method in the condition of smoothing out Bellman equation with strongly convex functions. This equivalence lays the foundation of a unified analysis for both global and local convergence behaviors of regularized policy iteration. We prove that regularized policy iteration has global linear convergence with the rate being $\gamma$ (discount factor). Furthermore, this algorithm converges quadratically once it enters a local region around the optimal value. We also show that a modified version of regularized policy iteration, i.e., with finite-step policy evaluation, is equivalent to inexact Newton method where the Newton iteration formula is solved with truncated iterations. We prove that the associated algorithm achieves an asymptotic linear convergence rate of $\gamma^M$ in which $M$ denotes the number of steps carried out in policy evaluation. Our results take a solid step towards a better understanding of the convergence properties of regularized policy iteration algorithms.


title: Multi-Task Learning-Enabled Automatic Vessel Draft Reading for Intelligent Maritime Surveillance

abstract: The accurate and efficient vessel draft reading (VDR) is an important component of intelligent maritime surveillance, which could be exploited to assist in judging whether the vessel is normally loaded or overloaded. The computer vision technique with an excellent price-to-performance ratio has become a popular medium to estimate vessel draft depth. However, the traditional estimation methods easily suffer from several limitations, such as sensitivity to low-quality images, high computational cost, etc. In this work, we propose a multi-task learning-enabled computational method (termed MTL-VDR) for generating highly reliable VDR. In particular, our MTL-VDR mainly consists of four components, i.e., draft mark detection, draft scale recognition, vessel/water segmentation, and final draft depth estimation. We first construct a benchmark dataset related to draft mark detection and employ a powerful and efficient convolutional neural network to accurately perform the detection task. The multi-task learning method is then proposed for simultaneous draft scale recognition and vessel/water segmentation. To obtain more robust VDR under complex conditions (e.g., damaged and stained scales, etc.), the accurate draft scales are generated by an automatic correction method, which is presented based on the spatial distribution rules of draft scales. Finally, an adaptive computational method is exploited to yield an accurate and robust draft depth. Extensive experiments have been implemented on the realistic dataset to compare our MTL-VDR with state-of-the-art methods. The results have demonstrated its superior performance in terms of accuracy, robustness, and efficiency. The computational speed exceeds 40 FPS, which satisfies the requirements of real-time maritime surveillance to guarantee vessel traffic safety.


title: Species Scale in Diverse Dimensions

abstract: In a quantum theory of gravity, the species scale $\Lambda_s$ can be defined as the scale at which corrections to the Einstein action become important or alternatively as codifying the "number of light degrees of freedom", due to the fact that $\Lambda_s^{-1}$ is the smallest size black hole described by the EFT involving only the Einstein term. In this paper, we check the validity of this picture in diverse dimensions and with different amounts of supersymmetry and verify the expected behavior of the species scale at the boundary of the moduli space. This also leads to the evaluation of the species scale in the interior of the moduli space as well as to the computation of the diameter of the moduli space. We also find evidence that the species scale satisfies the bound $\big|{\nabla \Lambda_s \over \Lambda_s} \big|^2\leq {1\over d-2}$ all over moduli space including the interior.


title: Borodin-Kostochka Conjecture holds for odd-hole-free graphs

abstract: The Borodin-Kostochka Conjecture states that for a graph $G$, if $\Delta(G)\geq 9$, then $\chi(G)\leq\max\{\Delta(G)-1,\omega(G)\}$. In this paper, we prove the Borodin-Kostochka Conjecture holding for odd-hole-free graphs.


title: Affine Springer Fibers and Generalized Haiman Ideals

abstract: We compute the Borel-Moore homology of unramified affine Springer fibers for $\mathrm{GL}_n$ under the assumption that they are equivariantly formal and relate them to certain ideals discussed by Haiman. For $n=3$, we give an explicit description of these ideals, compute their Hilbert series, generators and relations, and compare them to generalized $(q,t)$ Catalan numbers. We also compare the homology to the Khovanov-Rozansky homology of the associated link, and prove a version of a conjecture of Oblomkov, Rasmussen, and Shende in this case.


title: Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes

abstract: Learning the distribution of data on Riemannian manifolds is crucial for modeling data from non-Euclidean space, which is required by many applications in diverse scientific fields. Yet, existing generative models on manifolds suffer from expensive divergence computation or rely on approximations of heat kernel. These limitations restrict their applicability to simple geometries and hinder scalability to high dimensions. In this work, we introduce the Riemannian Diffusion Mixture, a principled framework for building a generative diffusion process on manifolds. Instead of following the denoising approach of previous diffusion models, we construct a diffusion process using a mixture of bridge processes derived on general manifolds without requiring heat kernel estimations. We develop a geometric understanding of the mixture process, deriving the drift as a weighted mean of tangent directions to the data points that guides the process toward the data distribution. We further propose a scalable training objective for learning the mixture process that readily applies to general manifolds. Our method achieves superior performance on diverse manifolds with dramatically reduced number of in-training simulation steps for general manifolds.


title: Enhancing Neural Architecture Search with Multiple Hardware Constraints for Deep Learning Model Deployment on Tiny IoT Devices

abstract: The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend to be too complex and computationally intensive for typical IoT end-nodes. To address this challenge, Neural Architecture Search (NAS) has emerged as a popular design automation technique for co-optimizing the accuracy and complexity of deep neural networks. Nevertheless, existing NAS techniques require many iterations to produce a network that adheres to specific hardware constraints, such as the maximum memory available on the hardware or the maximum latency allowed by the target application. In this work, we propose a novel approach to incorporate multiple constraints into so-called Differentiable NAS optimization methods, which allows the generation, in a single shot, of a model that respects user-defined constraints on both memory and latency in a time comparable to a single standard training. The proposed approach is evaluated on five IoT-relevant benchmarks, including the MLPerf Tiny suite and Tiny ImageNet, demonstrating that, with a single search, it is possible to reduce memory and latency by 87.4% and 54.2%, respectively (as defined by our targets), while ensuring non-inferior accuracy on state-of-the-art hand-tuned deep neural networks for TinyML.


title: Quantifying Agent Interaction in Multi-agent Reinforcement Learning for Cost-efficient Generalization

abstract: Generalization poses a significant challenge in Multi-agent Reinforcement Learning (MARL). The extent to which an agent is influenced by unseen co-players depends on the agent's policy and the specific scenario. A quantitative examination of this relationship sheds light on effectively training agents for diverse scenarios. In this study, we present the Level of Influence (LoI), a metric quantifying the interaction intensity among agents within a given scenario and environment. We observe that, generally, a more diverse set of co-play agents during training enhances the generalization performance of the ego agent; however, this improvement varies across distinct scenarios and environments. LoI proves effective in predicting these improvement disparities within specific scenarios. Furthermore, we introduce a LoI-guided resource allocation method tailored to train a set of policies for diverse scenarios under a constrained budget. Our results demonstrate that strategic resource allocation based on LoI can achieve higher performance than uniform allocation under the same computation budget.


title: Improved Membership Inference Attacks Against Language Classification Models

abstract: Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the people whose data was used to train models. Assessing the privacy risks of machine learning models is crucial to enabling knowledgeable decisions on whether to use, deploy, or share a model. A common approach to privacy risk assessment is to run one or more known attacks against the model and measure their success rate. We present a novel framework for running membership inference attacks against classification models. Our framework takes advantage of the ensemble method, generating many specialized attack models for different subsets of the data. We show that this approach achieves higher accuracy than either a single attack model or an attack model per class label, both on classical and language classification tasks.


title: COPlanner: Plan to Roll Out Conservatively but to Explore Optimistically for Model-Based RL

abstract: Dyna-style model-based reinforcement learning contains two phases: model rollouts to generate sample for policy learning and real environment exploration using current policy for dynamics model learning. However, due to the complex real-world environment, it is inevitable to learn an imperfect dynamics model with model prediction error, which can further mislead policy learning and result in sub-optimal solutions. In this paper, we propose $\texttt{COPlanner}$, a planning-driven framework for model-based methods to address the inaccurately learned dynamics model problem with conservative model rollouts and optimistic environment exploration. $\texttt{COPlanner}$ leverages an uncertainty-aware policy-guided model predictive control (UP-MPC) component to plan for multi-step uncertainty estimation. This estimated uncertainty then serves as a penalty during model rollouts and as a bonus during real environment exploration respectively, to choose actions. Consequently, $\texttt{COPlanner}$ can avoid model uncertain regions through conservative model rollouts, thereby alleviating the influence of model error. Simultaneously, it explores high-reward model uncertain regions to reduce model error actively through optimistic real environment exploration. $\texttt{COPlanner}$ is a plug-and-play framework that can be applied to any dyna-style model-based methods. Experimental results on a series of proprioceptive and visual continuous control tasks demonstrate that both sample efficiency and asymptotic performance of strong model-based methods are significantly improved combined with $\texttt{COPlanner}$.


title: Using Learnable Physics for Real-Time Exercise Form Recommendations

abstract: Good posture and form are essential for safe and productive exercising. Even in gym settings, trainers may not be readily available for feedback. Rehabilitation therapies and fitness workouts can thus benefit from recommender systems that provide real-time evaluation. In this paper, we present an algorithmic pipeline that can diagnose problems in exercise techniques and offer corrective recommendations, with high sensitivity and specificity in real-time. We use MediaPipe for pose recognition, count repetitions using peak-prominence detection, and use a learnable physics simulator to track motion evolution for each exercise. A test video is diagnosed based on deviations from the prototypical learned motion using statistical learning. The system is evaluated on six full and upper body exercises. These real-time recommendations, counseled via low-cost equipment like smartphones, will allow exercisers to rectify potential mistakes making self-practice feasible while reducing the risk of workout injuries.


title: Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model

abstract: Recently, text-to-image denoising diffusion probabilistic models (DDPMs) have demonstrated impressive image generation capabilities and have also been successfully applied to image inpainting. However, in practice, users often require more control over the inpainting process beyond textual guidance, especially when they want to composite objects with customized appearance, color, shape, and layout. Unfortunately, existing diffusion-based inpainting methods are limited to single-modal guidance and require task-specific training, hindering their cross-modal scalability. To address these limitations, we propose Uni-paint, a unified framework for multimodal inpainting that offers various modes of guidance, including unconditional, text-driven, stroke-driven, exemplar-driven inpainting, as well as a combination of these modes. Furthermore, our Uni-paint is based on pretrained Stable Diffusion and does not require task-specific training on specific datasets, enabling few-shot generalizability to customized images. We have conducted extensive qualitative and quantitative evaluations that show our approach achieves comparable results to existing single-modal methods while offering multimodal inpainting capabilities not available in other methods. Code will be available at https://github.com/ysy31415/unipaint.


title: Bidirectional recurrent imputation and abundance estimation of LULC classes with MODIS multispectral time series and geo-topographic and climatic data

abstract: Remotely sensed data are dominated by mixed Land Use and Land Cover (LULC) types. Spectral unmixing (SU) is a key technique that disentangles mixed pixels into constituent LULC types and their abundance fractions. While existing studies on Deep Learning (DL) for SU typically focus on single time-step hyperspectral (HS) or multispectral (MS) data, our work pioneers SU using MODIS MS time series, addressing missing data with end-to-end DL models. Our approach enhances a Long-Short Term Memory (LSTM)-based model by incorporating geographic, topographic (geo-topographic), and climatic ancillary information. Notably, our method eliminates the need for explicit endmember extraction, instead learning the input-output relationship between mixed spectra and LULC abundances through supervised learning. Experimental results demonstrate that integrating spectral-temporal input data with geo-topographic and climatic information significantly improves the estimation of LULC abundances in mixed pixels. To facilitate this study, we curated a novel labeled dataset for Andalusia (Spain) with monthly MODIS multispectral time series at 460m resolution for 2013. Named Andalusia MultiSpectral MultiTemporal Unmixing (Andalusia-MSMTU), this dataset provides pixel-level annotations of LULC abundances along with ancillary information. The dataset (https://zenodo.org/records/7752348) and code (https://github.com/jrodriguezortega/MSMTU) are available to the public.


title: On $O(n)$ Algorithms for Projection onto the Top-$k$-sum Constraint

abstract: The top-$k$-sum operator computes the sum of the largest $k$ components of a given vector. The Euclidean projection onto the top-$k$-sum constraint serves as a crucial subroutine in iterative methods to solve composite superquantile optimization problems. In this paper, we introduce a solver that implements two finite-termination algorithms to compute this projection. Both algorithms have complexity $O(n)$ when applied to a sorted $n$-dimensional input vector, where the absorbed constant is independent of $k$. This stands in contrast to the existing grid-search-inspired method that has $O(k(n-k))$ complexity. The improvement is significant when $k$ is linearly dependent on $n$, which frequently encountered in practical superquantile optimization applications. In instances where the input vector is unsorted, an additional cost is incurred to (partially) sort the vector. To reduce this cost, we further derive a rigorous procedure that leverages approximate sorting to compute the projection, which is particularly useful when solving a sequence of similar projection problems. Numerical results show that our methods solve problems of scale $n=10^7$ and $k=10^4$ within $0.05$ seconds, whereas the existing grid-search-based method and the Gurobi QP solver can take minutes to hours.


title: Exploring the landscape of large language models in medical question answering

abstract: With the rapid development of new large language models (LLMs), each claiming to surpass previous models, an overall picture of medical LLM research can be elusive. To address this challenge, we benchmark a range of top LLMs and identify consistent patterns which appear across models. We test $8$ well-known LLMs on $874$ newly collected questions from Polish medical licensing exams. For each question, we score each model on the top-1 accuracy and the distribution of probabilities assigned. We then compare with factors including question difficulty for humans, question length, and the scores of the other models. LLM accuracies were positively correlated pairwise ($0.29$ to $0.62$). Model performance was also correlated with human performance ($0.07$ to $0.16$), but negatively correlated to the difference between the question-level accuracy of top-scoring and bottom-scoring humans ($-0.16$ to $-0.23$). The top output probability and question length were positive and negative predictors of accuracy respectively (p $< 0.05$). The top scoring LLM, GPT-4 Turbo, scored $82\%$, followed by Med42, PaLM 2, Mixtral and GPT-3.5 around $63\%$. We found evidence of similarities between models in which questions they answer correctly, as well as similarities with human test takers. Larger models typically performed better, but differences in training methods were also highly impactful. Model accuracy was positively correlated with confidence, but negatively correlated with question length. We expect that similar training methods will lead these patterns to persist across future models. These patterns can therefore aid medical experts in forming expectations about LLMs as a category to support application research.


title: A Quasi Newton Method for Uncertain Multiobjective Optimization Problems via Robust Optimization Approach

abstract: In this paper, we propose a quasi Newton method to solve the robust counterpart of an uncertain multiobjective optimization problem under an arbitrary finite uncertainty set. Here the robust counterpart of an uncertain multiobjective optimization problem is the minimum of objective-wise worst case, which is a nonsmooth deterministic multiobjective optimization problem. In order to solve this robust counterpart with the help of quasi Newton method, we construct a sub-problem using Hessian approximation and solve it to determine a descent direction for the robust counterpart. We introduce an Armijo-type inexact line search technique to find an appropriate step length, and develop a modified BFGS formula to ensure positive definiteness of the Hessian matrix at each iteration. By incorporating descent direction, step length size, and modified BFGS formula, we write the quasi Newton's descent algorithm for the robust counterpart. We prove the convergence of the algorithm under standard assumptions and demonstrate that it achieves superlinear convergence rate. Furthermore, we validate the algorithm by comparing it with the weighted sum method through some numerical examples by using a performance profile.


title: On fundamental results for pushable homomorphisms of oriented graphs

abstract: This article deals with homomorphisms of oriented graphs with respect to push equivalence. Here homomorphisms refer to arc preserving vertex mappings, and push equivalence refers to the equivalence class of orientations of a graph $G$ those can be obtained from one another by reversing arcs of an edge cut. We study and prove some fundamental properties of pushable homomorphisms, and establish its connections to homomorphisms of signed graphs and graph coloring. To list a few highlights of this work: $\bullet$ We characterize orientations of a graph up to push equivalence and show that it is possible to decide whether they are equivalent or not in polynomial time. $\bullet$ We give a canonical definition of pushable homomorphism - this answers a natural open question. $\bullet$ We build a one-to-one correspondence between the equivalence classes of oriented and signed bipartite graphs. Thus, it is possible to translate a number of important results directly from the theory of signed graphs to oriented graphs. In particular, we show that pushable homomorphisms of bipartite graphs capture the entire theory of graph coloring as a subcase. $\bullet$ Given a graph $G$, we build a gadget oriented graph $\overrightarrow{G}^{(k)}$ which admits a pushable homomorphism to a directed odd cycle of length $(2k+1)$ if and only if $G$ admits a $(2k+1)$-coloring. We also show that it is NP-complete to determine whether an oriented (sparse) graph admits a pushable homomorphism to a directed odd cycle or not.


title: Euclidean methods and phase transitions for the strongest deformations compatible with Schwarzschild asymptotics

abstract: In this paper, we investigate the thermodynamic properties of a regular black hole model which exhibits the most significant subleading corrections to the Schwarzchild asymptotic behavior, in the context of general relativity, using the Euclidean path integral approach. We review the derivation of the Lagrangian for the matter fields which act as a source for this geometry, explicitly derive the proper thermodynamic quantities introduced in the first law of black hole mechanics, and show that they satisfy the Smarr formula. This analysis naturally leads to the emergence of an effective temperature that is distinct from the one associated with surface gravity. Furthermore, we study the phase structure in anti-de Sitter, Minkowski, and de Sitter spacetimes in the canonical ensemble, considering this effective temperature as the appropriate choice. We show that in this case the regularization of the singularity prevents the Hawking-Page transition and also leads to a deviation from the ``universal" mean-field theory critical ratio. We conjecture that the way a singularity is rendered smooth plays a pivotal role to the degree of this deviation. Finally, we provide remarks on constraints imposed on the minimal length scale by observational data and the viability of regular black holes.


title: ProFSA: Self-supervised Pocket Pretraining via Protein Fragment-Surroundings Alignment

abstract: Pocket representations play a vital role in various biomedical applications, such as druggability estimation, ligand affinity prediction, and de novo drug design. While existing geometric features and pretrained representations have demonstrated promising results, they usually treat pockets independent of ligands, neglecting the fundamental interactions between them. However, the limited pocket-ligand complex structures available in the PDB database (less than 100 thousand non-redundant pairs) hampers large-scale pretraining endeavors for interaction modeling. To address this constraint, we propose a novel pocket pretraining approach that leverages knowledge from high-resolution atomic protein structures, assisted by highly effective pretrained small molecule representations. By segmenting protein structures into drug-like fragments and their corresponding pockets, we obtain a reasonable simulation of ligand-receptor interactions, resulting in the generation of over 5 million complexes. Subsequently, the pocket encoder is trained in a contrastive manner to align with the representation of pseudo-ligand furnished by some pretrained small molecule encoders. Our method, named ProFSA, achieves state-of-the-art performance across various tasks, including pocket druggability prediction, pocket matching, and ligand binding affinity prediction. Notably, ProFSA surpasses other pretraining methods by a substantial margin. Moreover, our work opens up a new avenue for mitigating the scarcity of protein-ligand complex data through the utilization of high-quality and diverse protein structure databases.


title: Sliding cycles of the regularized piecewise linear $VI_3$ two-fold

abstract: The goal of this paper is to study the number of sliding limit cycles of a regularized piecewise linear $VI_3$ two-fold using the notion of slow divergence integral. We focus on limit cycles produced by canard cycles located in the half-plane with an invisible fold point. We prove that the integral has at most $1$ zero counting multiplicity (when it is not identically zero). This will imply that the canard cycles can produce at most $2$ limit cycles. Moreover, we detect regions in the parameter space with $2$ limit cycles.


title: A note on the structure coefficients of the centraliser algebra

abstract: In this note we generalize the definition of partial permutations of Ivanov and Kerov and we build a universal algebra which projects onto the m-centraliser algebra defined by Creedon. We use it to present a new proof for the polynomiality property of the structure coefficients of the m-centraliser algebra and to obtain upper bounds for the polynomial degrees.


title: Temperature-Dependent Collective Excitations in a Three-Dimensional Dirac System ZrTe$_{5}$

abstract: Zirconium pentatelluride (ZrTe$_{5}$), a system with a Dirac linear band across the Fermi level and anomalous transport features, has attracted considerable research interest for it is predicted to be located at the boundary between strong and weak topological insulators separated by a topological semimetal phase. However, the experimental verification of the topological phase transition and the topological ground state in ZrTe$_{5}$ is full of controversies, mostly due to the difficulty of precisely capturing the small gap evolution with single-particle band structure measurements. Alternatively, the collective excitations of electric charges, known as plasmons, in Dirac systems exhibiting unique behavior, can well reflect the topological nature of the band structure. Here, using reflective high-resolution electron energy loss spectroscopy (HREELS), we investigate the temperature-dependent collective excitations of ZrTe$_{5}$, and discover that the plasmon energy in ZrTe$_{5}$ is proportional to the $1/3$ power of the carrier density $n$, which is a unique feature of plasmons in three-dimensional Dirac systems. Based on this conclusion, the origin of the resistivity anomaly of ZrTe$_{5}$ can be attributed to the temperature-dependent chemical potential shift in extrinsic Dirac semimetals.


title: Gut Microbiota-derived Bile Acids Promote Gamma-secretase Activity Through Interactions with Nicastrin Subunits

abstract: Alzheimer's disease (AD) has emerged as a progressively pervasive neurodegenerative disorder worldwide. Bile acids, synthesized in the liver and modified by the gut microbiota, play pivotal roles in diverse physiological processes, and their dysregulation in individuals with AD has been well-documented. However, the protein targets associated with microbiota-derived bile acids in AD have received limited attention. To address this gap, we conducted comprehensive thermal proteomic analyses to unravel and comprehend the protein targets affected by microbiota-derived bile acids in AD. Our investigation identified sixty-five unique proteins as potential targets of deoxycholic acid (DCA), a primary component of the bile acid pool originating from the gut microbiota. Particularly noteworthy among these proteins were Nicastrin and Casein kinase 1 epsilon. We found that DCA, through its interaction with the Nicastrin subunit of {\gamma}-secretase, significantly contributed to the formation of amyloid beta, a key hallmark of AD pathology. Additionally, We observed substantial elevations in the urine levels of four bile acids (DCA, GHCA, GHDCA, and GUDCA) in AD patients compared to healthy controls. Moreover, the ratios of DCA to cholic acid (CA) and glycodeoxycholic acid (GDCA) to DCA were significantly increased in AD patients, indicating aberrations in the biosynthetic pathway responsible for bile acid dehydroxylation. The augmented levels of microbiota-derived bile acids and their altered ratios to primary bile acids exhibited notable associations with AD. Collectively, our findings provide crucial insights into the intricate interplay between microbiota-derived bile acids and the pathogenesis of AD, thereby shedding light on potential therapeutic targets for this debilitating disease.


title: Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality

abstract: Prompt-based continual learning is an emerging direction in leveraging pre-trained knowledge for downstream continual learning, and has almost reached the performance pinnacle under supervised pre-training. However, our empirical research reveals that the current strategies fall short of their full potential under the more realistic self-supervised pre-training, which is essential for handling vast quantities of unlabeled data in practice. This is largely due to the difficulty of task-specific knowledge being incorporated into instructed representations via prompt parameters and predicted by uninstructed representations at test time. To overcome the exposed sub-optimality, we conduct a theoretical analysis of the continual learning objective in the context of pre-training, and decompose it into hierarchical components: within-task prediction, task-identity inference, and task-adaptive prediction. Following these empirical and theoretical insights, we propose Hierarchical Decomposition (HiDe-)Prompt, an innovative approach that explicitly optimizes the hierarchical components with an ensemble of task-specific prompts and statistics of both uninstructed and instructed representations, further with the coordination of a contrastive regularization strategy. Our extensive experiments demonstrate the superior performance of HiDe-Prompt and its robustness to pre-training paradigms in continual learning (e.g., up to 15.01% and 9.61% lead on Split CIFAR-100 and Split ImageNet-R, respectively). Our code is available at \url{https://github.com/thu-ml/HiDe-Prompt}.


title: Are GATs Out of Balance?

abstract: While the expressive power and computational capabilities of graph neural networks (GNNs) have been theoretically studied, their optimization and learning dynamics, in general, remain largely unexplored. Our study undertakes the Graph Attention Network (GAT), a popular GNN architecture in which a node's neighborhood aggregation is weighted by parameterized attention coefficients. We derive a conservation law of GAT gradient flow dynamics, which explains why a high portion of parameters in GATs with standard initialization struggle to change during training. This effect is amplified in deeper GATs, which perform significantly worse than their shallow counterparts. To alleviate this problem, we devise an initialization scheme that balances the GAT network. Our approach i) allows more effective propagation of gradients and in turn enables trainability of deeper networks, and ii) attains a considerable speedup in training and convergence time in comparison to the standard initialization. Our main theorem serves as a stepping stone to studying the learning dynamics of positive homogeneous models with attention mechanisms.


title: AdaMesh: Personalized Facial Expressions and Head Poses for Adaptive Speech-Driven 3D Facial Animation

abstract: Speech-driven 3D facial animation aims at generating facial movements that are synchronized with the driving speech, which has been widely explored recently. Existing works mostly neglect the person-specific talking style in generation, including facial expression and head pose styles. Several works intend to capture the personalities by fine-tuning modules. However, limited training data leads to the lack of vividness. In this work, we propose AdaMesh, a novel adaptive speech-driven facial animation approach, which learns the personalized talking style from a reference video of about 10 seconds and generates vivid facial expressions and head poses. Specifically, we propose mixture-of-low-rank adaptation (MoLoRA) to fine-tune the expression adapter, which efficiently captures the facial expression style. For the personalized pose style, we propose a pose adapter by building a discrete pose prior and retrieving the appropriate style embedding with a semantic-aware pose style matrix without fine-tuning. Extensive experimental results show that our approach outperforms state-of-the-art methods, preserves the talking style in the reference video, and generates vivid facial animation. The supplementary video and code will be available at https://adamesh.github.io.


title: SAGE-ICP: Semantic Information-Assisted ICP

abstract: Robust and accurate pose estimation in unknown environments is an essential part of robotic applications. We focus on LiDAR-based point-to-point ICP combined with effective semantic information. This paper proposes a novel semantic information-assisted ICP method named SAGE-ICP, which leverages semantics in odometry. The semantic information for the whole scan is timely and efficiently extracted by a 3D convolution network, and these point-wise labels are deeply involved in every part of the registration, including semantic voxel downsampling, data association, adaptive local map, and dynamic vehicle removal. Unlike previous semantic-aided approaches, the proposed method can improve localization accuracy in large-scale scenes even if the semantic information has certain errors. Experimental evaluations on KITTI and KITTI-360 show that our method outperforms the baseline methods, and improves accuracy while maintaining real-time performance, i.e., runs faster than the sensor frame rate.


title: Global in Time Vortex Configurations for the $2$D Euler Equations

abstract: We consider the problem of finding a solution to the incompressible Euler equations $$ \omega_t + v\cdot \nabla \omega = 0 \quad \hbox{ in } \mathbb{R}^2 \times (0,\infty), \quad v(x,t) = \frac 1{2\pi} \int_{{\mathbb R}^2} \frac {(y-x)^\perp}{|y-x|^2} \omega (y,t)\, dy $$ that is close to a superposition of traveling vortices as $t\to \infty$. We employ a constructive approach by gluing classical traveling waves: two vortex-antivortex pairs traveling at main order with constant speed in opposite directions. More precisely, we find an initial condition that leads to a 4-vortex solution of the form $$ \omega (x,t) = \omega_0(x-ct\, e ) - \omega_0 ( x+ ct \, e) + o(1) \ \hbox{ as } t\to\infty $$ where $$ \omega_0( x ) = \frac 1{\varepsilon^{2}} W \left ( \frac {x-q} \varepsilon \right ) - \frac 1{\varepsilon^{2}}W \left ( \frac {x+q} \varepsilon \right ) + o(1) \ \hbox{ as } \varepsilon \to 0 $$ and $W(y)$ is a certain fixed smooth profile, radially symmetric, positive in the unit disc zero outside.


title: Multidimensional Hopfield Networks for clustering

abstract: We present the Multidimensional Hopfield Network (DHN), a natural generalisation of the Hopfield Network. In our theoretical investigations we focus on DHNs with a certain activation function and provide energy functions for them. We conclude that these DHNs are convergent in finite time, and are equivalent to greedy methods that aim to find graph clusterings of locally minimal cuts. We also show that the general framework of DHNs encapsulates several previously known algorithms used for generating graph embeddings and clusterings. Namely, the Cleora graph embedding algorithm, the Louvain method, and the Newmans method can be cast as DHNs with appropriate activation function and update rule. Motivated by these findings we provide a generalisation of Newmans method to the multidimensional case.


title: CacheGen: KV Cache Compression and Streaming for Fast Language Model Serving

abstract: As large language models (LLMs) take on complex tasks, their inputs are supplemented with longer contexts that incorporate domain knowledge or user-specific information. Yet using long contexts poses a challenge for responsive LLM systems, as nothing can be generated until the whole context is processed by the LLM. . CacheGen is a fast context-loading module for LLM systems. First, CacheGen uses a custom tensor encoder, which embraces KV cache's distributional properties, to encode a KV cache into more compact bitstream representations with negligible encoding/decoding overhead. This reduces the bandwidth demand to fetch the KV cache. Second, to maintain low context-loading delay and high generation quality, CacheGen adapts the streaming strategies to cope with changes in available bandwidth. When available bandwidth drops, CacheGen may raise the compression level for a part of the context or choose to recompute its KV cache on the fly. We test CacheGen on four popular LLMs of various sizes and four datasets (662 contexts in total). Compared to the recent systems that reuse the KV cache, CacheGen reduces the KV cache size by 3.5-4.3x and the total delay in fetching and processing contexts by 3.2-3.7x while having negligible impact on the LLM response quality in accuracy or perplexity.


title: Surrogate modeling for stochastic crack growth processes in structural health monitoring applications

abstract: Fatigue crack growth is one of the most common types of deterioration in metal structures with significant implications on their reliability. Recent advances in Structural Health Monitoring (SHM) have motivated the use of structural response data to predict future crack growth under uncertainty, in order to enable a transition towards predictive maintenance. Accurately representing different sources of uncertainty in stochastic crack growth (SCG) processes is a non-trivial task. The present work builds on previous research on physics-based SCG modeling under both material and load-related uncertainty. The aim here is to construct computationally efficient, probabilistic surrogate models for SCG processes that successfully encode these different sources of uncertainty. An approach inspired by latent variable modeling is employed that utilizes Gaussian Process (GP) regression models to enable the surrogates to be used to generate prior distributions for different Bayesian SHM tasks as the application of interest. Implementation is carried out in a numerical setting and model performance is assessed for two fundamental crack SHM problems; namely crack length monitoring (damage quantification) and crack growth monitoring (damage prognosis).


title: Textiverse: A Scalable Visual Analytics System for Exploring Geotagged and Timestamped Text Corpora

abstract: We propose Textiverse, a big data approach for mining geotagged timestamped textual data on a map, such as for Twitter feeds, crime reports, or restaurant reviews. We use a scalable data management pipeline that extracts keyphrases from online databases in parallel. We speed up this time-consuming step so that it outpaces the content creation rate of popular social media. The result is presented in a web-based interface that integrates with Google Maps to visualize textual content of massive scale. The visual design is based on aggregating spatial regions into discrete sites and rendering each such site as a circular tag cloud. To demonstrate the intended use of our technique, we first show how it can be used to characterize the U.S.\ National Science Foundation funding status based on all 489,151 awards. We then apply the same technique on visually representing a more spatially scattered and linguistically informal dataset: 1.2 million Twitter posts about the Android mobile operating system.


title: Cost-aware Joint Caching and Forwarding in Networks with Heterogeneous Cache Resources

abstract: Caching is crucial for enabling high-throughput networks for data intensive applications. Traditional caching technology relies on DRAM, as it can transfer data at a high rate. However, DRAM capacity is subject to contention by most system components and thus is very limited, implying that DRAM-only caches cannot scale to meet growing demand. Fortunately, persistent memory and flash storage technologies are rapidly evolving and can be utilized alongside DRAM to increase cache capacities. To do so without compromising network performance requires caching techniques adapted to the characteristics of these technologies. In this paper, we model the cache as a collection of storage blocks with different rate parameters and utilization costs. We introduce an optimization technique based on the drift-plus-penalty method and apply it in a framework which enables joint caching and forwarding. We show that it achieves an optimal trade-off between throughput and cache utilization costs in a virtual control plane. We then develop a corresponding practical policy in the data plane. Finally, through simulations in several settings, we demonstrate the superior performance of our proposed approach with respect to total user delay and cache utilization costs.


title: Multimodal Sampling via Approximate Symmetries

abstract: Sampling from multimodal distributions is a challenging task in scientific computing. When a distribution has an exact symmetry between the modes, direct jumps among them can accelerate the samplings significantly. However, the distributions from most applications do not have exact symmetries. This paper considers the distributions with approximate symmetries. We first construct an exactly symmetric reference distribution from the target one by averaging over the group orbit associated with the approximate symmetry. Next, we can apply the multilevel Monte Carlo methods by constructing a continuation path between the reference and target distributions. We discuss how to implement these steps with annealed importance sampling and tempered transitions. Compared with traditional multilevel methods, the proposed approach can be more effective since the reference and target distributions are much closer. Numerical results of the Ising models are presented to illustrate the efficiency of the proposed method.

categories: math.NA cs.NA math.ST physics.comp-ph stat.TH


title: Crowd Counting in Harsh Weather using Image Denoising with Pix2Pix GANs

abstract: Visual crowd counting estimates the density of the crowd using deep learning models such as convolution neural networks (CNNs). The performance of the model heavily relies on the quality of the training data that constitutes crowd images. In harsh weather such as fog, dust, and low light conditions, the inference performance may severely degrade on the noisy and blur images. In this paper, we propose the use of Pix2Pix generative adversarial network (GAN) to first denoise the crowd images prior to passing them to the counting model. A Pix2Pix network is trained using synthetic noisy images generated from original crowd images and then the pretrained generator is then used in the inference engine to estimate the crowd density in unseen, noisy crowd images. The performance is tested on JHU-Crowd dataset to validate the significance of the proposed method particularly when high reliability and accuracy are required.


title: Vec-Tok Speech: speech vectorization and tokenization for neural speech generation

abstract: Language models (LMs) have recently flourished in natural language processing and computer vision, generating high-fidelity texts or images in various tasks. In contrast, the current speech generative models are still struggling regarding speech quality and task generalization. This paper presents Vec-Tok Speech, an extensible framework that resembles multiple speech generation tasks, generating expressive and high-fidelity speech. Specifically, we propose a novel speech codec based on speech vectors and semantic tokens. Speech vectors contain acoustic details contributing to high-fidelity speech reconstruction, while semantic tokens focus on the linguistic content of speech, facilitating language modeling. Based on the proposed speech codec, Vec-Tok Speech leverages an LM to undertake the core of speech generation. Moreover, Byte-Pair Encoding (BPE) is introduced to reduce the token length and bit rate for lower exposure bias and longer context coverage, improving the performance of LMs. Vec-Tok Speech can be used for intra- and cross-lingual zero-shot voice conversion (VC), zero-shot speaking style transfer text-to-speech (TTS), speech-to-speech translation (S2ST), speech denoising, and speaker de-identification and anonymization. Experiments show that Vec-Tok Speech, built on 50k hours of speech, performs better than other SOTA models. Code will be available at https://github.com/BakerBunker/VecTok .


title: Optimizing the Placement of Roadside LiDARs for Autonomous Driving

abstract: Multi-agent cooperative perception is an increasingly popular topic in the field of autonomous driving, where roadside LiDARs play an essential role. However, how to optimize the placement of roadside LiDARs is a crucial but often overlooked problem. This paper proposes an approach to optimize the placement of roadside LiDARs by selecting optimized positions within the scene for better perception performance. To efficiently obtain the best combination of locations, a greedy algorithm based on perceptual gain is proposed, which selects the location that can maximize the perceptual gain sequentially. We define perceptual gain as the increased perceptual capability when a new LiDAR is placed. To obtain the perception capability, we propose a perception predictor that learns to evaluate LiDAR placement using only a single point cloud frame. A dataset named Roadside-Opt is created using the CARLA simulator to facilitate research on the roadside LiDAR placement problem.


title: IBoxCLA: Towards Robust Box-supervised Segmentation of Polyp via Improved Box-dice and Contrastive Latent-anchors

abstract: Box-supervised polyp segmentation attracts increasing attention for its cost-effective potential. Existing solutions often rely on learning-free methods or pretrained models to laboriously generate pseudo masks, triggering Dice constraint subsequently. In this paper, we found that a model guided by the simplest box-filled masks can accurately predict polyp locations/sizes, but suffers from shape collapsing. In response, we propose two innovative learning fashions, Improved Box-dice (IBox) and Contrastive Latent-Anchors (CLA), and combine them to train a robust box-supervised model IBoxCLA. The core idea behind IBoxCLA is to decouple the learning of location/size and shape, allowing for focused constraints on each of them. Specifically, IBox transforms the segmentation map into a proxy map using shape decoupling and confusion-region swapping sequentially. Within the proxy map, shapes are disentangled, while locations/sizes are encoded as box-like responses. By constraining the proxy map instead of the raw prediction, the box-filled mask can well supervise IBoxCLA without misleading its shape learning. Furthermore, CLA contributes to shape learning by generating two types of latent anchors, which are learned and updated using momentum and segmented polyps to steadily represent polyp and background features. The latent anchors facilitate IBoxCLA to capture discriminative features within and outside boxes in a contrastive manner, yielding clearer boundaries. We benchmark IBoxCLA on five public polyp datasets. The experimental results demonstrate the competitive performance of IBoxCLA compared to recent fully-supervised polyp segmentation methods, and its superiority over other box-supervised state-of-the-arts with a relative increase of overall mDice and mIoU by at least 6.5% and 7.5%, respectively.


title: Dynamic trait distribution as a source for shifts in interaction strength and population density

abstract: Intraspecific trait variation has been increasingly recognized as an important factor in determining species interaction and diversity. Eco-evolutionary models have studied the distribution of trait values within a population that changes over the generations as a result of selection and heritability. Non-heritable traits that can change within the lifetime, such as behavior, can cause trait-mediated indirect effects, often studied by modeling the dynamics of a homogeneous trait. Complementary to these two approaches, we study the distribution of traits within a population and its dynamics on short timescales due to ecological processes. We consider several mechanisms by which the trait distribution can shift dynamically: phenotypic plasticity within each individual, differential growth among individuals, and preferential consumption by the predator. Through a simple predator-prey model that explicitly tracks the trait distribution within the prey, we illustrate some unusual consequences of trait shifts, including the healthy herd effect and the emergent promotion of the prey by the predator. We analyze the cause of these phenomena by identifying the density and trait effects from the predator. Our results show that intraspecific trait variation and the dynamics of its distribution can lead to the modification of species interactions and result in outcomes that are otherwise unexpected.


title: Synthesizing Missing MRI Sequences from Available Modalities using Generative Adversarial Networks in BraTS Dataset

abstract: Glioblastoma is a highly aggressive and lethal form of brain cancer. Magnetic resonance imaging (MRI) plays a significant role in the diagnosis, treatment planning, and follow-up of glioblastoma patients due to its non-invasive and radiation-free nature. The International Brain Tumor Segmentation (BraTS) challenge has contributed to generating numerous AI algorithms to accurately and efficiently segment glioblastoma sub-compartments using four structural (T1, T1Gd, T2, T2-FLAIR) MRI scans. However, these four MRI sequences may not always be available. To address this issue, Generative Adversarial Networks (GANs) can be used to synthesize the missing MRI sequences. In this paper, we implement and utilize an open-source GAN approach that takes any three MRI sequences as input to generate the missing fourth structural sequence. Our proposed approach is contributed to the community-driven generally nuanced deep learning framework (GaNDLF) and demonstrates promising results in synthesizing high-quality and realistic MRI sequences, enabling clinicians to improve their diagnostic capabilities and support the application of AI methods to brain tumor MRI quantification.


title: Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs

abstract: In this position paper, we argue that instead of morally aligning LLMs to specific set of ethical principles, we should infuse generic ethical reasoning capabilities into them so that they can handle value pluralism at a global scale. When provided with an ethical policy, an LLM should be capable of making decisions that are ethically consistent to the policy. We develop a framework that integrates moral dilemmas with moral principles pertaining to different foramlisms of normative ethics, and at different levels of abstractions. Initial experiments with GPT-x models shows that while GPT-4 is a nearly perfect ethical reasoner, the models still have bias towards the moral values of Western and English speaking societies.


title: A Comparative Study of Pre-trained CNNs and GRU-Based Attention for Image Caption Generation

abstract: Image captioning is a challenging task involving generating a textual description for an image using computer vision and natural language processing techniques. This paper proposes a deep neural framework for image caption generation using a GRU-based attention mechanism. Our approach employs multiple pre-trained convolutional neural networks as the encoder to extract features from the image and a GRU-based language model as the decoder to generate descriptive sentences. To improve performance, we integrate the Bahdanau attention model with the GRU decoder to enable learning to focus on specific image parts. We evaluate our approach using the MSCOCO and Flickr30k datasets and show that it achieves competitive scores compared to state-of-the-art methods. Our proposed framework can bridge the gap between computer vision and natural language and can be extended to specific domains.


title: ADMEOOD: Out-of-Distribution Benchmark for Drug Property Prediction

abstract: Obtaining accurate and valid information for drug molecules is a crucial and challenging task. However, chemical knowledge and information have been accumulated over the past 100 years from various regions, laboratories, and experimental purposes. Little has been explored in terms of the out-of-distribution (OOD) problem with noise and inconsistency, which may lead to weak robustness and unsatisfied performance. This study proposes a novel benchmark ADMEOOD, a systematic OOD dataset curator and benchmark specifically designed for drug property prediction. ADMEOOD obtained 27 ADME (Absorption, Distribution, Metabolism, Excretion) drug properties from Chembl and relevant literature. Additionally, it includes two kinds of OOD data shifts: Noise Shift and Concept Conflict Drift (CCD). Noise Shift responds to the noise level by categorizing the environment into different confidence levels. On the other hand, CCD describes the data which has inconsistent label among the original data. Finally, it tested on a variety of domain generalization models, and the experimental results demonstrate the effectiveness of the proposed partition method in ADMEOOD: ADMEOOD demonstrates a significant difference performance between in-distribution and out-of-distribution data. Moreover, ERM (Empirical Risk Minimization) and other models exhibit distinct trends in performance across different domains and measurement types.


title: Attosecond control of solid-state high harmonic generation using {\omega}-3{\omega} fields

abstract: Controlling the electron dynamics in matter by individual oscillations of light fields has recently led to the development of attosecond metrology. One of the phenomena resulting from the nonlinear response of materials in the strong-field interaction regime is coherent emission of high energy photons. High harmonic spectra carry the fingerprints of sub-cycle electronic motion and the energy structure of the studied system. Here we show that tailoring the waveform of the driving light by using a coherent combination with its third harmonic frequency allows to control the electron tunneling time within each half-cycle of the fundamental wave with attosecond precision. We introduce an experimental scheme in which we simultaneously monitor the modulation of amplitude and emission delays of high harmonic radiation and the excited electron population generated in crystalline silicon as a function of the relative phase between the {\omega}-3{\omega} fields. The results reveal unambiguously the connection between the dynamics of electron tunneling and high harmonic generation processes in solids.


title: ADASR: An Adversarial Auto-Augmentation Framework for Hyperspectral and Multispectral Data Fusion

abstract: Deep learning-based hyperspectral image (HSI) super-resolution, which aims to generate high spatial resolution HSI (HR-HSI) by fusing hyperspectral image (HSI) and multispectral image (MSI) with deep neural networks (DNNs), has attracted lots of attention. However, neural networks require large amounts of training data, hindering their application in real-world scenarios. In this letter, we propose a novel adversarial automatic data augmentation framework ADASR that automatically optimizes and augments HSI-MSI sample pairs to enrich data diversity for HSI-MSI fusion. Our framework is sample-aware and optimizes an augmentor network and two downsampling networks jointly by adversarial learning so that we can learn more robust downsampling networks for training the upsampling network. Extensive experiments on two public classical hyperspectral datasets demonstrate the effectiveness of our ADASR compared to the state-of-the-art methods.


title: Finite-horizon Approximations and Episodic Equilibrium for Stochastic Games

abstract: This paper proposes a finite-horizon approximation scheme and introduces episodic equilibrium as a solution concept for stochastic games (SGs), where agents strategize based on the current state and episode stage. The paper also establishes an upper bound on the approximation error that decays with the episode length for both discounted and time-averaged utilities. This approach bridges the gap in the analysis of finite and infinite-horizon SGs, and provides a unifying framework to address time-averaged and discounted utilities. To show the effectiveness of the scheme, the paper presents episodic, decentralized (i.e., payoff-based), and model-free learning dynamics proven to reach (near) episodic equilibrium in broad classes of SGs, including zero-sum, identical-interest and specific general-sum SGs with switching controllers for both time-averaged and discounted utilities.


title: A survey of SiO $J=$ 1 -- 0 emission toward massive star-forming regions

abstract: The application of silicon monoxide (SiO) as a shock tracer arises from its propensity to occur in the gas phase as a result of shock-induced phenomena, including outflow activity and interactions between molecular clouds and expanding HII regions or supernova remnants. We searched for indications of shocks toward 366 massive star-forming regions by observing the ground rotational transition of SiO ($v=0$, $J=1-0$) at 43 GHz with the Korean VLBI Network (KVN) 21 m telescopes to extend our understanding on the origins of SiO in star-forming regions. We detected SiO emission toward 104 regions that consist of 57 IRDCs, 21 HMPOs, and 26 UCHIIs. The determined median SiO column density, $N$(SiO), and abundance, $X$(SiO), relative to $N$(H$_2$) are $8.12\times10^{12}$ cm$^{-2}$ and $1.28\times10^{-10}$, respectively. These values are similar to those obtained toward other star-forming regions and also consistent with predicted values from shock models with low-velocity shocks ($\lesssim$10 - 15 km s$^{-1}$). While the $X$(SiO) does not exhibit any strong correlation with the evolutionary stages of their host clumps, $L_{\rm SiO}$ is highly correlated with dust clump mass, and $L_{\rm SiO}/L_{\rm bol}$ also has a strong negative correlation with $T_{\rm dust}$. This shows that colder and younger clumps have high $L_{\rm SiO}/L_{\rm bol}$ suggestive of an evolutionary trend. This trend is not due to excess emission at higher velocities, such as SiO wing features, as the colder sources with high $L_{\rm SiO}/L_{\rm bol}$ ratios lack wing features. Comparing SiO emission with H$_2$O and Class I CH$_3$OH masers, we find a significant correlation between $L_{\rm SiO}$/$L_{\rm bol}$ and $L_{\rm CH_3OH}/L_{\rm bol}$ ratios, whereas no similar correlation is seen for the H$_2$O maser emission. This suggests a similar origin for the SiO and Class I CH$_3$OH emission in these sources.


title: Dynamically generated states from the $\eta K^*\bar{K}^*$, $\pi K^*\bar{K}^*$, and $K K^*\bar{K}^*$ systems within the fixed-center approximation

abstract: The three-body systems $\eta K^* \bar{K}^*$, $\pi K^* \bar{K}^*$, and $K K^* \bar{K}^*$ are further investigated within the framework of fixed-center approximation, where $K^* \bar{K}^*$ is treated as the fixed-center, corresponding to the possible scalar meson $a_0(1780)$ or the tensor meson $f_2'(1525)$. The interactions between $\eta$, $\pi$, $K$, and $K^*$ are taken from the chiral unitary approach. The resonance structures appear in the modulus squared of the three-body scattering amplitude and suggest that $\eta / \pi / K$-$(K^*\bar{K}^*)_{a_0(1780)/f'_2(1525)}$ hadron state can be formed. By scattering the $\eta$ meson on the fixed-center $(K^* \bar{K}^*)_{a_0(1780)}$, it is found that there is a distinct peak around 2100 MeV, as shown in the modulus squared of the three-body scattering amplitude, which can be associated with the meson $\pi(2070)$. For the scattering of the $\eta$ meson on the $(K^* \bar{K}^*)_{f_2'(1525)}$, a resonance structure around 1890 MeV is found and it can be associated with the $\eta_2(1870)$ meson. Other resonance structures are also found and can be associated with $\pi_2(1880)$ and $\eta(2010)$.


title: Uncovering Hidden Connections: Iterative Search and Reasoning for Video-grounded Dialog

abstract: In contrast to conventional visual question answering, video-grounded dialog necessitates a profound understanding of both dialog history and video content for accurate response generation. Despite commendable progress made by existing approaches, they still face the challenges of incrementally understanding complex dialog history and assimilating video information. In response to these challenges, we present an iterative search and reasoning framework, which consists of a textual encoder, a visual encoder, and a generator. Specifically, we devise a path search and aggregation strategy in the textual encoder, mining core cues from dialog history that are pivotal to understanding the posed questions. Concurrently, our visual encoder harnesses an iterative reasoning network to extract and emphasize critical visual markers from videos, enhancing the depth of visual comprehension. Finally, we utilize the pre-trained GPT-2 model as our answer generator to decode the mined hidden clues into coherent and contextualized answers. Extensive experiments on three public datasets demonstrate the effectiveness and generalizability of our proposed framework.


title: On the interacting dark energy scenarios $-$ the case for Hubble constant tension

abstract: The Hubble constant $H_0$ is one of the important cosmological parameters measuring the expansion rate of our universe at present moment. Over the last couple of years, $H_0$ has created an enormous amount of debates interests in the astrophysical and cosmological communities for its different estimations at many standard deviations by different observational surveys. The recent estimation of $H_0$ from the cosmic microwave background observations by Planck within the $\Lambda$-Cold Dark Matter ($\Lambda$CDM) paradigm is in tension with $\gtrsim 5 \sigma$ confidence with SH0ES (Supernovae and $H_0$ for the Equation of State of dark energy) collaboration. As a result, revision of the standard $\Lambda$CDM model has been suggested in various ways in order to examine whether such scenarios can solve this $H_0$ tension. Among the list of the proposed cosmological scenarios, in this chapter we focus on a generalized cosmological theory in which the dark components of the universe, namely, Dark Matter (DM) and Dark Energy (DE) are allowed to interact with each other in a non-gravitational way, widely known as the Interacting DE or Coupled DE scenarios. These interacting scenarios have received magnificent attention in the scientific community for their appealing consequences. Specifically, in the context of $H_0$ tension, it has been observed that the interacting DE scenarios can lead to higher values of the Hubble constant ($H_0$) value, and consequently, the tension on $H_0$ can be either alleviated or solved. In this chapter we review various interacting DE scenarios and their roles in alleviating the $H_0$ tension.


title: Deep ReLU networks and high-order finite element methods II: Chebyshev emulation

abstract: We show expression rates and stability in Sobolev norms of deep feedforward ReLU neural networks (NNs) in terms of the number of parameters defining the NN for continuous, piecewise polynomial functions, on arbitrary, finite partitions $\mathcal{T}$ of a bounded interval $(a,b)$. Novel constructions of ReLU NN surrogates encoding function approximations in terms of Chebyshev polynomial expansion coefficients are developed which require fewer neurons than previous constructions. Chebyshev coefficients can be computed easily from the values of the function in the Clenshaw--Curtis points using the inverse fast Fourier transform. Bounds on expression rates and stability are obtained that are superior to those of constructions based on ReLU NN emulations of monomials as considered in [Opschoor, Petersen and Schwab, 2020] and [Montanelli, Yang and Du, 2021]. All emulation bounds are explicit in terms of the (arbitrary) partition of the interval, the target emulation accuracy and the polynomial degree in each element of the partition. ReLU NN emulation error estimates are provided for various classes of functions and norms, commonly encountered in numerical analysis. In particular, we show exponential ReLU emulation rate bounds for analytic functions with point singularities and develop an interface between Chebfun approximations and constructive ReLU NN emulations.


title: Dynamic Brain Networks with Prescribed Functional Connectivity

abstract: In this paper, we consider stable stochastic linear systems modeling whole-brain resting-state dynamics. We parametrize the state matrix of the system (effective connectivity) in terms of its steady-state covariance matrix (functional connectivity) and a skew-symmetric matrix $S$. We examine how the matrix $S$ influences some relevant dynamic properties of the system. Specifically, we show that a large $S$ enhances the degree of stability and excitability of the system, and makes the latter more responsive to high-frequency inputs.


title: CoPAL: Corrective Planning of Robot Actions with Large Language Models

abstract: In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes to the field of Large Language Models (LLMs) applied to task and motion planning for robots. We propose a system architecture that orchestrates a seamless interplay between multiple cognitive levels, encompassing reasoning, planning, and motion generation. At its core lies a novel replanning strategy that handles physically grounded, logical, and semantic errors in the generated plans. We demonstrate the efficacy of the proposed feedback architecture, particularly its impact on executability, correctness, and time complexity via empirical evaluation in the context of a simulation and two intricate real-world scenarios: blocks world, barman and pizza preparation.


title: Classification of Dysarthria based on the Levels of Severity. A Systematic Review

abstract: Dysarthria is a neurological speech disorder that can significantly impact affected individuals' communication abilities and overall quality of life. The accurate and objective classification of dysarthria and the determination of its severity are crucial for effective therapeutic intervention. While traditional assessments by speech-language pathologists (SLPs) are common, they are often subjective, time-consuming, and can vary between practitioners. Emerging machine learning-based models have shown the potential to provide a more objective dysarthria assessment, enhancing diagnostic accuracy and reliability. This systematic review aims to comprehensively analyze current methodologies for classifying dysarthria based on severity levels. Specifically, this review will focus on determining the most effective set and type of features that can be used for automatic patient classification and evaluating the best AI techniques for this purpose. We will systematically review the literature on the automatic classification of dysarthria severity levels. Sources of information will include electronic databases and grey literature. Selection criteria will be established based on relevance to the research questions. Data extraction will include methodologies used, the type of features extracted for classification, and AI techniques employed. The findings of this systematic review will contribute to the current understanding of dysarthria classification, inform future research, and support the development of improved diagnostic tools. The implications of these findings could be significant in advancing patient care and improving therapeutic outcomes for individuals affected by dysarthria.


title: Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation

abstract: In this paper, we tackle a new problem: how to transfer knowledge from the pre-trained cumbersome yet well-performed CNN-based model to learn a compact Vision Transformer (ViT)-based model while maintaining its learning capacity? Due to the completely different characteristics of ViT and CNN and the long-existing capacity gap between teacher and student models in Knowledge Distillation (KD), directly transferring the cross-model knowledge is non-trivial. To this end, we subtly leverage the visual and linguistic-compatible feature character of ViT (i.e., student), and its capacity gap with the CNN (i.e., teacher) and propose a novel CNN-to-ViT KD framework, dubbed C2VKD. Importantly, as the teacher's features are heterogeneous to those of the student, we first propose a novel visual-linguistic feature distillation (VLFD) module that explores efficient KD among the aligned visual and linguistic-compatible representations. Moreover, due to the large capacity gap between the teacher and student and the inevitable prediction errors of the teacher, we then propose a pixel-wise decoupled distillation (PDD) module to supervise the student under the combination of labels and teacher's predictions from the decoupled target and non-target classes. Experiments on three semantic segmentation benchmark datasets consistently show that the increment of mIoU of our method is over 200% of the SoTA KD methods


title: Integration by parts formula for exit times of one dimensional diffusions

abstract: In line with the methodology introduced in our recent article for formulating probabilistic representations of integration by parts involving killed diffusion, we establish an integration by parts formula for the first exit time of one-dimensional diffusion processes. However, our approach diverges from the conventional differential calculus applied to the associated space Markov chain; instead, we employ calculus techniques that focus on the underlying time variables.


title: Morphology of star-forming clumps in ram-pressure stripped galaxies as seen by HST

abstract: We characterize the morphological properties of a statistically relevant sample of H$\alpha$ and UV young star-forming clumps and optical complexes, observed with the \textit{Hubble Space Telescope} in six galaxies of the GASP sample undergoing ram-pressure stripping. The catalogs comprise 2406 (323 in the tails) H$\alpha$ clumps, 3750 (899) UV clumps and 424 tail optical complexes. About 15-20\% of the clumps and 50\% of the complexes are resolved in size. We find that more than half of the complexes contain no H$\alpha$ clumps, while most of them contain at least one UV clump. The clump number and size increase with the complex size, while the median complex filling factor is larger for UV clumps ($0.27$) than for H$\alpha$ clumps ($0.10$) and does not correlate with almost any morphological property. This suggests that the clumps number and size grow with the complex keeping the filling factor constant. When studying the position of the clumps inside their complexes, H$\alpha$ clumps, and UV clumps to a lesser extent, show a displacement from the complex center of $0.1-1$ kpc and, in $\sim 60$\% of the cases, they are displaced away from the galactic disk. This is in accordance with the fireball configuration, already observed in the tails of stripped galaxies. Finally, the filling factor and the clump radius increase with the distance from the galactic disk, suggesting that the reciprocal displacement of the different stellar generations increases as a consequence of the velocity gradient caused by ram pressure.


title: RaftFed: A Lightweight Federated Learning Framework for Vehicular Crowd Intelligence

abstract: Vehicular crowd intelligence (VCI) is an emerging research field. Facilitated by state-of-the-art vehicular ad-hoc networks and artificial intelligence, various VCI applications come to place, e.g., collaborative sensing, positioning, and mapping. The collaborative property of VCI applications generally requires data to be shared among participants, thus forming network-wide intelligence. How to fulfill this process without compromising data privacy remains a challenging issue. Although federated learning (FL) is a promising tool to solve the problem, adapting conventional FL frameworks to VCI is nontrivial. First, the centralized model aggregation is unreliable in VCI because of the existence of stragglers with unfavorable channel conditions. Second, existing FL schemes are vulnerable to Non-IID data, which is intensified by the data heterogeneity in VCI. This paper proposes a novel federated learning framework called RaftFed to facilitate privacy-preserving VCI. The experimental results show that RaftFed performs better than baselines regarding communication overhead, model accuracy, and model convergence.


title: Why Does Sharpness-Aware Minimization Generalize Better Than SGD?

abstract: The challenge of overfitting, in which the model memorizes the training data and fails to generalize to test data, has become increasingly significant in the training of large neural networks. To tackle this challenge, Sharpness-Aware Minimization (SAM) has emerged as a promising training method, which can improve the generalization of neural networks even in the presence of label noise. However, a deep understanding of how SAM works, especially in the setting of nonlinear neural networks and classification tasks, remains largely missing. This paper fills this gap by demonstrating why SAM generalizes better than Stochastic Gradient Descent (SGD) for a certain data model and two-layer convolutional ReLU networks. The loss landscape of our studied problem is nonsmooth, thus current explanations for the success of SAM based on the Hessian information are insufficient. Our result explains the benefits of SAM, particularly its ability to prevent noise learning in the early stages, thereby facilitating more effective learning of features. Experiments on both synthetic and real data corroborate our theory.


title: Eternal solutions to a porous medium equation with strong nonhomogeneous absorption. Part I: Radially non-increasing profiles

abstract: Existence of specific \emph{eternal solutions} in exponential self-similar form to the following quasilinear diffusion equation with strong absorption$$\partial_t u=\Delta u^m-|x|^{\sigma}u^q,$$posed for $(t,x)\in(0,\infty)\times\mathbb{R}^N$, with $m>1$, $q\in(0,1)$ and $\sigma=\sigma_c:=2(1-q)/(m-1)$ is proved. Looking for radially symmetric solutions of the form$$u(t,x)=e^{-\alpha t}f(|x|e^{\beta t}), \qquad \alpha=\frac{2}{m-1}\beta,$$we show that there exists a unique exponent $\beta^*\in(0,\infty)$ for which there exists a one-parameter family $(u_A)_{A>0}$ of solutions with compactly supported and non-increasing profiles $(f_A)_{A>0}$ satisfying $f_A(0)=A$ and $f_A'(0)=0$. An important feature of these solutions is that they are bounded and do not vanish in finite time, a phenomenon which is known to take place for all non-negative bounded solutions when $\sigma\in (0,\sigma_c)$.


title: Subsurface Flows in Active Regions with Peculiar Magnetic Configurations

abstract: We present analysis of the evolution of subsurface flows in and around active regions with peculiar magnetic configurations and compare their characteristics with the normal active regions. We also study the zonal and meridional components of subsurface flows separately in different polarity regions separately to better understand their role in flux migration. We use the techniques of local correlation tracking and ring diagrams for computing surface and subsurface flows, respectively. Our study manifests an evidence that the meridional component of the flows near anti-Hale active regions is predominantly equatorward which disagrees with the poleward flow pattern seen in pro-Hale active regions. We also find clockwise or anti-clockwise flows surrounding the anti-Joy active regions depending on their locations in the Southern or Northern hemispheres, respectively.


title: The Control System of the Elliptical Cavity and Cryomodule Test Stand Demonstrator for ESS

abstract: CEA IRFU Saclay is taking part of ESS (European Spallation Source) construction through several packages and, especially in the last three years on the Elliptical Cavity and Cryomodule Test stand Demonstrator (ECCTD). The project consists of RF test, conditioning, cryogenic cool-down and regulations of eight cryomodules with theirs four cavities each. For now, two medium beta cavities cryomodules have been successfully tested. This paper describes the context and the realization of the control system for cryogenic and RF processes, added to cavities tuning motorization relying on COTS solutions: Siemens PLC, EtherCAT Beckhoff modules, IOxOS fast acquisition cards and MRF timing cards.


title: Paste Rheology and Surface Charge of Calcined Kaolinite

abstract: Partial substitution of the clinker in the cement by a supplementary cementitious material (SCM) is one of the main solutions to reduce the carbon footprint. Calcined kaolinite is a good candidate due to its availability and relatively high reactivity compared to other SCMs. The main issue with these calcined clay types of cements is the high-water demand at low clinker factors, a problem which remains not well understood. In this proceeding, we will show the role played by electrostatic interactions in the paste stiffening using as a model system pure calcined kaolinite paste prepared at various pH as well as salt types and concentrations. The study combines dynamic rheometry measurements in strain-sweep modes, surface charge characterization using potentiometric titration and electrophoretic measurements as well as calculations of inter-particle interactions using Monte-Carlo (MC) simulations in the framework of the primitive model. The calcined kaolinite is found to possess a negative permanent charge, presumably due to the Si(IV)/Al(III) substitution, and a titratable charge (as due to ionization of silanol and aluminol surface groups) with a point of zero proton charge at pH 4.65. In conditions relevant for cement paste, the calcined clay bear a strong negative charge ~ 300 mC/m2. The rheological measurements reveal that the paste stiffening is highly dependent on the pH, salt concentration and type as expected for systems controlled by electrostatic interactions. The stiffness increases with the salt concentration at natural pH and is the largest in solutions buffered with Ca(OH)2, that is at high Ca2+ concentrations and pH where the negative charge of the calcined clay is the strongest. The MC simulations of the inter-particle interactions are found to qualitatively explain the observed variation in the paste stiffness.


title: Anomalously large spin-dependent electron correlation in nearly half-metallic ferromagnet CoS$_2$

abstract: The spin-dependent band structure of CoS$_2$ which is a candidate for a half-metallic ferromagnet was investigated by both spin- and angle-resolved photoemission spectroscopy and theoretical calculations, in order to reappraise the half-metallicity and electronic correlations. We determined the three-dimensional Fermi surface and the spin-dependent band structure. As a result, we found that a part of the minority spin bands is on the occupied side in the vicinity of the Fermi level, providing spectroscopic evidence that CoS$_2$ is not but very close to a half-metal. Band calculations using density functional theory with generalized gradient approximation showed a good agreement with the observed majority spin $e_g$ bands, while it could not explain the observed band width of the minority-spin eg bands. On the other hand, theoretical calculations using dynamical mean field theory could better reproduce the strong mass renormalization in the minority-spin $e_g$ bands. All those results strongly suggest the presence of anomalously enhanced spin-dependent electron correlation effects on the electronic structure in the vicinity of the half-metallic state. We also report the temperature dependence of the electronic structure across the Curie temperature and discuss the mechanism of the thermal demagnetization. Our discovery of the anomalously large spin-dependent electronic correlations not only demonstrates a key factor in understanding the electronic structure of half-metals but also provides a motivation to improve theoretical calculations on spin-polarized strongly correlated systems.


title: Epidemiological impacts of age structures on human malaria transmission

abstract: Malaria is one of the most common mosquito-borne diseases widespread in tropical and subtropical regions, causing thousands of deaths every year in the world. In a previous paper, we formulated an age-structured model containing three structural variables: (i) the chronological age of human and mosquito populations, (ii) the time since they are infected, and (iii) humans waning immunity (i.e. the progressive loss of protective antibodies after recovery). In the present paper, we expand the analysis of this age-structured model and focus on the derivation of entomological and epidemiological results commonly used in the literature, following the works of Smith and McKenzie. We generalize their results to the age-structured case. In order to quantify the impact of neglecting structuring variables such as chronological age, we assigned values from the literature to our model parameters. While some parameters values are readily accessible from the literature, at least those about the human population, the parameters concerning mosquitoes are less commonly documented and the values of a number of them (e.g. mosquito survival in the presence or in absence of infection) can be discussed extensively.


title: BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations

abstract: Recent advancements in biological research leverage the integration of molecules, proteins, and natural language to enhance drug discovery. However, current models exhibit several limitations, such as the generation of invalid molecular SMILES, underutilization of contextual information, and equal treatment of structured and unstructured knowledge. To address these issues, we propose $\mathbf{BioT5}$, a comprehensive pre-training framework that enriches cross-modal integration in biology with chemical knowledge and natural language associations. $\mathbf{BioT5}$ utilizes SELFIES for $100%$ robust molecular representations and extracts knowledge from the surrounding context of bio-entities in unstructured biological literature. Furthermore, $\mathbf{BioT5}$ distinguishes between structured and unstructured knowledge, leading to more effective utilization of information. After fine-tuning, BioT5 shows superior performance across a wide range of tasks, demonstrating its strong capability of capturing underlying relations and properties of bio-entities. Our code is available at $\href{https://github.com/QizhiPei/BioT5}{Github}$.


title: Search for $J/\psi$ weak decays containing $D$ meson

abstract: Using a sample of about 10 billion $J/\psi$ events with the BESIII detector, we search for the weak decays of $J/\psi \to \bar{D}^0\pi^0 + c.c.$, $J/\psi \to \bar{D}^0\eta + c.c.$, $J/\psi \to \bar{D}^0\rho^0 + c.c.$, $J/\psi \to D^-\pi^+ + c.c.$, and $J/\psi \to D^-\rho^+ + c.c.$. Since no significant signal is observed, we set the upper limits of the branching fractions of these decays to be $\mathcal{B}(J/\psi \to \bar{D}^0\pi^0 + c.c.) < 4.7 \times 10^{-7}$, $\mathcal{B}(J/\psi \to \bar{D}^0\eta + c.c.) < 6.8 \times 10^{-7}$, $\mathcal{B}(J/\psi \to \bar{D}^0\rho^0 + c.c.) < 5.2 \times 10^{-7}$, $\mathcal{B}(J/\psi \to D^-\pi^+ + c.c.) < 7.0 \times 10^{-8}$, and $\mathcal{B}(J/\psi \to D^-\rho^+ + c.c.) < 6.0 \times 10^{-7}$ at the 90\% confidence level.