title: Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget

abstract: Compared to standard language model (LM) pretraining (i.e., from scratch), Knowledge Distillation (KD) entails an additional forward pass through a teacher model that is typically substantially larger than the target student model. As such, KD in LM pretraining materially slows down throughput of pretraining instances vis-a-vis pretraining from scratch. Scaling laws of LM pretraining suggest that smaller models can close the gap to larger counterparts if trained on more data (i.e., processing more tokens)-and under a fixed computation budget, smaller models are able be process more data than larger models. We thus hypothesize that KD might, in fact, be suboptimal to pretraining from scratch for obtaining smaller LMs, when appropriately accounting for the compute budget. To test this, we compare pretraining from scratch against several KD strategies for masked language modeling (MLM) in a fair experimental setup, with respect to amount of computation as well as pretraining data. Downstream results on GLUE, however, do not confirm our hypothesis: while pretraining from scratch performs comparably to ordinary KD under a fixed computation budget, more sophisticated KD strategies, namely TinyBERT (Jiao et al., 2020) and MiniLM (Wang et al., 2023), outperform it by a notable margin. We further find that KD yields larger gains over pretraining from scratch when the data must be repeated under the fixed computation budget.


title: Strong enhancement of magnetic coercivity induced by uniaxial stress

abstract: The performance of permanent magnets is intricately tied to their magnetic hysteresis loop. In this study, we investigate the heavy-fermion ferromagnet CeAgSb$_2$ through magnetization measurements under uniaxial stress. We observe a 2400 % increase in magnetic coercivity with just a modest stress of approximately 1 kbar. This effect persists even after pressure release, attributable to stress-induced defects that efficiently pin domain walls. Other magnetic properties such as ordering temperature and saturation moment exhibit only weak pressure dependencies and display full reversibility. Our findings offer a promising route for increasing coercive field strength and enhancing the energy product in ferromagnetic materials and are potentially applicable to a broad spectrum of commercial or emerging magnetic applications.


title: Observation of strain-rate softening behavior in jammed granular media

abstract: The strain-rate sensitivity of confined granular materials has been widely explored, with most findings exhibiting rate-strengthening behaviors. This study, however, reveals a distinct rate-softening behavior across a certain strain rate range based on triaxial tests on particle clusters of various materials with different surface properties, particle sizes, shapes, and stiffness. This softening effect is especially pronounced in the case of common rice particles. By examining the behavior of rice particles under different confining pressure and surface conditions, and directly measuring the frictional coefficient across various loading rates, we find that the reduction in surface frictional coefficient with the increasing strain rate predominantly contributes to this rate-softening behavior. This conclusion is validated by results from Finite Element Method (FEM) simulations. Additionally, we identify confining pressure as a critical factor regulating the normal stress between particles, and thereby enhancing frictional behavior. Rheometer tests reveal that the shear modulus exhibits a similar rate-softening trend. This study of rate-softening behavior in granular materials enhances our understanding of the mechanisms during their deformation under confining pressure. It also suggests that local inter-particle tribology significantly impacts overall granular behavior.


title: Neutrinos in Cosmology

abstract: Neutrinos are the least known particle in the Standard Model of elementary particle physics. They play a crucial role in cosmology, governing the universe's evolution and shaping the large-scale structures we observe today. In this chapter, we review crucial topics in neutrino cosmology, such as the neutrino decoupling process in the very early universe. We shall also revisit the current constraints on the number of effective relativistic degrees of freedom and the departures from its standard expectation of 3. Neutrino masses represent the very first departure from the Standard Model of elementary particle physics and may imply the existence of new unexplored mass generation mechanisms. Cosmology provides the tightest bound on the sum of neutrino masses, and we shall carefully present the nature of these constraints, both on the total mass of the neutrinos and on their precise spectrum. The ordering of the neutrino masses plays a major role in the design of future neutrino mass searches from laboratory experiments, such as neutrinoless double beta decay probes. Finally, we shall also present the futuristic perspectives for an eventual direct detection of cosmic, relic neutrinos.


title: Energy dependence of Quasi-periodic oscillations in accreting X-ray pulsars

abstract: We present the results from an investigation of the energy dependence of Quasi-Periodic Oscillations (QPOs) exhibited by accreting X-ray pulsars using data from archival \textit{XMM-Newton}, \textit{NuSTAR}, \textit{RXTE}, and \textit{NICER} observations. In a search for the presence of QPOs in 99 \textit{XMM-Newton} and \textit{NuSTAR} observations, we detected QPOs in eleven observations of five sources, viz., 4U 1626--67 (48 mHz), IGR J19294+1816 (30 mHz), V 0332+53 (2, 18 and 40 mHz), Cen X--3 (30 mHz), and XTE J1858+034 (180 mHz). A positive correlation of the QPO rms amplitude with energy is exhibited by 4U 1626--67, IGR J19294+1816, Cen X--3 and XTE J1858+034, while no energy dependence is observed in V 0332+53. We also analysed the energy spectrum to decouple thermal (soft-excess) from non-thermal emission and determine if the soft-excess has different QPO properties. We found no evidence for different QPO characteristics of the soft excess. The \textit{NuSTAR} observations of V 0332+53 during the Type-I outburst in 2016 show the presence of twin QPOs at 2.5 mHz and 18 mHz, while the \textit{XMM-Newton} and \textit{NuSTAR} observations during the Type-II outburst in 2015 show a QPO at 40 mHz. We review the observed QPO properties in the context of QPOs found in other types of accreting sources and the models usually used to explain the QPOs in accreting X-ray pulsars.


title: The Effect of Data Types' on the Performance of Machine Learning Algorithms for Financial Prediction

abstract: Forecasting cryptocurrencies as a financial issue is crucial as it provides investors with possible financial benefits. A small improvement in forecasting performance can lead to increased profitability; therefore, obtaining a realistic forecast is very important for investors. Successful forecasting provides traders with effective buy-or-hold strategies, allowing them to make more profits. The most important thing in this process is to produce accurate forecasts suitable for real-life applications. Bitcoin, frequently mentioned recently due to its volatility and chaotic behavior, has begun to pay great attention and has become an investment tool, especially during and after the COVID-19 pandemic. This study provided a comprehensive methodology, including constructing continuous and trend data using one and seven years periods of data as inputs and applying machine learning (ML) algorithms to forecast Bitcoin price movement. A binarization procedure was applied using continuous data to construct the trend data representing each input feature trend. Following the related literature, the input features are determined as technical indicators, google trends, and the number of tweets. Random forest (RF), K-Nearest neighbor (KNN), Extreme Gradient Boosting (XGBoost-XGB), Support vector machine (SVM) Naive Bayes (NB), Artificial Neural Networks (ANN), and Long-Short-Term Memory (LSTM) networks were applied on the selected features for prediction purposes. This work investigates two main research questions: i. How does the sample size affect the prediction performance of ML algorithms? ii. How does the data type affect the prediction performance of ML algorithms? Accuracy and area under the ROC curve (AUC) values were used to compare the model performance. A t-test was performed to test the statistical significance of the prediction results.


title: Correcting for confounding in longitudinal experiments: positioning non-linear mixed effects modeling as implementation of standardization using latent conditional exchangeability

abstract: Non-linear mixed effects modeling and simulation (NLME M&S) is evaluated to be used for standardization with longitudinal data in presence of confounders. Standardization is a well-known method in causal inference to correct for confounding by analyzing and combining results from subgroups of patients. We show that non-linear mixed effects modeling is a particular implementation of standardization that conditions on individual parameters described by the random effects of the mixed effects model. Our motivation is that in pharmacometrics NLME M&S is routinely used to analyze clinical trials and to predict and compare potential outcomes of the same patient population under different treatment regimens. Such a comparison is a causal question sometimes referred to as causal prediction. Nonetheless, NLME M&S is rarely positioned as a method for causal prediction. As an example, a simulated clinical trial is used that assumes treatment confounder feedback in which early outcomes can cause deviations from the planned treatment schedule. Being interested in the outcome for the hypothetical situation that patients adhere to the planned treatment schedule, we put assumptions in a causal diagram. From the causal diagram, conditional independence assumptions are derived either using latent conditional exchangeability, conditioning on the individual parameters, or using sequential conditional exchangeability, conditioning on earlier outcomes. Both conditional independencies can be used to estimate the estimand of interest, e.g., with standardization, and they give unbiased estimates.


title: LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation

abstract: Video object segmentation (VOS) aims to distinguish and track target objects in a video. Despite the excellent performance achieved by off-the-shell VOS models, existing VOS benchmarks mainly focus on short-term videos lasting about 5 seconds, where objects remain visible most of the time. However, these benchmarks poorly represent practical applications, and the absence of long-term datasets restricts further investigation of VOS in realistic scenarios. Thus, we propose a novel benchmark named LVOS, comprising 720 videos with 296,401 frames and 407,945 high-quality annotations. Videos in LVOS last 1.14 minutes on average, approximately 5 times longer than videos in existing datasets. Each video includes various attributes, especially challenges deriving from the wild, such as long-term reappearing and cross-temporal similar objects. Compared to previous benchmarks, our LVOS better reflects VOS models' performance in real scenarios. Based on LVOS, we evaluate 20 existing VOS models under 4 different settings and conduct a comprehensive analysis. On LVOS, these models suffer a large performance drop, highlighting the challenge of achieving precise tracking and segmentation in real-world scenarios. Attribute-based analysis indicates that key factor to accuracy decline is the increased video length, emphasizing LVOS's crucial role. We hope our LVOS can advance development of VOS in real scenes. Data and code are available at https://lingyihongfd.github.io/lvos.github.io/.


title: Assessment of physical schemes for WRF model in convection-permitting mode over southern Iberian Peninsula

abstract: Convection-permitting models (CPMs) enable the representation of meteorological variables at horizontal high resolution spatial scales (higher than 4 km), where convection plays a significant role. Physical schemes need to be evaluated considering factors in the studied region such as orography and climate variability. This study investigates the sensitivity of the WRF model as CPM to the use of different physics schemes on Andalusia, a complex orography region in southern Iberian Peninsula (IP). A set of 1-year WRF simulations was completed based on two one-way nested domains: the parent domain (d01) spanning the entire IP with 5 km spatial resolution and the nested domain (d02) for the region of Andalusia at 1 km of spatial resolution. 12 physic schemes were examined from combinations of microphysics (MP) schemes including THOMPSON, WRF single moment 6-class (WSM6), and WRF single moment 7-class (WSM7), and different options for the convection in d01, the Grell 3D (G3), Grell-Freitas (GF), Kain-Fritsch (KF), and deactivated cumulus parameterization (OFF). The simulated precipitation and 2-m temperature for the year 2018, a very wet year, were compared with observational datasets to determine the optimal WRF configuration, including point-to-point and station-point comparisons at different time aggregations. In general, greater differences were shown when comparing the results of convection schemes in d01. Simulations completed with GF or OFF presented better performance compared to the reference datasets. Concerning the MP, although THOMPSON showed a better fit in high mountain areas, it generally presents a worse agreement with the reference datasets. In terms of temperature, the results were very similar and, therefore, the selection of the best configuration was based mainly on the precipitation results with the WSM7-GF scheme being suitable for Andalusia region.


title: Computational Approaches for Integrating out Subjectivity in Cognate Synonym Selection

abstract: Working with cognate data involves handling synonyms, that is, multiple words that describe the same concept in a language. In the early days of language phylogenetics it was recommended to select one synonym only. However, as we show here, binary character matrices, which are used as input for computational methods, do allow for representing the entire dataset including all synonyms. Here we address the question how one can and if one should include all synonyms or whether it is preferable to select synonyms a priori. To this end, we perform maximum likelihood tree inferences with the widely used RAxML-NG tool and show that it yields plausible trees when all synonyms are used as input. Furthermore, we show that a priori synonym selection can yield topologically substantially different trees and we therefore advise against doing so. To represent cognate data including all synonyms, we introduce two types of character matrices beyond the standard binary ones: probabilistic binary and probabilistic multi-valued character matrices. We further show that it is dataset-dependent for which character matrix type the inferred RAxML-NG tree is topologically closest to the gold standard. We also make available a Python interface for generating all of the above character matrix types for cognate data provided in CLDF format.


title: End-to-end information extraction in handwritten documents: Understanding Paris marriage records from 1880 to 1940

abstract: The EXO-POPP project aims to establish a comprehensive database comprising 300,000 marriage records from Paris and its suburbs, spanning the years 1880 to 1940, which are preserved in over 130,000 scans of double pages. Each marriage record may encompass up to 118 distinct types of information that require extraction from plain text. In this paper, we introduce the M-POPP dataset, a subset of the M-POPP database with annotations for full-page text recognition and information extraction in both handwritten and printed documents, and which is now publicly available. We present a fully end-to-end architecture adapted from the DAN, designed to perform both handwritten text recognition and information extraction directly from page images without the need for explicit segmentation. We showcase the information extraction capabilities of this architecture by achieving a new state of the art for full-page Information Extraction on Esposalles and we use this architecture as a baseline for the M-POPP dataset. We also assess and compare how different encoding strategies for named entities in the text affect the performance of jointly recognizing handwritten text and extracting information, from full pages.


title: G2LTraj: A Global-to-Local Generation Approach for Trajectory Prediction

abstract: Predicting future trajectories of traffic agents accurately holds substantial importance in various applications such as autonomous driving. Previous methods commonly infer all future steps of an agent either recursively or simultaneously. However, the recursive strategy suffers from the accumulated error, while the simultaneous strategy overlooks the constraints among future steps, resulting in kinematically infeasible predictions. To address these issues, in this paper, we propose G2LTraj, a plug-and-play global-to-local generation approach for trajectory prediction. Specifically, we generate a series of global key steps that uniformly cover the entire future time range. Subsequently, the local intermediate steps between the adjacent key steps are recursively filled in. In this way, we prevent the accumulated error from propagating beyond the adjacent key steps. Moreover, to boost the kinematical feasibility, we not only introduce the spatial constraints among key steps but also strengthen the temporal constraints among the intermediate steps. Finally, to ensure the optimal granularity of key steps, we design a selectable granularity strategy that caters to each predicted trajectory. Our G2LTraj significantly improves the performance of seven existing trajectory predictors across the ETH, UCY and nuScenes datasets. Experimental results demonstrate its effectiveness. Code will be available at https://github.com/Zhanwei-Z/G2LTraj.


title: Fusing Depthwise and Pointwise Convolutions for Efficient Inference on GPUs

abstract: Depthwise and pointwise convolutions have fewer parameters and perform fewer operations than standard convolutions. As a result, they have become increasingly used in various compact DNNs, including convolutional neural networks (CNNs) and vision transformers (ViTs). However, they have a lower compute-to-memory-access ratio than standard convolutions, making their memory accesses often the performance bottleneck. This paper explores fusing depthwise and pointwise convolutions to overcome the memory access bottleneck. The focus is on fusing these operators on GPUs. The prior art on GPU-based fusion suffers from one or more of the following: (1) fusing either a convolution with an element-wise or multiple non-convolutional operators, (2) not explicitly optimizing for memory accesses, (3) not supporting depthwise convolutions. This paper proposes Fused Convolutional Modules (FCMs), a set of novel fused depthwise and pointwise GPU kernels. FCMs significantly reduce pointwise and depthwise convolutions memory accesses, improving execution time and energy efficiency. To evaluate the trade-offs associated with fusion and determine which convolutions are beneficial to fuse and the optimal FCM parameters, we propose FusePlanner. FusePlanner consists of cost models to estimate the memory accesses of depthwise, pointwise, and FCM kernels given GPU characteristics. Our experiments on three GPUs using representative CNNs and ViTs demonstrate that FCMs save up to 83% of the memory accesses and achieve speedups of up to 3.7x compared to cuDNN. Complete model implementations of various CNNs using our modules outperform TVMs' achieving speedups of up to 1.8x and saving up to two-thirds of the energy.


title: Lower bounds on expressions dependent on functions $\varphi(n)$, $\psi(n)$ and $\sigma(n)$, II

abstract: In this paper we establish lower bounds on several expressions dependent on functions $\varphi(n)$, $\psi(n)$ and $\sigma(n)$.


title: Super-resolution by converting evanescent waves in microsphere to propagating and transfer function from its surface to nano-jet

abstract: The EM waves transmitted through a thin object with fine structures is observed, by microsphere located above the object. While the waves include both evanescent and propagating waves, the high resolution is obtained by the evanescent ones, including the information on the fine structures of the object. Description of this process is divided into two parts: a) The super resolution is analyzed by using Helmholtz equation for the evanescent waves transmitted from the object to the microsphere surface. b) Using boundary condition, the electric fields on the inner surface of the microsphere includes both the evanescent and propagating waves. The transmission of these waves to a nano jet is produced by a transfer function, including convolution between the spatial modes of the evanescent waves with those of the microsphere, which increases the conversion of the evanescent waves to propagating waves, and thus increase the resolution.


title: Multi-Scale Heterogeneity-Aware Hypergraph Representation for Histopathology Whole Slide Images

abstract: Survival prediction is a complex ordinal regression task that aims to predict the survival coefficient ranking among a cohort of patients, typically achieved by analyzing patients' whole slide images. Existing deep learning approaches mainly adopt multiple instance learning or graph neural networks under weak supervision. Most of them are unable to uncover the diverse interactions between different types of biological entities(\textit{e.g.}, cell cluster and tissue block) across multiple scales, while such interactions are crucial for patient survival prediction. In light of this, we propose a novel multi-scale heterogeneity-aware hypergraph representation framework. Specifically, our framework first constructs a multi-scale heterogeneity-aware hypergraph and assigns each node with its biological entity type. It then mines diverse interactions between nodes on the graph structure to obtain a global representation. Experimental results demonstrate that our method outperforms state-of-the-art approaches on three benchmark datasets. Code is publicly available at \href{https://github.com/Hanminghao/H2GT}{https://github.com/Hanminghao/H2GT}.


title: StablePT: Towards Stable Prompting for Few-shot Learning via Input Separation

abstract: Large language models have shown their ability to become effective few-shot learners with prompting, revoluting the paradigm of learning with data scarcity. However, this approach largely depends on the quality of prompt initialization, and always exhibits large variability among different runs. Such property makes prompt tuning highly unreliable and vulnerable to poorly constructed prompts, which limits its extension to more real-world applications. To tackle this issue, we propose to treat the hard prompt and soft prompt as separate inputs to mitigate noise brought by the prompt initialization. Furthermore, we optimize soft prompts with contrastive learning for utilizing class-aware information in the training process to maintain model performance. Experimental results demonstrate that \sysname outperforms state-of-the-art methods by 7.20% in accuracy and reduces the standard deviation by 2.02 on average. Furthermore, extensive experiments underscore its robustness and stability across 7 datasets covering various tasks.


title: Improving LLM Classification of Logical Errors by Integrating Error Relationship into Prompts

abstract: LLMs trained in the understanding of programming syntax are now providing effective assistance to developers and are being used in programming education such as in generation of coding problem examples or providing code explanations. A key aspect of programming education is understanding and dealing with error message. However, 'logical errors' in which the program operates against the programmer's intentions do not receive error messages from the compiler. In this study, building on existing research on programming errors, we first define the types of logical errors that can occur in programming in general. Based on the definition, we propose an effective approach for detecting logical errors with LLMs that makes use of relations among error types in the Chain-of-Thought and Tree-of-Thought prompts. The experimental results indicate that when such logical error descriptions in the prompt are used, the average classifition performance is about 21% higher than the ones without them. We also conducted an experiment for exploiting the relations among errors in generating a new logical error dataset using LLMs. As there is very limited dataset for logical errors such benchmark dataset can be very useful for various programming related applications. We expect that our work can assist novice programmers in identifying the causes of code errors and correct them more effectively.


title: Design of a Representation Information Repository for the Long-Term Usability of Digital Building Documents

abstract: The long-term usability of digital building documents is essential for the maintenance and optimization of infrastructure portfolios. It supports the preservation of building-specific knowledge and the cultural heritage hidden within. However, having to do this throughout the lifecycle of a building - or even indefinitely - remains a major challenge. This is especially true for organizations responsible for large collections of digital building documents, such as public administrations or archives. In this article, we first describe the challenges and requirements associated with preservation tasks, and then introduce the concept of so-called representation information within BIM (Building Information Modeling). This type of information is important to give meaning to the stored bit sequences for a particular community. Then, we design a repository for representation information and introduce some so-called 23 BIMcore content elements. Finally, we focus on BIM and the construction sector and explain how the proposed repository can be used to implement the two concepts introduced in the ISO reference model OAIS (Open Archival Information System), namely the representation information and the context information, as well as the concept of significant properties, which has not yet been explicitly modeled in OAIS.


title: NMSSM Explanation for Excesses in the Search for Neutralinos and Charginos and a 95 GeV Higgs Boson

abstract: The observed excesses in the search for neutralinos and charginos by ATLAS and CMS can be fitted simultaneously in the minimal supersymmetric standard model (MSSM) assuming a light higgsino mass, of magnitude less than about 250 GeV, and a compressed higgsino dominated neutralino and chargino spectrum, with $5-10\%$ mass splittings. However, light higgsinos as dark matter would have far too large direct detection cross sections. We consider the next-to-MSSM (NMSSM) with an additional singlino-like lightest supersymmetric particle (LSP) a few GeV below the next-to-lightest supersymmetric particle (NLSP). Sparticles prefer to decay first into the NLSP and remnants from the final decay into the LSP are too soft to contribute to the observed signals. Co-annihilation in the higgsino-sector can generate a relic density in the WMAP/Planck window. The singlino-like LSP has automatically a direct detection cross section below present and future sensitivities: a direct detection signal in the near future would exclude this scenario. The singlet-like Higgs scalar of the NMSSM can have a mass around 95 GeV and signal cross sections in the $b\bar{b}$ channel at LEP and in the $\gamma\gamma$ channel at the LHC compatible with the respective observations.


title: First-order rhombohedral to cubic phase transition in photoexcited GeTe

abstract: Photoexcited GeTe undergoes a non-thermal phase transition from a rhombohedral to a rocksalt crystalline phase. The microscopic mechanism and the nature of the transition are unclear. By using constrained density functional perturbation theory and by accounting for quantum anharmonicity within the stochastic self-consistent harmonic approximation, we show that the non-thermal phase transition is strongly first order and does not involve phonon softening, at odd with the thermal one. The transition is driven by the closure of the single particle gap in the photoexcited rhombohedral phase. Finally, we show that ultrafast X-ray diffraction data are consistent with a coexistence of the two phases, as expected in a first order transition. Our results are relevant for the understanding of phase transitions and bonding in phase change materials.


title: Revisiting the Constraint on Equation of State of Neutron Star based on the Binary Neutron Star Mergers

abstract: The merger of neutron star (NS)-NS binary can form different production of the compact remnant, among which the supramassive NS (SMNS) could create an internal plateau and the followed steep decay marks the collapse of the SMNS. The proportion of SMNS and the corresponding collapse-time are often used to constrain the NS equation of state (EoS). This paper revisits this topic by considering the effect of an accretion disk on the compact remnant, which is not considered in previous works. Compared with previous works, the collapse-time distribution (peaks $\sim$100 s) of the SMNSs formed from NS-NS merger is almost unaffected by the initial surface magnetic ($B_{{\rm s},i}$) of NS, but the total energy output of the magnetic dipole radiation from the SMNSs depends on $B_{{\rm s},i}$ significantly. Coupling the constraints from the SMNS fraction, we exclude some EoSs and obtain three candidate EoSs, i.e., DD2, ENG, and MPA1. By comparing the distributions of the collapse-time and the luminosity of the internal plateau (in the short gamma-ray bursts) for those from observations with those obtained based on the three candidate EoSs, it is shown that only the EoS of ENG is favored. Our sample based on the ENG EOS and a mass distribution motivated by Galactic systems suggests that approximately $99\%$ of NS-NS mergers collapse to form a black hole within $10^7$s. This includes scenarios forming a BH promptly ($36.5\%$), a SMNS ($60.7\%$), or a stable NS that transitions into a BH or a SMNS following accretion ($2.1\%$). It also indicates that the remnants for GW170817 and GW190425, and the second object of GW190814 are more likely to be BHs.


title: Reliable or Deceptive? Investigating Gated Features for Smooth Visual Explanations in CNNs

abstract: Deep learning models have achieved remarkable success across diverse domains. However, the intricate nature of these models often impedes a clear understanding of their decision-making processes. This is where Explainable AI (XAI) becomes indispensable, offering intuitive explanations for model decisions. In this work, we propose a simple yet highly effective approach, ScoreCAM++, which introduces modifications to enhance the promising ScoreCAM method for visual explainability. Our proposed approach involves altering the normalization function within the activation layer utilized in ScoreCAM, resulting in significantly improved results compared to previous efforts. Additionally, we apply an activation function to the upsampled activation layers to enhance interpretability. This improvement is achieved by selectively gating lower-priority values within the activation layer. Through extensive experiments and qualitative comparisons, we demonstrate that ScoreCAM++ consistently achieves notably superior performance and fairness in interpreting the decision-making process compared to both ScoreCAM and previous methods.


title: Small Instanton Effects on Composite Axion Mass

abstract: This paper investigates the impact of small instanton effects on the axion mass in the composite accidental axion (CAA) models. These models are designed to address the axion quality problem, where QCD gauge symmetry is embedded as an unbroken diagonal subgroup of a product gauge group. These models contain small instantons not included in low-energy QCD, which could enhance the axion mass significantly. However, in the CAA models, our analysis reveals that these effects on the axion mass are non-vanishing but are negligible compared to the QCD effects. This highlights the important role of anomalous but non-spontaneously broken U(1) symmetries in restricting the impact of small instantons on the axion mass. Our study provides crucial insights into the dynamics within CAA models and suggests broader implications for understanding small instanton effects in other composite axion models.


title: Quantum Modelling of Magnetism in Strongly Correlated Materials: Evaluating Constrained DFT and LDA+$U$+$J$ for Y114

abstract: Transition-metal compounds represent a fascinating playground for exploring the intricate relationship between structural distortions, electronic properties, and magnetic behaviour, holding significant promise for technological advancements. Among these compounds, YBaCo$_4$O$_{7}$ (Y114) is attractive due to its manifestation of a ferrimagnetic component at low temperature intertwined with distortion effect due to the charge disproportionation on Co ions, exerting profound impact on its magnetic properties. In this perspective paper, we study the structural and magnetic intricacies of the Y114 crystal. Traditionally, the investigation of such materials has relied heavily on computational modelling using density-functional theory (DFT) with the on-site Coulomb interaction correction $U$ (DFT+$U$) based on the Hubbard model (sometimes including Hund's exchange coupling parameter $J$, DFT+$U$+$J$) to unravel their complexities. Herein, we analysed the spurious effects of magnetic-moment delocalisation and spillover to non-magnetic ions in the lattice on electronic structure and magnetic properties of Y114. To overcome this problem we have applied constrained DFT (cDFT) based on the potential self-consistency approach, and comprehensively explore the Y114 crystal's characteristics in its ferrimagnetic order. We find that cDFT yields magnetic moments of Co ions much closer to the experimental values than LDA+$U$+$J$ with the parameters $U$ and $J$ fitted to reproduce experimental lattice constants. cDFT allows for an accurate prediction of magnetic properties using oxidation states of magnetic ions as well-defined parameters. Through this perspective, we not only enhance our understanding of the magnetic interactions in Y114 crystal, but also pave the way for future investigations into magnetic materials.


title: Data-adaptive structural change-point detection via isolation

abstract: In this paper, a new data-adaptive method, called DAIS (Data Adaptive ISolation), is introduced for the estimation of the number and the location of change-points in a given data sequence. The proposed method can detect changes in various different signal structures; we focus on the examples of piecewise-constant and continuous, piecewise-linear signals. We highlight, however, that our algorithm can be extended to other frameworks, such as piecewise-quadratic signals. The data-adaptivity of our methodology lies in the fact that, at each step, and for the data under consideration, we search for the most prominent change-point in a targeted neighborhood of the data sequence that contains this change-point with high probability. Using a suitably chosen contrast function, the change-point will then get detected after being isolated in an interval. The isolation feature enhances estimation accuracy, while the data-adaptive nature of DAIS is advantageous regarding, mainly, computational complexity and accuracy. The simulation results presented indicate that DAIS is at least as accurate as state-of-the-art competitors.


title: Connecting physics to systems with modular spin-circuits

abstract: An emerging paradigm in modern electronics is that of CMOS + $\sf X$ requiring the integration of standard CMOS technology with novel materials and technologies denoted by $\sf X$. In this context, a crucial challenge is to develop accurate circuit models for $\sf X$ that are compatible with standard models for CMOS-based circuits and systems. In this perspective we present physics-based, experimentally benchmarked modular circuit models that can be used to evaluate a class of CMOS + $\sf X$ systems, where $\sf X$ denotes magnetic and spintronic materials and phenomena. This class of materials is particularly challenging because they go beyond conventional charge-based phenomena and involve the spin degree of freedom which involves non-trivial quantum effects. Starting from density matrices $-$ the central quantity in quantum transport $-$ using well-defined approximations, it is possible to obtain spin-circuits that generalize ordinary circuit theory to 4-component currents and voltages (1 for charge and 3 for spin). With step-by-step examples that progressively go higher in the computing stack, we illustrate how the spin-circuit approach can be used to start from the physics of magnetism and spintronics to enable accurate system-level evaluations. We believe the core approach can be extended to include other quantum degrees of freedom like valley and pseudospins starting from corresponding density matrices.


title: Pessimistic Value Iteration for Multi-Task Data Sharing in Offline Reinforcement Learning

abstract: Offline Reinforcement Learning (RL) has shown promising results in learning a task-specific policy from a fixed dataset. However, successful offline RL often relies heavily on the coverage and quality of the given dataset. In scenarios where the dataset for a specific task is limited, a natural approach is to improve offline RL with datasets from other tasks, namely, to conduct Multi-Task Data Sharing (MTDS). Nevertheless, directly sharing datasets from other tasks exacerbates the distribution shift in offline RL. In this paper, we propose an uncertainty-based MTDS approach that shares the entire dataset without data selection. Given ensemble-based uncertainty quantification, we perform pessimistic value iteration on the shared offline dataset, which provides a unified framework for single- and multi-task offline RL. We further provide theoretical analysis, which shows that the optimality gap of our method is only related to the expected data coverage of the shared dataset, thus resolving the distribution shift issue in data sharing. Empirically, we release an MTDS benchmark and collect datasets from three challenging domains. The experimental results show our algorithm outperforms the previous state-of-the-art methods in challenging MTDS problems. See https://github.com/Baichenjia/UTDS for the datasets and code.


title: The influence of non-Newtonian behaviors of blood on the hemodynamics past a bileaflet mechanical heart valve

abstract: This study employs extensive three-dimensional direct numerical simulations (DNS) to investigate the influence of blood non-Newtonian behaviors on the hemodynamics around a bileaflet mechanical heart valve under both steady inflow and physiologically realistic pulsatile flow conditions. Under steady inflow conditions, the study reveals that blood rheology impacts velocity and pressure field variations, as well as the values of clinically important surface and time-averaged parameters like wall shear stress (WSS) and pressure recovery. Notably, this influence is most pronounced at low Reynolds numbers, gradually diminishing as the Reynolds number increases. For instance, surface-averaged WSS values obtained with the non-Newtonian shear-thinning power-law model exceed those obtained with the Newtonian model. At $Re = 750$, this difference reaches around 67\%, reducing to less than 1\% at $Re = 5000$. Correspondingly, pressure recovery downstream of the valve leaflets is lower for the shear-thinning blood than the constant viscosity one, with the difference decreasing as the Reynolds number increases. On the other hand, in pulsatile flow conditions, jets formed between the leaflets and the valve housing wall are shorter than steady inflow conditions. Additionally, surface-averaged wall shear stress and blood damage (BD) parameter values are higher (with differences more than 13\% and 47\%, respectively) during the peak stage of the cardiac cycle, especially for blood exhibiting non-Newtonian yield stress characteristics compared to the shear-thinning or constant viscosity characteristics. Therefore, blood non-Newtonian behaviors, including shear-thinning and yield stress behaviors, exert a considerable influence on the hemodynamics around a mechanical heart valve.


title: Quasi-determinant and right eigenvalues of dual quaternion matrices

abstract: Dual quaternion/complex matrices have important applications in brain science and multi-agent formation control. In this paper, we first study some basic properties of determinants of dual complex matrices, including Sturm theorem and Bloomfield-Watson inequality for dual complex matrices. Then, we show that every eigenvalue of a dual complex matrix must be the root of the characteristic polynomial of this matrix. With the help of the determinants of dual complex matrices, we introduce the concept of quasi-determinants of dual quaternion matrices, and show that every right eigenvalue of a dual quaternion matrix must be the root of the quasi-characteristic polynomial of this matrix, as well as the quasi-determinant of a dual quaternion Hermitian matrix is equivalent to the product of the square of the magnitudes of all eigenvalues. Our results are helpful for the further study of dual quaternion matrix theory, and their applications.


title: Human-AI Interaction in Industrial Robotics: Design and Empirical Evaluation of a User Interface for Explainable AI-Based Robot Program Optimization

abstract: While recent advances in deep learning have demonstrated its transformative potential, its adoption for real-world manufacturing applications remains limited. We present an Explanation User Interface (XUI) for a state-of-the-art deep learning-based robot program optimizer which provides both naive and expert users with different user experiences depending on their skill level, as well as Explainable AI (XAI) features to facilitate the application of deep learning methods in real-world applications. To evaluate the impact of the XUI on task performance, user satisfaction and cognitive load, we present the results of a preliminary user survey and propose a study design for a large-scale follow-up study.


title: Transform Dialect Tutorial

abstract: Transform Dialect in MLIR provides operations that can be used to control transformation of the Intermediate Representation (IR) using a different portion of the IR. It refers to the IR being transformed as payload IR, and to the IR guiding the transformation as transform IR. The main use case for this dialect is orchestrating fine-grain transformations on individual IR objects (operations or values) or sets thereof. For example, it may involve finding loop-like operations with specific properties (e.g., large size) in the payload IR, applying loop tiling to those and only those operations, and then applying loop unrolling to the inner loops produced by the previous transformations. As such, it is not intended as a replacement for the pass infrastructure, nor for the pattern rewriting infrastructure. In the most common case, the transform IR will be processed and applied to the payload IR by a pass. Transformations expressed by the Transform dialect may be implemented using the pattern infrastructure or any other relevant MLIR component. The rest of this document explains the main concepts and usage scenario of the MLIR Transform Dialect combined with structured operations.


title: Deep Learning Forecasts Caldera Collapse Events at Kilauea Volcano

abstract: During the three month long eruption of Kilauea volcano, Hawaii in 2018, the pre-existing summit caldera collapsed in over 60 quasi-periodic failure events. The last 40 of these events, which generated Mw >5 very long period (VLP) earthquakes, had inter-event times between 0.8 - 2.2 days. These failure events offer a unique dataset for testing methods for predicting earthquake recurrence based on locally recorded GPS, tilt, and seismicity data. In this work, we train a deep learning graph neural network (GNN) to predict the time-to-failure of the caldera collapse events using only a fraction of the data recorded at the start of each cycle. We find that the GNN generalizes to unseen data and can predict the time-to-failure to within a few hours using only 0.5 days of data, substantially improving upon a null model based only on inter-event statistics. Predictions improve with increasing input data length, and are most accurate when using high-SNR tilt-meter data. Applying the trained GNN to synthetic data with different magma pressure decay times predicts failure at a nearly constant stress threshold, revealing that the GNN is sensing the underling physics of caldera collapse. These findings demonstrate the predictability of caldera collapse sequences under well monitored conditions, and highlight the potential of machine learning methods for forecasting real world catastrophic events with limited training data.


title: Aluminum nuclear demagnetization refrigerator for powerful continuous cooling

abstract: Many laboratories routinely cool samples to 10 mK, but relatively few can cool condensed matter below 1 mK. Easy access to the microkelvin range would propel fields such as quantum sensors and quantum materials. Such temperatures are achieved with adiabatic nuclear demagnetization. Existing nuclear demagnetization refrigerators (NDR) are "single-shot", and the recycling time is incompatible with proposed sub-mK experiments. Furthermore, a high cooling power is required to overcome the excess heat load of order nW on NDR pre-cooled by cryogen-free dilution refrigerators. We report the performance of an aluminum NDR designed for powerful cooling when part of a dual stage continuous NDR (CNDR). Its thermal resistance is minimized to maximize the cycling rate of the CNDR and consequently its cooling power. At the same time, its susceptibility to eddy current heating is minimized. A CNDR based on two of the aluminum NDR presented here would have a cooling power of approximately 40 nW at 560 $\mu$K.


title: A coupled fluid-dynamics-heat transfer model for 3D simulations of the aqueous humor flow in the human eye

abstract: Understanding human eye behavior involves intricate interactions between physical phenomena such as heat transfer and fluid dynamics. Accurate computational models are vital for comprehending ocular diseases and therapeutic interventions.This work focuses on modeling and simulating aqueous humor flow in the anterior and posterior chambers of the eye, coupled with overall heat transfer.Aqueous humor dynamics regulates intraocular pressure, crucial for understanding conditions like glaucoma.Convective effects from temperature disparities also influence this flow.Extending prior research, this work develops a comprehensive three-dimensional computational model to simulate coupled fluid-dynamic-heat transfer model, thus contributing to the understanding of ocular physiology.


title: PEFSL: A deployment Pipeline for Embedded Few-Shot Learning on a FPGA SoC

abstract: This paper tackles the challenges of implementing few-shot learning on embedded systems, specifically FPGA SoCs, a vital approach for adapting to diverse classification tasks, especially when the costs of data acquisition or labeling prove to be prohibitively high. Our contributions encompass the development of an end-to-end open-source pipeline for a few-shot learning platform for object classification on a FPGA SoCs. The pipeline is built on top of the Tensil open-source framework, facilitating the design, training, evaluation, and deployment of DNN backbones tailored for few-shot learning. Additionally, we showcase our work's potential by building and deploying a low-power, low-latency demonstrator trained on the MiniImageNet dataset with a dataflow architecture. The proposed system has a latency of 30 ms while consuming 6.2 W on the PYNQ-Z1 board.


title: Statistical Theory of Neutron-Induced Nuclear Fission and of Heavy-Ion Fusion

abstract: For both reactions we use an approach similar to that of compound-nucleus reaction theory. For neutron-induced fission, we describe the compound system generated by absorption of the neutron and the nuclear system near the scission point as two statistically independent systems governed by random-matrix theory. The systems are connected either by a barrier penetration factor or by a set of transition states above the barrier. Each system is coupled to a different set of channels. An analogous model is used for heavy-ion fusion. Assuming that (seen from the entrance channel) the system on the other side of the barrier is in the regime of strongly overlapping resonances, we obtain for fixed spin and parity closed-form analytical expressions for the total probability for fission and for fusion. Parts of these expressions can be calculated reliably within existing compound-nucleus reaction theory. The remaining parts are the probabilities for passage through or over the barrier. These may be determined theoretically from the liquid-drop model or experimentally from total fission or fusion cross sections.


title: A Concept for Semi-Automatic Configuration of Sufficiently Valid Simulation Setups for Automated Driving Systems

abstract: As simulation is increasingly used in scenario-based approaches to test Automated Driving Systems, the credibility of simulation results is a major concern. Arguably, credibility depends on the validity of the simulation setup and simulation models. When selecting appropriate simulation models, a trade-off must be made between validity, often connected to the model's fidelity, and cost of computation. However, due to the large number of test cases, expert-based methods to create sufficiently valid simulation setups seem infeasible. We propose using design contracts in order to semi-automatically compose simulation setups for given test cases from simulation models and to derive requirements for the simulation models, supporting separation of concerns between simulation model developers and users. Simulation model contracts represent their validity domains by capturing a validity guarantee and the associated operating conditions in an assumption. We then require the composition of the simulation model contracts to refine a test case contract. The latter contract captures the operating conditions of the test case in its assumption and validity requirements in its guarantee. Based on this idea, we present a framework that supports the compositional configuration of simulation setups based on the contracts and a method to derive runtime monitors for these simulation setups.


title: Interest Clock: Time Perception in Real-Time Streaming Recommendation System

abstract: User preferences follow a dynamic pattern over a day, e.g., at 8 am, a user might prefer to read news, while at 8 pm, they might prefer to watch movies. Time modeling aims to enable recommendation systems to perceive time changes to capture users' dynamic preferences over time, which is an important and challenging problem in recommendation systems. Especially, streaming recommendation systems in the industry, with only available samples of the current moment, present greater challenges for time modeling. There is still a lack of effective time modeling methods for streaming recommendation systems. In this paper, we propose an effective and universal method Interest Clock to perceive time information in recommendation systems. Interest Clock first encodes users' time-aware preferences into a clock (hour-level personalized features) and then uses Gaussian distribution to smooth and aggregate them into the final interest clock embedding according to the current time for the final prediction. By arming base models with Interest Clock, we conduct online A/B tests, obtaining +0.509% and +0.758% improvements on user active days and app duration respectively. Besides, the extended offline experiments show improvements as well. Interest Clock has been deployed on Douyin Music App.


title: QML-IB: Quantized Collaborative Intelligence between Multiple Devices and the Mobile Network

abstract: The integration of artificial intelligence (AI) and mobile networks is regarded as one of the most important scenarios for 6G. In 6G, a major objective is to realize the efficient transmission of task-relevant data. Then a key problem arises, how to design collaborative AI models for the device side and the network side, so that the transmitted data between the device and the network is efficient enough, which means the transmission overhead is low but the AI task result is accurate. In this paper, we propose the multi-link information bottleneck (ML-IB) scheme for such collaborative models design. We formulate our problem based on a novel performance metric, which can evaluate both task accuracy and transmission overhead. Then we introduce a quantizer that is adjustable in the quantization bit depth, amplitudes, and breakpoints. Given the infeasibility of calculating our proposed metric on high-dimensional data, we establish a variational upper bound for this metric. However, due to the incorporation of quantization, the closed form of the variational upper bound remains uncomputable. Hence, we employ the Log-Sum Inequality to derive an approximation and provide a theoretical guarantee. Based on this, we devise the quantized multi-link information bottleneck (QML-IB) algorithm for collaborative AI models generation. Finally, numerical experiments demonstrate the superior performance of our QML-IB algorithm compared to the state-of-the-art algorithm.


title: Evaluating Lexicon Incorporation for Depression Symptom Estimation

abstract: This paper explores the impact of incorporating sentiment, emotion, and domain-specific lexicons into a transformer-based model for depression symptom estimation. Lexicon information is added by marking the words in the input transcripts of patient-therapist conversations as well as in social media posts. Overall results show that the introduction of external knowledge within pre-trained language models can be beneficial for prediction performance, while different lexicons show distinct behaviours depending on the targeted task. Additionally, new state-of-the-art results are obtained for the estimation of depression level over patient-therapist interviews.


title: Large Language Model Informed Patent Image Retrieval

abstract: In patent prosecution, image-based retrieval systems for identifying similarities between current patent images and prior art are pivotal to ensure the novelty and non-obviousness of patent applications. Despite their growing popularity in recent years, existing attempts, while effective at recognizing images within the same patent, fail to deliver practical value due to their limited generalizability in retrieving relevant prior art. Moreover, this task inherently involves the challenges posed by the abstract visual features of patent images, the skewed distribution of image classifications, and the semantic information of image descriptions. Therefore, we propose a language-informed, distribution-aware multimodal approach to patent image feature learning, which enriches the semantic understanding of patent image by integrating Large Language Models and improves the performance of underrepresented classes with our proposed distribution-aware contrastive losses. Extensive experiments on DeepPatent2 dataset show that our proposed method achieves state-of-the-art or comparable performance in image-based patent retrieval with mAP +53.3%, Recall@10 +41.8%, and MRR@10 +51.9%. Furthermore, through an in-depth user analysis, we explore our model in aiding patent professionals in their image retrieval efforts, highlighting the model's real-world applicability and effectiveness.


title: A Negotiator's Backup Plan: Optimal Concessions with a Reservation Value

abstract: Automated negotiation is a well-known mechanism for autonomous agents to reach agreements. To realize beneficial agreements quickly, it is key to employ a good bidding strategy. When a negotiating agent has a good back-up plan, i.e., a high reservation value, failing to reach an agreement is not necessarily disadvantageous. Thus, the agent can adopt a risk-seeking strategy, aiming for outcomes with a higher utilities. Accordingly, this paper develops an optimal bidding strategy called MIA-RVelous for bilateral negotiations with private reservation values. The proposed greedy algorithm finds the optimal bid sequence given the agent's beliefs about the opponent in $O(n^2D)$ time, with $D$ the maximum number of rounds and $n$ the number of outcomes. The results obtained here can pave the way to realizing effective concurrent negotiations, given that concurrent negotiations can serve as a (probabilistic) backup plan.


title: Global solution for the stochastic nonlinear Schr\"odinger system with quadratic interaction in four dimensions

abstract: We discuss the global existence of solutions to a system of stochastic Schr\"odinger equations with multiplicative noise. Our setting of the quadratic nonlinear terms in dimension 4 is $L^2$-critical. We treat the solutions under the ground state. We estimate the time derivative of the quantity of energy by using the cancellation of the cubic terms in the spatial derivative of the solution.


title: Expressivity and Speech Synthesis

abstract: Imbuing machines with the ability to talk has been a longtime pursuit of artificial intelligence (AI) research. From the very beginning, the community has not only aimed to synthesise high-fidelity speech that accurately conveys the semantic meaning of an utterance, but also to colour it with inflections that cover the same range of affective expressions that humans are capable of. After many years of research, it appears that we are on the cusp of achieving this when it comes to single, isolated utterances. This unveils an abundance of potential avenues to explore when it comes to combining these single utterances with the aim of synthesising more complex, longer-term behaviours. In the present chapter, we outline the methodological advances that brought us so far and sketch out the ongoing efforts to reach that coveted next level of artificial expressivity. We also discuss the societal implications coupled with rapidly advancing expressive speech synthesis (ESS) technology and highlight ways to mitigate those risks and ensure the alignment of ESS capabilities with ethical norms.


title: Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models

abstract: Neural language models, particularly large-scale ones, have been consistently proven to be most effective in predicting brain neural activity across a range of studies. However, previous research overlooked the comparison of these models with psychologically plausible ones. Moreover, evaluations were reliant on limited, single-modality, and English cognitive datasets. To address these questions, we conducted an analysis comparing encoding performance of various neural language models and psychologically plausible models. Our study utilized extensive multi-modal cognitive datasets, examining bilingual word and discourse levels. Surprisingly, our findings revealed that psychologically plausible models outperformed neural language models across diverse contexts, encompassing different modalities such as fMRI and eye-tracking, and spanning languages from English to Chinese. Among psychologically plausible models, the one incorporating embodied information emerged as particularly exceptional. This model demonstrated superior performance at both word and discourse levels, exhibiting robust prediction of brain activation across numerous regions in both English and Chinese.


title: Nonlocal electrodynamics and the penetration depth of superconducting Sr$_2$RuO$_4$

abstract: The thermal quasiparticles in a clean type-II superconductor with line nodes give rise to a quadratic low-temperature change of the penetration depth, $\Delta \lambda \sim T^2$, as first shown by Kosztin and Leggett [I. Kosztin and A. J. Leggett, Phys. Rev. Lett. 79, 135 (1997)]. Here, we generalize this result to multiple nodes and compare it to numerically exact evaluations of the temperature-dependent penetration depth in Sr$_2$RuO$_4$ using a high-precision tight-binding model. We compare the calculations to recent penetration depth measurements in high purity single crystals of Sr$_2$RuO$_4$ [J. F. Landaeta et al., arXiv:2312.05129]. When assuming the order parameter to have $\mathrm{B}_{1\mathrm{g}}$ symmetry, we find that both a simple $d_{x^2-y^2}$-wave and complicated gap structures with contributions from higher harmonics and accidental nodes can accommodate the experimental data.


title: Toward thermoelectric characterization of (nano)materials by in situ transmission electron microscopy

abstract: We explore the possibility to perform an in situ transmission electron microscopy (TEM) thermoelectric characterization of materials. A differential heating element on a custom in situ TEM microchip allows to generate a temperature gradient across the studied materials, which are simultaneously measured electrically. A thermovoltage was induced in all studied devices, whose sign corresponds to the sign of the Seebeck coefficient of the tested materials. The results indicate that in situ thermoelectric TEM studies can help to profoundly understand the interplay between the thermoelectric properties on one side and the structure/composition of the materials down to the atomic level on the other side, including grain boundaries, dopants or crystal defects. We propose an improved in situ TEM microchip design, which should facilitate a full quantitative measurement of the induced temperature gradient, the electrical and thermal conductivities, as well as the Seebeck coefficient.


title: Parametric estimation and LAN property of the birth-death-move process with mutations

abstract: A birth-death-move process with mutations is a Markov model for a system of marked particles in interaction, that move over time, with births and deaths. In addition the mark of each particle may also change, which constitutes a mutation. Assuming a parametric form for this model, we derive its likelihood expression and prove its local asymptotic normality. The efficiency and asymptotic distribution of the maximum likelihood estimator, with an explicit expression of its covariance matrix, is deduced. The underlying technical assumptions are showed to be satisfied by several natural parametric specifications. As an application, we leverage this model to analyse the joint dynamics of two types of proteins in a living cell, that are involved in the exocytosis process. Our approach enables to quantify the so-called colocalization phenomenon, answering an important question in microbiology.


title: Exploring Multi-Lingual Bias of Large Code Models in Code Generation

abstract: Code generation aims to synthesize code and fulfill functional requirements based on natural language (NL) specifications, which can greatly improve development efficiency. In the era of large language models (LLMs), large code models (LCMs) have been recently proposed to generate source code. LCMs can generate highly feasible solutions for programming problems described in natural language. Despite the effectiveness, we observe a noticeable multilingual bias in the generation performance of LCMs. Specifically, LCMs demonstrate proficiency in generating solutions when provided with instructions in English, yet may falter when faced with semantically equivalent instructions in other NLs such as Chinese. Moreover, the ability of LCMs to generate code exhibits variety across different programming languages (PLs), such as Python and C++. The observed phenomenon indicates the presence of multi-lingual bias within the generative capabilities of LCMs, which has remained unexplored. In this paper, we aim to investigate the multi-lingual bias that exists in current LCMs. First, we initiate our investigation by constructing the first multi-lingual evaluation benchmark X-HumanEval-X, enabling us to systematically evaluate the extent of multi-lingual bias that exists in current LCMs. In our large-scale experiments on nine popular LCMs, we observe a pronounced multi-lingual bias of LCMs in code generation, including multi-NL and multi-PL bias. Specifically, when using Chinese instructions, the code generation capabilities of LCMs decrease by at least 13% in terms of the Pass@1 metric. Furthermore, LCMs perform variously across different programming languages, e.g., the performance gap between Python and C++ reaches as high as 20.9%. ...


title: Evaluating Telugu Proficiency in Large Language Models_ A Comparative Analysis of ChatGPT and Gemini

abstract: The growing prominence of large language models (LLMs) necessitates the exploration of their capabilities beyond English. This research investigates the Telugu language proficiency of ChatGPT and Gemini, two leading LLMs. Through a designed set of 20 questions encompassing greetings, grammar, vocabulary, common phrases, task completion, and situational reasoning, the study delves into their strengths and weaknesses in handling Telugu. The analysis aims to identify the LLM that demonstrates a deeper understanding of Telugu grammatical structures, possesses a broader vocabulary, and exhibits superior performance in tasks like writing and reasoning. By comparing their ability to comprehend and use everyday Telugu expressions, the research sheds light on their suitability for real-world language interaction. Furthermore, the evaluation of adaptability and reasoning capabilities provides insights into how each LLM leverages Telugu to respond to dynamic situations. This comparative analysis contributes to the ongoing discussion on multilingual capabilities in AI and paves the way for future research in developing LLMs that can seamlessly integrate with Telugu-speaking communities.


title: Numeric Reward Machines

abstract: Reward machines inform reinforcement learning agents about the reward structure of the environment and often drastically speed up the learning process. However, reward machines only accept Boolean features such as robot-reached-gold. Consequently, many inherently numeric tasks cannot profit from the guidance offered by reward machines. To address this gap, we aim to extend reward machines with numeric features such as distance-to-gold. For this, we present two types of reward machines: numeric-Boolean and numeric. In a numeric-Boolean reward machine, distance-to-gold is emulated by two Boolean features distance-to-gold-decreased and robot-reached-gold. In a numeric reward machine, distance-to-gold is used directly alongside the Boolean feature robot-reached-gold. We compare our new approaches to a baseline reward machine in the Craft domain, where the numeric feature is the agent-to-target distance. We use cross-product Q-learning, Q-learning with counter-factual experiences, and the options framework for learning. Our experimental results show that our new approaches significantly outperform the baseline approach. Extending reward machines with numeric features opens up new possibilities of using reward machines in inherently numeric tasks.


title: Fairness in AI: challenges in bridging the gap between algorithms and law

abstract: In this paper we examine algorithmic fairness from the perspective of law aiming to identify best practices and strategies for the specification and adoption of fairness definitions and algorithms in real-world systems and use cases. We start by providing a brief introduction of current anti-discrimination law in the European Union and the United States and discussing the concepts of bias and fairness from an legal and ethical viewpoint. We then proceed by presenting a set of algorithmic fairness definitions by example, aiming to communicate their objectives to non-technical audiences. Then, we introduce a set of core criteria that need to be taken into account when selecting a specific fairness definition for real-world use case applications. Finally, we enumerate a set of key considerations and best practices for the design and employment of fairness methods on real-world AI applications


title: AutoNet: Automatic Reachability Policy Management in Public Cloud Networks

abstract: Virtual Private Cloud (VPC) is the main network abstraction technology used in public cloud systems. VPCs are composed of a set of network services that permit the definition of complex network reachability properties among internal and external cloud entities such as tenants' VMs or some generic internet nodes. Although hiding the underlying complexity through a comprehensible abstraction layer, manually enforcing particular reachability intents in VPC networks is still notably error-prone and complex. In this paper, we propose AutoNet, a new model for assisting cloud tenants in managing reachability-based policies in VPC networks. AutoNet is capable of safely generating incremental VPC configurations while satisfying some metric-based high-level intent defined by the tenants. To achieve this goal, we leverage a MaxSAT-based encoding of the network configuration combined with several optimizations to scale to topologies with thousands of nodes. Our results show that the developed system is capable of achieving a sub-second response time for production VPC deployments while still providing fine-grained control over the generated configurations.


title: Entanglement Signature of the Superradiant Quantum Phase Transition

abstract: Entanglement and quantum correlations between atoms are not usually considered key ingredients of the superradiant phase transition. Here we consider the Tavis-Cummings model, a solvable system of two-levels atoms, coupled with a single-mode quantized electromagnetic field. This system undergoes a superradiant phase transition, even in a finite-size framework, accompanied by a spontaneous symmetry breaking, and an infinite sequence of energy level crossings. We find approximated expressions for the ground state, its energy, and the position of the level crossings, valid in the limit of a very large number of photons with respect to that of the atoms. In that same limit, we find that the number of photons scales quadratically with the coupling strength, and linearly with the system size, providing a new insight into the superradiance phenomenon. Resorting to novel multipartite measures, we then demonstrate that this quantum phase transition is accompanied by a crossover in the quantum correlations and entanglement between the atoms (qubits). The latters therefore represent suited order parameters for this transition. Finally, we show that these properties of the quantum phase transition persist in the thermodynamic limit.


title: Perspectives of a single-anode cylindrical chamber operating in ionization mode and high gas pressure

abstract: As part of the R2D2 (Rare Decays with Radial Detector) R&D, the use of a gas detector with a spherical or cylindrical cathode, equipped with a single anode and operating at high pressure, was studied for the search of rare phenomena such as neutrinoless double-beta decay. The presented measurements were obtained with a cylindrical detector, covering gas pressures ranging from 1 to 10 bar in argon and 1 to 6 bar in xenon, using both a point-like source of $^{210}$Po (5.3 MeV $\alpha$ ) and a diffuse source of $^{222}$Rn (5.5 MeV $\alpha$). Analysis and interpretation of the data were developed using the anodic current waveform. Similar detection performances were achieved with both gases, and comparable energy resolutions were measured with both sources. As long as the purity of the gas was sufficient, no significant degradation of the measured energy was observed by increasing the pressure. At the highest operating pressure, an energy resolution better than 1.5% full-width at half-maximum (FWHM) was obtained for both gaseous media, although optimal noise conditions were not reached.


title: Deep low-latency joint speech transmission and enhancement over a gaussian channel

abstract: Ensuring intelligible speech communication for hearing assistive devices in low-latency scenarios presents significant challenges in terms of speech enhancement, coding and transmission. In this paper, we propose novel solutions for low-latency joint speech transmission and enhancement, leveraging deep neural networks (DNNs). Our approach integrates two state-of-the-art DNN architectures for low-latency speech enhancement and low-latency analog joint source-channel-based transmission, creating a combined low-latency system and jointly training both systems in an end-to-end approach. Due to the computational demands of the enhancement system, this order is suitable when high computational power is unavailable in the decoder, like hearing assistive devices. The proposed system enables the configuration of total latency, achieving high performance even at latencies as low as 3 ms, which is typically challenging to attain. The simulation results provide compelling evidence that a joint enhancement and transmission system is superior to a simple concatenation system in diverse settings, encompassing various wireless channel conditions, latencies, and background noise scenarios.


title: Characterizing subadjoint varieties among Legendrian varieties

abstract: For a symplectic vector space $V$, a projective subvariety $Z \subset {\bf P} V$ is a Legendrian variety if its affine cone $\widehat{Z} \subset V$ is Lagrangian. In addition to the classical examples of subadjoint varieties associated to simple Lie algebras, many examples of nonsingular Legendrian varieties have been discovered which have positive-dimensional automorphism groups. We give a characterization of subadjoint varieties among such Legendrian varieties in terms of the isotropy representation. Our proof uses some special features of the projective third fundamental forms of Legendrian varieties and their relation to the lines on the Legendrian varieties.


title: Toroidic phase transitions in a direct-kagome artificial spin ice

abstract: Ferrotoroidicity, the fourth form of primary ferroic order, breaks both space and time inversion symmetry. So far, direct observation of ferrotoroidicity in natural materials remains elusive, which impedes the exploration of ferrotoroidic phase transitions. Here, we overcome the limitations of natural materials using an artificial nanomagnet system that can be characterized at the constituent level and at different effective temperatures. We design a nanomagnet array as to realize a direct-kagome spin ice. This artificial spin ice exhibits robust toroidal moments and a quasi-degenerate ground state with two distinct low-temperature toroidal phases: ferrotoroidicity and paratoroidicity. Using magnetic force microscopy and Monte Carlo simulation, we demonstrate a phase transition between ferrotoroidicity and paratoroidicity, along with a crossover to a non-toroidal paramagnetic phase. Our quasi-degenerate artificial spin ice in a direct-kagome structure provides a model system for the investigation of magnetic states and phase transitions that are inaccessible in natural materials.


title: Gaussian mixtures closest to a given measure via optimal transport

abstract: Given a determinate (multivariate) probability measure $\mu$, we characterize Gaussian mixtures $\nu\_\phi$ which minimize the Wasserstein distance $W\_2(\mu,\nu\_\phi)$ to $\mu$ when the mixing probability measure $\phi$ on the parameters $(m,\Sigma)$ of the Gaussians is supported on a compact set $S$.(i) We first show that such mixtures are optimal solutions of a particular optimal transport (OT) problem where the marginal $\nu\_{\phi}$ of the OT problem is also unknown via the mixing measure variable $\phi$. Next (ii) by using a well-known specific property of Gaussian measures, this optimal transport is then viewed as a Generalized Moment Problem (GMP) and if the set $S$ of mixture parameters $(m,\Sigma)$ is a basic compact semi-algebraic set, we provide a "mesh-free" numerical scheme to approximate as closely as desired the optimal distance by solving a hierarchy of semidefinite relaxations of increasing size. In particular, we neither assume that the mixing measure is finitely supported nor that the variance is the same for all components. If the original measure $\mu$ is not a Gaussian mixture with parameters $(m,\Sigma)\in S$, then a strictly positive distance is detected at a finite step of the hierarchy. If the original measure $\mu$ is a Gaussian mixture with parameters $(m,\Sigma)\in S$, then all semidefinite relaxations of the hierarchy have same zero optimal value. Moreover if the mixing measure is atomic with finite support, its components can sometimes be extracted from an optimal solution at some semidefinite relaxation of the hierarchy when Curto & Fialkow's flatness condition holds for some moment matrix.


title: SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphs

abstract: Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other. Despite increased attention to this issue, most approaches in trajectory prediction do not consider all of these factors sufficiently. We present SemanticFormer, an approach for predicting multimodal trajectories by reasoning over a semantic traffic scene graph using a hybrid approach. It utilizes high-level information in the form of meta-paths, i.e. trajectories on which an agent is allowed to drive from a knowledge graph which is then processed by a novel pipeline based on multiple attention mechanisms to predict accurate trajectories. SemanticFormer comprises a hierarchical heterogeneous graph encoder to capture spatio-temporal and relational information across agents as well as between agents and road elements. Further, it includes a predictor to fuse different encodings and decode trajectories with probabilities. Finally, a refinement module assesses permitted meta-paths of trajectories and speed profiles to obtain final predicted trajectories. Evaluation of the nuScenes benchmark demonstrates improved performance compared to several SOTA methods. In addition, we demonstrate that our knowledge graph can be easily added to two graph-based existing SOTA methods, namely VectorNet and Laformer, replacing their original homogeneous graphs. The evaluation results suggest that by adding our knowledge graph the performance of the original methods is enhanced by 5% and 4%, respectively.


title: Strength in numbers: A multiphase wind model with multiple cloud populations

abstract: Galactic outflows have a multiphase nature making them challenging to model analytically. Many previous studies have tried to produce models that come closer to reality. In this work, we continue these efforts and describe the interaction of the hot wind fluid with multiple cold cloud populations, with their number density determined by different probability density functions. To do so, we introduced realistic cloud-wind interaction source terms and a time-varying cooling area. We find that the model reproduces well results from small-scale hydrodynamic simulations, but exhibits a general destructive behavior both for a single cloud population as well as multiple ones. We show that including multiple cloud populations can alter the evolution of the wind drastically. We also compare our model to observations and show that the differential acceleration of multiple clouds can lead to a non-negligible velocity `dispersion' relevant for down-the-barrel studies. Furthermore, we compute the emitted cooling surface brightness and find it generally too faint to explain observed Lyman-$\alpha$ halos.


title: Low-overhead General-purpose Near-Data Processing in CXL Memory Expanders

abstract: To overcome the memory capacity wall of large-scale AI and big data applications, Compute Express Link (CXL) enables cost-efficient memory expansion beyond the local DRAM of processors. While its CXL.mem protocol stack minimizes interconnect latency, CXL memory accesses can still result in significant slowdowns for memory-bound applications. While near-data processing (NDP) in CXL memory can overcome such limitations, prior works propose application-specific HW units that are not suitable for practical CXL memory-based systems that should support various applications. On the other hand, existing CPU or GPU cores are not cost-effective for NDP because they are not optimized for memory-bound applications. In addition, the communication between the host processor and CXL controller for NDP offloading should achieve low latency, but the CXL$.$io (or PCIe) protocol incurs $\mu$s-scale latency and is not suitable for fine-grain NDP. To achieve high-performance NDP end-to-end, we propose a low-overhead general-purpose NDP architecture for CXL memory referred to as Memory-Mapped NDP (M$^2$NDP), which comprises memory-mapped functions (M$^2$func) and memory-mapped $\mu$threading (M$^2\mu$thr). The M$^2$func is a CXL.mem-compatible low-overhead communication mechanism between the host processor and NDP controller in the CXL memory. The M$^2\mu$thr enables low-cost, general-purpose NDP unit design by introducing lightweight $\mu$threads that support highly concurrent execution of NDP kernels with minimal resource wastage. By combining them, our M$^2$NDP achieves significant speedups for various applications, including in-memory OLAP, key-value store, large language model, recommendation model, and graph analytics by up to 128$\times$ (11.5$\times$ overall) and reduces energy by up to 87.9\% (80.1\% overall) compared to a baseline CPU or GPU host with passive CXL memory.


title: Probing Unlearned Diffusion Models: A Transferable Adversarial Attack Perspective

abstract: Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these involved concepts from diffusion models. However, these unlearning methods only shift the text-to-image mapping and preserve the visual content within the generative space of diffusion models, leaving a fatal flaw for restoring these erased concepts. This erasure trustworthiness problem needs probe, but previous methods are sub-optimal from two perspectives: (1) Lack of transferability: Some methods operate within a white-box setting, requiring access to the unlearned model. And the learned adversarial input often fails to transfer to other unlearned models for concept restoration; (2) Limited attack: The prompt-level methods struggle to restore narrow concepts from unlearned models, such as celebrity identity. Therefore, this paper aims to leverage the transferability of the adversarial attack to probe the unlearning robustness under a black-box setting. This challenging scenario assumes that the unlearning method is unknown and the unlearned model is inaccessible for optimization, requiring the attack to be capable of transferring across different unlearned models. Specifically, we employ an adversarial search strategy to search for the adversarial embedding which can transfer across different unlearned models. This strategy adopts the original Stable Diffusion model as a surrogate model to iteratively erase and search for embeddings, enabling it to find the embedding that can restore the target concept for different unlearning methods. Extensive experiments demonstrate the transferability of the searched adversarial embedding across several state-of-the-art unlearning methods and its effectiveness for different levels of concepts.


title: Cross-Block Fine-Grained Semantic Cascade for Skeleton-Based Sports Action Recognition

abstract: Human action video recognition has recently attracted more attention in applications such as video security and sports posture correction. Popular solutions, including graph convolutional networks (GCNs) that model the human skeleton as a spatiotemporal graph, have proven very effective. GCNs-based methods with stacked blocks usually utilize top-layer semantics for classification/annotation purposes. Although the global features learned through the procedure are suitable for the general classification, they have difficulty capturing fine-grained action change across adjacent frames -- decisive factors in sports actions. In this paper, we propose a novel ``Cross-block Fine-grained Semantic Cascade (CFSC)'' module to overcome this challenge. In summary, the proposed CFSC progressively integrates shallow visual knowledge into high-level blocks to allow networks to focus on action details. In particular, the CFSC module utilizes the GCN feature maps produced at different levels, as well as aggregated features from proceeding levels to consolidate fine-grained features. In addition, a dedicated temporal convolution is applied at each level to learn short-term temporal features, which will be carried over from shallow to deep layers to maximize the leverage of low-level details. This cross-block feature aggregation methodology, capable of mitigating the loss of fine-grained information, has resulted in improved performance. Last, FD-7, a new action recognition dataset for fencing sports, was collected and will be made publicly available. Experimental results and empirical analysis on public benchmarks (FSD-10) and self-collected (FD-7) demonstrate the advantage of our CFSC module on learning discriminative patterns for action classification over others.


title: Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detection

abstract: Recent self-training techniques have shown notable improvements in unsupervised domain adaptation for 3D object detection (3D UDA). These techniques typically select pseudo labels, i.e., 3D boxes, to supervise models for the target domain. However, this selection process inevitably introduces unreliable 3D boxes, in which 3D points cannot be definitively assigned as foreground or background. Previous techniques mitigate this by reweighting these boxes as pseudo labels, but these boxes can still poison the training process. To resolve this problem, in this paper, we propose a novel pseudo label refinery framework. Specifically, in the selection process, to improve the reliability of pseudo boxes, we propose a complementary augmentation strategy. This strategy involves either removing all points within an unreliable box or replacing it with a high-confidence box. Moreover, the point numbers of instances in high-beam datasets are considerably higher than those in low-beam datasets, also degrading the quality of pseudo labels during the training process. We alleviate this issue by generating additional proposals and aligning RoI features across different domains. Experimental results demonstrate that our method effectively enhances the quality of pseudo labels and consistently surpasses the state-of-the-art methods on six autonomous driving benchmarks. Code will be available at https://github.com/Zhanwei-Z/PERE.


title: Cerium Oxide-based Solid-State Thermal Transistors with Wide Switching Width of 9.5 W/mK

abstract: Thermal transistors that electrically switch heat flow on and off have attracted attention as thermal management devices. Electrochemical reduction/oxidation switches the thermal conductivity (\k{appa}) of active metal oxide layers. The \k{appa}-switching width (difference between on-state and off-state \k{appa}) of the previously proposed electrochemical thermal transistors is narrow, less than 5 W/mK. Here, we show solid-state electrochemical thermal transistors with a wide \k{appa}-switching width of 9.5 W/mK. We used CeO2 thin film as the active layer directly deposited on a solid electrolyte YSZ substrate. A Pt thin film was deposited on the surface of the CeO2 thin film and the back surface of the YSZ substrate to create a solid-state electrochemical thermal transistor. When the CeO2 thin film was once reduced (off-state) and then oxidized (on-state), the \k{appa} was approximately 2.5 W/mK in its most reduced state, and \k{appa} increased with oxidation to 11.8 W/mK (on-state). This reduction (off-state)/oxidation (on-state) cycle was repeated five times and the average value of \k{appa} was 2.5 W/mK after reduction (off-state) and 12 W/mK after oxidation (on-state). The \k{appa}-switching width was 9.5 W/mK. The CeO2-based solid-state electrochemical thermal transistors are potential materials for thermal shutters and thermal displays.


title: Weighted Feedback-Based Quantum Algorithm for Excited States Calculation

abstract: Drawing inspiration from the Lyapunov control technique for quantum systems, feedback-based quantum algorithms have been proposed for calculating the ground states of Hamiltonians. In this work, we consider extending these algorithms to tackle calculating excited states. Inspired by the weighted subspace-search variational quantum eigensolver algorithm, we propose a novel weighted feedback-based quantum algorithm for excited state calculation. We show that depending on how we design the weights and the feedback law, we can prepare the $p$th excited state or lowest energy states up to the $p$th excited state. Through an application in quantum chemistry, we show the effectiveness of the proposed algorithm, evaluating its efficacy via numerical simulations.


title: Online Electricity Purchase for Data Center with Dynamic Virtual Battery from Flexibility Aggregation

abstract: As a critical component of modern infrastructure, data centers account for a huge amount of power consumption and greenhouse gas emission. This paper studies the electricity purchase strategy for a data center to lower its energy cost while integrating local renewable generation under uncertainty. To facilitate efficient and scalable decision-making, we propose a two-layer hierarchy where the lower layer consists of the operation of all electrical equipment in the data center and the upper layer determines the procurement and dispatch of electricity. At the lower layer, instead of device-level scheduling in real time, we propose to exploit the inherent flexibility in demand, such as thermostatically controlled loads and flexible computing tasks, and aggregate them into virtual batteries. By this means, the upper-layer decision only needs to take into account these virtual batteries, the size of which is generally small and independent of the data center scale. We further propose an online algorithm based on Lyapunov optimization to purchase electricity from the grid with a manageable energy cost, even though the prices, renewable availability, and battery specifications are uncertain and dynamic. In particular, we show that, under mild conditions, our algorithm can achieve bounded loss compared with the offline optimal cost, while strictly respecting battery operational constraints. Extensive simulation studies validate the theoretical analysis and illustrate the tradeoff between optimality and conservativeness.


title: Comparative Mid-Infrared Spectroscopy of Dark, Primitive Asteroids: Does Shared Taxonomic Class Indicate Shared Silicate Composition?

abstract: Primitive asteroids with low albedos and red slopes in the visible and near infrared (VNIR) are found in both the Main Belt and the Jupiter Trojan clouds. In order to determine whether the VNIR spectral similarities of primitive Main Belt asteroids and Jupiter Trojans are reflective of a true compositional similarity, we compare the mid-infrared silicate emission features of Main Belt and Jupiter Trojan asteroids. Using archival data from the Spitzer Space Telescope's IRS spectrograph and observations from the Stratospheric Observatory for Infrared Astronomy's (SOFIA) FORCAST instrument, we analyze the 5-40 micron spectra of thirteen primitive Main Belt asteroids and compare them to those of Jupiter Trojans in the literature. We find that while many primitive asteroids in the Main Belt resemble their Trojan counterparts with strong spectral signatures of olivine-rich high-porosity silicate regoliths, we identify (368) Haidea as a spectrally distinctive asteroid that lacks strong evidence of olivine in its MIR spectrum. Differences in silicate compositions among D-type asteroids imply a diversity of origins for primitive asteroids.


title: Electronic decoupling and hole-doping of graphene nanoribbons on metal substrates by chloride intercalation

abstract: Atomically precise graphene nanoribbons (GNRs) have a wide range of electronic properties that depend sensitively on their chemical structure. Several types of GNRs have been synthesized on metal surfaces through selective surface-catalyzed reactions. The resulting GNRs are adsorbed on the metal surface, which may lead to hybridization between the GNR orbitals and those of the substrate. This makes investigation of the intrinsic electronic properties of GNRs more difficult, and also rules out capacitive gating. Here we demonstrate the formation of a dielectric gold chloride adlayer that can intercalate underneath GNRs on the Au(111) surface. The intercalated gold chloride adlayer electronically decouples the GNRs from the metal and leads to a substantial hole doping of the GNRs. Our results introduce an easily accessible tool in the in situ characterization of GNRs grown on Au(111) that allows for exploration of their electronic properties in a heavily hole-doped regime.


title: EL meteorites do date the giant planet instability

abstract: In our recent work, we combined dynamical simulations, meteoritic data and thermal models as well as asteroid observations to argue that the current parent body of the EL meteorites was implanted into the asteroid belt not earlier than 60 Myr after the beginning of the Solar System and that the most likely capture mechanism was the giant planet orbital instability. In the study "The link between Athor and EL meteorites does not constrain the timing of the giant planet instability" that appeared in arXiv, Izidoro and collaborators argue that the implantation of Athor into the asteroid belt does not necessarily require that the giant planet orbital instability occurred at the implantation time. Here we provide further arguments that, in the end, the giant planet instability is still the most likely dynamical process to implant asteroid Athor into the asteroid main belt between 60 and 100 Myr after the beginning of the Solar System.


title: ZSMILES: an approach for efficient SMILES storage for random access in Virtual Screening

abstract: Virtual screening is a technique used in drug discovery to select the most promising molecules to test in a lab. To perform virtual screening, we need a large set of molecules as input, and storing these molecules can become an issue. In fact, extreme-scale high-throughput virtual screening applications require a big dataset of input molecules and produce an even bigger dataset as output. These molecules' databases occupy tens of TB of storage space, and domain experts frequently sample a small portion of this data. In this context, SMILES is a popular data format for storing large sets of molecules since it requires significantly less space to represent molecules than other formats (e.g., MOL2, SDF). This paper proposes an efficient dictionary-based approach to compress SMILES-based datasets. This approach takes advantage of domain knowledge to provide a readable output with separable SMILES, enabling random access. We examine the benefits of storing these datasets using ZSMILES to reduce the cold storage footprint in HPC systems. The main contributions concern a custom dictionary-based approach and a data pre-processing step. From experimental results, we can notice how ZSMILES leverage domain knowledge to compress x1.13 more than state of the art in similar scenarios and up to $0.29$ compression ratio. We tested a CUDA version of ZSMILES targetting NVIDIA's GPUs, showing a potential speedup of 7x.


title: Convergence analysis of the transformed gradient projection algorithms on compact matrix manifolds

abstract: In this paper, to address the optimization problem on a compact matrix manifold, we introduce a novel algorithmic framework called the Transformed Gradient Projection (TGP) algorithm, using the projection onto this compact matrix manifold. Compared with the existing algorithms, the key innovation in our approach lies in the utilization of a new class of search directions and various stepsizes, including the Armijo, nonmonotone Armijo, and fixed stepsizes, to guide the selection of the next iterate. Our framework offers flexibility by encompassing the classical gradient projection algorithms as special cases, and intersecting the retraction-based line-search algorithms. Notably, our focus is on the Stiefel or Grassmann manifold, revealing that many existing algorithms in the literature can be seen as specific instances within our proposed framework, and this algorithmic framework also induces several new special cases. Then, we conduct a thorough exploration of the convergence properties of these algorithms, considering various search directions and stepsizes. To achieve this, we extensively analyze the geometric properties of the projection onto compact matrix manifolds, allowing us to extend classical inequalities related to retractions from the literature. Building upon these insights, we establish the weak convergence, convergence rate, and global convergence of TGP algorithms under three distinct stepsizes. In cases where the compact matrix manifold is the Stiefel or Grassmann manifold, our convergence results either encompass or surpass those found in the literature. Finally, through a series of numerical experiments, we observe that the TGP algorithms, owing to their increased flexibility in choosing search directions, outperform classical gradient projection and retraction-based line-search algorithms in several scenarios.