title: Scaling limit for local times and return times of a randomly biased walk on a Galton-Watson tree

abstract: We consider a null recurrent random walk $\mathbb{X}$ on a super-critical Galton Watson marked tree $\mathbb{T}$ in the (sub-)diffusive regime. We are interested in the asymptotic behaviour of the local time of its root at $n$, which is the total amount of time spent by the random walk $\mathbb{X}$ on the root of $\mathbb{T}$ up to the time $n$, and in its $n$-th return time to the root of $\mathbb{T}$. We show that properly renormalized, this local time and this $n$-th return time respectively converge in law to the maximum and to an hitting time of some stable L\'evy process. This paper aims in particular to extent the results of Y. Hu [Hu17].


title: Enhancing expressivity transfer in textless speech-to-speech translation

abstract: Textless speech-to-speech translation systems are rapidly advancing, thanks to the integration of self-supervised learning techniques. However, existing state-of-the-art systems fall short when it comes to capturing and transferring expressivity accurately across different languages. Expressivity plays a vital role in conveying emotions, nuances, and cultural subtleties, thereby enhancing communication across diverse languages. To address this issue this study presents a novel method that operates at the discrete speech unit level and leverages multilingual emotion embeddings to capture language-agnostic information. Specifically, we demonstrate how these embeddings can be used to effectively predict the pitch and duration of speech units in the target language. Through objective and subjective experiments conducted on a French-to-English translation task, our findings highlight the superior expressivity transfer achieved by our approach compared to current state-of-the-art systems.


title: On Committor Functions in Milestoning

abstract: As an optimal one-dimensional reaction coordinate, the committor function not only describes the probability of a trajectory initiated at a phase space point first reaching the product state before reaching the reactant state, but also preserves the kinetics when utilized to run a reduced dynamics model. However, calculating the committor function in high-dimensional systems poses significant challenges. In this paper, within the framework of Milestoning, exact expressions for committor functions at two levels of coarse graining are given, including committor functions of phase space point to point (CFPP) and milestone to milestone (CFMM). When combined with transition kernels obtained from trajectory analysis, these expressions can be utilized to accurately and efficiently compute the committor functions. Furthermore, based on the calculated committor functions, an adaptive algorithm is developed to gradually refine the transition state region. Finally, two model examples are employed to assess the accuracy of these different formulations of committor functions.


title: A Completely Locale-independent Session-based Recommender System by Leveraging Trained Model

abstract: In this paper, we propose a solution that won the 10th prize in the KDD Cup 2023 Challenge Task 2 (Next Product Recommendation for Underrepresented Languages/Locales). Our approach involves two steps: (i) Identify candidate item sets based on co-visitation, and (ii) Re-ranking the items using LightGBM with locale-independent features, including session-based features and product similarity. The experiment demonstrated that the locale-independent model performed consistently well across different test locales, and performed even better when incorporating data from other locales into the training.


title: An Analysis on Large Language Models in Healthcare: A Case Study of BioBERT

abstract: This paper conducts a comprehensive investigation into applying large language models, particularly on BioBERT, in healthcare. It begins with thoroughly examining previous natural language processing (NLP) approaches in healthcare, shedding light on the limitations and challenges these methods face. Following that, this research explores the path that led to the incorporation of BioBERT into healthcare applications, highlighting its suitability for addressing the specific requirements of tasks related to biomedical text mining. The analysis outlines a systematic methodology for fine-tuning BioBERT to meet the unique needs of the healthcare domain. This approach includes various components, including the gathering of data from a wide range of healthcare sources, data annotation for tasks like identifying medical entities and categorizing them, and the application of specialized preprocessing techniques tailored to handle the complexities found in biomedical texts. Additionally, the paper covers aspects related to model evaluation, with a focus on healthcare benchmarks and functions like processing of natural language in biomedical, question-answering, clinical document classification, and medical entity recognition. It explores techniques to improve the model's interpretability and validates its performance compared to existing healthcare-focused language models. The paper thoroughly examines ethical considerations, particularly patient privacy and data security. It highlights the benefits of incorporating BioBERT into healthcare contexts, including enhanced clinical decision support and more efficient information retrieval. Nevertheless, it acknowledges the impediments and complexities of this integration, encompassing concerns regarding data privacy, transparency, resource-intensive requirements, and the necessity for model customization to align with diverse healthcare domains.


title: Lyman Continuum Emission from Spectroscopically Confirmed Ly$\alpha$ Emitters at $z\sim3.1$

abstract: We present a study of Lyman continuum (LyC) emission in a sample of $\sim$150 Ly$\alpha$ emitters (LAEs) at $z\approx3.1$ in the Subaru-XMM Deep Survey field. These LAEs were previously selected using the narrowband technique and spectroscopically confirmed with Ly$\alpha$ equivalent widths (EWs) $\ge45$ \r{A}. We obtain deep UV images using a custom intermediate-band filter $U_{\rm J}$ that covers a wavelength range of $3330 \sim 3650$ \r{A}, corresponding to 810$\sim$890 \r{A} in the rest frame. We detect 5 individual LyC galaxy candidates in the $U_{\rm J}$ band, and their escape fractions ($f_{\rm esc}$) of LyC photons are roughly between 40% and 80%. This supports a previous finding that a small fraction of galaxies may have very high $f_{\rm esc}$. We find that the $f_{\rm esc}$ values of the 5 LyC galaxies are not apparently correlated with other galaxy properties such as Ly$\alpha$ luminosity and EW, UV luminosity and slope, and star-formation rate (SFR). This is partly due to the fact that these galaxies only represent a small fraction ($\sim3$%) of our LAE sample. For the remaining LAEs that are not detected in $U_{\rm J}$, we stack their $U_{\rm J}$-band images and constrain their average $f_{\rm esc}$. The upper limit of the average $f_{\rm esc}$ value is about 16%, consistent with the results in the literature. Compared with the non-LyC LAEs, the LyC LAEs tend to have higher Ly$\alpha$ luminosities, Ly$\alpha$ EWs, and SFRs, but their UV continuum slopes are similar to those of other galaxies.


title: Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extraction

abstract: Humans possess an extraordinary ability to selectively focus on the sound source of interest amidst complex acoustic environments, commonly referred to as cocktail party scenarios. In an attempt to replicate this remarkable auditory attention capability in machines, target speaker extraction (TSE) models have been developed. These models leverage the pre-registered cues of the target speaker to extract the sound source of interest. However, the effectiveness of these models is hindered in real-world scenarios due to the unreliable or even absence of pre-registered cues. To address this limitation, this study investigates the integration of natural language description to enhance the feasibility, controllability, and performance of existing TSE models. Specifically, we propose a model named LLM-TSE, wherein a large language model (LLM) extracts useful semantic cues from the user's typed text input. These cues can serve as independent extraction cues, task selectors to control the TSE process or complement the pre-registered cues. Our experimental results demonstrate competitive performance when only text-based cues are presented, the effectiveness of using input text as a task selector, and a new state-of-the-art when combining text-based cues with pre-registered cues. To our knowledge, this is the first study to successfully incorporate LLMs to guide target speaker extraction, which can be a cornerstone for cocktail party problem research.


title: A spectroscopic survey of Ly$\alpha$ emitters and Ly$\alpha$ luminosity function at Redshifts 3.7 and 4.8

abstract: We present a spectroscopic survey of Ly$\alpha$ emitters (LAEs) at $z\sim3.7$ and $z\sim4.8$. The LAEs are selected using the narrowband technique based on the combination of deep narrowband and broadband imaging data in two deep fields, and then spectroscopically confirmed with the MMT multi-fiber spectrograph Hectospec. The sample consists of 71 LAEs at $z\sim3.7$ and 69 LAEs at $z\sim4.8$ over $\sim 1.5$ deg$^2$, making it one of the largest spectroscopically confirmed sample of LAEs at the two redshifts. Their Ly$\alpha$ luminosities are measured using the secure redshifts and deep photometric data, and span a range of $\sim 10^{42.5}$ - $10^{43.6} \,\rm erg\, s^{-1}$, so these LAEs represent the most luminous galaxies at the redshifts in terms of Ly$\alpha$ luminosity. We estimate and correct sample incompletenesses and derive reliable Ly$\alpha$ luminosity function (LF)s at $z\sim3.7$ and 4.8 based on the two spectroscopic samples. We find that our Ly$\alpha$ LFs are roughly consistent (within a factor of $2-3$) with previous measurements at similar redshifts that were derived from either photometric samples or spectroscopic samples. By comparing with previous studies in different redshifts, we find that the Ly$\alpha$ LFs decrease mildly from $z\sim3.1$ to $z\sim5.7$, supporting the previous claim of the slow LF evolution between $z\sim2$ and $z\sim6$. At $z>5.7$, the LF declines rapidly towards higher redshift, partly due to the effect of cosmic reionization.


title: Symmetry-enforced many-body separability transitions

abstract: We study quantum many-body mixed states with a symmetry from the perspective of separability, i.e., whether a mixed state can be expressed as an ensemble of short-range entangled (SRE) symmetric pure states. We provide evidence for 'symmetry-enforced separability transitions' in a variety of states, where in one regime the mixed state is expressible as a convex sum of symmetric SRE pure states, while in the other regime, such a representation is not feasible. We first discuss Gibbs state of Hamiltonians that exhibit spontaneous breaking of a discrete symmetry, and argue that the associated thermal phase transition can be thought of as a symmetry-enforced separability transition. Next, we study cluster states in various dimensions subjected to local decoherence, and identify several distinct mixed-state phases and associated separability phase transitions, which also provides an alternate perspective on recently discussed 'average SPT order'. We also study decohered p+ip superconductors, and find that if the decoherence breaks the fermion parity explicitly, then the resulting mixed state can be expressed as a convex sum of non-chiral states, while a fermion-parity preserving decoherence results in a phase transition at a non-zero threshold that corresponds to spontaneous breaking of fermion parity. Finally, we briefly discuss systems that satisfy NLTS (no low-energy trivial state) property, such as the recently discovered good LDPC codes, and argue that the Gibbs state of such systems exhibits a temperature-tuned separability transition.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-th


title: Interactive Interior Design Recommendation via Coarse-to-fine Multimodal Reinforcement Learning

abstract: Personalized interior decoration design often incurs high labor costs. Recent efforts in developing intelligent interior design systems have focused on generating textual requirement-based decoration designs while neglecting the problem of how to mine homeowner's hidden preferences and choose the proper initial design. To fill this gap, we propose an Interactive Interior Design Recommendation System (IIDRS) based on reinforcement learning (RL). IIDRS aims to find an ideal plan by interacting with the user, who provides feedback on the gap between the recommended plan and their ideal one. To improve decision-making efficiency and effectiveness in large decoration spaces, we propose a Decoration Recommendation Coarse-to-Fine Policy Network (DecorRCFN). Additionally, to enhance generalization in online scenarios, we propose an object-aware feedback generation method that augments model training with diversified and dynamic textual feedback. Extensive experiments on a real-world dataset demonstrate our method outperforms traditional methods by a large margin in terms of recommendation accuracy. Further user studies demonstrate that our method reaches higher real-world user satisfaction than baseline methods.


title: Solar Flare 1/f Fluctuations from Amplitude Modulated Five Minute Oscillation

abstract: We first study the solar flare time sequence based on the GOES16 data. We find that the power spectrum density of the low-energy (E\leq E_{mean}) flare shows 1/f fluctuations, but the high-energy (E>E_{mean}) flare shows a flat spectrum. Further, we found that the flare timing time-sequence shows 1/f fluctuations clearer. These facts indicate that the solar flare 1/f fluctuations are associated with low-energy phenomena. We investigate the origin of this 1/f fluctuations based on our recent proposal: 1/f fluctuations arise from amplitude modulation and demodulation. We speculate that this amplitude modulation is encoded by the resonance with the Solar Five-minute Oscillation (SFO) and demodulated by magnetic reconnection. We partially demonstrate this scenario by analyzing the SFO eigenmodes resolving the frequency degeneracy in the azimuthal order number m by solar rotation and resonance. Since 1/f fluctuation is robust, we speculate that the solar flare 1/f fluctuations may be inherited by the various phenomena around the Sun, such as the sunspot numbers and the cosmic rays. Finally, we compare the solar flares and the earthquakes, both showing 1/f fluctuations. Interestingly, the same analysis for solar flares is possible for earthquakes if we read SFO as Earth's Free Oscillation, and magnetic reconnection as fault rupture. Furthermore, we point out the possibility that the same analysis also applies to the activity of the black hole/disk system if we read SFO as the Quasi-Periodic Oscillation of a black hole.

categories: astro-ph.SR nlin.AO physics.geo-ph physics.space-ph


title: Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators

abstract: Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. However, community concerns abound regarding the factuality and potential implications of using this uncensored knowledge. In light of this, we introduce CONNER, a COmpreheNsive kNowledge Evaluation fRamework, designed to systematically and automatically evaluate generated knowledge from six important perspectives -- Factuality, Relevance, Coherence, Informativeness, Helpfulness and Validity. We conduct an extensive empirical analysis of the generated knowledge from three different types of LLMs on two widely studied knowledge-intensive tasks, i.e., open-domain question answering and knowledge-grounded dialogue. Surprisingly, our study reveals that the factuality of generated knowledge, even if lower, does not significantly hinder downstream tasks. Instead, the relevance and coherence of the outputs are more important than small factual mistakes. Further, we show how to use CONNER to improve knowledge-intensive tasks by designing two strategies: Prompt Engineering and Knowledge Selection. Our evaluation code and LLM-generated knowledge with human annotations will be released to facilitate future research.


title: Revisiting Android App Categorization

abstract: Numerous tools rely on automatic categorization of Android apps as part of their methodology. However, incorrect categorization can lead to inaccurate outcomes, such as a malware detector wrongly flagging a benign app as malicious. One such example is the SlideIT Free Keyboard app, which has over 500000 downloads on Google Play. Despite being a "Keyboard" app, it is often wrongly categorized alongside "Language" apps due to the app's description focusing heavily on language support, resulting in incorrect analysis outcomes, including mislabeling it as a potential malware when it is actually a benign app. Hence, there is a need to improve the categorization of Android apps to benefit all the tools relying on it. In this paper, we present a comprehensive evaluation of existing Android app categorization approaches using our new ground-truth dataset. Our evaluation demonstrates the notable superiority of approaches that utilize app descriptions over those solely relying on data extracted from the APK file, while also leaving space for potential improvement in the former category. Thus, we propose two innovative approaches that effectively outperform the performance of existing methods in both description-based and APK-based methodologies. Finally, by employing our novel description-based approach, we have successfully demonstrated that adopting a higher-performing categorization method can significantly benefit tools reliant on app categorization, leading to an improvement in their overall performance. This highlights the significance of developing advanced and efficient app categorization methodologies for improved results in software engineering tasks.


title: The birth of (a robust) Arbitrage Theory in de Finetti's early contributions

abstract: \textit{Il significato soggettivo della probabilit\`a} (1931) by B. de Finetti \cite{deF} is unanimously considered the rise of `subjectivism', a notion which strongly influenced both Probability and Decision Theory. What is less acknowledge is that \cite{deF} posed the foundations of modern arbitrage theory. In this paper we aim at examining how de Finetti's contribution should be considered as the precursor of Asset Pricing Theory and we show how his findings relate to recent developments in Robust Finance.


title: Integrated Sensing and Communication Neighbor Discovery for MANET with Gossip Mechanism

abstract: Mobile Ad hoc Network (MANET), supporting Machine-Type Communication(MTC), has a strong demand for rapid networking. Neighbor Discovery (ND) is a key initial step in configuring MANETs and faces a serious challenge in decreasing convergence time. Integrated Sensing and Communication (ISAC), as one of the potential key technologies in the 6th Generation (6G) mobile networks, can obtain the sensing data as the priori information to accelerate ND convergence. In order to further reduce the convergence time of ND, this paper introduces the ISAC-enabled gossip mechanism into the ND algorithm. The prior information acquired by ISAC reduces the information redundancy brought by the gossip mechanism and thus decreases the probability of collision, which further improves convergence speed. The average number of discovered nodes within a given period is derived, which is applied as the critical metric to evaluate the performance of ND algorithms. The simulation results confirm the correctness of the theoretical derivation and show that the interplay between the prior mechanisms and the gossip mechanism significantly reduces the convergence time. In addition, to solve the problem of imperfect sensing information, reinforcement learning is applied. Under the constraints of the convergence condition, the non-Reply and non-Stop Algorithm based on Gossip and Q-learning (GQ-nRnS) proposed in this paper not only ensures the completeness of ND, but also maintains a high convergence speed of ND. Compared with the Q-learning-based ND algorithm (Q-ND), the average convergence time of the GQ-nRnS algorithm is reduced by about 66.4%.


title: A Multi-wavelength Study of Swift J0503.7-2819: a Chimeric magnetic CV

abstract: We present multi-wavelength temporal and spectral characteristics of a magnetic cataclysmic variable (MCV) Swift J0503.7-2819, using far ultraviolet (FUV) and X-ray data from AstroSat, supplemented with optical data from the Southern African Large Telescope and X-ray data from the XMM-Newton and Swift observatories. The X-ray modulations at 4897.6657 s and 3932.0355 s are interpreted as the orbital ($P_{\Omega}$) and spin ($P_{\omega}$) period, respectively, and are consistent with prior reports. With a spin-orbit period ratio of 0.8 and $P_{\Omega}$ falling below the period gap (2-3 hrs) of CVs, Swift J0503.7-2819 would be the newest addition to the growing population of nearly synchronous MCVs, which we call EX Hya-like systems. Hard X-ray luminosity of $<$ $2.5\times10^{32} erg s^{-1}$, as measured with the Swift Burst Alert Telescope, identifies it to be a low-luminosity intermediate polar, similar to other EX Hya-like systems. The phenomenology of the light curves and the spectral characteristics rule out a purely disc-fed/stream-fed model and instead reveal the presence of complex accretion structures around the white dwarf. We propose a ring-like accretion flow, akin to EX Hya, using period ratio, stability arguments, and observational features. An attempt is made to differentiate between the asynchronous polar/nearly-synchronous intermediate polar nature of Swift J0503.7-2819. Further, we note that with the advent of sensitive surveys, a growing population of MCVs that exhibit characteristics of both polars and intermediate polars is beginning to be identified, likely forming a genealogical link between the two conventional classes of MCVs.


title: The Allen-Cahn equation with nonlinear truncated Laplacians: description of radial solutions

abstract: We consider the Allen-Cahn equation with the so-called truncated Laplacians, which are fully nonlinear differential operators that depend on some eigenvalues of the Hessian matrix. By monitoring the sign of a quantity that is responsible for switches from a first order ODE regime to a second order ODE regime (and vice versa), we give a nearly complete description of radial solutions. In particular, we reveal the existence of surprising unbounded radial solutions. Also radial solutions cannot oscillate, which is in sharp contrast with the case of the Laplacian operator, or that of Pucci's operators.


title: VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention

abstract: The deep learning-based speech enhancement (SE) methods always take the clean speech's waveform or time-frequency spectrum feature as the learning target, and train the deep neural network (DNN) by reducing the error loss between the DNN's output and the target. This is a conventional single-task learning paradigm, which has been proven to be effective, but we find that the multi-task learning framework can improve SE performance. Specifically, we design a framework containing a SE module and a voice activity detection (VAD) module, both of which share the same encoder, and the whole network is optimized by the weighted loss of the two modules. Moreover, we design a causal spatial attention (CSA) block to promote the representation capability of DNN. Combining the VAD aided multi-task learning framework and CSA block, our SE network is named VSANet. The experimental results prove the benefits of multi-task learning and the CSA block, which give VSANet an excellent SE performance.


title: A structured L-BFGS method and its application to inverse problems

abstract: Many inverse problems are phrased as optimization problems in which the objective function is the sum of a data-fidelity term and a regularization. Often, the Hessian of the fidelity term is computationally unavailable while the Hessian of the regularizer allows for cheap matrix-vector products. In this paper, we study an LBFGS method that takes advantage of this structure. We show that the method converges globally without convexity assumptions and that the convergence is linear under a Kurdyka--{\L}ojasiewicz-type inequality. In addition, we prove linear convergence to cluster points near which the objective function is strongly convex. To the best of our knowledge, this is the first time that linear convergence of an LBFGS method is established in a non-convex setting. The convergence analysis is carried out in infinite dimensional Hilbert space, which is appropriate for inverse problems but has not been done before. Numerical results show that the new method outperforms other structured LBFGS methods and classical LBFGS on non-convex real-life problems from medical image registration. It also compares favorably with classical LBFGS on ill-conditioned quadratic model problems. An implementation of the method is freely available.


title: Score Regularized Policy Optimization through Diffusion Behavior

abstract: Recent developments in offline reinforcement learning have uncovered the immense potential of diffusion modeling, which excels at representing heterogeneous behavior policies. However, sampling from diffusion policies is considerably slow because it necessitates tens to hundreds of iterative inference steps for one action. To address this issue, we propose to extract an efficient deterministic inference policy from critic models and pretrained diffusion behavior models, leveraging the latter to directly regularize the policy gradient with the behavior distribution's score function during optimization. Our method enjoys powerful generative capabilities of diffusion modeling while completely circumventing the computationally intensive and time-consuming diffusion sampling scheme, both during training and evaluation. Extensive results on D4RL tasks show that our method boosts action sampling speed by more than 25 times compared with various leading diffusion-based methods in locomotion tasks, while still maintaining state-of-the-art performance.


title: Beyond Memorization: Violating Privacy Via Inference with Large Language Models

abstract: Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of whether current LLMs could violate individuals' privacy by inferring personal attributes from text given at inference time. In this work, we present the first comprehensive study on the capabilities of pretrained LLMs to infer personal attributes from text. We construct a dataset consisting of real Reddit profiles, and show that current LLMs can infer a wide range of personal attributes (e.g., location, income, sex), achieving up to $85\%$ top-1 and $95\%$ top-3 accuracy at a fraction of the cost ($100\times$) and time ($240\times$) required by humans. As people increasingly interact with LLM-powered chatbots across all aspects of life, we also explore the emerging threat of privacy-invasive chatbots trying to extract personal information through seemingly benign questions. Finally, we show that common mitigations, i.e., text anonymization and model alignment, are currently ineffective at protecting user privacy against LLM inference. Our findings highlight that current LLMs can infer personal data at a previously unattainable scale. In the absence of working defenses, we advocate for a broader discussion around LLM privacy implications beyond memorization, striving for a wider privacy protection.


title: RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation

abstract: Grammatical Error Correction (GEC) systems play a vital role in assisting people with their daily writing tasks. However, users may sometimes come across a GEC system that initially performs well but fails to correct errors when the inputs are slightly modified. To ensure an ideal user experience, a reliable GEC system should have the ability to provide consistent and accurate suggestions when encountering irrelevant context perturbations, which we refer to as context robustness. In this paper, we introduce RobustGEC, a benchmark designed to evaluate the context robustness of GEC systems. RobustGEC comprises 5,000 GEC cases, each with one original error-correct sentence pair and five variants carefully devised by human annotators. Utilizing RobustGEC, we reveal that state-of-the-art GEC systems still lack sufficient robustness against context perturbations. In addition, we propose a simple yet effective method for remitting this issue.


title: uxSense: Supporting User Experience Analysis with Visualization and Computer Vision

abstract: Analyzing user behavior from usability evaluation can be a challenging and time-consuming task, especially as the number of participants and the scale and complexity of the evaluation grows. We propose uxSense, a visual analytics system using machine learning methods to extract user behavior from audio and video recordings as parallel time-stamped data streams. Our implementation draws on pattern recognition, computer vision, natural language processing, and machine learning to extract user sentiment, actions, posture, spoken words, and other features from such recordings. These streams are visualized as parallel timelines in a web-based front-end, enabling the researcher to search, filter, and annotate data across time and space. We present the results of a user study involving professional UX researchers evaluating user data using uxSense. In fact, we used uxSense itself to evaluate their sessions.


title: Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models

abstract: Humans often interact with large language models (LLMs) in multi-turn interaction to obtain desired answers or more information. However, most existing studies overlook the multi-turn instruction following ability of LLMs, in terms of training dataset, training method, and evaluation benchmark. In this paper, we introduce Parrot, a solution aiming to enhance multi-turn instruction following for LLMs. First, we introduce an efficient but effective method for collecting multi-turn instructions that feature human-like queries, such as anaphora and ellipsis. Second, we propose a context-aware preference optimization strategy to further enhance LLMs for complex queries in multi-turn interaction. Moreover, to quantitatively evaluate LLMs in multi-turn instruction following, we manually build a multi-turn benchmark derived from existing ones. Extensive experiments show that Parrot improves current LLMs by up to 7.2% in multi-turn instruction following. Our dataset and codes will be open-sourced to facilitate future research.


title: Schanuel's lemma for extriangulated categories

abstract: In the context of extriangulated categories, we establish the injective version of Schanuel's lemma in homological algebra.


title: Adsorption of fragrance capsules onto cellulose nano- and micro-cellulose fibers in presence of guar biopolymers

abstract: Fabric softeners are formulated to enhance textile softness and impart a pleasant scent. One of the most efficient technologies for controlled fragrance delivery onto fabrics involves encapsulating scent molecules in polymer capsules. Here, we investigate the adsorption of anionic fragrance cap-sules on cotton fabrics with the goal of reducing the reliance on palm-oil-derived surfactants. First, we employ 200 nm-cellulose nanocrystals (CNC) as a reliable model for cotton fibers. CNC enables us to explore interactions among various softener components, including surfactants, guar biopolymers, and fragrances, using physical chemistry techniques applied to bulk dispersions. The primary objec-tive is to elucidate the role of surfactant vesicles, the primary ingredient in textile conditioners, in the association between fragrance capsules and cotton. Secondly, we examine the influence of bi-opolymers present in a newly developed, environmentally friendly softener on this association. Our findings demonstrate that anionic fragrance capsules are deposited onto cotton microfibers in the presence of either cationic surfactants or guar biopolymers, driven by electrostatic interactions. Scanning electron microscopy confirms capsule adsorption on textile fibers when these cationic in-gredients are present. Understanding the interaction mechanisms between fragrance capsules and cotton fabrics, as well as the roles played by other softener components, can facilitate the design of more efficient and sustainable formulations.


title: CAHA/PPAK Integral-field Spectroscopic Observations of M81. II. Testing Photoionization Models in A Spatially-resolved LINER

abstract: The origin of the low-ionization nuclear emission-line region (LINER) prevalent in local galaxies and its relationship with supermassive black holes are debated for decades. We preform a comprehensive evaluation of traditional photoionization models against the circumnuclear ionized gas in M81, for which recent CAHA/PPAK integral-field spectroscopic observations reveal a LINER characteristic out to a galactocentric radius of ~1 kpc. Constructed with the photoionization code cloudy, the models have the novel aspect of their primary parameters being well constrained by extensive observations of a prototypical low-luminosity active galactic nucleus (LLAGN) and an old stellar bulge in M81. Additionally, these models incorporate a reasonably broad range of uncertain nebular properties. It is found that the integrated photoionization by the LLAGN and hot, low-mass stars distributed in the bulge can roughly reproduce the observed radial intensity distributions of the Halpha, Hbeta and [N ii] lines, with the bulge stars dominating the ionizing flux at radii >~200 pc. However, the models generally fail to reproduce a similarly declining profile of the [Oiii] line or an accordingly flat profile of the [O iii]/Hbeta ratio. This clearly points to a deficiency of ionizing photons in the outer regions despite an extended photoionization source. The discrepancy might be alleviated if much of the observed [O iii] line arose from a bulge-filling, low-density gas surrounding a denser, Halpha-emitting disk, or by a higher AGN luminosity in the recent past. The case of M81 has important implications for the ionization mechanism of LINERs and low-ionization emission-line regions in general.


title: Almost sure dimensional properties for the spectrum and the density of states of Sturmian Hamiltonians

abstract: In this paper, we find a full Lebesgue measure set of frequencies $\check \II\subset [0,1]\setminus \Q$ such that for any $(\alpha,\lambda)\in \check \II\times [24,\infty)$, the Hausdorff and box dimensions of the spectrum of the Sturmian Hamiltonian $H_{\alpha,\lambda,\theta}$ coincide and are independent of $\alpha$. Denote the common value by $D(\lambda)$, we show that $D(\lambda)$ satisfies a Bowen type formula, and is locally Lipschitz. We obtain the exact asymptotic behavior of $D(\lambda)$ as $\lambda$ tends to $ \infty.$ This considerably improves the result of Damanik and Gorodetski (Comm. Math. Phys. 337, 2015). We also show that for any $(\alpha,\lambda)\in \check \II\times [24,\infty)$, the density of states measure of $H_{\alpha,\lambda,\theta}$ is exact-dimensional; its Hausdorff and packing dimensions coincide and are independent of $\alpha$. Denote the common value by $d(\lambda)$, we show that $d(\lambda)$ satisfies a Young type formula, and is Lipschitz. We obtain the exact asymptotic behavior of $d(\lambda)$ as $\lambda$ tends to $ \infty.$ During the course of study, we also answer several questions in the same paper of Damanik and Gorodetski.


title: SNOiC: Soft Labeling and Noisy Mixup based Open Intent Classification Model

abstract: This paper presents a Soft Labeling and Noisy Mixup-based open intent classification model (SNOiC). Most of the previous works have used threshold-based methods to identify open intents, which are prone to overfitting and may produce biased predictions. Additionally, the need for more available data for an open intent class presents another limitation for these existing models. SNOiC combines Soft Labeling and Noisy Mixup strategies to reduce the biasing and generate pseudo-data for open intent class. The experimental results on four benchmark datasets show that the SNOiC model achieves a minimum and maximum performance of 68.72\% and 94.71\%, respectively, in identifying open intents. Moreover, compared to state-of-the-art models, the SNOiC model improves the performance of identifying open intents by 0.93\% (minimum) and 12.76\% (maximum). The model's efficacy is further established by analyzing various parameters used in the proposed model. An ablation study is also conducted, which involves creating three model variants to validate the effectiveness of the SNOiC model.


title: Ultimate sharpness of the tunneling resonance in vertical heterostructures

abstract: Heterostructures comprised of two two-dimensional electron systems (2DES) separated by a dielectric exhibit resonant tunneling when the band structures of both systems are aligned. It is commonly assumed that the height and width of the resonant peak in the tunneling current is determined by electron scattering and rotational misalignment of crystal structures of the 2DES. We identify two fundamental factors limiting the maximum height and steepness of the resonance: coupling to contacts and tunnel splitting of energy levels. The upper limit of the tunneling current is the number of electrons available for tunneling times half the tunnel coupling between the 2DES. As a result of a tradeoff between the contact-induced level broadening and contact resistance, the maximum current is only achievable when the coupling to contacts equals the tunnel level splitting. According to our model calculations, the limiting behavior can be observed in double-gated graphene/few-layer hexagonal boron nitride/graphene heterostructures.


title: Flow evolution in particle-laden Rayleigh-B\'enard convection

abstract: A theoretical analysis is carried out to study flow evolution inside the laminar Rayleigh-B\'enard convection system laden with small particles. By describing particle dynamics and particle heat as sources of drag and heat respectively, the physics of particle impact on the flow evolution is studied. It is found that due to the relative velocity of the particulate phase to the fluid phase, particles work as a superimposed moment on the whole flow, attenuating the flow intensity. When the relative temperature of the particulate phase to the fluid phase occurs, particles act like a superimposed moment of buoyancy force on the whole flow, causing alterations in both flow intensity and flow direction.


title: Fluorescence enhancement in topologically optimized gallium phosphide all-dielectric nanoantennas

abstract: Nanoantennas capable of large fluorescence enhancement with minimal absorption are crucial for future optical technologies from single-photon sources to biosensing. Efficient dielectric nanoantennas have been designed, however, evaluating their performance at the individual emitter level is challenging due to the complexity of combining high-resolution nanofabrication, spectroscopy and nanoscale positioning of the emitter. Here, we study the fluorescence enhancement in infinity-shaped gallium phosphide (GaP) nanoantennas based on a topologically optimized design. Using fluorescence correlation spectroscopy (FCS), we probe the nanoantennas enhancement factor and observed an average of 63-fold fluorescence brightness enhancement with a maximum of 93-fold for dye molecules in nanogaps between 20 nm and 50 nm. The experimentally determined fluorescence enhancement of the nanoantennas was confirmed by numerical simulations of the local density of optical states (LDOS). Furthermore, we show that beyond design optimisation of dielectric nanoantennas, increased performances can be achieved via tailoring of nanoantenna fabrication.


title: Deep Aramaic: Towards a Synthetic Data Paradigm Enabling Machine Learning in Epigraphy

abstract: Epigraphy increasingly turns to modern artificial intelligence (AI) technologies such as machine learning (ML) for extracting insights from ancient inscriptions. However, scarce labeled data for training ML algorithms severely limits current techniques, especially for ancient scripts like Old Aramaic. Our research pioneers an innovative methodology for generating synthetic training data tailored to Old Aramaic letters. Our pipeline synthesizes photo-realistic Aramaic letter datasets, incorporating textural features, lighting, damage, and augmentations to mimic real-world inscription diversity. Despite minimal real examples, we engineer a dataset of 250,000 training and 25,000 validation images covering the 22 letter classes in the Aramaic alphabet. This comprehensive corpus provides a robust volume of data for training a residual neural network (ResNet) to classify highly degraded Aramaic letters. The ResNet model demonstrates high accuracy in classifying real images from the 8th century BCE Hadad statue inscription. Additional experiments validate performance on varying materials and styles, proving effective generalization. Our results validate the model's capabilities in handling diverse real-world scenarios, proving the viability of our synthetic data approach and avoiding the dependence on scarce training data that has constrained epigraphic analysis. Our innovative framework elevates interpretation accuracy on damaged inscriptions, thus enhancing knowledge extraction from these historical resources.


title: Reissner-Nordstr\"om black holes in de Sitter space-time: bounds with quasinormal frequencies

abstract: Rich physics can be divined from charged black holes subjected to extremal conditions. When applied in conjunction with principles like Weak Cosmic Censorship, this naturally leads to constraints on the mass and charge of the black hole. However, more nuanced principles such as the Weak Gravity Conjecture (WGC) and the recently proposed Festina-Lente (FL) bound can provide, respectively, upper and lower bounds on elementary charged particles. In this study, we examine the quasinormal modes (QNMs) exhibited by a massive scalar test field carrying an electric charge, oscillating in the outer region of the black hole. These modes are subjected to the constraints imposed by the FL and WGC bounds. Our analysis provides insight into the behaviour of QNMs, particularly in regions that approach the extremal conditions of the black hole. Notably, in these regimes, the stability of the modes becomes precarious, particularly in the presence of a positive cosmological constant. The implications of our findings are far-reaching and significant. They extend from safeguarding the principles of cosmic censorship to addressing the structural stability of the black hole's interior. Our semi-classical analysis presents compelling evidence suggesting that Strong Cosmic Censorship may be violated for black holes that are in close proximity to extremality within the context of Reissner-Nordstr\"om-de Sitter (RNdS) geometries.


title: Diffusion Models for Wireless Communications

abstract: Innovative foundation models, such as GPT-4 and stable diffusion models, have made a paradigm shift in the realm of artificial intelligence (AI) towards generative AI-based systems. AI and machine learning (AI/ML) algorithms are envisioned to be pervasively incorporated into the future wireless communications systems. In this article, we outline the applications of diffusion models in wireless communication systems, which are a new family of probabilistic generative models that have showcased state-of-the-art performance. The key idea is to decompose data generation process over "denoising" steps, gradually generating samples out of noise. Based on two case studies presented, we show how diffusion models can be employed for the development of resilient AI-native communication systems. Specifically, we propose denoising diffusion probabilistic models (DDPM) for a wireless communication scheme with non-ideal transceivers, where 30% improvement is achieved in terms of bit error rate. In the other example, DDPM is employed at the transmitter to shape the constellation symbols, highlighting a robust out-of-distribution performance.


title: Molecule-Edit Templates for Efficient and Accurate Retrosynthesis Prediction

abstract: Retrosynthesis involves determining a sequence of reactions to synthesize complex molecules from simpler precursors. As this poses a challenge in organic chemistry, machine learning has offered solutions, particularly for predicting possible reaction substrates for a given target molecule. These solutions mainly fall into template-based and template-free categories. The former is efficient but relies on a vast set of predefined reaction patterns, while the latter, though more flexible, can be computationally intensive and less interpretable. To address these issues, we introduce METRO (Molecule-Edit Templates for RetrOsynthesis), a machine-learning model that predicts reactions using minimal templates - simplified reaction patterns capturing only essential molecular changes - reducing computational overhead and achieving state-of-the-art results on standard benchmarks.


title: Adaptive and Gamified Learning Paths with Polyglot and .NET Interactive

abstract: The digital age is changing the role of educators and pushing for a paradigm shift in the education system as a whole. Growing demand for general and specialized education inside and outside classrooms is at the heart of this rising trend. In modern, heterogeneous learning environments, the one-size-fits-all approach is proven to be fundamentally flawed. Individualization through adaptivity is, therefore, crucial to nurture individual potential and address accessibility needs and neurodiversity. By formalizing a learning framework that takes into account all these different aspects, we aim to define and implement an open, content-agnostic, and extensible platform to design and consume adaptive and gamified learning experiences.


title: Consistency of some sequential experimental design strategies for excursion set estimation based on vector-valued Gaussian processes

abstract: We tackle the extension to the vector-valued case of consistency results for Stepwise Uncertainty Reduction sequential experimental design strategies established in [Bect et al., A supermartingale approach to Gaussian process based sequential design of experiments, Bernoulli 25, 2019]. This lead us in the first place to clarify, assuming a compact index set, how the connection between continuous Gaussian processes and Gaussian measures on the Banach space of continuous functions carries over to vector-valued settings. From there, a number of concepts and properties from the aforementioned paper can be readily extended. However, vector-valued settings do complicate things for some results, mainly due to the lack of continuity for the pseudo-inverse mapping that affects the conditional mean and covariance function given finitely many pointwise observations. We apply obtained results to the Integrated Bernoulli Variance and the Expected Measure Variance uncertainty functionals employed in [Fossum et al., Learning excursion sets of vector-valued Gaussian random fields for autonomous ocean sampling, The Annals of Applied Statistics 15, 2021] for the estimation for excursion sets of vector-valued functions.


title: Magnitude-and-phase-aware Speech Enhancement with Parallel Sequence Modeling

abstract: In speech enhancement (SE), phase estimation is important for perceptual quality, so many methods take clean speech's complex short-time Fourier transform (STFT) spectrum or the complex ideal ratio mask (cIRM) as the learning target. To predict these complex targets, the common solution is to design a complex neural network, or use a real network to separately predict the real and imaginary parts of the target. But in this paper, we propose to use a real network to estimate the magnitude mask and normalized cIRM, which not only avoids the significant increase of the model complexity caused by complex networks, but also shows better performance than previous phase estimation methods. Meanwhile, we devise a parallel sequence modeling (PSM) block to improve the RNN block in the convolutional recurrent network (CRN)-based SE model. We name our method as magnitude-and-phase-aware and PSM-based CRN (MPCRN). The experimental results illustrate that our MPCRN has superior SE performance.


title: Fuss-Catalan Triangles

abstract: For each $p>0$ we define by recurrence a triangle $T^p(n,k)$ whose rows sum to the Fuss-Catalan numbers $ \frac{1}{p n+1}\binom{pn+1}{n}$, generalizing the known Catalan triangle corresponding to the case $p=2$. (In fact, $T^p(n,k)$ has an explicit formula counting simple lattice paths). Moreover, for some small values of $p$, the signed sums turn out to be known sequences. \end{abstract}


title: On generalization of duality formulas for the Arakawa-Kaneko type zeta functions

abstract: Kaneko and Tsumura introduced the Arakawa-Kaneko type zeta function $\eta(-k_1,\ldots,-k_r;s_1,\ldots,s_r)$ for non-negative integers $k_1,\ldots,k_r$ and complex variables $s_1,\ldots,s_r$. Recently, Yamamoto showed that, by using the multiple integral expression, $\eta(u_1,\ldots,u_r;s_1,\ldots,s_r)$ can be extended to an analytic function of 2$r$ variables. Also, he showed that the function $\eta(u_1,\ldots,u_r;s_1,\ldots,s_r)$ satisfies a duality formula. In this paper, by using the a generalization of non-strict multi-indexed polylogarithm, we define a kind of Arakawa-Kaneko type zeta function, and show that this function satisfies a certain duality formula.


title: Well-posedness and regularity of mean-field backward doubly stochastic Volterra integral equations and applications to dynamic risk measures

abstract: In this paper, the theory of mean-field backward doubly stochastic Volterra integral equations (MF-BDSVIEs) is studied. First, we derive the well-posedness of M-solutions to MFBDSVIEs, and prove the comparison theorem for such a type of equations. Furthermore, the regularity result of the M-solution for MF-BDSVIEs is established by virtue of Malliavin calculus. Finally, as an application of the comparison theorem, we obtain the properties of dynamic risk measures governed by MF-BDSVIEs.


title: Byzantine-Resilient Decentralized Multi-Armed Bandits

abstract: In decentralized cooperative multi-armed bandits (MAB), each agent observes a distinct stream of rewards, and seeks to exchange information with others to select a sequence of arms so as to minimize its regret. Agents in the cooperative setting can outperform a single agent running a MAB method such as Upper-Confidence Bound (UCB) independently. In this work, we study how to recover such salient behavior when an unknown fraction of the agents can be Byzantine, that is, communicate arbitrarily wrong information in the form of reward mean-estimates or confidence sets. This framework can be used to model attackers in computer networks, instigators of offensive content into recommender systems, or manipulators of financial markets. Our key contribution is the development of a fully decentralized resilient upper confidence bound (UCB) algorithm that fuses an information mixing step among agents with a truncation of inconsistent and extreme values. This truncation step enables us to establish that the performance of each normal agent is no worse than the classic single-agent UCB1 algorithm in terms of regret, and more importantly, the cumulative regret of all normal agents is strictly better than the non-cooperative case, provided that each agent has at least 3f+1 neighbors where f is the maximum possible Byzantine agents in each agent's neighborhood. Extensions to time-varying neighbor graphs, and minimax lower bounds are further established on the achievable regret. Experiments corroborate the merits of this framework in practice.


title: On the Impact of Cross-Domain Data on German Language Models

abstract: Traditionally, large language models have been either trained on general web crawls or domain-specific data. However, recent successes of generative large language models, have shed light on the benefits of cross-domain datasets. To examine the significance of prioritizing data diversity over quality, we present a German dataset comprising texts from five domains, along with another dataset aimed at containing high-quality data. Through training a series of models ranging between 122M and 750M parameters on both datasets, we conduct a comprehensive benchmark on multiple downstream tasks. Our findings demonstrate that the models trained on the cross-domain dataset outperform those trained on quality data alone, leading to improvements up to $4.45\%$ over the previous state-of-the-art. The models are available at https://huggingface.co/ikim-uk-essen


title: A webcam-based machine learning approach for three-dimensional range of motion evaluation

abstract: Background. Joint range of motion (ROM) is an important quantitative measure for physical therapy. Commonly relying on a goniometer, accurate and reliable ROM measurement requires extensive training and practice. This, in turn, imposes a significant barrier for those who have limited in-person access to healthcare. Objective. The current study presents and evaluates an alternative machine learning-based ROM evaluation method that could be remotely accessed via a webcam. Methods. To evaluate its reliability, the ROM measurements for a diverse set of joints (neck, spine, and upper and lower extremities) derived using this method were compared to those obtained from a marker-based optical motion capture system. Results. Data collected from 25 healthy adults demonstrated that the webcam solution exhibited high test-retest reliability, with substantial to almost perfect intraclass correlation coefficients for most joints. Compared with the marker-based system, the webcam-based system demonstrated substantial to almost perfect inter-rater reliability for some joints, and lower inter-rater reliability for other joints (e.g., shoulder flexion and elbow flexion), which could be attributed to the reduced sensitivity to joint locations at the apex of the movement. Conclusions. The proposed webcam-based method exhibited high test-retest and inter-rater reliability, making it a versatile alternative for existing ROM evaluation methods in clinical practice and the tele-implementation of physical therapy and rehabilitation.


title: Multichannel consecutive data cross-extraction with 1DCNN-attention for diagnosis of power transformer

abstract: Power transformer plays a critical role in grid infrastructure, and its diagnosis is paramount for maintaining stable operation. However, the current methods for transformer diagnosis focus on discrete dissolved gas analysis, neglecting deep feature extraction of multichannel consecutive data. The unutilized sequential data contains the significant temporal information reflecting the transformer condition. In light of this, the structure of multichannel consecutive data cross-extraction (MCDC) is proposed in this article in order to comprehensively exploit the intrinsic characteristic and evaluate the states of transformer. Moreover, for the better accommodation in scenario of transformer diagnosis, one dimensional convolution neural network attention (1DCNN-attention) mechanism is introduced and offers a more efficient solution given the simplified spatial complexity. Finally, the effectiveness of MCDC and the superior generalization ability, compared with other algorithms, are validated in experiments conducted on a dataset collected from real operation cases of power transformer. Additionally, the better stability of 1DCNN-attention has also been certified.


title: Guided Attention for Interpretable Motion Captioning

abstract: While much effort has been invested in generating human motion from text, relatively few studies have been dedicated to the reverse direction, that is, generating text from motion. Much of the research focuses on maximizing generation quality without any regard for the interpretability of the architectures, particularly regarding the influence of particular body parts in the generation and the temporal synchronization of words with specific movements and actions. This study explores the combination of movement encoders with spatio-temporal attention models and proposes strategies to guide the attention during training to highlight perceptually pertinent areas of the skeleton in time. We show that adding guided attention with adaptive gate leads to interpretable captioning while improving performance compared to higher parameter-count non-interpretable SOTA systems. On the KIT MLD dataset, we obtain a BLEU@4 of 24.4% (SOTA+6%), a ROUGE-L of 58.30% (SOTA +14.1%), a CIDEr of 112.10 (SOTA +32.6) and a Bertscore of 41.20% (SOTA +18.20%). On HumanML3D, we obtain a BLEU@4 of 25.00 (SOTA +2.7%), a ROUGE-L score of 55.4% (SOTA +6.1%), a CIDEr of 61.6 (SOTA -10.9%), a Bertscore of 40.3% (SOTA +2.5%). Our code implementation and reproduction details will be soon available at https://github.com/rd20karim/M2T-Interpretable/tree/main.


title: An Adversarial Example for Direct Logit Attribution: Memory Management in gelu-4l

abstract: How do language models deal with the limited bandwidth of the residual stream? Prior work has suggested that some attention heads and MLP layers may perform a "memory management" role. That is, clearing residual stream directions set by earlier layers by reading in information and writing out the negative version. In this work, we present concrete evidence for this phenomenon in a 4-layer transformer. We identify several heads in layer 2 that consistently remove the output of a single layer 0 head. We then verify that this erasure causally depends on the original written direction. We further demonstrate that direct logit attribution (DLA) suggests that writing and erasing heads directly contribute to predictions, when in fact their effects cancel out. Then we present adversarial prompts for which this effect is particularly salient. These findings reveal that memory management can make DLA results misleading. Accordingly, we make concrete recommendations for circuit analysis to prevent interpretability illusions.


title: Empirical Analysis of the Impact of Legal Tender Digital Currency on Monetary Policy -Based on China's Data

abstract: This paper takes the development of China's Central bank digital currencies as a perspective, theoretically analyses the impact mechanism of the issuance and circulation of Central bank digital currencies on China's monetary policy and various variables of the money multiplier; at the same time, it selects the quarterly data from 2010 to 2022, and examines the impact of the Central bank digital currencies on the money supply multiplier through the establishment of the VECM model. The research results show that: the issuance of China's Central bank digital currencies will have an impact on the effectiveness of monetary policy and intermediary indicators; and have a certain positive impact on the narrow money multiplier and broad money multiplier. Based on theoretical analyses and empirical tests, this paper proposes that China should explore a more effective monetary policy in the context of Central bank digital currencies in the future on the premise of steadily promoting the development of Central bank digital currencies.


title: Code Polymorphism Meets Code Encryption: Confidentiality and Side-Channel Protection of Software Components

abstract: In this paper, we consider that, in practice, attack scenarios involving side-channel analysis combine two successive phases:an analysis phase, targeting the extraction of information about the target and the identification of possible vulnerabilities;and an exploitation phase, applying attack techniques on candidate vulnerabilities. We advocate that protections need to coverthese two phases in order to be effective against real-life attacks. We present PolEn, a toolchain and a processor architecturethat combine countermeasures in order to provide an effective mitigation of side-channel attacks: as a countermeasure againstthe analysis phase, our approach considers the use of code encryption; as a countermeasure against the exploitation phase,our approach considers the use of code polymorphism, because it relies on runtime code generation, and its combinationwith code encryption is particularly challenging. Code encryption is supported by a processor extension such that machineinstructions are only decrypted inside the CPU, which effectively prevents reverse engineering or any extraction of usefulinformation from memory dumps. Code polymorphism is implemented by software means. It regularly changes the observablebehaviour of the program, making it unpredictable for an attacker, hence reducing the possibility to exploit side-channelleakages. We present a prototype implementation, based on the RISC-V Spike simulator and a modified LLVM toolchain. Inour experimental evaluation, we illustrate that PolEn effectively reduces side-channel leakages. For the protected functionsevaluated, static memory use increases by a factor of 5 to 22, corresponding to the joint application of code encryption andcode polymorphism. The overhead, in terms of execution time, ranges between a factor of 1.8 and 4.6.


title: An Empirical Study of Instruction-tuning Large Language Models in Chinese

abstract: The success of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI). Subsequently, the release of LLMs has sparked the open-source community's interest in instruction-tuning, which is deemed to accelerate ChatGPT's replication process. However, research on instruction-tuning LLMs in Chinese, the world's most spoken language, is still in its early stages. Therefore, this paper makes an in-depth empirical study of instruction-tuning LLMs in Chinese, which can serve as a cookbook that provides valuable findings for effectively customizing LLMs that can better respond to Chinese instructions. Specifically, we systematically explore the impact of LLM bases, parameter-efficient methods, instruction data types, which are the three most important elements for instruction-tuning. Besides, we also conduct experiment to study the impact of other factors, e.g., chain-of-thought data and human-value alignment. We hope that this empirical study can make a modest contribution to the open Chinese version of ChatGPT. This paper will release a powerful Chinese LLMs that is comparable to ChatGLM. The code and data are available at https://github.com/PhoebusSi/Alpaca-CoT.


title: Magnetic State Control of Non-van der Waals 2D Materials by Hydrogenation

abstract: Controlling the magnetic state of two-dimensional (2D) materials is crucial for spintronic applications. By employing data-mining and autonomous density functional theory calculations, we demonstrate the switching of magnetic properties of 2D non-van der Waals materials upon hydrogen passivation. The magnetic configurations are tuned to states with flipped and enhanced moments. For 2D CdTiO$_3$ - a nonmagnetic compound in the pristine case - we observe an onset of ferromagnetism upon hydrogenation. Further investigation of the magnetization density of the pristine and passivated systems provides a detailed analysis of modified local spin symmetries and the emergence of ferromagnetism. Our results indicate that selective surface passivation is a powerful tool for tailoring magnetic properties of nanomaterials such as non-vdW 2D compounds.


title: Functional Generalized Canonical Correlation Analysis for studying multiple longitudinal variables

abstract: In this paper, we introduce Functional Generalized Canonical Correlation Analysis (FGCCA), a new framework for exploring associations between multiple random processes observed jointly. The framework is based on the multiblock Regularized Generalized Canonical Correlation Analysis (RGCCA) framework. It is robust to sparsely and irregularly observed data, making it applicable in many settings. We establish the monotonic property of the solving procedure and introduce a Bayesian approach for estimating canonical components. We propose an extension of the framework that allows the integration of a univariate or multivariate response into the analysis, paving the way for predictive applications. We evaluate the method's efficiency in simulation studies and present a use case on a longitudinal dataset.


title: Asymptotically stable Particle-in-Cell methods for the magnetized Vlasov--Poisson equations in orthogonal curvilinear coordinates

abstract: In high-temperature plasma physics, a strong magnetic field is usually used to confine charged particles. Therefore, for studying the classical mathematical models of the physical problems it needs to consider the effect of external magnetic fields. One of the important model equations in plasma is the Vlasov-Poisson equation with an external magnetic field. This equation usually has multi-scale characteristics and rich physical properties, thus it is very important and meaningful to construct numerical methods that can maintain the physical properties inherited by the original systems over long time. This paper extends the corresponding theory in Cartesian coordinates to general orthogonal curvilinear coordinates, and proves that a Poisson-bracket structure can still be obtained after applying the corresponding finite element discretization. However, the Hamiltonian systems in the new coordinate systems generally cannot be decomposed into sub-systems that can be solved accurately, so it is impossible to use the splitting methods to construct the corresponding geometric integrators. Therefore, this paper proposes a semi-implicit method for strong magnetic fields and analyzes the asymptotic stability of this method.


title: Dust Coagulation Reconciles Protoplanetary Disk Observations with the Vertical Shear Instability. I. Dust Coagulation and the VSI Dead Zone

abstract: Protoplanetary disks exhibit a vertical gradient in angular momentum, rendering them susceptible to the Vertical Shear Instability (VSI). The most important condition for the onset of this mechanism is a short timescale of thermal relaxation ($\lesssim 0.1$ orbital timescales). Simulations of fully VSI active disks are characterized by turbulent, vertically extended dust layers. This is in contradiction with recent observations of the outer regions of some protoplanetary disks, which appear highly settled. In this work, we demonstrate that the process of dust coagulation can diminish the cooling rate of the gas in the outer disk and extinct the VSI activity. Our findings indicate that the turbulence strength is especially susceptible to variations in the fragmentation velocity of the grains. A small fragmentation velocity of $\approx 100 \mathrm{\, cm \,s^{-1}}$ results in a fully turbulent simulation, whereas a value of $\approx 400 \mathrm{\, cm \,s^{-1}}$ results in a laminar outer disk, being consistent with observations. We show that VSI turbulence remains relatively unaffected by variations in the maximum particle size in the inner disk regions. However, we find that dust coagulation can significantly suppress the occurrence of VSI turbulence at larger distances from the central star.


title: Computing approximate roots of monotone functions

abstract: Given a function f: [a,b] -> R, if f(a) < 0 and f(b)> 0 and f is continuous, the Intermediate Value Theorem implies that f has a root in [a,b]. Moreover, given a value-oracle for f, an approximate root of f can be computed using the bisection method, and the number of required evaluations is polynomial in the number of accuracy digits. The goal of this note is to identify conditions under which this polynomiality result extends to a multi-dimensional function that satisfies the conditions of Miranda's theorem -- the natural multi-dimensional extension of the Intermediate Value Theorem. In general, finding an approximate root might require an exponential number of evaluations even for a two-dimensional function. We show that, if f is two-dimensional and satisfies a single monotonicity condition, then the number of required evaluations is polynomial in the accuracy. For any fixed dimension d, if f is a d-dimensional function that satisfies all d^2-d ``ex-diagonal'' monotonicity conditions (that is, component i of f is monotonically decreasing with respect to variable j for all i!=j), then the number of required evaluations is polynomial in the accuracy. But if f satisfies only d^2-d-2 ex-diagonal conditions, then the number of required evaluations may be exponential in the accuracy. The case of d^2-d-1 ex-diagonal conditions remains unsolved. As an example application, we show that computing approximate roots of monotone functions can be used for approximate envy-free cake-cutting.


title: Multi-Scale Dynamics of the Interaction Between Waves and Mean Flows: From Nonlinear WKB Theory to Gravity-Wave Parameterizations in Weather and Climate Models

abstract: The interaction between small-scale waves and a larger-scale flow can be described by a multi-scale theory that forms the basis for a new class of parameterizations of subgrid-scale gravity waves (GW) in weather and climate models. The development of this theory is reviewed here. It applies to all interesting regimes of atmospheric stratification, i.e. also to moderately strong stratification as occurring in the middle atmosphere, and thereby extends classic assumptions for the derivation of quasi-geostrophic theory. At strong wave amplitudes a fully nonlinear theory arises that is complemented by a quasilinear theory for weak GW amplitudes. The latter allows the extension to a spectral description that forms the basis of numerical implementations that avoid instabilities due to caustics, e.g. from GW reflection. Conservation properties are discussed, for energy and potential vorticity, as well as conditions under which a GW impact on the larger-scale flow is possible. The numerical implementation of the theory for GW parameterizations in atmospheric models is described, and the consequences of the approach are discussed, as compared to classic GW parameterizations. Although more costly than the latter, it exhibits significantly enhanced realism, while being considerably more efficient than an approach where all relevant GWs are to be resolved. The reported theory and its implementation might be of interest also for the efficient and conceptually insightful description of other wave-mean interactions, including those where the formation of caustics presents a special challenge.


title: Exploring Social Motion Latent Space and Human Awareness for Effective Robot Navigation in Crowded Environments

abstract: This work proposes a novel approach to social robot navigation by learning to generate robot controls from a social motion latent space. By leveraging this social motion latent space, the proposed method achieves significant improvements in social navigation metrics such as success rate, navigation time, and trajectory length while producing smoother (less jerk and angular deviations) and more anticipatory trajectories. The superiority of the proposed method is demonstrated through comparison with baseline models in various scenarios. Additionally, the concept of humans' awareness towards the robot is introduced into the social robot navigation framework, showing that incorporating human awareness leads to shorter and smoother trajectories owing to humans' ability to positively interact with the robot.


title: Numerical Simulation Study of Neutron-Proton Scattering using Phase Function Method

abstract: In this article, we propose a numerical approach to solve quantum mechanical scattering problems, using phase function method, by considering neutron-proton interaction as an example. The nonlinear phase equation, obtained from the time-independent Schrodinger equation, is solved using the Runge-Kutta method for obtaining S-wave scattering phase shifts for neutron-proton interaction modeled using Yukawa and Malfliet-Tjon potentials. While scattering phase shifts of S-states using Yukawa match with experimental data for only lower energies of 50 MeV, Malfliet-Tjon potential with repulsive term gives very good accuracy for all available energies up to 350 MeV. Utilizing these S-wave scattering phase shifts, low energy scattering parameters, and total S-wave cross section have been calculated and found to be consistent with experimental results. This simulation methodology can be easily extended to study scattering phenomenon using phase wave analysis approach in the realms of atomic, molecular, and nuclear physics.


title: On Penrose's Analogy between Curved Spacetime Regions and Optical Lenses

abstract: We present a detailed analysis of Penrose's gravito-optical analogy between the focusing effects of particular families of Ricci- and Weyl-curved spacetime regions on the one hand, and anastigmatic and astigmatic optical lenses on the other. We put the analogy in its historical context, investigate its underlying assumptions, its range of validity, its proof of concept, and its application in Penrose's study of the notion of energy flux in general relativity. Finally, we examine the analogy within the framework of Norton's material theory of induction.


title: Towards Foundation Models for Learning on Tabular Data

abstract: Learning on tabular data underpins numerous real-world applications. Despite considerable efforts in developing effective learning models for tabular data, current transferable tabular models remain in their infancy, limited by either the lack of support for direct instruction following in new tasks or the neglect of acquiring foundational knowledge and capabilities from diverse tabular datasets. In this paper, we propose Tabular Foundation Models (TabFMs) to overcome these limitations. TabFMs harness the potential of generative tabular learning, employing a pre-trained large language model (LLM) as the base model and fine-tuning it using purpose-designed objectives on an extensive range of tabular datasets. This approach endows TabFMs with a profound understanding and universal capabilities essential for learning on tabular data. Our evaluations underscore TabFM's effectiveness: not only does it significantly excel in instruction-following tasks like zero-shot and in-context inference, but it also showcases performance that approaches, and in instances, even transcends, the renowned yet mysterious closed-source LLMs like GPT-4. Furthermore, when fine-tuning with scarce data, our model achieves remarkable efficiency and maintains competitive performance with abundant training data. Finally, while our results are promising, we also delve into TabFM's limitations and potential opportunities, aiming to stimulate and expedite future research on developing more potent TabFMs.


title: New strategies to improve the sensitivity of the ANAIS-112 experiment at the Canfranc Underground Laboratory

abstract: The goal of the ANAIS-112 experiment, which operates at LSC, is to test in a model independent way the DAMA/LIBRA positive signal using the same target (NaI(Tl) crystals) and technique. Several strategies have been followed in this work to improve the sensitivity of the ANAIS-112 experiment. The Quenching Factor (QF) is a key factor in the comparison between different experiments. It has been determined both for iodine and sodium nuclear recoils in 5 crystals, for the first time in the same setup and using the same analysis protocol. Compatible values have been obtained for all of them. The calibration method in electron equivalent energy has proved to be critical in the QF estimation and allows understanding the discrepancies between previous measurements, but not concluding if the sodium QF is constant with energy or it increases up to about 80 keVnr. Therefore, further work is required to understand the conversion of the energy deposited in NaI(Tl) into light by different particles, as it is essential to develop a model for the QF. As a first step in an effort to understand the origin of some of the spurious event populations observed in the experiment, a GEANT4 simulation of an ANAIS-112 module has been developed including optical light emission and propagation after an energy deposit. Finally, the possibility of improving the sensitivity of NaI scintillators by replacing Photomultiplier Tubes with Silicon Photomultipliers as light sensors has been studied. These detectors offer very interesting opportunities within the new project ANAIS+. In this work we have characterized SiPMs from different manufacturers, established measurement protocols for the most relevant parameters, studied the properties of NaI and NaI(Tl) crystals at different temperatures and designed NaI+SiPM prototypes that will allow us to evaluate the limitations and opportunities of this new technology.


title: Tame deformations of highly singular function germs

abstract: We give analytic and algebraic conditions under which a deformation of real analytic functions with non-isolated singular locus are locally topologically trivial at the boundary.


title: Spectroscopy of hadrons with heavy quarks from lattice QCD

abstract: Lattice QCD results on hadrons with heavy quarks are briefly reviewed. The focus is on the spectrum of conventional and exotic hadrons. Structure of certain conventional hadrons is addressed as well.


title: Training and Onboarding initiatives in High Energy Physics experiments

abstract: In this paper we document the current analysis software training and onboarding activities in several High Energy Physics (HEP) experiments: ATLAS, CMS, LHCb, Belle II and DUNE. Fast and efficient onboarding of new collaboration members is increasingly important for HEP experiments as analyses and the related software become ever more complex with growing datasets. A meeting series was held by the HEP Software Foundation (HSF) in 2022 for experiments to showcase their initiatives. Here we document and analyse these in an attempt to determine a set of key considerations for future experiments.


title: How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances

abstract: Although large language models (LLMs) are impressive in solving various tasks, they can quickly be outdated after deployment. Maintaining their up-to-date status is a pressing concern in the current era. This paper provides a comprehensive review of recent advances in aligning LLMs with the ever-changing world knowledge without re-training from scratch. We categorize research works systemically and provide in-depth comparisons and discussion. We also discuss existing challenges and highlight future directions to facilitate research in this field. We release the paper list at https://github.com/hyintell/awesome-refreshing-llms


title: Probing solutions to the $S_8$ tension with galaxy clustering

abstract: The current discrepancy between the CMB and weak lensing measurements of the amplitude of matter fluctuations, the so-called $S_8$ tension, has attracted a great deal of recent attention, as it may show a crack in the $\Lambda$CDM model of cosmology. We review the evidence for this tension and describe potential solutions, focusing on extensions of the standard cosmological model, including interacting dark energy and modified gravity. We present a likelihood analysis of the BOSS DR12 data, probing these alternative models as well as $\Lambda$CDM. From this analysis, we show hints of non-standard cosmology compatible with those seen in weak lensing observations, demonstrating that interacting dark energy or modified gravity can explain them successfully. We then discuss the robustness of these results to analysis choices, as well as future paths to confirm them with additional data and further distinguish between models.


title: Investigating the Effect of Language Models in Sequence Discriminative Training for Neural Transducers

abstract: In this work, we investigate the effect of language models (LMs) with different context lengths and label units (phoneme vs. word) used in sequence discriminative training for phoneme-based neural transducers. Both lattice-free and N-best-list approaches are examined. For lattice-free methods with phoneme-level LMs, we propose a method to approximate the context history to employ LMs with full-context dependency. This approximation can be extended to arbitrary context length and enables the usage of word-level LMs in lattice-free methods. Moreover, a systematic comparison is conducted across lattice-free and N-best-list-based methods. Experimental results on Librispeech show that using the word-level LM in training outperforms the phoneme-level LM. Besides, we find that the context size of the LM used for probability computation has a limited effect on performance. Moreover, our results reveal the pivotal importance of the hypothesis space quality in sequence discriminative training.


title: Preliminary Results of a Scientometric Analysis of the German Information Retrieval Community 2020-2023

abstract: The German Information Retrieval community is located in two different sub-fields: Information and computer science. There are no current studies that investigate these communities on a scientometric level. Available studies only focus on the information scientific part of the community. We generated a data set of 401 recent IR-related publications extracted from six core IR conferences from a mainly computer scientific background. We analyze this data set at the institutional and researcher level. The data set is publicly released, and we also demonstrate a mapping use case.


title: Fast-ELECTRA for Efficient Pre-training

abstract: ELECTRA pre-trains language models by detecting tokens in a sequence that have been replaced by an auxiliary model. Although ELECTRA offers a significant boost in efficiency, its potential is constrained by the training cost brought by the auxiliary model. Notably, this model, which is jointly trained with the main model, only serves to assist the training of the main model and is discarded post-training. This results in a substantial amount of training cost being expended in vain. To mitigate this issue, we propose Fast-ELECTRA, which leverages an existing language model as the auxiliary model. To construct a learning curriculum for the main model, we smooth its output distribution via temperature scaling following a descending schedule. Our approach rivals the performance of state-of-the-art ELECTRA-style pre-training methods, while significantly eliminating the computation and memory cost brought by the joint training of the auxiliary model. Our method also reduces the sensitivity to hyper-parameters and enhances the pre-training stability.


title: Semantic Association Rule Learning from Time Series Data and Knowledge Graphs

abstract: Digital Twins (DT) are a promising concept in cyber-physical systems research due to their advanced features including monitoring and automated reasoning. Semantic technologies such as Knowledge Graphs (KG) are recently being utilized in DTs especially for information modelling. Building on this move, this paper proposes a pipeline for semantic association rule learning in DTs using KGs and time series data. In addition to this initial pipeline, we also propose new semantic association rule criterion. The approach is evaluated on an industrial water network scenario. Initial evaluation shows that the proposed approach is able to learn a high number of association rules with semantic information which are more generalizable. The paper aims to set a foundation for further work on using semantic association rule learning especially in the context of industrial applications.


title: Group theoretic approach to cyclic cubic fields

abstract: Let (k1,k2,k3,k4) be a quartet of cyclic cubic number fields sharing a common conductor c=pqr divisible by exactly three prime(power)s p,q,r. For those components k of the quartet whose 3-class group Cl(3,k) = Z/3Z x Z/3Z is elementary bicyclic, the automorphism group M = Gal(F(3,2,k)/k) of the maximal metabelian unramified 3-extension of k is determined by conditions for cubic residue symbols between p,q,r and for ambiguous principal ideals in subfields of the common absolute 3-genus field k* of k1,k2,k3,k4. With the aid of the relation rank d2(M), it is decided whether M coincides with the Galois group G = Gal(F(3,infinity,k)/k) of the maximal unramified pro-3-extension of k.


title: Choosing optimal parameters for a distributed multi-constrained QoS routing

abstract: We consider several basic questions on distributed routing in directed graphs with multiple additive costs, or metrics, and multiple constraints. Distributed routing in this sense is used in several protocols, such as IS-IS and OSPF. A practical approach to the multi-constraint routing problem is to, first, combine the metrics into a single `composite' metric, and then apply one-to-all shortest path algorithms, e.g. Dijkstra, in order to find shortest path trees. We show that, in general, even if a feasible path exists and is known for every source and destination pair, it is impossible to guarantee a distributed routing under several constraints. We also study the question of choosing the optimal `composite' metric. We show that under certain mathematical assumptions we can efficiently find a convex combination of several metrics that maximizes the number of discovered feasible paths. Sometimes it can be done analytically, and is in general possible using what we call a 'smart iterative approach'. We illustrate these findings by extensive experiments on several typical network topologies.


title: Atom-Motif Contrastive Transformer for Molecular Property Prediction

abstract: Recently, Graph Transformer (GT) models have been widely used in the task of Molecular Property Prediction (MPP) due to their high reliability in characterizing the latent relationship among graph nodes (i.e., the atoms in a molecule). However, most existing GT-based methods usually explore the basic interactions between pairwise atoms, and thus they fail to consider the important interactions among critical motifs (e.g., functional groups consisted of several atoms) of molecules. As motifs in a molecule are significant patterns that are of great importance for determining molecular properties (e.g., toxicity and solubility), overlooking motif interactions inevitably hinders the effectiveness of MPP. To address this issue, we propose a novel Atom-Motif Contrastive Transformer (AMCT), which not only explores the atom-level interactions but also considers the motif-level interactions. Since the representations of atoms and motifs for a given molecule are actually two different views of the same instance, they are naturally aligned to generate the self-supervisory signals for model training. Meanwhile, the same motif can exist in different molecules, and hence we also employ the contrastive loss to maximize the representation agreement of identical motifs across different molecules. Finally, in order to clearly identify the motifs that are critical in deciding the properties of each molecule, we further construct a property-aware attention mechanism into our learning framework. Our proposed AMCT is extensively evaluated on seven popular benchmark datasets, and both quantitative and qualitative results firmly demonstrate its effectiveness when compared with the state-of-the-art methods.


title: Adaptive Distributionally Robust Planning for Renewable-Powered Fast Charging Stations Under Decision-Dependent EV Diffusion Uncertainty

abstract: When deploying fast charging stations (FCSs) to support long-distance trips of electric vehicles (EVs), there exist indirect network effects: while the gradual diffusion of EVs directly influences the timing and capacities of FCS allocation, the decisions for FCS allocations, in turn, impact the drivers' willingness to adopt EVs. This interplay, if neglected, can result in uncovered EVs and security issues on the grid side and even hinder the effective diffusion of EVs. In this paper, we explicitly incorporate this interdependence by quantifying EV adoption rates as decision-dependent uncertainties (DDUs) using decision-dependent ambiguity sets (DDASs). Then, a two-stage decision-dependent distributionally robust FCS planning (D$^3$R-FCSP) model is developed for adaptively deploying FCSs with on-site sources and expanding the coupled distribution network. A multi-period capacitated arc cover-path cover (MCACPC) model is incorporated to capture the EVs' recharging patterns to ensure the feasibility of FCS locations and capacities. To resolve the nonlinearity and nonconvexity, the D$^3$R-FCSP model is equivalently reformulated into a single-level mixed-integer linear programming by exploiting its strong duality and applying the McCormick envelope. Finally, case studies highlight the superior out-of-sample performances of our model in terms of security and cost-efficiency. Furthermore, the byproduct of accelerated EV adoption through an implicit positive feedback loop is highlighted.


title: The solvability of inhomogeneous boundary-value problems in Sobolev spaces

abstract: The aim of the paper is to develop a general theory of solvability of linear inhomogeneous boundary-value problems for systems of ordinary differential equations of arbitrary order in Sobolev spaces. Boundary conditions are allowed to be overdetermined or underdetermined. They may contain derivatives, of the unknown vector-valued function, whose integer or fractional orders exceed the order of the differential equation. Similar problems arise naturally in various applications. The theory introduces the notion of a rectangular number characteristic matrix of the problem. The index and Fredholm numbers of this matrix coincide respectively with the index and Fredholm numbers of the inhomogeneous boundary-value problem. Unlike the index, the Fredholm numbers (i.e. the dimensions of the problem kernel and co-kernel) are unstable even with respect to small (in the norm) finite-dimensional perturbations. We give examples in which the characteristic matrix can be explicitly found. We also prove a limit theorem for a sequence of characteristic matrices. Specifically, it follows from this theorem that the Fredholm numbers of the problems under investigation are semicontinuous in the strong operator topology. Such a property ceases to be valid in the general case.


title: Give and Take: Federated Transfer Learning for Industrial IoT Network Intrusion Detection

abstract: The rapid growth in Internet of Things (IoT) technology has become an integral part of today's industries forming the Industrial IoT (IIoT) initiative, where industries are leveraging IoT to improve communication and connectivity via emerging solutions like data analytics and cloud computing. Unfortunately, the rapid use of IoT has made it an attractive target for cybercriminals. Therefore, protecting these systems is of utmost importance. In this paper, we propose a federated transfer learning (FTL) approach to perform IIoT network intrusion detection. As part of the research, we also propose a combinational neural network as the centerpiece for performing FTL. The proposed technique splits IoT data between the client and server devices to generate corresponding models, and the weights of the client models are combined to update the server model. Results showcase high performance for the FTL setup between iterations on both the IIoT clients and the server. Additionally, the proposed FTL setup achieves better overall performance than contemporary machine learning algorithms at performing network intrusion detection.


title: IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training

abstract: In the field of medical Vision-Language Pre-training (VLP), significant efforts have been devoted to deriving text and image features from both clinical reports and associated medical images. However, most existing methods may have overlooked the opportunity in leveraging the inherent hierarchical structure of clinical reports, which are generally split into `findings' for descriptive content and `impressions' for conclusive observation. Instead of utilizing this rich, structured format, current medical VLP approaches often simplify the report into either a unified entity or fragmented tokens. In this work, we propose a novel clinical prior guided VLP framework named IMITATE to learn the structure information from medical reports with hierarchical vision-language alignment. The framework derives multi-level visual features from the chest X-ray (CXR) images and separately aligns these features with the descriptive and the conclusive text encoded in the hierarchical medical report. Furthermore, a new clinical-informed contrastive loss is introduced for cross-modal learning, which accounts for clinical prior knowledge in formulating sample correlations in contrastive learning. The proposed model, IMITATE, outperforms baseline VLP methods across six different datasets, spanning five medical imaging downstream tasks. Comprehensive experimental results highlight the advantages of integrating the hierarchical structure of medical reports for vision-language alignment.


title: Stochastic parameters for scalar fields in de Sitter spacetime

abstract: The stochastic effective theory approach, often called stochastic inflation, is widely used in cosmology to describe scalar field dynamics during inflation. The existing formulations are, however, more qualitative than quantitative because the connection to the underlying quantum field theory (QFT) has not been properly established. A concrete sign of this is that the QFT parameters depend on the renormalisation scale, and therefore the relation between the QFT and stochastic theory must have explicit scale dependence that cancels it. In this paper we achieve that by determining the parameters of the second-order stochastic effective theory of light scalar fields in de Sitter to linear order in the self-coupling constant $\lambda$. This is done by computing equal-time two-point correlators to one-loop order both in QFT using dimensional regularisation and the $\overline{\rm MS}$ renormalisation scheme and the equal-time four-point correlator to leading order in both theories, and demanding that the results obtained in the two theories agree. With these parameters, the effective theory is valid when $m\lesssim H$ and $\lambda^2\ll m^4/H^4$, and therefore it is applicable in cases where neither perturbation theory nor any previously proposed stochastic effective theories are.


title: Isospin symmetry in the $T = 1, A = 62$ triplet

abstract: Excited states in the $T_z = 0, -1$ nuclei $^{62}$Ga and $^{62}$Ge were populated in direct reactions of relativistic radioactive ion beams at the RIBF. Coincident \grays were measured with the DALI2$^+$ array and uniquely assigned to the $A=62$ isobars. In addition, $^{62}$Ge was also studied independently at JYFL-ACCLAB using the ${}^{24}$Mg(${}^{40}$Ca,$2n$)${}^{62}$Ge fusion-evaporation reaction. The first excited $T=1, J^\pi =2^+$ states in $^{62}$Ga and $^{62}$Ge were identified at $979(1)$ and $965(1)$~keV, respectively, resolving discrepant interpretations in the literature. States beyond the first $2^+$ state in $^{62}$Ge were also identified for the first time in the present work. The results are compared with shell-model calculations in the $fp$ model space. Mirror and triplet energy differences are analyzed in terms of individual charge-symmetry and charge-independence breaking contributions. The MED results confirm the shrinkage of the $p$-orbits' radii when they are occupied by at least one nucleon on average.


title: CMB delensing with deep learning

abstract: The cosmic microwave background (CMB) stands as a pivotal source for studying weak gravitational lensing. While the lensed CMB aids in constraining cosmological parameters, it simultaneously smooths the original CMB's features. The angular power spectrum of the unlensed CMB showcases sharper acoustic peaks and more pronounced damping tails, enhancing the precision of inferring cosmological parameters that influence these aspects. Although delensing diminishes the $B$-mode power spectrum, it facilitates the pursuit of primordial gravitational waves and enables a lower variance reconstruction of lensing and additional sources of secondary CMB anisotropies. In this work, we explore the potential of deep learning techniques, specifically the U-Net++ algorithm, to play a pivotal role in CMB delensing. We analyze three fields, namely $T$, $Q$, and $U$ sky maps, present the angular power spectra of the CMB delensed $TT$, $EE$, $BB$, and $TE$, and compare them with the unlensed CMB angular power spectra. Our findings reveal that the angular power spectrum of the lensed CMB, processed by U-Net++, closely aligns with that of the unlensed CMB. Thus, U-Net++ based CMB delensing proves to be effective in mitigating the impacts of weak gravitational lensing, paving the way for enhancing the CMB delensing power spectrum in forthcoming CMB experiments. The code utilized for this analysis is available on GitHub.