title: Multiple Key-value Strategy in Recommendation Systems Incorporating Large Language Model

abstract: Recommendation system (RS) plays significant roles in matching users information needs for Internet applications, and it usually utilizes the vanilla neural network as the backbone to handle embedding details. Recently, the large language model (LLM) has exhibited emergent abilities and achieved great breakthroughs both in the CV and NLP communities. Thus, it is logical to incorporate RS with LLM better, which has become an emerging research direction. Although some existing works have made their contributions to this issue, they mainly consider the single key situation (e.g. historical interactions), especially in sequential recommendation. The situation of multiple key-value data is simply neglected. This significant scenario is mainstream in real practical applications, where the information of users (e.g. age, occupation, etc) and items (e.g. title, category, etc) has more than one key. Therefore, we aim to implement sequential recommendations based on multiple key-value data by incorporating RS with LLM. In particular, we instruct tuning a prevalent open-source LLM (Llama 7B) in order to inject domain knowledge of RS into the pre-trained LLM. Since we adopt multiple key-value strategies, LLM is hard to learn well among these keys. Thus the general and innovative shuffle and mask strategies, as an innovative manner of data argument, are designed. To demonstrate the effectiveness of our approach, extensive experiments are conducted on the popular and suitable dataset MovieLens which contains multiple keys-value. The experimental results demonstrate that our approach can nicely and effectively complete this challenging issue.


title: Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero

abstract: Artificial Intelligence (AI) systems have made remarkable progress, attaining super-human performance across various domains. This presents us with an opportunity to further human knowledge and improve human expert performance by leveraging the hidden knowledge encoded within these highly performant AI systems. Yet, this knowledge is often hard to extract, and may be hard to understand or learn from. Here, we show that this is possible by proposing a new method that allows us to extract new chess concepts in AlphaZero, an AI system that mastered the game of chess via self-play without human supervision. Our analysis indicates that AlphaZero may encode knowledge that extends beyond the existing human knowledge, but knowledge that is ultimately not beyond human grasp, and can be successfully learned from. In a human study, we show that these concepts are learnable by top human experts, as four top chess grandmasters show improvements in solving the presented concept prototype positions. This marks an important first milestone in advancing the frontier of human knowledge by leveraging AI; a development that could bear profound implications and help us shape how we interact with AI systems across many AI applications.


title: Decoding Stumpers: Large Language Models vs. Human Problem-Solvers

abstract: This paper investigates the problem-solving capabilities of Large Language Models (LLMs) by evaluating their performance on stumpers, unique single-step intuition problems that pose challenges for human solvers but are easily verifiable. We compare the performance of four state-of-the-art LLMs (Davinci-2, Davinci-3, GPT-3.5-Turbo, GPT-4) to human participants. Our findings reveal that the new-generation LLMs excel in solving stumpers and surpass human performance. However, humans exhibit superior skills in verifying solutions to the same problems. This research enhances our understanding of LLMs' cognitive abilities and provides insights for enhancing their problem-solving potential across various domains.


title: FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learning

abstract: Semi-Supervised Learning (SSL) has been an effective way to leverage abundant unlabeled data with extremely scarce labeled data. However, most SSL methods are commonly based on instance-wise consistency between different data transformations. Therefore, the label guidance on labeled data is hard to be propagated to unlabeled data. Consequently, the learning process on labeled data is much faster than on unlabeled data which is likely to fall into a local minima that does not favor unlabeled data, leading to sub-optimal generalization performance. In this paper, we propose FlatMatch which minimizes a cross-sharpness measure to ensure consistent learning performance between the two datasets. Specifically, we increase the empirical risk on labeled data to obtain a worst-case model which is a failure case that needs to be enhanced. Then, by leveraging the richness of unlabeled data, we penalize the prediction difference (i.e., cross-sharpness) between the worst-case model and the original model so that the learning direction is beneficial to generalization on unlabeled data. Therefore, we can calibrate the learning process without being limited to insufficient label information. As a result, the mismatched learning performance can be mitigated, further enabling the effective exploitation of unlabeled data and improving SSL performance. Through comprehensive validation, we show FlatMatch achieves state-of-the-art results in many SSL settings.


title: Chiral forces in longitudinally invariant dielectric photonic waveguides

abstract: Optical forces can be chiral when they exhibit opposite signs for the two enantiomeric versions of a chiral molecule or particle. Such forces could be eventually used to separate enantiomers, which could find application in numerous disciplines. Here, we analyze numerically the optical chiral forces arising in the basic element of photonic integrated circuitry: a dielectric waveguide with rectangular cross-section. Such waveguides are inherently lossless thus generating chiral forces that are invariant in the longitudinal direction and therefore enable enantiomeric separation over long (cm-scale) distances. Assuming Brownian motion in a liquid environment, we calculate first the force strength and time span needed to perform the separation of chiral nanoparticles as a function of the radii. Then we analyze the chiral forces produced by the fundamental quasi-TE guided mode in a silicon nitride waveguide and show that it can lead to enantiomeric separation via the transverse spin at short wavelengths (405 nm). At longer wavelengths (1310 nm), the proper combination of degenerate quasi-TE and quasi-TM modes would result in a quasi-circularly polarized mode with intrinsic chirality (helicity), leading to chiral gradient forces that also enable the enantiomeric separation of smaller nanoparticles. We report particle tracking simulations where the optical force field produced by a quasi-TE and a quasi-circular mode proved to separate enantiomers under a time span of two seconds. Our results suggest the viability of enantiomeric separation using simple photonic integrated circuits, though different wavelength windows should be selected according to the nanoparticle size.


title: V2C MXene-modified g-C3N4 for enhanced visible-light photocatalytic activity

abstract: Increasing the efficiency of charge transfer and separation efficiency of photogenerated carriers are still the main challenges in the field of semiconductor-based photocatalysts. Herein, we synthesized g-C3N4@V2C MXene photocatalyst by modifying g-C3N4 using V2C MXene. The prepared photocatalyst exhibited outstanding photocatalytic performance under visible light. The degradation efficiency of methyl orange by g-C3N4@V2C MXene photocatalyst was as high as 94.5%, which is 1.56 times higher than that by g-C3N4. This was attributed to the V2C MXene inhibiting the rapid recombination of photogenerated carriers and facilitating rapid transfer of photogenerated electrons (e) from g-C3N4 to MXene. Moreover, g-C3N4@V2C MXene photocatalyst showed good cycling stability. The photocatalytic performance was higher than 85% after three cycles. Experiments to capture free radicals revealed that superoxide radicals (02) are the main contributors to the photocatalytic activity. Thus, the proposed g-C3N4@V2C MXene photocatalyst is a promising visible-light catalyst.


title: Dynamic Fabry-Perot cavity stabilization technique for atom-cavity experiments

abstract: We present a stabilization technique developed to lock and dynamically tune the resonant frequency of a moderate finesse Fabry-P\'erot (FP) cavity used in precision atom-cavity quantum electrodynamics (QED) experiments. Most experimental setups with active stabilization either operate at one fixed resonant frequency or use transfer cavities to achieve the ability to tune the resonant frequency of the cavity. In this work, we present a simple and cost-effective solution to actively stabilize an optical cavity while achieving a dynamic tuning range of over 100 MHz with a precision under 1 MHz. Our unique scheme uses a reference laser locked to an electro-optic modulator (EOM) shifted saturation absorption spectroscopy (SAS) signal. The cavity is locked to the PDH error signal obtained from the dip in the reflected intensity of this reference laser. Our setup provides the feature to efficiently tune the resonant frequency of the cavity by only changing the EOM drive without unlocking and re-locking either the reference laser or the cavity. We present measurements of precision control of the resonant cavity frequency and vacuum Rabi splitting (VRS) to quantify the stability achieved and hence show that this technique is suitable for a variety of cavity QED experiments.


title: A Scattering theory on hyperbolic spaces

abstract: In this paper, we develop a theoretical framework for time-harmonic wave scattering on hyperbolic spaces. Using the limiting absorption principle (LAP), we derive the explicit forms of the ingoing and outgoing Green functions of the Helmholtz operator of hyperbolic spaces, and verify that they are the fundamental solutions. Then we establish accurate characterisations of the asymptotic behaviours of the Green functions and use them to establish the ingoing and outgoing radiation conditions, which are analogues to the Sommerfeld radiation conditions in the Euclidean setting. Moreover, we prove a Rellich's type theorem which guarantees that the scattered field as well as its far-field pattern are uniquely defined. Within the framework, we consider the scattering from a source and a potential respectively. To our best knowledge, the theoretical framework is new to the literature and it paves the way for many subsequent developments for wave scattering on hyperbolic spaces.


title: Enhanced Simultaneous Machine Translation with Word-level Policies

abstract: Recent years have seen remarkable advances in the field of Simultaneous Machine Translation (SiMT) due to the introduction of innovative policies that dictate whether to READ or WRITE at each step of the translation process. However, a common assumption in many existing studies is that operations are carried out at the subword level, even though the standard unit for input and output in most practical scenarios is typically at the word level. This paper demonstrates that policies devised and validated at the subword level are surpassed by those operating at the word level, which process multiple subwords to form a complete word in a single step. Additionally, we suggest a method to boost SiMT models using language models (LMs), wherein the proposed word-level policy plays a vital role in addressing the subword disparity between LMs and SiMT models. Code is available at https://github.com/xl8-ai/WordSiMT.


title: Bour's theorem for helicoidal surfaces with singularities

abstract: In this paper, generalizing the techniques of Bour's theorem, we prove that every generic cuspidal edge, more generally, generic $n$-type edge, which is invariant under a helicoidal motion in Euclidean $3$-space admits non-trivial isometric deformations. As a corollary, several geometric invariants, such as the limiting normal curvature, the cusp-directional torsion, the higher order cuspidal curvature and the bias, are proved to be extrinsic invariants.


title: Open Knowledge Base Canonicalization with Multi-task Unlearning

abstract: The construction of large open knowledge bases (OKBs) is integral to many applications in the field of mobile computing. Noun phrases and relational phrases in OKBs often suffer from redundancy and ambiguity, which calls for the investigation on OKB canonicalization. However, in order to meet the requirements of some privacy protection regulations and to ensure the timeliness of the data, the canonicalized OKB often needs to remove some sensitive information or outdated data. The machine unlearning in OKB canonicalization is an excellent solution to the above problem. Current solutions address OKB canonicalization by devising advanced clustering algorithms and using knowledge graph embedding (KGE) to further facilitate the canonicalization process. Effective schemes are urgently needed to fully synergise machine unlearning with clustering and KGE learning. To this end, we put forward a multi-task unlearning framework, namely MulCanon, to tackle machine unlearning problem in OKB canonicalization. Specifically, the noise characteristics in the diffusion model are utilized to achieve the effect of machine unlearning for data in OKB. MulCanon unifies the learning objectives of diffusion model, KGE and clustering algorithms, and adopts a two-step multi-task learning paradigm for training. A thorough experimental study on popular OKB canonicalization datasets validates that MulCanon achieves advanced machine unlearning effects.


title: Linear statistics for Coulomb gases: higher order cumulants

abstract: We consider $N$ classical particles interacting via the Coulomb potential in spatial dimension $d$ and in the presence of an external trap, at equilibrium at inverse temperature $\beta$. In the large $N$ limit, the particles are confined within a droplet of finite size. We study smooth linear statistics, i.e. the fluctuations of sums of the form ${\cal L}_N = \sum_{i=1}^N f({\bf x}_i)$, where ${\bf x}_i$'s are the positions of the particles and where $f({\bf x}_i)$ is a sufficiently regular function. There exists at present standard results for the first and second moments of ${\cal L}_N$ in the large $N$ limit, as well as associated Central Limit Theorems in general dimension and for a wide class of confining potentials. Here we obtain explicit expressions for the higher order cumulants of ${\cal L}_N$ at large $N$, when the function $f({\bf x})=f(|{\bf x}|)$ and the confining potential are both rotationnally invariant. A remarkable feature of our results is that these higher cumulants depend only on the value of $f'(|{\bf x}|)$ and its higher order derivatives evaluated exactly at the boundary of the droplet, which in this case is a $d$-dimensional sphere. In the particular two-dimensional case $d=2$ at the special value $\beta=2$, a connection to the Ginibre ensemble allows us to derive these results in an alternative way using the tools of determinantal point processes. Finally we also obtain the large deviation form of the full probability distribution function of ${\cal L}_N$.

categories: math-ph cond-mat.stat-mech math.MP math.PR


title: Graph Agent: Explicit Reasoning Agent for Graphs

abstract: Graph embedding methods such as Graph Neural Networks (GNNs) and Graph Transformers have contributed to the development of graph reasoning algorithms for various tasks on knowledge graphs. However, the lack of interpretability and explainability of graph embedding methods has limited their applicability in scenarios requiring explicit reasoning. In this paper, we introduce the Graph Agent (GA), an intelligent agent methodology of leveraging large language models (LLMs), inductive-deductive reasoning modules, and long-term memory for knowledge graph reasoning tasks. GA integrates aspects of symbolic reasoning and existing graph embedding methods to provide an innovative approach for complex graph reasoning tasks. By converting graph structures into textual data, GA enables LLMs to process, reason, and provide predictions alongside human-interpretable explanations. The effectiveness of the GA was evaluated on node classification and link prediction tasks. Results showed that GA reached state-of-the-art performance, demonstrating accuracy of 90.65%, 95.48%, and 89.32% on Cora, PubMed, and PrimeKG datasets, respectively. Compared to existing GNN and transformer models, GA offered advantages of explicit reasoning ability, free-of-training, easy adaption to various graph reasoning tasks


title: Topological Complexity Related To Multi-Valued Functions

abstract: In this paper, we deal with the robot motion planning problem in multi-valued function theory. We first enrich the multi-homotopy studies by introducing a multi-homotopy lifting property and a multi-fibration. Then we compute both a topological multi-complexity and a Lusternik-Schnirelmann multi-category of a space or a multi-fibration.


title: From port-based teleportation to Frobenius reciprocity theorem: partially reduced irreducible representations and their applications

abstract: In this paper, we present the connection of two concepts as induced representation and partially reduced irreducible representations (PRIR) appear in the context of port-based teleportation protocols. Namely, for a given finite group $G$ with arbitrary subgroup $H$, we consider a particular case of matrix irreducible representations, whose restriction to the subgroup $H$, as a matrix representation of $H$, is completely reduced to diagonal block form with an irreducible representation of $H$ in the blocks. The basic properties of such representations are given. Then as an application of this concept, we show that the spectrum of the port-based teleportation operator acting on $n$ systems is connected in a very simple way with the spectrum of the corresponding Jucys-Murphy operator for the symmetric group $S(n-1)\subset S(n)$. This shows on the technical level relation between teleporation and one of the basic objects from the point of view of the representation theory of the symmetric group. This shows a deep connection between the central object describing properties of deterministic PBT schemes and objects appearing naturally in the abstract representation theory of the symmetric group. In particular, we present a new expression for the eigenvalues of the Jucys-Murphy operators based on the irreducible characters of the symmetric group. As an additional but not trivial result, we give also purely matrix proof of the Frobenius reciprocity theorem for characters with explicit construction of the unitary matrix that realizes the reduction of the natural basis of induced representation to the reduced one.


title: Pre-electoral coalition agreement from the Black-Scholes point of view

abstract: A political party can be considered as a company whose value depends on the voters support i.e. on the percentage of population supporting the party. Dynamics of the support is thus as a stochastic process with a deterministic growth rate perturbed by a white noise modeled through the Wiener process. This is in an analogy with the option modeling where the stock price behaves similarly as the voters' support. While in the option theory we have the question of fair price of an option, the question that we ask here is what is a reasonable level of support that the coalition of a major party (safely above the election threshold) and a minor party (under or around the election threshold) should achieve in order the minor party to get one more representative. We shall elaborate some of the conclusions in the case of recent elections in Montenegro (June, 2023) which are particularly interesting due to lots of political subjects entering the race.


title: On slice measures of Green currents on CP(2)

abstract: Let $f$ be a holomorphic map of $\mathbb{C}\mathbb{P}^2$ of degree $d\geq 2$, let $T$ be its Green current and $\mu=T\wedge T$ be its equilibrium measure. We give a new proof of a theorem due to Dujardin asserting that $\mu \ll T\wedge\omega_{\mathbb{P}^2}$ implies $\lambda_2=\frac{1}{2} \log\ d$, where $\lambda_1 \geq \lambda_2$ are the Lyapunov exponents of $\mu$. Then, assuming $\mu\ll T\wedge\omega_{\mathbb{P}^2}$, we study slice measures $\nu :=T\wedge dd^c|W|^2$, where $W$ is a holomorphic local submersion. We give sufficient conditions on the Radon-Nikodym derivative of $\mu$ with respect to the trace measure $T\wedge\omega_{\mathbb{P}^2}$ ensuring $\mu=\nu$. The involved submersion $W$ comes from normal coordinates for the inverse branches of the iterates of $f$.


title: Heat and Mass Transfer in the Porous Wick of a Capillary Evaporator

abstract: Heat and mass transfer inside the porous wick of a capillary evaporator is studied using a mixed pore-network model. The impact of the thermal conductivity of the wick on the overheating limit (defined as the difference between the maximum temperature at the top of the metallic casing and the saturated temperature), breakthrough (which occurs when the vapor reaches the wick inlet) and the parasitic heat flux lost by conduction at the entrance of the wick (which decreases the efficiency of the evaporator) is investigated. The study suggests a bilayer wick as a possible better design to optimize the performance of the evaporator. With this design, the inlet layer is of low thermal conductivity with small pore size so as to reduce the parasitic heat flux. The inlet layer also plays a role of capillary lock limiting the risk of breakthrough. The second layer, right under the metallic casing, is more conductive with a high thermal conductivity and larger pores so as to limit the risk of overheating. It is shown that this design increases the range of heat loads which can be applied to the evaporator.


title: PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

abstract: Highly effective, task-specific prompts are often heavily engineered by experts to integrate detailed instructions and domain insights based on a deep understanding of both instincts of large language models (LLMs) and the intricacies of the target task. However, automating the generation of such expert-level prompts remains elusive. Existing prompt optimization methods tend to overlook the depth of domain knowledge and struggle to efficiently explore the vast space of expert-level prompts. Addressing this, we present PromptAgent, an optimization method that autonomously crafts prompts equivalent in quality to those handcrafted by experts. At its core, PromptAgent views prompt optimization as a strategic planning problem and employs a principled planning algorithm, rooted in Monte Carlo tree search, to strategically navigate the expert-level prompt space. Inspired by human-like trial-and-error exploration, PromptAgent induces precise expert-level insights and in-depth instructions by reflecting on model errors and generating constructive error feedback. Such a novel framework allows the agent to iteratively examine intermediate prompts (states), refine them based on error feedbacks (actions), simulate future rewards, and search for high-reward paths leading to expert prompts. We apply PromptAgent to 12 tasks spanning three practical domains: BIG-Bench Hard (BBH), as well as domain-specific and general NLP tasks, showing it significantly outperforms strong Chain-of-Thought and recent prompt optimization baselines. Extensive analyses emphasize its capability to craft expert-level, detailed, and domain-insightful prompts with great efficiency and generalizability.


title: Similarity-driven and Task-driven Models for Diversity of Opinion in Crowdsourcing Markets

abstract: The recent boom in crowdsourcing has opened up a new avenue for utilizing human intelligence in the realm of data analysis. This innovative approach provides a powerful means for connecting online workers to tasks that cannot effectively be done solely by machines or conducted by professional experts due to cost constraints. Within the field of social science, four elements are required to construct a sound crowd - Diversity of Opinion, Independence, Decentralization and Aggregation. However, while the other three components have already been investigated and implemented in existing crowdsourcing platforms, 'Diversity of Opinion' has not been functionally enabled yet. From a computational point of view, constructing a wise crowd necessitates quantitatively modeling and taking diversity into account. There are usually two paradigms in a crowdsourcing marketplace for worker selection: building a crowd to wait for tasks to come and selecting workers for a given task. We propose similarity-driven and task-driven models for both paradigms. Also, we develop efficient and effective algorithms for recruiting a limited number of workers with optimal diversity in both models. To validate our solutions, we conduct extensive experiments using both synthetic datasets and real data sets.


title: Searches for the light invisible axion-like particle in $K^{+}\to\pi^{+}\pi^{0}a$ decay

abstract: A high statistics data sample of the $K^{+}$ decays is recorded by the OKA collaboration. A missing mass analysis is performed to search for a light invisible pseudoscalar axion-like particle (ALP) $a$ in the decay $K^{+} \to \pi^{+} \pi^{0} a$. No signal is observed, the upper limits for the branching ratio of the decay are calculated. The $90\%$ confidence level upper limit is changing from $2.5\cdot10^{-6}$ to $2\cdot10^{-7}$ for the ALP mass from 0 to 200 MeV/$c^{2}$, except for the region of $\pi^{0}$ mass, where the upper limit is $4.4\cdot10^{-6}$.


title: An Integrative Paradigm for Enhanced Stroke Prediction: Synergizing XGBoost and xDeepFM Algorithms

abstract: Stroke prediction plays a crucial role in preventing and managing this debilitating condition. In this study, we address the challenge of stroke prediction using a comprehensive dataset, and propose an ensemble model that combines the power of XGBoost and xDeepFM algorithms. Our work aims to improve upon existing stroke prediction models by achieving higher accuracy and robustness. Through rigorous experimentation, we validate the effectiveness of our ensemble model using the AUC metric. Through comparing our findings with those of other models in the field, we gain valuable insights into the merits and drawbacks of various approaches. This, in turn, contributes significantly to the progress of machine learning and deep learning techniques specifically in the domain of stroke prediction.


title: An experimental protocol to access immersiveness in video games

abstract: In the video game industry, great importance is given to the experience that the user has while playing a game. In particular, this experience benefits from the players' perceived sense of being in the game or immersion. The level of user immersion depends not only on the game's content but also on how the game is displayed, thus on its User Interface (UI) and the Head's-Up Display (HUD). Another factor influencing immersiveness that has been found in the literature is the player's expertise: the more experience the user has with a specific game, the less they need information on the screen to be immersed in the game. Player's level of immersion can be accessed by using both questionnaires of their perceived experience and exploiting their behavioural and physiological responses while playing the target game. Therefore, in this paper, we propose an experimental protocol to access immersiveness of gamers while playing a third-person shooter (Fortnite) with UIs with a standard, a dietetic, and a proposed HUD. A subjective evaluation of the immersion will be provided by completing the Immersive Experience Questionnaire (IEQ), while objective indicators will be provided by face tracking, behaviour and physiological responses analyses. The ultimate goal of this study is to define guidelines for video game UI development that can enhance the players' immersion.


title: Evolution of colour correlated double parton distributions: a quantitative study

abstract: Double parton distributions satisfy the same evolution equations as ordinary single-parton densities, provided that the colours of the two partons are uncorrelated. The situation is different for colour correlated parton pairs, where evolution to higher scales results in a suppression by Sudakov double logarithms. We perform a detailed study of evolution for colour correlated double parton distributions, both analytically and numerically, at lowest order and beyond. When the two observed partons originate from the perturbative splitting of a single one, the Sudakov suppression of colour correlations at the cross section level is not as strong as one might expect.


title: RIPencapsulation: Defeating IP Encapsulation on TI MSP Devices

abstract: Internet of Things (IoT) devices sit at the intersection of unwieldy software complexity and unprecedented attacker access. This unique position comes with a daunting security challenge: how can I protect both proprietary code and confidential data on a device that the attacker has unfettered access to? Trusted Execution Environments (TEEs) promise to solve this challenge through hardware-based separation of trusted and untrusted computation and data. While TEEs do an adequate job of protecting secrets on desktop-class devices, we reveal that trade-offs made in one of the most widely-used commercial IoT devices undermine their TEE's security. This paper uncovers two fundamental weaknesses in IP Encapsulation (IPE), the TEE deployed by Texas Instruments for MSP430 and MSP432 devices. We observe that lack of call site enforcement and residual state after unexpected TEE exits enable an attacker to reveal all proprietary code and secret data within the IPE. We design and implement an attack called RIPencapsulation, which systematically executes portions of code within the IPE and uses the partial state revealed through the register file to exfiltrate secret data and to identify gadget instructions. The attack then uses gadget instructions to reveal all proprietary code within the IPE. Our evaluation with commodity devices and a production compiler and settings shows that -- even after following all manufacturer-recommended secure coding practices -- RIPencapsultaion reveals, within minutes, both the code and keys from third-party cryptographic implementations protected by the IPE.


title: Spectral gap of convex combination of a random permutation and a bistochastic matrix

abstract: We consider a random bistochastic matrix of size N of the form (1-r)M + rQ where 0<r<1, M is a uniformly distributed permutation and Q is a given bistochastic matrix. Under sparsity and regularity assumptions on the *-distribution of Q, we prove that the second largest eigenvalue of (1-r)M + rQ is essentially bounded by an approximation of the spectral radius of a deterministic asymptotic equivalent given by free probability theory.


title: On Pixel-level Performance Assessment in Anomaly Detection

abstract: Anomaly detection methods have demonstrated remarkable success across various applications. However, assessing their performance, particularly at the pixel-level, presents a complex challenge due to the severe imbalance that is most commonly present between normal and abnormal samples. Commonly adopted evaluation metrics designed for pixel-level detection may not effectively capture the nuanced performance variations arising from this class imbalance. In this paper, we dissect the intricacies of this challenge, underscored by visual evidence and statistical analysis, leading to delve into the need for evaluation metrics that account for the imbalance. We offer insights into more accurate metrics, using eleven leading contemporary anomaly detection methods on twenty-one anomaly detection problems. Overall, from this extensive experimental evaluation, we can conclude that Precision-Recall-based metrics can better capture relative method performance, making them more suitable for the task.


title: DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models

abstract: A long-standing goal of AI systems is to perform complex multimodal reasoning like humans. Recently, large language models (LLMs) have made remarkable strides in such multi-step reasoning on the language modality solely by leveraging the chain of thought (CoT) to mimic human thinking. However, the transfer of these advancements to multimodal contexts introduces heightened challenges, including but not limited to the impractical need for labor-intensive annotation and the limitations in terms of flexibility, generalizability, and explainability. To evoke CoT reasoning in multimodality, this work first conducts an in-depth analysis of these challenges posed by multimodality and presents two key insights: "keeping critical thinking" and "letting everyone do their jobs" in multimodal CoT reasoning. Furthermore, this study proposes a novel DDCoT prompting that maintains a critical attitude through negative-space prompting and incorporates multimodality into reasoning by first dividing the reasoning responsibility of LLMs into reasoning and recognition and then integrating the visual recognition capability of visual models into the joint reasoning process. The rationales generated by DDCoT not only improve the reasoning abilities of both large and small language models in zero-shot prompting and fine-tuning learning, significantly outperforming state-of-the-art methods but also exhibit impressive generalizability and explainability.


title: Non-isotropic Persistent Homology: Leveraging the Metric Dependency of PH

abstract: Persistent Homology is a widely used topological data analysis tool that creates a concise description of the topological properties of a point cloud based on a specified filtration. Most filtrations used for persistent homology depend (implicitly) on a chosen metric, which is typically agnostically chosen as the standard Euclidean metric on $\mathbb{R}^n$. Recent work has tried to uncover the 'true' metric on the point cloud using distance-to-measure functions, in order to obtain more meaningful persistent homology results. Here we propose an alternative look at this problem: we posit that information on the point cloud is lost when restricting persistent homology to a single (correct) distance function. Instead, we show how by varying the distance function on the underlying space and analysing the corresponding shifts in the persistence diagrams, we can extract additional topological and geometrical information. Finally, we numerically show that non-isotropic persistent homology can extract information on orientation, orientational variance, and scaling of randomly generated point clouds with good accuracy and conduct some experiments on real-world data.


title: Baryons as Vortexes on the $\eta^{\prime}$ Domain Wall

abstract: We show that the recent construction of $N_f=1$ baryons on the $\eta^\prime$ domain wall can be understood as vortexes of the principal effective theory -- the Chern-Simons-Higgs theory -- on a 2+1-dimensional sheet. This theory has a series of vertex solutions, and the vortex with unit topological charge naturally spins $N_c/2$, which coincides with the spin of the one-flavor baryon in QCD. Since the $N_c$ scaling of the vortexes is the same as that of baryons, baryons can be regarded as vortexes. By virtue of the particle-vortex symmetry, the dual Zhang-Hansson-Kivelson theory indicates that the quark carries topological charge $1/N_c$ and obeys fractional statistics. The generalization to arbitrary $N_f$ is also discussed.


title: Genomic regulatory architecture of human embryo retroviral LTR elements affecting evolution, development, and pathophysiology of Modern Humans

abstract: Two distinct families of pan-primate endogenous retroviruses, namely HERVL and HERVH, infected primates germline, colonized host genomes, and evolved into the global retroviral genomic regulatory dominion (GRD) operating during human embryogenesis (HE). HE retroviral GRD constitutes 8839 highly conserved fixed LTR elements linked to 5444 down-stream target genes forged by evolution into a functionally-consonant constellation of 26 genome-wide multimodular genomic regulatory networks (GRNs), each of which is defined by significant enrichment of numerous single gene ontology (GO)-specific traits. Locations of GRNs appear scattered across chromosomes to occupy from 5.5%-15.09% of human genome. Each GRN harbors from 529-1486 retroviral LTRs derived from LTR7, MLT2A1, and MLT2A2 sequences that are quantitatively balanced according to their genome-wide abundance. GRNs integrate activities from 199-805 down-stream target genes, including transcription factors, chromatin-state remodelers, signal-sensing and signal-transduction mediators, enzymatic and receptor binding effectors, intracellular complexes and extracellular matrix elements, and cell-cell adhesion molecules. GRNs compositions consist of several hundred to thousands smaller GO enrichment-defined genomic regulatory modules (GRMs) combining from a dozen to hundreds LTRs and down-stream target genes, which appear to operate on individuals life-span timescale along specific phenotypic avenues to exert profound effects on patterns of transcription, protein-protein interactions, developmental phenotypes, physiological traits, and pathological conditions of Modern Humans. Overall, this study identifies 69,573 statistically significant retroviral LTR-linked GRMs (Binominal FDR q-value threshold of 0.001), including 27,601 GRMs validated by the single GO-specific directed acyclic graph (DAG) analyses across six GO annotations.

categories: q-bio.GN q-bio.MN q-bio.NC q-bio.PE q-bio.TO


title: Optimal control for manipulating vibrational wave packets through polarizability interactions induced by non-resonant laser pulses

abstract: On the basis of optimal control theory, we numerically study how to optimally manipulate molecular vibrational dynamics by using cycle-averaged polarizability interactions induced by mildly intense non-resonant laser (NR) pulses. As the essential elements to be controlled are the probability amplitudes, namely, the populations and the relative phases of the vibrational eigenstates, we consider three fundamental control objectives: selective population transfer, wave packet shaping that requires both population control and relative-phase control, and wave packet deformation suppression that solely requires relative-phase control while avoiding population redistribution. The non-trivial control of wave packet deformation suppression is an extension of our previous study on wave packet spreading suppression. Focusing on the vibrational dynamics in the B state of I2 as a case study, we adopt optimal control simulations and model analyses under the impulsive excitation approximation to systematically examine how to achieve the control objectives with shaped NR pulses. Optimal solutions are always given by NR pulse trains, in which each pulse interval and each pulse intensity are adjusted to cooperate with the vibrational dynamics to effectively utilize the quantum interferences to realize the control objectives with high probability.


title: Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding

abstract: Grokking is the intriguing phenomenon where a model learns to generalize long after it has fit the training data. We show both analytically and numerically that grokking can surprisingly occur in linear networks performing linear tasks in a simple teacher-student setup with Gaussian inputs. In this setting, the full training dynamics is derived in terms of the training and generalization data covariance matrix. We present exact predictions on how the grokking time depends on input and output dimensionality, train sample size, regularization, and network initialization. We demonstrate that the sharp increase in generalization accuracy may not imply a transition from "memorization" to "understanding", but can simply be an artifact of the accuracy measure. We provide empirical verification for our calculations, along with preliminary results indicating that some predictions also hold for deeper networks, with non-linear activations.

categories: stat.ML cond-mat.dis-nn cs.LG math-ph math.MP


title: Right preconditioned GMRES for arbitrary singular systems

abstract: Brown and Walker (1997) showed that GMRES determines a least squares solution of $ A x = b $ where $ A \in {\bf R}^{n \times n} $ without breakdown for arbitrary $ b, x_0 \in {\bf R}^n $ if and only if $A$ is range-symmetric, i.e. $ {\cal R} (A^{\rm T}) = {\cal R} (A) $, where $ A $ may be singular and $ b $ may not be in the range space ${\cal R} A)$ of $A$. In this paper, we propose applying GMRES to $ A C A^{\rm T} z = b $, where $ C \in {\bf R}^{n \times n} $ is symmetric positive definite. This determines a least squares solution $ x = CA^{\rm T} z $ of $ A x = b $ without breakdown for arbitrary (singular) matrix $A \in {\bf R}^{n \times n}$ and $ b \in {\bf R}^n $. To make the method numerically stable, we propose using the pseudoinverse with an appropriate threshold parameter to suppress the influence of tiny singular values when solving the severely ill-conditioned Hessenberg systems which arise in the Arnoldi process of GMRES when solving inconsistent range-symmetric systems. Numerical experiments show that the method taking $C$ to be the identity matrix gives the least squares solution even when $A$ is not range-symmetric, including the case when $ {\rm index}(A) >1$.


title: Platonism, De Re, and (Philosophy of) Mathematical Practice

abstract: The chapter advances a reformulation of the classical problem of the nature of mathematical objects (if any), here called "Plato's problem," in line with the program of a philosophy of mathematical practice. It then provides a sketch of a platonist solution, following the same perspective. This solution disregards as nonsensical the question of the existence of abstract, and specifically mathematical, objects, by rather focusing on the modalities of our access to them: objects (in general, both concrete and abstract) are regarded as individual contents that we have (or can have) a de re epistemic access to. The question of the existence of mathematical objects is then replaced by that of the modalities of our de re epistemic access to individual mathematical contents.


title: How can neuromorphic hardware attain brain-like functional capabilities?

abstract: Research on neuromorphic computing is driven by the vision that we can emulate brain-like computing capability, learning capability, and energy-efficiency in novel hardware. Unfortunately, this vision has so far been pursued in a half-hearted manner. Most current neuromorphic hardware (NMHW) employs brain-like spiking neurons instead of standard artificial neurons. This is a good first step, which does improve the energy-efficiency of some computations, see \citep{rao2022long} for one of many examples. But current architectures and training methods for networks of spiking neurons in NMHW are largely copied from artificial neural networks. Hence it is not surprising that they inherit many deficiencies of artificial neural networks, rather than attaining brain-like functional capabilities. Of course, the brain is very complex, and we cannot implement all its details in NMHW. Instead, we need to focus on principles that are both easy to implement in NMHW and are likely to support brain-like functionality. The goal of this article is to highlight some of them.


title: Search for particle-stable tetraneutrons in thermal fission of $^{235}$U

abstract: Background: The existence of a tetraneutron comprising four neutrons has long been debated. Purpose: Motivated by a recent observation of particle-stable tetraneutrons, we investigated potential particle-stable tetraneutron emission in thermal neutron-induced $^{235}$U fission using a nuclear research reactor. Methods: We performed $\gamma$-ray spectroscopy for a $^{88}$SrCO$_3$ sample irradiated in a reactor core. Stable $^{88}$Sr was expected to produce $^{91}$Sr by a tetraneutron-induced ($^4n$,n) reaction; hence, observation of $\gamma$-rays followed by $\beta$ decay of $^{91}$Sr would indicate particle-stable tetraneutron emission. Results: The $\gamma$-ray spectrum of an irradiated $^{88}$SrCO$_3$ sample did not show any photopeak for $^{91}$Sr. Conclusion: The emission rate of particle-stable tetraneutrons, if they exist, is estimated to be lower than $8\times 10^{-7}$ per fission at the 95% confidence level, assuming the cross-sections of reactions induced by hypothetical particle-stable tetraneutrons.


title: Diversity Enhanced Narrative Question Generation for Storybooks

abstract: Question generation (QG) from a given context can enhance comprehension, engagement, assessment, and overall efficacy in learning or conversational environments. Despite recent advancements in QG, the challenge of enhancing or measuring the diversity of generated questions often remains unaddressed. In this paper, we introduce a multi-question generation model (mQG), which is capable of generating multiple, diverse, and answerable questions by focusing on context and questions. To validate the answerability of the generated questions, we employ a SQuAD2.0 fine-tuned question answering model, classifying the questions as answerable or not. We train and evaluate mQG on the FairytaleQA dataset, a well-structured QA dataset based on storybooks, with narrative questions. We further apply a zero-shot adaptation on the TellMeWhy and SQuAD1.1 datasets. mQG shows promising results across various evaluation metrics, among strong baselines.


title: ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee Behaviors

abstract: Understanding the behavior of non-human primates is crucial for improving animal welfare, modeling social behavior, and gaining insights into distinctively human and phylogenetically shared behaviors. However, the lack of datasets on non-human primate behavior hinders in-depth exploration of primate social interactions, posing challenges to research on our closest living relatives. To address these limitations, we present ChimpACT, a comprehensive dataset for quantifying the longitudinal behavior and social relations of chimpanzees within a social group. Spanning from 2015 to 2018, ChimpACT features videos of a group of over 20 chimpanzees residing at the Leipzig Zoo, Germany, with a particular focus on documenting the developmental trajectory of one young male, Azibo. ChimpACT is both comprehensive and challenging, consisting of 163 videos with a cumulative 160,500 frames, each richly annotated with detection, identification, pose estimation, and fine-grained spatiotemporal behavior labels. We benchmark representative methods of three tracks on ChimpACT: (i) tracking and identification, (ii) pose estimation, and (iii) spatiotemporal action detection of the chimpanzees. Our experiments reveal that ChimpACT offers ample opportunities for both devising new methods and adapting existing ones to solve fundamental computer vision tasks applied to chimpanzee groups, such as detection, pose estimation, and behavior analysis, ultimately deepening our comprehension of communication and sociality in non-human primates.


title: Growth of Massive Molecular Cloud Filament by Accretion Flows I: Slow Shock Instability v.s. Ambipolar Diffusion

abstract: The Herschel Gould Belt Survey showed that stars form in dense filaments in nearby molecular clouds. Recent studies suggest that massive filaments are bound by the slow shocks caused by accretion flows onto the filaments. The slow shock is known to be unstable to the corrugation deformation of the shock front. The corrugation instability could convert the accretion flow's ram pressure into turbulent pressure that influences the width of the filament, which, according to theory, determines the self-gravitational fragmentation scale and core mass. In spite of its importance, the effect of slow shock instability on star-forming filaments has not been investigated. In addition, the linear dispersion relation obtained from the ideal magnetohydrodynamics (MHD) analysis shows that the most unstable wavelength of shock corrugation is infinitesimally small (or mean free path). In the scale of dense filaments, the effect of ambipolar diffusion can suppress the instability at small scales. This study investigates the influence of ambipolar diffusion on the instability of the slow shock. We perform two-dimensional MHD simulations to examine the linear growth of the slow shock instability, considering the effect of ambipolar diffusion. The results demonstrate that the most unstable scale of slow shock instability is approximately five times the length scale of ambipolar diffusion l_AD calculated using post-shock variables, where, l_AD corresponds to the scale where the magnetic Reynolds number for ambipolar diffusivity is unity.


title: Relating $\beta'_*$ and $\gamma'_{Q*}$ in the ${\cal N}=1$ SQCD Conformal Window

abstract: In this note we show that $\beta'_*$, the $\beta$-function slopes in the electric and magnetic theories are equal at the corresponding infrared fixed points. This follows from the scaling of the correlators of the trace of the energy momentum tensors. The slopes $\beta'_*$ determine the scaling dimensions. Our paper can be considered as a commentary to Anselmi et al. [1] -- it proposes an improved derivation not based on a rather contrived construction by Kutasov et al. [2]. As a byproduct we note that $\gamma'_{Q^*}$ -- the slopes of the matter superfield anomalous dimension -- vanish at both edges of the conformal window where one of the dual theories is strongly coupled. Finally, we determine the two-coupling magnetic fixed point at weak coupling correcting the result of [3]}.


title: CLEX: Continuous Length Extrapolation for Large Language Models

abstract: Transformer-based Large Language Models (LLMs) are pioneering advances in many natural language processing tasks, however, their exceptional capabilities are restricted within the preset context window of Transformer. Position Embedding (PE) scaling methods, while effective in extending the context window to a specific length, demonstrate either notable limitations in their extrapolation abilities or sacrificing partial performance within the context window. Length extrapolation methods, although theoretically capable of extending the context window beyond the training sequence length, often underperform in practical long-context applications. To address these challenges, we propose Continuous Length EXtrapolation (CLEX) for LLMs. We generalise the PE scaling approaches to model the continuous dynamics by ordinary differential equations over the length scaling factor, thereby overcoming the constraints of current PE scaling methods designed for specific lengths. Moreover, by extending the dynamics to desired context lengths beyond the training sequence length, CLEX facilitates the length extrapolation with impressive performance in practical tasks. We demonstrate that CLEX can be seamlessly incorporated into LLMs equipped with Rotary Position Embedding, such as LLaMA and GPT-NeoX, with negligible impact on training and inference latency. Experimental results reveal that CLEX can effectively extend the context window to over 4x or almost 8x training length, with no deterioration in performance. Furthermore, when evaluated on the practical LongBench benchmark, our model trained on a 4k length exhibits competitive performance against state-of-the-art open-source models trained on context lengths up to 32k. Our code is available at https://github.com/DAMO-NLP-SG/CLEX.


title: The Small-World Effect for Interferometer Networks

abstract: Complex network theory has focused on properties of networks with real-valued edge weights. However, in signal transfer networks, such as those representing the transfer of light across an interferometer, complex-valued edge weights are needed to represent the manipulation of the signal in both magnitude and phase. These complex-valued edge weights introduce interference into the signal transfer, but it is unknown how such interference affects network properties such as small-worldness. To address this gap, we have introduced a small-world interferometer network model with complex-valued edge weights and generalized existing network measures to define the interferometric clustering coefficient, the apparent path length, and the interferometric small-world coefficient. Using high-performance computing resources, we generated a large set of small-world interferometers over a wide range of parameters in system size, nearest-neighbor count, and edge-weight phase and computed their interferometric network measures. We found that the interferometric small-world coefficient depends significantly on the amount of phase on complex-valued edge weights: for small edge-weight phases, constructive interference led to a higher interferometric small-world coefficient; while larger edge-weight phases induced destructive interference which led to a lower interferometric small-world coefficient. Thus, for the small-world interferometer model, interferometric measures are necessary to capture the effect of interference on signal transfer. This model is an example of the type of problem that necessitates interferometric measures, and applies to any wave-based network including quantum networks.


title: Faithful Path Language Modeling for Explainable Recommendation over Knowledge Graph

abstract: The integration of path reasoning with language modeling in recommender systems has shown promise for enhancing explainability but often struggles with the authenticity of the explanations provided. Traditional models modify their architecture to produce entities and relations alternately--for example, employing separate heads for each in the model--which does not ensure the authenticity of paths reflective of actual Knowledge Graph (KG) connections. This misalignment can lead to user distrust due to the generation of corrupted paths. Addressing this, we introduce PEARLM (Path-based Explainable-Accurate Recommender based on Language Modelling), which innovates with a Knowledge Graph Constraint Decoding (KGCD) mechanism. This mechanism ensures zero incidence of corrupted paths by enforcing adherence to valid KG connections at the decoding level, agnostic of the underlying model architecture. By integrating direct token embedding learning from KG paths, PEARLM not only guarantees the generation of plausible and verifiable explanations but also highly enhances recommendation accuracy. We validate the effectiveness of our approach through a rigorous empirical assessment, employing a newly proposed metric that quantifies the integrity of explanation paths. Our results demonstrate a significant improvement over existing methods, effectively eliminating the generation of inaccurate paths and advancing the state-of-the-art in explainable recommender systems.


title: ClearMark: Intuitive and Robust Model Watermarking via Transposed Model Training

abstract: Due to costly efforts during data acquisition and model training, Deep Neural Networks (DNNs) belong to the intellectual property of the model creator. Hence, unauthorized use, theft, or modification may lead to legal repercussions. Existing DNN watermarking methods for ownership proof are often non-intuitive, embed human-invisible marks, require trust in algorithmic assessment that lacks human-understandable attributes, and rely on rigid thresholds, making it susceptible to failure in cases of partial watermark erasure. This paper introduces ClearMark, the first DNN watermarking method designed for intuitive human assessment. ClearMark embeds visible watermarks, enabling human decision-making without rigid value thresholds while allowing technology-assisted evaluations. ClearMark defines a transposed model architecture allowing to use of the model in a backward fashion to interwove the watermark with the main task within all model parameters. Compared to existing watermarking methods, ClearMark produces visual watermarks that are easy for humans to understand without requiring complex verification algorithms or strict thresholds. The watermark is embedded within all model parameters and entangled with the main task, exhibiting superior robustness. It shows an 8,544-bit watermark capacity comparable to the strongest existing work. Crucially, ClearMark's effectiveness is model and dataset-agnostic, and resilient against adversarial model manipulations, as demonstrated in a comprehensive study performed with four datasets and seven architectures.


title: Pressure-induced non-monotonic crossover of steady relaxation dynamics in a metallic glass

abstract: Relaxation dynamics, as a key to understand glass formation and glassy properties, remains an elusive and challenging issue in condensed matter physics. In this work, in situ high-pressure synchrotron high-energy x-ray photon correlation spectroscopy has been developed to probe the atomic-scale relaxation dynamics of a cerium-based metallic glass during compression. Although the sample density continuously increases, the collective atomic motion initially slows down as generally expected and then counter-intuitively accelerates with further compression (density increase), showing an unusual non-monotonic pressure-induced steady relaxation dynamics crossover at ~3 GPa. Furthermore, by combining in situ high-pressure synchrotron x-ray diffraction, the relaxation dynamics anomaly is evidenced to closely correlate with the dramatic changes in local atomic structures during compression, rather than monotonically scaling with either sample density or overall stress level. These findings could provide new insight into relaxation dynamics and their relationship with local atomic structures of glasses.


title: Strong measurable continuous modifications of stochastic flows

abstract: This paper is devoted to the construction of stochastic flows of measurable mappings in a locally compact separable metric space (M, $\rho$). We propose a new construction that produces strong measurable continuous modifications for certain stochastic flows of measurable mappings in metric graphs.


title: Magneto-optical properties of textured La$_{2/3}$Sr$_{1/3}$MnO$_3$ thin films integrated on silicon via a Ca$_2$Nb$_3$O$_{10}$ nanosheet layer

abstract: We demonstrate the possibility of growing textured La$_{2/3}$Sr$_{1/3}$MnO$_3$ (LSMO) thin films on silicon substrates with magneto-optical and optical properties comparable to high-quality epitaxial layers grown on bulk SrTiO$_3$ (STO). The pulsed laser deposition growth of LSMO is achieved by a two-dimensional nanosheet (NS) seed layer of Ca$_2$Nb$_3$O$_{10}$ (CNO) inducing epitaxial stabilization of LSMO films. The resulting layers possess a higher Curie temperature and a lower overall magnetization than samples of LSMO on STO. Spectra of the full permittivity tensor were calculated from optical and magneto-optical measurements. Spectral dependencies of both the diagonal and off-diagonal elements share many similarities between the LSMO/NS/Si and LSMO/STO samples. These similarities indicate comparable electronic structures of the layers and demonstrate comparable optical quality of textured LSMO on NS/Si and epitaxial LSMO on STO.


title: Towards Explainability in Monocular Depth Estimation

abstract: The estimation of depth in two-dimensional images has long been a challenging and extensively studied subject in computer vision. Recently, significant progress has been made with the emergence of Deep Learning-based approaches, which have proven highly successful. This paper focuses on the explainability in monocular depth estimation methods, in terms of how humans perceive depth. This preliminary study emphasizes on one of the most significant visual cues, the relative size, which is prominent in almost all viewed images. We designed a specific experiment to mimic the experiments in humans and have tested state-of-the-art methods to indirectly assess the explainability in the context defined. In addition, we observed that measuring the accuracy required further attention and a particular approach is proposed to this end. The results show that a mean accuracy of around 77% across methods is achieved, with some of the methods performing markedly better, thus, indirectly revealing their corresponding potential to uncover monocular depth cues, like relative size.


title: Upgrade of the fast analogue intra-pulse phase feedback at SPARC_LAB

abstract: SPARC_LAB is a facility designed for the production of FEL radiation and the exploration of advanced acceleration techniques using a high brightness electron photo-injector. Specifically, particle-driven plasma wakefield acceleration (PWFA) necessitates exceptional beam stability, in order to minimize the jitter between the driver and witness beams. This requirement directly translates into RF phase jitter minimization, since a velocity bunching (RF compression) working point is employed at SPARC_LAB for acceleration. In the past, a fast intra-pulse phase feedback system has been developed to stabilize the klystron RF pulse. This allowed to reach a phase stability of S-band power units (both driven by PFN modulators) below 50 fs rms. However, in order to meet the more stringent requirements of PWFA scheme, some upgrades of this feedback system have been recently carried out. A prototype has been tested on a C-band klystron driven by a solid-state modulator, in order to investigate the possibility for an additional improvement resulting from the inherently more stable power source. In this paper the preliminary measurement results obtained at SPARC_LAB after such upgrades will be reviewed.


title: DualMatch: Robust Semi-Supervised Learning with Dual-Level Interaction

abstract: Semi-supervised learning provides an expressive framework for exploiting unlabeled data when labels are insufficient. Previous semi-supervised learning methods typically match model predictions of different data-augmented views in a single-level interaction manner, which highly relies on the quality of pseudo-labels and results in semi-supervised learning not robust. In this paper, we propose a novel SSL method called DualMatch, in which the class prediction jointly invokes feature embedding in a dual-level interaction manner. DualMatch requires consistent regularizations for data augmentation, specifically, 1) ensuring that different augmented views are regulated with consistent class predictions, and 2) ensuring that different data of one class are regulated with similar feature embeddings. Extensive experiments demonstrate the effectiveness of DualMatch. In the standard SSL setting, the proposal achieves 9% error reduction compared with SOTA methods, even in a more challenging class-imbalanced setting, the proposal can still achieve 6% error reduction. Code is available at https://github.com/CWangAI/DualMatch


title: Demonstration and frequency noise characterization of a 17 $\mu$m quantum cascade laser

abstract: We describe the properties of a continuous-wave room-temperature quantum cascade laser operating at the long wavelength of 17 $\mu$m. Long wavelength mid-infrared quantum cascade lasers offer new opportunities for chemical detection, vibrational spectroscopy and metrological measurements using molecular species. In particular, probing low energy vibrational transitions would be beneficial to the spectroscopy of large and complex molecules, reducing intramolecular vibrational energy redistribution which acts as a decoherence channel. By performing linear absorption spectroscopy of the v2 fundamental vibrational mode of N2O molecules, we have demonstrated the spectral range and spectroscopic potential of this laser, and characterized its free-running frequency noise properties. Finally, we also discuss the potential application of this specific laser in an experiment to test fundamental physics with ultra-cold molecules.


title: Variational principles of metric mean dimension for random dynamical systems

abstract: It is well-known that the relativized variational principle established by Bogenschutz and Kifer connects the fiber topological entropy and fiber measure-theoretic entropy. In context of random dynamical systems, metric mean dimension was introduced to characterize infinite fiber entropy systems. We give four types of measure-theoretic $\epsilon$-entropies, called measure-theoretic entropy of partitions decreasing in diameter, Shapira's entropy, Katok's entropy and Brin-Katok local entropy, and establish four variational principles for metric mean dimension.


title: When Quantum Fluctuations Meet Structural Instabilities: The Isotope- and Pressure-Induced Phase Transition in the Quantum Paraelectric NaOH

abstract: Anhydrous sodium hydroxide, a common and structurally simple compound, shows spectacular isotope effects: NaOD undergoes a first-order transition, which is absent in NaOH. By combining ab initio electronic structure calculations with path integrals, we show that NaOH is an unusual example of a quantum paraelectric: zero-point quantum fluctuations stretch the weak hydrogen bonds (HBs) until they become unstable and break. By strengthening HBs via isotope substitution or applied pressure, the system can be driven down to a broken-symmetry antiferroelectric phase. We also provide a simple quantitative criterion for HB breaking in layered crystals and show that nuclear quantum effects are crucial in paraelectric to ferroelectric transitions in hydrogen-bonded hydroxides.


title: Constructing disjoint Steiner trees in Sierpi\'{n}ski graphs

abstract: Let $G$ be a graph and $S\subseteq V(G)$ with $|S|\geq 2$. Then the trees $T_1, T_2, \cdots, T_\ell$ in $G$ are \emph{internally disjoint Steiner trees} connecting $S$ (or $S$-Steiner trees) if $E(T_i) \cap E(T_j )=\emptyset$ and $V(T_i)\cap V(T_j)=S$ for every pair of distinct integers $i,j$, $1 \leq i, j \leq \ell$. Similarly, if we only have the condition $E(T_i) \cap E(T_j )=\emptyset$ but without the condition $V(T_i)\cap V(T_j)=S$, then they are \emph{edge-disjoint Steiner trees}. The \emph{generalized $k$-connectivity}, denoted by $\kappa_k(G)$, of a graph $G$, is defined as $\kappa_k(G)=\min\{\kappa_G(S)|S \subseteq V(G) \ \textrm{and} \ |S|=k \}$, where $\kappa_G(S)$ is the maximum number of internally disjoint $S$-Steiner trees. The \emph{generalized local edge-connectivity} $\lambda_{G}(S)$ is the maximum number of edge-disjoint Steiner trees connecting $S$ in $G$. The {\it generalized $k$-edge-connectivity} $\lambda_k(G)$ of $G$ is defined as $\lambda_k(G)=\min\{\lambda_{G}(S)\,|\,S\subseteq V(G) \ and \ |S|=k\}$. These measures are generalizations of the concepts of connectivity and edge-connectivity, and they and can be used as measures of vulnerability of networks. It is, in general, difficult to compute these generalized connectivities. However, there are precise results for some special classes of graphs. In this paper, we obtain the exact value of $\lambda_{k}(S(n,\ell))$ for $3\leq k\leq \ell^n$, and the exact value of $\kappa_{k}(S(n,\ell))$ for $3\leq k\leq \ell$, where $S(n, \ell)$ is the Sierpi\'{n}ski graphs with order $\ell^n$. As a direct consequence, these graphs provide additional interesting examples when $\lambda_{k}(S(n,\ell))=\kappa_{k}(S(n,\ell))$. We also study the some network properties of Sierpi\'{n}ski graphs.


title: Covariance matrices for the Lyman-$\alpha$ forest using the lognormal approximation

abstract: We investigate the nature of correlations in the small-scale flux statistics of the Lyman-$\alpha$ (Ly$\alpha$) forest across redshift bins. Understanding these correlations is important for unbiased cosmological and astrophysical parameter inference using the Ly$\alpha$ forest. We focus on the 1-dimensional flux power spectrum (FPS) and mean flux ($\bar F$) simulated using the semi-numerical lognormal model we developed in earlier work. The lognormal model can capture the effects of long wavelength modes with relative ease as compared to full smoothed particle hydrodynamical (SPH) simulations that are limited by box volume. For a single redshift bin of size $\Delta z\simeq 0.1$, we show that the lognormal model predicts positive cross-correlations between $k$-bins in the FPS, and a negative correlation for $\bar F\times$ FPS, in qualitative agreement with SPH simulations and theoretical expectations. For measurements across two neighbouring redshift bins of width $\Delta z$ each (obtained by 'splitting' skewers of length $2\Delta z$ in half), the lognormal model predicts an anti-correlation for FPS $\times$ FPS and a positive correlation for $\bar F\times$ FPS, caused by long wavelength modes. This is in contrast to SPH simulations which predict a negligible magnitude for cross-redshift correlations derived from such `split' skewers, and we discuss possible reasons for this difference. Finally, we perform a preliminary test of the impact of neglecting long wavelength modes on parameter inference, finding that whereas the correlation structure of neighbouring redshift bins has relatively little impact, the absence of long wavelength modes in the model can lead to $\gtrsim2-\sigma$ biases in the inference of astrophysical parameters. Our results motivate a more careful treatment of long wavelength modes in analyses that rely on the small scale Ly$\alpha$ forest for parameter inference.


title: Recent advances in label-free imaging and quantification techniques for the study of lipid droplets in cells

abstract: Lipid droplets (LDs), once considered mere storage depots for lipids, have gained recognition for their intricate roles in cellular processes, including metabolism, membrane trafficking, and disease states like obesity and cancer. This review explores label-free imaging techniques' applications in LD research. We discuss holotomography and vibrational spectroscopic microscopy, emphasizing their potential for studying LDs without molecular labels, and we highlight the growing integration of artificial intelligence. Clinical applications in disease diagnosis and therapy are also considered.


title: Learning Continuous Network Emerging Dynamics from Scarce Observations via Data-Adaptive Stochastic Processes

abstract: Learning network dynamics from the empirical structure and spatio-temporal observation data is crucial to revealing the interaction mechanisms of complex networks in a wide range of domains. However, most existing methods only aim at learning network dynamic behaviors generated by a specific ordinary differential equation instance, resulting in ineffectiveness for new ones, and generally require dense observations. The observed data, especially from network emerging dynamics, are usually difficult to obtain, which brings trouble to model learning. Therefore, how to learn accurate network dynamics with sparse, irregularly-sampled, partial, and noisy observations remains a fundamental challenge. We introduce Neural ODE Processes for Network Dynamics (NDP4ND), a new class of stochastic processes governed by stochastic data-adaptive network dynamics, to overcome the challenge and learn continuous network dynamics from scarce observations. Intensive experiments conducted on various network dynamics in ecological population evolution, phototaxis movement, brain activity, epidemic spreading, and real-world empirical systems, demonstrate that the proposed method has excellent data adaptability and computational efficiency, and can adapt to unseen network emerging dynamics, producing accurate interpolation and extrapolation with reducing the ratio of required observation data to only about 6\% and improving the learning speed for new dynamics by three orders of magnitude.


title: Sourcing the Kerr geometry

abstract: The Kerr metric is a vacuum solution of the Einstein equations outside of a rotating black hole, but what interior matter is actually rotating and sourcing the Kerr geometry? Here, we describe a rotating exotic matter which can source the Kerr geometry for the entire acceptable range of its spin parameter and be shown to saturate the radial null-energy condition at every point in the interior, while being free of any obvious pathologies. We do so by introducing the rotating frozen star, whose compactness is controlled by a perturbative parameter and whose outer surface can be arbitrarily close to the horizon of a Kerr black hole. The interior geometry modifies Kerr's such that there is neither an inner ergosphere nor an inner horizon, and the metric and Einstein tensors are regular everywhere except for a mild, removable singularity at the center of the star. The geometry of each radial slice of the interior is a nearly null surface with the same geometry, but different radial size, as that of the would-be horizon on the outermost slice. Moreover, the metric limits to that of the static frozen star as the spin is taken to zero. The integral of the energy density leads to a rest mass that is equal to the irreducible mass of a Kerr black hole, and the integral of the angular-momentum density confirms that the ratio of the angular momentum to the mass is equal to the Kerr spin parameter. Including the rotational energy in the standard way, we then obtain the total gravitational mass and angular momentum of a Kerr black hole with the same mass and spin parameters. We propose that the rotating frozen star provides a classical description of the highly quantum final state of gravitationally collapsed matter, which features a maximally entropic, stringy fluid as described by our polymer model for the black hole interior.


title: Formal Runtime Error Detection During Development in the Automotive Industry

abstract: Modern automotive software is highly complex and consists of millions lines of code. For safety-relevant automotive software, it is recommended to use sound static program analysis to prove the absence of runtime errors. However, the analysis is often perceived as burdensome by developers because it runs for a long time and produces many false alarms. If the analysis is performed on the integrated software system, there is a scalability problem, and the analysis is only possible at a late stage of development. If the analysis is performed on individual modules instead, this is possible at an early stage of development, but the usage context of modules is missing, which leads to too many false alarms. In this case study, we present how automatically inferred contracts add context to module-level analysis. Leveraging these contracts with an off-the-shelf tool for abstract interpretation makes module-level analysis more precise and more scalable. We evaluate this framework quantitatively on industrial case studies from different automotive domains. Additionally, we report on our qualitative experience for the verification of large-scale embedded software projects.


title: SU(3) breaking effect in the $Z_c$ and $Z_{cs}$ states

abstract: Based on the hadronic resonance picture, we propose a possible framework to simultaneously describe the resonance parameters of the observed $Z_{cs}$ and $Z_{c}$ states that are close to the thresholds of the $D^{(*)}\bar{D}^{(*)}_s$ and $D^{(*)}\bar{D}^{(*)}$ systems, respectively. We construct the effective potentials of the $Z_{cs}$ and $Z_{c}$ states by analogy with the effective potentials of the leading order (LO) and next-to-leading-order (NLO) $N-\bar{N}$ interactions. Then we introduce an SU(3) breaking factor $g_x$ to identify the differences between the effective potentials in the $Z_{cs}$ and $Z_{c}$ states. We perform two calculations to discuss the differences and similarities of the $Z_{cs}$ and $Z_{c}$ states. In the first calculation, we adopt the LECs extracted from the experimental $Z_{cs}$ states to calculate the $Z_c$ states, and show that if the $Z_{cs}(4000)$ is the SU(3) partner of the $Z_c(3900)$, then our framework can reproduce the large width difference between the $Z_{cs}(4000)$ and $Z_{c}(3900)$ by adjusting the SU(3) breaking factor in a reasonable region. Besides, this SU(3) breaking effect also accounts for the absence of a $Z_{c}$ state with $J^{PC}=1^{++}$, which should be the SU(3) partner of the $Z_{cs}(3985)$. In the second calculation, we separately fit the LECs from the experimental $Z_{cs}$ and $Z_{c}$ states. We show that these two sets of LECs are very similar to each other, indicating a unified set of LECs that could describe the effective potentials of the $Z_{cs}$ and $Z_{c}$ states simultaneously. Then we proceed to systematically predict the other possible $Z_{cs}$ and $Z_{c}$ states that are close to the $D^{(*)}\bar{D}^{(*)}_s$ and $D^{(*)}\bar{D}^{(*)}$ systems, respectively. Further explorations on the $Z_{cs}$ states would be crucial to test our theory.


title: Understanding Impact of Angle in Urban Transportation

abstract: Traffic congestion at urban-scale levels occurs when road network supply is insufficient compared with demand. Therefore, the relationship between supply and demand has been extensively investigated in the literature. Especially the impact of a network's topology (i.e., connectivity) on traffic congestion has been widely studied. On the other hand, only a few studies analyze the relationship between the physical shape of the road network (i.e., morphology), demand, and congestion. For example, angular indicators associated with links and trips can be utilized to characterize such morphology. However, statistical analysis of angular indicators requires a specialized methodology called Directional Statistics, and how to apply Directional Statistics to traffic data is not obvious. Here, this study develops a descriptive model of traffic congestion based on Directional Statistics. It describes direction-dependent congestion levels using angular distributions that characterize the shape of road network and travel demand. Specifically, the shape of road network is characterized by the distribution of angles of each road link in a specific region. Likewise, the travel demand is characterized by the distribution of angles of each trip in the region. Then, a statistical model that describes travel time for a trip with arbitrary direction by these two angular distribution is constructed by paying special attention to the fact that roads and demands from all angles would affect congestion. A simple estimation method for the proposed model is also presented. Finally, the model was estimated using actual data in Tokyo, and the relationship between the characteristics of the shape of the road network, the direction of demand, and congestion is analyzed from the new perspective of angles.


title: Violation of the two-time Leggett-Garg inequalities for a harmonic oscillator

abstract: We investigate the violation of the Leggett-Garg inequalities for a harmonic oscillator in various quantum states. We focus on the two-time quasi-probability distribution function with a dichotomic variable constructed with the position operator of a harmonic oscillator. First, we developed a new formula to compute the two-time quasi-probability distribution function, whose validity is demonstrated in comparison with the formula developed in the recent paper by Mawby and Halliwell[Phys.Rev.A, 107 032216 (2023)]. Second, we demonstrated the variety of the violation of the two-time Leggett-Garg inequalities assuming various quantum states of a harmonic oscillator including the squeezed coherent state and the thermal squeezed coherent state. Third, we demonstrated that a certain type of extension of the dichotomic variable and the corresponding projection operator can boost violation of the Leggett-Garg inequalities for the ground state and the squeezed state. We also discuss when the Leggett-Garg inequalities are violated in an intuitive manner.


title: Semiring Provenance for Lightweight Description Logics

abstract: We investigate semiring provenance--a successful framework originally defined in the relational database setting--for description logics. In this context, the ontology axioms are annotated with elements of a commutative semiring and these annotations are propagated to the ontology consequences in a way that reflects how they are derived. We define a provenance semantics for a language that encompasses several lightweight description logics and show its relationships with semantics that have been defined for ontologies annotated with a specific kind of annotation (such as fuzzy degrees). We show that under some restrictions on the semiring, the semantics satisfies desirable properties (such as extending the semiring provenance defined for databases). We then focus on the well-known why-provenance, which allows to compute the semiring provenance for every additively and multiplicatively idempotent commutative semiring, and for which we study the complexity of problems related to the provenance of an axiom or a conjunctive query answer. Finally, we consider two more restricted cases which correspond to the so-called positive Boolean provenance and lineage in the database setting. For these cases, we exhibit relationships with well-known notions related to explanations in description logics and complete our complexity analysis. As a side contribution, we provide conditions on an ELHI_bot ontology that guarantee tractable reasoning.


title: Symphony of experts: orchestration with adversarial insights in reinforcement learning

abstract: Structured reinforcement learning leverages policies with advantageous properties to reach better performance, particularly in scenarios where exploration poses challenges. We explore this field through the concept of orchestration, where a (small) set of expert policies guides decision-making; the modeling thereof constitutes our first contribution. We then establish value-functions regret bounds for orchestration in the tabular setting by transferring regret-bound results from adversarial settings. We generalize and extend the analysis of natural policy gradient in Agarwal et al. [2021, Section 5.3] to arbitrary adversarial aggregation strategies. We also extend it to the case of estimated advantage functions, providing insights into sample complexity both in expectation and high probability. A key point of our approach lies in its arguably more transparent proofs compared to existing methods. Finally, we present simulations for a stochastic matching toy model.


title: Janus icosahedral particles: amorphization driven by three-dimensional atomic misfit and edge dislocation compensation

abstract: Icosahedral nanoparticles composed of fivefold twinned tetrahedra have broad applications. The strain relief mechanism and angular deficiency in icosahedral multiply twinned particles are poorly understood in three dimensions. Here, we resolved the three-dimensional atomic structures of Janus icosahedral nanoparticles using atomic resolution electron tomography. A geometrically fivefold face consistently corresponds to a less ordered face like two hemispheres. We quantify rich structural variety of icosahedra including bond orientation order, bond length, strain tensor; and packing efficiency, atom number, solid angle of each tetrahedron. These structural characteristics exhibit two-sided distribution. Edge dislocations near the axial atoms and small disordered domains fill the angular deficiency. Our findings provide new insights how the fivefold symmetry can be compensated and the geometrically-necessary internal strains relived in multiply twinned particles.


title: Efficient Serverless Function Scheduling at the Network Edge

abstract: Serverless computing is a promising approach for edge computing since its inherent features, e.g., lightweight virtualization, rapid scalability, and economic efficiency. However, previous studies have not studied well the issues of significant cold start latency and highly dynamic workloads in serverless function scheduling, which are exacerbated at the resource-limited network edge. In this paper, we formulate the Serverless Function Scheduling (SFS) problem for resource-limited edge computing, aiming to minimize the average response time. To efficiently solve this intractable scheduling problem, we first consider a simplified offline form of the problem and design a polynomial-time optimal scheduling algorithm based on each function's weight. Furthermore, we propose an Enhanced Shortest Function First (ESFF) algorithm, in which the function weight represents the scheduling urgency. To avoid frequent cold starts, ESFF selectively decides the initialization of new function instances when receiving requests. To deal with dynamic workloads, ESFF judiciously replaces serverless functions based on the function weight at the completion time of requests. Extensive simulations based on real-world serverless request traces are conducted, and the results show that ESFF consistently and substantially outperforms existing baselines under different settings.


title: Exponential stability of solutions to the Schr{\"o}dinger-Poisson equation

abstract: We prove an exponential stability result for the small solutions of the Schr{\"o}dinger-Poisson equation on the circle without exterior parameters in Gevrey class. More precisely we prove that for most of the initial data of Gevrey-norm smaller than $\varepsilon$ small enough, the solution of the Schr{\"o}dinger-Poisson equation remains smaller than $2\varepsilon$ for times of order $exp(\alpha |\log \varepsilon|^2 / \log |\log \varepsilon|)$. We stress out that this is the optimal time expected for PDEs as conjectured by Jean Bourgain in [Bou04].


title: Show from Tell: Audio-Visual Modelling in Clinical Settings

abstract: Auditory and visual signals usually present together and correlate with each other, not only in natural environments but also in clinical settings. However, the audio-visual modelling in the latter case can be more challenging, due to the different sources of audio/video signals and the noise (both signal-level and semantic-level) in auditory signals -- usually speech. In this paper, we consider audio-visual modelling in a clinical setting, providing a solution to learn medical representations that benefit various clinical tasks, without human expert annotation. A simple yet effective multi-modal self-supervised learning framework is proposed for this purpose. The proposed approach is able to localise anatomical regions of interest during ultrasound imaging, with only speech audio as a reference. Experimental evaluations on a large-scale clinical multi-modal ultrasound video dataset show that the proposed self-supervised method learns good transferable anatomical representations that boost the performance of automated downstream clinical tasks, even outperforming fully-supervised solutions.


title: Modelling pyro-convection phenomenon during a mega-fire event in Portugal

abstract: The present study contributes to an increased understanding of pyro-convection phenomena by using a fire-atmosphere coupled simulation, and investigates in detail the large-scale meteorological conditions affecting Portugal during the occurrence of multiple mega-fires events on 15 October 2017. Two numerical simulations were performed using the MesoNH atmospheric model. The first simulation, was run for a large single domain (300 x 250 grid points) with a 15 km resolution. In the second one, the MesoNH was coupled to a fire propagation model (ForeFire) to study in detail the Quiaios's fire. To optimize both high resolution in the proximity of the fire region and computational efficiency, the simulation is set up using 3 nested domains (300 x 300 grid points) with horizontal resolution of 2000 m, 400 m, and 80 m respectively. The emission into the atmosphere of the heat and the water vapour fluxes caused by the evolving fire is managed by the ForeFire code. The fire spatio-temporal evolution is based on an assigned map, which follows what reported by public authorities. At the large scale, the simulation shows the evolution of the hurricane Ophelia, pointing out the influence of south/southwest winds on the rapid spread of active fires, as well as the subtropical moisture transport toward mainland Portugal in the early evening, when violent pyro-convective activity was observed in Central Portugal. The coupled simulation allowed to reproduce the formation of a PyroCu cloud inside the smoke plume. The convective updraughts caused by the fire led to the vertical transport of water vapour to higher levels and enhanced the development of a high-based cloud over a dry atmospheric layer within the smoke plume.


title: Harris's method for non-conservative periodic semiflows and application to some non-local PDEs

abstract: In this paper we propose some Harris-like criteria in order to study the long time behavior of general positive and periodic semiflows. These criteria allow us to obtain new existence results of principal eigenelements, and their exponential attractiveness. We present applications to two biological models in a space-time varying environment: a non local selection-mutation equation and a growth-fragmentation equation. The particularity of this article is to study some inhomogeneous problems that are periodic in time, as it appears for instance when the environment changes, due for instance to the seasonal cycle or circadian rhythms.


title: Exploring the Formation of Resistive Pseudodisks with the GPU Code Astaroth

abstract: Pseudodisks are dense structures formed perpendicular to the direction of the magnetic field during the gravitational collapse of a molecular cloud core. Numerical simulations of the formation of pseudodisks are usually computationally expensive with conventional CPU codes. To demonstrate the proof-of-concept of a fast computing method for this numerically costly problem, we explore the GPU-powered MHD code Astaroth, a 6th-order finite difference method with low adjustable finite resistivity implemented with sink particles. The formation of pseudodisks is physically and numerically robust and can be achieved with a simple and clean setup for this newly adopted numerical approach for science verification. The method's potential is illustrated by evidencing the dependence on the initial magnetic field strength of specific physical features accompanying the formation of pseudodisks, e.g. the occurrence of infall shocks and the variable behavior of the mass and magnetic flux accreted on the central object. As a performance test, we measure both weak and strong scaling of our implementation to find most efficient way to use the code on a multi-GPU system. Once suitable physics and problem-specific implementations are realized, the GPU-accelerated code is an efficient option for 3-D magnetized collapse problems.


title: A Novel Approach for Object Based Audio Broadcasting

abstract: Object Based Audio (OBA) provides a new kind of audio experience, delivered to the audience to personalize and customize their experience of listening and to give them choice of what and how to hear their audio content. OBA can be applied to different platforms such as broadcasting, streaming and cinema sound. This paper presents a novel approach for creating object-based audio on the production side. The approach here presents Sample-by-Sample Object Based Audio (SSOBA) embedding. SSOBA places audio object samples in such a way that allows audiences to easily individualize their chosen audio sources according to their interests and needs. SSOBA is an extra service and not an alternative, so it is also compliant with legacy audio players. The biggest advantage of SSOBA is that it does not require any special additional hardware in the broadcasting chain and it is therefore easy to implement and equip legacy players and decoders with enhanced ability. Input audio objects, number of output channels and sampling rates are three important factors affecting SSOBA performance and specifying it to be lossless or lossy. SSOBA adopts interpolation at the decoder side to compensate for eliminated samples. Both subjective and objective experiments are carried out to evaluate the output results at each step. MUSHRA subjective experiments conducted after the encoding step shows good-quality performance of SSOBA with up to five objects. SNR measurements and objective experiments, performed after decoding and interpolation, show significant successful recovery and separation of audio objects. Experimental results show that a minimum sampling rate of 96 kHz is indicated to encode up to five objects in a Stereo-mode channel to acquire good subjective and objective results simultaneously.


title: Primordial Black Hole formation from overlapping cosmological fluctuations

abstract: We consider the formation of primordial black holes (PBHs), during the radiation-dominated Universe, generated from the collapse of super-horizon curvature fluctuations that are overlapped with others on larger scales. Using a set of different curvature profiles, we show that the threshold for PBH formation (defined as the critical peak of the compaction function) can be decreased by several percentages, thanks to the overlapping between two peaks in the profile of the compaction function. In the opposite case, when the fluctuations are sufficiently decoupled the threshold values behave as having the fluctuations isolated (isolated peaks). We find that the analytical estimates of arXiv:1907.13311 can be used accurately when applied to the corresponding peak that is leading to the gravitational collapse. We also study in detail the dynamics and estimate the final PBH mass for different initial configurations, showing that the profile dependence has a significant effect on that.


title: Gramian Attention Heads are Strong yet Efficient Vision Learners

abstract: We introduce a novel architecture design that enhances expressiveness by incorporating multiple head classifiers (\ie, classification heads) instead of relying on channel expansion or additional building blocks. Our approach employs attention-based aggregation, utilizing pairwise feature similarity to enhance multiple lightweight heads with minimal resource overhead. We compute the Gramian matrices to reinforce class tokens in an attention layer for each head. This enables the heads to learn more discriminative representations, enhancing their aggregation capabilities. Furthermore, we propose a learning algorithm that encourages heads to complement each other by reducing correlation for aggregation. Our models eventually surpass state-of-the-art CNNs and ViTs regarding the accuracy-throughput trade-off on ImageNet-1K and deliver remarkable performance across various downstream tasks, such as COCO object instance segmentation, ADE20k semantic segmentation, and fine-grained visual classification datasets. The effectiveness of our framework is substantiated by practical experimental results and further underpinned by generalization error bound. We release the code publicly at: https://github.com/Lab-LVM/imagenet-models.


title: Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

abstract: Representational spaces learned via language modeling are fundamental to Natural Language Processing (NLP), however there has been limited understanding regarding how and when during training various types of linguistic information emerge and interact. Leveraging a novel information theoretic probing suite, which enables direct comparisons of not just task performance, but their representational subspaces, we analyze nine tasks covering syntax, semantics and reasoning, across 2M pre-training steps and five seeds. We identify critical learning phases across tasks and time, during which subspaces emerge, share information, and later disentangle to specialize. Across these phases, syntactic knowledge is acquired rapidly after 0.5% of full training. Continued performance improvements primarily stem from the acquisition of open-domain knowledge, while semantics and reasoning tasks benefit from later boosts to long-range contextualization and higher specialization. Measuring cross-task similarity further reveals that linguistically related tasks share information throughout training, and do so more during the critical phase of learning than before or after. Our findings have implications for model interpretability, multi-task learning, and learning from limited data.


title: A Comprehensive Python Library for Deep Learning-Based Event Detection in Multivariate Time Series Data and Information Retrieval in NLP

abstract: Event detection in time series data is crucial in various domains, including finance, healthcare, cybersecurity, and science. Accurately identifying events in time series data is vital for making informed decisions, detecting anomalies, and predicting future trends. Despite extensive research exploring diverse methods for event detection in time series, with deep learning approaches being among the most advanced, there is still room for improvement and innovation in this field. In this paper, we present a new deep learning supervised method for detecting events in multivariate time series data. Our method combines four distinct novelties compared to existing deep-learning supervised methods. Firstly, it is based on regression instead of binary classification. Secondly, it does not require labeled datasets where each point is labeled; instead, it only requires reference events defined as time points or intervals of time. Thirdly, it is designed to be robust by using a stacked ensemble learning meta-model that combines deep learning models, ranging from classic feed-forward neural networks (FFNs) to state-of-the-art architectures like transformers. This ensemble approach can mitigate individual model weaknesses and biases, resulting in more robust predictions. Finally, to facilitate practical implementation, we have developed a Python package to accompany our proposed method. The package, called eventdetector-ts, can be installed through the Python Package Index (PyPI). In this paper, we present our method and provide a comprehensive guide on the usage of the package. We showcase its versatility and effectiveness through different real-world use cases from natural language processing (NLP) to financial security domains.


title: Delocalization of vortex magnetic field near a planar defect

abstract: In this letter we discuss physical mechanisms for delocalization of the magnetic field of Abrikosov vortex in superconductors in the presence of planar defects of various electronic transparency. The resulting strong perturbation of the supercurrent can significantly affect the local flux measurements and mimic the vortices that carried only part of a flux quantum.