title: Multi-threshold Deep Metric Learning for Facial Expression Recognition

abstract: Effective expression feature representations generated by a triplet-based deep metric learning are highly advantageous for facial expression recognition (FER). The performance of triplet-based deep metric learning is contingent upon identifying the best threshold for triplet loss. Threshold validation, however, is tough and challenging, as the ideal threshold changes among datasets and even across classes within the same dataset. In this paper, we present the multi-threshold deep metric learning technique, which not only avoids the difficult threshold validation but also vastly increases the capacity of triplet loss learning to construct expression feature representations. We find that each threshold of the triplet loss intrinsically determines a distinctive distribution of inter-class variations and corresponds, thus, to a unique expression feature representation. Therefore, rather than selecting a single optimal threshold from a valid threshold range, we thoroughly sample thresholds across the range, allowing the representation characteristics manifested by thresholds within the range to be fully extracted and leveraged for FER. To realize this approach, we partition the embedding layer of the deep metric learning network into a collection of slices and model training these embedding slices as an end-to-end multi-threshold deep metric learning problem. Each embedding slice corresponds to a sample threshold and is learned by enforcing the corresponding triplet loss, yielding a set of distinct expression features, one for each embedding slice. It makes the embedding layer, which is composed of a set of slices, a more informative and discriminative feature, hence enhancing the FER accuracy. Extensive evaluations demonstrate the superior performance of the proposed approach on both posed and spontaneous facial expression datasets.


title: Loop torsors and Abhyankar's lemma

abstract: We define the notion of loop torsors under certain group schemes defined over the localization of a regularhenselian ring A at a strict normal crossing divisor D. We provide a Galois cohomological criterion for classifying those torsors. We revisit also the related theory of loop torsors on Laurent polynomial rings.


title: Petrophysical Characterization of Fractured Limestone from Beauce Aquifer Vadose Zone (O-ZNS Observatory, France)

abstract: In recent years, water needs increased, driven by climate change and world population growth. In this context, we study groundwater flow in the vadose zone of Beauce aquifer (O-ZNS site, France). This lacustrine limestone vadose zone is characterized by multi-scale heterogeneities. They are defined by strongly various pore structures. This leads to uncertainties for reservoir properties prediction using geophysical methods which impacts reservoir models for flow simulations.In this study, we combined microstructure description and petrophysical analysis in order to model and predict reservoir properties based on different limestones facies and to infer the influence of weathering/fracturing on both acoustics and electrical properties.A total of 16 samples from these facies were cored and characterized by their porosity, permeability, acoustic velocities, complex electrical properties and microstructure analysis.Based on our multi-method approach, we demonstrated the influence of rock structure on reservoir properties prediction and modelling. Petrophysical and microstructure characterization have highlighted two main facies (microporous and homogenous facies and macroporous and heterogenous facies) which can be used to improve reservoir and flow models. However, further development is needed in order to quantify macropores and their link with weathering and to assess permeability models using electrical properties.


title: Theory on Mixture-of-Experts in Continual Learning

abstract: Continual learning (CL) has garnered significant attention because of its ability to adapt to new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been identified as a major issue in CL, as the model adapts to new tasks. The Mixture-of-Experts (MoE) model has recently been shown to effectively mitigate catastrophic forgetting in CL, by employing a gating network to sparsify and distribute diverse tasks among multiple experts. However, there is a lack of theoretical analysis of MoE and its impact on the learning performance in CL. This paper provides the first theoretical results to characterize the impact of MoE in CL via the lens of overparameterized linear regression tasks. We establish the benefit of MoE over a single expert by proving that the MoE model can diversify its experts to specialize in different tasks, while its router learns to select the right expert for each task and balance the loads across all experts. Our study further suggests an intriguing fact that the MoE in CL needs to terminate the update of the gating network after sufficient training rounds to attain system convergence, which is not needed in the existing MoE studies that do not consider the continual task arrival. Furthermore, we provide explicit expressions for the expected forgetting and overall generalization error to characterize the benefit of MoE in the learning performance in CL. Interestingly, adding more experts requires additional rounds before convergence, which may not enhance the learning performance. Finally, we conduct experiments on both synthetic and real datasets to extend these insights from linear models to deep neural networks (DNNs), which also shed light on the practical algorithm design for MoE in CL.


title: Constrained velocity-free control of spacecraft attitude via explicit reference governor

abstract: This paper introduces an explicit reference governor-based control scheme tailored for addressing the velocity-free spacecraft attitude maneuver problem. This problem is subject to specific constraints, namely the pointing constraint, angular velocity constraint, and input saturation. The proposed control scheme operates in two layers, ensuring the asymptotic stability of the spacecraft's attitude while adhering to the aforementioned constraints. The inner layer employs output feedback control utilizing an angular velocity observer based on immersion and invariance technology. This observer facilitates attitude stabilization without the measurement of angular velocity. Through an analysis of the geometry associated with the pointing constraint, determination of the upper bound of angular velocity, and optimization of the control input solution, the reference layer establishes a safety boundary described by the invariant set. Additionally, we introduce the dynamic factor related to the angular velocity estimation error into the invariant set to prevent states from exceeding the constraint set due to unmeasurable angular velocity information. The shortest guidance path is then designed in the reference layer. Finally, we substantiate the efficacy of the proposed constrained attitude control algorithm through numerical simulations.


title: Exploring Test-Time Adaptation for Object Detection in Continually Changing Environments

abstract: For real-world applications, neural network models are commonly deployed in dynamic environments, where the distribution of the target domain undergoes temporal changes. Continual Test-Time Adaptation (CTTA) has recently emerged as a promising technique to gradually adapt a source-trained model to test data drawn from a continually changing target domain. Despite recent advancements in addressing CTTA, two critical issues remain: 1) The use of a fixed threshold for pseudo-labeling in existing methodologies leads to the generation of low-quality pseudo-labels, as model confidence varies across categories and domains; 2) While current solutions utilize stochastic parameter restoration to mitigate catastrophic forgetting, their capacity to preserve critical information is undermined by its intrinsic randomness. To tackle these challenges, we present CTAOD, aiming to enhance the performance of detection models in CTTA scenarios. Inspired by prior CTTA works for effective adaptation, CTAOD is founded on the mean-teacher framework, characterized by three core components. Firstly, the object-level contrastive learning module tailored for object detection extracts object-level features using the teacher's region of interest features and optimizes them through contrastive learning. Secondly, the dynamic threshold strategy updates the category-specific threshold based on predicted confidence scores to improve the quality of pseudo-labels. Lastly, we design a data-driven stochastic restoration mechanism to selectively reset inactive parameters using the gradients as weights for a random mask matrix, thereby ensuring the retention of essential knowledge. We demonstrate the effectiveness of our approach on four CTTA tasks for object detection, where CTAOD outperforms existing methods, especially achieving a 3.0 mAP improvement on the Cityscapes-to-Cityscapes-C CTTA task.


title: On symplectic geometry of tangent bundles of Hermitian symmetric spaces

abstract: We explicitly construct a symplectomorphism that relates magnetic twists to the invariant hyperk\"ahler structure of the tangent bundle of a Hermitian symmetric space. This symplectomorphism reveals foliations by (pseudo-) holomorphic planes, predicted by vanishing of symplectic homology. Furthermore, in the spirit of Weinstein's tubular neighborhood theorem, we extend the (Lagrangian) diagonal embedding of a compact Hermitian symmetric space to an open dense embedding of a specified neighborhood of the zero section. Using this embedding, we compute the Gromov width and Hofer-Zehnder capacity of these neighborhoods of the zero section.


title: UniCoder: Scaling Code Large Language Model via Universal Code

abstract: Intermediate reasoning or acting steps have successfully improved large language models (LLMs) for handling various downstream natural language processing (NLP) tasks. When applying LLMs for code generation, recent works mainly focus on directing the models to articulate intermediate natural-language reasoning steps, as in chain-of-thought (CoT) prompting, and then output code with the natural language or other structured intermediate steps. However, such output is not suitable for code translation or generation tasks since the standard CoT has different logical structures and forms of expression with the code. In this work, we introduce the universal code (UniCode) as the intermediate representation. It is a description of algorithm steps using a mix of conventions of programming languages, such as assignment operator, conditional operator, and loop. Hence, we collect an instruction dataset UniCoder-Instruct to train our model UniCoder on multi-task learning objectives. UniCoder-Instruct comprises natural-language questions, code solutions, and the corresponding universal code. The alignment between the intermediate universal code representation and the final code solution significantly improves the quality of the generated code. The experimental results demonstrate that UniCoder with the universal code significantly outperforms the previous prompting methods by a large margin, showcasing the effectiveness of the structural clues in pseudo-code.


title: EmoLLM: Multimodal Emotional Understanding Meets Large Language Models

abstract: Multi-modal large language models (MLLMs) have achieved remarkable performance on objective multimodal perception tasks, but their ability to interpret subjective, emotionally nuanced multimodal content remains largely unexplored. Thus, it impedes their ability to effectively understand and react to the intricate emotions expressed by humans through multimodal media. To bridge this gap, we introduce EmoBench, the first comprehensive benchmark designed specifically to evaluate the emotional capabilities of MLLMs across five popular emotional tasks, using a diverse dataset of 287k images and videos paired with corresponding textual instructions. Meanwhile, we propose EmoLLM, a novel model for multimodal emotional understanding, incorporating with two core techniques. 1) Multi-perspective Visual Projection, it captures diverse emotional cues from visual data from multiple perspectives. 2) EmoPrompt, it guides MLLMs to reason about emotions in the correct direction. Experimental results demonstrate that EmoLLM significantly elevates multimodal emotional understanding performance, with an average improvement of 12.1% across multiple foundation models on EmoBench. Our work contributes to the advancement of MLLMs by facilitating a deeper and more nuanced comprehension of intricate human emotions, paving the way for the development of artificial emotional intelligence capabilities with wide-ranging applications in areas such as human-computer interaction, mental health support, and empathetic AI systems. Code, data, and model will be released.


title: Deriving the Redfield equation for electronically open molecules

abstract: We introduce a formalism to describe fractional charging of a molecule due to interactions with its environment. The interactions which induce fractional charging are contained in the Hamiltonian of the full system (molecule and environment). Such interactions can be singled out by expressing the Hamiltonian in a local spin orbital basis, and they are the main focus of this work. A reduced density operator for the molecule is derived starting from the Liouville-von Neumann equation for the full system by employing an explicitly constructed projection superoperator. By treating the molecule as an electronically open quantum system, we obtain a Redfield equation where the environment is included approximately. Phenomenological broadening of energy levels is included to mimic finite lifetimes of electronic states. The populations of the reduced density operator determine the mixture of different redox states and, hence, the fractional charging of the molecule. To illustrate the formalism, we use benzene physisorbed on a graphene sheet as a toy model. The work presented in this paper constitutes an initial step toward understanding molecules as electronically open quantum systems.


title: Enumeration of Row-Column Designs

abstract: We computationally completely enumerate a number of types of row-column designs up to isotopism, including double, sesqui and triple arrays as known from the literature, and two newly introduced types that we call mono arrays and AO-arrays. We calculate autotopism group sizes for the designs we generate. For larger parameter values, where complete enumeration is not feasible, we generate examples of some of the designs, and generate exhaustive lists of admissible parameters. For some admissible parameter sets, we prove non-existence results. We also give some explicit constructions of sesqui arrays, mono arrays and AO-arrays, and investigate connections to Youden rectangles and binary pseud Youden designs.


title: Experimental investigation of exit dynamics of a circular cylinder out of water and silicone oil

abstract: Experimental investigations of the exit dynamics of a horizontal cylindrical object were performed in water and silicone oil (50 cSt). The fully immersed cylinder was initially at rest in a still fluid tank before being pushed (or pulled according to the measurement procedure) upwards at a constant velocity. Firstly, we demonstrate that these conditions are better satisfied for a large aspect ratio cylinder equipped with vertical side plates. Secondly, the influence of the initial depth on the liquid entrained and the wake generated by the cylinder is discussed. The deformation of the bath is found to be independent of the starting depth when the starting depth is larger than 6 times the cylinder diameter. In the present case, this criterion reflects also the finite acceleration of the cylinder to reach the determined constant exit velocity. Measurements in a range of exit speeds between 0.1 and 1 m/s indicate that the thickness of the liquid above the cylinder, when the cylinder starts crossing the interface, increases with the speed according to a logarithmic law of the Froude number. During the subsequent drainage, the evolution of the coated liquid thickness is found to first decrease exponentially with time just after the crossing of the interface. At later times, a change of regime occurs and the drainage follows the inverse of the square root of time irrespective of the crossing speed. Finally, the force necessary to maintain a constant exit speed during the motion of the cylinder inside and outside the bath is analyzed. This global measurement of the entrained liquid confirms the square root scaling of the thinning with time during the drainage process.


title: Ray tracing simulations of bending magnet sources with SHADOW4

abstract: We explain the algorithm employed in SHADOW4 to generate bending magnet sources. We provide an overview of the fundamental equations used to calculate the spectral and angular distributions of synchrotron emission from bending magnets. We outline the procedures for ray sampling. We present examples for intensity and polarization of the bending magnet at the old ESRF1 storage ring, and phase spaces for the bending magnet of the upcoming ALSU ring. Finally, we discuss the calculation of the effective source size and compare it with ray tracing.


title: Transient Evaluation of Non-Markovian Models by Stochastic State Classes and Simulation

abstract: Non-Markovian models have great expressive power, at the cost of complex analysis of the stochastic process. The method of Stochastic State Classes (SSCs) derives closed-form analytical expressions for the joint Probability Density Functions (PDFs) of the active timers with marginal expolynomial PDF, though being hindered by the number of concurrent non-exponential timers and of discrete events between regenerations. Simulation is an alternative capable of handling the large class of PDFs samplable via inverse transform, which however suffers from rare events. We combine these approaches to analyze time-bounded transient properties of non-Markovian models. We enumerate SSCs near the root of the state-space tree and then rely on simulation to reach the target, affording transient evaluation of models for which the method of SSCs is not viable while reducing computational time and variance of the estimator of transient probabilities with respect to simulation. Promising results are observed in the estimation of rare event probabilities.


title: Analysis of surface tension in terms of force gradient per unit area

abstract: Conventionally, surface tension is expressed as a force per unit length or as an energy per unit area.In this paper, we propose a thought experiment which consists of replacing the surface tension by an equivalent force gradient following fluid mechanics principles. Such a system of equivalent forces allows to analyze the effects of tensioactivity in terms of force per unit area or in terms of energy per unit volume.This theoretical tool proposes an alternative vision of tensioactivity forces at the interfaces and allows to rewrite the wellknown capillarity equations by calculating forces equilibrium at steady state. The new equations will be applied the case of known phenomena known phenomena such as meniscus, capillary tube, wilhelmy blade and equilibrium of drops and semi-drops.The paper will be concluded by extending our thought experience with the formulation of some hypotheses that would make it possible to interpret such equivalent stress gradients.


title: Evaluating and Analyzing Relationship Hallucinations in LVLMs

abstract: The issue of hallucinations is a prevalent concern in existing Large Vision-Language Models (LVLMs). Previous efforts have primarily focused on investigating object hallucinations, which can be easily alleviated by introducing object detectors. However, these efforts neglect hallucinations in inter-object relationships, which is essential for visual comprehension. In this work, we introduce R-Bench, a novel benchmark for evaluating Vision Relationship Hallucination. R-Bench features image-level questions that focus on the existence of relationships and instance-level questions that assess local visual comprehension. We identify three types of relationship co-occurrences that lead to hallucinations: relationship-relationship, subject-relationship, and relationship-object. The visual instruction tuning dataset's long-tail distribution significantly impacts LVLMs' understanding of visual relationships. Furthermore, our analysis reveals that current LVLMs tend to disregard visual content and overly rely on the common sense knowledge of Large Language Models. They also struggle with reasoning about spatial relationships based on contextual information.


title: Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

abstract: State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter count and computational costs without significantly impacting their performance. Our study focuses on transformer-based LLMs, specifically targeting the computationally intensive feedforward networks (FFN), which are less studied than attention blocks. We consider three candidate linear layer approximations in the FFN by combining efficient low-rank and block-diagonal matrices. In contrast to many previous works that examined these approximations, our study i) explores these structures from the training-from-scratch perspective, ii) scales up to 1.3B parameters, and iii) is conducted within recent Transformer-based LLMs rather than convolutional architectures. We first demonstrate they can lead to actual computational gains in various scenarios, including online decoding when using a pre-merge technique. Additionally, we propose a novel training regime, called \textit{self-guided training}, aimed at improving the poor training dynamics that these approximations exhibit when used from initialization. Experiments on the large RefinedWeb dataset show that our methods are both efficient and effective for training and inference. Interestingly, these structured FFNs exhibit steeper scaling curves than the original models. Further applying self-guided training to the structured matrices with 32\% FFN parameters and 2.5$\times$ speed-up enables only a 0.4 perplexity increase under the same training FLOPs. Finally, we develop the wide and structured networks surpassing the current medium-sized and large-sized Transformer in perplexity and throughput performance. Our code is available at \url{https://github.com/CLAIRE-Labo/StructuredFFN/tree/main}.


title: Auxiliary Chemical Geothermometers Applied to Waters from some East African Rift Areas (Djibouti, Ethiopia, Kenya) for Geothermal Exploration

abstract: If the temperature values of geothermal reservoirs given by classical chemical geothermometers applied on thermal waters are relatively divergent, it is often difficult to estimate the temperatures of these reservoirs with sufficient accuracy for geothermal exploration, before drilling operations. In this case, some auxiliary chemical geothermometers such as Na-Li, Mg-Li, Na-Rb, Na-Cs, K-Sr, K-F, K-Mn, K-Fe, K-W, etc., existing in the literature can be useful tools to help estimating these temperatures. However, previous studies have shown these geothermometers are not only dependent on temperature, but also on other parameters such as the nature of the reservoir rocks and minerals, the fluid salinity, etc. Consequently, they must be used with caution. Another problem for the use of these geothermometers is that Li, Sr, Cs, Rb, Mn, Fe and W are under the form of trace elements in numerous geothermal waters and that it is often difficult to find analyses of these elements in the literature. In this study, we test some of these auxiliary geothermometers on several waters selected from literature data relative to East African Rift (EAR) geothermal areas, in Republic of Djibouti, Ethiopia and Kenya, where temperature values of deep geothermal reservoirs have been measured into wells or estimated with certainty using chemical classical geothermometers applied on thermal waters. The comparative results are discussed and allow bringing conclusions and recommendations. Among the tested auxiliary geothermometers, this work shows that the Na-Li thermometric relationship defined for the dilute waters from hightemperature volcanic geothermal areas of Iceland is one of the most relevant to estimate the temperatures of deep reservoirs for waters from several geothermal areas from the Republic of Djibouti, Ethiopia and Kenya. In previous studies, this Na-Li thermometric relationship had also given good estimations of reservoir temperatures for high-temperature (T $\ge$ 300{\textdegree}C) borehole dilute waters from the Los Humeros geothermal area, in Mexico, in volcanic environment. The use of other auxiliary geothermometers such as K-F, K-Sr, Na-Rb and Na-Cs (when F, Sr, Rb and Cs have been analysed) can be also relevant in some cases.


title: A Queuing Envelope Model for Estimating Latency Guarantees in Deterministic Networking Scenarios

abstract: Accurate estimation of queuing delays is crucial for designing and optimizing communication networks, particularly in the context of Deterministic Networking (DetNet) scenarios. This study investigates the approximation of Internet queuing delays using an M/M/1 envelope model, which provides a simple methodology to find tight upper bounds of real delay percentiles. Real traffic statistics collected at large Internet Exchange Points (like Amsterdam and San Francisco) have been used to fit polynomial regression models for transforming packet queuing delays into the M/M/1 envelope models. We finally propose a methodology for providing delay percentiles in DetNet scenarios where tight latency guarantees need to be assured.


title: Learning in Wilson-Cowan model for metapopulation

abstract: The Wilson-Cowan model for metapopulation, a Neural Mass Network Model, treats different subcortical regions of the brain as connected nodes, with connections representing various types of structural, functional, or effective neuronal connectivity between these regions. Each region comprises interacting populations of excitatory and inhibitory cells, consistent with the standard Wilson-Cowan model. By incorporating stable attractors into such a metapopulation model's dynamics, we transform it into a learning algorithm capable of achieving high image and text classification accuracy. We test it on MNIST and Fashion MNIST, in combination with convolutional neural networks, on CIFAR-10 and TF-FLOWERS, and, in combination with a transformer architecture (BERT), on IMDB, always showing high classification accuracy. These numerical evaluations illustrate that minimal modifications to the Wilson-Cowan model for metapopulation can reveal unique and previously unobserved dynamics.

categories: q-bio.NC cond-mat.dis-nn cond-mat.stat-mech cs.AI cs.NE


title: Exploration of the deep geothermal potential of Petite-Terre Island in Mayotte

abstract: In 2017, the electricity mix of the Department of Mayotte included 5% photovoltaic production, spread over more than 70 installations on the island, and 95% diesel thermal production, provided by two power plants. Nevertheless, since 2005, in order to diversify its electricity supply, the local authorities of Mayotte set up a vast program to develop renewable energies, including the evaluation of Mayotte's geothermal potential to produce electricity.In this framework, BRGM started a program to explore the deep geothermal potential of the department of Mayotte. The conclusions of the different studies confirmed the idea of a strong potential under Petite Terre (Traineau et al., 2006; Sanjuan et al., 2008; Darnet et al., 2019).Our present study aims at refining the knowledge of the subsurface and the geothermal system potentially present beyond a depth of 1000m. This new phase, carried out between 2021 and 2022 includes a geophysical measurement campaign accompanied by a fracture analysis and the study of gas emanating from the ground.The different data set acquired during the campaigns are analysed and interpreted jointly with the data acquired in the framework of the monitoring of the exceptional seismo-volcanic activity observed since May 2018 off the coast of Mayotte.The result of this analysis is a 3D geological model of the structure of the island of Petite Terre, completed by a hydrothermal model of the functioning of the geothermal system, with the aim to help in locating the most favourable zones for geothermal exploitation.


title: Guardrails for avoiding harmful medical product recommendations and off-label promotion in generative AI models

abstract: Generative AI (GenAI) models have demonstrated remarkable capabilities in a wide variety of medical tasks. However, as these models are trained using generalist datasets with very limited human oversight, they can learn uses of medical products that have not been adequately evaluated for safety and efficacy, nor approved by regulatory agencies. Given the scale at which GenAI may reach users, unvetted recommendations pose a public health risk. In this work, we propose an approach to identify potentially harmful product recommendations, and demonstrate it using a recent multimodal large language model.


title: Automated Privacy-Preserving Techniques via Meta-Learning

abstract: Sharing private data for learning tasks is pivotal for transparent and secure machine learning applications. Many privacy-preserving techniques have been proposed for this task aiming to transform the data while ensuring the privacy of individuals. Some of these techniques have been incorporated into tools, whereas others are accessed through various online platforms. However, such tools require manual configuration, which can be complex and time-consuming. Moreover, they require substantial expertise, potentially restricting their use to those with advanced technical knowledge. In this paper, we propose AUTOPRIV, the first automated privacy-preservation method, that eliminates the need for any manual configuration. AUTOPRIV employs meta-learning to automate the de-identification process, facilitating the secure release of data for machine learning tasks. The main goal is to anticipate the predictive performance and privacy risk of a large set of privacy configurations. We provide a ranked list of the most promising solutions, which are likely to achieve an optimal approximation within a new domain. AUTOPRIV is highly effective as it reduces computational complexity and energy consumption considerably.


title: A hybrid FEM-NN optimization method to learn the physics-constrained constitutive relations from full-field data

abstract: Neural networks (NNs) have demonstrated strong capabilities of representing high-dimensional, complex functional relations, and hence have been widely used to characterize complex constitutive relations for various types of materials, such as polycrystals, polymers, etc. However, to construct a reliable NN-based constitutive model, a considerable amount of data, i.e. stress-strain states along different loading paths is needed, which can be expensive to collect. To address such challenge, we develop a hybrid finite element method (FEM) - NN optimization framework to learn complex hyperelastic constitutive relations from full-field data. The key advantage of this framework is that it can make use of the non-uniform displacement field due to the geometric inhomogeneities for training NN-based constitutive models. Since such data can provide many different stress-strain states in a single test, it can greatly reduce the number of experiments needed for the training of NNs. Besides, we adopt a mechanics-informed neural network (MINN) as our architecture to ensure that our NN-based models satisfy all necessary physical constraints by construction, such as objectivity, material symmetry, polyconvexity, etc. Such architecture is also key to the convergence of our optimization framework. We then use both synthetic and experimental data to test the performance of our proposed framework on various isotropic hyperelastic materials. Results show that our optimization framework can be used to train NN-based constitutive models for hyperelastic materials with high accuracy and efficiency using data generated from simple tests, which can also be easily adapted to characterize complex constitutive models for a broader range of materials.


title: Distance-based Chatterjee correlation: a new generalized robust measure of directed association for multivariate real and complex-valued data

abstract: Building upon the Chatterjee correlation (2021: J. Am. Stat. Assoc. 116, p2009) for two real-valued variables, this study introduces a generalized measure of directed association between two vector variables, real or complex-valued, and of possibly different dimensions. The new measure is denoted as the "distance-based Chatterjee correlation", owing to the use here of the "distance transformed data" defined in Szekely et al (2007: Ann. Statist. 35, p2769) for the distance correlation. A main property of the new measure, inherited from the original Chatterjee correlation, is its predictive and asymmetric nature: it measures how well one variable can be predicted by the other, asymmetrically. This allows for inferring the causal direction of the association, by using the method of Blobaum et al (2019: PeerJ Comput. Sci. 1, e169). Since the original Chatterjee correlation is based on ranks, it is not available for complex variables, nor for general multivariate data. The novelty of our work is the extension to multivariate real and complex-valued pairs of vectors, offering a robust measure of directed association in a completely non-parametric setting. Informally, the intuitive assumption used here is that distance correlation is mathematically equivalent to Pearson's correlation when applied to "distance transformed" data. The next logical step is to compute Chatterjee's correlation on the same "distance transformed" data, thereby extending the analysis to multivariate vectors of real and complex valued data. As a bonus, the new measure here is robust to outliers, which is not true for the distance correlation of Szekely et al. Additionally, this approach allows for inference regarding the causal direction of the association between the variables.


title: Suppressing Uncertainties in Degradation Estimation for Blind Super-Resolution

abstract: The problem of blind image super-resolution aims to recover high-resolution (HR) images from low-resolution (LR) images with unknown degradation modes. Most existing methods model the image degradation process using blur kernels. However, this explicit modeling approach struggles to cover the complex and varied degradation processes encountered in the real world, such as high-order combinations of JPEG compression, blur, and noise. Implicit modeling for the degradation process can effectively overcome this issue, but a key challenge of implicit modeling is the lack of accurate ground truth labels for the degradation process to conduct supervised training. To overcome this limitations inherent in implicit modeling, we propose an \textbf{U}ncertainty-based degradation representation for blind \textbf{S}uper-\textbf{R}esolution framework (\textbf{USR}). By suppressing the uncertainty of local degradation representations in images, USR facilitated self-supervised learning of degradation representations. The USR consists of two components: Adaptive Uncertainty-Aware Degradation Extraction (AUDE) and a feature extraction network composed of Variable Depth Dynamic Convolution (VDDC) blocks. To extract Uncertainty-based Degradation Representation from LR images, the AUDE utilizes the Self-supervised Uncertainty Contrast module with Uncertainty Suppression Loss to suppress the inherent model uncertainty of the Degradation Extractor. Furthermore, VDDC block integrates degradation information through dynamic convolution. Rhe VDDC also employs an Adaptive Intensity Scaling operation that adaptively adjusts the degradation representation according to the network hierarchy, thereby facilitating the effective integration of degradation information. Quantitative and qualitative experiments affirm the superiority of our approach.


title: Constraining dark matter from strong phase transitions in a $U(1)_{L_{\mu}-L_{\tau}}$ model: Implications for neutrino masses and muon $g-2$

abstract: In this paper, we study a non-minimal gauged $U(1)_{L_{\mu}-L_{\tau}}$ model, where we add two complex singlet scalars, three right-handed Majorana neutrinos (RHN), and a vector-like dark fermion to the Standard Model (SM), all non-trivially charged under the extra gauge symmetry. The model offers an easy resolution to the muon $(g-2)$ anomaly, which fixes the scale of spontaneous symmetry breaking. Furthermore, the two-zero minor structure in the RHN mass matrix provides successful predictions for neutrino oscillation parameters, including the Dirac phase. The extended scalar sector can easily induce first-order phase transitions. We identify all possible phase transition patterns in the three-dimensional field space. We quantify the associated gravitational waves from the sound wave source and demonstrate that the signatures can be observed in future space-based experiments. We find that strong first-order phase transitions require large values of scalar quartic couplings which constrain the scalar dark matter (DM) relic density to a maximum of $10^{-2}$ and $10^{-5}$ when we consider the DM direct detection bound. Nonetheless, the model successfully explains the DM relic density via contribution from the vector-like dark fermion. We show the allowed range of the model parameters that can address all the beyond SM issues targeted in this study.


title: Orders-of-magnitude reduction in photonic mode volume by nano-sculpting

abstract: Three-dimensionally sculpted dielectric nanostructures supporting material(air) confined optical modes with single-emitter mode volumes three(four) orders of magnitude below the diffraction limit, $V_{\textbf{r}_0} \approx 0.0004 \left[\lambda/(2 n)\right]^3 \left( V_{\textbf{r}_0} \approx 0.00003 \left[\lambda/2\right]^3\right)$, are discovered using topology optimization. Encapsulating the nanostructure by ellipsoidal shells enables seemingly unbounded mode quality factor enhancement ($Q > 10^8$ demonstrated numerically) leading to Purcell enhancement above $10^{11}$. It is studied how $V_{\textbf{r}_0}$ and $Q$ depend on the choice of material, device volume, minimum feature size and number of shells.


title: Introduction to the 7-Dimensional Telescope: Commissioning Procedures and Data Characteristics

abstract: The 7-Dimensional Telescope (7DT) is a multi-telescope system designed to identify electromagnetic (EM) counterparts of gravitational-wave (GW) sources. Consisting of 20 50-cm telescopes along with 40 medium-band filters of 25 nm width, 7DT can obtain spectral mapping images for a large field of view (~1.25 square degrees). Along with flexible operation, real-time data reduction, and analysis, the 7DT's spectral mapping capability enables 7DT to follow up GW events quickly and discover EM counterparts. Among 20 planned telescopes, 12 units are deployed at the El Sauce Observatory located at Rio Hurtado Valley in Chile. Since we obtained the first light of 7DT in October 2023, we started its commissioning procedures including examination of bias levels, master flat production, and spectrophotometric standardization. In this talk, we present 7DT instruments and their set-up, commissioning procedures, and data characteristics of 7DT along with our three-layered surveys which are assumed to be initiated in early 2024.


title: Probing the Neutrino Seesaw Scale with Gravitational Waves

abstract: Neutrinos are the most elusive particles of the Standard Model. The physics behind their masses remains unknown and requires introducing new particles and interactions. An elegant solution to this problem is provided by the seesaw mechanism. Typically considered at a high scale, it is potentially testable in gravitational wave experiments by searching for a spectrum from cosmic strings, which offers a rather generic signature across many high-scale seesaw models. Here we consider the possibility of a low-scale seesaw mechanism at the PeV scale, generating neutrino masses within the framework of a model with gauged U(1) lepton number. In this case, the gravitational wave signal at high frequencies arises from a first order phase transition in the early Universe, whereas at low frequencies it is generated by domain wall annihilation, leading to a double-peaked structure in the gravitational wave spectrum. The signals discussed here can be searched for in upcoming experiments, including gravitational wave interferometers, pulsar timing arrays, and astrometry observations.


title: InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection

abstract: The prevalence of sarcasm in social media, conveyed through text-image combinations, presents significant challenges for sentiment analysis and intention mining. Current multi-modal sarcasm detection methods have been proven to struggle with biases from spurious cues, leading to a superficial understanding of the complex interactions between text and image. To address these issues, we propose InterCLIP-MEP, a robust framework for multi-modal sarcasm detection. InterCLIP-MEP introduces a refined variant of CLIP, Interactive CLIP (InterCLIP), as the backbone, enhancing sample representations by embedding cross-modality information in each encoder. Furthermore, a novel training strategy is designed to adapt InterCLIP for a Memory-Enhanced Predictor (MEP). MEP uses dynamic dual-channel memory to store valuable historical knowledge of test samples and then leverages this memory as a non-parametric classifier to derive the final prediction. By using InterCLIP to encode text-image interactions more effectively and incorporating MEP, InterCLIP-MEP offers a more robust recognition of multi-modal sarcasm. Experiments demonstrate that InterCLIP-MEP achieves state-of-the-art performance on the MMSD2.0 benchmark. Code and data are available at https://github.com/CoderChen01/InterCLIP-MEP.


title: Genealogical processes of non-neutral population models under rapid mutation

abstract: We show that genealogical trees arising from a broad class of non-neutral models of population evolution converge to the Kingman coalescent under a suitable rescaling of time. As well as non-neutral biological evolution, our results apply to genetic algorithms encompassing the prominent class of sequential Monte Carlo (SMC) methods. The time rescaling we need differs slightly from that used in classical results for convergence to the Kingman coalescent, which has implications for the performance of different resampling schemes in SMC algorithms. In addition, our work substantially simplifies earlier proofs of convergence to the Kingman coalescent, and corrects an error common to several earlier results.


title: SLOctolyzer: Fully automatic analysis toolkit for segmentation and feature extracting in scanning laser ophthalmoscopy images

abstract: Purpose: To describe SLOctolyzer: an open-source analysis toolkit for en face retinal vessels appearing in infrared reflectance scanning laser ophthalmoscopy (SLO) images. Methods: SLOctolyzer includes two main modules: segmentation and measurement. The segmentation module use deep learning methods to delineate retinal anatomy, while the measurement module quantifies key retinal vascular features such as vessel complexity, density, tortuosity, and calibre. We evaluate the segmentation module using unseen data and measure its reproducibility. Results: SLOctolyzer's segmentation module performed well against unseen internal test data (Dice for all-vessels, 0.9097; arteries, 0.8376; veins, 0.8525; optic disc, 0.9430; fovea, 0.8837). External validation against severe retinal pathology showed decreased performance (Dice for arteries, 0.7180; veins, 0.7470; optic disc, 0.9032). SLOctolyzer had good reproducibility (mean difference for fractal dimension, -0.0007; vessel density, -0.0003; vessel calibre, -0.3154 $\mu$m; tortuosity density, 0.0013). SLOctolyzer can process a macula-centred SLO image in under 20 seconds and a disc-centred SLO image in under 30 seconds using a standard laptop CPU. Conclusions: To our knowledge, SLOctolyzer is the first open-source tool to convert raw SLO images into reproducible and clinically meaningful retinal vascular parameters. SLO images are captured simultaneous to optical coherence tomography (OCT), and we believe our software will be useful for extracting retinal vascular measurements from large OCT image sets and linking them to ocular or systemic diseases. It requires no specialist knowledge or proprietary software, and allows manual correction of segmentations and re-computing of vascular metrics. SLOctolyzer is freely available at https://github.com/jaburke166/SLOctolyzer.


title: Almost Auerbach, Markushevich and Schauder bases in Hilbert and Banach spaces

abstract: For any sequence of positive numbers $(\varepsilon_n)_{n=1}^\infty$ such that $\sum_{n=1}^\infty \varepsilon_n = \infty$ we provide an explicit simple construction of $(1+\varepsilon_n)$-bounded Markushevich basis in a separable Hilbert space which is not strong, or, in other terminology, is not hereditary complete; this condition on the sequence $(\varepsilon_n)_{n=1}^\infty$ is sharp. Using a finite-dimensional version of this construction, Dvoretzky's theorem and a construction of Vershynin, we conclude that in any Banach space for any sequence of positive numbers $(\varepsilon_n)_{n=1}^\infty$ such that $\sum_{n=1}^\infty \varepsilon_n^2 = \infty$ there exists a $(1+\varepsilon_n)$-bounded Markushevich basis which is not a Schauder basis after any permutation of its elements.


title: The Hidden Pitfalls of the Cosine Similarity Loss

abstract: We show that the gradient of the cosine similarity between two points goes to zero in two under-explored settings: (1) if a point has large magnitude or (2) if the points are on opposite ends of the latent space. Counterintuitively, we prove that optimizing the cosine similarity between points forces them to grow in magnitude. Thus, (1) is unavoidable in practice. We then observe that these derivations are extremely general -- they hold across deep learning architectures and for many of the standard self-supervised learning (SSL) loss functions. This leads us to propose cut-initialization: a simple change to network initialization that helps all studied SSL methods converge faster.


title: Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration

abstract: To create culturally inclusive vision-language models (VLMs), the foremost requirement is developing a test benchmark that can diagnose the models' ability to respond to questions reflecting cultural elements. This paper addresses the necessity for such benchmarks, noting that existing research has relied on human annotators' manual efforts, which impedes diversity and efficiency. We propose a semi-automated pipeline for constructing cultural VLM benchmarks to enhance diversity and efficiency. This pipeline leverages human-VLM collaboration, where VLMs generate questions based on guidelines, human-annotated examples, and image-wise relevant knowledge, which are then reviewed by native speakers for quality and cultural relevance. The effectiveness of our adaptable pipeline is demonstrated through a specific application: creating a dataset tailored to Korean culture, dubbed K-Viscuit. The resulting benchmark features two types of questions: Type 1 questions measure visual recognition abilities, while Type 2 assess fine-grained visual reasoning skills. This ensures a thorough diagnosis of VLM models across various aspects. Our evaluation using K-Viscuit revealed that open-source models notably lag behind proprietary models in understanding Korean culture, highlighting areas for improvement. We provided diverse analyses of VLM performance across different cultural aspects. Besides, we explored the potential of incorporating external knowledge retrieval to enhance the generation process, suggesting future directions for improving cultural interpretation ability of VLMs. Our dataset and code will be made publicly available.


title: Project Management for Ground-based Telescope Array Development

abstract: Center for the Gravitational-Wave Universe at Seoul National University has been operating its main observational facility, the 7-Dimensional Telescope (7DT) since October 2023. Located at El Sauce Observatory in Chilean Rio Hurtado Valley, 7DT consists of 20 50-cm telescopes equipped with 40 medium-band filters of 25 nm full width at half maximum along with a CMOS camera of 61 megapixels. 7DT produces about 1 TB per night of spectral mapping image data including calibration, and the byproduct of the data reduction pipeline once our planned three layered surveys (Reference Imaging Survey, Wide Field Survey, and Intensive Monitoring Survey) start in 2024. We are expecting to generate 1 PB per year by combining raw data, reduced data, and data products (e.g. calibrated stacked images, spectral cubes, and object catalogs). To incorporate this huge amount of data, we now have a data storage for 1 PB which we will increment by 1 PB per year. We also have a high-performance computation facility that is equipped with 2 NVIDIA A100 GPU cards since we plan to carry out real-time data reduction and analysis for follow-up observation data of gravitational wave events. To incorporate this, we established a 400 Mbps network connection between the facilities in Korea and Chile. Taking advantage of the high-performance network, we have been carrying out fully remote operations since October 2023. In this talk, we present details of designing, planning, and executing the ground-based telescope facility project, especially within low-budget academic environments. While we cover as much ground as possible, we will emphasize human resource management, project risk management, and financial contingency management.


title: Inferring the scrape-off layer heat flux width in a divertor with a low degree of axisymmetry

abstract: Plasma facing components (PFCs) in the next generation of tokamak devices will operate in challenging environments, with heat loads predicted to exceed 10 MWm$^{-2}$. The magnitude of these heat loads is set by the width of the channel, the "scrape-off layer" (SOL), into which heat is exhausted, and can be characterised by an e-folding length scale for the decay of heat flux across the channel. It is expected this channel will narrow as tokamaks move towards reactor relevant conditions. Understanding the processes involved in setting the SOL heat flux width is imperative to be able to predict the heat loads PFCs must handle in future devices. Measurements of the SOL width are performed on the high-field spherical tokamak, ST40, using a newly commissioned infrared thermography system. With its high on-axis toroidal magnetic field ($\geq$1.5 T) ST40 is uniquely positioned to investigate the influence of toroidal field on the heat flux width in spherical tokamaks, whilst also extending measurements of the SOL width in spherical tokamaks to increased poloidal field ($\geq$0.3 T). Due to the divertor on ST40 having a low degree of axisymmetry, it is necessary for a set of radial measurements of the heat flux to be taken across the divertor, made possible using an automated toolchain that fully incorporates its 3D geometry. These radial profiles are combined with the magnetic topology of the plasma to infer the width of the SOL, with both single and double exponential profiles of heat flux observed. A reduction in the heat flux is observed toroidally across part of the divertor, with preliminary investigations indicating that partial shadowing occurs, resulting from the separation between magnetic field lines and trailing edges upstream of the observed region becoming comparable to the ion gyro-radius.


title: Physical simulation of nucleation and crystallization processes in transparent organic melts

abstract: The aim of this work is the development of scientifically based ways of influencing the process of nucleation of crystallization centres to control the cast structure and the properties of blanks at the casting stage. The possibility of controlling crystal nucleation was studied on transparent modelling media using the droplet method. The dependence of the crystallization kinetics of drops with a size of 100{\div}200 {\mu}m on the overheating temperature, the exposure in the overheated state and the degree of supercooling was established. The curves of the crystallization kinetics of drops from their melts as the criteria for evaluating the crystallization process were chosen. The nature of the change in the experimental media crystallization kinetics curves confirms the assumption about the decisive role of impurities in the crystallization processes of any alloys. The confirmation of the hypothesis about the decisive role of impurities in the processes of crystallization from positions of heterogeneous nucleation is the dependence of the number of solidified drops with the same diameter on the degree and duration of their overheating.


title: Seeking Certainty In Uncertainty: Dual-Stage Unified Framework Solving Uncertainty in Dynamic Facial Expression Recognition

abstract: The contemporary state-of-the-art of Dynamic Facial Expression Recognition (DFER) technology facilitates remarkable progress by deriving emotional mappings of facial expressions from video content, underpinned by training on voluminous datasets. Yet, the DFER datasets encompass a substantial volume of noise data. Noise arises from low-quality captures that defy logical labeling, and instances that suffer from mislabeling due to annotation bias, engendering two principal types of uncertainty: the uncertainty regarding data usability and the uncertainty concerning label reliability. Addressing the two types of uncertainty, we have meticulously crafted a two-stage framework aiming at \textbf{S}eeking \textbf{C}ertain data \textbf{I}n extensive \textbf{U}ncertain data (SCIU). This initiative aims to purge the DFER datasets of these uncertainties, thereby ensuring that only clean, verified data is employed in training processes. To mitigate the issue of low-quality samples, we introduce the Coarse-Grained Pruning (CGP) stage, which assesses sample weights and prunes those deemed unusable due to their low weight. For samples with incorrect annotations, the Fine-Grained Correction (FGC) stage evaluates prediction stability to rectify mislabeled data. Moreover, SCIU is conceived as a universally compatible, plug-and-play framework, tailored to integrate seamlessly with prevailing DFER methodologies. Rigorous experiments across prevalent DFER datasets and against numerous benchmark methods substantiates SCIU's capacity to markedly elevate performance metrics.


title: Detecting eclipsing double white dwarfs with electromagnetic and gravitational waves

abstract: Galactic double white dwarfs are predominant sources of gravitational waves in the millihertz frequencies accessible to space-borne gravitational wave detectors. With advances in multi-messenger astronomy, an increasing number of double white dwarf systems will be discovered through both electromagnetic and gravitational wave observations. In this paper, we simulated two populations of double white dwarfs originating from different star formation histories (hereafter referred to as Model 1 and Model 2) using the binary population synthesis method. We predicted the number of double white dwarfs in our Galaxy detectable by TianQin and Laser Interferometer Space Antenna (LISA) individually, as well as through their joint observation. In addition, we performed an analysis to evaluate the accuracy of the parameter estimation using the Fisher information matrix. Furthermore, we predicted the number of eclipsing double white dwarfs detectable by Gaia and LSST. Our study found that over the nominal mission durations, TianQin, LISA, and their joint observation can detect $5\times10^3$ ($1\times10^4$), $1.7\times10^4$ ($3.3\times10^4$), and $1.8\times10^4$ ($3.5\times10^4$) double white dwarfs with signal-to-noise ratios greater than 7 in Model 1 (Model 2), respectively. Gaia and LSST are expected to detect 67 (186) and 273 (554) eclipsing double white dwarfs in Model 1 (Model 2) with orbital period less than 30 hours, respectively. We also found that several dozen eclipsing double white dwarfs can be detected jointly through electromagnetic and gravitational wave observations.


title: Bijective BWT based compression schemes

abstract: We show that for any string $w$ of length $n$, $r_B = O(z\log^2 n)$, where $r_B$ and $z$ are respectively the number of character runs in the bijective Burrows-Wheeler transform (BBWT), and the number of Lempel-Ziv 77 factors of $w$. We can further induce a bidirectional macro scheme of size $O(r_B)$ from the BBWT. Finally, there exists a family of strings with $r_B = \Omega(\log n)$ but having only $r=2$ character runs in the standard Burrows--Wheeler transform (BWT). However, a lower bound for $r$ is the minimal run-length of the BBWTs applied to the cyclic shifts of $w$, whose time complexity might be $o(n^2)$ in the light that we show how to compute the Lyndon factorization of all cyclic rotations in $O(n)$ time. Considering also the rotation operation performing cyclic shifts, we conjecture that we can transform two strings having the same Parikh vector to each other by BBWT and rotation operations, and prove this conjecture for the case of binary alphabets and permutations.


title: ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance

abstract: Diffusion models excel at producing high-quality images; however, scaling to higher resolutions, such as 4K, often results in over-smoothed content, structural distortions, and repetitive patterns. To this end, we introduce ResMaster, a novel, training-free method that empowers resolution-limited diffusion models to generate high-quality images beyond resolution restrictions. Specifically, ResMaster leverages a low-resolution reference image created by a pre-trained diffusion model to provide structural and fine-grained guidance for crafting high-resolution images on a patch-by-patch basis. To ensure a coherent global structure, ResMaster meticulously aligns the low-frequency components of high-resolution patches with the low-resolution reference at each denoising step. For fine-grained guidance, tailored image prompts based on the low-resolution reference and enriched textual prompts produced by a vision-language model are incorporated. This approach could significantly mitigate local pattern distortions and improve detail refinement. Extensive experiments validate that ResMaster sets a new benchmark for high-resolution image generation and demonstrates promising efficiency. The project page is https://shuweis.github.io/ResMaster .


title: DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution

abstract: Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior knowledge. The success of diffusion models based on general text prompts has validated the effectiveness of textual control in the field of text2image. However, given the severe degradation commonly presented in low-resolution images, coupled with the randomness characteristics of diffusion models, current models struggle to adequately discern semantic and degradation information within severely degraded images. This often leads to obstacles such as semantic loss, visual artifacts, and visual hallucinations, which pose substantial challenges for practical use. To address these challenges, this paper proposes to leverage degradation-aligned language prompt for accurate, fine-grained, and high-fidelity image restoration. Complementary priors including semantic content descriptions and degradation prompts are explored. Specifically, on one hand, image-restoration prompt alignment decoder is proposed to automatically discern the degradation degree of LR images, thereby generating beneficial degradation priors for image restoration. On the other hand, much richly tailored descriptions from pretrained multimodal large language model elicit high-level semantic priors closely aligned with human perception, ensuring fidelity control for image restoration. Comprehensive comparisons with state-of-the-art methods have been done on several popular synthetic and real-world benchmark datasets. The quantitative and qualitative analysis have demonstrated that the proposed method achieves a new state-of-the-art perceptual quality level, especially in real-world cases based on reference-free metrics.


title: EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations

abstract: The study of multimodal interaction in therapy can yield a comprehensive understanding of therapist and patient behavior that can be used to develop a multimodal virtual agent supporting therapy. This investigation aims to uncover how therapists skillfully blend therapy's task goal (employing classical steps of Motivational Interviewing) with the social goal (building a trusting relationship and expressing empathy). Furthermore, we seek to categorize patients into various ``types'' requiring tailored therapeutic approaches. To this intent, we present multimodal annotations of a corpus consisting of simulated motivational interviewing conversations, wherein actors portray the roles of patients and therapists. We introduce EMMI, composed of two publicly available MI corpora, AnnoMI and the Motivational Interviewing Dataset, for which we add multimodal annotations. We analyze these annotations to characterize functional behavior for developing a virtual agent performing motivational interviews emphasizing social and empathic behaviors. Our analysis found three clusters of patients expressing significant differences in behavior and adaptation of the therapist's behavior to those types. This shows the importance of a therapist being able to adapt their behavior depending on the current situation within the dialog and the type of user.


title: Emerging NeoHebbian Dynamics in Forward-Forward Learning: Implications for Neuromorphic Computing

abstract: Advances in neural computation have predominantly relied on the gradient backpropagation algorithm (BP). However, the recent shift towards non-stationary data modeling has highlighted the limitations of this heuristic, exposing that its adaptation capabilities are far from those seen in biological brains. Unlike BP, where weight updates are computed through a reverse error propagation path, Hebbian learning dynamics provide synaptic updates using only information within the layer itself. This has spurred interest in biologically plausible learning algorithms, hypothesized to overcome BP's shortcomings. In this context, Hinton recently introduced the Forward-Forward Algorithm (FFA), which employs local learning rules for each layer and has empirically proven its efficacy in multiple data modeling tasks. In this work we argue that when employing a squared Euclidean norm as a goodness function driving the local learning, the resulting FFA is equivalent to a neo-Hebbian Learning Rule. To verify this result, we compare the training behavior of FFA in analog networks with its Hebbian adaptation in spiking neural networks. Our experiments demonstrate that both versions of FFA produce similar accuracy and latent distributions. The findings herein reported provide empirical evidence linking biological learning rules with currently used training algorithms, thus paving the way towards extrapolating the positive outcomes from FFA to Hebbian learning rules. Simultaneously, our results imply that analog networks trained under FFA could be directly applied to neuromorphic computing, leading to reduced energy usage and increased computational speed.


title: Study of Wolf-Rayet stars using uGMRT

abstract: In recent years, systems involving massive stars with large wind kinetic power have been considered as promising sites for investigating relativistic particle acceleration in low radio frequencies. With this aim, we observed two Wolf-Rayet systems, WR 114 and WR 142, using upgraded Giant Meterwave Radio Telescope observations in Band 4 (550-950 MHz) and Band 5 (1050-1450 MHz). None of the targets was detected at these frequencies. Based on the non-detection, we report 3$\sigma$ upper limits to the radio flux densities at 735 and 1260 MHz (123 and 66 $\mu$Jy for WR 114, and 111 and 96 $\mu$Jy for WR 142, respectively). The plausible scenarios to interpret this non-detection are presented.


title: Improving Quaternion Neural Networks with Quaternionic Activation Functions

abstract: In this paper, we propose novel quaternion activation functions where we modify either the quaternion magnitude or the phase, as an alternative to the commonly used split activation functions. We define criteria that are relevant for quaternion activation functions, and subsequently we propose our novel activation functions based on this analysis. Instead of applying a known activation function like the ReLU or Tanh on the quaternion elements separately, these activation functions consider the quaternion properties and respect the quaternion space $\mathbb{H}$. In particular, all quaternion components are utilized to calculate all output components, carrying out the benefit of the Hamilton product in e.g. the quaternion convolution to the activation functions. The proposed activation functions can be incorporated in arbitrary quaternion valued neural networks trained with gradient descent techniques. We further discuss the derivatives of the proposed activation functions where we observe beneficial properties for the activation functions affecting the phase. Specifically, they prove to be sensitive on basically the whole input range, thus improved gradient flow can be expected. We provide an elaborate experimental evaluation of our proposed quaternion activation functions including comparison with the split ReLU and split Tanh on two image classification tasks using the CIFAR-10 and SVHN dataset. There, especially the quaternion activation functions affecting the phase consistently prove to provide better performance.


title: Phase diagram of non-Hermitian BCS superfluids in a dissipative asymmetric Hubbard model

abstract: We investigate the non-Hermitian (NH) attractive Fermi-Hubbard model with asymmetric hopping and complex-valued interactions, which should be realized by collective one-body loss and two-body loss. By means of the NH BCS theory, we find that the weak asymmetry of the hopping does not affect the BCS superfluidity since it only affects the imaginary part of the eigenvalues of the BdG Hamiltonian. Systematic analysis in the $d$-dimensional hypercubic lattices clarifies that the singularity in the density of states affects the phase boundary between the normal and dissipation-induced superfluid states. Our results can be tested in ultracold atoms by using the photoassociation techniques and a nonlocal Rabi coupling with local losses and postselecting null measurement outcomes utilized by quantum-gas microscopes.

categories: cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con quant-ph


title: Beyond the Local Void: A comprehensive view on the origins of the Amaterasu particle

abstract: We use the reconstructed properties of the Amaterasu particle, the second-highest energy cosmic ray ever detected, to map out three-dimensional constraints on the location of its unknown source. We highlight possible astrophysical sources that are compatible with these regions and requirements. Among these, M82, a powerful starburst galaxy, stands out as a strong candidate due to its position and proximity. To derive our constraints, we use CRPropa 3 to model all relevant propagation effects, including deflections in the Galactic and extra-Galactic magnetic fields. We consider key input quantities such as source distance, position, energy, and the strength and coherence length of the extra-Galactic magnetic field as free parameters. We then infer constraints on these parameters by applying approximate Bayesian computation. We present our results, demonstrating the impact of different assumptions for the arrival mass of the Amaterasu particle and the systematic uncertainties on the energy scale.


title: Robust prediction under missingness shifts

abstract: Prediction becomes more challenging with missing covariates. What method is chosen to handle missingness can greatly affect how models perform. In many real-world problems, the best prediction performance is achieved by models that can leverage the informative nature of a value being missing. Yet, the reasons why a covariate goes missing can change once a model is deployed in practice. If such a missingness shift occurs, the conditional probability of a value being missing differs in the target data. Prediction performance in the source data may no longer be a good selection criterion, and approaches that do not rely on informative missingness may be preferable. However, we show that the Bayes predictor remains unchanged by ignorable shifts for which the probability of missingness only depends on observed data. Any consistent estimator of the Bayes predictor may therefore result in robust prediction under those conditions, although we show empirically that different methods appear robust to different types of shifts. If the missingness shift is non-ignorable, the Bayes predictor may change due to the shift. While neither approach recovers the Bayes predictor in this case, we found empirically that disregarding missingness was most beneficial when it was highly informative.


title: Influence analyses of "designs" for evaluating inconsistency in network meta-analysis

abstract: Network meta-analysis is an evidence synthesis method for comparative effectiveness analyses of multiple available treatments. To justify evidence synthesis, consistency is a relevant assumption; however, existing methods founded on statistical testing possibly have substantial limitations of statistical powers or several drawbacks in treating multi-arm studies. Besides, inconsistency is theoretically explained as design-by-treatment interactions, and the primary purpose of these analyses is prioritizing "designs" for further investigations to explore sources of biases and irregular issues that might influence the overall results. In this article, we propose an alternative framework for inconsistency evaluations using influence diagnostic methods that enable quantitative evaluations of the influences of individual designs to the overall results. We provide four new methods to quantify the influences of individual designs through a "leave-one-design-out" analysis framework. We also propose a simple summary measure, the O-value, for prioritizing designs and interpreting these influential analyses straightforwardly. Furthermore, we propose another testing approach based on the leave-one-design-out analysis framework. By applying the new methods to a network meta-analysis of antihypertensive drugs, we demonstrate the new methods located potential sources of inconsistency accurately. The proposed methods provide new insights into alternatives to existing test-based methods, especially quantifications of influences of individual designs on the overall network meta-analysis results.


title: Towards Comprehensive Preference Data Collection for Reward Modeling

abstract: Reinforcement Learning from Human Feedback (RLHF) facilitates the alignment of large language models (LLMs) with human preferences, thereby enhancing the quality of responses generated. A critical component of RLHF is the reward model, which is trained on preference data and outputs a scalar reward during the inference stage. However, the collection of preference data still lacks thorough investigation. Recent studies indicate that preference data is collected either by AI or humans, where chosen and rejected instances are identified among pairwise responses. We question whether this process effectively filters out noise and ensures sufficient diversity in collected data. To address these concerns, for the first time, we propose a comprehensive framework for preference data collection, decomposing the process into four incremental steps: Prompt Generation, Response Generation, Response Filtering, and Human Labeling. This structured approach ensures the collection of high-quality preferences while reducing reliance on human labor. We conducted comprehensive experiments based on the data collected at different stages, demonstrating the effectiveness of the proposed data collection method.


title: Decomposing God Header File via Multi-View Graph Clustering

abstract: God Header File refers to a header file with large code size and wide file impact. Such files pose difficulties in code comprehension and slow down compilation, ultimately increasing the maintenance cost during software evolution. Although this concept is similar to God Class, existing refactoring methods for God Classes are inappropriate for God Header Files. The reason lies in the fact that the code elements in header files are mostly short declaration types, and build dependencies of the entire system should be considered with the aim of improving compilation efficiency. Meanwhile, these methods overlook the concern of cyclic dependencies, which holds immense importance in the God Header File decomposition. To address these challenges, this paper proposes a God Header File decomposing approach based on multi-view graph clustering. It first constructs a code element graph with multiple relationships. Then after coarsening the graph, a novel multi-view graph clustering algorithm is applied to identify clusters of closely related code elements, and a heuristic algorithm is introduced to address the cyclic dependencies in the clustering result. We evaluate our approach on a synthetic dataset as well as six real-world God Header Files from different projects. The results show that our approach could achieve 11.5% higher accuracy in comparison to existing God Class refactoring methods. Moreover, our decomposition results attain better modularity on all the real-world God Header Files and reduce recompilation time for historical commits by 15% to 60%.


title: All-optical production of Bose-Einstein condensates with 2 Hz repetition rate

abstract: Bose-Einstein condensates (BECs) of neutral atoms constitute an important quantum system for fundamental research and precision metrology. Many applications require short preparation times of BECs, for example, for optimized data acquisition rates in scientific applications, and reduced dead times and improved bandwidths for atomic quantum sensors. Here, we report on the generation of rubidium BECs with a repetition rate of more than 2 Hz. The system relies on forced evaporation in a dynamically adjusted optical potential, which is created by the spatial modulation of laser beams. Our system provides a versatile source of the ubiquitous rubidium BECs, and promotes their exploitation for high-precision atom interferometers.


title: Deepfake tweets automatic detection

abstract: This study addresses the critical challenge of detecting DeepFake tweets by leveraging advanced natural language processing (NLP) techniques to distinguish between genuine and AI-generated texts. Given the increasing prevalence of misinformation, our research utilizes the TweepFake dataset to train and evaluate various machine learning models. The objective is to identify effective strategies for recognizing DeepFake content, thereby enhancing the integrity of digital communications. By developing reliable methods for detecting AI-generated misinformation, this work contributes to a more trustworthy online information environment.


title: eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure

abstract: This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes from the domain of U.S. civil procedure. It includes summaries of legal cases, specific questions, potential answers, and detailed explanations for why each solution is relevant, all sourced from a book aimed at law students. By comparing different methods, we aimed to understand how effectively they handle the complexities found in legal datasets. Our findings show how well the zero-shot method of large language models can understand complicated data. We achieved our highest F1 score of 64% in these experiments.


title: A versatile and transportable endstation for controlled molecule experiments

abstract: We report on a new versatile transportable endstation for controlled molecule (eCOMO) experiments providing a combination of molecular beam purification by electrostatic deflection and simultaneous ion and electron detection using velocity-map imaging (VMI). The $b$-type electrostatic deflector provides spatial dispersion of species based on their effective-dipole-moment-to-mass ratio. This enables selective investigation of molecular rotational quantum states, conformers, and molecular clusters. Furthermore, the double-sided VMI spectrometer equipped with two high-temporal-resolution event-driven Timepix3 cameras provides detection of all generated ions independently of their mass-over-charge ratio and electrons. To demonstrate the potential of this novel apparatus, we present experimental results from our investigation of carbonyl sulfide (OCS) after ionization. Specifically, we provide the characterization of the molecular beam, electrostatic deflector, and electron- and ion-VMI spectrometer. The eCOMO endstation delivers a platform for ultrafast dynamics studies using a wide range of light sources from table-top lasers to free-electron-laser and synchrotron-radiation facilities. This makes it suitable for research activities spanning from atomic, molecular, and cluster physics, over energy science and chemistry, to structural biology.


title: Emergence of quantum Griffiths singularity in disordered TiN thin films

abstract: The association of quantum Griffiths singularity (QGS) to the magnetic-field-induced superconductor-metal transition predicts the unconventional diverging behaviour of dynamical critical exponent in low disorder crystalline two-dimensional superconductors. But whether this state exists in the superconducting systems exhibiting superconductor-insulator transition remains elusive. Here, we report the emergence of quantum Griffiths singularity in ultrathin disordered TiN thin films with more than two orders of magnitude variation in their normal state resistance. For both superconductor-metal transition and superconductor-insulator transition types, a diverging critical exponent is observed while approaching the quantum phase transition. Further, the magnetoresistance isotherms obey a direct activated scaling governed by an infinite-randomness fixed critical point. Finally, this work establishes the robustness of the QGS phenomenon towards a wide range of temperature and also towards a wide range of disorder strength as correlated with the normal state resistance.


title: An irreversible investment problem with a learning-by-doing feature

abstract: We study a model of irreversible investment for a decision-maker who has the possibility to gradually invest in a project with unknown value. In this setting, we introduce and explore a feature of "learning-by-doing", where the learning rate of the unknown project value is increasing in the decision-maker's level of investment in the project. We show that, under some conditions on the functional dependence of the learning rate on the level of investment (the "signal-to-noise" ratio), the optimal strategy is to invest gradually in the project so that a two-dimensional sufficient statistic reflects below a monotone boundary. Moreover, this boundary is characterised as the solution of a differential problem. Finally, we also formulate and solve a discrete version of the problem, which mirrors and complements the continuous version.


title: Cross-domain Transfer of Valence Preferences via a Meta-optimization Approach

abstract: Cross-domain recommendation offers a potential avenue for alleviating data sparsity and cold-start problems. Embedding and mapping, as a classic cross-domain research genre, aims to identify a common mapping function to perform representation transformation between two domains. Nevertheless, previous coarse-grained preference representations, non-personalized mapping functions, and excessive reliance on overlapping users limit their performance, especially in scenarios where overlapping users are sparse. To address aforementioned challenges, we propose a novel cross-domain approach, namely CVPM. CVPM formalizes cross-domain interest transfer as a hybrid architecture of parametric meta-learning and self-supervised learning, which not only transfers user preferences at a finer level, but also enables signal enhancement with the knowledge of non-overlapping users. Specifically, with deep insights into user preferences and valence preference theory, we believe that there exists significant difference between users' positive preferences and negative behaviors, and thus employ differentiated encoders to learn their distributions. In particular, we further utilize the pre-trained model and item popularity to sample pseudo-interaction items to ensure the integrity of both distributions. To guarantee the personalization of preference transfer, we treat each user's mapping as two parts, the common transformation and the personalized bias, where the network used to generate the personalized bias is output by a meta-learner. Furthermore, in addition to the supervised loss for overlapping users, we design contrastive tasks for non-overlapping users from both group and individual-levels to avoid model skew and enhance the semantics of representations. Exhaustive data analysis and extensive experimental results demonstrate the effectiveness and advancement of our proposed framework.


title: OTCE: Hybrid SSM and Attention with Cross Domain Mixture of Experts to construct Observer-Thinker-Conceiver-Expresser

abstract: Recent research has shown that combining Mamba with Transformer architecture, which has selective state space and quadratic self-attention mechanism, outperforms using Mamba or Transformer architecture alone in language modeling tasks. The quadratic self-attention mechanism effectively alleviates the shortcomings of selective state space in handling long-term dependencies of any element in the sequence. We propose a position information injection method that connects the selective state space model with the quadratic attention, and integrates these two architectures with hybrid experts with cross-sharing domains, so that we can enjoy the advantages of both. We design a new architecture with a more biomimetic idea: Observer-Thinker-Conceiver-Expresser (OTCE), which can compete with well-known medium-scale open-source language models on a small scale in language modeling tasks.


title: Recent advancements on MPC for tracking: periodic and harmonic formulations

abstract: The main benefit of model predictive control (MPC) is its ability to steer the system to a given reference without violating the constraints while minimizing some objective. Furthermore, a suitably designed MPC controller guarantees asymptotic stability of the closed-loop system to the given reference as long as its optimization problem is feasible at the initial state of the system. Therefore, one of the limitations of classical MPC is that changing the reference may lead to an unfeasible MPC problem. Furthermore, due to a lack of deep knowledge of the system, it is possible for the user to provide a desired reference that is unfeasible or non-attainable for the MPC controller, leading to the same problem. This chapter summarizes MPC formulations recently proposed that have been designed to address these issues. In particular, thanks to the addition of an artificial reference as decision variable, the formulations achieve asymptotic stability and recursive feasibility guarantees regardless of the reference provided by the user, even if it is changed online or if it violates the system constraints. We show a recent formulation which extends this idea, achieving better performance and larger domains of attraction when working with small prediction horizons. Additional benefits of these formulations, when compared to classical MPC, are also discussed and highlighted with illustrative examples.


title: Preparation and observation of jammed particles with power size distribution

abstract: Several materials, such as rocks, powders and molecules, are multi-component systems. However, compared to single-component systems, it is difficult to understand the physical component. In this study, as a coarse-grained model for powders with extremely large size variations, we experimentally and numerically filled circular particles with a power size distribution and investigated their structure at the jamming transition point. In the experiment, oil in water droplets following a power size distribution were created, and then we constructed a model with steady injection and fracture to explain the size distribution. In numerical calculations, the dependence of the packing structure on the exponent of the particle size distribution was investigated. The existence of fractal structure with cutoffs was experimentally and numerically found from the structure factor. Numerical calculations show that the area fraction of rattlers is almost independent of exponent, but the number fraction is significantly dependent.


title: PRODIGE -- Planet-forming disks in Taurus with NOEMA

abstract: We aim to constrain the gas density and temperature distributions as well as gas masses in several T Tauri protoplanetary disks located in Taurus. We use the 12CO, 13CO, and C18O (2-1) isotopologue emission observed at 0.9 with the IRAM NOrthern Extended Millimeter Array (NOEMA) as part of the MPG-IRAM Observatory Program PRODIGE (PROtostars and DIsks: Global Evolution PIs: P. Caselli & Th. Henning). Our sample consists of Class II disks with no evidence of strong radial substructures. We use thesedata to constrain the thermal and chemical structure of these disks through theoretical models for gas emission. To fit the combined optically thick and thin CO line data in Fourier space, we developed the DiskCheF code, which includes the parameterized disk physical structure, machine-learning (ML) accelerated chemistry, and the RADMC-3D line radiative transfer module. A key novelty of DiskCheF is the fast and feasible ML-based chemistry trained on the extended grid of the disk physical-chemical models precomputed with the ANDES2 code. This ML approach allows complex chemical kinetics models to be included in a time-consuming disk fitting without the need to run a chemical code. We present a novel approach to incorporate chemistry into disk modeling without the need to explicitly calculate a chemical network every time. Using this new disk modeling tool, we successfully fit the 12CO, 13CO, and C18O (2-1) data from the CI, CY, DL, DM, DN, and IQ Tau disks. The combination of optically thin and optically thick CO lines allows us to simultaneously constrain the disk temperature and mass distribution, and derive the CO-based gas masses. These values are in reasonable agreement with the disk dust masses rescaled by a factor of 100 as well as with other indirect gas measurements.


title: Mixed precision iterative refinement for least squares with linear equality constraints and generalized least squares problems

abstract: Recent development on mixed precision techniques has largely enhanced the performance of various linear algebra solvers, one of which being the least squares problem $\min_{x}\lVert b-Ax\rVert_{2}$. By transforming the least squares problem into an augmented linear system, mixed precision techniques are capable of refining the lower precision solution to the working precision. In this paper, we propose mixed precision iterative refinement algorithms for two variants of the least squares problem -- the least squares problem with linear equality constraints (LSE) and the generalized least squares problem (GLS). Both classical and GMRES-based iterative refinement can be applied to augmented systems of these two problems to improve the accuracy of the solution. For reasonably well-conditioned problems our algorithms reduce the execution time by a factor of 40% in average compared to the fixed precision ones from LAPACK on the x86-64 architecture.


title: A Dual-Channel Particle Swarm Optimization Algorithm Based on Adaptive Balance Search

abstract: The balance between exploration (Er) and exploitation (Ei) determines the generalization performance of the particle swarm optimization (PSO) algorithm on different problems. Although the insufficient balance caused by global best being located near a local minimum has been widely researched, few scholars have systematically paid attention to two behaviors about personal best position (P) and global best position (G) existing in PSO. 1) P's uncontrollable-exploitation and involuntary-exploration guidance behavior. 2) G's full-time and global guidance behavior, each of which negatively affects the balance of Er and Ei. With regards to this, we firstly discuss the two behaviors, unveiling the mechanisms by which they affect the balance, and further pinpoint three key points for better balancing Er and Ei: eliminating the coupling between P and G, empowering P with controllable-exploitation and voluntary-exploration guidance behavior, controlling G's full-time and global guidance behavior. Then, we present a dual-channel PSO algorithm based on adaptive balance search (DCPSO-ABS). This algorithm entails a dual-channel framework to mitigate the interaction of P and G, aiding in regulating the behaviors of P and G, and meanwhile an adaptive balance search strategy for empowering P with voluntary-exploration and controllable-exploitation guidance behavior as well as adaptively controlling G's full-time and global guidance behavior. Finally, three kinds of experiments on 57 benchmark functions are designed to demonstrate that our proposed algorithm has stronger generalization performance than selected state-of-the-art algorithms.


title: UNICAD: A Unified Approach for Attack Detection, Noise Reduction and Novel Class Identification

abstract: As the use of Deep Neural Networks (DNNs) becomes pervasive, their vulnerability to adversarial attacks and limitations in handling unseen classes poses significant challenges. The state-of-the-art offers discrete solutions aimed to tackle individual issues covering specific adversarial attack scenarios, classification or evolving learning. However, real-world systems need to be able to detect and recover from a wide range of adversarial attacks without sacrificing classification accuracy and to flexibly act in {\bf unseen} scenarios. In this paper, UNICAD, is proposed as a novel framework that integrates a variety of techniques to provide an adaptive solution. For the targeted image classification, UNICAD achieves accurate image classification, detects unseen classes, and recovers from adversarial attacks using Prototype and Similarity-based DNNs with denoising autoencoders. Our experiments performed on the CIFAR-10 dataset highlight UNICAD's effectiveness in adversarial mitigation and unseen class classification, outperforming traditional models.


title: LOGCAN++: Local-global class-aware network for semantic segmentation of remote sensing images

abstract: Remote sensing images usually characterized by complex backgrounds, scale and orientation variations, and large intra-class variance. General semantic segmentation methods usually fail to fully investigate the above issues, and thus their performances on remote sensing image segmentation are limited. In this paper, we propose our LOGCAN++, a semantic segmentation model customized for remote sensing images, which is made up of a Global Class Awareness (GCA) module and several Local Class Awareness (LCA) modules. The GCA module captures global representations for class-level context modeling to reduce the interference of background noise. The LCA module generates local class representations as intermediate perceptual elements to indirectly associate pixels with the global class representations, targeting at dealing with the large intra-class variance problem. In particular, we introduce affine transformations in the LCA module for adaptive extraction of local class representations to effectively tolerate scale and orientation variations in remotely sensed images. Extensive experiments on three benchmark datasets show that our LOGCAN++ outperforms current mainstream general and remote sensing semantic segmentation methods and achieves a better trade-off between speed and accuracy. Code is available at https://github.com/xwmaxwma/rssegmentation.


title: Theoretical and experimental constraints on early-universe models in $F(R)$ gravity

abstract: This work investigates Early Dark Energy (EDE) scenarios as a potential precombination solution to the Hubble tension problem in the $F(R)$ gravity theory. We first develop a dimensionless quantity to visualize the density ratio between the EDE field and matter. Following existing scenarios, we then discuss conditions under which the Hubble tension could be alleviated by introducing a temporary injection of $10\%$ fractional energy around the time of matter-radiation equality between $z=10^{3}-10^{4}$. We further confront these models with local gravity tests and find inconsistencies with observations. Taking a broader view, we convert constraints from local gravity tests into constraints for general EDE in $F(R)$ gravity. We eventually arrive at a no-go theorem for $F(R)$ gravity, which restricts nontrivial modifications to General Relativity in the early universe.


title: Production of pentaquarks with hidden charm and double strangeness in $\Xi_b$ and $\Omega_b$ decays

abstract: Recently, several pentaquark states $P_{css}$, with global flavor $\bar c c s s n$, have been predicted within a theoretical framework based on unitary coupled channels. We study theoretically the feasibility to observe the $P_{css}$ with $I(J^P)=\frac{1}{2}(\frac{1}{2}^-)$ in the decays $\Xi_b^0\to \eta \eta_c \Xi^0$ and $\Omega_b^-\to K^- \eta_c \Xi^0$. Indeed, within the model, the $\eta_c \Xi^0$ channel is the lowest mass pseudoscalar-baryon channel to which this pentaquark state couples, thus we can expect to observe its signal in the $\eta_c \Xi^0$ invariant mass distribution of the mentioned decays. We identify the dominant weak decay processes and then implement the hadronization into the different meson-baryon channels in the final state, linked by flavor symmetry. The dominant meson-baryon final state interaction is then implemented to generate the full amplitude, implicitly accounting for the dynamical emergence of the pentaquark states. We obtain a clear Breit-Wigner-like resonant signal in the spectrum of the $\Omega_b^-$ decay, exceeding that in the $\Xi_b^0$ decay by two to three orders of magnitude. In the case of the latter decay, the resonant state would manifest as a significant dip in the spectrum. We study the feasibility of searching for these $b$-hadron decay modes and analysing their resonant components using the current and future data samples from the LHCb experiment.


title: $\text{Alpha}^2$: Discovering Logical Formulaic Alphas using Deep Reinforcement Learning

abstract: Alphas are pivotal in providing signals for quantitative trading. The industry highly values the discovery of formulaic alphas for their interpretability and ease of analysis, compared with the expressive yet overfitting-prone black-box alphas. In this work, we focus on discovering formulaic alphas. Prior studies on automatically generating a collection of formulaic alphas were mostly based on genetic programming (GP), which is known to suffer from the problems of being sensitive to the initial population, converting to local optima, and slow computation speed. Recent efforts employing deep reinforcement learning (DRL) for alpha discovery have not fully addressed key practical considerations such as alpha correlations and validity, which are crucial for their effectiveness. In this work, we propose a novel framework for alpha discovery using DRL by formulating the alpha discovery process as program construction. Our agent, $\text{Alpha}^2$, assembles an alpha program optimized for an evaluation metric. A search algorithm guided by DRL navigates through the search space based on value estimates for potential alpha outcomes. The evaluation metric encourages both the performance and the diversity of alphas for a better final trading strategy. Our formulation of searching alphas also brings the advantage of pre-calculation dimensional analysis, ensuring the logical soundness of alphas, and pruning the vast search space to a large extent. Empirical experiments on real-world stock markets demonstrates $\text{Alpha}^2$'s capability to identify a diverse set of logical and effective alphas, which significantly improves the performance of the final trading strategy. The code of our method is available at https://github.com/x35f/alpha2.